CN102289510A - Method and device for writing data to production volume - Google Patents
Method and device for writing data to production volume Download PDFInfo
- Publication number
- CN102289510A CN102289510A CN201110255006XA CN201110255006A CN102289510A CN 102289510 A CN102289510 A CN 102289510A CN 201110255006X A CN201110255006X A CN 201110255006XA CN 201110255006 A CN201110255006 A CN 201110255006A CN 102289510 A CN102289510 A CN 102289510A
- Authority
- CN
- China
- Prior art keywords
- data
- written
- data block
- copy
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
Abstract
The embodiment of the invention provides a method and device for writing data to a production volume. The method for writing the data to the production volume comprises the following steps of: receiving a data operation request carrying data to be written and the initial address and the length of the data to be written; when copy-on-write is not carried out in a target region of the data to be written in the production volume, determining data blocks in the need of performing the copy-on-write according to the initial address and the length of the data to be written and the preset storage granularity; performing the copy-on-write on the data blocks in the need of performing the copy-on-write, and generating mapping marks corresponding to the data blocks; and writing the data to be written to the data blocks after performing the copy-on-write. According to the method and device disclosed by the invention, the sizes of practical data blocks on the production volume corresponding to the mapping marks can be dynamically adjusted; the system performance is increased; and resource pool resources is saved.
Description
Technical field
The embodiment of the invention relates to communication technical field, relates in particular to a kind of to producing the method and apparatus that volume writes data.
Background technology
Along with the continuous development of information science technology and the widespread use of the Internet, the data volume that produces is with incredible speed rapid growth, the design of storage system becomes the problem that the application system design needs consideration gradually, professional progress is also had higher requirement at aspects such as availability, reliability and extensibilities to the data treatment technology, while also vigorously advocating green storage, therefore also has higher requirement to distribution of storage system reasonable resources and utilization.The demand of data protection on the one hand,, data backup and data parallel utilization (as test, report generation and/or data analysis etc.) seems more and more important; On the other hand, the running that the online commerce pattern requires system not stop, shutdown then means losing of professional pause and commercial opportunity.Thus, the data snapshot technology is arisen at the historic moment.
Snapshot is that data object is produced available copy fully, comprises this data object at sometime reflection.Utilize the data snapshot technology, can obtain the consistance reflection (being snapshot) in the instant moment of available fully production volume data in moment, and take less storage space; Behind the snapshot creation, can carry out simultaneously with the visit that production is rolled up the visit of snapshot, thereby not influence the business continuance of producing volume.Wherein, produce volume, be also referred to as source logical unit number (Logic Unit Number; Hereinafter to be referred as: LUN) or the source physical volume, be to use the volume that data storage and addressing space are provided, be deployed in the storage array for the basic service of storage system.
When creating snapshot, need set up a snapshot logic copy constantly, promptly generate a mapping table, the deposit position of the real data of indication snapshot correspondence.When snapshot had just been created, the pointer in the mapping table all points to be produced in the volume, the corresponding actual blocks of data of producing on the volume of each record in the mapping table.
In the time will involving in the row modification to production, need then to judge earlier whether wait to revise partial data had made to write preceding copy (Copy-On-Write), do not write preceding copy if do, then need to write earlier preceding copy, be about to partial data to be revised and copy to resource pool, and the modification mapping table, make the relevant position in the pointed resource pool, and then production is involved in row revise; Done and write preceding copy if wait to revise partial data, then can directly revise this partial data of producing volume.If produce volume a plurality of snapshots are arranged, then before production being involved in the row modification, need carry out foregoing judgement, and determine whether to write preceding copy, just can involve in row then and revise production according to judged result to the map information of each snapshot.Wherein, resource pool is used to deposit the data that production is rolled up that are different from of snapshot, comprises and writes the preceding copies data of writing that produces when producing volume, and resource pool and production volume are deployed in the same storage array.
The data snapshot technology is ensureing under the prerequisite of business continuance, has produced the data consistency reflection that data object is carved at a time, to a certain extent powerful guarantee the reliability and the integrality of data.But, because the production of the map tag correspondence in mapping table volume is gone up the size of actual blocks of data and is fixed, therefore exist and reduce system performance and waste resource pool problem of resource, and after the long-time read-write, map tag stochastic distribution in the mapping table, so when reading and writing snapshot or production volume, need carry out repeatedly being redirected, and the position of redirected correspondence is at random at every turn, readwrite performance will greatly descend.
Summary of the invention
The embodiment of the invention provides a kind of and rolls up the size that goes up actual blocks of data to producing the method and apparatus that volume writes data to realize the production of dynamically adjusting the map tag correspondence, improves the system performance and the Pooled resources that economizes on resources.
The embodiment of the invention provides a kind of and rolls up the method that writes data to producing, and comprising:
Receive data operation request, described data operation request is carried data to be written, and the start address of described data to be written and length;
Before the target area that produces data to be written described in the volume did not carry out writing during copy, according to start address, length and the predefined storage granularity of described data to be written determine needs write before the data block of copy;
Described needs are write the data block of preceding copy and write preceding copy, and the generation map tag corresponding with described data block;
Described data to be written are write preceding copy data block afterwards.
It is a kind of to producing the device that volume writes data that the embodiment of the invention also provides, and comprising:
Receiver module is used to receive data operation request, and described data operation request is carried data to be written, and the start address of described data to be written and length;
Determination module was used for when preceding copy was not carried out writing in the target area of data to be written described in the described production volume, determined the data block that copies before needs are write according to start address, length and the predefined storage granularity of described data to be written;
Generation module is used for that the needs that described determination module is determined are write the preceding data block that copies and writes preceding copy, and the generation map tag corresponding with described data block;
Writing module is used for the data to be written that described receiver module receives are write preceding copy data block afterwards.
Pass through the embodiment of the invention, receive after the data to be written, before the target area of data to be written did not carry out writing in producing volume during copy, according to start address, length and the predefined storage granularity of data to be written determine needs write before the data block of copy; Above-mentioned needs are write the data block of preceding copy and write preceding copy, and the generation map tag corresponding with above-mentioned data block; Data to be written are write preceding copy data block afterwards.Thereby the production volume that can realize dynamically adjusting the map tag correspondence is gone up the size of actual blocks of data, improves the system performance and the Pooled resources that economizes on resources.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do one to the accompanying drawing of required use in embodiment or the description of the Prior Art below introduces simply, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 writes the process flow diagram of an embodiment of method of data to the production volume for the present invention;
Fig. 2 writes the process flow diagram of another embodiment of method of data to the production volume for the present invention;
Fig. 3 is the synoptic diagram of an embodiment of data writing process of the present invention;
Fig. 4 is the synoptic diagram of another embodiment of data writing process of the present invention;
Fig. 5 is the synoptic diagram of another embodiment of data writing process of the present invention;
The synoptic diagram of the embodiment of map tag that Fig. 6 is continuous for the present invention merges;
Fig. 7 writes the structural representation of an embodiment of device of data to the production volume for the present invention;
Fig. 8 writes the structural representation of another embodiment of device of data to the production volume for the present invention.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention clearer, below in conjunction with the accompanying drawing in the embodiment of the invention, technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills are obtained under the prerequisite of not making creative work belongs to the scope of protection of the invention.
Fig. 1 for the present invention to producing the process flow diagram that volume writes an embodiment of method of data, as shown in Figure 1, this can comprise to producing the method that volume writes data:
Particularly, according to start address, length and the predefined storage granularity of above-mentioned data to be written determine needs write before copy data block can for: the storage array of producing the volume place according to the length of above-mentioned data to be written and predefined storage granularity determine needs write before the size of data block of copy, and before writing according to the start address of above-mentioned data to be written and above-mentioned needs the size of the data block of copy determine above-mentioned needs write before the position of data block of copy.
In the present embodiment, above-mentioned predefined storage granularity can for: before need writing the size of data block of copy be predefined storage granularity minimum value 2 power power doubly; The minimum value of above-mentioned predefined storage granularity be 2 power power doubly, for example: minimum input and output (the Input Output that can be the visit disk; Hereinafter to be referred as: IO) granularity, the i.e. size of a sector.
Wherein, map tag is used to write down the relevant information of the data block of writing preceding copy, for the further instruction map tag, for instance, the library preservation books are if borrow, can remove to search corresponding books by the call number of record, here, map tag just can be understood as call number, and the data block of copy just can be understood as books before writing.In addition, map tag can also be for pointer etc., and the embodiment of the invention does not limit the form of map tag, if map tag can write down write before the relevant information of data block of copy.
Further, after the data block before above-mentioned data to be written are successfully write after the copy, the storage array of producing the volume place returns the write operation success response; Perhaps, after the data block failure before above-mentioned data to be written are write after the copy, return the write operation failure response.
In addition, in the present embodiment, when in producing volume, existing at least one to carry out writing the data block of preceding copy in the data block that the target area covered of above-mentioned data to be written, the storage array of producing the volume place is according to the above-mentioned quantity of carrying out writing the preceding data block that copies, above-mentioned carried out writing before the size of data block of copy and the size of above-mentioned target area, data to be written are split as one section data segment to be written, perhaps according to the above-mentioned quantity of carrying out writing the preceding data block that copies, the above-mentioned size of carrying out writing the preceding data block that copies, above-mentioned carried out writing before the data block of copy in the target area the position and the big young pathbreaker data to be written of above-mentioned target area be split as at least two sections data segments to be written.Wherein, the size of this target area is the length of data to be written.
For instance, the data block of copy before in producing volume, only existing one to carry out writing in the data block that the target area covered of above-mentioned data to be written, and before this carried out writing during the size of the data block of copy and above-mentioned target area big or small identical, only need above-mentioned data to be written are split as one section data segment to be written, at this moment also be equivalent to above-mentioned data to be written not split.
The data block of copy before in producing volume, only existing one to carry out writing in the data block that the target area covered of above-mentioned data to be written, and when the data block of copy was less than above-mentioned target area big or small before this carried out writing, if the data block of copy was positioned at the endpoint location of above-mentioned target area before this carried out writing, then above-mentioned data to be written can be split as at least two sections data segments to be written; If the data block of copy was positioned at the middle part of above-mentioned target area before this carried out writing, then need above-mentioned data to be written are split as at least three sections data segments to be written.
For example: the target area of supposing data to be written has covered 3 data blocks, is followed successively by data block 1, data block 2 and data block 3; If data block 1 or data block 3 carried out writing preceding copy, the data block of copy was positioned at the endpoint location of above-mentioned target area before promptly carrying out writing, then data to be written being split as two sections data segments to be written gets final product, the target area of one section data segment to be written after the fractionation is data block 1 or data block 3, and the target area of section data segment to be written of another after the fractionation is two blocks of data pieces except that data block 1 or data block 3; If data block 2 carried out writing preceding copy, the data block of copy was positioned at the middle part of above-mentioned target area before promptly carrying out writing, then need data to be written are split as three sections data segments to be written, the target area of one section data segment to be written after the fractionation is a data block 1, the target area of section data segment to be written of another after the fractionation is a data block 2, and the target area of the one section data segment to be written again after the fractionation is a data block 3.
The data block of copy be example to the fractionation mode of data to be written is that example describes before only existing one to carry out writing in the data block that the target area was covered of present embodiment with above-mentioned data to be written, when existing two or more to carry out writing the data block of preceding copy in the data block that the target area covered of data to be written, the fractionation mode of data to be written and last similar, do not repeat them here, in simple terms, to make at least two sections data segments to be written that split the back acquisition form two groups exactly, the data block of copy before the target area of one group of data segment to be written only covers and carried out writing, the data block of copy before another target area of organizing data segment to be written only covers and do not carry out writing.
Then, the storage array of producing the volume place judges whether every section data segment to be written data block that the target area covered to be written carried out writing preceding copy in above-mentioned at least two sections data segments to be written;
The data segment to be written of copy before not carrying out writing for the data block that the target area covered to be written, above-mentioned storage array according to start address, length and the predefined storage granularity of above-mentioned data segment to be written determine needs write before the data block of copy; Above-mentioned needs are write the data block of preceding copy and write preceding copy, and generate the map tag corresponding with this data block; At last, the data in the above-mentioned data segment to be written are write preceding copy data block afterwards.
Carried out writing the preceding data segment to be written that copies for the data block that the target area covered to be written, the data in the above-mentioned data segment to be written were write the above-mentioned data segment to be written data block that the target area covered to be written.
Further, after above-mentioned at least two sections data segments to be written all write success, above-mentioned storage array returned the write operation success response; Perhaps, after at least one section data segment to be written write failure in above-mentioned at least two sections data segments to be written, above-mentioned storage array returned the write operation failure response.
In the present embodiment, after the step 104, the storage array of producing the volume place can also detect the data block of map tag correspondence, and the map tag of continuous data block correspondence is physically merged into a map tag; Thereby can reduce the consumption of memory source, the elevator system performance.For instance, after the storage array of producing the volume place detects the data block of map tag correspondence, find map tag 1 corresponding data piece 1, map tag 3 corresponding data pieces 2, the physical address of tentation data piece 1 region is 0～9, the physical address of data block 2 regions is 10～19, and then data block 1 and data block 2 are continuous data block physically, therefore the map tag 1 of data block 1 correspondence and the map tag 3 of data block 2 correspondences can be merged into a map tag.
The production volume that the foregoing description can realize dynamically adjusting the map tag correspondence is gone up the size of actual blocks of data, improves the system performance and the Pooled resources that economizes on resources; And the foregoing description support merges continuous map tag, thereby can reduce the consumption of memory source, the elevator system performance.
Fig. 2 for the present invention to producing the process flow diagram that volume writes another embodiment of method of data, as shown in Figure 2, this can comprise to producing the method that volume writes data:
Step 201, the storage array of producing the volume place receives data operation request, and this data operation request is carried data to be written, and the start address of above-mentioned data to be written and length.
Particularly, produce volume, be also referred to as source LUN, can be kept in the mapping table in the internal memory of main frame, producing volume when storage array normally moves is to read and write in internal memory, finally can be saved on the storage array behind the electricity under the system.
Judge whether exist in the mapping table with this production volume in the corresponding map tag of the data block that the target area covered of above-mentioned data to be written; If there is not the corresponding map tag of data block that is covered with above-mentioned target area in the mapping table, can determine that then the target area that produces above-mentioned data to be written in the volume do not carry out writing preceding copy; If there is the corresponding map tag of at least one data block that is covered with above-mentioned target area in the mapping table, then can determine to produce the data block that copies before existing at least one to carry out writing in the data block that the target area covered of above-mentioned data to be written in the volume.
Concrete, above-mentioned storage array can according to the length of above-mentioned data to be written and predefined storage granularity determine needs write before the size of data block of copy, and before writing according to the start address of above-mentioned data to be written and above-mentioned needs the size of the data block of copy determine above-mentioned needs write before the position of data block of copy.
In the present embodiment, above-mentioned predefined storage granularity can for: before need writing the size of data block of copy be predefined storage granularity minimum value 2 power power doubly; The minimum value of above-mentioned predefined storage granularity be 2 power power doubly, for example: can be the minimum IO granularity of visit disk, the i.e. size of a sector.
Further, the map tag that generates can be recorded in the above-mentioned mapping table.
For instance, the data block of copy before in producing volume, only existing one to carry out writing in the data block that the target area covered of above-mentioned data to be written, and before this carried out writing during the size of the data block of copy and above-mentioned target area big or small identical, only need above-mentioned data to be written are split as one section data segment to be written, at this moment also be equivalent to above-mentioned data to be written not split; The data block of copy before in producing volume, only existing one to carry out writing in the data block that the target area covered of above-mentioned data to be written, and when the size of the data block of copy was less than above-mentioned target area big or small before this carried out writing, if the data block of copy was positioned at the endpoint location of above-mentioned target area before this carried out writing, then above-mentioned data to be written can be split as at least two sections data segments to be written; If the data block of copy was positioned at the middle part of above-mentioned target area before this carried out writing, then need above-mentioned data to be written are split as at least three sections data segments to be written; For example: the target area of supposing data to be written has covered 3 data blocks, is followed successively by data block 1, data block 2 and data block 3; If data block 1 or data block 3 carried out writing preceding copy, the data block of copy was positioned at the endpoint location of above-mentioned target area before promptly carrying out writing, then data to be written being split as two sections data segments to be written gets final product, the target area cover data piece 1 or the data block 3 of one section data segment to be written after the fractionation, the target area of section data segment to be written of another after the fractionation covers two blocks of data pieces except that data block 1 or data block 3; If data block 2 carried out writing preceding copy, the data block of copy was positioned at the middle part of above-mentioned target area before promptly carrying out writing, then need data to be written are split as three sections data segments to be written, the target area cover data piece 1 of one section data segment to be written after the fractionation, the target area cover data piece 2 of section data segment to be written of another after the fractionation, the target area cover data piece 3 of the one section data segment to be written again after the fractionation.
The data block of copy be example to the fractionation mode of data to be written is that example describes before only existing one to carry out writing in the data block that the target area was covered of present embodiment with above-mentioned data to be written, when existing two or more to carry out writing the data block of preceding copy in the data block that the target area covered of data to be written, the fractionation mode of data to be written and last similar, do not repeat them here, in simple terms, to make at least two sections data segments to be written that split the back acquisition form two groups exactly, the data block of copy before the target area of one group of data segment to be written only covers and carried out writing, the data block of copy before another target area of organizing data segment to be written only covers and do not carry out writing.
Step 207 judges whether every section data segment to be written data block that the target area covered to be written carried out writing preceding copy at least two sections data segments to be written.Carried out writing the preceding data segment to be written that copies, execution in step 208 for the data block that the target area covered to be written; Do not carry out writing the preceding data segment to be written that copies, execution in step 209 for the data block that the target area covered to be written.
Wherein, whether before carrying out writing the mode that provides in the step 202 was provided the judgment mode of copy, did not repeat them here.
Step 209, the storage array of producing the volume place according to start address, length and the predefined storage granularity of above-mentioned data segment to be written determine needs write before the data block of copy; Above-mentioned needs are write the data block of preceding copy and write preceding copy, and the generation map tag corresponding with above-mentioned data block; Data in the above-mentioned data segment to be written are write preceding copy data block afterwards; Execution in step 210 then.
Particularly, above-mentioned storage array determines that according to start address, length and the predefined storage granularity of above-mentioned data segment to be written the mode that provides in mode and the step 203 of data block of copy before needs are write is identical, does not repeat them here.
Step 210 judges whether data to be written carried out fractionation.If then execution in step 211, if data to be written were not carried out fractionation, then execution in step 212.
Particularly, can after data to be written are split, split sign, be used for representing that the data of this data segment to be written are to split the data to be written that the back obtains for the data segment to be written after splitting is provided with.Like this, split sign as long as detect whether to exist in the data to be written, split sign if exist, data then to be written were carried out fractionation, if there is no split sign, and data then to be written were not carried out fractionation.Certainly, this judges just whether data to be written carried out a kind of mode that splits, and the embodiment of the invention is not limited in this, and the embodiment of the invention does not limit judging the mode whether data to be written carried out splitting.
In the present embodiment, the storage array of producing the volume place can also detect the data block of map tag correspondence, and the map tag of continuous data block correspondence is physically merged into a map tag; Thereby can reduce the consumption of memory source, the elevator system performance.For instance, after above-mentioned storage array detects the data block of map tag correspondence, find map tag 1 corresponding data piece 1, map tag 3 corresponding data pieces 2, the physical address of tentation data piece 1 region is 0～9, the physical address of data block 2 regions is 10～19, and then data block 1 and data block 2 are continuous data block physically, therefore the map tag 1 of data block 1 correspondence and the map tag 3 of data block 2 correspondences can be merged into a map tag.
The production volume that the foregoing description can realize dynamically adjusting the map tag correspondence is gone up the size of actual blocks of data, improves the system performance and the Pooled resources that economizes on resources; And the foregoing description support merges continuous map tag, thereby can reduce the consumption of memory source, the elevator system performance.
Be IO below with the data operation request, the minimum value of predefined storage granularity for 1KB for example to describing that the embodiment of the invention provides to producing the method that volume writes data.
Scene one, the storage array of producing the volume place receives the IO1 that main frame sends, size is 4KB, suppose that this production volume did not upward carry out writing preceding copy in IO1 target area to be written, since the size of IO1 be 22 powers doubly, therefore the size of the data block of copy is 4KB before can determining to need in the above-mentioned target area to write, 4KB copying data before directly needs being write in the data block of copy is to resource pool, and the generation map tag corresponding with above-mentioned data block, and the map tag that generates recorded in the mapping table, data block before then the data to be written among the IO1 being write after the copy, as shown in Figure 3, Fig. 3 is the synoptic diagram of an embodiment of data writing process of the present invention.
Scene two, the storage array of producing the volume place receives IO2, size is 1.5KB, suppose that this production volume did not upward carry out writing preceding copy in IO2 target area to be written, since the size of IO2 be not 2 power power doubly, therefore according to size and the predefined storage granularity of IO2, the size of the data block of copy is 2KB before can determining to write, 2KB copying data before above-mentioned then storage array is write needs in the data block of copy is to resource pool, and the generation map tag corresponding with above-mentioned data block, and the map tag that generates recorded in the mapping table, data block before then the data to be written among the IO2 being write after the copy, as shown in Figure 4, Fig. 4 is the synoptic diagram of another embodiment of data writing process of the present invention.The zone of size for not covered by IO2 in the preceding data block that copies of writing of 2KB represented in the shadow region among Fig. 4.
Scene three, the storage array of producing the volume place receives IO3, size is 1.5MB, supposing to produce volume upward has part to carry out writing preceding copy in IO3 target area to be written, generated map tag, need split into IO3 at least two little IO this moment, the method that provides according to the embodiment of the invention at each IO after the splitting size of coming the specified data piece again, as shown in Figure 5, produce volume and go up IO3 target area cover data piece 1～4 to be written, wherein data block 2 and data block 3 had carried out writing preceding copy, because data block 2 and data block 3 are positioned at the centre position of above-mentioned target area, therefore IO3 need be split as 3 IO, be designated as IO3-1 respectively, IO3-2 and IO3-3.
Wherein, the IO3-2 data block that the target area covered to be written is data block 2 and data block 3, because data block 2 and data block 3 had carried out writing preceding copy, therefore directly the data among the IO3-2 is write the production volume and gets final product; The IO3-1 data block that the target area covered to be written is a data block 1, the IO3-3 data block that the target area covered to be written is a data block 4, tentation data piece 1, data block 2, data block 3, the size of data block 4 is respectively 256KB, 512KB, 512KB and 256KB, therefore need respectively copying data with 256KB size on data block 1 and the data block 4 to resource pool, and generate respectively the map tag corresponding with above-mentioned data block 1 and data block 4, and the map tag that generates recorded in the mapping table, data block 1 and data block 4 before respectively the data to be written among IO3-1 and the IO3-3 being write then after the copy, as shown in Figure 5, Fig. 5 is the synoptic diagram of another embodiment of data writing process of the present invention.
The scene that above-mentioned scene one and scene two are revised for the small data piece, for example, the business scenario that small data pieces such as depositor's document data base modification of bank are revised, scene three are the scene that big data block is revised, for example: the business scenario that big data blocks such as modification of website picture and video library application are revised.In sum, what the embodiment of the invention provided can dynamically adjust the snapshot data block size according to the application of practical business to producing the method that volume writes data, can reasonable distribution and utilize the storage system resource, make memory source and resource pool resource consumption optimum.
Further, in the embodiment of the invention, the storage array of producing the volume place can also detect the data block of map tag correspondence, and the map tag of continuous data block correspondence is physically merged into a map tag; Thereby can reduce the consumption of memory source, the elevator system performance.The synoptic diagram of the embodiment of map tag that Fig. 6 is continuous for the present invention merges, as shown in Figure 6, data block 1, data block 2, data block 3 and data block 4 are continuous data block physically, the map tag of data block 1, data block 2, data block 3 and data block 4 correspondences can be merged into 1 map tag.
The embodiment of the invention provide to produce volume write the method for data can reasonable distribution and utilize the storage system resource, reduce the consumption of memory source and resource pool resource, and support map tag to merge, can promote the performance of reading of storage system, what the embodiment of the invention provided is not only applicable to virtual snapshot to producing the method that volume writes data, suitable equally to duplication services such as Clone mirror picture, remote copy and LUN copies.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of programmed instruction, aforesaid program can be stored in the computer read/write memory medium, this program is carried out the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
Fig. 7 for the present invention to producing the structural representation that volume writes an embodiment of device of data, can be used as the part of storage array or storage array to producing device that volume writes data in the present embodiment, realize the present invention's flow process embodiment illustrated in fig. 1.As shown in Figure 7, this can comprise to the device that the production volume writes data: receiver module 71, determination module 72, generation module 73 and writing module 74.
Wherein, receiver module 71 is used to receive data operation request, and this data operation request is carried data to be written, and the start address of above-mentioned data to be written and length.
Above-mentionedly the size that the production volume of map tag correspondence is gone up actual blocks of data be can realize dynamically adjusting, the system performance and the Pooled resources that economizes on resources improved to producing device that volume writes data.
Fig. 8 writes the structural representation of another embodiment of device of data to the production volume for the present invention, can be used as storage array to producing the device that volume writes data in the present embodiment, or the part of storage array realizes the flow process of the present invention embodiment illustrated in figures 1 and 2.Compare to producing the device that volume writes data with shown in Figure 7, difference is, shown in Figure 8 can also comprise to producing the device that volume writes data: split that module 75, judge module 76, first response are returned module 77, second response is returned module 78 and merged module 79.
Wherein, split module 75, when being used for the data block of copy before existing at least one to carry out writing in the data block that the target area covered of the above-mentioned data to be written of above-mentioned production volume, according to the above-mentioned quantity of carrying out writing the preceding data block that copies, above-mentioned carried out writing before the size of data block of copy and the size of above-mentioned target area, data to be written are split as one section data segment to be written, perhaps according to the above-mentioned quantity of carrying out writing the preceding data block that copies, the above-mentioned size of carrying out writing the preceding data block that copies, above-mentioned carried out writing before the data block of copy in the target area the position and the big young pathbreaker data to be written of above-mentioned target area be split as at least two sections data segments to be written, make at least two sections data segments to be written that split the back acquisition form two groups, the data block of copy before the target area of one group of data segment to be written only covers and carried out writing, the data block of copy before another target area of organizing data segment to be written only covers and do not carry out writing.Wherein, the size of this target area is the length of data to be written.
Judge module 76 is used for judging whether every section data segment to be written of at least two sections data segments to be written data block that the target area covered to be written carried out writing preceding copy.
In the present embodiment, when copy before determination module 72 can also be worked as the data segment to be written data block that the target area covered to be written and do not carried out writing, according to start address, length and the predefined storage granularity of above-mentioned data segment to be written determine needs write before the data block of copy; The data block of copy was write preceding copy before generation module 73 can also be write the needs that above-mentioned determination module 72 is determined then, and the generation map tag corresponding with above-mentioned data block; Data block before writing module 74 can also write the data in the above-mentioned data segment to be written after the copy; And when the data segment to be written data block that the target area covered to be written carried out writing preceding copy, the data in this data segment to be written are write this data segment to be written data block that the target area covered to be written.
Module 77 is returned in first response, is used for returning the write operation success response after above-mentioned at least two sections data segments to be written all write success; Perhaps, after at least one section data segment to be written writes failure in above-mentioned at least two sections data segments to be written, return the write operation failure response.
Module 78 is returned in second response, is used for after the data block after the copy, returning the write operation success response before data to be written are successfully write; Perhaps, after the data block failure before data to be written are write after the copy, return the write operation failure response.
Merge module 79, be used for the data block of map tag correspondence is detected, the map tag of continuous data block correspondence is physically merged into a map tag.
Above-mentionedly the size that the production volume of map tag correspondence is gone up actual blocks of data be can realize dynamically adjusting, the system performance and the Pooled resources that economizes on resources improved to producing device that volume writes data; And the foregoing description support merges continuous map tag, thereby can reduce the consumption of memory source, the elevator system performance.
It will be appreciated by those skilled in the art that accompanying drawing is the synoptic diagram of a preferred embodiment, module in the accompanying drawing or flow process might not be that enforcement the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
It should be noted that at last: above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (10)
1. one kind writes the method for data to producing volume, it is characterized in that, comprising:
Receive data operation request, described data operation request is carried data to be written, and the start address of described data to be written and length;
Before the target area that produces data to be written described in the volume did not carry out writing during copy, according to start address, length and the predefined storage granularity of described data to be written determine needs write before the data block of copy;
Described needs are write the data block of preceding copy and write preceding copy, and the generation map tag corresponding with described data block;
Described data to be written are write preceding copy data block afterwards.
2. method according to claim 1 is characterized in that, described start address according to described data to be written, length and predefined storage granularity determine that the data block that copies before needs are write comprises:
According to the length and the predefined storage granularity of described data to be written, the size of the data block of copy before determining to write;
The size of the data block of copy before writing according to the start address of described data to be written and described needs, determine described needs write before the position of data block of copy.
3. method according to claim 1 is characterized in that, also comprises:
When existence was carried out writing the data block of preceding copy in the data block that the target area covered of data to be written described in the described production volume, according to the described quantity of carrying out writing the preceding data block that copies, described carried out writing before the size of data block of copy and the size of described target area, described data to be written are split as one section data segment to be written, perhaps according to the described quantity of carrying out writing the preceding data block that copies, the described size of carrying out writing the preceding data block that copies, described carried out writing before the data block of copy in described target area the position and the described data to be written of big young pathbreaker of described target area be split as at least two sections data segments to be written, make at least two sections data segments to be written that split the back acquisition form two groups, the data block of copy before the target area of one group of data segment to be written only covers and carried out writing, the data block of copy before another target area of organizing data segment to be written only covers and do not carry out writing.
4. method according to claim 3 is characterized in that, described described data to be written is split as after two sections data segments to be written at least, also comprises:
Judge whether every section data segment to be written data block that the target area covered to be written carried out writing preceding copy in described at least two sections data segments to be written;
Do not carry out writing the preceding data segment to be written that copies for the data block that the target area covered to be written, determined the data block that copies before needs are write according to start address, length and the predefined storage granularity of described data segment to be written; Described needs are write the data block of preceding copy and write preceding copy, and the generation map tag corresponding with described data block; Data in the described data segment to be written are write preceding copy data block afterwards;
Carried out writing the preceding data segment to be written that copies for the data block that the target area covered to be written, the data in the described data segment to be written were write the described data segment to be written data block that the target area covered to be written.
5. according to any described method of claim 1-4, it is characterized in that, described with described data to be written write before the copy after data block after, also comprise:
Data block to the map tag correspondence detects, and the map tag of continuous data block correspondence is physically merged into a map tag.
6. one kind to producing the device that volume writes data, it is characterized in that, comprising:
Receiver module is used to receive data operation request, and described data operation request is carried data to be written, and the start address of described data to be written and length;
Determination module was used for when preceding copy was not carried out writing in the target area of data to be written described in the described production volume, determined the data block that copies before needs are write according to start address, length and the predefined storage granularity of described data to be written;
Generation module is used for that the needs that described determination module is determined are write the preceding data block that copies and writes preceding copy, and the generation map tag corresponding with described data block;
Writing module is used for the data to be written that described receiver module receives are write preceding copy data block afterwards.
7. device according to claim 6 is characterized in that,
Described determination module, specifically be used for according to the length of described data to be written and predefined storage granularity determine needs write before the size of data block of copy, and before writing according to the start address of described data to be written and described needs the size of the data block of copy determine described needs write before the position of data block of copy.
8. device according to claim 6 is characterized in that, also comprises:
Split module, when being used for the data block of copy before the data block that the target area the covered existence of data to be written described in the described production volume was carried out writing, according to the described quantity of carrying out writing the preceding data block that copies, described carried out writing before the size of data block of copy and the size of described target area, described data to be written are split as one section data segment to be written, perhaps according to the described quantity of carrying out writing the preceding data block that copies, the described size of carrying out writing the preceding data block that copies, described carried out writing before the data block of copy in described target area the position and the described data to be written of big young pathbreaker of described target area be split as at least two sections data segments to be written, make at least two sections data segments to be written that split the back acquisition form two groups, the data block of copy before the target area of one group of data segment to be written only covers and carried out writing, the data block of copy before another target area of organizing data segment to be written only covers and do not carry out writing.
9. device according to claim 8 is characterized in that, also comprises:
Judge module is used for judging whether every section data segment to be written of described at least two sections data segments to be written data block that the target area covered to be written carried out writing preceding copy;
Described determination module, also be used for when the described data segment to be written data block that the target area covered to be written did not carry out writing preceding copy, determine the data block that copies before needs are write according to start address, length and the predefined storage granularity of described data segment to be written;
Described generation module is used for that also the needs that described determination module is determined are write the preceding data block that copies and writes preceding copy, and the generation map tag corresponding with described data block;
The said write module also is used for the data of described data segment to be written are write preceding copy data block afterwards; And when the described data segment to be written data block that the target area covered to be written carried out writing preceding copy, the data in the described data segment to be written are write the described data segment to be written data block that the target area covered to be written.
10. according to any described device of claim 6-9, it is characterized in that, also comprise:
Merge module, be used for the data block of map tag correspondence is detected, the map tag of continuous data block correspondence is physically merged into a map tag.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110255006.XA CN102289510B (en) | 2011-08-31 | 2011-08-31 | Method and device for writing data to production volume |
| PCT/CN2012/078662 WO2013029434A1 (en) | 2011-08-31 | 2012-07-14 | Method and device for writing data into production volume |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110255006.XA CN102289510B (en) | 2011-08-31 | 2011-08-31 | Method and device for writing data to production volume |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102289510A true CN102289510A (en) | 2011-12-21 |
| CN102289510B CN102289510B (en) | 2013-10-09 |
Family
ID=45335936
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110255006.XA Active CN102289510B (en) | 2011-08-31 | 2011-08-31 | Method and device for writing data to production volume |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102289510B (en) |
| WO (1) | WO2013029434A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013029434A1 (en) * | 2011-08-31 | 2013-03-07 | 华为数字技术（成都）有限公司 | Method and device for writing data into production volume |
| WO2013149524A1 (en) * | 2012-04-01 | 2013-10-10 | 华为技术有限公司 | Method and system for writing data |
| CN103842954A (en) * | 2013-12-05 | 2014-06-04 | 华为技术有限公司 | Data processing method, device and system in storage system |
| CN103955413A (en) * | 2014-04-11 | 2014-07-30 | 重庆纳跃信息科技有限公司 | File snapshot reduction method based on file local modification |
| CN104407933A (en) * | 2014-10-31 | 2015-03-11 | 华为技术有限公司 | Data backup method and device |
| CN104407936A (en) * | 2014-11-18 | 2015-03-11 | 华为数字技术（成都）有限公司 | Data snapshot method and device |
| CN107357928A (en) * | 2017-07-26 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of method and system for realizing storage snapshot |
| CN107608825A (en) * | 2017-09-19 | 2018-01-19 | 杭州宏杉科技股份有限公司 | A kind of method and device of cloud backup snapshot data |
| CN111399774A (en) * | 2020-03-09 | 2020-07-10 | 星辰天合（北京）数据科技有限公司 | Data processing method and device based on snapshot under distributed storage system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7206961B1 (en) * | 2002-09-30 | 2007-04-17 | Emc Corporation | Preserving snapshots during disk-based restore |
| CN101477447A (en) * | 2009-01-21 | 2009-07-08 | 杭州华三通信技术有限公司 | Disk snap method and apparatus |
| CN101482838A (en) * | 2009-02-06 | 2009-07-15 | 杭州华三通信技术有限公司 | Data write-in method and apparatus based on copy-on-write |
| CN101840362A (en) * | 2009-10-28 | 2010-09-22 | 创新科存储技术有限公司 | Method and device for achieving copy-on-write snapshot |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101819543A (en) * | 2010-02-01 | 2010-09-01 | 成都市华为赛门铁克科技有限公司 | Snapshot data processing method, system and storage device |
| CN102289510B (en) * | 2011-08-31 | 2013-10-09 | 华为数字技术（成都）有限公司 | Method and device for writing data to production volume |
-
2011
- 2011-08-31 CN CN201110255006.XA patent/CN102289510B/en active Active
-
2012
- 2012-07-14 WO PCT/CN2012/078662 patent/WO2013029434A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7206961B1 (en) * | 2002-09-30 | 2007-04-17 | Emc Corporation | Preserving snapshots during disk-based restore |
| CN101477447A (en) * | 2009-01-21 | 2009-07-08 | 杭州华三通信技术有限公司 | Disk snap method and apparatus |
| CN101482838A (en) * | 2009-02-06 | 2009-07-15 | 杭州华三通信技术有限公司 | Data write-in method and apparatus based on copy-on-write |
| CN101840362A (en) * | 2009-10-28 | 2010-09-22 | 创新科存储技术有限公司 | Method and device for achieving copy-on-write snapshot |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013029434A1 (en) * | 2011-08-31 | 2013-03-07 | 华为数字技术（成都）有限公司 | Method and device for writing data into production volume |
| WO2013149524A1 (en) * | 2012-04-01 | 2013-10-10 | 华为技术有限公司 | Method and system for writing data |
| CN103842954B (en) * | 2013-12-05 | 2017-02-15 | 华为技术有限公司 | Data processing method, device, system and server in storage system |
| CN103842954A (en) * | 2013-12-05 | 2014-06-04 | 华为技术有限公司 | Data processing method, device and system in storage system |
| CN103955413A (en) * | 2014-04-11 | 2014-07-30 | 重庆纳跃信息科技有限公司 | File snapshot reduction method based on file local modification |
| CN104407933A (en) * | 2014-10-31 | 2015-03-11 | 华为技术有限公司 | Data backup method and device |
| CN104407933B (en) * | 2014-10-31 | 2018-10-02 | 华为技术有限公司 | A kind of backup method and device of data |
| CN104407936A (en) * | 2014-11-18 | 2015-03-11 | 华为数字技术（成都）有限公司 | Data snapshot method and device |
| CN104407936B (en) * | 2014-11-18 | 2017-08-18 | 华为数字技术（成都）有限公司 | A kind of data snapshot method and device |
| CN107357928A (en) * | 2017-07-26 | 2017-11-17 | 郑州云海信息技术有限公司 | A kind of method and system for realizing storage snapshot |
| CN107357928B (en) * | 2017-07-26 | 2020-09-18 | 苏州浪潮智能科技有限公司 | Method and system for realizing snapshot storage |
| CN107608825A (en) * | 2017-09-19 | 2018-01-19 | 杭州宏杉科技股份有限公司 | A kind of method and device of cloud backup snapshot data |
| CN111399774A (en) * | 2020-03-09 | 2020-07-10 | 星辰天合（北京）数据科技有限公司 | Data processing method and device based on snapshot under distributed storage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102289510B (en) | 2013-10-09 |
| WO2013029434A1 (en) | 2013-03-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102289510B (en) | Method and device for writing data to production volume | |
| CN102929748B (en) | Data back up method and device | |
| CN101840362B (en) | Method and device for achieving copy-on-write snapshot | |
| CN103810058A (en) | Backup method, equipment and system for virtual machine | |
| CN102096557B (en) | Capacity expansion method, device and system for independent redundant array of inexpensive disc (RAID) | |
| CN103814360A (en) | Data replication method and storage system | |
| CN102096561B (en) | Hierarchical data storage processing method, device and storage equipment | |
| CN102971698B (en) | Snapshot data-processing method and system, storage system and snapshot agency | |
| CN102831069B (en) | Internal memory processing method, memory management equipment | |
| CN103793291B (en) | Distributed data copying method and device | |
| CN109598156B (en) | Method for redirecting engine snapshot stream during writing | |
| CN103678036B (en) | A kind of backup method found based on virtual machine operation information data | |
| CN103064760B (en) | Backup method and backup device | |
| CN103324533A (en) | distributed data processing method, device and system | |
| CN101819543A (en) | Snapshot data processing method, system and storage device | |
| CN105487823A (en) | Data migration method and device | |
| CN102326141A (en) | Processing method and apparatus for raid configuration information and raid controller | |
| CN105868054A (en) | Method and device for data backup in dual-computer system environment | |
| CN104407935A (en) | Snapshot rollback method and storage equipment | |
| CN107111531A (en) | Use the data recovery of distribution diagram | |
| CN103049224A (en) | Method, device and system for importing data into physical tape | |
| CN107729536A (en) | A kind of date storage method and device | |
| CN103838521A (en) | Data processing method and data processing device | |
| KR101996641B1 (en) | Apparatus and method for memory overlay | |
| CN104598293A (en) | Online snapshot method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Applicant after: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. Address before: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Applicant before: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES Co.,Ltd. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES CO., LTD. TO: HUAWEI DIGITAL TECHNOLOGY (CHENGDU) CO., LTD. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220831 Address after: No. 1899 Xiyuan Avenue, high tech Zone (West District), Chengdu, Sichuan 610041 Patentee after: Chengdu Huawei Technologies Co.,Ltd. Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. |