CN104424105B

CN104424105B - The read-write processing method and device of a kind of internal storage data

Info

Publication number: CN104424105B
Application number: CN201310376301.XA
Authority: CN
Inventors: 董建波; 张立新; 侯锐; 李晔
Original assignee: Huawei Technologies Co Ltd; Institute of Computing Technology of CAS
Current assignee: Huawei Technologies Co Ltd; Institute of Computing Technology of CAS
Priority date: 2013-08-26
Filing date: 2013-08-26
Publication date: 2017-08-25
Anticipated expiration: 2033-08-26
Also published as: CN104424105A; WO2015027806A1

Abstract

The invention discloses a kind of read-write processing method of internal storage data and device, it is related to computer systems technology field, solve the more expense of the less internal storage data accessing operation waste of multiple data volumes in the prior art to wrap in request of data, cause the problem of efficiency of transmission is low.Method includes：Source node obtains each request bag to be sent；The destination node mark of parsing each request bag to be sent, and judge each request bag to be sent destination node identify whether it is identical；Using at least two request bags to be sent identified with identical destination node as sub- request bag, a merging request bag is packaged as；The merging request bag is sent to the destination node and identifies corresponding destination node, the merging request bag is used to indicate that the destination node carries out read and/or write to the internal storage data of the destination node.The embodiment of the present invention is applied in the read-write processing procedure of internal storage data.

Description

The read-write processing method and device of a kind of internal storage data

Technical field

The present invention relates to the read-write processing method and dress in computer systems technology field, more particularly to a kind of internal storage data Put.

Background technology

In multi-node computer system, the data interaction efficiency between local and remote node directly affects whole system Performance.Remote direct memory is accessed（Remote Direct Memory Access, RDMA）It is to be by internal storage data from one System is moved quickly into remote system stored device, without being had any impact to operating system, such as in the feelings intervened without CPU Under condition, the internal storage data of a node is transferred directly in the physical memory of another node, and then reduce data transfer Influence to processing component, the performance of lifting system.

In RDMA read-write operation, internal memory and Cache（Cache memory）Between data exchange granularity be one Individual Cache Line, size is 64Bytes（Byte）Or 128Bytes, if each Cache Line data packed Sent into a request data package, this small-scale data transfer has a certain degree of link bandwidth and wasted, for example PCIE（Peripheral Component Interface Express, peripheral interconnection standard）Data packet head may have There is 16Bytes, and if Payload（Payload）Length is 16Bytes, then the utilization rate of link bandwidth only has 50%, therefore Multiple less teledata accessing operations of data volume can waste more expense and be wrapped in request of data, cause efficiency of transmission low Under.

The content of the invention

Embodiments of the invention provide a kind of read-write processing method and device of internal storage data, and improve link utilizes effect Rate.

To reach above-mentioned purpose, embodiments of the invention are adopted the following technical scheme that：

In a first aspect, the invention provides a kind of read-write processing method of internal storage data, including：

Each request bag to be sent is obtained, the request bag to be sent includes：Read request packet, and/or write request bag；

The destination node mark of parsing each request bag to be sent, and judge the mesh of each request bag to be sent Node identification it is whether identical；

Using at least two request bags to be sent identified with identical destination node as sub- request bag, pack For a merging request bag, the merging request bag includes public packet header and at least two sub- request bags, the public packet header In comprising bag mark, sub- request bag number mark and source node identification is merged, the merging bag is identified for indicating the request The merging bag for described at least two sub- request bag combinations is wrapped, the sub- request bag number is identified for indicating the merging request The number of the sub- request bag carried is wrapped, the sub- request bag includes sub- request bag packet header and sub- solicited message；

The merging request bag is sent to the destination node and identifies corresponding destination node, the merging request bag is used Read and/or write is carried out to the internal storage data of the destination node in the instruction destination node.

In the first possible implementation of first aspect, it is described be packaged as one merge request bag include：

The merging bag mark is set to predetermined value, the predetermined value indicates that the request bag please for described at least two sons The merging bag for asking package to close；

The number of sub- request bag is obtained, by the number write-in sub- request bag number mark.

With reference to the first possible implementation of first aspect or first aspect, in second of possible implementation In, the destination node mark of each request bag to be sent described in the parsing, and judge the mesh of each request bag to be sent Node identification it is whether identical including：

Obtain the destination node mark carried in each request bag to be sent；

The destination node of each request bag to be sent identifies whether identical described in judging；

It is described be packaged as one merge request bag include：

The destination node mark in the sub- request bag is extracted, and destination node mark is placed in the merging and is asked In the public packet header of bag.

With reference to the first possible implementation of first aspect or first aspect, in the third possible implementation In, the destination node mark of each request bag to be sent described in the parsing, and judge the mesh of each request bag to be sent Node identification it is whether identical including：

Obtain the destination node memory address carried in each request bag to be sent；

According to the destination node memory address, the destination node memory address ownership is searched in address attribution table Destination node is identified, and the address attribution table is the mapping table that purpose node memory address is identified with destination node；

The destination node of each request bag to be sent identifies whether identical described in judging.

With reference to second of the possible implementation or the third possible implementation of first aspect, in the 4th kind of possibility Implementation in, the sub- request bag include write request attached bag and/or read request attached bag, write request attached bag packet header include knowledge Write request information in the write request mark of not described write request attached bag, the write request attached bag includes the purpose section to be written The data and the destination node memory address to be written of point, read request attached bag packet header include identification read request Read request information in the read request mark of bag, the read request attached bag is included in the destination node residing for data to be read Address is deposited, methods described also includes：

Receive in the write request response message that the destination node is sent, the write request response message comprising write request into The corresponding write request mark of the write request attached bag of work(；And/or,

Receive in the read request response message that the destination node is sent, the read request response message comprising read request into The corresponding read request mark of the read request attached bag of work(, and the payload read, the payload please for the reading Seek the corresponding data of attached bag medium-long range memory address.

With reference to first aspect or first aspect the first possible implementation or second of possible implementation or The third possible implementation or the 4th kind of possible implementation, in the 5th kind of possible implementation, the parsing The destination node of each request bag to be sent is identified, and the destination node mark of judgement each request bag to be sent is It is no it is identical including：

According to the corresponding destination node mark of each described request bag to be sent, the destination node is searched in the routing table Corresponding routed port is identified, the routing table identifies corresponding routed port, the routed port comprising the destination node The port on the path of the destination node is reached for the request bag to be sent；

Judge whether the routed port of each request bag to be sent is identical.

Second aspect, the present invention provides a kind of read-write processing method of internal storage data, including：

Receive request bag；

Judge merging bag mark whether is carried in the request bag received, the bag mark that merges is used to indicate the request bag For the merging request bag of at least two sub- request bag combinations, the sub- request bag includes：Read request attached bag, and/or write request Bag；

When carrying merging bag mark in the request bag, the request bag is determined to merge request bag, the merging is asked Asking includes public packet header and sub- request bag, in the public packet header comprising merge bag mark, sub- request bag number mark and Source node identification, the sub- request bag number identifies the number for indicating the sub- request bag that the merging request bag is carried, institute State sub- request bag and include sub- request bag packet header and sub- solicited message；

According to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, extract described Merge the sub- request bag with the corresponding number of the sub- request bag number mark in request bag；

According to every sub- request bag packet header and sub- solicited message, corresponding sub- request bag is handled.

It is described to be asked according to every sub- request bag packet header and son in the first possible implementation of second aspect Information is sought, handling corresponding sub- request bag includes：

It is to be written in write request mark, the write request information of the write request attached bag in write request attached bag packet header The data to be written are write the destination node memory address by data and destination node memory address to be written；With/ Or,

Read request mark in read request attached bag packet header, and treating in the read request information of the read request attached bag The destination node memory address residing for data is read, the data to be read are read in the destination node memory address.

With reference to the first possible implementation of second aspect, in second of possible implementation, carried described Take it is described merging request bag in after the sub- request bag of the corresponding number of the sub- request bag number mark, in addition to：

In the sub- request bag packet header that the source node identification is write to every sub- request bag, in order to the destination node to The source node sends response message.

With reference to second of possible implementation of second aspect, in the third possible implementation, the purpose Node sends response message to the source node to be included：

Judge whether each corresponding source node identification of response message to be sent is identical；

Using the response message to be sent with identical source node identification as sub- response message, a conjunction is packaged as And response message bag, the merging response message bag includes the sub- response message of write request and/or the sub- response message of read request；

The merging response message bag is sent to the corresponding source node of the source node identification.

In the 4th kind of possible implementation of second aspect, when the destination node is routed port, described Extract it is described merging request bag in after the sub- request bag of the corresponding number of the sub- request bag number mark, in addition to：

Extract in the source node identification in the public packet header for merging request bag, the packet header for writing every sub- request bag.

The third aspect, the present invention provides a kind of read-write processing unit of internal storage data, including：

Acquiring unit, for obtaining each request bag to be sent, the request bag to be sent includes：Read request packet, and/or Write request bag；

Judging unit, for parsing the destination node mark of each request bag to be sent, and judges that described each is treated The destination node of transmission request bag identifies whether identical；

Processing unit, for using it is described with identical destination node identify at least two request bags to be sent as Sub- request bag, is packaged as a merging request bag, and the merging request bag includes public packet header and at least two sub- request bags, Comprising bag mark, sub- request bag number mark and source node identification is merged in the public packet header, the merging bag mark is used for Merging bag of the request bag for described at least two sub- request bag combinations is indicated, the sub- request bag number is identified for indicating The number for merging the sub- request bag that request bag is carried, the sub- request bag includes sub- request bag packet header and sub- solicited message；

Transmitting element, corresponding destination node, institute are identified for the merging request bag to be sent into the destination node State and merge request bag for indicating that the destination node carries out read and/or write to the internal storage data of the destination node.

In the first possible implementation of the third aspect, the processing unit includes：

First mark module, for the merging bag mark to be set into predetermined value, the predetermined value indicates the request bag For the merging bag of described at least two sub- request bag combinations；

The number is write the sub- request bag number mark by the second mark module, the number for obtaining sub- request bag In knowledge.

With reference to the first possible implementation of the third aspect or the third aspect, in second of possible implementation In, the judging unit includes：

First acquisition module, the destination node mark carried for obtaining in each request bag to be sent；

First judge module, for judging that it is identical that the destination node of each request bag to be sent is identified whether；

The processing unit also includes：

3rd mark module, for extracting the mark of the destination node in the sub- request bag, and by the destination node mark Know and be placed in the public packet header of the merging request bag.

With reference to the first possible implementation of the third aspect or the third aspect, in the third possible implementation In, the judging unit includes：

Second acquisition module, for obtaining the destination node memory address carried in each request bag to be sent；

First searching modul, for according to the destination node memory address, the purpose to be searched in address attribution table The destination node mark of node memory address attribution, the address attribution table is that purpose node memory address is identified with destination node Mapping table；

Second judge module, for judging that it is identical that the destination node of each request bag to be sent is identified whether.

With reference to second of the possible implementation or the third possible implementation of the third aspect, in the 4th kind of possibility Implementation in, the sub- request bag that the merging request bag that the processing unit is obtained includes include write request attached bag And/or read request attached bag, write request attached bag packet header includes recognizing the write request mark of the write request attached bag, the write request Write request information in attached bag is with including the data and the destination node internal memory to be written of the destination node to be written Location, read request attached bag packet header includes recognizing that the reading in the read request mark of the read request attached bag, the read request attached bag please Information is asked to include the destination node memory address residing for data to be read, described device also includes：

Receiving unit, for receiving the write request response message that the destination node is sent, the write request response message In include the successful corresponding write request mark of the write request attached bag of write request；And/or, for receiving the destination node hair The read request successfully corresponding reading of the read request attached bag is included in the read request response message sent, the read request response message Request mark, and the payload read, the payload are that the read request attached bag medium-long range memory address is corresponding Data.

With reference to the third aspect or the third aspect the first possible implementation or second of possible implementation or The third possible implementation or the 4th kind of possible implementation, it is described to judge in the 5th kind of possible implementation Unit also includes：

Second searching modul, for according to the corresponding destination node mark of each described request bag to be sent, in routing table Middle to search the corresponding routed port of the destination node mark, the routing table identifies corresponding route comprising the destination node Port, the routed port reaches the port on the path of the destination node for the request bag to be sent；

3rd judge module, for judging whether the routed port of each request bag to be sent is identical.

Fourth aspect, the present invention provides a kind of read-write processing unit of internal storage data, including：

Receiving unit, for receiving request bag；

Whether merging bag mark is carried in judging unit, the request bag for judging reception, and the merging bag mark is used for Merging request bag of the request bag at least two sub- request bag combinations is indicated, the sub- request bag includes：Read request attached bag, And/or write request attached bag；

Determining unit, for when carrying merging bag mark in the request bag, determining the request bag to merge request Bag, the merging request bag is included in public packet header and sub- request bag, the public packet header comprising merging bag mark, sub- request Bag number is identified and source node identification, and the sub- request bag number is identified for indicating the son request that the merging request bag is carried The number of bag, the sub- request bag includes sub- request bag packet header and sub- solicited message；

Extraction unit, for according to the sub- request bag number mark and every sub- request bag carried in the merging request bag Packet header, extracts the sub- request bag merged in request bag with the corresponding number of the sub- request bag number mark；

Processing unit, for according to every sub- request bag packet header and sub- solicited message, handling corresponding sub- request bag.

In the first possible implementation of fourth aspect, the processing unit includes：

First processing module, writes for write request mark, the write request attached bag in the write request attached bag packet header The data to be written are write the mesh by data to be written and destination node memory address to be written in solicited message Node memory address；

Second processing module, for the read request mark in read request attached bag packet header, and the read request attached bag Read request information in data to be read residing for destination node memory address, in the destination node memory address read The data to be read.

With reference to the first possible implementation of fourth aspect, in second of possible implementation, described device Also include：

Writing unit is identified, for the source node identification to be write in the sub- request bag packet header of every sub- request bag, with It is easy to the destination node to send response message to the source node.

It is described to judge in the third possible implementation with reference to second of possible implementation of fourth aspect Unit, is additionally operable to judge whether each corresponding source node identification of response message to be sent is identical；

The processing unit, is additionally operable to ring the response message to be sent with identical source node identification as son Answer message, be packaged as one merging response message bag, the merging response message bag include the sub- response message of write request and/or The sub- response message of read request；

Described device also includes：

Transmitting element, for the merging response message bag to be sent into the corresponding source node of the source node identification.

In the 4th kind of possible implementation of fourth aspect, when the destination node is routed port, the place Unit is managed, is additionally operable to extract the source node identification in the public packet header of the merging request bag, writes the bag of every sub- request bag In head.

The read-write processing method and device of a kind of internal storage data provided in an embodiment of the present invention, it is pending that source node obtains each Request bag is sent, the request bag to be sent includes：Read request packet, and/or write request bag, then parse it is described each it is to be sent please Ask the destination node of bag to identify, and judge each request bag to be sent destination node identify whether it is identical, by the tool There are at least two request bags to be sent of identical destination node mark respectively as sub- request bag, be packaged as one and merge request Bag, is sent to the destination node by the merging request bag and identifies corresponding destination node, the merging request bag is used to refer to Show that the destination node carries out read and/or write to the internal storage data of the destination node.The embodiment of the present invention solves existing There is the more expense of multiple less internal storage data read-write operations wastes of data volume in technology to be wrapped in request of data, cause transmission The problem of inefficiency, improve the utilization ratio of link.

Brief description of the drawings

In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in the embodiment of the present invention Accompanying drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.

Fig. 1 is a kind of flow chart of the read-write processing method of internal storage data provided in an embodiment of the present invention；

Fig. 2 is a kind of schematic diagram of read request packet form；

Fig. 3 is a kind of schematic diagram of write request bag form；

Fig. 4 is the schematic diagram of another read request packet form；

Fig. 5 is the schematic diagram of another write request bag form；

Fig. 6 is a kind of schematic diagram for merging write request bag form provided in an embodiment of the present invention；

Fig. 7 is a kind of schematic diagram for merging read request packet form provided in an embodiment of the present invention；

Fig. 8 is a kind of schematic diagram for merging read-write requests bag form provided in an embodiment of the present invention；

Fig. 9 is another schematic diagram for merging write request bag form provided in an embodiment of the present invention；

Figure 10 is another schematic diagram for merging read request packet form provided in an embodiment of the present invention；

Figure 11 is another schematic diagram for merging read-write requests bag form provided in an embodiment of the present invention；

Figure 12 is the flow chart of the read-write processing method of another internal storage data provided in an embodiment of the present invention；

Figure 13 is the flow chart of the read-write processing method of another internal storage data provided in an embodiment of the present invention；

Figure 14 is a kind of structure chart of the read-write processing unit of internal storage data provided in an embodiment of the present invention；

Figure 15 for a kind of internal storage data provided in an embodiment of the present invention read-write processing unit in processing unit structure chart；

Figure 16 is the structure chart of the read-write processing unit of another internal storage data provided in an embodiment of the present invention；

Figure 17 for a kind of internal storage data provided in an embodiment of the present invention read-write processing unit in judging unit structure chart；

Figure 18 is the structure chart of the read-write processing unit of another internal storage data provided in an embodiment of the present invention；

Figure 19 for a kind of internal storage data provided in an embodiment of the present invention read-write processing unit in judging unit structure chart；

Figure 20 is the structure chart of the read-write processing unit of provided in an embodiment of the present invention and another internal storage data；

Figure 21 for processing unit in the provided in an embodiment of the present invention and read-write processing unit of another internal storage data knot Composition；

Figure 22 is the structure chart of the read-write processing unit of another internal storage data provided in an embodiment of the present invention；

Figure 23 is the structure chart of the read-write processing unit of yet a further internal storage data provided in an embodiment of the present invention；

Figure 24 is a kind of hardware structure diagram of the read-write processing unit of internal storage data provided in an embodiment of the present invention；

Figure 25 is the hardware structure diagram of the read-write processing unit of another internal storage data provided in an embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made Embodiment, belongs to the scope of protection of the invention.

When local memory and long-distance inner carry out data interaction, for the less internal storage data read-write operation meeting of data volume Waste more expense to wrap in request of data, cause efficiency of transmission low, the embodiment of the present invention provides a kind of internal storage data Read-write processing method, the request with identical destination node address is merged, and to improve the utilization rate of link, the present invention is real The executive agent source node for applying the method for example can be computer node（Also referred to as calculate node）, as shown in figure 1, this method Comprise the following steps：

101st, each request bag to be sent is obtained, the request bag to be sent includes：Read request packet, and/or write request bag.

Each request bag to be sent that the source node is obtained includes read request packet, and/or write request bag.

102nd, the destination node mark of each request bag to be sent is parsed, and judges each described request bag to be sent Destination node identify whether it is identical.

Wherein it is possible to realize above-mentioned steps 102 by two ways.

Mode one：The destination node mark carried in each request bag to be sent is first obtained, then judges that described each is treated The destination node of transmission request bag identifies whether identical.

In mode one, before the source node carries out internal storage data read-write processing to destination node, with reference to existing skill Source node described in art sends internal memory to the destination node and borrows request, and the destination node is determined according to the state of self EMS memory Fixed to receive or refuse, after the destination node receives the request of the source node, the destination node is by the internal memory of distribution Address and address size are sent to the source node, and the source node is local for this section of memory address distribution of the destination node Memory address, and address mapping table is set up, the address mapping table is that local memory address and the destination node are identified and institute State the map listing of the memory address of destination node.

When the source node is sent to the destination node reads or writes request bag, the request bag includes the source section The memory address of point identification, destination node mark and the destination node, wherein destination node mark and the mesh Node memory address, be by the source node after the request for carrying local memory address is got, using described Address mapping table, is found by the local memory address, is illustrated in figure 2 read request packet to be sent, and Fig. 3, which is shown, to be treated Send write request bag.The destination node mark carried by obtaining in the request bag to be sent shown in Fig. 2 and/or Fig. 3, and judge The destination node of each request bag to be sent identifies whether identical.

Mode two：Obtain the destination node memory address carried in each request bag to be sent；According to the destination node Memory address, searches the destination node mark of the destination node memory address ownership, the address is returned in address attribution table It is the mapping table that purpose node memory address is identified with destination node to belong to table；Judge the mesh of each request bag to be sent Node identification it is whether identical.

In mode two, illustrate using exemplified by PCIE, the read request packet to be sent is as shown in figure 4, described to be sent write Request bag is as shown in figure 5, wherein, the address carried in the read request packet to be sent and the write request bag to be sent is described Destination node memory address, searches the destination node mark of the destination node memory address ownership, institute in address attribution table The mapping table that address attribution table identifies for purpose node memory address with destination node is stated, for example, in the address attribution In table, when the destination node memory address is 0H1000-0H1fff, corresponding destination node is designated 1, the purpose section When point memory address is 0H2000-0H2fff, corresponding destination node is designated 2, and the destination node memory address is During 0H3000-0H2fff, corresponding destination node is designated 3.When getting the purpose section that is carried in the request bag to be sent After point memory address, table is belonged to according to address above mentioned and obtains the corresponding destination node mark of destination node memory address.

For example, when the destination node memory address carried in the read request packet to be sent is 0H1001, it is described to treat When sending that the destination node memory address that carries is 0H1ff0 in write request bag, the read request packet to be sent and described treat Write request bag is sent to be present in during the destination node is designated 1 in corresponding destination node memory address range, therefore institute State read request packet to be sent identical with the destination node mark of the write request bag to be sent.

103rd, using at least two request bags to be sent identified with identical destination node as sub- request bag, A merging request bag is packaged as, the merging request bag includes public packet header and at least two sub- request bags, described public Comprising bag mark, sub- request bag number mark and source node identification is merged in packet header, the merging bag identifies described for indicating Request bag is the merging bag of described at least two sub- request bag combinations, and the sub- request bag number is identified for indicating the merging The number for the sub- request bag that request bag is carried, the sub- request bag includes sub- request bag packet header and sub- solicited message.

When sub- request bag is packaged into merging request bag, includes public packet header in the merging request bag and son is asked Merging bag mark is included in bag, the public packet header（Combine, C）, for indicating that the request bag is described at least two sons The merging bag of request bag combination, and the merging bag mark is set to predetermined value, the predetermined value indicates that the request bag is institute The merging bag of at least two sub- request bag combinations is stated, such as represents request bag during C=" 1 " to merge request bag；Including sub- request bag Number is identified（Combined Requests Number, CR NUM）, for indicating the son request that the merging request bag is carried The number of bag, when being packaged as merging request bag, obtains the number of sub- request bag, and the number is write into the sub- request bag In number mark；Also include source node identification（Requester ID）, for indicating the source node that the merging request bag is sent, It is exactly the mark of local source node, in addition also comprising in each sub- request bag packet header in the public packet header for merging request bag Public information.Sub- request bag in the merging request bag includes sub- request bag packet header and sub- solicited message, the sub- request bag Packet header includes the type of the sub- request bag（Type）And length, wherein length is specially transaction layer packet length （Transaction Lay Packet, TLP length）.Wherein, it is write request attached bag that type, which is used to distinguish the sub- request bag, Or read request attached bag.

Wherein it is possible to the write request attached bag identified with identical destination node is packaged into a merging write request bag, or The read request attached bag identified with identical destination node is packaged into a merging read request packet by person, or in order to further improve Link utilization, the write request attached bag and read request attached bag that are identified with identical destination node are packaged into a merging read-write please Bag is sought, is not limited herein.

, it is necessary to extract the sub- request bag in the merging request bag that a packing is obtained by way of in above-mentioned steps 102 In destination node mark, and by the destination node identify be placed in it is described merging request bag public packet header in.Such as Fig. 6 institutes Show, for obtained merging write request bag, as shown in fig. 7, being obtained merging read request packet, as shown in figure 8, being obtained merging Read-write requests bag.

In the merging request bag that two packings are obtained by way of in above-mentioned steps 102, obtained merging is illustrated in figure 9 Write request bag, is as shown in Figure 10 obtained merging read request packet, as shown in figure 11 the merging read-write requests bag to obtain.Separately Outside, also include request coding in the merging request bag obtained in pass-through mode two in the packet header of every sub- request bag, be the source Node, to the coding of sub- request bag, is the unique mark of every sub- request bag.

104th, the merging request bag is sent to the destination node and identifies corresponding destination node, the merging request Wrap for indicating that the destination node carries out read and/or write to the internal storage data of the destination node.

A kind of read-write processing method of internal storage data provided in an embodiment of the present invention, source node obtains each request to be sent Bag, and the destination node mark of each request bag to be sent is parsed, judge the purpose section of each request bag to be sent Whether point identification is identical, then has at least two request bags to be sent that identical destination node is identified as son using described Request bag, is packaged as a merging request bag, most at last the merging request bag to be sent to destination node mark corresponding Destination node, the merging request bag be used to indicating the destination node internal storage data of the destination node read and/ Or write operation.The embodiment of the present invention solves the less internal storage data accessing operation of multiple data volumes in the prior art and wastes more Expense wrapped in request of data, cause the problem of efficiency of transmission is low, improve the utilization ratio of link.

The embodiment of the present invention also provides a kind of read-write processing method of internal storage data, the execution of the method for the embodiment of the present invention Main body destination node, can be a remote computer node, as shown in figure 12, this method comprises the following steps：

1201st, request bag is received；

1202nd, judge that merging whether is carried in the request bag received is wrapped mark, the merging bag mark is described for indicating Request bag is the merging request bag of at least two sub- request bag combinations, and the sub- request bag includes：Read request attached bag, and/or write Ask attached bag.

When the destination node receives request bag, first judge whether include merging bag mark C in the request bag, For example when judging C=" 1 ", represent the request bag to merge request bag.

1203rd, when carrying merging bag mark in the request bag, determine the request bag to merge request bag, the conjunction And request bag is included in public packet header and sub- request bag, the public packet header comprising merging bag mark, sub- request bag number mark Know and source node identification, the sub- request bag number identifies for indicating the sub- request bag that the merging request bag is carried Number, the sub- request bag includes sub- request bag packet header and sub- solicited message；

1204th, according to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, carry Take the sub- request bag with the corresponding number of the sub- request bag number mark in the merging request bag.

When it is determined that the request bag received is merges request bag, except including in the public packet header of the merging request bag Merge bag mark, also comprising sub- request bag number mark and source node identification, its neutron request bag number is identified for indicating institute The number for merging the sub- request bag that request bag is carried is stated, source node identification is used for the source section for indicating that the merging request bag is sent Point.Sub- request bag packet header and sub- solicited message are included in every sub- request bag.

By the sub- request bag number mark carried in the merging request bag and every sub- request bag packet header, extract described Merge the sub- request bag with the corresponding number of the sub- request bag number mark in request bag, wherein it is possible to utilize sub- request bag Type and length in number mark and every sub- request bag packet header, or utilize sub- request bag number mark and every sub- request bag With the corresponding number of the sub- request bag number mark in form, type and length in packet header, the extraction merging request bag Sub- request bag.

1205th, according to every sub- request bag packet header and sub- solicited message, corresponding sub- request bag is handled.

Wherein, can basis due to write request attached bag and/or read request attached bag may be included in the merging request bag Form and/or type in sub- request bag packet header make a distinction write request attached bag and read request attached bag, so that by different requests The processing different with the progress of read request attached bag of write request attached bag.

With reference in the prior art, for sub- write request, according in the destination node carried in the write request attached bag Address and payload are deposited, the payload is write on the destination node memory address；For sub- read request, according to institute The destination node memory address carried in read request attached bag is stated, the content on the destination node memory address is read, and Return to the source node.

A kind of read-write processing method of internal storage data provided in an embodiment of the present invention, destination node judges the request bag received In whether carry merging bag mark, when in the request bag carry merge bag mark when, determine the request bag for merge ask Bag, then according to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, extracts described Merge the sub- request bag with the corresponding number of the sub- request bag number mark in request bag, finally according to every sub- request bag Packet header and sub- solicited message, handle corresponding sub- request bag.The embodiment of the present invention solve in the prior art multiple data volumes compared with Small internal storage data accessing operation wastes more expense and wrapped in request of data, causes the problem of efficiency of transmission is low, improves The utilization ratio of link.

The embodiment of the present invention can apply in RDMA, will have identical destination node in the internal storage data of a calculate node Request bag to be sent carry out packing merging, send jointly to the corresponding remote computing nodes of the destination node, be specifically this Ground Cache sends the requests to local memory controller, carries out packing merging treatment, is then sent to long-distance inner controller and enters Capable processing of unpacking, long-range Cache is sent to by obtained request.The present embodiment is illustrated by taking PCIE as an example, and Fig. 4 is standard Read request packet form in PCIE, Fig. 5 is write request bag form, and wherein form and type are used for distinguishing the request bag for read request Bag or write request bag, transaction layer packet length are used to represent the request packet length, and source node identification is used to indicate to send described Address in the source node of request bag, read request packet represents the address for the internal storage data that the read request packet will be read, described Address in write request bag represented by the payload of carrying in the write request bag, the memory address to be write, other fields Implication may be referred to the bag form of PCIE in the prior art.A kind of internal memory is discussed in detail by taking above-mentioned application scenarios as an example below The read-write processing method of data, as shown in figure 13, this method comprises the following steps：

1301st, source node obtains each request bag to be sent, and the request bag to be sent includes：Read request packet, and/or write Request bag；

1302nd, the destination node mark of source node parsing each request bag to be sent, and judge it is described each The destination node of request bag to be sent identifies whether identical.

Obtain the destination node memory address carried in each request bag to be sent；According to the destination node internal memory Location, searches the destination node mark of the destination node memory address ownership in address attribution table, and the address attribution table is The mapping table that destination node memory address is identified with destination node；Judge the destination node of each request bag to be sent Identify whether identical.

The read request packet to be sent is described pending as shown in figure 4, the write request bag to be sent is as shown in figure 5, wherein It is the destination node memory address to send the address carried in read request packet and the write request bag to be sent, in address attribution table The middle destination node mark for searching the destination node memory address ownership, the address attribution table is purpose node memory address The mapping table identified with destination node, for example, in the address attribution table, when the destination node memory address is During 0H1000-0H1fff, corresponding destination node is designated 1, when the destination node memory address is 0H2000-0H2fff, Corresponding destination node is designated 2, when the destination node memory address is 0H3000-0H2fff, corresponding destination node mark Know for 3.After the destination node memory address carried in the request bag to be sent is got, obtained according to address above mentioned ownership table Take the corresponding destination node mark of destination node memory address.

1303rd, the source node makees at least two request bags to be sent identified with identical destination node respectively For sub- request bag, a merging request bag is packaged as, the merging request bag includes public packet header and at least two son requests Comprising bag mark, sub- request bag number mark and source node identification is merged in bag, the public packet header, the merging bag mark is used In indicating merging bag of the request bag for described at least two sub- request bag combinations, the sub- request bag number is identified for referring to Show the number for the sub- request bag that the merging request bag is carried, the sub- request bag includes sub- request bag packet header and son request letter Breath.

Wherein it is possible to the write request attached bag identified with identical destination node is packaged into a merging write request bag, or The read request attached bag identified with identical destination node is packaged into a merging read request packet by person, or in order to further improve Link utilization, the write request attached bag and read request attached bag that are identified with identical destination node are packaged into a merging read-write please Bag is sought, so the merging request bag includes write request attached bag and/or read request attached bag.

When sub- request bag is packaged into merging request bag, includes public packet header in the merging request bag and son is asked Merging bag mark is included in bag, the public packet header（Combine, C）, for indicating that the request bag is many sub- request bag groups The merging request bag of conjunction, such as represent request bag to merge request bag during C=" 1 "；Including sub- request bag number mark （Combined Requests Number, CR NUM）, the number for indicating the sub- request bag that the merging request bag is carried, Also include source node identification（Requester ID）, for indicating the source node that the merging request bag is sent, that is, locally The mark of source node, in addition also comprising the public letter in each sub- request bag packet header in the public packet header for merging request bag Breath.Sub- request bag in the merging request bag includes sub- request bag packet header and sub- solicited message, the sub- request bag Bao Toubao Form containing the sub- request bag（Fmt）, type（Type）And length, wherein length is specially transaction layer packet length （Transaction Lay Packet, TLP length）.Wherein, it is to write to ask that form and type, which are used to distinguish the sub- request bag, Ask attached bag or read request attached bag.

It is coding of the source node to sub- request bag in addition, also including request coding in the packet header of every sub- request bag, It is the unique mark of every sub- request bag, so that the source node is when receiving the response message that the destination node is returned, The performance of the sub- request is determined according to the request coding carried in the response message.

It is specific as shown in Figure 10, two read request attached bags are merged to the merging bag mark obtained merging in read request packet, figure It is the extraneous information newly added to be identified with sub- request bag number, wherein the sub- request bag number identification length is 4 bits, can be with The number for indicating the read request attached bag for merging and being included in read request packet is 16.Natively include request coding in PCIE （Namely mark）Field, length is 8 bits, and high 4 bit of the field is shared, 0- in the merging read request packet 3 bits are used for distinguishing different read request attached bags, 16 read request attached bags can be distinguished, with the sub- request bag number identifier word The number that segment table shows matches.Wherein, traffic class（TC）, pollution reserved bit（EP）, attribute（Attr）And source node identification （Requester ID）The public packet header belonged in the merging read request packet；Form（Fmt）, type（Type）, whether have ECRC（TD）, transaction layer packet length（TLP length）, request coding（Request Coding）, last byte-aligned（Last DW BE）With the first byte-aligned（1st DW BE）Belong to read request attached bag packet header, the implication of above-mentioned field may be referred to existing Read request packet form in PCIE in technology.

Included as shown in figure 9, two write request attached bags are merged and obtain merging in write request bag, the merging write request bag The implication of field is similar with the implication comprising field in the merging read request packet shown in Figure 10, simply in each write request attached bag also The payload of destination node will be write by including.

In order to further improve link utilization, write request attached bag and read request that identical destination node can be identified Bag is packaged into a merging request bag, as shown in figure 11.

For the son request in above-mentioned merging request bag, packing conjunction is carried out according to the transmission sequencing of the sub- request And.

1304th, the merging request bag is sent to the destination node and identifies corresponding destination node by the source node, The request bag that merges is used to indicate that the destination node carries out read and/or write to the internal storage data of the destination node.

1305th, the destination node receives request bag；

1306th, the destination node judges merging bag mark whether is carried in the request bag received, described to merge bag mark For indicating merging request bag of the request bag at least two sub- request bag combinations, the sub- request bag includes：Read request Attached bag, and/or write request attached bag.

1307th, when carrying merging bag mark in the request bag, determine the request bag to merge request bag, the conjunction And request bag is included in public packet header and sub- request bag, the public packet header comprising merging bag mark, sub- request bag number mark Know and source node identification, the sub- request bag number identifies for indicating the sub- request bag that the merging request bag is carried Number, the sub- request bag includes sub- request bag packet header and sub- solicited message；

1308th, according to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, carry Take the sub- request bag with the corresponding number of the sub- request bag number mark in the merging request bag.

When judging the request bag to merge request bag, identified according to the sub- request bag number, and please per height Form, type and the length of bag are sought, every sub- request bag is obtained.Further, since may include in the merging request bag Write request attached bag and/or read request attached bag, can make a distinction write request according to the form in sub- request bag packet header and type Bag and read request attached bag, so that by the processing different with the progress of read request attached bag of the write request attached bag of different requests.

1309th, according to every sub- request bag packet header and sub- solicited message, corresponding sub- request bag is handled.

It is to be written in write request mark, the write request information of the write request attached bag in write request attached bag packet header The data to be written are write the destination node memory address by data and destination node memory address to be written；With/ Or, the read request mark in read request attached bag packet header, and it is to be read in the read request information of the read request attached bag Destination node memory address residing for data, reads the data to be read in the destination node memory address.

Further, after node handles sub- request bag for said purpose, it is easy to send to the source node In response message, the sub- request bag packet header that the source node identification is write to every sub- request bag, it can also merge in addition by described In the sub- request bag packet header of other information every sub- request bag of write-in in the public packet header in request bag so that every sub- request bag Form before being converted into merging.

In addition, the destination node is after antithetical phrase request processing, response message can be returned to the source node, to accuse Know the performance that the source node is asked per height.It can be fed back by following two modes：

Mode one：

The destination node sends the response message of the sub- request bag after processing respectively：

Obtain the source node identification in the write request attached bag；

Send in write request response message, the write request response message and wrap to the corresponding source node of the source node identification Containing write request, successfully the corresponding write request of the write request attached bag is identified.

Wherein, when the write request attached bag is non-propelling movement type write request, it is necessary to which the destination node is to the source node Feedback is sent, or can require to complete the write request attached bag of write request, response message is sent to the source node.

The source node is received in the write request response message that the destination node is sent, the write request response message and wrapped Containing write request, successfully the corresponding write request of the write request attached bag is identified.

With reference in the prior art, the source node is after write request response message is received, according to the write request of carrying Mark, is contrasted with the write request mark in the write request attached bag that sends, can obtain which write request attached bag in institute State destination node to be successfully written, which write request attached bag does not write, can be again for the successful request bag of no write request Send.

And/or,

The destination node obtains the source node identification in the read request attached bag；

Send in read request response message, the read request response message and wrap to the corresponding source node of the source node identification Containing the read request successfully corresponding request coding of the read request attached bag, and the payload obtained, the payload is The data that the sub- read request is obtained.

The source node is received in the read request response message that the destination node is sent, the read request response message and wrapped Containing the read request successfully corresponding read request mark of the read request attached bag, and the payload obtained, the payload The data obtained for the sub- read request.

Payload in the read request attached bag is the destination node in the read request attached bag it is long-range in The data that address acquisition is arrived are deposited, the destination node responds the corresponding read request of the sub- read request for successfully getting payload Message is sent to the source node, and the source node is after the payload is received, according to the transmission read request attached bag When, which address of the local terminal of record is needed to read data, and corresponding payload is read back into phase according to read request mark Answer address.

Mode two：

The source node is after the merging response message bag is got, write request mark and/or reading in the bag Request mark obtains corresponding response message, and the processing mode after acquisition is identical with described in mode one, no longer goes to live in the household of one's in-laws on getting married herein State.

Method in the embodiment of the present invention, can also be applied to the data transfer between multiple ports in system, according to The corresponding destination node mark of described each request bag to be sent, searches the destination node and identifies corresponding road in the routing table By port, the routing table identifies corresponding routed port comprising the destination node, and the routed port is described to be sent Request bag reaches the port on the path of the destination node, judge each request bag to be sent routed port whether phase Together, the request bag to be sent with identical routed port is merged, obtains merging request bag, and by the merging request bag It is sent to the routed port.The routed port is received after the merging request bag, carries out operation of unpacking, and extracts described Merge the source node identification in the public packet header of request bag, in the packet header for writing every sub- request bag, then proceed to turn below Hair operation.

The embodiment of the present invention provides a kind of read-write processing unit 14 of internal storage data, the read-write processing dress of the internal storage data Put 14 to may reside in calculate node, can also be exactly a calculate node, as shown in figure 14, described device includes obtaining single Member 141, judging unit 142, processing unit 143 and transmitting element 144.

Wherein, acquiring unit 141, for obtaining each request bag to be sent, the request bag to be sent includes：Read request Bag, and/or write request bag；

Judging unit 142, for parsing the destination node mark of each request bag to be sent, and judge it is described each The destination node of request bag to be sent identifies whether identical；

Processing unit 143, for distinguishing described with least two request bags to be sent that identical destination node is identified As sub- request bag, a merging request bag is packaged as, the merging request bag includes public packet header and at least two sons please Ask in bag, the public packet header comprising merging bag mark, sub- request bag number mark and source node identification, the merging bag mark For indicating merging bag of the request bag for described at least two sub- request bag combinations, the sub- request bag number, which is identified, to be used for The number for merging the sub- request bag that request bag is carried is indicated, the sub- request bag includes sub- request bag packet header and son request letter Breath；

Transmitting element 144, corresponding destination node is identified for the merging request bag to be sent into the destination node, The request bag that merges is used to indicate that the destination node carries out read and/or write to the internal storage data of the destination node.

A kind of read-write processing unit of internal storage data provided in an embodiment of the present invention, obtains each request bag to be sent, and The destination node mark of parsing each request bag to be sent, judges the destination node mark of each request bag to be sent It is whether identical, then there are at least two request bags to be sent that identical destination node is identified as sub- request using described Bag, is packaged as a merging request bag, and most the merging request bag is sent to the destination node and identifies corresponding purpose at last Node, the merging request bag is used to indicate that the destination node is read and/or write to the internal storage data of the destination node Operation.The embodiment of the present invention solves the less teledata accessing operation of multiple data volumes in the prior art and wastes more open Pin is wrapped in request of data, is caused the problem of efficiency of transmission is low, is improved the utilization ratio of link.

Optionally, as shown in figure 15, the processing unit includes：

First mark module 151, for the merging bag mark to be set into predetermined value, the predetermined value indicates the request Wrap the merging bag for described at least two sub- request bag combinations；

The number is write the sub- request bag number by the second mark module 152, the number for obtaining sub- request bag In mark.

Optionally, as shown in figure 16, the judging unit includes：

First acquisition module 161, the destination node mark carried for obtaining in each request bag to be sent；

First judge module 162, for judging that it is identical that the destination node of each request bag to be sent is identified whether；

The processing unit also includes：

3rd mark module 163, for extracting the mark of the destination node in the sub- request bag, and by the destination node Mark is placed in the public packet header of the merging request bag.

Optionally, as shown in figure 17, the judging unit includes：

Second acquisition module 171, for obtaining the destination node memory address carried in each request bag to be sent；

First searching modul 172, for according to the destination node memory address, the mesh to be searched in address attribution table Node memory address attribution destination node mark, the address attribution table is purpose node memory address and destination node mark The mapping table of knowledge；

Second judge module 173, for judging that it is identical that the destination node of each request bag to be sent is identified whether.

Optionally, the sub- request bag that the merging request bag that the processing unit is obtained includes includes write request attached bag And/or read request attached bag, write request attached bag packet header includes recognizing the write request mark of the write request attached bag, the write request Write request information in attached bag is with including the data and the destination node internal memory to be written of the destination node to be written Location, read request attached bag packet header includes recognizing that the reading in the read request mark of the read request attached bag, the read request attached bag please Information is asked to include the destination node memory address residing for data to be read, as shown in figure 18, described device also includes：

Receiving unit 181, for receiving the write request response message that the destination node is sent, the write request response disappears Comprising write request, successfully the corresponding write request of the write request attached bag is identified in breath；And/or, for receiving the destination node Comprising read request, successfully the read request attached bag is corresponding in the read request response message of transmission, the read request response message Read request is identified, and the payload read, and the payload is read request attached bag medium-long range memory address correspondence Data.

Optionally, as shown in figure 19, the judging unit also includes：

Second searching modul 191, for according to the corresponding destination node mark of each described request bag to be sent, in route The destination node is searched in table and identifies corresponding routed port, the routing table identifies corresponding road comprising the destination node By port, the routed port reaches the port on the path of the destination node for the request bag to be sent；

3rd judge module 192, for judging whether the routed port of each request bag to be sent is identical.

Correspondingly, the embodiment of the present invention also provides a kind of read-write processing unit 20 of internal storage data, the internal storage data Read-write processing unit 20 may reside in calculate node, can also be exactly a calculate node, as shown in figure 20, described device Including receiving unit 201, judging unit 202, determining unit 203, extraction unit 204 and processing unit 205.

Receiving unit 201, for receiving request bag；

Whether merging bag mark is carried in judging unit 202, the request bag for judging reception, and the merging is wrapped mark and used In indicating merging request bag of the request bag at least two sub- request bag combinations, the sub- request bag includes：Read request Bag, and/or write request attached bag；

Determining unit 203, for when carrying merging bag mark in the request bag, determining that the request bag is asked to merge Seek bag, the merging request bag includes in public packet header and sub- request bag, the public packet header asking comprising merging bag mark, son Bag number is asked to identify and source node identification, the sub- request bag number is identified for indicating that the son that the merging request bag is carried please The number of bag is sought, the sub- request bag includes sub- request bag packet header and sub- solicited message；

Extraction unit 204, for being asked according to the sub- request bag number mark carried in the merging request bag and per height Bag packet header is asked, the sub- request bag merged in request bag with the corresponding number of the sub- request bag number mark is extracted；

Processing unit 205, for according to every sub- request bag packet header and sub- solicited message, handling corresponding sub- request Bag.

A kind of read-write processing unit of internal storage data provided in an embodiment of the present invention, judges whether taken in the request bag received Tape merge bag is identified, and when carrying merging bag mark in the request bag, determines the request bag to merge request bag, Ran Hougen According to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, the merging request bag is extracted In sub- request bag with the corresponding number of the sub- request bag number mark, finally please according to every sub- request bag packet header and son Information is sought, corresponding sub- request bag is handled.The embodiment of the present invention solves the less long-range number of multiple data volumes in the prior art More expense is wasted according to accessing operation to wrap in request of data, is caused the problem of efficiency of transmission is low, is improved the profit of link Use efficiency.

Optionally, as shown in figure 21, the processing unit includes：

First processing module 211, for write request mark, the write request attached bag in write request attached bag packet header Data to be written and destination node memory address to be written in write request information, the data to be written are write described Destination node memory address；

Second processing module 212, for the read request mark in read request attached bag packet header, and read request The destination node memory address residing for data to be read in the read request information of bag, reads in the destination node memory address Take the data to be read.

Optionally, as shown in figure 22, described device also includes：

Writing unit 221 is identified, for the source node identification to be write in the sub- request bag packet header of every sub- request bag, In order to which the destination node sends response message to the source node.

Optionally, the judging unit, is additionally operable to judge that each corresponding source node identification of response message to be sent is It is no identical；

As shown in figure 23, described device also includes：

Transmitting element 231, for the merging response message bag to be sent into the corresponding source node of the source node identification.

Optionally, when the destination node is routed port, the processing unit is additionally operable to extract the merging request In source node identification in the public packet header of bag, the packet header for writing every sub- request bag.

The operating process of said apparatus 14 and device 20, referring to above-mentioned internal storage data read-write processing method it is treated Journey.

The read-write processing unit of internal storage data shown in above-mentioned Figure 14 to Figure 19 can be set based on computer or other networks Standby hardware configuration realizes that as shown in figure 24, the hardware configuration of the read-write processing unit 24 of internal storage data includes memory 241st, transceiver 242, processor 243 and bus 244.

Wherein, processor 243, memory 241 and transceiver 242 are connected by bus 244.

Memory 241 can be read-only storage（Read Only Memory, ROM）, static storage device, dynamic memory Equipment or random access memory（Random Access Memory, RAM）.Memory 241 can store an operating system and The instruction of other applications and application data.The instruction stored in memory 241 is run execution by processor 243.

Memory 241 realizes Figure 14 each functional units into embodiment illustrated in fig. 19 available for storage in the embodiment of the present invention Instruction.

Transceiver 242 is used for realizing communication of the read-write processing unit 24 with other equipment of internal storage data.

In the embodiment of the present invention, transceiver 242, which is used to send, merges request bag and reception response message.

Processor 243 can use general central processing unit（Central Processing Unit, CPU）, microprocessor Device, application specific integrated circuit（Application SpecificIntegrated Circuit, ASIC）, or one or many Individual integrated circuit, for performing relative program.

In the embodiment of the present invention, processor 243 is used to perform the instruction in memory 241, specific to perform：

The merging request bag is sent to the destination node by transceiver 242 and identifies corresponding destination node, institute State and merge request bag for indicating that the destination node carries out read and/or write to the internal storage data of the destination node.

Wherein, the concrete processing procedure in processor 243 is referred to shown in embodiment of the method part and Figure 14 to Figure 19 Device embodiment part, repeat no more here.

Bus 244 may include a path, in the read-write processing unit all parts of internal storage data（Such as processor 243, deposit Reservoir 241 and transceiver 242）Between transmit information.

The read-write processing unit of internal storage data shown in above-mentioned Figure 20 to Figure 23 can computer based hardware configuration Realize, as shown in figure 25, the hardware configuration of the read-write processing unit 25 of internal storage data includes memory 251, transceiver 252, place Manage device 253 and bus 254.

Wherein, processor 253, memory 251 and transceiver 252 are communicated to connect by bus 254.

Memory 251 can be read-only storage（Read Only Memory, ROM）, static storage device, dynamic memory Equipment or random access memory（Random Access Memory, RAM）.Memory 251 can store an operating system and The instruction of other applications and application data.The instruction stored in memory 251 is run execution by processor 253.

Memory 251 realizes Figure 20 each functional units into embodiment illustrated in fig. 23 available for storage in the embodiment of the present invention Instruction.

Transceiver 252 is used for realizing the communication between the read-write processing unit 25 of internal storage data and other equipment.

In the embodiment of the present invention, transceiver 252, which is used to receive, merges request bag and transmission response message.

Processor 253 can use general central processing unit（Central Processing Unit, CPU）, microprocessor Device, application specific integrated circuit（Application Specific Integrated Circuit, ASIC）, or one or Multiple integrated circuits, for performing relative program.

In the embodiment of the present invention, processor 253 is used to perform the instruction in memory 251, specific to perform：

Request bag is received by transceiver 252；

Wherein, the concrete processing procedure in processor 253 is referred to shown in embodiment of the method part and Figure 20 to Figure 23 Device embodiment part, repeat no more here.

Bus 254 may include a path, in the read-write processing unit all parts of internal storage data（Such as processor 253, deposit Reservoir 251 and transceiver 252）Between transmit information.

It is apparent to those skilled in the art that, for convenience and simplicity of description, only with above-mentioned each function The division progress of module is for example, in practical application, as needed can distribute above-mentioned functions by different function moulds Block is completed, i.e., the internal structure of device is divided into different functional modules, to complete all or part of work(described above Energy.The specific work process of the system, apparatus, and unit of foregoing description, may be referred to corresponding in preceding method embodiment Journey, will not be repeated here.

In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be with Realize by another way.For example, device embodiment described above is only schematical, for example, the module or The division of unit, only a kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units Or component can combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, institute Display or the coupling each other discussed or direct-coupling or communication connection can be by some interfaces, device or unit INDIRECT COUPLING or communication connection, can be electrical, machinery or other forms.

The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.

In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.

If the integrated unit is realized using in the form of SFU software functional unit and as independent production marketing or used When, it can be stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially The part contributed in other words to prior art or all or part of the technical scheme can be in the form of software products Embody, the computer software product is stored in a storage medium, including some instructions are to cause a computer Equipment（Can be personal computer, server, or network equipment etc.）Or processor（processor）Perform the present invention each The all or part of step of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage （ROM, Read-Only Memory）, random access memory（RAM, Random Access Memory）, magnetic disc or CD Etc. it is various can be with the medium of store program codes.

The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims

1. a kind of read-write processing method of internal storage data, it is characterised in that including：

The destination node mark of parsing each request bag to be sent, and judge the purpose section of each request bag to be sent Whether point identification is identical；

Using at least two request bags to be sent identified with identical destination node as sub- request bag, one is packaged as Individual merging request bag, the merging request bag includes public packet header and at least two sub- request bags, the public packet header Zhong Bao Containing bag mark, sub- request bag number mark and source node identification is merged, the merging bag is identified for indicating that the request bag is The merging bag of at least two sub- request bag combination, the sub- request bag number is identified for indicating that the merging request bag is taken The number of the sub- request bag of band, the sub- request bag includes sub- request bag packet header and sub- solicited message；

The merging request bag is sent to the destination node and identifies corresponding destination node, the merging request bag is used to refer to Show that the destination node carries out read and/or write to the internal storage data of the destination node.

2. the read-write processing method of internal storage data according to claim 1, it is characterised in that described to be packaged as a merging Request bag includes：

The merging bag mark is set to predetermined value, the predetermined value indicates that the request bag is described at least two sub- request bags The merging bag of combination；

3. the read-write processing method of internal storage data according to claim 1 or 2, it is characterised in that the parsing is described each The destination node mark of individual request bag to be sent, and judge each request bag to be sent destination node identify whether it is identical Including：

Obtain the destination node mark carried in each request bag to be sent；

It is described be packaged as one merge request bag include：

The destination node mark in the sub- request bag is extracted, and destination node mark is placed in the merging request bag In public packet header.

4. the read-write processing method of internal storage data according to claim 1 or 2, it is characterised in that the parsing is described each The destination node mark of individual request bag to be sent, and judge each request bag to be sent destination node identify whether it is identical Including：

According to the destination node memory address, the purpose of the destination node memory address ownership is searched in address attribution table Node identification, the address attribution table is the mapping table that purpose node memory address is identified with destination node；

5. the read-write processing method of internal storage data according to claim 3, it is characterised in that the sub- request bag includes writing Attached bag and/or read request attached bag are asked, write request attached bag packet header includes recognizing the write request mark of the write request attached bag, institute Stating the write request information in write request attached bag includes the data and the purpose section to be written of the destination node to be written Point memory address, read request attached bag packet header includes recognizing the read request mark of the read request attached bag, the read request attached bag In read request information include the destination node memory address residing for data to be read, methods described also includes：

Receive successful comprising write request in the write request response message that the destination node is sent, the write request response message The corresponding write request mark of the write request attached bag；And/or,

Receive successful comprising read request in the read request response message that the destination node is sent, the read request response message The corresponding read request mark of the read request attached bag, and the payload read, the payload is read request The corresponding data of bag medium-long range memory address.

6. the read-write processing method of the internal storage data according to any one of claim 1,2,5, it is characterised in that the parsing The destination node of each request bag to be sent is identified, and the destination node mark of judgement each request bag to be sent is It is no it is identical including：

According to the corresponding destination node mark of each described request bag to be sent, the destination node mark is searched in the routing table Corresponding routed port, the routing table identifies corresponding routed port comprising the destination node, and the routed port is institute State the port on the path of the request bag arrival to be sent destination node；

Judge whether the routed port of each request bag to be sent is identical.

7. a kind of read-write processing method of internal storage data, it is characterised in that including：

Receive request bag；

Judge merging bag mark whether is carried in the request bag received, the bag mark that merges is used to indicate the request bag for extremely The merging request bag of few two sub- request bag combinations, the sub- request bag includes：Read request attached bag, and/or write request attached bag；

When carrying merging bag mark in the request bag, determine the request bag to merge request bag, the merging request bag Include in public packet header and sub- request bag, the public packet header comprising merging bag mark, sub- request bag number mark and source section Point identification, the sub- request bag number identifies the number for indicating the sub- request bag that the merging request bag is carried, the son Request bag includes sub- request bag packet header and sub- solicited message；

According to the sub- request bag number mark and every sub- request bag packet header carried in the merging request bag, described merge is extracted With the sub- request bag of the corresponding number of the sub- request bag number mark in request bag；

8. the read-write processing method of internal storage data according to claim 7, it is characterised in that described according to every height Request bag packet header and sub- solicited message, handling corresponding sub- request bag includes：

The data to be written in write request mark, the write request information of the write request attached bag in write request attached bag packet header And destination node memory address to be written, the data to be written are write into the destination node memory address；And/or,

Read request mark in read request attached bag packet header, and it is to be read in the read request information of the read request attached bag Destination node memory address residing for data, reads the data to be read in the destination node memory address.

9. the read-write processing method of internal storage data according to claim 8, it is characterised in that extract described merge described In request bag with after the sub- request bag of the corresponding number of the sub- request bag number mark, in addition to：

In the sub- request bag packet header that the source node identification is write to every sub- request bag, in order to which the destination node is to described Source node sends response message.

10. the read-write processing method of internal storage data according to claim 9, it is characterised in that the destination node is to institute Stating source node transmission response message includes：

Using the response message to be sent with identical source node identification as sub- response message, it is packaged as one and merges sound Message package is answered, the merging response message bag includes the sub- response message of write request and/or the sub- response message of read request；

11. the read-write processing method of internal storage data according to claim 7, it is characterised in that when destination node is route During port, it is described extract it is described merge in request bag with the sub- request bag of the corresponding number of the sub- request bag number mark it Afterwards, in addition to：

12. a kind of read-write processing unit of internal storage data, it is characterised in that including：

Acquiring unit, for obtaining each request bag to be sent, the request bag to be sent includes：Read request packet, and/or write please Seek bag；

Judging unit, the destination node mark for parsing each request bag to be sent, and each is to be sent described in judgement The destination node of request bag identifies whether identical；

Processing unit, for being asked described with least two request bags to be sent that identical destination node is identified as son Bag is sought, a merging request bag is packaged as, the merging request bag includes public packet header and at least two sub- request bags, described Comprising bag mark, sub- request bag number mark and source node identification is merged in public packet header, the merging bag is identified for indicating The request bag is the merging bag of described at least two sub- request bag combinations, and the sub- request bag number identifies described for indicating Merge the number for the sub- request bag that request bag is carried, the sub- request bag includes sub- request bag packet header and sub- solicited message；

Transmitting element, corresponding destination node, the conjunction are identified for the merging request bag to be sent into the destination node And request bag is used to indicate that the destination node carries out read and/or write to the internal storage data of the destination node.

13. the read-write processing unit of internal storage data according to claim 12, it is characterised in that the processing unit bag Include：

First mark module, for the merging bag mark to be set into predetermined value, the predetermined value indicates that the request bag is institute State the merging bag of at least two sub- request bag combinations；

Second mark module, the number for obtaining sub- request bag, by the number write-in sub- request bag number mark.

14. the read-write processing unit of the internal storage data according to claim 12 or 13, it is characterised in that

The judging unit includes：

The processing unit also includes：

3rd mark module, puts for extracting the mark of the destination node in the sub- request bag, and by destination node mark In the public packet header of the merging request bag.

15. the read-write processing unit of the internal storage data according to claim 12 or 13, it is characterised in that the judging unit Including：

First searching modul, for according to the destination node memory address, the destination node to be searched in address attribution table The destination node mark of memory address ownership, the address attribution table is pair that purpose node memory address is identified with destination node Answer relation table；

16. the read-write processing unit of internal storage data according to claim 14, it is characterised in that the processing unit is obtained The sub- request bag that includes of the merging request bag include write request attached bag and/or read request attached bag, write request attached bag packet header Include recognizing that the write request information in the write request mark of the write request attached bag, the write request attached bag includes institute to be written The data and the destination node memory address to be written of destination node are stated, it is described that read request attached bag packet header includes identification Read request information in the read request mark of read request attached bag, the read request attached bag includes the mesh residing for data to be read Node memory address, described device also includes：

Receiving unit, is wrapped for receiving in the write request response message that the destination node is sent, the write request response message Containing write request, successfully the corresponding write request of the write request attached bag is identified；And/or, sent for receiving the destination node The read request successfully corresponding read request of the read request attached bag is included in read request response message, the read request response message Mark, and the payload read, the payload are the corresponding data of the read request attached bag medium-long range memory address.

17. the read-write processing unit of the internal storage data according to any one of claim 12,13,16, it is characterised in that described Judging unit also includes：

Second searching modul, for according to the corresponding destination node mark of each described request bag to be sent, looking into the routing table The destination node is looked for identify corresponding routed port, the routing table identifies corresponding route end comprising the destination node Mouthful, the routed port reaches the port on the path of the destination node for the request bag to be sent；

18. a kind of read-write processing unit of internal storage data, it is characterised in that including：

Receiving unit, for receiving request bag；

Whether merging bag mark is carried in judging unit, the request bag for judging reception, and mark is wrapped in the merging to be used to indicate The request bag is the merging request bag of at least two sub- request bag combinations, and the sub- request bag includes：Read request attached bag, and/ Or write request attached bag；

Determining unit, for when carrying merging bag mark in the request bag, determining the request bag to merge request bag, institute Stating merging request bag is included in public packet header and sub- request bag, the public packet header comprising merging bag mark, sub- request bag Number mark and source node identification, the sub- request bag number are identified for indicating the sub- request bag that the merging request bag is carried Number, the sub- request bag includes sub- request bag packet header and sub- solicited message；

Extraction unit, for according to the sub- request bag number mark and every sub- request bag bag carried in the merging request bag Head, extracts the sub- request bag merged in request bag with the corresponding number of the sub- request bag number mark；

19. the read-write processing unit of internal storage data according to claim 18, it is characterised in that the processing unit bag Include：

First processing module, for write request mark, the write request of the write request attached bag in write request attached bag packet header The data to be written are write the purpose section by data to be written and destination node memory address to be written in information Point memory address；

Second processing module, the reading for the read request mark in read request attached bag packet header, and the read request attached bag The destination node memory address residing for data to be read in solicited message, reads described in the destination node memory address Data to be read.

20. the read-write processing unit of internal storage data according to claim 19, it is characterised in that described device also includes：

Writing unit is identified, for the source node identification to be write in the sub- request bag packet header of every sub- request bag, in order to The destination node sends response message to the source node.

21. the read-write processing unit of internal storage data according to claim 20, it is characterised in that

The judging unit, is additionally operable to judge whether each corresponding source node identification of response message to be sent is identical；

The processing unit, is additionally operable to disappear the response message to be sent with identical source node identification as sub- response Breath, is packaged as a merging response message bag, and the merging response message bag includes the sub- response message of write request and/or reads to ask Seek sub- response message；

Described device also includes：

22. the read-write processing unit of internal storage data according to claim 18, it is characterised in that when destination node is route During port, the processing unit is additionally operable to extract the source node identification in the public packet header of the merging request bag, and write-in is each In the packet header of sub- request bag.