CN102082688A - Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware - Google Patents

Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware Download PDF

Info

Publication number
CN102082688A
CN102082688A CN2010106117487A CN201010611748A CN102082688A CN 102082688 A CN102082688 A CN 102082688A CN 2010106117487 A CN2010106117487 A CN 2010106117487A CN 201010611748 A CN201010611748 A CN 201010611748A CN 102082688 A CN102082688 A CN 102082688A
Authority
CN
China
Prior art keywords
order
tcp
software
connection
hardware
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010106117487A
Other languages
Chinese (zh)
Other versions
CN102082688B (en
Inventor
刘朝辉
纪奎
窦晓光
张英文
李静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dawning Information Industry Beijing Co Ltd
Dawning Information Industry Co Ltd
Original Assignee
Dawning Information Industry Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dawning Information Industry Beijing Co Ltd filed Critical Dawning Information Industry Beijing Co Ltd
Priority to CN201010611748.7A priority Critical patent/CN102082688B/en
Publication of CN102082688A publication Critical patent/CN102082688A/en
Application granted granted Critical
Publication of CN102082688B publication Critical patent/CN102082688B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a method for realizing management of a TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware. The hardware is responsible of the application and use of the out-of-order buffer, the software is responsible for the release of the out-of-order buffer, and the method comprises the following steps: using a hardware network card to receive an out-of-order TCP message, then applying for the out-of-order buffer, and notifying the software of an out-of-order TCP connection; and connecting the out-of-order buffer into a linked list in series when the software of an interface library processes the out-of-order TCP connection, and using the software to look up the linked list and notifying the hardware of releasing the buffer when the out-of-order buffer needs to be deleted. By adopting the method, the management of the large-capacity TCP out-of-order buffer is realized, and a TCP unloading system can perform out-of-order rearrangement on a high-speed network.

Description

A kind of software and hardware combining realizes the method for the out of order buffer management of TCP
Technical field
The present invention relates to the network data processing field, be specifically related to the method that a kind of software and hardware combining realizes the out of order buffer management of TCP.
Background technology
The TCP Unloading Technology is the TCP/IP network protocol stack in the host software to be handled to be cured in the network interface card hardware realize, so that reduce the cpu of system load, increases the technology of network I/O bandwidth.The TCP uninstalling system generally comprises two parts function, and first is the management of TCP connection status, shows to safeguard that with the TCP connection each TCP connects beginning, transfer of data, closing state.Second portion is the tcp data management, is used for the data of out of order TCP message are resequenced, and the data extract of TCP transmission is come out to submit to main frame.
When in hardware, carrying out the out of order rearrangement of TCP, need to use the out of order data of buffering area buffer memory, need complicated out of order buffer management mechanism, wherein the most important thing is the distribution and the release of out of order buffering area.
In the general TCP uninstalling system, hardware distributes at every turn and discharges out of order buffering area all will repeatedly visit plate and carry internal memory, particularly during the buffer release district, often need to search the oldest buffering area, the plate that is subject to hardware carries memory size and special chip clock frequency, the typical hardware system is difficult to realize searching efficiently, causes and can not manage jumbo out of order buffering area, is difficult to satisfy the out of order rearrangement requirement of tcp of express network.
Summary of the invention
The objective of the invention is to strengthen the out of order buffer management ability of TCP of hardware, make the out of order buffering area of the big capacity of TCP uninstalling system support by software.
A kind of software and hardware combining realizes the method for the out of order buffer management of TCP, may further comprise the steps:
After A, network interface card received the message of a TCP connection, out of order if message has taken place, then slave plate carried out of order buffering area of application in the internal memory, is used for the message of this connection is sorted;
B, network interface card are when the message that connects to this TCP of software transmission, and by a mark is set in the header of message, this connection of notice software has taken place out of order, has taken an out of order buffering area;
After C, interface library are received the message that out of order TCP connection takes place, this TCP connection is connected in series in the out of order TCP chained list, and the heap(ed) capacity of chained list is safeguarded;
D, when out of order TCP capacity surpasses the threshold value of systemic presupposition, interface library software is found out the out of order TCP that needs discharge and is connected from chained list, notice hardware discharges the out of order buffering area of this connection.
A kind of optimal technical scheme of the present invention is:
When software is searched the out of order buffering area that need to discharge in the described D step, can be by the oldest connection, methods such as minimum use connection are selected, and notice discharges the out of order buffering area of this connection.
The present invention has realized the out of order buffer management of large capacity I CP, makes the TCP uninstalling system can carry out out of order rearrangement on express network.
Description of drawings
Fig. 1 is that system of the present invention forms structure chart
Embodiment
Use the out of order buffering area that plate carries in the internal memory that out of order message is sorted in the hardware, in out of order buffer management process, hardware is responsible for the application and the use of out of order buffering area.
Software is set up the chained list of the out of order buffering area in using in application software api interface storehouse, out of order buffering area is managed, and software is responsible for the release of out of order buffering area.
Implementation method and process are as follows:
(1) the hardware network interface card receives out of order TCP message, applies for out of order buffering area.
After the hardware network interface card received the message of a TCP connection, out of order if message has taken place, then slave plate carried out of order buffering area of application in the internal memory, is used for the message of this connection is sorted.
(2) hardware network interface card notice software TCP connection has taken place out of order.
Hardware is when the message that connects to this TCP of software transmission, and by a mark is set in the header of message, this connection of notice software has taken place out of order, has taken an out of order buffering area.
(3) the out of order TCP of interface library software processes connects, notice hardware buffer release district.
After interface library is received the message that out of order TCP connection takes place, this TCP connection is connected in series in the out of order TCP chained list, and the heap(ed) capacity of chained list safeguarded, when out of order TCP capacity surpasses the threshold value of systemic presupposition, interface library software is found out the out of order TCP connection that needs discharge from chained list, such as the oldest connection or the connection of minimum use, notice hardware discharges the out of order buffering area of this connection.

Claims (2)

1. a software and hardware combining realizes the method for the out of order buffer management of TCP, it is characterized in that: may further comprise the steps:
After A, network interface card received the message of a TCP connection, out of order if message has taken place, then slave plate carried out of order buffering area of application in the internal memory, is used for the message of this connection is sorted;
B, network interface card are when the message that connects to this TCP of software transmission, and by a mark is set in the header of message, this connection of notice software has taken place out of order, has taken an out of order buffering area;
After C, interface library are received the message that out of order TCP connection takes place, this TCP connection is connected in series in the out of order TCP chained list, and the heap(ed) capacity of chained list is safeguarded;
D, when out of order TCP capacity surpasses the threshold value of systemic presupposition, interface library software is found out the out of order TCP that needs discharge and is connected from chained list, notice hardware discharges the out of order buffering area of this connection.
2. a kind of according to claim 1 software and hardware combining realizes the method for the out of order buffer management of TCP, it is characterized in that: during software searches that needs discharge in the described D step out of order buffering area, can be by the oldest connection, methods such as minimum use connection are selected, and notice discharges the out of order buffering area of this connection.
CN201010611748.7A 2010-12-17 2010-12-17 Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware Active CN102082688B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010611748.7A CN102082688B (en) 2010-12-17 2010-12-17 Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010611748.7A CN102082688B (en) 2010-12-17 2010-12-17 Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware

Publications (2)

Publication Number Publication Date
CN102082688A true CN102082688A (en) 2011-06-01
CN102082688B CN102082688B (en) 2014-08-13

Family

ID=44088445

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010611748.7A Active CN102082688B (en) 2010-12-17 2010-12-17 Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware

Country Status (1)

Country Link
CN (1) CN102082688B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114024924A (en) * 2022-01-05 2022-02-08 北京安博通科技股份有限公司 TCP stream recombination method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030172342A1 (en) * 2002-03-08 2003-09-11 Uri Elzur System and method for identifying upper layer protocol message boundaries
CN1679282A (en) * 2002-08-30 2005-10-05 美国博通公司 System and method for TCP offload
CN1985492A (en) * 2004-06-17 2007-06-20 美国博通公司 Method and system for supporting iSCSI read operations and iSCSI chimney
CN101253745A (en) * 2005-07-18 2008-08-27 博通以色列研发公司 Method and system for transparent TCP offload
CN101540720A (en) * 2008-06-06 2009-09-23 曙光信息产业(北京)有限公司 Zero-copy method for supporting link aggregation of multi-type network cards
CN101841545A (en) * 2010-05-14 2010-09-22 中国科学院计算技术研究所 TCP stream restructuring and/or packetizing method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030172342A1 (en) * 2002-03-08 2003-09-11 Uri Elzur System and method for identifying upper layer protocol message boundaries
CN1679282A (en) * 2002-08-30 2005-10-05 美国博通公司 System and method for TCP offload
CN1985492A (en) * 2004-06-17 2007-06-20 美国博通公司 Method and system for supporting iSCSI read operations and iSCSI chimney
CN101253745A (en) * 2005-07-18 2008-08-27 博通以色列研发公司 Method and system for transparent TCP offload
CN101540720A (en) * 2008-06-06 2009-09-23 曙光信息产业(北京)有限公司 Zero-copy method for supporting link aggregation of multi-type network cards
CN101841545A (en) * 2010-05-14 2010-09-22 中国科学院计算技术研究所 TCP stream restructuring and/or packetizing method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杜英明: "高速网络环境下基于零拷贝的报文捕获机制研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑(月刊)》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114024924A (en) * 2022-01-05 2022-02-08 北京安博通科技股份有限公司 TCP stream recombination method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN102082688B (en) 2014-08-13

Similar Documents

Publication Publication Date Title
CA2920748C (en) Ascertaining command completion in flash memories
CN105490985B (en) Method and device for realizing TCP long connection based on signaling transmission
US11966410B2 (en) System and method for providing a hybrid set-based extract, load, and transformation of data
WO2018121696A1 (en) Multi-thread processing method and device, and server
US8195613B2 (en) Transactional archiving of an electronic document
US20190068501A1 (en) Throttling for bandwidth imbalanced data transfers
US9357007B2 (en) Controlling storing of data
CN101178726B (en) Method to unarchive data file
WO2019062572A1 (en) Data processing method, device and system
CN104050276A (en) Cache processing method and system of distributed database
KR20150093673A (en) Database synchronization
CN104346401A (en) Method and device for message forwarding between components in cloud management platform
CN102255964B (en) Internet application software testing method and system
CN113722106A (en) Memory management method and device
CN110209341B (en) Data writing method and device and storage equipment
RU2645594C2 (en) Method and device for traffic management
CN102082688B (en) Method for realizing management of TCP (transmission control protocol) out-of-order buffer by means of combination of software and hardware
US8141103B2 (en) Solution for modifying a queue manager to support smart aliasing which permits extensible software to execute against queued data without application modifications
CN102904917A (en) Mass image processing system and method thereof
US20090106454A1 (en) Independent synchronization of meta-data between devices
KR20160091471A (en) In-memory Database System based on Circle-Queue and Data processing method thereof
CN102479211A (en) Mass data processing system and method on basis of database
US20100332678A1 (en) Smart nagling in a tcp connection
CN102750342A (en) Method for maintaining data consistency for cluster file system
CN102075416B (en) Method for realizing TCP (transmission control protocol) connection data buffer by combining software and hardware

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220802

Address after: 100193 No. 36 Building, No. 8 Hospital, Wangxi Road, Haidian District, Beijing

Patentee after: Dawning Information Industry (Beijing) Co.,Ltd.

Patentee after: DAWNING INFORMATION INDUSTRY Co.,Ltd.

Address before: 100084 Beijing Haidian District City Mill Street No. 64

Patentee before: Dawning Information Industry (Beijing) Co.,Ltd.