WO2003021436A2 - Selective offloading of protocol processing - Google Patents

Selective offloading of protocol processing Download PDF

Info

Publication number
WO2003021436A2
WO2003021436A2 PCT/GB2002/003968 GB0203968W WO03021436A2 WO 2003021436 A2 WO2003021436 A2 WO 2003021436A2 GB 0203968 W GB0203968 W GB 0203968W WO 03021436 A2 WO03021436 A2 WO 03021436A2
Authority
WO
WIPO (PCT)
Prior art keywords
protocol
network
offload
host
resident
Prior art date
Application number
PCT/GB2002/003968
Other languages
French (fr)
Other versions
WO2003021436A3 (en
Inventor
John William Hayes
Original Assignee
Archduke Design, Inc.
Jehan, Robert
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Archduke Design, Inc., Jehan, Robert filed Critical Archduke Design, Inc.
Priority to AU2002321567A priority Critical patent/AU2002321567A1/en
Publication of WO2003021436A2 publication Critical patent/WO2003021436A2/en
Publication of WO2003021436A3 publication Critical patent/WO2003021436A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/509Offload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level

Definitions

  • the present invention pertains to methods and apparatus for delegating computing resources and tasks in a network.
  • selected portions of a protocol processing task are dynamically offloaded to an auxiliary processor.
  • Memory bandwidth or CPU processing intensive tasks are then performed by the auxiliary processor to reduce the memory bandwidth or host CPU processing cycles consumed by performing the protocol processing task.
  • one preferred embodiment of the invention enables the offloading auxiliary processor to deposit incoming user data directly into the user's memory space, bypassing the placing of a copy of the data into the operating system's memory and thereby reducing the number of times the received data is copied, enabling a zero-copy architecture.
  • Another preferred embodiment enables the offloading auxiliary processor to transfer protocol processing back to the host CPU in the event of errors, low resources or other events that are not considered routine for the auxiliary processor to perform.
  • This capability allows one preferred embodiment to have less processing power or memory resources in the auxiliary processor and still perform the mainline or "fastpath" code efficiently without being burdened by having to maintain the slower and much more complex error handling and recovery routines which are then implemented back on the host CPU.
  • There may also be included a filtering function which enables the network interface to select between a plurality of protocol processing functions, which although they may perform the same protocol processing tasks, differ in how the tasks are distributed between the host CPU and an offloading auxiliary processor.
  • the present invention provides methods and apparatus for delivering selective offloading of protocol processing from a host computer to an offloading auxiliary processor.
  • Selective offloading of protocol processing enables a host to offload the most computationally intensive, memory bandwidth intensive and performance critical portions of the protocol processing task to an auxiliary processorwithout requiring the auxiliary processor to perform the full suite of functions necessary to perform a complete protocol processing offload.
  • This capability enables the offloading auxiliary processor to be built with fewer resources, and thus more inexpensively.
  • the offloading host will only offload the portions of the protocol processing task that the auxiliary processor can process. If the auxiliary processor is requested to perform an action that it is unable to perform, for any reason, it simply returns the request back to the host computer.
  • the request may be partially completed or not completed at all. This allows "fastpath" functions to be offloaded while more complex, but slower functions such as error handling, resequencing and lost packet recovery and retransmission to be handled by the host computer.
  • This also allows an auxiliary processor to be built with limited resources that allows it to offload only a specific number of tasks. When the host computer exceeds the capabilities of the auxiliary processor, the additional tasks are performed on the host computer. This enables the development of inexpensive auxiliary processors to accelerate protocol processing in computing environments that would otherwise not be served by protocol accelerating technology.
  • Each protocol processing task is offloaded individually, with the host computer regaining control at the end of each protocol processing task or sequence of tasks. This allows the auxiliary processor to maintain only the state information pertinent to the tasks that the auxiliary processor is currently performing. While the host regains control at the end of each task, multiple tasks and sequences of tasks may be chained together to minimize the need to resynchronize state information with the host computer.
  • the host computer includes information regarding the protocol to be offloaded. It is expected that the protocol will be a combination of protocols including the network protocol, the transport protocol and the application protocol. It can be any protocol or set of protocols in the seven layer ISO protocol reference model. When multiple protocols of different layers are taken together, each unique combination of protocols is treated as a separate protocol. This allows the underlying protocols to be tailored to the requirements of the application and the application protocol.
  • iSCSI internet SCSI
  • VIA Virtual Interface Architecture
  • Methods of constructing the auxiliary processor include adding network processors and memory to a NIC, adding network processors, memory and hardware state machines to a NIC or by adding hardware state machines and memory to a NIC. Additionally, in place of a NIC, this functionality can be placed on the main processor board or "motherboard" of the host computer, or embedded within the I/O subsystem.
  • FIGS. 1 & 2 provide illustrations which help explain the basic concepts comprising the present invention.
  • Figure 3 is an illustration which shows the relationship between computers C, a computer network E, a network router R, a network switch S and a network attached storage system D.
  • Figure 4 is an illustration which shows the relationship between a computer C and an associated user U, a computer network E, and a network attached storage system D.
  • FIG. 5 is an illustration which shows Internet Protocol (IP) header.
  • IP Internet Protocol
  • FIG 6 is an illustration which shows the Transmission Control Protocol (TCP) header.
  • Figure 7 is an illustration which shows the relationship between the network interface NIC, the computer network E and other primary components of a computer C including the central processor CPU, the memory controller MC and the memory M.
  • TCP Transmission Control Protocol
  • Figure 8 is an illustration of a classical architectural model of host based protocol processing function.
  • Figure 9 is an illustration of a full protocol processing offload model.
  • Figure 10 is a schematic illustration of the invention.
  • Figure 11 is flow chart of a basic embodiment of a selective offloading protocol process.
  • Figure 12 is detailed flow chart of a selective offloading protocol process.
  • Figure 13 shows selective offloading of a protocol process to a host network interface device driver function within a selective protocol offloading system.
  • Figure 14 shows selective offloading of a protocol process to a host resident offload protocol device driver function within a selective protocol offloading system.
  • Figure 15 shows selective offloading of a protocol process to an AP resident offload protocol device driver function within a selective protocol offloading system.
  • a request is first sent to the remote computer which "hosts" the website.
  • This request contains specific information about how the content is to be transported from the host computer to the ISP, and then finally to the person requesting the information.
  • Much of this initial request pertains to a determination of the "application protocol” that will be used to convey information from the host computer to the user's computer.
  • a protocol is a predetermined standard or agreement that establishes the rules of exchange between or among computers. For example, when motorists all stop at a red "STOP" signs when they reach an intersection, they are obeying a protocol or rule that has been established to ensure a safe flow of traffic.
  • the Internet generally runs on aprotocol called 'TCP/IP," which stands for Transmission Control
  • TCP/IP includes two protocols, TCP and IP .
  • IP IP
  • Most simple transactions that use the Internet are governed by TCP/IP.
  • An example of an application protocol utilized by the present invention is called "iSCSI.”
  • iSCSI Internet SCSI (Small Computer System Interface) is an application layer Internet Protocol networking standard for linking data storage facilities.
  • SCSI Small Computer System Interface
  • iSCSI Internet SCSI (Small Computer System Interface) is an application layer Internet Protocol networking standard for linking data storage facilities.
  • iSCSI is used to facilitate data transfers over intranets, and to manage storage over long distances.
  • the iSCSI protocol is among the key technologies expected to help bring about rapid development of the storage area network (SAN) market, by increasing the capabilities and performance of storage data transmission.
  • SAN storage area network
  • iSCSI can be used to transmit data over local area networks (LANs), wide area networks (WANs), or the Internet and can enable location-independent data storage and retrieval.
  • Every computer that hosts a webpage has a limited amount of hardware, software and storage space, and, as a consequence, a limited amount processing capacity that is available for fulfilling requests for information, files or images from users.
  • User requests are conveyed to a host computer over the Internet. Once they arrive at the host, they are generally answered in order, and the host processes each request and sends back a reply to each user.
  • Factory No. 1 all the resources of the factory are utilized to accomplish all the steps needed to fulfill requests from many users.
  • Factory No.2 which employs the concepts of division of labor, delegation of tightly-defined work functions, and outsourcing, produces more products using the same set of resources. This is true because the delegation of certain tasks to workers outside the main plant frees up workers, equipment and other resources inside the big building to concentrate on what they do best- manufacturing the product that the customer has ordered. The people in the Receiving and Shipping Stations support this effort by doing their own limited jobs well, and keeping the stream of large boxes of finished merchandise flowing to happy customers.
  • the small cartons of raw materials delivered to the factories are somewhat like the requests for webpages generated by computer users connected to a network like the Internet.
  • the factories resemble a host computer that stores web pages that users would like to view or download.
  • the large boxes of finished goods leaving a factory represent the content that is dispatched over the network back to the origin of a request.
  • the primary computing system which comprises both hardware and software. These functions are re-assigned to supporting hardware software, which are specially configured to perform sharply defined and limited tasks.
  • the outsourcing of precisely segmented computing capabilities frees up resources in the primary hardware and software, and enhances the entire system. As a result, more users are cared for at a higher level of service employing the same set of hardware and software assets.
  • the present invention furnishes a solution for augmenting the service capacity of a host in a network.
  • a set of protocol processing tasks which are normally furnished by the host, are generally delegated to auxiliary processor. These protocol processing tasks generally involve interpreting the requests for data as they arrive from many users.
  • This new auxiliary processor supports the efforts of the primary hardware and software within the host computer, and may take the form of a new "card” or “blade” that sits on the motherboard of the host computer. Just like the owner of a personal computer can insert a new hardware component like a network, printer or port adapter into the main motherboard of his or her computer, the new invention offers a way to augment the host computer to make it work better.
  • the new auxiliary processor may be reduced to an application-specific integrated circuit (ASIC) or some other chip which is added to the host computer, ⁇ .
  • ASIC application-specific integrated circuit
  • the auxiliary processor offloads the reception of iSCSI data over the TCP/IP network protocol, performing all necessary TCP/IP functions that occur during the normal course of a TCP/IP receive operation and all necessary iSCSI data movement functions. In the event of an error or other exceptional condition, the auxiliary processor transfers control back to the offloading host to handle the condition.
  • the auxiliary processor offloads the transmission of "iSCSI" data over the TCP/IP network protocol, performing all necessary TCP/IP functions that occur during thenormal course of a TCP/IP transmit operation and all necessary iSCSI data movement functions. In the event of an error or other exceptional condition, the auxiliary processor transfers control back to the offloading host to handle the condition.
  • the protocol may be a combination of protocols including the network protocol, the transport protocol and the application protocol.
  • the offloaded protocols can be any protocol or set of protocols in the seven layer ISO protocol reference model. This protocol may be identical to one of the set of protocols in the seven layer ISO set, or may be a variation, which, while not identical, is generally logically consistent with one of the original seven layer ISO protocols. Examples of this include IP and TCP, which correspond to layers three and four, respectively. When multiple protocols of different layers are taken together, each unique combination of protocols is treated as a separate protocol. This capability allows the underlying protocols to be tailored to the requirements of the application and the application protocol. The additional protocols are described below in the following sections.
  • the first is that the selective offloading of protocol processing offloads the protocol processing tasks in a per application basis.
  • Previous systems use an all or nothing approach, and performs protocol offload on a per protocol basis.
  • the semantics of each application protocol are different, and even though they may use the same underlaying network and transport protocols, may see wildly differing performance improvements.
  • Using the selective offloading of protocol processing allows the protocol offload to be performed where it gives the greatest benefit, without requiring it to perform protocol offload for application that do not benefit from it.
  • the second key reason why the selective offloading of protocol processing is a technological advance is that it does not affect the design of the existing host based protocol stack.
  • a host protocol stack is provided by the operating system vendor.
  • Most operating systems are closed source, meaning that the code that instructs the computer how to run is kept tightly controlled by the operating system vendor. Because of this control, it is very difficult to modify the protocol stack.
  • the only areas that a software engineer can safely add code is at the specific interfaces defined by the operating system vendor. This is usually limited to device driver and application interfaces. Trying to reverse engineer a protocol stack and add functionality usually causes instability within the protocol stack.
  • the fourth key reason why the selective offloading of protocol processing is a technological advance is that it maintains the same network (IP) address that is used by the host protocol stack and does not require the allocation of additional network addresses.
  • IP network
  • the offload protocol stack has its own network address. When a new network address is used, all of the remote devices must be administered to allowthe newprotocol address to access the device. With the selective offloading of protocolprocessing, which uses the same network address as the host protocol stack, this administrative burden is removed.
  • the last key reason why the selective offloading of protocol processing is a technological advance is that allows the host protocol stack to use the same MAC and PHY interface on the selective offload apparatus. This enables all of the legacy applications, management and diagnostic tools to use the MAC and PHY portions of the selective offload network interface. This preserves the investment that has already been made in these applications and tools and provided a straightforward migration path. Conversion from a host based protocol stack to the selective offload protocol stack is transparent to the applications and remote devices. The only application experiences a different behavior is the application or applications that have been explicitly selected for the selective offloading of protocol processing. None of the prior art addresses all of these issues.
  • Figure 3 generally illustrates the embodiments of a computer network 10 to which the present invention pertains as Selective Offloading of Protocol Processing from computers 12a-12n.
  • a computer 12a is attached to the computer network 14.
  • the computer 12 is capable of communicating with other network routers 18, network switches 20, network storage devices 16, and other computers 12, such as computers 12b-12n.
  • Figure 4 is an illustration 22 which shows the relationship between a computer 12 and an associated user U, a computer network 14, and a network attached storage system D.
  • the computer 12 shown in Figure 4 typically comprises a processing system 28, and comprises one or more applications 30.
  • the computer 12 is connected to the network 14 through a network connection 24 and a network interface
  • NIC network interface card
  • a network destination computer 16 is also connected to the network 14, through a network connection 32. Communication between the computer 12 and the network storage computer 16 is typically accomplishedthrough one or more established protocols, such as the TCP protocol for transport services, such as RFC-793, and/or the IP protocol for network services, such as RFC-791.
  • Figure 5 is a schematic diagram of an IP (Internet Protocol) header 40.
  • the IP header 40 is defined by RFC 791 and typically comprises several fields, including a Source Address 42, a Destination
  • IP header is examples of elements of the protocol, or protocol elements.
  • a protocol element is any field or string of data that is included within received data.
  • FIG. 6 is a schematic diagram of a TCP (Transmission Control Protocol) header 70.
  • the TCP header is defined in RFC 793. It typically comprises several fields, including a Source Port SP 72, a Destination Port DP 74, a sequence number 76, an acknowledgment number 78, a data offset 80, a reserve field 82, TCP flags 84, a window 86, a checksum 88, and an urgent pointer 90.
  • TCP Transmission Control Protocol
  • Figure 7 illustrates the relationship between the network interface NIC 26, the computer network
  • a computer network 14 is connected to a network interface NIC 26.
  • An auxiliary processor AP 102 is co-located with the network interface NIC 26.
  • a network interface NIC 26 is connected to a computer 12 via an I/O interface 104.
  • the I/O interface 104 is connected to the memory controller 106.
  • a memory controller 106 is connected to the memory 108 andthe processor 28 of computer
  • Figure 8 is a schematic depiction showing the current model of host based protocol processing as it is usually performed in a modem computer 12.
  • a computer network 14 is connected to a network interface 26a, which is connected to a computer 12.
  • a network interface device driver function 114 communicates with the NIC 26, and with an IP protocol processing function 116.
  • the IP protocol processing function 116 communicates with a TCP protocol • processing function 118 and the network interface device driver 114.
  • a network application 120 communicates with the TCP protocol processing function 118.
  • Each of the layered functional blocks 122 comprises a network device driver function 114, an IP protocol processing function 116, and TCP protocol processing function 118 has a specific function that it performs for all data that is passed to it by the layers above and below which defines a classical arrangement of host based network protocol processing.
  • FIG. 9 is a schematic depiction showing the current model of full protocol processing offload to an auxiliary processor 132.
  • a computer network 14 is connected to a full offload network interface NIC
  • a full offload auxiliary processor 132 is co-located with the full offload network interface NIC 26b.
  • the full offload network interface NIC is connected to a computer 12.
  • an offload network interface device driver function 134 communicates with the NIC 26b and with an IP protocol processing function 136.
  • the IP protocol processing function 136 communicates with a TCP protocol processing function 138 andthe offload network interface device driver function 134.
  • a TCP protocol processing function 138 communicates with the IP protocol processing function 136 and the auxiliary processor resident host offload interface function 140.
  • the auxiliary processor resident host offload interface function 140 communicates with the TCP protocol processing function 138 and the host resident host offload interface function 142.
  • the host resident host offload interface function 142 communicates with the auxiliary processor resident host offload interface function 140 and the network application 120.
  • each layer 114, 116, 118 of the protocol processing stack 122 from Figure 9 has moved from operating in the host operating system 112 of computer 12 to operating in the full offload auxiliary processor 132 of the network interface 26b.
  • the offloading system 130 shown in Figure 9 accomplishes the desired result of offloading the protocol processing from the host processor 12, it requires that all network functions and requirements be fully implemented in the offloading auxiliary processor 132.
  • the resource requirements, including the buffering of data is relatively small.
  • network errors and other conditions occur such as dropped or lost packets, the receipt of packets out of sequence, or the receipt of fragmented data, the resources consumed rise dramatically.
  • FIG. 10 is a schematic depiction of an embodiment of the present invention 150 which employs a selective offloading auxiliary processor 152.
  • a computer network 14 is connected to a physical interface function 168 of the network interface 26c.
  • a physical interface function 168 receives data from a computer network 14 and sends it to a filtering function 174.
  • a physical interface function 168 receives data to transmit to a computer network 14 from a host network interface device driver function 114, a host resident offload protocol device driver function 160 and an AP resident offload protocol device driver function 170.
  • a filtering function 174 receives inbound data from a physical interface function 168, and selects an appropriate device driver to send the received data to for processing.
  • a filtering function 174 selects between a host network interface device driver function 114, a host resident offload protocol device driver function 160 or an AP resident offload protocol device driver function 170.
  • a host network interface device driver function 114 sends outbound data to a physical interface function 168 and inbound data to an IP protocol processing function 116.
  • the same host network interface device driver 114 receives inbound data from a filtering function 174 and outbound data from an IP protocol processing function 116.
  • An IP protocol processing function 116 communicates with a TCP protocol processing function 118 and a host network interface device driver 114.
  • TCP protocol processing function 118 communicates with the TCP protocol processing function 118.
  • An AP resident offload protocol stack device driver function 170 sends outbound data to a physical interface function 168 and inbound data to an AP resident offload task interface function 154.
  • the same AP resident offload protocol stack device driver function 170 receives inbound data from a filtering function 174 and outbound data from an AP resident offload task interface function 154 and AP resident IP protocol offload function 156.
  • An AP resident offload task interface function 154 receives inbound data from an AP resident offload protocol stack device driver function 170 and a host resident offload task interface function 162.
  • the same AP resident offload task interface function 154 sends outbound data to an AP resident offload protocol stack device driver function 1 0 and inbound data to an AP resident IP offload function 156 or a host resident offload task interface function 162.
  • An AP resident IP offload protocol processing function 156 receives inbound data from an AP resident offload task interface function 154 and receives outbound data from an AP resident TCP offload protocol processing function 158.
  • the same AP resident IP offload protocol processing function 156 sends inbound data to an AP resident TCP offload protocol processing function 158 and sends outbound data to an AP resident offload protocol stack device driver function 170.
  • An AP resident TCP offload protocol processing function 158 communicates with an AP resident IP offload protocol processing function 156, an AP resident offload task interface function 154 and an AP resident Application protocol offload processing function 159.
  • An AP resident Application protocol offload processing function 159 communicates with an AP resident TCP protocol offload processing function 158 and an AP resident offload task interface function 154.
  • a host resident offload protocol stack device driver function 160 sends outbound data to a physical interface function 168 and sends inbound data to the host resident IP protocol offload processing function 1 4. The same host resident offload protocol stack device driver function 160 receives inbound data from a filtering function 174 and receives outbound data from host resident IP protocol offload processing function 164.
  • a host resident IP protocol offload processing function 164 communicates with a host resident TCP protocol offload processing function 166, a host resident offload protocol stack device driver function 1 0, and a host resident offload task interface function 162.
  • a host resident TCP protocol offload processing function 166 communicates with a host resident IP protocol offload processing function 164, a host resident offload task interface function 162 and a host resident Application protocol offload processing function 167.
  • a host resident Application protocol offload processing function 167 communicates with a host resident TCP protocol offload processing function 166 and a host resident task interface function 162.
  • a host resident offload task interface function 162 communicates with an AP resident offload task interface function 154, a host resident IP protocol offload processing function 164, a host resident TCP protocol offload processing function 166, a host resident Application protocol offload processing function 167 and the network application 172.
  • protocol state information is passedbetween the host resident task interface function 1 2, the host resident Application protocol offload processing function 167, the host resident TCP offload protocol processing function 166 and the host resident IP offload protocol processing function 1 4.
  • the host resident task interface function 162 is responsible for maintaining the protocol state information in the host.
  • Protocol state information is also passed between the AP resident task interface function 154, the AP resident Application protocol offload protocol processing function 159, the AP resident TCP offload protocol processing function 158 and the AP resident IP offload protocol function 156.
  • the AP resident task interface function 154 is responsible for maintaining the protocol state information in the auxiliary processor 152.
  • Protocol state information is passed between the host computer 12 and the auxiliary processor 152 by the host resident task interface function 162 and the AP resident task interface function 154 respectively.
  • the protocol service state info ⁇ nation includes the task request from the network application 172, state information describing the connection that was previously established and initialized, if the request pertains to a previously established connection and information to support the communications and synchronization between the host resident offload task interface function 162 and the AP resident offload task interface function 154.
  • IP network layer
  • TCP transport layer
  • an Ethernet frame is received from the Ethernet media E by the NIC 26 and is passed, unmodified, to the device driver 114.
  • the device driver 114 strips away the Ethernet header and passes the IP packet to the IP protocol processor 116.
  • the IP protocol processor 116 validates the given IP packet and strips off the IP header and passes the resulting
  • each protocol processing function is limited in its scope and when receiving network data from the NIC 26, only receives data from the layer below it and sends data to the layer above it. It does not look further into the data.
  • the NIC 26 must be aware of the existence of multiple sets of protocol processing functions, otherwise known as parallel protocol processing stacks.
  • a filter 174 selecting which protocol stack to use on the basis of the application protocol and not solely on the destination media access control (MAC) address or the destination network address of the received network data enables the network protocol offload function to intelligently select which network protocol(s) are offloaded and to which network protocol processing stack the received network data is sent to for processing. This completes the enabling of the selective network protocol offload functionality.
  • application aware filtering in the network interface allows an incoming network data to be sent to the standard host based network protocol processing function, the AP resident offload protocol processing function, the host resident offload protocol processing function, or another, application specific protocol processing function.
  • a network application running on a computer 12 must establish a connection and retrieve data from the network attached storage system 16.
  • network application 172 sends a request to a host resident offload task interface function 162 to open a TCP connection and perform application specific initialization with a network attached storage device 16.
  • Network application 172 is able to make this request using a host resident offload task interface function 162, because the AP and host resident TCP and +Ap ⁇ lication protocol processing functions 166, 158, 167, 159 are able to offload the network and application protocols that network application 172 uses.
  • the task of establishing a new TCP connection and performing application specific initialization is considered a complex task that should not be offloaded to the auxiliary processor.
  • a host resident offload task interface function 162 calls a host resident TCP protocol offload processing function 166 with a protocol service request.
  • a protocol service request includes the task request from the network application 172, the information describing the connection, and information to support the communications and synchronization between a host resident offload task interface function 162 and an AP resident offload task interface function 154.
  • the host resident TCP protocol offload processing function 166 performs the requested task, making calls to a host resident IP protocol processing function 164 which, in turn, performs the requested task, making calls to a host resident offload protocol stack device driver fimction 160.
  • a host resident offload protocol stack device driver function 160 calls a physical interface function 168 and receives data from a filtering function 174.
  • the AP resident task interface 154 takes the given TCP state information and passes it to the AP resident TCP protocol offload function 158. Once the state information has been transferred, the AP resident task interface 154 indicates the completion of the state transfer to the host resident task interface 162. A host resident task interface function 162 then notifies a network application 1 2. Now that the connection between computer 12 and network attached storage 16 has been established and initialized, network ap lication 172 calls a host resident offload task interface function 162 requesting that data be sent to network attached storage 16.
  • the host resident offload task interface function 162 recognizes that this task is most efficiently accomplished by offloading it to an auxiliary processor 152, and calls an AP resident offload task interface function 154 with a protocol service request.
  • a protocol service request includes the request from the network application 172, the information describing the connection that was previously established and initialized and information to support the communications and synchronization between a host resident offload task interface function 1 2 and an AP resident offload task interface function 154.
  • An AP resident offload task interface function 154 upon receiving and accepting this request forwards the request to an AP resident Application protocol offload processing function 159.
  • An AP resident Application protocol offload processing function 159 performs the requested task, making calls to an AP resident TCP protocol processing function 158.
  • An AP resident TCP protocol processing function 158 performs its function and calls an AP resident IP protocol processing function 156 which, in turn, performs the requested task, making calls to an AP resident offload protocol device driver function 170.
  • An AP resident offload protocol device driver function 170 calls aphysicalinterface function
  • an AP resident task interface function 154 notifies a host resident offload task interface function 162, by passing back a protocol service response.
  • a host resident offload task interface function 162 notifies a network application 172.
  • a network application 172 calls a host resident offload task interface function 162 requesting that a specific piece of data be read from the network attached storage 16.
  • a host resident offload task interface function 1 2 recognizes that this task is most efficiently accomplished by offloading it to the auxiliary processor 152, and calls an AP resident offload task interface function 154 with the protocol service request.
  • An AP resident offload task interface function 154 upon receiving and accepting this request forwards the request to an AP resident Application protocol offload processing function 158.
  • An AP resident Application protocol offload processing function 158 performs the requested task, making calls to an AP resident TCP protocol processing function 158.
  • An AP resident TCP protocol processing function 158 performs its function and calls an AP resident IP protocol processing function 156 which, in turn, performs the requested task, making calls to an AP resident offload protocol device driver function 170.
  • An AP resident offload protocol device driver function 170 calls a physical interface function 168 and receives data from a filtering function 174.
  • an AP resident TCP protocol offload processing function 158 detects that some of the data segments have been dropped.
  • a full network protocol stack is required to collect the segments that have been received and acknowledge those up until the first dropped segment.
  • the subsequent segments must be held, unacknowledged, until the missing segment(s) are received. Retaining these segments consume storage resources in the auxiliary processor 152.
  • an AP resident TCP protocol offload processing function 158 notifies an AP resident task interface function 154 of the loss by passing back a protocol service response for the TCP connection and a protocol service response for the Application task request.
  • An AP resident task interface function 154 notifies a host resident offload task interface function 162, by passing back the protocol service responses.
  • a host resident offload task interface function 162 passes this protocol service responses to a host resident TCP protocol offload processing function 166 and a host resident application protocol processing function 167 to complete. The error recovery and the remainder of the original task is performed by a host resident Application and TCP protocol offload processing functions 166 and 167.
  • the host resident Application protocol offload processing function 166 notifies a host resident offload task interface function 162, by passing back a protocol service response.
  • a host resident offload task interface function 162 then notifies a network application 172. If the given TCP connection is to be reused and the error recovery has been completed, the TCP connection state can again be transferred from the host resident TCP protocol offload function 166 to the AP resident TCP protocol offload processing function 158. This demonstrates how fast path tasks can be easily offloaded to an auxiliary processor, without burdening them with error recovery and exceptional condition processing abilities.
  • Examples of errors and exceptional conditions that should be handled by the host resident portion of the network protocol processing offload functions include IP reassembly, TCP resequencing, lost first packet of a fragmented TCP segment, lost TCP acknowledgments, lost packet containing application framing information, out of order TCP segments where the first TCP segment contains application framing data and other situations where due to the nature of the data that is lost or reordered, some user data must be stored for use later. This greatly reduces the buffering and storage requirements of the auxiliary processor.
  • a network application 172 calls a host resident offload task interface function 162 requesting that data be sent to network attached storage 16.
  • a host resident offload task interface function 162 recognizes that this task is most efficiently accomplished by offloading it to an auxiliary processor 152, and calls an AP resident offload task interface function 154 with the protocol service request.
  • An AP resident offload task interface function 154 receives the request, but because of a shortage of resources, is unable to execute the requested task.
  • An AP resident offload task interface function 154 notifies a host resident offload task interface function 162, by passing back a protocol service response indicating that the protocol service request was rejected due to lack of resources.
  • the host resident offload task interface function 162 upon receiving a protocol service response indicating a lack of resources, passes the request to a host resident Application protocol offload processing function 167 for execution.
  • Resources that may cause task rejection may include frame buffer space, data frame descriptor space, CPU utilization, task descriptor space, host I O interface bandwidth, and network interface bandwidth.
  • an intelligent filtering function is required to enable the functionality of Selected Offloading of Protocol Processing.
  • the filtering rules that control the operation of a filtering function 174 must be able to be manipulated during the course of operation.
  • these filter rule manipulations include the ability to atomically add, delete and modify individual rules.
  • these filter rule manipulations only require that an enable bit be atomically settable and resettable, with other functions being non-atomic.
  • the size of the rule filter must accommodate the number of active tasks of the given application protocol plus a default rule to match the application and a second default rule for all non-matching traffic.
  • a much smaller rule table can be used to differentiate between offloadable application network traffic and non-offloadable network traffic.
  • the rules are composed of a plurality of single rules. This plurality of single rules can be combined logically to form a plurality of complex rules.
  • the logical operations used for combining a plurality of single mles into a complex rule include AND, OR, NOT, NAND, and NOR.
  • the filtering function must be able to match the desired network address, the desired TCP application protocol number and be able to look into the application headers far enough to filter on the application framing data.
  • the filtering function must be able to use protocol elements to match at least on the desired network address and the desired TCP application protocol number.
  • the filtering function should be able to use protocol elements to compare the rules against any layer of the ISO reference protocol stack model.
  • the filtering function must be able to specify which of a plurality of sets of protocol processing functions should receive and process the received network data.
  • the auxiliary processor function may be constructed using a processor or processors, memory, an interface to the physical network interface and an interface to the host I/O interface.
  • the various auxiliary processor resident functions are implemented in this embodiment as firmware functions that are executed by the processor or processors.
  • some of the repetitive protocol processing functions may be implemented using state machines in hardware in addition to the processor or processors, memory, physical network interface and host I/O interface.
  • the form of this hardware may be gate arrays, programmable array logic (PALs), field programmable gate arrays (FPGAs), Application Specific Integrated Circuits (ASICs), quantum processors, chemical processors or other similar logic platforms.
  • the various auxiliary processor resident functions are implemented in this embodiment as a combination of firmware functions that are executed by the processor or processors and hardware functions that are utilized by the processor or processors.
  • a more highly integrated system may be created by combining computer chips that previously resided on different boards on a single board.
  • functions that previously resided in multiple computer chips may be combined into fewer chips or a single chip.
  • the invention encompasses any method of incorporating selective offloading of protocol processing.
  • auxiliary processor In an alternative preferred embodiment of the auxiliary processor function, the entire auxiliary processor may be implemented using hardware.
  • the various forms of hardware are listed above
  • the network interface may be implemented as a card, designed to plug into the host computer's I/O interface such as a Peripheral
  • PCI Component Interconnect
  • PCI-X PCI-X interface
  • InfiniBand This may be extended to any wired, wireless or optical interface.
  • An embodiment of this type lets the network interface be installed after the computer has been manufactured.
  • the network interface may be implemented as a single ASIC which may be mounted on the motherboard of the computer at the time of manufacture.
  • the network interface may be implemented as a logic component of the I/O subsystem of the host computer.
  • other logic components may be combined with the offload NIC functionality in a highly complex ASIC.
  • the network interface may be implemented as a logic component of the memory subsystem of the host computer.
  • other logic components may be combined with the offload NIC functionality in a highly complex ASIC.
  • apparatus for selectively offloading of a protocol processing function comprising a host computer 12; an auxiliary processor 152 coupled to said host computer 12; a host protocol stack composed of a set of protocol processing functions which include a network protocol processing function 116, a transport protocol processing function 118 and an application protocol processing function 120 residing on said host computer 12; a host resident offload protocol stack composed of a set of protocol processing functions which include a host resident network protocol offload processing function 164, a host resident transport protocol offload processing function and a host resident application protocol offload processing function 162 residing on said host computer 12; an auxiliary processor resident offload protocol stack composed of a set of protocol processing functions which include an auxiliary processor resident network protocol offload processing function 156, an auxiliary processor
  • the host computer 12 is capable of requesting that a task be performed using said host protocol stack, of requesting that a task be performed using said host resident protocol offload stack, of requesting that a task be performed using said auxiliary processor resident protocol offload stack.
  • the auxiliary processor 152 is capable of performing offload protocol processing at the request of said host computer 12, of returning a completion status of said protocol processing task to said host computer 12.
  • the filtering function 174 is capable of selecting the correct set of protocol processing functions.
  • the teachings herein can also provide apparatus for selectively performing protocol processing that utilizes a plurality of sets of protocol processing functions that differ primarily in the locality of where the protocol processing is performed which is composed of the following localities:
  • a host protocol stack composed of a set of protocol processing functions which include a network protocol processing function 2, a transport protocol processing function 3 and an application protocol processing function 4 which reside on a host computer 12;
  • a host resident offload protocol stack composed of a set of protocol processing functions which include a host resident network protocol offload processing function 164, a host resident transport protocol offload processing function and a host resident application protocol offload processing function 166 which reside on a host computer 12;
  • auxiliary processor resident offload protocol stack composed of a set of protocol processing functions which include an auxiliary processor resident network protocol offload processing function 156, an auxiliary processor resident transport protocol offload processing function and an auxiliary processor resident application protocol offload processing function 158 which reside on an auxiliary processor 152.
  • the teachings also provide for a method of selecting one set of protocol processing functions from a plurality of sets of protocol processing functions for a given packet of network data which contains a set of protocol elements that uniquely defines the network connection, which method includes the steps of: comparing saidprotocol elements against apluralityofunique sets ofprotocol elements in filtering function
  • said plurality of unique sets of protocol elements containing a designator of a set of rotocol processing functions in filtering function 174; when a match occurs between the protocol elements in the given packet and a set ofprotocol elements selected from a plurality of unique sets ofprotocol elements, passing the given packet to the set ofprotocol processing functions indicated by the designator contained within the matched set ofprotocol elements; when a match does not occur between the protocol elements in the given packet and the plurality of unique sets ofprotocol elements, passing the packet to a default set ofprotocol processing functions.
  • the teachings herein also provide for a method of transferring state information between two sets ofprotocol processing functions for the purpose of transferring the locality of the protocol processing from the host resident offload protocol processing set of functions to the auxiliary processor resident offload protocol processing set of functions including the steps of: given a set of host resident offload protocol processing functions 164, 166, a set of auxiliary processor resident offload protocol processing functions 158, 156 , a task interface 162, 154, a filtering function 174 and an application 172; said application 172 utilizes network connection identifier elements to uniquely identify the given network connection, the network connection identifier elements being composed of the following set ofprotocol elements: a network protocol source address SA, a network protocol destination address DA, a transport protocol source port 72 and a transport protocol destination port 74; said application 172 instructs the task interface 162 to transfer the protocol processing of the said network connection from the host resident offload protocol processing functions 164, 166 to the auxiliary processor resident offload protocol processing functions 158, 156; said task
  • the teachings herein also provide for a method of rejecting the transferring of state information between two sets ofprotocol processing functions including the steps of: given a set of host resident offload protocol processing functions 164, 166, a set of auxiliary processor resident offload protocol processing functions 158, 156, a task interface 162, 154, a filtering function 174 and an application 172; said application 172 utilizes network connection identifier elements to uniquely identify the given network connection.
  • the network connection identifier elements are composed of the following set ofprotocol elements: a network protocol source address SA, a network protocol destination address DA, a transport protocol source port 72 and a transport protocol destination port 74; said application 172 instructs the task interface 162 to transfer the protocol processing of the said network connection from the host resident offload protocol processing functions 164, 166 to the auxiliary processor resident offload protocol processing functions 158, 156; said task interface 162 sets a flag in the protocol processing state information in the host that informs the host resident offload protocol processing functions 164, 166 that a protocol processing state transfer is pending; said task interface 162 copies the protocol processing state information from the host resident offload protocol processing functions 164, 166 and passes this state information and the network connection identifier elements to the task interface 154; said task interface 154 rejects the given protocol processing state information by informing task interface 162 that it does not have the resources to complete the request; said task interface 162 unsets a flag in the protocol processing state information in the host that informs the host resident off
  • the teachings herein also provide for a method of enabling a computer 12 to use the same advertised network address to access applications utilizing the default host protocol stack and applications utilizing a protocol offload or protocol accelerator for a given network request, which is received by a network interface NIC on host computer 12, the method including the steps of: said network interface NIC uses filtering function 174 to determine which set ofprotocol processing functions to process the given network request; said filtering function 174 filters on data included in the network request that is in addition to the destination network address DA; said request is passed to the set ofprotocol processing functions returned by the filtering function 174.
  • the present invention provides methods and apparatus for delivering selective offloading of protocol processing. These methods and apparatus will generate substantial benefits in the computer network business by improving the efficiency and performance of computer networks.
  • the auxiliary processor is any processor or hardware state machine that is not one of the general purpose processors used to perform application processing for a given application.
  • the auxiliary processor is connected in some fashion, either directly or indirectly to the host computer.
  • Host Computer This is the computer upon which the application program runs.
  • the computer "hosts" the application and its associated support functions.
  • the host computer is connected in some fashion, either directly or indirectly to the auxiliary processor.
  • Protocol Stack is a plurality ofprotocol processing functions that perform processing for one or more of the protocol layers as defined in the ISO 7 layer reference model. Typically, this includes layer 3 (network) and layer 4 (transport) functions, but may be any set ofprotocol processing functions.
  • the host protocol stack is protocol stack which is a component of the host operating system and is generally provided by the operating system vendor.
  • the host protocol stack resides on a host computer.
  • the host resident protocol offload stack is protocol stack which has the ability to selectively offload protocol processing functions to an auxiliary processor.
  • the host resident protocol offload stack resides on a host computer.
  • the auxiliary processor resident protocol offload stack is protocol stack which performs protocol processing functions and offloads these functions from the host computer.
  • the auxiliary processor resident protocol offload stack resides on an auxiliary processor.
  • Protocol Service Request is a request made to ths auxiliary processor resident offload protocol stack to perform a function on behalf of the host resident offload protocol stack.
  • the protocol service request is accompanied by protocol service state information which fully describes the request.
  • Protocol Service Response is a response made to the host resident offload protocol stack by the auxiliary processor resident offload protocol stack informing it of the completion of a protocol service request.
  • the protocol service response is accompanied by protocol service state information which fully describes the response.
  • Protocol State Information is the computer data necessary to maintain a network connection by a protocol stack. A protocol stack needs one instance ofprotocol state information for each network connection.
  • Protocol Service State Information is computer data necessary to fulfill a protocol service request and response. It may contain protocol state information.
  • Network Connection - is an established state between two network endpoints utilizing a connection oriented transport protocol.
  • An example of a network connection is a TCP connection.
  • TCP Connection - A TCP connection is identified by the IP Source Address 42, the IP Destination Address 44, the TCP Source Port 72 and the TCP Destination Port 74.
  • a specific TCP connection may be described and identified by a set of filter rules.
  • Protocol Elements Each piece of received network data is composed ofprotocol elements.
  • a protocol element is any field or string of data that is included within received network data.
  • the protocol elements can be divided into protocol control information and protocol payload information.
  • the fields in the IP header ( Figure 5), the fields in the TCP header ( Figure 6) and any other protocol header or payload fields may be considered protocol elements.
  • Protocol Element Definition is a description of a specific instance of a protocol element.
  • An example of a protocol element definition is "the TCP Source Port 72 is 80" or "the IP Source Address 42 is not on the 192.168.21/24 network”.
  • Filter Rules A filter rule is a protocol element definition and a protocol stack designator. If the protocol element definition matches the protocol element from the given network data, then the network data is passed to the designated protocol stack. Multiple filter rules may be combined to create complex filters.

Abstract

Methods and apparatus for the selective offloading of protocol processing are disclosed. In a preferred embodiment of the invention, computationally intensive and memory bandwidth intensive protocol processing tasks are offloaded from the host processor of a computer (12) to an auxiliary processor (152).

Description

Selective Offloading of Protocol Processing
TECHNICAL FIELD
The present invention pertains to methods and apparatus for delegating computing resources and tasks in a network. In one embodiment of the invention, selected portions of a protocol processing task are dynamically offloaded to an auxiliary processor. Memory bandwidth or CPU processing intensive tasks are then performed by the auxiliary processor to reduce the memory bandwidth or host CPU processing cycles consumed by performing the protocol processing task. More particularly, one preferred embodiment of the invention enables the offloading auxiliary processor to deposit incoming user data directly into the user's memory space, bypassing the placing of a copy of the data into the operating system's memory and thereby reducing the number of times the received data is copied, enabling a zero-copy architecture. Another preferred embodiment enables the offloading auxiliary processor to transfer protocol processing back to the host CPU in the event of errors, low resources or other events that are not considered routine for the auxiliary processor to perform. This capability allows one preferred embodiment to have less processing power or memory resources in the auxiliary processor and still perform the mainline or "fastpath" code efficiently without being burdened by having to maintain the slower and much more complex error handling and recovery routines which are then implemented back on the host CPU. There may also be included a filtering function which enables the network interface to select between a plurality of protocol processing functions, which although they may perform the same protocol processing tasks, differ in how the tasks are distributed between the host CPU and an offloading auxiliary processor.
BACKGROUND ART Over the past several years the portion of a computer's CPU cycles that are spent performing communications and protocol processing tasks have increased to keep up with the greater bandwidth provided by new networking technologies, most notably 100 megabit (Mb) and gigabit (Gb) Ethernet. As the demands for more CPU cycles to process the networking protocol traffic has increased, several strategies have emerged to mitigate this increase and are based upon optimizing specific functions of the most widely used protocol for computer networking, TCP/IP (Transmission Control Protocol/Internet Protocol). The standard accepted strategies all offload specific, fixed functions of this protocol, specifically performing the calculations of the TCP and IP checksums, or have focused on reducing the number of times the network interface card (NIC) interrupts the host computer. Both of these strategies have been used successfully together to reduce the overall protocol processing load on the host computer, both still provide for substantial processing by the host computer.
Other strategies have focused on putting the entire networking protocol stack implementation on an offloading auxiliary processor to completely offload the host operating system of the protocol processing task. While this may work for a limited set of applications, it requires a costly auxiliary processor with a large memory capacity and complicated interactions with the host computer. None of the above solutions provides a dynamic mechanism to offload portions of a data stream's network protocol processing on a transactional or on a single event basis. The development of such a system would constitute a major technological advance, and would satisfy long felt needs and aspirations in both the computer networking and computer server industries.
DISCLOSURE OF THE INVENTION The present invention provides methods and apparatus for delivering selective offloading of protocol processing from a host computer to an offloading auxiliary processor. Selective offloading of protocol processing enables a host to offload the most computationally intensive, memory bandwidth intensive and performance critical portions of the protocol processing task to an auxiliary processorwithout requiring the auxiliary processor to perform the full suite of functions necessary to perform a complete protocol processing offload. This capability enables the offloading auxiliary processor to be built with fewer resources, and thus more inexpensively. The offloading host will only offload the portions of the protocol processing task that the auxiliary processor can process. If the auxiliary processor is requested to perform an action that it is unable to perform, for any reason, it simply returns the request back to the host computer. The request may be partially completed or not completed at all. This allows "fastpath" functions to be offloaded while more complex, but slower functions such as error handling, resequencing and lost packet recovery and retransmission to be handled by the host computer. This also allows an auxiliary processor to be built with limited resources that allows it to offload only a specific number of tasks. When the host computer exceeds the capabilities of the auxiliary processor, the additional tasks are performed on the host computer. This enables the development of inexpensive auxiliary processors to accelerate protocol processing in computing environments that would otherwise not be served by protocol accelerating technology.
Each protocol processing task is offloaded individually, with the host computer regaining control at the end of each protocol processing task or sequence of tasks. This allows the auxiliary processor to maintain only the state information pertinent to the tasks that the auxiliary processor is currently performing. While the host regains control at the end of each task, multiple tasks and sequences of tasks may be chained together to minimize the need to resynchronize state information with the host computer. When making an offload request, the host computer includes information regarding the protocol to be offloaded. It is expected that the protocol will be a combination of protocols including the network protocol, the transport protocol and the application protocol. It can be any protocol or set of protocols in the seven layer ISO protocol reference model. When multiple protocols of different layers are taken together, each unique combination of protocols is treated as a separate protocol. This allows the underlying protocols to be tailored to the requirements of the application and the application protocol. One preferred embodiment of this is iSCSI (internet SCSI) over TCP/IP. Another preferred embodiment is VIA (Virtual Interface Architecture) over TCP/IP .
Methods of constructing the auxiliary processor include adding network processors and memory to a NIC, adding network processors, memory and hardware state machines to a NIC or by adding hardware state machines and memory to a NIC. Additionally, in place of a NIC, this functionality can be placed on the main processor board or "motherboard" of the host computer, or embedded within the I/O subsystem. An appreciation of the other aims and objectives of the present invention and a more complete and comprehensive understanding of this invention may be obtained by studying the following description of a preferred embodiment, and by referring to the accompanying drawings.
A BRIEF DESCRIPTION OF THE DRAWINGS
Figures 1 & 2 provide illustrations which help explain the basic concepts comprising the present invention.
Figure 3 is an illustration which shows the relationship between computers C, a computer network E, a network router R, a network switch S and a network attached storage system D. Figure 4 is an illustration which shows the relationship between a computer C and an associated user U, a computer network E, and a network attached storage system D.
Figure 5 is an illustration which shows Internet Protocol (IP) header.
Figure 6 is an illustration which shows the Transmission Control Protocol (TCP) header. Figure 7 is an illustration which shows the relationship between the network interface NIC, the computer network E and other primary components of a computer C including the central processor CPU, the memory controller MC and the memory M.
Figure 8 is an illustration of a classical architectural model of host based protocol processing function.
Figure 9 is an illustration of a full protocol processing offload model. Figure 10 is a schematic illustration of the invention.
Figure 11 is flow chart of a basic embodiment of a selective offloading protocol process.
Figure 12 is detailed flow chart of a selective offloading protocol process.
Figure 13 shows selective offloading of a protocol process to a host network interface device driver function within a selective protocol offloading system. Figure 14 shows selective offloading of a protocol process to a host resident offload protocol device driver function within a selective protocol offloading system.
Figure 15 shows selective offloading of a protocol process to an AP resident offload protocol device driver function within a selective protocol offloading system. BEST MODE FOR CARRYING OUT THE INVENTION
I. Background of the Invention
On any given day, millions upon millions of computers connect to the Internet to convey or to obtain information. A person using a personal computer who wants to connect to another computer to send e-mail or to look at a webpage generally uses a device called a modem to connect an "Internet Service Provider." The computer at the ISP then conveys messages or webpages from other computers that may be located in far-off places around the world.
When a person requests a page from a website, a request is first sent to the remote computer which "hosts" the website. This request contains specific information about how the content is to be transported from the host computer to the ISP, and then finally to the person requesting the information. Much of this initial request pertains to a determination of the "application protocol" that will be used to convey information from the host computer to the user's computer. A protocol is a predetermined standard or agreement that establishes the rules of exchange between or among computers. For example, when motorists all stop at a red "STOP" signs when they reach an intersection, they are obeying a protocol or rule that has been established to ensure a safe flow of traffic. The Internet generally runs on aprotocol called 'TCP/IP," which stands for Transmission Control
Protocol/Internet Protocols. Actually, TCP/IP includes two protocols, TCP and IP . In general, most simple transactions that use the Internet are governed by TCP/IP. An example of an application protocol utilized by the present invention is called "iSCSI." In general, iSCSI is Internet SCSI (Small Computer System Interface) is an application layer Internet Protocol networking standard for linking data storage facilities. By carrying SCSI commands over IP networks, iSCSI is used to facilitate data transfers over intranets, and to manage storage over long distances. The iSCSI protocol is among the key technologies expected to help bring about rapid development of the storage area network (SAN) market, by increasing the capabilities and performance of storage data transmission. Because of the ubiquity of IP networks, iSCSI can be used to transmit data over local area networks (LANs), wide area networks (WANs), or the Internet and can enable location-independent data storage and retrieval.
When many users try to download the same webpage at the same time, some users experience delays in receiving information, because the computer that stores the webpage is unable to handle so many requests simultaneously. Every computer that hosts a webpage has a limited amount of hardware, software and storage space, and, as a consequence, a limited amount processing capacity that is available for fulfilling requests for information, files or images from users. User requests are conveyed to a host computer over the Internet. Once they arrive at the host, they are generally answered in order, and the host processes each request and sends back a reply to each user.
A simple analogy can help to explain the process furnishing content from a host computer to many personal computer users over a network. Consider the factory depicted in Figure 1. Raw materials arrive at the loading dock, where they are unloaded, unpacked and sorted. Finished goods are then produced inside the single factory building, and are then packed and shipped to customers.
Compare the conventional approach illustrated in Figure 1 to a more modern factory, which is portrayed in Figure 2. Factory No. 2 is more efficient than Factory No. 1, because specific functions and processes that are required to fulfill customer requests have been delegated to particular, specialized work sites outside the main factory. As shown in Figure 2, the job of unloading, opening and sorting cartons of raw materials as they arrive from suppliers is now performed by a separate "Receiving Station" which is equipped with customized tools and specially skilled workers who are focused just on the initial tasks of unloading, opening and sorting small cartons of raw materials. In addition, Figure 2 also reveals a "Shipping Station" on the opposite side of the manufacturing facility. Like their counterparts at the other end of the operation, the workers at the Shipping Station have their own customized equipment and skills that are designed to empower them to fulfill their designated packing.and shipping duties.
In Factory No. 1, all the resources of the factory are utilized to accomplish all the steps needed to fulfill requests from many users.
Factory No.2, which employs the concepts of division of labor, delegation of tightly-defined work functions, and outsourcing, produces more products using the same set of resources. This is true because the delegation of certain tasks to workers outside the main plant frees up workers, equipment and other resources inside the big building to concentrate on what they do best- manufacturing the product that the customer has ordered. The people in the Receiving and Shipping Stations support this effort by doing their own limited jobs well, and keeping the stream of large boxes of finished merchandise flowing to happy customers.
In this analogy, the small cartons of raw materials delivered to the factories are somewhat like the requests for webpages generated by computer users connected to a network like the Internet. The factories resemble a host computer that stores web pages that users would like to view or download. The large boxes of finished goods leaving a factory represent the content that is dispatched over the network back to the origin of a request.
Factories built of bricks and mortar function best when resources are deployed efficiently. The efficient deployment of resources results in the efficient production of goods. Just like factories built of bricks and mortar, computer networks work better when resources are utilized efficiently.
In the present invention, particular functions are removed from the primary computing system, which comprises both hardware and software. These functions are re-assigned to supporting hardware software, which are specially configured to perform sharply defined and limited tasks. The outsourcing of precisely segmented computing capabilities frees up resources in the primary hardware and software, and enhances the entire system. As a result, more users are cared for at a higher level of service employing the same set of hardware and software assets. Specifically, the present invention furnishes a solution for augmenting the service capacity of a host in a network. A set of protocol processing tasks, which are normally furnished by the host, are generally delegated to auxiliary processor. These protocol processing tasks generally involve interpreting the requests for data as they arrive from many users. This new auxiliary processor supports the efforts of the primary hardware and software within the host computer, and may take the form of a new "card" or "blade" that sits on the motherboard of the host computer. Just like the owner of a personal computer can insert a new hardware component like a network, printer or port adapter into the main motherboard of his or her computer, the new invention offers a way to augment the host computer to make it work better. In another embodiment, the new auxiliary processor may be reduced to an application-specific integrated circuit (ASIC) or some other chip which is added to the host computer, π. Overview of the Invention The present invention provides methods and apparatus for selective offloading of protocol processing from a host CPU to an offloading auxiliary processor. In one preferred embodiment of the invention, the auxiliary processor offloads the reception of iSCSI data over the TCP/IP network protocol, performing all necessary TCP/IP functions that occur during the normal course of a TCP/IP receive operation and all necessary iSCSI data movement functions. In the event of an error or other exceptional condition, the auxiliary processor transfers control back to the offloading host to handle the condition.
In another preferred embodiment of the invention, the auxiliary processor offloads the transmission of "iSCSI" data over the TCP/IP network protocol, performing all necessary TCP/IP functions that occur during thenormal course of a TCP/IP transmit operation and all necessary iSCSI data movement functions. In the event of an error or other exceptional condition, the auxiliary processor transfers control back to the offloading host to handle the condition.
In other preferred embodiments, other tasks and sequences of tasks may be offloaded to the auxiliary processor. The tasks and sequences of tasks are described in further detail below.
In other preferred embodiments, other network protocols, transport protocols and application protocols may be offloaded to the auxiliary processor. The protocol may be a combination of protocols including the network protocol, the transport protocol and the application protocol. The offloaded protocols can be any protocol or set of protocols in the seven layer ISO protocol reference model. This protocol may be identical to one of the set of protocols in the seven layer ISO set, or may be a variation, which, while not identical, is generally logically consistent with one of the original seven layer ISO protocols. Examples of this include IP and TCP, which correspond to layers three and four, respectively. When multiple protocols of different layers are taken together, each unique combination of protocols is treated as a separate protocol. This capability allows the underlying protocols to be tailored to the requirements of the application and the application protocol. The additional protocols are described below in the following sections.
There are five key reasons why the development of this system constitutes a technological advance. The first is that the selective offloading of protocol processing offloads the protocol processing tasks in a per application basis. Previous systems use an all or nothing approach, and performs protocol offload on a per protocol basis. The semantics of each application protocol are different, and even though they may use the same underlaying network and transport protocols, may see wildly differing performance improvements. Using the selective offloading of protocol processing allows the protocol offload to be performed where it gives the greatest benefit, without requiring it to perform protocol offload for application that do not benefit from it.
The second key reason why the selective offloading of protocol processing is a technological advance is that it does not affect the design of the existing host based protocol stack. For most modern computer operating systems, a host protocol stack is provided by the operating system vendor. Most operating systems are closed source, meaning that the code that instructs the computer how to run is kept tightly controlled by the operating system vendor. Because of this control, it is very difficult to modify the protocol stack. The only areas that a software engineer can safely add code is at the specific interfaces defined by the operating system vendor. This is usually limited to device driver and application interfaces. Trying to reverse engineer a protocol stack and add functionality usually causes instability within the protocol stack. Also, if the protocol stack has been modified by software outside of that provided by the operating system vendor, then the operating system vendor will not provide support for that installation of software. In short, having to modify the host protocol stack using undefined or undocumented interfaces makes the commercial viability of such a product very limited.
Because the host protocol stack is not modified, implementing selective offloading of protocol processing is operating system independent. This means that the architecture described within this document is suitable for a wide range of operating systems. This allows a core implementation to be built and maintained with only small interface sections that are designed and tuned for each specific operating system.
The fourth key reason why the selective offloading of protocol processing is a technological advance is that it maintains the same network (IP) address that is used by the host protocol stack and does not require the allocation of additional network addresses. In prior art, the offload protocol stack has its own network address. When a new network address is used, all of the remote devices must be administered to allowthe newprotocol address to access the device. With the selective offloading of protocolprocessing, which uses the same network address as the host protocol stack, this administrative burden is removed.
The last key reason why the selective offloading of protocol processing is a technological advance is that allows the host protocol stack to use the same MAC and PHY interface on the selective offload apparatus. This enables all of the legacy applications, management and diagnostic tools to use the MAC and PHY portions of the selective offload network interface. This preserves the investment that has already been made in these applications and tools and provided a straightforward migration path. Conversion from a host based protocol stack to the selective offload protocol stack is transparent to the applications and remote devices. The only application experiences a different behavior is the application or applications that have been explicitly selected for the selective offloading of protocol processing. None of the prior art addresses all of these issues.
III. Preferred & Alternative Embodiments
Figure 3 generally illustrates the embodiments of a computer network 10 to which the present invention pertains as Selective Offloading of Protocol Processing from computers 12a-12n. A computer 12a is attached to the computer network 14. The computer 12 is capable of communicating with other network routers 18, network switches 20, network storage devices 16, and other computers 12, such as computers 12b-12n.
Figure 4 is an illustration 22 which shows the relationship between a computer 12 and an associated user U, a computer network 14, and a network attached storage system D. The computer 12 shown in Figure 4 typically comprises a processing system 28, and comprises one or more applications 30.
The computer 12 is connected to the network 14 through a network connection 24 and a network interface
26, typically a network interface card NIC.
As seen in Figure 4, a network destination computer 16 is also connected to the network 14, through a network connection 32. Communication between the computer 12 and the network storage computer 16 is typically accomplishedthrough one or more established protocols, such as the TCP protocol for transport services, such as RFC-793, and/or the IP protocol for network services, such as RFC-791. Figure 5 is a schematic diagram of an IP (Internet Protocol) header 40. The IP header 40 is defined by RFC 791 and typically comprises several fields, including a Source Address 42, a Destination
Address 44, a version 46, an IHL 48, a service type 50, a total length 52, an identification 54, flags 56, fragment offset 58, time to live 60, protocol 62, and header checksum 64. The fields of the IP header are examples of elements of the protocol, or protocol elements. In this Specification and in the Claims that follow, a protocol element is any field or string of data that is included within received data.
Figure 6 is a schematic diagram of a TCP (Transmission Control Protocol) header 70. The TCP header is defined in RFC 793. It typically comprises several fields, including a Source Port SP 72, a Destination Port DP 74, a sequence number 76, an acknowledgment number 78, a data offset 80, a reserve field 82, TCP flags 84, a window 86, a checksum 88, and an urgent pointer 90.
Figure 7 illustrates the relationship between the network interface NIC 26, the computer network
14 and other primary components of a computer 12, including the central processor 28, the memory controller 106, and the memory 108. The fields of the TCP header are examples of protocol elements. As seen in Figure 7, a computer network 14 is connected to a network interface NIC 26. An auxiliary processor AP 102 is co-located with the network interface NIC 26. A network interface NIC 26 is connected to a computer 12 via an I/O interface 104. The I/O interface 104 is connected to the memory controller 106. A memory controller 106 is connected to the memory 108 andthe processor 28 of computer
12. Figure 8 is a schematic depiction showing the current model of host based protocol processing as it is usually performed in a modem computer 12. A computer network 14 is connected to a network interface 26a, which is connected to a computer 12. Within the operating system 112 of computer 12, a network interface device driver function 114 communicates with the NIC 26, and with an IP protocol processing function 116. The IP protocol processing function 116 communicates with a TCP protocol • processing function 118 and the network interface device driver 114. A network application 120 communicates with the TCP protocol processing function 118. Each of the layered functional blocks 122 comprises a network device driver function 114, an IP protocol processing function 116, and TCP protocol processing function 118 has a specific function that it performs for all data that is passed to it by the layers above and below which defines a classical arrangement of host based network protocol processing.
Figure 9 is a schematic depiction showing the current model of full protocol processing offload to an auxiliary processor 132. A computer network 14 is connected to a full offload network interface NIC
26b. A full offload auxiliary processor 132 is co-located with the full offload network interface NIC 26b. The full offload network interface NIC is connected to a computer 12. Within the full offload auxiliary processor 132, an offload network interface device driver function 134 communicates with the NIC 26b and with an IP protocol processing function 136. The IP protocol processing function 136 communicates with a TCP protocol processing function 138 andthe offload network interface device driver function 134.
A TCP protocol processing function 138 communicates with the IP protocol processing function 136 and the auxiliary processor resident host offload interface function 140. The auxiliary processor resident host offload interface function 140 communicates with the TCP protocol processing function 138 and the host resident host offload interface function 142. The host resident host offload interface function 142 communicates with the auxiliary processor resident host offload interface function 140 and the network application 120.
As seen in Figure 9, each layer 114, 116, 118 of the protocol processing stack 122 from Figure 9 has moved from operating in the host operating system 112 of computer 12 to operating in the full offload auxiliary processor 132 of the network interface 26b. Although the offloading system 130 shown in Figure 9 accomplishes the desired result of offloading the protocol processing from the host processor 12, it requires that all network functions and requirements be fully implemented in the offloading auxiliary processor 132. When all data communications are functioning normally, the resource requirements, including the buffering of data is relatively small. When network errors and other conditions occur such as dropped or lost packets, the receipt of packets out of sequence, or the receipt of fragmented data, the resources consumed rise dramatically. Specific examples of errors and exceptional conditions that cause an increase in resource utilization include IP reassembly, TCP resequencing, loss of the first packet of a fragmented TCP segment, loss of TCP acknowledgments, loss of a packet containing application framing information, out of order TCP segments where the first TCP segment contains application framing data and other situations where due to the nature of the data that is lost or reordered, some user data must be stored for use later. Figure 10 is a schematic depiction of an embodiment of the present invention 150 which employs a selective offloading auxiliary processor 152. A computer network 14 is connected to a physical interface function 168 of the network interface 26c. A physical interface function 168 receives data from a computer network 14 and sends it to a filtering function 174. A physical interface function 168 receives data to transmit to a computer network 14 from a host network interface device driver function 114, a host resident offload protocol device driver function 160 and an AP resident offload protocol device driver function 170. A filtering function 174 receives inbound data from a physical interface function 168, and selects an appropriate device driver to send the received data to for processing. A filtering function 174 selects between a host network interface device driver function 114, a host resident offload protocol device driver function 160 or an AP resident offload protocol device driver function 170.
A host network interface device driver function 114 sends outbound data to a physical interface function 168 and inbound data to an IP protocol processing function 116. The same host network interface device driver 114 receives inbound data from a filtering function 174 and outbound data from an IP protocol processing function 116. An IP protocol processing function 116 communicates with a TCP protocol processing function 118 and a host network interface device driver 114. A network application
120 communicates with the TCP protocol processing function 118. Processing functions 114, 116, and 118, aTe the standard, unmodified, host based network protocol processing functions 122 also depicted in Figure 5.
An AP resident offload protocol stack device driver function 170 sends outbound data to a physical interface function 168 and inbound data to an AP resident offload task interface function 154. The same AP resident offload protocol stack device driver function 170 receives inbound data from a filtering function 174 and outbound data from an AP resident offload task interface function 154 and AP resident IP protocol offload function 156. An AP resident offload task interface function 154 receives inbound data from an AP resident offload protocol stack device driver function 170 and a host resident offload task interface function 162. The same AP resident offload task interface function 154 sends outbound data to an AP resident offload protocol stack device driver function 1 0 and inbound data to an AP resident IP offload function 156 or a host resident offload task interface function 162. An AP resident IP offload protocol processing function 156 receives inbound data from an AP resident offload task interface function 154 and receives outbound data from an AP resident TCP offload protocol processing function 158. The same AP resident IP offload protocol processing function 156 sends inbound data to an AP resident TCP offload protocol processing function 158 and sends outbound data to an AP resident offload protocol stack device driver function 170. An AP resident TCP offload protocol processing function 158 communicates with an AP resident IP offload protocol processing function 156, an AP resident offload task interface function 154 and an AP resident Application protocol offload processing function 159. An AP resident Application protocol offload processing function 159 communicates with an AP resident TCP protocol offload processing function 158 and an AP resident offload task interface function 154. A host resident offload protocol stack device driver function 160 sends outbound data to a physical interface function 168 and sends inbound data to the host resident IP protocol offload processing function 1 4. The same host resident offload protocol stack device driver function 160 receives inbound data from a filtering function 174 and receives outbound data from host resident IP protocol offload processing function 164. A host resident IP protocol offload processing function 164 communicates with a host resident TCP protocol offload processing function 166, a host resident offload protocol stack device driver function 1 0, and a host resident offload task interface function 162. A host resident TCP protocol offload processing function 166 communicates with a host resident IP protocol offload processing function 164, a host resident offload task interface function 162 and a host resident Application protocol offload processing function 167. A host resident Application protocol offload processing function 167 communicates with a host resident TCP protocol offload processing function 166 and a host resident task interface function 162. A host resident offload task interface function 162 communicates with an AP resident offload task interface function 154, a host resident IP protocol offload processing function 164, a host resident TCP protocol offload processing function 166, a host resident Application protocol offload processing function 167 and the network application 172.
In addition to passing network data between the various functions, protocol state information is passedbetween the host resident task interface function 1 2, the host resident Application protocol offload processing function 167, the host resident TCP offload protocol processing function 166 and the host resident IP offload protocol processing function 1 4. The host resident task interface function 162 is responsible for maintaining the protocol state information in the host. Protocol state information is also passed between the AP resident task interface function 154, the AP resident Application protocol offload protocol processing function 159, the AP resident TCP offload protocol processing function 158 and the AP resident IP offload protocol function 156. The AP resident task interface function 154 is responsible for maintaining the protocol state information in the auxiliary processor 152. Protocol state information is passed between the host computer 12 and the auxiliary processor 152 by the host resident task interface function 162 and the AP resident task interface function 154 respectively.
The protocol service state infoπnation includes the task request from the network application 172, state information describing the connection that was previously established and initialized, if the request pertains to a previously established connection and information to support the communications and synchronization between the host resident offload task interface function 162 and the AP resident offload task interface function 154.
Prior inventions have used combinations of the approaches 110, 130 shown in Figures 8 and 9. When these are combined directly, each implementation must implement the entire scope of the network protocol. Each implementation must handle all contingencies, errors, corner cases and unusual circumstances. The ability to have a robust host resident protocol stack with an auxiliary processor based offload engine where individual tasks are selected and transferred to the auxiliary processor for completion has been a long strived for goal. Many earlier attempts have tried to shoehorn in the task selection and transfer process into an existing host protocol stack 116, 118. This has proved to be cumbersome, difficult and error prone. The results have not included an effective, robust product.
The novel use of using a parallel host resident protocol processing function that has been designed to facilitate the transfer of protocol processing tasks to and from an auxiliary protocol processor allows the original network protocol processing stack to remain unmodified, fully functional and robust, while enabling a selective protocol processing offload functionality. But this approach only solves part of the problem. The network application may be bound to the correct protocol processing stack, but classically, incoming network data is always demultiplexed in a defined order where the network layer (IP) is handled first, followed by the transport layer (TCP) until finally the data is sent to the application. The application only receives the data after the default, host based network protocol processing stack has processed it, bypassing the offload functionality. This is shown in Figure 8, where an Ethernet frame is received from the Ethernet media E by the NIC 26 and is passed, unmodified, to the device driver 114. The device driver 114 strips away the Ethernet header and passes the IP packet to the IP protocol processor 116. The IP protocol processor 116 validates the given IP packet and strips off the IP header and passes the resulting
TCP segment to the TCP protocol processor 118. The TCP protocol processor 118 validates the given TCP segment and strips off the TCP header. The resulting data is sent to the application. As seen from this description, each protocol processing function is limited in its scope and when receiving network data from the NIC 26, only receives data from the layer below it and sends data to the layer above it. It does not look further into the data. To avoid all of the protocol processing functions being performed by the host protocol stack 116, 118, the NIC 26 must be aware of the existence of multiple sets of protocol processing functions, otherwise known as parallel protocol processing stacks.
In the past, when operating a host based network protocol stack and an offloaded network protocol stack, a separate network address was required to be allocated to the offload protocol stack. This consumes network addresses and forces networking devices that communicate with the offloaded protocol stack to be aware of the existence of the offloaded protocol stack in as much as the communicating devices must address the offload protocol stack directly. This results in an additional administrative overhead where the communicating network devices must be administered to inform them of the address of the offload network protocol stack. For large numbers of network devices in complex data centers, this can be a large job and can slow deployment.
The novel use of a filter 174 within the network interface function to determine which protocol processing function to use allows the transparent introduction of protocol offload processing. The transparency comes from the ability to use the same network address as the host protocol stack 116, 118 and thus does not require that any administrative action be taken to enable the communicating network devices to communicate with an additional network address. It has been recognized that the benefit of offloading network protocol processing is directly related to the design of the application protocol that is being used. Put simply, some applications will benefit greatly when network protocol offloading is used and some will not.
The novel use of a filter 174 selecting which protocol stack to use on the basis of the application protocol and not solely on the destination media access control (MAC) address or the destination network address of the received network data enables the network protocol offload function to intelligently select which network protocol(s) are offloaded and to which network protocol processing stack the received network data is sent to for processing. This completes the enabling of the selective network protocol offload functionality. Combined with the use of dual host resident network protocol stacks, application aware filtering in the network interface allows an incoming network data to be sent to the standard host based network protocol processing function, the AP resident offload protocol processing function, the host resident offload protocol processing function, or another, application specific protocol processing function. IV. Methods of Operation of Selective Offload Protocol Processing
In Figure 3, a network application running on a computer 12 must establish a connection and retrieve data from the network attached storage system 16. To accomplish this, in Figure 7, network application 172 sends a request to a host resident offload task interface function 162 to open a TCP connection and perform application specific initialization with a network attached storage device 16. Network application 172 is able to make this request using a host resident offload task interface function 162, because the AP and host resident TCP and +Apρlication protocol processing functions 166, 158, 167, 159 are able to offload the network and application protocols that network application 172 uses.
In one preferred embodiment of this invention, the task of establishing a new TCP connection and performing application specific initialization is considered a complex task that should not be offloaded to the auxiliary processor. Once the TCP connection is established, it is then passed to the auxiliary processor so that subsequent data movement operations will be offloaded. A host resident offload task interface function 162 calls a host resident TCP protocol offload processing function 166 with a protocol service request. A protocol service request includes the task request from the network application 172, the information describing the connection, and information to support the communications and synchronization between a host resident offload task interface function 162 and an AP resident offload task interface function 154. The host resident TCP protocol offload processing function 166 performs the requested task, making calls to a host resident IP protocol processing function 164 which, in turn, performs the requested task, making calls to a host resident offload protocol stack device driver fimction 160. A host resident offload protocol stack device driver function 160 calls a physical interface function 168 and receives data from a filtering function 174. Once the TCP connection has been established, the information describing the TCP connection is transferred from the host resident TCP protocol offload function 166 to the AP resident TCP offload function 158 by the act of the host resident task interface 162 taking the TCP state information and passing this state information to the AP resident task interface 154. The AP resident task interface 154 takes the given TCP state information and passes it to the AP resident TCP protocol offload function 158. Once the state information has been transferred, the AP resident task interface 154 indicates the completion of the state transfer to the host resident task interface 162. A host resident task interface function 162 then notifies a network application 1 2. Now that the connection between computer 12 and network attached storage 16 has been established and initialized, network ap lication 172 calls a host resident offload task interface function 162 requesting that data be sent to network attached storage 16.
In one preferred embodiment of this invention, the host resident offload task interface function 162 recognizes that this task is most efficiently accomplished by offloading it to an auxiliary processor 152, and calls an AP resident offload task interface function 154 with a protocol service request. A protocol service request includes the request from the network application 172, the information describing the connection that was previously established and initialized and information to support the communications and synchronization between a host resident offload task interface function 1 2 and an AP resident offload task interface function 154. An AP resident offload task interface function 154, upon receiving and accepting this request forwards the request to an AP resident Application protocol offload processing function 159. An AP resident Application protocol offload processing function 159 performs the requested task, making calls to an AP resident TCP protocol processing function 158. An AP resident TCP protocol processing function 158 performs its function and calls an AP resident IP protocol processing function 156 which, in turn, performs the requested task, making calls to an AP resident offload protocol device driver function 170. An AP resident offload protocol device driver function 170 calls aphysicalinterface function
168 and receives data from a filtering function 174. Once a task has been completed, an AP resident task interface function 154 notifies a host resident offload task interface function 162, by passing back a protocol service response. A host resident offload task interface function 162 notifies a network application 172. A network application 172 calls a host resident offload task interface function 162 requesting that a specific piece of data be read from the network attached storage 16.
In one preferred embodiment of this invention, a host resident offload task interface function 1 2 recognizes that this task is most efficiently accomplished by offloading it to the auxiliary processor 152, and calls an AP resident offload task interface function 154 with the protocol service request. An AP resident offload task interface function 154, upon receiving and accepting this request forwards the request to an AP resident Application protocol offload processing function 158. An AP resident Application protocol offload processing function 158 performs the requested task, making calls to an AP resident TCP protocol processing function 158. An AP resident TCP protocol processing function 158 performs its function and calls an AP resident IP protocol processing function 156 which, in turn, performs the requested task, making calls to an AP resident offload protocol device driver function 170. An AP resident offload protocol device driver function 170 calls a physical interface function 168 and receives data from a filtering function 174. During the execution of the given task by an AP resident TCP protocol offload processing function 158, an AP resident TCP protocol offload processing function 158 detects that some of the data segments have been dropped. A full network protocol stack is required to collect the segments that have been received and acknowledge those up until the first dropped segment. The subsequent segments must be held, unacknowledged, until the missing segment(s) are received. Retaining these segments consume storage resources in the auxiliary processor 152. In the case of selective offloading of network protocol processing, an AP resident TCP protocol offload processing function 158 notifies an AP resident task interface function 154 of the loss by passing back a protocol service response for the TCP connection and a protocol service response for the Application task request. An AP resident task interface function 154 notifies a host resident offload task interface function 162, by passing back the protocol service responses. A host resident offload task interface function 162 passes this protocol service responses to a host resident TCP protocol offload processing function 166 and a host resident application protocol processing function 167 to complete. The error recovery and the remainder of the original task is performed by a host resident Application and TCP protocol offload processing functions 166 and 167. Once the task has been completed, the host resident Application protocol offload processing function 166 notifies a host resident offload task interface function 162, by passing back a protocol service response. A host resident offload task interface function 162 then notifies a network application 172. If the given TCP connection is to be reused and the error recovery has been completed, the TCP connection state can again be transferred from the host resident TCP protocol offload function 166 to the AP resident TCP protocol offload processing function 158. This demonstrates how fast path tasks can be easily offloaded to an auxiliary processor, without burdening them with error recovery and exceptional condition processing abilities. Examples of errors and exceptional conditions that should be handled by the host resident portion of the network protocol processing offload functions include IP reassembly, TCP resequencing, lost first packet of a fragmented TCP segment, lost TCP acknowledgments, lost packet containing application framing information, out of order TCP segments where the first TCP segment contains application framing data and other situations where due to the nature of the data that is lost or reordered, some user data must be stored for use later. This greatly reduces the buffering and storage requirements of the auxiliary processor.
In another example a network application 172 calls a host resident offload task interface function 162 requesting that data be sent to network attached storage 16. In one embodiment of this invention, a host resident offload task interface function 162 recognizes that this task is most efficiently accomplished by offloading it to an auxiliary processor 152, and calls an AP resident offload task interface function 154 with the protocol service request. An AP resident offload task interface function 154 receives the request, but because of a shortage of resources, is unable to execute the requested task. An AP resident offload task interface function 154 notifies a host resident offload task interface function 162, by passing back a protocol service response indicating that the protocol service request was rejected due to lack of resources. The host resident offload task interface function 162, upon receiving a protocol service response indicating a lack of resources, passes the request to a host resident Application protocol offload processing function 167 for execution. This demonstrates how the selective network protocol offload may function in a limited resource environment. Resources that may cause task rejection may include frame buffer space, data frame descriptor space, CPU utilization, task descriptor space, host I O interface bandwidth, and network interface bandwidth.
V. Methods of Operation of the Selective Offload Filtering Function
As has been shown above, an intelligent filtering function is required to enable the functionality of Selected Offloading of Protocol Processing. The filtering rules that control the operation of a filtering function 174 must be able to be manipulated during the course of operation.
In a preferred embodiment, these filter rule manipulations include the ability to atomically add, delete and modify individual rules.
In an alternative embodiment, these filter rule manipulations only require that an enable bit be atomically settable and resettable, with other functions being non-atomic. In a preferred embodiment, the size of the rule filter must accommodate the number of active tasks of the given application protocol plus a default rule to match the application and a second default rule for all non-matching traffic.
In an alternative embodiment, a much smaller rule table can be used to differentiate between offloadable application network traffic and non-offloadable network traffic. In a preferred embodiment, the rules are composed of a plurality of single rules. This plurality of single rules can be combined logically to form a plurality of complex rules. The logical operations used for combining a plurality of single mles into a complex rule include AND, OR, NOT, NAND, and NOR.
In a preferred embodiment, the filtering function must be able to match the desired network address, the desired TCP application protocol number and be able to look into the application headers far enough to filter on the application framing data.
In an alternative embodiment, the filtering function must be able to use protocol elements to match at least on the desired network address and the desired TCP application protocol number.
In another alternative embodiment, the filtering function should be able to use protocol elements to compare the rules against any layer of the ISO reference protocol stack model. In a preferred embodiment, the filtering function must be able to specify which of a plurality of sets of protocol processing functions should receive and process the received network data.
VI. Apparatus for Selective Offloading of Protocol Processing
In one preferred embodiment, the auxiliary processor function may be constructed using a processor or processors, memory, an interface to the physical network interface and an interface to the host I/O interface. The various auxiliary processor resident functions are implemented in this embodiment as firmware functions that are executed by the processor or processors. In an alternative preferred embodiment of the auxiliary processor function, some of the repetitive protocol processing functions may be implemented using state machines in hardware in addition to the processor or processors, memory, physical network interface and host I/O interface. The form of this hardware may be gate arrays, programmable array logic (PALs), field programmable gate arrays (FPGAs), Application Specific Integrated Circuits (ASICs), quantum processors, chemical processors or other similar logic platforms. The various auxiliary processor resident functions are implemented in this embodiment as a combination of firmware functions that are executed by the processor or processors and hardware functions that are utilized by the processor or processors.
In another embodiment of the invention, a more highly integrated system may be created by combining computer chips that previously resided on different boards on a single board. Alternatively, functions that previously resided in multiple computer chips may be combined into fewer chips or a single chip. In general, the invention encompasses any method of incorporating selective offloading of protocol processing.
In an alternative preferred embodiment of the auxiliary processor function, the entire auxiliary processor may be implemented using hardware. The various forms of hardware are listed above
In a preferred embodiment of the network interface NIC, the network interface may be implemented as a card, designed to plug into the host computer's I/O interface such as a Peripheral
Component Interconnect (PCI) interface, PCI-X interface or InfiniBand. This may be extended to any wired, wireless or optical interface. An embodiment of this type lets the network interface be installed after the computer has been manufactured.
In an alternative embodiment of the network interface NIC, the network interface may be implemented as a single ASIC which may be mounted on the motherboard of the computer at the time of manufacture.
In an alternative embodiment of the network interface NIC, the network interface may be implemented as a logic component of the I/O subsystem of the host computer. In this embodiment, other logic components may be combined with the offload NIC functionality in a highly complex ASIC.
In an alternative embodiment of the network interface NIC, the network interface may be implemented as a logic component of the memory subsystem of the host computer. In this embodiment, other logic components may be combined with the offload NIC functionality in a highly complex ASIC. It will be apparent from the teachings herein that there can be provided apparatus for selectively offloading of a protocol processing function comprising a host computer 12; an auxiliary processor 152 coupled to said host computer 12; a host protocol stack composed of a set of protocol processing functions which include a network protocol processing function 116, a transport protocol processing function 118 and an application protocol processing function 120 residing on said host computer 12; a host resident offload protocol stack composed of a set of protocol processing functions which include a host resident network protocol offload processing function 164, a host resident transport protocol offload processing function and a host resident application protocol offload processing function 162 residing on said host computer 12; an auxiliary processor resident offload protocol stack composed of a set of protocol processing functions which include an auxiliary processor resident network protocol offload processing function 156, an auxiliary processor resident transport protocol offload processing fiinction and an auxiliary processor resident application protocol offload processing function 158 residing on said auxiliary processor
152; and a filtering function 174. The host computer 12 is capable of requesting that a task be performed using said host protocol stack, of requesting that a task be performed using said host resident protocol offload stack, of requesting that a task be performed using said auxiliary processor resident protocol offload stack. The auxiliary processor 152 is capable of performing offload protocol processing at the request of said host computer 12, of returning a completion status of said protocol processing task to said host computer 12. The filtering function 174 is capable of selecting the correct set of protocol processing functions.
The teachings herein can also provide apparatus for selectively performing protocol processing that utilizes a plurality of sets of protocol processing functions that differ primarily in the locality of where the protocol processing is performed which is composed of the following localities:
(1) a host protocol stack composed of a set of protocol processing functions which include a network protocol processing function 2, a transport protocol processing function 3 and an application protocol processing function 4 which reside on a host computer 12;
(2) a host resident offload protocol stack composed of a set of protocol processing functions which include a host resident network protocol offload processing function 164, a host resident transport protocol offload processing function and a host resident application protocol offload processing function 166 which reside on a host computer 12; and
(3) an auxiliary processor resident offload protocol stack composed of a set of protocol processing functions which include an auxiliary processor resident network protocol offload processing function 156, an auxiliary processor resident transport protocol offload processing function and an auxiliary processor resident application protocol offload processing function 158 which reside on an auxiliary processor 152.
The teachings also provide for a method of selecting one set of protocol processing functions from a plurality of sets of protocol processing functions for a given packet of network data which contains a set of protocol elements that uniquely defines the network connection, which method includes the steps of: comparing saidprotocol elements against apluralityofunique sets ofprotocol elements in filtering function
174; said plurality of unique sets of protocol elements containing a designator of a set of rotocol processing functions in filtering function 174; when a match occurs between the protocol elements in the given packet and a set ofprotocol elements selected from a plurality of unique sets ofprotocol elements, passing the given packet to the set ofprotocol processing functions indicated by the designator contained within the matched set ofprotocol elements; when a match does not occur between the protocol elements in the given packet and the plurality of unique sets ofprotocol elements, passing the packet to a default set ofprotocol processing functions.
The teachings herein also provide for a method of transferring state information between two sets ofprotocol processing functions for the purpose of transferring the locality of the protocol processing from the host resident offload protocol processing set of functions to the auxiliary processor resident offload protocol processing set of functions including the steps of: given a set of host resident offload protocol processing functions 164, 166, a set of auxiliary processor resident offload protocol processing functions 158, 156 , a task interface 162, 154, a filtering function 174 and an application 172; said application 172 utilizes network connection identifier elements to uniquely identify the given network connection, the network connection identifier elements being composed of the following set ofprotocol elements: a network protocol source address SA, a network protocol destination address DA, a transport protocol source port 72 and a transport protocol destination port 74; said application 172 instructs the task interface 162 to transfer the protocol processing of the said network connection from the host resident offload protocol processing functions 164, 166 to the auxiliary processor resident offload protocol processing functions 158, 156; said task interface 162 sets a flag in the protocol processing state information in the host that informs the host resident offload protocol processing functions 164, 166 that a protocol processing state transfer is pending; said task interface 162 copies the protocol processing state information from the host resident offload protocol processing functions 164, 166 and passes this state information and the network connection identifier elements to the task interface 154; said task interface 154 takes the given protocol processing state information and passes it to the auxiliary processor resident offload protocol processing functions 158, ,156; said task interface 154 unsets the flags in the protocol processing state information in the auxiliary processor that informs the auxiliary processor offload protocol processing functions 158, 156 that a protocol processing state transfer is pending, said task interface 154 instructs filtering function 174 to change the protocol processing function designator associated with the said network connection identifier elements set to the auxiliary processor resident protocol-processing functions 158, 156; said task interface 154 informs said task interface 162 that the requested operation has been completed; said task interface 162 informs the application 172 that the requested operation has been completed.
The teachings herein also provide for a method of rejecting the transferring of state information between two sets ofprotocol processing functions including the steps of: given a set of host resident offload protocol processing functions 164, 166, a set of auxiliary processor resident offload protocol processing functions 158, 156, a task interface 162, 154, a filtering function 174 and an application 172; said application 172 utilizes network connection identifier elements to uniquely identify the given network connection. The network connection identifier elements are composed of the following set ofprotocol elements: a network protocol source address SA, a network protocol destination address DA, a transport protocol source port 72 and a transport protocol destination port 74; said application 172 instructs the task interface 162 to transfer the protocol processing of the said network connection from the host resident offload protocol processing functions 164, 166 to the auxiliary processor resident offload protocol processing functions 158, 156; said task interface 162 sets a flag in the protocol processing state information in the host that informs the host resident offload protocol processing functions 164, 166 that a protocol processing state transfer is pending; said task interface 162 copies the protocol processing state information from the host resident offload protocol processing functions 164, 166 and passes this state information and the network connection identifier elements to the task interface 154; said task interface 154 rejects the given protocol processing state information by informing task interface 162 that it does not have the resources to complete the request; said task interface 162 unsets a flag in the protocol processing state information in the host that informs the host resident offload protocol processing functions 1 4, 166 that a protocol processing state transfer is pending; said task interface 162 informs the application 172 that the requested operation has been not been completed.
The teachings herein also provide for a method of enabling a computer 12 to use the same advertised network address to access applications utilizing the default host protocol stack and applications utilizing a protocol offload or protocol accelerator for a given network request, which is received by a network interface NIC on host computer 12, the method including the steps of: said network interface NIC uses filtering function 174 to determine which set ofprotocol processing functions to process the given network request; said filtering function 174 filters on data included in the network request that is in addition to the destination network address DA; said request is passed to the set ofprotocol processing functions returned by the filtering function 174.
INDUSTRIAL APPLICABILITY The present invention provides methods and apparatus for delivering selective offloading of protocol processing. These methods and apparatus will generate substantial benefits in the computer network business by improving the efficiency and performance of computer networks.
CONCLUSION
Although the present invention has been described in detail with reference to particular preferred and alternative embodiments, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the Claims that follow. The various hardware and software configurations that have been disclosed above are intended to educate the reader about preferred and alternative embodiments, and are not intended to constrain the limits of the invention or the scope of the Claims. The List of Reference Characters which follows is intended to provide the reader with a convenient means of identifying elements of the invention in the Specification and Drawings. This list is not intended to delineate or narrow the scope of the Claims. GLOSSARY
Auxiliary Processor - The auxiliary processor is any processor or hardware state machine that is not one of the general purpose processors used to perform application processing for a given application. The auxiliary processor is connected in some fashion, either directly or indirectly to the host computer.
Host Computer - This is the computer upon which the application program runs. The computer "hosts" the application and its associated support functions. The host computer is connected in some fashion, either directly or indirectly to the auxiliary processor.
Protocol Stack - A protocol stack is a plurality ofprotocol processing functions that perform processing for one or more of the protocol layers as defined in the ISO 7 layer reference model. Typically, this includes layer 3 (network) and layer 4 (transport) functions, but may be any set ofprotocol processing functions.
Host Protocol Stack- The host protocol stack is protocol stack which is a component of the host operating system and is generally provided by the operating system vendor. The host protocol stack resides on a host computer.
Host Resident Protocol Offload Stack - The host resident protocol offload stack is protocol stack which has the ability to selectively offload protocol processing functions to an auxiliary processor. The host resident protocol offload stack resides on a host computer.
Auxiliary Processor Resident Protocol Offload Stack - The auxiliary processor resident protocol offload stack is protocol stack which performs protocol processing functions and offloads these functions from the host computer. The auxiliary processor resident protocol offload stack resides on an auxiliary processor.
Protocol Service Request - The protocol service request is a request made to ths auxiliary processor resident offload protocol stack to perform a function on behalf of the host resident offload protocol stack. The protocol service request is accompanied by protocol service state information which fully describes the request.
Protocol Service Response - The protocol service response is a response made to the host resident offload protocol stack by the auxiliary processor resident offload protocol stack informing it of the completion of a protocol service request. The protocol service response is accompanied by protocol service state information which fully describes the response. Protocol State Information - Protocol state information is the computer data necessary to maintain a network connection by a protocol stack. A protocol stack needs one instance ofprotocol state information for each network connection.
Protocol Service State Information - Protocol service state information is computer data necessary to fulfill a protocol service request and response. It may contain protocol state information.
Network Connection - A network connection is an established state between two network endpoints utilizing a connection oriented transport protocol. An example of a network connection is a TCP connection.
TCP Connection - A TCP connection is identified by the IP Source Address 42, the IP Destination Address 44, the TCP Source Port 72 and the TCP Destination Port 74. A specific TCP connection may be described and identified by a set of filter rules.
Protocol Elements - Each piece of received network data is composed ofprotocol elements. A protocol element is any field or string of data that is included within received network data. The protocol elements can be divided into protocol control information and protocol payload information. Within a TCP/IP network, the fields in the IP header (Figure 5), the fields in the TCP header (Figure 6) and any other protocol header or payload fields may be considered protocol elements.
Protocol Element Definition - A protocol element definition is a description of a specific instance of a protocol element. An example of a protocol element definition is "the TCP Source Port 72 is 80" or "the IP Source Address 42 is not on the 192.168.21/24 network".
Filter Rules - A filter rule is a protocol element definition and a protocol stack designator. If the protocol element definition matches the protocol element from the given network data, then the network data is passed to the designated protocol stack. Multiple filter rules may be combined to create complex filters.
LIST OF REFERENCE CHARACTERS
AP Auxiliary processor
B I/O interface
C Computer
CPU Central processing unit
M Memory
MC Memory controller
14 Computer network
16 Network attached storage
18 Network router
20 Network switch
26 Network interface NIC
26a Standard Network Interface
26b Full Offload Network Interface
26c Selective Offload Network Interface
42 IP Source Address
44 IP Destination Address
46 IP Version
48 IP Header Length
50 IP Service Type
52 IP Total Length
54 IP Identification
56 IP Flags
58 IP Fragment Offset
60 IP Time to Live
62 IP Protocol
64 IP Header Checksum
72 TCP Source Port
74 TCP Destination Port 6 TCP Sequence Number 8 TCP Acknowledgment Number
80 TCP Data Offset
82 TCP Reserved
84 TCP Flags
86 TCP Window
88 TCP Checksum 90 TCP Urgent Pointer
100 Classic NIC System Architecture
102 Classic NIC Auxiliary Processor
104 I/O Interface
106 Memory Controller
108 Memory
110 Host-Based Protocol Processing System
112 Host Operating System
114 Host network interface device driver
116 Host IP protocol processing function
118 Host TCP protocol processing function
120 Network application
122 Protocol Processing Stack
130 Full Protocol Processing Offload System
132 Full Offload Auxiliary Processor
134 Auxiliary processor network interface device driver
136 Auxiliary processor IP protocol processing function
138 Auxiliary processor TCP protocol processing function
140 Auxiliary processor side host offload interface
142 Host side host offload interface
152 Enhanced Auxiliary Processor
154 Auxiliary processor resident offload task interface function
156 Auxiliary processor resident IP protocol offload processing function
158 Auxiliary processor resident TCP protocol offload processing function
159 Auxiliary processor resident Application protocol offload processing function
160 Host resident offload protocol stack device driver function 162 Host resident offload task interface function
164 Host resident IP protocol offload processing function
166 Host resident TCP protocol offload processing function
167 Host resident Application protocol offload processing function
168 Physical network interface function
170 Auxiliary processor resident offload protocol device driver function
172 Offload enabled network application
174 Filtering function
200 Basic Method for Selective Offloading of Protocol Processing
210 Packet Receipt 220 Packet Content Analysis
222 Processing Destination Logic
224 Selective Offloading for Protocol Processing
226 Diversion of Offloaded Protocol Processing 228a-
228n Protocol Processing Destinations
230 Detailed Method for Selective Offloading of Protocol Processing
232 Packet Receipt
234 First Packet Portion Analysis
236 First Packet Portion Decision
238 First Packet Portion Affirmative Decision
240 First Packet Portion Affirmative Protocol Routing
242 First Packet Portion Negative Decision
244 Second Packet Portion Analysis
246 Second Packet Portion Decision
248 Second Packet Portion Affirmative Decision
250 Second Packet Portion Affirmative Protocol Routing
252 Second Packet Portion Negative Decision
254 Third Packet Portion Analysis
256 Third Packet Portion Decision
258 Third Packet Portion Affirmative Decision
260 Third Packet Portion Affirmative Protocol Routing
262 Third Packet Portion Negative Decision
264 Third Packet Portion Default Protocol Routing
270 Selective Offloading of Protocol Processing to Host Interface Device Driver
280 Selective Offloading of Protocol Processing to Host Resident Offload Protocol Device
Driver
290 Selective Offloading of Protocol Processing to AP Resident Offload Protocol Device
Driver

Claims

CLAIMSWhat is claimed is:
1. A method including the steps of:
providing a host computer means for processing a plurality of user service requests conveyed over a network;
said host computer means including hardware and software means for fulfilling said plurality of user service requests; and
providing an auxiliary processor means for handling protocol processing for said plurality of user service requests to free up a portion of said hardware and software means of said host computer means for performing other tasks;
said auxiliary processor means being connected to but generally being separate from said host computer means;
said host computer means selectively determining when said auxiliary processor means handles protocol processing for any of said plurality of user service requests.
2. A method as recited in Claim 1, including the step of: providing said auxiliary processor means to said host computer means by placing a separate card within said host computer means.
3. A method as recited in Claim 1, including the step of: providing said auxiliary processor means to said host computer means by adding a separate chip on a board within said host computer means.
4. A method as recited in any preceding Claim, in which: said auxiliary processor means offloads the reception of a plurality of iSCSI data over a TCP/IP network protocol.
5. A method as recited in any preceding Claim, in which: said auxiliary processor means generally performs necessary TCP/IP functions that occur during the normal course of a TCP/IP receive operation and/or a TCP/IP transmit operation, and necessary iSCSI data movement functions.
6. A method as recited in any preceding Claim, in which: said auxiliary processor means transfers control back to said host computer means to in the event of an error.
7. A method as recited in any preceding Claim, in which: said auxiliary processor means transfers control back to said host computer means in the event of an exceptional condition.
8. A method as recited in any preceding Claim , in which: said auxiliary processor means offloads a protocol which is among the set of protocols in the seven layer ISO protocol reference model.
9. A method as recited in Claim 8, in which: a plurality of multiple protocols of different layers are taken together, and said auxiliary processor means treats each unique combination of protocols as a separate protocol.
10. An apparatus including:
a host computer means (12) operable to process a plurality of user service requests conveyed over a network; said host computer including hardware and software means for fulfilling said plurality of user service requests; and
auxiliary processing means (152) operable to protocol processing for user service requests, said auxiliary processing means (152) being connected to but generally being seprate from said host computer (12);
said host computer (12) being operable selectively to determine when said auxiliary processing means should handles handle protocol processing for any user service request.
11. An apparatus including:
a host computer (12);
a computer network (14); said computer network (14) having a connection to said host computer (12);
a network interface means (26c) for conveying data to and from said host computer ( 12) and said computer network (14); said network interface means (26c) being connected to but separate from said host computer
(12); said network interface means (26c) including
a physical interface means for conveying data (168) to and from said computer network (14);
a filter means (174) for receiving inbound data to transmit to said computer network (14); said filter means (174) being coupled to said physical interface means (168); and
an auxiliary processor means for selective protocol processing (152); said auxiliary processor means (152) being coupled to said filter means (174).
PCT/GB2002/003968 2001-09-04 2002-08-30 Selective offloading of protocol processing WO2003021436A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002321567A AU2002321567A1 (en) 2001-09-04 2002-08-30 Selective offloading of protocol processing

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/946,144 US20030046330A1 (en) 2001-09-04 2001-09-04 Selective offloading of protocol processing
US09/946,144 2001-09-04

Publications (2)

Publication Number Publication Date
WO2003021436A2 true WO2003021436A2 (en) 2003-03-13
WO2003021436A3 WO2003021436A3 (en) 2003-11-27

Family

ID=25484016

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2002/003968 WO2003021436A2 (en) 2001-09-04 2002-08-30 Selective offloading of protocol processing

Country Status (3)

Country Link
US (2) US20030046330A1 (en)
AU (1) AU2002321567A1 (en)
WO (1) WO2003021436A2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004097641A1 (en) 2003-04-02 2004-11-11 International Business Machines Corporation State recovery and failover of intelligent network adapters
EP1521409A2 (en) * 2003-10-01 2005-04-06 Broadcom Corporation System and method for load balancing and fail over
WO2006122939A1 (en) * 2005-05-18 2006-11-23 International Business Machines Corporation Network acceleration architecture
WO2007069095A2 (en) * 2005-07-18 2007-06-21 Broadcom Israel R & D Method and system for transparent tcp offload
WO2010085713A1 (en) * 2009-01-23 2010-07-29 Qualcomm Incorporated Methods and systems using data rate driven protocol accelerator for mobile devices
CN103532955A (en) * 2013-10-18 2014-01-22 苏州斯凯迪网络科技有限公司 Embedded multi-protocol mobile network data acquisition probe equipment
EP2930890A4 (en) * 2012-12-31 2015-11-18 Huawei Tech Co Ltd Network device and message processing method

Families Citing this family (138)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5978379A (en) 1997-01-23 1999-11-02 Gadzoox Networks, Inc. Fiber channel learning bridge, learning half bridge, and protocol
US6757746B2 (en) * 1997-10-14 2004-06-29 Alacritech, Inc. Obtaining a destination address so that a network interface device can write network data without headers directly into host memory
US8782199B2 (en) * 1997-10-14 2014-07-15 A-Tech Llc Parsing a packet header
US8621101B1 (en) 2000-09-29 2013-12-31 Alacritech, Inc. Intelligent network storage interface device
US6226680B1 (en) 1997-10-14 2001-05-01 Alacritech, Inc. Intelligent network interface system method for protocol processing
US6697868B2 (en) * 2000-02-28 2004-02-24 Alacritech, Inc. Protocol processing stack for use with intelligent network interface device
US8539112B2 (en) 1997-10-14 2013-09-17 Alacritech, Inc. TCP/IP offload device
US6434620B1 (en) 1998-08-27 2002-08-13 Alacritech, Inc. TCP/IP offload network interface device
US7430171B2 (en) 1998-11-19 2008-09-30 Broadcom Corporation Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost
US8135842B1 (en) 1999-08-16 2012-03-13 Nvidia Corporation Internet jack
US8019901B2 (en) 2000-09-29 2011-09-13 Alacritech, Inc. Intelligent network storage interface system
US7039717B2 (en) * 2000-11-10 2006-05-02 Nvidia Corporation Internet modem streaming socket method
US7379475B2 (en) * 2002-01-25 2008-05-27 Nvidia Corporation Communications processor
WO2002084499A1 (en) * 2001-04-11 2002-10-24 Chelsio Communications, Inc. Multi-purpose switching network interface controller
US7239636B2 (en) 2001-07-23 2007-07-03 Broadcom Corporation Multiple virtual channels for use in network devices
US7295555B2 (en) 2002-03-08 2007-11-13 Broadcom Corporation System and method for identifying upper layer protocol message boundaries
US7543087B2 (en) * 2002-04-22 2009-06-02 Alacritech, Inc. Freeing transmit memory on a network interface device prior to receiving an acknowledgement that transmit data has been received by a remote device
US7403542B1 (en) * 2002-07-19 2008-07-22 Qlogic, Corporation Method and system for processing network data packets
US8015303B2 (en) * 2002-08-02 2011-09-06 Astute Networks Inc. High data rate stateful protocol processing
US8631162B2 (en) * 2002-08-30 2014-01-14 Broadcom Corporation System and method for network interfacing in a multiple network environment
US7934021B2 (en) 2002-08-29 2011-04-26 Broadcom Corporation System and method for network interfacing
US7346701B2 (en) * 2002-08-30 2008-03-18 Broadcom Corporation System and method for TCP offload
US7411959B2 (en) 2002-08-30 2008-08-12 Broadcom Corporation System and method for handling out-of-order frames
US7783035B2 (en) * 2002-08-30 2010-08-24 Adaptec, Inc. Systems and methods for implementing host-based security in a computer network
US8180928B2 (en) 2002-08-30 2012-05-15 Broadcom Corporation Method and system for supporting read operations with CRC for iSCSI and iSCSI chimney
US7313623B2 (en) 2002-08-30 2007-12-25 Broadcom Corporation System and method for TCP/IP offload independent of bandwidth delay product
US7397800B2 (en) * 2002-08-30 2008-07-08 Broadcom Corporation Method and system for data placement of out-of-order (OOO) TCP segments
US20040049603A1 (en) * 2002-09-05 2004-03-11 International Business Machines Corporation iSCSI driver to adapter interface protocol
US7299266B2 (en) * 2002-09-05 2007-11-20 International Business Machines Corporation Memory management offload for RDMA enabled network adapters
US20040049580A1 (en) * 2002-09-05 2004-03-11 International Business Machines Corporation Receive queue device with efficient queue flow control, segment placement and virtualization mechanisms
US7596621B1 (en) * 2002-10-17 2009-09-29 Astute Networks, Inc. System and method for managing shared state using multiple programmed processors
US7814218B1 (en) 2002-10-17 2010-10-12 Astute Networks, Inc. Multi-protocol and multi-format stateful processing
US8151278B1 (en) 2002-10-17 2012-04-03 Astute Networks, Inc. System and method for timer management in a stateful protocol processing system
US7313148B2 (en) * 2002-11-18 2007-12-25 Sun Microsystems, Inc. Method and system for TCP large segment offload with ack-based transmit scheduling
US7698550B2 (en) * 2002-11-27 2010-04-13 Microsoft Corporation Native wi-fi architecture for 802.11 networks
US7596634B2 (en) * 2002-12-12 2009-09-29 Millind Mittal Networked application request servicing offloaded from host
US7184445B2 (en) * 2003-02-12 2007-02-27 Silverback Systems Inc. Architecture and API for of transport and upper layer protocol processing acceleration
US7594002B1 (en) 2003-02-14 2009-09-22 Istor Networks, Inc. Hardware-accelerated high availability integrated networked storage system
US7389462B1 (en) 2003-02-14 2008-06-17 Istor Networks, Inc. System and methods for high rate hardware-accelerated network protocol processing
US7512663B1 (en) 2003-02-18 2009-03-31 Istor Networks, Inc. Systems and methods of directly placing data in an iSCSI storage device
US7420931B2 (en) * 2003-06-05 2008-09-02 Nvidia Corporation Using TCP/IP offload to accelerate packet filtering
US7609696B2 (en) * 2003-06-05 2009-10-27 Nvidia Corporation Storing and accessing TCP connection information
FR2856263B1 (en) * 2003-06-19 2007-03-09 Seb Sa DEVICE FOR FILTERING A COOKING BATH FOR AN ELECTRIC FRYER WITH PLASTER RESISTANCE
US20050015645A1 (en) * 2003-06-30 2005-01-20 Anil Vasudevan Techniques to allocate information for processing
US20050050187A1 (en) * 2003-09-03 2005-03-03 International Business Machines Corporation Method and apparatus for support of bottleneck avoidance in an intelligent adapter
US7526577B2 (en) 2003-09-19 2009-04-28 Microsoft Corporation Multiple offload of network state objects with support for failover events
EP1515511B1 (en) 2003-09-10 2011-10-12 Microsoft Corporation Multiple offload of network state objects with support for failover events
US20050086349A1 (en) * 2003-10-16 2005-04-21 Nagarajan Subramaniyan Methods and apparatus for offloading TCP/IP processing using a protocol driver interface filter driver
US6996070B2 (en) * 2003-12-05 2006-02-07 Alacritech, Inc. TCP/IP offload device with reduced sequential processing
US8065439B1 (en) 2003-12-19 2011-11-22 Nvidia Corporation System and method for using metadata in the context of a transport offload engine
US7899913B2 (en) * 2003-12-19 2011-03-01 Nvidia Corporation Connection management system and method for a transport offload engine
US8549170B2 (en) * 2003-12-19 2013-10-01 Nvidia Corporation Retransmission system and method for a transport offload engine
US8176545B1 (en) 2003-12-19 2012-05-08 Nvidia Corporation Integrated policy checking system and method
US20050188074A1 (en) * 2004-01-09 2005-08-25 Kaladhar Voruganti System and method for self-configuring and adaptive offload card architecture for TCP/IP and specialized protocols
US7249306B2 (en) * 2004-02-20 2007-07-24 Nvidia Corporation System and method for generating 128-bit cyclic redundancy check values with 32-bit granularity
US7206872B2 (en) * 2004-02-20 2007-04-17 Nvidia Corporation System and method for insertion of markers into a data stream
US20050246443A1 (en) * 2004-03-31 2005-11-03 Intel Corporation Management of offload operations in a network storage driver
US7698413B1 (en) 2004-04-12 2010-04-13 Nvidia Corporation Method and apparatus for accessing and maintaining socket control information for high speed network connections
US7764709B2 (en) * 2004-07-07 2010-07-27 Tran Hieu T Prioritization of network traffic
US7493427B2 (en) * 2004-07-14 2009-02-17 International Business Machines Corporation Apparatus and method for supporting received data processing in an offload of network protocol processing
US7930422B2 (en) * 2004-07-14 2011-04-19 International Business Machines Corporation Apparatus and method for supporting memory management in an offload of network protocol processing
US7533176B2 (en) * 2004-07-14 2009-05-12 International Business Machines Corporation Method for supporting connection establishment in an offload of network protocol processing
US8248939B1 (en) 2004-10-08 2012-08-21 Alacritech, Inc. Transferring control of TCP connections between hierarchy of processing mechanisms
US7957379B2 (en) * 2004-10-19 2011-06-07 Nvidia Corporation System and method for processing RX packets in high speed network applications using an RX FIFO buffer
US7835380B1 (en) * 2004-10-19 2010-11-16 Broadcom Corporation Multi-port network interface device with shared processing resources
CA2586763C (en) 2004-11-08 2013-12-17 Cluster Resources, Inc. System and method of providing system jobs within a compute environment
US7783880B2 (en) * 2004-11-12 2010-08-24 Microsoft Corporation Method and apparatus for secure internet protocol (IPSEC) offloading with integrated host protocol stack management
JP4700063B2 (en) * 2004-11-19 2011-06-15 ノースロップ グラマン コーポレイション Real-time packet processing system and method
US9075657B2 (en) 2005-04-07 2015-07-07 Adaptive Computing Enterprises, Inc. On-demand access to compute resources
US7643420B2 (en) * 2005-03-11 2010-01-05 Broadcom Corporation Method and system for transmission control protocol (TCP) traffic smoothing
US9231886B2 (en) 2005-03-16 2016-01-05 Adaptive Computing Enterprises, Inc. Simple integration of an on-demand compute environment
US20060227804A1 (en) * 2005-04-07 2006-10-12 International Business Machines Corporation Method for enablement for offloading functions in a single LAN adapter
US7475167B2 (en) * 2005-04-15 2009-01-06 Intel Corporation Offloading data path functions
EP1891538A4 (en) 2005-05-11 2009-01-21 Bigfoot Networks Inc Distributed processing system and method
US8713180B2 (en) * 2005-06-22 2014-04-29 Cisco Technology, Inc. Zero-copy network and file offload for web and application servers
US20070022212A1 (en) * 2005-07-22 2007-01-25 Fan Kan F Method and system for TCP large receive offload
US7430220B2 (en) * 2005-07-29 2008-09-30 International Business Machines Corporation System load based dynamic segmentation for network interface cards
US7437546B2 (en) * 2005-08-03 2008-10-14 Intel Corporation Multiple, cooperating operating systems (OS) platform system and method
US7616563B1 (en) 2005-08-31 2009-11-10 Chelsio Communications, Inc. Method to implement an L4-L7 switch using split connections and an offloading NIC
US7724658B1 (en) 2005-08-31 2010-05-25 Chelsio Communications, Inc. Protocol offload transmit traffic management
US7660306B1 (en) 2006-01-12 2010-02-09 Chelsio Communications, Inc. Virtualizing the operation of intelligent network interface circuitry
US7639715B1 (en) 2005-09-09 2009-12-29 Qlogic, Corporation Dedicated application interface for network systems
US20070073966A1 (en) * 2005-09-23 2007-03-29 Corbin John R Network processor-based storage controller, compute element and method of using same
US9455844B2 (en) * 2005-09-30 2016-09-27 Qualcomm Incorporated Distributed processing system and method
US20070124378A1 (en) * 2005-10-14 2007-05-31 Uri Elzur Method and system for indicate and post processing in a flow through data architecture
US7899045B2 (en) * 2006-03-29 2011-03-01 Intel Corporation TCP multicast system and method
US20070233886A1 (en) * 2006-04-04 2007-10-04 Fan Kan F Method and system for a one bit TCP offload
US20070297334A1 (en) * 2006-06-21 2007-12-27 Fong Pong Method and system for network protocol offloading
US8245284B2 (en) * 2006-10-05 2012-08-14 Microsoft Corporation Extensible network discovery
US7966039B2 (en) 2007-02-02 2011-06-21 Microsoft Corporation Bidirectional dynamic offloading of tasks between a host and a mobile device
US8935406B1 (en) 2007-04-16 2015-01-13 Chelsio Communications, Inc. Network adaptor configured for connection establishment offload
US20080263171A1 (en) * 2007-04-19 2008-10-23 Alacritech, Inc. Peripheral device that DMAS the same data to different locations in a computer
US8806028B2 (en) * 2007-04-26 2014-08-12 Novatel Wireless, Inc. System and method for accessing data and applications on a host when the host is in a dormant state
US8060644B1 (en) 2007-05-11 2011-11-15 Chelsio Communications, Inc. Intelligent network adaptor with end-to-end flow control
US8589587B1 (en) * 2007-05-11 2013-11-19 Chelsio Communications, Inc. Protocol offload in intelligent network adaptor, including application level signalling
US7831720B1 (en) * 2007-05-17 2010-11-09 Chelsio Communications, Inc. Full offload of stateful connections, with partial connection offload
US8539513B1 (en) 2008-04-01 2013-09-17 Alacritech, Inc. Accelerating data transfer in a virtual computer system with tightly coupled TCP connections
EP2128416A1 (en) * 2008-05-28 2009-12-02 GM Global Technology Operations, Inc. A method and system for controlling a high pressure pump, particularly for a diesel engine fuel injection system
US8327014B2 (en) * 2008-06-30 2012-12-04 Cisco Technology, Inc. Multi-layer hardware-based service acceleration (MHSA)
US8341286B1 (en) 2008-07-31 2012-12-25 Alacritech, Inc. TCP offload send optimization
US9306793B1 (en) 2008-10-22 2016-04-05 Alacritech, Inc. TCP offload device that batches session layer headers to reduce interrupts as well as CPU copies
US8341262B2 (en) * 2008-11-07 2012-12-25 Dell Products L.P. System and method for managing the offload type for offload protocol processing
US8572251B2 (en) * 2008-11-26 2013-10-29 Microsoft Corporation Hardware acceleration for remote desktop protocol
CN101754064A (en) * 2008-12-02 2010-06-23 华为技术有限公司 Communication network and communication method
US8224885B1 (en) 2009-01-26 2012-07-17 Teradici Corporation Method and system for remote computing session management
US20110106937A1 (en) * 2009-10-29 2011-05-05 Fluke Corporation Mixed-mode analysis
US11720290B2 (en) 2009-10-30 2023-08-08 Iii Holdings 2, Llc Memcached server functionality in a cluster of data processing nodes
US9237126B2 (en) * 2010-09-09 2016-01-12 Gerald R. McEvoy One-way bus bridge
US8958284B2 (en) * 2011-06-16 2015-02-17 St-Ericsson Sa Port number reservation agent
US8713169B2 (en) 2011-10-11 2014-04-29 Cisco Technology, Inc. Distributed IPv6 neighbor discovery for large datacenter switching systems
WO2013081620A1 (en) * 2011-12-01 2013-06-06 Intel Corporation Server including switch circuitry
US8918634B2 (en) 2012-02-21 2014-12-23 International Business Machines Corporation Network node with network-attached stateless security offload device employing out-of-band processing
US9762561B2 (en) * 2012-10-31 2017-09-12 Dell Products, Lp System and method for tunneling of management traffic
US10057387B2 (en) * 2012-12-26 2018-08-21 Realtek Singapore Pte Ltd Communication traffic processing architectures and methods
US11132277B2 (en) * 2012-12-28 2021-09-28 Iii Holdings 2, Llc System and method for continuous low-overhead monitoring of distributed applications running on a cluster of data processing nodes
US20170010915A1 (en) * 2014-01-31 2017-01-12 Hewlett Packard Enterprise Development Lp Performing processing tasks using an auxiliary processing unit
US20150256645A1 (en) * 2014-03-10 2015-09-10 Riverscale Ltd Software Enabled Network Storage Accelerator (SENSA) - Network Server With Dedicated Co-processor Hardware Implementation of Storage Target Application
US9606879B2 (en) 2014-09-29 2017-03-28 Nxp Usa, Inc. Multi-partition networking device and method therefor
US9548906B2 (en) 2014-11-24 2017-01-17 Nxp Usa, Inc. High availability multi-partition networking device with reserve partition and method for operating
US10089197B2 (en) * 2014-12-16 2018-10-02 Intel Corporation Leverage offload programming model for local checkpoints
GB2542373A (en) * 2015-09-16 2017-03-22 Nanospeed Tech Ltd TCP/IP offload system
CN105245387A (en) * 2015-10-26 2016-01-13 华为技术有限公司 Method and system for processing message
US10003554B1 (en) 2015-12-22 2018-06-19 Amazon Technologies, Inc. Assisted sideband traffic management
US10157162B2 (en) * 2016-06-27 2018-12-18 Intel Corporation External universal boosting agent device that improves computing performance by managing the offloading of application tasks for connected electronic devices
US10860508B2 (en) * 2017-05-25 2020-12-08 Western Digital Technologies, Inc. Offloaded disaggregated storage architecture
US10536859B2 (en) 2017-08-15 2020-01-14 Charter Communications Operating, Llc Methods and apparatus for dynamic control and utilization of quasi-licensed wireless spectrum
US11409569B2 (en) * 2018-03-29 2022-08-09 Xilinx, Inc. Data processing system
US10795612B2 (en) * 2018-07-31 2020-10-06 EMC IP Holding Company LLC Offload processing using storage device slots
US11003539B2 (en) 2019-01-15 2021-05-11 EMC IP Holding Company LLC Offload processing using a storage slot
US11129171B2 (en) 2019-02-27 2021-09-21 Charter Communications Operating, Llc Methods and apparatus for wireless signal maximization and management in a quasi-licensed wireless system
US11374779B2 (en) 2019-06-30 2022-06-28 Charter Communications Operating, Llc Wireless enabled distributed data apparatus and methods
US11182222B2 (en) * 2019-07-26 2021-11-23 Charter Communications Operating, Llc Methods and apparatus for multi-processor device software development and operation
US11528748B2 (en) 2019-09-11 2022-12-13 Charter Communications Operating, Llc Apparatus and methods for multicarrier unlicensed heterogeneous channel access
US11368552B2 (en) * 2019-09-17 2022-06-21 Charter Communications Operating, Llc Methods and apparatus for supporting platform and application development and operation
US11026205B2 (en) 2019-10-23 2021-06-01 Charter Communications Operating, Llc Methods and apparatus for device registration in a quasi-licensed wireless system
US11457485B2 (en) 2019-11-06 2022-09-27 Charter Communications Operating, Llc Methods and apparatus for enhancing coverage in quasi-licensed wireless systems
US11363466B2 (en) 2020-01-22 2022-06-14 Charter Communications Operating, Llc Methods and apparatus for antenna optimization in a quasi-licensed wireless system
US11363119B1 (en) 2020-12-03 2022-06-14 Wormhole Labs, Inc. Remote processing of augmented reality workloads

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5281963A (en) * 1990-10-04 1994-01-25 Oki Electric Industry Co., Ltd. Information processing equipment having communication capabilities and which calculates load factor
US6141705A (en) * 1998-06-12 2000-10-31 Microsoft Corporation System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3282986B2 (en) * 1996-02-28 2002-05-20 富士通株式会社 Liquid crystal display
US6697868B2 (en) * 2000-02-28 2004-02-24 Alacritech, Inc. Protocol processing stack for use with intelligent network interface device
US6226680B1 (en) * 1997-10-14 2001-05-01 Alacritech, Inc. Intelligent network interface system method for protocol processing
US6434620B1 (en) * 1998-08-27 2002-08-13 Alacritech, Inc. TCP/IP offload network interface device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5281963A (en) * 1990-10-04 1994-01-25 Oki Electric Industry Co., Ltd. Information processing equipment having communication capabilities and which calculates load factor
US6141705A (en) * 1998-06-12 2000-10-31 Microsoft Corporation System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1609063A1 (en) * 2003-04-02 2005-12-28 International Business Machines Corporation State recovery and failover of intelligent network adapters
WO2004097641A1 (en) 2003-04-02 2004-11-11 International Business Machines Corporation State recovery and failover of intelligent network adapters
EP1609063A4 (en) * 2003-04-02 2009-03-11 Ibm State recovery and failover of intelligent network adapters
US8285881B2 (en) 2003-09-10 2012-10-09 Broadcom Corporation System and method for load balancing and fail over
EP1521409A3 (en) * 2003-10-01 2010-03-31 Broadcom Corporation System and method for load balancing and fail over
EP1521409A2 (en) * 2003-10-01 2005-04-06 Broadcom Corporation System and method for load balancing and fail over
WO2006122939A1 (en) * 2005-05-18 2006-11-23 International Business Machines Corporation Network acceleration architecture
WO2007069095A2 (en) * 2005-07-18 2007-06-21 Broadcom Israel R & D Method and system for transparent tcp offload
US7684344B2 (en) 2005-07-18 2010-03-23 Broadcom Corporation Method and system for transparent TCP offload
CN101253745B (en) * 2005-07-18 2011-06-22 博通以色列研发公司 Method and system for transparent TCP offload
US8064459B2 (en) 2005-07-18 2011-11-22 Broadcom Israel Research Ltd. Method and system for transparent TCP offload with transmit and receive coupling
US8274976B2 (en) 2005-07-18 2012-09-25 Broadcom Corporation Method and system for transparent TCP offload
WO2007069095A3 (en) * 2005-07-18 2007-12-06 Broadcom Israel R & D Method and system for transparent tcp offload
WO2010085713A1 (en) * 2009-01-23 2010-07-29 Qualcomm Incorporated Methods and systems using data rate driven protocol accelerator for mobile devices
US8171175B2 (en) 2009-01-23 2012-05-01 Qualcomm Incorporated Methods and systems using data rate driven protocol accelerator for mobile devices
EP2930890A4 (en) * 2012-12-31 2015-11-18 Huawei Tech Co Ltd Network device and message processing method
CN103532955A (en) * 2013-10-18 2014-01-22 苏州斯凯迪网络科技有限公司 Embedded multi-protocol mobile network data acquisition probe equipment

Also Published As

Publication number Publication date
US20030158906A1 (en) 2003-08-21
WO2003021436A3 (en) 2003-11-27
US20030046330A1 (en) 2003-03-06
AU2002321567A1 (en) 2003-03-18

Similar Documents

Publication Publication Date Title
WO2003021436A2 (en) Selective offloading of protocol processing
CN101015187B (en) Apparatus and method for supporting connection establishment in an offload of network protocol processing
US5613155A (en) Bundling client write requests in a server
KR101941416B1 (en) Networking Technologies
CN100468377C (en) Apparatus and method for supporting memory management in an offload of network protocol processing
US6928478B1 (en) Method and apparatus for implementing a MAC address pool for assignment to a virtual interface aggregate
US8874797B2 (en) Network interface for use in parallel computing systems
US8458280B2 (en) Apparatus and method for packet transmission over a high speed network supporting remote direct memory access operations
JP5364773B2 (en) System and method for managing a connection between a client and a server
JP3762846B2 (en) Data processing apparatus and method for managing workload related to a group of servers
CN1864376B (en) Method, system, and product for utilizing host memory from an offload adapter
US20150003467A1 (en) Application-controlled network packet classification
CA2507423A1 (en) Method and system for transferring large data files over parallel connections
CA2341211A1 (en) Intelligent network interface device and system for accelerating communication
US11025564B2 (en) RDMA transport with hardware integration and out of order placement
US11068412B2 (en) RDMA transport with hardware integration
EP1759317B1 (en) Method and system for supporting read operations for iscsi and iscsi chimney
US8566833B1 (en) Combined network and application processing in a multiprocessing environment
CN101827019A (en) Network Interface Unit
US7124231B1 (en) Split transaction reordering circuit
US20040260841A1 (en) Method, apparatus, and system for internet protocol communication over intelligent platform management bus
EP1589424A2 (en) Vertical perimeter framework for providing application services in multi-CPU environments
US20090132582A1 (en) Processor-server hybrid system for processing data
US7460550B2 (en) Storage structure and method utilizing multiple protocol processor units
US7522590B2 (en) Managing message arrival to ensure proper matching of unordered messages

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG UZ VN YU ZA ZM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE BG CH CY CZ DK EE ES FI FR GB GR IE IT LU MC PT SE SK TR BF BJ CF CG CI GA GN GQ GW ML MR NE SN TD TG

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP