US8612622B2 - Real-time message queuing for a processing ring - Google Patents

Real-time message queuing for a processing ring Download PDF

Info

Publication number
US8612622B2
US8612622B2 US12/767,747 US76774710A US8612622B2 US 8612622 B2 US8612622 B2 US 8612622B2 US 76774710 A US76774710 A US 76774710A US 8612622 B2 US8612622 B2 US 8612622B2
Authority
US
United States
Prior art keywords
data
information
processing
cdn
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/767,747
Other versions
US20110082944A1 (en
Inventor
Wylie Swanson
Bryan D. Black
Nathan F. Raciborski
Jacob S. Roersma
Colin Rasor
Albert P. Tobey
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Edgio Inc
Original Assignee
Limelight Networks Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Limelight Networks Inc filed Critical Limelight Networks Inc
Priority to US12/767,747 priority Critical patent/US8612622B2/en
Assigned to LIMELIGHT NETWORKS, INC. reassignment LIMELIGHT NETWORKS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TOBEY, ALBERT P., RACIBORSKI, NATHAN F., BLACK, BRYAN D., RASOR, COLIN, ROERSMA, JACOB S., SWANSON, WYLIE
Priority to EP10821363.8A priority patent/EP2484064A4/en
Priority to CN2010800518701A priority patent/CN102714634A/en
Priority to BR112012007538A priority patent/BR112012007538A2/en
Priority to PCT/US2010/051190 priority patent/WO2011041722A2/en
Publication of US20110082944A1 publication Critical patent/US20110082944A1/en
Priority to US13/568,970 priority patent/US9197537B2/en
Publication of US8612622B2 publication Critical patent/US8612622B2/en
Application granted granted Critical
Assigned to U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION reassignment U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION PATENT SECURITY AGREEMENT Assignors: EDGIO, INC., MOJO MERGER SUB, LLC
Assigned to LYNROCK LAKE MASTER FUND LP [LYNROCK LAKE PARTNERS LLC, ITS GENERAL PARTNER] reassignment LYNROCK LAKE MASTER FUND LP [LYNROCK LAKE PARTNERS LLC, ITS GENERAL PARTNER] PATENT SECURITY AGREEMENT Assignors: EDGIO, INC., MOJO MERGER SUB, LLC
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/12Shortest path evaluation
    • H04L45/125Shortest path evaluation based on throughput or bandwidth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/302Route determination based on requested QoS
    • H04L45/306Route determination based on the nature of the carried application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast

Definitions

  • This disclosure relates in general to processing networks and, but not by way of limitation, to data streaming from a content delivery network (CDN).
  • CDN content delivery network
  • CDNs provide enhanced delivery of content for others. Each CDN takes content from content providers and efficiently provides the content to end users who request the content. Quality of service (QoS) can vary when using a CDN. In some cases, a point of presence (POP) used by an end user may not be the most favorable location to receive content. For example, a user in Phoenix could use a POP in New York in some circumstances likely providing less than optimum QoS.
  • QoS Quality of service
  • POP point of presence
  • Delivery of content is greatly effected by how the broader Internet is behaving in real time or near real time.
  • General trends provided by infrequent updates do not provide the timely information to make some delivery decisions of a CDN.
  • the present disclosure describes systems and methods for gathering distributed information from a number of data agents for a messaging queue, which is coupled to a number of processing subscribers.
  • the data agents provide their gathered information to an interface defined by an API.
  • the gathered data may be reformatted or further processed before adding the gathered information to the messaging queue.
  • a number of processing subscribers listen to a content stream produced by the messaging queue to receive data they have subscribed to. Once the processing subscriber receives the content stream, the processing subscriber applies algorithms to the content stream to perform one or more other functions. For instance, the processing subscriber can feed back processed data into the messaging queue and/or perform an action based, at least in part, upon the content stream.
  • Information in various degrees of processing and aggregation can be passed through any number of cycles in a processing ring to allow for a clearinghouse of information to flow in real time or near real time.
  • the present disclosure describes a content delivery network (CDN) for timely exchange of information for distributed processing of the information.
  • the CDN includes first and second interfaces, a messaging queue and third and fourth interfaces.
  • the first interface is coupled to a first data agent, which supplies first data to the first interface.
  • the second interface is coupled to a second data agent, which supplies second data to the second interface.
  • the messaging queue within the CDN, produces a stream, which is a function of the first data and the second data.
  • the messaging queue is coupled to the first interface and the second interface.
  • the third interface is coupled to the messaging queue and a first processing subscriber, which receives the stream.
  • the first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent.
  • the fourth interface is coupled to the messaging queue and a second processing subscriber, which receives the stream.
  • the first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent.
  • the present disclosure describes a method for aggregating information with a CDN for timely exchange of the information in a distributed fashion.
  • First data is received from a first interface, which is coupled to a first data agent.
  • Second data is received from a second interface, which is coupled to a second data agent.
  • the first data and second data is processed.
  • a stream is formulated with a messaging queue of the CDN, which is a function of the first data and the second data.
  • the messaging queue is coupled to the first interface and the second interface.
  • the stream is sent to a third interface, which is coupled to a first processing subscriber to receive the stream.
  • the first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent.
  • the present disclosure describes a method for aggregating information with a distributed network of POPs for timely exchange of the information in a distributed fashion.
  • First data is received from a first interface of a first POP, wherein the first interface is coupled to a first data agent.
  • Second data is received from a second interface of a second POP.
  • the second interface is coupled to a second data agent.
  • the distributed network of POPs include the first POP and the second POP.
  • the first POP is geographically distant from the second POP.
  • the first data and second data is processed.
  • a stream is formulated with a messaging queue, which is a function of the first data and the second data.
  • the messaging queue is coupled to the first interface and the second interface.
  • the stream is sent to a third interface, which is coupled to a processing subscriber to receive the stream.
  • FIG. 1 depicts a block diagram of an embodiment of a content distribution system
  • FIG. 2 depicts a block diagram of an embodiment of a data processing system
  • FIG. 3 depicts a diagram of an embodiment that demonstrates data flows
  • FIG. 4 depicts a block diagram of an embodiment of a processing ring
  • FIG. 5 depicts a block diagram of an embodiment that details portions of a content delivery network (CDN);
  • CDN content delivery network
  • FIG. 6 illustrates a flowchart of an embodiment of a process for operation of the data processing system
  • FIG. 7 illustrates a flowchart of an embodiment of a process that configures an internal processing subscriber
  • FIG. 8 illustrates a flowchart of an embodiment of a process for setting up a data agent and using the data agent to report information to a messaging queue
  • FIGS. 9A and 9B illustrate flowcharts of embodiments of a process for improving upon Anycast routing.
  • the content originator 106 offloads delivery of the content objects to a content delivery network (CDN) 110 in this embodiment.
  • the content originator 106 produces and/or distributes content objects and includes a content provider 108 , a content site 116 , and an origin server 112 .
  • the CDN 110 can cache, redistribute and/or host content in various embodiments for third parties to offload delivery and typically provide better quality of service (QoS).
  • QoS quality of service
  • the content distribution system 100 locates the content objects (or portions thereof) and distributes the content objects to an end user system 102 or processing subscribers (not shown).
  • the content objects are dynamically cached or processed within the CDN 110 to improve the QoS without replicating the whole content object, unless subsequently requested by the end user 128 .
  • a content object is any content file or content stream and could include, for example, video, pictures, data, audio, software, and/or text.
  • a content object could be gathered information or a content stream from a messaging queue.
  • the content object could be live, delayed or stored.
  • the content object could be gathered information, which is streamed to or from the CDN 110 in real time or near real time.
  • references may be made to a content object, content, content stream and/or content file, but it is to be understood that those terms could be used interchangeably wherever they may appear.
  • the CDN 110 includes a number of points of presence (POPs) 120 , which are geographically distributed through the content distribution system 100 to deliver content.
  • POPs points of presence
  • Various embodiments may have any number of POPs 120 within the CDN 110 that are generally distributed in various locations around the Internet 104 to be proximate to end user systems 102 .
  • Multiple POPs 120 use the same IP address such that an Anycast routing scheme is used to find a POP 120 likely to be close to the end user in a network sense for each request.
  • WAN wide area network
  • 114 may couple the POPs 120 with each other and also couple the POPs 120 with other parts of the CDN 110 .
  • the request for the web page is passed either directly or indirectly via the Internet 104 to the content originator 106 .
  • the content originator 106 is the source or re-distributor of content objects.
  • the content site 116 is a ⁇ web site accessible by the end user system 102 .
  • the content site 116 could be a web site where the content is viewable with a web browser.
  • the content site 116 could be accessible with application software other than a web browser.
  • the content provider 108 directs content requests to a CDN 110 after they are made or formulates the delivery path by embedding the delivery path into the URLs for a web page in this embodiment. In any event, the request for content is handed over to the CDN 110 in this embodiment by using an Anycast IP address corresponding to two or more POPs 120 .
  • the request is associated with a particular POP 120 within the CDN 110 using the Anycast routing scheme.
  • the particular POP 120 may retrieve the portion of the content object from the content provider 108 .
  • the content provider 108 may directly provide the content object to the CDN 110 and its associated POPs 120 through prepopulation, i.e., in advance of the first request.
  • the content objects are provided to the CDN 110 and stored in one or more CDN servers such that the portion of the requested content may be served from the CDN 110 .
  • the CDN servers include edge servers that actually serve end user requests.
  • the origin server 112 holds a copy of each content object for the content originator 106 . Periodically, the content of the origin server 112 may be reconciled with the CDN 110 through a cache, hosting and/or pre-population algorithm.
  • the content object is stored within the particular POP 120 and is served from that POP 120 to the end user system 102 .
  • Streamed content objects can have real time or near real time information or can be previously stored.
  • the end user system 102 receives the content object and processes it for use by the end user 128 or an automated processing systems.
  • the end user system 102 could be a personal computer, media player, handheld computer, Internet appliance, phone, IPTV set top, web server, processing system, streaming radio or any other device that receives and/or plays content objects.
  • a number of the end user systems 102 could be networked together.
  • This CDN 110 allows efficient gathering of real time information for distribution both inside and outside of the CDN 110 .
  • External data agents could provide information to different POPs 120 in different cities that is aggregated by the CDN 110 into a content stream from a messaging queue 226 for processing in yet another location by receiving the content stream from a nearby POP 120 .
  • the WAN 114 can be far more efficient and secure when distributing content between POPs 120 in embodiments. Additionally, processing subscribers can get the benefit of similar information being available in a content stream to provide a broader sampling of information to base processing decisions upon.
  • a data processing system 200 uses the CDN 110 infrastructure to efficiently share information in real time or near real time.
  • the data processing system 200 performs internal data gathering and processing of streamed content along with external data gathering and processing in this embodiment. Other embodiments could have either all external or all internal data gathering.
  • the data processing system 200 allows reporting timely information that might be of interest to the reporting party or other parties.
  • the data processing system 200 can monitor gathered information from several sources to allow it to make timely business and/or processing decisions based upon that information. For example, reports on the health of various links on the Internet could be gathered and reported to the data processing system 200 from a number of sources to allow the data processing system 200 to route delivery requests to edge servers that are relatively free of Internet congestion. By gathering information from many sources, the reliability of the gathered information increases in the aggregate such that subscribers can use the aggregated information or content stream to make better decisions in one embodiment.
  • the CDN 110 is used for a number of purposes to include the aggregation and distribution of gathered information as discussed above. Additionally, the CDN 110 performs processing of the gathered information for internal purposes or as a service for others in this embodiment. Although not detailed in FIG. 2 , the CDN 110 can perform more traditional tasks like distributing content for others by caching content from origin servers or hosting content as the origin server. Those blocks associated with distributing content are not detailed in the CDN 110 shown in FIG. 2 . Other embodiments of the CDN might not perform the traditional content delivery instead focusing the CDN on performing as a clearinghouse for gathered information in various stages of processing and aggregation.
  • the CDN 110 gathers information from one or more internal data agents 208 B.
  • the internal data agents 208 B gather information relating to such things as delivery performance, resource loading, bandwidth cost, customer provisioning, business intelligence, etc.
  • FIG. 2 shows a single internal and external data agent 208 for simplicity, but it is to be understood that there could be any number of internal and external data agents 208 .
  • the internal data agents 208 B can report the gathered information in real-time, near real-time or along another time line. To account for any delay in reporting information, a time stamp or staleness indicator can inform others of how timely the information was sampled.
  • the CDN 110 can opt to allow third parties to use internally or externally gathered information that is aggregated within the CDN 110 by subscription of the external processing subscriber(s) 212 A for the third party.
  • a command and control (CC) interface 238 configures the gathered input information to and output of content streams from the CDN 110 .
  • APIs for accepting gathered information and providing content streams are provided to third parties external to the CDN 110 who want to subscribe to content streams.
  • the CDN 110 or a third party can designed an as yet undefined APIs using the CC interface 238 .
  • the CDN 110 can also define authorization and authentication parameters using the CC interface 238 such as authentication, authorization, login, and/or data encryption.
  • CC information is passed to the various data agents 208 and processing subscribers 212 through a channel separate from the gathered information or content stream in this embodiment, but other embodiments could embed CC information in these communication channels.
  • the CC information allows throttling information reporting frequency, specifying formats for information and content streams, deactivation of a data agent 208 or processing subscriber 212 , updating authentication and authorization, etc.
  • the various content streams that are available can be researched and explored through the CC interface 238 .
  • Those content stream selections for a particular processing subscriber 212 are stored in the queue subscription information 222 .
  • the CDN 110 then routes selected content streams to processing subscribers 212 that have selected delivery of a given content stream.
  • the CDN 110 also supports historical queries of the various content streams that are stored in an historical datastore 234 as gathered by an archive data agent 208 C.
  • the archive data agent 208 C supports running of hypothetical queries against historical messaging queue information to test how algorithms running at a processing subscriber 212 would react, for example, to content streams gathered in the past.
  • various content streams can be selected for archiving into the historical datastore 234 .
  • External data agents 208 A can also gather information that is reported to the CDN 110 in real-time, near real-time or along another time line.
  • Each type of information or variable collected by CDN 110 falls within a defined API or multiple APIs.
  • the CC interface 238 is used to define additional variables to modify an API that might be of use to processing subscribers 212 .
  • the additional variables can be passed to all processing subscribes 212 or just a subset.
  • a data agent 208 may report last mile bandwidth achieved and a subscriber identifier associate with the test, but define the subscriber identifier as a private variable that would not be passed to processing subscribers 212 outside its domain. Processing subscribers 212 within its domain would receive the subscriber identifier along with bandwidth reports reported by its own data agents 208 .
  • Encryption and/or unique addressing of content streams or sub-streams can be used to hide the private variables within the messaging queues.
  • Some types of information may have standard APIs.
  • the developer can specify or suggest a new API through the CC interface 238 as new sources of information are characterized and provided.
  • An example of an API that reports delivery health information could be one that accepts source IP address, destination IP address, streaming rate, latency, reliability, and sample time. With enough data agents 208 reporting delivery health from within the CDN 110 or externally, an aggregation of that information can be used for any number of purposes.
  • Some embodiments charge for receiving content streams by external processing subscribers 212 A.
  • the cost can be per record, per byte or per subscription.
  • Some embodiments offset credit for gathered information provided from external data agents 208 A against the cost for content streams to external processing subscribers 212 A. For example, each gathered information record provided to the CDN 110 would result in a free data record from the content stream in one embodiment. Generally, data in the aggregated content stream becomes a more reliable sampling with more entities reporting information.
  • the CDN 110 can negotiate pricing for information provided and information consumed through costing information accessible through the CC interface 238 .
  • External data agents 208 A communicate with the CDN 110 through an interface or data input adapter 230 .
  • FIG. 2 only shows a single external data agent 208 A, although it is to be understood that there could be hundreds, thousands or millions of external data agents 208 in various embodiments.
  • the communication with the data input adapter 230 can be encrypted or not.
  • a socket using a TCP connection could be used.
  • other transport layer protocols like SCTP and UDP could be used in some embodiments to intake the gathered information.
  • a protocol such as SSL could be used to protect the information over the TCP connection.
  • Authentication and authorization can be performed to any external data agent 208 A interfacing to the CDN 110 .
  • the data input adapter 230 receives the information from an external data agent 208 A by providing the API and any encryption, authorization, and/or authentication. In some cases, the data input adapter 230 reformats or rearranges the information from the external data agent 208 A. Although not shown, some embodiments could use a data input adapter 230 for an internal data agent 208 B.
  • the CDN 110 has a number of POPs 120 geographically distributed such that most external data agents 208 A and processing subscribers 212 A are relatively close to a POP 120 .
  • External data agents 208 A and external processing subscribers 212 A are assigned to a particular POP 120 using Anycast, DNS resolution, redirection, or other methods to use a nearby POP 120 with adequate QoS.
  • the POP 120 to use for gathered information or content streams may be chosen to reduce the number of POPs 120 sending a particular stream, limit loading of a POP 120 , speed latency in gathering or streaming of information, or satisfy other requirements.
  • a processing ring could be fixed to the specified POP to use for each data agent 208 and processing subscriber 212 .
  • the messaging queue 226 takes all the information from the data agents 208 and distributes the gathered information as a content stream to any processing subscribers 212 that have requested the content stream from the messaging queue 226 .
  • the messaging queue 226 may be in a single POP 120 , a central location or distributed among a number of POPs 120 . Only content streams within the messaging queue 226 that a particular processing subscriber 212 has subscribed to may be read by that processing subscriber 212 if received at all. Gathered information sent to the messaging queue 226 is processed and returned in a content stream in a fraction of a second by the messaging queue 226 .
  • Protocols such as Multicast or multiple Unicast could be used to distributed streams within the messaging queue 226 . Additionally, transport layer protocols like TCP, SCTP and UDP could be used in various embodiments.
  • an external or internal processing subscriber 212 A, 212 B can be assigned one or more content streams within the messaging queue 226 .
  • a content stream is a particular type of messages in a particular category.
  • six data agents 208 could all report content delivery metrics as information passed through the messaging queue 226 into a given content stream.
  • One or more processing subscribers 212 could subscribe and receive the content stream to process the information and make a decision and/or feed the output from the processing as gathered information fed back into the messaging queue 226 .
  • a developer can search the available content streams or specify a new content stream and its API. The new content stream might be determined by processing a number of existing content streams with a processing subscriber 212 .
  • the CDN 110 has internal processing subscribers 212 B that process assigned content streams to perform functions within the CDN 110 .
  • Internal processing subscribers 212 B could perform functions such as provisioning new accounts or improving routing based upon one or more content streams from the messaging queue 226 .
  • Processing rules 216 - 2 are provided to the internal processing subscriber 212 B to provide algorithms, rules, instructions, and/or software that define how the subscribed content streams are processed.
  • Processing rules 216 - 2 can decide filtering and weighting of records from the content stream. To the extent that decisions are made based upon analysis of the content stream, each data record is time stamped to reflect when the information was gathered such that additional credibility could be given to more recent results, for example. Other embodiments may filter out records in the content stream that are from an unreliable source or stale. For example, a particular contributor of information may prove to have less than optimal gathered information and that could be weighted very low or removed altogether. For external processing subscribers 212 A, the filtering could be done by the data output adapter 242 to reduce bandwidth passing from the CDN 110 .
  • Internal processing subscribers 212 B may additionally process one or more content streams to provide different information to feed back into the messaging queue 226 to be part of a different content stream.
  • hundreds of external data agents 208 could provide geographically correlated temperature measurements that are put into a content stream on the messaging queue 226 .
  • An internal processing subscriber 212 B could receive the content stream and process it into topographic heat map that is supplied back as gathered information passed onto the messaging queue 226 for possible use by other internal and external processing subscribers 212 .
  • the various data agents 208 and processing subscribers 212 arranged in a chain form a processing loop.
  • External processing subscribers 212 A act similarly to internal processing subscribers 212 B, but for third parties that are not part of the CDN 110 .
  • the external processing subscribers 212 A interface with the CDN 110 through data output adapters 242 .
  • Data output adapters 242 can perform authentication, authorization, reformatting, filtering, encryption, etc.
  • External processing subscribers 212 A can ingest content streams from the messaging queue 226 , but they can also act as an external data agent in some cases by returning processed information back into the messaging queue 226 .
  • Processing rules 216 - 1 define how the external processing subscribers 212 A will process the subscribed content streams.
  • the CC interface 238 allows the CDN 110 to query historical messaging queue 226 information.
  • An archive data agent 208 C listens to the messaging queue 226 to store content streams in a historical database 234 .
  • the historical database 234 may store content streams for varying amounts of time and may not store all content streams. Different content streams may be stored, for different amounts of time. For example, temperature readings for a refrigerator may be put on the messaging queue 226 but only stored if beyond some threshold that corresponds to a failure.
  • Gathered information 304 from a number of data agents 208 is sent to the CDN 110 . Additional gathered information 304 may be gathered within the CDN 110 by internal data agents 208 B as described above.
  • a messaging queue 226 is produced by the CDN 110 having a number of content streams 308 . Processing subscribers 212 (not shown) outside and within the CDN 110 receive the streams 308 in real time or near real time.
  • FIG. 4 a block diagram of an embodiment of a processing ring 400 is shown.
  • This example of a processing ring 400 gathers information 304 from n data agents 208 . Some of the information 304 goes through up to three rounds of processing before the end of the processing ring is reached. Some of the processing subscribers 212 - 2 , 212 - 3 , 212 - m , 212 - 5 do not provide their further processed information back to the messaging queue to act as an end point for the information flow that are sometimes referred to as “listening subscribers” herein. Although there are three messaging queues 226 shown, it is to be understood these could the same messaging queue or any number of different messaging queues. The messaging queues 226 could be wholly within the CDN 110 or partially outside the CDN 110 in various embodiments. Certainly, portions of the messaging queues 226 are accessible to external processing subscribers 212 A as content streams 308 .
  • the data agents 208 could be reporting the time it takes to ping a given address.
  • This gathered information 304 is reported in real time (i.e., less than 1 second) or near real time (i.e., less than 10 seconds after gathering) and coupled to the messaging queue 226 .
  • the gathered information 304 is time stamped to indicate freshness of the raw information. For example, the time the test is performed could be memorialized in the time stamp.
  • Each data agent 208 would report its address, the given address to ping, a ping time, and when the ping test was performed to the messaging queue 226 in this example.
  • the various data agents 208 could be in several POPs 120 of the CDN 110 and third party systems coupled to the CDN 110 , for example, an origin server that hosts content could report the responsiveness to pings from its location. Through aggregation of many ping results, the health of the Internet can be monitored in real time or near real time in this example.
  • the second processing subscriber 212 - 2 is a listening subscriber that does not provide further information to the messaging queue 226 , but takes the stream 308 and uses it, for example, to update routing tables for a router. For example, routing tables could be updated by the second processing subscriber 212 - 2 to specify what are most likely to the most responsive routes on the Internet in real time or near real time.
  • the first processing subscriber 212 takes the stream 308 with ping results from a number of data sources and further processes it by grouping results by autonomous systems (AS) number and reports that gathered and processed information 304 back into the messaging queue 226 . Average results grouped by AS number is gathered information that takes far less bandwidth to report to others and avoids having to inspect each and every record in the content stream 308 by processing subscribers 212 further along in the processing ring 400 .
  • AS autonomous systems
  • processing subscribers 212 listening to the content stream 308 of ping results summarized by AS number.
  • a fourth processing subscriber 212 - 4 further processes the stream 308 by adding geographic information for the AS numbers. This processing correlates the ping results to geographic estimates for the AS numbers. That gathered information 304 is provided back to the messaging queue 226 .
  • a fifth processing subscriber 212 - 5 listens to the content stream 308 from the messaging queue 226 to receive geographically correlated ping results.
  • this processing ring 400 has three levels of processing, other embodiments could have more or less. Additionally, data agents 208 could provide any number of different information 304 that is used in the processing.
  • FIG. 5 an embodiment of a block diagram detailing portions of the CDN 110 .
  • This embodiment of the CDN 110 shows two POPs 120 , but typically there would be more POPs 120 distributed across the Internet 104 to increase the likelihood a POP 120 is nearby (in a network sense) to the end user systems 102 , external processing subscriber 212 A or external data agent 208 A.
  • Each POP 120 can pass requests, content objects, status information, gathered information 304 , content streams 308 etc. between POPs 120 using the Internet 104 and a WAN 114 .
  • the WAN 114 couples together the POPs 120 using a private backbone in this embodiment, but could include public networks in other embodiments.
  • Each POP 120 includes a number of edge servers 530 that service requests from end user systems 102 .
  • Anycast routing scheme requests for content find a particular POP 120 of the CDN 110 that is likely nearby in a network sense to the requestor. This is often a POP 120 well suited to supply the content object, but in some cases another POP is better suited for some reason.
  • an Internet service provider may use a proxy in a location geographically distant from the end user system 102 that causes the request for content to find a POP 120 near the proxy instead of near the end user system 102 when Anycast resolution is used to find a nearby POP 120 .
  • the edge servers 530 serve content objects, receive generated information 304 and relay content streams 308 .
  • the data input adapter 230 and data output adapter 242 functionality can be implemented within the edge server 530 in this embodiment.
  • the messaging queue(s) 226 are available typically from the WAN 114 in unfiltered form. Those individual content streams 308 subscribed to are provided to a external processing subscriber 212 A by the edge server 530 in this embodiment. The processing subscribers 212 subscribed to a given content stream 308 could be grouped to a single edge server 530 where practical.
  • the switch fabric 540 receives a request for a content object and assigns an edge server 530 that is typically located in the POP 120 that originally received the request, but not necessarily.
  • the switch fabric 540 can alternatively assign the request to an edge server 530 in another POP 120 .
  • a table within the switch fabric 540 indicates a favored POP 120 for certain IP addresses, AS numbers and/or ranges of IP addresses. Where there is no favored POP indicated or the favored POP originally received the request, it is presumed that Anycast acted properly and the POP 120 receiving the request would route the request to an edge server 530 for fulfillment.
  • An internal data agent 208 B monitors the incoming requests for content and notes how Anycast is resolving. Other embodiments could use other ways to resolve to a POP 120 such as single-stage DNS, two-stage DNS, request redirect, etc.
  • the internal data agent 208 B notes the IP address of the requestor, resolution technique and the time of the request for reporting that gathered information 308 to the messaging queue 226 .
  • external data agents 208 A could observe how Anycast is resolving for requests from various IP addresses and report that gathered information 304 to the messaging queue 226 .
  • the gathered information includes in each record, the requesting IP address, the location of the POP 120 found with Anycast, the protocol used in the request, the particular request, the time that the request was received and latency, bandwidth, packet loss, jitter, and other QoS factors related to the delivery.
  • An API to the messaging queue 226 is used to gather the records.
  • Third-party location services provide approximate geographic locations for IP addresses, AS numbers and/or portions of IP addresses.
  • An external data agent 208 A with the location service provides information 304 when IP addresses, AS numbers and/or groups of IP addresses are correlated to a geographic location. As correlations are made by the service between locations and IP address(es), the external data agent 208 A provides that gathered information 304 .
  • the internal processing subscriber 212 B receives the content stream 308 from the location service(s) along with the content stream from the internal data agents 208 B in each POP 120 that report Anycast resolutions.
  • feedback from deliveries can be used to determine better POPs 120 for particular IP addresses and/or ranges of addresses.
  • An internal data agent 208 B (not shown) within each edge server 530 can determine the latency, bandwidth, packet loss, jitter, and other QoS factors for a particular delivery from a POP 120 and edge server 530 to a particular IP address. That gathered information 304 can be encapsulated into a content stream 308 that is received by the internal processing subscriber 212 B.
  • third parties making deliveries outside of the CDN 110 with their own servers or using another CDN can provide information with an external data agent 208 A that is coupled to the internal processing subscriber 212 B by the messaging queue 226 .
  • the switch fabric 540 could route according to the suggestion of the location service and where there is no suggestion, switch fabric could route the request to the POP 120 providing the best QoS for that IP address or similar IP addresses based upon information from the content stream 308 .
  • the internal processing subscriber 212 B receives a content stream 308 from one or more geolocation services. Additionally, gathered information 304 from individual deliveries within or outside the CDN 110 are sent in one or more streams 308 to the internal processing subscribers 212 B in each POP 120 . Processing rules 516 indicate how to interpret the stream 308 . For example, there may be weighting in the processing rules to favor delivery results gathered within the CDN 110 in contrast to delivery results gathered outside the CDN 110 . Results from deliveries or from geolocation services could be aged in favor of newer results in appreciation of the changing conditions on the Internet 104 in one embodiment.
  • the switch fabric 540 may prefer one POP 120 , but could prefer a different POP 120 for a request for a small content file download or content stream 308 .
  • the above Table shows an example of some of the routing preferences within the switch fabric 540 that would be used in choosing an edge server 530 between the POPs 120 . It is to be understood that there would be far more table entries in a typical embodiment of routing preferences. In some cases, there are ranges of various sizes and even specific addresses specified for special handling with the switch fabric 540 .
  • the most specific range would be favored over the broader ranges. For example, a request from IP address 128.234.343.123 would have the entry for that specific address and entries for the 128-171.xxx.xxx.xxx and 128.234.343.xxx ranges. In this case, the 128.234.343.123 entry would be used instead of the entry for any range because IP address is more specific. If the request were for a small file download however, the entry for the 128.234.343.xxx range would be used since the 128.234.343.123 entry has no routing preference for a small file download such that the delivery would be from the Témpe POP regardless of which POP 120 originally received the request using Anycast. As the content stream 308 is received, the content stream 308 is processed and applied to routing preferences for all entries that correspond to the information gathered for a particular address such that the Table is changing in real time or near real time.
  • This embodiment shows an internal processing subscriber 212 B in each POP 120 locally processing the content stream 308 to adjust the switch fabric 540 for those times that Anycast does not resolve a request to a favored POP 120 .
  • Other embodiments could adjust how the switch fabric 540 resolves requests in different ways. There could be embodiments that don't have an internal processing subscriber 212 B in each POP 120 for programming the switch fabric 540 .
  • One location in the CDN 100 would have the internal processing subscriber 212 B that would also include an internal data agent 208 B (not shown) that sends information 304 to those POPs 120 not processing the rules locally to affect the switch fabric 540 .
  • the internal processing subscriber 212 B in each POP 120 could produce the table of preferred POPs 120 according to the processing rules 516 applied to the content stream 308 .
  • the table of preferred POPs 120 for various IP addresses of requests are routed by the switch fabric 540 to the preferred POP 120 to effectively override the Anycast distribution of requests.
  • the geolocation service and Anycast routing may not find a POP 120 with adequate QoS, better QoS or the best QoS.
  • QoS falls below a threshold in one or more metrics, and the Anycast and geolocation service is not finding an adequate solution above the threshold, another algorithm can be used to find a better POP 120 to perform the delivery for an IP address or range of IP addresses.
  • the switch fabric 540 can this algorithm to assign a POP 120 in a random, unpredictable or round-robin fashion. One embodiment might assign the next closest POP 120 .
  • the results of how the delivery was performed is reported back to the internal processing subscriber 212 B with the appropriate content stream 308 .
  • the POP 120 would become the new choice for similar requests.
  • a number of different POPs 120 could be tested with actual deliveries or test deliveries of content objects. This probing for better POP 120 assignments could be done periodically even if QoS doesn't fall below a threshold as the performance of the Internet 104 changes over time. Requests from IP addresses with historically unpredictable QoS could be targeted more often to probe for a better POP 120 .
  • FIG. 6 an embodiment of a process 600 for operation of the data processing system 200 is shown.
  • the depicted portion of the process begins in block 604 where the developer would use the CC interface 238 to manage the interaction between the data agents 208 and the messaging queue 226 .
  • the developer inputs the API design where there is not one pre-defined, address of the data agent 108 , authentication and authorization information for any external data agents 208 A, etc. into the CC interface 238 .
  • the API design specifies the types of variables, how they are formatted and other information to describe the gathered information 304 in the data feed to the messaging queue 226 .
  • the API design also defines how the gathered information 304 is portrayed when sent from the messaging queue 226 as a content stream 308 .
  • the content stream 308 has records or samples that are defined by the API design.
  • the developer chooses the available content streams 308 in the messaging queue 226 for use by a particular processing subscriber 212 .
  • a given content stream 308 chosen may only have records from the data agents 208 previously configured in block 604 or could include records of third parties from other data agents 208 .
  • Each record in the content stream 308 could be serialized or include the data agent address as a mechanism to differentiate records.
  • the developer interacts with the data processing system 200 to input API information, address of the processing subscriber 212 , authentication and/or authorization information, etc. into the CC interface 238 to configure a particular processing subscriber 212 to interact with the messaging queue 226 of the CDN 110 . All queue subscription information is recorded for each processing subscriber 212 in the queue subscription information database 222 .
  • the input gathered information 304 and output content stream 308 for the messaging queue 226 is configured at this point by the developer.
  • the developer also configures the processing rules 216 for the processing subscriber 212 to use when operating upon its content stream(s) 308 from the messaging queue 226 .
  • the processing rules 216 may or may not be stored within the CDN 110 .
  • the developer may find it helpful to check the rule operation against the historical datastore 234 when designing the rules to provide test results from a prior content stream(s) 308 .
  • Many levels of data agents 208 and processing subscribers 212 can be defined in blocks 604 and 608 to define a processing ring.
  • operation of the developer's data processing system begins when the data agent(s) 208 reports gathered information 304 .
  • the data processing system 200 could have any number of data agents 208 internal or external to the CDN 110 .
  • External data agents 208 A generally use data input adapters 230 as described above.
  • External processing subscribers 212 A generally use data output adapters 242 . Any configuration of the external data agents 208 A or external processing subscribers 212 A can be performed with the CC interface 238 .
  • a data adapter 230 checks, reformats and/or performs other processing on the gathered information 304 in block 616 .
  • the checks may include authentication and/or authorization, for example, or checks on formatting, data types, valid data ranges, etc.
  • Internal data agents 208 B can optionally skip block 616 going directly to block 620 . After the data is available within the CDN 110 and optionally checked by a data adapter 230 , the gathered information 304 is injected into the messaging queue 226 in block 620 .
  • the messaging queue 226 distributes gathered information in block 624 that is comprised of a series of messages, packets, samples, or records in a particular category that are collectively referred to as a content stream 308 . Because gathered information 304 is produced by the data agents 208 often in real time and reported to the messaging queue 226 without delay, the gathered information 304 is quickly made available in real-time or near real-time, for example, the data may be less than one, two, five, ten, or twenty seconds old when it enters the messaging queue 226 .
  • the content streams 308 are distributed in multicast and/or unicast fashion to the various processing subscribers 212 within the CDN 110 or anywhere on the Internet in block 624 .
  • multicast is used for processing subscribers 212 within the CDN 110 or that have networks that support multicast, and parallel unicast streams are used for external Processing subscribers 212 B that do not have network support for multicast.
  • Each processing subscriber 212 can only read the content streams 308 in block 628 that it subscribes to.
  • Authentication and/or authorization using, for example, encryption can be use to protect streams 308 or sub-streams from exposure to non-subscribers.
  • each processing subscriber 212 operates on its one or more content streams 308 from the massaging queue 226 in block 632 .
  • a processing subscriber 212 can optionally return the processed information 304 back into the messaging queue 226 in block 636 by also acting as a data agent 208 unlike listening subscribers that do not include capability to act as data agent 208 .
  • processing subscribers 212 typically perform an operation or action in block 640 based, at least in part, on the information 304 gathered from the content stream 308 . Any type of action such as ordering supplies, granting access, provisioning a customer, closing down systems, routing traffic differently, choosing or repurposing resources, etc. could be performed in various embodiments.
  • FIG. 7 an embodiment of a process 700 is shown that configures an internal processing subscriber 212 B to aid in improved routing of a request for content to an edge server 530 who services that request.
  • an example of improving upon Anycast routing is used in conjunction with the embodiment shown in FIG. 5 .
  • the depicted portion of the process 700 begins in block 704 where the content streams 308 are chosen to be supplied to the internal processing subscriber 212 B of each POP 120 .
  • Content streams 308 having delivery metrics and location estimations are chosen for delivery to the internal processing subscriber 212 B from the messaging queue 226 .
  • the gathered information from: (1) geolocation services that provide estimates of location based upon an IP address, and/or (2) internal/external information gathered on content delivery between two IP addresses could be passed to the internal processing subscriber 212 B from the messaging queue 226 .
  • each POP 120 includes an internal data agent 208 B that gathers information 304 on each content delivery. Although shown separate from the internal processing subscriber 212 B, the internal data agent 208 B could be integral to the internal processing subscriber 212 B. The internal data agent 208 B is configured to report content delivery results information 304 to the messaging queue 226 . This embodiment could use gathered information 304 gathered from deliveries outside the CDN 110 , but that is not necessary as Anycast routing could be refined solely from internally gathered information 304 provided by each POP 120 .
  • processing rules 516 are designed.
  • the internal processing subscriber 212 B uses the processing rules 516 to analyze, process, reformat, etc. the subscribed content streams 308 .
  • a content stream 308 reporting external delivery results between two IP addresses could have a processing rule that matches the source IP address with the most similarly situated POP 120 by inferring that the source IP address was close to the POP's IP address and those delivery results could be used by that POP 120 if there wasn't any internally gathered delivery results that were deemed more reliable.
  • the IP address of the source of a particular delivery could be determined to correspond to a Denver located POP 120 and the delivery result could be presumed to be similar to a delivery results from the Denver POP 120 of the CDN 110 .
  • the routing-preferences Table could be updated to improve how the switch fabric 540 assigns the next request to an edge server 530 when the Denver POP 120 is likely to have higher QoS for the requestor's IP address or a range of similarly situated IP addresses. If the Phoenix POP 120 received a request that indicated that the Denver POP 120 delivered to the IP address of the request better, for example, the switch fabric 540 would send the request to the Denver POP 120 for fulfillment.
  • the messaging queue 226 distributes the various content streams 308 to the various processing subscribers 212 that have requested those content streams 308 .
  • the various streams 308 that the internal processing subscriber 212 B has signed-up for are received as the information 304 is reported through the messaging queue 226 .
  • the internal processing subscriber 212 B in each POP 120 would receive a multicasted content stream 308 from the WAN 114 , which supports multicasting protocols.
  • the processing rules 516 are applied to the streams 308 as information is received by the internal processing subscribers 212 B.
  • the routing preferences Table in the switch fabric 540 are updated in block 720 as information in the content streams 308 is processed to provide real time or near real time reaction to how the Internet 104 is delivering content at any moment.
  • processing loops back to block 712 to gather more records from the content stream 308 for processing in a loop of blocks 712 , 716 and 720 .
  • FIG. 8 an embodiment of a process 800 for setting up a data agent 208 and using the data agent 208 to report gathered information 304 to the messaging queue 226 is shown.
  • the depicted portion of the process 800 begins in block 804 where the data agent 208 is configured to gather information.
  • the data agent 804 is typically software that may interface to sensors, data sensing equipment and/or data gathering equipment of various configurations.
  • the data agent 208 measures various parameters associated with delivering a content object between two IP address. A physical location of the source IP address and possibly even the location of the destination IP address may also be known and reported to the API as a data record in the gathered information 304 . Other demographic information on the sender and/or receiver could be reported in addition to physical location.
  • the record for a particular delivery is sent as gathered information 304 and can be determined using an edge server 530 and/or information from the end user system 102 .
  • a set top box that acts as an end user system 102 could report to the edge server 530 the latency and data rate of the delivery of a content object. Some embodiments could test the link between edge server 530 and end user system 102 .
  • the data agent 208 is configured to reformat the gathered information according to an API of the CDN 110 .
  • the data agent 208 is integrated into the CDN 110 in block 808 . Integration could include interaction with the CC interface 238 as described above.
  • the data agent 208 may be a dedicated server or a piece of test equipment or may be software that runs on an existing server or piece of test equipment. Integration of the data agent 208 may include providing authorization and/or authentication information that an external data agent 208 A would use when reporting information to the CDN 110 .
  • the delivery performance is monitored between two IP addresses. Monitoring of delivery can take place on either end of the delivery and be reported in the record.
  • the data agent 208 reports information 304 regarding each delivery to the messaging queue 226 in block 816 .
  • the gathered delivery information 304 is converted into a stream 308 by the CDN 110 in block 820 as the messaging queue 226 .
  • Some embodiments can mask the provider of the gathered information 304 by modifying or obscuring IP addresses, business names, identifiers or other information that could be traced back to the provider.
  • privacy rules could be applied to gathered information to sanitize it prior to reaching the stream 308 . The privacy rules could allow some subscribers to see some information while others could not see that information.
  • the various processing subscribers 212 that request the content stream 308 are sent the content stream 308 using parallel unicast streams, broadcast and/or multicast in block 824 .
  • the streams can be sent with multicast and with parallel unicast outside the CDN 110 in one embodiment.
  • processing loops back to block 812 to loop through blocks 812 , 816 , 820 and 824 to report records as gathered information 304 for distribution as content streams 308 by the messaging queue 226 .
  • FIG. 9A a flowchart of an embodiment of a′ process 900 - 1 for improving upon Anycast routing is shown.
  • the depicted portion of the process 900 - 1 begins in block 904 where an end user system 102 requests translation of a domain name into an IP address from a domain name service (DNS).
  • DNS domain name service
  • the DNS performs a lookup to find the IP address for the domain in block 908 .
  • the IP address corresponds to a number of POPs 120 for the CDN 110 according to an Anycast routing scheme. Once the IP address is known, the end user system 102 requests the content object at the IP address of many POPs 120 in block 912 .
  • the switch fabric 540 determines the edge server 530 to route the request to.
  • the edge server 530 is in the current POP 120 if Anycast routing has not been overridden. Loading, edge server capability, cache utilization, bandwidth utilization, random, or round robin schemes can be used to choose a particular edge server from many edge servers in a particular POP 120 .
  • another edge server 530 in another POP 120 can be chosen when it is deemed that delivery to the IP address of the end user system 102 may work better.
  • the edge server 530 in the other POP 120 would be routed the request in that circumstance.
  • the edge server 530 is chosen by the other POP 120 according to one embodiment, but in this embodiment, the switch fabric 540 of the current POP 120 chooses the particular edge server 530 in the other POP 120 .
  • the switch fabric 540 routes the request to the chosen edge server 530 in block 924 .
  • the edge server fulfills the request for the content object in block 928 .
  • FIG. 9B a flowchart of another embodiment of a process 900 - 2 for improving upon Anycast routing is shown.
  • the depicted portion of the process 900 - 2 follows the embodiment of FIG. 9A for blocks 904 , 908 , 912 , and 916 .
  • the switch fabric 540 assigns the request to an edge server 530 in the current POP 120 in block 918 .
  • Different POPs 120 are favored to deliver different content objects.
  • the edge server 530 favored to deliver a content object is found within the CDN 110 regardless of POP 120 in block 922 .
  • a favored edge server 530 may be favored because it already stores the content object, is less loaded resources and/or bandwidth, it is likely to deliver higher QoS, is closer to the requester in a network sense, has better resources, has specialized software to support the request, or has some other factor or characteristic.
  • edge server 530 If the edge server 530 is not favored to deliver the requested content, the edge server 530 queries throughout the CDN to find another edge server 530 . In this embodiment, an edge server is not favored when it has not cached or stored the content object.
  • Each edge server 530 has a table that specifies a parent server to query for finding a favored edge server 530 that has cached or stored the content object. The table may have different parent servers for a content objects or groups of content objects. That parent server may query to another parent server if the content object is not stored or cached. This process can continue until even the origin server is determined to be the only server in the chain that has the content object stored.
  • the source is relayed back through the chain of ancestors to the original edge server 530 that was initially assigned the request.
  • the original edge server 530 returns a redirect to the end user system 102 in block 926 .
  • the redirect causes the end user system 102 to request the content object from the content source.
  • the content source fulfills the request for the content object. In this way, the end user system 102 can be directed to another POP, a host server or even the origin server.
  • the CDN could operate the messaging queue intake and outtake as a service on the Internet. Any collection of entities or businesses could use the CDN to share information in a collective manner that would benefit from certain information even if it is from a competitor. With increasing numbers of different categories and types of streams that are present on the messaging queue, the more different types of information can be taken into account when making a decision. Some embodiments use processing rules to weight different sources in the stream differently. Routing, for example, could have a weighting algorithm to favor internally gathered results over results from another source of gathered information.
  • the embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged.
  • a process is terminated when its operations are completed, but could have additional steps not included in the figure.
  • a process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination corresponds to a return of the function to the calling function or the main function.
  • embodiments may be implemented by hardware, software, scripting languages, firmware, middleware, microcode, hardware description languages, and/or any combination thereof.
  • the program code or code segments to perform the necessary tasks may be stored in a machine readable medium such as a storage medium.
  • a code segment or machine-executable instruction may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a script, a class, or any combination of instructions, data structures, and/or program statements.
  • a code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, and/or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.

Abstract

Systems and methods for gathering distributed information from a number of data agents for a messaging queue, which is coupled to a number of processing subscribers is disclosed. The data agents provide their gathered information to an interface defined by an API. The gathered data may be reformatted or further processed before adding the gathered information to the messaging queue. A number of processing subscribers listen to a content stream produced by the messaging queue to receive data they have subscribed to. Once the processing subscriber receives the content stream, the processing subscriber applies algorithms to the content stream to perform one or more other functions. For instance, the processing subscriber can feed back processed data into the messaging queue and/or perform an action based, at least in part, upon the content stream. Information in various degrees of processing and aggregation can be passed through any number of cycles in a processing ring to allow for a clearinghouse of information to flow in real time or near real time.

Description

This application claims the benefit of and is a non-provisional of: U.S. Provisional Application Ser. No. 61/248,380 filed on Oct. 2, 2009; and U.S. Provisional Application Ser. No. 61/248,381 filed on Oct. 2, 2009; which are hereby expressly incorporated by reference in their entirety for all purposes.
This application is related to co-pending U.S. patent application Ser. No. 12/767,747 filed on Apr. 26, 2010, entitled “ENHANCED ANYCAST FOR EDGE SERVER SELECTION”, which is hereby expressly incorporated by reference in its entirety for all purposes.
BACKGROUND
This disclosure relates in general to processing networks and, but not by way of limitation, to data streaming from a content delivery network (CDN).
CDNs provide enhanced delivery of content for others. Each CDN takes content from content providers and efficiently provides the content to end users who request the content. Quality of service (QoS) can vary when using a CDN. In some cases, a point of presence (POP) used by an end user may not be the most favorable location to receive content. For example, a user in Phoenix could use a POP in New York in some circumstances likely providing less than optimum QoS.
Delivery of content is greatly effected by how the broader Internet is behaving in real time or near real time. There are services that provide Internet health information that is gathered and periodically made available. This can be useful to some, but does not provide recent enough information for many decisions a CDN or other large-scale user of the Internet would require to provide high levels of QoS. General trends provided by infrequent updates do not provide the timely information to make some delivery decisions of a CDN.
SUMMARY
In one embodiment, the present disclosure describes systems and methods for gathering distributed information from a number of data agents for a messaging queue, which is coupled to a number of processing subscribers. The data agents provide their gathered information to an interface defined by an API. The gathered data may be reformatted or further processed before adding the gathered information to the messaging queue. A number of processing subscribers listen to a content stream produced by the messaging queue to receive data they have subscribed to. Once the processing subscriber receives the content stream, the processing subscriber applies algorithms to the content stream to perform one or more other functions. For instance, the processing subscriber can feed back processed data into the messaging queue and/or perform an action based, at least in part, upon the content stream. Information in various degrees of processing and aggregation can be passed through any number of cycles in a processing ring to allow for a clearinghouse of information to flow in real time or near real time.
In another embodiment, the present disclosure describes a content delivery network (CDN) for timely exchange of information for distributed processing of the information. The CDN includes first and second interfaces, a messaging queue and third and fourth interfaces. The first interface is coupled to a first data agent, which supplies first data to the first interface. The second interface is coupled to a second data agent, which supplies second data to the second interface. The messaging queue, within the CDN, produces a stream, which is a function of the first data and the second data. The messaging queue is coupled to the first interface and the second interface. The third interface is coupled to the messaging queue and a first processing subscriber, which receives the stream. The first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent. The fourth interface is coupled to the messaging queue and a second processing subscriber, which receives the stream. The first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent.
In still another embodiment, the present disclosure describes a method for aggregating information with a CDN for timely exchange of the information in a distributed fashion. First data is received from a first interface, which is coupled to a first data agent. Second data is received from a second interface, which is coupled to a second data agent. The first data and second data is processed. A stream is formulated with a messaging queue of the CDN, which is a function of the first data and the second data. The messaging queue is coupled to the first interface and the second interface. The stream is sent to a third interface, which is coupled to a first processing subscriber to receive the stream. The first data and/or the second data is received in the stream by the first processing subscriber less than ten seconds after the first data and/or the second data is gathered by the first data agent and/or second data agent.
In still another embodiment, the present disclosure describes a method for aggregating information with a distributed network of POPs for timely exchange of the information in a distributed fashion. First data is received from a first interface of a first POP, wherein the first interface is coupled to a first data agent. Second data is received from a second interface of a second POP. The second interface is coupled to a second data agent. The distributed network of POPs include the first POP and the second POP. The first POP is geographically distant from the second POP. The first data and second data is processed. A stream is formulated with a messaging queue, which is a function of the first data and the second data. The messaging queue is coupled to the first interface and the second interface. The stream is sent to a third interface, which is coupled to a processing subscriber to receive the stream.
Further areas of applicability of the present disclosure will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating various embodiments, are intended for purposes of illustration only and are not intended to necessarily limit the scope of the disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
The present disclosure is described in conjunction with the appended figures:
FIG. 1 depicts a block diagram of an embodiment of a content distribution system;
FIG. 2 depicts a block diagram of an embodiment of a data processing system;
FIG. 3 depicts a diagram of an embodiment that demonstrates data flows;
FIG. 4 depicts a block diagram of an embodiment of a processing ring;
FIG. 5 depicts a block diagram of an embodiment that details portions of a content delivery network (CDN);
FIG. 6 illustrates a flowchart of an embodiment of a process for operation of the data processing system;
FIG. 7 illustrates a flowchart of an embodiment of a process that configures an internal processing subscriber;
FIG. 8 illustrates a flowchart of an embodiment of a process for setting up a data agent and using the data agent to report information to a messaging queue; and
FIGS. 9A and 9B illustrate flowcharts of embodiments of a process for improving upon Anycast routing.
In the appended figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label by a dash and a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
DETAILED DESCRIPTION
The ensuing description provides preferred exemplary embodiment(s) only, and is not intended to limit the scope, applicability or configuration of the disclosure. Rather, the ensuing description of the preferred exemplary embodiment(s) will provide those skilled in the art with an enabling description for implementing a preferred exemplary embodiment. It is understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope as set forth in the appended claims.
Referring first to FIG. 1, a block diagram of an embodiment of a content distribution system 100 is shown. The content originator 106 offloads delivery of the content objects to a content delivery network (CDN) 110 in this embodiment. The content originator 106 produces and/or distributes content objects and includes a content provider 108, a content site 116, and an origin server 112. The CDN 110 can cache, redistribute and/or host content in various embodiments for third parties to offload delivery and typically provide better quality of service (QoS).
In this embodiment, the content distribution system 100 locates the content objects (or portions thereof) and distributes the content objects to an end user system 102 or processing subscribers (not shown). The content objects are dynamically cached or processed within the CDN 110 to improve the QoS without replicating the whole content object, unless subsequently requested by the end user 128. A content object is any content file or content stream and could include, for example, video, pictures, data, audio, software, and/or text. For example, a content object could be gathered information or a content stream from a messaging queue. The content object could be live, delayed or stored. The content object could be gathered information, which is streamed to or from the CDN 110 in real time or near real time. Throughout the specification, references may be made to a content object, content, content stream and/or content file, but it is to be understood that those terms could be used interchangeably wherever they may appear.
Many content providers 108 use a CDN 110 to deliver the content objects over the Internet 104 to end users 128. The CDN 110 includes a number of points of presence (POPs) 120, which are geographically distributed through the content distribution system 100 to deliver content. Various embodiments may have any number of POPs 120 within the CDN 110 that are generally distributed in various locations around the Internet 104 to be proximate to end user systems 102. Multiple POPs 120 use the same IP address such that an Anycast routing scheme is used to find a POP 120 likely to be close to the end user in a network sense for each request. In addition to the Internet 104, a wide area network (WAN) 114 or other backbone may couple the POPs 120 with each other and also couple the POPs 120 with other parts of the CDN 110.
When an end user 128 requests a web page through its respective end user system 102, the request for the web page is passed either directly or indirectly via the Internet 104 to the content originator 106. The content originator 106 is the source or re-distributor of content objects. The content site 116 is a \ web site accessible by the end user system 102. In one embodiment, the content site 116 could be a web site where the content is viewable with a web browser. In other embodiments, the content site 116 could be accessible with application software other than a web browser. The content provider 108 directs content requests to a CDN 110 after they are made or formulates the delivery path by embedding the delivery path into the URLs for a web page in this embodiment. In any event, the request for content is handed over to the CDN 110 in this embodiment by using an Anycast IP address corresponding to two or more POPs 120.
Once the request for a content object is passed to the CDN 110, the request is associated with a particular POP 120 within the CDN 110 using the Anycast routing scheme. The particular POP 120 may retrieve the portion of the content object from the content provider 108. Alternatively, the content provider 108 may directly provide the content object to the CDN 110 and its associated POPs 120 through prepopulation, i.e., in advance of the first request. In this embodiment, the content objects are provided to the CDN 110 and stored in one or more CDN servers such that the portion of the requested content may be served from the CDN 110. The CDN servers include edge servers that actually serve end user requests. The origin server 112 holds a copy of each content object for the content originator 106. Periodically, the content of the origin server 112 may be reconciled with the CDN 110 through a cache, hosting and/or pre-population algorithm. Some content providers could use an origin server within the CDN 110 to host the content and avoid the need to maintain a copy.
Once the content object is retrieved from the origin server 112 by the CDN 110, the content object is stored within the particular POP 120 and is served from that POP 120 to the end user system 102. Streamed content objects can have real time or near real time information or can be previously stored. The end user system 102 receives the content object and processes it for use by the end user 128 or an automated processing systems. The end user system 102 could be a personal computer, media player, handheld computer, Internet appliance, phone, IPTV set top, web server, processing system, streaming radio or any other device that receives and/or plays content objects. In some embodiments, a number of the end user systems 102 could be networked together. Although this embodiment only shows a single content originator 106 and a single CDN 110, it is to be understood that there could be many of each in various embodiments.
This CDN 110 allows efficient gathering of real time information for distribution both inside and outside of the CDN 110. External data agents could provide information to different POPs 120 in different cities that is aggregated by the CDN 110 into a content stream from a messaging queue 226 for processing in yet another location by receiving the content stream from a nearby POP 120. The WAN 114 can be far more efficient and secure when distributing content between POPs 120 in embodiments. Additionally, processing subscribers can get the benefit of similar information being available in a content stream to provide a broader sampling of information to base processing decisions upon.
Referring to FIG. 2, an embodiment of a data processing system 200 is shown that uses the CDN 110 infrastructure to efficiently share information in real time or near real time. The data processing system 200 performs internal data gathering and processing of streamed content along with external data gathering and processing in this embodiment. Other embodiments could have either all external or all internal data gathering. The data processing system 200 allows reporting timely information that might be of interest to the reporting party or other parties. The data processing system 200 can monitor gathered information from several sources to allow it to make timely business and/or processing decisions based upon that information. For example, reports on the health of various links on the Internet could be gathered and reported to the data processing system 200 from a number of sources to allow the data processing system 200 to route delivery requests to edge servers that are relatively free of Internet congestion. By gathering information from many sources, the reliability of the gathered information increases in the aggregate such that subscribers can use the aggregated information or content stream to make better decisions in one embodiment.
The CDN 110 is used for a number of purposes to include the aggregation and distribution of gathered information as discussed above. Additionally, the CDN 110 performs processing of the gathered information for internal purposes or as a service for others in this embodiment. Although not detailed in FIG. 2, the CDN 110 can perform more traditional tasks like distributing content for others by caching content from origin servers or hosting content as the origin server. Those blocks associated with distributing content are not detailed in the CDN 110 shown in FIG. 2. Other embodiments of the CDN might not perform the traditional content delivery instead focusing the CDN on performing as a clearinghouse for gathered information in various stages of processing and aggregation.
Internally, the CDN 110 gathers information from one or more internal data agents 208B. The internal data agents 208B gather information relating to such things as delivery performance, resource loading, bandwidth cost, customer provisioning, business intelligence, etc. FIG. 2 shows a single internal and external data agent 208 for simplicity, but it is to be understood that there could be any number of internal and external data agents 208. The internal data agents 208B can report the gathered information in real-time, near real-time or along another time line. To account for any delay in reporting information, a time stamp or staleness indicator can inform others of how timely the information was sampled. The CDN 110 can opt to allow third parties to use internally or externally gathered information that is aggregated within the CDN 110 by subscription of the external processing subscriber(s) 212A for the third party.
A command and control (CC) interface 238 configures the gathered input information to and output of content streams from the CDN 110. APIs for accepting gathered information and providing content streams are provided to third parties external to the CDN 110 who want to subscribe to content streams. The CDN 110 or a third party can designed an as yet undefined APIs using the CC interface 238. The CDN 110 can also define authorization and authentication parameters using the CC interface 238 such as authentication, authorization, login, and/or data encryption. CC information is passed to the various data agents 208 and processing subscribers 212 through a channel separate from the gathered information or content stream in this embodiment, but other embodiments could embed CC information in these communication channels. The CC information allows throttling information reporting frequency, specifying formats for information and content streams, deactivation of a data agent 208 or processing subscriber 212, updating authentication and authorization, etc.
The various content streams that are available can be researched and explored through the CC interface 238. Those content stream selections for a particular processing subscriber 212 are stored in the queue subscription information 222. The CDN 110 then routes selected content streams to processing subscribers 212 that have selected delivery of a given content stream. Additionally, the CDN 110 also supports historical queries of the various content streams that are stored in an historical datastore 234 as gathered by an archive data agent 208C. The archive data agent 208C supports running of hypothetical queries against historical messaging queue information to test how algorithms running at a processing subscriber 212 would react, for example, to content streams gathered in the past. Through the CC interface 238 various content streams can be selected for archiving into the historical datastore 234.
External data agents 208A can also gather information that is reported to the CDN 110 in real-time, near real-time or along another time line. There is a defined API between the data agent 208 and the CDN 110. Each type of information or variable collected by CDN 110 falls within a defined API or multiple APIs. In some cases, the CC interface 238 is used to define additional variables to modify an API that might be of use to processing subscribers 212. The additional variables can be passed to all processing subscribes 212 or just a subset. For example, a data agent 208 may report last mile bandwidth achieved and a subscriber identifier associate with the test, but define the subscriber identifier as a private variable that would not be passed to processing subscribers 212 outside its domain. Processing subscribers 212 within its domain would receive the subscriber identifier along with bandwidth reports reported by its own data agents 208. Encryption and/or unique addressing of content streams or sub-streams can be used to hide the private variables within the messaging queues.
Some types of information may have standard APIs. The developer can specify or suggest a new API through the CC interface 238 as new sources of information are characterized and provided. An example of an API that reports delivery health information could be one that accepts source IP address, destination IP address, streaming rate, latency, reliability, and sample time. With enough data agents 208 reporting delivery health from within the CDN 110 or externally, an aggregation of that information can be used for any number of purposes.
Some embodiments charge for receiving content streams by external processing subscribers 212A. The cost can be per record, per byte or per subscription. Some embodiments offset credit for gathered information provided from external data agents 208A against the cost for content streams to external processing subscribers 212A. For example, each gathered information record provided to the CDN 110 would result in a free data record from the content stream in one embodiment. Generally, data in the aggregated content stream becomes a more reliable sampling with more entities reporting information. The CDN 110 can negotiate pricing for information provided and information consumed through costing information accessible through the CC interface 238.
External data agents 208A communicate with the CDN 110 through an interface or data input adapter 230. FIG. 2 only shows a single external data agent 208A, although it is to be understood that there could be hundreds, thousands or millions of external data agents 208 in various embodiments. The communication with the data input adapter 230 can be encrypted or not. For example, a socket using a TCP connection could be used. In addition to TCP, other transport layer protocols like SCTP and UDP could be used in some embodiments to intake the gathered information. A protocol such as SSL could be used to protect the information over the TCP connection. Authentication and authorization can be performed to any external data agent 208A interfacing to the CDN 110. The data input adapter 230 receives the information from an external data agent 208A by providing the API and any encryption, authorization, and/or authentication. In some cases, the data input adapter 230 reformats or rearranges the information from the external data agent 208A. Although not shown, some embodiments could use a data input adapter 230 for an internal data agent 208B.
The CDN 110 has a number of POPs 120 geographically distributed such that most external data agents 208A and processing subscribers 212A are relatively close to a POP 120. External data agents 208A and external processing subscribers 212A are assigned to a particular POP 120 using Anycast, DNS resolution, redirection, or other methods to use a nearby POP 120 with adequate QoS. The POP 120 to use for gathered information or content streams may be chosen to reduce the number of POPs 120 sending a particular stream, limit loading of a POP 120, speed latency in gathering or streaming of information, or satisfy other requirements. A processing ring could be fixed to the specified POP to use for each data agent 208 and processing subscriber 212.
The messaging queue 226 takes all the information from the data agents 208 and distributes the gathered information as a content stream to any processing subscribers 212 that have requested the content stream from the messaging queue 226. The messaging queue 226 may be in a single POP 120, a central location or distributed among a number of POPs 120. Only content streams within the messaging queue 226 that a particular processing subscriber 212 has subscribed to may be read by that processing subscriber 212 if received at all. Gathered information sent to the messaging queue 226 is processed and returned in a content stream in a fraction of a second by the messaging queue 226. Various multicasting and routing techniques can be used to distribute a content stream from the messaging queue 226 that a number of processing subscribers 212 have requested. Protocols such as Multicast or multiple Unicast could be used to distributed streams within the messaging queue 226. Additionally, transport layer protocols like TCP, SCTP and UDP could be used in various embodiments.
Through the CC interface 238, an external or internal processing subscriber 212A, 212B can be assigned one or more content streams within the messaging queue 226. A content stream is a particular type of messages in a particular category. For example, six data agents 208 could all report content delivery metrics as information passed through the messaging queue 226 into a given content stream. One or more processing subscribers 212 could subscribe and receive the content stream to process the information and make a decision and/or feed the output from the processing as gathered information fed back into the messaging queue 226. Through the CC interface 238 a developer can search the available content streams or specify a new content stream and its API. The new content stream might be determined by processing a number of existing content streams with a processing subscriber 212.
The CDN 110 has internal processing subscribers 212B that process assigned content streams to perform functions within the CDN 110. Internal processing subscribers 212B could perform functions such as provisioning new accounts or improving routing based upon one or more content streams from the messaging queue 226. Processing rules 216-2 are provided to the internal processing subscriber 212B to provide algorithms, rules, instructions, and/or software that define how the subscribed content streams are processed.
Processing rules 216-2 can decide filtering and weighting of records from the content stream. To the extent that decisions are made based upon analysis of the content stream, each data record is time stamped to reflect when the information was gathered such that additional credibility could be given to more recent results, for example. Other embodiments may filter out records in the content stream that are from an unreliable source or stale. For example, a particular contributor of information may prove to have less than optimal gathered information and that could be weighted very low or removed altogether. For external processing subscribers 212A, the filtering could be done by the data output adapter 242 to reduce bandwidth passing from the CDN 110.
Internal processing subscribers 212B may additionally process one or more content streams to provide different information to feed back into the messaging queue 226 to be part of a different content stream. For example, hundreds of external data agents 208 could provide geographically correlated temperature measurements that are put into a content stream on the messaging queue 226. An internal processing subscriber 212B could receive the content stream and process it into topographic heat map that is supplied back as gathered information passed onto the messaging queue 226 for possible use by other internal and external processing subscribers 212. The various data agents 208 and processing subscribers 212 arranged in a chain form a processing loop.
External processing subscribers 212A act similarly to internal processing subscribers 212B, but for third parties that are not part of the CDN 110. The external processing subscribers 212A interface with the CDN 110 through data output adapters 242. Data output adapters 242 can perform authentication, authorization, reformatting, filtering, encryption, etc. External processing subscribers 212A can ingest content streams from the messaging queue 226, but they can also act as an external data agent in some cases by returning processed information back into the messaging queue 226. Processing rules 216-1 define how the external processing subscribers 212A will process the subscribed content streams.
As mentioned above, the CC interface 238 allows the CDN 110 to query historical messaging queue 226 information. An archive data agent 208C listens to the messaging queue 226 to store content streams in a historical database 234. The historical database 234 may store content streams for varying amounts of time and may not store all content streams. Different content streams may be stored, for different amounts of time. For example, temperature readings for a refrigerator may be put on the messaging queue 226 but only stored if beyond some threshold that corresponds to a failure.
With reference to FIG. 3, an embodiment of a diagram 300 demonstrating data flows is shown. Gathered information 304 from a number of data agents 208 (not shown) is sent to the CDN 110. Additional gathered information 304 may be gathered within the CDN 110 by internal data agents 208B as described above. A messaging queue 226 is produced by the CDN 110 having a number of content streams 308. Processing subscribers 212 (not shown) outside and within the CDN 110 receive the streams 308 in real time or near real time.
Referring next to FIG. 4, a block diagram of an embodiment of a processing ring 400 is shown. This example of a processing ring 400 gathers information 304 from n data agents 208. Some of the information 304 goes through up to three rounds of processing before the end of the processing ring is reached. Some of the processing subscribers 212-2, 212-3, 212-m, 212-5 do not provide their further processed information back to the messaging queue to act as an end point for the information flow that are sometimes referred to as “listening subscribers” herein. Although there are three messaging queues 226 shown, it is to be understood these could the same messaging queue or any number of different messaging queues. The messaging queues 226 could be wholly within the CDN 110 or partially outside the CDN 110 in various embodiments. Certainly, portions of the messaging queues 226 are accessible to external processing subscribers 212A as content streams 308.
In one example, the data agents 208 could be reporting the time it takes to ping a given address. This gathered information 304 is reported in real time (i.e., less than 1 second) or near real time (i.e., less than 10 seconds after gathering) and coupled to the messaging queue 226. In most cases, the gathered information 304 is time stamped to indicate freshness of the raw information. For example, the time the test is performed could be memorialized in the time stamp. Each data agent 208 would report its address, the given address to ping, a ping time, and when the ping test was performed to the messaging queue 226 in this example. The various data agents 208 could be in several POPs 120 of the CDN 110 and third party systems coupled to the CDN 110, for example, an origin server that hosts content could report the responsiveness to pings from its location. Through aggregation of many ping results, the health of the Internet can be monitored in real time or near real time in this example.
In this example, there are two processing subscribers 212-1, 212-2 that are listening to the content streams 308 that are reporting ping results. The second processing subscriber 212-2 is a listening subscriber that does not provide further information to the messaging queue 226, but takes the stream 308 and uses it, for example, to update routing tables for a router. For example, routing tables could be updated by the second processing subscriber 212-2 to specify what are most likely to the most responsive routes on the Internet in real time or near real time. The first processing subscriber 212 takes the stream 308 with ping results from a number of data sources and further processes it by grouping results by autonomous systems (AS) number and reports that gathered and processed information 304 back into the messaging queue 226. Average results grouped by AS number is gathered information that takes far less bandwidth to report to others and avoids having to inspect each and every record in the content stream 308 by processing subscribers 212 further along in the processing ring 400.
There are m processing subscribers 212 listening to the content stream 308 of ping results summarized by AS number. A fourth processing subscriber 212-4 further processes the stream 308 by adding geographic information for the AS numbers. This processing correlates the ping results to geographic estimates for the AS numbers. That gathered information 304 is provided back to the messaging queue 226. A fifth processing subscriber 212-5 listens to the content stream 308 from the messaging queue 226 to receive geographically correlated ping results. Although this processing ring 400 has three levels of processing, other embodiments could have more or less. Additionally, data agents 208 could provide any number of different information 304 that is used in the processing.
Referring next to FIG. 5, an embodiment of a block diagram detailing portions of the CDN 110. This embodiment of the CDN 110 shows two POPs 120, but typically there would be more POPs 120 distributed across the Internet 104 to increase the likelihood a POP 120 is nearby (in a network sense) to the end user systems 102, external processing subscriber 212A or external data agent 208A. Each POP 120 can pass requests, content objects, status information, gathered information 304, content streams 308 etc. between POPs 120 using the Internet 104 and a WAN 114. The WAN 114 couples together the POPs 120 using a private backbone in this embodiment, but could include public networks in other embodiments.
Each POP 120 includes a number of edge servers 530 that service requests from end user systems 102. Through the Anycast routing scheme, requests for content find a particular POP 120 of the CDN 110 that is likely nearby in a network sense to the requestor. This is often a POP 120 well suited to supply the content object, but in some cases another POP is better suited for some reason. For example, an Internet service provider (ISP) may use a proxy in a location geographically distant from the end user system 102 that causes the request for content to find a POP 120 near the proxy instead of near the end user system 102 when Anycast resolution is used to find a nearby POP 120.
The edge servers 530 serve content objects, receive generated information 304 and relay content streams 308. The data input adapter 230 and data output adapter 242 functionality can be implemented within the edge server 530 in this embodiment. The messaging queue(s) 226 are available typically from the WAN 114 in unfiltered form. Those individual content streams 308 subscribed to are provided to a external processing subscriber 212A by the edge server 530 in this embodiment. The processing subscribers 212 subscribed to a given content stream 308 could be grouped to a single edge server 530 where practical.
In this embodiment, the switch fabric 540 receives a request for a content object and assigns an edge server 530 that is typically located in the POP 120 that originally received the request, but not necessarily. The switch fabric 540 can alternatively assign the request to an edge server 530 in another POP 120. A table within the switch fabric 540 indicates a favored POP 120 for certain IP addresses, AS numbers and/or ranges of IP addresses. Where there is no favored POP indicated or the favored POP originally received the request, it is presumed that Anycast acted properly and the POP 120 receiving the request would route the request to an edge server 530 for fulfillment.
An internal data agent 208B monitors the incoming requests for content and notes how Anycast is resolving. Other embodiments could use other ways to resolve to a POP 120 such as single-stage DNS, two-stage DNS, request redirect, etc. The internal data agent 208B notes the IP address of the requestor, resolution technique and the time of the request for reporting that gathered information 308 to the messaging queue 226. Although not shown, external data agents 208A could observe how Anycast is resolving for requests from various IP addresses and report that gathered information 304 to the messaging queue 226. The gathered information includes in each record, the requesting IP address, the location of the POP 120 found with Anycast, the protocol used in the request, the particular request, the time that the request was received and latency, bandwidth, packet loss, jitter, and other QoS factors related to the delivery. An API to the messaging queue 226 is used to gather the records.
To determine if a POP 120 that didn't originally receive the request for a content object is better suited to serve the content object, there are a number of techniques to choose a better POP 120. Third-party location services provide approximate geographic locations for IP addresses, AS numbers and/or portions of IP addresses. An external data agent 208A with the location service provides information 304 when IP addresses, AS numbers and/or groups of IP addresses are correlated to a geographic location. As correlations are made by the service between locations and IP address(es), the external data agent 208A provides that gathered information 304. The internal processing subscriber 212B receives the content stream 308 from the location service(s) along with the content stream from the internal data agents 208B in each POP 120 that report Anycast resolutions.
In addition to using third party location services external to the CDN 110, feedback from deliveries can be used to determine better POPs 120 for particular IP addresses and/or ranges of addresses. An internal data agent 208B (not shown) within each edge server 530 can determine the latency, bandwidth, packet loss, jitter, and other QoS factors for a particular delivery from a POP 120 and edge server 530 to a particular IP address. That gathered information 304 can be encapsulated into a content stream 308 that is received by the internal processing subscriber 212B. Additionally, third parties making deliveries outside of the CDN 110 with their own servers or using another CDN can provide information with an external data agent 208A that is coupled to the internal processing subscriber 212B by the messaging queue 226. The switch fabric 540 could route according to the suggestion of the location service and where there is no suggestion, switch fabric could route the request to the POP 120 providing the best QoS for that IP address or similar IP addresses based upon information from the content stream 308.
In this embodiment, the internal processing subscriber 212B receives a content stream 308 from one or more geolocation services. Additionally, gathered information 304 from individual deliveries within or outside the CDN 110 are sent in one or more streams 308 to the internal processing subscribers 212B in each POP 120. Processing rules 516 indicate how to interpret the stream 308. For example, there may be weighting in the processing rules to favor delivery results gathered within the CDN 110 in contrast to delivery results gathered outside the CDN 110. Results from deliveries or from geolocation services could be aged in favor of newer results in appreciation of the changing conditions on the Internet 104 in one embodiment.
TABLE
Routing Preferences for Switch Fabric
POP(s) Content Object Type Favored POP
000-063.xxx.xxx.xxx All Denver
064-127.xxx.xxx.xxx All New York
128-171.xxx.xxx.xxx All Phoenix
172-256.xxx.xxx.xxx All San Jose
128.234.343.xxx High-bitrate streamed Chicago
Small file download Tempe
VoIP phone call Los Angeles
Web page Phoenix
128.234.343.123 High-bitrate streamed New York
Flash Denver
VoIP phone call Denver
Remainder San Jose
129.xxx.xxx.xxx High-bitrate streamed Tempe
Small file download Tempe
Large file download Denver
Remainder Chicago
130.001.xxx.xxx Low-bitrate streamed Los Angeles
Small file download San Jose
Gaming Los Angeles
Web page San Jose
For different types of content objects, different metrics may be more important for deciding the favored POP. For example, streaming video generally favors higher bandwidth over latency. When the switch fabric 540 receives a request for streaming video, the switch fabric 540 may prefer one POP 120, but could prefer a different POP 120 for a request for a small content file download or content stream 308. The above Table shows an example of some of the routing preferences within the switch fabric 540 that would be used in choosing an edge server 530 between the POPs 120. It is to be understood that there would be far more table entries in a typical embodiment of routing preferences. In some cases, there are ranges of various sizes and even specific addresses specified for special handling with the switch fabric 540.
Where there are multiple entries for a particular IP address, the most specific range would be favored over the broader ranges. For example, a request from IP address 128.234.343.123 would have the entry for that specific address and entries for the 128-171.xxx.xxx.xxx and 128.234.343.xxx ranges. In this case, the 128.234.343.123 entry would be used instead of the entry for any range because IP address is more specific. If the request were for a small file download however, the entry for the 128.234.343.xxx range would be used since the 128.234.343.123 entry has no routing preference for a small file download such that the delivery would be from the Témpe POP regardless of which POP 120 originally received the request using Anycast. As the content stream 308 is received, the content stream 308 is processed and applied to routing preferences for all entries that correspond to the information gathered for a particular address such that the Table is changing in real time or near real time.
This embodiment shows an internal processing subscriber 212B in each POP 120 locally processing the content stream 308 to adjust the switch fabric 540 for those times that Anycast does not resolve a request to a favored POP 120. Other embodiments could adjust how the switch fabric 540 resolves requests in different ways. There could be embodiments that don't have an internal processing subscriber 212B in each POP 120 for programming the switch fabric 540. One location in the CDN 100 would have the internal processing subscriber 212B that would also include an internal data agent 208B (not shown) that sends information 304 to those POPs 120 not processing the rules locally to affect the switch fabric 540.
The internal processing subscriber 212B in each POP 120 could produce the table of preferred POPs 120 according to the processing rules 516 applied to the content stream 308. The table of preferred POPs 120 for various IP addresses of requests are routed by the switch fabric 540 to the preferred POP 120 to effectively override the Anycast distribution of requests. On occasion, the geolocation service and Anycast routing may not find a POP 120 with adequate QoS, better QoS or the best QoS. When QoS falls below a threshold in one or more metrics, and the Anycast and geolocation service is not finding an adequate solution above the threshold, another algorithm can be used to find a better POP 120 to perform the delivery for an IP address or range of IP addresses. The switch fabric 540 can this algorithm to assign a POP 120 in a random, unpredictable or round-robin fashion. One embodiment might assign the next closest POP 120.
After the delivery with the POP 120 chosen in any of these fashions, the results of how the delivery was performed is reported back to the internal processing subscriber 212B with the appropriate content stream 308. If the delivery has higher QoS, the POP 120 would become the new choice for similar requests. In some cases, a number of different POPs 120 could be tested with actual deliveries or test deliveries of content objects. This probing for better POP 120 assignments could be done periodically even if QoS doesn't fall below a threshold as the performance of the Internet 104 changes over time. Requests from IP addresses with historically unpredictable QoS could be targeted more often to probe for a better POP 120.
With reference to FIG. 6, an embodiment of a process 600 for operation of the data processing system 200 is shown. The depicted portion of the process begins in block 604 where the developer would use the CC interface 238 to manage the interaction between the data agents 208 and the messaging queue 226. The developer inputs the API design where there is not one pre-defined, address of the data agent 108, authentication and authorization information for any external data agents 208A, etc. into the CC interface 238. The API design specifies the types of variables, how they are formatted and other information to describe the gathered information 304 in the data feed to the messaging queue 226. The API design also defines how the gathered information 304 is portrayed when sent from the messaging queue 226 as a content stream 308. The content stream 308 has records or samples that are defined by the API design.
In block 608, the developer chooses the available content streams 308 in the messaging queue 226 for use by a particular processing subscriber 212. A given content stream 308 chosen may only have records from the data agents 208 previously configured in block 604 or could include records of third parties from other data agents 208. Each record in the content stream 308 could be serialized or include the data agent address as a mechanism to differentiate records. Additionally, the developer interacts with the data processing system 200 to input API information, address of the processing subscriber 212, authentication and/or authorization information, etc. into the CC interface 238 to configure a particular processing subscriber 212 to interact with the messaging queue 226 of the CDN 110. All queue subscription information is recorded for each processing subscriber 212 in the queue subscription information database 222.
The input gathered information 304 and output content stream 308 for the messaging queue 226 is configured at this point by the developer. The developer also configures the processing rules 216 for the processing subscriber 212 to use when operating upon its content stream(s) 308 from the messaging queue 226. The processing rules 216 may or may not be stored within the CDN 110. The developer may find it helpful to check the rule operation against the historical datastore 234 when designing the rules to provide test results from a prior content stream(s) 308. Many levels of data agents 208 and processing subscribers 212 can be defined in blocks 604 and 608 to define a processing ring.
With reference to block 612, operation of the developer's data processing system begins when the data agent(s) 208 reports gathered information 304. The data processing system 200 could have any number of data agents 208 internal or external to the CDN 110. External data agents 208A generally use data input adapters 230 as described above. External processing subscribers 212A generally use data output adapters 242. Any configuration of the external data agents 208A or external processing subscribers 212A can be performed with the CC interface 238.
Where the data agent 208 is an external data agent 208A, as determined in block 628, a data adapter 230 checks, reformats and/or performs other processing on the gathered information 304 in block 616. The checks may include authentication and/or authorization, for example, or checks on formatting, data types, valid data ranges, etc. Internal data agents 208B, as determined in block 628, can optionally skip block 616 going directly to block 620. After the data is available within the CDN 110 and optionally checked by a data adapter 230, the gathered information 304 is injected into the messaging queue 226 in block 620. The messaging queue 226 distributes gathered information in block 624 that is comprised of a series of messages, packets, samples, or records in a particular category that are collectively referred to as a content stream 308. Because gathered information 304 is produced by the data agents 208 often in real time and reported to the messaging queue 226 without delay, the gathered information 304 is quickly made available in real-time or near real-time, for example, the data may be less than one, two, five, ten, or twenty seconds old when it enters the messaging queue 226.
According to the subscription information 212, the content streams 308 are distributed in multicast and/or unicast fashion to the various processing subscribers 212 within the CDN 110 or anywhere on the Internet in block 624. Typically, multicast is used for processing subscribers 212 within the CDN 110 or that have networks that support multicast, and parallel unicast streams are used for external Processing subscribers 212B that do not have network support for multicast. Each processing subscriber 212 can only read the content streams 308 in block 628 that it subscribes to. Authentication and/or authorization using, for example, encryption, can be use to protect streams 308 or sub-streams from exposure to non-subscribers. According to the processing rules 216, each processing subscriber 212 operates on its one or more content streams 308 from the massaging queue 226 in block 632.
A processing subscriber 212 can optionally return the processed information 304 back into the messaging queue 226 in block 636 by also acting as a data agent 208 unlike listening subscribers that do not include capability to act as data agent 208. Although not required, processing subscribers 212 typically perform an operation or action in block 640 based, at least in part, on the information 304 gathered from the content stream 308. Any type of action such as ordering supplies, granting access, provisioning a customer, closing down systems, routing traffic differently, choosing or repurposing resources, etc. could be performed in various embodiments.
Referring next to FIG. 7, an embodiment of a process 700 is shown that configures an internal processing subscriber 212B to aid in improved routing of a request for content to an edge server 530 who services that request. When explaining the process 700, an example of improving upon Anycast routing is used in conjunction with the embodiment shown in FIG. 5. The depicted portion of the process 700 begins in block 704 where the content streams 308 are chosen to be supplied to the internal processing subscriber 212B of each POP 120. Content streams 308 having delivery metrics and location estimations are chosen for delivery to the internal processing subscriber 212B from the messaging queue 226. For example, the gathered information from: (1) geolocation services that provide estimates of location based upon an IP address, and/or (2) internal/external information gathered on content delivery between two IP addresses could be passed to the internal processing subscriber 212B from the messaging queue 226.
In this example, each POP 120 includes an internal data agent 208B that gathers information 304 on each content delivery. Although shown separate from the internal processing subscriber 212B, the internal data agent 208B could be integral to the internal processing subscriber 212B. The internal data agent 208B is configured to report content delivery results information 304 to the messaging queue 226. This embodiment could use gathered information 304 gathered from deliveries outside the CDN 110, but that is not necessary as Anycast routing could be refined solely from internally gathered information 304 provided by each POP 120.
In block 708, processing rules 516 are designed. The internal processing subscriber 212B uses the processing rules 516 to analyze, process, reformat, etc. the subscribed content streams 308. For example, a content stream 308 reporting external delivery results between two IP addresses could have a processing rule that matches the source IP address with the most similarly situated POP 120 by inferring that the source IP address was close to the POP's IP address and those delivery results could be used by that POP 120 if there weren't any internally gathered delivery results that were deemed more reliable. For example, the IP address of the source of a particular delivery could be determined to correspond to a Denver located POP 120 and the delivery result could be presumed to be similar to a delivery results from the Denver POP 120 of the CDN 110. If the delivery from the Denver source IP address were better than that seen from other POPs 120 of the CDN 110, the routing-preferences Table could be updated to improve how the switch fabric 540 assigns the next request to an edge server 530 when the Denver POP 120 is likely to have higher QoS for the requestor's IP address or a range of similarly situated IP addresses. If the Phoenix POP 120 received a request that indicated that the Denver POP 120 delivered to the IP address of the request better, for example, the switch fabric 540 would send the request to the Denver POP 120 for fulfillment.
The messaging queue 226 distributes the various content streams 308 to the various processing subscribers 212 that have requested those content streams 308. In block 712, the various streams 308 that the internal processing subscriber 212B has signed-up for are received as the information 304 is reported through the messaging queue 226. In this example, the internal processing subscriber 212B in each POP 120 would receive a multicasted content stream 308 from the WAN 114, which supports multicasting protocols. The processing rules 516 are applied to the streams 308 as information is received by the internal processing subscribers 212B. The routing preferences Table in the switch fabric 540 are updated in block 720 as information in the content streams 308 is processed to provide real time or near real time reaction to how the Internet 104 is delivering content at any moment. After block 720, processing loops back to block 712 to gather more records from the content stream 308 for processing in a loop of blocks 712, 716 and 720.
With reference to FIG. 8, an embodiment of a process 800 for setting up a data agent 208 and using the data agent 208 to report gathered information 304 to the messaging queue 226 is shown. When explaining the process 800, an example used for improving Anycast routing will be used in conjunction with the embodiment shown in FIG. 5, but it is to be understood that the general idea of a messaging queue 226 could be used for many different purposes. The depicted portion of the process 800 begins in block 804 where the data agent 208 is configured to gather information. The data agent 804 is typically software that may interface to sensors, data sensing equipment and/or data gathering equipment of various configurations. In this example, the data agent 208 measures various parameters associated with delivering a content object between two IP address. A physical location of the source IP address and possibly even the location of the destination IP address may also be known and reported to the API as a data record in the gathered information 304. Other demographic information on the sender and/or receiver could be reported in addition to physical location.
The record for a particular delivery is sent as gathered information 304 and can be determined using an edge server 530 and/or information from the end user system 102. For example, a set top box that acts as an end user system 102 could report to the edge server 530 the latency and data rate of the delivery of a content object. Some embodiments could test the link between edge server 530 and end user system 102. The data agent 208 is configured to reformat the gathered information according to an API of the CDN 110.
The data agent 208 is integrated into the CDN 110 in block 808. Integration could include interaction with the CC interface 238 as described above. The data agent 208 may be a dedicated server or a piece of test equipment or may be software that runs on an existing server or piece of test equipment. Integration of the data agent 208 may include providing authorization and/or authentication information that an external data agent 208A would use when reporting information to the CDN 110. In block 812, the delivery performance is monitored between two IP addresses. Monitoring of delivery can take place on either end of the delivery and be reported in the record. The data agent 208 reports information 304 regarding each delivery to the messaging queue 226 in block 816.
The gathered delivery information 304 is converted into a stream 308 by the CDN 110 in block 820 as the messaging queue 226. Some embodiments can mask the provider of the gathered information 304 by modifying or obscuring IP addresses, business names, identifiers or other information that could be traced back to the provider. Additionally, privacy rules could be applied to gathered information to sanitize it prior to reaching the stream 308. The privacy rules could allow some subscribers to see some information while others could not see that information. The various processing subscribers 212 that request the content stream 308 are sent the content stream 308 using parallel unicast streams, broadcast and/or multicast in block 824. For processing subscribers 212 within the CDN 110, the streams can be sent with multicast and with parallel unicast outside the CDN 110 in one embodiment. After block 824, processing loops back to block 812 to loop through blocks 812, 816, 820 and 824 to report records as gathered information 304 for distribution as content streams 308 by the messaging queue 226.
Referring next to FIG. 9A, a flowchart of an embodiment of a′ process 900-1 for improving upon Anycast routing is shown. The depicted portion of the process 900-1 begins in block 904 where an end user system 102 requests translation of a domain name into an IP address from a domain name service (DNS). The DNS performs a lookup to find the IP address for the domain in block 908. The IP address corresponds to a number of POPs 120 for the CDN 110 according to an Anycast routing scheme. Once the IP address is known, the end user system 102 requests the content object at the IP address of many POPs 120 in block 912.
Only one POP 120 ultimately receives the content request as the various routers will choose the routing to find the POP 120. The content is requested from the POP in block 916. In block 920, the switch fabric 540 determines the edge server 530 to route the request to. The edge server 530 is in the current POP 120 if Anycast routing has not been overridden. Loading, edge server capability, cache utilization, bandwidth utilization, random, or round robin schemes can be used to choose a particular edge server from many edge servers in a particular POP 120.
Based upon analysis of the content stream, another edge server 530 in another POP 120 can be chosen when it is deemed that delivery to the IP address of the end user system 102 may work better. The edge server 530 in the other POP 120 would be routed the request in that circumstance. The edge server 530 is chosen by the other POP 120 according to one embodiment, but in this embodiment, the switch fabric 540 of the current POP 120 chooses the particular edge server 530 in the other POP 120. The switch fabric 540 routes the request to the chosen edge server 530 in block 924. The edge server fulfills the request for the content object in block 928.
With reference to FIG. 9B, a flowchart of another embodiment of a process 900-2 for improving upon Anycast routing is shown. The depicted portion of the process 900-2 follows the embodiment of FIG. 9A for blocks 904, 908, 912, and 916. After block 916, the switch fabric 540 assigns the request to an edge server 530 in the current POP 120 in block 918. Different POPs 120 are favored to deliver different content objects. In this embodiment, the edge server 530 favored to deliver a content object is found within the CDN 110 regardless of POP 120 in block 922. A favored edge server 530 may be favored because it already stores the content object, is less loaded resources and/or bandwidth, it is likely to deliver higher QoS, is closer to the requester in a network sense, has better resources, has specialized software to support the request, or has some other factor or characteristic.
If the edge server 530 is not favored to deliver the requested content, the edge server 530 queries throughout the CDN to find another edge server 530. In this embodiment, an edge server is not favored when it has not cached or stored the content object. Each edge server 530 has a table that specifies a parent server to query for finding a favored edge server 530 that has cached or stored the content object. The table may have different parent servers for a content objects or groups of content objects. That parent server may query to another parent server if the content object is not stored or cached. This process can continue until even the origin server is determined to be the only server in the chain that has the content object stored.
Once the source of the content object is found, the source is relayed back through the chain of ancestors to the original edge server 530 that was initially assigned the request. The original edge server 530 returns a redirect to the end user system 102 in block 926. The redirect causes the end user system 102 to request the content object from the content source. In block 930, the content source fulfills the request for the content object. In this way, the end user system 102 can be directed to another POP, a host server or even the origin server.
A number of variations and modifications of the disclosed embodiments can also be used. For example, the CDN could operate the messaging queue intake and outtake as a service on the Internet. Any collection of entities or businesses could use the CDN to share information in a collective manner that would benefit from certain information even if it is from a competitor. With increasing numbers of different categories and types of streams that are present on the messaging queue, the more different types of information can be taken into account when making a decision. Some embodiments use processing rules to weight different sources in the stream differently. Routing, for example, could have a weighting algorithm to favor internally gathered results over results from another source of gathered information.
Specific details are given in the above description to provide a thorough understanding of the embodiments. However, it is understood that the embodiments may be practiced without these specific details. For example, circuits may be shown in block diagrams in order not to obscure the embodiments in unnecessary detail. In other instances, well-known circuits, processes, algorithms, structures, and techniques may be shown without unnecessary detail in order to avoid obscuring the embodiments.
Also, it is noted that the embodiments may be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination corresponds to a return of the function to the calling function or the main function.
Furthermore, embodiments may be implemented by hardware, software, scripting languages, firmware, middleware, microcode, hardware description languages, and/or any combination thereof. When implemented in software, firmware, middleware, scripting language, and/or microcode, the program code or code segments to perform the necessary tasks may be stored in a machine readable medium such as a storage medium. A code segment or machine-executable instruction may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a script, a class, or any combination of instructions, data structures, and/or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, and/or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, token passing, network transmission, etc.
While the principles of the disclosure have been described above in connection with specific apparatuses and methods, it is to be clearly understood that this description is made only by way of example and not as limitation on the scope of the disclosure.

Claims (19)

What is claimed is:
1. A content delivery network (CDN) comprising one or more server computers for timely exchange of information for distributed processing of the information, the CDN comprising:
a first interface coupled to a first data agent, which supplies a first data to the first interface, the first data agent being within the CDN, and wherein the first data supplied to the first interface comprises performance data;
a second interface coupled to a second data agent, which supplies a second data to the second interface, the second data agent being outside the CDN;
a messaging queue within the CDN that distributes a plurality of message streams, wherein each message stream of the plurality of message streams is mapped to a category field of a plurality of category fields, and wherein the messaging queue is coupled to the first interface and the second interface;
a first message stream of the plurality of message streams for conveying performance data, wherein the first message stream is mapped to a first category field of the plurality of category fields and includes the first data and the second data;
a second message stream of the plurality of message streams for conveying performance data, wherein the second message stream is mapped to a second category field of the plurality of category fields and includes a third data, but not the second data;
a third interface coupled to the messaging queue and a first processing subscriber, which receives the first message stream by screening for the first category field, wherein one or both of the first data and the second data is received in the first message stream by the first processing subscriber less than ten seconds after one or both of the first data and the second data is gathered by one or both of the first data agent and second data agent;
a fourth interface coupled to the messaging queue and a second processing subscriber, which receives the first message stream by screening for the first category field, wherein one or both of the first data and the second data is received in the first message stream by the second processing subscriber less than ten seconds after one or both of the first data and the second data is gathered by one or both of the first data agent and second data agent; and
a fifth interface coupled to the messaging queue and a third processing subscriber, which receives the second message stream by screening for the second category field.
2. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, further comprising an input adapter coupled between the first interface and the messaging queue, wherein the input adapter checks or reformats the first data.
3. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, wherein the first data is processed to obscure information before the first data reaches the first message stream.
4. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, wherein one or both of the first data agent and the second data agent is:
within a domain not under control of the CDN.
5. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, wherein at least one of the first processing subscriber and the second processing subscriber is:
within a domain not under control of the CDN.
6. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, further comprising a historic datastore that stores at least a portion of the messaging queue and allows query of the at least the portion.
7. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, further comprising processing rules, wherein the processing rules instruct the first processing subscriber how to process the first data or the second data in the first message stream.
8. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, wherein at least two of the first through fourth interfaces use the same communication media.
9. The CDN for timely exchange of information for distributed processing of the information as recited in claim 1, wherein the messaging queue receives from the first processing subscriber a fourth data, wherein the first message stream further becomes a function of the fourth data.
10. A method for aggregating information with a CDN for timely exchange of the information in a distributed fashion, the method comprising:
receiving a first data from a first interface, which is coupled to a first data agent, the first data agent being within the CDN, and wherein the first data received from the first interface comprises performance data;
receiving a second data from a second interface, which is coupled to a second data agent, the second data agent being outside the CDN;
processing the first data and second data;
formulating a first message stream, for conveying performance data, with a messaging queue of the CDN, wherein:
the first message stream is a function of the first data and the second data,
the first message stream is mapped to a first category field of a plurality of category fields, and
the messaging queue is coupled to the first interface and the second interface;
formulating a second message stream, for conveying performance data, with the messaging queue of the CDN, wherein the second messaging stream is mapped to a second category field of the plurality of category fields and includes a third data, but not the second data;
sending the first message stream to a third interface, which is coupled to a first processing subscriber to receive the first message stream by screening for the first category field, wherein one or both of the first data and the second data is received in the first message stream by the first processing subscriber less than ten seconds after one or both of the first data and the second data is gathered by one or both of the first data agent and second data agent; and
sending the second message stream to a fourth interface, which is coupled to a second processing subscriber to receive the second message stream by screening for the second category field, wherein the third data is received in the second message steam by the second processing subscriber.
11. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, wherein:
the first interface is to a first point of presence (POP),
the second interface is to a second POP, and
the first POP is geographically distant from the second POP.
12. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, further comprising processing the stream with the first processing subscriber.
13. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, further comprising sending the first message stream to a fifth interface, which is coupled to a third processing subscriber to receive the first message stream, wherein one or both of the first data and the second data is received in the first message stream by the first processing subscriber less than ten seconds after one or both of the first data and the second data is gathered by one or both of the first data agent and second data agent.
14. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, further comprising performing an action with the first processing subscriber based upon the first message stream.
15. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, further comprising:
processing the first message stream with the first processing subscriber; and
producing a fourth data from the processing with the first processing subscriber, wherein the fourth data is coupled to the messaging queue within the CDN.
16. The method for aggregating information with the CDN for timely exchange of the information in the distributed fashion as recited in claim 10, further comprising receiving a fourth data from a third interface coupled to the first processing subscriber, wherein the third data is a function of the stream.
17. A method for aggregating information with a distributed network of points of presence (POPs) for timely exchange of the information in a distributed fashion, the method comprising:
receiving a first data from a first interface of a first POP, wherein the first interface is coupled to a first data agent, the first data agent being within the distributed network, and wherein the first data received from the first interface comprises performance data;
receiving a second data from a second interface of a second POP, wherein:
the second interface is coupled to a second data agent, the second data agent being outside the distributed network,
the distributed network of POPs comprise the first POP and the second POP, and
the first POP is geographically distant from the second POP;
processing the first data and second data;
formulating a first message stream, for conveying performance data, with a messaging queue of the distributed network, wherein:
the first message stream is a function of the first data and the second data,
the first message stream is mapped to a first category field of a plurality of category fields, and
the messaging queue is coupled to the first interface and the second interface;
formulating a second message stream, for conveying performance data, with the messaging queue of the distributed network, wherein the second messaging stream is mapped to a second category field of the plurality of category fields and includes a third data, but not the second data;
sending the first message stream to a third interface, which is coupled to a first processing subscriber to receive the first message stream by screening for the first category field, wherein one or both of the first data and the second data is received in the first message stream by the first processing subscriber less than ten seconds after one or both of the first data and the second data is gathered by one or both of the first data agent and second data agent; and
sending the second message stream to a fourth interface, which is coupled to a second processing subscriber to receive the second message stream by screening for the second category field, wherein the third data is received in the second message steam by the second processing subscriber.
18. The method for aggregating information with the distributed network of POPs for timely exchange of the information in the distributed fashion as recited in claim 17, wherein the third interface is for a third POP, which is geographically distant from at least one of the first POP and the second POP.
19. A non-transitory machine-readable medium having machine-executable instructions configured to perform the machine-implementable method for aggregating information with the distributed network of POPs for timely exchange of the information in the distributed fashion as recited in claim 17.
US12/767,747 2009-10-02 2010-04-26 Real-time message queuing for a processing ring Expired - Fee Related US8612622B2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US12/767,747 US8612622B2 (en) 2009-10-02 2010-04-26 Real-time message queuing for a processing ring
PCT/US2010/051190 WO2011041722A2 (en) 2009-10-02 2010-10-01 Real-time message queuing for a processing ring
CN2010800518701A CN102714634A (en) 2009-10-02 2010-10-01 Real-time message queuing for a processing ring
BR112012007538A BR112012007538A2 (en) 2009-10-02 2010-10-01 real-time message queue for processing ring
EP10821363.8A EP2484064A4 (en) 2009-10-02 2010-10-01 Real-time message queuing for a processing ring
US13/568,970 US9197537B2 (en) 2009-10-02 2012-08-07 Enhanced anycast for edge server selection

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US24838109P 2009-10-02 2009-10-02
US24838009P 2009-10-02 2009-10-02
US12/767,747 US8612622B2 (en) 2009-10-02 2010-04-26 Real-time message queuing for a processing ring

Publications (2)

Publication Number Publication Date
US20110082944A1 US20110082944A1 (en) 2011-04-07
US8612622B2 true US8612622B2 (en) 2013-12-17

Family

ID=43824021

Family Applications (4)

Application Number Title Priority Date Filing Date
US12/767,747 Expired - Fee Related US8612622B2 (en) 2009-10-02 2010-04-26 Real-time message queuing for a processing ring
US12/767,746 Active 2030-09-25 US8199752B2 (en) 2009-10-02 2010-04-26 Enhanced anycast for edge server selection
US13/246,474 Active US8270403B2 (en) 2009-10-02 2011-09-27 Enhanced Anycast for edge server selection
US13/568,970 Active 2031-01-29 US9197537B2 (en) 2009-10-02 2012-08-07 Enhanced anycast for edge server selection

Family Applications After (3)

Application Number Title Priority Date Filing Date
US12/767,746 Active 2030-09-25 US8199752B2 (en) 2009-10-02 2010-04-26 Enhanced anycast for edge server selection
US13/246,474 Active US8270403B2 (en) 2009-10-02 2011-09-27 Enhanced Anycast for edge server selection
US13/568,970 Active 2031-01-29 US9197537B2 (en) 2009-10-02 2012-08-07 Enhanced anycast for edge server selection

Country Status (5)

Country Link
US (4) US8612622B2 (en)
EP (2) EP2484065A4 (en)
CN (2) CN102640467A (en)
BR (2) BR112012007533A2 (en)
WO (2) WO2011041726A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150172135A1 (en) * 2013-12-17 2015-06-18 Limelight Networks, Inc. Dynamic bandwidth allocation for cooperative delivery systems
US9191369B2 (en) 2009-07-17 2015-11-17 Aryaka Networks, Inc. Application acceleration as a service system and method
US9571407B2 (en) 2014-12-10 2017-02-14 Limelight Networks, Inc. Strategically scheduling TCP stream transmissions
US11843682B1 (en) * 2022-08-31 2023-12-12 Adobe Inc. Prepopulating an edge server cache

Families Citing this family (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8028090B2 (en) 2008-11-17 2011-09-27 Amazon Technologies, Inc. Request routing utilizing client location information
US7991910B2 (en) 2008-11-17 2011-08-02 Amazon Technologies, Inc. Updating routing information based on client location
US8606996B2 (en) 2008-03-31 2013-12-10 Amazon Technologies, Inc. Cache optimization
US8321568B2 (en) 2008-03-31 2012-11-27 Amazon Technologies, Inc. Content management
US7962597B2 (en) 2008-03-31 2011-06-14 Amazon Technologies, Inc. Request routing based on class
US7970820B1 (en) 2008-03-31 2011-06-28 Amazon Technologies, Inc. Locality based content distribution
US9407681B1 (en) 2010-09-28 2016-08-02 Amazon Technologies, Inc. Latency measurement in resource requests
US9426213B2 (en) 2008-11-11 2016-08-23 At&T Intellectual Property Ii, L.P. Hybrid unicast/anycast content distribution network system
US8782236B1 (en) 2009-06-16 2014-07-15 Amazon Technologies, Inc. Managing resources using resource expiration data
US8560597B2 (en) 2009-07-30 2013-10-15 At&T Intellectual Property I, L.P. Anycast transport protocol for content distribution networks
US8966033B2 (en) 2009-08-17 2015-02-24 At&T Intellectual Property I, L.P. Integrated proximity routing for content distribution
US8397073B1 (en) 2009-09-04 2013-03-12 Amazon Technologies, Inc. Managing secure content in a content delivery network
US8612622B2 (en) * 2009-10-02 2013-12-17 Limelight Networks, Inc. Real-time message queuing for a processing ring
US9495338B1 (en) 2010-01-28 2016-11-15 Amazon Technologies, Inc. Content distribution network
US8756272B1 (en) 2010-08-26 2014-06-17 Amazon Technologies, Inc. Processing encoded content
US8639748B2 (en) 2010-09-01 2014-01-28 Edgecast Networks, Inc. Optimized content distribution based on metrics derived from the end user
US9712484B1 (en) 2010-09-28 2017-07-18 Amazon Technologies, Inc. Managing request routing information utilizing client identifiers
US8468247B1 (en) 2010-09-28 2013-06-18 Amazon Technologies, Inc. Point of presence management in request routing
US10958501B1 (en) 2010-09-28 2021-03-23 Amazon Technologies, Inc. Request routing information based on client IP groupings
US9003035B1 (en) 2010-09-28 2015-04-07 Amazon Technologies, Inc. Point of presence management in request routing
US8452874B2 (en) 2010-11-22 2013-05-28 Amazon Technologies, Inc. Request routing processing
US8621042B2 (en) 2010-12-27 2013-12-31 Limelight Networks, Inc. Anycast redirect to unicast content download
US10467042B1 (en) 2011-04-27 2019-11-05 Amazon Technologies, Inc. Optimized deployment based upon customer locality
US9407539B1 (en) * 2011-06-24 2016-08-02 Amazon Technologies, Inc. Techniques for utilizing network destination identifiers simultaneously announced from multiple locations
US20130097277A1 (en) * 2011-10-12 2013-04-18 Electronics And Telecommunications Research Institute Method and apparatus for load balancing of content-centric network
US8738766B1 (en) * 2011-11-01 2014-05-27 Edgecast Networks, Inc. End-to-end monitoring and optimization of a content delivery network using anycast routing
US8745177B1 (en) * 2011-11-01 2014-06-03 Edgecast Networks, Inc. End-to-end monitoring and optimization of a content delivery network using anycast routing
US20150170616A1 (en) * 2012-04-27 2015-06-18 Google Inc. Local data quality heatmap
US9154551B1 (en) 2012-06-11 2015-10-06 Amazon Technologies, Inc. Processing DNS queries to identify pre-processing information
US8356074B1 (en) 2012-08-09 2013-01-15 Limelight Networks, Inc. Inter point of presence split architecture
US8612588B1 (en) 2012-08-09 2013-12-17 Limelight Networks, Inc. Point of presence to point of presence web page compression
US9537973B2 (en) * 2012-11-01 2017-01-03 Microsoft Technology Licensing, Llc CDN load balancing in the cloud
US9374276B2 (en) 2012-11-01 2016-06-21 Microsoft Technology Licensing, Llc CDN traffic management in the cloud
US9331976B2 (en) * 2012-11-15 2016-05-03 Electronics And Telecommunications Research Institute Method of request routing re-direction with loop detection and prevention
US8745221B1 (en) 2013-09-18 2014-06-03 Limelight Networks, Inc. Dynamic request rerouting
US8819187B1 (en) 2013-10-29 2014-08-26 Limelight Networks, Inc. End-to-end acceleration of dynamic content
US9894143B1 (en) * 2013-11-06 2018-02-13 Amazon Technologies, Inc. Pre-processing and processing pipeline for queue client
US8775564B1 (en) 2013-12-31 2014-07-08 Limelight Networks, Inc. Time based CDN traffic allocation
US20150172354A1 (en) * 2013-12-17 2015-06-18 Limelight Networks, Inc. Content-delivery transfer for cooperative delivery systems
US9467506B2 (en) 2014-01-27 2016-10-11 Google Inc. Anycast based, wide area distributed mapping and load balancing system
US10044609B2 (en) * 2014-02-04 2018-08-07 Fastly, Inc. Communication path selection for content delivery
US9577972B1 (en) * 2014-09-09 2017-02-21 Amazon Technologies, Inc. Message inspection in a distributed strict queue
US10097448B1 (en) 2014-12-18 2018-10-09 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10225326B1 (en) 2015-03-23 2019-03-05 Amazon Technologies, Inc. Point of presence based data uploading
US9832141B1 (en) 2015-05-13 2017-11-28 Amazon Technologies, Inc. Routing based request correlation
US9860159B1 (en) * 2015-09-22 2018-01-02 Amazon Technologies, Inc. Multi-path routing
US10044604B1 (en) 2015-09-22 2018-08-07 Amazon Technologies, Inc. Multi-path routing
US9825846B1 (en) * 2015-09-22 2017-11-21 Amazon Technologies, Inc. Multi-path routing
US10270878B1 (en) * 2015-11-10 2019-04-23 Amazon Technologies, Inc. Routing for origin-facing points of presence
CN107231283B (en) * 2016-03-23 2020-12-18 阿里巴巴集团控股有限公司 Message management method and device and message pre-reading method and device
US10075551B1 (en) 2016-06-06 2018-09-11 Amazon Technologies, Inc. Request management for hierarchical cache
CN107517160B (en) * 2016-06-15 2020-08-18 阿尔格布鲁控股有限公司 Method, device and system for data routing across different autonomous systems
US10110694B1 (en) 2016-06-29 2018-10-23 Amazon Technologies, Inc. Adaptive transfer rate for retrieving content from a server
US10361985B1 (en) * 2016-09-22 2019-07-23 Amazon Technologies, Inc. Message processing using messaging services
US10616250B2 (en) 2016-10-05 2020-04-07 Amazon Technologies, Inc. Network addresses with encoded DNS-level information
US10333944B2 (en) * 2016-11-03 2019-06-25 Microsoft Technology Licensing, Llc Detecting impossible travel in the on-premise settings
US10831549B1 (en) 2016-12-27 2020-11-10 Amazon Technologies, Inc. Multi-region request-driven code execution system
US10938884B1 (en) 2017-01-30 2021-03-02 Amazon Technologies, Inc. Origin server cloaking using virtual private cloud network environments
US11075987B1 (en) 2017-06-12 2021-07-27 Amazon Technologies, Inc. Load estimating content delivery network
US10382921B2 (en) * 2017-09-15 2019-08-13 Veniam, Inc. Systems and methods for in-vehicle sensing using a captive portal with smart phone data collection in the context of a network of moving things
US10742593B1 (en) 2017-09-25 2020-08-11 Amazon Technologies, Inc. Hybrid content request routing system
CN108762945A (en) * 2018-05-14 2018-11-06 浪潮通用软件有限公司 A kind of implementation method for supporting a variety of message queues
US11132404B2 (en) * 2018-05-30 2021-09-28 Apple Inc. Techniques for facilitating communications between isolated processes executing within a web browser
CN110662292B (en) * 2018-06-29 2023-04-07 慧与发展有限责任合伙企业 Transmitting multicast frames
US10862852B1 (en) 2018-11-16 2020-12-08 Amazon Technologies, Inc. Resolution of domain name requests in heterogeneous network environments
US11025747B1 (en) 2018-12-12 2021-06-01 Amazon Technologies, Inc. Content request pattern-based routing system
US10789195B1 (en) * 2019-07-17 2020-09-29 Capital One Services, Llc Article, device, and techniques for serverless streaming message processing
US11070485B2 (en) * 2019-12-05 2021-07-20 Netflix, Inc. Multimedia content steering
US10931786B1 (en) * 2020-03-31 2021-02-23 Amazon Technologies, Inc. Dynamic content placement for content delivery networks
US11711445B2 (en) * 2020-09-16 2023-07-25 Netflix, Inc. Configurable access-based cache policy control
US11799948B2 (en) 2020-11-17 2023-10-24 Cisco Technology, Inc. Cloud service datacenter selection based on data sovereignty policies
US20230269217A1 (en) * 2022-02-23 2023-08-24 Cisco Technology, Inc. Binding flows to unique addresses or ports

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020065899A1 (en) 2000-11-30 2002-05-30 Smith Erik Richard System and method for delivering dynamic content
US20020143929A1 (en) * 2000-12-07 2002-10-03 Maltz David A. Method and system for collection and storage of traffic data from heterogeneous network elements in a computer network
US20020152309A1 (en) 1999-11-22 2002-10-17 Gupta Ajit Kumar Integrated point of presence server network
US20030079027A1 (en) 2001-10-18 2003-04-24 Michael Slocombe Content request routing and load balancing for content distribution networks
US20040083479A1 (en) * 2002-10-23 2004-04-29 Oleg Bondarenko Method for organizing multiple versions of XML for use in a contact center environment
US20040114569A1 (en) 2002-12-17 2004-06-17 Naden James M. Cummunication network route determination
US6785704B1 (en) 1999-12-20 2004-08-31 Fastforward Networks Content distribution system for operation over an internetwork including content peering arrangements
US20050021863A1 (en) 2000-06-23 2005-01-27 Cloudshield Technologies, Inc. Apparatus and method for virtual edge placement of web sites
US6871324B2 (en) 2001-05-25 2005-03-22 International Business Machines Corporation Method and apparatus for efficiently and dynamically updating monitored metrics in a heterogeneous system
US20060233155A1 (en) 2002-03-19 2006-10-19 Srivastava Sunil K Server load balancing using IP option field approach to identify route to selected server
US7127713B2 (en) 2002-01-11 2006-10-24 Akamai Technologies, Inc. Java application framework for use in a content delivery network (CDN)
US20060271705A1 (en) 2000-03-16 2006-11-30 Garcia-Luna-Aceves J J System and method for discovering information objects and information object repositories in computer networks
US20070025327A1 (en) 2005-08-01 2007-02-01 Limelight Networks, Inc. Heavy load packet-switched routing
US20070118667A1 (en) 2005-11-21 2007-05-24 Limelight Networks, Inc. Domain name resolution based dynamic resource assignment
US20070118668A1 (en) 2005-11-21 2007-05-24 Limelight Networks, Inc. Domain Name Resolution Resource Allocation
US7269157B2 (en) 2001-04-10 2007-09-11 Internap Network Services Corporation System and method to assure network service levels with intelligent routing
US20080062990A1 (en) 2006-09-11 2008-03-13 Cisco Technology, Inc. Retransmission-based stream repair and stream join
US20080072264A1 (en) 2006-08-02 2008-03-20 Aaron Crayford Distribution of content on a network
US20080147866A1 (en) * 2001-09-28 2008-06-19 Level 3 Communications, Llc Distributing requests across multiple content delivery networks based on subscriber policy
US7523181B2 (en) 1999-11-22 2009-04-21 Akamai Technologies, Inc. Method for determining metrics of a content delivery and global traffic management network
US20090113057A1 (en) 2007-10-26 2009-04-30 Jacobus Van Der Merwe Proximity Routing For Session Based Applications Using Anycast
US7574499B1 (en) 2000-07-19 2009-08-11 Akamai Technologies, Inc. Global traffic management system using IP anycast routing and dynamic load-balancing
US20110016180A1 (en) * 2009-07-17 2011-01-20 Aryaka Networks, Inc. Application acceleration as a service system and method
US20110069626A1 (en) * 2009-09-23 2011-03-24 Ethan Sun Network testing providing for concurrent real-time ingress and egress viewing of network traffic data
US20110099290A1 (en) * 2000-07-19 2011-04-28 Akamai Technologies, Inc. Method for determining metrics of a content delivery and global traffic management network

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2001265051A1 (en) * 2000-05-26 2001-12-11 Akamai Technologies, Inc. Global load balancing across mirrored data centers
US7155723B2 (en) * 2000-07-19 2006-12-26 Akamai Technologies, Inc. Load balancing service
CN100525288C (en) * 2000-10-26 2009-08-05 普里斯梅迪亚网络有限公司 Method and apparatus for large payload distribution in network
ITTO20011082A1 (en) * 2001-11-19 2003-05-19 Telecom Italia Lab Spa PROCEDURE TO CHECK THE FUNCTIONALITY OF A CDN NETWORK, ITS SYSTEM AND IT PRODUCT.
CN1697354B (en) * 2005-06-17 2010-05-05 顾红波 Method for reliable transmitting data through multicast and unicast protocol, and host of receiving data
US7636677B1 (en) * 2007-05-14 2009-12-22 Coremetrics, Inc. Method, medium, and system for determining whether a target item is related to a candidate affinity item
CN101364936B (en) * 2007-08-08 2011-01-26 中国电信股份有限公司 Service differentiating and quality control system and method for multiple edge wideband access network
US8321568B2 (en) * 2008-03-31 2012-11-27 Amazon Technologies, Inc. Content management
US8117306B1 (en) * 2008-09-29 2012-02-14 Amazon Technologies, Inc. Optimizing content management
US20110035497A1 (en) * 2009-08-05 2011-02-10 Dynamic Network Services, Inc. System and method for providing global server load balancing
US20110055386A1 (en) * 2009-08-31 2011-03-03 Level 3 Communications, Llc Network analytics management
US8612622B2 (en) * 2009-10-02 2013-12-17 Limelight Networks, Inc. Real-time message queuing for a processing ring

Patent Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050010653A1 (en) 1999-09-03 2005-01-13 Fastforward Networks, Inc. Content distribution system for operation over an internetwork including content peering arrangements
US7523181B2 (en) 1999-11-22 2009-04-21 Akamai Technologies, Inc. Method for determining metrics of a content delivery and global traffic management network
US20020152309A1 (en) 1999-11-22 2002-10-17 Gupta Ajit Kumar Integrated point of presence server network
US6785704B1 (en) 1999-12-20 2004-08-31 Fastforward Networks Content distribution system for operation over an internetwork including content peering arrangements
US20060271705A1 (en) 2000-03-16 2006-11-30 Garcia-Luna-Aceves J J System and method for discovering information objects and information object repositories in computer networks
US20050021863A1 (en) 2000-06-23 2005-01-27 Cloudshield Technologies, Inc. Apparatus and method for virtual edge placement of web sites
US20110099290A1 (en) * 2000-07-19 2011-04-28 Akamai Technologies, Inc. Method for determining metrics of a content delivery and global traffic management network
US7574499B1 (en) 2000-07-19 2009-08-11 Akamai Technologies, Inc. Global traffic management system using IP anycast routing and dynamic load-balancing
US20020065899A1 (en) 2000-11-30 2002-05-30 Smith Erik Richard System and method for delivering dynamic content
US20020143929A1 (en) * 2000-12-07 2002-10-03 Maltz David A. Method and system for collection and storage of traffic data from heterogeneous network elements in a computer network
US7269157B2 (en) 2001-04-10 2007-09-11 Internap Network Services Corporation System and method to assure network service levels with intelligent routing
US6871324B2 (en) 2001-05-25 2005-03-22 International Business Machines Corporation Method and apparatus for efficiently and dynamically updating monitored metrics in a heterogeneous system
US20080147866A1 (en) * 2001-09-28 2008-06-19 Level 3 Communications, Llc Distributing requests across multiple content delivery networks based on subscriber policy
US20030079027A1 (en) 2001-10-18 2003-04-24 Michael Slocombe Content request routing and load balancing for content distribution networks
US20080235400A1 (en) 2001-10-18 2008-09-25 Level 3 Communications, Llc Content request routing and load balancing for content distribution networks
US7127713B2 (en) 2002-01-11 2006-10-24 Akamai Technologies, Inc. Java application framework for use in a content delivery network (CDN)
US20060233155A1 (en) 2002-03-19 2006-10-19 Srivastava Sunil K Server load balancing using IP option field approach to identify route to selected server
US20040083479A1 (en) * 2002-10-23 2004-04-29 Oleg Bondarenko Method for organizing multiple versions of XML for use in a contact center environment
US20040114569A1 (en) 2002-12-17 2004-06-17 Naden James M. Cummunication network route determination
US20070025327A1 (en) 2005-08-01 2007-02-01 Limelight Networks, Inc. Heavy load packet-switched routing
US20070118668A1 (en) 2005-11-21 2007-05-24 Limelight Networks, Inc. Domain Name Resolution Resource Allocation
US20070118667A1 (en) 2005-11-21 2007-05-24 Limelight Networks, Inc. Domain name resolution based dynamic resource assignment
US20080072264A1 (en) 2006-08-02 2008-03-20 Aaron Crayford Distribution of content on a network
US20080062990A1 (en) 2006-09-11 2008-03-13 Cisco Technology, Inc. Retransmission-based stream repair and stream join
US20090113057A1 (en) 2007-10-26 2009-04-30 Jacobus Van Der Merwe Proximity Routing For Session Based Applications Using Anycast
US20110016180A1 (en) * 2009-07-17 2011-01-20 Aryaka Networks, Inc. Application acceleration as a service system and method
US20110069626A1 (en) * 2009-09-23 2011-03-24 Ethan Sun Network testing providing for concurrent real-time ingress and egress viewing of network traffic data

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Anycast Addressing on the Internet, Kuro5hin, pp. 1-7, Jan. 2, 2004.
Anycast Wikipedia, pp. 1-3, Oct. 2, 2006.
Buyya, Rajkumar et al., "A Case for Peering of Content Delivery Networks", pp. 1-14, Oct. 2006.
Green, M. et al., "Content internetworking architecture overview", IETF Internal Draft, Feb. 22, 2002.
International Search Report dated May 31, 2011 for International Application No. PCT/US2010/051195, 3 pages.

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9191369B2 (en) 2009-07-17 2015-11-17 Aryaka Networks, Inc. Application acceleration as a service system and method
US9832170B2 (en) 2009-07-17 2017-11-28 Aryaka Networks, Inc. Application acceleration as a service system and method
US20150172135A1 (en) * 2013-12-17 2015-06-18 Limelight Networks, Inc. Dynamic bandwidth allocation for cooperative delivery systems
US9571407B2 (en) 2014-12-10 2017-02-14 Limelight Networks, Inc. Strategically scheduling TCP stream transmissions
US11843682B1 (en) * 2022-08-31 2023-12-12 Adobe Inc. Prepopulating an edge server cache

Also Published As

Publication number Publication date
US20110082916A1 (en) 2011-04-07
CN102640467A (en) 2012-08-15
EP2484065A4 (en) 2013-08-07
EP2484064A2 (en) 2012-08-08
WO2011041722A2 (en) 2011-04-07
US8199752B2 (en) 2012-06-12
US8270403B2 (en) 2012-09-18
BR112012007533A2 (en) 2019-09-24
WO2011041722A3 (en) 2011-07-28
BR112012007538A2 (en) 2016-12-06
CN102714634A (en) 2012-10-03
US9197537B2 (en) 2015-11-24
EP2484065A2 (en) 2012-08-08
WO2011041726A3 (en) 2011-07-28
US20110082944A1 (en) 2011-04-07
EP2484064A4 (en) 2015-04-22
WO2011041726A2 (en) 2011-04-07
US20120300775A1 (en) 2012-11-29
US20120023198A1 (en) 2012-01-26

Similar Documents

Publication Publication Date Title
US8612622B2 (en) Real-time message queuing for a processing ring
US11765219B2 (en) Network monitoring to determine performance of infrastructure service providers
US10911509B2 (en) Configuring manifest files including redirect uniform resource locators
US8943170B2 (en) Content delivery network aggregation with selected content delivery
US20150264009A1 (en) Client-selectable routing using dns requests
US20150350291A1 (en) System, method and live streaming optimizer server for live media content distribution optimization from a content delivery network
US20170041422A1 (en) Method and system for retrieving a content manifest in a network
US9015309B2 (en) Networked probe system
US11936708B2 (en) Configuring manifest files including redirect uniform resource locators
Li Popularity-driven caching strategy for dynamic adaptive streaming over information-centric networks
Meng et al. Elastic caching solutions for content dissemination services elastic caching solutions for content dissemination services of ip-based internet technologies prospective
EP2827557A1 (en) Automated application metric selection for multi-cost ALTO queries

Legal Events

Date Code Title Description
AS Assignment

Owner name: LIMELIGHT NETWORKS, INC., ARIZONA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SWANSON, WYLIE;BLACK, BRYAN D.;RACIBORSKI, NATHAN F.;AND OTHERS;SIGNING DATES FROM 20100513 TO 20100719;REEL/FRAME:024803/0782

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FEPP Fee payment procedure

Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.)

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20171217

AS Assignment

Owner name: LYNROCK LAKE MASTER FUND LP (LYNROCK LAKE PARTNERS LLC, ITS GENERAL PARTNER), NEW YORK

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EDGIO, INC.;MOJO MERGER SUB, LLC;REEL/FRAME:065597/0212

Effective date: 20231114

Owner name: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, ARIZONA

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EDGIO, INC.;MOJO MERGER SUB, LLC;REEL/FRAME:065597/0406

Effective date: 20231114