WO2002035799A3 - Method and apparatus for large payload distribution in a network - Google Patents

Method and apparatus for large payload distribution in a network Download PDF

Info

Publication number
WO2002035799A3
WO2002035799A3 PCT/US2001/032638 US0132638W WO0235799A3 WO 2002035799 A3 WO2002035799 A3 WO 2002035799A3 US 0132638 W US0132638 W US 0132638W WO 0235799 A3 WO0235799 A3 WO 0235799A3
Authority
WO
WIPO (PCT)
Prior art keywords
network
file
content
nodes
large payload
Prior art date
Application number
PCT/US2001/032638
Other languages
French (fr)
Other versions
WO2002035799A2 (en
Inventor
Siew Yong Sim
Desmond Cho-Hung Chan
Original Assignee
Prismedia Networks Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/681,644 external-priority patent/US6970939B2/en
Application filed by Prismedia Networks Inc filed Critical Prismedia Networks Inc
Priority to AU2002224448A priority Critical patent/AU2002224448A1/en
Priority to EP01989004A priority patent/EP1368948A2/en
Publication of WO2002035799A2 publication Critical patent/WO2002035799A2/en
Publication of WO2002035799A3 publication Critical patent/WO2002035799A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/188—Virtual file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/12—Avoiding congestion; Recovering from congestion
    • H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering

Abstract

Large payload files are selectively partitioned in blocks and theblocks distributed to a plurality of distribution stations at theedge of the network qualified to have the data. Each qualified station decides how much and what portion of the content to save locally, based on information such as network location and environment, usage, popularity, and other distribution criteria defined by the content provider. Different pieces of a large payload file may be available from different nodes, however, when a user requests access to the large payload file, for example, through an application server, a virtual file control system creates an illusion that the entire file is present at the connected node. However, since only selective portions of the large payload file may actually be resident at that node's storage at the time of request, a cluster of distribution servers at the distribution station may download the non-resident portions of the file as the applicationserver is servicing the user. The download may be in parallel andusually from the least congested nodes. New nodes added to the network learn from other nodes in the network what content they should have and downlaod the required content, in a desired amount, onto their local storage devices from the nearest and least congested nodes without interrupting network operation. Each node manages its local storage and decides what content to prune based on information such as usage patterns.
PCT/US2001/032638 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network WO2002035799A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2002224448A AU2002224448A1 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network
EP01989004A EP1368948A2 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
US26628600P 2000-10-26 2000-10-26
US60/266,286 2000-10-26
US09/681,644 2001-05-15
US09/681,644 US6970939B2 (en) 2000-10-26 2001-05-15 Method and apparatus for large payload distribution in a network
US09/681,665 2001-05-17
US09/681,665 US7165095B2 (en) 2000-10-26 2001-05-17 Method and apparatus for distributing large payload file to a plurality of storage devices in a network
US09/681,671 US6857012B2 (en) 2000-10-26 2001-05-18 Method and apparatus for initializing a new node in a network
US09/681,669 US7181523B2 (en) 2000-10-26 2001-05-18 Method and apparatus for managing a plurality of servers in a content delivery network
US09/681,669 2001-05-18
US09/681,673 2001-05-18
US09/681,668 US7177270B2 (en) 2000-10-26 2001-05-18 Method and apparatus for minimizing network congestion during large payload delivery
US09/681,668 2001-05-18
US09/681,672 2001-05-18
US09/681,672 US7047287B2 (en) 2000-10-26 2001-05-18 Method and apparatus for automatically adapting a node in a network
US09/681,671 2001-05-18
US09/681,673 US7058014B2 (en) 2000-10-26 2001-05-18 Method and apparatus for generating a large payload file

Publications (2)

Publication Number Publication Date
WO2002035799A2 WO2002035799A2 (en) 2002-05-02
WO2002035799A3 true WO2002035799A3 (en) 2003-09-25

Family

ID=27575312

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/032638 WO2002035799A2 (en) 2000-10-26 2001-10-26 Method and apparatus for large payload distribution in a network

Country Status (4)

Country Link
EP (1) EP1368948A2 (en)
CN (1) CN100525288C (en)
AU (1) AU2002224448A1 (en)
WO (1) WO2002035799A2 (en)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE381191T1 (en) 2000-10-26 2007-12-15 Prismedia Networks Inc METHOD AND SYSTEM FOR MANAGING DISTRIBUTED CONTENT AND CORRESPONDING METADATA
US7171469B2 (en) 2002-09-16 2007-01-30 Network Appliance, Inc. Apparatus and method for storing data in a proxy cache in a network
US7284030B2 (en) * 2002-09-16 2007-10-16 Network Appliance, Inc. Apparatus and method for processing data in a network
US7552223B1 (en) 2002-09-16 2009-06-23 Netapp, Inc. Apparatus and method for data consistency in a proxy cache
KR100585668B1 (en) * 2004-03-22 2006-06-07 엘지전자 주식회사 Multimedia compiling method and apparatus using virtual media file system and multimedia file structure
CN100433619C (en) * 2004-07-23 2008-11-12 腾讯科技（深圳）有限公司 Data download method and system
CN100411341C (en) * 2005-08-10 2008-08-13 华为技术有限公司 Parallel downloading method and terminal
WO2007028252A2 (en) * 2005-09-08 2007-03-15 Nortel Networks Limited Load balancing for an air interface protocol architecture with a plurality of heterogenous physical layer modes
US20070168405A1 (en) * 2006-01-17 2007-07-19 Ori Pomerantz Self-optimizing network attached storage for multiple geographic locations
CN101064729B (en) * 2006-04-27 2010-06-09 中国电信股份有限公司 System and method for realizing FTP download service through CDN network
CN101495973A (en) * 2006-06-09 2009-07-29 迅龙国际集团有限公司 N^N data management, access, storage, transmission, exchange and retrieval system (data concentration management)
US8082289B2 (en) 2006-06-13 2011-12-20 Advanced Cluster Systems, Inc. Cluster computing support for application programs
CN101184104B (en) * 2007-12-21 2010-12-15 腾讯科技（深圳）有限公司 Distributed memory system and method
JP4557028B2 (en) * 2008-03-19 2010-10-06 ソニー株式会社 Information processing apparatus, information processing method, client device, information processing system
CA2673554C (en) * 2009-07-21 2017-01-03 Ibm Canada Limited - Ibm Canada Limitee Web distributed storage system
WO2011023134A1 (en) * 2009-08-28 2011-03-03 Beijing Innovation Works Technology Company Limited Method and system for managing distributed storage system through virtual file system
US8199752B2 (en) * 2009-10-02 2012-06-12 Limelight Networks, Inc. Enhanced anycast for edge server selection
CN102486739B (en) * 2009-11-30 2015-03-25 国际商业机器公司 Method and system for distributing data in high-performance computer cluster
US9628579B2 (en) 2010-05-13 2017-04-18 Futurewei Technologies, Inc. System, apparatus for content delivery for internet traffic and methods thereof
US8463788B2 (en) * 2010-09-03 2013-06-11 Marvell World Trade Ltd. Balancing caching load in a peer-to-peer based network file system
JP5743469B2 (en) * 2010-09-22 2015-07-01 キヤノン株式会社 Information processing apparatus, control method thereof, and control program
US8612550B2 (en) 2011-02-07 2013-12-17 Microsoft Corporation Proxy-based cache content distribution and affinity
PL2512105T3 (en) * 2011-04-15 2018-01-31 Deutsche Telekom Ag Network traffic engineering
JP5932987B2 (en) * 2011-06-08 2016-06-08 コニンクリーケ・ケイピーエヌ・ナムローゼ・フェンノートシャップ Location and extraction of segmented content
CN104106073B (en) * 2011-12-21 2017-06-27 阿卡麦科技公司 Security strategy editing machine
US20150063361A1 (en) * 2012-03-28 2015-03-05 Nec Corporation Computer system and communication route changing method
EP2660723A1 (en) * 2012-05-03 2013-11-06 Thomson Licensing Method of data storing and maintenance in a distributed data storage system and corresponding device
KR101872570B1 (en) * 2012-10-08 2018-06-28 패트릭 순-시옹 Distributed storage systems and methods
US9246998B2 (en) 2012-10-16 2016-01-26 Microsoft Technology Licensing, Llc Load balancer bypass
CN103036967B (en) * 2012-12-10 2017-03-15 北京奇虎科技有限公司 A kind of download management equipment, method and data downloading system
CN103152396A (en) * 2013-02-05 2013-06-12 华南师范大学 Data placement method and device applied to content distribution network system
CN103778212B (en) * 2014-01-16 2017-04-05 国网山东省电力公司青岛供电公司 Parallel mass data processing method based on back end
CN103929491B (en) * 2014-04-28 2016-02-03 努比亚技术有限公司 Method of data synchronization and system and mobile terminal
CN105634992B (en) * 2015-12-29 2019-01-11 网宿科技股份有限公司 CDN platform adaptive band width control method and system
CN108683692B (en) * 2018-03-16 2021-05-11 创新先进技术有限公司 Service request processing method and device
CN109308239B (en) * 2018-09-26 2022-02-18 北京百度网讯科技有限公司 Method and apparatus for outputting information
CN109981780A (en) * 2019-03-27 2019-07-05 深圳市网心科技有限公司 A kind of dispatching method, node device, scheduling system and storage medium
CN110308917B (en) * 2019-06-26 2024-02-23 深圳前海微众银行股份有限公司 Applet issuing method, device, equipment and computer storage medium
CN113301379B (en) * 2021-05-26 2022-10-04 广州方硅信息技术有限公司 Live broadcast list updating method, device, system and storage medium
US11606249B1 (en) * 2022-01-19 2023-03-14 Dell Products L.P. System and method for communication management in distributed system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5751968A (en) * 1995-09-12 1998-05-12 Vocaltec Ltd. System and method for distributing multi-media presentations in a computer network
EP0967559A1 (en) * 1998-06-24 1999-12-29 Lucent Technologies Inc. Push-pull services for the internet
US6038601A (en) * 1997-07-21 2000-03-14 Tibco, Inc. Method and apparatus for storing and delivering documents on the internet
US6081840A (en) * 1997-10-14 2000-06-27 Zhao; Yan Two-level content distribution system
US6105029A (en) * 1997-09-17 2000-08-15 International Business Machines Corporation Retrieving network files through parallel channels

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5751968A (en) * 1995-09-12 1998-05-12 Vocaltec Ltd. System and method for distributing multi-media presentations in a computer network
US6038601A (en) * 1997-07-21 2000-03-14 Tibco, Inc. Method and apparatus for storing and delivering documents on the internet
US6105029A (en) * 1997-09-17 2000-08-15 International Business Machines Corporation Retrieving network files through parallel channels
US6081840A (en) * 1997-10-14 2000-06-27 Zhao; Yan Two-level content distribution system
EP0967559A1 (en) * 1998-06-24 1999-12-29 Lucent Technologies Inc. Push-pull services for the internet

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
ALLEN MIU ET AL: "Performance Analysis of a Dynamic Parallel Downloading Scheme from Mirror Sites Throughout the Internet", 6892 TERM PAPER, XX, XX, December 1999 (1999-12-01), pages 1 - 13, XP002204897 *
BABAK S NOGHAMI ET AL: "A Novel Approach to Reduce Latency on the Internet: Component-Based Download", DEPT. OF ELECTRICAL AND COMPUTER ENGINEERING, UNIVERSITY OF MANITOBA, June 2000 (2000-06-01), XP002204898 *
GRUBER S ET AL: "Design Considerations for an RTSP-Based Prefix-Caching Proxy for Multimedia Streams", AT&T LABS RESEARCH, 7 September 1999 (1999-09-07), XP002194289 *
RODRIGUEZ P ET AL: "Parallel-access for mirror sites in the Internet", INFOCOM 2000. NINETEENTH ANNUAL JOINT CONFERENCE OF THE IEEE COMPUTER AND COMMUNICATIONS SOCIETIES. PROCEEDINGS. IEEE TEL AVIV, ISRAEL 26-30 MARCH 2000, PISCATAWAY, NJ, USA,IEEE, US, 26 March 2000 (2000-03-26), pages 864 - 873, XP010376176, ISBN: 0-7803-5880-5 *

Also Published As

Publication number Publication date
WO2002035799A2 (en) 2002-05-02
AU2002224448A1 (en) 2002-05-06
EP1368948A2 (en) 2003-12-10
CN100525288C (en) 2009-08-05
CN1481635A (en) 2004-03-10

Similar Documents

Publication Publication Date Title
WO2002035799A3 (en) Method and apparatus for large payload distribution in a network
EP1988684A3 (en) Method and apparatus for large payload distribution in a network
CN103024825B (en) Method and device of distributing network source among multiple applications of terminal
Bestavros et al. Server-Initated Document Dissemination for the WWW.
CN107707943B (en) A kind of method and system for realizing cloud service fusion
US20100131545A1 (en) Distribution Data Items Within Geographically Distributed Databases
EP0957616A3 (en) A protocol for exchanging configuration data in a computer network
CA2182124A1 (en) Method and System for Licensing Program Management Within a Distributed Data Processing System
WO2001059673A3 (en) Method and system for accessing a remote storage area
WO2005067428A3 (en) Routing of resource information in a network
CN101741884B (en) Distributed storage method and device
CA2308280A1 (en) System and method for capacity shaping in an internet environment
CN106453576B (en) A kind of exchange method, system and control centre based on mixing cloud platform
EP1351141A3 (en) Method and system for managing data records on a computer network
WO2003094033A3 (en) Method and system for configuration and download in a restricted architecture network
CA2406821A1 (en) Switchable resource management in clustered computer system
CN105337901A (en) Router intelligent bandwidth allocation method and device
DE60045327D1 (en) System and method for integrated load distribution and resource management in an Internet environment
WO2004092869A3 (en) Data matrix method and system for distribution of data
CN107147921A (en) Based on section and the intelligence CDN video playback accelerated methods dispatched and equipment
AU2002340853A1 (en) Hierarchical caching in telecommunication networks
CN105872856A (en) Method and system for distributing stream media files
JP2001092744A5 (en) Program information processing device
CN103516761A (en) Time-sharing control method for server accessed by multiple terminals and cloud computing system
WO2000052574A3 (en) Method and system for data processing by proxy

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2001989004

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 018208142

Country of ref document: CN

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2001989004

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP