CA2294511C - System for adaptive video/audio transport over a network - Google Patents
System for adaptive video/audio transport over a network Download PDFInfo
- Publication number
- CA2294511C CA2294511C CA002294511A CA2294511A CA2294511C CA 2294511 C CA2294511 C CA 2294511C CA 002294511 A CA002294511 A CA 002294511A CA 2294511 A CA2294511 A CA 2294511A CA 2294511 C CA2294511 C CA 2294511C
- Authority
- CA
- Canada
- Prior art keywords
- video
- frames
- bandwidth
- network channel
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6583—Acknowledgement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/39—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
Abstract
A system for adaptively transporting video over networks wherein the available bandwidth varies with time. The system comprises a video/audio codec that functions to compress, code, decode and decompress video streams that are transmitted over networks having available banwidths that vary with time and location. Depending on the channel bandwidth, the system adjusts the compression ratio to accomodate a plurality of bandwidths ranging from 20 Kbps for POTS to several Mbps for switched LAN and ATM environments. Bandwidth adjustability is provided by offering a trade off between video resolution, frame rate and individual frame quality. The system generates a video data stream comprised of Key, P and B frames from a raw source of video. Each frame type is further comprised of multiple levels of data representing varying degrees of quality. In addition, several video server platforms can be utilized in tandem to transmit video/audio information with each video server platform transmitting information for a single compression/resolution level.
Description
SYSTEM FOR ADAPTIVE VIDEOIAUDIO TRANSPORT OVER A NETWORK
FIELD OF THE INVENTION
The present invention relates generally to transport of video and audio information over networks and more particularly relates to adapting the transport of video and audio information over IP networks having varying bandwidth capacities.
BACKGROUND OF THE INVENTION
Traditionally, most, if not all, of the content found on the Internet today is ~o text and image based. While video content can add tremendous new excitement and value to the Internet in the form of advertising, online training, video conferencing and many other functions, these types of applications are rare today. Even when they do exist, the quality of the overall experience is poor.
In addition, most often, the cost is prohibitively too high for wide scale deployment.
The Internet and other TCP/IP networks are challenging environments in which to deliver streaming real time audio/video. The bandwidth available over a connection at any particular instant varies with both time and location. This variation in bandwidth causes entire packets containing substantial audiolvideo content to be lost. In addition, the latency through the network, causing the video 2o that is ultimately displayed to 'fitter' or lose clarity at the client.
These factors may be tolerable for file transfer traffic where fitter does not matter since high level protocols correct for errors and losses. They do, however, make data delivery difficult for real time audio/video streaming applications.
A major challenge in transporting video over TCPIIP networks is that 2s video requires much higher bandwidth than most other types of data objects.
To illustrate, consider that the raw data required for a one hour movie shown at a resolution ofi 640 X 480 at 30 fps is approximately 100 GB. To transmit this uncompressed raw video over a 10 Mbps Ethernet fink would take approximately 22 hours. The transmit the same video over a 28.8 Kbps modem would take 3o approximately 320 days. Thus, it is clear, that for practical purposes, video must be heavily compressed for real time video transmission over a network have finite speed.
Another major challenge to transporting video over TCP/IP networks or any network generally, is coping with variable bandwidth. Two aspects of bandwidth variation include time-dependent bandwidth variation and site-dependent bandwidth variation.
Time-dependent bandwidth variation is due to changes in network traffic because the network is a shared resource. Site-dependent bandwidth variation arises from the fact that the video data stream is, in many video-related applications, sent to multiple sites. The connections from the server to each site typically have varying available bandwidths. For example. even within the same building, one recipient may be on a local area network (LAN), while another recipient may be connected via an integrated services digital network ( ISDN) line. Thus, it would be useful if available bandwidth were dynamically measured and this measurement used to provide optimum quality video to each site. This would minimize any waste of network resources and reduce CPU resource usage.
Current video transport or delivery systems essentially ignore the problems of transporting video over TCP/IP networks as discussed above. These systems provide a simple control to the sender or creator of the video stream that functions to select a particular video transmission bandwidth. A common soiution is to select a target transmission bandwidth as the lowest common bandwidth for all recipients. This solution results in poorer quality for users with access to higher bandwidth. Another common solution is to pump in video data based on the capabilities of the source, thus allowing the downstream network routers to drop the packets as needed. This solution results in wasted network resources.
The article, "Method to Deliver Scalable Video across a Distributed Computer System." [IBM Technical Disclosure Bulletin. Vol. 37, No. ~, pp. ?51-256 (May 1994)]
describes a method which implements a new file format "on top of a byte-oriented multimedia file and has a reference frame and a number of delta frames.
EP 0739140 teaches a base layer and an enhancement layer containing error data that involves an addition process at the client node.
Campbell, et al., ''Meeting End-to-End QOS Challenges for Scalable Flows in Heterogeneous Multimedia Environments.'' [High Performance Networking 6, 6'h Int. Conf.
High Performance Networking (HPN), Palma de Mallorca, pp. 101-1 l~ (Sept. 13-l~, 1990]
FIELD OF THE INVENTION
The present invention relates generally to transport of video and audio information over networks and more particularly relates to adapting the transport of video and audio information over IP networks having varying bandwidth capacities.
BACKGROUND OF THE INVENTION
Traditionally, most, if not all, of the content found on the Internet today is ~o text and image based. While video content can add tremendous new excitement and value to the Internet in the form of advertising, online training, video conferencing and many other functions, these types of applications are rare today. Even when they do exist, the quality of the overall experience is poor.
In addition, most often, the cost is prohibitively too high for wide scale deployment.
The Internet and other TCP/IP networks are challenging environments in which to deliver streaming real time audio/video. The bandwidth available over a connection at any particular instant varies with both time and location. This variation in bandwidth causes entire packets containing substantial audiolvideo content to be lost. In addition, the latency through the network, causing the video 2o that is ultimately displayed to 'fitter' or lose clarity at the client.
These factors may be tolerable for file transfer traffic where fitter does not matter since high level protocols correct for errors and losses. They do, however, make data delivery difficult for real time audio/video streaming applications.
A major challenge in transporting video over TCPIIP networks is that 2s video requires much higher bandwidth than most other types of data objects.
To illustrate, consider that the raw data required for a one hour movie shown at a resolution ofi 640 X 480 at 30 fps is approximately 100 GB. To transmit this uncompressed raw video over a 10 Mbps Ethernet fink would take approximately 22 hours. The transmit the same video over a 28.8 Kbps modem would take 3o approximately 320 days. Thus, it is clear, that for practical purposes, video must be heavily compressed for real time video transmission over a network have finite speed.
Another major challenge to transporting video over TCP/IP networks or any network generally, is coping with variable bandwidth. Two aspects of bandwidth variation include time-dependent bandwidth variation and site-dependent bandwidth variation.
Time-dependent bandwidth variation is due to changes in network traffic because the network is a shared resource. Site-dependent bandwidth variation arises from the fact that the video data stream is, in many video-related applications, sent to multiple sites. The connections from the server to each site typically have varying available bandwidths. For example. even within the same building, one recipient may be on a local area network (LAN), while another recipient may be connected via an integrated services digital network ( ISDN) line. Thus, it would be useful if available bandwidth were dynamically measured and this measurement used to provide optimum quality video to each site. This would minimize any waste of network resources and reduce CPU resource usage.
Current video transport or delivery systems essentially ignore the problems of transporting video over TCP/IP networks as discussed above. These systems provide a simple control to the sender or creator of the video stream that functions to select a particular video transmission bandwidth. A common soiution is to select a target transmission bandwidth as the lowest common bandwidth for all recipients. This solution results in poorer quality for users with access to higher bandwidth. Another common solution is to pump in video data based on the capabilities of the source, thus allowing the downstream network routers to drop the packets as needed. This solution results in wasted network resources.
The article, "Method to Deliver Scalable Video across a Distributed Computer System." [IBM Technical Disclosure Bulletin. Vol. 37, No. ~, pp. ?51-256 (May 1994)]
describes a method which implements a new file format "on top of a byte-oriented multimedia file and has a reference frame and a number of delta frames.
EP 0739140 teaches a base layer and an enhancement layer containing error data that involves an addition process at the client node.
Campbell, et al., ''Meeting End-to-End QOS Challenges for Scalable Flows in Heterogeneous Multimedia Environments.'' [High Performance Networking 6, 6'h Int. Conf.
High Performance Networking (HPN), Palma de Mallorca, pp. 101-1 l~ (Sept. 13-l~, 1990]
teaches providing guarantees for the transmission of a base layer, while enhancement layers compete for residual bandwidth.
EP 064> j 14 discloses dynamic bandwidth estimation and adaptation for packet communications networks. but not the selection of a single quality level and the consequent transmission of the selected quality level.
SUMMARY OF THE INVENTION
The present invention is a system for adaptively transporting video over networks wherein the available bandwidth varies with time. The present invention has application to any type of network, including those that utilize the Internet Protocol (IP), such as the Internet or other TCP/IP networks. The system comprises a video/audio codec or coder/decoder that functions to compress, code. decode and decompress video streams that are transmitted over networks having available bandwidths that vary with time and location.
Depending on the channel bandwidth. the system adjusts the compression ratio to accommodate a plurality of bandwidths. ranging from ?0 Kbps for plain old telephone service (POTS) to several Mbps for switched LAN and ATM environments.
Bandwidth adjustability is provided by offering a trade-off between video resolution (e.G., 160 x 1?0.
~~0 x ?40, 640 Y 480), frame rate (e.G.. 30 fps, l~ fps. 7.~ fps) and individual frame quality.
This flexibility is useful fox different applications that stress different requirements.
The system functions to Generate a prioritized video data stream comprising multiple levels from a raw source of video. This video stream is stored in a file and accessed by the video server when servicing clients. In operation, the video client only receives a subset of the levels. The levels are chosen to have a suitable data content to match that of the network connection. This permits a better fit between network bandwidth consumed and video image quality. Each of the levels is built on top of the previous levels, with the higher levels providing incremental information not present in the lower levels. This ensures that bandwidth is not wasted on the client end or on the encoder/server side. The system Qenerates the video stream that is sent to the client such that a loss of any individual packet on the network will not cause sustained degraded quality at the client.
The scaleable compression performed by the system is suitable for transparent video within an Internet environment characterized by large diversity and heterogeneity. The system functions to match the image quality of the video data being transported with the wide variations in available network bandwidth. In _.~....w..~.W.~..~_...,.~.~........__. _._~,~,.-..w-,.,.~..~.m_.___.._ addition, the system can adjust the video data to match the differences in available computing power on the client computer system. The system, utilizing 'best effort' protocols such as those found on the Internet, adapts to the time varying nature of the available bandwidth.
There is therefore provided in accordance with the present invention a method of transporting video over a network channel, comprising the steps of compressing a raw video source into a plurality of frames, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel; selecting one of the plurality of levels of each frame to transmit over the nei:work channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel; and sending the selected level of each frame over the network channel.
In one embodiment, the step of compressing comprises the step of compressing the raw video source into a plurality of frames, wherein one or more frames contain different amounts. of video content information, the plurality of frames grouped so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences. The step of compressing comprises the step of compressing the raw video source into Key, P and B type frames, the Key, P and B frames generated so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences.
There is also provided in accordance with the present invention a method of transporting video from a video server to a video client over a network channel, comprising the steps of compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of comprE~ssion; estimating the bandwidth of the network channel; determining the amount of video information waiting to be displayed at the video client; selecting one of the plurality of levels of each frame to send over the network channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of they bandwidth of the network channel; choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; and sending the chosen frames of the selected level over the network channel.
Further, there is provided in accordance with the present invention a video server for transporting video from a video source over a network channel to a video client, the video source consisting of a plurality of frames of video data, each frame of video data consisting of multiple compression levels, the video server comprising receiver means for inputting frames of video data from the video source;
sending means coupled to the receiver means, the sending means for determining which compression level within the frame to transmit in accordance with the estimated available bandwidth of the network channel, the sending means for encapsulating the frames of video data into a plurality of packets for transmission over the network channel; and a controller for managing the operation of the receiver means and the sending means whereby the rate of transmission of the sending means is maintained so as to match the available bandwidth of the network channel.
In one embodiment, the sending means comprises a rate control unit for measuring the available bandwidth of the network channel; a frame selector for inputting video frame data output by the receiver means, the frame selector outputting frames of a particular .compression level in accordance with the bandwidth measured by the rate control unit; a packet generator for inputting video frame data output by the frame selector, the packet generator for encapsulating said video frame data into a plurality of packets for transmission, the packet generator determining which frames are to be transmitted; a packet transmitter for placing onto the network channel the plurality of packets output by the packet generator;
and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
EP 064> j 14 discloses dynamic bandwidth estimation and adaptation for packet communications networks. but not the selection of a single quality level and the consequent transmission of the selected quality level.
SUMMARY OF THE INVENTION
The present invention is a system for adaptively transporting video over networks wherein the available bandwidth varies with time. The present invention has application to any type of network, including those that utilize the Internet Protocol (IP), such as the Internet or other TCP/IP networks. The system comprises a video/audio codec or coder/decoder that functions to compress, code. decode and decompress video streams that are transmitted over networks having available bandwidths that vary with time and location.
Depending on the channel bandwidth. the system adjusts the compression ratio to accommodate a plurality of bandwidths. ranging from ?0 Kbps for plain old telephone service (POTS) to several Mbps for switched LAN and ATM environments.
Bandwidth adjustability is provided by offering a trade-off between video resolution (e.G., 160 x 1?0.
~~0 x ?40, 640 Y 480), frame rate (e.G.. 30 fps, l~ fps. 7.~ fps) and individual frame quality.
This flexibility is useful fox different applications that stress different requirements.
The system functions to Generate a prioritized video data stream comprising multiple levels from a raw source of video. This video stream is stored in a file and accessed by the video server when servicing clients. In operation, the video client only receives a subset of the levels. The levels are chosen to have a suitable data content to match that of the network connection. This permits a better fit between network bandwidth consumed and video image quality. Each of the levels is built on top of the previous levels, with the higher levels providing incremental information not present in the lower levels. This ensures that bandwidth is not wasted on the client end or on the encoder/server side. The system Qenerates the video stream that is sent to the client such that a loss of any individual packet on the network will not cause sustained degraded quality at the client.
The scaleable compression performed by the system is suitable for transparent video within an Internet environment characterized by large diversity and heterogeneity. The system functions to match the image quality of the video data being transported with the wide variations in available network bandwidth. In _.~....w..~.W.~..~_...,.~.~........__. _._~,~,.-..w-,.,.~..~.m_.___.._ addition, the system can adjust the video data to match the differences in available computing power on the client computer system. The system, utilizing 'best effort' protocols such as those found on the Internet, adapts to the time varying nature of the available bandwidth.
There is therefore provided in accordance with the present invention a method of transporting video over a network channel, comprising the steps of compressing a raw video source into a plurality of frames, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel; selecting one of the plurality of levels of each frame to transmit over the nei:work channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel; and sending the selected level of each frame over the network channel.
In one embodiment, the step of compressing comprises the step of compressing the raw video source into a plurality of frames, wherein one or more frames contain different amounts. of video content information, the plurality of frames grouped so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences. The step of compressing comprises the step of compressing the raw video source into Key, P and B type frames, the Key, P and B frames generated so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences.
There is also provided in accordance with the present invention a method of transporting video from a video server to a video client over a network channel, comprising the steps of compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of comprE~ssion; estimating the bandwidth of the network channel; determining the amount of video information waiting to be displayed at the video client; selecting one of the plurality of levels of each frame to send over the network channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of they bandwidth of the network channel; choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; and sending the chosen frames of the selected level over the network channel.
Further, there is provided in accordance with the present invention a video server for transporting video from a video source over a network channel to a video client, the video source consisting of a plurality of frames of video data, each frame of video data consisting of multiple compression levels, the video server comprising receiver means for inputting frames of video data from the video source;
sending means coupled to the receiver means, the sending means for determining which compression level within the frame to transmit in accordance with the estimated available bandwidth of the network channel, the sending means for encapsulating the frames of video data into a plurality of packets for transmission over the network channel; and a controller for managing the operation of the receiver means and the sending means whereby the rate of transmission of the sending means is maintained so as to match the available bandwidth of the network channel.
In one embodiment, the sending means comprises a rate control unit for measuring the available bandwidth of the network channel; a frame selector for inputting video frame data output by the receiver means, the frame selector outputting frames of a particular .compression level in accordance with the bandwidth measured by the rate control unit; a packet generator for inputting video frame data output by the frame selector, the packet generator for encapsulating said video frame data into a plurality of packets for transmission, the packet generator determining which frames are to be transmitted; a packet transmitter for placing onto the network channel the plurality of packets output by the packet generator;
and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
The invention further provides a method of transporting a video stream over a network channel, comprising thE: steps of compressing a raw video source into a plurality of quality levels, each quality level corresponding to a particular degree of compression and having an associated group of pictures sequence; estimating the bandwidth of the network channel; selecting one of the plurality of quality levels in accordance with the bandwidth estimate, wherein the selected quality level optimizes the use of the bandwidth of thE; network channel during a first time interval;
and sending the group of pictures sequence associated with the selected quality level over the network channel.
In a preferred embodiment of the invention, the step of compressing comprises compressing the raw video source into a plurality of frames, each frame having video data corresponding to one of the plurality of quality levels.
In accordance with the present invention, there is also provided a method of transporting video from a video server to a video client over a network channel, comprising the steps of compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression; estimating the bandwidth of the network channel; determining the amount of video information waiting to be displayed at the video client; selecting one of thE: plurality of levels of each frame to send over the network channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of thE: bandwidth of the network channel; choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; sending the chosen frames containing a higher amount of video data content and of a selected level over the network channel utilizing a reliable communication protocol; and sending the chosen frames containing a lower amount video data content and of a selected level over the network channel utilizing an unreliable communication protocol.
and sending the group of pictures sequence associated with the selected quality level over the network channel.
In a preferred embodiment of the invention, the step of compressing comprises compressing the raw video source into a plurality of frames, each frame having video data corresponding to one of the plurality of quality levels.
In accordance with the present invention, there is also provided a method of transporting video from a video server to a video client over a network channel, comprising the steps of compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression; estimating the bandwidth of the network channel; determining the amount of video information waiting to be displayed at the video client; selecting one of thE: plurality of levels of each frame to send over the network channel in accordance with the bandwidth estimate whereby the level selected optimizes the use of thE: bandwidth of the network channel; choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; sending the chosen frames containing a higher amount of video data content and of a selected level over the network channel utilizing a reliable communication protocol; and sending the chosen frames containing a lower amount video data content and of a selected level over the network channel utilizing an unreliable communication protocol.
Still further, there is provided in accordance with the present invention a video server system for transporting video from a plurality of video sources over a network channel to a video client, each video source consisting of a plurality of frames of video data, each frame of video data consisting of a single compression level, the video server system comprising a plurality of video servers, each video server associated with a single video source at a particular compression level, each video server comprising receiver means for inputting frames of video data from the video source associated with that particular video server; sending means coupled to the receiver means, the sending means for determining which frames to transmit in accordance with the available bandwidth of the network channel, the sending means for encapsulating the frames of video data into a plurality of packets for transmission over the network channel; a controller for managing the operation of the receiver means and the sending means;; and a rate controller for determining which video server to utilize for transmission of video data based on the available bandwidth of thp natwnrk nhannPl In one embodiment, the sending means comprises means for interfacing the video server to the rate controller; a bandwidth measurement unit for measuring the available bandwidth of the network channel; a packet generator for inputting video frame data output by the receiver means, the packet generator for encapsulating the video frame data into a plurality of packets for transmission, the packet generator determining which frames are to be transmitted; a packet transmitter for placing onto the network channel the plurality of packets output by the packet generator;
and a receiver for receiving acknowledgments sent by the video client over the network channel in resuonse to aackets received thereby.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention is herein described, by way of example only, with reference to the accomp$nying drawings, wherein:
Fig. 1 is a high level block diagram illustrating the adaptive video s transport system of the present invention including the video compression/file generator, video server and video client;
Fig. 2 is a high level block diagram illustrating the video server portion of the present invention in more detail;
Fig. 3 is a high level block diagram illustrating the video client portion of ~o the present invention in more detail;
Fig. 4 is a block diagram illustrating an example group of pictures (GOP) comprising a key frame and a plurality of P and B frames;
Fig. 5 is a diagram illustrating the five levels of video data that make up a Key frame as stored in the file format of the present invention;
~s Fig. 6 is a diagram illustrating the five levels of video data that make up a P frame as stored in the file format of the present invention;
Fig. 7 is a diagram illustrating the five levels of video data that make up a B frame as stored in the file format of the present invention;
Fig. 8 is a diagram illustrating a sample group of pictures sequence 2o composed of Key, P and B frames making up a video stream;
Fig. 9 is a high level diagram illustrating the sender portion of the video server in more detail;
Fig. 10 is a graph illustrating the receiver bit rate versus the number of bytes online;
"s Fig. 11 is a high level flow diagram illustrating the scan phase of the bandwidth measurement portion of the present~invention;
Fig. 12 is a high level flow diagram illustrating the fixed phase of the bandwidth measurement portion of the present invention;
Fig. 13 is a high level flow diagram illustrating the method of selecting ao frames to be transmitted performed by the sender portion of the present invention;
and a receiver for receiving acknowledgments sent by the video client over the network channel in resuonse to aackets received thereby.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention is herein described, by way of example only, with reference to the accomp$nying drawings, wherein:
Fig. 1 is a high level block diagram illustrating the adaptive video s transport system of the present invention including the video compression/file generator, video server and video client;
Fig. 2 is a high level block diagram illustrating the video server portion of the present invention in more detail;
Fig. 3 is a high level block diagram illustrating the video client portion of ~o the present invention in more detail;
Fig. 4 is a block diagram illustrating an example group of pictures (GOP) comprising a key frame and a plurality of P and B frames;
Fig. 5 is a diagram illustrating the five levels of video data that make up a Key frame as stored in the file format of the present invention;
~s Fig. 6 is a diagram illustrating the five levels of video data that make up a P frame as stored in the file format of the present invention;
Fig. 7 is a diagram illustrating the five levels of video data that make up a B frame as stored in the file format of the present invention;
Fig. 8 is a diagram illustrating a sample group of pictures sequence 2o composed of Key, P and B frames making up a video stream;
Fig. 9 is a high level diagram illustrating the sender portion of the video server in more detail;
Fig. 10 is a graph illustrating the receiver bit rate versus the number of bytes online;
"s Fig. 11 is a high level flow diagram illustrating the scan phase of the bandwidth measurement portion of the present~invention;
Fig. 12 is a high level flow diagram illustrating the fixed phase of the bandwidth measurement portion of the present invention;
Fig. 13 is a high level flow diagram illustrating the method of selecting ao frames to be transmitted performed by the sender portion of the present invention;
Fig. 14 is a high level flow diagram illustrating the method of sending a packet performed by the sender portion of the present invention; and Fig. 15 is a high level block diagram illustrating an alternative embodiment of the adaptive video transport system of the present invention inctuding the video compression/file generator, multi-platform video server and video client.
DETAILED DESCRIPTION OF THE INVENTION
Notation Used Throughout The following notation is used throughout this document.
Term Definition AVI Audio Video Interleaved CPU Central Processing Unit GOP Group of Pictures GUI Graphical User Interface IP Internet Protocol ISDN integrated Services Digital Network LAN Local Area Network MPEG Motion Picture Expert Group POTS Plain Old Telephone Service RSVP Reservation Protocol TCP Transmission Control Protocol UDP User Datagram Protocol Note that throughout this document, the term video is meant to encompass both video data and audio data.
System Overview The present invention is a system for adaptively transporting video and audio over networks wherein the available bandwidth varies with time. The ~o invention has application to any type of network including those that utilize the Internet Protocol (IP) such as the Internet or any other TCP/IP based network.
A
high level block diagram illustrating the adaptive video transport system of the present invention is shown in Figure 1. The system, generally referenced 10, comprises a video compression/file generator 14, video server 18 and one or ~s more video clients 22. Only one video client is shown for clarity sake.
The video compressionlfife generator 14 in combination with the video client 22 comprise a video/audio codec or coderldecoder that functions to compress, code, decode and decompress video streams that are transmitted over the network 20 into a compressed video and audio file. The compressed file may be in any suitable format such as Audio Video Interleaved (AVI) format. Note that the network may comprise any type of network, TCP/IP or otherwise including the s Internet. The generation of the compressed video and audio file 16 can be performed either online or off-line. Typically, the video and audio file is generated off-line. Note that any suitable method of video compression can be utilized in the present invention such as described in connection with the Motion Pictures Expert Group (MPEG)-1, MPEG-2 or MPEG-4 standards.
One important aspect of the invention is that although the available bandwidth of the network may vary with time and location, the quality of the transmitted video is varied in accordance with the available bandwidth.
Depending on the channel bandwidth, the system adjusts the compression ratio to accommodate a plurality of bandwidths ranging from 20 Kbps for plain old telephone service (POTS) to several Mbps for switched LAN environments.
Bandwidth adjustability is provided by offering a trade off between video resolution (e.g., 160 x 120, 320 x 240, 640 x 480), frame rate (e.g., 30 fps, 15 fps, 7.5 fps) and individual frame quality. This flexibility is useful for different applications that stress different requirements.
2o The system functions to generate a prioritized video data stream comprising multiple levels from a raw source of video 12. This video stream is stored in a file (compressed video and audio file 16 in Figure 1) and accessed by the video server 18 when servicing clients 22. In operation, the video client only receives a subset of the levels that form the video and audio file 16. The levels z5 are chosen to have a suitable data content to match that of the network connection between server and client. This permits a better fit between network bandwidth consumed and video image quality. Each of the levels is built on top of the previous levels, with the higher levels providing incremental information not present in the tower levels. This ensures that bandwidth is not wasted on the so client end or on the encoder/server side. The system generates the video stream that is sent to the client such that a loss of any individual packet on the network will not cause sustained degraded quality at the client.
The scaleable compression performed by the system is suitable for transparent video within an Internet environment characterized by large diversity s and heterogeneity. The system functions to match the image quality of the video data being transported with the wide variations in available network bandwidth. in addition, the system can adjust the video data to match the differences in available computing power on the client computer system. The system, utilizing 'best effort' protocols such as those found on TCPIIP networks, adapts to the time ~o varying nature of the available bandwidth.
During the transport of video data, the server process functions to employ an adaptive congestion control method. The method estimates the network bandwidth or link capacity and adjusts the amount of video data to be sent over the link accordingly. The system of the present invention can be ~s adapted to exploit the 'bandwidth reservation (RSVP) protocol and quality of service features of TCP/i'~P networks that are currently evolving.
A high level block diagram illustrating the video server portion of the present invention in more detail is shown in Figure 2. The video server 18 comprises one or more receivers 30, one or more senders 32 and a controller 34.
Zo During operation, a receiver instance is created for each request for a different video object. The data input to the receiver may be provided from an AVI file data file, for example. The video data file may be located on the same computer as the video server or may be located on a remote computer. The video data file can be stored on a single computer, e.g., video server, or on multiple platforms, e.g., ?5 multiple video servers, aIS described in more detail below. In this case, the video data is transmitted over a network that connects the remote video data and the video server. Each instance of the receiver 30 functions to receive data from the video data file that was previously generated by the video compressionlfile generator module 14.
so The sender functions to accept video frame data from the receiver and encapsulate the video data into packets for transmission of the network to the client. Each client that requests a connection to be established causes an instance of the sender to be created. Requests for multiple video sources from the same client cause additional instances of the sender to be created. The sender functions to assemble packets for transmission from the video source data s input to the receiver. The packets are formed on the basis of the current choice for the level of video transmission quality. Based on bandwidth measurements, the sender determines the appropriate level of quality to transmit to the client to best match the available bandwidth. Assembled packets are sent to the network for delivery over the network connection to the video client(s).
The sender also measures the available bandwidth of the network connection between the video server and the video client. As described in more detail, the sender utilizes the bandwidth measurements to determine the appropriate video quality level to send over the connection. If too low a video quality is chosen then network bandwidth is wasted and a better picture could be 15 hand the client display. On the other hand, if too high a video level is chosen then too much data may become lost or corrupted which also causes the quality of the picture on the client display to suffer.
The controller 34 functions to manage the plurality of receivers, the plurality of senders, the assembly of packets from the video source file, delivery of Zo the packets over the network connection and measurement of the bandwidth of the network connection. The sender is described in more detail hereinbeiow.
A high level block diagram illustrating the video client portion of the present invention in more detail is shown in Figure 3. The video client 22 comprises a packet receiver 50, packet decoder 52, a display generator 54 and a 25 transmitter 51. The packet receiver functions to receive video packets as they come in from the network connection. The video stream data is removed and input to the packet decoder 52. The packet decoder functions to decode and decompress the video data stream and sends the decoded/decompressed video stream to the display generator 54. The display generator functions to prepare so the video data for actual transmission to and display on the host computer's display subsystem. In addition, the packet decoder functions to generate acknowledges in response to the reception of packets from the video server.
The acknowledges, in addition to other status information, are sent back to the video server via the transmitter 51.
Video and audio file Generation and Format s The generation of the video source file, e.g., video and audio file 16 (Figure 1 ), and its internal format will now be described in more detail. As previously described, the video source file used by the video server to generate the video stream that is sent over the network connection to the client is created by the video compression/file generator 14 (Figure 1 ). The input to the ~o compression/generator is a raw video source 12. The raw video source can be, for example, a non compressed AVI file, a non compressed Quicklime file or a compressed MPEG-1 audio/video file.
The function of the video compression/file generator is to compress the raw video source into multiple levels of varying quality. In particular, the raw video ~s source is compressed unto three types of data objects commonly referred to as frames. The three types of frames include Key frames, P frames and B frames.
These frames are similar to the I frames, P frames and B frames, respectively, as described in the MPEG-1 specification standard (officially designated as ISO/IEC
11172) and the MPEG-2 specification standard (officially designated as ISO/IEC
20 13818).
The compressed video stream that is sent to the client comprises a plurality of data units termed 'groups of pictures' or GOPs. A block diagram illustrating an example group of pictures (GOP) comprising a key frame and a plurality of P and B frames is shown in Figure 4. A group of pictures or GOP
2s comprises a sequence of frames made up of a combination of Key, P and B
frames. Each GOP has a single Key frame as the first frame which is followed one or more P and B frames.
P frames are dependent on other frames in that they contain incremental changes to video data that was delivered previously either in a Key 3o frame or another P frame. B frames are also dependent on other frames in they contain incremental changes to video data that was delivered previously either in a Key frame or a P frame. Note that B frames never contain data that modifies a previous B frame. Therefore, a B frame may be lost during transmission without having any effect on the following frames in the GOP sequence.
With reference to Figure 4, the example GOP is shown comprising a s Key frame 60, three B frames 62, 66, 70 and three P frames 64, 68, 72. Each GOP typically represents a particular unit or chunk of video information such as a scene in the video. For example, depending on the compression technique used, drastic scene changes may trigger the generation of a new GOP headed by a new Key frame. The video stream, as shown by the arrow, is made up of a ~o sequence of GOPs transmitted one after the other. Each of the three types of frames will now be described in more detail.
Key frames are constructed so as to incorporate all the video information that is essential for the decoding and display of P and B frames. Key frames typically are the largest in terms of data size of the three frames. It is possible that ~s only partial information from the key frames gets delivered to the client.
If Key frames are lost or arrive damaged, the subsequent P and B frames cannot be used as they build on the data contained in the Key frame.
The video data incorporated into P frames includes data that is predicted based on a previous Key frame or a previous P frame. The information that is Zo included within a P frame is mainly the motion estimation information which is essential for the decoding and display of the P and B frames. In the event that Key frame information is missing, i.e., a Key frame was skipped or lost, all the subsequent P frames based on that particular K frame will be ignored in order to prevent visual artifacts. The video server utilizes the fact that partial Key frame zs information is missing, based on feedback from the video client, to skip sending subsequent P frames that are based on the corrupted or lost Key frame in order to conserve bandwidth.
The video data incorporated into B frames includes motion estimation information that is based on the information that was previously sent either in a so Key frame or a P frame. Note that B frames are never based on a previously sent B frame. When certain Key frame or P frame data is missing, i.e., a Key or P
frame was skipped or lost, all the B frame data subsequent to the lost frame is skipped by the video server in order to conserve bandwidth.
The raw video source is compressed into multiple types of frames comprised of video data having varying degrees of quality since the network s cannot guarantee any particular bandwidth or an error free network connection.
Thus, these multiple frame types can be assigned varying degrees of importance or priority. The most important of all the frame types are the Key frames which are assigned the highest priority. Being the most important, key frames are sent using a reliable mechanism. Such a reliable mechanism includes using a network ~o protocol such as TCP or reliable UDP. Reliable UDP refers to utilizing UDP, a basically unreliable protocol, in combination with a reliable mechanism that sits at a higher layer in the communication stack such as the Application Layer. The upper communication levels ensure that packets are delivered to the client.
The second most important frame type are the P frames which are ~s transmitted using a semi reliable protocol such as reliable UDP as described above. If P frames are lost or corrupted en route to the video client, the video server may or may not resend them. For example, if too much time has passed, replacement packets would arrive at the client too late for display.
The least important frame type are the B frames which are sent using an Zo unreliable protocol such as UDP. The B frame data may or may reach the video client due to the condition of the network connection between the server and the client. Upon arrival at the client of B frame data, the client determines whether it is useful and should be displayed. If the client determines that the B frame is not usable, an interpolation mechanism is used to improve the video quality.
25 As described previously, the video stream stored in the video and audio source file (compressed video and audio file 1B in Figure 1), is made up of three type of frames, i.e., Key frames, P frames and B frames, that are grouped into sequences of GOPs. In addition, each frame type is further broken down into multiple levels of detail.' In the example protocol and file format disclosed herein, ao each frame type is further broken down info five different video data levels, numbered 1 through 5. Level 1 contains the least amount of data which ."..,..,..~... "."."rFb~~~..~......~w.m..w~u..w....
........u....._...""..,.._.._.~....~,..m."",.",~.,n,..w,.....,....W....".,~....
.~,µ,....W.m.y...... . .~....... ...
represents the lowest video quality and level 5 contains the most amount of data representing the highest quality of video.
Every frame (Key, P and B frames) output by the video compression/file generator is composed of data from all five levels. Thus, the video source file s contains data representing a broad variation in output video quality. The video compression/file generator functions to assemble GOPs each having a particular combination of Key, P and B frames.~Thus, some GOPs may have fewer or more P and B frames. Each frame, however, contains video data for each of the five quality resolution levels. However, for each GOP, the video client only receives ~o data corresponding to a single level. The video server determines for each GOP
the appropriate level of data to send to the client. Once a video quality level is chosen by the video server, it is used for the entire GOP. Adjacent GOPs can be comprised of different level data. However, data of different levels cannot be sent within a GOP.
15 A diagram illustrating the five levels of video data that make up a Key frame as stored in the file format of the present invention is shown in Figure 5. A
sample Key frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size. The data size for the levels is 0.5 KB, 1 KB, 3 KB, 7 KB, 15 KB which 2o correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample Key frame for all five levels is 26.5 KB. The data sizes in Figure 5 and the subsequent Figures represent an example file and are for illustration purposes only. However, the relative sizes of the data for each of the levels does increase when going from level 1 towards level 5. This is to be expected since level 5 2s contains the highest quality video data.
A diagram illustrating the five levels of video data that make up a P
frame as stored in the file format of the present invention is shown in Figure 6. A
sample P frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size.
The $o data size for the levels is 0.1 KB, 0.2 KB, 0.5 KB, 1 KB, 2.2 KB which correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample P frame for all five levels is 4 KB:
A diagram illustrating the five levels of video data that make up a B
frame as stored in the file format of the present invention is shown in Figure 7. A
s sample B frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size.
The data size for the levels i$ 0.15 KB, 0.35 KB, 0.5 KB, 1 KB, 3 KB which correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample B frame for all five levels is 5.0 KB.
~o A diagram illustrating a sample group of pictures (GOP) sequence composed of Key, P and B frames making up a video stream is shown in Figure 8. In this example, the video server has determined that level 2 data should be sent for this GOP. Thus, the Key frame 80, B frames 82, 86, 90 and P frames 84, 88, 92 are shown depicting level 2 data and associated data size. The total data ~s size of the GOP is 2.485 KB.
Video Server Process The video server portion of the video transport system of the present invention will now be described in more detail. The function of the video server is to accept a remote client connection request, retrieve a local or remote stored file 2o and transmit it to the client. Before and during the transmission of the video information, the server appropriately adjusts the rate of data flow from the server to the client. The rate is adjusted beforehand based on initial estimation of the bandwidth of the data channel. In addition, the data rate is adjusted during transmission using a bandwidth measurement method that uses statistical is evaluation of the connection between the server and the client. The dynamic adjustment of the data rate by the server functions to allow the client to receive video having a quality that matches the bandwidth capacity of the connection.
Further, during the server/client connection, the client can control the transmission of the data by the server, thus performing a video on demand function.
The acknowledge packet sent by the client comprises an identification of the last received packet, its arrival time and a list of any packets missed since the transmission of the previous acknowledge.
A high level diagram illustrating the sender portion of the video server in s more detail is shown in Figure 9. The sender 32 comprises a frame selector 100, packet generator 102, packet transmitter 104, rate control unit 106 and receiver 108. In operation, the frame selector functions to accept the full frame video data containing all five levels of data from the receiver and select out of the five levels of data, the level of data appropriate for the connection with a particular client.
~o The choice of what compression level to send is made on a client by client basis.
The frame selector used bandwidth information provided by the rate control unit 106 to determine which of the five levels of data to pass to the packet generator.
It is important to note that the raw video source data may me compressed into more or less than five levels. A higher number of levels permits a finer tuning of 15 the available bandwidth to the amount of data sent over the connection.
In combination with the estimated bandwidth measurement, the frame selector utilizes a level bandwidth table in determining which level data to select.
A different level bandwidth table is associated with each video source file.
The level bandwidth table contains an entry for each of the five possible compression zo levels. Each entry contains the average bandwidth necessary to transmit the data at that level. The frame selector chooses a level having the most information content that the network connection can support using the bandwidth measurements performed by the rate control unit. For example, the level bandwidth table for a sample video source file may be as follows.
Level Bandwidth Required (Kbps) If, for example, the rate control unit measures the bandwidth of the network connection to be 25 Kbps, the frame selector would pass only level 2 data to the packet generator. Thus, the output of the frame selector would comprise a sequence of video frames wherein each video frame contains data s from only one of the video compression levels (level 2 data in this example).
it is important to note for the very first video frame or packet that is to sent to the client, no bandwidth measurement is available. This is because, the bandwidth measurement method, as described in more detail below, utilizes transmitted packets to dletermine the bandwidth of the channel. Thus, before the ~o first packet is sent, a different mechanisms is used to initially determine the bandwidth of the channel. In its request to open a video source, the video client transmits to the server tire bandwidth of the connection the last time the client was connected to a server. This mechanism is based on the assumption that the previous connection a client had with a server is similar to the present connection.
In the case where a computer is attached to TCP/IP networks via two ways, e.g., dial up modem and high speed LAN, this mechanism does not provide an accurate initial bandwidth estimate.
The packet generator 102 functions to receive the frames having video data from a particular dompression level and encapsulate them into packets for Zo transmission over the network. The assembled packets are output to the packet transmitter 104 which is responsible for delivery of the packets over the network.
In addition, to preparing packets from the frames received, the packet generator functions to determine uuhich (if any) frames to skip. Depending on the measured bandwidth of the channel, the packet generator may skip frames in order to is reduce the transmitted bit rate. This occurs when the bandwidth of the network connection cannot support transmission of every Key, P and B frame. The method of choosing which frames to select is described in more detail hereinbelow.
The packet generator does not send packets to the packet transmitter ao 104 until requested to do so by the packet transmitter. The delivery of the packets onto the network is controlled by the rate control unit 106. The rate control unit keeps track of the amount of video information in terms of time that is queued for display at the client. In addition, the video frames from the video source are time stamped for synchronization purposes. The rate control unit uses acknowledges received by the client via the acknowledgment receiver 108 to determine the next s packet transmission time. Once the packet transmitter is notified to send the next packet of data, it requests a packet from the packet generator.
Notification of acknowledges or ACKs received by the receiver 108 are also input to the packet transmitter in order to assure proper receipt by the client.
In addition, the packet transmitter maintains a buffer of packets transmitted to the ~o client. In the event the video server determines to resend a packet, the packet transmitter retrieves the packet from the buffer. Once receipt of a packet is acknowledged by the client, the packet is deleted from the buffer and the buffer space is freed up.
Network Bandwidth Measurement Process 15 The bandwidth measurement method as executed by the rate control unit 106 in the sender will now be described in more detail. The bandwidth measurement method actually comprises two separate phases. The first phase being a scanned phase and the second being a fixed phase. In general, the bandwidth measurement method operates by transmitting packets through the 2o network connection and measuring the rate of reception of the packets at the client. A graph illustrating the receiver bit rate versus the number of bytes online is shown in Figure 10. The number of bytes transmitted into the network pipe is increased slowly until a point is reached where bytes are not received any quicker at the client. The term bytes on line means the number of bytes or packets that Zs have been transmitted by the server or the sender but not yet received by the client. During this scan phase portion of the bandwidth measurement method, the 'immediate' flag is set 'on' for each packet sent by the sender. This causes the client to send an acknowledge packet for every packet received. Thus, the sender should receive an acknowledge packet for every packet transmitted to the ao client. As shown in Figure 10 as the number of packets or bytes online increases, a point is reached where the client does not receive packets any faster. The corresponding receive rate at this point can be modeled as an estimate of the bandwidth of the network channel.
The scan phase portion of the bandwidth measurement method will now be described in more detiail. A high level flow diagram illustrating the scan phase s of the bandwidth measurement method of the present invention is shown in Figure 11. As stated previously, the immediate flag is set 'on' for all packets transmitted by the sender during the scan phase of the bandwidth measurement method. This forces the client to immediately send an acknowledge packet for every packet received over the channel. In addition, an acknowledge packet is ~o also sent if the last received packet has a sequence number greater than the sequence number of the last received packet. In this case, a packet loss event has occurred. Also, an acknowledge packet is sent if the previous acknowledge was sent more than an predefined time out period ago. For example, if the time out period is 3 seconds, an acknowledge is sent if the last packet was received more than 3 second ago.
The acknowledge packet sent by the client contains an identification of the last received packet, it's arrival time and a list of any packets missed since the transmission of the previous acknowledge. Initially, the recommended bytes online (RecommendedBytesOnline) is set equal to the size of the packet zo (PacketSize) (step 110). In the next step, a single packet is sent by the sender to the client (step 112). The current number of bytes online (BytesOnline) is then calculated (step 114). The number of BytesOnline can be calculated since the sender has knowledge of each packet that is placed into the network pipe in addition to having knowledge of each acknowledgment received from the client.
Z5 Thus at any one time the sender is aware of outstanding packets still in the network pipe. Next, the number of bytes online_ is compared to the recommended bytes online ( step 116).' The number of bytes online can be calculated using the sequence number of the last packet that was sent, as known by the sender, subtracted from the seqjuence number of the last packet acknowledged. Both 3o these entities are known by the sender and thus the number of bytes online can be calculated. If the number of bytes online are less than the recommended bytes online then control returns to step 112 and an additional packet is placed into the network pipe. In this manner the number of bytes online is made equal to the recommended bytes online.
After the packet is sent, a time out is then set to a particular value, for s example, 1000 (step 118). The sender than waits for ether an acknowledgment or a time out to occur (step 120). If a time out occurs then control is returned to step 112 since the packet is assumed lost and another packet is then sent (step 122). If an acknowledgment was received, the number of acknowledged bytes online (AckBytesOnline) is then calculated (step 124). The acknowledged bytes ~o online is equal to the recommended bytes online for the last acknowledged packet. Each packet that is sent by the sender has associated with it a number indicating the recommended bytes online at the time that particular packet was sent. This number is stored in a log at the sender and associated with the particular packet that is transmitted. When a packet is acknowledged the ~s recommended bytes online for that particular acknowledge packet is recalled. If the value of the acknowledged bytes online is less than the recommended bytes online than control returns to step 112 and another packet is placed into the network pipe (step 126). If the number of acknowledged bytes online is equal to the number of bytes online than the receiving bandwidth is then calculated (step 20 128).
The effect of these steps is to keep the number of packets or bytes in the network pipe constant and in a steady state. The receiving bandwidth is calculated from the sending speed since an acknowledge is received for every packet that is placed into the pipe. This assumes that an acknowledge packet is 2s sent immediately upon the client receiving a packet from the sender. If the receiving bandwidth of the pipe has not been _exceeded then the sending rate at the sender should be equal to the receiving rate at the client. Thus, as long as the maximum bandwidth of the channel is not exceeded, the sending rate can be modeled as the receiving rate and correspondingly the receiving bandwidth can so be computed.
It is then deterlmined whether the receiving bandwidth has leveled off (step 130). With reference to Figure 10, in this step, it is checked whether the number of bytes online his begun to level off as shown in the right most portion of the curve in the Figure. The leveling off of the receive bandwidth is detected by s comparing the current receiving bandwidth to the average of the last five values of the receiving bandwidth.' If the latest value of the receiving bandwidth is within 5%
of the average then the receiving bandwidth is considered to have leveled off.
Consequently, the banduvidth of the network connection is estimated to be the value of the last received bandwidth. If the receiving bandwidth has not leveled ~o off, i.e., within 5% of the average of the previous five measurements, then the recommended bytes online (RecommendedBytesOnline) is incremented by the packet size (step 132). Control then returns to step 112 and an additional packet is placed into the network pipe.
If the receiving bandwidth is found not to have leveled off it means the ~s number of bytes online corresponds to the linear portion of the curve in Figure 10.
Thus, the maximum bandwidth of the network pipe has not been reached and additional packets can be pumped into the network channel. If the receiving bandwidth has been found to have leveled off the recommended bandwidth (RecommendedBVl~ is bet equal to the current value of the receiving bandwidth 20 (ReceivingBVl~ (step 13#). The recommended bandwidth value is utilized by the rate control unit as an initial estimate of the bandwidth of the network connection.
The scan phase portion of the bandwidth measurement method is used initially as a relatively crude estimate of the bandwidth of the network channel.
During steady state operation of the sender portion of the video server a fixed zs phase bandwidth measurement method is utilized to better fine tune and track changes in the bandwidth of the network channel. A high level flow diagram illustrating the fixed phase method of the bandwidth measurement portion of the present invention is shown in Figure 12. During the fixed phase of the bandwidth measurement method tf~e immediate flag is set to 'off in each packet sent by the so sender. The first step is to set a variable representing the time to send (TimeToSend) equal to the current time, i.e., now (step 140). Next, it is checked whether the value of time to send is greater than or equal to the current time (step 142). If the time to send is greater than or equal to the current time, a packet is sent into the network channel (step 150). Information about the packet is then stored in a database (step 152). The information stored in the data base includes s the PacketlD, PacketSize and the value of the TimeToSend. A new value for the TimeToSend, which represents the time for transmission of the next packet, is then calculated based on the current value of the TimeToSend, the RecommendedBW and the PacketSize (step 160). Control then returns to step 142 where it is checked whether it is time to send the next packet.
If the value of the time to send has not been reached, it is then checked whether an acknowledgment has been received (step 144). If an acknowledgment has not been received, control loops back to step 142 and the time to send is checked again. If an acknowledgment has been received, the information contained in the acknowledgment packet is stored in the database ~s {step 146). The information stored in the database includes an acknowledgment packet ID (AckPacketlD), the time to receive (TimeToReceive) and the time to acknowledgment (TimeToAck). The value of the acknowledgment packet ID is the value of the ID or sequence number of the acknowledgment packet itself.
The time to receive is the time stamp generated by the client which represents the 2o time of arrival of the packet transmitted by the sender that the acknowledgment packet corresponds to. The time to acknowledgment is a time stamp generated by the sender representing the time the acknowledgment packet was received by the video server.
In the next step, various entities are then calculated (step 148). The 25 number of bytes sent (BytesSent) by the sender is calculated using the latest response (LastResp) and the previous response (PreviousResp). The data for the previous response and the last response are generated from the respective acknowledgment packets received by the sender. Similarly, the number of bytes received by the client (BytesRec) is calculated using the information contained in 3o the acknowledgment packet for the previous response and the last response.
The send rate (SendRate) is then computed by dividing the number of bytes sent by the difference between the time to send (TimeToSend) for the previous response subtracted from the time to send for the last or current response, as shown below.
BytesSent SendRate =
TinleToSend(PreviousResp) - TimeToSend(LastResp) s Similarly, the rdceive rate (RecRate) is calculated by dividing the number of bytes received by the time to receive (TimeToRec) for the previous response subtracted from the time to receive for the last response, as shown below.
BytesRec RecRate =
Tim~ToRec(PreviousResp) - TimeToRec(LastResp) The send rate is then compared to the received rate (step 154). If the ~o sending rate is less then or equal to the receiving rate this means the network connection is being underutilized and a portion of the bandwidth remains unused.
In this case, the recommended bandwidth is increased by a particular amount, for example 10% (step 158). If the sending rate is greater than the receiving rate this means too much data is being pumped into the network pipe and the sending rate ~s needs to be reduced. Thus, the recommended bandwidth is set equal to the receive rate (step 156).
Whether the bandwidth is increased or decreased, the next step is to determine the new tinne to send based on the current time to send, the recommended bandwidth and the PacketSize (step 160). Control then returns to 2o step 142 where it is checked whether the time has arrived to send another packet.
Using this method, the sender constantly tries to utilize the available bandwidth as effcientfy~ as possible by keeping the network pipe full. In other words, the sender attermpts to maintain the number of bytes online to correspond with the bandwidth of the network connection. If the sender senses the bandwidth is of the network connect~on being underutilized it increases the number of bytes online accordingly. Conversely, if the sender determines that the bandwidth of the network connection is being exceeded it appropriately lowers the sending rate accordingly.
_.... ..~..,a~",~.~.~."~,.M ~,....~.....~....~..~.-_... ..
....~...~~..~..~.w~.__.~.~ ~...~_ _. _.._._.
As discussed previously, the packet generator 102 (Figure 9) receives the video frames for a particular level from the frame selector 100. The function of the packet generator is to encapsulate the video frame data into packets and transmit them to the packet transmitter 104. In addition, the packet generator s determines which of the frames it receives to encapsulate into packets and send to the packet transmitter. The packet generator determines which frames to encapsulate based on the recommended bandwidth determined by the rate control unit 106.
A high level flow diagram illustrating the method of selecting frames to ~o be transmitted as performed by the sender portion of the present invention is shown in Figure 13. initially, the value Q is set to a particular value which represents an optimum size of the queue within the video client. The size of the queue is measured in time, i.e. seconds, and represents the amount of video information currently queued in the video client ready to be displayed. The packet ~s generator uses the current level of this queue to determine which of the Key, P
and B frames to send to the packet transmitter.
First, it is checked to see whether the current level of the client queue is less than half Of QppT which represents an optimum size for the client queue (step 190). If the size of the client queue is less than half of this value than only a Key 2o frame is sent (step 194). In this case only Key frames are sent due to time considerations. The level of the client queue is considered to be too short to send Key, P and B frames.
If the level of the client queue is found to be between half the optimum queue Qom. and a full optimum queue {step 192), both Key and P frames are sent ~s (step 196). In this case, the client queue is considered to contain sufficient video information in terms of time to permit the transmission of Key and P frames.
Lastly, if the size of the client queue is equal to or above the level of the optimum queue, Key, P and B-frames are sent to the client (step 198). In this case, the client queue of considered to contain enough seconds of video to permit enough so time to send Key, P and B frames.
As described' previously, the packet generator sends packets for transmission to the packet transmitter. For each packet received by the packet transmitter an appropriate method of communications is selected. Key-frames, for example, should be sent using a very reliable communication method since they s are used as the basis fc~r both P and B frames. On the other hand, B frames may be sent using an unreliable communication method sine they are less important.
A high level flow diagram illustrating the method of sending a packet performed by the paclaet transmitter portion of the present invention is shown Figure 14. The first step is to apply a time stamp to the packet received from the io packet generator (step 170). If the packet contains Key frame data (step 172) then the packet is sent using a best effort communication protocol. The best effort protocol can be an implementation of a reliable UDP which includes the video server retransmitting the Key frame as long as there is enough time for the client to receiver and display it on time. If the packet contains P frame information (step 15 176) then the packet is sent via a semi reliable communication protocol (step 178). In this case, the server makes a decision based on the available bandwidth whether to resend the P frame information packet to the video client. Lastly, if the packet contains B franhe information it is sent via a non reliable communication protocol such as UDP Qstep 180). In this case, the video server does not have an Zo option to retransmit the'', packet if not received by the video client.
Video Client I~rocess The video cliient portion of the video transport system of the present invention will now be described in more detail. The video client is a graphical user interface (GUI) based' process or application that functions to decode a video 25 stream transmitted by'the server. in general, the client functions as an off line video player, capable c~f playing back local file streams, as well as an online video player utilizing a direct connection to the server. Thus, the video client supports both store and forwaa~d as well as real time implementations of video over a network. The client can preferably supply a VCR like GUI display, i.e., play, stop, so fast forward, pause, etc. buttons.
During a real time transmission of video data, the client reports back status and bandwidth related information to the video server via a reverse channel. Based on the number of transmission errors as well as the number of data packets lost, as communicated via the status and bandwidth information sent s back to the server, the server make an online determination regarding the quantity of data to send to the client.
As described previously, this online decision forms the core of the adaptive video transport system. The video server makes a determination as to the bandwidth of the connection and the quality of the connection, i.e., rate of ~o packet loss, based on the amount of information received by the video client.
Knowledge of the amount of data that each client receives is essential to the server in order to determine the amount and type of data to transmit to each particular video client.
Multi-Platform Video Server 15 In an alternative embodiment, the video server 18 of Figure 1 can be constructed using multiple platforms rather than a single platform. In this embodiment, the video server functionality is spread over multiple computer platforms. Each individual platform within the multi plattorm video server functions to transmit a single video compression level. A high level black diagram 2o illustrating an alternative embodiment of the adaptive video transport system of the present invention including the video compressionlfiie generator, multi-platform video server and video client is shown in Figure 1 b.
The adaptive video transport system, generally referenced 200, comprises a video compressionlfife generator 212, a plurality of video servers #1 25 through #N 216 and one or more video clients 220. Only one video client is shown in Figure 15 for clarity sake. The video compression/file generator 212 in combination with the video client 220 comprise a video codec or coderldecoder that functions to compress, code, decode and decompress video/audio streams that are transmitted over the network 218 into a plurality of compressed 3o video/audio files. Each compressed video/audio file is compressed using a different compression le~rel. Each individual video server piaiform is responsible for transmitting one of video compression levels.
The video comipression/file generator 212 functions similarly to that of the video compressionlfile generator 14 of Figure 1 with the exception that the s video compression/file generator of Figure 15 generates a separate compressed video/audio file for each compression level. For N compression levels, the video compression~le generatbr 212 functions to generate a compressed video/audio file 214 for levels 1 thrdugh N. Considering the system described previously, compressed video/audia files 214 are generated for Levels 1 through Level 5.
~o The compressed video/~udio files may be in any suitable format such as AVI
format. The generation of the compressed video/audio files 214 can be performed either on-line or off-line. Typically the video/audio file is generated off-line. Note that any suitable method of video compression can be utilized to process the raw video delta 210 such as described in connection with the MPEG
~s 1, MPEG-2 or MPEG-4 standards.
In order to serve N bandwidth levels, where each bandwidth level represents a different qu~alitylresolution band, N video servers and N
compressed video/audio files are reqwired. One compressed video/audio file and video server are associated with each bandwidth level, i.e., compression level. Thus, the Zo complete video server system comprises N separate video server platforms each handling one compression level. An additional platform 222 functions as a rate controller (bandwidth cotrtroller) which performs the scan phase and fixed phase bandwidth measuremeht methods, frame selection method and packet transmission method as described previously in connection with Figures 11 2s through 14. The rate controller 222 functions as a bandwidth controller executing the bandwidth measurement methods described earlier and is operative to select which of the video servers #1 through #N to transmit to the video client 220.
For each client, data from only one video server is sent at any one time. The same video server is used to 'send data for an entire GOP. However, different video so servers can be utilized to send video/audio data for other GOPs since the compression level for a GOP is independent of the compression levels used for other GOPs.
Each of the N video servers 216 can comprise the video server 18 {Figure 2) described previously or may comprise a standard off the shelf video s server such as the MPEG-2 based Media Server from Oracle Inc. or the NetShow Server from Microsoft Corporation, Redmond, Washington. The standard video server must be suitably modified to provide a communication capability with the rate controller 222 before it will operate in the present invention. The modifications typically include providing a communication interface between the ~o standard video server and the rate controller.
The video client 220 functions similarly and is constructed in similar fashion to that of the video client shown in Figure 3. The video client functions to decode and decompress the videolaudio data stream and sends the decodedldecompressed video/audio stream to a display connected thereto. in addition, the video client 220 is adapted to issue the video file requests to the rate controller 222 rather than to any of the video servers 1 through N. Throughout the video transmission session, the video client 220 functions to return acknowledgments and statistics to the rate controller 222. The rate controller uses the acknowledgments and statistics returned by the video client 220 in order 2o to calculate the optimum compression (resolution) level to use.
An advantage of the adaptive video transport system of Figure 15 is that performance is enhanced. The performance enhancement is achieved in part by the use of standard video servers which are optimized for performance.
Assuming each of the N video servers can generate 250 concurrent 512 Kbps 2s video/audio streams, the complete video server system is capable of generating up to 250 X N concurrent 512 Kbps non-scaleable streams and an even higher number of concurrent lower speed 28.8, 56, 128 or 256 Kbps streams. Note that whenever the initial bandwidth is known, for example within an Intranet, the video client will play back video directly from the most suitable server. When the initial so bandwidth is unknown beforehand, the rate controller 222 functions to determine the optimum bandwidth for the particular network connection. Thus, the alternative embodiment shown in Figure 15 can be utilized to implement the multi-compression layer and adaptive bandwidth measurement scheme of the present invention by piggy backing on existing standard video server technology and enhancing it to offer scaleable video transmission.
s While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.
DETAILED DESCRIPTION OF THE INVENTION
Notation Used Throughout The following notation is used throughout this document.
Term Definition AVI Audio Video Interleaved CPU Central Processing Unit GOP Group of Pictures GUI Graphical User Interface IP Internet Protocol ISDN integrated Services Digital Network LAN Local Area Network MPEG Motion Picture Expert Group POTS Plain Old Telephone Service RSVP Reservation Protocol TCP Transmission Control Protocol UDP User Datagram Protocol Note that throughout this document, the term video is meant to encompass both video data and audio data.
System Overview The present invention is a system for adaptively transporting video and audio over networks wherein the available bandwidth varies with time. The ~o invention has application to any type of network including those that utilize the Internet Protocol (IP) such as the Internet or any other TCP/IP based network.
A
high level block diagram illustrating the adaptive video transport system of the present invention is shown in Figure 1. The system, generally referenced 10, comprises a video compression/file generator 14, video server 18 and one or ~s more video clients 22. Only one video client is shown for clarity sake.
The video compressionlfife generator 14 in combination with the video client 22 comprise a video/audio codec or coderldecoder that functions to compress, code, decode and decompress video streams that are transmitted over the network 20 into a compressed video and audio file. The compressed file may be in any suitable format such as Audio Video Interleaved (AVI) format. Note that the network may comprise any type of network, TCP/IP or otherwise including the s Internet. The generation of the compressed video and audio file 16 can be performed either online or off-line. Typically, the video and audio file is generated off-line. Note that any suitable method of video compression can be utilized in the present invention such as described in connection with the Motion Pictures Expert Group (MPEG)-1, MPEG-2 or MPEG-4 standards.
One important aspect of the invention is that although the available bandwidth of the network may vary with time and location, the quality of the transmitted video is varied in accordance with the available bandwidth.
Depending on the channel bandwidth, the system adjusts the compression ratio to accommodate a plurality of bandwidths ranging from 20 Kbps for plain old telephone service (POTS) to several Mbps for switched LAN environments.
Bandwidth adjustability is provided by offering a trade off between video resolution (e.g., 160 x 120, 320 x 240, 640 x 480), frame rate (e.g., 30 fps, 15 fps, 7.5 fps) and individual frame quality. This flexibility is useful for different applications that stress different requirements.
2o The system functions to generate a prioritized video data stream comprising multiple levels from a raw source of video 12. This video stream is stored in a file (compressed video and audio file 16 in Figure 1) and accessed by the video server 18 when servicing clients 22. In operation, the video client only receives a subset of the levels that form the video and audio file 16. The levels z5 are chosen to have a suitable data content to match that of the network connection between server and client. This permits a better fit between network bandwidth consumed and video image quality. Each of the levels is built on top of the previous levels, with the higher levels providing incremental information not present in the tower levels. This ensures that bandwidth is not wasted on the so client end or on the encoder/server side. The system generates the video stream that is sent to the client such that a loss of any individual packet on the network will not cause sustained degraded quality at the client.
The scaleable compression performed by the system is suitable for transparent video within an Internet environment characterized by large diversity s and heterogeneity. The system functions to match the image quality of the video data being transported with the wide variations in available network bandwidth. in addition, the system can adjust the video data to match the differences in available computing power on the client computer system. The system, utilizing 'best effort' protocols such as those found on TCPIIP networks, adapts to the time ~o varying nature of the available bandwidth.
During the transport of video data, the server process functions to employ an adaptive congestion control method. The method estimates the network bandwidth or link capacity and adjusts the amount of video data to be sent over the link accordingly. The system of the present invention can be ~s adapted to exploit the 'bandwidth reservation (RSVP) protocol and quality of service features of TCP/i'~P networks that are currently evolving.
A high level block diagram illustrating the video server portion of the present invention in more detail is shown in Figure 2. The video server 18 comprises one or more receivers 30, one or more senders 32 and a controller 34.
Zo During operation, a receiver instance is created for each request for a different video object. The data input to the receiver may be provided from an AVI file data file, for example. The video data file may be located on the same computer as the video server or may be located on a remote computer. The video data file can be stored on a single computer, e.g., video server, or on multiple platforms, e.g., ?5 multiple video servers, aIS described in more detail below. In this case, the video data is transmitted over a network that connects the remote video data and the video server. Each instance of the receiver 30 functions to receive data from the video data file that was previously generated by the video compressionlfile generator module 14.
so The sender functions to accept video frame data from the receiver and encapsulate the video data into packets for transmission of the network to the client. Each client that requests a connection to be established causes an instance of the sender to be created. Requests for multiple video sources from the same client cause additional instances of the sender to be created. The sender functions to assemble packets for transmission from the video source data s input to the receiver. The packets are formed on the basis of the current choice for the level of video transmission quality. Based on bandwidth measurements, the sender determines the appropriate level of quality to transmit to the client to best match the available bandwidth. Assembled packets are sent to the network for delivery over the network connection to the video client(s).
The sender also measures the available bandwidth of the network connection between the video server and the video client. As described in more detail, the sender utilizes the bandwidth measurements to determine the appropriate video quality level to send over the connection. If too low a video quality is chosen then network bandwidth is wasted and a better picture could be 15 hand the client display. On the other hand, if too high a video level is chosen then too much data may become lost or corrupted which also causes the quality of the picture on the client display to suffer.
The controller 34 functions to manage the plurality of receivers, the plurality of senders, the assembly of packets from the video source file, delivery of Zo the packets over the network connection and measurement of the bandwidth of the network connection. The sender is described in more detail hereinbeiow.
A high level block diagram illustrating the video client portion of the present invention in more detail is shown in Figure 3. The video client 22 comprises a packet receiver 50, packet decoder 52, a display generator 54 and a 25 transmitter 51. The packet receiver functions to receive video packets as they come in from the network connection. The video stream data is removed and input to the packet decoder 52. The packet decoder functions to decode and decompress the video data stream and sends the decoded/decompressed video stream to the display generator 54. The display generator functions to prepare so the video data for actual transmission to and display on the host computer's display subsystem. In addition, the packet decoder functions to generate acknowledges in response to the reception of packets from the video server.
The acknowledges, in addition to other status information, are sent back to the video server via the transmitter 51.
Video and audio file Generation and Format s The generation of the video source file, e.g., video and audio file 16 (Figure 1 ), and its internal format will now be described in more detail. As previously described, the video source file used by the video server to generate the video stream that is sent over the network connection to the client is created by the video compression/file generator 14 (Figure 1 ). The input to the ~o compression/generator is a raw video source 12. The raw video source can be, for example, a non compressed AVI file, a non compressed Quicklime file or a compressed MPEG-1 audio/video file.
The function of the video compression/file generator is to compress the raw video source into multiple levels of varying quality. In particular, the raw video ~s source is compressed unto three types of data objects commonly referred to as frames. The three types of frames include Key frames, P frames and B frames.
These frames are similar to the I frames, P frames and B frames, respectively, as described in the MPEG-1 specification standard (officially designated as ISO/IEC
11172) and the MPEG-2 specification standard (officially designated as ISO/IEC
20 13818).
The compressed video stream that is sent to the client comprises a plurality of data units termed 'groups of pictures' or GOPs. A block diagram illustrating an example group of pictures (GOP) comprising a key frame and a plurality of P and B frames is shown in Figure 4. A group of pictures or GOP
2s comprises a sequence of frames made up of a combination of Key, P and B
frames. Each GOP has a single Key frame as the first frame which is followed one or more P and B frames.
P frames are dependent on other frames in that they contain incremental changes to video data that was delivered previously either in a Key 3o frame or another P frame. B frames are also dependent on other frames in they contain incremental changes to video data that was delivered previously either in a Key frame or a P frame. Note that B frames never contain data that modifies a previous B frame. Therefore, a B frame may be lost during transmission without having any effect on the following frames in the GOP sequence.
With reference to Figure 4, the example GOP is shown comprising a s Key frame 60, three B frames 62, 66, 70 and three P frames 64, 68, 72. Each GOP typically represents a particular unit or chunk of video information such as a scene in the video. For example, depending on the compression technique used, drastic scene changes may trigger the generation of a new GOP headed by a new Key frame. The video stream, as shown by the arrow, is made up of a ~o sequence of GOPs transmitted one after the other. Each of the three types of frames will now be described in more detail.
Key frames are constructed so as to incorporate all the video information that is essential for the decoding and display of P and B frames. Key frames typically are the largest in terms of data size of the three frames. It is possible that ~s only partial information from the key frames gets delivered to the client.
If Key frames are lost or arrive damaged, the subsequent P and B frames cannot be used as they build on the data contained in the Key frame.
The video data incorporated into P frames includes data that is predicted based on a previous Key frame or a previous P frame. The information that is Zo included within a P frame is mainly the motion estimation information which is essential for the decoding and display of the P and B frames. In the event that Key frame information is missing, i.e., a Key frame was skipped or lost, all the subsequent P frames based on that particular K frame will be ignored in order to prevent visual artifacts. The video server utilizes the fact that partial Key frame zs information is missing, based on feedback from the video client, to skip sending subsequent P frames that are based on the corrupted or lost Key frame in order to conserve bandwidth.
The video data incorporated into B frames includes motion estimation information that is based on the information that was previously sent either in a so Key frame or a P frame. Note that B frames are never based on a previously sent B frame. When certain Key frame or P frame data is missing, i.e., a Key or P
frame was skipped or lost, all the B frame data subsequent to the lost frame is skipped by the video server in order to conserve bandwidth.
The raw video source is compressed into multiple types of frames comprised of video data having varying degrees of quality since the network s cannot guarantee any particular bandwidth or an error free network connection.
Thus, these multiple frame types can be assigned varying degrees of importance or priority. The most important of all the frame types are the Key frames which are assigned the highest priority. Being the most important, key frames are sent using a reliable mechanism. Such a reliable mechanism includes using a network ~o protocol such as TCP or reliable UDP. Reliable UDP refers to utilizing UDP, a basically unreliable protocol, in combination with a reliable mechanism that sits at a higher layer in the communication stack such as the Application Layer. The upper communication levels ensure that packets are delivered to the client.
The second most important frame type are the P frames which are ~s transmitted using a semi reliable protocol such as reliable UDP as described above. If P frames are lost or corrupted en route to the video client, the video server may or may not resend them. For example, if too much time has passed, replacement packets would arrive at the client too late for display.
The least important frame type are the B frames which are sent using an Zo unreliable protocol such as UDP. The B frame data may or may reach the video client due to the condition of the network connection between the server and the client. Upon arrival at the client of B frame data, the client determines whether it is useful and should be displayed. If the client determines that the B frame is not usable, an interpolation mechanism is used to improve the video quality.
25 As described previously, the video stream stored in the video and audio source file (compressed video and audio file 1B in Figure 1), is made up of three type of frames, i.e., Key frames, P frames and B frames, that are grouped into sequences of GOPs. In addition, each frame type is further broken down into multiple levels of detail.' In the example protocol and file format disclosed herein, ao each frame type is further broken down info five different video data levels, numbered 1 through 5. Level 1 contains the least amount of data which ."..,..,..~... "."."rFb~~~..~......~w.m..w~u..w....
........u....._...""..,.._.._.~....~,..m."",.",~.,n,..w,.....,....W....".,~....
.~,µ,....W.m.y...... . .~....... ...
represents the lowest video quality and level 5 contains the most amount of data representing the highest quality of video.
Every frame (Key, P and B frames) output by the video compression/file generator is composed of data from all five levels. Thus, the video source file s contains data representing a broad variation in output video quality. The video compression/file generator functions to assemble GOPs each having a particular combination of Key, P and B frames.~Thus, some GOPs may have fewer or more P and B frames. Each frame, however, contains video data for each of the five quality resolution levels. However, for each GOP, the video client only receives ~o data corresponding to a single level. The video server determines for each GOP
the appropriate level of data to send to the client. Once a video quality level is chosen by the video server, it is used for the entire GOP. Adjacent GOPs can be comprised of different level data. However, data of different levels cannot be sent within a GOP.
15 A diagram illustrating the five levels of video data that make up a Key frame as stored in the file format of the present invention is shown in Figure 5. A
sample Key frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size. The data size for the levels is 0.5 KB, 1 KB, 3 KB, 7 KB, 15 KB which 2o correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample Key frame for all five levels is 26.5 KB. The data sizes in Figure 5 and the subsequent Figures represent an example file and are for illustration purposes only. However, the relative sizes of the data for each of the levels does increase when going from level 1 towards level 5. This is to be expected since level 5 2s contains the highest quality video data.
A diagram illustrating the five levels of video data that make up a P
frame as stored in the file format of the present invention is shown in Figure 6. A
sample P frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size.
The $o data size for the levels is 0.1 KB, 0.2 KB, 0.5 KB, 1 KB, 2.2 KB which correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample P frame for all five levels is 4 KB:
A diagram illustrating the five levels of video data that make up a B
frame as stored in the file format of the present invention is shown in Figure 7. A
s sample B frame and each of its five levels of data of varying resolution and quality is shown in the Figure. Each level is shown with a corresponding data size.
The data size for the levels i$ 0.15 KB, 0.35 KB, 0.5 KB, 1 KB, 3 KB which correspond to levels 1, 2, 3, 4, 5, respectively. Thus, the total data size of the sample B frame for all five levels is 5.0 KB.
~o A diagram illustrating a sample group of pictures (GOP) sequence composed of Key, P and B frames making up a video stream is shown in Figure 8. In this example, the video server has determined that level 2 data should be sent for this GOP. Thus, the Key frame 80, B frames 82, 86, 90 and P frames 84, 88, 92 are shown depicting level 2 data and associated data size. The total data ~s size of the GOP is 2.485 KB.
Video Server Process The video server portion of the video transport system of the present invention will now be described in more detail. The function of the video server is to accept a remote client connection request, retrieve a local or remote stored file 2o and transmit it to the client. Before and during the transmission of the video information, the server appropriately adjusts the rate of data flow from the server to the client. The rate is adjusted beforehand based on initial estimation of the bandwidth of the data channel. In addition, the data rate is adjusted during transmission using a bandwidth measurement method that uses statistical is evaluation of the connection between the server and the client. The dynamic adjustment of the data rate by the server functions to allow the client to receive video having a quality that matches the bandwidth capacity of the connection.
Further, during the server/client connection, the client can control the transmission of the data by the server, thus performing a video on demand function.
The acknowledge packet sent by the client comprises an identification of the last received packet, its arrival time and a list of any packets missed since the transmission of the previous acknowledge.
A high level diagram illustrating the sender portion of the video server in s more detail is shown in Figure 9. The sender 32 comprises a frame selector 100, packet generator 102, packet transmitter 104, rate control unit 106 and receiver 108. In operation, the frame selector functions to accept the full frame video data containing all five levels of data from the receiver and select out of the five levels of data, the level of data appropriate for the connection with a particular client.
~o The choice of what compression level to send is made on a client by client basis.
The frame selector used bandwidth information provided by the rate control unit 106 to determine which of the five levels of data to pass to the packet generator.
It is important to note that the raw video source data may me compressed into more or less than five levels. A higher number of levels permits a finer tuning of 15 the available bandwidth to the amount of data sent over the connection.
In combination with the estimated bandwidth measurement, the frame selector utilizes a level bandwidth table in determining which level data to select.
A different level bandwidth table is associated with each video source file.
The level bandwidth table contains an entry for each of the five possible compression zo levels. Each entry contains the average bandwidth necessary to transmit the data at that level. The frame selector chooses a level having the most information content that the network connection can support using the bandwidth measurements performed by the rate control unit. For example, the level bandwidth table for a sample video source file may be as follows.
Level Bandwidth Required (Kbps) If, for example, the rate control unit measures the bandwidth of the network connection to be 25 Kbps, the frame selector would pass only level 2 data to the packet generator. Thus, the output of the frame selector would comprise a sequence of video frames wherein each video frame contains data s from only one of the video compression levels (level 2 data in this example).
it is important to note for the very first video frame or packet that is to sent to the client, no bandwidth measurement is available. This is because, the bandwidth measurement method, as described in more detail below, utilizes transmitted packets to dletermine the bandwidth of the channel. Thus, before the ~o first packet is sent, a different mechanisms is used to initially determine the bandwidth of the channel. In its request to open a video source, the video client transmits to the server tire bandwidth of the connection the last time the client was connected to a server. This mechanism is based on the assumption that the previous connection a client had with a server is similar to the present connection.
In the case where a computer is attached to TCP/IP networks via two ways, e.g., dial up modem and high speed LAN, this mechanism does not provide an accurate initial bandwidth estimate.
The packet generator 102 functions to receive the frames having video data from a particular dompression level and encapsulate them into packets for Zo transmission over the network. The assembled packets are output to the packet transmitter 104 which is responsible for delivery of the packets over the network.
In addition, to preparing packets from the frames received, the packet generator functions to determine uuhich (if any) frames to skip. Depending on the measured bandwidth of the channel, the packet generator may skip frames in order to is reduce the transmitted bit rate. This occurs when the bandwidth of the network connection cannot support transmission of every Key, P and B frame. The method of choosing which frames to select is described in more detail hereinbelow.
The packet generator does not send packets to the packet transmitter ao 104 until requested to do so by the packet transmitter. The delivery of the packets onto the network is controlled by the rate control unit 106. The rate control unit keeps track of the amount of video information in terms of time that is queued for display at the client. In addition, the video frames from the video source are time stamped for synchronization purposes. The rate control unit uses acknowledges received by the client via the acknowledgment receiver 108 to determine the next s packet transmission time. Once the packet transmitter is notified to send the next packet of data, it requests a packet from the packet generator.
Notification of acknowledges or ACKs received by the receiver 108 are also input to the packet transmitter in order to assure proper receipt by the client.
In addition, the packet transmitter maintains a buffer of packets transmitted to the ~o client. In the event the video server determines to resend a packet, the packet transmitter retrieves the packet from the buffer. Once receipt of a packet is acknowledged by the client, the packet is deleted from the buffer and the buffer space is freed up.
Network Bandwidth Measurement Process 15 The bandwidth measurement method as executed by the rate control unit 106 in the sender will now be described in more detail. The bandwidth measurement method actually comprises two separate phases. The first phase being a scanned phase and the second being a fixed phase. In general, the bandwidth measurement method operates by transmitting packets through the 2o network connection and measuring the rate of reception of the packets at the client. A graph illustrating the receiver bit rate versus the number of bytes online is shown in Figure 10. The number of bytes transmitted into the network pipe is increased slowly until a point is reached where bytes are not received any quicker at the client. The term bytes on line means the number of bytes or packets that Zs have been transmitted by the server or the sender but not yet received by the client. During this scan phase portion of the bandwidth measurement method, the 'immediate' flag is set 'on' for each packet sent by the sender. This causes the client to send an acknowledge packet for every packet received. Thus, the sender should receive an acknowledge packet for every packet transmitted to the ao client. As shown in Figure 10 as the number of packets or bytes online increases, a point is reached where the client does not receive packets any faster. The corresponding receive rate at this point can be modeled as an estimate of the bandwidth of the network channel.
The scan phase portion of the bandwidth measurement method will now be described in more detiail. A high level flow diagram illustrating the scan phase s of the bandwidth measurement method of the present invention is shown in Figure 11. As stated previously, the immediate flag is set 'on' for all packets transmitted by the sender during the scan phase of the bandwidth measurement method. This forces the client to immediately send an acknowledge packet for every packet received over the channel. In addition, an acknowledge packet is ~o also sent if the last received packet has a sequence number greater than the sequence number of the last received packet. In this case, a packet loss event has occurred. Also, an acknowledge packet is sent if the previous acknowledge was sent more than an predefined time out period ago. For example, if the time out period is 3 seconds, an acknowledge is sent if the last packet was received more than 3 second ago.
The acknowledge packet sent by the client contains an identification of the last received packet, it's arrival time and a list of any packets missed since the transmission of the previous acknowledge. Initially, the recommended bytes online (RecommendedBytesOnline) is set equal to the size of the packet zo (PacketSize) (step 110). In the next step, a single packet is sent by the sender to the client (step 112). The current number of bytes online (BytesOnline) is then calculated (step 114). The number of BytesOnline can be calculated since the sender has knowledge of each packet that is placed into the network pipe in addition to having knowledge of each acknowledgment received from the client.
Z5 Thus at any one time the sender is aware of outstanding packets still in the network pipe. Next, the number of bytes online_ is compared to the recommended bytes online ( step 116).' The number of bytes online can be calculated using the sequence number of the last packet that was sent, as known by the sender, subtracted from the seqjuence number of the last packet acknowledged. Both 3o these entities are known by the sender and thus the number of bytes online can be calculated. If the number of bytes online are less than the recommended bytes online then control returns to step 112 and an additional packet is placed into the network pipe. In this manner the number of bytes online is made equal to the recommended bytes online.
After the packet is sent, a time out is then set to a particular value, for s example, 1000 (step 118). The sender than waits for ether an acknowledgment or a time out to occur (step 120). If a time out occurs then control is returned to step 112 since the packet is assumed lost and another packet is then sent (step 122). If an acknowledgment was received, the number of acknowledged bytes online (AckBytesOnline) is then calculated (step 124). The acknowledged bytes ~o online is equal to the recommended bytes online for the last acknowledged packet. Each packet that is sent by the sender has associated with it a number indicating the recommended bytes online at the time that particular packet was sent. This number is stored in a log at the sender and associated with the particular packet that is transmitted. When a packet is acknowledged the ~s recommended bytes online for that particular acknowledge packet is recalled. If the value of the acknowledged bytes online is less than the recommended bytes online than control returns to step 112 and another packet is placed into the network pipe (step 126). If the number of acknowledged bytes online is equal to the number of bytes online than the receiving bandwidth is then calculated (step 20 128).
The effect of these steps is to keep the number of packets or bytes in the network pipe constant and in a steady state. The receiving bandwidth is calculated from the sending speed since an acknowledge is received for every packet that is placed into the pipe. This assumes that an acknowledge packet is 2s sent immediately upon the client receiving a packet from the sender. If the receiving bandwidth of the pipe has not been _exceeded then the sending rate at the sender should be equal to the receiving rate at the client. Thus, as long as the maximum bandwidth of the channel is not exceeded, the sending rate can be modeled as the receiving rate and correspondingly the receiving bandwidth can so be computed.
It is then deterlmined whether the receiving bandwidth has leveled off (step 130). With reference to Figure 10, in this step, it is checked whether the number of bytes online his begun to level off as shown in the right most portion of the curve in the Figure. The leveling off of the receive bandwidth is detected by s comparing the current receiving bandwidth to the average of the last five values of the receiving bandwidth.' If the latest value of the receiving bandwidth is within 5%
of the average then the receiving bandwidth is considered to have leveled off.
Consequently, the banduvidth of the network connection is estimated to be the value of the last received bandwidth. If the receiving bandwidth has not leveled ~o off, i.e., within 5% of the average of the previous five measurements, then the recommended bytes online (RecommendedBytesOnline) is incremented by the packet size (step 132). Control then returns to step 112 and an additional packet is placed into the network pipe.
If the receiving bandwidth is found not to have leveled off it means the ~s number of bytes online corresponds to the linear portion of the curve in Figure 10.
Thus, the maximum bandwidth of the network pipe has not been reached and additional packets can be pumped into the network channel. If the receiving bandwidth has been found to have leveled off the recommended bandwidth (RecommendedBVl~ is bet equal to the current value of the receiving bandwidth 20 (ReceivingBVl~ (step 13#). The recommended bandwidth value is utilized by the rate control unit as an initial estimate of the bandwidth of the network connection.
The scan phase portion of the bandwidth measurement method is used initially as a relatively crude estimate of the bandwidth of the network channel.
During steady state operation of the sender portion of the video server a fixed zs phase bandwidth measurement method is utilized to better fine tune and track changes in the bandwidth of the network channel. A high level flow diagram illustrating the fixed phase method of the bandwidth measurement portion of the present invention is shown in Figure 12. During the fixed phase of the bandwidth measurement method tf~e immediate flag is set to 'off in each packet sent by the so sender. The first step is to set a variable representing the time to send (TimeToSend) equal to the current time, i.e., now (step 140). Next, it is checked whether the value of time to send is greater than or equal to the current time (step 142). If the time to send is greater than or equal to the current time, a packet is sent into the network channel (step 150). Information about the packet is then stored in a database (step 152). The information stored in the data base includes s the PacketlD, PacketSize and the value of the TimeToSend. A new value for the TimeToSend, which represents the time for transmission of the next packet, is then calculated based on the current value of the TimeToSend, the RecommendedBW and the PacketSize (step 160). Control then returns to step 142 where it is checked whether it is time to send the next packet.
If the value of the time to send has not been reached, it is then checked whether an acknowledgment has been received (step 144). If an acknowledgment has not been received, control loops back to step 142 and the time to send is checked again. If an acknowledgment has been received, the information contained in the acknowledgment packet is stored in the database ~s {step 146). The information stored in the database includes an acknowledgment packet ID (AckPacketlD), the time to receive (TimeToReceive) and the time to acknowledgment (TimeToAck). The value of the acknowledgment packet ID is the value of the ID or sequence number of the acknowledgment packet itself.
The time to receive is the time stamp generated by the client which represents the 2o time of arrival of the packet transmitted by the sender that the acknowledgment packet corresponds to. The time to acknowledgment is a time stamp generated by the sender representing the time the acknowledgment packet was received by the video server.
In the next step, various entities are then calculated (step 148). The 25 number of bytes sent (BytesSent) by the sender is calculated using the latest response (LastResp) and the previous response (PreviousResp). The data for the previous response and the last response are generated from the respective acknowledgment packets received by the sender. Similarly, the number of bytes received by the client (BytesRec) is calculated using the information contained in 3o the acknowledgment packet for the previous response and the last response.
The send rate (SendRate) is then computed by dividing the number of bytes sent by the difference between the time to send (TimeToSend) for the previous response subtracted from the time to send for the last or current response, as shown below.
BytesSent SendRate =
TinleToSend(PreviousResp) - TimeToSend(LastResp) s Similarly, the rdceive rate (RecRate) is calculated by dividing the number of bytes received by the time to receive (TimeToRec) for the previous response subtracted from the time to receive for the last response, as shown below.
BytesRec RecRate =
Tim~ToRec(PreviousResp) - TimeToRec(LastResp) The send rate is then compared to the received rate (step 154). If the ~o sending rate is less then or equal to the receiving rate this means the network connection is being underutilized and a portion of the bandwidth remains unused.
In this case, the recommended bandwidth is increased by a particular amount, for example 10% (step 158). If the sending rate is greater than the receiving rate this means too much data is being pumped into the network pipe and the sending rate ~s needs to be reduced. Thus, the recommended bandwidth is set equal to the receive rate (step 156).
Whether the bandwidth is increased or decreased, the next step is to determine the new tinne to send based on the current time to send, the recommended bandwidth and the PacketSize (step 160). Control then returns to 2o step 142 where it is checked whether the time has arrived to send another packet.
Using this method, the sender constantly tries to utilize the available bandwidth as effcientfy~ as possible by keeping the network pipe full. In other words, the sender attermpts to maintain the number of bytes online to correspond with the bandwidth of the network connection. If the sender senses the bandwidth is of the network connect~on being underutilized it increases the number of bytes online accordingly. Conversely, if the sender determines that the bandwidth of the network connection is being exceeded it appropriately lowers the sending rate accordingly.
_.... ..~..,a~",~.~.~."~,.M ~,....~.....~....~..~.-_... ..
....~...~~..~..~.w~.__.~.~ ~...~_ _. _.._._.
As discussed previously, the packet generator 102 (Figure 9) receives the video frames for a particular level from the frame selector 100. The function of the packet generator is to encapsulate the video frame data into packets and transmit them to the packet transmitter 104. In addition, the packet generator s determines which of the frames it receives to encapsulate into packets and send to the packet transmitter. The packet generator determines which frames to encapsulate based on the recommended bandwidth determined by the rate control unit 106.
A high level flow diagram illustrating the method of selecting frames to ~o be transmitted as performed by the sender portion of the present invention is shown in Figure 13. initially, the value Q is set to a particular value which represents an optimum size of the queue within the video client. The size of the queue is measured in time, i.e. seconds, and represents the amount of video information currently queued in the video client ready to be displayed. The packet ~s generator uses the current level of this queue to determine which of the Key, P
and B frames to send to the packet transmitter.
First, it is checked to see whether the current level of the client queue is less than half Of QppT which represents an optimum size for the client queue (step 190). If the size of the client queue is less than half of this value than only a Key 2o frame is sent (step 194). In this case only Key frames are sent due to time considerations. The level of the client queue is considered to be too short to send Key, P and B frames.
If the level of the client queue is found to be between half the optimum queue Qom. and a full optimum queue {step 192), both Key and P frames are sent ~s (step 196). In this case, the client queue is considered to contain sufficient video information in terms of time to permit the transmission of Key and P frames.
Lastly, if the size of the client queue is equal to or above the level of the optimum queue, Key, P and B-frames are sent to the client (step 198). In this case, the client queue of considered to contain enough seconds of video to permit enough so time to send Key, P and B frames.
As described' previously, the packet generator sends packets for transmission to the packet transmitter. For each packet received by the packet transmitter an appropriate method of communications is selected. Key-frames, for example, should be sent using a very reliable communication method since they s are used as the basis fc~r both P and B frames. On the other hand, B frames may be sent using an unreliable communication method sine they are less important.
A high level flow diagram illustrating the method of sending a packet performed by the paclaet transmitter portion of the present invention is shown Figure 14. The first step is to apply a time stamp to the packet received from the io packet generator (step 170). If the packet contains Key frame data (step 172) then the packet is sent using a best effort communication protocol. The best effort protocol can be an implementation of a reliable UDP which includes the video server retransmitting the Key frame as long as there is enough time for the client to receiver and display it on time. If the packet contains P frame information (step 15 176) then the packet is sent via a semi reliable communication protocol (step 178). In this case, the server makes a decision based on the available bandwidth whether to resend the P frame information packet to the video client. Lastly, if the packet contains B franhe information it is sent via a non reliable communication protocol such as UDP Qstep 180). In this case, the video server does not have an Zo option to retransmit the'', packet if not received by the video client.
Video Client I~rocess The video cliient portion of the video transport system of the present invention will now be described in more detail. The video client is a graphical user interface (GUI) based' process or application that functions to decode a video 25 stream transmitted by'the server. in general, the client functions as an off line video player, capable c~f playing back local file streams, as well as an online video player utilizing a direct connection to the server. Thus, the video client supports both store and forwaa~d as well as real time implementations of video over a network. The client can preferably supply a VCR like GUI display, i.e., play, stop, so fast forward, pause, etc. buttons.
During a real time transmission of video data, the client reports back status and bandwidth related information to the video server via a reverse channel. Based on the number of transmission errors as well as the number of data packets lost, as communicated via the status and bandwidth information sent s back to the server, the server make an online determination regarding the quantity of data to send to the client.
As described previously, this online decision forms the core of the adaptive video transport system. The video server makes a determination as to the bandwidth of the connection and the quality of the connection, i.e., rate of ~o packet loss, based on the amount of information received by the video client.
Knowledge of the amount of data that each client receives is essential to the server in order to determine the amount and type of data to transmit to each particular video client.
Multi-Platform Video Server 15 In an alternative embodiment, the video server 18 of Figure 1 can be constructed using multiple platforms rather than a single platform. In this embodiment, the video server functionality is spread over multiple computer platforms. Each individual platform within the multi plattorm video server functions to transmit a single video compression level. A high level black diagram 2o illustrating an alternative embodiment of the adaptive video transport system of the present invention including the video compressionlfiie generator, multi-platform video server and video client is shown in Figure 1 b.
The adaptive video transport system, generally referenced 200, comprises a video compressionlfife generator 212, a plurality of video servers #1 25 through #N 216 and one or more video clients 220. Only one video client is shown in Figure 15 for clarity sake. The video compression/file generator 212 in combination with the video client 220 comprise a video codec or coderldecoder that functions to compress, code, decode and decompress video/audio streams that are transmitted over the network 218 into a plurality of compressed 3o video/audio files. Each compressed video/audio file is compressed using a different compression le~rel. Each individual video server piaiform is responsible for transmitting one of video compression levels.
The video comipression/file generator 212 functions similarly to that of the video compressionlfile generator 14 of Figure 1 with the exception that the s video compression/file generator of Figure 15 generates a separate compressed video/audio file for each compression level. For N compression levels, the video compression~le generatbr 212 functions to generate a compressed video/audio file 214 for levels 1 thrdugh N. Considering the system described previously, compressed video/audia files 214 are generated for Levels 1 through Level 5.
~o The compressed video/~udio files may be in any suitable format such as AVI
format. The generation of the compressed video/audio files 214 can be performed either on-line or off-line. Typically the video/audio file is generated off-line. Note that any suitable method of video compression can be utilized to process the raw video delta 210 such as described in connection with the MPEG
~s 1, MPEG-2 or MPEG-4 standards.
In order to serve N bandwidth levels, where each bandwidth level represents a different qu~alitylresolution band, N video servers and N
compressed video/audio files are reqwired. One compressed video/audio file and video server are associated with each bandwidth level, i.e., compression level. Thus, the Zo complete video server system comprises N separate video server platforms each handling one compression level. An additional platform 222 functions as a rate controller (bandwidth cotrtroller) which performs the scan phase and fixed phase bandwidth measuremeht methods, frame selection method and packet transmission method as described previously in connection with Figures 11 2s through 14. The rate controller 222 functions as a bandwidth controller executing the bandwidth measurement methods described earlier and is operative to select which of the video servers #1 through #N to transmit to the video client 220.
For each client, data from only one video server is sent at any one time. The same video server is used to 'send data for an entire GOP. However, different video so servers can be utilized to send video/audio data for other GOPs since the compression level for a GOP is independent of the compression levels used for other GOPs.
Each of the N video servers 216 can comprise the video server 18 {Figure 2) described previously or may comprise a standard off the shelf video s server such as the MPEG-2 based Media Server from Oracle Inc. or the NetShow Server from Microsoft Corporation, Redmond, Washington. The standard video server must be suitably modified to provide a communication capability with the rate controller 222 before it will operate in the present invention. The modifications typically include providing a communication interface between the ~o standard video server and the rate controller.
The video client 220 functions similarly and is constructed in similar fashion to that of the video client shown in Figure 3. The video client functions to decode and decompress the videolaudio data stream and sends the decodedldecompressed video/audio stream to a display connected thereto. in addition, the video client 220 is adapted to issue the video file requests to the rate controller 222 rather than to any of the video servers 1 through N. Throughout the video transmission session, the video client 220 functions to return acknowledgments and statistics to the rate controller 222. The rate controller uses the acknowledgments and statistics returned by the video client 220 in order 2o to calculate the optimum compression (resolution) level to use.
An advantage of the adaptive video transport system of Figure 15 is that performance is enhanced. The performance enhancement is achieved in part by the use of standard video servers which are optimized for performance.
Assuming each of the N video servers can generate 250 concurrent 512 Kbps 2s video/audio streams, the complete video server system is capable of generating up to 250 X N concurrent 512 Kbps non-scaleable streams and an even higher number of concurrent lower speed 28.8, 56, 128 or 256 Kbps streams. Note that whenever the initial bandwidth is known, for example within an Intranet, the video client will play back video directly from the most suitable server. When the initial so bandwidth is unknown beforehand, the rate controller 222 functions to determine the optimum bandwidth for the particular network connection. Thus, the alternative embodiment shown in Figure 15 can be utilized to implement the multi-compression layer and adaptive bandwidth measurement scheme of the present invention by piggy backing on existing standard video server technology and enhancing it to offer scaleable video transmission.
s While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.
Claims (11)
1. A method of transporting video over a network channel, comprising the steps of:
compressing a raw video source into a plurality of frames, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
selecting one of said plurality of levels of each frame to transmit over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel; and sending said selected level of each frame over the network channel.
compressing a raw video source into a plurality of frames, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
selecting one of said plurality of levels of each frame to transmit over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel; and sending said selected level of each frame over the network channel.
2. The method according to claim 1, wherein said step of compressing comprises the step of compressing the raw video source into a plurality of frames, wherein one or more frames contain different amounts of video content information, said plurality of frames grouped so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences.
3. The method according to claim 1, wherein said step of compressing comprises the step of compressing the raw video source into Key, P and B type frames, said Key, P and B frames generated so as to form a video stream consisting of a plurality of group of pictures (GOP) sequences.
4. A method of transporting video from a video server to a video client over a network channel, comprising the steps of:
compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
determining the amount of video information waiting to be displayed at the video client;
selecting one of said plurality of levels of each frame to send over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel;
choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; and sending the chosen frames of said selected level over the network channel.
compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
determining the amount of video information waiting to be displayed at the video client;
selecting one of said plurality of levels of each frame to send over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel;
choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client; and sending the chosen frames of said selected level over the network channel.
5. A video server for transporting video from a video source over a network channel to a video client, said video source consisting of a plurality of frames of video data, each frame of video data consisting of multiple compression levels, said video server comprising:
receiver means for inputting frames of video data from the video source;
sending means coupled to said receiver means, said sending means for determining which compression level within said frame to transmit in accordance with the estimated available bandwidth of the network channel, said sending means for encapsulating said frames of video data into a plurality of packets for transmission over said network channel; and a controller for managing the operation of said receiver means and said sending means whereby the rate of transmission of said sending means is maintained so as to match the available bandwidth of the network channel.
receiver means for inputting frames of video data from the video source;
sending means coupled to said receiver means, said sending means for determining which compression level within said frame to transmit in accordance with the estimated available bandwidth of the network channel, said sending means for encapsulating said frames of video data into a plurality of packets for transmission over said network channel; and a controller for managing the operation of said receiver means and said sending means whereby the rate of transmission of said sending means is maintained so as to match the available bandwidth of the network channel.
6. The video server according to claim 5, wherein said sending means comprises:
a rate control unit for measuring the available bandwidth of the network channel;
a frame selector for inputting video frame data output by said receiver means, said frame selector outputting frames of a particular compression level in accordance with the bandwidth measured by said rate control unit;
a packet generator for inputting video frame data output by said frame selector, said packet generator for encapsulating said video frame data into a plurality of packets for transmission, said packet generator determining which frames are to be transmitted;
a packet transmitter for placing onto the network channel the plurality of packets output by said packet generator; and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
a rate control unit for measuring the available bandwidth of the network channel;
a frame selector for inputting video frame data output by said receiver means, said frame selector outputting frames of a particular compression level in accordance with the bandwidth measured by said rate control unit;
a packet generator for inputting video frame data output by said frame selector, said packet generator for encapsulating said video frame data into a plurality of packets for transmission, said packet generator determining which frames are to be transmitted;
a packet transmitter for placing onto the network channel the plurality of packets output by said packet generator; and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
7. A method of transporting a video stream over a network channel, comprising the steps of:
a) compressing a raw video source into a plurality of quality levels, each quality level corresponding to a particular degree of compression and having an associated group of pictures sequence;
b) estimating the bandwidth of the network channel;
c) selecting one of the plurality of quality levels in accordance with the bandwidth estimate, wherein the selected quality level optimizes the use of the bandwidth of the network channel during a first time interval; and d) sending the group of pictures sequence associated with the selected quality level over the network channel.
a) compressing a raw video source into a plurality of quality levels, each quality level corresponding to a particular degree of compression and having an associated group of pictures sequence;
b) estimating the bandwidth of the network channel;
c) selecting one of the plurality of quality levels in accordance with the bandwidth estimate, wherein the selected quality level optimizes the use of the bandwidth of the network channel during a first time interval; and d) sending the group of pictures sequence associated with the selected quality level over the network channel.
8. The method of claim 7, wherein step a) comprises compressing the raw video source into a plurality of frames, each frame having video data corresponding to one of the plurality of quality levels.
9. A method of transporting video from a video server to a video client over a network channel, comprising the steps of:
compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
determining the amount of video information waiting to be displayed at the video client;
selecting one of said plurality of levels of each frame to send over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel;
choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client;
sending the chosen frames containing a higher amount of video data content and of a selected level over the network channel utilizing a reliable communication protocol; and sending the chosen frames containing a lower amount video data content and of a selected level over the network channel utilizing an unreliable communication protocol.
compressing data from a raw video source so as to generate a plurality of frames, each frame containing a particular amount of video content information, each frame comprising a plurality of levels, each level corresponding to a particular degree of compression;
estimating the bandwidth of the network channel;
determining the amount of video information waiting to be displayed at the video client;
selecting one of said plurality of levels of each frame to send over the network channel in accordance with said bandwidth estimate whereby the level selected optimizes the use of the bandwidth of the network channel;
choosing which frames to send over the network channel in accordance with the amount of video information waiting to be displayed at the video client;
sending the chosen frames containing a higher amount of video data content and of a selected level over the network channel utilizing a reliable communication protocol; and sending the chosen frames containing a lower amount video data content and of a selected level over the network channel utilizing an unreliable communication protocol.
10. A video server system for transporting video from a plurality of video sources over a network channel to a video client, each video source consisting of a plurality of frames of video data, each frame of video data consisting of a single compression level, said video server system comprising:
a plurality of video servers, each video server associated with a single video source at a particular compression level, each video server comprising:
receiver means for inputting frames of video data from the video source associated with that particular video server;
sending means coupled to said receiver means, said sending means for determining which frames to transmit in accordance with the available bandwidth of the network channel, said sending means for encapsulating said frames of video data into a plurality of packets for transmission over said network channel;
a controller for managing the operation of said receiver means and said sending means; and a rate controller for determining which video server to utilize for transmission of video data based on the available bandwidth of the network channel.
a plurality of video servers, each video server associated with a single video source at a particular compression level, each video server comprising:
receiver means for inputting frames of video data from the video source associated with that particular video server;
sending means coupled to said receiver means, said sending means for determining which frames to transmit in accordance with the available bandwidth of the network channel, said sending means for encapsulating said frames of video data into a plurality of packets for transmission over said network channel;
a controller for managing the operation of said receiver means and said sending means; and a rate controller for determining which video server to utilize for transmission of video data based on the available bandwidth of the network channel.
11. The video server system according to claim 10, wherein said sending means comprises:
means for interfacing said video server to said rate controller;
a bandwidth measurement unit for measuring the available bandwidth of the network channel;
a packet generator for inputting video frame data output by said receiver means, said packet generator for encapsulating said video frame data into a plurality of packets for transmission, said packet generator determining which frames are to be transmitted;
a packet transmitter for placing onto the network channel the plurality of packets output by said packet generator; and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
means for interfacing said video server to said rate controller;
a bandwidth measurement unit for measuring the available bandwidth of the network channel;
a packet generator for inputting video frame data output by said receiver means, said packet generator for encapsulating said video frame data into a plurality of packets for transmission, said packet generator determining which frames are to be transmitted;
a packet transmitter for placing onto the network channel the plurality of packets output by said packet generator; and a receiver for receiving acknowledgments sent by the video client over the network channel in response to packets received thereby.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/884,531 | 1997-06-26 | ||
US08/884,531 US6014694A (en) | 1997-06-26 | 1997-06-26 | System for adaptive video/audio transport over a network |
PCT/IL1998/000300 WO1999000984A1 (en) | 1997-06-26 | 1998-06-25 | System for adaptive video/audio transport over a network |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2294511A1 CA2294511A1 (en) | 1999-01-07 |
CA2294511C true CA2294511C (en) | 2002-04-02 |
Family
ID=25384840
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002294511A Expired - Fee Related CA2294511C (en) | 1997-06-26 | 1998-06-25 | System for adaptive video/audio transport over a network |
Country Status (8)
Country | Link |
---|---|
US (1) | US6014694A (en) |
EP (1) | EP0992160A1 (en) |
JP (1) | JP2002511216A (en) |
KR (1) | KR20010020498A (en) |
AU (1) | AU7928998A (en) |
CA (1) | CA2294511C (en) |
IL (1) | IL133439A0 (en) |
WO (1) | WO1999000984A1 (en) |
Families Citing this family (548)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6769128B1 (en) | 1995-06-07 | 2004-07-27 | United Video Properties, Inc. | Electronic television program guide schedule system and method with data feed access |
US9832244B2 (en) * | 1995-07-14 | 2017-11-28 | Arris Enterprises Llc | Dynamic quality adjustment based on changing streaming constraints |
US7512698B1 (en) * | 1995-07-14 | 2009-03-31 | Broadband Royalty Corporation | Dynamic quality adjustment based on changing streaming constraints |
US7058721B1 (en) | 1995-07-14 | 2006-06-06 | Broadband Royalty Corporation | Dynamic quality adjustment based on changing streaming constraints |
US5940073A (en) | 1996-05-03 | 1999-08-17 | Starsight Telecast Inc. | Method and system for displaying other information in a TV program guide |
US6751221B1 (en) * | 1996-10-04 | 2004-06-15 | Kabushiki Kaisha Toshiba | Data transmitting node and network inter-connection node suitable for home network environment |
US6654933B1 (en) | 1999-09-21 | 2003-11-25 | Kasenna, Inc. | System and method for media stream indexing |
US9113122B2 (en) | 1997-04-21 | 2015-08-18 | Rovi Guides, Inc. | Method and apparatus for time-shifting video and text in a text-enhanced television program |
CN1941863B (en) | 1997-07-21 | 2011-06-29 | 骏升发展(美国)有限公司 | Method for displaying target advertisement to user in electronic program guide system |
US7325077B1 (en) | 1997-08-21 | 2008-01-29 | Beryl Technical Assays Llc | Miniclient for internet appliance |
JP3493985B2 (en) * | 1997-11-26 | 2004-02-03 | 安藤電気株式会社 | Video communication evaluation device |
IL122361A0 (en) * | 1997-11-29 | 1998-04-05 | Algotec Systems Ltd | Image compression method |
JP2000013777A (en) * | 1998-06-26 | 2000-01-14 | Matsushita Electric Ind Co Ltd | Video reproducing device and video storage device |
JP2995177B1 (en) * | 1998-07-10 | 1999-12-27 | 株式会社ディジタル・ビジョン・ラボラトリーズ | Stream distribution system |
CN1867068A (en) | 1998-07-14 | 2006-11-22 | 联合视频制品公司 | Client-server based interactive television program guide system with remote server recording |
AU758390B2 (en) * | 1998-07-27 | 2003-03-20 | Webtv Networks, Inc. | Remote computer access |
US8189662B2 (en) * | 1999-07-27 | 2012-05-29 | Microsoft Corporation | Selection compression |
JP3847481B2 (en) * | 1998-08-17 | 2006-11-22 | 富士写真フイルム株式会社 | Data transfer method and apparatus, and recording medium |
US6898762B2 (en) | 1998-08-21 | 2005-05-24 | United Video Properties, Inc. | Client-server electronic program guide |
US6298071B1 (en) | 1998-09-03 | 2001-10-02 | Diva Systems Corporation | Method and apparatus for processing variable bit rate information in an information distribution system |
US6580829B1 (en) * | 1998-09-25 | 2003-06-17 | Sarnoff Corporation | Detecting and coding flash frames in video data |
US8165155B2 (en) * | 2004-07-01 | 2012-04-24 | Broadcom Corporation | Method and system for a thin client and blade architecture |
US6859799B1 (en) | 1998-11-30 | 2005-02-22 | Gemstar Development Corporation | Search engine for video and graphics |
US6637031B1 (en) * | 1998-12-04 | 2003-10-21 | Microsoft Corporation | Multimedia presentation latency minimization |
US6624761B2 (en) | 1998-12-11 | 2003-09-23 | Realtime Data, Llc | Content independent data compression method and system |
US6356943B2 (en) * | 1998-12-14 | 2002-03-12 | Emc Corporation | Distance learning implementation |
US7237251B1 (en) | 1999-03-02 | 2007-06-26 | Bigband Networks, Inc. | Method and apparatus for using delay time during switching events to display previously stored information elements |
US6601104B1 (en) | 1999-03-11 | 2003-07-29 | Realtime Data Llc | System and methods for accelerated data storage and retrieval |
US6604158B1 (en) | 1999-03-11 | 2003-08-05 | Realtime Data, Llc | System and methods for accelerated data storage and retrieval |
JP2000270330A (en) * | 1999-03-18 | 2000-09-29 | Fujitsu Ltd | System and method for video image distribution |
US6654806B2 (en) * | 1999-04-09 | 2003-11-25 | Sun Microsystems, Inc. | Method and apparatus for adaptably providing data to a network environment |
FI113124B (en) | 1999-04-29 | 2004-02-27 | Nokia Corp | Communication |
CA2280662A1 (en) * | 1999-05-21 | 2000-11-21 | Joe Toth | Media server with multi-dimensional scalable data compression |
EP1056273A3 (en) * | 1999-05-25 | 2002-01-02 | SeeItFirst, Inc. | Method and system for providing high quality images from a digital video stream |
US6879634B1 (en) * | 1999-05-26 | 2005-04-12 | Bigband Networks Inc. | Method and system for transmitting media streams over a variable bandwidth network |
US8266657B2 (en) | 2001-03-15 | 2012-09-11 | Sling Media Inc. | Method for effectively implementing a multi-room television system |
US6263503B1 (en) * | 1999-05-26 | 2001-07-17 | Neal Margulis | Method for effectively implementing a wireless television system |
US6557172B1 (en) * | 1999-05-28 | 2003-04-29 | Intel Corporation | Communicating enhancement data in layers |
US6817028B1 (en) * | 1999-06-11 | 2004-11-09 | Scientific-Atlanta, Inc. | Reduced screen control system for interactive program guide |
US7010801B1 (en) * | 1999-06-11 | 2006-03-07 | Scientific-Atlanta, Inc. | Video on demand system with parameter-controlled bandwidth deallocation |
US7992163B1 (en) | 1999-06-11 | 2011-08-02 | Jerding Dean F | Video-on-demand navigational system |
DE19929379A1 (en) * | 1999-06-25 | 2001-01-11 | Bosch Gmbh Robert | Terminal with an encoder and decoder for MPEG4 files |
US8255956B2 (en) * | 1999-06-28 | 2012-08-28 | Cox Communications, Inc. | System and method for delivery of short-time duration video segments |
KR20010010109A (en) * | 1999-07-16 | 2001-02-05 | 구자홍 | Broadcasting Service System Based On Mobile Network |
US7380015B1 (en) * | 1999-09-10 | 2008-05-27 | Kdd Corporation | Apparatus and method for compression-transmitting and decoding picture information and storage medium stored its control programs |
WO2001020447A1 (en) * | 1999-09-13 | 2001-03-22 | Videosdotcom, Inc. | Set-top box for internet-based distribution of video and other data |
JP2001094954A (en) * | 1999-09-17 | 2001-04-06 | Fujitsu Ltd | Image distribution system and method therefor |
US6973475B2 (en) * | 1999-09-18 | 2005-12-06 | Wildtangent | Dynamic scalable multi-media content streaming |
US6598074B1 (en) * | 1999-09-23 | 2003-07-22 | Rocket Network, Inc. | System and method for enabling multimedia production collaboration over a network |
WO2001024463A1 (en) * | 1999-09-27 | 2001-04-05 | Cti Squared Ltd. | Method and device for unified messaging |
US7072343B1 (en) * | 1999-09-27 | 2006-07-04 | Cisco Technology, Inc. | Methods and apparatus for controlling a data stream using a host agent acting on behalf of a host computer |
US8341662B1 (en) * | 1999-09-30 | 2012-12-25 | International Business Machine Corporation | User-controlled selective overlay in a streaming media |
US7010492B1 (en) | 1999-09-30 | 2006-03-07 | International Business Machines Corporation | Method and apparatus for dynamic distribution of controlled and additional selective overlays in a streaming media |
US6535485B1 (en) * | 1999-10-01 | 2003-03-18 | Telcordia Technologies, Inc. | Methods and systems for an improved reliability packet network |
US9668011B2 (en) * | 2001-02-05 | 2017-05-30 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Single chip set-top box system |
US6920179B1 (en) * | 1999-11-16 | 2005-07-19 | Agere Systems Inc. | Method and apparatus for video transmission over a heterogeneous network using progressive video coding |
JP2001157183A (en) * | 1999-11-25 | 2001-06-08 | Nec Corp | Video telephone system |
US7047305B1 (en) * | 1999-12-09 | 2006-05-16 | Vidiator Enterprises Inc. | Personal broadcasting system for audio and video data using a wide area network |
US7069573B1 (en) * | 1999-12-09 | 2006-06-27 | Vidiator Enterprises Inc. | Personal broadcasting and viewing method of audio and video data using a wide area network |
US7389356B2 (en) * | 1999-12-15 | 2008-06-17 | Microsoft Corporation | Generalized differentiation methods and arrangements for adaptive multimedia communications |
US7116717B1 (en) * | 1999-12-15 | 2006-10-03 | Bigband Networks, Inc. | Method and system for scalable representation, storage, transmission and reconstruction of media streams |
US7093028B1 (en) * | 1999-12-15 | 2006-08-15 | Microsoft Corporation | User and content aware object-based data stream transmission methods and arrangements |
US7823182B1 (en) * | 1999-12-22 | 2010-10-26 | AT & T Intellectual Property II | Method and system for adaptive transmission of smoothed data over wireless channels |
KR100364401B1 (en) * | 1999-12-31 | 2002-12-11 | 엘지전자 주식회사 | Multi Media Service System Using Virtual Server |
US7089577B1 (en) | 2000-01-14 | 2006-08-08 | Terayon Communication Systems, Inc. | Process for supplying video-on-demand and other requested programs and services from a headend |
US6857132B1 (en) * | 2000-01-14 | 2005-02-15 | Terayon Communication Systems, Inc. | Head end multiplexer to select and transmit video-on-demand and other requested programs and services |
WO2001055863A1 (en) * | 2000-01-28 | 2001-08-02 | Ibeam Broadcasting Corporation | A system and method for performing broadcast-enabled disk drive replication in a distributed data delivery network |
JP4035806B2 (en) * | 2000-01-31 | 2008-01-23 | 株式会社日立製作所 | Video distribution system |
US7289244B2 (en) | 2000-02-02 | 2007-10-30 | Raja Singh Tuli | Portable high speed internet access device |
US7356570B1 (en) | 2000-08-29 | 2008-04-08 | Raja Tuli | Portable high speed communication device |
US20020030843A1 (en) * | 2000-02-02 | 2002-03-14 | Tuli Raja Singh | Portable high speed internet access device |
US7023572B2 (en) * | 2000-02-02 | 2006-04-04 | Raja Singh Tuli | Portable high speed internet access device |
US6633314B1 (en) * | 2000-02-02 | 2003-10-14 | Raja Tuli | Portable high speed internet device integrating cellular telephone and palm top computer |
US20020115477A1 (en) * | 2001-02-13 | 2002-08-22 | Raja Singh | Portable high speed internet access device with scrolling |
US7068381B1 (en) * | 2000-02-02 | 2006-06-27 | Raja Tuli | Portable high speed internet access device |
US7181608B2 (en) | 2000-02-03 | 2007-02-20 | Realtime Data Llc | Systems and methods for accelerated loading of operating systems and application programs |
US7327761B2 (en) * | 2000-02-03 | 2008-02-05 | Bandwiz Inc. | Data streaming |
US7304990B2 (en) * | 2000-02-03 | 2007-12-04 | Bandwiz Inc. | Method of encoding and transmitting data over a communication medium through division and segmentation |
US20030191876A1 (en) * | 2000-02-03 | 2003-10-09 | Fallon James J. | Data storewidth accelerator |
US6941382B1 (en) | 2000-02-07 | 2005-09-06 | Raja Tuli | Portable high speed internet or desktop device |
US6874009B1 (en) | 2000-02-16 | 2005-03-29 | Raja Tuli | Portable high speed internet device with user fees |
JP3793941B2 (en) * | 2000-02-24 | 2006-07-05 | 株式会社日立製作所 | Video server device and video delivery method thereof in video delivery system |
US6591423B1 (en) * | 2000-02-28 | 2003-07-08 | Qwest Communications International Inc. | Gateway power synchronization |
US6842768B1 (en) | 2000-03-01 | 2005-01-11 | Siemens Communications, Inc. | Apparatus and method for selectable compression |
EP1130921B1 (en) * | 2000-03-02 | 2005-01-12 | Matsushita Electric Industrial Co., Ltd. | Data transmission in non-reliable networks |
JP4355465B2 (en) * | 2000-03-24 | 2009-11-04 | 株式会社オプティム | Advertisement notification system |
US6674717B1 (en) * | 2000-03-30 | 2004-01-06 | Network Physics, Inc. | Method for reducing packet loss and increasing internet flow by feedback control |
US6647480B1 (en) * | 2000-03-31 | 2003-11-11 | International Business Machines Corporation | Data block update utilizing flash memory having unused memory size smaller than the data block size |
US20020054068A1 (en) * | 2000-03-31 | 2002-05-09 | United Video Properties, Inc. | Systems and methods for reducing cut-offs in program recording |
AU2001249621A1 (en) * | 2000-03-31 | 2001-10-15 | Siebel Systems, Inc. | Thin client method and system for generating page delivery language output from applets, views, and screen definitions |
US8516525B1 (en) | 2000-06-09 | 2013-08-20 | Dean F. Jerding | Integrated searching system for interactive media guide |
US7975277B1 (en) | 2000-04-03 | 2011-07-05 | Jerding Dean F | System for providing alternative services |
US7200857B1 (en) * | 2000-06-09 | 2007-04-03 | Scientific-Atlanta, Inc. | Synchronized video-on-demand supplemental commentary |
US20020010754A1 (en) * | 2000-04-07 | 2002-01-24 | Brown Keith R. | Electric power metering package |
US6937814B1 (en) * | 2000-04-14 | 2005-08-30 | Realnetworks, Inc. | System and method for play while recording processing |
WO2001080524A2 (en) * | 2000-04-17 | 2001-10-25 | Circadence Corporation | Method and system for overcoming denial of service attacks |
US7051111B1 (en) | 2000-04-25 | 2006-05-23 | Digeo, Inc. | Multiple source proxy management system |
US6747991B1 (en) | 2000-04-26 | 2004-06-08 | Carnegie Mellon University | Filter and method for adaptively modifying the bit rate of synchronized video and audio streams to meet packet-switched network bandwidth constraints |
US20010039663A1 (en) * | 2000-05-03 | 2001-11-08 | Hughes Electronics Corporation | Portable device for use with digital over-the-air communication system for use with terrestrial broadcasting system |
US20010039662A1 (en) * | 2000-05-03 | 2001-11-08 | Hughes Electronics Corporation | Digital over-the-air communication system for use with digital terrestrial broadcasting system |
US7934232B1 (en) | 2000-05-04 | 2011-04-26 | Jerding Dean F | Navigation paradigm for access to television services |
US20010044835A1 (en) * | 2000-05-17 | 2001-11-22 | Schober Joseph Frank | Selecting content to be communicated based on automatic detection of communication bandwidth |
JP2001338218A (en) * | 2000-05-29 | 2001-12-07 | Isao:Kk | System and method for advertisement and computer- readable recording medium with program recorded |
US7260826B2 (en) * | 2000-05-31 | 2007-08-21 | Microsoft Corporation | Resource allocation in multi-stream IP network for optimized quality of service |
US20020078463A1 (en) * | 2000-06-08 | 2002-06-20 | Foster Mark J. | Method and processor engine architecture for the delivery of dynamically compressed audio video content over a broadband network |
US6925651B2 (en) * | 2000-06-08 | 2005-08-02 | Agile Tv Corporation | Method and processor engine architecture for the delivery of audio and video content over a broadband network |
US8069259B2 (en) * | 2000-06-09 | 2011-11-29 | Rodriguez Arturo A | Managing removal of media titles from a list |
US6769127B1 (en) * | 2000-06-16 | 2004-07-27 | Minerva Networks, Inc. | Method and system for delivering media services and application over networks |
US6973501B1 (en) * | 2000-06-21 | 2005-12-06 | Adc Telecommunications, Inc. | Reducing loss in transmission quality under changing network conditions |
CA2312333A1 (en) * | 2000-06-21 | 2001-12-21 | Kimihiko E. Sato | Multimedia compression, coding and transmission method and apparatus |
US7191242B1 (en) | 2000-06-22 | 2007-03-13 | Apple, Inc. | Methods and apparatuses for transferring data |
KR20020000985A (en) * | 2000-06-23 | 2002-01-09 | 오상수 | Internet service server system, computer system and advertising method thereof |
US7630721B2 (en) | 2000-06-27 | 2009-12-08 | Ortiz & Associates Consulting, Llc | Systems, methods and apparatuses for brokering data between wireless devices and data rendering devices |
US7812856B2 (en) | 2000-10-26 | 2010-10-12 | Front Row Technologies, Llc | Providing multiple perspectives of a venue activity to electronic wireless hand held devices |
US7003794B2 (en) * | 2000-06-27 | 2006-02-21 | Bamboo Mediacasting, Inc. | Multicasting transmission of multimedia information |
US7962370B2 (en) * | 2000-06-29 | 2011-06-14 | Rodriguez Arturo A | Methods in a media service system for transaction processing |
DE60122833T2 (en) * | 2000-07-07 | 2007-09-06 | Hitachi, Ltd. | Base station device for transmitting multimedia information |
US7111163B1 (en) | 2000-07-10 | 2006-09-19 | Alterwan, Inc. | Wide area network using internet with quality of service |
US20020028024A1 (en) * | 2000-07-11 | 2002-03-07 | Mediaflow Llc | System and method for calculating an optimum display size for a visual object |
US6671732B1 (en) * | 2000-07-24 | 2003-12-30 | Comverse Ltd. | Method and apparatus for control of content based rich media streaming |
US7277956B2 (en) * | 2000-07-28 | 2007-10-02 | Kasenna, Inc. | System and method for improved utilization of bandwidth in a computer system serving multiple users |
US7310678B2 (en) * | 2000-07-28 | 2007-12-18 | Kasenna, Inc. | System, server, and method for variable bit rate multimedia streaming |
US7117239B1 (en) | 2000-07-28 | 2006-10-03 | Axeda Corporation | Reporting the state of an apparatus to a remote computer |
US7051106B2 (en) * | 2000-08-15 | 2006-05-23 | Lucent Technologies Inc. | Scheduling of calls with known holding times |
US7035912B2 (en) | 2000-08-28 | 2006-04-25 | Abaco.P.R., Inc. | Method and apparatus allowing a limited client device to use the full resources of a networked server |
EP1316218A2 (en) * | 2000-08-29 | 2003-06-04 | Koninklijke Philips Electronics N.V. | Method of running an algorithm and a scalable programmable processing device |
US7016412B1 (en) * | 2000-08-29 | 2006-03-21 | Koninklijke Philips Electronics N.V. | System and method for dynamic adaptive decoding of scalable video to balance CPU load |
WO2002019249A2 (en) * | 2000-09-01 | 2002-03-07 | Moxi Digital Inc. | System and method for intelligent buffering and bandwidth allocation |
US7688803B1 (en) | 2000-09-01 | 2010-03-30 | Young Steven J | System and method for coordinating between multiple telephony channels |
JPWO2002023908A1 (en) * | 2000-09-11 | 2004-01-29 | 村瀬 洋太郎 | Network video / audio distribution method, device thereof, and video / audio creation method |
US8595372B2 (en) * | 2000-09-12 | 2013-11-26 | Wag Acquisition, Llc | Streaming media buffering system |
US6766376B2 (en) | 2000-09-12 | 2004-07-20 | Sn Acquisition, L.L.C | Streaming media buffering system |
US7716358B2 (en) | 2000-09-12 | 2010-05-11 | Wag Acquisition, Llc | Streaming media buffering system |
GB2367219A (en) * | 2000-09-20 | 2002-03-27 | Vintage Global | Streaming of media file data over a dynamically variable bandwidth channel |
US7185014B1 (en) | 2000-09-22 | 2007-02-27 | Axeda Corporation | Retrieving data from a server |
US8108543B2 (en) | 2000-09-22 | 2012-01-31 | Axeda Corporation | Retrieving data from a server |
US8290062B1 (en) * | 2000-09-27 | 2012-10-16 | Intel Corporation | Method and apparatus for manipulating MPEG video |
US7424058B1 (en) | 2000-09-28 | 2008-09-09 | Autodesk, Inc. | Variable bit-rate encoding |
US7103906B1 (en) | 2000-09-29 | 2006-09-05 | International Business Machines Corporation | User controlled multi-device media-on-demand system |
US6968012B1 (en) | 2000-10-02 | 2005-11-22 | Firepad, Inc. | Methods for encoding digital video for decoding on low performance devices |
US7417568B2 (en) * | 2000-10-03 | 2008-08-26 | Realtime Data Llc | System and method for data feed acceleration and encryption |
US6842777B1 (en) | 2000-10-03 | 2005-01-11 | Raja Singh Tuli | Methods and apparatuses for simultaneous access by multiple remote devices |
US8692695B2 (en) | 2000-10-03 | 2014-04-08 | Realtime Data, Llc | Methods for encoding and decoding data |
US9143546B2 (en) | 2000-10-03 | 2015-09-22 | Realtime Data Llc | System and method for data feed acceleration and encryption |
US7191211B2 (en) * | 2000-10-03 | 2007-03-13 | Raja Tuli | Portable high speed internet access device priority protocol |
JP3639517B2 (en) * | 2000-10-04 | 2005-04-20 | 三洋電機株式会社 | Moving picture decoding apparatus and moving picture decoding method |
AU2002213071A1 (en) * | 2000-10-11 | 2002-04-22 | United Video Properties, Inc. | Systems and methods for supplementing on-demand media |
AU2002211570A1 (en) | 2000-10-11 | 2002-04-22 | United Video Properties, Inc. | Systems and methods for caching data in media-on-demand systems |
JP2004511937A (en) * | 2000-10-11 | 2004-04-15 | ユナイテッド ビデオ プロパティーズ, インコーポレイテッド | System and method for providing storage of data in a server of an on-demand media delivery system |
US6985934B1 (en) * | 2000-10-23 | 2006-01-10 | Binham Communications Corporation | Method and system for providing rich media content over a computer network |
WO2002035844A2 (en) * | 2000-10-24 | 2002-05-02 | Eyeball Networks Inc. | Dynamic quality adaptation using personal quality profiles and composite performance metric |
US6915327B1 (en) | 2000-10-30 | 2005-07-05 | Raja Singh Tuli | Portable high speed communication device peripheral connectivity |
US7340759B1 (en) * | 2000-11-10 | 2008-03-04 | Scientific-Atlanta, Inc. | Systems and methods for adaptive pricing in a digital broadband delivery system |
US7319667B1 (en) * | 2000-11-15 | 2008-01-15 | Cisco Technology, Inc. | Communication system with priority data compression |
US7200859B1 (en) | 2000-11-22 | 2007-04-03 | Digeo, Inc. | Apparatus and method for intelligent multimedia compression and distribution |
US8225361B2 (en) * | 2000-11-27 | 2012-07-17 | Cox Communications, Inc. | Remote monitoring and control method and apparatus for an information distribution system |
US7437654B2 (en) * | 2000-11-29 | 2008-10-14 | Lucent Technologies Inc. | Sub-packet adaptation in a wireless communication system |
AU2002222097A1 (en) * | 2000-11-29 | 2002-06-11 | British Telecommunications Public Limited Company | Transmitting and receiving real-time data |
US20020071052A1 (en) * | 2000-12-07 | 2002-06-13 | Tomoaki Itoh | Transmission rate control method |
JP2002290974A (en) * | 2000-12-07 | 2002-10-04 | Matsushita Electric Ind Co Ltd | Transmission rate control method |
AU2002232634A1 (en) * | 2000-12-18 | 2002-07-01 | Agile Tv Corporation | Method and processor engine architecture for the delivery of audio and video content over a broadband network |
KR100449497B1 (en) * | 2000-12-21 | 2004-09-21 | 주식회사 매직아이 | Apparatus and method for providing realtime information |
GB0031539D0 (en) * | 2000-12-22 | 2001-02-07 | Pa Consulting Services | Feedback control to encoder |
GB0031537D0 (en) * | 2000-12-22 | 2001-02-07 | Pa Consulting Services | Feedback control from decoder |
US7127517B2 (en) * | 2000-12-27 | 2006-10-24 | International Business Machines Corporation | Protocol adapter framework for integrating non-IIOP applications into an object server container |
KR20020058635A (en) * | 2000-12-30 | 2002-07-12 | 오길록 | Bandwidth Adaptation Transcording Method using Frame Dropping Ratio |
US6813643B2 (en) | 2001-01-05 | 2004-11-02 | Digeo, Inc. | Multimedia system with selectable protocol module including MPEG logic and docsis logic sharing a single tuner |
US6928461B2 (en) | 2001-01-24 | 2005-08-09 | Raja Singh Tuli | Portable high speed internet access device with encryption |
EP1354275A4 (en) * | 2001-01-26 | 2011-04-27 | Eastman Kodak Co | Method and apparatus for dynamic optimization and network delivery of multimedia content |
US20020116518A1 (en) * | 2001-02-01 | 2002-08-22 | Silen Bradley A. | Fast environment detection and selection of optimized media |
US20020133614A1 (en) * | 2001-02-01 | 2002-09-19 | Samaradasa Weerahandi | System and method for remotely estimating bandwidth between internet nodes |
KR20020065291A (en) * | 2001-02-06 | 2002-08-13 | 넷코덱(주) | Video data compression and transmission method for remote monitoring |
US7386046B2 (en) * | 2001-02-13 | 2008-06-10 | Realtime Data Llc | Bandwidth sensitive data compression and decompression |
US20020116705A1 (en) * | 2001-02-20 | 2002-08-22 | Perlman Stephen G. | System and method for processing conditional access data |
US20030018978A1 (en) * | 2001-03-02 | 2003-01-23 | Singal Sanjay S. | Transfer file format and system and method for distributing media content |
EP1374080A2 (en) * | 2001-03-02 | 2004-01-02 | Kasenna, Inc. | Metadata enabled push-pull model for efficient low-latency video-content distribution over a network |
WO2002073963A1 (en) | 2001-03-12 | 2002-09-19 | Polycom, Inc. | A low-delay video encoding method for concealing the effects of packet loss in multi-channel packet switched networks |
EP1725038A3 (en) * | 2001-03-12 | 2009-08-26 | Polycom, Inc. | A low-delay video encoding method for concealing the effects of packet loss in multi-channel packet switched networks |
EP1241891A1 (en) * | 2001-03-13 | 2002-09-18 | eJay AG | Apparatus and method for transmitting audio and/or video data |
US6708337B2 (en) * | 2001-03-16 | 2004-03-16 | Qedsoft, Inc. | Dynamic multimedia streaming using time-stamped remote instructions |
US7046805B2 (en) * | 2001-03-20 | 2006-05-16 | Digeo, Inc. | System and method for efficiently storing and processing multimedia content |
US7602847B1 (en) | 2001-03-27 | 2009-10-13 | Vixs Systems, Inc. | Device and method for compression of a video stream |
EP1261204A2 (en) * | 2001-03-29 | 2002-11-27 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for data reproduction |
US8107524B2 (en) * | 2001-03-30 | 2012-01-31 | Vixs Systems, Inc. | Adaptive bandwidth footprint matching for multiple compressed video streams in a fixed bandwidth network |
US20070053428A1 (en) * | 2001-03-30 | 2007-03-08 | Vixs Systems, Inc. | Managed degradation of a video stream |
GB2374746B (en) * | 2001-04-19 | 2005-04-13 | Discreet Logic Inc | Displaying image data |
US20020169880A1 (en) * | 2001-04-19 | 2002-11-14 | Koninklijke Philips Electronics N.V. | Method and device for robust real-time estimation of the bottleneck bandwidth in the internet |
US7072297B2 (en) * | 2001-04-30 | 2006-07-04 | Networks Physics, Inc. | Method for dynamical identification of network congestion characteristics |
US7551560B1 (en) * | 2001-04-30 | 2009-06-23 | Opnet Technologies, Inc. | Method of reducing packet loss by resonance identification in communication networks |
US20050021804A1 (en) * | 2001-05-08 | 2005-01-27 | Heino Hameleers | Method and system for controlling the transmission of media streams |
US6665002B2 (en) * | 2001-05-11 | 2003-12-16 | Leadtek Research Inc. | Real-time video/audio quality adjustment method |
US20020178286A1 (en) * | 2001-05-23 | 2002-11-28 | Roger Booker | Video file transfer network |
US7093277B2 (en) * | 2001-05-30 | 2006-08-15 | Digeo, Inc. | System and method for improved multi-stream multimedia transmission and processing |
US7386129B2 (en) | 2001-05-30 | 2008-06-10 | Digeo, Inc. | System and method for multimedia content simulcast |
US20020188745A1 (en) * | 2001-06-11 | 2002-12-12 | Hughes David A. | Stacked stream for providing content to multiple types of client devices |
AU2002305877A1 (en) * | 2001-06-13 | 2002-12-23 | Automated Energy, Inc. | Utility metering slider bar |
US20030009765A1 (en) * | 2001-06-22 | 2003-01-09 | Linden Thomas M. | Multiple program burst broadcast |
US6792449B2 (en) * | 2001-06-28 | 2004-09-14 | Microsoft Corporation | Startup methods and apparatuses for use in streaming content |
US7526788B2 (en) * | 2001-06-29 | 2009-04-28 | Scientific-Atlanta, Inc. | Graphic user interface alternate download options for unavailable PRM content |
US8006262B2 (en) * | 2001-06-29 | 2011-08-23 | Rodriguez Arturo A | Graphic user interfaces for purchasable and recordable media (PRM) downloads |
US7512964B2 (en) * | 2001-06-29 | 2009-03-31 | Cisco Technology | System and method for archiving multiple downloaded recordable media content |
US7496945B2 (en) * | 2001-06-29 | 2009-02-24 | Cisco Technology, Inc. | Interactive program guide for bidirectional services |
US8209429B2 (en) * | 2001-07-19 | 2012-06-26 | British Telecommunications Public Limited Company | Video stream switching |
US6959348B1 (en) * | 2001-07-30 | 2005-10-25 | Vixs Systems, Inc. | Method and system for accessing data |
US7675972B1 (en) | 2001-07-30 | 2010-03-09 | Vixs Systems, Inc. | System and method for multiple channel video transcoding |
JP2003046977A (en) * | 2001-07-31 | 2003-02-14 | Matsushita Electric Ind Co Ltd | Relay server |
US7463737B2 (en) * | 2001-08-15 | 2008-12-09 | Digeo, Inc. | System and method for conditional access key encryption |
US20030039226A1 (en) * | 2001-08-24 | 2003-02-27 | Kwak Joseph A. | Physical layer automatic repeat request (ARQ) |
WO2003025898A1 (en) * | 2001-09-14 | 2003-03-27 | Automated Energy, Inc. | Utility monitoring and management system |
FI115418B (en) * | 2001-09-20 | 2005-04-29 | Oplayo Oy | Adaptive media stream |
KR20040041170A (en) * | 2001-09-21 | 2004-05-14 | 브리티쉬 텔리커뮤니케이션즈 파블릭 리미티드 캄퍼니 | Data communications method and system using receiving buffer size to calculate transmission rate for congestion control |
KR20030026109A (en) * | 2001-09-24 | 2003-03-31 | 엠큐브웍스(주) | Apparatus and Method for transmiting multimedia data to adapt channel condition |
US8370517B2 (en) * | 2001-09-27 | 2013-02-05 | International Business Machines Corporation | Conserving energy in a data processing network |
FR2831742B1 (en) * | 2001-10-25 | 2004-02-27 | Cit Alcatel | METHOD FOR TRANSMITTING PACKETS VIA A TELECOMMUNICATIONS NETWORK USING THE IP PROTOCOL |
US7139330B1 (en) | 2001-10-31 | 2006-11-21 | Vixs Systems, Inc. | System for signal mixing and method thereof |
US7596127B1 (en) | 2001-10-31 | 2009-09-29 | Vixs Systems, Inc. | System for allocating data in a communications system and method thereof |
WO2003041413A1 (en) * | 2001-11-05 | 2003-05-15 | Pa Consulting Services Limited | Error control to video encoder |
US7171444B2 (en) * | 2001-11-14 | 2007-01-30 | Sharp Laboratories Of America, Inc. | Remote desktop protocol compression system |
US7106715B1 (en) | 2001-11-16 | 2006-09-12 | Vixs Systems, Inc. | System for providing data to multiple devices and method thereof |
US7403564B2 (en) * | 2001-11-21 | 2008-07-22 | Vixs Systems, Inc. | System and method for multiple channel video transcoding |
US7356079B2 (en) * | 2001-11-21 | 2008-04-08 | Vixs Systems Inc. | Method and system for rate control during video transcoding |
US7165180B1 (en) | 2001-11-27 | 2007-01-16 | Vixs Systems, Inc. | Monolithic semiconductor device for preventing external access to an encryption key |
AU2002365821A1 (en) * | 2001-11-30 | 2003-06-17 | British Telecommunications Public Limited Company | Data transmission |
EP1459493A1 (en) * | 2001-12-11 | 2004-09-22 | Koninklijke Philips Electronics N.V. | System for transmitting additional information via a network |
EP1320216A1 (en) * | 2001-12-11 | 2003-06-18 | BRITISH TELECOMMUNICATIONS public limited company | Method and device for multicast transmission |
CN101527684A (en) * | 2001-12-15 | 2009-09-09 | 汤姆森许可公司 | System and method for delivering data streams of multiple data types at different priority levels |
US7254601B2 (en) | 2001-12-20 | 2007-08-07 | Questra Corporation | Method and apparatus for managing intelligent assets in a distributed environment |
US20030161324A1 (en) * | 2002-01-16 | 2003-08-28 | Aviom, Inc. | System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost |
US7529263B1 (en) * | 2002-01-19 | 2009-05-05 | Ucentric Systems, Inc. | Local area-networked system having intelligent traffic control and efficient bandwidth management |
US20030139966A1 (en) * | 2002-01-23 | 2003-07-24 | Sirota Peter L. | Advertisement delivery for streaming program |
KR20030066276A (en) * | 2002-02-01 | 2003-08-09 | (주)리얼미디어코리아 | A system and method for providing moving picture advertisement service using internet |
US7334251B2 (en) * | 2002-02-11 | 2008-02-19 | Scientific-Atlanta, Inc. | Management of television advertising |
US7627886B2 (en) * | 2002-03-04 | 2009-12-01 | Microsoft Corporation | Systems and methods for displaying video streams |
JP4039086B2 (en) * | 2002-03-05 | 2008-01-30 | ソニー株式会社 | Information processing apparatus and information processing method, information processing system, recording medium, and program |
KR20040091731A (en) * | 2002-03-14 | 2004-10-28 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Method of and system for multi-path communication |
US8671213B2 (en) * | 2002-03-14 | 2014-03-11 | Citrix Systems, Inc. | Methods and apparatus for generating graphical and media displays at a client |
US7324695B2 (en) * | 2002-03-18 | 2008-01-29 | Seimens Medical Solutions Usa, Inc. | Prioritized image visualization from scalable compressed data |
US20050120038A1 (en) * | 2002-03-27 | 2005-06-02 | Jebb Timothy R. | Data structure for data streaming system |
DE60335178D1 (en) * | 2002-03-27 | 2011-01-13 | British Telecomm | VIDEO CODING AND TRANSMISSION |
EP1359722A1 (en) * | 2002-03-27 | 2003-11-05 | BRITISH TELECOMMUNICATIONS public limited company | Data streaming system and method |
ATE386387T1 (en) * | 2002-04-03 | 2008-03-15 | Gsbs Dev Corp | COMMUNICATION SYSTEM AND METHOD FOR SEQUENTIAL DATA TRANSMISSION IN A FIRE DETECTION NETWORK |
CN1640095A (en) * | 2002-04-08 | 2005-07-13 | 三菱电机株式会社 | Data transmission apparatus and data transmission method |
US7668901B2 (en) * | 2002-04-15 | 2010-02-23 | Avid Technology, Inc. | Methods and system using a local proxy server to process media data for local area users |
US7178149B2 (en) * | 2002-04-17 | 2007-02-13 | Axeda Corporation | XML scripting of soap commands |
JP3689063B2 (en) * | 2002-04-19 | 2005-08-31 | 松下電器産業株式会社 | Data receiving apparatus and data distribution system |
US7450645B2 (en) * | 2002-04-26 | 2008-11-11 | Interuniversitair Microelektronica Centrum Vzw (Imec) | Method and system for transmitting digital signals between nodes of a network for optimized processing at the receiving node |
WO2003092296A1 (en) * | 2002-04-26 | 2003-11-06 | Nec Corporation | Moving picture data code conversion/transmission method and device, code conversion/reception method and device |
WO2003092295A1 (en) * | 2002-04-26 | 2003-11-06 | Nec Corporation | Moving image transferring system, moving image encoding apparatus, moving image decoding apparatus, and moving image transferring program |
US20050117643A1 (en) * | 2002-04-26 | 2005-06-02 | Nec Corporation | Moving image transferring system, moving image encoding apparatus, moving image decoding apparatus, and moving image transferring program |
US7310679B1 (en) | 2002-04-29 | 2007-12-18 | Vixs Systems Inc. | Method and system for transmitting video content while preventing other transmissions in a contention-based network |
US7120253B2 (en) * | 2002-05-02 | 2006-10-10 | Vixs Systems, Inc. | Method and system for protecting video data |
US20030223733A1 (en) * | 2002-05-14 | 2003-12-04 | Intelligent Digital Systems Llc | System and method of processing audio/video data in a remote monitoring system |
JP2005526455A (en) * | 2002-05-22 | 2005-09-02 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Transmission method that absorbs fluctuation of channel transmission rate using virtual reception buffer |
US7450646B2 (en) * | 2002-06-04 | 2008-11-11 | Panasonic Corporation | Image data transmitting apparatus and method and image data reproducing apparatus and method |
US7725557B2 (en) * | 2002-06-24 | 2010-05-25 | Microsoft Corporation | Client-side caching of streaming media content |
US20040059978A1 (en) * | 2002-06-25 | 2004-03-25 | Parvathanathan Subrahmanya | Reduced latency for recovery from communications errors |
JP2004056394A (en) * | 2002-07-18 | 2004-02-19 | Fujitsu Ltd | Control apparatus for controlling capturing apparatus and storage apparatus via lan, capturing apparatus for the same, storage apparatus, program, and method |
US20040022322A1 (en) * | 2002-07-19 | 2004-02-05 | Meetrix Corporation | Assigning prioritization during encode of independently compressed objects |
US7533398B2 (en) * | 2002-07-26 | 2009-05-12 | The Associated Press | Automatic selection of encoding parameters for transmission of media objects |
US6618776B1 (en) | 2002-08-15 | 2003-09-09 | Logitech Europe, S.A. | USB bandwidth monitor |
GB0218961D0 (en) * | 2002-08-15 | 2002-09-25 | Koninkl Philips Electronics Nv | Transmission method and system |
KR100663586B1 (en) * | 2002-08-28 | 2007-01-02 | 삼성전자주식회사 | Method and apparatus transmitting a header compressed packet data |
KR100949755B1 (en) * | 2002-09-05 | 2010-03-25 | 에이전시 포 사이언스, 테크놀로지 앤드 리서치 | A method and an apparatus for controlling the rate of a video sequence, a video encoding device |
KR100486713B1 (en) * | 2002-09-17 | 2005-05-03 | 삼성전자주식회사 | Apparatus and method for streaming multimedia data |
US7412703B2 (en) * | 2002-09-19 | 2008-08-12 | Sedna Patent Services, Llc | Low cost, highly accurate video server bit-rate compensation |
JP3893344B2 (en) * | 2002-10-03 | 2007-03-14 | 松下電器産業株式会社 | Image encoding method and image encoding apparatus |
US7190670B2 (en) * | 2002-10-04 | 2007-03-13 | Nokia Corporation | Method and apparatus for multimedia streaming in a limited bandwidth network with a bottleneck link |
JP4040426B2 (en) * | 2002-10-18 | 2008-01-30 | 富士通株式会社 | Data transmission device |
JP4034169B2 (en) * | 2002-11-05 | 2008-01-16 | 株式会社エヌ・ティ・ティ・ドコモ | Mobile communication system, radio control apparatus, base station, and communication method |
US7716312B2 (en) | 2002-11-13 | 2010-05-11 | Avid Technology, Inc. | Method and system for transferring large data files over parallel connections |
US20040199650A1 (en) * | 2002-11-14 | 2004-10-07 | Howe John E. | System and methods for accelerating data delivery |
US7558323B2 (en) * | 2002-11-27 | 2009-07-07 | Hitachi Kokusai Electric Inc. | Video data transmission method for changing transmission data amounts in accordance with a transmission speed and a transmission system therefor |
US8176428B2 (en) * | 2002-12-03 | 2012-05-08 | Datawind Net Access Corporation | Portable internet access device back page cache |
US20040131122A1 (en) * | 2002-12-09 | 2004-07-08 | Kei Kudo | Encoding device and encoding method |
US7366199B1 (en) * | 2002-12-10 | 2008-04-29 | Apple Inc. | Method and apparatus measuring bandwidth |
US20040141555A1 (en) * | 2003-01-16 | 2004-07-22 | Rault Patrick M. | Method of motion vector prediction and system thereof |
US7408989B2 (en) * | 2003-01-16 | 2008-08-05 | Vix5 Systems Inc | Method of video encoding using windows and system thereof |
US7920630B2 (en) * | 2003-01-21 | 2011-04-05 | Broadcom Corporation | Buffer descriptor data structure for communication link between decode and display processes in MPEG decoders |
US7493646B2 (en) | 2003-01-30 | 2009-02-17 | United Video Properties, Inc. | Interactive television systems with digital video recording and adjustable reminders |
CN1754385B (en) * | 2003-02-21 | 2010-07-21 | 日本电气株式会社 | Image data distribution device, method, image data receiving method |
US7966418B2 (en) | 2003-02-21 | 2011-06-21 | Axeda Corporation | Establishing a virtual tunnel between two computer programs |
US7606305B1 (en) | 2003-02-24 | 2009-10-20 | Vixs Systems, Inc. | Method and system for transcoding video data |
US7133452B1 (en) | 2003-02-24 | 2006-11-07 | Vixs Systems, Inc. | Method and system for transcoding video data |
US7327784B2 (en) * | 2003-02-24 | 2008-02-05 | Vixs Systems, Inc. | Method and system for transcoding video data |
US7130350B1 (en) | 2003-02-28 | 2006-10-31 | Vixs Systems, Inc. | Method and system for encoding and decoding data in a video stream |
US20110181686A1 (en) * | 2003-03-03 | 2011-07-28 | Apple Inc. | Flow control |
JP2004272563A (en) * | 2003-03-07 | 2004-09-30 | Fujitsu Ltd | Communication control program, content distribution program, terminal equipment, and content server |
GB0306296D0 (en) * | 2003-03-19 | 2003-04-23 | British Telecomm | Data transmission |
EP1627524A4 (en) * | 2003-03-20 | 2009-05-27 | Ge Security Inc | Systems and methods for multi-resolution image processing |
GB0306973D0 (en) * | 2003-03-26 | 2003-04-30 | British Telecomm | Transmitting video |
US7526565B2 (en) * | 2003-04-03 | 2009-04-28 | International Business Machines Corporation | Multiple description hinting and switching for adaptive media services |
US20060051059A1 (en) | 2004-09-08 | 2006-03-09 | Krakirian Haig H | Video recorder having user extended and automatically extended time slots |
US7395346B2 (en) | 2003-04-22 | 2008-07-01 | Scientific-Atlanta, Inc. | Information frame modifier |
US20040221305A1 (en) * | 2003-04-30 | 2004-11-04 | International Business Machines Corporation | Apparatus, method and computer programming product for cable TV service portability |
US20040252197A1 (en) * | 2003-05-05 | 2004-12-16 | News Iq Inc. | Mobile device management system |
US20040240752A1 (en) * | 2003-05-13 | 2004-12-02 | Dobbs Andrew Bruno | Method and system for remote and adaptive visualization of graphical image data |
US7739105B2 (en) * | 2003-06-13 | 2010-06-15 | Vixs Systems, Inc. | System and method for processing audio frames |
US7274740B2 (en) * | 2003-06-25 | 2007-09-25 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US20040268400A1 (en) * | 2003-06-26 | 2004-12-30 | Microsoft Corporation | Quick starting video content |
US7054774B2 (en) | 2003-06-27 | 2006-05-30 | Microsoft Corporation | Midstream determination of varying bandwidth availability |
US20050052465A1 (en) * | 2003-07-03 | 2005-03-10 | Moore Richard L. | Wireless keyboard, video, mouse device |
FR2857198B1 (en) * | 2003-07-03 | 2005-08-26 | Canon Kk | QUALITY OF SERVICE OPTIMIZATION IN THE DISTRIBUTION OF DIGITAL DATA STREAMS |
US20050044260A1 (en) * | 2003-08-08 | 2005-02-24 | Maven Networks, Inc. | System and method for delivery of broadband content |
US20050034153A1 (en) * | 2003-08-08 | 2005-02-10 | Maven Networks, Inc. | System and method for delivery of broadband content with integrated interactive elements |
WO2005020565A1 (en) | 2003-08-11 | 2005-03-03 | Warner Bros. Entertainment Inc. | Digital media distribution device |
US7822123B2 (en) * | 2004-10-06 | 2010-10-26 | Microsoft Corporation | Efficient repeat padding for hybrid video sequence with arbitrary video resolution |
US7844992B2 (en) * | 2003-09-10 | 2010-11-30 | Thomson Licensing | Video on demand server system and method |
WO2005029224A2 (en) * | 2003-09-12 | 2005-03-31 | Arkados, Inc. | Method and system for distributed content management and delivery |
WO2005029237A2 (en) * | 2003-09-15 | 2005-03-31 | Digital Networks North America, Inc. | Method and system for adaptive transcoding and transrating in a video network |
US7634558B1 (en) * | 2003-09-22 | 2009-12-15 | Sprint Spectrum L.P. | Method and system for updating network presence records at a rate dependent on network load |
US7668396B2 (en) * | 2003-09-29 | 2010-02-23 | Vixs Systems, Inc. | Method and system for noise reduction in an image |
US7277101B2 (en) | 2003-09-29 | 2007-10-02 | Vixs Systems Inc | Method and system for scaling images |
WO2005034092A2 (en) * | 2003-09-29 | 2005-04-14 | Handheld Entertainment, Inc. | Method and apparatus for coding information |
US9325998B2 (en) | 2003-09-30 | 2016-04-26 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7308649B2 (en) | 2003-09-30 | 2007-12-11 | International Business Machines Corporation | Providing scalable, alternative component-level views |
US7502834B2 (en) * | 2003-09-30 | 2009-03-10 | International Business Machines Corporation | Autonomic content load balancing |
JP4362702B2 (en) * | 2003-10-14 | 2009-11-11 | 日本電気株式会社 | Video distribution system and method and program |
US20050091693A1 (en) * | 2003-10-22 | 2005-04-28 | Rochelle Communications, Inc. | Dual mode set-top box that optimizes the delivery and user selection of audio or video programming over data networks |
US7016409B2 (en) | 2003-11-12 | 2006-03-21 | Sony Corporation | Apparatus and method for use in providing dynamic bit rate encoding |
US7475322B2 (en) * | 2003-11-14 | 2009-01-06 | Avocent Huntsville Corporation | Wireless broadcast protocol |
US7599002B2 (en) * | 2003-12-02 | 2009-10-06 | Logitech Europe S.A. | Network camera mounting system |
US20050120128A1 (en) * | 2003-12-02 | 2005-06-02 | Wilife, Inc. | Method and system of bandwidth management for streaming data |
US7778326B1 (en) | 2003-12-23 | 2010-08-17 | At&T Intellectual Property Ii, L.P. | System and method for dynamically determining multimedia transmission based on communication bandwidth |
JP2005191933A (en) * | 2003-12-25 | 2005-07-14 | Funai Electric Co Ltd | Transmitter and transceiver system |
US20050183120A1 (en) * | 2004-01-13 | 2005-08-18 | Saurabh Jain | Multi-user personalized digital multimedia distribution methods and systems |
EP1709530A2 (en) * | 2004-01-20 | 2006-10-11 | Broadcom Corporation | System and method for supporting multiple users |
US8161388B2 (en) * | 2004-01-21 | 2012-04-17 | Rodriguez Arturo A | Interactive discovery of display device characteristics |
ATE491291T1 (en) * | 2004-01-30 | 2010-12-15 | Ericsson Telefon Ab L M | PACKET SEQUENCE CONTROL FOR DATA STREAM TRANSMISSION |
US7406598B2 (en) * | 2004-02-17 | 2008-07-29 | Vixs Systems Inc. | Method and system for secure content distribution |
US8018850B2 (en) * | 2004-02-23 | 2011-09-13 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
GB0406901D0 (en) * | 2004-03-26 | 2004-04-28 | British Telecomm | Transmitting recorded material |
US20050234961A1 (en) * | 2004-04-16 | 2005-10-20 | Pinnacle Systems, Inc. | Systems and Methods for providing a proxy for a shared file system |
US20050262245A1 (en) * | 2004-04-19 | 2005-11-24 | Satish Menon | Scalable cluster-based architecture for streaming media |
US7162533B2 (en) | 2004-04-30 | 2007-01-09 | Microsoft Corporation | Session description message extensions |
US9998802B2 (en) * | 2004-06-07 | 2018-06-12 | Sling Media LLC | Systems and methods for creating variable length clips from a media stream |
US7917932B2 (en) | 2005-06-07 | 2011-03-29 | Sling Media, Inc. | Personal video recorder functionality for placeshifting systems |
EP1769399B1 (en) | 2004-06-07 | 2020-03-18 | Sling Media L.L.C. | Personal media broadcasting system |
US8099755B2 (en) * | 2004-06-07 | 2012-01-17 | Sling Media Pvt. Ltd. | Systems and methods for controlling the encoding of a media stream |
US7975062B2 (en) | 2004-06-07 | 2011-07-05 | Sling Media, Inc. | Capturing and sharing media content |
US8346605B2 (en) * | 2004-06-07 | 2013-01-01 | Sling Media, Inc. | Management of shared media content |
US7769756B2 (en) * | 2004-06-07 | 2010-08-03 | Sling Media, Inc. | Selection and presentation of context-relevant supplemental content and advertising |
US7684404B1 (en) * | 2004-06-10 | 2010-03-23 | Intel Corporation | Asynchronous transfer mode (ATM) cell formatting |
US7984179B1 (en) | 2004-06-29 | 2011-07-19 | Sextant Navigation, Inc. | Adaptive media transport management for continuous media stream over LAN/WAN environment |
US20070226344A1 (en) * | 2004-07-23 | 2007-09-27 | General Instrument Corporation | Centralized Resource Manager With Power Switching System |
US7571246B2 (en) * | 2004-07-29 | 2009-08-04 | Microsoft Corporation | Media transrating over a bandwidth-limited network |
US8904458B2 (en) * | 2004-07-29 | 2014-12-02 | At&T Intellectual Property I, L.P. | System and method for pre-caching a first portion of a video file on a set-top box |
US8086575B2 (en) * | 2004-09-23 | 2011-12-27 | Rovi Solutions Corporation | Methods and apparatus for integrating disparate media formats in a networked media system |
US20060073843A1 (en) * | 2004-10-01 | 2006-04-06 | Naveen Aerrabotu | Content formatting and device configuration in group communication sessions |
US8243820B2 (en) * | 2004-10-06 | 2012-08-14 | Microsoft Corporation | Decoding variable coded resolution video with native range/resolution post-processing operation |
US9071847B2 (en) | 2004-10-06 | 2015-06-30 | Microsoft Technology Licensing, Llc | Variable coding resolution in video codec |
US7839933B2 (en) * | 2004-10-06 | 2010-11-23 | Microsoft Corporation | Adaptive vertical macroblock alignment for mixed frame video sequences |
US20060084459A1 (en) * | 2004-10-13 | 2006-04-20 | Vinh Phan | Outer loop power control of user equipment in wireless communication |
US7797723B2 (en) * | 2004-10-30 | 2010-09-14 | Sharp Laboratories Of America, Inc. | Packet scheduling for video transmission with sender queue control |
US7784076B2 (en) * | 2004-10-30 | 2010-08-24 | Sharp Laboratories Of America, Inc. | Sender-side bandwidth estimation for video transmission with receiver packet buffer |
US8356327B2 (en) * | 2004-10-30 | 2013-01-15 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7450128B2 (en) * | 2004-11-15 | 2008-11-11 | Hewlett-Packard Development Company, L.P. | Systems and methods of providing image copy and modify commands to a receiver with an associated display |
KR100669634B1 (en) * | 2004-12-06 | 2007-01-15 | 엘지전자 주식회사 | Methods for encoding and decoding moving picture data |
WO2006076220A2 (en) * | 2005-01-10 | 2006-07-20 | Swagelok Company | Carburization of ferrous-based shape memory alloys |
US7830960B2 (en) * | 2005-01-13 | 2010-11-09 | Qualcomm Incorporated | Mode selection techniques for intra-prediction video encoding |
US8112083B1 (en) | 2005-01-18 | 2012-02-07 | Sprint Spectrum L.P. | Method and system for dynamic adjustment of radio frequency registration period based on load conditions |
US7421048B2 (en) * | 2005-01-20 | 2008-09-02 | Vixs Systems, Inc. | System and method for multimedia delivery in a wireless environment |
US7609766B2 (en) * | 2005-02-08 | 2009-10-27 | Vixs Systems, Inc. | System of intra-picture complexity preprocessing |
US20060184697A1 (en) * | 2005-02-11 | 2006-08-17 | Microsoft Corporation | Detecting clock drift in networked devices through monitoring client buffer fullness |
US20080022343A1 (en) * | 2006-07-24 | 2008-01-24 | Vvond, Inc. | Multiple audio streams |
US8949920B2 (en) * | 2005-03-17 | 2015-02-03 | Vixs Systems Inc. | System and method for storage device emulation in a multimedia processing system |
US7400869B2 (en) * | 2005-03-22 | 2008-07-15 | Vixs Systems Inc. | System and method for adaptive DC offset compensation in wireless transmissions |
US8081657B2 (en) * | 2005-03-22 | 2011-12-20 | Bigband Networks Inc. | Method and device for providing video, data and voice to end user devices |
US8560753B1 (en) | 2005-03-30 | 2013-10-15 | Teradici Corporation | Method and apparatus for remote input/output in a computer system |
US7516255B1 (en) | 2005-03-30 | 2009-04-07 | Teradici Corporation | Method and apparatus for providing a low-latency connection between a data processor and a remote graphical user interface over a network |
US8335239B2 (en) * | 2005-03-31 | 2012-12-18 | At&T Intellectual Property I, L.P. | Methods, systems, and devices for bandwidth conservation |
US8306033B2 (en) * | 2005-03-31 | 2012-11-06 | At&T Intellectual Property I, L.P. | Methods, systems, and computer program products for providing traffic control services |
US8024438B2 (en) | 2005-03-31 | 2011-09-20 | At&T Intellectual Property, I, L.P. | Methods, systems, and computer program products for implementing bandwidth management services |
US7975283B2 (en) * | 2005-03-31 | 2011-07-05 | At&T Intellectual Property I, L.P. | Presence detection in a bandwidth management system |
US8098582B2 (en) * | 2005-03-31 | 2012-01-17 | At&T Intellectual Property I, L.P. | Methods, systems, and computer program products for implementing bandwidth control services |
US9973817B1 (en) | 2005-04-08 | 2018-05-15 | Rovi Guides, Inc. | System and method for providing a list of video-on-demand programs |
US20060235883A1 (en) | 2005-04-18 | 2006-10-19 | Krebs Mark S | Multimedia system for mobile client platforms |
KR101223234B1 (en) * | 2005-05-04 | 2013-01-17 | 삼성전자주식회사 | Apparatus and method for changing channel in digital broadcasting system |
US11733958B2 (en) | 2005-05-05 | 2023-08-22 | Iii Holdings 1, Llc | Wireless mesh-enabled system, host device, and method for use therewith |
US8019883B1 (en) * | 2005-05-05 | 2011-09-13 | Digital Display Innovations, Llc | WiFi peripheral mode display system |
US7743183B2 (en) * | 2005-05-23 | 2010-06-22 | Microsoft Corporation | Flow control for media streaming |
US20070003224A1 (en) * | 2005-06-30 | 2007-01-04 | Jason Krikorian | Screen Management System for Media Player |
US7702952B2 (en) * | 2005-06-30 | 2010-04-20 | Sling Media, Inc. | Firmware update for consumer electronic device |
US7933294B2 (en) * | 2005-07-20 | 2011-04-26 | Vidyo, Inc. | System and method for low-delay, interactive communication using multiple TCP connections and scalable coding |
US8289370B2 (en) | 2005-07-20 | 2012-10-16 | Vidyo, Inc. | System and method for scalable and low-delay videoconferencing using scalable video coding |
US7979885B2 (en) * | 2005-08-11 | 2011-07-12 | Harmonic Inc. | Real time bit rate switching for internet protocol television |
US20070044123A1 (en) * | 2005-08-16 | 2007-02-22 | Alcatel | System and method for smoothing channel changing in internet protocol television systems |
US7817849B2 (en) * | 2005-08-18 | 2010-10-19 | Hewlett-Packard Development Company, L.P. | Method and apparatus for graphical data compression |
US8104054B2 (en) | 2005-09-01 | 2012-01-24 | At&T Intellectual Property I, L.P. | Methods, systems, and devices for bandwidth conservation |
US8701148B2 (en) | 2005-09-01 | 2014-04-15 | At&T Intellectual Property I, L.P. | Methods, systems, and devices for bandwidth conservation |
US8189472B2 (en) * | 2005-09-07 | 2012-05-29 | Mcdonald James F | Optimizing bandwidth utilization to a subscriber premises |
US20070067480A1 (en) * | 2005-09-19 | 2007-03-22 | Sharp Laboratories Of America, Inc. | Adaptive media playout by server media processing for robust streaming |
US7707485B2 (en) | 2005-09-28 | 2010-04-27 | Vixs Systems, Inc. | System and method for dynamic transrating based on content |
US20070079342A1 (en) | 2005-09-30 | 2007-04-05 | Guideworks, Llc | Systems and methods for managing local storage of on-demand content |
JP2009512265A (en) * | 2005-10-06 | 2009-03-19 | イージーシー アンド シー カンパニー リミテッド | Video data transmission control system and method on network |
KR100664955B1 (en) * | 2005-10-20 | 2007-01-04 | 삼성전자주식회사 | Method for controlling download speed of broadcast receiving device and apparatus for the same |
CA2628095A1 (en) * | 2005-11-01 | 2007-05-10 | Telcordia Technologies, Inc. | System and method for high qos digital content-based services |
US7877517B2 (en) | 2005-11-09 | 2011-01-25 | International Business Machines Corporation | Determining whether to compress data transmitted over a network |
US20070112826A1 (en) * | 2005-11-10 | 2007-05-17 | Vixs Systems, Inc. | Multimedia transcoding based on remaining storage capacity |
US20070139189A1 (en) * | 2005-12-05 | 2007-06-21 | Helmig Kevin S | Multi-platform monitoring system and method |
KR100744542B1 (en) * | 2005-12-08 | 2007-08-01 | 한국전자통신연구원 | Apparatus and method for multi-codec variable bandwidth QoS control |
US9681105B2 (en) | 2005-12-29 | 2017-06-13 | Rovi Guides, Inc. | Interactive media guidance system having multiple devices |
US8607287B2 (en) * | 2005-12-29 | 2013-12-10 | United Video Properties, Inc. | Interactive media guidance system having multiple devices |
US20070157240A1 (en) * | 2005-12-29 | 2007-07-05 | United Video Properties, Inc. | Interactive media guidance system having multiple devices |
US9544602B2 (en) * | 2005-12-30 | 2017-01-10 | Sharp Laboratories Of America, Inc. | Wireless video transmission system |
US7956930B2 (en) | 2006-01-06 | 2011-06-07 | Microsoft Corporation | Resampling and picture resizing operations for multi-resolution video coding and decoding |
US8131995B2 (en) * | 2006-01-24 | 2012-03-06 | Vixs Systems, Inc. | Processing feature revocation and reinvocation |
US7793329B2 (en) * | 2006-02-06 | 2010-09-07 | Kasenna, Inc. | Method and system for reducing switching delays between digital video feeds using multicast slotted transmission technique |
JP4568246B2 (en) * | 2006-03-30 | 2010-10-27 | 株式会社東芝 | Server device |
US7652994B2 (en) * | 2006-03-31 | 2010-01-26 | Sharp Laboratories Of America, Inc. | Accelerated media coding for robust low-delay video streaming over time-varying and bandwidth limited channels |
KR100834755B1 (en) * | 2006-04-03 | 2008-06-05 | 삼성전자주식회사 | Broadcasting channel grouping apparatus and channel changing method for IP TV |
GB2440582A (en) * | 2006-08-04 | 2008-02-06 | Siemens Ag | Resource allocation in a broadcast service |
US20080123660A1 (en) * | 2006-08-09 | 2008-05-29 | Interdigital Technology Corporation | Method and apparatus for providing differentiated quality of service for packets in a particular flow |
EP2053797B1 (en) * | 2006-08-16 | 2012-10-31 | Fujitsu Limited | Multichannel data transfer apparatus and method |
US7898950B2 (en) * | 2006-08-18 | 2011-03-01 | Microsoft Corporation | Techniques to perform rate matching for multimedia conference calls |
US20080062322A1 (en) * | 2006-08-28 | 2008-03-13 | Ortiva Wireless | Digital video content customization |
US8606966B2 (en) * | 2006-08-28 | 2013-12-10 | Allot Communications Ltd. | Network adaptation of digital content |
US8773494B2 (en) * | 2006-08-29 | 2014-07-08 | Microsoft Corporation | Techniques for managing visual compositions for a multimedia conference call |
KR100893863B1 (en) * | 2006-09-05 | 2009-04-20 | 엘지전자 주식회사 | Method of transmitting link-adaptive transmission of data stream in mobile communication system |
US8861597B2 (en) * | 2006-09-18 | 2014-10-14 | Sharp Laboratories Of America, Inc. | Distributed channel time allocation for video streaming over wireless networks |
US8370479B2 (en) | 2006-10-03 | 2013-02-05 | Axeda Acquisition Corporation | System and method for dynamically grouping devices based on present device conditions |
US7743161B2 (en) * | 2006-10-10 | 2010-06-22 | Ortiva Wireless, Inc. | Digital content buffer for adaptive streaming |
US20080101410A1 (en) * | 2006-10-25 | 2008-05-01 | Microsoft Corporation | Techniques for managing output bandwidth for a conferencing server |
US20080115185A1 (en) * | 2006-10-31 | 2008-05-15 | Microsoft Corporation | Dynamic modification of video properties |
US20080109557A1 (en) * | 2006-11-02 | 2008-05-08 | Vinay Joshi | Method and system for reducing switching delays between digital video feeds using personalized unicast transmission techniques |
US7652993B2 (en) * | 2006-11-03 | 2010-01-26 | Sharp Laboratories Of America, Inc. | Multi-stream pro-active rate adaptation for robust video transmission |
US7715481B2 (en) * | 2006-11-29 | 2010-05-11 | Ipera Technology, Inc. | System and method for allocation of resources for processing video |
US7855963B2 (en) * | 2006-12-21 | 2010-12-21 | Aruba Networks, Inc. | Capacity estimation and proportional sharing of varying capacity channels |
US8065397B2 (en) | 2006-12-26 | 2011-11-22 | Axeda Acquisition Corporation | Managing configurations of distributed devices |
US8139487B2 (en) | 2007-02-28 | 2012-03-20 | Microsoft Corporation | Strategies for selecting a format for data transmission based on measured bandwidth |
US7801888B2 (en) | 2007-03-09 | 2010-09-21 | Microsoft Corporation | Media content search results ranked by popularity |
US8107571B2 (en) * | 2007-03-20 | 2012-01-31 | Microsoft Corporation | Parameterized filters and signaling techniques |
US20080256485A1 (en) * | 2007-04-12 | 2008-10-16 | Jason Gary Krikorian | User Interface for Controlling Video Programs on Mobile Computing Devices |
US7957309B1 (en) | 2007-04-16 | 2011-06-07 | Hewlett-Packard Development Company, L.P. | Utilizing multiple distortion measures |
US20080301732A1 (en) * | 2007-05-31 | 2008-12-04 | United Video Properties, Inc. | Systems and methods for personalizing an interactive media guidance application |
US20080307349A1 (en) * | 2007-06-08 | 2008-12-11 | Microsoft Corporation | Sharing a computer display across a network |
US8082507B2 (en) | 2007-06-12 | 2011-12-20 | Microsoft Corporation | Scalable user interface |
FR2917919B1 (en) * | 2007-06-21 | 2010-06-11 | Canon Kk | METHOD AND DEVICE FOR TRANSMITTING IMAGES |
JP2009009330A (en) * | 2007-06-27 | 2009-01-15 | Fujitsu Ltd | Information processor, information processing system and control method for information processor |
US20090019492A1 (en) | 2007-07-11 | 2009-01-15 | United Video Properties, Inc. | Systems and methods for mirroring and transcoding media content |
US8151005B2 (en) * | 2007-08-04 | 2012-04-03 | Broadcom Corporation | System and method for adjusting a level of compression for computing clients |
US7929553B2 (en) * | 2007-08-10 | 2011-04-19 | Broadcom Corporation | System and method for adjusting compression for computing clients based on a latency level |
JP2009077024A (en) * | 2007-09-19 | 2009-04-09 | Panasonic Corp | Tcp packet communication device, and technique related thereto |
US8477793B2 (en) * | 2007-09-26 | 2013-07-02 | Sling Media, Inc. | Media streaming device with gateway functionality |
US8350971B2 (en) | 2007-10-23 | 2013-01-08 | Sling Media, Inc. | Systems and methods for controlling media devices |
US8432804B2 (en) * | 2007-11-29 | 2013-04-30 | Hewlett-Packard Development Company, L.P. | Transmitting video streams |
KR101453131B1 (en) * | 2007-12-14 | 2014-10-27 | 톰슨 라이센싱 | Apparatus and method for simulcast over a variable bandwidth channel |
WO2009078839A1 (en) | 2007-12-18 | 2009-06-25 | Thomson Licensing | Apparatus and method for file size estimation over broadcast networks |
US8060609B2 (en) * | 2008-01-04 | 2011-11-15 | Sling Media Inc. | Systems and methods for determining attributes of media items accessed via a personal media broadcaster |
US20090198830A1 (en) * | 2008-02-06 | 2009-08-06 | Inventec Corporation | Method of adjusting network data sending speed according to data processing speed at client |
EP2101503A1 (en) * | 2008-03-11 | 2009-09-16 | British Telecommunications Public Limited Company | Video coding |
US8667279B2 (en) | 2008-07-01 | 2014-03-04 | Sling Media, Inc. | Systems and methods for securely place shifting media content |
US8381310B2 (en) | 2009-08-13 | 2013-02-19 | Sling Media Pvt. Ltd. | Systems, methods, and program applications for selectively restricting the placeshifting of copy protected digital media content |
CN101662455A (en) * | 2008-08-29 | 2010-03-03 | 深圳华为通信技术有限公司 | Method and device for data transmission |
US20100070925A1 (en) * | 2008-09-08 | 2010-03-18 | Sling Media Inc. | Systems and methods for selecting media content obtained from multple sources |
US8667163B2 (en) * | 2008-09-08 | 2014-03-04 | Sling Media Inc. | Systems and methods for projecting images from a computer system |
US8060089B1 (en) | 2008-09-22 | 2011-11-15 | Sprint Spectrum L.P. | Paging success rate control mechanism |
US10063934B2 (en) | 2008-11-25 | 2018-08-28 | Rovi Technologies Corporation | Reducing unicast session duration with restart TV |
US9191610B2 (en) * | 2008-11-26 | 2015-11-17 | Sling Media Pvt Ltd. | Systems and methods for creating logical media streams for media storage and playback |
EP2200319A1 (en) | 2008-12-10 | 2010-06-23 | BRITISH TELECOMMUNICATIONS public limited company | Multiplexed video streaming |
US8578272B2 (en) | 2008-12-31 | 2013-11-05 | Apple Inc. | Real-time or near real-time streaming |
US8099476B2 (en) * | 2008-12-31 | 2012-01-17 | Apple Inc. | Updatable real-time or near real-time streaming |
US8156089B2 (en) | 2008-12-31 | 2012-04-10 | Apple, Inc. | Real-time or near real-time streaming with compressed playlists |
US8260877B2 (en) | 2008-12-31 | 2012-09-04 | Apple Inc. | Variant streams for real-time or near real-time streaming to provide failover protection |
US8438602B2 (en) * | 2009-01-26 | 2013-05-07 | Sling Media Inc. | Systems and methods for linking media content |
EP2219342A1 (en) | 2009-02-12 | 2010-08-18 | BRITISH TELECOMMUNICATIONS public limited company | Bandwidth allocation control in multiple video streaming |
US8171148B2 (en) * | 2009-04-17 | 2012-05-01 | Sling Media, Inc. | Systems and methods for establishing connections between devices communicating over a network |
US9191322B2 (en) * | 2009-05-19 | 2015-11-17 | Beaumaris Networks Inc. | Methods, apparatus and computer readable medium for managed adaptive bit rate for bandwidth reclamation |
US8843977B2 (en) * | 2009-06-04 | 2014-09-23 | Verizon Patent And Licensing Inc. | Media content delivery systems and methods |
US8406431B2 (en) * | 2009-07-23 | 2013-03-26 | Sling Media Pvt. Ltd. | Adaptive gain control for digital audio samples in a media stream |
US20110022620A1 (en) * | 2009-07-27 | 2011-01-27 | Gemstar Development Corporation | Methods and systems for associating and providing media content of different types which share atrributes |
US9479737B2 (en) * | 2009-08-06 | 2016-10-25 | Echostar Technologies L.L.C. | Systems and methods for event programming via a remote media player |
US20110032986A1 (en) * | 2009-08-07 | 2011-02-10 | Sling Media Pvt Ltd | Systems and methods for automatically controlling the resolution of streaming video content |
US8532472B2 (en) * | 2009-08-10 | 2013-09-10 | Sling Media Pvt Ltd | Methods and apparatus for fast seeking within a media stream buffer |
US9565479B2 (en) * | 2009-08-10 | 2017-02-07 | Sling Media Pvt Ltd. | Methods and apparatus for seeking within a media stream using scene detection |
US9525838B2 (en) * | 2009-08-10 | 2016-12-20 | Sling Media Pvt. Ltd. | Systems and methods for virtual remote control of streamed media |
US8799408B2 (en) | 2009-08-10 | 2014-08-05 | Sling Media Pvt Ltd | Localization systems and methods |
US8966101B2 (en) * | 2009-08-10 | 2015-02-24 | Sling Media Pvt Ltd | Systems and methods for updating firmware over a network |
US20110035466A1 (en) * | 2009-08-10 | 2011-02-10 | Sling Media Pvt Ltd | Home media aggregator system and method |
US20110035765A1 (en) * | 2009-08-10 | 2011-02-10 | Sling Media Pvt Ltd | Systems and methods for providing programming content |
US9160974B2 (en) | 2009-08-26 | 2015-10-13 | Sling Media, Inc. | Systems and methods for transcoding and place shifting media content |
US8314893B2 (en) * | 2009-08-28 | 2012-11-20 | Sling Media Pvt. Ltd. | Remote control and method for automatically adjusting the volume output of an audio device |
US9166714B2 (en) | 2009-09-11 | 2015-10-20 | Veveo, Inc. | Method of and system for presenting enriched video viewing analytics |
US20110072452A1 (en) * | 2009-09-23 | 2011-03-24 | Rovi Technologies Corporation | Systems and methods for providing automatic parental control activation when a restricted user is detected within range of a device |
US9014546B2 (en) * | 2009-09-23 | 2015-04-21 | Rovi Guides, Inc. | Systems and methods for automatically detecting users within detection regions of media devices |
US20110083156A1 (en) * | 2009-10-07 | 2011-04-07 | Canon Kabushiki Kaisha | Network streaming of a video stream over multiple communication channels |
US20110113354A1 (en) * | 2009-11-12 | 2011-05-12 | Sling Media Pvt Ltd | Always-on-top media player launched from a web browser |
US9015225B2 (en) | 2009-11-16 | 2015-04-21 | Echostar Technologies L.L.C. | Systems and methods for delivering messages over a network |
IN2012DN03438A (en) * | 2009-12-08 | 2015-10-23 | Ericsson Telefon Ab L M | |
US8799485B2 (en) * | 2009-12-18 | 2014-08-05 | Sling Media, Inc. | Methods and apparatus for establishing network connections using an inter-mediating device |
US8626879B2 (en) | 2009-12-22 | 2014-01-07 | Sling Media, Inc. | Systems and methods for establishing network connections using local mediation services |
US9178923B2 (en) * | 2009-12-23 | 2015-11-03 | Echostar Technologies L.L.C. | Systems and methods for remotely controlling a media server via a network |
US9275054B2 (en) | 2009-12-28 | 2016-03-01 | Sling Media, Inc. | Systems and methods for searching media content |
CN102137248B (en) * | 2010-01-21 | 2015-05-20 | 腾讯科技(深圳)有限公司 | Video resolution switching method and device, terminal and switching system |
US20110191456A1 (en) * | 2010-02-03 | 2011-08-04 | Sling Media Pvt Ltd | Systems and methods for coordinating data communication between two devices |
US8856349B2 (en) * | 2010-02-05 | 2014-10-07 | Sling Media Inc. | Connection priority services for data communication between two devices |
EP2362651A1 (en) | 2010-02-19 | 2011-08-31 | Thomson Licensing | Multipath delivery for adaptive streaming |
US20110208506A1 (en) * | 2010-02-24 | 2011-08-25 | Sling Media Inc. | Systems and methods for emulating network-enabled media components |
US20110235709A1 (en) * | 2010-03-25 | 2011-09-29 | Apple Inc. | Frame dropping algorithm for fast adaptation of buffered compressed video to network condition changes |
US8560642B2 (en) | 2010-04-01 | 2013-10-15 | Apple Inc. | Real-time or near real-time streaming |
US8805963B2 (en) | 2010-04-01 | 2014-08-12 | Apple Inc. | Real-time or near real-time streaming |
GB201105502D0 (en) | 2010-04-01 | 2011-05-18 | Apple Inc | Real time or near real time streaming |
CN102882845B (en) | 2010-04-07 | 2016-07-13 | 苹果公司 | In real time or quasi real time streaming |
US8467412B2 (en) * | 2010-04-14 | 2013-06-18 | Ericsson Television Inc. | Adaptive rate shifting for delivery of video services to service groups |
US8819269B2 (en) * | 2010-06-30 | 2014-08-26 | Cable Television Laboratories, Inc. | Adaptive bit rate method and system using retransmission and replacement |
KR101755433B1 (en) * | 2010-12-24 | 2017-07-11 | 삼성전자주식회사 | Method For Transmitting and Receiving of Video Telephony having function of adjusting Quality of resolution |
US20120230431A1 (en) | 2011-03-10 | 2012-09-13 | Jill Boyce | Dependency parameter set for scalable video coding |
US8560002B1 (en) | 2011-05-05 | 2013-10-15 | Sprint Spectrum L.P. | Use of reverse transmission power history as basis to vary frequency of engaging in background communications |
US8856283B2 (en) | 2011-06-03 | 2014-10-07 | Apple Inc. | Playlists for real-time or near real-time streaming |
US8843586B2 (en) | 2011-06-03 | 2014-09-23 | Apple Inc. | Playlists for real-time or near real-time streaming |
CN103797798B (en) * | 2011-09-01 | 2017-05-17 | 日本电气株式会社 | Captured image compression and transmission method and captured image compression and transmission system |
US9292826B1 (en) * | 2011-12-21 | 2016-03-22 | Time Warner Cable Enterprises Llc | Adaptive bit rates in multicast communications |
US8805418B2 (en) | 2011-12-23 | 2014-08-12 | United Video Properties, Inc. | Methods and systems for performing actions based on location-based rules |
MY173712A (en) | 2011-12-28 | 2020-02-17 | Mimos Berhad | A system and method for adaptive media content delivery |
KR20130099515A (en) * | 2012-02-29 | 2013-09-06 | 삼성전자주식회사 | Apparatas and method of displaying a contents using for key frame in a terminal |
US20130254417A1 (en) * | 2012-03-21 | 2013-09-26 | Jason Nicholls | System method device for streaming video |
US10674191B2 (en) | 2012-04-06 | 2020-06-02 | Minerva Networks, Inc | Systems and methods to remotely synchronize digital data |
US9173185B1 (en) | 2012-04-10 | 2015-10-27 | Sprint Spectrum L.P. | Methods and systems for managing registration signaling based on off-time duration |
US9313486B2 (en) | 2012-06-20 | 2016-04-12 | Vidyo, Inc. | Hybrid video coding techniques |
US9491220B2 (en) | 2012-07-13 | 2016-11-08 | Infosys Limited | Systems and methods for adapting mobile multimedia content delivery service |
EP2733903B1 (en) * | 2012-11-20 | 2017-02-15 | Alcatel Lucent | Method for transmitting a video stream |
TW201421985A (en) * | 2012-11-23 | 2014-06-01 | Inst Information Industry | Scene segments transmission system, method and recording medium |
US8935734B2 (en) | 2013-02-01 | 2015-01-13 | Ebay Inc. | Methods, systems and apparatus for configuring a system of content access devices |
US9402107B2 (en) | 2013-03-15 | 2016-07-26 | Time Warner Cable Enterprises Llc | Apparatus and methods for delivery of multicast and unicast content in a content delivery network |
US9066153B2 (en) | 2013-03-15 | 2015-06-23 | Time Warner Cable Enterprises Llc | Apparatus and methods for multicast delivery of content in a content delivery network |
US9035992B1 (en) * | 2013-04-08 | 2015-05-19 | Google Inc. | Bandwidth modulation system and method |
US10009628B2 (en) | 2013-06-07 | 2018-06-26 | Apple Inc. | Tuning video compression for high frame rate and variable frame rate capture |
CN104423783B (en) * | 2013-09-02 | 2019-03-29 | 联想(北京)有限公司 | The method and electronic equipment of information transmission |
US9674563B2 (en) | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
JP5889489B2 (en) * | 2013-12-19 | 2016-03-22 | オリンパス株式会社 | Image photographing system and image photographing apparatus |
US9455932B2 (en) * | 2014-03-03 | 2016-09-27 | Ericsson Ab | Conflict detection and resolution in an ABR network using client interactivity |
US10142259B2 (en) | 2014-03-03 | 2018-11-27 | Ericsson Ab | Conflict detection and resolution in an ABR network |
CN105376642B (en) * | 2014-08-18 | 2019-12-03 | 深圳Tcl新技术有限公司 | Video playing resolution ratio switching method and system |
TWI586175B (en) * | 2014-09-16 | 2017-06-01 | 鴻海精密工業股份有限公司 | Method and system for managing bandwidth of video conference |
CN105491320B (en) * | 2014-09-16 | 2018-12-14 | 南宁富桂精密工业有限公司 | Videoconference bandwidth management method and system |
CN105828183B (en) | 2015-01-04 | 2017-12-05 | 华为技术有限公司 | Video frame processing method and frame of video process chip |
US9432556B2 (en) | 2015-01-05 | 2016-08-30 | Qualcomm Incorporated | Devices and methods for facilitating frame dropping in remote display applications |
US10645465B2 (en) * | 2015-12-21 | 2020-05-05 | Centurylink Intellectual Property Llc | Video file universal identifier for metadata resolution |
KR20170080156A (en) * | 2015-12-31 | 2017-07-10 | 주식회사 경동원 | Wireless doorphone and apparatus and method for controlling stream thereof |
US10154317B2 (en) | 2016-07-05 | 2018-12-11 | BoxCast, LLC | System, method, and protocol for transmission of video and audio data |
TWI621354B (en) * | 2016-12-12 | 2018-04-11 | Chunghwa Telecom Co Ltd | Multi-network video uninterrupted set-top box system and method |
DE102018108784B4 (en) * | 2018-04-13 | 2023-08-03 | Exaring Ag | Method for sending a digital video signal to a receiving device, processing unit and computer program product |
JP2019191962A (en) * | 2018-04-25 | 2019-10-31 | 富士通株式会社 | Screen transmission program, screen transmission method, and screen transmission/reception system |
US11570473B2 (en) * | 2018-08-03 | 2023-01-31 | V-Nova International Limited | Entropy coding for signal enhancement coding |
CN109818960B (en) * | 2019-01-29 | 2021-07-09 | 视联动力信息技术股份有限公司 | Data processing method and device |
WO2022088200A1 (en) * | 2020-11-02 | 2022-05-05 | 深圳市大疆创新科技有限公司 | Video transmission method and apparatus, and mobile platform and computer-readable storage medium |
FI129689B (en) | 2020-12-23 | 2022-06-30 | NSION Oy | Managing data flow between source node and recipient node |
US11811877B2 (en) * | 2021-05-13 | 2023-11-07 | Agora Lab, Inc. | Universal transport framework for heterogeneous data streams |
CN116318559B (en) * | 2023-05-18 | 2023-08-18 | 深圳沛喆微电子有限公司 | Method for automatically accelerating video transmission rate of WiFi6 intelligent router system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3390033B2 (en) * | 1992-10-14 | 2003-03-24 | 株式会社日立製作所 | Packet communication method |
US5359593A (en) * | 1993-08-26 | 1994-10-25 | International Business Machines Corporation | Dynamic bandwidth estimation and adaptation for packet communications networks |
US5592226A (en) * | 1994-01-26 | 1997-01-07 | Btg Usa Inc. | Method and apparatus for video data compression using temporally adaptive motion interpolation |
US5621660A (en) * | 1995-04-18 | 1997-04-15 | Sun Microsystems, Inc. | Software-based encoder for a software-implemented end-to-end scalable video delivery system |
US5604731A (en) * | 1995-04-19 | 1997-02-18 | Lucent Technologies Inc. | Renegotiated bit-rate service system and method |
-
1997
- 1997-06-26 US US08/884,531 patent/US6014694A/en not_active Expired - Lifetime
-
1998
- 1998-06-25 IL IL13343998A patent/IL133439A0/en unknown
- 1998-06-25 JP JP50337599A patent/JP2002511216A/en active Pending
- 1998-06-25 EP EP98929608A patent/EP0992160A1/en not_active Ceased
- 1998-06-25 KR KR1019997012204A patent/KR20010020498A/en not_active Application Discontinuation
- 1998-06-25 AU AU79289/98A patent/AU7928998A/en not_active Abandoned
- 1998-06-25 CA CA002294511A patent/CA2294511C/en not_active Expired - Fee Related
- 1998-06-25 WO PCT/IL1998/000300 patent/WO1999000984A1/en not_active Application Discontinuation
Also Published As
Publication number | Publication date |
---|---|
WO1999000984A1 (en) | 1999-01-07 |
IL133439A0 (en) | 2001-04-30 |
AU7928998A (en) | 1999-01-19 |
CA2294511A1 (en) | 1999-01-07 |
JP2002511216A (en) | 2002-04-09 |
EP0992160A1 (en) | 2000-04-12 |
US6014694A (en) | 2000-01-11 |
KR20010020498A (en) | 2001-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2294511C (en) | System for adaptive video/audio transport over a network | |
KR100966447B1 (en) | Data streaming system and method | |
EP1454452B1 (en) | Method, system and device for data transmission | |
Ramanujan et al. | Adaptive streaming of MPEG video over IP networks | |
Vandalore et al. | A survey of application layer techniques for adaptive streaming of multimedia | |
US8395990B2 (en) | Method and apparatus for streaming scalable multimedia data streams | |
KR100917743B1 (en) | Data structure for data streaming system | |
CN1478349A (en) | Transmitting and receiving real-time data | |
Chakareski et al. | Adaptive systems for improved media streaming experience | |
Fankhauser et al. | WaveVideo–An integrated approach to adaptive wireless video | |
Kassler et al. | Generic QoS aware media stream transcoding and adaptation | |
Vass et al. | Multiresolution-multicast video distribution over the Internet | |
Hong et al. | QoS control for internet delivery of video data | |
Psannis et al. | Efficient support of wireless video multicast services in 3G and beyond | |
Hoac | A Study of Congestion Adaptive Video Coding for IP Networks | |
Wijnhoven et al. | Design of a Multi-Channel Streaming Video Server for Surveillance Systems | |
Tan | Video compression and streaming over packet-switched networks | |
Yanhong et al. | A new scheme for multiple source video streaming | |
Shen | Layer-Optimized Streaming of Motion-Compensated Orthogonal Video | |
Reisslein et al. | A Decentralized Prefetching Protocol | |
Fang et al. | Robust scalable pre-compressed video coding based on MPEG4-FGS over the Internet |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKLA | Lapsed | ||
MKLA | Lapsed |
Effective date: 20030625 |