US20120002945A1 - Rtp-formatted media clips - Google Patents
Rtp-formatted media clips Download PDFInfo
- Publication number
- US20120002945A1 US20120002945A1 US13/233,840 US201113233840A US2012002945A1 US 20120002945 A1 US20120002945 A1 US 20120002945A1 US 201113233840 A US201113233840 A US 201113233840A US 2012002945 A1 US2012002945 A1 US 2012002945A1
- Authority
- US
- United States
- Prior art keywords
- stored
- data
- rtp
- audio
- samples
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/87—Regeneration of colour television signals
- H04N9/877—Regeneration of colour television signals by assembling picture element blocks in an intermediate memory
Definitions
- the present invention is directed to persistent data storage and in particular to persistent storage of real-time data.
- RTP 1889 the data format the data as payloads of RTP packets, i.e., as payloads of packets substantially of the type described in the Internet community's Request for Comments 1889 (“RFC 1889”).
- the payloads are stored with the RTP header's accompanying timestamp information so as to specify the data's relative playback timing explicitly rather than only implicitly, from their positions in the data stream.
- FIG. 1 is a block diagram that illustrates a number of environments in which the present invention's teachings can be employed;
- FIG. 2 is a format diagram depicting one format environment in which an RTP packet may be transmitted
- FIG. 3 is a format diagram of an RTP header
- FIG. 4 is a format diagram of a data segment employed by one embodiment of the present invention to store data persistently.
- FIG. 1 is a block diagram that is representative of a number of ways in which the present invention's teachings can be practiced.
- FIG. 1 includes a block 12 representing some type of sampler, such as a video camera or microphone. This sampler creates a digital representation of a sound record and/or a time-dependent scene, which a transmitter 14 may send over channel 16 to a receiver 18 for rendering by some kind of a player 20 , such as speakers and/or a computer monitor.
- the channel 16 may be a packet network, in which case the receiver 18 would include an interface to that channel 16 .
- the transmitter and receiver will typically be implemented in personal-computer or similar processors, which operate in accordance with stored programs contained in respective persistent stores 22 and 24 , typically magnetic disks. Operating in accordance with this programming, such processors can format data for storage in accordance with the present invention's teachings and act as drivers that operate the players 20 to play back data thus stored. In one application of the present invention's teachings the receiver 18 may record the received information in the persistent store 24 instead of, or contemporaneously with, driving the player 20 with that information.
- FIG. 2 is a format diagram that places such a packet in a typical, Ethernet environment, although RTP packets may be sent in other environments, too. If the receiver receives the packet over an Ethernet link, the RTP packet will be included in an Ethernet frame that starts with an Ethernet header and ends with an Ethernet trailer, as FIG. 2 illustrates.
- a typical Ethernet link may be shared by a number of nodes, and the Ethernet header indicates, among other things, which of the several nodes is to receive the Ethernet frame's contents.
- Ethernet frame indicates that, say, FIG. 1 's receiver 18 is the proper recipient node
- that receiver further consults the Ethernet header to determine which of its processes is to receive the Ethernet frame's payload.
- that process is the Internet Protocol (“IP”) process, whose purpose is to determine whether—and, if so, how—to forward the received information along other links to which the recipient node may be coupled.
- IP Internet Protocol
- the IP process interprets the first part of the Ethernet frame's payload as an IP header, as FIG. 2 indicates.
- the IP header includes an indication of the intended ultimate internetwork node for which the IP packet's payload is intended. For present purposes, we will assume that the intended internetwork node is FIG. 1 's receiver 18 itself, i.e., that the receiver is not to forward it further but instead is to use the IP packet's payload itself.
- the receiver 18 thereupon further inspects the IP header for an indication of the process to which the IP payload's contents should be delivered.
- that process is the User Datagram Protocol (“UDP”) process.
- UDP User Datagram Protocol
- the UDP process is the IP suite's transport-level protocol for delivering without providing reliability services. Its header, like the previous headers, includes demultiplexing information to identify the process that can appropriately interpret the UDP datagram's payload.
- That process is the RTP process. That process interprets the UDP datagram's payload as beginning with an RTP header, whose format FIG. 3 illustrates.
- the purposes of the various fields depicted in that drawing are well known to those skilled in the art, so we mention only the timestamp field here. That field is the one that specifies the relative timing of the samples contained in the RTP packet.
- the timestamp value does not represent an actual, “wall-clock” time. Indeed, the value to be associated with the initial sample transmitted in an RTP session is chosen randomly. But the values after that represent the relative real times at which subsequent samples were taken.
- the time duration represented by a single increment of the timestamp value depends on the particular type of data stream being transmitted, but the receiver typically infers that value from the contents of the RTP header's PT field, which is a code for the type of data that the RTP payload represents. If, as FIG. 2 indicates for the sake of example, the RTP payload is of the H.261 format often used to send video information, the timestamp would typically give the nominal sample time for all of the data within the packet, because the data typically all apply to the same video frame. In cases in which the RTP payload instead contains audio information, not all of the data will typically have been taken at the same time. But they will represent an uninterrupted sequence of samples, and the timestamp value represents the first sample's time.
- the receiver 18 drives the player 20 with this information at times that correspond to the timestamps that accompany the information. That is, it establishes a relation between the advancing timestamp values and values on a local real-time clock, and it does not apply data to its player until its local wall-clock time reaches the time that corresponds to the timestamp value.
- the receiver 18 may instead, or additionally, record the transmitted information in persistent storage.
- the format with which real-time information is recorded is largely that set forth in the above-mentioned RTP specification.
- the file containing the real-time information includes timestamp-containing headers to indicate the relative timing with which the various stored information is to be played.
- a typical file for containing such information may, for instance, consist of a number of segments of which each has a format similar to that of FIG. 4 .
- Each such segment begins with a length field, which indicates how long the remainder of the segment is.
- this length field can be the value obtained from the UDP header.
- the next field includes at least an RTP timestamp, and it is designated the “RTP Header” field in FIG. 4 because it typically will simply be a received packet's RTP header.
- some implementations may omit certain RTP-header fields, such as those containing contributing-source identifiers, whose values may not be needed for the use to which the data will be put. Some implementations may additionally omit fields that were received with values different from those they have to contain during retransmission.
- the system for doing so plays or transmits it accordance with the timestamps. That is, it reads the timestamp for a given segment and then does not play or transmit it until the wall-clock time that the timestamp value dictates. It the system retransmits the stored media packets, it must replace the stored timestamp with a value consistent with the sender's wall clock as specified in RFC 1889. It must also replace the received synchronization-source identifier with one appropriate for the sender. In some cases the stored data will follow other data in the same session, and it will be preferable in such situations for the stored sequence number to be so modified as to indicate a discontinuity in the current media stream. A difference greater than one between successive sequence numbers is such a discontinuity indicator.
- the present invention's teachings will often be employed in multimedia situations, in which associated audio information is to be played with video information.
- audio and associated video are usually transmitted in separate RTP sessions, and the present invention's implementations will typically store the information in that fashion.
- the video information may be stored in RTP format in a file called, say, “scene 1.261,” where the “.261” extension may indicate that the format of the file's information is that specified by the International Telecommunications Union's H.261 standard.
- the audio may be stored in a file called, for instance, “scene 1.711” to indicate that it conforms to the G.711 audio-data standard.
- the timestamp information contained in the video file will not in general correspond to that in the audio file.
- timestamp values are assigned randomly at the beginning of a session, and the video and audio information will have been transmitted in separate sessions.
- the time-interval length represented by one increment of the video timestamp values will not in general be the same as the length that an audio-timestamp-value increment represents. It may therefore be considered desirable in some cases to add information that represents the relative timing between the two files.
- time-interval length represented by a single time-stamp-value increment may be inferred from, say, the file-name extension.
- a receiver can use it to keep a record of received information.
- a receiver of a so-called voice-over-IP signal or of a videoconference signal may use the present invention to record the substance of a conference or other telephone call. This is clearly a simple way to store information that has been received in RTP format.
- FIG. 1 transmitter 14 may place the samples received from the sampling equipment 12 into the RTP format. Acting as a persistent-store driver, transmitter 14 stores the resultant packets in store 22 and then retrieves them for subsequent transmission or playback on local equipment (not shown). Transmitter 14 may, for instance, be a video- and/or audio-clip server, which sends stored information on demand to client network nodes. Storage in the RTP format greatly simplifies this process.
- a given storage directory may contain a file called “scene 1.261” to represent audio information and another called “scene 1.711” to represent the related video information.
- the same directory may include a further file called, say, “scene 1.723,” containing RTP information whose payload conforms to a different audio standard, which some clients may prefer. So the present invention makes it convenient to store different audio versions for the same video clip, and vice versa. This applies not only to storage formats but also to, say, languages. For example, German, French, and Spanish versions of the audio for a film can be stored in different files and used with the same video file.
- This mechanism also provides a simple, efficient method to insert stored media clips into a real-time media stream.
- a typical example of this function is to broadcast a message such as “Conference will end in five minutes” to all participants in a scheduled conference.
- FIG. 1 can be interpreted as illustrating a testing scenario.
- the transmitter 14 represents a test-signal source, which applies test signals to a unit under test in the position of the channel 16 and receiver 18 .
- the ability to employ a repeatable test signal is essential, and the RTP-format data in persistent store 22 would dictate the repeatable values to be transmitted.
- Dashed lines 26 enclose elements of test equipment for performing such a test.
- circuitry 28 for comparing the unit under test's output with the input would provide most of the desired functionality. The output signal could be compared simply with the input signal or with a signal determined from other values contained in RTP format in a persistent store.
Abstract
A transmitter (14) of audio, video, or other real-time information reads the information from a persistent store (22) in which the real-time information has been stored in the Real-time-Transport Protocol (“RTP”) format (FIG. 4). A receiver (18) receives the information from the channel (16) through which the transmitter (14) has transmitted it, and the receiver may store the information in a persistent store (24) in RTP format instead of or in addition to playing it by applying it to an appropriate player (20). Parts of this communications circuit may be tested by a tester unit (26) that also employs RTP-format information from a persistent store (22).
Description
- The present application is a Divisional of application Ser. No. 11/525,434, filed Sep. 22, 2006, which is a continuation of U.S. patent application Ser. No. 09/606,582, which was filed on Jun. 29, 2000, the entire contents of both of which are hereby incorporated by reference.
- 1. Field of the Invention
- The present invention is directed to persistent data storage and in particular to persistent storage of real-time data.
- 2. Background Information
- A wide variety of media have been employed for storing real-time-type data persistently. In addition to the media traditionally employed to store such information in an analog manner, compact disks, digital versatile disks, and magnetic disks are all currently employed to store such data digitally. Because real-time data tends to be voluminous, a great degree of effort has been dedicated to storing it digitally in a format that makes data storage and use economical and convenient.
- As a consequence, persistent real-time-data storage has achieved a high degree of sophistication and effectiveness.
- But I have recognized that a further advance in such storage will greatly contribute to the ease with which such storage and the resultant playback can be performed. Specifically, in storing real-time data, I format the data as payloads of RTP packets, i.e., as payloads of packets substantially of the type described in the Internet community's Request for Comments 1889 (“RFC 1889”). The payloads are stored with the RTP header's accompanying timestamp information so as to specify the data's relative playback timing explicitly rather than only implicitly, from their positions in the data stream.
- Since real-time data tend to be transmitted and received in RTP packets, such storage makes it quite convenient and computationally inexpensive to store received real-time information and to transmit such information when it has been retrieved from storage. Additionally, the fact that the RTP format lends itself to separate storage of video and audio information yields significant versatility to such data's playback.
- The invention description below refers to the accompanying drawings, of which:
-
FIG. 1 is a block diagram that illustrates a number of environments in which the present invention's teachings can be employed; -
FIG. 2 is a format diagram depicting one format environment in which an RTP packet may be transmitted; -
FIG. 3 is a format diagram of an RTP header; and -
FIG. 4 is a format diagram of a data segment employed by one embodiment of the present invention to store data persistently. -
FIG. 1 is a block diagram that is representative of a number of ways in which the present invention's teachings can be practiced.FIG. 1 includes ablock 12 representing some type of sampler, such as a video camera or microphone. This sampler creates a digital representation of a sound record and/or a time-dependent scene, which atransmitter 14 may send overchannel 16 to areceiver 18 for rendering by some kind of aplayer 20, such as speakers and/or a computer monitor. In one application, thechannel 16 may be a packet network, in which case thereceiver 18 would include an interface to thatchannel 16. - The transmitter and receiver will typically be implemented in personal-computer or similar processors, which operate in accordance with stored programs contained in respective
persistent stores players 20 to play back data thus stored. In one application of the present invention's teachings thereceiver 18 may record the received information in thepersistent store 24 instead of, or contemporaneously with, driving theplayer 20 with that information. - So, although the drawing's legend for
block 18 is “receiver,” that block not only receives packets but also operates thepersistent store 24 and drives theplayers 20. Similarly, the “transmitter” 14 performs several functions in addition to transmitting. - The
transmitter 14 will typically break up thesampler 12's output sequence into discrete packets according to the RFC 1889 specification, so thereceiver 18 will receive the real-time information in the form of RTP packets.FIG. 2 is a format diagram that places such a packet in a typical, Ethernet environment, although RTP packets may be sent in other environments, too. If the receiver receives the packet over an Ethernet link, the RTP packet will be included in an Ethernet frame that starts with an Ethernet header and ends with an Ethernet trailer, asFIG. 2 illustrates. A typical Ethernet link may be shared by a number of nodes, and the Ethernet header indicates, among other things, which of the several nodes is to receive the Ethernet frame's contents. - If the Ethernet frame indicates that, say, FIG. 1
's receiver 18 is the proper recipient node, that receiver further consults the Ethernet header to determine which of its processes is to receive the Ethernet frame's payload. In the illustrative scenario, that process is the Internet Protocol (“IP”) process, whose purpose is to determine whether—and, if so, how—to forward the received information along other links to which the recipient node may be coupled. - The IP process interprets the first part of the Ethernet frame's payload as an IP header, as
FIG. 2 indicates. The IP header includes an indication of the intended ultimate internetwork node for which the IP packet's payload is intended. For present purposes, we will assume that the intended internetwork node is FIG. 1'sreceiver 18 itself, i.e., that the receiver is not to forward it further but instead is to use the IP packet's payload itself. - The
receiver 18 thereupon further inspects the IP header for an indication of the process to which the IP payload's contents should be delivered. In the illustrated scenario, that process is the User Datagram Protocol (“UDP”) process. The UDP process is the IP suite's transport-level protocol for delivering without providing reliability services. Its header, like the previous headers, includes demultiplexing information to identify the process that can appropriately interpret the UDP datagram's payload. - In this case, that process is the RTP process. That process interprets the UDP datagram's payload as beginning with an RTP header, whose format
FIG. 3 illustrates. The purposes of the various fields depicted in that drawing are well known to those skilled in the art, so we mention only the timestamp field here. That field is the one that specifies the relative timing of the samples contained in the RTP packet. The timestamp value does not represent an actual, “wall-clock” time. Indeed, the value to be associated with the initial sample transmitted in an RTP session is chosen randomly. But the values after that represent the relative real times at which subsequent samples were taken. - The time duration represented by a single increment of the timestamp value depends on the particular type of data stream being transmitted, but the receiver typically infers that value from the contents of the RTP header's PT field, which is a code for the type of data that the RTP payload represents. If, as
FIG. 2 indicates for the sake of example, the RTP payload is of the H.261 format often used to send video information, the timestamp would typically give the nominal sample time for all of the data within the packet, because the data typically all apply to the same video frame. In cases in which the RTP payload instead contains audio information, not all of the data will typically have been taken at the same time. But they will represent an uninterrupted sequence of samples, and the timestamp value represents the first sample's time. - To play the information thus received, the
receiver 18 drives theplayer 20 with this information at times that correspond to the timestamps that accompany the information. That is, it establishes a relation between the advancing timestamp values and values on a local real-time clock, and it does not apply data to its player until its local wall-clock time reaches the time that corresponds to the timestamp value. - Now, although the transmitted information is ordinarily to be played in the fashion just described, the
receiver 18 may instead, or additionally, record the transmitted information in persistent storage. In accordance with the present invention, the format with which real-time information is recorded is largely that set forth in the above-mentioned RTP specification. Specifically, the file containing the real-time information includes timestamp-containing headers to indicate the relative timing with which the various stored information is to be played. - A typical file for containing such information may, for instance, consist of a number of segments of which each has a format similar to that of
FIG. 4 . Each such segment begins with a length field, which indicates how long the remainder of the segment is. In the case of a device, such asreceiver 18, that has received RTP-format information delivered in a UDP datagram, this length field can be the value obtained from the UDP header. The next field includes at least an RTP timestamp, and it is designated the “RTP Header” field inFIG. 4 because it typically will simply be a received packet's RTP header. Still, some implementations may omit certain RTP-header fields, such as those containing contributing-source identifiers, whose values may not be needed for the use to which the data will be put. Some implementations may additionally omit fields that were received with values different from those they have to contain during retransmission. - In any event, when the information is to be played or transmitted, the system for doing so plays or transmits it accordance with the timestamps. That is, it reads the timestamp for a given segment and then does not play or transmit it until the wall-clock time that the timestamp value dictates. It the system retransmits the stored media packets, it must replace the stored timestamp with a value consistent with the sender's wall clock as specified in RFC 1889. It must also replace the received synchronization-source identifier with one appropriate for the sender. In some cases the stored data will follow other data in the same session, and it will be preferable in such situations for the stored sequence number to be so modified as to indicate a discontinuity in the current media stream. A difference greater than one between successive sequence numbers is such a discontinuity indicator.
- The present invention's teachings will often be employed in multimedia situations, in which associated audio information is to be played with video information. As those skilled in the art will recognize, audio and associated video are usually transmitted in separate RTP sessions, and the present invention's implementations will typically store the information in that fashion. For instance, suppose that a multimedia presentation entitled “
Scene 1” is to be stored. The video information may be stored in RTP format in a file called, say, “scene 1.261,” where the “.261” extension may indicate that the format of the file's information is that specified by the International Telecommunications Union's H.261 standard. The audio may be stored in a file called, for instance, “scene 1.711” to indicate that it conforms to the G.711 audio-data standard. - Now, the timestamp information contained in the video file will not in general correspond to that in the audio file. As was mentioned above, timestamp values are assigned randomly at the beginning of a session, and the video and audio information will have been transmitted in separate sessions. Moreover, the time-interval length represented by one increment of the video timestamp values will not in general be the same as the length that an audio-timestamp-value increment represents. It may therefore be considered desirable in some cases to add information that represents the relative timing between the two files.
- But most implementers will not find this necessary. Ordinarily, the first samples from two related files can be counted on to have been taken close enough in time to be considered simultaneous, so timing can be based on this assumption. Additionally, the time-interval length represented by a single time-stamp-value increment may be inferred from, say, the file-name extension.
- The present invention's approach to persistent storage lends itself to a wide variety of uses. As was just explained, a receiver can use it to keep a record of received information. For example, a receiver of a so-called voice-over-IP signal or of a videoconference signal may use the present invention to record the substance of a conference or other telephone call. This is clearly a simple way to store information that has been received in RTP format.
- But the present invention is also advantageous for storing information that has not yet been transmitted. FIG. 1's
transmitter 14 may place the samples received from thesampling equipment 12 into the RTP format. Acting as a persistent-store driver,transmitter 14 stores the resultant packets instore 22 and then retrieves them for subsequent transmission or playback on local equipment (not shown).Transmitter 14 may, for instance, be a video- and/or audio-clip server, which sends stored information on demand to client network nodes. Storage in the RTP format greatly simplifies this process. - Additionally, the type of separate audio and video storage to which the RTP format lends itself, together with the fact that such information tends to be sent in different RTP sessions, affords a significant degree of flexibility. As was stated above, a given storage directory may contain a file called “scene 1.261” to represent audio information and another called “scene 1.711” to represent the related video information. The same directory may include a further file called, say, “scene 1.723,” containing RTP information whose payload conforms to a different audio standard, which some clients may prefer. So the present invention makes it convenient to store different audio versions for the same video clip, and vice versa. This applies not only to storage formats but also to, say, languages. For example, German, French, and Spanish versions of the audio for a film can be stored in different files and used with the same video file.
- This mechanism also provides a simple, efficient method to insert stored media clips into a real-time media stream. A typical example of this function is to broadcast a message such as “Conference will end in five minutes” to all participants in a scheduled conference.
- The present invention's teachings will also find considerable use for testing.
FIG. 1 can be interpreted as illustrating a testing scenario. Thetransmitter 14 represents a test-signal source, which applies test signals to a unit under test in the position of thechannel 16 andreceiver 18. For such purposes, the ability to employ a repeatable test signal is essential, and the RTP-format data inpersistent store 22 would dictate the repeatable values to be transmitted. Dashedlines 26 enclose elements of test equipment for performing such a test. In some cases,circuitry 28 for comparing the unit under test's output with the input would provide most of the desired functionality. The output signal could be compared simply with the input signal or with a signal determined from other values contained in RTP format in a persistent store. - From the foregoing description, it is apparent that the present invention's teachings can be employed in a wide range of embodiments and thus constitute a significant advance in the art.
Claims (10)
1. A method of performing persistent storage comprising:
A) taking samples of time-dependent data; and
B) storing a record of the data in a persistent medium as stored RTP packets whose payloads represent the samples' values and whose timestamps represent the times at which the first samples in their respective payloads were taken.
2. A method as defined in claim 1 wherein:
A) the sampled data are audio data; and
B) the method further includes retrieving the stored RTP packets and playing the audio data in accordance with the stored packets' RTP timestamps.
3. A method as defined in claim 1 wherein:
A) the sampled data are video data; and
B) the method further includes retrieving the stored RTP packets and playing the video data in accordance with the stored packets' RTP timestamps.
4. A method as defined in claim 3 further including:
A) concurrently with taking the samples of the video data, taking samples of audio data;
B) storing a second stored record of the audio data in a persistent medium as second stored RTP packets, whose payloads represent the audio samples' values and whose timestamps represent the times at which the first samples in their respective payloads were taken; and
C) playing the second stored record simultaneously with the first-mentioned stored record in accordance with the stored timestamps contained in the second stored record.
5. A method as defined in claim 1 further including retrieving the stored record and transmitting in accordance with the timestamp in each recorded packet a corresponding transmitted RTP packet including a transmitted RTP timestamp and including a payload the same as that of the recorded packet to which that transmitted packet corresponds.
6. For storing time-dependent data, an apparatus comprising:
A) a persistent medium operable to store data and retrieve data thus stored;
B) a sampler that produces a sampled record by taking samples of a time-dependent function; and
C) a persistent-store driver that responds to the sampler by storing in the persistent medium a stored record as stored RTP packets whose payloads represent the samples' values and whose time-stamps represent the times at which the first samples in their respective payloads were taken.
7. An apparatus as defined in claim 6 wherein:
A) the sampled data are audio data;
B) the persistent-store driver also retrieves the stored record; and
C) the apparatus further includes an audio player and an audio driver that drives the audio player to play the stored record in accordance with the thus-retrieved stored timestamps contained therein.
8. An apparatus as defined in claim 6 wherein:
A) the sampled data are video data;
B) the persistent-store driver also retrieves the stored record; and
C) the apparatus further includes a video player and a video driver that drives the video player to play the thus-retrieved stored record in accordance with the stored timestamps contained therein.
9. An apparatus as defined in claim 8 wherein:
A) the sampler additionally produces a second sampled record by taking audio samples of a sound signal;
B) the persistent-store driver additionally responds to the sampler by storing in the persistent medium a second stored record as stored RTP packets whose payloads represent the audio samples' values and whose timestamps represent the times at which the first audio samples in their respective payloads were taken; and
C) the apparatus further includes an audio player and an audio driver that retrieves the second stored record and drives the audio player; simultaneously with the video driver's driving of the video player, in accordance with the stored timestamps contained in the second stored record.
10. An apparatus as defined in claim 6 wherein:
A) the persistent-store driver also retrieves the stored record; and
B) the apparatus further includes a transmitter that transmits in accordance with the timestamp in each thus-retrieved recorded packet a corresponding transmitted RTP packet that both includes a transmitted RTP timestamp and includes a payload the same as that of the recorded packet to which that transmitted packet corresponds.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/233,840 US20120002945A1 (en) | 2000-06-29 | 2011-09-15 | Rtp-formatted media clips |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/606,582 US7136577B1 (en) | 2000-06-29 | 2000-06-29 | RTP-formated media clips |
US11/525,434 US9014532B2 (en) | 2000-06-29 | 2006-09-22 | RTP-formatted media clips |
US13/233,840 US20120002945A1 (en) | 2000-06-29 | 2011-09-15 | Rtp-formatted media clips |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/525,434 Division US9014532B2 (en) | 2000-06-29 | 2006-09-22 | RTP-formatted media clips |
Publications (1)
Publication Number | Publication Date |
---|---|
US20120002945A1 true US20120002945A1 (en) | 2012-01-05 |
Family
ID=37397744
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/606,582 Expired - Lifetime US7136577B1 (en) | 2000-06-29 | 2000-06-29 | RTP-formated media clips |
US11/525,434 Active 2026-03-06 US9014532B2 (en) | 2000-06-29 | 2006-09-22 | RTP-formatted media clips |
US13/233,840 Abandoned US20120002945A1 (en) | 2000-06-29 | 2011-09-15 | Rtp-formatted media clips |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/606,582 Expired - Lifetime US7136577B1 (en) | 2000-06-29 | 2000-06-29 | RTP-formated media clips |
US11/525,434 Active 2026-03-06 US9014532B2 (en) | 2000-06-29 | 2006-09-22 | RTP-formatted media clips |
Country Status (1)
Country | Link |
---|---|
US (3) | US7136577B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130102983A1 (en) * | 2011-10-12 | 2013-04-25 | Karen Wynne Gilmartin | Systems and methods for a fluid-absorbing member |
WO2016057760A1 (en) * | 2014-10-08 | 2016-04-14 | Infinesse Corporation | Reliable and efficient motionless image transfer for sip/rtp media conferencing |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7136577B1 (en) * | 2000-06-29 | 2006-11-14 | Tandberg Telecom As | RTP-formated media clips |
US7483532B2 (en) * | 2003-07-03 | 2009-01-27 | Microsoft Corporation | RTP payload format |
US20060028537A1 (en) * | 2004-07-30 | 2006-02-09 | Pulitzer J H | Interchangeable display for an A/V telecommunication device |
US7684566B2 (en) | 2005-05-27 | 2010-03-23 | Microsoft Corporation | Encryption scheme for streamed multimedia content protected by rights management system |
US8321690B2 (en) | 2005-08-11 | 2012-11-27 | Microsoft Corporation | Protecting digital media of various content types |
US20090281907A1 (en) * | 2006-06-29 | 2009-11-12 | Robert Skog | Method and arrangement for purchasing streamed media |
US8699383B2 (en) * | 2007-10-19 | 2014-04-15 | Voxer Ip Llc | Method and apparatus for real-time synchronization of voice communications |
US8559319B2 (en) * | 2007-10-19 | 2013-10-15 | Voxer Ip Llc | Method and system for real-time synchronization across a distributed services communication network |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5598352A (en) * | 1994-09-30 | 1997-01-28 | Cirrus Logic, Inc. | Method and apparatus for audio and video synchronizing in MPEG playback systems |
US5959684A (en) * | 1997-07-28 | 1999-09-28 | Sony Corporation | Method and apparatus for audio-video synchronizing |
US6111924A (en) * | 1998-02-03 | 2000-08-29 | Videoserver, Inc. | Error-correction-code synchronization in a videoconferencing gateway |
US6163647A (en) * | 1996-12-02 | 2000-12-19 | Nec Corporation | Apparatus for synchronized playback of audio-video signals |
US6201562B1 (en) * | 1998-10-31 | 2001-03-13 | Kar-Wing E. Lor | Internet protocol video phone adapter for high bandwidth data access |
US6608841B1 (en) * | 1999-12-30 | 2003-08-19 | Nokia Networks Oy | System and method for achieving robust IP/UDP/RTP header compression in the presence of unreliable networks |
US6687752B1 (en) * | 2000-03-01 | 2004-02-03 | Ezenial Inc. | Dynamic RTP/RTCP timestamp validation |
US6724736B1 (en) * | 2000-05-12 | 2004-04-20 | 3Com Corporation | Remote echo cancellation in a packet based network |
US20040095939A1 (en) * | 1999-05-25 | 2004-05-20 | Jin Yang | Method and apparatus for telecommunications using internet protocol |
US6880004B2 (en) * | 1998-08-26 | 2005-04-12 | Sts Software Systems Ltd. | Method for restoring a portion of a communication session transmitted over a computer network |
US7136577B1 (en) * | 2000-06-29 | 2006-11-14 | Tandberg Telecom As | RTP-formated media clips |
US7286652B1 (en) * | 2000-05-31 | 2007-10-23 | 3Com Corporation | Four channel audio recording in a packet based network |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5871398A (en) * | 1995-06-30 | 1999-02-16 | Walker Asset Management Limited Partnership | Off-line remote system for lotteries and games of skill |
US6201834B1 (en) * | 1996-12-20 | 2001-03-13 | Intel Corporation | Method and apparatus for packet loss recovery with standard-based packet video |
JPH10322665A (en) * | 1997-05-07 | 1998-12-04 | Lsi Logic Corp | Repetitive read control method/device for gop data |
US6175871B1 (en) * | 1997-10-01 | 2001-01-16 | 3Com Corporation | Method and apparatus for real time communication over packet networks |
US6181713B1 (en) * | 1997-10-27 | 2001-01-30 | Sun Microsystems, Inc. | Selectable depacketizer architecture |
US6377995B2 (en) * | 1998-02-19 | 2002-04-23 | At&T Corp. | Indexing multimedia communications |
IL123819A (en) * | 1998-03-24 | 2001-09-13 | Geo Interactive Media Group Lt | Network media streaming |
US6643496B1 (en) * | 1998-03-31 | 2003-11-04 | Canon Kabushiki Kaisha | System, method, and apparatus for adjusting packet transmission rates based on dynamic evaluation of network characteristics |
US6377579B1 (en) * | 1998-06-11 | 2002-04-23 | Synchrodyne Networks, Inc. | Interconnecting a synchronous switching network that utilizes a common time reference with an asynchronous switching network |
US6587985B1 (en) * | 1998-11-30 | 2003-07-01 | Matsushita Electric Industrial Co., Ltd. | Data transmission method, data transmission apparatus, data receiving apparatus, and packet data structure |
US7010032B1 (en) * | 1999-03-12 | 2006-03-07 | Kabushiki Kaisha Toshiba | Moving image coding apparatus and decoding apparatus |
US6466585B1 (en) * | 1999-04-01 | 2002-10-15 | Nokia Corporation | Apparatus and associated method for communicating multimedia information upon a communication link |
US6680921B1 (en) * | 1999-06-18 | 2004-01-20 | Telefonaktiebolaget Lm Ericsson (Publ) | Estimation of time stamps in real-time packet communications |
US6804237B1 (en) * | 1999-06-23 | 2004-10-12 | Nortel Networks Limited | Method, devices and signals for multiplexing payload data for transport in a data network |
US6771644B1 (en) * | 1999-09-17 | 2004-08-03 | Lucent Technologies Inc. | Program insertion in real time IP multicast |
US7369536B2 (en) * | 1999-11-02 | 2008-05-06 | Verizon Business Global Llc | Method for providing IP telephony with QoS using end-to-end RSVP signaling |
US6300887B1 (en) * | 1999-11-09 | 2001-10-09 | Nokia Networks Oy | Efficient handoff procedure for header compression |
US6282192B1 (en) * | 2000-01-27 | 2001-08-28 | Cisco Technology, Inc. | PSTN fallback using dial on demand routing scheme |
AU2001236570A1 (en) * | 2000-01-28 | 2001-08-07 | Ibeam Broadcasting Corporation | Method and apparatus for encoder-based distribution of live video and other streaming content |
US6606112B1 (en) * | 2000-03-16 | 2003-08-12 | Tandberg Telecom As | Composite-video generation from different-rate constituents |
US6683909B1 (en) * | 2000-03-16 | 2004-01-27 | Ezenial Inc. | Macroblock parsing without processing overhead |
JP4407007B2 (en) * | 2000-05-02 | 2010-02-03 | ソニー株式会社 | Data transmission apparatus and method |
KR100441589B1 (en) * | 2002-04-01 | 2004-07-23 | 삼성전자주식회사 | Apparatus for generating/restoring RTP packet and method thereof |
US20050058081A1 (en) * | 2003-09-16 | 2005-03-17 | Elliott Brig Barnum | Systems and methods for measuring the distance between devices |
US7551647B2 (en) * | 2004-07-19 | 2009-06-23 | Qvidium Technologies, Inc. | System and method for clock synchronization over packet-switched networks |
US20100128770A1 (en) * | 2008-11-21 | 2010-05-27 | Adrian Stanciu | Measuring Delay in a Network Segment and/or through a Network Communications Device |
-
2000
- 2000-06-29 US US09/606,582 patent/US7136577B1/en not_active Expired - Lifetime
-
2006
- 2006-09-22 US US11/525,434 patent/US9014532B2/en active Active
-
2011
- 2011-09-15 US US13/233,840 patent/US20120002945A1/en not_active Abandoned
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5598352A (en) * | 1994-09-30 | 1997-01-28 | Cirrus Logic, Inc. | Method and apparatus for audio and video synchronizing in MPEG playback systems |
US6163647A (en) * | 1996-12-02 | 2000-12-19 | Nec Corporation | Apparatus for synchronized playback of audio-video signals |
US5959684A (en) * | 1997-07-28 | 1999-09-28 | Sony Corporation | Method and apparatus for audio-video synchronizing |
US6111924A (en) * | 1998-02-03 | 2000-08-29 | Videoserver, Inc. | Error-correction-code synchronization in a videoconferencing gateway |
US6880004B2 (en) * | 1998-08-26 | 2005-04-12 | Sts Software Systems Ltd. | Method for restoring a portion of a communication session transmitted over a computer network |
US6201562B1 (en) * | 1998-10-31 | 2001-03-13 | Kar-Wing E. Lor | Internet protocol video phone adapter for high bandwidth data access |
US20040095939A1 (en) * | 1999-05-25 | 2004-05-20 | Jin Yang | Method and apparatus for telecommunications using internet protocol |
US6608841B1 (en) * | 1999-12-30 | 2003-08-19 | Nokia Networks Oy | System and method for achieving robust IP/UDP/RTP header compression in the presence of unreliable networks |
US6687752B1 (en) * | 2000-03-01 | 2004-02-03 | Ezenial Inc. | Dynamic RTP/RTCP timestamp validation |
US6724736B1 (en) * | 2000-05-12 | 2004-04-20 | 3Com Corporation | Remote echo cancellation in a packet based network |
US7286652B1 (en) * | 2000-05-31 | 2007-10-23 | 3Com Corporation | Four channel audio recording in a packet based network |
US7136577B1 (en) * | 2000-06-29 | 2006-11-14 | Tandberg Telecom As | RTP-formated media clips |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130102983A1 (en) * | 2011-10-12 | 2013-04-25 | Karen Wynne Gilmartin | Systems and methods for a fluid-absorbing member |
WO2016057760A1 (en) * | 2014-10-08 | 2016-04-14 | Infinesse Corporation | Reliable and efficient motionless image transfer for sip/rtp media conferencing |
Also Published As
Publication number | Publication date |
---|---|
US7136577B1 (en) | 2006-11-14 |
US9014532B2 (en) | 2015-04-21 |
US20070014545A1 (en) | 2007-01-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9014532B2 (en) | RTP-formatted media clips | |
JP4516082B2 (en) | Server to client streaming | |
US7633551B2 (en) | Compressed timing indicators for media samples | |
JP4649091B2 (en) | Communication terminal, server device, relay device, broadcast communication system, broadcast communication method, and program | |
US6865604B2 (en) | Method for extracting a computer network-based telephone session performed through a computer network | |
EP1108239B1 (en) | Communication management system for computer network-based telephones | |
US6418473B1 (en) | Multimedia clent and server | |
US20050021821A1 (en) | Data transmission | |
US7561518B2 (en) | Data sending/receiving system and method, information providing apparatus and method, and data receiving apparatus and method | |
EP1048156A2 (en) | Method and apparatus for media data transmission | |
EP0950322B1 (en) | Arrangement comprising insertion means for the identification of an information packet stream carrying encoded digital data by means of additional information | |
KR100640918B1 (en) | Method for manufacturing Stream File in Internet Streaming Service | |
JPH08307417A (en) | Recorder and reproducer for electronic conference | |
KR101873675B1 (en) | Method for Transmitting Audio Content Information in Network-based Audio Video Bridging System | |
EP1051008A2 (en) | Method and apparatus for media data transmission | |
Muraleedharan | Audio and Video Streaming in Online Learning | |
Jones et al. | US6714984: Method and apparatus for media data transmission | |
JP2002077825A (en) | Method for transmitting data and data transmitter and method for recording data and method for reproducing data and data recorder/reproducer | |
JP2005191942A (en) | Streaming distribution method, streaming reproduction method, streaming distribution device, streaming reproduction device, and streaming distribution / reproduction system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CISCO TECHNOLOGY, INC., CALIFORNIA Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNORS:TANDBERG TELECOM AS;CISCO SYSTEMS INTERNATIONAL SARL;SIGNING DATES FROM 20111110 TO 20111129;REEL/FRAME:027307/0451 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |