CA2680184C - Techniques for unidirectional disabling of audio-video synchronization - Google Patents
Techniques for unidirectional disabling of audio-video synchronization Download PDFInfo
- Publication number
- CA2680184C CA2680184C CA2680184A CA2680184A CA2680184C CA 2680184 C CA2680184 C CA 2680184C CA 2680184 A CA2680184 A CA 2680184A CA 2680184 A CA2680184 A CA 2680184A CA 2680184 C CA2680184 C CA 2680184C
- Authority
- CA
- Canada
- Prior art keywords
- information
- video
- audio
- synchronization
- audio information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/613—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L7/00—Arrangements for synchronising receiver with transmitter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Abstract
This disclosure describes techniques to allow for unidirectional disabling of audio video synchronization. In particular, a synchronization command is defined for packet-based network protocols. The synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving direction. In this way, devices are given more control over audio-video synchronization, and can disable such synchronization in a unidirectional manner only, while maintaining synchronization in the opposite direction.
Description
TECHNIQUES FOR UNIDIRECTIONAL DISABLING OF AUDIO-VIDEO
SYNCHRONIZATION
[0001]
TECHNICAL FIELD
SYNCHRONIZATION
[0001]
TECHNICAL FIELD
[0002] This disclosure relates to packet-based communication of audio and video information and, more particularly, techniques for disabling audio and video synchronization.
BACKGROUND
BACKGROUND
[0003] Packet-based communication according to the internet protocol (IP) is used for a wide variety of telecommunication applications. In many telecommunication applications, audio coding is used along with video coding in order to provide multimedia (i.e., audio-video) content that can be communicated between devices. Examples of applications that code audio and video information include video telephony (VT), video conferencing, and streaming video applications, to name a few. The audio and video information may be segmented into frames or packets, which comprise blocks of audio and video data. The information can be encoded, and then transmitted from an encoding device to a decoding device via packet-based IP communication. The decoding device decodes and assembles the audio and video information to create audio and video output.
100041 In many network protocols, time stamps are used with the audio and video information in order to allow for synchronization of the information at the decoding device.
In VT applications, for example, the video information may be synchronized with the audio information at the decoding device in order to ensure that the audio and video information is presented to the user in unison. As one example, it is desirable that audible speech be synchronized to movement of a speaker's mouth. Likewise, it may be intended that particular video content be viewed in conjunction with specific audio. In some specifications, such as 3GPP TS26.114 (the third generation partnership project technical specification 26.114), signaling is provisioned to allow disabling of multi-media synchronization altogether. In this case, audio information and video information are not synchronized for any communication between devices, e.g., the audio and video synchronization is disabled in both directions of a bi-directional communication.
SUMMARY
[0005] In general, this disclosure describes techniques for unidirectional disabling of audio-video synchronization. In particular, a synchronization command is defined for packet-based network protocols. The synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving directions. In this way, devices are given more control over audio-video synchronization, and can disable such synchronization in a unidirectional manner (i.e., in one direction only) while maintaining synchronization in the opposite direction.
[0006] For example, in voice-over-IP (VOIP) applications that support video telephony (VT), the default network configuration may define video synchronization with the audio. In this case, time stamps associated with the video information may be used to properly synchronize the video information with the audio information at the decoding device. In some cases, however, it may be desirable to allow a device to send an alternative video clip, while maintaining audio communication in the send path.
Furthermore, it may be desirable to allow for audio-video VT in the receive path, even if an alternative video clip is being transmitted in the send path. In these and other cases, it may be desirable to disable audio-video synchronization in the send path, while maintaining audio-video synchronization in the receive path. For such bi-lateral audio-video communications, the techniques of this disclosure allow the devices to send and receive commands to instruct the other device to either send or receive unsynchronized audio and video information. At the same time, however, audio-video synchronization may be maintained for communications in the opposite direction relative to the direction that has synchronization disabled.
[0007] In one example, this disclosure provides a method comprising generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and sending the command to a device.
[0008] In another example, this disclosure provides a method comprising receiving from a device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disabling synchronization of video information and audio information in the one direction in response to receiving the command.
[0009] In another example, this disclosure provides a device comprising a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and a transmitter that sends the command to another device.
[0010] In another example, this disclosure provides a device comprising a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command.
[0011] In another example, this disclosure provides a system comprising a packet-based network, a first device coupled to the packet-based network, and a second device coupled to the packet-based network, wherein the first device and the second device are communicatively coupled to one another for bi-directional communication through the packet based network. The first device generates a command to disable synchronization of video information and audio information in one direction of the bi-directional communication, and sends the command to a second device, and the second device receives the command, and disables synchronization of video information and audio information in the one direction in response to receiving the command.
[0012] The techniques described in this disclosure may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the software may be executed in a digital signal processor (DSP) or other type of processor.
The software that executes the techniques may be initially stored in a machine-readable medium and loaded and executed in the processor.
[0013] Accordingly, this disclosure also contemplates a computer readable medium comprising instructions that upon execution in a device cause the device to perform any of the techniques described herein. In some cases, the computer readable medium may be included in a computer program product, which may include packaging materials.
Furthermore, if implemented in hardware, the techniques of this disclosure may be directed to a circuit or other hardware apparatus that performs any of the techniques described herein.
' 74769-2585 3a [0013a] According to one aspect of the present invention, there is provided a method comprising the steps of: generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
sending the command to a device; sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
10013b1 According to another aspect of the present invention, there is provided a method comprising the steps of: receiving from a device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication; disabling synchronization of video information and audio information in the one direction in response to receiving the command; sending first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
[0013c] According to still another aspect of the present invention, there is provided a device for communicating audio and video information, comprising: a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a hi-directional communication; a transmitter that sends the command to another device; the transmitter sends first audio information and first video information to the other device, wherein synchronization is disabled for the first audio information and the first video information; and a receiver receives second audio information and second video information from the other device, wherein synchronization is enabled for the second audio information and the second video information.
= ' 74769-2585 3b [0013d] According to yet another aspect of the present invention, there is provided a device comprising: a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command a transmitter that sends first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and the receiver receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
[0013e] According to a further aspect of the present invention, there is provided a device for communicating audio and video information, comprising: means for generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the device and another device; means for sending the command to the other device; means sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and means for receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
[0013f] According to yet a further aspect of the present invention, there is provided a computer-readable medium storing code for causing a computer to communicate video information and audio information with another device, comprising: code for causing the computer to generate a command to disable synchronization of video information and audio information in only one direction of a hi-directional communication between the computer and the device; code for causing the computer to send the command to the device code for cause the computer to send first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video . 74769-2585 3c information; and code for causing the computer to process received second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
= 74769-2585 [0014] Additional details of various aspects and examples of the techniques described in this disclosure are set forth in the accompanying drawings and the description below.
Other features, objects and advantages of the techniques described herein will become apparent from the description and drawings.
BRIEF DESCRIPTION OF DRAWINGS
[0015] FIG. 1 is a block diagram illustrating a system that may implement techniques for unidirectional disabling of audio-video synchronization.
[0016] FIG. 2 is a block diagram of a device that may implement techniques for unidirectional disabling of audio-video synchronization.
[0017] FIG. 3 is a flow diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner.
[0018] FIG. 4 is a timing diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner.
DETAILED DESCRIPTION
[0019] This disclosure describes techniques to allow for unidirectional disabling of audio-video synchronization. In particular, this disclosure proposes a synchronization command that may be used for devices that communicate via packet-based network protocols.
The synchronization command can disable audio-video synchronization in a unidirectional manner. In particular, the synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving direction.
Devices can send and receive the commands to facilitate control over audio-video synchronization. In particular, devices can send and receive the commands to disable synchronization in only one direction of communication, while maintaining synchronization in the opposite direction of communication.
= = 74769-2585 4a [0020] In many network protocols, time stamps are used for the audio and video information in order to allow for synchronization of the information at the decoding device.
In packet-based video telephony (VT) applications, for example, the video information may be synchronized with the audio information at the decoding device in order to ensure that the audio information and video information are presented to the user in unison.
Such synchronization is typically the default setting for devices in the network. As one example, it is often desirable that audible speech be synchronized to movement of a speaker's mouth in VT application. Likewise, it may be intended that particular video content be viewed in conjunction with specific audio.
[0021] In some specifications, such as 3GPP TS26.114 (the third generation partnership project technical specification 26.114), signaling is provisioned to allow disabling of multi-media synchronization altogether. In this case, signaling can disable synchronization for all communication between devices, e.g., the audio and video information in both directions of a bi-directional communication. The signaling provisioned by 3GPP TS26.114, however, lacks an ability to disable synchronization in only one direction, while maintaining synchronization in the opposite direction.
[0022] As an example, voice-over-IP (VOIP) applications that support VT may have default network configurations that define video synchronization with the audio. In this case, time stamps associated with the video information may be used to properly synchronize the video information with the audio information at the decoding device.
In some cases, however, it may be desirable to allow a device to send a video clip, while maintaining audio communication in the send path. In this case, the video information is unrelated to the audio information, and should not be synchronized.
Furthermore, it may also be desirable to allow for full audio-video VT in the receive path, even if an alternative video clip is being transmitted in the send path. In these and other cases, it may be desirable to disable audio-video synchronization in the send path, while maintaining audio-video synchronization in the receive path. For such bi-lateral audio-video communications, the techniques of this disclosure allow the devices to send and receive commands to instruct the other device to either send or receive unsynchronized audio and video information. At the same time, however, audio-video synchronization may be maintained for communications in the opposite direction relative to the direction that has synchronization disabled.
[0023] FIG. 1 is a block diagram illustrating a system 2 that may use the techniques described herein. As shown in FIG. 1, system 2 includes a first audio-video device 4, a second audio-video device 6, and a packet-based network 8. First audio-video device 4 and second audio-video device 6 are both coupled to packet-based network 8. In this way, first audio-video device 4 and second audio-video device 6 are communicatively coupled to one another for bi-directional communication through packet-based network 8.
100041 In many network protocols, time stamps are used with the audio and video information in order to allow for synchronization of the information at the decoding device.
In VT applications, for example, the video information may be synchronized with the audio information at the decoding device in order to ensure that the audio and video information is presented to the user in unison. As one example, it is desirable that audible speech be synchronized to movement of a speaker's mouth. Likewise, it may be intended that particular video content be viewed in conjunction with specific audio. In some specifications, such as 3GPP TS26.114 (the third generation partnership project technical specification 26.114), signaling is provisioned to allow disabling of multi-media synchronization altogether. In this case, audio information and video information are not synchronized for any communication between devices, e.g., the audio and video synchronization is disabled in both directions of a bi-directional communication.
SUMMARY
[0005] In general, this disclosure describes techniques for unidirectional disabling of audio-video synchronization. In particular, a synchronization command is defined for packet-based network protocols. The synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving directions. In this way, devices are given more control over audio-video synchronization, and can disable such synchronization in a unidirectional manner (i.e., in one direction only) while maintaining synchronization in the opposite direction.
[0006] For example, in voice-over-IP (VOIP) applications that support video telephony (VT), the default network configuration may define video synchronization with the audio. In this case, time stamps associated with the video information may be used to properly synchronize the video information with the audio information at the decoding device. In some cases, however, it may be desirable to allow a device to send an alternative video clip, while maintaining audio communication in the send path.
Furthermore, it may be desirable to allow for audio-video VT in the receive path, even if an alternative video clip is being transmitted in the send path. In these and other cases, it may be desirable to disable audio-video synchronization in the send path, while maintaining audio-video synchronization in the receive path. For such bi-lateral audio-video communications, the techniques of this disclosure allow the devices to send and receive commands to instruct the other device to either send or receive unsynchronized audio and video information. At the same time, however, audio-video synchronization may be maintained for communications in the opposite direction relative to the direction that has synchronization disabled.
[0007] In one example, this disclosure provides a method comprising generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and sending the command to a device.
[0008] In another example, this disclosure provides a method comprising receiving from a device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disabling synchronization of video information and audio information in the one direction in response to receiving the command.
[0009] In another example, this disclosure provides a device comprising a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and a transmitter that sends the command to another device.
[0010] In another example, this disclosure provides a device comprising a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command.
[0011] In another example, this disclosure provides a system comprising a packet-based network, a first device coupled to the packet-based network, and a second device coupled to the packet-based network, wherein the first device and the second device are communicatively coupled to one another for bi-directional communication through the packet based network. The first device generates a command to disable synchronization of video information and audio information in one direction of the bi-directional communication, and sends the command to a second device, and the second device receives the command, and disables synchronization of video information and audio information in the one direction in response to receiving the command.
[0012] The techniques described in this disclosure may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the software may be executed in a digital signal processor (DSP) or other type of processor.
The software that executes the techniques may be initially stored in a machine-readable medium and loaded and executed in the processor.
[0013] Accordingly, this disclosure also contemplates a computer readable medium comprising instructions that upon execution in a device cause the device to perform any of the techniques described herein. In some cases, the computer readable medium may be included in a computer program product, which may include packaging materials.
Furthermore, if implemented in hardware, the techniques of this disclosure may be directed to a circuit or other hardware apparatus that performs any of the techniques described herein.
' 74769-2585 3a [0013a] According to one aspect of the present invention, there is provided a method comprising the steps of: generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
sending the command to a device; sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
10013b1 According to another aspect of the present invention, there is provided a method comprising the steps of: receiving from a device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication; disabling synchronization of video information and audio information in the one direction in response to receiving the command; sending first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
[0013c] According to still another aspect of the present invention, there is provided a device for communicating audio and video information, comprising: a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a hi-directional communication; a transmitter that sends the command to another device; the transmitter sends first audio information and first video information to the other device, wherein synchronization is disabled for the first audio information and the first video information; and a receiver receives second audio information and second video information from the other device, wherein synchronization is enabled for the second audio information and the second video information.
= ' 74769-2585 3b [0013d] According to yet another aspect of the present invention, there is provided a device comprising: a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command a transmitter that sends first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and the receiver receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
[0013e] According to a further aspect of the present invention, there is provided a device for communicating audio and video information, comprising: means for generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the device and another device; means for sending the command to the other device; means sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and means for receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
[0013f] According to yet a further aspect of the present invention, there is provided a computer-readable medium storing code for causing a computer to communicate video information and audio information with another device, comprising: code for causing the computer to generate a command to disable synchronization of video information and audio information in only one direction of a hi-directional communication between the computer and the device; code for causing the computer to send the command to the device code for cause the computer to send first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video . 74769-2585 3c information; and code for causing the computer to process received second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
= 74769-2585 [0014] Additional details of various aspects and examples of the techniques described in this disclosure are set forth in the accompanying drawings and the description below.
Other features, objects and advantages of the techniques described herein will become apparent from the description and drawings.
BRIEF DESCRIPTION OF DRAWINGS
[0015] FIG. 1 is a block diagram illustrating a system that may implement techniques for unidirectional disabling of audio-video synchronization.
[0016] FIG. 2 is a block diagram of a device that may implement techniques for unidirectional disabling of audio-video synchronization.
[0017] FIG. 3 is a flow diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner.
[0018] FIG. 4 is a timing diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner.
DETAILED DESCRIPTION
[0019] This disclosure describes techniques to allow for unidirectional disabling of audio-video synchronization. In particular, this disclosure proposes a synchronization command that may be used for devices that communicate via packet-based network protocols.
The synchronization command can disable audio-video synchronization in a unidirectional manner. In particular, the synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving direction.
Devices can send and receive the commands to facilitate control over audio-video synchronization. In particular, devices can send and receive the commands to disable synchronization in only one direction of communication, while maintaining synchronization in the opposite direction of communication.
= = 74769-2585 4a [0020] In many network protocols, time stamps are used for the audio and video information in order to allow for synchronization of the information at the decoding device.
In packet-based video telephony (VT) applications, for example, the video information may be synchronized with the audio information at the decoding device in order to ensure that the audio information and video information are presented to the user in unison.
Such synchronization is typically the default setting for devices in the network. As one example, it is often desirable that audible speech be synchronized to movement of a speaker's mouth in VT application. Likewise, it may be intended that particular video content be viewed in conjunction with specific audio.
[0021] In some specifications, such as 3GPP TS26.114 (the third generation partnership project technical specification 26.114), signaling is provisioned to allow disabling of multi-media synchronization altogether. In this case, signaling can disable synchronization for all communication between devices, e.g., the audio and video information in both directions of a bi-directional communication. The signaling provisioned by 3GPP TS26.114, however, lacks an ability to disable synchronization in only one direction, while maintaining synchronization in the opposite direction.
[0022] As an example, voice-over-IP (VOIP) applications that support VT may have default network configurations that define video synchronization with the audio. In this case, time stamps associated with the video information may be used to properly synchronize the video information with the audio information at the decoding device.
In some cases, however, it may be desirable to allow a device to send a video clip, while maintaining audio communication in the send path. In this case, the video information is unrelated to the audio information, and should not be synchronized.
Furthermore, it may also be desirable to allow for full audio-video VT in the receive path, even if an alternative video clip is being transmitted in the send path. In these and other cases, it may be desirable to disable audio-video synchronization in the send path, while maintaining audio-video synchronization in the receive path. For such bi-lateral audio-video communications, the techniques of this disclosure allow the devices to send and receive commands to instruct the other device to either send or receive unsynchronized audio and video information. At the same time, however, audio-video synchronization may be maintained for communications in the opposite direction relative to the direction that has synchronization disabled.
[0023] FIG. 1 is a block diagram illustrating a system 2 that may use the techniques described herein. As shown in FIG. 1, system 2 includes a first audio-video device 4, a second audio-video device 6, and a packet-based network 8. First audio-video device 4 and second audio-video device 6 are both coupled to packet-based network 8. In this way, first audio-video device 4 and second audio-video device 6 are communicatively coupled to one another for bi-directional communication through packet-based network 8.
[0024] First audio-video device 4 and second audio-video device 6 may include reciprocal components to support two-way communication of audio-video information.
The communication liffl( between first audio-video device 4 and second audio-video device 6 may include wired or wireless channels or possibly a combination of wired and wireless channels.
[0025] First audio-video device 4 and second audio-video device 6 may be implemented to include one or more processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic, software, hardware, firmware, or any combinations thereof Examples of first audio-video device 4 and second audio-video device 6 may include digital televisions, laptop computers or desktop computers, digital music and video devices, video gaming devices, and wireless communication devices such as cellular, satellite or terrestrial-based radiotelephones, and personal digital assistants (PDAs).
[0026] In an exemplary embodiment, first and second devices 4, 6 each comprise wireless communication devices, e.g., handsets commonly referred to as cellular telephones. In this case, first and second devices 4, 6 may support VT
applications in which audio and video information is transmitted between devices 4, 6. The default setting for such VT applications may define synchronization of video information with audio information in both paths of communication. For purposes of explanation, communications from first audio-video device 4 to second audio-video device 6 may be referred to as forward communications, while communications from second audio-video device 6 to first audio-video device 4 may be referred to as reverse communications. Of course, these directions could be reversed.
[0027] The components described herein are exemplary of those applicable to implementation of the techniques described herein, although first audio-video device 4 and second audio-video device 6 may include many other components, if desired.
Moreover, the techniques of this disclosure are not necessarily limited to use in a system like that of system 2. The techniques may find application in any audio-video coding environment in which the video information is synchronized with the audio information.
[0028] In general, first audio-video device 4 generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication with second audio-video device 6. First audio-video device 4 sends the command to second audio-video device 6. Second audio-video device 6 receives the command to disable synchronization of video information and audio information in only one direction of the bi-directional communication.
In response to receiving the command, second audio-video device 6 disables synchronization of video information and audio information in the one direction.
Second audio-video device 6 may send an acknowledgement of the command to first audio-video device 4 to indicate that synchronization of video information and audio information is disabled in the one direction. First audio-video device 4 receives the acknowledgement of the command from second audio-video device 6, and in response to the acknowledgement, first audio-video device 4 disables synchronization of video information and audio information in the one direction.
[0029] In one example, the command disables synchronization of video and audio information in a forward direction of communication, e.g., from first audio-video device 4 to second audio-video device 6. In this case, first audio-video device 4 sends first audio information and first video information to second audio-video device 6 and synchronization is disabled for the first audio information and the first video information. The first audio information may comprise first voice information associated with a first user at first audio-video device 4, and the first video information may comprise a video clip unrelated to the first audio information. First audio-video device 4 then receives second audio information and second video information from second audio-video device 6, wherein synchronization is enabled for the second audio information and the second video information. The second audio information may comprise second voice information associated with a second user at second audio-video device 6, and the second video information may comprise video associated with the second audio information.
[0030] In another example, the command disables synchronization of video and audio information in a reverse direction of communication, e.g., from second audio-video device 6 to first audio-video device 4. In this case, first audio-video device 4 sends first audio information and first video information to second audio-video device 6, wherein synchronization is enabled for the first audio information and the first video information. The first audio information comprises first voice information associated with a first user at first audio-video device 4, and the first video information comprises video associated with the first audio information. First audio-video device 4 receives second audio information and second video information from second audio-video device 6, wherein synchronization is disabled for the second audio information and the second video information. The second audio information may comprise second voice information associated with a second user at second audio-video device 6, and the second video information comprises a video clip unrelated to the second audio information.
[0031] In one exemplary implementation, the command to disable synchronization in one direction comprises a synchronization attribute command in a third generation partnership project technical specification 26.114 (3GPP TS26.114) protocol.
In this case, the command may comprise a session description protocol (SDP) update within a bi-directional video stream that indicates that video information in the sending direction, the receiving direction, or both the sending and receiving direction should not be synchronized with audio information. First and second devices 4, 6 can be programmed to understand the command, and disable synchronization in the manner specified by the command. Again, this includes the ability to disable synchronization in only a unidirectional manner.
[0032] FIG. 2 is block diagram of an exemplary audio-video device 10, which may correspond to either first audio-video device 4 or second audio-video device 6 of FIG. 1.
Device 10 sends and receives communications with another device through packet-based network 8. The communications may include both audio and video information.
Transmitter 14 sends such audio-video information, and receiver 16 receives such audio-video information. In some implementations, transmitter 14 and receiver could be integrated into a common transceiver.
[0033] Control unit 12 facilitates control and data transfer within audio-video device 10.
Device 10 includes a video unit 18, which may comprise a video CODEC (encoder-decoder) to facilitate encoding and decoding of video information. Device 10 also includes an audio unit 20, which may comprise an audio CODEC to facilitate encoding and decoding of audio information. In some cases, video unit 18 and audio unit 20 may be integrated into a common audio-video CODEC. Video information may be synchronized with audio information as a default setting. In this case, video unit 18 synchronizes any decoded video information with decoded audio information from audio unit 20, e.g., based on time stamps of the video and audio information.
Memory 22 stores the encoded and decoded information. User interface(s) 24 may facilitate interaction with a user, and may include display screens, touch screens, keypads, scroll bars, scroll wheels, or any other unit that can present output or receive input from a user.
The various components illustrated in FIG. 2 may be implemented at least in part as one or more processors, DSPs, ASICs, FPGAs, discrete logic, software, hardware, firmware, or any combinations thereof. If implemented in software, executable instructions may be stored in memory 22, and loaded into control unit 12 (or other units of device 10) for execution.
[0034] In accordance with this disclosure, device 10 generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication with another device. In particular, control unit generates the command, and causes transmitter 14 to send the command to another device (not shown in FIG. 2) via packet-based network 8. Receiver 16 may receive an acknowledgement of the command from the other device, and in response to the acknowledgement, device 10 disables synchronization of video information and audio information in the one direction.
[0035] In another example, device 10 may receive the command to disable synchronization of video information and audio information in one direction of the bi-directional communication. In this case, device 10 receives the command from another device (not shown in FIG. 2), which may be coupled to device 10 via packet-based network 8. In response to receiving the command, device 10 disables synchronization of video information and audio information in the one direction. In this case, device 10 may send an acknowledgement of the command to the other device via packet-based network 8 to indicate that synchronization of video information and audio information is disabled in the one direction.
[0036] The command may disable synchronization of video and audio information in a forward direction of communication, e.g., from device 10 to another device coupled to packet-based network 8, or in a reverse direction, e.g., from the other device to device 10. In forward direction case, transmitter 14 of device 10 sends audio information and video information to another device and synchronization is disabled for the audio information and the video information. In the reverse direction case, receiver 16 of audio-video device 10 receives audio information and video information from another device, wherein synchronization is disabled for the audio information and the video information. When synchronization is disabled, video unit 18 decodes the video information without synchronizing the video information with audio information. User interface(s) 24 present the video information without synchronization with the audio information decoded by audio unit 20.
[0037] FIG. 3 is a flow diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner. As shown in FIG. 3, first audio-video device 4 generates a command to disable synchronization in one direction (31), and first audio-video device 4 sends the command to second audio-video device 6 (32).
Second audio-video device 6 receives the command (33), and disables synchronization in the one direction in response to the command (34). Second audio-video device 6 also sends an acknowledgement (35) to first audio-video device 4.
[0038] First audio-video device 4 receives the acknowledgement (36), and disables synchronization in the one direction (37) in response to the acknowledgement.
First audio-video device 4 sends and receives audio information to and from second audio-video device 6 (38), and second audio-video device 6 sends and receives audio information to and from first audio-video device 4 (39). At this point, audio-video synchronization is disabled in either the forward or reverse direction of the bi-lateral communication between audio-video device 4 and 6. That is to say, audio-video synchronization is disabled in one direction of the bi-lateral communication, but remains enabled in the opposite direction of the bi-lateral communication.
[0039] FIG. 4 is a timing diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner. D1 and D2 represent first and second devices respectively. D1 may correspond to device 4 of FIG. 1 and D2 may correspond to device 6 of FIG. 1. As shown in FIG. 4, D1 sends an offer to D2.
The offer specifies that m=audio 7000 RTP/AVP 100. This means that D1 wants D2 to send audio information having a real time transport protocol / audio video profile (RTP/AVP) of 100 to port 7000 of device Dl. RTP/AVP 100 specifies the payload type of the audio communication. The offer also specifies that a=rtpmap:100 evrcb0/8000, which provides a mapping of information and identifies an audio CODEC to be used. In particular, "evrcb0/8000" signals that the CODEC "evrcb" should be used with a sampling frequency of 8000. The "0" in "evrcb0" signals a specific packetization mode of speech frames produced by the evrcb CODEC. The parameter "rtpmap" maps the payload type 100 (from "m=audio 7000 RTP/AVP 100) to evrcb0/8000. The actual packet carries the payload type 100, which can be interpreted by D2 as an identification of evrcb0/8000.
The communication liffl( between first audio-video device 4 and second audio-video device 6 may include wired or wireless channels or possibly a combination of wired and wireless channels.
[0025] First audio-video device 4 and second audio-video device 6 may be implemented to include one or more processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic, software, hardware, firmware, or any combinations thereof Examples of first audio-video device 4 and second audio-video device 6 may include digital televisions, laptop computers or desktop computers, digital music and video devices, video gaming devices, and wireless communication devices such as cellular, satellite or terrestrial-based radiotelephones, and personal digital assistants (PDAs).
[0026] In an exemplary embodiment, first and second devices 4, 6 each comprise wireless communication devices, e.g., handsets commonly referred to as cellular telephones. In this case, first and second devices 4, 6 may support VT
applications in which audio and video information is transmitted between devices 4, 6. The default setting for such VT applications may define synchronization of video information with audio information in both paths of communication. For purposes of explanation, communications from first audio-video device 4 to second audio-video device 6 may be referred to as forward communications, while communications from second audio-video device 6 to first audio-video device 4 may be referred to as reverse communications. Of course, these directions could be reversed.
[0027] The components described herein are exemplary of those applicable to implementation of the techniques described herein, although first audio-video device 4 and second audio-video device 6 may include many other components, if desired.
Moreover, the techniques of this disclosure are not necessarily limited to use in a system like that of system 2. The techniques may find application in any audio-video coding environment in which the video information is synchronized with the audio information.
[0028] In general, first audio-video device 4 generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication with second audio-video device 6. First audio-video device 4 sends the command to second audio-video device 6. Second audio-video device 6 receives the command to disable synchronization of video information and audio information in only one direction of the bi-directional communication.
In response to receiving the command, second audio-video device 6 disables synchronization of video information and audio information in the one direction.
Second audio-video device 6 may send an acknowledgement of the command to first audio-video device 4 to indicate that synchronization of video information and audio information is disabled in the one direction. First audio-video device 4 receives the acknowledgement of the command from second audio-video device 6, and in response to the acknowledgement, first audio-video device 4 disables synchronization of video information and audio information in the one direction.
[0029] In one example, the command disables synchronization of video and audio information in a forward direction of communication, e.g., from first audio-video device 4 to second audio-video device 6. In this case, first audio-video device 4 sends first audio information and first video information to second audio-video device 6 and synchronization is disabled for the first audio information and the first video information. The first audio information may comprise first voice information associated with a first user at first audio-video device 4, and the first video information may comprise a video clip unrelated to the first audio information. First audio-video device 4 then receives second audio information and second video information from second audio-video device 6, wherein synchronization is enabled for the second audio information and the second video information. The second audio information may comprise second voice information associated with a second user at second audio-video device 6, and the second video information may comprise video associated with the second audio information.
[0030] In another example, the command disables synchronization of video and audio information in a reverse direction of communication, e.g., from second audio-video device 6 to first audio-video device 4. In this case, first audio-video device 4 sends first audio information and first video information to second audio-video device 6, wherein synchronization is enabled for the first audio information and the first video information. The first audio information comprises first voice information associated with a first user at first audio-video device 4, and the first video information comprises video associated with the first audio information. First audio-video device 4 receives second audio information and second video information from second audio-video device 6, wherein synchronization is disabled for the second audio information and the second video information. The second audio information may comprise second voice information associated with a second user at second audio-video device 6, and the second video information comprises a video clip unrelated to the second audio information.
[0031] In one exemplary implementation, the command to disable synchronization in one direction comprises a synchronization attribute command in a third generation partnership project technical specification 26.114 (3GPP TS26.114) protocol.
In this case, the command may comprise a session description protocol (SDP) update within a bi-directional video stream that indicates that video information in the sending direction, the receiving direction, or both the sending and receiving direction should not be synchronized with audio information. First and second devices 4, 6 can be programmed to understand the command, and disable synchronization in the manner specified by the command. Again, this includes the ability to disable synchronization in only a unidirectional manner.
[0032] FIG. 2 is block diagram of an exemplary audio-video device 10, which may correspond to either first audio-video device 4 or second audio-video device 6 of FIG. 1.
Device 10 sends and receives communications with another device through packet-based network 8. The communications may include both audio and video information.
Transmitter 14 sends such audio-video information, and receiver 16 receives such audio-video information. In some implementations, transmitter 14 and receiver could be integrated into a common transceiver.
[0033] Control unit 12 facilitates control and data transfer within audio-video device 10.
Device 10 includes a video unit 18, which may comprise a video CODEC (encoder-decoder) to facilitate encoding and decoding of video information. Device 10 also includes an audio unit 20, which may comprise an audio CODEC to facilitate encoding and decoding of audio information. In some cases, video unit 18 and audio unit 20 may be integrated into a common audio-video CODEC. Video information may be synchronized with audio information as a default setting. In this case, video unit 18 synchronizes any decoded video information with decoded audio information from audio unit 20, e.g., based on time stamps of the video and audio information.
Memory 22 stores the encoded and decoded information. User interface(s) 24 may facilitate interaction with a user, and may include display screens, touch screens, keypads, scroll bars, scroll wheels, or any other unit that can present output or receive input from a user.
The various components illustrated in FIG. 2 may be implemented at least in part as one or more processors, DSPs, ASICs, FPGAs, discrete logic, software, hardware, firmware, or any combinations thereof. If implemented in software, executable instructions may be stored in memory 22, and loaded into control unit 12 (or other units of device 10) for execution.
[0034] In accordance with this disclosure, device 10 generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication with another device. In particular, control unit generates the command, and causes transmitter 14 to send the command to another device (not shown in FIG. 2) via packet-based network 8. Receiver 16 may receive an acknowledgement of the command from the other device, and in response to the acknowledgement, device 10 disables synchronization of video information and audio information in the one direction.
[0035] In another example, device 10 may receive the command to disable synchronization of video information and audio information in one direction of the bi-directional communication. In this case, device 10 receives the command from another device (not shown in FIG. 2), which may be coupled to device 10 via packet-based network 8. In response to receiving the command, device 10 disables synchronization of video information and audio information in the one direction. In this case, device 10 may send an acknowledgement of the command to the other device via packet-based network 8 to indicate that synchronization of video information and audio information is disabled in the one direction.
[0036] The command may disable synchronization of video and audio information in a forward direction of communication, e.g., from device 10 to another device coupled to packet-based network 8, or in a reverse direction, e.g., from the other device to device 10. In forward direction case, transmitter 14 of device 10 sends audio information and video information to another device and synchronization is disabled for the audio information and the video information. In the reverse direction case, receiver 16 of audio-video device 10 receives audio information and video information from another device, wherein synchronization is disabled for the audio information and the video information. When synchronization is disabled, video unit 18 decodes the video information without synchronizing the video information with audio information. User interface(s) 24 present the video information without synchronization with the audio information decoded by audio unit 20.
[0037] FIG. 3 is a flow diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner. As shown in FIG. 3, first audio-video device 4 generates a command to disable synchronization in one direction (31), and first audio-video device 4 sends the command to second audio-video device 6 (32).
Second audio-video device 6 receives the command (33), and disables synchronization in the one direction in response to the command (34). Second audio-video device 6 also sends an acknowledgement (35) to first audio-video device 4.
[0038] First audio-video device 4 receives the acknowledgement (36), and disables synchronization in the one direction (37) in response to the acknowledgement.
First audio-video device 4 sends and receives audio information to and from second audio-video device 6 (38), and second audio-video device 6 sends and receives audio information to and from first audio-video device 4 (39). At this point, audio-video synchronization is disabled in either the forward or reverse direction of the bi-lateral communication between audio-video device 4 and 6. That is to say, audio-video synchronization is disabled in one direction of the bi-lateral communication, but remains enabled in the opposite direction of the bi-lateral communication.
[0039] FIG. 4 is a timing diagram illustrating a technique in which audio-video synchronization is disabled in a unidirectional manner. D1 and D2 represent first and second devices respectively. D1 may correspond to device 4 of FIG. 1 and D2 may correspond to device 6 of FIG. 1. As shown in FIG. 4, D1 sends an offer to D2.
The offer specifies that m=audio 7000 RTP/AVP 100. This means that D1 wants D2 to send audio information having a real time transport protocol / audio video profile (RTP/AVP) of 100 to port 7000 of device Dl. RTP/AVP 100 specifies the payload type of the audio communication. The offer also specifies that a=rtpmap:100 evrcb0/8000, which provides a mapping of information and identifies an audio CODEC to be used. In particular, "evrcb0/8000" signals that the CODEC "evrcb" should be used with a sampling frequency of 8000. The "0" in "evrcb0" signals a specific packetization mode of speech frames produced by the evrcb CODEC. The parameter "rtpmap" maps the payload type 100 (from "m=audio 7000 RTP/AVP 100) to evrcb0/8000. The actual packet carries the payload type 100, which can be interpreted by D2 as an identification of evrcb0/8000.
[0040] The offer also specifies that m=video 6000 RTP/AVP 98. This means that wants D2 to send video information having an RTP/AVP of 98 to port 6000 of device Dl. RTP/AVP 98 specifies the payload type of the video communication. The offer also specifies that a=3gpp sync info:No Sync:send. This command (a=3gpp sync info:No Sync:send) is one example of a command that disables synchronization in a unidirectional manner. In this case, D1 has requested D2 to disable synchronization in the sending direction from D1 to D2. Alternatively, D1 could send a command (a=3gpp sync info:No Sync:recv) to disable synchronization in the receive direction from D2 to D1, or a command (a=3gpp sync info:No Sync:send and recv) to disable synchronization in both the sending and receive directions.
[0041] Upon receiving the offer from D1, D2 sends an answer, which acknowledges the offer. The answer specifies that m=audio 8000 RTP/AVP 100. This means that D2 wants D1 to send audio information having an RTP/AVP of 100 to port 8000 of device D2. Again, RTP/AVP 100 specifies the payload type of the audio communication.
The answer also specifies that a=rtpmap:100 evrcb0/8000, which provides a mapping of information and identifies an audio CODEC to be used. Again, "evrcb0/8000"
signals that the CODEC "evrcb" should be used with a sampling frequency of 8000, and the "0"
in "evrcb0" signals a specific packetization mode of speech frames produced by the evrcb CODEC. The parameter "rtpmap" maps the payload type 100 (from "m=audio 8000 RTP/AVP 100) to evrcb0/8000.
[0042] The answer also specifies that m=video 7000 RTP/AVP 98. This means that wants D1 to send video information having an RTP/AVP of 98 to port 7000 of device D2. Again, RTP/AVP 98 specifies the payload type of the video communication.
The answer also specifies that a=3gpp sync info:No Sync:recv. This command acknowledges that D2 will disable synchronization in the sending direction from D1 to D2.
[0043] The commands described in this disclosure can facilitate unidirectional disabling of audio-video synchronization. In particular, the synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving direction. Devices D1 and D2 can send and receive the commands to facilitate control over audio-video synchronization. In this way, devices D1 and D2 can send and receive the commands to disable synchronization in one direction of communication, while maintaining synchronization in the opposite direction of communication.
[0044] A number of techniques and examples have been described. The described techniques may be implemented in hardware, software, firmware, or any combination thereof If implemented in software, the techniques described herein may be embodied in a computer readable medium comprising instructions that upon execution in a device to perform one or more of the techniques described above. For example, the instructions, upon execution, may cause the device to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and send the command to another device. Also, the instructions, upon execution, may cause the device to receive from another device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disable synchronization of video information and audio information in the one direction in response to receiving the command. In some cases, the computer readable medium may be included in a computer program product, which may include packaging materials.
[0045] The computer-readable medium may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, magnetic or optical data storage media, and the like. The instructions may be executed by one or more processors or other machines, such as one or more DSPs, general purpose microprocessors, one or more ASICs, one or more FPGAs, or other equivalent integrated or discrete logic circuitry. In some embodiments, the functionality described herein may be provided within dedicated software modules or hardware units.
[0046] Furthermore, in some cases, the techniques of this disclosure may be implemented in hardware, in which case this disclosure may be directed to a circuit, such as an integrated circuit, ASIC, FPGA, or the like. The circuit may cause the device to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and send the command to another device. Also, the circuit may cause the device to receive from another device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disable synchronization of video information and audio information in the one direction in response to receiving the command.
[0047] Although the techniques described above have been primarily described in the context of a bi-directional communication between two devices, the techniques of this disclosure may apply to scenarios where a given device has bi-directional communication with multiple devices. In this case, the given device that generates and sends the command may send the command to multiple devices, all of which have a bi-directional communication with the given device. Each of the different devices that receive the command may disable synchronization in only one direction of the bi-directional communication, and acknowledge the command to the sending device as described herein.
[0048] These and other examples are within the scope of the following claims.
[0041] Upon receiving the offer from D1, D2 sends an answer, which acknowledges the offer. The answer specifies that m=audio 8000 RTP/AVP 100. This means that D2 wants D1 to send audio information having an RTP/AVP of 100 to port 8000 of device D2. Again, RTP/AVP 100 specifies the payload type of the audio communication.
The answer also specifies that a=rtpmap:100 evrcb0/8000, which provides a mapping of information and identifies an audio CODEC to be used. Again, "evrcb0/8000"
signals that the CODEC "evrcb" should be used with a sampling frequency of 8000, and the "0"
in "evrcb0" signals a specific packetization mode of speech frames produced by the evrcb CODEC. The parameter "rtpmap" maps the payload type 100 (from "m=audio 8000 RTP/AVP 100) to evrcb0/8000.
[0042] The answer also specifies that m=video 7000 RTP/AVP 98. This means that wants D1 to send video information having an RTP/AVP of 98 to port 7000 of device D2. Again, RTP/AVP 98 specifies the payload type of the video communication.
The answer also specifies that a=3gpp sync info:No Sync:recv. This command acknowledges that D2 will disable synchronization in the sending direction from D1 to D2.
[0043] The commands described in this disclosure can facilitate unidirectional disabling of audio-video synchronization. In particular, the synchronization command can disable audio-video synchronization in a sending direction, a receiving direction, or both the sending and receiving direction. Devices D1 and D2 can send and receive the commands to facilitate control over audio-video synchronization. In this way, devices D1 and D2 can send and receive the commands to disable synchronization in one direction of communication, while maintaining synchronization in the opposite direction of communication.
[0044] A number of techniques and examples have been described. The described techniques may be implemented in hardware, software, firmware, or any combination thereof If implemented in software, the techniques described herein may be embodied in a computer readable medium comprising instructions that upon execution in a device to perform one or more of the techniques described above. For example, the instructions, upon execution, may cause the device to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and send the command to another device. Also, the instructions, upon execution, may cause the device to receive from another device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disable synchronization of video information and audio information in the one direction in response to receiving the command. In some cases, the computer readable medium may be included in a computer program product, which may include packaging materials.
[0045] The computer-readable medium may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, magnetic or optical data storage media, and the like. The instructions may be executed by one or more processors or other machines, such as one or more DSPs, general purpose microprocessors, one or more ASICs, one or more FPGAs, or other equivalent integrated or discrete logic circuitry. In some embodiments, the functionality described herein may be provided within dedicated software modules or hardware units.
[0046] Furthermore, in some cases, the techniques of this disclosure may be implemented in hardware, in which case this disclosure may be directed to a circuit, such as an integrated circuit, ASIC, FPGA, or the like. The circuit may cause the device to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and send the command to another device. Also, the circuit may cause the device to receive from another device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication, and disable synchronization of video information and audio information in the one direction in response to receiving the command.
[0047] Although the techniques described above have been primarily described in the context of a bi-directional communication between two devices, the techniques of this disclosure may apply to scenarios where a given device has bi-directional communication with multiple devices. In this case, the given device that generates and sends the command may send the command to multiple devices, all of which have a bi-directional communication with the given device. Each of the different devices that receive the command may disable synchronization in only one direction of the bi-directional communication, and acknowledge the command to the sending device as described herein.
[0048] These and other examples are within the scope of the following claims.
Claims (20)
1. A method comprising the steps of:
generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
sending the command to a device;
sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
sending the command to a device;
sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
2. The method of claim 1, further comprising the step of receiving an acknowledgement of the command from the device indicating that the device has disabled synchronization of video information and audio information in the one direction.
3. The method of claim 1, wherein:
the first audio information comprises first voice information associated with a first user;
the first video information comprises video associated with the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises a video clip unrelated to the second audio information.
the first audio information comprises first voice information associated with a first user;
the first video information comprises video associated with the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises a video clip unrelated to the second audio information.
4. The method of claim 1, wherein the command comprises a synchronization attribute command in a protocol conforming to a third generation partnership project technical specification 26.114 (3GPP TS26.114).
5. A method comprising the steps of receiving from a device a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
disabling synchronization of video information and audio information in the one direction in response to receiving the command;
sending first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
disabling synchronization of video information and audio information in the one direction in response to receiving the command;
sending first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
6. The method of claim 5, further comprising the step of sending an acknowledgement of the command to the device to indicate that synchronization of video information and audio information is disabled in the one direction.
7. The method of claim 5, wherein:
the first audio information comprises first voice information associated with a first user;
the first video information comprises a video clip unrelated to the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises video associated with the second audio information.
the first audio information comprises first voice information associated with a first user;
the first video information comprises a video clip unrelated to the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises video associated with the second audio information.
8. The method of claim 5, wherein the command comprises a synchronization attribute command in a protocol conforming to a third generation partnership project technical specification 26.114 (3GPP TS26.114).
9. A device for communicating audio and video information, comprising:
a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
a transmitter that sends the command to another device;
the transmitter sends first audio information and first video information to the other device, wherein synchronization is disabled for the first audio information and the first video information; and a receiver receives second audio information and second video information from the other device, wherein synchronization is enabled for the second audio information and the second video information.
a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
a transmitter that sends the command to another device;
the transmitter sends first audio information and first video information to the other device, wherein synchronization is disabled for the first audio information and the first video information; and a receiver receives second audio information and second video information from the other device, wherein synchronization is enabled for the second audio information and the second video information.
10. The device of claim 9, further comprising a receiver that receives an acknowledgement of the command from the other device indicating that the other device has disabled synchronization of video information and audio information in the one direction.
11. The device of claim 9, wherein:
the first audio information comprises first voice information associated with a first user;
the first video information comprises a video clip unrelated to the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises video associated with the second audio information.
the first audio information comprises first voice information associated with a first user;
the first video information comprises a video clip unrelated to the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises video associated with the second audio information.
12. A device for communicating audio and video information, comprising:
a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
a transmitter that sends the command to another device, wherein the one direction comprises a direction of communication from the other device to the device, and wherein:
the transmitter is configured to send first audio information and first video information to the other device, wherein synchronization is enabled for the first audio information and the first video information; and a receiver is configured to receive second audio information and second video information from the other device, wherein synchronization is disabled for the second audio information and the second video information.
a control unit that generates a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
a transmitter that sends the command to another device, wherein the one direction comprises a direction of communication from the other device to the device, and wherein:
the transmitter is configured to send first audio information and first video information to the other device, wherein synchronization is enabled for the first audio information and the first video information; and a receiver is configured to receive second audio information and second video information from the other device, wherein synchronization is disabled for the second audio information and the second video information.
13. The device of claim 12, wherein:
the first audio information comprises first voice information associated with a first user;
the first video information comprises video associated with the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises a video clip unrelated to the second audio information.
the first audio information comprises first voice information associated with a first user;
the first video information comprises video associated with the first audio information;
the second audio information comprises second voice information associated with a second user; and the second video information comprises a video clip unrelated to the second audio information.
14. The device of claim 9, wherein the command comprises a synchronization attribute command in a protocol conforming to a third generation partnership project technical specification 26.114 (3GPP TS26.114).
15. The device of claim 9, wherein the device comprises at least one of:
a wireless communication device handset; and an integrated circuit.
a wireless communication device handset; and an integrated circuit.
16. A device comprising:
a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command a transmitter that sends first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and the receiver receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
a receiver that receives a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication;
and a control unit that disables synchronization of video information and audio information in the one direction in response to receiving the command a transmitter that sends first audio information and first video information to the device, wherein synchronization is disabled for the first audio information and the first video information; and the receiver receiving second audio information and second video information from the device, wherein synchronization is enabled for the second audio information and the second video information.
17. A device for communicating audio and video information, comprising:
means for generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the device and another device;
means for sending the command to the other device;
means sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and means for receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
means for generating a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the device and another device;
means for sending the command to the other device;
means sending first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and means for receiving second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
18. The device of claim 17, further comprising means for receiving an acknowledgement of the command from the other device indicating that the other device has disabled synchronization of video information and audio information in one direction.
19. A computer-readable medium storing code for causing a computer to communicate video information and audio information with another device, comprising:
code for causing the computer to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the computer and the device;
code for causing the computer to send the command to the device code for cause the computer to send first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and code for causing the computer to process received second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
code for causing the computer to generate a command to disable synchronization of video information and audio information in only one direction of a bi-directional communication between the computer and the device;
code for causing the computer to send the command to the device code for cause the computer to send first audio information and first video information to the device, wherein synchronization is enabled for the first audio information and the first video information; and code for causing the computer to process received second audio information and second video information from the device, wherein synchronization is disabled for the second audio information and the second video information.
20. The computer-readable medium storing code according to claim 19, further comprising code for configuring the computer to receive an acknowledgement of the command from the device indicating that the device has disabled synchronization of video information and audio information in one direction.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US89680607P | 2007-03-23 | 2007-03-23 | |
| US60/896,806 | 2007-03-23 | ||
| US12/042,876 | 2008-03-05 | ||
| US12/042,876 US8077745B2 (en) | 2007-03-23 | 2008-03-05 | Techniques for unidirectional disabling of audio-video synchronization |
| PCT/US2008/057923 WO2008118819A1 (en) | 2007-03-23 | 2008-03-21 | Techniques for unidirectional disabling of audio-video synchronization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2680184A1 CA2680184A1 (en) | 2008-10-02 |
| CA2680184C true CA2680184C (en) | 2013-05-21 |
Family
ID=39774789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2680184A Active CA2680184C (en) | 2007-03-23 | 2008-03-21 | Techniques for unidirectional disabling of audio-video synchronization |
Country Status (10)
| Country | Link |
|---|---|
| US (1) | US8077745B2 (en) |
| EP (1) | EP2137927B1 (en) |
| JP (2) | JP5102347B2 (en) |
| KR (1) | KR101111356B1 (en) |
| CN (1) | CN101641941B (en) |
| BR (1) | BRPI0809387B1 (en) |
| CA (1) | CA2680184C (en) |
| RU (1) | RU2425465C1 (en) |
| TW (1) | TWI367012B (en) |
| WO (1) | WO2008118819A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5813767B2 (en) * | 2010-07-21 | 2015-11-17 | ディー−ボックス テクノロジーズ インコーポレイテッド | Media recognition and synchronization to motion signals |
| US9491505B2 (en) | 2012-02-28 | 2016-11-08 | Qualcomm Incorporated | Frame capture and buffering at source device in wireless display system |
| US10218684B2 (en) * | 2015-01-30 | 2019-02-26 | Ncr Corporation | Secure data transmission |
| KR20170067546A (en) * | 2015-12-08 | 2017-06-16 | 한국전자통신연구원 | System and method for audio signal and a video signal synchronization |
| US11689583B2 (en) * | 2018-12-10 | 2023-06-27 | Telefonaktiebolaget Lm Ericsson (Publ) | Network node, entity and methods performed therein for handling a communication session in a communication network |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5872784A (en) | 1993-10-20 | 1999-02-16 | Lsi Logic Corporation | High speed single chip digital video network apparatus |
| KR0165430B1 (en) | 1995-09-06 | 1999-03-20 | 김광호 | Method and apparatus for detecting and protecting a sync. |
| US5570372A (en) * | 1995-11-08 | 1996-10-29 | Siemens Rolm Communications Inc. | Multimedia communications with system-dependent adaptive delays |
| RU2273111C2 (en) | 1999-05-14 | 2006-03-27 | Конинклейке Филипс Электроникс Н.В. | Method for transformation of packet stream of information signals to stream of information signals with time stamps and vice versa |
| US6480902B1 (en) * | 1999-05-25 | 2002-11-12 | Institute For Information Industry | Intermedia synchronization system for communicating multimedia data in a computer network |
| CN1801949A (en) | 2001-10-29 | 2006-07-12 | 松下电器产业株式会社 | Video/audio synchronizing apparatus |
| DE10232988B4 (en) * | 2002-07-19 | 2007-11-22 | Infineon Technologies Ag | Method and device for the clocked output of asynchronously received digital signals |
| CA2439733A1 (en) | 2002-10-07 | 2004-04-07 | Microsoft Corporation | Time references for multimedia objects |
| JP2004282667A (en) | 2003-03-19 | 2004-10-07 | Matsushita Electric Ind Co Ltd | Transmitter having correction function of regeneration desynchronization, receiver having the same, and transmission equipment having the transmitter and the receiver |
| TWI269987B (en) | 2004-03-02 | 2007-01-01 | Intervideo Digital Technology | Method for computer system to load audio/video data from remote server |
| US20050195860A1 (en) * | 2004-03-05 | 2005-09-08 | General Instrument Corporation | Combining data streams conforming to mutually exclusive signaling protocols into a single IP telephony session |
| US7773581B2 (en) * | 2004-03-19 | 2010-08-10 | Ericsson Ab | Method and apparatus for conferencing with bandwidth control |
| US7486658B2 (en) * | 2005-07-29 | 2009-02-03 | Cisco Technology, Inc. | Method and system for media synchronization in QoS-enabled wireless networks |
| US20070047590A1 (en) * | 2005-08-26 | 2007-03-01 | Nokia Corporation | Method for signaling a device to perform no synchronization or include a synchronization delay on multimedia stream |
-
2008
- 2008-03-05 US US12/042,876 patent/US8077745B2/en active Active
- 2008-03-21 CA CA2680184A patent/CA2680184C/en active Active
- 2008-03-21 TW TW097110314A patent/TWI367012B/en active
- 2008-03-21 EP EP08744217.4A patent/EP2137927B1/en not_active Not-in-force
- 2008-03-21 CN CN200880009164.3A patent/CN101641941B/en active Active
- 2008-03-21 BR BRPI0809387-3A patent/BRPI0809387B1/en not_active IP Right Cessation
- 2008-03-21 RU RU2009139086/09A patent/RU2425465C1/en active
- 2008-03-21 KR KR1020097022147A patent/KR101111356B1/en active IP Right Grant
- 2008-03-21 WO PCT/US2008/057923 patent/WO2008118819A1/en active Application Filing
- 2008-03-21 JP JP2010501135A patent/JP5102347B2/en active Active
-
2012
- 2012-07-13 JP JP2012157367A patent/JP5270021B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| US8077745B2 (en) | 2011-12-13 |
| CA2680184A1 (en) | 2008-10-02 |
| BRPI0809387A2 (en) | 2014-09-09 |
| RU2009139086A (en) | 2011-04-27 |
| BRPI0809387B1 (en) | 2020-09-29 |
| EP2137927B1 (en) | 2017-01-11 |
| US20080232768A1 (en) | 2008-09-25 |
| KR101111356B1 (en) | 2012-02-24 |
| KR20090119934A (en) | 2009-11-20 |
| RU2425465C1 (en) | 2011-07-27 |
| TWI367012B (en) | 2012-06-21 |
| JP5102347B2 (en) | 2012-12-19 |
| CN101641941A (en) | 2010-02-03 |
| TW200901717A (en) | 2009-01-01 |
| JP5270021B2 (en) | 2013-08-21 |
| EP2137927A1 (en) | 2009-12-30 |
| JP2010522517A (en) | 2010-07-01 |
| CN101641941B (en) | 2014-03-12 |
| JP2012239198A (en) | 2012-12-06 |
| WO2008118819A1 (en) | 2008-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9161286B2 (en) | Method and arrangement for session negotiation | |
| EP1943858B1 (en) | Traffic generation during a state of an inactive user plane | |
| US7843974B2 (en) | Audio and video synchronization | |
| CA2680184C (en) | Techniques for unidirectional disabling of audio-video synchronization | |
| US9826072B1 (en) | Network-terminal interoperation using compatible payloads | |
| EP3281317B1 (en) | Multi-layer timing synchronization framework | |
| CN101848492A (en) | Message transmission method between media gateways, media gateway and wireless communication system | |
| CN101790754A (en) | System and method for providing amr-wb dtx synchronization | |
| AU2009205423B9 (en) | Efficient interworking between circuit-switched and packet-switched multimedia services defining a maximum packet size attribute | |
| US20110235632A1 (en) | Method And Apparatus For Performing High-Quality Speech Communication Across Voice Over Internet Protocol (VoIP) Communications Networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request |