WO2008054100A1 - Method and apparatus for decoding metadata used for playing stereoscopic contents - Google Patents
Method and apparatus for decoding metadata used for playing stereoscopic contents Download PDFInfo
- Publication number
- WO2008054100A1 WO2008054100A1 PCT/KR2007/005358 KR2007005358W WO2008054100A1 WO 2008054100 A1 WO2008054100 A1 WO 2008054100A1 KR 2007005358 W KR2007005358 W KR 2007005358W WO 2008054100 A1 WO2008054100 A1 WO 2008054100A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- content
- media data
- stereoscopic
- elementary stream
- descriptor
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/178—Metadata, e.g. disparity information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
Abstract
Provided are metadata that is newly required to transmit contents containing stereoscopic images and motion pictures that are captured by a stereo camera or a computer graphic/animation making program or reproduce the contents after storing the same. The metadata is defined such that the metadata is contained in a structure of an MPEG-4 initial object descriptor, an object descriptor, and an ES-descriptor. The contents containing the stereoscopic images and motion pictures can be transferred based on MPEG-4 systems. In addition, the contents can be stored based on an MP-4 file and effectively reproduced.
Description
METHOD AND APPARATUS FOR DECODING METADATA USED FOR PLAYING
STEREOSCOPIC CONTENTS
TECHNICAL FIELD
The present invention relates to a method and apparatus for defining metadata required for effectively reproducing contents containing a motion picture file and a stereoscopic file, forming a storage format using the metadata, and decoding the metadata. The present invention has been made as a part of a next generation key information technology business of the Korean Ministry of Information and Communication and the Institute of Information Technology Assessment (Project No.: 2005-S-403, Project Name: Research In Convergence Information Broadcasting (Smar TV).
BACKGROUND ART
In order to distribute and generate two-dimensional (2D) images and motion pictures, a variety of formats such as AVI-files and MPEG-4 (MP4) files have been developed. However, research has been carried out into developing a method for transferring stereoscopic videos and a storage format for reproducing stereoscopic contents has been standardized by MPEG since January 2007.
DETAILED DESCRIPTION OF THE INVENTION
TECHNICAL PROBLEM For real-time or non-real-time transmission and reproduction of contents containing stereoscopic images and motion pictures that are captured by a stereo camera or a computer graphic/animation making program, a predetermined transmission stream format or a storage format is required. Media data of the contents and metadata required for reproducing the contents are necessary for the formats.
TECHNICAL SOLUTION
The present invention provides metadata that is newly required to transmit contents containing stereoscopic images and motion pictures that are captured by a stereo camera or a computer graphic/animation making program or to reproduce the
contents after storing the same, defines the metadata such that the metadata is contained in a structure of an MPEG-4 initial object descriptor, an object descriptor, and an ES (elementary stream)-descriptor, and allows the contents containing the stereoscopic images and motion pictures to be transferred based on MPEG-4 systems or allows the contents to be effectively reproduced when the contents are stored in the form of an MP4 file.
The present invention also provides a new descriptor containing metadata, which is defined to maintain compatibility with existing descriptors such as the MPEG-4 initial object descriptor, object descriptor, and ES-descriptor so that a user having an existing player can view a 2D image.
The present invention also provides a stereoscopic player structure having a function that can reproduce contents with a 2D mode or a variety of other stereoscopic display modes, which can be selected by a user, by using the metadata provided by the present invention, thereby providing a variety of viewing methods to the user.
ADVANTAGEOUS EFFECTS
According to the present invention, metadata required for reproducing stereoscopic images and motion pictures is defined and an MPEG-4-based descriptor containing the metadata and a structure of the MPEG-4-based descriptor are provided, thereby enabling the stereoscopic contents to be transferred and stored.
DESCRIPTION OF THE DRAWINGS
FIGS. 1A through 1C are diagrams of an object descriptor (ObjectDescriptor), an initial object descriptor (InitialObjectDescriptor), and an ES descriptor (ES_Descriptor) of an MPEG-4 system.
FIGS. 2A and 2B are diagrams illustrating an example of descriptors describing metadata of the present invention.
FIG. 3 is a schematic diagram of a decoding apparatus for reproducing stereoscopic contents according to an embodiment of the present invention.
DESCRIPTION OF THE TABLES Table 1 is a metadata list that is proposed to process stereoscopic contents.
Table 2 is a class tag list with respect to descriptors defined by MPEG-4 systems.
Table 3 is a class tag list with respect to descriptors that are newly proposed to process stereoscopic contents. Table 4 is a classification of metadata (StereoVisualformat) that is proposed to process stereoscopic contents.
Table 5 is a classification of metadata (StereoAdditionalVisualSize) that is proposed to process stereoscopic contents.
Table 6 is a classification of metadata (StereoVisualType) that is proposed to process stereoscopic contents.
Table 7 is a classification of metadata (StereoAdditionalVisual_ES) that is proposed to process stereoscopic contents.
BEST MODE According to one aspect of the present invention, there is provided a computer readable recording medium having recorded thereon metadata used for reproducing stereoscopic content, the metadata including an identification code indicating whether received content is stereoscopic content or two-dimensional (2D) content. If the received content is the stereoscopic content, the meta data further includes an elementary stream code indicating whether the stereoscopic content includes one elementary stream or two elementary streams.
The metadata may include at least one of an elementary stream format code that, when the stereoscopic content includes one elementary stream, indicates whether left and right images decoded from the elementary stream have a top-down format, a side-by-side format, a field sequential format, or a frame sequential format; a type code that, when the stereoscopic content comprises two elementary streams, indicates whether additional media data of the stereoscopic content represents a second visual point image, a depth map, or a disparity map; a size code indicating the ratio of an image size of main media data of the stereoscopic content to an image size of the additional media data of the stereoscopic content; and an elementary stream flag code indicating whether an elementary stream described in an elementary stream descriptor represents the additional media data of the stereoscopic content.
According to another aspect of the present invention, there is provided an apparatus for decoding a stereoscopic image, the apparatus including a receiving unit
receiving a bit-stream including a header storing metadata used for reproducing stereoscopic content, coded main media data, and coded additional media data. The metadata includes an identification code indicating whether received content is stereoscopic content or two-dimensional (2D) content. If the received content is the stereoscopic content, the meta data further includes an elementary stream code indicating whether the stereoscopic content includes one elementary stream or two elementary streams.
According to another aspect of the present invention, there is provided an apparatus for decoding a stereoscopic image, the apparatus including a receiving unit receiving a bit-stream including a header storing metadata used for reproducing stereoscopic content, coded main media data, and coded additional media data; a viewing mode selection unit allowing a user to select one of a two-dimensional (2D) mode and a three-dimensional (3D) mode based on the metadata contained in the bitstream; and a display unit displaying the content as a 2D scene or a 3D scene by decoding the bitstream according to the selected mode.
According to another aspect of the present invention, there is provided a method of decoding a stereoscopic image, the method including receiving a bit-stream including a header storing metadata used for reproducing stereoscopic content, coded main media data, and coded additional media data; allowing a user to select one of a two-dimensional (2D) mode and a three-dimensional (3D) mode based on the metadata contained in the bitstream; and displaying the content as a 2D scene or a 3D scene by decoding the bitstream according to the selected mode.
Hereinafter, the present invention will be described in detail by explaining preferred embodiments of the invention with reference to the attached drawings. Like reference numerals in the drawings denote like elements. In the following description, detailed descriptions of relevant well-known functions or structures will be omitted for the purpose of clarity.
MODE OF THE INVENTION Stereoscopic image or motion picture contents are formed with a pair of images of left and right yisual points. Alternatively, the stereoscopic image or motion picture contents may be formed with one of the images and a depth map or disparity map. In this case, the depth map or disparity map is used to imaginarily generate the other of the images, thereby making the stereoscopic content.
In an embodiment of the present invention, one of the images of the left and right visual points is defined as main media data and the other of the images is defined as additional media data using the depth map or disparity map.
There are a variety of methods for displaying stereoscopic contents. That is, a polarization method for reproducing the contents by overlapping the left and right images, a frame sequential method for reproducing the contents by alternately reproducing frames of the left and right images, a field sequential method for reproducing the contents by alternately reproducing field images of the left and right images, and a method for reproducing the contents by interleaving odd number lines of the left image and even number lines of the right images by pixel units have been mainly used.
In the embodiment of the present invention, metadata that is newly required to transfer the contents containing the stereoscopic images or motion pictures or to reproduce the contents after storing the same may be generally defined as described below. This will be described with reference to the accompanying table 1.
Table 1 shows a list of metadata required for reproducing the stereoscopic images.
The metadata include an identification code, an elementary stream (ES) code, an ES format code, a size code, a type code, and an ES flag code. In the table 1 , VisualContentType indicates the identification code and numberOFVisualES_mius1 denotes the ES code. In addition, StereoVisualFormat indicates the ES format code and StereoAdditionalVisualSize denotes the size code. Furthermore,
StereoAdditionalVisualType indicates the type code and StereoAdditionalVisual_ES flag denotes the ES flag code. In order to process the stereoscopic contents, information for indicating that the contents that are being transferred or stored is the stereoscopic contents or the existing 2D contents, is necessary. The identification code (VisualContentType) of the metadata indicates that the transferred contents are the stereoscopic contents or the two-dimensional (2D) contents. When the identification code indicates that the transferred contents are the stereoscopic contents, the ES code (NumberOFVisualES_mius1) indicates that the stereoscopic contents is formed with one ES or two ESs. That is, the ES code indicates that the main media data and the additional media data of the coded stereoscopic ES are formed with one ES or with respective ESs.
When the stereoscopic contents are formed with one ES, the ES format code (StereoVisualFormat) indicates that the format of the left and right coded images is a top-down format where the left and right codes images are divided top and bottom in one frame, a side-by-side format where the left and right images are divided side by side in one frame, .a field sequential format where the left and right images alternate, or a frame sequential format where left and right image frames alternate.
When the stereoscopic contents are formed with two ESs, the type code (StereoAdditionalVisualType) indicates that the additional media data of the stereoscopic contents are the second visual point image, the depth map, or the disparity map.
When the stereoscopic contents are formed with two ESs, this means that the code streams of the main media data and additional media data are assigned with respective ESJDs. Therefore, an ES corresponding to the main media data with respect to the additional media data must be identified so as to generate the stereoscopic contents using the two media data after the coding is performed.
In this case, the type code metadata, which indicates whether the additional media data is the image of the first visual point, the depth map, or the disparity map, is necessary. Like in the above case, the size code metadata, which indicates the image size of the additional media data, is necessary. The size code (StereoAdditionalVisualSize) is information indicating an image size of the main and addition media data of the stereoscopic contents. That is, the size code indicates that the image size of the additional media data is identical to that of the main media data, 1/2 of the image size of the main media data in a horizontal direction, 1/2 of the image size of the main media data in a vertical direction, or 1/2 of the image size of the main media data in the horizontal and vertical directions.
The left and right images are displayed with their original sizes when the stereoscopic display format is the polarization format or sequential format. However, the left and right images are displayed with 1/2 sizes in the horizontal and vertical directions when the stereoscopic display format is another type of format. Therefore, for example, when the ES format code (StereoVisualFormat) is the frame sequential format, a size code representing size information of the first visual point image (right image) that is defined as the additional media data, is necessary.
Therefore, a size code that comprises information considering and indicating that the left image maintains its original size considering the reproduction of the 2D
contents and the right image is reduced in size by 1/2 in the horizontal direction, 1/2 in the vertical direction, or 1/2 in the horizontal and vertical directions.
The ES flag code (StereoAdditionalVisual_ES flag) indicates whether the ES described by the ES_descriptor indicates the additional media data of the stereoscopic contents or not.
FIGS. 1A through 1C are diagrams of the object descriptor (ObjectDescriptor), initial object descriptor (InitialObjectDescriptor), and ES descriptor (ES_Descriptor) of the MPEG-4 system.
A field "extDescr" contained in each of the object descriptor, initial object descriptor, and ES descriptor is a field that is defined by the MPEG-4 to additionally describe a descriptor that will be necessary later.
In an embodiment of the present invention, a descriptor describing the metadata is contained in the field "extDescr" of each of the object descriptor, initial object descriptor, and ES_descriptor of the MPEG-4 system so that the contents containing images and motion pictures can be transferred based on the MPEG-4 systems or can be effectively reproduced when the contents are stored based on the MP4-file.
FIGS. 2A and 2B are diagrams illustrating an example of descriptors describing the metadata of the present invention.
The two descriptors "ObjectStereoscopicDescriptor" and "ES_stereoscopicDescriptor" describing the metadata of the present invention are designed to be compatible with the object descriptor, initial object descriptor, and ES_descriptor that are defined by the MPEG-4 system.
The accompanying table 2 illustrates a descriptor list defined in the MPEG-4 parti systems. As shown in the accompanying table 3, the two descriptors of the present invention are assigned with "private value" and added to the descriptor list.
The descriptor "ObjectStereoscopicDescriptor" represents information that must be contained in the initial object descriptor or the object descriptor. In order to maintain the compatibility with the existing initial object descriptor or the existing object descriptor, the descriptor "ObjectStereoscopicDescriptor" is structured to be contained in the field "extDescr" of each of the object descriptor, initial object descriptor, and ES descriptor.
Therefore, when the object descriptor and initial object descriptor of the MPEG-4 system contain the descriptor "ObjectStereoscopicDescriptor," it can be noted that the transferred contents in a bit-stream are the stereoscopic contents.
FIG. 2A illustrates the metadata contained in the descriptor "ObjectSterescopicDescriptor" and a structure of the metadata according to an embodiment of the present invention.
When NumberOfVisualES_mius1 is 0 in the descriptor "ObjectSterescopicDescriptor," the reference numeral 210 shows a case where the stereoscopic metadata is formed with one ES and indicates that the left and right decoded image formats are a top-down format, a side-by-side format, a field sequential format, or a frame sequential format from the ES through the ES format code
(StereoVisualFormat). In this case, the classification and value of the ES format code (StereoVisualFormat) used is defined as shown in the accompanying table 4.
In the descriptor "ObjectStereoscopicDescriptor," when
NumberOfVisualES_mius1 is 1 (220), it means that the stereoscopic media data includes ESs for the respective main and additional media data in one object. The information is described using the size code (StereoAdditionalVisualSize) and the type code (StereoAdditionalVisualType). The size codes are classified and assigned with respective values as shown in the accompanying table 5. The type codes are classified and assigned with a value as shown in the accompanying table 6.
FIG. 2B illustrates metadata and a structure of the metadata that is included in the descriptor "ES_stereoscopicDescriptor" according to an embodiment of the present invention.
The descriptor "ES_stereoscopicDescriptor" represents information that must be contained in the ES descriptor. In order to maintain the compatibility with a structure of the existing ES descriptor, the descriptor "ES_stereoscopicDescriptor" is contained in the field "extDescr" of the ES descriptor as a descriptor. When ESs for the respective main and additional media data exists in one object, the "streamDependenceFlag" is set as "1 ,' in the ES descriptor describing the ES for the additional data and includes an ESJD value describing the main media data.
However, even if the contents are not the stereoscopic contents, many ESs exists in one object and thus the "streamDependenceFlag" can be set as "1." Therefore, even when the "streamDependenceFlag" is set as "1," the ES cannot be limited as the additional media data of the main media data for generating the stereoscopic contents. Therefore, when NumberOfVisualES_mius1 is 1 in the descriptor "ObjectStereoscopicDescriptor" and thus the ESs for the respective main
and additional media data exist in the stereoscopic media data, the descriptor "ES_stereoscopicDescriptor" is added to the descriptor "ES_Descriptor" to represent that the ES is the additional media data for generating the stereoscopic contents. The descriptor "ES_stereoscopicDescriptor" has, as shown in FIG. 2B, an ES flag code (StereoAdditionalVisual_ES flag) value and is defined as shown in the accompanying table 7.
When the ES flag code (StereoAdditionalVisual_ES flag) value is set as "1 ," the stereoscopic contents are identified such that the ES described in "DependsOn_ES_ID" of "ES_Descriptor" is the main media data and the present ES is the additional media data.
FIG. 3 is a schematic diagram of a decoding apparatus for reproducing stereoscopic contents according to an embodiment of the present invention.
A stereoscopic player for reproducing a stream of stereoscopic contents containing metadata, which are transferred or stored, must change the media data format in response to a display method of the stereoscopic contents and display the contents after decoding the media data. In addition, the stereoscopic player must include a function for allowing the user to select one of the 2D display mode and the stereoscopic display mode.
Therefore, the decoding apparatus of this embodiment of the present invention includes a receiving unit 310, a mode selection unit 320, a contents generation unit 330, and a display unit 340.
The receiving unit 310 receives a bit-stream including a header storing the metadata used for reproducing the stereoscopic contents, and main and additional media data that are coded. In addition, the receiving unit 310 decodes the bit-stream received from the decoding unit and transmits the decoded metadata and media data to the content generation unit 330.
The mode selection unit 320 allows the user to select one of the 2D and three-dimensional (3D) modes based on the metadata. When the currently received bit-stream is the stereoscopic contents, the decoding unit reproduces the decoded 3D contents. In this case, a mark or log that indicates that the screen is displaying the 3D contents, is inserted in the screen.
That is, when the contents are the 3D contents, the user can view and listen to the contents by selecting one of the 2D and 3D modes.
The contents generation unit 330 generates contents having a format corresponding to a display panel of the player that is an example of the decoding apparatus using the user's selection input from the mode selection unit 320 and the decoded data. In an embodiment, when the display panel mounted on the player receives a frame that is interleaved line-by-line and generates the stereoscopic contents, stereoscopic contents that are obtained by interleaving the left and right images that are reduced in size by 1/2 in the vertical direction are generated.
The display unit 340 receives and reproduces the images output from the contents generation unit 330. The display unit 340 displays the contents image output from the contents generation unit 330 with the 2D or 3D image In accordance with the user's mode selection.
In this case, when the user selects the 3D display mode, the main and additional media data that are coded are decoded to generate and output a 3D scene. When the user selects the 2D display mode, only the main media data are decoded to output a 2D scene.
When the user's mode selection input through the mode selection unit 320 is the 2D mode, the display unit 340 extracts and outputs the main media data from the media data. When the user's mode selection input through the mode selection unit 320 is the stereo mode, the display unit 340 reduces sizes of the left and right images by 1/2 in the vertical direction as compared with their original sizes using StereoVisualFormat, StereoAdditionalVisualType, StereoAdditionalVisualSize metadata contained in ObjectStereoscopicDescriptor and StereoAdditionalVisual_ES flag information contained in ES_StereoscopicDescriptor and interleaves the size changed left and right images. For example, when the StereoVisualFormat information contained in
ObjectStereoscopicDescriptor is the top- down format, the left and right images are separated and interleaved line-by-line since the left and right images are a format that is formed top and bottom in one frame. When the StereoVisualFormat information contained in ObjectStereoscopicDescriptor is the side-by-side format, the left and right images are separated and doubled in the horizontal direction and down-sized by 1/2 in the vertical direction and interleaved line-by-line.
When the StereoVisualFormat information contained in ObjectStereoscopicDescriptor is the field sequential format, the left and right field images are regarded as a pair, interleaved line-by-line, and output. When the
StereoVisualFormat information contained in ObjectStereoscopicDescriptor is the frame sequential format, the left image frame is reduced in size by 1/2 in the vertical direction and the right image frame is generated as the stereoscopic contents by using the StereoAdditionalVisualSize information and output through the display unit. That is, when StereoAdditionalVisualSize is an image that is identical in size to the left image, the left image is reduced by 1/2 in the vertical direction. When StereoAdditionalVisualSize is an image that is half the size of the left image in the horizontal direction, the left image is doubled in the horizontal direction and reduced by 1/2 in the vertical direction. Furthermore, when StereoAdditionalVisualSize is an image that is half the size of the left image in the vertical direction, the size of the image is not varied. When StereoAdditionalVisualSize is an image that is half the size of the left image in the horizontal and vertical directions, the size of the image is doubled in the horizontal direction, after which the left and right images are interleaved line-by-line and output. Furthermore, sizes of the right image, depth map, and disparity map are varied based on the StereoAdditionalVisualSize information contained in ObjectStereoscopicDescriptor. When it is determined according to the StereoAdditionalVisualType information that the image is the right image, the image is interleaved line-by-line and output. When the image is the depth map or disparity map, an imaginary image of the right visual point is generated using an imaginary visual point image generation algorithm based on the depth or disparity, interleaved line-by-line, and output to the reproduction unit.
The invention can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data, which can be thereafter read by a computer system.
Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Meanwhile, the above-described embodiments may be realized in the form of programs that can be executed by a
computer. The program may be stored in a recording medium that can be read by a normal digital computer.
The recording medium may be selected from the group consisting of a magnetic storage medium (e.g., a ROM, a floppy disk, a hard disk, and the like), an optical storage medium (e.g., a CD-ROM, a DVD, and the like), and a carrier wave (e.g., transmission through Internet). In addition, the computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.
Claims
1. A computer readable recording medium having recorded thereon metadata used for reproducing stereoscopic content, the metadata comprising an identification code indicating whether received content is stereoscopic content or two-dimensional (2D) content, wherein if the received content is the stereoscopic content, the meta data further comprises an elementary stream code indicating whether the stereoscopic content includes one elementary stream or two elementary streams.
2. The computer readable recording medium of claim 1 , wherein the metadata comprises at least one of: an elementary stream format code that, when the stereoscopic content comprises one elementary stream, indicates whether left and right images decoded from the elementary stream have a top-down format, a side-by-side format, a field sequential format, or a frame sequential format; a type code that, when the stereoscopic content comprises two elementary streams, indicates whether additional media data of the stereoscopic content represents a second visual point image, a depth map, or a disparity map; a size code indicating the ratio of an image size of main media data of the stereoscopic content to an image size of the additional media data of the stereoscopic content; and an elementary stream flag code indicating whether an elementary stream described in an elementary stream descriptor represents the additional media data of the stereoscopic content.
3. The computer readable recording medium of claim 1 , wherein the main media data represents a first visual point image of the stereoscopic content, and the additional media data represents one of a second visual point image, a depth map, and a disparity map of the stereoscopic content.
4. The computer readable recording medium of claim 2, wherein, when the elementary stream format code represents a frame sequential format, the metadata comprises the size code.
5. The computer readable recording medium of claim 1 , wherein a descriptor describing the metadata is contained in an extDescr field included in each of an initial object descriptor, an object descriptor, and a base stream descriptor that are defined in MPEG-4 standards, wherein the extDescr field is defined in order to additionally describe a descriptor which is to be required later by the MPEG-4 standards.
6. A method of decoding a stereoscopic image, the method comprising receiving a bit-stream including a header storing metadata used for reproducing stereoscopic content, coded main media data, and coded additional media data, wherein the metadata comprises an identification code indicating whether received content is stereoscopic content or two-dimensional (2D) content, and if the received content is the stereoscopic content, the meta data further comprises an elementary stream code indicating whether the stereoscopic content includes one elementary stream or two elementary streams.
7. The method of claim 6, wherein the metadata comprises at least one of: an elementary stream format code that, when the stereoscopic content comprises one elementary stream, indicates whether left and right images decoded from the elementary stream have a top-down format, a side-by-side format, a field sequential format, or a frame sequential format; a type code that, when the stereoscopic content comprises two elementary streams, indicates whether the additional media data of the stereoscopic content represents a second visual point image, a depth map, or a disparity map; a size code indicating the ratio of an image size of the main media data of the stereoscopic content to an image size of the additional media data of the stereoscopic content; and an elementary stream flag code indicating whether the elementary stream described in an elementary stream descriptor represents the additional media data of the stereoscopic content.
8. The method of claim 6, wherein the main media data represents a first visual point image of the stereoscopic content, and the additional media data represents one of a second visual point image, a depth map, and a disparity map of the stereoscopic content.
9. The method of claim 7, wherein, when the elementary stream format code represents a frame sequential format, the metadata comprises the size code.
10. The method of claim 6, wherein a descriptor describing the metadata is contained in an extDescr field included in each of an initial object descriptor, an object descriptor, and a base stream descriptor that are defined in MPEG-4 standards, wherein the extDescr field is defined in order to additionally describe a descriptor which is to be required later by the MPEG-4 standards.
11. The method of claim 6, further comprising: if the identification code indicates that the received content is the stereoscopic content, selecting a 2D mode or a three-dimensional (3D) mode in order to display the received content, where the received content is two-dimensionally displayed in the 2D mode and is three-dimensionally displayed in the 3D mode; and generating content by decoding the received bitstream by using the metadata and the selected mode.
12. The method of claim 11 , further comprising, when the selected mode is the 3D mode, decoding both the coded main media data and additional media data and displaying the content as a 3D scene.
13. The method of claim 11 , further comprising, when the selected mode is the 2D mode, decoding only the coded main media data and displaying the content as a 2D scene.
14. A method of decoding a stereoscopic image, the method comprising: receiving a bit-stream including a header storing metadata used for reproducing stereoscopic content, coded main media data, and coded additional media data; allowing a user to select one of a two-dimensional (2D) mode and a three-dimensional (3D) mode based on the metadata contained in the bitstream; generating content by decoding the bitstream by using the meta data and the mode selected by the user; and displaying the content as a 2D scene or a 3D scene by decoding the bitstream according to the selected mode.
15. The method of claim 14, wherein the metadata comprises an identification code indicating whether received content is stereoscopic content or 2D content, wherein if the received content is the stereoscopic content, the meta data further comprises an elementary stream code indicating whether the stereoscopic content includes one elementary stream or two elementary streams.
16. The method of claim 15, wherein the metadata comprises at least one of: an elementary stream format code that, when the stereoscopic content comprises one elementary stream, indicates whether left and right images decoded from the elementary stream have a top-down format, a side-by-side format, a field sequential format, or a frame sequential format; a type code that, when the stereoscopic content comprises two elementary streams, indicates whether additional media data of the stereoscopic content represents a second visual point image, a depth map, or a disparity map; a size code indicating the ratio of an image size of the main media data of the stereoscopic content to an image size of the additional media data of the stereoscopic content; and an elementary stream flag code indicating whether the elementary stream described in an elementary stream descriptor represents additional media data of the stereoscopic content.
17. The method of claim 14, wherein the main media data represents a first visual point image of the stereoscopic content, and the additional media data represents one of a second visual point image, a depth map, and a disparity map of the stereoscopic content.
18. The method of claim 14, wherein a descriptor describing the metadata is contained in an extDescr field included in each of an initial object descriptor, an object descriptor, and a base stream descriptor that are defined in MPEG-4 standards, wherein the extDescr field is defined in order to additionally describe a descriptor which is to be required later by the MPEG-4 standards.
19. The method of claim 14, wherein if the selected mode is the 3D mode, the displaying of the content comprises decoding both the coded main media data and additional media data and displaying the content as a 3D scene.
20. The method of claim 14, wherein if the selected mode is the 2D mode, the displaying of the content comprises decoding only the coded main media data and displaying the content as a 2D scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009535205A JP5022443B2 (en) | 2006-11-01 | 2007-10-29 | Method of decoding metadata used for playback of stereoscopic video content |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2006-0107491 | 2006-11-01 | ||
| KR20060107491 | 2006-11-01 | ||
| KR20070108435A KR101362941B1 (en) | 2006-11-01 | 2007-10-26 | Method and Apparatus for decoding metadata used for playing stereoscopic contents |
| KR10-2007-0108435 | 2007-10-26 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2008054100A1 true WO2008054100A1 (en) | 2008-05-08 |
Family
ID=39344420
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2007/005358 WO2008054100A1 (en) | 2006-11-01 | 2007-10-29 | Method and apparatus for decoding metadata used for playing stereoscopic contents |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2008054100A1 (en) |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010126608A3 (en) * | 2009-05-01 | 2010-12-16 | Thomson Licensing | 3d video coding formats |
| EP2334093A1 (en) * | 2009-10-28 | 2011-06-15 | Sony Corporation | Stream receiving device, stream receiving method, stream transmission device, stream transmission method and computer program |
| EP2343907A2 (en) * | 2008-10-10 | 2011-07-13 | LG Electronics Inc. | Reception system and data processing method |
| WO2011083626A1 (en) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | Image processing device, information recording medium, image processing method, and program |
| WO2011083625A1 (en) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | Image processing device, information recording medium, image processing medium, and program |
| EP2347598A2 (en) * | 2008-10-10 | 2011-07-27 | LG Electronics Inc. | Receiving system and method of processing data |
| WO2011109814A1 (en) * | 2010-03-05 | 2011-09-09 | General Instrument Corporation | Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content |
| WO2011130732A1 (en) * | 2010-04-16 | 2011-10-20 | General Instrument Corporation | Method and apparatus for distribution of 3d television program materials |
| ITTO20100549A1 (en) * | 2010-06-28 | 2011-12-29 | Sisvel Technology Srl | METHOD FOR 2D-COMPATIBLE DECODING OF STEREOSCOPIC VIDEO FLOWS |
| JP2012039340A (en) * | 2010-08-06 | 2012-02-23 | Hitachi Consumer Electronics Co Ltd | Receiving apparatus and receiving method |
| USRE43741E1 (en) | 2002-10-05 | 2012-10-16 | Qualcomm Incorporated | Systematic encoding and decoding of chain reaction codes |
| EP2582142A2 (en) * | 2010-06-09 | 2013-04-17 | Samsung Electronics Co., Ltd | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
| CN103081479A (en) * | 2010-09-03 | 2013-05-01 | 索尼公司 | Encoding device, encoding method, decoding device, and decoding method |
| EP2001235B1 (en) * | 2007-06-08 | 2013-05-22 | Samsung Electronics Co., Ltd. | MPEG-4 format extension for recording stereoscopic or synthetic 3D video data with related metadata |
| JP2013527676A (en) * | 2010-04-14 | 2013-06-27 | サムスン エレクトロニクス カンパニー リミテッド | Method and apparatus for encoding 3D video data, and decoding method and apparatus |
| ITTO20120901A1 (en) * | 2012-10-15 | 2014-04-16 | Rai Radiotelevisione Italiana | PROCEDURE FOR CODING AND DECODING A DIGITAL VIDEO AND ITS CODIFICATION AND DECODING DEVICES |
| US8806050B2 (en) | 2010-08-10 | 2014-08-12 | Qualcomm Incorporated | Manifest file updates for network streaming of coded multimedia data |
| US8887020B2 (en) | 2003-10-06 | 2014-11-11 | Digital Fountain, Inc. | Error-correcting multi-stage code generator and decoder for communication systems having single transmitters or multiple transmitters |
| US8918533B2 (en) | 2010-07-13 | 2014-12-23 | Qualcomm Incorporated | Video switching for streaming video data |
| US8958375B2 (en) | 2011-02-11 | 2015-02-17 | Qualcomm Incorporated | Framing for an improved radio link protocol including FEC |
| US9136983B2 (en) | 2006-02-13 | 2015-09-15 | Digital Fountain, Inc. | Streaming and buffering using variable FEC overhead and protection periods |
| US9136878B2 (en) | 2004-05-07 | 2015-09-15 | Digital Fountain, Inc. | File download and streaming system |
| EP2930927A1 (en) * | 2009-04-27 | 2015-10-14 | LG Electronics, Inc. | Broadcast receiver and 3d video data processing method thereof |
| US9178535B2 (en) | 2006-06-09 | 2015-11-03 | Digital Fountain, Inc. | Dynamic stream interleaving and sub-stream based delivery |
| US9185439B2 (en) | 2010-07-15 | 2015-11-10 | Qualcomm Incorporated | Signaling data for multiplexing video components |
| US9191151B2 (en) | 2006-06-09 | 2015-11-17 | Qualcomm Incorporated | Enhanced block-request streaming using cooperative parallel HTTP and forward error correction |
| US9225961B2 (en) | 2010-05-13 | 2015-12-29 | Qualcomm Incorporated | Frame packing for asymmetric stereo video |
| US9237101B2 (en) | 2007-09-12 | 2016-01-12 | Digital Fountain, Inc. | Generating and communicating source identification information to enable reliable communications |
| US9236976B2 (en) | 2001-12-21 | 2016-01-12 | Digital Fountain, Inc. | Multi stage code generator and decoder for communication systems |
| US9240810B2 (en) | 2002-06-11 | 2016-01-19 | Digital Fountain, Inc. | Systems and processes for decoding chain reaction codes through inactivation |
| US9246633B2 (en) | 1998-09-23 | 2016-01-26 | Digital Fountain, Inc. | Information additive code generator and decoder for communication systems |
| US9253233B2 (en) | 2011-08-31 | 2016-02-02 | Qualcomm Incorporated | Switch signaling methods providing improved switching between representations for adaptive HTTP streaming |
| AU2011296954B2 (en) * | 2010-09-03 | 2016-02-11 | Sony Corporation | Encoding device and encoding method, as well as decoding device and decoding method |
| US9264069B2 (en) | 2006-05-10 | 2016-02-16 | Digital Fountain, Inc. | Code generator and decoder for communications systems operating using hybrid codes to allow for multiple efficient uses of the communications systems |
| US9270414B2 (en) | 2006-02-21 | 2016-02-23 | Digital Fountain, Inc. | Multiple-field based code generator and decoder for communications systems |
| US9270299B2 (en) | 2011-02-11 | 2016-02-23 | Qualcomm Incorporated | Encoding and decoding using elastic codes with flexible source block mapping |
| US9281847B2 (en) | 2009-02-27 | 2016-03-08 | Qualcomm Incorporated | Mobile reception of digital video broadcasting—terrestrial services |
| US9288010B2 (en) | 2009-08-19 | 2016-03-15 | Qualcomm Incorporated | Universal file delivery methods for providing unequal error protection and bundled file delivery services |
| US9294226B2 (en) | 2012-03-26 | 2016-03-22 | Qualcomm Incorporated | Universal object delivery and template-based file delivery |
| US9338430B2 (en) | 2010-09-03 | 2016-05-10 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method |
| US9344703B2 (en) | 2008-09-30 | 2016-05-17 | Panasonic Intellectual Property Management Co., Ltd. | Recording medium, playback device, system LSI, playback method, glasses, and display device for 3D images |
| US9380096B2 (en) | 2006-06-09 | 2016-06-28 | Qualcomm Incorporated | Enhanced block-request streaming system for handling low-latency streaming |
| US9386064B2 (en) | 2006-06-09 | 2016-07-05 | Qualcomm Incorporated | Enhanced block-request streaming using URL templates and construction rules |
| US9419749B2 (en) | 2009-08-19 | 2016-08-16 | Qualcomm Incorporated | Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes |
| US9432433B2 (en) | 2006-06-09 | 2016-08-30 | Qualcomm Incorporated | Enhanced block-request streaming system using signaling or block creation |
| US9485492B2 (en) | 2010-09-14 | 2016-11-01 | Thomson Licensing Llc | Compression methods and apparatus for occlusion data |
| US9596447B2 (en) | 2010-07-21 | 2017-03-14 | Qualcomm Incorporated | Providing frame packing type information for video coding |
| US9843844B2 (en) | 2011-10-05 | 2017-12-12 | Qualcomm Incorporated | Network streaming of media data |
| US9917874B2 (en) | 2009-09-22 | 2018-03-13 | Qualcomm Incorporated | Enhanced block-request streaming using block partitioning or request controls for improved client-side handling |
| EP3457688A1 (en) * | 2017-09-15 | 2019-03-20 | Thomson Licensing | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
| WO2019055389A1 (en) * | 2017-09-15 | 2019-03-21 | Interdigital Vc Holdings, Inc. | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
| WO2020013977A1 (en) * | 2018-07-13 | 2020-01-16 | Interdigital Vc Holdings, Inc. | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
| US20230070744A1 (en) * | 2011-10-14 | 2023-03-09 | Advanced Micro Devices, Inc. | Region-based image decompression |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0639031A2 (en) * | 1993-07-09 | 1995-02-15 | RCA Thomson Licensing Corporation | Method and apparatus for encoding stereo video signals |
| WO2004059980A1 (en) * | 2002-12-27 | 2004-07-15 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding and decoding stereoscopic video |
| EP1524859A2 (en) * | 2003-10-16 | 2005-04-20 | Sharp Kabushiki Kaisha | System and method for three-dimensional video coding |
-
2007
- 2007-10-29 WO PCT/KR2007/005358 patent/WO2008054100A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0639031A2 (en) * | 1993-07-09 | 1995-02-15 | RCA Thomson Licensing Corporation | Method and apparatus for encoding stereo video signals |
| WO2004059980A1 (en) * | 2002-12-27 | 2004-07-15 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding and decoding stereoscopic video |
| EP1524859A2 (en) * | 2003-10-16 | 2005-04-20 | Sharp Kabushiki Kaisha | System and method for three-dimensional video coding |
Cited By (100)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9246633B2 (en) | 1998-09-23 | 2016-01-26 | Digital Fountain, Inc. | Information additive code generator and decoder for communication systems |
| US9236976B2 (en) | 2001-12-21 | 2016-01-12 | Digital Fountain, Inc. | Multi stage code generator and decoder for communication systems |
| US9240810B2 (en) | 2002-06-11 | 2016-01-19 | Digital Fountain, Inc. | Systems and processes for decoding chain reaction codes through inactivation |
| US9236885B2 (en) | 2002-10-05 | 2016-01-12 | Digital Fountain, Inc. | Systematic encoding and decoding of chain reaction codes |
| USRE43741E1 (en) | 2002-10-05 | 2012-10-16 | Qualcomm Incorporated | Systematic encoding and decoding of chain reaction codes |
| US8887020B2 (en) | 2003-10-06 | 2014-11-11 | Digital Fountain, Inc. | Error-correcting multi-stage code generator and decoder for communication systems having single transmitters or multiple transmitters |
| US9136878B2 (en) | 2004-05-07 | 2015-09-15 | Digital Fountain, Inc. | File download and streaming system |
| US9236887B2 (en) | 2004-05-07 | 2016-01-12 | Digital Fountain, Inc. | File download and streaming system |
| US9136983B2 (en) | 2006-02-13 | 2015-09-15 | Digital Fountain, Inc. | Streaming and buffering using variable FEC overhead and protection periods |
| US9270414B2 (en) | 2006-02-21 | 2016-02-23 | Digital Fountain, Inc. | Multiple-field based code generator and decoder for communications systems |
| US9264069B2 (en) | 2006-05-10 | 2016-02-16 | Digital Fountain, Inc. | Code generator and decoder for communications systems operating using hybrid codes to allow for multiple efficient uses of the communications systems |
| US9386064B2 (en) | 2006-06-09 | 2016-07-05 | Qualcomm Incorporated | Enhanced block-request streaming using URL templates and construction rules |
| US9178535B2 (en) | 2006-06-09 | 2015-11-03 | Digital Fountain, Inc. | Dynamic stream interleaving and sub-stream based delivery |
| US11477253B2 (en) | 2006-06-09 | 2022-10-18 | Qualcomm Incorporated | Enhanced block-request streaming system using signaling or block creation |
| US9191151B2 (en) | 2006-06-09 | 2015-11-17 | Qualcomm Incorporated | Enhanced block-request streaming using cooperative parallel HTTP and forward error correction |
| US9209934B2 (en) | 2006-06-09 | 2015-12-08 | Qualcomm Incorporated | Enhanced block-request streaming using cooperative parallel HTTP and forward error correction |
| US9628536B2 (en) | 2006-06-09 | 2017-04-18 | Qualcomm Incorporated | Enhanced block-request streaming using cooperative parallel HTTP and forward error correction |
| US9432433B2 (en) | 2006-06-09 | 2016-08-30 | Qualcomm Incorporated | Enhanced block-request streaming system using signaling or block creation |
| US9380096B2 (en) | 2006-06-09 | 2016-06-28 | Qualcomm Incorporated | Enhanced block-request streaming system for handling low-latency streaming |
| EP2001235B1 (en) * | 2007-06-08 | 2013-05-22 | Samsung Electronics Co., Ltd. | MPEG-4 format extension for recording stereoscopic or synthetic 3D video data with related metadata |
| US9237101B2 (en) | 2007-09-12 | 2016-01-12 | Digital Fountain, Inc. | Generating and communicating source identification information to enable reliable communications |
| US9344703B2 (en) | 2008-09-30 | 2016-05-17 | Panasonic Intellectual Property Management Co., Ltd. | Recording medium, playback device, system LSI, playback method, glasses, and display device for 3D images |
| EP2343907A2 (en) * | 2008-10-10 | 2011-07-13 | LG Electronics Inc. | Reception system and data processing method |
| US8427469B2 (en) | 2008-10-10 | 2013-04-23 | Lg Electronics Inc. | Receiving system and method of processing data |
| EP2347598A2 (en) * | 2008-10-10 | 2011-07-27 | LG Electronics Inc. | Receiving system and method of processing data |
| EP2347598A4 (en) * | 2008-10-10 | 2014-05-28 | Lg Electronics Inc | Receiving system and method of processing data |
| US9204125B2 (en) | 2008-10-10 | 2015-12-01 | Lg Electronics Inc. | Receiving system and method of processing data |
| US9762888B2 (en) | 2008-10-10 | 2017-09-12 | Lg Electronics Inc. | Receiving system and method of processing data |
| EP2343907A4 (en) * | 2008-10-10 | 2012-06-20 | Lg Electronics Inc | Reception system and data processing method |
| US9712803B2 (en) | 2008-10-10 | 2017-07-18 | Lg Electronics Inc. | Receiving system and method of processing data |
| US9281847B2 (en) | 2009-02-27 | 2016-03-08 | Qualcomm Incorporated | Mobile reception of digital video broadcasting—terrestrial services |
| EP2930927A1 (en) * | 2009-04-27 | 2015-10-14 | LG Electronics, Inc. | Broadcast receiver and 3d video data processing method thereof |
| WO2010126608A3 (en) * | 2009-05-01 | 2010-12-16 | Thomson Licensing | 3d video coding formats |
| US9942558B2 (en) | 2009-05-01 | 2018-04-10 | Thomson Licensing | Inter-layer dependency information for 3DV |
| WO2010126612A3 (en) * | 2009-05-01 | 2011-01-20 | Thomson Licensing | Reference picture lists for 3dv |
| US9288010B2 (en) | 2009-08-19 | 2016-03-15 | Qualcomm Incorporated | Universal file delivery methods for providing unequal error protection and bundled file delivery services |
| US9660763B2 (en) | 2009-08-19 | 2017-05-23 | Qualcomm Incorporated | Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes |
| US9419749B2 (en) | 2009-08-19 | 2016-08-16 | Qualcomm Incorporated | Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes |
| US9876607B2 (en) | 2009-08-19 | 2018-01-23 | Qualcomm Incorporated | Methods and apparatus employing FEC codes with permanent inactivation of symbols for encoding and decoding processes |
| US11770432B2 (en) | 2009-09-22 | 2023-09-26 | Qualcomm Incorporated | Enhanced block-request streaming system for handling low-latency streaming |
| US9917874B2 (en) | 2009-09-22 | 2018-03-13 | Qualcomm Incorporated | Enhanced block-request streaming using block partitioning or request controls for improved client-side handling |
| US11743317B2 (en) | 2009-09-22 | 2023-08-29 | Qualcomm Incorporated | Enhanced block-request streaming using block partitioning or request controls for improved client-side handling |
| US10855736B2 (en) | 2009-09-22 | 2020-12-01 | Qualcomm Incorporated | Enhanced block-request streaming using block partitioning or request controls for improved client-side handling |
| US8704873B2 (en) | 2009-10-28 | 2014-04-22 | Sony Corporation | Receiving stream data which may be used to implement both two-dimensional display and three-dimensional display |
| EP2334093A1 (en) * | 2009-10-28 | 2011-06-15 | Sony Corporation | Stream receiving device, stream receiving method, stream transmission device, stream transmission method and computer program |
| JP2011142586A (en) * | 2010-01-08 | 2011-07-21 | Sony Corp | Image processing device, information recording medium, image processing method, and program |
| WO2011083625A1 (en) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | Image processing device, information recording medium, image processing medium, and program |
| JP2011142585A (en) * | 2010-01-08 | 2011-07-21 | Sony Corp | Image processing device, information recording medium, image processing method, and program |
| WO2011083626A1 (en) * | 2010-01-08 | 2011-07-14 | ソニー株式会社 | Image processing device, information recording medium, image processing method, and program |
| WO2011109814A1 (en) * | 2010-03-05 | 2011-09-09 | General Instrument Corporation | Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content |
| US9154814B2 (en) | 2010-03-05 | 2015-10-06 | Google Technology Holdings LLC | Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content |
| JP2013527676A (en) * | 2010-04-14 | 2013-06-27 | サムスン エレクトロニクス カンパニー リミテッド | Method and apparatus for encoding 3D video data, and decoding method and apparatus |
| US10368050B2 (en) | 2010-04-16 | 2019-07-30 | Google Technology Holdings LLC | Method and apparatus for distribution of 3D television program materials |
| CN102845068A (en) * | 2010-04-16 | 2012-12-26 | 通用仪表公司 | Method and apparatus for distribution of 3d television program materials |
| CN102845068B (en) * | 2010-04-16 | 2016-09-14 | 摩托罗拉移动有限责任公司 | The method of distribution and equipment for 3D television program material |
| WO2011130732A1 (en) * | 2010-04-16 | 2011-10-20 | General Instrument Corporation | Method and apparatus for distribution of 3d television program materials |
| US9237366B2 (en) | 2010-04-16 | 2016-01-12 | Google Technology Holdings LLC | Method and apparatus for distribution of 3D television program materials |
| US11558596B2 (en) | 2010-04-16 | 2023-01-17 | Google Technology Holdings LLC | Method and apparatus for distribution of 3D television program materials |
| US10893253B2 (en) | 2010-04-16 | 2021-01-12 | Google Technology Holdings LLC | Method and apparatus for distribution of 3D television program materials |
| US9225961B2 (en) | 2010-05-13 | 2015-12-29 | Qualcomm Incorporated | Frame packing for asymmetric stereo video |
| EP2582142A2 (en) * | 2010-06-09 | 2013-04-17 | Samsung Electronics Co., Ltd | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
| EP2582142A4 (en) * | 2010-06-09 | 2014-04-02 | Samsung Electronics Co Ltd | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
| US9674502B2 (en) | 2010-06-09 | 2017-06-06 | Samsung Electronics Co., Ltd. | Method for providing fragment-based multimedia streaming service and device for same, and method for receiving fragment-based multimedia streaming service and device for same |
| ITTO20100549A1 (en) * | 2010-06-28 | 2011-12-29 | Sisvel Technology Srl | METHOD FOR 2D-COMPATIBLE DECODING OF STEREOSCOPIC VIDEO FLOWS |
| WO2012001606A1 (en) * | 2010-06-28 | 2012-01-05 | Sisvel Technology S.R.L. | Method for decoding 2d-compatible stereoscopic video flows |
| CN102986229B (en) * | 2010-06-28 | 2017-12-22 | 意大利希思卫电子发展股份公司 | The method for decoding 2D compatible stereoscopic video streams |
| US9578298B2 (en) | 2010-06-28 | 2017-02-21 | S.I.Sv.El Societa' Italiana Per Lo Sviluppo Dell'elettronica S.P.A. | Method for decoding 2D-compatible stereoscopic video flows |
| CN102986229A (en) * | 2010-06-28 | 2013-03-20 | 西斯维尔科技有限公司 | Method for decoding 2D-compatible stereoscopic video flows |
| US8918533B2 (en) | 2010-07-13 | 2014-12-23 | Qualcomm Incorporated | Video switching for streaming video data |
| US9185439B2 (en) | 2010-07-15 | 2015-11-10 | Qualcomm Incorporated | Signaling data for multiplexing video components |
| US9596447B2 (en) | 2010-07-21 | 2017-03-14 | Qualcomm Incorporated | Providing frame packing type information for video coding |
| US9602802B2 (en) | 2010-07-21 | 2017-03-21 | Qualcomm Incorporated | Providing frame packing type information for video coding |
| JP2012039340A (en) * | 2010-08-06 | 2012-02-23 | Hitachi Consumer Electronics Co Ltd | Receiving apparatus and receiving method |
| US9319448B2 (en) | 2010-08-10 | 2016-04-19 | Qualcomm Incorporated | Trick modes for network streaming of coded multimedia data |
| US9456015B2 (en) | 2010-08-10 | 2016-09-27 | Qualcomm Incorporated | Representation groups for network streaming of coded multimedia data |
| US8806050B2 (en) | 2010-08-10 | 2014-08-12 | Qualcomm Incorporated | Manifest file updates for network streaming of coded multimedia data |
| AU2011296954B2 (en) * | 2010-09-03 | 2016-02-11 | Sony Corporation | Encoding device and encoding method, as well as decoding device and decoding method |
| CN103081479A (en) * | 2010-09-03 | 2013-05-01 | 索尼公司 | Encoding device, encoding method, decoding device, and decoding method |
| CN105979240A (en) * | 2010-09-03 | 2016-09-28 | 索尼公司 | Encoding device and encoding method, as well as decoding device and decoding method |
| US9338430B2 (en) | 2010-09-03 | 2016-05-10 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method |
| US9762884B2 (en) | 2010-09-03 | 2017-09-12 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method for encoding multiple viewpoints for compatibility with existing mode allowing fewer viewpoints |
| CN105979240B (en) * | 2010-09-03 | 2018-06-05 | 索尼公司 | Code device and coding method and decoding apparatus and coding/decoding method |
| US9485492B2 (en) | 2010-09-14 | 2016-11-01 | Thomson Licensing Llc | Compression methods and apparatus for occlusion data |
| US9883161B2 (en) | 2010-09-14 | 2018-01-30 | Thomson Licensing | Compression methods and apparatus for occlusion data |
| US9270299B2 (en) | 2011-02-11 | 2016-02-23 | Qualcomm Incorporated | Encoding and decoding using elastic codes with flexible source block mapping |
| US8958375B2 (en) | 2011-02-11 | 2015-02-17 | Qualcomm Incorporated | Framing for an improved radio link protocol including FEC |
| US9253233B2 (en) | 2011-08-31 | 2016-02-02 | Qualcomm Incorporated | Switch signaling methods providing improved switching between representations for adaptive HTTP streaming |
| US9843844B2 (en) | 2011-10-05 | 2017-12-12 | Qualcomm Incorporated | Network streaming of media data |
| US20230070744A1 (en) * | 2011-10-14 | 2023-03-09 | Advanced Micro Devices, Inc. | Region-based image decompression |
| US9294226B2 (en) | 2012-03-26 | 2016-03-22 | Qualcomm Incorporated | Universal object delivery and template-based file delivery |
| CN104813657A (en) * | 2012-10-15 | 2015-07-29 | Rai意大利无线电视股份有限公司 | Method for coding and decoding a digital video, and related coding and decoding devices |
| US9961324B2 (en) | 2012-10-15 | 2018-05-01 | Rai Radiotelevisione Italiana S.P.A. | Method for coding and decoding a digital video, and related coding and decoding devices |
| WO2014060937A1 (en) * | 2012-10-15 | 2014-04-24 | Rai Radiotelevisione Italiana S.P.A. | Method for coding and decoding a digital video, and related coding and decoding devices |
| CN104813657B (en) * | 2012-10-15 | 2018-12-21 | Rai意大利无线电视股份有限公司 | For by the method for digital video encoding and decoding and correlative coding and decoding device |
| ITTO20120901A1 (en) * | 2012-10-15 | 2014-04-16 | Rai Radiotelevisione Italiana | PROCEDURE FOR CODING AND DECODING A DIGITAL VIDEO AND ITS CODIFICATION AND DECODING DEVICES |
| USRE49786E1 (en) | 2012-10-15 | 2024-01-02 | Rai Radiotelevisione Italiana S.P.A. | Method for coding and decoding a digital video, and related coding and decoding devices |
| CN111264058A (en) * | 2017-09-15 | 2020-06-09 | 交互数字Vc控股公司 | Method and apparatus for encoding and decoding three-degree-of-freedom and volume-compatible video streams |
| EP3457688A1 (en) * | 2017-09-15 | 2019-03-20 | Thomson Licensing | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
| WO2019055389A1 (en) * | 2017-09-15 | 2019-03-21 | Interdigital Vc Holdings, Inc. | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
| WO2020013977A1 (en) * | 2018-07-13 | 2020-01-16 | Interdigital Vc Holdings, Inc. | Methods and devices for encoding and decoding three degrees of freedom and volumetric compatible video stream |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2008054100A1 (en) | Method and apparatus for decoding metadata used for playing stereoscopic contents | |
| JP5022443B2 (en) | Method of decoding metadata used for playback of stereoscopic video content | |
| US11115641B2 (en) | Method of transmitting omnidirectional video, method of receiving omnidirectional video, device for transmitting omnidirectional video, and device for receiving omnidirectional video | |
| JP6960528B2 (en) | Methods, devices, and computer programs for generating and processing media content | |
| CN101711483B (en) | Format for encoded stereoscopic image data file | |
| JP7399224B2 (en) | Methods, devices and computer programs for transmitting media content | |
| US8508579B2 (en) | System and method for generating and reproducing 3D stereoscopic image file including 2D image | |
| CN101868970A (en) | The method of recording three-dimensional image data | |
| JP2009124768A (en) | Multimedia information generation apparatus, and multimedia information reproduction apparatus | |
| KR20090037283A (en) | Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata | |
| KR20110113186A (en) | Method and system for transmitting over a video interface and for compositing 3d video and 3d overlays | |
| KR101390810B1 (en) | Method and apparatus for receiving image data stream comprising parameters for displaying local three dimensional image, and method and apparatus for generating image data stream comprising parameters for displaying local three dimensional image | |
| CN102265626B (en) | Method for transmitting data on stereoscopic image, method for playing back stereoscopic image, and method for creating file of stereoscopic image | |
| KR100959534B1 (en) | Method of constructing maf file format and apparatus of decoding for video signal using thereof method | |
| CN102948154A (en) | Content distribution system, playback device, distribution server, playback method, and distribution method | |
| EP2183924A2 (en) | Method of generating contents information and apparatus for managing contents using the contents information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07833666 Country of ref document: EP Kind code of ref document: A1 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| ENP | Entry into the national phase |
Ref document number: 2009535205 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 07833666 Country of ref document: EP Kind code of ref document: A1 |