US20090315979A1 - Method and apparatus for processing 3d video image - Google Patents

Method and apparatus for processing 3d video image Download PDF

Info

Publication number
US20090315979A1
US20090315979A1 US12/489,726 US48972609A US2009315979A1 US 20090315979 A1 US20090315979 A1 US 20090315979A1 US 48972609 A US48972609 A US 48972609A US 2009315979 A1 US2009315979 A1 US 2009315979A1
Authority
US
United States
Prior art keywords
image
graphic
video image
video
format
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/489,726
Inventor
Kil-soo Jung
Hyun-kwon Chung
Dae-jong LEE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to US12/489,726 priority Critical patent/US20090315979A1/en
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHUNG, HYUN-KWON, JUNG, KIL-SOO, LEE, DAE-JONG
Publication of US20090315979A1 publication Critical patent/US20090315979A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration by the use of histogram techniques
    • G06T5/92—
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/133—Equalising the characteristics of different image components, e.g. their average brightness or colour balance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/158—Switching image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/339—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
    • H04N13/359—Switching between monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/005—Aspects relating to the "3D+depth" image format

Definitions

  • aspects of the present invention relate to a method and an apparatus to process a three-dimensional (3D ) video image, and more particularly, to a method and an apparatus to process a 3D video image to be output with subtitles or a menu.
  • Three-dimensional (3D ) video technology has widely spread with development of digital technology.
  • the 3D video technology that gives a two-dimensional (2D) image depth information to represent a more realistic image has been applied to various fields, including communications, gaming, medical services, and broadcasting services.
  • the human eyes are apart from each other by a predetermined distance in the horizontal direction so that a 2D image is seen by the left and right eyes differently, which is referred to as binocular disparity.
  • the human brain combines two different 2D images to generate a 3D image having depth and reality.
  • Methods of generating 3D images using binocular disparity include a method using glasses and a method using a device including a lenticular lens, a parallax barrier, and parallax illumination without having glasses.
  • aspects of the present invention provide a 3D video image processing method and apparatus to output a video image in a three-dimensional (3D ) format with a graphic image such as subtitles or a menu.
  • a video image processing method including: acquiring 3D format information of a video image generated from video data to determine a 3D format of the video image; generating, from a first graphic image generated from graphic data different from the video data, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information; and overlaying the video image with the second graphic image.
  • the generating of the second graphic image may include horizontally scaling down the frame of the first graphic image to generate sub frames, and generating the second graphic image having a frame including two sub frames arranged in the horizontal direction.
  • the generating of the second graphic image may include vertically scaling down the frame of the first graphic image to generate sub frames, and generating the second graphic image having a frame including two sub frames arranged in the vertical direction
  • the acquiring of the 3D format information may include: extracting an identifier representing whether the video image is a 3D format image from the video data; and acquiring the 3D format information from the video data when the video image is a 3D format image using the identifier.
  • the video image processing method may further include splitting the video image overlaid with the second graphic image into a left-eye image and a right-eye image and outputting the left-eye image and the right-eye image.
  • the graphic data may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu.
  • the generating of the second graphic image may include generating a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and generating a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information.
  • the overlaying of the video image with the second graphic image may include overlaying the video image overlaid with the second presentation graphic image with the second interactive graphic image.
  • a video image processing method including: acquiring 3D format information of a video image generated from video data; converting the video image to a 3D interfaced format using the 3D format information; and overlaying the 3D interlaced format video image with a graphic image generated from graphic data.
  • the converting of the format of the video image to the interlaced format may include alternately arranging odd-numbered horizontal lines of the upper image and even-numbered horizontal lines of the lower image or alternately arranging even-numbered horizontal lines of the upper image and odd-numbered horizontal lines of the lower image to convert the video image to the interlaced format video image.
  • the converting of the format of the video image to the interlaced format may include alternately arranging odd-numbered vertical lines of the left image and even-numbered vertical lines of the right image or alternately arranging even-numbered vertical lines of the left image and odd-numbered vertical lines of the right image to convert the video image to the interlaced format video image.
  • the video image processing method may further include splitting the video image overlaid with the graphic image into a left-eye image and a right-eye image and outputting the left-eye image and the right-eye image.
  • a video image processing apparatus including: a video data decoder to decode video data to generate a video image; a graphic data decoder decoding graphic data to generate a first graphic image; a second graphic image generator to extract 3D format information of the video image from the video data to determine the a 3D format of the video image, and to generate, from the first graphic image, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information; and a blender to overlay the video image with the second graphic image.
  • a video image processing apparatus including: a video data decoder to decode video data to generate a video image; a graphic data decoder to decode graphic data to generate a graphic image; a format converter to extract 3D format information of the video image from the video data and to convert the video image to a 3D interlaced format video image using the 3D format information; and a blender overlaying the 3D interlaced format video image with the graphic image.
  • a computer readable recording medium storing a program to execute a video image processing method, the method including: acquiring 3D format information of a video image generated from video data to determine a 3D format of the video image; generating a second graphic image, from a first graphic image generated from graphic data, corresponding to the determined 3D format of the video image using the 3D format information; and overlaying the video image with the second graphic image.
  • a computer readable recording medium storing a program to execute a video image processing method, the method including: acquiring 3D format information of a video image generated from video data; converting the video image to a 3D interfaced format video image; and overlaying the 3D interlaced format video image with a graphic image generated from graphic data.
  • a video image processing method of a video image processing apparatus including: acquiring, by the video image processing apparatus, three-dimensional (3D ) format information of a video image generated from video data; and overlaying, by the video image processing apparatus, the video image with a graphic image according to the acquired 3D format information, wherein the graphic image is generated from graphic data that is distinct from the video image.
  • 3D three-dimensional
  • a computer-readable recording medium implemented by a video image processing apparatus, the computer-readable recording medium including: video data comprising a video image and three-dimensional (3D ) format information used by the video image processing apparatus to overlay the video image with a graphic image in a 3D format, wherein the graphic image is generated from graphic data that is distinct from the video image.
  • video data comprising a video image and three-dimensional (3D ) format information used by the video image processing apparatus to overlay the video image with a graphic image in a 3D format, wherein the graphic image is generated from graphic data that is distinct from the video image.
  • FIG. 1 is a block diagram of a video image processing apparatus according to an embodiment of the present invention
  • FIGS. 2A to 2E illustrate examples of video images and graphic images generated by the video image processing apparatus illustrated in FIG. 1 ;
  • FIG. 3 is a block diagram of a video image processing apparatus according to another embodiment of the present invention.
  • FIGS. 4A to 4E illustrate examples of video images and graphic images generated by the video image processing apparatus illustrated in FIG. 3 ;
  • FIG. 5 is a flowchart of a video image processing method according to an embodiment of the present invention.
  • FIG. 6 is a flowchart of a video image processing method according to another embodiment of the present invention.
  • FIG. 1 is a block diagram of a video image processing apparatus 100 according to an embodiment of the present invention
  • FIGS. 2A to 2E illustrate video images and graphic images generated by the video image processing apparatus 100 illustrated in FIG. 1
  • the video image processing apparatus 100 includes a video data decoder 110 , a graphic data decoder 120 , a second graphic image generator 130 , a video image buffer 140 , a graphic image buffer 150 , and a blender 160 . While the video image processing apparatus 100 does not include an output device 200 in FIG. 1 , it is understood that, according to other embodiments, the video image processing apparatus 100 may include the output device 200 .
  • the video image processing apparatus 100 may be a television, a computer, a mobile device, a set-top box, a gaming system, etc.
  • the output device 200 may be a cathode ray tube display device, a liquid crystal display device, a plasma display device, an organic light emitting diode display device, goggles, etc.
  • each of the units 110 , 120 , 130 , 140 , 150 , 160 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • a demultiplexer (not shown) demultiplexes an input signal in the form of a bit stream, transmits video data IN 1 to the video data decoder 110 and transmits graphic data IN 2 to the graphic data decoder 120 .
  • the video data decoder 110 decodes the video data IN 1 to generate a video image.
  • the video image can be a 2D format image or a 3D format image.
  • FIG. 2A illustrates 3D format video images decoded by the video data decoder 110 . As illustrated in FIG. 2A , in the 3D format image, left and right images to be simultaneously displayed are allocated to a single frame. While not required in all aspects, the video image processing apparatus 100 may include a drive to read a disc including the video data and the graphic data, or can be connected to a separate drive.
  • a 3D image display apparatus sequentially displays an image for the left eye and an image for the right eye to reproduce a 3D image.
  • a viewer recognizes an image to be played without pause when the display apparatus plays the image at a minimum frame rate of 60 Hz based on one eye.
  • the display apparatus therefore outputs the 3D image at a minimum frame rate of 120 Hz in order for the viewer to recognize the 3D image to be played without pause. That is, the viewer recognizes the 3D image when left and right images are sequentially displayed at least every 1/12 seconds.
  • a player that decodes video data may not have an output terminal supporting 120 Hz.
  • the player may output frame images and transmit the frame images to the display apparatus at 60 Hz (i.e., every 1/60 seconds).
  • the video image processing apparatus 100 corresponds to the player and the output device 200 corresponds to the display apparatus.
  • the video image processing apparatus 100 transmits frame images of a video image to the output device 200 at a frame rate of 60 Hz
  • the video image has a 3D format including both left and right images in order for the output device 200 to output the video image at a frame rate of 120 Hz.
  • the 3D format includes a top-and-down format, a side-by-side format, and an interlaced format.
  • a video image in the top-and-down format is illustrated in the upper part of FIG. 2A .
  • a left-eye image and a right-eye image which are sub-sampled in the vertical direction, are respectively allocated to upper and lower parts of a frame.
  • a video image in the side-by-side format is illustrated in the lower part of FIG. 2A .
  • a left-eye image and a right-eye image which are sub-sampled in the horizontal direction, are respectively allocated to left and right parts of a frame.
  • the video data decoder 110 transmits the video image to the video image buffer 140 .
  • the graphic data decoder 120 decodes the graphic data received from the demultiplexer to generate a first graphic image.
  • the graphic data may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu.
  • the graphic data decoder 120 generates a first presentation graphic image using the presentation graphic data and generates a first interactive graphic image using the interactive graphic data.
  • FIG. 2B illustrates the first graphic image decoded by the graphic data decoder 120 .
  • the first graphic image is overlaid on the 2D video format image to provide subtitles or a menu with respect to the video image.
  • the video image is a 3D format image as illustrated in FIG. 2A
  • the first graphic image as illustrated in FIG. 2B does not have a format suitable for the 3D format video image.
  • a proper subtitle or menu is not output when the first graphic image is overlaid on the 3D format video image.
  • a graphic image in a format suitable for the 3D format video image is required.
  • the second graphic image generator 130 extracts an identifier representing whether the video image is a 2D format image or a 3D format image from a header of the video data.
  • the second graphic image generator 130 sends the first graphic image to the graphic image buffer 150 when the second graphic image generator 130 determines that the video image is a 2D format image using the identifier.
  • the second graphic image generator 130 acquires 3D format information representing a format type of the 3D video image from the header of the video data.
  • the second graphic image generator 130 decodes the 3D format information to recognize the 3D format type of the video image and generates the second graphic image using the 3D format type.
  • the second graphic image generator 130 is described above to determine whether the video image is a 2D format image or a 3D format image, and to determine the 3D format type, it is understood that aspects of the present invention are not limited thereto.
  • a controller may be included in the video image processing apparatus 100 to determine whether the video image is a 2D format image or a 3D format image, acquire the 3D format information when the video image is a 3D format image, and/or notify the second graphic image generator 130 of the 3D format information and/or the 3D format type.
  • the second graphic image generator 130 generates the second graphic image suitable for the 3D format type of the video image using the first graphic image and the 3D format information.
  • the second graphic image generator 130 vertically samples the frame of the first graphic image to generate sub frames having a reduced vertical size.
  • the second graphic image generator 130 generates two sub frames having a reduced size and vertically arranges the two sub frames to suit the top-and-bottom format of the video image to generate a single frame including the two sub frames.
  • the upper part illustrates the second graphic image generated using the first graphic image illustrated in the upper part of FIG. 2B when the video image has the top-and-down format as illustrated in the upper part of FIG. 2A .
  • the second graphic image generator 130 horizontally samples the frame of the first graphic image to generate sub frames having a reduced horizontal size.
  • the second graphic image generator 130 generates two sub frames and horizontally arranges the two sub frames to suit the side-by-side format to generate a single frame including the two sub frames.
  • the lower part of FIG. 2C illustrates the second graphic image generated using the first graphic image illustrated in the lower part of FIG. 2B when the video image has the side-by-side format as illustrated in the lower part of FIG. 2A .
  • the second graphic image generator 130 When the graphic data includes both the presentation graphic data providing subtitles and the interactive graphic data providing a menu, the second graphic image generator 130 generates a second presentation graphic image using the first presentation graphic image and generates a second interactive graphic image using the first interactive graphic image. The second graphic image generator 130 transmits the generated second graphic image (including the second presentation graphic image and/or the second interactive graphic image) to the graphic image buffer 150 .
  • the video image processing apparatus 100 includes a system time clock (STC) counter (not shown).
  • STC system time clock
  • the video image processing apparatus 100 decodes and outputs the video image according to the STC counter.
  • the video image buffer 140 and the graphic image buffer 150 temporarily store the video image and the second graphic image, respectively, and transmit the video image and the second graphic image to the blender 160 when the STC corresponds to a presentation time stamp (PTS).
  • PTS presentation time stamp
  • FIG. 2D illustrates video images overlaid with the second graphic images illustrated in FIG. 2C according to the blender 160 .
  • the upper part of FIG. 2D illustrates a video image overlaid with the second graphic image converted to suit the top-and-down format when the video image has the top-and-down format.
  • the lower part of FIG. 2D illustrates a video image overlaid with the second graphic image converted to suit the side-by-side format when the video image has the side-by-side format.
  • the blender 160 overlays the video image with the second presentation graphic image, and overlays the video image overlaid with the second presentation graphic image with the second interactive graphic image in sequence. That is, the blender 160 blends the video image with subtitles first, and then blends the video image blended with the subtitles with a menu. However, it is understood that in other aspects, the blender 160 blends the video image with a menu first, and then blends the video image blended with the menu with subtitles.
  • the output device 200 outputs the image received from the blender 160 as a 3D image OUT 1 .
  • the output device 200 separates left and right images included in a single 3D format image of the video frame from each other to generate a left-eye image and a right-eye image.
  • the output device 200 alternately displays the left-eye image and the right-eye image at least every 1/120 seconds.
  • the output image OUT 1 can be received at a receiving unit through which a user sees an output screen, such as goggles, through wired and/or wireless protocols.
  • FIG. 2E illustrates the left-eye image and the right-eye image output from the output device 200 .
  • the video image processing apparatus 100 may transmit the image received from the blender 160 to an external device, or may record the image on a storage medium.
  • the video image processing apparatus 100 may include a drive to record the image on a disc (such as a DVD, Blu-ray, etc.) directly, or can be connected to a separate drive.
  • the video image is a 3D format image
  • a graphic image suitable for the 3D video image format is generated.
  • the 3D video image is suitably overlaid with the graphic image and output with the graphic image.
  • FIG. 3 is a block diagram of a video image processing apparatus 300 according to another embodiment of the present invention
  • FIGS. 4A to 4E illustrate video images and graphic images generated by the video image processing apparatus illustrated in FIG. 3
  • the video image processing apparatus 300 includes a video data decoder 310 , a graphic data decoder 320 , a format converter 330 , a video image buffer 340 , a graphic image buffer 350 , and a blender 160 .
  • the video image processing apparatus 300 is independent of an output device 400 in FIG. 3 , it is understood that aspects of the present invention are not limited thereto, and the video image processing apparatus 300 includes the output device 400 in other aspects.
  • the video image processing apparatus 300 may be a television, a computer, a mobile device, a set-top box, a gaming system, etc.
  • the output device 400 may be a cathode ray tube display device, a liquid crystal display device, a plasma display device, an organic light emitting diode display device, etc.
  • each of the units 310 , 320 , 330 , 340 , 350 , 160 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • the video data decoder 310 decodes video data IN 3 to generate a video image.
  • the video data decoder 310 transmits the video image to the format converter 330 .
  • the format converter 330 determines whether the video image is a 2D format image or a 3D format image and acquires 3D format information of the video image when the video image is a 3D format image.
  • the format converter 330 determines whether the 3D video image is an interlaced format using the 3D format information of the 3D video image.
  • the interlaced format samples a left-eye image and a right-eye image by 1 ⁇ 2 at a predetermined interval in the vertical or horizontal direction such that the left-eye and right-eye images are alternately located in the vertical or horizontal direction to generate a 3D image.
  • FIG. 4A illustrates 3D format video images decoded by the video data decoder 310 . As described above with reference to FIG. 2A , in a single 3D format image, left and right images to be simultaneously displayed are allocated. The upper part of FIG. 4A illustrates a top-and-down format video image and the lower part of FIG. 4A illustrates a side-by-side format video image.
  • the graphic data decoder 320 decodes graphic data IN 4 to generate a graphic image providing subtitles and/or a menu.
  • the graphic data IN 4 may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu.
  • the graphic data decoder 320 decodes the presentation graphic data to generate a presentation graphic image providing subtitles and decodes the interactive graphic data to generate an interactive graphic image providing a menu.
  • FIG. 4B illustrates graphic images generated by the graphic data decoder 320 .
  • the graphic data decoder 320 sends the generated graphic image(s) to the graphic image buffer 350 .
  • the graphic image has a format suitable for a 2D format video image.
  • a proper subtitles or menu cannot be output when the video image is overlaid with the graphic image if the video image is the top-and-down format or the side-by-side format as illustrated in FIG. 4A .
  • the format converter 330 extracts an identifier representing whether the video image is a 2D format image or a 3D format image from the header of the video data.
  • the format converter 330 determines that the video image is a 2D format image using the identifier, the format converter 330 transmits the 2D format video image to the video image buffer 340 .
  • the format converter 330 acquires 3D format information representing the format type of the 3D video format image from the header of the video data.
  • the format converter 330 sends the video image to the video image buffer 340 when the video image is a 3D interlaced format video image.
  • the video image processing apparatus 300 may include a controller to determine whether the video image is a 2D format image or a 3D format image, acquire format information of the video image, and/or notify the format converter 330 of the format information when the video image is a 3D format image.
  • the format converter 330 converts the format of the video image to the interlaced format when the video image is not a 2D image and is not a 3D interlaced format video image. For example, when the video image has a top-and-down format, the format converter 330 alternately arranges odd-numbered horizontal lines of the upper part of the video image and even-numbered horizontal lines of the lower part of the video image or alternately arranges even-numbered horizontal lines of the upper part of the video image and odd-numbered horizontal lines of the lower part of the video image to convert the top-and-down format video image into the interlaced format video image.
  • the upper part of FIG. 4C illustrates the interlaced format video image converted by the format converter 330 when the decoded video image has a top-and-down format.
  • the format converter 330 can alternately arrange even-numbered vertical lines of the left part of the video image and odd-numbered vertical lines of the right part of the video image or alternately arrange odd-numbered vertical lines of the left part of the video image and even-numbered vertical lines of the right part of the video image to convert the side-by-side format video image into the interlaced format video image.
  • the lower part of FIG. 4C illustrates the interlaced format video image converted by the format converter 330 when the decoded video image has a side-by-side format. Accordingly, the format converter 330 transmits the 3D interlaced format video image to the video image buffer 340 .
  • the video image buffer 340 and the graphic image buffer 350 temporarily store the video image and the graphic image, respectively, and transmit the video image and the graphic image to the blender 360 when the STC corresponds to the PTS, as described above with reference to the video image processing apparatus 100 of FIG. 1 .
  • the blender 360 overlays the video image with the graphic image and transmits the video image overlaid with the graphic image to the output device 400 .
  • the graphic data includes both the presentation graphic data providing subtitles and the interactive graphic data providing a menu
  • the blender 360 overlays the video image with the presentation graphic image, and overlays the video image overlaid with the presentation graphic image with the interactive graphic image in sequence.
  • the blender 160 overlays the video image with the interactive graphic image first, and then overlays the video image overlaid with the interactive graphic image with the presentation graphic image.
  • FIG. 4D illustrates video images overlaid with the graphic images according to the blender 360 .
  • the output device 400 outputs the video image received from the blender 360 as a 3D image OUT 2 .
  • the output image OUT 2 can be received at a receiving unit through which a user sees an output screen, such as goggles, through wired and/or wireless protocols.
  • the output device 400 splits the video image overlaid with the graphic image into a left-eye image and a right-eye image and outputs the left-eye image and the right-eye image.
  • the output device 400 separates left and right images included in a single video frame to generate the left-eye image and the right-eye image and alternately displays the left-eye image and the right-eye image at least every 1/120 seconds.
  • FIG. 4E illustrates left-eye images and right-eye images output from the output device 400 .
  • the video image processing apparatus 300 may transmit the image received from the blender 160 to an external device, or may record the image on a storage medium.
  • the video image processing apparatus 300 may include a drive to record the image on a disc (such as a DVD, Blu-ray, etc.) directly, or can be connected to a separate drive.
  • aspects of the present invention convert the format of a 3D video image to an interlaced format when the 3D video image is not the interlaced format, overlay the video image with subtitles and/or a menu, and output the video image overlaid with the subtitles and/or the menu.
  • FIG. 5 is a flow chart of a video image processing method according to an embodiment of the present invention.
  • a video image processing apparatus acquires 3D format information of a video image in operation 510 .
  • the video image processing apparatus extracts an identifier representing that the video image is a 3D format image from a header of the video data and obtains the 3D format information from the video data when the video image is the 3D format image.
  • the video image processing apparatus decodes graphic data to generate a first graphic image.
  • the video image processing apparatus generates a second graphic image suitable for the format of the video image using the first graphic image and the acquired 3D format information when the video image is the 3D format image in operation 520 .
  • the video image processing apparatus scales down the frame of the first graphic image in the horizontal direction to generate sub frames and arranges the sub frames in the horizontal direction to generate the second graphic image having two sub frames arranged in the horizontal direction.
  • the video image processing apparatus scales down the frame of the first graphic image in the vertical direction to generate sub frames and arranges the sub frames in the vertical direction to generate the second graphic image including two sub frames arranged in the vertical direction.
  • the video image processing apparatus overlays the video image with the generated second graphic image in operation 530 .
  • the graphic data includes both presentation graphic data providing subtitles and interactive graphic data providing a menu
  • the video image processing apparatus overlays the video image with a second presentation graphic image first, and then overlays the video image overlaid with the second presentation graphic image with a second interactive graphic image.
  • the video image processing apparatus splits the video image overlaid with the second graphic image into a left-eye image and a right-eye image and outputs the left-eye image and the right-eye image.
  • FIG. 6 is a flow chart of a video image processing method of a video image processing apparatus according to another embodiment of the present invention.
  • the video image processing apparatus decodes video data to generate a video image and decodes graphic data to generate a graphic image. Furthermore, the video image processing apparatus extracts an identifier representing whether the video image is a 2D format image or a 3D format image from the video data. Referring to FIG. 6 , when the video image is the 3D format image, the video image processing apparatus acquires video format information in operation 610 .
  • the video image processing apparatus determines whether the video image is an interlaced format in operation 620 , and overlays the video image with the graphic image when the video image is the interlaced format in operation 640 .
  • the video image processing apparatus converts the format of the video image into the interlaced format in operation 630 .
  • the video image processing apparatus alternately arranges odd-numbered horizontal lines of the upper part of the video image and even-numbered horizontal lines of the lower part of the video image or alternately arranges even numbered horizontal lines of the upper part of the video image and odd-numbered horizontal lines of the lower part of the video image to convert the video image to an interlace format video image when the video image is a top-and-down format.
  • the video image processing apparatus alternately arranges odd-numbered vertical lines of the left part of the video image and even-numbered vertical lines of the right part of the video image or alternately arranges even-numbered vertical lines of the left part of the video image and odd-numbered vertical lines of the right part of the video image to convert the video image to the interlaced format video image when the video image is a side-by-side format.
  • the video image processing apparatus overlays the converted interlaced format video image with the graphic image in operation S 640 .
  • the video image processing apparatus splits the video image overlaid with the graphic image into a left-eye image and a right-eye image and alternately outputs the left-eye image and the right-eye image at least every 1/120 seconds.
  • aspects of the present invention can also be embodied as computer-readable code on a computer-readable recording medium.
  • the computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
  • the computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion.
  • aspects of the present invention may also be realized as a data signal embodied in a carrier wave and comprising a program readable by a computer and transmittable over the Internet.
  • one or more units of the video image processing apparatus 100 can include a processor or microprocessor executing a computer program stored in a computer-readable medium, such as a local storage.

Abstract

A 3D video image processing method including: acquiring three-dimensional (3D) format information of a video image generated from video data to determine a 3D format of the video image; generating, from a first graphic image, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information, the first graphic image being generated from graphic data; and overlaying the video image with the second graphic image.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of U.S. Provisional Patent Application No. 61/075,184, filed on Jun. 24, 2008 in the U.S. Patent and Trademark Office, and the benefit of Korean Patent Application No. 10-2008-0091268, filed on Sep. 17, 2008 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entirety by reference.
    • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • Aspects of the present invention relate to a method and an apparatus to process a three-dimensional (3D ) video image, and more particularly, to a method and an apparatus to process a 3D video image to be output with subtitles or a menu.
  • 2. Description of the Related Art
  • Three-dimensional (3D ) video technology has widely spread with development of digital technology. The 3D video technology that gives a two-dimensional (2D) image depth information to represent a more realistic image has been applied to various fields, including communications, gaming, medical services, and broadcasting services.
  • The human eyes are apart from each other by a predetermined distance in the horizontal direction so that a 2D image is seen by the left and right eyes differently, which is referred to as binocular disparity. The human brain combines two different 2D images to generate a 3D image having depth and reality. Methods of generating 3D images using binocular disparity include a method using glasses and a method using a device including a lenticular lens, a parallax barrier, and parallax illumination without having glasses.
    • SUMMARY OF THE INVENTION
  • Aspects of the present invention provide a 3D video image processing method and apparatus to output a video image in a three-dimensional (3D ) format with a graphic image such as subtitles or a menu.
  • According to an aspect of the present invention, there is provided a video image processing method including: acquiring 3D format information of a video image generated from video data to determine a 3D format of the video image; generating, from a first graphic image generated from graphic data different from the video data, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information; and overlaying the video image with the second graphic image.
  • According to an aspect of the present invention, when the 3D format is a side-by-side format, the generating of the second graphic image may include horizontally scaling down the frame of the first graphic image to generate sub frames, and generating the second graphic image having a frame including two sub frames arranged in the horizontal direction.
  • According to an aspect of the present invention, when the 3D format is a top-and-down format, the generating of the second graphic image may include vertically scaling down the frame of the first graphic image to generate sub frames, and generating the second graphic image having a frame including two sub frames arranged in the vertical direction
  • According to an aspect of the present invention, the acquiring of the 3D format information may include: extracting an identifier representing whether the video image is a 3D format image from the video data; and acquiring the 3D format information from the video data when the video image is a 3D format image using the identifier.
  • According to an aspect of the present invention, the video image processing method may further include splitting the video image overlaid with the second graphic image into a left-eye image and a right-eye image and outputting the left-eye image and the right-eye image.
  • According to an aspect of the present invention, the graphic data may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu.
  • According to an aspect of the present invention, when the graphic data includes both the presentation graphic data and the interactive graphic data, the generating of the second graphic image may include generating a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and generating a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information.
  • According to an aspect of the present invention, the overlaying of the video image with the second graphic image may include overlaying the video image overlaid with the second presentation graphic image with the second interactive graphic image.
  • According to another aspect of the present invention, there is provided a video image processing method including: acquiring 3D format information of a video image generated from video data; converting the video image to a 3D interfaced format using the 3D format information; and overlaying the 3D interlaced format video image with a graphic image generated from graphic data.
  • According to an aspect of the present invention, when the video image is a top-and-down format including an upper image and a lower image, the converting of the format of the video image to the interlaced format may include alternately arranging odd-numbered horizontal lines of the upper image and even-numbered horizontal lines of the lower image or alternately arranging even-numbered horizontal lines of the upper image and odd-numbered horizontal lines of the lower image to convert the video image to the interlaced format video image.
  • According to an aspect of the present invention, when the video image is a side-by-side format including a left image and a right image, the converting of the format of the video image to the interlaced format may include alternately arranging odd-numbered vertical lines of the left image and even-numbered vertical lines of the right image or alternately arranging even-numbered vertical lines of the left image and odd-numbered vertical lines of the right image to convert the video image to the interlaced format video image.
  • According to an aspect of the present invention, the video image processing method may further include splitting the video image overlaid with the graphic image into a left-eye image and a right-eye image and outputting the left-eye image and the right-eye image.
  • According to another aspect of the present invention, there is provided a video image processing apparatus including: a video data decoder to decode video data to generate a video image; a graphic data decoder decoding graphic data to generate a first graphic image; a second graphic image generator to extract 3D format information of the video image from the video data to determine the a 3D format of the video image, and to generate, from the first graphic image, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information; and a blender to overlay the video image with the second graphic image.
  • According to yet another aspect of the present invention, there is provided a video image processing apparatus including: a video data decoder to decode video data to generate a video image; a graphic data decoder to decode graphic data to generate a graphic image; a format converter to extract 3D format information of the video image from the video data and to convert the video image to a 3D interlaced format video image using the 3D format information; and a blender overlaying the 3D interlaced format video image with the graphic image.
  • According to still another aspect of the present invention, there is provided a computer readable recording medium storing a program to execute a video image processing method, the method including: acquiring 3D format information of a video image generated from video data to determine a 3D format of the video image; generating a second graphic image, from a first graphic image generated from graphic data, corresponding to the determined 3D format of the video image using the 3D format information; and overlaying the video image with the second graphic image.
  • According to another aspect of the present invention, there is provided a computer readable recording medium storing a program to execute a video image processing method, the method including: acquiring 3D format information of a video image generated from video data; converting the video image to a 3D interfaced format video image; and overlaying the 3D interlaced format video image with a graphic image generated from graphic data.
  • According to an aspect of the present invention, there is provided a video image processing method of a video image processing apparatus, the video image processing method including: acquiring, by the video image processing apparatus, three-dimensional (3D ) format information of a video image generated from video data; and overlaying, by the video image processing apparatus, the video image with a graphic image according to the acquired 3D format information, wherein the graphic image is generated from graphic data that is distinct from the video image.
  • According to an aspect of the present invention, there is provided a computer-readable recording medium implemented by a video image processing apparatus, the computer-readable recording medium including: video data comprising a video image and three-dimensional (3D ) format information used by the video image processing apparatus to overlay the video image with a graphic image in a 3D format, wherein the graphic image is generated from graphic data that is distinct from the video image.
  • Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
  • FIG. 1 is a block diagram of a video image processing apparatus according to an embodiment of the present invention;
  • FIGS. 2A to 2E illustrate examples of video images and graphic images generated by the video image processing apparatus illustrated in FIG. 1;
  • FIG. 3 is a block diagram of a video image processing apparatus according to another embodiment of the present invention;
  • FIGS. 4A to 4E illustrate examples of video images and graphic images generated by the video image processing apparatus illustrated in FIG. 3;
  • FIG. 5 is a flowchart of a video image processing method according to an embodiment of the present invention; and
  • FIG. 6 is a flowchart of a video image processing method according to another embodiment of the present invention.
    •  DETAILED DESCRIPTION OF THE EMBODIMENTS
  • Reference will now be made in detail to the present embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present invention by referring to the figures.
  • FIG. 1 is a block diagram of a video image processing apparatus 100 according to an embodiment of the present invention, and FIGS. 2A to 2E illustrate video images and graphic images generated by the video image processing apparatus 100 illustrated in FIG. 1. Referring to FIG. 1, the video image processing apparatus 100 includes a video data decoder 110, a graphic data decoder 120, a second graphic image generator 130, a video image buffer 140, a graphic image buffer 150, and a blender 160. While the video image processing apparatus 100 does not include an output device 200 in FIG. 1, it is understood that, according to other embodiments, the video image processing apparatus 100 may include the output device 200. The video image processing apparatus 100 may be a television, a computer, a mobile device, a set-top box, a gaming system, etc. The output device 200 may be a cathode ray tube display device, a liquid crystal display device, a plasma display device, an organic light emitting diode display device, goggles, etc. Moreover, while not required, each of the units 110, 120, 130, 140, 150, 160 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • A demultiplexer (not shown) demultiplexes an input signal in the form of a bit stream, transmits video data IN1 to the video data decoder 110 and transmits graphic data IN2 to the graphic data decoder 120. The video data decoder 110 decodes the video data IN1 to generate a video image. The video image can be a 2D format image or a 3D format image. FIG. 2A illustrates 3D format video images decoded by the video data decoder 110. As illustrated in FIG. 2A, in the 3D format image, left and right images to be simultaneously displayed are allocated to a single frame. While not required in all aspects, the video image processing apparatus 100 may include a drive to read a disc including the video data and the graphic data, or can be connected to a separate drive.
  • A 3D image display apparatus sequentially displays an image for the left eye and an image for the right eye to reproduce a 3D image. A viewer recognizes an image to be played without pause when the display apparatus plays the image at a minimum frame rate of 60 Hz based on one eye. As the 3D image is generated when images input through left and right eyes are combined, the display apparatus therefore outputs the 3D image at a minimum frame rate of 120 Hz in order for the viewer to recognize the 3D image to be played without pause. That is, the viewer recognizes the 3D image when left and right images are sequentially displayed at least every 1/12 seconds.
  • While a display apparatus supports 120 Hz, a player that decodes video data may not have an output terminal supporting 120 Hz. For example, the player may output frame images and transmit the frame images to the display apparatus at 60 Hz (i.e., every 1/60 seconds). Thus, to generate left and right images every 1/120 seconds through the display apparatus using the frame images transmitted from the player every 1/60 seconds, both left and right images must be included in a frame of a video image. According to aspects of the present invention, the video image processing apparatus 100 corresponds to the player and the output device 200 corresponds to the display apparatus. Accordingly, when the video image processing apparatus 100 transmits frame images of a video image to the output device 200 at a frame rate of 60 Hz, the video image has a 3D format including both left and right images in order for the output device 200 to output the video image at a frame rate of 120 Hz. The 3D format includes a top-and-down format, a side-by-side format, and an interlaced format.
  • A video image in the top-and-down format is illustrated in the upper part of FIG. 2A. In the top-and-down format, a left-eye image and a right-eye image, which are sub-sampled in the vertical direction, are respectively allocated to upper and lower parts of a frame. A video image in the side-by-side format is illustrated in the lower part of FIG. 2A. In the side-by-side format, a left-eye image and a right-eye image, which are sub-sampled in the horizontal direction, are respectively allocated to left and right parts of a frame. The video data decoder 110 transmits the video image to the video image buffer 140.
  • The graphic data decoder 120 decodes the graphic data received from the demultiplexer to generate a first graphic image. The graphic data may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu. When the graphic data includes both the presentation graphic data and the interactive graphic data, the graphic data decoder 120 generates a first presentation graphic image using the presentation graphic data and generates a first interactive graphic image using the interactive graphic data.
  • FIG. 2B illustrates the first graphic image decoded by the graphic data decoder 120. When the video image is a 2D format image, the first graphic image is overlaid on the 2D video format image to provide subtitles or a menu with respect to the video image. However, when the video image is a 3D format image as illustrated in FIG. 2A, the first graphic image as illustrated in FIG. 2B does not have a format suitable for the 3D format video image. Thus, a proper subtitle or menu is not output when the first graphic image is overlaid on the 3D format video image. Accordingly, when the video image has a 3D format, a graphic image in a format suitable for the 3D format video image is required.
  • The second graphic image generator 130 extracts an identifier representing whether the video image is a 2D format image or a 3D format image from a header of the video data. The second graphic image generator 130 sends the first graphic image to the graphic image buffer 150 when the second graphic image generator 130 determines that the video image is a 2D format image using the identifier. Conversely, when the second graphic image generator 130 determines that the video image is a 3D format image, the second graphic image generator 130 acquires 3D format information representing a format type of the 3D video image from the header of the video data. The second graphic image generator 130 decodes the 3D format information to recognize the 3D format type of the video image and generates the second graphic image using the 3D format type. While the second graphic image generator 130 is described above to determine whether the video image is a 2D format image or a 3D format image, and to determine the 3D format type, it is understood that aspects of the present invention are not limited thereto. For example, according to other aspects, although a controller is not shown in FIG. 1, a controller may be included in the video image processing apparatus 100 to determine whether the video image is a 2D format image or a 3D format image, acquire the 3D format information when the video image is a 3D format image, and/or notify the second graphic image generator 130 of the 3D format information and/or the 3D format type.
  • The second graphic image generator 130 generates the second graphic image suitable for the 3D format type of the video image using the first graphic image and the 3D format information. When the video image has a top-and-down format (as illustrated in the upper portion of FIG. 2A), the second graphic image generator 130 vertically samples the frame of the first graphic image to generate sub frames having a reduced vertical size. The second graphic image generator 130 generates two sub frames having a reduced size and vertically arranges the two sub frames to suit the top-and-bottom format of the video image to generate a single frame including the two sub frames. In FIG. 2C, the upper part illustrates the second graphic image generated using the first graphic image illustrated in the upper part of FIG. 2B when the video image has the top-and-down format as illustrated in the upper part of FIG. 2A.
  • When the video image has a side-by-side format (as illustrated in the lower part of FIG. 2A), the second graphic image generator 130 horizontally samples the frame of the first graphic image to generate sub frames having a reduced horizontal size. The second graphic image generator 130 generates two sub frames and horizontally arranges the two sub frames to suit the side-by-side format to generate a single frame including the two sub frames. The lower part of FIG. 2C illustrates the second graphic image generated using the first graphic image illustrated in the lower part of FIG. 2B when the video image has the side-by-side format as illustrated in the lower part of FIG. 2A.
  • When the graphic data includes both the presentation graphic data providing subtitles and the interactive graphic data providing a menu, the second graphic image generator 130 generates a second presentation graphic image using the first presentation graphic image and generates a second interactive graphic image using the first interactive graphic image. The second graphic image generator 130 transmits the generated second graphic image (including the second presentation graphic image and/or the second interactive graphic image) to the graphic image buffer 150.
  • The video image processing apparatus 100 includes a system time clock (STC) counter (not shown). The video image processing apparatus 100 decodes and outputs the video image according to the STC counter. The video image buffer 140 and the graphic image buffer 150 temporarily store the video image and the second graphic image, respectively, and transmit the video image and the second graphic image to the blender 160 when the STC corresponds to a presentation time stamp (PTS).
  • The blender 160 overlays the video image with the second graphic image and transmits the video image overlaid with the second graphic image to the output device 200. FIG. 2D illustrates video images overlaid with the second graphic images illustrated in FIG. 2C according to the blender 160. The upper part of FIG. 2D illustrates a video image overlaid with the second graphic image converted to suit the top-and-down format when the video image has the top-and-down format. The lower part of FIG. 2D illustrates a video image overlaid with the second graphic image converted to suit the side-by-side format when the video image has the side-by-side format.
  • When the graphic data includes both the presentation graphic data providing subtitles and the interactive graphic data providing a menu, the blender 160 overlays the video image with the second presentation graphic image, and overlays the video image overlaid with the second presentation graphic image with the second interactive graphic image in sequence. That is, the blender 160 blends the video image with subtitles first, and then blends the video image blended with the subtitles with a menu. However, it is understood that in other aspects, the blender 160 blends the video image with a menu first, and then blends the video image blended with the menu with subtitles.
  • The output device 200 outputs the image received from the blender 160 as a 3D image OUT1. The output device 200 separates left and right images included in a single 3D format image of the video frame from each other to generate a left-eye image and a right-eye image. The output device 200 alternately displays the left-eye image and the right-eye image at least every 1/120 seconds. The output image OUT1 can be received at a receiving unit through which a user sees an output screen, such as goggles, through wired and/or wireless protocols. FIG. 2E illustrates the left-eye image and the right-eye image output from the output device 200. Alternatively, while not required in all aspects, the video image processing apparatus 100 may transmit the image received from the blender 160 to an external device, or may record the image on a storage medium. For example, the video image processing apparatus 100 may include a drive to record the image on a disc (such as a DVD, Blu-ray, etc.) directly, or can be connected to a separate drive.
  • As described above, according to aspects of the present invention, when the video image is a 3D format image, a graphic image suitable for the 3D video image format is generated. Furthermore, the 3D video image is suitably overlaid with the graphic image and output with the graphic image.
  • FIG. 3 is a block diagram of a video image processing apparatus 300 according to another embodiment of the present invention, and FIGS. 4A to 4E illustrate video images and graphic images generated by the video image processing apparatus illustrated in FIG. 3. Referring to FIG. 3, the video image processing apparatus 300 includes a video data decoder 310, a graphic data decoder 320, a format converter 330, a video image buffer 340, a graphic image buffer 350, and a blender 160. While the video image processing apparatus 300 is independent of an output device 400 in FIG. 3, it is understood that aspects of the present invention are not limited thereto, and the video image processing apparatus 300 includes the output device 400 in other aspects. The video image processing apparatus 300 may be a television, a computer, a mobile device, a set-top box, a gaming system, etc. The output device 400 may be a cathode ray tube display device, a liquid crystal display device, a plasma display device, an organic light emitting diode display device, etc. Moreover, while not required, each of the units 310, 320, 330, 340, 350, 160 can be one or more processors or processing elements on one or more chips or integrated circuits.
  • The video data decoder 310 decodes video data IN3 to generate a video image. The video data decoder 310 transmits the video image to the format converter 330. The format converter 330 determines whether the video image is a 2D format image or a 3D format image and acquires 3D format information of the video image when the video image is a 3D format image. The format converter 330 determines whether the 3D video image is an interlaced format using the 3D format information of the 3D video image. The interlaced format samples a left-eye image and a right-eye image by ½ at a predetermined interval in the vertical or horizontal direction such that the left-eye and right-eye images are alternately located in the vertical or horizontal direction to generate a 3D image.
  • FIG. 4A illustrates 3D format video images decoded by the video data decoder 310. As described above with reference to FIG. 2A, in a single 3D format image, left and right images to be simultaneously displayed are allocated. The upper part of FIG. 4A illustrates a top-and-down format video image and the lower part of FIG. 4A illustrates a side-by-side format video image.
  • The graphic data decoder 320 decodes graphic data IN4 to generate a graphic image providing subtitles and/or a menu. The graphic data IN4 may include presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu. When the graphic data includes both the presentation graphic data and the interactive graphic data, the graphic data decoder 320 decodes the presentation graphic data to generate a presentation graphic image providing subtitles and decodes the interactive graphic data to generate an interactive graphic image providing a menu. FIG. 4B illustrates graphic images generated by the graphic data decoder 320. The graphic data decoder 320 sends the generated graphic image(s) to the graphic image buffer 350.
  • As illustrated in FIG. 4B, the graphic image has a format suitable for a 2D format video image. Thus, a proper subtitles or menu cannot be output when the video image is overlaid with the graphic image if the video image is the top-and-down format or the side-by-side format as illustrated in FIG. 4A.
  • Accordingly, the format converter 330 extracts an identifier representing whether the video image is a 2D format image or a 3D format image from the header of the video data. When the format converter 330 determines that the video image is a 2D format image using the identifier, the format converter 330 transmits the 2D format video image to the video image buffer 340. When the format converter 330 determines that the video image is a 3D format image, the format converter 330 acquires 3D format information representing the format type of the 3D video format image from the header of the video data. The format converter 330 sends the video image to the video image buffer 340 when the video image is a 3D interlaced format video image. While the format converter 330 is described above to determine whether the video image is a 2D format image or a 3D format image, and to determine the 3D format type, it is understood that aspects of the present invention are not limited thereto. For example, according to other aspects, although a controller is not shown in FIG. 3, the video image processing apparatus 300 may include a controller to determine whether the video image is a 2D format image or a 3D format image, acquire format information of the video image, and/or notify the format converter 330 of the format information when the video image is a 3D format image.
  • The format converter 330 converts the format of the video image to the interlaced format when the video image is not a 2D image and is not a 3D interlaced format video image. For example, when the video image has a top-and-down format, the format converter 330 alternately arranges odd-numbered horizontal lines of the upper part of the video image and even-numbered horizontal lines of the lower part of the video image or alternately arranges even-numbered horizontal lines of the upper part of the video image and odd-numbered horizontal lines of the lower part of the video image to convert the top-and-down format video image into the interlaced format video image. The upper part of FIG. 4C illustrates the interlaced format video image converted by the format converter 330 when the decoded video image has a top-and-down format. Similarly, when the video image has a side-by-side format, the format converter 330 can alternately arrange even-numbered vertical lines of the left part of the video image and odd-numbered vertical lines of the right part of the video image or alternately arrange odd-numbered vertical lines of the left part of the video image and even-numbered vertical lines of the right part of the video image to convert the side-by-side format video image into the interlaced format video image. The lower part of FIG. 4C illustrates the interlaced format video image converted by the format converter 330 when the decoded video image has a side-by-side format. Accordingly, the format converter 330 transmits the 3D interlaced format video image to the video image buffer 340.
  • The video image buffer 340 and the graphic image buffer 350 temporarily store the video image and the graphic image, respectively, and transmit the video image and the graphic image to the blender 360 when the STC corresponds to the PTS, as described above with reference to the video image processing apparatus 100 of FIG. 1. The blender 360 overlays the video image with the graphic image and transmits the video image overlaid with the graphic image to the output device 400. When the graphic data includes both the presentation graphic data providing subtitles and the interactive graphic data providing a menu, the blender 360 overlays the video image with the presentation graphic image, and overlays the video image overlaid with the presentation graphic image with the interactive graphic image in sequence. However, it is understood that in other aspects, the blender 160 overlays the video image with the interactive graphic image first, and then overlays the video image overlaid with the interactive graphic image with the presentation graphic image. FIG. 4D illustrates video images overlaid with the graphic images according to the blender 360.
  • The output device 400 outputs the video image received from the blender 360 as a 3D image OUT2. The output image OUT2 can be received at a receiving unit through which a user sees an output screen, such as goggles, through wired and/or wireless protocols. The output device 400 splits the video image overlaid with the graphic image into a left-eye image and a right-eye image and outputs the left-eye image and the right-eye image. The output device 400 separates left and right images included in a single video frame to generate the left-eye image and the right-eye image and alternately displays the left-eye image and the right-eye image at least every 1/120 seconds. FIG. 4E illustrates left-eye images and right-eye images output from the output device 400. Alternatively, while not required in all aspects, the video image processing apparatus 300 may transmit the image received from the blender 160 to an external device, or may record the image on a storage medium. For example, the video image processing apparatus 300 may include a drive to record the image on a disc (such as a DVD, Blu-ray, etc.) directly, or can be connected to a separate drive.
  • As described above, aspects of the present invention convert the format of a 3D video image to an interlaced format when the 3D video image is not the interlaced format, overlay the video image with subtitles and/or a menu, and output the video image overlaid with the subtitles and/or the menu.
  • FIG. 5 is a flow chart of a video image processing method according to an embodiment of the present invention. Referring to FIG. 5, a video image processing apparatus acquires 3D format information of a video image in operation 510. For example, the video image processing apparatus extracts an identifier representing that the video image is a 3D format image from a header of the video data and obtains the 3D format information from the video data when the video image is the 3D format image. Furthermore, the video image processing apparatus decodes graphic data to generate a first graphic image. The video image processing apparatus generates a second graphic image suitable for the format of the video image using the first graphic image and the acquired 3D format information when the video image is the 3D format image in operation 520. For example, when the video image is a side-by-side format, the video image processing apparatus scales down the frame of the first graphic image in the horizontal direction to generate sub frames and arranges the sub frames in the horizontal direction to generate the second graphic image having two sub frames arranged in the horizontal direction. When the video image has a top-and-down format, the video image processing apparatus scales down the frame of the first graphic image in the vertical direction to generate sub frames and arranges the sub frames in the vertical direction to generate the second graphic image including two sub frames arranged in the vertical direction.
  • The video image processing apparatus overlays the video image with the generated second graphic image in operation 530. When the graphic data includes both presentation graphic data providing subtitles and interactive graphic data providing a menu, the video image processing apparatus overlays the video image with a second presentation graphic image first, and then overlays the video image overlaid with the second presentation graphic image with a second interactive graphic image. Moreover, in some aspects, the video image processing apparatus splits the video image overlaid with the second graphic image into a left-eye image and a right-eye image and outputs the left-eye image and the right-eye image.
  • FIG. 6 is a flow chart of a video image processing method of a video image processing apparatus according to another embodiment of the present invention. The video image processing apparatus decodes video data to generate a video image and decodes graphic data to generate a graphic image. Furthermore, the video image processing apparatus extracts an identifier representing whether the video image is a 2D format image or a 3D format image from the video data. Referring to FIG. 6, when the video image is the 3D format image, the video image processing apparatus acquires video format information in operation 610. The video image processing apparatus determines whether the video image is an interlaced format in operation 620, and overlays the video image with the graphic image when the video image is the interlaced format in operation 640. When the video image is not the interlaced format (operation 620), the video image processing apparatus converts the format of the video image into the interlaced format in operation 630. Specifically, the video image processing apparatus alternately arranges odd-numbered horizontal lines of the upper part of the video image and even-numbered horizontal lines of the lower part of the video image or alternately arranges even numbered horizontal lines of the upper part of the video image and odd-numbered horizontal lines of the lower part of the video image to convert the video image to an interlace format video image when the video image is a top-and-down format. Conversely, the video image processing apparatus alternately arranges odd-numbered vertical lines of the left part of the video image and even-numbered vertical lines of the right part of the video image or alternately arranges even-numbered vertical lines of the left part of the video image and odd-numbered vertical lines of the right part of the video image to convert the video image to the interlaced format video image when the video image is a side-by-side format. The video image processing apparatus overlays the converted interlaced format video image with the graphic image in operation S640. In some aspects, the video image processing apparatus splits the video image overlaid with the graphic image into a left-eye image and a right-eye image and alternately outputs the left-eye image and the right-eye image at least every 1/120 seconds.
  • While not restricted thereto, aspects of the present invention can also be embodied as computer-readable code on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Aspects of the present invention may also be realized as a data signal embodied in a carrier wave and comprising a program readable by a computer and transmittable over the Internet. Moreover, while not required in all aspects, one or more units of the video image processing apparatus 100 can include a processor or microprocessor executing a computer program stored in a computer-readable medium, such as a local storage.
  • Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in this embodiment without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims (31)

1. A video image processing method of a video image processing apparatus, the video image processing method comprising:
acquiring, by the video image processing apparatus, three-dimensional (3D ) format information of a video image generated from video data to determine a 3D format of the video image;
generating, by the video image processing apparatus, from a first graphic image, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information, the first graphic image being generated from graphic data that is distinct from the video image; and
overlaying, by the video image processing apparatus, the video image with the second graphic image.
2. The video image processing method as claimed in claim 1, wherein the generating of the second graphic image comprises:
when the determined 3D format is a side-by-side format, horizontally scaling down a frame of the first graphic image to generate two sub frames; and
generating the second graphic image having a frame including the generated two sub frames arranged in a horizontal direction.
3. The video image processing method as claimed in claim 1, wherein the generating of the second graphic image comprises;
when the determined 3D format is a top-and-down format, vertically scaling down a frame of the first graphic image to generate two sub frames; and
generating the second graphic image having a frame including the generated two sub frames arranged in a vertical direction
4. The video image processing method as claimed in claim 1, wherein the acquiring of the 3D format information comprises:
extracting an identifier representing whether the video image is a 3D format image from the video data; and
acquiring the 3D format information from the video data when the video image is the 3D format image using the identifier.
5. The video image processing method as claimed in claim 1, further comprising:
splitting the video image overlaid with the second graphic image into a left-eye image and a right-eye image; and
outputting the left-eye image and the right-eye image.
6. The video image processing method as claimed in claim 1, further comprising:
transmitting the video image overlaid with the second graphic image to an external device to be output as a left-eye image and a right-eye image.
7. The video image processing method as claimed in claim 1, wherein:
the graphic data includes presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu;
when the graphic data includes the presentation graphic data and the interactive graphic data, the generating of the second graphic image comprises:
generating a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and
generating a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information; and
the overlaying of the video image with the second graphic image comprises:
overlaying the video image with the second presentation graphic image, and
overlaying the video image overlaid with the second presentation graphic image with the second interactive graphic image.
8. The video image processing method as claimed in claim 1, wherein:
the graphic data includes presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu; and
when the graphic data includes the presentation graphic data and the interactive graphic data, the generating of the second graphic image comprises:
generating a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and
generating a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information; and
the overlaying of the video image with the second graphic image comprises:
overlaying the video image with the second interactive graphic image, and
overlaying the video image overlaid with the second interactive graphic image with the second presentation graphic image.
9. The video image processing method as claimed in claim 1, wherein the generating of the second graphic image comprises:
scaling down a frame of the first graphic image to generate two sub frames; and
generating the second graphic image having a frame including the generated two sub frames,
wherein the two sub frames comprise a first sub frame corresponding to a left-eye image and a second sub frame corresponding to a right-eye image.
10. A video image processing method of a video image processing apparatus, the video image processing method comprising:
acquiring, by the video image processing apparatus, three-dimensional (3D ) format information of a video image generated from video data;
converting, by the video image processing apparatus, the video image to a 3D interlaced format video image using the acquired 3D format information; and
overlaying, by the video image processing apparatus, the 3D interlaced format video image with a graphic image generated from graphic data that is distinct from the video image.
11. The video image processing method as claimed in claim 10, wherein the converting of the video image to the 3D interlaced format video image comprises:
when the video image is a top-and-down format including an upper image and a lower image, alternately arranging odd-numbered horizontal lines of the upper image and even-numbered horizontal lines of the lower image or alternately arranging even-numbered horizontal lines of the upper image and odd-numbered horizontal lines of the lower image to convert the video image to the 3D interlaced format video image.
12. The video image processing method as claimed in claim 10, wherein the converting of the video image to the 3D interlaced format video image comprises:
when the video image is a side-by-side format including a left image and a right image, alternately arranging odd-numbered vertical lines of the left image and even-numbered vertical lines of the right image or alternately arranging even-numbered vertical lines of the left image and odd-numbered vertical lines of the right image to convert the video image to the 3D interlaced format video image.
13. The video image processing method as claimed in claim 10, further comprising:
splitting the video image overlaid with the graphic image into a left-eye image and a right-eye image; and
outputting the left-eye image and the right-eye image.
14. The video image processing method as claimed in claim 10, further comprising:
transmitting the video image overlaid with the graphic image to an external device to be output as a left-eye image and a right-eye image.
15. A video image processing apparatus comprising:
a video data decoder to decode video data to generate a video image;
a graphic data decoder to decode graphic data to generate a first graphic image;
a second graphic image generator to extract three-dimensional (3D ) format information of the video image from the video data to determine a 3D format of the video image, and to generate, from the first graphic image, a second graphic image corresponding to the determined 3D format of the video image using the 3D format information; and
a blender overlay the video image with the second graphic image.
16. The video image processing apparatus as claimed in claim 15, wherein when the determined 3D format is a side-by-side format, the second graphic image generator horizontally scales down a frame of the first graphic image to generate two sub frames, and generates the second graphic image including the generated two sub frames arranged in a horizontal direction.
17. The video image processing apparatus as claimed in claim 15, wherein when the determined 3D format is a top-and-down format, the second graphic image generator vertically scales down a frame of the first graphic image to generate two sub frames, and generates the second graphic image including the generated two sub frames arranged in a vertical direction.
18. The video image processing apparatus as claimed in claim 15, wherein the second graphic image generator extracts an identifier representing whether the video image is a 3D format image from the video data and acquires the 3D format information from the video data when the video image is the 3D format image using the identifier.
19. The video image processing apparatus as claimed in claim 15, further comprising an output unit to split the video image overlaid with the second graphic image into a left-eye image and a right-eye image and to output the left-eye image and the right-eye image.
20. The video image processing apparatus as claimed in claim 15, further comprising an output unit to transmit the video image overlaid with the second graphic image to an external device to be output as a left-eye image and a right-eye image.
21. The video image processing apparatus as claimed in claim 15, wherein:
the graphic data includes presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu;
when the graphic data includes the presentation graphic data and the interactive graphic data, the second graphic image generator generates a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and generates a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information; and
the blender overlays the video image with the second presentation graphic image, and overlays the video image overlaid with the second presentation graphic image with the second interactive graphic image.
22. The video image processing apparatus as claimed in claim 15, wherein:
the graphic data includes presentation graphic data to provide subtitles and/or interactive graphic data to provide a menu;
when the graphic data includes the presentation graphic data and the interactive graphic data, the second graphic image generator generates a second interactive graphic image using a first interactive graphic image generated from the interactive graphic data and the 3D format information, and generates a second presentation graphic image using a first presentation graphic image generated from the presentation graphic data and the 3D format information; and
the blender overlays the video image with the second interactive graphic image, and overlays the video image overlaid with the second interactive graphic image with the second presentation graphic image.
23. The video image processing apparatus as claimed in claim 15, wherein:
the second graphic image generator scales down a frame of the first graphic image to generate two sub frames, and generates the second graphic image having a frame including the generated two sub frames; and
the two sub frames comprise a first sub frame corresponding to a left-eye image and a second sub frame corresponding to a right-eye image.
24. A video image processing apparatus comprising:
a video data decoder to decode video data to generate a video image;
a graphic data decoder to decode graphic data to generate a graphic image;
a format converter to extract three-dimensional (3D ) format information of the video image from the video data and to convert the video image to a 3D interlaced format video image using the extracted 3D format information; and
a blender to overlay the 3D interlaced format video image with the graphic image.
25. The video image processing apparatus as claimed in claim 24, wherein when the video image is a top-and-down format including an upper image and a lower image, the format converter alternately arranges odd-numbered horizontal lines of the upper image and even-numbered horizontal lines of the lower image or alternately arranges even-numbered horizontal lines of the upper image and odd-numbered horizontal lines of the lower image to convert the video image to the 3D interlaced format video image.
26. The video image processing apparatus as claimed in claim 24, wherein when the video image is a side-by-side format including a left image and a right image, the format converter alternately arranges odd-numbered vertical lines of the left image and even-numbered vertical lines of the right image or alternately arranges even-numbered vertical lines of the left image and odd-numbered vertical lines of the right image to convert the video image to the 3D interlaced format video image.
27. The video image processing apparatus as claimed in claim 24, further comprising an output unit to split the video image overlaid with the graphic image into a left-eye image and a right-eye image and to output the left-eye image and the right-eye image.
28. The video image processing apparatus as claimed in claim 24, further comprising an output unit to transmit the video image overlaid with the graphic image to an external device to be output as a left-eye image and a right-eye image.
29. A computer readable recording medium storing a program to execute the method of claim 1 and implemented by the video image processing apparatus.
30. A computer readable recording medium storing a program to execute the method of claim 10 and implemented by the video image processing apparatus.
31. A computer-readable recording medium implemented by a video image processing apparatus, the computer-readable recording medium comprising:
video data comprising a video image and three-dimensional (3D ) format information used by the video image processing apparatus to overlay the video image with a graphic image in a 3D format,
wherein the graphic image is generated from graphic data that is distinct from the video image.
US12/489,726 2008-06-24 2009-06-23 Method and apparatus for processing 3d video image Abandoned US20090315979A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/489,726 US20090315979A1 (en) 2008-06-24 2009-06-23 Method and apparatus for processing 3d video image

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US7518408P 2008-06-24 2008-06-24
KR1020080091268A KR101539935B1 (en) 2008-06-24 2008-09-17 Method and apparatus for processing 3D video image
KR10-2008-0091268 2008-09-17
US12/489,726 US20090315979A1 (en) 2008-06-24 2009-06-23 Method and apparatus for processing 3d video image

Publications (1)

Publication Number Publication Date
US20090315979A1 true US20090315979A1 (en) 2009-12-24

Family

ID=41812276

Family Applications (6)

Application Number Title Priority Date Filing Date
US12/479,978 Abandoned US20090315884A1 (en) 2008-06-24 2009-06-08 Method and apparatus for outputting and displaying image data
US12/489,758 Abandoned US20090317061A1 (en) 2008-06-24 2009-06-23 Image generating method and apparatus and image processing method and apparatus
US12/489,726 Abandoned US20090315979A1 (en) 2008-06-24 2009-06-23 Method and apparatus for processing 3d video image
US12/490,589 Abandoned US20090315977A1 (en) 2008-06-24 2009-06-24 Method and apparatus for processing three dimensional video data
US12/556,699 Expired - Fee Related US8488869B2 (en) 2008-06-24 2009-09-10 Image processing method and apparatus
US12/564,201 Abandoned US20100103168A1 (en) 2008-06-24 2009-09-22 Methods and apparatuses for processing and displaying image

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/479,978 Abandoned US20090315884A1 (en) 2008-06-24 2009-06-08 Method and apparatus for outputting and displaying image data
US12/489,758 Abandoned US20090317061A1 (en) 2008-06-24 2009-06-23 Image generating method and apparatus and image processing method and apparatus

Family Applications After (3)

Application Number Title Priority Date Filing Date
US12/490,589 Abandoned US20090315977A1 (en) 2008-06-24 2009-06-24 Method and apparatus for processing three dimensional video data
US12/556,699 Expired - Fee Related US8488869B2 (en) 2008-06-24 2009-09-10 Image processing method and apparatus
US12/564,201 Abandoned US20100103168A1 (en) 2008-06-24 2009-09-22 Methods and apparatuses for processing and displaying image

Country Status (7)

Country Link
US (6) US20090315884A1 (en)
EP (4) EP2292019A4 (en)
JP (4) JP2011525743A (en)
KR (9) KR20100002032A (en)
CN (4) CN102077600A (en)
MY (1) MY159672A (en)
WO (4) WO2009157668A2 (en)

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045779A1 (en) * 2008-08-20 2010-02-25 Samsung Electronics Co., Ltd. Three-dimensional video apparatus and method of providing on screen display applied thereto
WO2010151555A1 (en) * 2009-06-24 2010-12-29 Dolby Laboratories Licensing Corporation Method for embedding subtitles and/or graphic overlays in a 3d or multi-view video data
WO2011006104A1 (en) * 2009-07-10 2011-01-13 Dolby Laboratories Licensing Corporation Modifying images for a 3-dimensional display mode
US20110018966A1 (en) * 2009-07-23 2011-01-27 Naohisa Kitazato Receiving Device, Communication System, Method of Combining Caption With Stereoscopic Image, Program, and Data Structure
US20110122949A1 (en) * 2009-11-17 2011-05-26 Sony Corporation Image transmission method, image receiving method, image transmission device, image receiving device, and image transmission system
US20110134216A1 (en) * 2009-12-08 2011-06-09 Darren Neuman Method and system for mixing video and graphics
US20110141236A1 (en) * 2008-09-02 2011-06-16 Hiroshi Mitani Three-dimensional video image transmission system, video image display device and video image output device
US20110149036A1 (en) * 2008-12-02 2011-06-23 Jong-Yeul Suh Method for displaying 3d caption and 3d display apparatus for implementing the same
US20110157307A1 (en) * 2009-12-28 2011-06-30 Toshiya Hamada Image Processing Device, Image Processing Method, and Program
US20110164113A1 (en) * 2008-09-07 2011-07-07 Dolby Laboratories Licensing Corporation Conversion of Interleaved Data Sets, Including Chroma Correction and/or Correction of Checkerboard Interleaved Formatted 3D Images
US20110175988A1 (en) * 2010-01-21 2011-07-21 General Instrument Corporation 3d video graphics overlay
US20110200302A1 (en) * 2010-02-12 2011-08-18 Sony Corporation Information processing device, information processing method, playback device, playback method, program and recording medium
WO2011102818A1 (en) * 2010-02-19 2011-08-25 Thomson Licensing Stereo logo insertion
WO2011105992A1 (en) * 2010-02-24 2011-09-01 Thomson Licensing Subtitling for stereoscopic images
US20110216163A1 (en) * 2010-03-08 2011-09-08 Dolby Laboratories Licensing Corporation Methods For Carrying And Transmitting 3D Z-Norm Attributes In Digital TV Closed Captioning
US20110221862A1 (en) * 2010-03-12 2011-09-15 Mark Kenneth Eyer Disparity Data Transport and Signaling
US20110228060A1 (en) * 2010-03-18 2011-09-22 Nariaki Yamamoto Three-dimensional video reproduction apparatus, three-dimensional video reproduction method, and integrated circuit
US20110234585A1 (en) * 2010-03-24 2011-09-29 Samsung Electronics Co. Ltd. Method and apparatus for processing 3d images in mobile terminal
US20110234754A1 (en) * 2008-11-24 2011-09-29 Koninklijke Philips Electronics N.V. Combining 3d video and auxiliary data
WO2011130094A1 (en) * 2010-04-16 2011-10-20 The Directv Group, Inc. Method and apparatus for presenting on-screen graphics in a frame-compatible 3d format
US20110273534A1 (en) * 2010-05-05 2011-11-10 General Instrument Corporation Program Guide Graphics and Video in Window for 3DTV
US20110292038A1 (en) * 2010-05-27 2011-12-01 Sony Computer Entertainment America, LLC 3d video conversion
CN102316346A (en) * 2010-07-07 2012-01-11 索尼公司 Image data transmitting apparatus and method, receiving equipment and method and system
US20120032954A1 (en) * 2009-04-10 2012-02-09 Sang-Choul Han Apparatus and method for reproducing stereoscopic images, providing a user interface appropriate for a 3d image signal
EP2451175A1 (en) * 2010-11-03 2012-05-09 Samsung Electronics Co., Ltd. Display apparatus and method for providing graphic image
US20120229599A1 (en) * 2009-11-27 2012-09-13 Masayuki Fukuyama Video signal processing device and video signal processing method
CN102742283A (en) * 2010-02-09 2012-10-17 皇家飞利浦电子股份有限公司 3d video format detection
EP2519011A1 (en) * 2010-06-10 2012-10-31 Sony Corporation Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
US20130002656A1 (en) * 2010-01-13 2013-01-03 Thomson Licensing System and method for combining 3d text with 3d content
US20130010064A1 (en) * 2010-03-24 2013-01-10 Panasonic Corporation Video processing device
WO2013009480A1 (en) * 2011-07-13 2013-01-17 General Instrument Corporation Dual mode user interface system and method for 3d video
US20130293673A1 (en) * 2010-09-06 2013-11-07 Advanced Digital Broadcast S.A. Method and a system for determining a video frame type
US20140002593A1 (en) * 2011-03-02 2014-01-02 Huawei Technologies Co., Ltd. Method and apparatus for acquiring 3d format description information
US20140111699A1 (en) * 2012-10-18 2014-04-24 Samsung Electronics Co., Ltd. Broadcast receiving apparatus, method of controlling the same, user terminal device, and method of providing screen thereof
US9215436B2 (en) 2009-06-24 2015-12-15 Dolby Laboratories Licensing Corporation Insertion of 3D objects in a stereoscopic image at relative depth
US20160029003A1 (en) * 2010-03-05 2016-01-28 Google Technology Holdings LLC Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content
US20160353081A1 (en) * 2008-12-19 2016-12-01 Koninklijke Philips N.V. Method and device for overlaying 3d graphics over 3d video
US9519994B2 (en) 2011-04-15 2016-12-13 Dolby Laboratories Licensing Corporation Systems and methods for rendering 3D image independent of display size and viewing distance
US10164776B1 (en) 2013-03-14 2018-12-25 goTenna Inc. System and method for private and point-to-point communication between computing devices
US10433025B2 (en) * 2016-05-10 2019-10-01 Jaunt Inc. Virtual reality resource scheduling of process in a cloud-based virtual reality processing system
US11470303B1 (en) 2010-06-24 2022-10-11 Steven M. Hoffberg Two dimensional to three dimensional moving image converter

Families Citing this family (166)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
EP4336447A1 (en) 2008-05-20 2024-03-13 FotoNation Limited Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8520979B2 (en) 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
JP2010062695A (en) * 2008-09-02 2010-03-18 Sony Corp Image processing apparatus, image processing method, and program
US9269154B2 (en) * 2009-01-13 2016-02-23 Futurewei Technologies, Inc. Method and system for image processing to classify an object in an image
JP5647242B2 (en) * 2009-07-27 2014-12-24 コーニンクレッカ フィリップス エヌ ヴェ Combining 3D video and auxiliary data
KR20110013693A (en) * 2009-08-03 2011-02-10 삼성모바일디스플레이주식회사 Organic light emitting display and driving method thereof
KR101056281B1 (en) 2009-08-03 2011-08-11 삼성모바일디스플레이주식회사 Organic electroluminescent display and driving method thereof
JP5444955B2 (en) * 2009-08-31 2014-03-19 ソニー株式会社 Stereoscopic image display system, parallax conversion device, parallax conversion method, and program
US8614737B2 (en) * 2009-09-11 2013-12-24 Disney Enterprises, Inc. System and method for three-dimensional video capture workflow for dynamic rendering
US20110063298A1 (en) * 2009-09-15 2011-03-17 Samir Hulyalkar Method and system for rendering 3d graphics based on 3d display capabilities
US8988495B2 (en) * 2009-11-03 2015-03-24 Lg Eletronics Inc. Image display apparatus, method for controlling the image display apparatus, and image display system
EP2502115A4 (en) 2009-11-20 2013-11-06 Pelican Imaging Corp Capturing and processing of images using monolithic camera array with heterogeneous imagers
TWI491243B (en) * 2009-12-21 2015-07-01 Chunghwa Picture Tubes Ltd Image processing method
US8687116B2 (en) * 2010-01-14 2014-04-01 Panasonic Corporation Video output device and video display system
JP2011166666A (en) * 2010-02-15 2011-08-25 Sony Corp Image processor, image processing method, and program
KR101445777B1 (en) * 2010-02-19 2014-11-04 삼성전자 주식회사 Reproducing apparatus and control method thereof
KR20110098420A (en) * 2010-02-26 2011-09-01 삼성전자주식회사 Display device and driving method thereof
US20110216083A1 (en) * 2010-03-03 2011-09-08 Vizio, Inc. System, method and apparatus for controlling brightness of a device
US8830300B2 (en) * 2010-03-11 2014-09-09 Dolby Laboratories Licensing Corporation Multiscalar stereo video format conversion
JP2011199388A (en) * 2010-03-17 2011-10-06 Sony Corp Reproducing device, reproduction control method, and program
JP5526929B2 (en) * 2010-03-30 2014-06-18 ソニー株式会社 Image processing apparatus, image processing method, and program
SG184509A1 (en) * 2010-04-12 2012-11-29 Fortem Solutions Inc Camera projection meshes
EP2547101A4 (en) * 2010-04-14 2013-12-18 Samsung Electronics Co Ltd Method and apparatus for generating a broadcast bit stream for digital broadcasting with captions, and method and apparatus for receiving a broadcast bit stream for digital broadcasting with captions
US9237366B2 (en) * 2010-04-16 2016-01-12 Google Technology Holdings LLC Method and apparatus for distribution of 3D television program materials
KR101697184B1 (en) 2010-04-20 2017-01-17 삼성전자주식회사 Apparatus and Method for generating mesh, and apparatus and method for processing image
KR20120119927A (en) * 2010-05-11 2012-11-01 삼성전자주식회사 3-Dimension glasses and System for wireless power transmission
US20120012748A1 (en) 2010-05-12 2012-01-19 Pelican Imaging Corporation Architectures for imager arrays and array cameras
KR101082234B1 (en) * 2010-05-13 2011-11-09 삼성모바일디스플레이주식회사 Organic light emitting display device and driving method thereof
JP2011249895A (en) * 2010-05-24 2011-12-08 Panasonic Corp Signal processing system and signal processing apparatus
KR101699875B1 (en) 2010-06-03 2017-01-25 엘지디스플레이 주식회사 Apparatus and method for three- dimension liquid crystal display device
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
US8402502B2 (en) 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
US9787974B2 (en) 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US8918831B2 (en) 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
KR101645404B1 (en) 2010-07-06 2016-08-04 삼성디스플레이 주식회사 Organic Light Emitting Display
US9049426B2 (en) 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
KR101279660B1 (en) * 2010-07-07 2013-06-27 엘지디스플레이 주식회사 3d image display device and driving method thereof
US8848038B2 (en) * 2010-07-09 2014-09-30 Lg Electronics Inc. Method and device for converting 3D images
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
IT1401367B1 (en) * 2010-07-28 2013-07-18 Sisvel Technology Srl METHOD TO COMBINE REFERENCE IMAGES TO A THREE-DIMENSIONAL CONTENT.
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
JPWO2012017687A1 (en) * 2010-08-05 2013-10-03 パナソニック株式会社 Video playback device
KR101674688B1 (en) * 2010-08-12 2016-11-09 엘지전자 주식회사 A method for displaying a stereoscopic image and stereoscopic image playing device
JP2012044625A (en) * 2010-08-23 2012-03-01 Sony Corp Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
KR101218815B1 (en) * 2010-08-26 2013-01-21 주식회사 티스마트 3D user interface processing method and set-top box using the same
US8994792B2 (en) * 2010-08-27 2015-03-31 Broadcom Corporation Method and system for creating a 3D video from a monoscopic 2D video and corresponding depth information
JP5058316B2 (en) * 2010-09-03 2012-10-24 株式会社東芝 Electronic device, image processing method, and image processing program
CN103262544A (en) * 2010-09-10 2013-08-21 青岛海信电器股份有限公司 Display method and equipment for 3d tv interface
WO2012044272A1 (en) * 2010-09-29 2012-04-05 Thomson Licensing Automatically switching between three dimensional and two dimensional contents for display
JP2012094111A (en) * 2010-09-29 2012-05-17 Sony Corp Image processing device, image processing method and program
JP5543892B2 (en) * 2010-10-01 2014-07-09 日立コンシューマエレクトロニクス株式会社 REPRODUCTION DEVICE, REPRODUCTION METHOD, DISPLAY DEVICE, AND DISPLAY METHOD
CN102447959A (en) * 2010-10-01 2012-05-09 日立民用电子株式会社 Receiver
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
TWI420151B (en) * 2010-10-07 2013-12-21 Innolux Corp Display method
KR101232086B1 (en) * 2010-10-08 2013-02-08 엘지디스플레이 주식회사 Liquid crystal display and local dimming control method of thereof
US20120092327A1 (en) * 2010-10-14 2012-04-19 Sony Corporation Overlaying graphical assets onto viewing plane of 3d glasses per metadata accompanying 3d image
JP5550520B2 (en) * 2010-10-20 2014-07-16 日立コンシューマエレクトロニクス株式会社 Playback apparatus and playback method
CN102469319A (en) * 2010-11-10 2012-05-23 康佳集团股份有限公司 Three-dimensional menu generation method and three-dimensional display device
JP5789960B2 (en) * 2010-11-18 2015-10-07 セイコーエプソン株式会社 Display device, display device control method, and program
JP5786315B2 (en) * 2010-11-24 2015-09-30 セイコーエプソン株式会社 Display device, display device control method, and program
CN101980545B (en) * 2010-11-29 2012-08-01 深圳市九洲电器有限公司 Method for automatically detecting 3DTV video program format
CN101984671B (en) * 2010-11-29 2013-04-17 深圳市九洲电器有限公司 Method for synthesizing video images and interface graphs by 3DTV receiving system
US8878950B2 (en) 2010-12-14 2014-11-04 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using super-resolution processes
JP2012129845A (en) * 2010-12-16 2012-07-05 Jvc Kenwood Corp Image processing device
JP5611807B2 (en) * 2010-12-27 2014-10-22 Ｎｅｃパーソナルコンピュータ株式会社 Video display device
US8600151B2 (en) 2011-01-03 2013-12-03 Apple Inc. Producing stereoscopic image
KR101814798B1 (en) * 2011-01-26 2018-01-04 삼성전자주식회사 Apparatus for processing three dimension image and method for the same
CN102157012B (en) * 2011-03-23 2012-11-28 深圳超多维光电子有限公司 Method for three-dimensionally rendering scene, graphic image treatment device, equipment and system
KR101801141B1 (en) * 2011-04-19 2017-11-24 엘지전자 주식회사 Apparatus for displaying image and method for operating the same
KR20120119173A (en) * 2011-04-20 2012-10-30 삼성전자주식회사 3d image processing apparatus and method for adjusting three-dimensional effect thereof
JP2012231254A (en) * 2011-04-25 2012-11-22 Toshiba Corp Stereoscopic image generating apparatus and stereoscopic image generating method
KR101973822B1 (en) 2011-05-11 2019-04-29 포토네이션 케이맨 리미티드 Systems and methods for transmitting and receiving array camera image data
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
CN102231829B (en) * 2011-06-27 2014-12-17 深圳超多维光电子有限公司 Display format identification method and device of video file as well as video player
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
WO2013023325A1 (en) * 2011-08-18 2013-02-21 北京世纪高蓝科技有限公司 Method for converting 2d into 3d based on image motion information
CN103002297A (en) * 2011-09-16 2013-03-27 联咏科技股份有限公司 Method and device for generating dynamic depth values
US20130070060A1 (en) 2011-09-19 2013-03-21 Pelican Imaging Corporation Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion
US8952996B2 (en) * 2011-09-27 2015-02-10 Delta Electronics, Inc. Image display system
WO2013049699A1 (en) 2011-09-28 2013-04-04 Pelican Imaging Corporation Systems and methods for encoding and decoding light field image files
US8813109B2 (en) 2011-10-21 2014-08-19 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US8687470B2 (en) 2011-10-24 2014-04-01 Lsi Corporation Optical disk playback device with three-dimensional playback functionality
JP5289538B2 (en) * 2011-11-11 2013-09-11 株式会社東芝 Electronic device, display control method and program
CN102413350B (en) * 2011-11-30 2014-04-16 四川长虹电器股份有限公司 Method for processing blue-light 3D (three-dimensional) video
FR2983673A1 (en) * 2011-12-02 2013-06-07 Binocle CORRECTION METHOD FOR ALTERNATE PROJECTION OF STEREOSCOPIC IMAGES
EP2817955B1 (en) 2012-02-21 2018-04-11 FotoNation Cayman Limited Systems and methods for the manipulation of captured light field image data
US8479226B1 (en) * 2012-02-21 2013-07-02 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US8713590B2 (en) 2012-02-21 2014-04-29 The Nielsen Company (Us), Llc Methods and apparatus to identify exposure to 3D media presentations
US10445398B2 (en) * 2012-03-01 2019-10-15 Sony Corporation Asset management during production of media
US9315997B2 (en) 2012-04-10 2016-04-19 Dirtt Environmental Solutions, Ltd Tamper evident wall cladding system
US20150109411A1 (en) * 2012-04-26 2015-04-23 Electronics And Telecommunications Research Institute Image playback apparatus for 3dtv and method performed by the apparatus
KR20150023907A (en) 2012-06-28 2015-03-05 펠리칸 이매징 코포레이션 Systems and methods for detecting defective camera arrays, optic arrays, and sensors
US20140002674A1 (en) 2012-06-30 2014-01-02 Pelican Imaging Corporation Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors
KR102111181B1 (en) 2012-08-21 2020-05-15 포토내이션 리미티드 Systems and methods for parallax detection and correction in images captured using array cameras
US20140055632A1 (en) 2012-08-23 2014-02-27 Pelican Imaging Corporation Feature based high resolution motion estimation from low resolution images captured using an array source
KR20140039649A (en) 2012-09-24 2014-04-02 삼성전자주식회사 Multi view image generating method and multi view image display apparatus
US9143711B2 (en) 2012-11-13 2015-09-22 Pelican Imaging Corporation Systems and methods for array camera focal plane control
US20150296198A1 (en) * 2012-11-27 2015-10-15 Intellectual Discovery Co., Ltd. Method for encoding and decoding image using depth information, and device and image system using same
KR101430985B1 (en) * 2013-02-20 2014-09-18 주식회사 카몬 System and Method on Providing Multi-Dimensional Content
US9462164B2 (en) 2013-02-21 2016-10-04 Pelican Imaging Corporation Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
WO2014133974A1 (en) 2013-02-24 2014-09-04 Pelican Imaging Corporation Thin form computational and modular array cameras
WO2014138697A1 (en) 2013-03-08 2014-09-12 Pelican Imaging Corporation Systems and methods for high dynamic range imaging using array cameras
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
WO2014164909A1 (en) 2013-03-13 2014-10-09 Pelican Imaging Corporation Array camera architecture implementing quantum film sensors
US9124831B2 (en) 2013-03-13 2015-09-01 Pelican Imaging Corporation System and methods for calibration of an array camera
US9100586B2 (en) 2013-03-14 2015-08-04 Pelican Imaging Corporation Systems and methods for photometric normalization in array cameras
WO2014159779A1 (en) 2013-03-14 2014-10-02 Pelican Imaging Corporation Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
JP2016524125A (en) 2013-03-15 2016-08-12 ペリカン イメージング コーポレイション System and method for stereoscopic imaging using a camera array
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US9445003B1 (en) 2013-03-15 2016-09-13 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
CN104079941B (en) * 2013-03-27 2017-08-25 中兴通讯股份有限公司 A kind of depth information decoding method, device and Video processing playback equipment
CN104469338B (en) * 2013-09-25 2016-08-17 联想(北京)有限公司 A kind of control method and device
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US10491916B2 (en) * 2013-10-01 2019-11-26 Advanced Micro Devices, Inc. Exploiting camera depth information for video encoding
CN103543953B (en) * 2013-11-08 2017-01-04 深圳市汉普电子技术开发有限公司 The method of the 3D film source that broadcasting identifies without 3D and touch apparatus
JP2015119464A (en) * 2013-11-12 2015-06-25 セイコーエプソン株式会社 Display device and control method of the same
WO2015074078A1 (en) 2013-11-18 2015-05-21 Pelican Imaging Corporation Estimating depth from projected texture using camera arrays
WO2015081279A1 (en) 2013-11-26 2015-06-04 Pelican Imaging Corporation Array camera configurations incorporating multiple constituent array cameras
WO2015134996A1 (en) 2014-03-07 2015-09-11 Pelican Imaging Corporation System and methods for depth regularization and semiautomatic interactive matting using rgb-d images
CN104143308B (en) 2014-07-24 2016-09-07 京东方科技集团股份有限公司 The display methods of a kind of 3-D view and device
US10228751B2 (en) 2014-08-06 2019-03-12 Apple Inc. Low power mode
US9647489B2 (en) 2014-08-26 2017-05-09 Apple Inc. Brownout avoidance
EP3467776A1 (en) 2014-09-29 2019-04-10 Fotonation Cayman Limited Systems and methods for dynamic calibration of array cameras
US10708391B1 (en) 2014-09-30 2020-07-07 Apple Inc. Delivery of apps in a media stream
US10231033B1 (en) * 2014-09-30 2019-03-12 Apple Inc. Synchronizing out-of-band content with a media stream
CN105095895B (en) * 2015-04-23 2018-09-25 广州广电运通金融电子股份有限公司 Valuable file identification device self-correction recognition methods
CN105376546A (en) * 2015-11-09 2016-03-02 中科创达软件股份有限公司 2D-to-3D method, device and mobile terminal
CN105472374A (en) * 2015-11-19 2016-04-06 广州华多网络科技有限公司 3D live video realization method, apparatus, and system
US20170150137A1 (en) * 2015-11-25 2017-05-25 Atheer, Inc. Method and apparatus for selective mono/stereo visual display
US20170150138A1 (en) * 2015-11-25 2017-05-25 Atheer, Inc. Method and apparatus for selective mono/stereo visual display
CN105872519B (en) * 2016-04-13 2018-03-27 万云数码媒体有限公司 A kind of 2D plus depth 3D rendering transverse direction storage methods based on RGB compressions
CN106101681A (en) * 2016-06-21 2016-11-09 青岛海信电器股份有限公司 3-D view display processing method, signal input device and television terminal
CN106982367A (en) * 2017-03-31 2017-07-25 联想(北京)有限公司 Video transmission method and its device
US10038500B1 (en) * 2017-05-11 2018-07-31 Qualcomm Incorporated Visible light communication
US10735707B2 (en) * 2017-08-15 2020-08-04 International Business Machines Corporation Generating three-dimensional imagery
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
CN107589989A (en) * 2017-09-14 2018-01-16 晨星半导体股份有限公司 Display device and its method for displaying image based on Android platform
US10817307B1 (en) 2017-12-20 2020-10-27 Apple Inc. API behavior modification based on power source health
US11363133B1 (en) 2017-12-20 2022-06-14 Apple Inc. Battery health-based power management
EP3644604A1 (en) * 2018-10-23 2020-04-29 Koninklijke Philips N.V. Image generating apparatus and method therefor
CN109257585B (en) * 2018-10-25 2021-04-06 京东方科技集团股份有限公司 Brightness correction device and method, display device, display system and method
CN109274949A (en) * 2018-10-30 2019-01-25 京东方科技集团股份有限公司 A kind of method of video image processing and its device, display equipment
CN112188181B (en) * 2019-07-02 2023-07-04 中强光电股份有限公司 Image display device, stereoscopic image processing circuit and synchronization signal correction method thereof
DE112020004391T5 (en) 2019-09-17 2022-06-02 Boston Polarimetrics, Inc. SYSTEMS AND METHODS FOR SURFACE MODELING USING POLARIZATION FEATURES
JP2022552833A (en) 2019-10-07 2022-12-20 ボストン ポーラリメトリックス，インコーポレイティド System and method for polarized surface normal measurement
WO2021108002A1 (en) 2019-11-30 2021-06-03 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
KR102241615B1 (en) * 2020-01-15 2021-04-19 한국과학기술원 Method to identify and video titles using metadata in video webpage source code, and apparatuses performing the same
KR20220132620A (en) 2020-01-29 2022-09-30 인트린식 이노베이션 엘엘씨 Systems and methods for characterizing object pose detection and measurement systems
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
CN112004162B (en) * 2020-09-08 2022-06-21 宁波视睿迪光电有限公司 Online 3D content playing system and method
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US11770513B1 (en) * 2022-07-13 2023-09-26 Rovi Guides, Inc. Systems and methods for reducing a number of focal planes used to display three-dimensional objects

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4523226A (en) * 1982-01-27 1985-06-11 Stereographics Corporation Stereoscopic television system
US5808664A (en) * 1994-07-14 1998-09-15 Sanyo Electric Co., Ltd. Method of converting two-dimensional images into three-dimensional images
US6313866B1 (en) * 1997-09-30 2001-11-06 Kabushiki Kaisha Toshiba Three-dimensional image display apparatus
US20020009149A1 (en) * 1999-12-14 2002-01-24 Rodriguez Arturo A. System and method for adaptive video processing with coordinated resource allocation
US20030128273A1 (en) * 1998-12-10 2003-07-10 Taichi Matsui Video processing apparatus, control method therefor, and storage medium
US20030156188A1 (en) * 2002-01-28 2003-08-21 Abrams Thomas Algie Stereoscopic video
US20040218269A1 (en) * 2002-01-14 2004-11-04 Divelbiss Adam W. General purpose stereoscopic 3D format conversion system and method
US20040233215A1 (en) * 2002-03-27 2004-11-25 Dawson Thomas Patrick Graphics and video integration with alpha and video blending
US20050030301A1 (en) * 2001-12-14 2005-02-10 Ocuity Limited Control of optical switching apparatus
US20050053276A1 (en) * 2003-07-15 2005-03-10 Stmicroelectronics S.R.I. Method of obtaining a depth map from a digital image
US20050259959A1 (en) * 2004-05-19 2005-11-24 Kabushiki Kaisha Toshiba Media data play apparatus and system
US20060288081A1 (en) * 2005-05-26 2006-12-21 Samsung Electronics Co., Ltd. Information storage medium including application for obtaining metadata and apparatus and method of obtaining metadata
US20070081587A1 (en) * 2005-09-27 2007-04-12 Raveendran Vijayalakshmi R Content driven transcoder that orchestrates multimedia transcoding using content information
US20070120972A1 (en) * 2005-11-28 2007-05-31 Samsung Electronics Co., Ltd. Apparatus and method for processing 3D video signal
US20080018731A1 (en) * 2004-03-08 2008-01-24 Kazunari Era Steroscopic Parameter Embedding Apparatus and Steroscopic Image Reproducer
US20080198218A1 (en) * 2006-11-03 2008-08-21 Quanta Computer Inc. Stereoscopic image format transformation method applied to display system
US20100091012A1 (en) * 2006-09-28 2010-04-15 Koninklijke Philips Electronics N.V. 3 menu display
US20100188566A1 (en) * 2006-11-29 2010-07-29 Panasonic Corporation Video/audio signal input/output device, video/audio reproduction device, video/audio device network and signal reproducing method
US7826709B2 (en) * 2002-04-12 2010-11-02 Mitsubishi Denki Kabushiki Kaisha Metadata editing apparatus, metadata reproduction apparatus, metadata delivery apparatus, metadata search apparatus, metadata re-generation condition setting apparatus, metadata delivery method and hint information description method
US7893908B2 (en) * 2006-05-11 2011-02-22 Nec Display Solutions, Ltd. Liquid crystal display device and liquid crystal panel drive method

Family Cites Families (103)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4667228A (en) * 1983-10-14 1987-05-19 Canon Kabushiki Kaisha Image signal processing apparatus
JPS63116593A (en) * 1986-11-04 1988-05-20 Matsushita Electric Ind Co Ltd Stereoscopic picture reproducing device
US5262879A (en) * 1988-07-18 1993-11-16 Dimensional Arts. Inc. Holographic image conversion method for making a controlled holographic grating
US5058992A (en) * 1988-09-07 1991-10-22 Toppan Printing Co., Ltd. Method for producing a display with a diffraction grating pattern and a display produced by the method
JP2508387B2 (en) * 1989-10-16 1996-06-19 凸版印刷株式会社 Method of manufacturing display having diffraction grating pattern
US5291317A (en) * 1990-07-12 1994-03-01 Applied Holographics Corporation Holographic diffraction grating patterns and methods for creating the same
JP3081675B2 (en) * 1991-07-24 2000-08-28 オリンパス光学工業株式会社 Image recording device and image reproducing device
US5740274A (en) * 1991-09-12 1998-04-14 Fuji Photo Film Co., Ltd. Method for recognizing object images and learning method for neural networks
US6011581A (en) * 1992-11-16 2000-01-04 Reveo, Inc. Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
US6084978A (en) * 1993-12-16 2000-07-04 Eastman Kodak Company Hierarchical storage and display of digital images used in constructing three-dimensional image hard copy
CN1113320C (en) * 1994-02-01 2003-07-02 三洋电机株式会社 Method of converting two-dimensional images into three-dimensional images
US5739844A (en) * 1994-02-04 1998-04-14 Sanyo Electric Co. Ltd. Method of converting two-dimensional image into three-dimensional image
US5684890A (en) * 1994-02-28 1997-11-04 Nec Corporation Three-dimensional reference image segmenting method and apparatus
US6104828A (en) * 1994-03-24 2000-08-15 Kabushiki Kaisha Topcon Ophthalmologic image processor
KR100374463B1 (en) * 1994-09-22 2003-05-09 산요 덴키 가부시키가이샤 How to convert 2D image to 3D image
US6985168B2 (en) * 1994-11-14 2006-01-10 Reveo, Inc. Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
JPH09116931A (en) * 1995-10-18 1997-05-02 Sanyo Electric Co Ltd Method and identifying left and right video image for time division stereoscopic video signal
US5917940A (en) * 1996-01-23 1999-06-29 Nec Corporation Three dimensional reference image segmenting method and device and object discrimination system
JPH09322199A (en) * 1996-05-29 1997-12-12 Olympus Optical Co Ltd Stereoscopic video display device
US5986781A (en) * 1996-10-28 1999-11-16 Pacific Holographics, Inc. Apparatus and method for generating diffractive element using liquid crystal display
JPH10224822A (en) * 1997-01-31 1998-08-21 Sony Corp Video display method and display device
JPH10313417A (en) * 1997-03-12 1998-11-24 Seiko Epson Corp Digital gamma correction circuit, liquid crystal display device using the same and electronic device
DE19806547C2 (en) * 1997-04-30 2001-01-25 Hewlett Packard Co System and method for generating stereoscopic display signals from a single computer graphics pipeline
JP4698831B2 (en) * 1997-12-05 2011-06-08 ダイナミック ディジタル デプス リサーチ プロプライエタリー リミテッド Image conversion and coding technology
US6850631B1 (en) * 1998-02-20 2005-02-01 Oki Electric Industry Co., Ltd. Photographing device, iris input device and iris image input method
JP4149037B2 (en) * 1998-06-04 2008-09-10 オリンパス株式会社 Video system
JP2000298246A (en) * 1999-02-12 2000-10-24 Canon Inc Device and method for display, and storage medium
JP2000275575A (en) * 1999-03-24 2000-10-06 Sharp Corp Stereoscopic video display device
KR100334722B1 (en) * 1999-06-05 2002-05-04 강호석 Method and the apparatus for generating stereoscopic image using MPEG data
JP2001012946A (en) * 1999-06-30 2001-01-19 Toshiba Corp Dynamic image processor and processing method
US6839663B1 (en) * 1999-09-30 2005-01-04 Texas Tech University Haptic rendering of volumetric soft-bodies objects
US6968568B1 (en) * 1999-12-20 2005-11-22 International Business Machines Corporation Methods and apparatus of disseminating broadcast information to a handheld device
US20020009137A1 (en) * 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
KR100908989B1 (en) * 2000-04-04 2009-07-22 소니 가부시끼 가이샤 Stereoscopic image creation method and apparatus
JP2001320693A (en) * 2000-05-12 2001-11-16 Sony Corp Service providing device and method, reception terminal and method, service providing system
AU2001266862A1 (en) * 2000-06-12 2001-12-24 Vrex, Inc. Electronic stereoscopic media delivery system
JP3667620B2 (en) * 2000-10-16 2005-07-06 株式会社アイ・オー・データ機器 Stereo image capturing adapter, stereo image capturing camera, and stereo image processing apparatus
US6762755B2 (en) 2000-10-16 2004-07-13 Pixel Science, Inc. Method and apparatus for creating and displaying interactive three dimensional computer images
GB0100563D0 (en) * 2001-01-09 2001-02-21 Pace Micro Tech Plc Dynamic adjustment of on-screen displays to cope with different widescreen signalling types
US6678323B2 (en) * 2001-01-24 2004-01-13 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry Through Communications Research Centre Bandwidth reduction for stereoscopic imagery and video signals
KR20020096203A (en) * 2001-06-18 2002-12-31 (주)디지털국영 The Method for Enlarging or Reducing Stereoscopic Images
JP2003157292A (en) * 2001-11-20 2003-05-30 Nec Corp System and method for managing layout of product
KR100397511B1 (en) * 2001-11-21 2003-09-13 한국전자통신연구원 The processing system and it's method for the stereoscopic/multiview Video
JP2003284099A (en) * 2002-03-22 2003-10-03 Olympus Optical Co Ltd Video information signal recording medium and video display apparatus
CA2380105A1 (en) * 2002-04-09 2003-10-09 Nicholas Routhier Process and system for encoding and playback of stereoscopic video sequences
JP4652389B2 (en) * 2002-04-12 2011-03-16 三菱電機株式会社 Metadata processing method
JPWO2003092303A1 (en) * 2002-04-25 2005-09-08 シャープ株式会社 Multimedia information generating apparatus and multimedia information reproducing apparatus
JP4154569B2 (en) * 2002-07-10 2008-09-24 日本電気株式会社 Image compression / decompression device
JP4362105B2 (en) * 2002-07-16 2009-11-11 韓國電子通信研究院 Apparatus and method for adaptive conversion of 2D and 3D stereoscopic video signals
KR100488804B1 (en) * 2002-10-07 2005-05-12 한국전자통신연구원 System for data processing of 2-view 3dimention moving picture being based on MPEG-4 and method thereof
JP2004186863A (en) * 2002-12-02 2004-07-02 Amita Technology Kk Stereophoscopic vision display unit and stereophoscopic vision signal processing circuit
JP4183499B2 (en) * 2002-12-16 2008-11-19 三洋電機株式会社 Video file processing method and video processing method
JP2004246066A (en) * 2003-02-13 2004-09-02 Fujitsu Ltd Virtual environment creating method
JP2004274125A (en) * 2003-03-05 2004-09-30 Sony Corp Image processing apparatus and method
JP4677175B2 (en) * 2003-03-24 2011-04-27 シャープ株式会社 Image processing apparatus, image pickup system, image display system, image pickup display system, image processing program, and computer-readable recording medium recording image processing program
JP2004309868A (en) * 2003-04-08 2004-11-04 Sony Corp Imaging device and stereoscopic video generating device
KR100556826B1 (en) * 2003-04-17 2006-03-10 한국전자통신연구원 System and Method of Internet Broadcasting for MPEG4 based Stereoscopic Video
EP1617684A4 (en) * 2003-04-17 2009-06-03 Sharp Kk 3-dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
JP2004357156A (en) * 2003-05-30 2004-12-16 Sharp Corp Video reception apparatus and video playback apparatus
JP2005026800A (en) * 2003-06-30 2005-01-27 Konica Minolta Photo Imaging Inc Image processing method, imaging apparatus, image processing apparatus, and image recording apparatus
US7411611B2 (en) * 2003-08-25 2008-08-12 Barco N. V. Device and method for performing multiple view imaging by means of a plurality of video processing devices
EP1510940A1 (en) * 2003-08-29 2005-03-02 Sap Ag A method of providing a visualisation graph on a computer and a computer for providing a visualisation graph
US7613344B2 (en) * 2003-12-08 2009-11-03 Electronics And Telecommunications Research Institute System and method for encoding and decoding an image using bitstream map and recording medium thereof
JP2005175997A (en) * 2003-12-12 2005-06-30 Sony Corp Decoding apparatus, electronic apparatus, computer, decoding method, program, and recording medium
KR100544677B1 (en) * 2003-12-26 2006-01-23 한국전자통신연구원 Apparatus and method for the 3D object tracking using multi-view and depth cameras
JP4227076B2 (en) * 2004-05-24 2009-02-18 株式会社東芝 Display device for displaying stereoscopic image and display method for displaying stereoscopic image
KR100543219B1 (en) * 2004-05-24 2006-01-20 한국과학기술연구원 Method for generating haptic vector field and 3d-height map in 2d-image
KR100708838B1 (en) * 2004-06-30 2007-04-17 삼성에스디아이 주식회사 Stereoscopic display device and driving method thereof
JP2006041811A (en) * 2004-07-26 2006-02-09 Kddi Corp Free visual point picture streaming method
KR20040077596A (en) * 2004-07-28 2004-09-04 손귀연 Stereoscopic Image Display Device Based on Flat Panel Display
CN100573231C (en) * 2004-09-08 2009-12-23 日本电信电话株式会社 3 D displaying method, device
KR100694069B1 (en) * 2004-11-29 2007-03-12 삼성전자주식회사 Recording apparatus including plurality of data blocks of different sizes, file managing method using the same and printing apparatus including the same
KR100656575B1 (en) 2004-12-31 2006-12-11 광운대학교 산학협력단 Three-dimensional display device
TWI261099B (en) * 2005-02-17 2006-09-01 Au Optronics Corp Backlight modules
KR100828358B1 (en) * 2005-06-14 2008-05-08 삼성전자주식회사 Method and apparatus for converting display mode of video, and computer readable medium thereof
US7404645B2 (en) * 2005-06-20 2008-07-29 Digital Display Innovations, Llc Image and light source modulation for a digital display system
KR100813977B1 (en) * 2005-07-08 2008-03-14 삼성전자주식회사 High resolution 2D-3D switchable autostereoscopic display apparatus
US8384763B2 (en) * 2005-07-26 2013-02-26 Her Majesty the Queen in right of Canada as represented by the Minster of Industry, Through the Communications Research Centre Canada Generating a depth map from a two-dimensional source image for stereoscopic and multiview imaging
JP4717728B2 (en) * 2005-08-29 2011-07-06 キヤノン株式会社 Stereo display device and control method thereof
MY159176A (en) * 2005-10-19 2016-12-30 Thomson Licensing Multi-view video coding using scalable video coding
KR100793750B1 (en) * 2006-02-14 2008-01-10 엘지전자 주식회사 The display device for storing the various configuration data for displaying and the method for controlling the same
KR100780701B1 (en) 2006-03-28 2007-11-30 (주)오픈브이알 Apparatus automatically creating three dimension image and method therefore
KR20070098364A (en) * 2006-03-31 2007-10-05 (주)엔브이엘소프트 Apparatus and method for coding and saving a 3d moving image
KR101137347B1 (en) * 2006-05-11 2012-04-19 엘지전자 주식회사 apparatus for mobile telecommunication and method for displaying an image using the apparatus
US7953315B2 (en) * 2006-05-22 2011-05-31 Broadcom Corporation Adaptive video processing circuitry and player using sub-frame metadata
US20070294737A1 (en) * 2006-06-16 2007-12-20 Sbc Knowledge Ventures, L.P. Internet Protocol Television (IPTV) stream management within a home viewing network
WO2007148219A2 (en) * 2006-06-23 2007-12-27 Imax Corporation Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition
KR100761022B1 (en) * 2006-08-14 2007-09-21 광주과학기술원 Haptic rendering method based on depth image, device therefor, and haptic broadcasting system using them
KR100716142B1 (en) * 2006-09-04 2007-05-11 주식회사 이시티 Method for transferring stereoscopic image data
EP1901474B1 (en) 2006-09-13 2011-11-30 Stmicroelectronics Sa System for synchronizing modules in an integrated circuit in mesochronous clock domains
EP2105032A2 (en) * 2006-10-11 2009-09-30 Koninklijke Philips Electronics N.V. Creating three dimensional graphics data
JP4755565B2 (en) * 2006-10-17 2011-08-24 シャープ株式会社 Stereoscopic image processing device
KR101362941B1 (en) * 2006-11-01 2014-02-17 한국전자통신연구원 Method and Apparatus for decoding metadata used for playing stereoscopic contents
KR100786468B1 (en) * 2007-01-02 2007-12-17 삼성에스디아이 주식회사 2d and 3d image selectable display device
US8213711B2 (en) * 2007-04-03 2012-07-03 Her Majesty The Queen In Right Of Canada As Represented By The Minister Of Industry, Through The Communications Research Centre Canada Method and graphical user interface for modifying depth maps
US8488868B2 (en) * 2007-04-03 2013-07-16 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry, Through The Communications Research Centre Canada Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images
JP4564512B2 (en) 2007-04-16 2010-10-20 富士通株式会社 Display device, display program, and display method
KR100839429B1 (en) * 2007-04-17 2008-06-19 삼성에스디아이 주식회사 Electronic display device and the method thereof
WO2008140190A1 (en) * 2007-05-14 2008-11-20 Samsung Electronics Co, . Ltd. Method and apparatus for encoding and decoding multi-view image
JP4462288B2 (en) * 2007-05-16 2010-05-12 株式会社日立製作所 Video display device and three-dimensional video display device using the same
KR101398168B1 (en) * 2007-10-10 2014-05-22 한국전자통신연구원 Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
US20090315981A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image processing method and apparatus
WO2010048632A1 (en) * 2008-10-24 2010-04-29 Real D Stereoscopic image format with depth information

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4523226A (en) * 1982-01-27 1985-06-11 Stereographics Corporation Stereoscopic television system
US5808664A (en) * 1994-07-14 1998-09-15 Sanyo Electric Co., Ltd. Method of converting two-dimensional images into three-dimensional images
US6313866B1 (en) * 1997-09-30 2001-11-06 Kabushiki Kaisha Toshiba Three-dimensional image display apparatus
US20030128273A1 (en) * 1998-12-10 2003-07-10 Taichi Matsui Video processing apparatus, control method therefor, and storage medium
US20020009149A1 (en) * 1999-12-14 2002-01-24 Rodriguez Arturo A. System and method for adaptive video processing with coordinated resource allocation
US20050030301A1 (en) * 2001-12-14 2005-02-10 Ocuity Limited Control of optical switching apparatus
US20040218269A1 (en) * 2002-01-14 2004-11-04 Divelbiss Adam W. General purpose stereoscopic 3D format conversion system and method
US20030156188A1 (en) * 2002-01-28 2003-08-21 Abrams Thomas Algie Stereoscopic video
US20040233215A1 (en) * 2002-03-27 2004-11-25 Dawson Thomas Patrick Graphics and video integration with alpha and video blending
US7826709B2 (en) * 2002-04-12 2010-11-02 Mitsubishi Denki Kabushiki Kaisha Metadata editing apparatus, metadata reproduction apparatus, metadata delivery apparatus, metadata search apparatus, metadata re-generation condition setting apparatus, metadata delivery method and hint information description method
US20050053276A1 (en) * 2003-07-15 2005-03-10 Stmicroelectronics S.R.I. Method of obtaining a depth map from a digital image
US20080018731A1 (en) * 2004-03-08 2008-01-24 Kazunari Era Steroscopic Parameter Embedding Apparatus and Steroscopic Image Reproducer
US20050259959A1 (en) * 2004-05-19 2005-11-24 Kabushiki Kaisha Toshiba Media data play apparatus and system
US20060288081A1 (en) * 2005-05-26 2006-12-21 Samsung Electronics Co., Ltd. Information storage medium including application for obtaining metadata and apparatus and method of obtaining metadata
US20070081587A1 (en) * 2005-09-27 2007-04-12 Raveendran Vijayalakshmi R Content driven transcoder that orchestrates multimedia transcoding using content information
US20070120972A1 (en) * 2005-11-28 2007-05-31 Samsung Electronics Co., Ltd. Apparatus and method for processing 3D video signal
US7893908B2 (en) * 2006-05-11 2011-02-22 Nec Display Solutions, Ltd. Liquid crystal display device and liquid crystal panel drive method
US20100091012A1 (en) * 2006-09-28 2010-04-15 Koninklijke Philips Electronics N.V. 3 menu display
US20080198218A1 (en) * 2006-11-03 2008-08-21 Quanta Computer Inc. Stereoscopic image format transformation method applied to display system
US20100188566A1 (en) * 2006-11-29 2010-07-29 Panasonic Corporation Video/audio signal input/output device, video/audio reproduction device, video/audio device network and signal reproducing method

Cited By (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045779A1 (en) * 2008-08-20 2010-02-25 Samsung Electronics Co., Ltd. Three-dimensional video apparatus and method of providing on screen display applied thereto
US20110141236A1 (en) * 2008-09-02 2011-06-16 Hiroshi Mitani Three-dimensional video image transmission system, video image display device and video image output device
US9264690B2 (en) * 2008-09-07 2016-02-16 Dolby Laboratories Licensing Corporation Conversion of interleaved data sets, including chroma correction and/or correction of checkerboard interleaved formatted 3D images
US20110164113A1 (en) * 2008-09-07 2011-07-07 Dolby Laboratories Licensing Corporation Conversion of Interleaved Data Sets, Including Chroma Correction and/or Correction of Checkerboard Interleaved Formatted 3D Images
US20110234754A1 (en) * 2008-11-24 2011-09-29 Koninklijke Philips Electronics N.V. Combining 3d video and auxiliary data
US9253469B2 (en) * 2008-12-02 2016-02-02 Lg Electronics Inc. Method for displaying 3D caption and 3D display apparatus for implementing the same
US8599242B2 (en) * 2008-12-02 2013-12-03 Lg Electronics Inc. Method for displaying 3D caption and 3D display apparatus for implementing the same
US20140139626A1 (en) * 2008-12-02 2014-05-22 Lg Electronics Inc. Method for displaying 3d caption and 3d display apparatus for implementing the same
US8878899B2 (en) * 2008-12-02 2014-11-04 Lg Electronics Inc. Method for displaying 3D caption and 3D display apparatus for implementing the same
US20150009305A1 (en) * 2008-12-02 2015-01-08 Lg Electronics Inc. Method for displaying 3d caption and 3d display apparatus for implementing the same
US20110149036A1 (en) * 2008-12-02 2011-06-23 Jong-Yeul Suh Method for displaying 3d caption and 3d display apparatus for implementing the same
US10158841B2 (en) * 2008-12-19 2018-12-18 Koninklijke Philips N.V. Method and device for overlaying 3D graphics over 3D video
US20160353081A1 (en) * 2008-12-19 2016-12-01 Koninklijke Philips N.V. Method and device for overlaying 3d graphics over 3d video
US9918069B2 (en) * 2008-12-19 2018-03-13 Koninklijke Philips N.V. Method and device for overlaying 3D graphics over 3D video
US20120032954A1 (en) * 2009-04-10 2012-02-09 Sang-Choul Han Apparatus and method for reproducing stereoscopic images, providing a user interface appropriate for a 3d image signal
US9215436B2 (en) 2009-06-24 2015-12-15 Dolby Laboratories Licensing Corporation Insertion of 3D objects in a stereoscopic image at relative depth
WO2010151555A1 (en) * 2009-06-24 2010-12-29 Dolby Laboratories Licensing Corporation Method for embedding subtitles and/or graphic overlays in a 3d or multi-view video data
US9215435B2 (en) 2009-06-24 2015-12-15 Dolby Laboratories Licensing Corp. Method for embedding subtitles and/or graphic overlays in a 3D or multi-view video data
US9479766B2 (en) * 2009-07-10 2016-10-25 Dolby Laboratories Licensing Corporation Modifying images for a 3-dimensional display mode
US20120098943A1 (en) * 2009-07-10 2012-04-26 Dolby Laboratories Licensing Corporation Modifying Images for a 3-Dimensional Display Mode
WO2011006104A1 (en) * 2009-07-10 2011-01-13 Dolby Laboratories Licensing Corporation Modifying images for a 3-dimensional display mode
US20110018966A1 (en) * 2009-07-23 2011-01-27 Naohisa Kitazato Receiving Device, Communication System, Method of Combining Caption With Stereoscopic Image, Program, and Data Structure
US20110122949A1 (en) * 2009-11-17 2011-05-26 Sony Corporation Image transmission method, image receiving method, image transmission device, image receiving device, and image transmission system
US8867617B2 (en) * 2009-11-17 2014-10-21 Sony Corporation Image transmission method, image receiving method, image transmission device, image receiving device, and image transmission system
US20120229599A1 (en) * 2009-11-27 2012-09-13 Masayuki Fukuyama Video signal processing device and video signal processing method
US8994787B2 (en) * 2009-11-27 2015-03-31 Panasonic Intellectual Property Management Co., Ltd. Video signal processing device and video signal processing method
US20110134216A1 (en) * 2009-12-08 2011-06-09 Darren Neuman Method and system for mixing video and graphics
US20110134218A1 (en) * 2009-12-08 2011-06-09 Darren Neuman Method and system for utilizing mosaic mode to create 3d video
US9307223B2 (en) * 2009-12-08 2016-04-05 Broadcom Corporation Method and system for mixing video and graphics
US9137513B2 (en) * 2009-12-08 2015-09-15 Broadcom Corporation Method and system for mixing video and graphics
US8922622B2 (en) * 2009-12-28 2014-12-30 Sony Corporation Image processing device, image processing method, and program
US20110157307A1 (en) * 2009-12-28 2011-06-30 Toshiya Hamada Image Processing Device, Image Processing Method, and Program
US20130002656A1 (en) * 2010-01-13 2013-01-03 Thomson Licensing System and method for combining 3d text with 3d content
US20110175988A1 (en) * 2010-01-21 2011-07-21 General Instrument Corporation 3d video graphics overlay
CN102742283A (en) * 2010-02-09 2012-10-17 皇家飞利浦电子股份有限公司 3d video format detection
US20170085859A1 (en) * 2010-02-09 2017-03-23 Koninklijke Philips N.V. 3d video format detection
US9325964B2 (en) * 2010-02-09 2016-04-26 Koninklijke Philips N.V. 3D video format detection
US20120314028A1 (en) * 2010-02-09 2012-12-13 Koninklijke Philips Electronics N.V. 3d video format detection
US9729852B2 (en) * 2010-02-09 2017-08-08 Koninklijke Philips N.V. 3D video format detection
US9025933B2 (en) 2010-02-12 2015-05-05 Sony Corporation Information processing device, information processing method, playback device, playback method, program and recording medium
US20110200302A1 (en) * 2010-02-12 2011-08-18 Sony Corporation Information processing device, information processing method, playback device, playback method, program and recording medium
WO2011100488A1 (en) * 2010-02-12 2011-08-18 Sony Corporation Information processing device, information processing method, playback device, playback method, program and recording medium
WO2011102818A1 (en) * 2010-02-19 2011-08-25 Thomson Licensing Stereo logo insertion
CN102860014A (en) * 2010-02-19 2013-01-02 汤姆森特许公司 Stereo logo insertion
US9860513B2 (en) 2010-02-19 2018-01-02 Thomson Licensing Stereo logo insertion
US10560681B2 (en) 2010-02-19 2020-02-11 Interdigital Madison Patent Holdings Stereo logo insertion
WO2011105992A1 (en) * 2010-02-24 2011-09-01 Thomson Licensing Subtitling for stereoscopic images
US20160029003A1 (en) * 2010-03-05 2016-01-28 Google Technology Holdings LLC Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content
US20110216163A1 (en) * 2010-03-08 2011-09-08 Dolby Laboratories Licensing Corporation Methods For Carrying And Transmitting 3D Z-Norm Attributes In Digital TV Closed Captioning
US9426441B2 (en) 2010-03-08 2016-08-23 Dolby Laboratories Licensing Corporation Methods for carrying and transmitting 3D z-norm attributes in digital TV closed captioning
WO2011112370A1 (en) * 2010-03-12 2011-09-15 Sony Corporation Disparity data transport and signaling
US20110221862A1 (en) * 2010-03-12 2011-09-15 Mark Kenneth Eyer Disparity Data Transport and Signaling
US8817072B2 (en) 2010-03-12 2014-08-26 Sony Corporation Disparity data transport and signaling
CN102783159A (en) * 2010-03-12 2012-11-14 索尼公司 Disparity data transport and signaling
KR101295451B1 (en) 2010-03-12 2013-08-09 소니 주식회사 Disparity data transport and signaling
US9521394B2 (en) 2010-03-12 2016-12-13 Sony Corporation Disparity data transport and signaling
US20110228060A1 (en) * 2010-03-18 2011-09-22 Nariaki Yamamoto Three-dimensional video reproduction apparatus, three-dimensional video reproduction method, and integrated circuit
US8508585B2 (en) * 2010-03-18 2013-08-13 Panasonic Corporation Three-dimensional video reproduction apparatus, three-dimensional video reproduction method, and integrated circuit
US20110234585A1 (en) * 2010-03-24 2011-09-29 Samsung Electronics Co. Ltd. Method and apparatus for processing 3d images in mobile terminal
US20130010064A1 (en) * 2010-03-24 2013-01-10 Panasonic Corporation Video processing device
WO2011130094A1 (en) * 2010-04-16 2011-10-20 The Directv Group, Inc. Method and apparatus for presenting on-screen graphics in a frame-compatible 3d format
US9414042B2 (en) * 2010-05-05 2016-08-09 Google Technology Holdings LLC Program guide graphics and video in window for 3DTV
US11317075B2 (en) * 2010-05-05 2022-04-26 Google Technology Holdings LLC Program guide graphics and video in window for 3DTV
US20110273534A1 (en) * 2010-05-05 2011-11-10 General Instrument Corporation Program Guide Graphics and Video in Window for 3DTV
US20160330426A1 (en) * 2010-05-05 2016-11-10 Google Technology Holdings LLC Program guide graphics and video in window for 3dtv
US20110292038A1 (en) * 2010-05-27 2011-12-01 Sony Computer Entertainment America, LLC 3d video conversion
CN102884801A (en) * 2010-06-10 2013-01-16 索尼公司 Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
EP2519011A4 (en) * 2010-06-10 2013-09-04 Sony Corp Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
EP2519011A1 (en) * 2010-06-10 2012-10-31 Sony Corporation Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device and stereoscopic image data reception method
US11470303B1 (en) 2010-06-24 2022-10-11 Steven M. Hoffberg Two dimensional to three dimensional moving image converter
CN102316346A (en) * 2010-07-07 2012-01-11 索尼公司 Image data transmitting apparatus and method, receiving equipment and method and system
AU2011202792A8 (en) * 2010-07-07 2015-08-27 Sony Corporation Image data transmission apparatus, image data transmission method, image data reception apparatus, image data reception method, and image data transmission and reception system
EP2405666A3 (en) * 2010-07-07 2013-08-07 Sony Corporation Display of superimposing information in 3D system
US10819974B2 (en) 2010-07-07 2020-10-27 Saturn Licensing Llc Image data transmission apparatus, image data transmission method, image data reception apparatus, image data reception method, and image data transmission and reception system
AU2011202792B2 (en) * 2010-07-07 2015-08-13 Sony Corporation Image data transmission apparatus, image data transmission method, image data reception apparatus, image data reception method, and image data transmission and reception system
CN102316346B (en) * 2010-07-07 2015-10-21 索尼公司 Image data transmitting apparatus and method, receiving equipment and method and system
US20130293673A1 (en) * 2010-09-06 2013-11-07 Advanced Digital Broadcast S.A. Method and a system for determining a video frame type
EP2451175A1 (en) * 2010-11-03 2012-05-09 Samsung Electronics Co., Ltd. Display apparatus and method for providing graphic image
US20140002593A1 (en) * 2011-03-02 2014-01-02 Huawei Technologies Co., Ltd. Method and apparatus for acquiring 3d format description information
US9519994B2 (en) 2011-04-15 2016-12-13 Dolby Laboratories Licensing Corporation Systems and methods for rendering 3D image independent of display size and viewing distance
US9979947B2 (en) 2011-07-13 2018-05-22 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
WO2013009480A1 (en) * 2011-07-13 2013-01-17 General Instrument Corporation Dual mode user interface system and method for 3d video
US10638110B2 (en) 2011-07-13 2020-04-28 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
US11064179B2 (en) 2011-07-13 2021-07-13 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
US9294752B2 (en) 2011-07-13 2016-03-22 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
US9258509B2 (en) * 2012-10-18 2016-02-09 Samsung Electronics Co., Ltd. Broadcast receiving apparatus, method of controlling the same, user terminal device, and method of providing screen thereof
US20140111699A1 (en) * 2012-10-18 2014-04-24 Samsung Electronics Co., Ltd. Broadcast receiving apparatus, method of controlling the same, user terminal device, and method of providing screen thereof
US10164776B1 (en) 2013-03-14 2018-12-25 goTenna Inc. System and method for private and point-to-point communication between computing devices
US10433025B2 (en) * 2016-05-10 2019-10-01 Jaunt Inc. Virtual reality resource scheduling of process in a cloud-based virtual reality processing system
US11051081B2 (en) 2016-05-10 2021-06-29 Verizon Patent And Licensing Inc. Virtual reality resource scheduling of processes in a cloud-based virtual reality processing system

Also Published As

Publication number Publication date
JP2011525743A (en) 2011-09-22
US20090315884A1 (en) 2009-12-24
WO2009157668A2 (en) 2009-12-30
KR20100002035A (en) 2010-01-06
KR20100002049A (en) 2010-01-06
US20100104219A1 (en) 2010-04-29
WO2009157701A2 (en) 2009-12-30
WO2009157708A3 (en) 2010-04-15
EP2289247A4 (en) 2014-05-28
CN102077600A (en) 2011-05-25
JP2011525746A (en) 2011-09-22
US20090315977A1 (en) 2009-12-24
KR20100002037A (en) 2010-01-06
KR20100002036A (en) 2010-01-06
EP2289248A4 (en) 2014-07-02
WO2009157701A3 (en) 2010-04-15
JP5547725B2 (en) 2014-07-16
KR20100002033A (en) 2010-01-06
CN102067614B (en) 2014-06-11
KR20100002031A (en) 2010-01-06
KR20100002032A (en) 2010-01-06
KR101539935B1 (en) 2015-07-28
CN102067613B (en) 2016-04-13
MY159672A (en) 2017-01-13
WO2009157708A2 (en) 2009-12-30
KR20100002048A (en) 2010-01-06
WO2009157714A3 (en) 2010-03-25
WO2009157668A3 (en) 2010-03-25
KR20100002038A (en) 2010-01-06
EP2279625A2 (en) 2011-02-02
US20100103168A1 (en) 2010-04-29
EP2279625A4 (en) 2013-07-03
EP2289247A2 (en) 2011-03-02
CN102067615A (en) 2011-05-18
US8488869B2 (en) 2013-07-16
CN102067613A (en) 2011-05-18
EP2292019A2 (en) 2011-03-09
CN102067615B (en) 2015-02-25
CN102067614A (en) 2011-05-18
JP2011526103A (en) 2011-09-29
US20090317061A1 (en) 2009-12-24
JP2011525745A (en) 2011-09-22
EP2292019A4 (en) 2014-04-30
WO2009157714A2 (en) 2009-12-30
EP2289248A2 (en) 2011-03-02

Similar Documents

Publication Publication Date Title
US20090315979A1 (en) Method and apparatus for processing 3d video image
US10158841B2 (en) Method and device for overlaying 3D graphics over 3D video
JP5407957B2 (en) Stereoscopic image data transmitting apparatus and stereoscopic image data receiving apparatus
JP5407968B2 (en) Stereoscopic image data transmitting apparatus and stereoscopic image data receiving apparatus
JP5402715B2 (en) Stereo image data transmitting apparatus, stereo image data transmitting method, stereo image data receiving apparatus, and stereo image data receiving method
US20130127990A1 (en) Video processing apparatus for generating video output satisfying display capability of display device according to video input and related method thereof
KR20110113186A (en) Method and system for transmitting over a video interface and for compositing 3d video and 3d overlays
TW201103311A (en) Transferring of 3D image data
US20100103165A1 (en) Image decoding method, image outputting method, and image decoding and outputting apparatuses
TW201119348A (en) Transferring of 3D image data
KR102008818B1 (en) Digital broadcast signal processing method and device
EP2615835A2 (en) Method and apparatus for processing video image
KR20130129212A (en) Device and method for receiving digital broadcast signal
JP2011249945A (en) Stereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device, and stereoscopic image data reception method
TWI587682B (en) Interlaced 3d video
JP5390016B2 (en) Video processing device
WO2012029293A1 (en) Video processing device, video processing method, computer program and delivery method
JP5390017B2 (en) Video processing device
JP2012120142A (en) Stereoscopic image data transmission device, stereoscopic image data transmission method, and stereoscopic image data reception device
JP5375490B2 (en) Transmitting apparatus, receiving apparatus, communication system, and program
JP5568404B2 (en) Video display system and playback device
WO2012160812A1 (en) Image processing device, transmitting device, stereoscopic image viewing system, image processing method, image processing program and integrated circuit
JP2012039337A (en) Video display system and playback device
EA040953B1 (en) DEVICE AND METHOD FOR PROCESSING THREE-DIMENSIONAL (3D) VIDEO INFORMATION

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JUNG, KIL-SOO;CHUNG, HYUN-KWON;LEE, DAE-JONG;REEL/FRAME:022876/0180

Effective date: 20090622

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION