US20040143789A1 - Information storage medium including device-aspect-ratio information, method and apparatus therefor - Google Patents

Information storage medium including device-aspect-ratio information, method and apparatus therefor Download PDF

Info

Publication number
US20040143789A1
US20040143789A1 US10/685,708 US68570803A US2004143789A1 US 20040143789 A1 US20040143789 A1 US 20040143789A1 US 68570803 A US68570803 A US 68570803A US 2004143789 A1 US2004143789 A1 US 2004143789A1
Authority
US
United States
Prior art keywords
picture
markup
information
markup document
ratio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/685,708
Inventor
Hyun-kwon Chung
Sung-wook Park
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020030060246A external-priority patent/KR100565061B1/en
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHUNG, HYUN-KWON, PARK, SUNG-WOOK
Publication of US20040143789A1 publication Critical patent/US20040143789A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/775Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/84Television signal recording using optical recording
    • H04N5/85Television signal recording using optical recording on discs or drums

Definitions

  • the present invention relates to an information storage medium including device-aspect-ratio information of a markup document, and a method and apparatus to play back audio and video (AV) data in an interactive mode using the markup document.
  • AV audio and video
  • markup documents are written in a markup language such as a hypertext markup language (HTML) or the like.
  • the markup documents may be recorded on or played back from, for example, digital versatile discs (DVDS) via a personal computer (PC).
  • DVDs are being sold in the market.
  • an interactive DVD supports an interactive mode to show markup-document-based AV contents.
  • contents recorded on the interactive DVD can be played back in two modes.
  • One of the two modes is a video mode in which contents are displayed as from that of a general DVD.
  • the other mode is an interactive mode in which contents are displayed via a display window defined by a markup document.
  • a web browser in a PC displays a markup document recorded on an interactive DVD, and a display window defined by the markup document displays the contents selected by the user.
  • an AV picture is obtained from AV data and a markup picture is obtained from a markup document.
  • the AV picture may be embedded in the markup picture to display an interactive picture in an interactive mode.
  • the AV data-made movie may be shown in an AV picture, and various types of additional information such as scripts, stories, photos of actresses or actors, or the like may be displayed in a markup picture.
  • the additional information may include a variety of resource files such as image files, text files, animation files, and the like.
  • FIGS. 1A, 1B, 1 C, and 1 D show types of pictures displayed on a display device during a playback from a conventional DVD.
  • FIG. 1A shows a picture having an aspect ratio of 4:3.
  • FIG. 1B shows a 4:3 letter box picture with blanks marked with slanted lines appearing in upper and lower portions thereof, where a 16:9 source picture is displayed on a 4:3 screen of the display device.
  • FIG. 1C shows a 4:3 pan-scan picture to overcome the disadvantage of a size reduction of actual contents in the 4:3 letter box picture. In other words, relatively unimportant side portions of the 16:9 source picture are cut out to display the remaining source picture as a 4:3 picture.
  • FIG. 1D shows a 16:9 picture.
  • an interactive picture is fixedly displayed as one of the pictures of FIGS. 1A, 1B, 1 C, and 1 D.
  • a markup document recorded on an interactive DVD is displayed on a display device having a screen with an aspect ratio that is not fit for the markup document, a portion of data in a markup picture, such as texts, graphics, or the like, may be distorted.
  • FIGS. 2A and 2B illustrate a case where a markup document made as a 16:9 source picture is distortedly displayed in a 4:3 letter box picture.
  • FIG. 2A illustrates a 16:9 source picture displayed on a 16:9 screen
  • FIG. 2B illustrate a case where the 16:9 source picture is displayed as the 4:3 letter box picture.
  • the size of an AV picture is reduced, whereas a markup picture containing texts, graphics or the like written in a HTML is displayed as is. Accordingly, a portion of the texts, graphics or the like may overlap blank portions of the 4:3 letter box picture and may not be shown to a user.
  • an aspect of the present invention to provide an information storage medium including device-aspect-ratio information of a markup document, and a method and apparatus to display an interactive picture using the device-aspect-ratio information.
  • an information storage medium comprising video data and a markup document to play back the video data in an interactive mode, wherein the markup document includes device-aspect-ratio information which is referred to display the markup document.
  • the device-aspect-ratio information may be information on an aspect ratio of a target display device intended to display the markup document in the interactive mode.
  • the device-aspect-ratio information may be provided according to a design of a markup document maker.
  • the device-aspect-ratio information may be instruction information to transform a source markup picture into a markup picture with a predetermined aspect ratio, the source markup picture being obtained from the markup document.
  • a method of displaying an interactive picture using a markup document and audio video (AV) data comprising obtaining device-aspect-ratio information corresponding to the markup document, obtaining a markup picture from the markup document according to the device-aspect-ratio information, obtaining an AV picture from the AV data, and displaying the interactive picture including combining the AV picture and the markup picture.
  • AV audio video
  • the device-aspect-ratio information may be included in the markup document.
  • the obtaining of the device-aspect-ratio information may comprise reading information on an aspect ratio of a target display device intended to display the markup document in an interactive mode.
  • the obtaining of the device-aspect-ratio information may comprise parsing device-aspect-ratio information which is written in the markup document using a property of a tag.
  • the obtaining of the markup picture may comprise transforming a source markup picture into the markup picture with a predetermined aspect ratio according to the device-aspect-ratio information, the source markup picture being obtained from the markup document.
  • the obtaining of the markup picture may comprise scaling a source markup picture to output the markup picture corresponding to the device-aspect-ratio information in response to information on an aspect ratio of a destination device being different from the device-aspect-ratio information, the destination device substantially displaying the markup document.
  • a method of processing a markup document in an interactive mode comprising determining whether device-aspect-ratio information is included in the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode, and processing the markup document according to the device-aspect-ratio information in response to the device-aspect-ratio information being included in the markup document.
  • the processing of the markup document may comprise transforming a source markup picture obtained from the markup document according to the device-aspect-ratio information in response to information on an aspect ratio of a destination device displaying the markup document being different from the device-aspect-ratio information, and outputting the source markup picture as is in response to the information on the aspect ratio of the destination device corresponding to the device-aspect-ratio information.
  • a method of processing a source markup picture of a markup document and a source audio video (AV) picture of an AV data in an interactive mode comprising obtaining AV picture type selection information, determining whether device-aspect-ratio information is included in the markup document, transforming the source AV picture according to the AV picture type selection information and outputting the source markup picture as is in response to the device-aspect-ratio information not being included in the markup document, and transforming the source AV picture and the source markup picture according to the AV picture type selection information and the device-aspect-ratio information, respectively, in response to the device-aspect-ratio information being included in the markup document.
  • an apparatus which processes audio and video (AV) data in an interactive mode using a markup document, comprising an AV playback engine and an enhanced audio and video (ENAV) engine.
  • the AV playback engine decodes the AV data to output an AV picture.
  • the ENAV engine interprets the markup document to obtain a source markup picture, transforms the source markup picture into a markup picture, combines the markup picture and the AV picture, and outputs an interactive picture including the markup picture and the AV picture.
  • the ENAV engine may read device-aspect-ratio information included in the markup document and obtain the markup picture according to the device-aspect-ratio information.
  • the ENAV engine may obtain device-aspect-ratio information which is information on an aspect ratio of a screen of a target display device intended to display the markup document in the interactive mode.
  • the ENAV engine may parse device-aspect-ratio information which is written in the markup document using a property of a tag.
  • the ENAV engine may transform the source markup picture into the markup picture with a predetermined aspect ratio according to device-aspect-ratio information of the markup document.
  • an apparatus for processing a markup document in an interactive mode comprising a controller to output a markup picture of the markup document and a video picture of an audio video data in the interactive mode, and a markup transformer which transforms the markup picture according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document.
  • the markup transformer may scale the markup picture according to the device-aspect-ratio information in response to information on an aspect ratio of a destination device displaying the markup document being different from the device-aspect-ratio information and output markup picture as is in response to the information on the aspect ratio of the destination device corresponding to the device-aspect-ratio information.
  • a computer readable medium encoded with operating instructions for implementing a method of displaying an interactive picture using a markup document and audio video (AV) data, performed by a computer, the method comprising obtaining device-aspect-ratio information corresponding to the markup document, obtaining a markup picture from the markup document according to the device-aspect-ratio information, obtaining an AV picture from the AV data, and displaying the interactive picture including combining the AV picture and the markup picture.
  • AV audio video
  • a computer readable medium encoded with operating instructions for implementing a method of processing a markup document in an interactive mode, performed by a computer, the method comprising determining whether device-aspect-ratio information is included in the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode, and processing the markup document according to the device-aspect-ratio information in response to the device-aspect-ratio information being included in the markup document.
  • a method in a computer system to process audio video (AV) data in an interactive mode using a markup document comprising controlling an AV playback engine to obtain a video picture of the AV data, and controlling an enhanced audio and video (ENAV) engine to transform a markup picture of the markup document according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode.
  • AV audio video
  • ENAV enhanced audio and video
  • FIGS. 1A, 1B, 1 C, and 1 D are views showing types of pictures displayed on a display device during a playback from a conventional interactive DVD;
  • FIG. 2A is a view showing a markup document made as a 16:9 source picture
  • FIG. 2B is a view showing a case where the markup document of FIG. 2A is distortedly displayed as a 4:3 letter box picture;
  • FIG. 3 is a view of a playback system according to an embodiment of the present invention.
  • FIG. 4 is a block diagram illustrating a volume space of a disc 100 of FIG. 3;
  • FIG. 5 is a root chart illustrating a directory structure of the disc 100 , according to an embodiment of the present invention.
  • FIG. 6 is a block diagram of a playback device 200 of FIG. 3;
  • FIG. 7 is a detailed block diagram of an AV playback engine 2 and an enhanced AV (ENAV) engine 3 of FIG. 6;
  • FIG. 8 is a block diagram illustrating an operation of a markup transformer 31 of FIG. 7;
  • FIG. 9 is a flowchart illustrating a method of transforming a source markup picture according to device-aspect-ratio information, according to an embodiment of the present invention.
  • FIG. 10 is a flowchart illustrating a method of transforming a source markup picture and a source video picture, according to an embodiment of the present invention.
  • a “markup document” is data recorded to support an interactive mode.
  • the markup document refers to, for example, a markup document written in a markup language and/or script codes, script code files and program files linked to the markup document or additionally provided, and resource files such as audio files, animation files, image files, or the like linked to and displayed with the markup document.
  • the markup document serves as an application program necessary to play back AV data in an interactive mode and as additional contents provided with the AV data.
  • FIG. 3 shows a playback system according to an embodiment of the present invention.
  • the playback system includes a playback device 200 , a display device, for example, a television (TV) monitor 300 , and a remote controller 400 .
  • the remote controller 400 may serve as a user input device.
  • An information storage medium for example, a disc 100 , supports an interactive mode.
  • the information storage medium comprises a markup document including device-aspect-ratio information. The device-aspect-ratio information is used to display the markup document.
  • the remote controller 400 receives a control command from a user and transmits the control command to the playback device 200 .
  • the playback device 200 plays back AV data recorded on the disc 100 in an interactive mode. That is, where the disc 100 is loaded into a DVD drive and the user selects the interactive mode, the playback device 200 plays back the AV data from the disc 100 and transmits the AV data to the TV monitor 300 .
  • the TV monitor 300 displays an AV picture obtained from the AV data, along with a markup picture obtained from a markup document.
  • An “interactive picture” refers to a combination of the AV picture and the markup picture.
  • An “interactive mode” refers to a mode in which an AV picture is displayed in a display window defined by a markup document.
  • the interactive mode refers to a mode in which an AV picture is embedded in a markup picture to be displayed as an interactive picture.
  • the AV picture refers to DVD-Video data which is recorded on the disc 100 , played back by the playback device 200 , and displayed on the TV monitor 300 .
  • the markup picture refers to a markup document which is recorded on the disc 100 , interpreted and executed by the playback device 200 , and displayed on the TV monitor 300 .
  • a “video mode” refers to a mode in which AV data is played back according to DVD-Video standards.
  • the video mode refers to a mode in which only an AV picture obtained from playback of AV data is displayed.
  • the playback device 200 supports both the interactive mode and the video mode, and may obtain AV data and/or interactive data via a network, for example, the Internet.
  • the playback device 200 outputs the markup picture as is or transforms the markup picture according to device-aspect-ratio information of the markup document.
  • the device-aspect-ratio information refers to information on an aspect ratio of a display device intended to display the markup document in an interactive mode.
  • a picture prior to being transformed is referred to as a source markup picture and/or a source AV picture, and a transformed or non-transformed picture being finally shown to the user may be referred to as a markup picture and/or an AV picture.
  • the playback device 200 checks an aspect ratio of a destination device, i.e., an actual aspect ratio of the TV monitor 300 , and even though the actual aspect ratio of the TV monitor 300 is different from the device-aspect-ratio information in the markup document, the playback device 200 scales and outputs the markup picture so as to fit/correspond to the device-aspect-ratio information.
  • an aspect ratio of a destination device i.e., an actual aspect ratio of the TV monitor 300
  • the playback device 200 scales and outputs the markup picture so as to fit/correspond to the device-aspect-ratio information.
  • the markup document includes device-aspect-ratio information corresponding to 16:9.
  • the markup document is displayed as is.
  • the source markup picture is transformed according to the device-aspect-ratio information corresponding to 16:9 to be fitted into the actual display of 4:3.
  • the user may set display information in the playback device 200 via the remote controller 400 or an on-screen-display (OSD) menu.
  • the display information includes AV picture type selection information to select a type of an AV picture to be shown to the user in the video mode or the interactive mode.
  • displayable types of pictures include a 4:3 picture, a 16:9 picture, a 4:3 letter box picture, and a 4:3 pan-scan picture.
  • FIG. 4 shows a volume space of the disc 100 of FIG. 3, according to an embodiment of the present invention.
  • the volume space includes a volume and file structure area, a DVD-Video data area, an interactive data area, and an other-data area.
  • Information on volume and file is recorded in the volume and file structure area, and AV data, for example, video titles, recorded in a DVD-Video format is included in the DVD-Video data area.
  • the interactive data area includes markup document files to support the interactive mode.
  • the DVD-Video data area may further include control information VIDEO_TS.IFO to control a playback of a total set of video titles recorded on the disc 100 , control information VTS — 01 — 0.IFO to control a playback of a first set of video titles, and AV data VTS — 01 — 0.VOB, VTS — 01 — 1.VOB, . . . , and VTS — 01_n.VOB.
  • the AV data VTS — 01 — 0.VOB, VTS — 01_.VOB, . . . , and VTS — 01_n.VOB refer to the video titles, i.e., video objects VOB.
  • Each of the vide objects VOB includes a video object unit VOBU in which a navigation pack, a video pack, and an audio pack are packed.
  • the detailed structure of the video objects VOB is described in a DVD-Video standard (DVD-Video for Read Only Memory Disc 1.0).
  • the interactive data area stores a plurality of markup document files.
  • the interactive data area stores a startup file which is read first in response to the interactive mode being selected, a markup document corresponding to a selected video title, and the like.
  • markup document files refer to markup documents, script code files, program files, style sheets to define styles of the markup documents, and resource files such as audio files, animation files, image files, and so forth to be linked to and displayed with the markup documents.
  • FIG. 5 shows a directory structure of the disc 100 , according to an embodiment of the present invention.
  • a root directory includes a DVD-Video directory VIDEO_TS, and an ENAV directory DVD-ENAV in which interactive data is recorded to support the interactive mode. While not explained in detail, the root directory may further include other directories and other files.
  • the DVD-Video directory VIDEO_TS stores the control information (VIDEO_TS.IFO and VTS — 01 — 0.IFO), the AV data (VTS — 01 — 0.VOB, VTS — 01 — 1.VOB, . . . , and VTS — 01_n.VOB), and the like.
  • the ENAV directory DVD_ENAV stores a startup file (STARTUP.MLS), other ENAV files, and the like.
  • FIG. 6 shows the playback device 200 of FIG. 3 according to an embodiment of the present invention.
  • the playback device 200 includes a reader 1 , an AV playback engine 2 , and an ENAV engine 3 .
  • the reader 1 reads the AV data, i.e., the DVD-Video data and the markup documents, from the disc 100 according to a control signal output from the ENAV engine 3 .
  • the AV playback engine 2 plays back the read AV data.
  • the AV playback engine 2 can be realized as a DVD-Video playback engine which plays back the DVD-Video data.
  • the AV playback engine 2 transforms an AV picture with reference to the AV picture type selection information set in the playback device 200 .
  • the ENAV engine 3 interprets and executes the markup documents to play back the DVD-Video data recorded on the disc 100 in the interactive mode.
  • the ENAV engine 3 also blends and outputs the DVD-Video data stream from the AV playback engine 2 and the interpreted markup documents.
  • the TV monitor 300 then displays a markup picture in which the AV picture is embedded.
  • the ENAV engine 3 may include various plug-ins that assist to open files of various formats included in or linked to the markup documents.
  • the ENAV engine 3 can call a Windows Media Player to play back AV data which can be displayed only in the Windows Media Player.
  • the ENAV engine 3 can also be connected to a network to fetch necessary information such as ENAV files or the like.
  • the ENAV engine 3 reads the device-aspect-ratio information in the markup document, and transforms a source markup picture or outputs the source markup picture as is, with reference to the device-aspect-ratio information.
  • the ENAV engine 3 checks the actual aspect ratio of the TV monitor 300 , i.e., destination-aspect-ratio information, and where the device-aspect-ratio information is different from the destination-aspect-ratio information, the ENAV engine 3 scales and outputs the markup picture so as to correspond to the device-aspect-ratio information.
  • the AV playback engine 2 communicates with the ENAV engine 3 via an Application Program Interface (API). For example, the AV playback engine 2 responds to a request of the ENAV engine 3 , informs the ENAV engine 3 of its status, and sends a “trigger” to the ENAV engine 3 . For example, where a war scene of the movie Star Wars is displayed in an AV picture in an interactive mode, the ENAV engine 3 is informed by the trigger before and after the displaying of the war scene that a quiz corresponding to the war scene should be displayed in the interactive picture.
  • API Application Program Interface
  • FIG. 7 shows the AV playback engine 2 and the ENAV engine 3 of FIG. 6 according to an embodiment of the present invention.
  • the AV playback engine 2 includes a video transformer 21
  • the ENAV engine 3 includes a markup transformer 31 and a video position and picture size controller 32 .
  • the name of a source video picture derives from a feature in that only video data, except audio data, is perceived via the visual organ of the user.
  • the user can substantially view the source video picture as an AV picture.
  • a source sub-picture is obtained from sub-picture data.
  • the sub-picture data is defined according to DVD-Video standards.
  • a source markup picture is obtained from the markup document.
  • the video transformer 21 transforms the source video picture into a video picture according to the AV picture type selection information set by the user. Where the source video picture fits/corresponds to the AV picture type selection information, the video transformer 21 may output the source video picture as is. Here, the source video picture is obtained by decoding the AV data. The source sub-picture is added to the video picture.
  • the markup transformer 31 transforms the source markup picture into a markup picture according to the device-aspect-ratio information of the markup document. Where the device-aspect ration information corresponds to the destination-aspect-ratio information, the video transformer 31 may output the source markup picture as is. Where the device-aspect-ratio information is different from the destination-aspect-ratio information, the markup transformer 31 scales the source markup picture and outputs the markup picture based on the device-aspect-ratio information.
  • the video position and picture size controller 32 combines the markup picture and the video picture to output the interactive picture.
  • the video position and picture size controller 32 adjusts the position and size of the AV picture with reference to instruction information to embed the AV picture in the markup picture.
  • the instruction information is recorded in the markup document and provides instructions as to the position and size of a video to be displayed.
  • FIG. 8 shows an operation of the markup transformer 31 of FIG. 7 according to an embodiment of the present invention.
  • the markup transformer 31 transforms the source markup picture into a markup picture with an aspect ratio of 4:3 or 16:9 with reference to the device-aspect-ratio information in the markup document.
  • the markup transformer 31 transforms the source markup picture into a markup picture with an aspect ratio 16:9 or 4:3 with reference to the device-aspect-ratio information.
  • the markup transformer 31 scales the source markup picture and outputs a markup picture fit for the device-aspect-ratio information.
  • the markup transformer 31 may operate as follows. Where a markup document includes device-aspect ratio information for a 4:3 ratio, and a destination display device, for example, the TV monitor 300 , is a 4:3 TV monitor, a source markup picture is output as is. Where the destination display device is not a 4:3 TV monitor, instead for example, is a 16:9 TV monitor, the source markup picture is scaled, so output of it may have a 4:3 aspect ratio on the TV monitor.
  • a markup document includes device-aspect-ratio information for a 16:9 ratio
  • a destination display device for example, the TV monitor 300
  • a source markup picture is output as is.
  • the destination display device is not a 16:9 TV monitor, instead for example, is a 4:3 TV monitor
  • the source markup picture may be scaled, so output of it may have a 16:9 aspect ratio on the TV monitor, for example, in a letter-boxed output setup.
  • FIG. 9 illustrates a method of transforming a source markup picture, according to an embodiment of the present invention.
  • the ENAV engine 3 parses a markup document.
  • the ENAV engine 3 determines whether device-aspect-ratio information is written in the markup document. Where the device-aspect-ratio information is written in the markup document, the ENAV engine 3 transforms a source markup picture into a markup picture with an aspect ratio corresponding to the device-aspect-ratio information in operation 903 .
  • FIG. 10 illustrates a method of transforming a source markup picture and a source video picture, according to another embodiment of the present invention.
  • the playback device 200 reads AV picture type selection information of display information set by, for example, a user.
  • the playback device 200 searches a markup document for device-aspect-ratio information.
  • the playback device 200 determines whether the device-aspect-ratio information is written in the markup document. Where the device-aspect-ratio information is written in the markup document, the playback device 200 transforms an source AV picture and a source markup picture based on the AV picture type selection information and the device-aspect-ratio information in operation 1004 . Where the device-aspect-ratio information is not written in the markup document, the playback device 200 transforms only the source AV picture based on the AV picture type selection information and outputs the source markup picture as is, in operation 1005
  • an interactive picture may be displayed according to a design of a content maker by writing information on an aspect ratio of a target display device in a markup document.
  • the playback device 200 may display a markup document according to the resolution information provided by the design of the content maker.
  • information on an aspect ratio of a screen of a target display device can be written in a markup document.
  • a source markup picture can be transformed into a markup picture with reference to the information.
  • an interactive picture including a markup document is displayed in an interactive mode according to a design of a content maker without being distorted in position and size.
  • a display device has been described with respect to a TV monitor, and an information storage medium has been described with respect to a DVD, it is understood that the present invention is not limited thereto.
  • other storage media known or to be known may comprise a markup document including device-aspect-ratio information, within the scope of the present invention.
  • a display system has been described with respect to a playback device, it is understood that the present invention is applicable to, for example, a system having a playback device which reproduces and/or records data with respect to an information storage medium.
  • a system which uses the present invention also includes permanent or removable storage, such as magnetic and optical discs, RAM, ROM, a carrier wave medium, etc., on which the process and data structures of the present invention can be stored and distributed.
  • the operations can also be distributed via, for example, downloading over a network such as the Internet.

Abstract

An information storage medium includes video data and a markup document to play back the video data in an interactive mode. The markup document includes device-aspect-ratio information which is referred to for displaying of the markup document.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims the benefit of Korean Patent Application Nos. 2002-63632, 2002-69592, and 2003-60246, filed on Oct. 17, 2002, Nov. 11, 2002, and Aug. 29, 2003, respectively, in the Korean Intellectual Property Office, the disclosures of which are incorporated herein by reference. [0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The present invention relates to an information storage medium including device-aspect-ratio information of a markup document, and a method and apparatus to play back audio and video (AV) data in an interactive mode using the markup document. [0003]
  • 2. Description of the Related Art [0004]
  • Generally, markup documents are written in a markup language such as a hypertext markup language (HTML) or the like. The markup documents may be recorded on or played back from, for example, digital versatile discs (DVDS) via a personal computer (PC). Such DVDs are being sold in the market. Among these DVDs, an interactive DVD supports an interactive mode to show markup-document-based AV contents. Typically, contents recorded on the interactive DVD can be played back in two modes. One of the two modes is a video mode in which contents are displayed as from that of a general DVD. The other mode is an interactive mode in which contents are displayed via a display window defined by a markup document. For example, where a user selects an interactive mode, a web browser in a PC displays a markup document recorded on an interactive DVD, and a display window defined by the markup document displays the contents selected by the user. In other words, an AV picture is obtained from AV data and a markup picture is obtained from a markup document. The AV picture may be embedded in the markup picture to display an interactive picture in an interactive mode. [0005]
  • For example, where contents correspond to an AV data-made movie, the AV data-made movie may be shown in an AV picture, and various types of additional information such as scripts, stories, photos of actresses or actors, or the like may be displayed in a markup picture. The additional information may include a variety of resource files such as image files, text files, animation files, and the like. [0006]
  • FIGS. 1A, 1B, [0007] 1C, and 1D show types of pictures displayed on a display device during a playback from a conventional DVD. In particular, FIG. 1A shows a picture having an aspect ratio of 4:3. FIG. 1B shows a 4:3 letter box picture with blanks marked with slanted lines appearing in upper and lower portions thereof, where a 16:9 source picture is displayed on a 4:3 screen of the display device. FIG. 1C shows a 4:3 pan-scan picture to overcome the disadvantage of a size reduction of actual contents in the 4:3 letter box picture. In other words, relatively unimportant side portions of the 16:9 source picture are cut out to display the remaining source picture as a 4:3 picture. That is, only a portion of the source picture is shown to a user as the 4:3 letter box picture, while the cut portions are not shown to the user. The quality of the 4:3 pan-scan picture is dependent on how portions to be cut are determined, i.e., the user's skill. FIG. 1D shows a 16:9 picture.
  • In the conventional art, an interactive picture is fixedly displayed as one of the pictures of FIGS. 1A, 1B, [0008] 1C, and 1D. In this case, where a markup document recorded on an interactive DVD is displayed on a display device having a screen with an aspect ratio that is not fit for the markup document, a portion of data in a markup picture, such as texts, graphics, or the like, may be distorted.
  • FIGS. 2A and 2B illustrate a case where a markup document made as a 16:9 source picture is distortedly displayed in a 4:3 letter box picture. FIG. 2A illustrates a 16:9 source picture displayed on a 16:9 screen, and FIG. 2B illustrate a case where the 16:9 source picture is displayed as the 4:3 letter box picture. As shown in FIG. 2B, the size of an AV picture is reduced, whereas a markup picture containing texts, graphics or the like written in a HTML is displayed as is. Accordingly, a portion of the texts, graphics or the like may overlap blank portions of the 4:3 letter box picture and may not be shown to a user. [0009]
  • SUMMARY OF THE INVENTION
  • Accordingly, it is an aspect of the present invention to provide an information storage medium including device-aspect-ratio information of a markup document, and a method and apparatus to display an interactive picture using the device-aspect-ratio information. [0010]
  • Additional aspects and/or advantages of the present invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention. [0011]
  • To achieve the above and/or other aspects of the present invention, there is provided an information storage medium comprising video data and a markup document to play back the video data in an interactive mode, wherein the markup document includes device-aspect-ratio information which is referred to display the markup document. [0012]
  • The device-aspect-ratio information may be information on an aspect ratio of a target display device intended to display the markup document in the interactive mode. The device-aspect-ratio information may be provided according to a design of a markup document maker. [0013]
  • The device-aspect-ratio information may be instruction information to transform a source markup picture into a markup picture with a predetermined aspect ratio, the source markup picture being obtained from the markup document. [0014]
  • To achieve the above and/or other aspects of the present invention, there is provided a method of displaying an interactive picture using a markup document and audio video (AV) data, the method comprising obtaining device-aspect-ratio information corresponding to the markup document, obtaining a markup picture from the markup document according to the device-aspect-ratio information, obtaining an AV picture from the AV data, and displaying the interactive picture including combining the AV picture and the markup picture. [0015]
  • The device-aspect-ratio information may be included in the markup document. [0016]
  • The obtaining of the device-aspect-ratio information may comprise reading information on an aspect ratio of a target display device intended to display the markup document in an interactive mode. [0017]
  • The obtaining of the device-aspect-ratio information may comprise parsing device-aspect-ratio information which is written in the markup document using a property of a tag. [0018]
  • The obtaining of the markup picture may comprise transforming a source markup picture into the markup picture with a predetermined aspect ratio according to the device-aspect-ratio information, the source markup picture being obtained from the markup document. [0019]
  • The obtaining of the markup picture may comprise scaling a source markup picture to output the markup picture corresponding to the device-aspect-ratio information in response to information on an aspect ratio of a destination device being different from the device-aspect-ratio information, the destination device substantially displaying the markup document. [0020]
  • To achieve the above and/or other aspects of the present invention, there is provided a method of processing a markup document in an interactive mode, the method comprising determining whether device-aspect-ratio information is included in the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode, and processing the markup document according to the device-aspect-ratio information in response to the device-aspect-ratio information being included in the markup document. [0021]
  • The processing of the markup document may comprise transforming a source markup picture obtained from the markup document according to the device-aspect-ratio information in response to information on an aspect ratio of a destination device displaying the markup document being different from the device-aspect-ratio information, and outputting the source markup picture as is in response to the information on the aspect ratio of the destination device corresponding to the device-aspect-ratio information. [0022]
  • To achieve the above and/or other aspects of the present invention, there is provided a method of processing a source markup picture of a markup document and a source audio video (AV) picture of an AV data in an interactive mode, the method comprising obtaining AV picture type selection information, determining whether device-aspect-ratio information is included in the markup document, transforming the source AV picture according to the AV picture type selection information and outputting the source markup picture as is in response to the device-aspect-ratio information not being included in the markup document, and transforming the source AV picture and the source markup picture according to the AV picture type selection information and the device-aspect-ratio information, respectively, in response to the device-aspect-ratio information being included in the markup document. [0023]
  • To achieve the above and/or other aspects of the present invention, there is provided an apparatus which processes audio and video (AV) data in an interactive mode using a markup document, comprising an AV playback engine and an enhanced audio and video (ENAV) engine. The AV playback engine decodes the AV data to output an AV picture. The ENAV engine interprets the markup document to obtain a source markup picture, transforms the source markup picture into a markup picture, combines the markup picture and the AV picture, and outputs an interactive picture including the markup picture and the AV picture. [0024]
  • The ENAV engine may read device-aspect-ratio information included in the markup document and obtain the markup picture according to the device-aspect-ratio information. [0025]
  • The ENAV engine may obtain device-aspect-ratio information which is information on an aspect ratio of a screen of a target display device intended to display the markup document in the interactive mode. [0026]
  • The ENAV engine may parse device-aspect-ratio information which is written in the markup document using a property of a tag. [0027]
  • The ENAV engine may transform the source markup picture into the markup picture with a predetermined aspect ratio according to device-aspect-ratio information of the markup document. [0028]
  • To achieve the above and/or other aspects of the present invention, there is provided an apparatus for processing a markup document in an interactive mode, comprising a controller to output a markup picture of the markup document and a video picture of an audio video data in the interactive mode, and a markup transformer which transforms the markup picture according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document. [0029]
  • The markup transformer may scale the markup picture according to the device-aspect-ratio information in response to information on an aspect ratio of a destination device displaying the markup document being different from the device-aspect-ratio information and output markup picture as is in response to the information on the aspect ratio of the destination device corresponding to the device-aspect-ratio information. [0030]
  • To achieve the above and/or other aspects of the present invention, there is provided a computer readable medium encoded with operating instructions for implementing a method of displaying an interactive picture using a markup document and audio video (AV) data, performed by a computer, the method comprising obtaining device-aspect-ratio information corresponding to the markup document, obtaining a markup picture from the markup document according to the device-aspect-ratio information, obtaining an AV picture from the AV data, and displaying the interactive picture including combining the AV picture and the markup picture. [0031]
  • To achieve the above and/or other aspects of the present invention, there is provided a computer readable medium encoded with operating instructions for implementing a method of processing a markup document in an interactive mode, performed by a computer, the method comprising determining whether device-aspect-ratio information is included in the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode, and processing the markup document according to the device-aspect-ratio information in response to the device-aspect-ratio information being included in the markup document. [0032]
  • To achieve the above and/or other aspects of the present invention, there is provided a method in a computer system to process audio video (AV) data in an interactive mode using a markup document, the method comprising controlling an AV playback engine to obtain a video picture of the AV data, and controlling an enhanced audio and video (ENAV) engine to transform a markup picture of the markup document according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document in the interactive mode.[0033]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the aspects of the present invention, taken in conjunction with the accompanying drawings of which: [0034]
  • FIGS. 1A, 1B, [0035] 1C, and 1D are views showing types of pictures displayed on a display device during a playback from a conventional interactive DVD;
  • FIG. 2A is a view showing a markup document made as a 16:9 source picture; [0036]
  • FIG. 2B is a view showing a case where the markup document of FIG. 2A is distortedly displayed as a 4:3 letter box picture; [0037]
  • FIG. 3 is a view of a playback system according to an embodiment of the present invention; [0038]
  • FIG. 4 is a block diagram illustrating a volume space of a [0039] disc 100 of FIG. 3;
  • FIG. 5 is a root chart illustrating a directory structure of the [0040] disc 100, according to an embodiment of the present invention;
  • FIG. 6 is a block diagram of a [0041] playback device 200 of FIG. 3;
  • FIG. 7 is a detailed block diagram of an [0042] AV playback engine 2 and an enhanced AV (ENAV) engine 3 of FIG. 6;
  • FIG. 8 is a block diagram illustrating an operation of a [0043] markup transformer 31 of FIG. 7;
  • FIG. 9 is a flowchart illustrating a method of transforming a source markup picture according to device-aspect-ratio information, according to an embodiment of the present invention; and [0044]
  • FIG. 10 is a flowchart illustrating a method of transforming a source markup picture and a source video picture, according to an embodiment of the present invention.[0045]
  • DETAILED DESCRIPTION OF THE INVENTION
  • Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. The embodiments are described below in order to explain the present invention by referring to the figures. [0046]
  • A “markup document” is data recorded to support an interactive mode. The markup document refers to, for example, a markup document written in a markup language and/or script codes, script code files and program files linked to the markup document or additionally provided, and resource files such as audio files, animation files, image files, or the like linked to and displayed with the markup document. In other words, the markup document serves as an application program necessary to play back AV data in an interactive mode and as additional contents provided with the AV data. [0047]
  • FIG. 3 shows a playback system according to an embodiment of the present invention. The playback system includes a [0048] playback device 200, a display device, for example, a television (TV) monitor 300, and a remote controller 400. The remote controller 400 may serve as a user input device. An information storage medium, for example, a disc 100, supports an interactive mode. According to an embodiment of the present invention, the information storage medium comprises a markup document including device-aspect-ratio information. The device-aspect-ratio information is used to display the markup document.
  • The [0049] remote controller 400 receives a control command from a user and transmits the control command to the playback device 200. The playback device 200 plays back AV data recorded on the disc 100 in an interactive mode. That is, where the disc 100 is loaded into a DVD drive and the user selects the interactive mode, the playback device 200 plays back the AV data from the disc 100 and transmits the AV data to the TV monitor 300. The TV monitor 300 displays an AV picture obtained from the AV data, along with a markup picture obtained from a markup document. An “interactive picture” refers to a combination of the AV picture and the markup picture.
  • An “interactive mode” refers to a mode in which an AV picture is displayed in a display window defined by a markup document. In other words, the interactive mode refers to a mode in which an AV picture is embedded in a markup picture to be displayed as an interactive picture. Here, the AV picture refers to DVD-Video data which is recorded on the [0050] disc 100, played back by the playback device 200, and displayed on the TV monitor 300. The markup picture refers to a markup document which is recorded on the disc 100, interpreted and executed by the playback device 200, and displayed on the TV monitor 300. A “video mode” refers to a mode in which AV data is played back according to DVD-Video standards. In other words, the video mode refers to a mode in which only an AV picture obtained from playback of AV data is displayed. According to an embodiment of the present invention, the playback device 200 supports both the interactive mode and the video mode, and may obtain AV data and/or interactive data via a network, for example, the Internet.
  • The [0051] playback device 200 outputs the markup picture as is or transforms the markup picture according to device-aspect-ratio information of the markup document. For example, the device-aspect-ratio information refers to information on an aspect ratio of a display device intended to display the markup document in an interactive mode. A picture prior to being transformed is referred to as a source markup picture and/or a source AV picture, and a transformed or non-transformed picture being finally shown to the user may be referred to as a markup picture and/or an AV picture. According to an aspect of the present invention, the playback device 200 checks an aspect ratio of a destination device, i.e., an actual aspect ratio of the TV monitor 300, and even though the actual aspect ratio of the TV monitor 300 is different from the device-aspect-ratio information in the markup document, the playback device 200 scales and outputs the markup picture so as to fit/correspond to the device-aspect-ratio information.
  • According to an embodiment of the present invention, where a source markup picture is intended to be displayed in a display device having an aspect ratio of 16:9, according to, for example, a design of a markup document content maker, the markup document includes device-aspect-ratio information corresponding to 16:9. In this case, where an actual display device has an actual aspect ratio of 16:9, the markup document is displayed as is. Where the actual display device has an actual aspect ratio of, for example, 4:3, the source markup picture is transformed according to the device-aspect-ratio information corresponding to 16:9 to be fitted into the actual display of 4:3. [0052]
  • The user may set display information in the [0053] playback device 200 via the remote controller 400 or an on-screen-display (OSD) menu. The display information includes AV picture type selection information to select a type of an AV picture to be shown to the user in the video mode or the interactive mode. In the present embodiment, displayable types of pictures include a 4:3 picture, a 16:9 picture, a 4:3 letter box picture, and a 4:3 pan-scan picture.
  • FIG. 4 shows a volume space of the [0054] disc 100 of FIG. 3, according to an embodiment of the present invention. The volume space includes a volume and file structure area, a DVD-Video data area, an interactive data area, and an other-data area. Information on volume and file is recorded in the volume and file structure area, and AV data, for example, video titles, recorded in a DVD-Video format is included in the DVD-Video data area. The interactive data area includes markup document files to support the interactive mode.
  • The DVD-Video data area may further include control information VIDEO_TS.IFO to control a playback of a total set of video titles recorded on the [0055] disc 100, control information VTS010.IFO to control a playback of a first set of video titles, and AV data VTS010.VOB, VTS011.VOB, . . . , and VTS01_n.VOB. The AV data VTS010.VOB, VTS01_.VOB, . . . , and VTS01_n.VOB refer to the video titles, i.e., video objects VOB. Each of the vide objects VOB includes a video object unit VOBU in which a navigation pack, a video pack, and an audio pack are packed. The detailed structure of the video objects VOB is described in a DVD-Video standard (DVD-Video for Read Only Memory Disc 1.0).
  • The interactive data area stores a plurality of markup document files. In other words, the interactive data area stores a startup file which is read first in response to the interactive mode being selected, a markup document corresponding to a selected video title, and the like. [0056]
  • As described above, according to an aspect of the present invention, interactive data is written in a plurality of markup document files. As previously described, the markup document files refer to markup documents, script code files, program files, style sheets to define styles of the markup documents, and resource files such as audio files, animation files, image files, and so forth to be linked to and displayed with the markup documents. [0057]
  • FIG. 5 shows a directory structure of the [0058] disc 100, according to an embodiment of the present invention. Referring to FIG. 5, a root directory includes a DVD-Video directory VIDEO_TS, and an ENAV directory DVD-ENAV in which interactive data is recorded to support the interactive mode. While not explained in detail, the root directory may further include other directories and other files.
  • The DVD-Video directory VIDEO_TS stores the control information (VIDEO_TS.IFO and VTS[0059] 010.IFO), the AV data (VTS010.VOB, VTS011.VOB, . . . , and VTS01_n.VOB), and the like. The ENAV directory DVD_ENAV stores a startup file (STARTUP.MLS), other ENAV files, and the like.
  • FIG. 6 shows the [0060] playback device 200 of FIG. 3 according to an embodiment of the present invention. The playback device 200 includes a reader 1, an AV playback engine 2, and an ENAV engine 3. The reader 1 reads the AV data, i.e., the DVD-Video data and the markup documents, from the disc 100 according to a control signal output from the ENAV engine 3.
  • The [0061] AV playback engine 2 plays back the read AV data. According to an embodiment of the present embodiment, where the AV data is recorded as the DVD-Video data, the AV playback engine 2 can be realized as a DVD-Video playback engine which plays back the DVD-Video data. In particular, the AV playback engine 2 transforms an AV picture with reference to the AV picture type selection information set in the playback device 200.
  • The [0062] ENAV engine 3 interprets and executes the markup documents to play back the DVD-Video data recorded on the disc 100 in the interactive mode. The ENAV engine 3 also blends and outputs the DVD-Video data stream from the AV playback engine 2 and the interpreted markup documents. The TV monitor 300 then displays a markup picture in which the AV picture is embedded. While not shown, the ENAV engine 3 may include various plug-ins that assist to open files of various formats included in or linked to the markup documents. For example, the ENAV engine 3 can call a Windows Media Player to play back AV data which can be displayed only in the Windows Media Player. The ENAV engine 3 can also be connected to a network to fetch necessary information such as ENAV files or the like.
  • In particular, the [0063] ENAV engine 3 reads the device-aspect-ratio information in the markup document, and transforms a source markup picture or outputs the source markup picture as is, with reference to the device-aspect-ratio information. The ENAV engine 3 checks the actual aspect ratio of the TV monitor 300, i.e., destination-aspect-ratio information, and where the device-aspect-ratio information is different from the destination-aspect-ratio information, the ENAV engine 3 scales and outputs the markup picture so as to correspond to the device-aspect-ratio information.
  • The [0064] AV playback engine 2 communicates with the ENAV engine 3 via an Application Program Interface (API). For example, the AV playback engine 2 responds to a request of the ENAV engine 3, informs the ENAV engine 3 of its status, and sends a “trigger” to the ENAV engine 3. For example, where a war scene of the movie Star Wars is displayed in an AV picture in an interactive mode, the ENAV engine 3 is informed by the trigger before and after the displaying of the war scene that a quiz corresponding to the war scene should be displayed in the interactive picture.
  • FIG. 7 shows the [0065] AV playback engine 2 and the ENAV engine 3 of FIG. 6 according to an embodiment of the present invention. The AV playback engine 2 includes a video transformer 21, and the ENAV engine 3 includes a markup transformer 31 and a video position and picture size controller 32.
  • The name of a source video picture derives from a feature in that only video data, except audio data, is perceived via the visual organ of the user. The user can substantially view the source video picture as an AV picture. A source sub-picture is obtained from sub-picture data. The sub-picture data is defined according to DVD-Video standards. A source markup picture is obtained from the markup document. [0066]
  • The [0067] video transformer 21 transforms the source video picture into a video picture according to the AV picture type selection information set by the user. Where the source video picture fits/corresponds to the AV picture type selection information, the video transformer 21 may output the source video picture as is. Here, the source video picture is obtained by decoding the AV data. The source sub-picture is added to the video picture.
  • The [0068] markup transformer 31 transforms the source markup picture into a markup picture according to the device-aspect-ratio information of the markup document. Where the device-aspect ration information corresponds to the destination-aspect-ratio information, the video transformer 31 may output the source markup picture as is. Where the device-aspect-ratio information is different from the destination-aspect-ratio information, the markup transformer 31 scales the source markup picture and outputs the markup picture based on the device-aspect-ratio information.
  • The video position and [0069] picture size controller 32 combines the markup picture and the video picture to output the interactive picture. In particular, the video position and picture size controller 32 adjusts the position and size of the AV picture with reference to instruction information to embed the AV picture in the markup picture. For example, the instruction information is recorded in the markup document and provides instructions as to the position and size of a video to be displayed.
  • FIG. 8 shows an operation of the [0070] markup transformer 31 of FIG. 7 according to an embodiment of the present invention. Referring to FIG. 8, where the source markup picture has an aspect ratio of 1:1, the markup transformer 31 transforms the source markup picture into a markup picture with an aspect ratio of 4:3 or 16:9 with reference to the device-aspect-ratio information in the markup document. Where the source markup picture has an aspect ratio of 4:3 or 16:9, the markup transformer 31 transforms the source markup picture into a markup picture with an aspect ratio 16:9 or 4:3 with reference to the device-aspect-ratio information.
  • Where the device-aspect-ratio information is different from the destination-aspect-ratio information, the [0071] markup transformer 31 scales the source markup picture and outputs a markup picture fit for the device-aspect-ratio information.
  • According to an embodiment of the present invention, the [0072] markup transformer 31 may operate as follows. Where a markup document includes device-aspect ratio information for a 4:3 ratio, and a destination display device, for example, the TV monitor 300, is a 4:3 TV monitor, a source markup picture is output as is. Where the destination display device is not a 4:3 TV monitor, instead for example, is a 16:9 TV monitor, the source markup picture is scaled, so output of it may have a 4:3 aspect ratio on the TV monitor.
  • According to another embodiment of the present invention, where a markup document includes device-aspect-ratio information for a 16:9 ratio, and a destination display device, for example, the [0073] TV monitor 300, is a 16:9 TV monitor, a source markup picture is output as is. Where, the destination display device is not a 16:9 TV monitor, instead for example, is a 4:3 TV monitor, the source markup picture may be scaled, so output of it may have a 16:9 aspect ratio on the TV monitor, for example, in a letter-boxed output setup.
  • In the present embodiment, while a display device, for example, the [0074] TV monitor 300, is described with respect to an aspect ratio of 4:3 or 16:9 and that the device-aspect-ratio information in the markup document targets on a display device with an aspect ratio of 4:3 or 16:9, it is understood that an aspect ratio may vary. Accordingly, the present invention is not limited with respect to the above-described aspect ratios, and is applicable to other aspect ratios without departing from the spirit and scope of the present invention.
  • FIG. 9 illustrates a method of transforming a source markup picture, according to an embodiment of the present invention. In [0075] operation 901, the ENAV engine 3 parses a markup document. In operation 902, the ENAV engine 3 determines whether device-aspect-ratio information is written in the markup document. Where the device-aspect-ratio information is written in the markup document, the ENAV engine 3 transforms a source markup picture into a markup picture with an aspect ratio corresponding to the device-aspect-ratio information in operation 903.
  • FIG. 10 illustrates a method of transforming a source markup picture and a source video picture, according to another embodiment of the present invention. In [0076] operation 1001, the playback device 200 reads AV picture type selection information of display information set by, for example, a user. In operation 1002, the playback device 200 searches a markup document for device-aspect-ratio information. In operation 1003, the playback device 200 determines whether the device-aspect-ratio information is written in the markup document. Where the device-aspect-ratio information is written in the markup document, the playback device 200 transforms an source AV picture and a source markup picture based on the AV picture type selection information and the device-aspect-ratio information in operation 1004. Where the device-aspect-ratio information is not written in the markup document, the playback device 200 transforms only the source AV picture based on the AV picture type selection information and outputs the source markup picture as is, in operation 1005
  • An example of a markup document including device-aspect-ratio information is shown below. [0077]
    <?xml version=“1.0” encoding=“UTF-8”?>
    <!DOCTYPE html PUBLIC -//DVD/DTD XHTML DVD-HTML1.0//EN”
    “http://www.dvdforum.org/enav/dvdhtml-1-0.dtd”>
    <html>
    <head>
    <title>4x3 PAGE </title>
    <meta name=“bestlook” content=“4:3” />
    <script language=“ecmascript”>
    <![CDATA[
    function onload_handler ( )
    {
    idplayer.play( );
    idplayer.enableVideoTransform(0);
    // if 0, disable video transformation, while if 1, enable video transformation.
    }
    ]]>
    </script>
    </head>
    <body id=“ docbody” onload=“onload_handler ( )”>
    <object style=“ position: absolute; left: 150px; top: 100px; width: 370px; height: 250px”
    data=“dvd:video_ts” id=“idplayer” />
    </body>
    </html>
  • As shown in the above example, the device-aspect-ratio information is inserted into the markup document using a tag <meta name=“bestlook” content=“aspect ratio”>. As in the above example, an interactive picture may be displayed according to a design of a content maker by writing information on an aspect ratio of a target display device in a markup document. [0078]
  • Another example of the markup document including the device-aspect-ratio information is shown below. [0079]
    <?xml version=“1.0” encoding=“UTF-8”?>
    <!DOCTYPE html PUBLIC -//DVD/DTD XHTML DVD-HTML1.0//EN”
    “http://www.dvdforum.org/enav/dvdhtml-1-0.dtd”>
    <html>
    <head>
    <title>4x3 PAGE </title>
    <meta name=“bestlook” content=“R720×480,A4×3” />
    <script language=“ecmascript”>
    <![CDATA[
    function onload_handler ( )
    {
    idplayer.play( );
    idplayer.enableVideoTransform(0);
    // if 0, disable first video transformation, while if 1, enable first video transformation.
    }
    ]]>
    </script>
    </head>
    <body id=“ docbody” onload=“onload_handler ( )”>
    <object style=“ position: absolute; left: 150px; top: 100px; width: 370px; height: 250px”
    data=“dvd:video_ts” id=“idplayer” />
    </body>
    </html>
  • As shown in the above example, according to an embodiment of the present invention, in addition to the device-aspect-ratio information, resolution information is inserted into the markup document using a tag <meta name=“bestlook” content=“Rresolution, Aaspect ratio”>. In this case, the [0080] playback device 200 may display a markup document according to the resolution information provided by the design of the content maker.
  • As described above, according to the present invention, information on an aspect ratio of a screen of a target display device can be written in a markup document. A source markup picture can be transformed into a markup picture with reference to the information. [0081]
  • According to an aspect of the present invention, an interactive picture including a markup document is displayed in an interactive mode according to a design of a content maker without being distorted in position and size. [0082]
  • While a display device has been described with respect to a TV monitor, and an information storage medium has been described with respect to a DVD, it is understood that the present invention is not limited thereto. For example, other storage media known or to be known may comprise a markup document including device-aspect-ratio information, within the scope of the present invention. Furthermore, while a display system has been described with respect to a playback device, it is understood that the present invention is applicable to, for example, a system having a playback device which reproduces and/or records data with respect to an information storage medium. [0083]
  • It is understood that a system which uses the present invention also includes permanent or removable storage, such as magnetic and optical discs, RAM, ROM, a carrier wave medium, etc., on which the process and data structures of the present invention can be stored and distributed. The operations can also be distributed via, for example, downloading over a network such as the Internet. [0084]
  • Although a few embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents. [0085]

Claims (9)

What is claimed is:
1. An information storage medium comprising:
Audio and/or video data; and
a markup document to play the audio and/or video data in an interactive mode, wherein:
the markup document includes device-aspect-ratio information, and
the device-aspect-ratio information is referenced to display the markup document.
2. The information storage medium of claim 1, wherein the device-aspect-ratio information is information on an aspect ratio of a target display device intended to display the markup document in the interactive mode.
3. The information storage medium of claim 1, wherein the device-aspect-ratio information is information on an aspect ratio of a target display device intended to display the markup document in the interactive mode according to a design of a markup document maker.
4. The information storage medium of claim 1, wherein the device-aspect-ratio information is written in the markup document using a property of a tag.
5. The information storage medium of claim 1, wherein the markup document further includes information on a resolution of the markup document.
6. The information storage medium of claim 5, wherein the device-aspect-ratio information and the resolution information are written in the markup document using a property of a tag.
7. The information storage medium of claim 1, wherein the device-aspect-ratio information is instruction information to transform a source markup picture into a markup picture with a predetermined aspect ratio, the source markup picture being obtained from the markup document.
8. The information storage medium of claim 1, wherein the device-aspect-ratio information is instruction information to transform a source markup picture into a markup picture with an aspect ratio of 4:3 or 16:9, the source markup picture being obtained from the markup document.
9. The information storage medium of claim 1, wherein:
the markup document further includes embedding information, and
the embedding information is referenced to embed the video data with respect to the markup document in the interactive mode.
US10/685,708 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor Abandoned US20040143789A1 (en)

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
KR2002-63632 2002-10-17
KR20020063632 2002-10-17
KR20020069592 2002-11-11
KR2002-69592 2002-11-11
KR2003-60246 2003-08-29
KR1020030060246A KR100565061B1 (en) 2002-10-17 2003-08-29 Information storage medium containing device-aspect-ratio information, method and apparatus therefor
KR2003-60547 2003-08-30
KR1020030060547A KR100584567B1 (en) 2002-10-17 2003-08-30 Information storage medium containing device-aspect-ratio information
KR1020030060546A KR100584566B1 (en) 2002-10-17 2003-08-30 Method for generating AV data in interactive mode by using markup document containing device-aspect-ratio information
KR2003-60546 2003-08-30

Publications (1)

Publication Number Publication Date
US20040143789A1 true US20040143789A1 (en) 2004-07-22

Family

ID=36121703

Family Applications (3)

Application Number Title Priority Date Filing Date
US10/685,708 Abandoned US20040143789A1 (en) 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor
US10/685,702 Abandoned US20040141717A1 (en) 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor
US10/685,701 Expired - Fee Related US7784073B2 (en) 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor

Family Applications After (2)

Application Number Title Priority Date Filing Date
US10/685,702 Abandoned US20040141717A1 (en) 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor
US10/685,701 Expired - Fee Related US7784073B2 (en) 2002-10-17 2003-10-16 Information storage medium including device-aspect-ratio information, method and apparatus therefor

Country Status (11)

Country Link
US (3) US20040143789A1 (en)
EP (1) EP1552516A4 (en)
JP (1) JP4988200B2 (en)
AU (1) AU2003269546A1 (en)
BR (1) BR0315004A (en)
CA (1) CA2498882A1 (en)
MX (1) MXPA05003945A (en)
PL (1) PL377692A1 (en)
RU (1) RU2323486C2 (en)
TW (1) TWI221261B (en)
WO (1) WO2004036575A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080034295A1 (en) * 2006-08-04 2008-02-07 Kulas Charles J Displaying tags associated with items in a video playback
US20090019491A1 (en) * 2006-08-04 2009-01-15 Kulas Charles J Moving video tags outside of a video area to create a menu system
US11743537B2 (en) 2006-08-04 2023-08-29 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100424481B1 (en) 2000-06-24 2004-03-22 엘지전자 주식회사 Apparatus and method for recording and reproducing a digital broadcasting service information on optical medium
KR100910972B1 (en) 2002-12-07 2009-08-05 엘지전자 주식회사 Method for controling a playback in interactive optical disc player
AU2003282439A1 (en) * 2002-11-27 2004-06-18 Samsung Electronics Co., Ltd. Apparatus and method for reproducing interactive contents by controlling font according to aspect ratio conversion
KR100920654B1 (en) 2002-12-09 2009-10-09 엘지전자 주식회사 Method for controling a playback in interactive optical disc player
KR100930353B1 (en) 2003-03-06 2009-12-08 엘지전자 주식회사 How to handle connection request of disc player
EP1924992A4 (en) * 2005-08-22 2010-04-07 Lg Electronics Inc Apparatus for reproducing data, method thereof, apparatus for recording the same, method thereof and recording medium
KR20080038221A (en) * 2005-08-22 2008-05-02 엘지전자 주식회사 Recording medium, method and apparatus for reproducing data, and method and apparatus for recording data
US20080065980A1 (en) * 2006-09-08 2008-03-13 Opera Software Asa Modifying a markup language document which includes a clickable image
US7814412B2 (en) * 2007-01-05 2010-10-12 Microsoft Corporation Incrementally updating and formatting HD-DVD markup
US9009661B2 (en) 2008-12-18 2015-04-14 Adobe Systems Incorporated Platform sensitive application characteristics
US9009662B2 (en) * 2008-12-18 2015-04-14 Adobe Systems Incorporated Platform sensitive application characteristics
US20130262989A1 (en) * 2012-03-30 2013-10-03 Samsung Electronics Co., Ltd. Method of preserving tags for edited content
WO2014069920A1 (en) 2012-11-01 2014-05-08 Samsung Electronics Co., Ltd. Recording medium, reproducing device for providing service based on data of recording medium, and method thereof
CN114143588B (en) * 2020-09-03 2023-06-06 华为技术有限公司 Playing control method and electronic equipment

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5897644A (en) * 1996-09-25 1999-04-27 Sun Microsystems, Inc. Methods and apparatus for fixed canvas presentations detecting canvas specifications including aspect ratio specifications within HTML data streams
US5907659A (en) * 1996-05-09 1999-05-25 Matsushita Electric Industrial Co., Ltd. Optical disc for which a sub-picture can be favorably superimposed on a main image, and a disc reproduction apparatus and a disc reproduction method for the disc
US5982445A (en) * 1996-10-21 1999-11-09 General Instrument Corporation Hypertext markup language protocol for television display and control
US6141693A (en) * 1996-06-03 2000-10-31 Webtv Networks, Inc. Method and apparatus for extracting digital data from a video stream and using the digital data to configure the video stream for display on a television set
US20020057286A1 (en) * 2000-08-25 2002-05-16 Markel Steven O. Device independent video enhancement scripting language
US20020069411A1 (en) * 1999-12-09 2002-06-06 Liberate Technologies, Morecom Division, Inc. Enhanced display of world wide web pages on television
US20020106191A1 (en) * 2001-01-05 2002-08-08 Vm Labs, Inc. Systems and methods for creating a video montage from titles on a digital video disk
US20020126142A1 (en) * 2001-03-10 2002-09-12 Pace Micro Technology Plc. Video display resizing
US6681395B1 (en) * 1998-03-20 2004-01-20 Matsushita Electric Industrial Company, Ltd. Template set for generating a hypertext for displaying a program guide and subscriber terminal with EPG function using such set broadcast from headend
US6973619B1 (en) * 1998-06-30 2005-12-06 International Business Machines Corporation Method for generating display control information and computer
US7346920B2 (en) * 2000-07-07 2008-03-18 Sonic Solutions, A California Corporation System, method and article of manufacture for a common cross platform framework for development of DVD-Video content integrated with ROM content

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US106191A (en) * 1870-08-09 Fire-place heater
JPH10108143A (en) * 1996-09-27 1998-04-24 Sony Corp Image display controller and its method
US6195692B1 (en) * 1997-06-02 2001-02-27 Sony Corporation Television/internet system having multiple data stream connections
US6263344B1 (en) * 1997-09-18 2001-07-17 Bo Wu Method and apparatus for processing hypertext objects on optical disc players
US7178106B2 (en) * 1999-04-21 2007-02-13 Sonic Solutions, A California Corporation Presentation of media content from multiple media sources
EP1312214A2 (en) * 2000-08-21 2003-05-21 Intellocity USA, Inc. System and method for television enhancement
JP2002082660A (en) * 2000-09-08 2002-03-22 Nec Software Hokuriku Ltd Screen output control method and device and recording medium
CA2327159C (en) * 2000-11-30 2008-10-07 Ibm Canada Limited-Ibm Canada Limitee System and method for dynamically displaying html form elements
EP1454226A4 (en) * 2001-10-23 2004-12-29 Samsung Electronics Co Ltd Information storage medium including markup document and av data, recording method, reproducing method, and reproducing apparatus therefor
TW578083B (en) * 2001-10-25 2004-03-01 Samsung Electronics Co Ltd Storage medium adaptable to changes in screen aspect ratio and reproducing method thereof
KR100871845B1 (en) * 2001-10-25 2008-12-03 삼성전자주식회사 Optical storage medium adaptable to change of screen ratio of length and breadth and reproducing method thereof

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5907659A (en) * 1996-05-09 1999-05-25 Matsushita Electric Industrial Co., Ltd. Optical disc for which a sub-picture can be favorably superimposed on a main image, and a disc reproduction apparatus and a disc reproduction method for the disc
US6141693A (en) * 1996-06-03 2000-10-31 Webtv Networks, Inc. Method and apparatus for extracting digital data from a video stream and using the digital data to configure the video stream for display on a television set
US5897644A (en) * 1996-09-25 1999-04-27 Sun Microsystems, Inc. Methods and apparatus for fixed canvas presentations detecting canvas specifications including aspect ratio specifications within HTML data streams
US5982445A (en) * 1996-10-21 1999-11-09 General Instrument Corporation Hypertext markup language protocol for television display and control
US6681395B1 (en) * 1998-03-20 2004-01-20 Matsushita Electric Industrial Company, Ltd. Template set for generating a hypertext for displaying a program guide and subscriber terminal with EPG function using such set broadcast from headend
US6973619B1 (en) * 1998-06-30 2005-12-06 International Business Machines Corporation Method for generating display control information and computer
US20020069411A1 (en) * 1999-12-09 2002-06-06 Liberate Technologies, Morecom Division, Inc. Enhanced display of world wide web pages on television
US7346920B2 (en) * 2000-07-07 2008-03-18 Sonic Solutions, A California Corporation System, method and article of manufacture for a common cross platform framework for development of DVD-Video content integrated with ROM content
US20020057286A1 (en) * 2000-08-25 2002-05-16 Markel Steven O. Device independent video enhancement scripting language
US20020106191A1 (en) * 2001-01-05 2002-08-08 Vm Labs, Inc. Systems and methods for creating a video montage from titles on a digital video disk
US20020126142A1 (en) * 2001-03-10 2002-09-12 Pace Micro Technology Plc. Video display resizing

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10003781B2 (en) 2006-08-04 2018-06-19 Gula Consulting Limited Liability Company Displaying tags associated with items in a video playback
US10187688B2 (en) 2006-08-04 2019-01-22 Gula Consulting Limited Liability Company Moving video tags
US20090019491A1 (en) * 2006-08-04 2009-01-15 Kulas Charles J Moving video tags outside of a video area to create a menu system
US9451195B2 (en) 2006-08-04 2016-09-20 Gula Consulting Limited Liability Company Moving video tags outside of a video area to create a menu system
US9648296B2 (en) 2006-08-04 2017-05-09 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback
US9906829B2 (en) 2006-08-04 2018-02-27 Gula Consulting Limited Liability Company Moving video tags
US20080046956A1 (en) * 2006-08-04 2008-02-21 Kulas Charles J User control for displaying tags associated with items in a video playback
US10043553B2 (en) 2006-08-04 2018-08-07 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback
US20080034295A1 (en) * 2006-08-04 2008-02-07 Kulas Charles J Displaying tags associated with items in a video playback
US10546614B2 (en) 2006-08-04 2020-01-28 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback
US10575044B2 (en) 2006-08-04 2020-02-25 Gula Consulting Limited Liabiity Company Moving video tags
US11743537B2 (en) 2006-08-04 2023-08-29 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback
US11011206B2 (en) 2006-08-04 2021-05-18 Gula Consulting Limited Liability Company User control for displaying tags associated with items in a video playback
US11678008B2 (en) * 2007-07-12 2023-06-13 Gula Consulting Limited Liability Company Moving video tags
US10979760B2 (en) 2007-07-12 2021-04-13 Gula Consulting Limited Liability Company Moving video tags

Also Published As

Publication number Publication date
MXPA05003945A (en) 2005-06-17
BR0315004A (en) 2005-08-09
RU2323486C2 (en) 2008-04-27
EP1552516A4 (en) 2006-09-13
TWI221261B (en) 2004-09-21
AU2003269546A1 (en) 2004-05-04
JP4988200B2 (en) 2012-08-01
EP1552516A1 (en) 2005-07-13
PL377692A1 (en) 2006-02-06
TW200410154A (en) 2004-06-16
US20040141717A1 (en) 2004-07-22
WO2004036575A1 (en) 2004-04-29
US7784073B2 (en) 2010-08-24
US20040143793A1 (en) 2004-07-22
RU2005111238A (en) 2006-02-27
JP2006512025A (en) 2006-04-06
CA2498882A1 (en) 2004-04-29

Similar Documents

Publication Publication Date Title
US7376333B2 (en) Information storage medium including markup document and AV data, recording and reproducing method, and reproducing apparatus therefore
US7784073B2 (en) Information storage medium including device-aspect-ratio information, method and apparatus therefor
US20050058435A1 (en) Information storage medium for storing information for downloading text subtitles, and method and apparatus for reproducing the subtitles
EP1308956A1 (en) Method and apparatus for reproducing contents from information storage medium in interactive mode
US20030182627A1 (en) Reproducing method and apparatus for interactive mode using markup documents
US20030147635A1 (en) Information storage medium containing display mode information, and reproducing apparatus and method
KR100565056B1 (en) Method and apparatus for reproducing AV data in interactive mode and information storage medium thereof
US20050094973A1 (en) Moving picture reproducing apparatus in which player mode information is set, reproducing method using the same, and storage medium
KR100584566B1 (en) Method for generating AV data in interactive mode by using markup document containing device-aspect-ratio information
JP2005085462A (en) Information storage medium for recording search information file, and its reproducing method and reproducing device
KR100584576B1 (en) Information storage medium for reproducing AV data in interactive mode
KR100584575B1 (en) Method for reproducing AV data in interactive mode
KR20030067459A (en) Information storage medium containing display mode indicating information, reproducing apparatus and method therefor

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHUNG, HYUN-KWON;PARK, SUNG-WOOK;REEL/FRAME:015182/0858

Effective date: 20040323

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION