CA2420379A1 - Set-top preview program - Google Patents
Set-top preview program Download PDFInfo
- Publication number
- CA2420379A1 CA2420379A1 CA002420379A CA2420379A CA2420379A1 CA 2420379 A1 CA2420379 A1 CA 2420379A1 CA 002420379 A CA002420379 A CA 002420379A CA 2420379 A CA2420379 A CA 2420379A CA 2420379 A1 CA2420379 A1 CA 2420379A1
- Authority
- CA
- Canada
- Prior art keywords
- content
- video
- interactive
- enhanced
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4782—Web browsing, e.g. WebTV
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/637—Control signals issued by the client directed to the server or network components
- H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8545—Content authoring for generating interactive applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
- H04N7/087—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only
- H04N7/088—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division with signal insertion during the vertical blanking interval only the inserted signal being digital
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
- H04N7/165—Centralised control of user terminal ; Registering at central
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
Abstract
Disclosed is a system for generating a graphics window that is capable of emulatingenhanced video from a combined video and interactive content stream.
The set-top emulatorcan randomly access the combined video and interactive content stream to provide an easymanner of randomly accessing portions of the combined video and interactive stream for qualitycontrol purposes. Random access allows selective viewing of the enhanced video which savestime.
Additionally, the combined video and interactive content stream can be simultaneously viewed as it is being produced to allow immediate feedback to an interactive television producer.
The set-top emulatorcan randomly access the combined video and interactive content stream to provide an easymanner of randomly accessing portions of the combined video and interactive stream for qualitycontrol purposes. Random access allows selective viewing of the enhanced video which savestime.
Additionally, the combined video and interactive content stream can be simultaneously viewed as it is being produced to allow immediate feedback to an interactive television producer.
Description
Cross-Reference to Related Applications The present invention is based upon and claims priority from U.S. provisional application serial # 60/228,002 filed August 25, 2000 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms" by Steven O. Market.
l0 Back~rouud a. Field The present disclosure generally pertains to interactive television and more particularly to software programs for previewing combined video and interactive content.
b. Description of the Back~ound Interactive TV is based upon the concept of simultaneously displaying media objects such as audio/video content with interactive TV content objects such as HTML
web pages that allows a viewer to access Tnternet web pages. The combined video/audio and interactive content data may be generated by iTV producers, content providers or others. The combined content is transmitted to viewers who can view and utilize the combined content materials.
In a process of generating the combined content, it is necessary to lay out the structure of the display. For example, the media object may appear as a background display with the interactive TV content object as a foreground display that only covers a smaller portion of the screen. Alternatively; the media object may appear as a transparent portion of the interactive TV content that cov ers the remaining portion of the screen. In any event, the interactive screen display must be laid out in some fashion that allows viewing of both the interactive TV content object and the media object.
Usually, layout schemes exist that provide for optimal viewing of both the interactive TV
content obj ect and the media object on the single display. In other words, interactive TV
content displa}= portions and the video display portions do not interfere with one another and are displayed in an optimal fashion for viewing. Other portions should also be verified beyond the interactive TV content display portions and the video display portions. For example, the navigation link, event triggering and overall functionality built into the enhanced content should also be verified.
iTV producers and others who generate the combined video and interactive content information use software programs such as iTV Producer and iTV Author, which are both available from Intellocity Inc., 1400 Market Street, Denver, Colorado 80202.
After the combined video and interactive content is senerated using a pro~am such as 1 o this by interactive television producers, the combined content must be checked to make sure that the display is properly generated. Currently, the combined content must be applied to several set-top boxes and the content viewed in its entirety with modifications being made after the viewing process has been completed. This is a time consuming and error prone process performed by highly paid software engineers who are capable of i5 operating the interactive television production software, and involves expensive equipment.
It would therefore be advantageous to provide a software program that can simulate the functions of various set-top box platforms to allow random access to certain portions of the combined content stream to ensure that the combined content stream 20 provides the desired display of information, while simultaneously allowing the editing of the combined content stream.
Summary of the Invention The present invention overcomes the disadvantages and limitations of the prior art 25 by providing a software emulation pro~am that allows a personal computer to emulate the functions of various set-top boxes so that a combined video and an enhanced content stream can be displayed and randomly accessed to ensure that a desired layout is achieved for the displayed information. By allowing random access to various portions of the combined content stream, only critical portions of the combined content stream 3o need to be checked which greatly reduces the review period. For example, it may only be necessary to check the combined display when there is a change in the interactive TV
content that is being displayed or a change of scene in the video stream.
Hence, only those portions where the interactive TV content has changed may require checking to ensure that the combined content is properly displayed. For example, it may be valuable to check to make sure that each new section of interactive TV content does not obscure some important portion of the media object.
Further, since a computer is being used to view the combined content stream, the combined content stream can be accessed and modified in a very quick fashion while it is being checked. This process additionally reduces the time in checking and modifying the combined content stream.
l0 The validation process may also involve verifying that the navigation links are operational, and that any other functionality created as part of the enhancement works as intended.
The present invention may therefore comprise a method of emulating the functions performed by a set-top box to display an enhanced video stream on a computer t 5 that includes a combination of video content and interactive content comprising:
generating a layout file that provides time based actions that are applied to the video content and the interactive content; applying a set ofrules to the layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining the interactive content to select a color that is not being used by the interactive 2o content; assigning the color as a transparent color; locating the video content in the enhanced video stream to generate video content location data; setting portions of the enhanced video stream corresponding to the video content location data as the transparent color.
The advantages of the present invention are that combined video and interactive 25 content streams can be checked for quality assurance in a very quick and easy fashion.
The combined content stream can also be modified during the quality assurance checking process in an expeditious manner. Further, the present invention may be used in combination with authoring programs such as iTV Producer, available from Intellocity, that allow interactive TV producers to check the combined video and interactive content 30 stream as it is produced which reduces time of production and provides optimal desired results.
Brief Description of the Drawings In the drawings, FIGURE I is a schematic illustration of a computer monitor screen that is displaying a combined video and interactive content stream utilizing the present invention.
FIGURE 2 is a view of a computer monitor screen that is displaying another example of a combined video and interactive content stream.
FIGURE 3 is a schematic diagram of the environment in which the present to invention operates.
FIGURE 4 is a flow diagram illustrating the operation of the software of the present invention.
FIGURE 5 is a flow diagram illustrating the steps for selecting a transparent color.
15 FIGURE 6 is a flow diagram illustrating the steps for examining HTML code to locate the position of a media object.
FIGURE 7 is a program listing of an X11~IL script that specifies the assets (e.g., graphics and text) of a page, the layout information of the page assets (e.g., position of the graphics), the properties of the assets (e.g., the font, font size and color), and the 2o triggers required to provide the desired enhanced content.
FIGURE 8 is a flow diagram that illustrates how content is generated, emulated and modified.
Detailed Description of the Preferred Embodiment of the Invention 25 Fig. 1 is schematic illustration of a computer monitor 100 that displaying a graphic window 102 that is generated in accordance with the present invention.
The graphic window 1 OZ may be a window generated under, and compatible with, a Microsoft operating system, or other operating systems. The graphic window 102 emulates the display that would otherwise be created on a TV set when a combined video 3o and interactive content stream is applied to a set-top box that is connected to the TV. As shown in Fig. 1, the graphic window displays a media object 104 which is background video'as illustrated in Fig. 1. The graphic window 102 also displays an HTML
object 106 that appears as interactive content in the foreground of the graphic window I02. In other words, the HTi~TL object 106 obscures and covers the background video 104.
Hence, to obtain an optimal display, the interactive content 106 must be placed in a position that does not obscure important portions of the background video 104.
Hence, the iTV producer that encodes the video with interactive content must carefully select the location of the interactive content 106 on the background video 104. If the interactive content 106 is not placed in the proper location on the picture, valuable content of the background video 104 may be lost.
l0 Fig. 2 illustrates a computer monitor 200 that also includes a graphic window 202 that is generated in accordance with the present invention to emulate the display of a combined video and interactive content stream as it would appear on a TV
connected to a set-top box. Fig. 2 discloses another manner of displaying the combined video and interactive content stream in which the media object 204 (i.e., the video) is placed in a transparent window within the interactive content 206 and the viewable portion of the interactive content 206 is displayed on the remaining portion of the screen.
The window 204, in which the media object appears, comprises a transparent portion of the interactive content 206. Hence, the interactive content 206 must be placed in portions that do not coincide with the transparent window 204 to insure that all of the information of the interactive content 206 is properly displayed. If interactive content 206 is placed on the transparent window 204, it will not appear on the display since the media object 204 appears within the transparent window.
Fig. 3 is a schematic block diagram illustrating an implementation of the present invention. As shown in Fig. 3, a computer 300 is utilized to generate and display enhanced video 332 on a computer monitor 302. Computer 300 includes an interactive TV (iTV) producer 326 that is used to generate the combined video and interactive content stream 328. The iTV producer 326 may comprise a software program loaded into the computer 300 that receives a media object 322, such as video data, as well as an HTML object 324 that comprises interactive TV content stored in a storage device 314.
The iTV producer 326 combines the HTML object 324 and the media object 322 in a desired fashion such as illustrated in Figs. 1 or 2.
A feature of the iTV producer 326 that is illustrated in Fig. 3 is that the iTV
producer 326 can be used to place the background video and interactive content on the display screen so that important portions of both the HTML object 324 and the media object 322 are not obscured by one another. The iTV producer 326 includes tools for laying out the HTML object 324 and media object 322 to accomplish this task and prevent obscuration of important information. The iTV producer is disclosed more fully in U.S. patent application serial # 60/228,002 filed August 25, 2000 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms" which is specifically incorporated herein by reference for aII that l0 it discloses and teaches.
Computer 300 of Fig. 3, as pointed out above, uses the iTV content that is stored in a storage device 314 as the HTML object 324 to generate the combined video and interactive content stream 328. The media object 322 is generated from video data that is produced by a Windows video layer 320. The Windows video layer is a standard program provided by Microsoft that interfaces with various sources of video data to provide the media object 322 in a common format.
The Windows video layer 320 can receive video data from various sources. For example, the Windows video layer 320 may receive stored video data 311 such as AVI or MPEG data from a storage device 312 which may reside within the computer 300.
This data may have been previously stored in the computer 300. The Windows video layer 320 may also receive external video data 318 from a TV tuner card 316 which may also reside within the computer 300. The TV tuner card 316 may be coupled to various NTSC
sources 304 such as an RF source 306, a composite video source 308, or a streaming video source 3I0. The TV tuner card can be any commonly available tuner card such as the "All in Wonder" tuner card available from ATI, lnc.
The combined video and interactive content stream 328 that is produced by the iTV producer, as shown in Fig. 3, is stored in storage device 329 for later use. The combined video and interactive content stream 328 can also be applied to the set-top emulator 330. The set-top emulator is capable of generating an enhanced video signal 332 in the same manner as a set-top box so that the enhanced video 332 can be displayed on a computer monitor 302 as illustrated in Figs. 1 and 2. The computer emulator 330 can comprise a software program or a hardware accelerator that performs the functions of the set-top box and generates a graphic window such as graphic window 102 of Fi~_ I
and~202 of Fig. 2 for display on the computer monitor 302 as indicated above.
The advantage of the system illustrated in Fig. 3 is that the iTV producer, using the computer 300, can view the enhanced video 332 as it is being generated by the iTV
producer, or randomly access the combined video and interactive content stream 328 that has been stored in storage device 329 via connection 334. In other words, the computer 300 can access any portion of the stored combined video and interactive content stream to determine how portions of that content stream may appear when displayed on the computer monitor 302 as enhanced video 332. Another emulation program is disclosed in provisional patent application Serial number 60/228,002 filed August 2~, 2000, entitled "Data Driven System and Method for Distribution of Interactive Content to Multiple Target Presentation Platforms" by Steven O. Market, which is specifically incorporated herein by reference for all it discloses and teaches.
Fig. 4 is a flow diagram illustrating the steps 400 performed by the set-top emulator 330. The set-top emulator 330 loads the HTML object 324 from the combined video and interactive content stream 328 at step 402. At step 404, the set-top emulator 330 examines the HTML content to select a color that is not used in the HTML
content.
That color is then designated as a transparent color (Traps C). At step 406, the set-top emulator 330 further examines the HTML code to locate the position of the media object that has been programmed into the HTML code as height and width data. At step 408, it is then determined whether the media object is to be displayed as back~ound or in a window. Tf the HTML code indicates that the media object is to be displayed in the background, the background of the HTML content is set to Traps C at step 4I0.
If the media object is to be displayed in a window, the window of the HTML content is set to Traps C. The process then proceeds to step 414 at which the set-top emulator positions and sizes the media object to match the area designated as Traps C.
Iii other words, the media object is positioned and sized to fit in a window if the HTML
content has indicated the media object is to be displayed in a window. Alternatively, the media object is sized and located in the background portion of the HTML content if the HTML
code indicates that the media object should be displayed in the background. At step 416, the transparency function of the HTML object is then set to Trans C so that the media object can be displayed in those areas that have been designated as Trans C.
Fig. 5 is a flow diagram illustrating the steps 500 that are performed in the process of selecting the Trans C color as indicated in step 404 of Fig. 4. As shown in Fig. 5, a page of the HTML code is loaded into a temporary browser at step 502. At step 504, a bit map of the web image is captured. At step 506, the Trans C color is set to RGB
(0,0,1) which is the first color away from black. At step 508, the system then determines whether that color exists in the bit map of the HTML web page. Tf that color does exist, one is added to the Trans C RGB color at step 510. For example, the RGB color on the i0 second step becomes RGB (0,0,2). Each of the RGB colors may be an eight bit color so that the numbers range from 0 to 255. The process then returns to step 508 to determine if the new color that is set for Trans C is a color that exists in the web page bit map. If it is not, the Trans C color is set to that color, i.e. the color that has been found that does not exist in the web page bit map. That Trans C color is then made to be transparent.
Fig. 6 is a flow diagram illustrating the steps 600 that are performed for examining HTML code to locate the position of a media object in both height and width, as indicated as step 406 in Fig. 4. As shown in Fig. 6, at step 604, it is determined if an HTML web page includes any subpages that are referred to a frame set. For example, a single HTML web page may be constructed of a number of different HTML
subpages. Tf the web page is constructed of several different subpages or constitutes a frame set, the process proceeds to step 606 where it is determined if the background of the frame set is set to TV (video). In other words, it is determined whether the HTML code indicates that the background information is TV (video) information, colors, graphics, or some other background information. If it is determined that the HTML code does not indicate that the background information is not a video signal, this process is repeated for each frame in the frame set at step 610. The process then returns to step 604. If it is determined at step 606 that the HTML code indicates that the video TV signal should appear in the background of the frame set, the process proceeds to step 618 where the coordinates X, Y, height and width are set to the size of the pace. Tf it is determined at step 604 that the 3o pane does not constitute a frame set, the process proceeds to step 612 where it is determined if the HTML code indicates that the background is set to TV, i.e.
if a video signal should appear in the background. If it is determined at step 612 that the HTML
code indicates that the background is set to TV, the process proceeds to step 618 where the coordinates X, Y, height, width are set to the size of the page. The process then ends.
If it is determined that the HTML code indicates that the background is not set to TV, the process proceeds to step 620. At step 620, a list of objects or elements is obtained from the HTML code. The process then proceeds to step 622 where it is determined if the list of objects or elements is empty. If the Iist of objects or elements is not empty, the process proceeds to step 624 where the first object or element in the list is obtained. The process then proceeds to step 626 where it is determined if the source (SRC) of an image object or element is a video signal or the object itself is a TV/Media object or element. If not, the first object or element is removed from the list at step 628 and the process returns to step 622. If the SRC of an image obj ect or element is a video signal or the obj ect or element itself is a TV/Media object, the process proceeds to step 630 where the coordinates X, Y, height and width of the object or element are obtained. The process then ends. If it is determined at step 622 that the list of objects or elements is empty, the process proceeds to step 632 where it is determined if the analysis is part of the frame set and not the last frame of the frame set. If it is, the process returns to step 604. If it is not, the process ends.
Fig. 7 is a program listing of an XML script 700 that illustrates how the enhanced content is defned for a specific page. As shown in Fig. 7, a page of enhanced content can be represented by a series of XlIiIL tags. At step 702, a page is declared via the <PAGE> tag with alI subsequent tags, until the closing </PAGE> at step 732, being part of the page. Within the page, at step 704 is an element that is a graphic (step 706) whose name is declared at step 708. The graphic source is declared at step 710. The position of the graphic is provided at steps 712 and 714. Should the viewer click on this graphic, as it is shown on the television, the link to address (URL) is declared in step 71 b. Further a trigger is defined in step 7I 8 of Fig. 7 that illustrates how, at a specific time defined in step 720, an action can occur. The action is defined to change the source (step 722) of the named ~aphic (step 724) to a new source (step 726). The end or scope of the trigger 3o is declared in step 728, as well as the end of the element in step 730 and the end of the page in step 732. This ESL script is then passed through an XSL parser to generate the emulation HTML and JavaScript, such as described in U.S. Provisional Application Serial Number 60/227,063 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms," filed August 21, 2000, by Steven O. Market which is specifically incorporated herein by reference for all that it discloses and teaches.
Fig. 8 is a flow diagram that illustrates the steps 800 that show how content is generated, emulated and modified in accordance with the present invention. At step 802, a video file is generated that contains relevant portions of a video stream to be enhanced.
In other words, rather than using an entire video stream in order to view the emulation, a l0 file is generated that contains relevant portions of the video stream that contains a significantly smaller amount of data which is easier to operate and manipulate. For example, only every 30'h frame of video data may be captured in the video file which reduces the size of the video file by a factor of 30. At step 804, an author, who is someone that is generating an enhanced video segment, uses an interactive authoring 15 pro~am, such as disclosed in U.S. Provisional Application Serial Number 601227,930 entitled "System and Method for Web Based Enhanced Interactive Television Page Layout," f led August 25, 2000, by Steven O. Market which is specifically incorporated herein by reference for all that it discloses and teaches, to insert interactive objects and elements onto an interactive screen. The interactive authoring program allows the author 2o to start, play, pause and stop the video. At step 806, the authoring program generates an iTVML layout file (page) that identifies the video file, the interactive elements and objects, provides locations of the interactive objects and elements on the interactive page and other similar functions. The iTVI~iL layout file is a particular schema of XML code that provide time based actions that are applied to both video and interactive content. At 25 step 808, it is then determined whether the iTVML code should be published.
In other words, it is determined whether the iTVNIL code should be translated into HTML
code and Java script that can be viewed through a set-top box.
If it is determined at step 808 that the iTVML code should not be published, the process proceeds to step 814. At. step 814, an XSL parser is applied to the iTVML code.
30 The XSL parser applies rules to the iTVML code that are specific to generate emulation code that works with a browser used by the author's computer to generate a display of the l0 enhanced video on the author's or other individual's computer screen as it would appear on a TV connected to a set-top box. The author or quality engineer or other individual viewing the emulated display can then access different portions of the code in a random fashion, rather than a serial fashion, to view the manner in which the enhanced program will be displayed. At step 816, the author or other individual can make actual changes in the iTVML code and then return to step 814 to apply the XSL parser and view the result of the changes. If it is determined at step 808 that the iTVML code should be published, the process proceeds to step 810 where the XSL parser is applied to the iTVML
code to generate HTML code as disclosed in U.S. Provisional Application Serial Number 60/227,063 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms," filed August 21, 2000, by Steven O. Market. The HTML code can then be applied to a standard HTML processor in a set-top box and viewed on a TV. Alternatively, or in conjunction with the above, an XSL
parser can be applied to the iTVML code that applies rules to the iTVMI, code that are specific to generate emulation code that can be viewed by a browser on the author's computer. At step 812, the author can then make changes to the code so that the interactive objects and elements appear as desired.
The present invention therefore provides a device that is capable of generating a graphics window on a computer monitor so that enhanced video can be viewed either as 2o it is produced or randomly accessed from storage. The present invention enables an iTV
producer or a quality control engineer to review the enhanced video to insure that it is properly Iaid out and important portions of either the iTV content or video stream are not obscured. The combined video and interactive content stream can be randomly accessed so that quality control engineers only need to access certain portions of the video stream to check quality, rather than viewing an entire video stream. Further, iTV
producers can view the results of the enhanced video in real time.
The foregoing description of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to Iimit the invention to the precise form disclosed, and other modifications and variations may be possible in 3o Iight of the above teachings. The embodiment was chosen and described in order to best explain the principles of the invention and its practical application to thereby enable others,skilled in the art to best utilize the invention in various embodiments and various modifications as are suited to the particular use contemplated. It is intended that the appended claims be construed to include other alternative embodiments of the invention except insofar as limited by the prior art.
l0 Back~rouud a. Field The present disclosure generally pertains to interactive television and more particularly to software programs for previewing combined video and interactive content.
b. Description of the Back~ound Interactive TV is based upon the concept of simultaneously displaying media objects such as audio/video content with interactive TV content objects such as HTML
web pages that allows a viewer to access Tnternet web pages. The combined video/audio and interactive content data may be generated by iTV producers, content providers or others. The combined content is transmitted to viewers who can view and utilize the combined content materials.
In a process of generating the combined content, it is necessary to lay out the structure of the display. For example, the media object may appear as a background display with the interactive TV content object as a foreground display that only covers a smaller portion of the screen. Alternatively; the media object may appear as a transparent portion of the interactive TV content that cov ers the remaining portion of the screen. In any event, the interactive screen display must be laid out in some fashion that allows viewing of both the interactive TV content object and the media object.
Usually, layout schemes exist that provide for optimal viewing of both the interactive TV
content obj ect and the media object on the single display. In other words, interactive TV
content displa}= portions and the video display portions do not interfere with one another and are displayed in an optimal fashion for viewing. Other portions should also be verified beyond the interactive TV content display portions and the video display portions. For example, the navigation link, event triggering and overall functionality built into the enhanced content should also be verified.
iTV producers and others who generate the combined video and interactive content information use software programs such as iTV Producer and iTV Author, which are both available from Intellocity Inc., 1400 Market Street, Denver, Colorado 80202.
After the combined video and interactive content is senerated using a pro~am such as 1 o this by interactive television producers, the combined content must be checked to make sure that the display is properly generated. Currently, the combined content must be applied to several set-top boxes and the content viewed in its entirety with modifications being made after the viewing process has been completed. This is a time consuming and error prone process performed by highly paid software engineers who are capable of i5 operating the interactive television production software, and involves expensive equipment.
It would therefore be advantageous to provide a software program that can simulate the functions of various set-top box platforms to allow random access to certain portions of the combined content stream to ensure that the combined content stream 20 provides the desired display of information, while simultaneously allowing the editing of the combined content stream.
Summary of the Invention The present invention overcomes the disadvantages and limitations of the prior art 25 by providing a software emulation pro~am that allows a personal computer to emulate the functions of various set-top boxes so that a combined video and an enhanced content stream can be displayed and randomly accessed to ensure that a desired layout is achieved for the displayed information. By allowing random access to various portions of the combined content stream, only critical portions of the combined content stream 3o need to be checked which greatly reduces the review period. For example, it may only be necessary to check the combined display when there is a change in the interactive TV
content that is being displayed or a change of scene in the video stream.
Hence, only those portions where the interactive TV content has changed may require checking to ensure that the combined content is properly displayed. For example, it may be valuable to check to make sure that each new section of interactive TV content does not obscure some important portion of the media object.
Further, since a computer is being used to view the combined content stream, the combined content stream can be accessed and modified in a very quick fashion while it is being checked. This process additionally reduces the time in checking and modifying the combined content stream.
l0 The validation process may also involve verifying that the navigation links are operational, and that any other functionality created as part of the enhancement works as intended.
The present invention may therefore comprise a method of emulating the functions performed by a set-top box to display an enhanced video stream on a computer t 5 that includes a combination of video content and interactive content comprising:
generating a layout file that provides time based actions that are applied to the video content and the interactive content; applying a set ofrules to the layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining the interactive content to select a color that is not being used by the interactive 2o content; assigning the color as a transparent color; locating the video content in the enhanced video stream to generate video content location data; setting portions of the enhanced video stream corresponding to the video content location data as the transparent color.
The advantages of the present invention are that combined video and interactive 25 content streams can be checked for quality assurance in a very quick and easy fashion.
The combined content stream can also be modified during the quality assurance checking process in an expeditious manner. Further, the present invention may be used in combination with authoring programs such as iTV Producer, available from Intellocity, that allow interactive TV producers to check the combined video and interactive content 30 stream as it is produced which reduces time of production and provides optimal desired results.
Brief Description of the Drawings In the drawings, FIGURE I is a schematic illustration of a computer monitor screen that is displaying a combined video and interactive content stream utilizing the present invention.
FIGURE 2 is a view of a computer monitor screen that is displaying another example of a combined video and interactive content stream.
FIGURE 3 is a schematic diagram of the environment in which the present to invention operates.
FIGURE 4 is a flow diagram illustrating the operation of the software of the present invention.
FIGURE 5 is a flow diagram illustrating the steps for selecting a transparent color.
15 FIGURE 6 is a flow diagram illustrating the steps for examining HTML code to locate the position of a media object.
FIGURE 7 is a program listing of an X11~IL script that specifies the assets (e.g., graphics and text) of a page, the layout information of the page assets (e.g., position of the graphics), the properties of the assets (e.g., the font, font size and color), and the 2o triggers required to provide the desired enhanced content.
FIGURE 8 is a flow diagram that illustrates how content is generated, emulated and modified.
Detailed Description of the Preferred Embodiment of the Invention 25 Fig. 1 is schematic illustration of a computer monitor 100 that displaying a graphic window 102 that is generated in accordance with the present invention.
The graphic window 1 OZ may be a window generated under, and compatible with, a Microsoft operating system, or other operating systems. The graphic window 102 emulates the display that would otherwise be created on a TV set when a combined video 3o and interactive content stream is applied to a set-top box that is connected to the TV. As shown in Fig. 1, the graphic window displays a media object 104 which is background video'as illustrated in Fig. 1. The graphic window 102 also displays an HTML
object 106 that appears as interactive content in the foreground of the graphic window I02. In other words, the HTi~TL object 106 obscures and covers the background video 104.
Hence, to obtain an optimal display, the interactive content 106 must be placed in a position that does not obscure important portions of the background video 104.
Hence, the iTV producer that encodes the video with interactive content must carefully select the location of the interactive content 106 on the background video 104. If the interactive content 106 is not placed in the proper location on the picture, valuable content of the background video 104 may be lost.
l0 Fig. 2 illustrates a computer monitor 200 that also includes a graphic window 202 that is generated in accordance with the present invention to emulate the display of a combined video and interactive content stream as it would appear on a TV
connected to a set-top box. Fig. 2 discloses another manner of displaying the combined video and interactive content stream in which the media object 204 (i.e., the video) is placed in a transparent window within the interactive content 206 and the viewable portion of the interactive content 206 is displayed on the remaining portion of the screen.
The window 204, in which the media object appears, comprises a transparent portion of the interactive content 206. Hence, the interactive content 206 must be placed in portions that do not coincide with the transparent window 204 to insure that all of the information of the interactive content 206 is properly displayed. If interactive content 206 is placed on the transparent window 204, it will not appear on the display since the media object 204 appears within the transparent window.
Fig. 3 is a schematic block diagram illustrating an implementation of the present invention. As shown in Fig. 3, a computer 300 is utilized to generate and display enhanced video 332 on a computer monitor 302. Computer 300 includes an interactive TV (iTV) producer 326 that is used to generate the combined video and interactive content stream 328. The iTV producer 326 may comprise a software program loaded into the computer 300 that receives a media object 322, such as video data, as well as an HTML object 324 that comprises interactive TV content stored in a storage device 314.
The iTV producer 326 combines the HTML object 324 and the media object 322 in a desired fashion such as illustrated in Figs. 1 or 2.
A feature of the iTV producer 326 that is illustrated in Fig. 3 is that the iTV
producer 326 can be used to place the background video and interactive content on the display screen so that important portions of both the HTML object 324 and the media object 322 are not obscured by one another. The iTV producer 326 includes tools for laying out the HTML object 324 and media object 322 to accomplish this task and prevent obscuration of important information. The iTV producer is disclosed more fully in U.S. patent application serial # 60/228,002 filed August 25, 2000 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms" which is specifically incorporated herein by reference for aII that l0 it discloses and teaches.
Computer 300 of Fig. 3, as pointed out above, uses the iTV content that is stored in a storage device 314 as the HTML object 324 to generate the combined video and interactive content stream 328. The media object 322 is generated from video data that is produced by a Windows video layer 320. The Windows video layer is a standard program provided by Microsoft that interfaces with various sources of video data to provide the media object 322 in a common format.
The Windows video layer 320 can receive video data from various sources. For example, the Windows video layer 320 may receive stored video data 311 such as AVI or MPEG data from a storage device 312 which may reside within the computer 300.
This data may have been previously stored in the computer 300. The Windows video layer 320 may also receive external video data 318 from a TV tuner card 316 which may also reside within the computer 300. The TV tuner card 316 may be coupled to various NTSC
sources 304 such as an RF source 306, a composite video source 308, or a streaming video source 3I0. The TV tuner card can be any commonly available tuner card such as the "All in Wonder" tuner card available from ATI, lnc.
The combined video and interactive content stream 328 that is produced by the iTV producer, as shown in Fig. 3, is stored in storage device 329 for later use. The combined video and interactive content stream 328 can also be applied to the set-top emulator 330. The set-top emulator is capable of generating an enhanced video signal 332 in the same manner as a set-top box so that the enhanced video 332 can be displayed on a computer monitor 302 as illustrated in Figs. 1 and 2. The computer emulator 330 can comprise a software program or a hardware accelerator that performs the functions of the set-top box and generates a graphic window such as graphic window 102 of Fi~_ I
and~202 of Fig. 2 for display on the computer monitor 302 as indicated above.
The advantage of the system illustrated in Fig. 3 is that the iTV producer, using the computer 300, can view the enhanced video 332 as it is being generated by the iTV
producer, or randomly access the combined video and interactive content stream 328 that has been stored in storage device 329 via connection 334. In other words, the computer 300 can access any portion of the stored combined video and interactive content stream to determine how portions of that content stream may appear when displayed on the computer monitor 302 as enhanced video 332. Another emulation program is disclosed in provisional patent application Serial number 60/228,002 filed August 2~, 2000, entitled "Data Driven System and Method for Distribution of Interactive Content to Multiple Target Presentation Platforms" by Steven O. Market, which is specifically incorporated herein by reference for all it discloses and teaches.
Fig. 4 is a flow diagram illustrating the steps 400 performed by the set-top emulator 330. The set-top emulator 330 loads the HTML object 324 from the combined video and interactive content stream 328 at step 402. At step 404, the set-top emulator 330 examines the HTML content to select a color that is not used in the HTML
content.
That color is then designated as a transparent color (Traps C). At step 406, the set-top emulator 330 further examines the HTML code to locate the position of the media object that has been programmed into the HTML code as height and width data. At step 408, it is then determined whether the media object is to be displayed as back~ound or in a window. Tf the HTML code indicates that the media object is to be displayed in the background, the background of the HTML content is set to Traps C at step 4I0.
If the media object is to be displayed in a window, the window of the HTML content is set to Traps C. The process then proceeds to step 414 at which the set-top emulator positions and sizes the media object to match the area designated as Traps C.
Iii other words, the media object is positioned and sized to fit in a window if the HTML
content has indicated the media object is to be displayed in a window. Alternatively, the media object is sized and located in the background portion of the HTML content if the HTML
code indicates that the media object should be displayed in the background. At step 416, the transparency function of the HTML object is then set to Trans C so that the media object can be displayed in those areas that have been designated as Trans C.
Fig. 5 is a flow diagram illustrating the steps 500 that are performed in the process of selecting the Trans C color as indicated in step 404 of Fig. 4. As shown in Fig. 5, a page of the HTML code is loaded into a temporary browser at step 502. At step 504, a bit map of the web image is captured. At step 506, the Trans C color is set to RGB
(0,0,1) which is the first color away from black. At step 508, the system then determines whether that color exists in the bit map of the HTML web page. Tf that color does exist, one is added to the Trans C RGB color at step 510. For example, the RGB color on the i0 second step becomes RGB (0,0,2). Each of the RGB colors may be an eight bit color so that the numbers range from 0 to 255. The process then returns to step 508 to determine if the new color that is set for Trans C is a color that exists in the web page bit map. If it is not, the Trans C color is set to that color, i.e. the color that has been found that does not exist in the web page bit map. That Trans C color is then made to be transparent.
Fig. 6 is a flow diagram illustrating the steps 600 that are performed for examining HTML code to locate the position of a media object in both height and width, as indicated as step 406 in Fig. 4. As shown in Fig. 6, at step 604, it is determined if an HTML web page includes any subpages that are referred to a frame set. For example, a single HTML web page may be constructed of a number of different HTML
subpages. Tf the web page is constructed of several different subpages or constitutes a frame set, the process proceeds to step 606 where it is determined if the background of the frame set is set to TV (video). In other words, it is determined whether the HTML code indicates that the background information is TV (video) information, colors, graphics, or some other background information. If it is determined that the HTML code does not indicate that the background information is not a video signal, this process is repeated for each frame in the frame set at step 610. The process then returns to step 604. If it is determined at step 606 that the HTML code indicates that the video TV signal should appear in the background of the frame set, the process proceeds to step 618 where the coordinates X, Y, height and width are set to the size of the pace. Tf it is determined at step 604 that the 3o pane does not constitute a frame set, the process proceeds to step 612 where it is determined if the HTML code indicates that the background is set to TV, i.e.
if a video signal should appear in the background. If it is determined at step 612 that the HTML
code indicates that the background is set to TV, the process proceeds to step 618 where the coordinates X, Y, height, width are set to the size of the page. The process then ends.
If it is determined that the HTML code indicates that the background is not set to TV, the process proceeds to step 620. At step 620, a list of objects or elements is obtained from the HTML code. The process then proceeds to step 622 where it is determined if the list of objects or elements is empty. If the Iist of objects or elements is not empty, the process proceeds to step 624 where the first object or element in the list is obtained. The process then proceeds to step 626 where it is determined if the source (SRC) of an image object or element is a video signal or the object itself is a TV/Media object or element. If not, the first object or element is removed from the list at step 628 and the process returns to step 622. If the SRC of an image obj ect or element is a video signal or the obj ect or element itself is a TV/Media object, the process proceeds to step 630 where the coordinates X, Y, height and width of the object or element are obtained. The process then ends. If it is determined at step 622 that the list of objects or elements is empty, the process proceeds to step 632 where it is determined if the analysis is part of the frame set and not the last frame of the frame set. If it is, the process returns to step 604. If it is not, the process ends.
Fig. 7 is a program listing of an XML script 700 that illustrates how the enhanced content is defned for a specific page. As shown in Fig. 7, a page of enhanced content can be represented by a series of XlIiIL tags. At step 702, a page is declared via the <PAGE> tag with alI subsequent tags, until the closing </PAGE> at step 732, being part of the page. Within the page, at step 704 is an element that is a graphic (step 706) whose name is declared at step 708. The graphic source is declared at step 710. The position of the graphic is provided at steps 712 and 714. Should the viewer click on this graphic, as it is shown on the television, the link to address (URL) is declared in step 71 b. Further a trigger is defined in step 7I 8 of Fig. 7 that illustrates how, at a specific time defined in step 720, an action can occur. The action is defined to change the source (step 722) of the named ~aphic (step 724) to a new source (step 726). The end or scope of the trigger 3o is declared in step 728, as well as the end of the element in step 730 and the end of the page in step 732. This ESL script is then passed through an XSL parser to generate the emulation HTML and JavaScript, such as described in U.S. Provisional Application Serial Number 60/227,063 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms," filed August 21, 2000, by Steven O. Market which is specifically incorporated herein by reference for all that it discloses and teaches.
Fig. 8 is a flow diagram that illustrates the steps 800 that show how content is generated, emulated and modified in accordance with the present invention. At step 802, a video file is generated that contains relevant portions of a video stream to be enhanced.
In other words, rather than using an entire video stream in order to view the emulation, a l0 file is generated that contains relevant portions of the video stream that contains a significantly smaller amount of data which is easier to operate and manipulate. For example, only every 30'h frame of video data may be captured in the video file which reduces the size of the video file by a factor of 30. At step 804, an author, who is someone that is generating an enhanced video segment, uses an interactive authoring 15 pro~am, such as disclosed in U.S. Provisional Application Serial Number 601227,930 entitled "System and Method for Web Based Enhanced Interactive Television Page Layout," f led August 25, 2000, by Steven O. Market which is specifically incorporated herein by reference for all that it discloses and teaches, to insert interactive objects and elements onto an interactive screen. The interactive authoring program allows the author 2o to start, play, pause and stop the video. At step 806, the authoring program generates an iTVML layout file (page) that identifies the video file, the interactive elements and objects, provides locations of the interactive objects and elements on the interactive page and other similar functions. The iTVI~iL layout file is a particular schema of XML code that provide time based actions that are applied to both video and interactive content. At 25 step 808, it is then determined whether the iTVML code should be published.
In other words, it is determined whether the iTVNIL code should be translated into HTML
code and Java script that can be viewed through a set-top box.
If it is determined at step 808 that the iTVML code should not be published, the process proceeds to step 814. At. step 814, an XSL parser is applied to the iTVML code.
30 The XSL parser applies rules to the iTVML code that are specific to generate emulation code that works with a browser used by the author's computer to generate a display of the l0 enhanced video on the author's or other individual's computer screen as it would appear on a TV connected to a set-top box. The author or quality engineer or other individual viewing the emulated display can then access different portions of the code in a random fashion, rather than a serial fashion, to view the manner in which the enhanced program will be displayed. At step 816, the author or other individual can make actual changes in the iTVML code and then return to step 814 to apply the XSL parser and view the result of the changes. If it is determined at step 808 that the iTVML code should be published, the process proceeds to step 810 where the XSL parser is applied to the iTVML
code to generate HTML code as disclosed in U.S. Provisional Application Serial Number 60/227,063 entitled "A Data Driven System and Method for Distribution of Interactive Content to Multiple Targeted Presentation Platforms," filed August 21, 2000, by Steven O. Market. The HTML code can then be applied to a standard HTML processor in a set-top box and viewed on a TV. Alternatively, or in conjunction with the above, an XSL
parser can be applied to the iTVML code that applies rules to the iTVMI, code that are specific to generate emulation code that can be viewed by a browser on the author's computer. At step 812, the author can then make changes to the code so that the interactive objects and elements appear as desired.
The present invention therefore provides a device that is capable of generating a graphics window on a computer monitor so that enhanced video can be viewed either as 2o it is produced or randomly accessed from storage. The present invention enables an iTV
producer or a quality control engineer to review the enhanced video to insure that it is properly Iaid out and important portions of either the iTV content or video stream are not obscured. The combined video and interactive content stream can be randomly accessed so that quality control engineers only need to access certain portions of the video stream to check quality, rather than viewing an entire video stream. Further, iTV
producers can view the results of the enhanced video in real time.
The foregoing description of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to Iimit the invention to the precise form disclosed, and other modifications and variations may be possible in 3o Iight of the above teachings. The embodiment was chosen and described in order to best explain the principles of the invention and its practical application to thereby enable others,skilled in the art to best utilize the invention in various embodiments and various modifications as are suited to the particular use contemplated. It is intended that the appended claims be construed to include other alternative embodiments of the invention except insofar as limited by the prior art.
Claims (5)
What is claimed is:
1. A method of emulating the functions performed by a set-top box to display an enhanced video stream on a computer, said enhanced video stream includes, a combination of video content and interactive content comprising:
generating a layout file that provides time based actions that are applied to said video content and said interactive content;
applying a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining said interactive content to select a color that is not being used by said interactive content;
assigning said color as a transparent color;
locating said video content in said enhanced video stream to generate video content location data;
setting portions of said enhanced content corresponding to said video content location data as said transparent color.
generating a layout file that provides time based actions that are applied to said video content and said interactive content;
applying a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining said interactive content to select a color that is not being used by said interactive content;
assigning said color as a transparent color;
locating said video content in said enhanced video stream to generate video content location data;
setting portions of said enhanced content corresponding to said video content location data as said transparent color.
2. The method of claim 1 further comprising;
accessing various portions of said layout file in a random fashion to check proper layout of said layout file and make modifications.
accessing various portions of said layout file in a random fashion to check proper layout of said layout file and make modifications.
3. The method of claim 2 further comprising;
Publishing said enhanced video stream after said layout file has been checked and modified.
Publishing said enhanced video stream after said layout file has been checked and modified.
4. A system for emulating the functions of a set-top box to display an enhanced video stream on a computer that includes a combination of video content and interactive content comprising:
interactive television producer code that is capable of generating said enhanced video stream;
a storage device coupled to receive said enhanced video stream from said interactive producer code and store a video file;
emulation code that generates a layout file, applies a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser, examines interactive content in said layout file to select a color not being used, sets said selected color to be transparent in said interactive content, locates video content in said layout file and generates video content layout data and sets portions of said enhanced content that corresponds to said video content layout data to be transparent.
interactive television producer code that is capable of generating said enhanced video stream;
a storage device coupled to receive said enhanced video stream from said interactive producer code and store a video file;
emulation code that generates a layout file, applies a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser, examines interactive content in said layout file to select a color not being used, sets said selected color to be transparent in said interactive content, locates video content in said layout file and generates video content layout data and sets portions of said enhanced content that corresponds to said video content layout data to be transparent.
5. A storage medium containing emulation code that emulates the functions performed by a set-top box to display an enhanced video stream on a computer, said enhanced video stream including a combination of video content and interactive content, said emulation code performing the following functions:
generating a layout file that provides time based actions that are applied to said video content and said interactive content;
applying a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining said interactive content to select a color that is not being used by said interactive content;
assigning said color as a transparent color;
locating said video content in said enhanced video stream to generate video content location data;
setting portions of said enhanced content corresponding to said video content location data as said transparent color.
generating a layout file that provides time based actions that are applied to said video content and said interactive content;
applying a set of rules to said layout file that produce instructions that emulate the functionality of a set-top box when applied to a browser;
examining said interactive content to select a color that is not being used by said interactive content;
assigning said color as a transparent color;
locating said video content in said enhanced video stream to generate video content location data;
setting portions of said enhanced content corresponding to said video content location data as said transparent color.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US22800200P | 2000-08-25 | 2000-08-25 | |
| US60/228,002 | 2000-08-25 | ||
| US09/934,108 | 2001-08-21 | ||
| US09/934,108 US7213255B2 (en) | 2000-08-25 | 2001-08-21 | Set-top preview program |
| PCT/US2001/041896 WO2002017621A2 (en) | 2000-08-25 | 2001-08-27 | Set-top preview program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2420379A1 true CA2420379A1 (en) | 2002-02-28 |
Family
ID=26921970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002420379A Abandoned CA2420379A1 (en) | 2000-08-25 | 2001-08-27 | Set-top preview program |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US7213255B2 (en) |
| EP (1) | EP1312205B1 (en) |
| AU (1) | AU8916301A (en) |
| CA (1) | CA2420379A1 (en) |
| WO (1) | WO2002017621A2 (en) |
Families Citing this family (49)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8932136B2 (en) * | 2000-08-25 | 2015-01-13 | Opentv, Inc. | Method and system for initiating an interactive game |
| US7526723B2 (en) | 2000-08-25 | 2009-04-28 | Intellocity Usa Inc. | System and method for emulating enhanced and interactive streaming media delivery |
| AU2003220332A1 (en) * | 2002-03-15 | 2003-09-29 | Metatv | System and method for construction, delivery and display of itv content |
| KR100954072B1 (en) * | 2002-04-22 | 2010-04-23 | 톰슨 라이센싱 에스.에이. | Method and apparatus for controlling a video signal processing apparatus to prevent screen aging |
| US20040010792A1 (en) * | 2002-07-12 | 2004-01-15 | Wallace Michael W. | Method and system for providing flexible time-based control of application appearance and behavior |
| JP4114421B2 (en) * | 2002-07-22 | 2008-07-09 | ソニー株式会社 | Electronic device apparatus, server apparatus, and layout description document providing method |
| WO2004036384A2 (en) * | 2002-10-18 | 2004-04-29 | Intellocity Usa, Inc. | Ichoose video advertising |
| US8549574B2 (en) * | 2002-12-10 | 2013-10-01 | Ol2, Inc. | Method of combining linear content and interactive content compressed together as streaming interactive video |
| US20050034153A1 (en) * | 2003-08-08 | 2005-02-10 | Maven Networks, Inc. | System and method for delivery of broadband content with integrated interactive elements |
| US20050044260A1 (en) * | 2003-08-08 | 2005-02-24 | Maven Networks, Inc. | System and method for delivery of broadband content |
| US20050034151A1 (en) * | 2003-08-08 | 2005-02-10 | Maven Networks, Inc. | System and method of integrating video content with interactive elements |
| US7913237B2 (en) * | 2003-08-26 | 2011-03-22 | Ensequence, Inc. | Compile-time code validation based on configurable virtual machine |
| US20050081218A1 (en) * | 2003-08-26 | 2005-04-14 | Acott Troy Steven | Configurable simulation of virtual machine behavior |
| US9865017B2 (en) * | 2003-12-23 | 2018-01-09 | Opentv, Inc. | System and method for providing interactive advertisement |
| US10387920B2 (en) | 2003-12-23 | 2019-08-20 | Roku, Inc. | System and method for offering and billing advertisement opportunities |
| US10032192B2 (en) | 2003-12-23 | 2018-07-24 | Roku, Inc. | Automatic localization of advertisements |
| US7979877B2 (en) | 2003-12-23 | 2011-07-12 | Intellocity Usa Inc. | Advertising methods for advertising time slots and embedded objects |
| CN100396094C (en) * | 2004-09-15 | 2008-06-18 | 财团法人工业技术研究院 | Random selection pre-looking method and its recording medium for digital video frequency film |
| US8370455B2 (en) * | 2006-03-09 | 2013-02-05 | 24/7 Media | Systems and methods for mapping media content to web sites |
| GB2463329B (en) * | 2008-09-10 | 2013-02-20 | Echostar Advanced Technologies L L C | Set-top box emulation system |
| US11606615B2 (en) * | 2010-04-27 | 2023-03-14 | Comcast Cable Communications, Llc | Remote user interface |
| US9060152B2 (en) | 2012-08-17 | 2015-06-16 | Flextronics Ap, Llc | Remote control having hotkeys with dynamically assigned functions |
| US11368760B2 (en) | 2012-08-17 | 2022-06-21 | Flextronics Ap, Llc | Applications generating statistics for user behavior |
| US20140053198A1 (en) * | 2012-08-17 | 2014-02-20 | Flextronics Ap, Llc | Live television application information panel |
| US9591339B1 (en) | 2012-11-27 | 2017-03-07 | Apple Inc. | Agnostic media delivery system |
| US9774917B1 (en) | 2012-12-10 | 2017-09-26 | Apple Inc. | Channel bar user interface |
| US10200761B1 (en) | 2012-12-13 | 2019-02-05 | Apple Inc. | TV side bar user interface |
| US9532111B1 (en) | 2012-12-18 | 2016-12-27 | Apple Inc. | Devices and method for providing remote control hints on a display |
| US10521188B1 (en) | 2012-12-31 | 2019-12-31 | Apple Inc. | Multi-user TV user interface |
| US9237367B2 (en) * | 2013-01-28 | 2016-01-12 | Rhythmone, Llc | Interactive video advertisement in a mobile browser |
| US9973723B2 (en) | 2014-02-24 | 2018-05-15 | Apple Inc. | User interface and graphics composition with high dynamic range video |
| CN106415475A (en) | 2014-06-24 | 2017-02-15 | 苹果公司 | Column interface for navigating in a user interface |
| KR102398394B1 (en) | 2014-06-24 | 2022-05-16 | 애플 인크. | Input device and user interface interactions |
| CN105451047A (en) * | 2015-12-20 | 2016-03-30 | 天脉聚源（北京）科技有限公司 | Interactive information configuration method and device for interactive television system |
| US10264314B2 (en) * | 2016-04-29 | 2019-04-16 | Pccw Vuclip (Singapore) Pte. Ltd. | Multimedia content management system |
| DK201670582A1 (en) | 2016-06-12 | 2018-01-02 | Apple Inc | Identifying applications on which content is available |
| DK201670581A1 (en) | 2016-06-12 | 2018-01-08 | Apple Inc | Device-level authorization for viewing content |
| US11966560B2 (en) | 2016-10-26 | 2024-04-23 | Apple Inc. | User interfaces for browsing content from multiple content applications on an electronic device |
| DK201870354A1 (en) | 2018-06-03 | 2019-12-20 | Apple Inc. | Setup procedures for an electronic device |
| US11445263B2 (en) | 2019-03-24 | 2022-09-13 | Apple Inc. | User interfaces including selectable representations of content items |
| WO2020198221A1 (en) | 2019-03-24 | 2020-10-01 | Apple Inc. | User interfaces for viewing and accessing content on an electronic device |
| CN114297620A (en) | 2019-03-24 | 2022-04-08 | 苹果公司 | User interface for media browsing application |
| US11683565B2 (en) | 2019-03-24 | 2023-06-20 | Apple Inc. | User interfaces for interacting with channels that provide content that plays in a media browsing application |
| WO2020243645A1 (en) | 2019-05-31 | 2020-12-03 | Apple Inc. | User interfaces for a podcast browsing and playback application |
| US11863837B2 (en) | 2019-05-31 | 2024-01-02 | Apple Inc. | Notification of augmented reality content on an electronic device |
| US11843838B2 (en) | 2020-03-24 | 2023-12-12 | Apple Inc. | User interfaces for accessing episodes of a content series |
| US11899895B2 (en) | 2020-06-21 | 2024-02-13 | Apple Inc. | User interfaces for setting up an electronic device |
| US11720229B2 (en) | 2020-12-07 | 2023-08-08 | Apple Inc. | User interfaces for browsing and presenting content |
| US11934640B2 (en) | 2021-01-29 | 2024-03-19 | Apple Inc. | User interfaces for record labels |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4408221A (en) | 1981-09-22 | 1983-10-04 | Mccoy Reginald F H | Television chroma-key systems |
| GB8928058D0 (en) * | 1989-12-12 | 1990-02-14 | Crosfield Electronics Ltd | Digital image generation |
| TW420931B (en) * | 1996-08-22 | 2001-02-01 | Hitachi Ltd | Television receiver and receiving method thereof |
| US5982445A (en) | 1996-10-21 | 1999-11-09 | General Instrument Corporation | Hypertext markup language protocol for television display and control |
| US5973692A (en) | 1997-03-10 | 1999-10-26 | Knowlton; Kenneth Charles | System for the capture and indexing of graphical representations of files, information sources and the like |
| US6023714A (en) | 1997-04-24 | 2000-02-08 | Microsoft Corporation | Method and system for dynamically adapting the layout of a document to an output device |
| US6034739A (en) * | 1997-06-09 | 2000-03-07 | Evans & Sutherland Computer Corporation | System for establishing a three-dimensional garbage matte which enables simplified adjusting of spatial relationships between physical and virtual scene elements |
| GB2327837B (en) | 1997-07-29 | 1999-09-15 | Microsoft Corp | Providing enhanced content with broadcast video |
| US20020007493A1 (en) * | 1997-07-29 | 2002-01-17 | Laura J. Butler | Providing enhanced content with broadcast video |
| US6201538B1 (en) | 1998-01-05 | 2001-03-13 | Amiga Development Llc | Controlling the layout of graphics in a television environment |
| US5933141A (en) * | 1998-01-05 | 1999-08-03 | Gateway 2000, Inc. | Mutatably transparent displays |
| US6754905B2 (en) * | 1998-07-23 | 2004-06-22 | Diva Systems Corporation | Data structure and methods for providing an interactive program guide |
| US20030088878A1 (en) * | 2000-03-25 | 2003-05-08 | Karl Rogers | System and method for integration of high quality video multi-casting service with an interactive communication and information environment using internet protocols |
-
2001
- 2001-08-21 US US09/934,108 patent/US7213255B2/en active Active
- 2001-08-27 CA CA002420379A patent/CA2420379A1/en not_active Abandoned
- 2001-08-27 EP EP01968962.9A patent/EP1312205B1/en not_active Expired - Lifetime
- 2001-08-27 AU AU8916301A patent/AU8916301A/en active Pending
- 2001-08-27 WO PCT/US2001/041896 patent/WO2002017621A2/en active IP Right Grant
Also Published As
| Publication number | Publication date |
|---|---|
| AU8916301A (en) | 2002-03-04 |
| EP1312205A2 (en) | 2003-05-21 |
| AU2001289163A2 (en) | 2002-03-04 |
| US7213255B2 (en) | 2007-05-01 |
| US20020026637A1 (en) | 2002-02-28 |
| WO2002017621A2 (en) | 2002-02-28 |
| EP1312205B1 (en) | 2017-08-23 |
| WO2002017621A3 (en) | 2002-06-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7213255B2 (en) | Set-top preview program | |
| AU2001289162B2 (en) | Method and system of creating enhancement content to be displayed with a television program | |
| US7162697B2 (en) | System and method for distribution of interactive content to multiple targeted presentation platforms | |
| US6791579B2 (en) | Method of enhancing streaming media content | |
| US6785902B1 (en) | Document data structure and method for integrating broadcast television with web pages | |
| US20020057286A1 (en) | Device independent video enhancement scripting language | |
| JP4451063B2 (en) | Method and apparatus for reformatting content for display on interactive television | |
| CN101796543B (en) | Data system and method | |
| US20010033296A1 (en) | Method and apparatus for delivery and presentation of data | |
| US20100146376A1 (en) | Audio/Video Program-Related Hyperlink Printer | |
| US20040034622A1 (en) | Applications software and method for authoring and communicating multimedia content in a multimedia object communication and handling platform | |
| US7526723B2 (en) | System and method for emulating enhanced and interactive streaming media delivery | |
| CA2481659A1 (en) | System and method for creating interactive content at multiple points in the television production process | |
| US20130205334A1 (en) | Method and apparatus for providing supplementary information about content in broadcasting system | |
| AU2001289163B2 (en) | Set-top preview program | |
| CN106034254B (en) | It is a kind of to realize the method and system that operation is interacted with text in video | |
| Soares Neto et al. | The nested context language reuse features | |
| AU2001289163A1 (en) | Set-top preview program | |
| EP0841610A2 (en) | Hot areas in interactive movies | |
| Grahn | The media9 Package, v1. 25 | |
| KR100372891B1 (en) | Caption management method for offering a play script in Internet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued | ||
| FZDE | Discontinued |
Effective date: 20060828 |