WO2001072040A2 - System and method for automatic content enhancement of multimedia output device - Google Patents
System and method for automatic content enhancement of multimedia output device Download PDFInfo
- Publication number
- WO2001072040A2 WO2001072040A2 PCT/EP2001/002759 EP0102759W WO0172040A2 WO 2001072040 A2 WO2001072040 A2 WO 2001072040A2 EP 0102759 W EP0102759 W EP 0102759W WO 0172040 A2 WO0172040 A2 WO 0172040A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- media
- data
- content
- signal
- broadcast
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/26603—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25883—Management of end-user data being end-user demographical data, e.g. age, family status or address
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
- H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/454—Content or additional data filtering, e.g. blocking advertisements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
- H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4782—Web browsing, e.g. WebTV
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
- H04N7/165—Centralised control of user terminal ; Registering at central
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17345—Control of the passage of the selected programme
- H04N7/17354—Control of the passage of the selected programme in an intermediate station common to a plurality of user terminals
Definitions
- the present invention relates to a video system that recognizes patterns in digitized images, and more particularly to such systems that isolate symbols or a series of symbols, such as text characters and/or logos in video data streams, and displays information or projects a sound related to the symbols based on a user's preferences.
- the invention also relates to a system that processes the audio input, such as words, music, or other sounds and responds by displaying information or projecting a sound related to the audio input.
- Recognition of text in document images is well known in the art. Recognition of symbols may be based on similar technology. Document scanners and associated optical character recognition (OCR) software are widely available and well understood. However, detection and recognition of text and other symbols in video frames presents unique problems and requires a very different approach than does text in printed documents. Text in printed documents is usually restricted to single-color characters on a uniform background (plain paper) and generally requires only a simple thresholding algorithm to separate the text from the background. By contrast, symbols in scaled-down video images suffer from a variety of noise components, including uncontrolled illumination conditions. Also, the background frequently moves and symbols may be of different color, sizes, orientation, font styles, etc.
- Real-time broadcast, analog tape, and digital video are a few examples of video sources that provide educational and entertainment value to an observer. These sources can trigger or re-trigger an observer's interest in a particular topic or product. For example, a display of a BMW® logo on a video screen may spark an interest in the observer concerning the performance of BMW® automobiles or an interest in the locations of local and national BMW® authorized dealers. These interests can be fleeting and soon forgotten by the observer. The observer may be reluctant to pursue his recently triggered interest, especially if pursuit will interrupt his enjoyment of the current programming.
- a display of a Coca Cola® logo can spark an interest in the number of calories in a 12 ounce can of Coke®, but the interest may not be great enough to motivate the observer to retrieve a can of Coke® to find this information and satisfy the interest. If not promptly attended to, this interest may be forgotten soon afterwards.
- a media display system enhances content by recognizing patterns in the media signal and modifying the media signal responsively to the recognized patterns.
- the media signal could be a television program.
- the television could include a logo of a car company.
- the system would recognize the logo and correlate it with enhanced content stored locally.
- the system would modify the broadcast signal in appropriate way.
- the enhanced content could be a commercial video clip or the phone number of a local car dealer.
- the modification to the broadcast signal could, in such a case, include overlaying the local car dealer's number on the video signal or buffering the broadcast signal and playing the commercial video clip.
- the present invention recognizes patterns in video and/or audio inputs and retrieves and outputs additional information based on the recognized patterns. Patterns may be recognized using any of a variety of known signal processing techniques.
- the method of the invention classifies patterns, looks up the class identified in the signal in a database, and outputs additional content corresponding to the recognized class along with the current video/audio signal thereby enhancing it. So, for example, if the logo of a car company were recognized in the video stream and found to correspond to a class in the database, the system would locate additional data corresponding to the logo, for example the name and address of a local dealer, and output this data as text superimposed on the video stream.
- the response of the system may be customized based on the preferences of the user.
- the logo for the car company may be classifiable using a database of symbol classes employed by the system, the user may not be interested in that car or have some general switch turned off so that the content enhancement does not occur.
- User-specific preference data can take the form of a separate database to be used in conjunction with a generic classification database that contains classification data for a large number of symbols, including ones the user does not care about.
- the user's profile data can be used to set up a symbol classification database such that only classes corresponding to interests of the particular user are stored. The latter has the advantage of making it possible for the volume of data stored locally to be minimized.
- Pending US Patent Applications 09/370,931 , 09/441 ,943, and 09/441,949 describe methods and devices for classifying symbols, especially text and text blocks, in video streams.
- the foregoing US patent applications are hereby incorporated by reference in their entirety as if fully set forth herein.
- the identical method, or any other suitable ones, may be employed to recognize symbols in a video stream for purposes of implementing the instant invention.
- Recognition of speech is a mature technology area that is continually being refined.
- Software that can recognize speech is sufficiently developed to recognize various words, especially if their sound is a trademark or has features that are well-known, such as the famous voice of Tony the Tiger associated with a breakfast cereal.
- the same basic technology used for speech recognition may be applied to the classification of other sounds as well. Thus, the sound of a car accelerating, the sound of a commercial jingle, etc. can also be classified.
- Content enhancements can take many forms. For example, an Internet link could be invoked and indicated to the user either as an on-screen token, as a synthetic speech phrase, etc.
- a Web-TV®-like system may then provide support to allow the user to invoke a link instantly.
- the system could play a sound clip related to the recognized pattern.
- the system can operate automatically by immediately displaying the information once it recognizes a symbol or an array of symbols to which the system is programmed to respond. It could also be programmed to respond automatically when it recognizes a word, phrase, or sound. Examples of potential recognizable patterns include a displayed word, a spoken phrase, a logo or a series of musical notes. Displayed information can consist of text information, a sound clip, objects, faces, pictures, or any other information in any media form (sound, visual, etc.) related to the recognized pattern.
- the information can be superimposed on the video display so that the observer can continue to receive the programming while receiving the additional stored information.
- the video data stream could be automatically buffered so that the additional content does not interfere with the user's enjoyment of an on-going sequence.
- the process of superimposing text on a screen is described in detail in the U.S. patent no. 5,418,576 entitled "Television Receiver with Perceived Contrast reduction in a Predetermined Area of a Picture where Text is .Superimposed.”
- the same techniques can be employed to insert other visual information such as pictures, distortions of existing visual information (e.g., an embossment of the existing visual field on an icon), faces, etc.
- An observer watches a Mercedes Benz® commercial on a television screen.
- the system recognizes the Mercedes logo through the video input and displays information about the latest Mercedes automobile by superimposing the information on the television screen.
- a video input having the text characters "Martin Luther King” on the lower right hand side is received by the system.
- the system recognizes the characters as being the name of the civil rights leader and plays a sound clip of his "I have a dream" speech.
- the system receives and processes the audio input to recognize certain words, phrases, or sounds.
- processing the trademarked chimes of the Intel® Corporation may trigger the system to retrieve the names of the board members of Intel.
- the audio input Microsoft® as recognized through a speech to text converter, can trigger the system to retrieve personal information about William Gates III.
- Enhanced content sources may be, for example, Web URLs, web pages, movie databases, stock trading databases, shopping on-line catalogs, museum information, bookstore on-line, dictionaries, or encyclopedias.
- the information displayed and the different patterns the system is programmed to recognize can be set according to the user's preference. In certain instances, it may be preferable to limit the number of recognized patterns so that the observer is not bombarded with information about topics that are not interesting to the observer. Such limitation can take the form of limiting the number of responses per set time frame or responding to only certain selected patterns.
- the recognizable patterns and the corresponding stored information are downloaded from the Internet.
- the information can be periodically updated by an outside source so that the observer can be supplied with updated information.
- the system could be programmed to request responses from the user to the enhanced content and to update the profile accordingly.
- the system could be programmed to allow the user to set parameters explicitly during a setup procedure.
- the system may also incorporate a software switch for turning off this function or a logon feature so that the system can operate according to the preferences of a currently logged-on user.
- the user can also select the type of information displayed for each patterned input when more than one set of information is available for a single recognized pattern. For example, if the system has both location information and stock price information for the recognizable pattern for Tiffany's, the system can display one or both of the available information depending on the user's preferences.
- the system can also benefit advertisers by directing advertising only to interested users.
- the directed advertising information can include special offers on products or services related to the recognized pattern.
- the delivery of content by advertisers to the set-top boxes of the user for delivery through the system can be administered through the Internet. Users can update their set-top boxes with new content dynamically.
- a system service provider could allow dynamic updating by advertisers of content and some of the rules for display.
- the local content can be controlled dynamically according to the current season (e.g., barbecue grill content might not be stored locally during the winter and snow plowing services might not be stored locally in the summer), according to the advertising campaign underway by the advertiser, etc. as well as according to the local preferences of the user.
- Video or audio inputs can also be modified or intentionally programmed to trigger a response by the system.
- the video/audio input provider can provide programming that accents the recognizable patterns, such as by placing the intended video pattern on the screen with a white background.
- the enhanced item could be identified with, and function as, a clickable link, say to a locally stored media item, an online-store connection, etc.
- This feature could be made sensitive to the type of show or some other parameter (e.g., time of day, channel, etc.) so that it would not occur at all times. So. for example, if a person in a talk show were wearing a wardrobe identifiable with a particular designer, outlet stores where the designer's goods could be purchased might be displayed or otherwise made available through a link.
- the invention will be described in connection with certain preferred embodiments, with reference to the following illustrative figures so that it may be more fully understood.
- FIG. 1 is a diagram illustrating the components that may be used to practice the invention.
- FIG. 2 is a block diagram of the functional elements that may be used to implement the invention according to one embodiment thereof.
- FIG. 3 is a flowchart showing a basic content enhancement method according to an embodiment of the invention.
- FIG. 4 is a figurative image of a display showing two recognizable symbols which may trigger a content enhancement.
- FIG. 5 is a figurative image of a display showing a website superimposed over a video image illustrating a way of enhancing content without interrupting an ongoing multimedia display.
- FIG. 6 is a figurative image of a display showing a website in a picture-in- picture display superimposed over a video image illustrating another way of enhancing content without interrupting an ongoing multimedia display.
- the invention may be used in connection with the environment of a television with Internet capability.
- a computer 240 sends program information to a television 230.
- the computer 240 may be equipped to receive the video signal 270 and control the channel-changing function and to provide Internet browser capability. Commands may be entered into the computer 240 via a memory card or disk 220, a remote controller 210 (connected via an IR port 215) or a keyboard 212 or downloaded via network connection.
- a data link 260 provides Internet connection and an antenna, cable, or satellite link 270 provides audio and/or video data. This could be a telephone line connectable to an Internet service provider or some other suitable data connection. Note that the data and audio/video links 260 and 270 could include the same physical channel.
- the computer 240 preferably has a mass storage device 235, for example a hard disk, to store program schedule information, program applications and upgrades, and other information. Information about the user's preferences and other data can be uploaded into the computer 240 via removable media such as the memory card or disk 220.
- the computer can be a set-top box with processing capability.
- the mass storage can be replaced by volatile memory or non-volatile memory.
- the data can be stored locally or remotely.
- the entire computer 240 could be replaced with a server operating offsite through a link.
- these controllers could send commands through a data channel 260 which could be separate from, or the same as, the physical channel carrying the video.
- the video 270 or other content can be carried by a cable, satellite, RF, or any other physical channel or obtained from a mass storage or removable storage medium.
- a switched physical channel such as a phone line or a virtually switched channel such as ATM or other network suitable for synchronous data communication.
- Content could be asynchronous and tolerant of dropouts so that present-day IP networks could be used.
- the content of the line through which programming content is received could be audio, chat conversation data, web sites, or any other kind of content for which a variety of selections are possible.
- Data can be received through channels other than the separate data link 260. For example, data can be received through the same physical channel as the video or other content. It could even be provided through removable data storage media such as memory card or disk 220.
- the remote control 210 can be replaced by a keyboard, voice command interface, 3D-mouse, joystick, or any other suitable input device.
- Selections can be made by moving a highlighting indicator, identifying a selection symbolically (e.g., by a name or number), or making selections in batch form through a data transmission or via removable media. In the latter case, one or more selections may be stored in some form and transmitted to the computer 240, bypassing the display 170 altogether.
- batch data could come from a portable storage device (e.g. a personal digital assistant, memory card, or smart card, or downloaded). Such a device could have many preferences stored on it for use in various environments so as to customize the computer equipment to be used.
- an advertiser user interface in the form of an advertiser client process 170 provides data to a Host server 175.
- the host server sends data to the computer 240 which stores this data selectively on a local data store, for example, a disk 235.
- the advertiser client process 170 could be implemented via a browser session in which an advertiser, wishing to provide content enhancement through the directed advertising channel provided by an embodiment of the present invention, could upload data including media content and various control data.
- the uploaded data is stored on a service host server 175 for control and periodic updating of the viewer system 200.
- video, audio, and/or other media data are supplied by some source or sources 310, to an output device 350.
- the media signal is modified, displaced, and/or stored by a hard disk video recorder, DVD-RW or WebTV box or Media Output Combiner / Switch / Buffer / Client 390.
- a set-top box (not shown), functionally coterminous with computer 240, may provide the latter functionality.
- a symbol classifier 330 receives the media data and parses the signal to search for recognizable elements. These elements can be graphic images, images, audio sequences, voice finge ⁇ rints, or any other classifiable signal.
- the symbol classifier 330 outputs class identifiers to an enhanced content processor 360.
- a user profile data store 320 stores user preferences with regard to the enhanced media content that may be displayed.
- the user profile data may contain an indication that the user is interested in sports cars and that the user does not mind interruptions of broadcast media to receive enhanced content from advertisers relating sports cars.
- the enhanced content processor 360 applies the class identifier from the symbol classifier to a class / enhanced content correlation data store 370 to find a pointer to media content contained in an enhanced content data store 340.
- the class identifier and the pointer to the media content contained in the enhanced content data store 340 are combined with the user profile data from user profile data store 320 to determine if a content enhancement should be made.
- the enhanced content output controller 395 takes enhanced content from the enhanced content data store 340, generates instructions for the media output combiner / switch 390 responsively to the instructions from the enhanced content processor and commands from an input device 355.
- the enhanced content output controller 395 then outputs selected media content and instructions to the media output combiner / switch 390 to modify the media data stream before it is displayed on the output device 350.
- the user input device 355 also allows the user profile data to be updated in user profile data store 320.
- the symbol classifier may utilize any suitable mechanism for classifying the media data signal stream.
- the methods described in pending US Patent Applications 09/370,931, 09/441,943, and 09/441,949 for classifying symbols, especially text and text blocks, in video streams may be used and preferred, particularly the neural network method and system described in the latter application.
- Recognition of speech is a mature technology area that is continually being refined.
- Software that can recognize speech is sufficiently developed to recognize various words.
- the same and related signal processing technology for example voice-print technology that can be used to identify the voices of particular individuals, may be used by symbol classifier 330.
- the classes can be trademark sounds or sounds with features that are well-known, such as the famous voice of Tony the Tiger associated with a breakfast cereal. Classes can be defined for sounds like the sound of a car accelerating, the sound of a commercial jingle, etc.
- the user profile data store 320 may contain any of a variety of user-modifiable parameters that informs the control processes used in the embodiment described with respect to FIG. 2.
- the profile data may include any of the following or any other suitable parameters.
- Enhancement technique for various types of enhanced content such as websites, commercials, text or audio clips, etc.
- the profile may indicate whether a) the media data should be buffered and the display changed to invoke a web site corresponding to classified media element; b) a video image should be ghosted and continued in the background (See discussion with reference to FIG. 5) while a website display is shown on top of it; c) a link should be placed on the display which can then be selected (for example, using a pointer and button on remote 210); d) a picture-in-picture display (See discussion with reference to FIG. 6) may be shown with the additional content such as a commercial, a website, etc. e) a text overlay is preferred over a high bandwidth item such as a commercial or infomercial
- How classified items should be identified such as by applying a solarize filter to a portion of the video display and halting (and buffering it), increasing contrast, or switching to an alternate view.
- the type of content that is of interest to the user for example, sports cars, beer, weddings, business, technology, literature, weather, etc. a) This could include different levels of interest. So, for example, if the user is generally not particularly interested in weather per se, the user could indicate an interest in receiving enhanced content only if a weather advisory were issued for the user's locality.
- What data sources are available for extracting additional user profile data for example, a set-top box used for television viewing with enhanced electronic program guide information may store user preferences with respect to genre, time of day, preferred channels and programs, etc. that may be used to provide data to the user profile data store 320.
- the class / enhanced content correlation data store 370 may be a lookup table data indicating a correspondence between recognized classes and enhanced content that may be output.
- the class / enhanced content correlation data store 370 may also contain data downloaded from the service host server 175 originating from the advertiser client process 170 indicating certain specific instructions with regard to that content such as an expiration date for a contest, weather conditions that should obtain before the content is output (e.g., only advertise snow plowing services when it is snowing), etc.
- the data stored by the class / enhanced content correlation data store 370 thus points to particular items in the enhanced content data store 340.
- the enhanced content processor 360 takes its instructions from user profile data and the class identifiers supplied by the symbol classifier 330.
- the enhanced content processor obtains the vector(s) required to find the relevant content data and supplies this and control information to the enhanced content output controller 395.
- the media data are sampled and processed by the symbol classifier 330 in step A- 1.
- the symbol classifier attempts, in step A-2. to classify the whole or portions of the media data until it identifies and classifies a pattern. If a pattern is successfully classified in step A- 3, a class identifier is applied to the enhanced content processor 360.
- step A-4 the enhanced content processor 360 applies any conditions or rules in the user profile data and the content provider (e.g., advertiser) data stored in class / enhanced content correlation data store 370 to determine if and what precise content should be used to enhance the media data stream.
- the content provider e.g., advertiser
- step A-5 control passes to step A-6 in which enhanced content output controller 395 controls media output combiner / switch / buffer / client 390 to enhance the media signal accordingly. So, for example, if a car company logo 310 is identified in the media data by the symbol classifier 330, a class identifier would be applied to the enhanced content processor 360.
- the result might be, depending on rules obtained from the user profile data store 320 and class / enhanced content correlation data 370, a website overlay 325.
- a weather warning message 315 were displayed, marquis-style, across the screen, a picture-in-picture (PIP) window 330 indicating the availability of a weather-information website or another broadcast channel could be displayed with an invitation to the viewer to switch to the additional content.
- PIP picture-in-picture
- the concept of enhancing content can include the addition of an icon, selection of which could provide additional media content, or it could simply be the addition of content on the original media stream.
- An example of the latter would be superimposed text with the phone number of a local Ford(R) dealer in response to a Ford(R) commercial or logo.
- the idea of enhanced content can include interactive elements through which the timing, content, scope, etc. of the enhanced content can be controlled by the user in response to the classification of a media element.
- the user can decide whether to link to the additional weather information by selecting an ephemeral link (the PIP window 330) or to ignore it. If the user selects the link, more media content is displayed than if the user ignores it.
- the enhanced content output controller 395 is responsive to the control parameters applied by the enhanced content processor 360.
- the control parameters can include a basic process to be followed by the enhanced content output controller 395 along with a set of pointers to specific items of content within the enhanced content data store 340.
- the basic process might be to highlight a specific region of the display for a specified amount of time, to define a selectable region on the display and to trigger a web link upon selection of that region via the input device 355.
- the media content could be a URL, a video clip, a sound, or a bit of formatted text.
- the content along with detailed instructions for modifying the media data stream are sent to the media output combiner / switch / buffer / client 390.
- the latter implements the instructions to overlay text, buffer the media data, provide Internet client services, to invoke a website, etc. according to the commands from the enhanced content output controller 395.
- the enhanced content output controller 395 may transmit more than one set of instructions and media items. For example, if the initial phase of enhanced content is the generation of a web link, only the link media data and instructions defining the superimposed link would be transmitted.
- further content such as a URL would then be supplied output to the media output combiner / switch / buffer / client 390.
- the input device 355 could be a light pen, a TV-style remote controller, a keyboard, a mouse, or any other suitable device for generating commands.
- the output device 350 could be a TV, a monitor, a TV-wall, broadcast or multicast channel, chat client. Internet console, or any other suitable device.
- Media data can include any type of information content including text, video, audio, live data by closed circuit system, chat data, IP packets, etc.
- the output device 350 could also include more than one physical device. For example, it could be multiple monitors where one is used to output enhanced content and the other outputs the original media data.
- electronic program guide data may indicate the genre of the media data stream (e.g., a TV broadcast in the comedy genre).
- Other data that may be relevant to decisions to supply enhanced content may include the time of day, day of year, current weather, name of the broadcast item appearing in the media signal, etc.
- processing of video or other streaming information could be implemented as a back end process rather than at the client (e.g., the remote terminal or television set-top box near the viewer).
- client e.g., the remote terminal or television set-top box near the viewer.
- only control information need be transmitted to the client process and the processing and storage capacity could be reduced. That is, all the possible symbol classes and information for classifying raw data could be stored at the back end processor.
- the content enhancement data could be transmitted as embedded control information using any suitable process of such as video watermarks, data inserted in the blanking interval, etc. Control data could also be delivered by XML or other meta standards for multimedia data packaging including MPEG-7, ATSC, DVB, etc.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP01925426A EP1205075A2 (en) | 2000-03-21 | 2001-03-12 | System and method for automatic content enhancement of multimedia output device |
JP2001568614A JP2003528498A (en) | 2000-03-21 | 2001-03-12 | System and method for automatic content enhancement of a multimedia output device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US53284500A | 2000-03-21 | 2000-03-21 | |
US09/532,845 | 2000-03-21 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2001072040A2 true WO2001072040A2 (en) | 2001-09-27 |
WO2001072040A3 WO2001072040A3 (en) | 2002-03-21 |
Family
ID=24123412
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2001/002759 WO2001072040A2 (en) | 2000-03-21 | 2001-03-12 | System and method for automatic content enhancement of multimedia output device |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP1205075A2 (en) |
JP (1) | JP2003528498A (en) |
TW (1) | TW518890B (en) |
WO (1) | WO2001072040A2 (en) |
Cited By (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1311124A1 (en) * | 2001-11-13 | 2003-05-14 | Matsushita Electric Industrial Co., Ltd. | Selective protection method for images transmission |
WO2003043329A2 (en) * | 2001-11-16 | 2003-05-22 | Thales | Control broadcast programme signal, control write and read systems, related production and broadcasting channel |
WO2003050733A1 (en) * | 2001-12-11 | 2003-06-19 | Koninklijke Philips Electronics N.V. | Shopping through television |
EP1343323A2 (en) * | 2002-03-07 | 2003-09-10 | Chello Broadband NV | Display of enhanced content |
EP1343320A2 (en) * | 2002-03-07 | 2003-09-10 | Chello Broadband NV | Media playout system |
WO2003105463A2 (en) * | 2002-06-10 | 2003-12-18 | Koninklijke Philips Electronics N.V. | Content augmentation based on personal profiles |
WO2004004336A3 (en) * | 2002-06-28 | 2004-02-19 | Thomson Licensing Sa | Audiovisual program synchronization system and method |
FR2848767A1 (en) * | 2002-12-17 | 2004-06-18 | Nptv | Video broadcasting signal time marking method for synchronizing video program with enriching function, involves generating marking signal when graphical unit in video sequence is detected, and associating signal with part of sequence |
WO2005020579A1 (en) * | 2003-08-25 | 2005-03-03 | Koninklijke Philips Electronics, N.V. | Real-time media dictionary |
WO2009027110A1 (en) * | 2007-08-28 | 2009-03-05 | Sony Ericsson Mobile Communications Ab | Methods, devices, and computer program products for providing unobtrusive video advertising content |
EP2081385A2 (en) * | 2008-01-15 | 2009-07-22 | Mitsubishi Electric Corporation | Application execution terminal |
US7689613B2 (en) | 2006-10-23 | 2010-03-30 | Sony Corporation | OCR input to search engine |
US7814524B2 (en) | 2007-02-14 | 2010-10-12 | Sony Corporation | Capture of configuration and service provider data via OCR |
JP2010266880A (en) * | 2010-06-23 | 2010-11-25 | Sony Corp | Mobile terminal device, information processing method, and program |
US7966552B2 (en) | 2006-10-16 | 2011-06-21 | Sony Corporation | Trial selection of STB remote control codes |
US7991271B2 (en) | 2007-02-14 | 2011-08-02 | Sony Corporation | Transfer of metadata using video frames |
US8035656B2 (en) | 2008-11-17 | 2011-10-11 | Sony Corporation | TV screen text capture |
US8077263B2 (en) | 2006-10-23 | 2011-12-13 | Sony Corporation | Decoding multiple remote control code sets |
WO2012027594A2 (en) | 2010-08-27 | 2012-03-01 | Intel Corporation | Techniques for augmenting a digital on-screen graphic |
WO2012084908A1 (en) * | 2010-12-23 | 2012-06-28 | Eldon Technology Limited | Recognition of images within a video based on a stored representation |
US8320674B2 (en) | 2008-09-03 | 2012-11-27 | Sony Corporation | Text localization for image and video OCR |
US8438589B2 (en) | 2007-03-28 | 2013-05-07 | Sony Corporation | Obtaining metadata program information during channel changes |
GB2500653A (en) * | 2012-03-28 | 2013-10-02 | Sony Corp | Broadcast audio video content distribution system with associated metadata defining links to other content |
DE102012212435A1 (en) * | 2012-07-16 | 2014-01-16 | Axel Springer Digital Tv Guide Gmbh | Receiving- and reproducing apparatus for e.g. contents of TV set, has display element in which apparatus displays characteristic portions based on request of user about interaction options parallel to reproduction of media content |
US8655805B2 (en) | 2010-08-30 | 2014-02-18 | International Business Machines Corporation | Method for classification of objects in a graph data stream |
US8763038B2 (en) | 2009-01-26 | 2014-06-24 | Sony Corporation | Capture of stylized TV table data via OCR |
WO2014137942A1 (en) * | 2013-03-05 | 2014-09-12 | Google Inc. | Surfacing information about items mentioned or presented in a film in association with viewing the film |
WO2014189891A1 (en) * | 2013-05-20 | 2014-11-27 | Google Inc. | Personalized annotations |
EP2919478A1 (en) * | 2014-03-14 | 2015-09-16 | Samsung Electronics Co., Ltd. | Content processing apparatus and method for providing an event |
WO2015144248A1 (en) * | 2014-03-28 | 2015-10-01 | Arcelik Anonim Sirketi | Image display device with automatic subtitle generation function |
US9432722B2 (en) | 2014-07-23 | 2016-08-30 | Comigo Ltd. | Reducing interference of an overlay with underlying content |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI484831B (en) * | 2008-11-13 | 2015-05-11 | Mstar Semiconductor Inc | Multimedia broadcasting method and multimedia broadcasting device thereof |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4204689A1 (en) * | 1992-02-17 | 1993-08-19 | Peter Biet | Automatic recording control circuitry for domestic video recorder - allows interruption of recording mode for blanking out advertising slots inserted in transmitted programme. |
US5818510A (en) * | 1994-10-21 | 1998-10-06 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
WO1999004568A1 (en) * | 1997-07-18 | 1999-01-28 | Tvcompass.Com Limited | Communication system and method |
US5929849A (en) * | 1996-05-02 | 1999-07-27 | Phoenix Technologies, Ltd. | Integration of dynamic universal resource locators with television presentations |
US6029045A (en) * | 1997-12-09 | 2000-02-22 | Cogent Technology, Inc. | System and method for inserting local content into programming content |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
BR9714949A (en) * | 1996-12-20 | 2005-04-12 | Princeton Video Image Inc | Superior adjustment device for targeted electronic insertion of video indications |
EP1013087A4 (en) * | 1997-08-27 | 2003-01-02 | Starsight Telecast Inc | Systems and methods for replacing television signals |
IL127790A (en) * | 1998-04-21 | 2003-02-12 | Ibm | System and method for selecting, accessing and viewing portions of an information stream(s) using a television companion device |
-
2001
- 2001-03-12 TW TW90105695A patent/TW518890B/en not_active IP Right Cessation
- 2001-03-12 WO PCT/EP2001/002759 patent/WO2001072040A2/en active Application Filing
- 2001-03-12 EP EP01925426A patent/EP1205075A2/en not_active Withdrawn
- 2001-03-12 JP JP2001568614A patent/JP2003528498A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4204689A1 (en) * | 1992-02-17 | 1993-08-19 | Peter Biet | Automatic recording control circuitry for domestic video recorder - allows interruption of recording mode for blanking out advertising slots inserted in transmitted programme. |
US5818510A (en) * | 1994-10-21 | 1998-10-06 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
US5929849A (en) * | 1996-05-02 | 1999-07-27 | Phoenix Technologies, Ltd. | Integration of dynamic universal resource locators with television presentations |
WO1999004568A1 (en) * | 1997-07-18 | 1999-01-28 | Tvcompass.Com Limited | Communication system and method |
US6029045A (en) * | 1997-12-09 | 2000-02-22 | Cogent Technology, Inc. | System and method for inserting local content into programming content |
Cited By (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1311124A1 (en) * | 2001-11-13 | 2003-05-14 | Matsushita Electric Industrial Co., Ltd. | Selective protection method for images transmission |
WO2003043329A3 (en) * | 2001-11-16 | 2003-12-11 | Thales Sa | Control broadcast programme signal, control write and read systems, related production and broadcasting channel |
WO2003043329A2 (en) * | 2001-11-16 | 2003-05-22 | Thales | Control broadcast programme signal, control write and read systems, related production and broadcasting channel |
FR2832580A1 (en) * | 2001-11-16 | 2003-05-23 | Thales Sa | BROADCAST PROGRAM SIGNAL WITH ORDER, ORDER RECORDING AND READING SYSTEMS, RELATED PRODUCTION AND BROADCAST CHAIN |
WO2003050733A1 (en) * | 2001-12-11 | 2003-06-19 | Koninklijke Philips Electronics N.V. | Shopping through television |
US8261306B2 (en) | 2001-12-11 | 2012-09-04 | Koninklijke Philips Electronics N.V. | System for and method of shopping through television |
EP1343323A3 (en) * | 2002-03-07 | 2004-01-02 | Chello Broadband NV | Display of enhanced content |
AU2003200899B2 (en) * | 2002-03-07 | 2007-11-01 | Upc Broadband Operations Bv | Display of enhanced content |
EP1343320A2 (en) * | 2002-03-07 | 2003-09-10 | Chello Broadband NV | Media playout system |
EP1343320A3 (en) * | 2002-03-07 | 2004-03-03 | Chello Broadband NV | Media playout system |
US8132223B2 (en) | 2002-03-07 | 2012-03-06 | Upc Broadband Operations Bv | Display of enhanced content |
EP1343323A2 (en) * | 2002-03-07 | 2003-09-10 | Chello Broadband NV | Display of enhanced content |
US8826365B2 (en) | 2002-03-07 | 2014-09-02 | Upc Broadband Operations Bv | Media playout system |
GB2387984B (en) * | 2002-03-07 | 2005-11-09 | Chello Broadband N V | Display of enhanced content |
WO2003105463A2 (en) * | 2002-06-10 | 2003-12-18 | Koninklijke Philips Electronics N.V. | Content augmentation based on personal profiles |
WO2003105463A3 (en) * | 2002-06-10 | 2004-02-26 | Koninkl Philips Electronics Nv | Content augmentation based on personal profiles |
US7373336B2 (en) | 2002-06-10 | 2008-05-13 | Koninklijke Philips Electronics N.V. | Content augmentation based on personal profiles |
CN100379294C (en) * | 2002-06-28 | 2008-04-02 | 汤姆森许可贸易公司 | Synchronization system and method for audiovisual programmes |
KR101011140B1 (en) * | 2002-06-28 | 2011-01-26 | 톰슨 라이센싱 | Synchronization system and method for audiovisual programmes, associated devices and methods |
US8612544B2 (en) | 2002-06-28 | 2013-12-17 | Thomson Licensing | Audiovisual program synchronization system and method |
WO2004004336A3 (en) * | 2002-06-28 | 2004-02-19 | Thomson Licensing Sa | Audiovisual program synchronization system and method |
WO2004057870A3 (en) * | 2002-12-17 | 2004-08-12 | Nptv | Video broadcasting |
WO2004057870A2 (en) * | 2002-12-17 | 2004-07-08 | Nptv | Video broadcasting |
FR2848767A1 (en) * | 2002-12-17 | 2004-06-18 | Nptv | Video broadcasting signal time marking method for synchronizing video program with enriching function, involves generating marking signal when graphical unit in video sequence is detected, and associating signal with part of sequence |
WO2005020579A1 (en) * | 2003-08-25 | 2005-03-03 | Koninklijke Philips Electronics, N.V. | Real-time media dictionary |
US7966552B2 (en) | 2006-10-16 | 2011-06-21 | Sony Corporation | Trial selection of STB remote control codes |
US8077263B2 (en) | 2006-10-23 | 2011-12-13 | Sony Corporation | Decoding multiple remote control code sets |
US7689613B2 (en) | 2006-10-23 | 2010-03-30 | Sony Corporation | OCR input to search engine |
US8629942B2 (en) | 2006-10-23 | 2014-01-14 | Sony Corporation | Decoding multiple remote control code sets |
US7991271B2 (en) | 2007-02-14 | 2011-08-02 | Sony Corporation | Transfer of metadata using video frames |
US9241134B2 (en) | 2007-02-14 | 2016-01-19 | Sony Corporation | Transfer of metadata using video frames |
US9124922B2 (en) | 2007-02-14 | 2015-09-01 | Sony Corporation | Capture of stylized TV table data via OCR |
US7814524B2 (en) | 2007-02-14 | 2010-10-12 | Sony Corporation | Capture of configuration and service provider data via OCR |
US8438589B2 (en) | 2007-03-28 | 2013-05-07 | Sony Corporation | Obtaining metadata program information during channel changes |
US8621498B2 (en) | 2007-03-28 | 2013-12-31 | Sony Corporation | Obtaining metadata program information during channel changes |
US7987478B2 (en) | 2007-08-28 | 2011-07-26 | Sony Ericsson Mobile Communications Ab | Methods, devices, and computer program products for providing unobtrusive video advertising content |
WO2009027110A1 (en) * | 2007-08-28 | 2009-03-05 | Sony Ericsson Mobile Communications Ab | Methods, devices, and computer program products for providing unobtrusive video advertising content |
EP2081385A3 (en) * | 2008-01-15 | 2010-10-20 | Mitsubishi Electric Corporation | Application execution terminal |
EP2081385A2 (en) * | 2008-01-15 | 2009-07-22 | Mitsubishi Electric Corporation | Application execution terminal |
US8320674B2 (en) | 2008-09-03 | 2012-11-27 | Sony Corporation | Text localization for image and video OCR |
US8035656B2 (en) | 2008-11-17 | 2011-10-11 | Sony Corporation | TV screen text capture |
US8763038B2 (en) | 2009-01-26 | 2014-06-24 | Sony Corporation | Capture of stylized TV table data via OCR |
JP2010266880A (en) * | 2010-06-23 | 2010-11-25 | Sony Corp | Mobile terminal device, information processing method, and program |
US20130321570A1 (en) * | 2010-08-27 | 2013-12-05 | Bran Ferren | Techniques for object based operations |
EP2609733A2 (en) * | 2010-08-27 | 2013-07-03 | Intel Corporation | Techniques for object based operations |
EP2609732A2 (en) * | 2010-08-27 | 2013-07-03 | Intel Corporation | Techniques for augmenting a digital on-screen graphic |
US9788075B2 (en) | 2010-08-27 | 2017-10-10 | Intel Corporation | Techniques for augmenting a digital on-screen graphic |
EP2609732A4 (en) * | 2010-08-27 | 2015-01-21 | Intel Corp | Techniques for augmenting a digital on-screen graphic |
EP2609733A4 (en) * | 2010-08-27 | 2015-02-18 | Intel Corp | Techniques for object based operations |
WO2012027594A2 (en) | 2010-08-27 | 2012-03-01 | Intel Corporation | Techniques for augmenting a digital on-screen graphic |
US9516391B2 (en) | 2010-08-27 | 2016-12-06 | Intel Corporation | Techniques for object based operations |
US8655805B2 (en) | 2010-08-30 | 2014-02-18 | International Business Machines Corporation | Method for classification of objects in a graph data stream |
WO2012084908A1 (en) * | 2010-12-23 | 2012-06-28 | Eldon Technology Limited | Recognition of images within a video based on a stored representation |
US10070201B2 (en) | 2010-12-23 | 2018-09-04 | DISH Technologies L.L.C. | Recognition of images within a video based on a stored representation |
GB2500653A (en) * | 2012-03-28 | 2013-10-02 | Sony Corp | Broadcast audio video content distribution system with associated metadata defining links to other content |
US9532107B2 (en) | 2012-03-28 | 2016-12-27 | Sony Corporation | Content distribution |
DE102012212435A1 (en) * | 2012-07-16 | 2014-01-16 | Axel Springer Digital Tv Guide Gmbh | Receiving- and reproducing apparatus for e.g. contents of TV set, has display element in which apparatus displays characteristic portions based on request of user about interaction options parallel to reproduction of media content |
WO2014137942A1 (en) * | 2013-03-05 | 2014-09-12 | Google Inc. | Surfacing information about items mentioned or presented in a film in association with viewing the film |
US9658994B2 (en) | 2013-05-20 | 2017-05-23 | Google Inc. | Rendering supplemental information concerning a scheduled event based on an identified entity in media content |
WO2014189891A1 (en) * | 2013-05-20 | 2014-11-27 | Google Inc. | Personalized annotations |
US20150264450A1 (en) * | 2014-03-14 | 2015-09-17 | Samsung Electronics Co., Ltd. | Content processing apparatus and method for providing an event |
EP2919478A1 (en) * | 2014-03-14 | 2015-09-16 | Samsung Electronics Co., Ltd. | Content processing apparatus and method for providing an event |
US9807470B2 (en) | 2014-03-14 | 2017-10-31 | Samsung Electronics Co., Ltd. | Content processing apparatus and method for providing an event |
WO2015144248A1 (en) * | 2014-03-28 | 2015-10-01 | Arcelik Anonim Sirketi | Image display device with automatic subtitle generation function |
US9432722B2 (en) | 2014-07-23 | 2016-08-30 | Comigo Ltd. | Reducing interference of an overlay with underlying content |
Also Published As
Publication number | Publication date |
---|---|
WO2001072040A3 (en) | 2002-03-21 |
TW518890B (en) | 2003-01-21 |
EP1205075A2 (en) | 2002-05-15 |
JP2003528498A (en) | 2003-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2001072040A2 (en) | System and method for automatic content enhancement of multimedia output device | |
AU739891B2 (en) | Interactivity with audiovisual programming | |
US6064420A (en) | Simulating two way connectivity for one way data streams for multiple parties | |
US10567834B2 (en) | Using an audio stream to identify metadata associated with a currently playing television program | |
US6249914B1 (en) | Simulating two way connectivity for one way data streams for multiple parties including the use of proxy | |
US7278154B2 (en) | Host apparatus for simulating two way connectivity for one way data streams | |
EP1053641B1 (en) | A hand-held apparatus for simulating two way connectivity for one way data streams | |
JP4044965B2 (en) | Set-top device and method for inserting selected video into video broadcast | |
US7269837B1 (en) | Interactive television advertising method | |
KR101591535B1 (en) | Techniques to consume content and metadata | |
EP2293301A1 (en) | Method for generating streaming media increment description file and method and system for cutting in multimedia in streaming media | |
US20030208755A1 (en) | Conversational content recommender | |
US20030055722A1 (en) | Method and apparatus for control of advertisements | |
KR20010089778A (en) | Fusion of media for information sources | |
US20020152117A1 (en) | System and method for targeting object oriented audio and video content to users | |
US20020010589A1 (en) | System and method for supporting interactive operations and storage medium | |
US20070229706A1 (en) | Information reading apparatus | |
KR100374251B1 (en) | Multi-Media Offering System using Internet and Offering Method thereof | |
JP2000032363A (en) | Television device and television system | |
WO2000033197A1 (en) | Method and apparatus for content-linking supplemental information with time-sequence data | |
US20090037387A1 (en) | Method for providing contents and system therefor | |
MXPA01010910A (en) | Advertisement selection based on user action in an electronic program guide. | |
JP2003505945A (en) | Method and apparatus for displaying multimedia information with a broadcast program | |
KR20030065719A (en) | Data broadcasting service apparatus and method | |
KR20020001141A (en) | Internet broadcasting system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): JP |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2001925426 Country of ref document: EP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
ENP | Entry into the national phase in: |
Ref country code: JP Ref document number: 2001 568614 Kind code of ref document: A Format of ref document f/p: F |
|
AK | Designated states |
Kind code of ref document: A3 Designated state(s): JP |
|
AL | Designated countries for regional patents |
Kind code of ref document: A3 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
WWP | Wipo information: published in national office |
Ref document number: 2001925426 Country of ref document: EP |