WO2001001331A1 - Digital watermarks in tv and radio broadcasts - Google Patents

Digital watermarks in tv and radio broadcasts Download PDF

Info

Publication number
WO2001001331A1
WO2001001331A1 PCT/US2000/017157 US0017157W WO0101331A1 WO 2001001331 A1 WO2001001331 A1 WO 2001001331A1 US 0017157 W US0017157 W US 0017157W WO 0101331 A1 WO0101331 A1 WO 0101331A1
Authority
WO
WIPO (PCT)
Prior art keywords
receiver
watermark
signal
data
content
Prior art date
Application number
PCT/US2000/017157
Other languages
French (fr)
Inventor
Bruce L. Davis
Geoffrey B. Rhoads
Original Assignee
Digimarc Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digimarc Corporation filed Critical Digimarc Corporation
Priority to AU57577/00A priority Critical patent/AU5757700A/en
Publication of WO2001001331A1 publication Critical patent/WO2001001331A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2542Management at additional data server, e.g. shopping server, rights management server for selling goods, e.g. TV shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • Broadcast signals can carry in-band digital information though use of known watermark technology (a few examples of which are detailed in the cited patents and applications). This digital information can be used to direct a user to a particular internet site or resident application for supplemental or complimentary information, entertainment, merchandising, and commerce opportunities.
  • FIG. 1 shows an illustrative embodiment of the present invention.
  • an illustrative embodiment 10 of the present invention includes a radio or television transmitter 12, a portable or fixed radio or television receiver 14, a personal computer or other network connection 16, and remote resources 18 available through the internet 20.
  • the transmitter 12 is conventional, but includes a watermark encoder to embed a digital watermark in the transmitted signal.
  • the receiver 14 is likewise generally conventional (e.g., including an RF amplifier, a mixer, one or more intermediate frequency amplifiers, and a detector), but additionally includes a watermark detector 22, a button or other user interface feature 24 (which may be on a remote control associated with the receiver), and an external interface 26 (e.g., infrared, wireless, Bluetooth, serial, USB, firewire, etc.).
  • the receiver can be a species of computer.
  • the watermark payload data is combined with a pseudo-random carrier signal (e.g., by multiplying, XORing, etc.), and combined with (e.g. added to) the audio or video content signal.
  • the carrier signal may be shaped in various ways. For example, zeroes in the carrier signal can be omitted (e.g., leaving values of-1 and 1, or -2, -1, 1, and 2, etc.), or the frequency spectrum of the carrier can be tailored to match the frequency spectrum of the signal being encoded, etc.
  • the watermarking also encodes a calibration signal with the payload data. This calibration signal is used in decoding, as detailed in the cited patents and applications (e.g., to permit accurate detection of the payload data even from a corrupted signal).
  • the computer 16 can be a personal computer, an internet appliance, or other network interface device.
  • the computer includes provision for communicating with the external link of the receiver 14, and also includes a network connection for coupling to the internet 20.
  • the remote resources 18 include the myriad servers coupled to the internet to provide information, entertainment, and commerce opportunities to users thereof.
  • audio material (such as a song or an advertisement) is transmitted to the receiver in the usual manner. Encoded in the audio signal is digital information represented as a watermark. Upon decoding at the receiver, this information is transmitted to the computer 16 (or stored for later transmission if the receiver does not have a persistent network connection).
  • the encoded information need only comprise a unique identifier, or database key.
  • the identifier serves to initiate from such device one or more supplemental or complimentary applications corresponding to the encoded broadcast content, such as purchasing a song for download, purchasing a CD containing the song, viewing news and concert schedules for recording artists, viewing a music video, etc.
  • Similar arrangements and benefits can be delivered through watermarked spoken word programming, and through television (video) broadcasts.
  • the broadcasts can be distributed through any of the conventional methods other than over-the-air, including cable and satellite.
  • the infrastructure through which the receiver 16 couples to the remote resources 18 can take various forms.
  • the user device e.g., receiver 14 or computer 16
  • That computer includes a database that stores a URL corresponding to each watermark ID.
  • the router computer Upon receiving a watermark ID, the router computer returns the corresponding URL to the originating device (12 or 16).
  • a browser at the originating device then establishes a link to the specified URL. That URL then provides the information, entertainment, or commerce opportunity corresponding to the encoded broadcast.
  • the just-detailed system is advantageous in that it permits the encoding of a short identifier in the broadcast (e.g., instead of a lengthy URL). Moreover, the corresponding URL can be changed over time, as needed. Other embodiments of the present invention, however, do not need this level of complexity; the encoded identifier can more directly trigger the desired remote resource response.
  • Amazon's patent 5,960,411), or an order form could be invoked on the screen of the computer 16 as soon as the data was transmitted to it.
  • the digital watermark transmitted with the song could cause a picture of the singer to appear on the personal computer.
  • users could indicate their like or dislike for the song.
  • the link can be used to allow the user to indicate a "vote" concerning a subject being played over the audio link.
  • the embedded ID identifies the subject matter being voted on, and likewise serves to specify the remote resource 18 that is to receive the vote. To that resource the user's computer can dispatch a "yes” or “no” vote, a "like” or “dislike” preference, etc., by corresponding data sent over the internet.
  • embodiments like that detailed can be used to enable interactive advertisement and promotion for local radio and TV broadcasters, generating traffic and fulfillment activities for local merchants.
  • network broadcast content is locally customized with links corresponding to local merchants and other resources.
  • a Ford advertisement may be customized to initiate a link to a local Ford dealership.
  • nationally-distributed broadcast content can include links suitable for a national audience (e.g., to corporate web sites of advertisers).
  • the local broadcaster may process such network feeds to identify such national links.
  • the local broadcast processor may look-up a corresponding local link.
  • the existing national link data can then be replaced with the local link data.
  • the broadcast may have been encoded with "blank" watermark payload bits that can be filled-in by the local broadcaster without removing the national link. These supplemental payload bits can serve to indicate the locality in which the payload was received, permitting a router computer or the like to return a URL appropriate to that area.
  • satellite content distribution can enjoy a virtual high speed asynchronous network capability by downstreaming relatively small digital watermark payloads as segues to PCs and other devices with higher bandwidth connections.
  • the distributor sends "pointers" that direct receivers and recipients to certain applications on the other networks; essentially, off-loading the heavy lifting to other carriers so as to provide more value to its customers and content providers with very little bandwidth consumption.
  • Auxiliary content that is not desired by all satellite subscribers is not sent over the satellite; those subscribers employ the satellite-conveyed watermark data to obtain such auxiliary content using other connections (e.g., terrestrial internet).
  • Radio over the internet is increasingly popular.
  • the screen of the internet terminal is poorly utilized in such radio broadcasts.
  • a watermark decoded from a web broadcast is decoded, and is used to enhance the experience by supplementing the audio with accompanying visual presentations.
  • the display presents streaming and other media on the screen while the internet radio is playing, such ancillary content being related to the then-broadcast radio content.
  • This ancillary visual information can include concert schedules, fan news about the musician or person being broadcast, commercial web sites offering CDs, etc.
  • the display can present associated commercial information, with accompanying visual and/or video promotional materials.
  • these displays can include the opportunity to buy the advertised product, or download a "trial" version.
  • the visual displays can include conventional user interface features, such as buttons that can be selected by a user to initiate a purchase transaction or other operation in known manners.
  • the computer radio decodes embedded watermark data from the audio programming.
  • the watermark literally conveys the address of one or more web sites that are to be displayed.
  • the computer can be programmed to recognize these embedded web addresses, and display the corresponding web content in one or more separate browser windows. These windows can be tiled or otherwise presented on the display screen, together with the radio user interface. (The ancillary windows may overlie the radio interface in some embodiments.)
  • the embedded watermark information also changes. Web displays corresponding to the earlier-decoded watermark are discontinued, and new web displays corresponding to the current watermark information are presented.
  • the audio broadcast need not be literally encoded with web addresses.
  • the audio can be encoded with data including an identifier (e.g., 32 bits).
  • the computer connects to a remote web server (whose address is pre-identified) and provides this identifier.
  • the remote server responds with the web addresses of the content to be displayed.
  • the local computer then loads and displays these web pages, as in the first embodiment.
  • the embedded identifier also changes, leading to changed web addresses corresponding to the current audio material.
  • a watermark-aware radio consider a car radio that has a "capture" button on the front panel (or other form of user interface, e.g., a Capture icon on a GUI). If a user hears a song they want to record and keep, they press the Capture button while the song is playing. In response, the radio device decodes a watermark embedded in the music, and thereby knows the identity of the music. The radio then makes a wireless transmission identifying the user and the desired song. A local repeater network picks up the wireless signal and relays it (e.g. by wireless rebroadcast, by modem, or other communication medium) to a music clearinghouse. The clearinghouse charges the user a nominal fee (e.g. via a prearranged credit card), and queues the music for download to a predetermined location associated with the user.
  • a nominal fee e.g. via a prearranged credit card
  • the predetermined location is the user's own computer. If a "live" IP address is known for the user's computer, the music can be transferred immediately. If the user's computer is only occasionally connected to the internet, the music can be stored at a web site (e.g. protected with a user-set password), and can be downloaded to the user's computer whenever it is convenient.
  • a "live" IP address is known for the user's computer. If the user's computer is only occasionally connected to the internet, the music can be stored at a web site (e.g. protected with a user-set password), and can be downloaded to the user's computer whenever it is convenient.
  • the predetermined location is a personal music library maintained by the user.
  • the library can take the form, e.g., of a hard-disk or semiconductor memory array in which the user customarily stores music.
  • This storage device is adapted to provide music data to one or more playback units employed by the user (e.g. a personal MP3 player, a home stereo system, a car stereo system, etc.).
  • the library is physically located at the user's residence, but could be remotely sited, e.g. consolidated with the music libraries of many other users at a central location.
  • the personal music library can have its own internet connection. Or it can be equipped with wireless capabilities, permitting it to receive digital music from wireless broadcasts (e.g. from the clearinghouse). In either case, the library can provide music to the user's playback devices by short-range wireless broadcast. By such arrangement, a user can conveniently compile an archive of favorite music - even while away from home.
  • the radio can be a portable unit (e.g. a boombox, a Walkman radio, etc.) or a home device, rather than an automotive unit.
  • the UI feature employed by the user to initiate capture a musical selection need not be a button (physical or on-screen).
  • it can be a voice-recognition system that responds to spoken commands, such as "capture” or "record.”
  • it can be a form of gesture interface.
  • the radio can decode watermarks from all received programs, and keep the most recent in a small FIFO memory.
  • the user need not issue the capture instruction while the song is playing, but can do so even after the song is finished.
  • data corresponding to the watermark can be made available to the user in various forms. For example, it can be presented to the user on an LCD screen, identifying the artist and song currently playing. If a corresponding UI button is activated, the device can so-identify the last several selections. Moreover, the data need not be presented to the user in displayed form; it can be annunciated by known computer-speech technologies instead.
  • the device In embodiments in which the watermark does not convey ASCII text data, but instead conveys UIDs (unique identifiers), or coded abbreviations, the device must generally interpret this data before presenting it to the user.
  • the device is a pocket-sized FM radio and is equipped with a 1 megabyte semiconductor non-volative RAM memory.
  • the memory includes a data structure that serves as a look-up table, matching code numbers to artist names and song titles. When the user queries the device to learn the identify of a song, the memory is indexed in accordance with one or more fields from the decoded watermark, and the resulting textual data from the memory (e.g. song title and artist) is annunciated or displayed to the user.
  • the RF receiver provides a ready mechanism for providing such updated data.
  • the radio "awakens" briefly at otherwise idle moments and tunes to a predetermined frequency at which updated data for the memory is broadcast, either in a baseband broadcast channel, or in an ancillary (e.g. SCA) channel. Or such data can be repeatedly transmitted on an SCA channel, received whenever the radio is turned on.
  • ancillary e.g. SCA
  • internet delivery of updated memory data can be substituted for wireless delivery. For example, the artist/song title memory in the personal player can be updated by placing the player in a "nest" every evening.
  • the nest (which may be integrated with a battery charger for the appliance) can have an internet connection, and can exchange data with the personal device by infrared, inductive, or other proximity-coupling technologies, or through metal contacts. Each evening, the nest can receive an updated collection of artists/song titles, and can rewrite the memory in the personal device accordingly. By such arrangement, the watermark data can always be properly intepreted for presentation to the user.
  • the "Capture” concepts noted above can be extended to other functions as well.
  • One is akin to forwarding of email. If a consumer hears a song that another friend would enjoy, the listener can send a copy of the song to the friend.
  • This instruction can be issued by pressing a "Send” button, or by invoking a similar function on a graphical (or voice- or gesture-responsive) user interface.
  • the appliance so-instructed can query the person as to the recipient.
  • the person can designate the desired recipient(s) by typing in a name, or a portion thereof sufficient to uniquely identify the recipient. Or more typically, the person can speak the recipient's name.
  • a voice recognition unit can listen to the spoken instructions and identify the desired recipient.
  • An "address book' ike feature has the requisite information for the recipient (e.g., the web site, IP address, or other data identifying the location to which music for that recipient should stored or queued, the format in which the music should be delivered, etc.) stored therein.
  • the appliance dispatches instructions to the clearinghouse, including an authorization to debit the sender's credit card for the music charge.
  • the clearinghouse attends to delivery of the music in a desired manner to the specified recipient.
  • a listener may query the appliance (by voice, GUI or physical button, textual, gesture, or other input) to identify CDs on which the then-playing selection is recorded. Or the listener may query the appliance for the then-playing artist's concert schedule.
  • the appliance can contact a remote database, relay the query, and forward data from the watermark payload identifying the artist and/or song title to which the query relates.
  • the database locates the requested data, and relays same back to the appliance for presentation (via a display, by machine speech, or other output) to the user.
  • the user can continue the dialog with a further instruction, e.g., to buy one of the CDs on which the then-playing song is included.
  • this instruction may be entered by voice, GUI, etc., and dispatched from the appliance to the clearinghouse, which can then complete the transaction in accordance with pre-stored information (e.g. credit card account number, mailing address, etc.).
  • a confirming message is relayed to the appliance for presentation to the user.
  • a user can query the appliance as to the artist or song-title of the selection currently playing.
  • the appliance can consult the embedded watermark data (and optionally consult a memory to determine the textual names associated with coded watermark data), and provide the requested information to the user (e.g., by a display, annunciation, or other output).
  • the foregoing concepts e.g. Capture, Send, etc.
  • the broadcast is not encoded with different data at different times (e.g., a different payload for each song).
  • the broadcast is constantly encoded with a single identifier, e.g., identifying the broadcaster.
  • the encoding can be the broadcaster's FCC call sign, a binary identifier corresponding to a particular station, etc.
  • Such encoding can be effected anywhere in the audio chain, e.g., in the audio feed between the studio and the broadcast transmitter.
  • the audio signal can be converted to digital form (if not already in such form), summed with a low level watermark signal, and converted back to analog form (if necessary).
  • the user device e.g., receiver 14
  • time data from the clock is written into a memory.
  • the time data, and the decoded station identifier can then (or later) be forwarded to a remote database to which the broadcaster writes its play log.
  • the audio (or video) selection being broadcast at that instant can be identified.
  • the content identifier thereby obtained can then be utilized as above-described to augment the user's enjoyment of the broadcast.
  • the receiver may include, for example, a memory (e.g., RAM) in which sampled excerpts of received audio can be stored under control of an associated CPU.
  • the stored audio can thereafter be transferred to the computer 16, and the watermark decoded therefrom at the computer.
  • the audio can be processed to reduce its size, without unduly impairing the watermark information conveyed thereby.
  • One way this can be accomplished is to high pass filter the audio (e.g., with a cutoff frequency of one-fourth the sample frequency).
  • the filtered audio can be quantized into a three state signal: -1, 0, or 1, depending on the polarity of the filtered signal. (Values within a predetermined threshold of 0 can be assigned a value of 0.) It will be recognized that such processing is a form of lossless compression - lossy because the process is not reversible.
  • the watermark payload can be decoded from the resulting three-state signal (e.g., using the techniques disclosed in the cited patents and applications), even though the underlying audio carrier signal is essentially lost.
  • This bit sequence can be further compressed using known lossless compression techniques (e.g., LZ77 or LZ78) to further save on storage requirements.
  • LZ77 or LZ78 lossless compression technique
  • the high pass filtering can be used without the quantization, and vice versa. Still other compression techniques can naturally be used, provided same do not unduly impair the encoded watermark information.
  • all audio received by the receiver is digitized, and the last 5 seconds are always available in a FIFO RAM buffer.
  • those 5 seconds of audio are copied into a separate retention memory, and the five next- following seconds of audio are likewise written into that retention memory, yielding 10 seconds of data from which the watermark can later be discerned.
  • the audio processing operation just described can be performed on-the-fly during such operation, or by post processing.
  • a number of such excerpts can be stored - one each time the button 24 is activated - depending on the capacity of the retention memory.
  • Known user interface techniques can be employed to allow the user to manage this collection of data excerpts, e.g., controlling which are transmitted to the computer 16, which are invoked to obtain related internet content, which are permanently stored on-disk in the computer 16 to serve as long-term bookmarks to internet sites of particular interest, etc.
  • receiver 14 and computer 16 are described as separate units, this need not be the case.
  • the detailed functionality of these devices can be provided in a single unit.
  • the detailed embodiments employ particular watermarking techniques detailed in the cited patents and applications, the principles are equally applicable with any other digital watermarking technology, including those that transform the audio or video signal to another domain (e.g., wavelet, DCT, etc.), and alter the signal representation by changing the signal coefficients in such domain.
  • any other digital watermarking technology including those that transform the audio or video signal to another domain (e.g., wavelet, DCT, etc.), and alter the signal representation by changing the signal coefficients in such domain.
  • auxiliary data-conveyal technologies including SCA subcarriers, vertical blanking interval techniques, etc.
  • a song or other content may correspond to links to several alternative destinations.
  • the user can be presented a menu of such links from which to choose. Or a link to one of several alternative destinations may be automatically chosen based on the context or environment in which the content was encountered. (E.g., if a user activates the "Capture" button on a portable radio receiver, a different link may be pursued than if the user actives the button while using a desktop computer. In such cases, context information sufficient to distinguish such settings would be relayed from the device to the remote system.)
  • the augmentation of the broadcast content is initiated by a user action, e.g., activating a Capture button.
  • the augmentation is automatic (e.g., presentation of streaming media corresponding to a watermark decoded from received audio).
  • the augmented information can be automatically retrieved, but not presented to the user unless called for.
  • the augmentation data can be cached, e.g., on the user's device, and presented immediately, on demand.
  • a user listening to an internet radio broadcast can summon additional information by using dropdown menus of the sort typically associated with Windows applications.
  • a "More" menu could present options such as "About the artist,” “Order this music,” “Concert schedules,” etc. Unless requested, such information stays hidden. But when such menu is activated, the corresponding information is delivered from the cache.

Abstract

Wireless (26) and Internet (20) broadcasts can carry in-band digital information through the use of watermark technology (22). This digital information can be used to direct a user to a particular Internet site or resident application for supplemental or complimentary information, entertainment, merchandising, and commerce opportunities (18).

Description

DIGITAL WATERMARKS IN TV AND RADIO BROADCASTS
Related Application Data
This application claims priority to provisional applications 60/141,763, filed June 30, 1999; and 60/141,468, filed June 29, 1999.
The subject matter of the present application is related to that disclosed in US Patent 5,862,260, and in copending applications 08/746,613, filed November 12, 1996 (allowed, also published as WO 9743736); 09/343,104, filed June 29, 1999; 60/164,619, filed November 10, 1999; 09/503,881, filed February 14, 2000; 09/525,865, filed March 15, 2000; and 09/547,664, filed April 12, 2000.
Background and Summary of the Invention Broadcast signals can carry in-band digital information though use of known watermark technology (a few examples of which are detailed in the cited patents and applications). This digital information can be used to direct a user to a particular internet site or resident application for supplemental or complimentary information, entertainment, merchandising, and commerce opportunities.
Brief Description of the Drawings Fig. 1 shows an illustrative embodiment of the present invention.
Detailed Description
Referring to Fig. 1, an illustrative embodiment 10 of the present invention includes a radio or television transmitter 12, a portable or fixed radio or television receiver 14, a personal computer or other network connection 16, and remote resources 18 available through the internet 20.
The transmitter 12 is conventional, but includes a watermark encoder to embed a digital watermark in the transmitted signal. The receiver 14 is likewise generally conventional (e.g., including an RF amplifier, a mixer, one or more intermediate frequency amplifiers, and a detector), but additionally includes a watermark detector 22, a button or other user interface feature 24 (which may be on a remote control associated with the receiver), and an external interface 26 (e.g., infrared, wireless, Bluetooth, serial, USB, firewire, etc.). In some embodiments, the receiver can be a species of computer.
The watermark encoding and decoding can follow the techniques set forth in the cited patents and applications. In such arrangements, the watermark payload data is combined with a pseudo-random carrier signal (e.g., by multiplying, XORing, etc.), and combined with (e.g. added to) the audio or video content signal. The carrier signal may be shaped in various ways. For example, zeroes in the carrier signal can be omitted (e.g., leaving values of-1 and 1, or -2, -1, 1, and 2, etc.), or the frequency spectrum of the carrier can be tailored to match the frequency spectrum of the signal being encoded, etc. In some embodiments, the watermarking also encodes a calibration signal with the payload data. This calibration signal is used in decoding, as detailed in the cited patents and applications (e.g., to permit accurate detection of the payload data even from a corrupted signal).
The computer 16 can be a personal computer, an internet appliance, or other network interface device. The computer includes provision for communicating with the external link of the receiver 14, and also includes a network connection for coupling to the internet 20. The remote resources 18 include the myriad servers coupled to the internet to provide information, entertainment, and commerce opportunities to users thereof.
In the illustrated system, audio material (such as a song or an advertisement) is transmitted to the receiver in the usual manner. Encoded in the audio signal is digital information represented as a watermark. Upon decoding at the receiver, this information is transmitted to the computer 16 (or stored for later transmission if the receiver does not have a persistent network connection).
The encoded information need only comprise a unique identifier, or database key. When passed to the computer 16 (and optionally therefrom to a remote resource 18), the identifier serves to initiate from such device one or more supplemental or complimentary applications corresponding to the encoded broadcast content, such as purchasing a song for download, purchasing a CD containing the song, viewing news and concert schedules for recording artists, viewing a music video, etc.
Similar arrangements and benefits can be delivered through watermarked spoken word programming, and through television (video) broadcasts. The broadcasts can be distributed through any of the conventional methods other than over-the-air, including cable and satellite.
The infrastructure through which the receiver 16 couples to the remote resources 18 can take various forms. In application 09/547,664, filed April 12, 2000, the assignee detailed one such arrangement. In that system, the user device (e.g., receiver 14 or computer 16) dispatches the watermark ID to a router computer. That computer includes a database that stores a URL corresponding to each watermark ID. Upon receiving a watermark ID, the router computer returns the corresponding URL to the originating device (12 or 16). A browser at the originating device then establishes a link to the specified URL. That URL then provides the information, entertainment, or commerce opportunity corresponding to the encoded broadcast. The just-detailed system is advantageous in that it permits the encoding of a short identifier in the broadcast (e.g., instead of a lengthy URL). Moreover, the corresponding URL can be changed over time, as needed. Other embodiments of the present invention, however, do not need this level of complexity; the encoded identifier can more directly trigger the desired remote resource response.
Turning to particular cases, consider a product advertisement encoded with watermark data that links to product specifications, multi-media product demonstrations, and/or purchase instructions. Alternatively, for commonplace items, the user might merely push a "buy" button 24 on the receiver and the order could be placed automatically (e.g., using one-click technology of the type detailed in
Amazon's patent 5,960,411), or an order form could be invoked on the screen of the computer 16 as soon as the data was transmitted to it.
If a particular song was playing, the digital watermark transmitted with the song could cause a picture of the singer to appear on the personal computer. Alternatively, through an automatic link to the internet, users could indicate their like or dislike for the song. In still other applications the link can be used to allow the user to indicate a "vote" concerning a subject being played over the audio link. (In such embodiments, the embedded ID identifies the subject matter being voted on, and likewise serves to specify the remote resource 18 that is to receive the vote. To that resource the user's computer can dispatch a "yes" or "no" vote, a "like" or "dislike" preference, etc., by corresponding data sent over the internet.
As will be recognized, embodiments like that detailed can be used to enable interactive advertisement and promotion for local radio and TV broadcasters, generating traffic and fulfillment activities for local merchants. In one such embodiment, network broadcast content is locally customized with links corresponding to local merchants and other resources. Thus, a Ford advertisement may be customized to initiate a link to a local Ford dealership.
(Such local customization can be performed by the broadcaster or by another party. In some embodiments, nationally-distributed broadcast content can include links suitable for a national audience (e.g., to corporate web sites of advertisers). The local broadcaster may process such network feeds to identify such national links. When same are encountered, the local broadcast processor may look-up a corresponding local link. The existing national link data can then be replaced with the local link data. Or, the broadcast may have been encoded with "blank" watermark payload bits that can be filled-in by the local broadcaster without removing the national link. These supplemental payload bits can serve to indicate the locality in which the payload was received, permitting a router computer or the like to return a URL appropriate to that area.)
By employing such watermark-based content augmentation, satellite content distribution can enjoy a virtual high speed asynchronous network capability by downstreaming relatively small digital watermark payloads as segues to PCs and other devices with higher bandwidth connections. Rather than sending large payloads via the satellite link, the distributor sends "pointers" that direct receivers and recipients to certain applications on the other networks; essentially, off-loading the heavy lifting to other carriers so as to provide more value to its customers and content providers with very little bandwidth consumption. Auxiliary content that is not desired by all satellite subscribers is not sent over the satellite; those subscribers employ the satellite-conveyed watermark data to obtain such auxiliary content using other connections (e.g., terrestrial internet).
Radio over the internet is increasingly popular. However, the screen of the internet terminal is poorly utilized in such radio broadcasts. In accordance with another aspect of the invention, a watermark decoded from a web broadcast is decoded, and is used to enhance the experience by supplementing the audio with accompanying visual presentations.
In one such embodiment, the display presents streaming and other media on the screen while the internet radio is playing, such ancillary content being related to the then-broadcast radio content. This ancillary visual information can include concert schedules, fan news about the musician or person being broadcast, commercial web sites offering CDs, etc. During radio advertisements the display can present associated commercial information, with accompanying visual and/or video promotional materials. In addition to eye-catching visual presentations, these displays can include the opportunity to buy the advertised product, or download a "trial" version. (The visual displays can include conventional user interface features, such as buttons that can be selected by a user to initiate a purchase transaction or other operation in known manners.)
Technically, the computer radio decodes embedded watermark data from the audio programming. In some embodiments, the watermark literally conveys the address of one or more web sites that are to be displayed. The computer can be programmed to recognize these embedded web addresses, and display the corresponding web content in one or more separate browser windows. These windows can be tiled or otherwise presented on the display screen, together with the radio user interface. (The ancillary windows may overlie the radio interface in some embodiments.) As the radio content changes, the embedded watermark information also changes. Web displays corresponding to the earlier-decoded watermark are discontinued, and new web displays corresponding to the current watermark information are presented. As noted, the audio broadcast need not be literally encoded with web addresses. Instead, the audio can be encoded with data including an identifier (e.g., 32 bits). On detecting this identifier, the computer connects to a remote web server (whose address is pre-identified) and provides this identifier. The remote server responds with the web addresses of the content to be displayed. The local computer then loads and displays these web pages, as in the first embodiment. As the audio programming changes, the embedded identifier also changes, leading to changed web addresses corresponding to the current audio material.
Returning to the original example of a watermark-aware radio, consider a car radio that has a "capture" button on the front panel (or other form of user interface, e.g., a Capture icon on a GUI). If a user hears a song they want to record and keep, they press the Capture button while the song is playing. In response, the radio device decodes a watermark embedded in the music, and thereby knows the identity of the music. The radio then makes a wireless transmission identifying the user and the desired song. A local repeater network picks up the wireless signal and relays it (e.g. by wireless rebroadcast, by modem, or other communication medium) to a music clearinghouse. The clearinghouse charges the user a nominal fee (e.g. via a prearranged credit card), and queues the music for download to a predetermined location associated with the user.
In one embodiment, the predetermined location is the user's own computer. If a "live" IP address is known for the user's computer, the music can be transferred immediately. If the user's computer is only occasionally connected to the internet, the music can be stored at a web site (e.g. protected with a user-set password), and can be downloaded to the user's computer whenever it is convenient.
In other embodiments, the predetermined location is a personal music library maintained by the user. The library can take the form, e.g., of a hard-disk or semiconductor memory array in which the user customarily stores music. This storage device is adapted to provide music data to one or more playback units employed by the user (e.g. a personal MP3 player, a home stereo system, a car stereo system, etc.). In most installations, the library is physically located at the user's residence, but could be remotely sited, e.g. consolidated with the music libraries of many other users at a central location. The personal music library can have its own internet connection. Or it can be equipped with wireless capabilities, permitting it to receive digital music from wireless broadcasts (e.g. from the clearinghouse). In either case, the library can provide music to the user's playback devices by short-range wireless broadcast. By such arrangement, a user can conveniently compile an archive of favorite music - even while away from home.
Many variants of the foregoing are of course possible. The radio can be a portable unit (e.g. a boombox, a Walkman radio, etc.) or a home device, rather than an automotive unit. The UI feature employed by the user to initiate capture a musical selection need not be a button (physical or on-screen). For example, in some embodiments it can be a voice-recognition system that responds to spoken commands, such as "capture" or "record." Or it can be a form of gesture interface.
Instead of decoding the watermark only in response to the user's "capture" command, the radio can decode watermarks from all received programs, and keep the most recent in a small FIFO memory. By such arrangement, the user need not issue the capture instruction while the song is playing, but can do so even after the song is finished.
In some embodiments, data corresponding to the watermark can be made available to the user in various forms. For example, it can be presented to the user on an LCD screen, identifying the artist and song currently playing. If a corresponding UI button is activated, the device can so-identify the last several selections. Moreover, the data need not be presented to the user in displayed form; it can be annunciated by known computer-speech technologies instead.
In embodiments in which the watermark does not convey ASCII text data, but instead conveys UIDs (unique identifiers), or coded abbreviations, the device must generally interpret this data before presenting it to the user. In an illustrative embodiment, the device is a pocket-sized FM radio and is equipped with a 1 megabyte semiconductor non-volative RAM memory. The memory includes a data structure that serves as a look-up table, matching code numbers to artist names and song titles. When the user queries the device to learn the identify of a song, the memory is indexed in accordance with one or more fields from the decoded watermark, and the resulting textual data from the memory (e.g. song title and artist) is annunciated or displayed to the user.
In most applications, such memory will require frequent updating. The RF receiver provides a ready mechanism for providing such updated data. In one embodiment, the radio "awakens" briefly at otherwise idle moments and tunes to a predetermined frequency at which updated data for the memory is broadcast, either in a baseband broadcast channel, or in an ancillary (e.g. SCA) channel. Or such data can be repeatedly transmitted on an SCA channel, received whenever the radio is turned on. In variants of the foregoing, internet delivery of updated memory data can be substituted for wireless delivery. For example, the artist/song title memory in the personal player can be updated by placing the player in a "nest" every evening. The nest (which may be integrated with a battery charger for the appliance) can have an internet connection, and can exchange data with the personal device by infrared, inductive, or other proximity-coupling technologies, or through metal contacts. Each evening, the nest can receive an updated collection of artists/song titles, and can rewrite the memory in the personal device accordingly. By such arrangement, the watermark data can always be properly intepreted for presentation to the user.
The "Capture" concepts noted above can be extended to other functions as well. One is akin to forwarding of email. If a consumer hears a song that another friend would enjoy, the listener can send a copy of the song to the friend. This instruction can be issued by pressing a "Send" button, or by invoking a similar function on a graphical (or voice- or gesture-responsive) user interface. In response, the appliance so-instructed can query the person as to the recipient. The person can designate the desired recipient(s) by typing in a name, or a portion thereof sufficient to uniquely identify the recipient. Or more typically, the person can speak the recipient's name. As is conventional with hands-free vehicle cell phones, a voice recognition unit can listen to the spoken instructions and identify the desired recipient. An "address book' ike feature has the requisite information for the recipient (e.g., the web site, IP address, or other data identifying the location to which music for that recipient should stored or queued, the format in which the music should be delivered, etc.) stored therein. In response to such command, the appliance dispatches instructions to the clearinghouse, including an authorization to debit the sender's credit card for the music charge. Again, the clearinghouse attends to delivery of the music in a desired manner to the specified recipient. Still further, a listener may query the appliance (by voice, GUI or physical button, textual, gesture, or other input) to identify CDs on which the then-playing selection is recorded. Or the listener may query the appliance for the then-playing artist's concert schedule. Again, the appliance can contact a remote database, relay the query, and forward data from the watermark payload identifying the artist and/or song title to which the query relates. The database locates the requested data, and relays same back to the appliance for presentation (via a display, by machine speech, or other output) to the user. If desired, the user can continue the dialog with a further instruction, e.g., to buy one of the CDs on which the then-playing song is included. Again, this instruction may be entered by voice, GUI, etc., and dispatched from the appliance to the clearinghouse, which can then complete the transaction in accordance with pre-stored information (e.g. credit card account number, mailing address, etc.). A confirming message is relayed to the appliance for presentation to the user.
While the foregoing transactions require a link to a remote site or database, other watermark-based consumer services can be provided without such a link. For example, a user can query the appliance as to the artist or song-title of the selection currently playing. The appliance can consult the embedded watermark data (and optionally consult a memory to determine the textual names associated with coded watermark data), and provide the requested information to the user (e.g., by a display, annunciation, or other output). The foregoing concepts (e.g. Capture, Send, etc.) can also be employed in connection with internet- rather than radio-delivery of music.
In other embodiments of the invention, the broadcast is not encoded with different data at different times (e.g., a different payload for each song). Instead, the broadcast is constantly encoded with a single identifier, e.g., identifying the broadcaster. The encoding can be the broadcaster's FCC call sign, a binary identifier corresponding to a particular station, etc. Such encoding can be effected anywhere in the audio chain, e.g., in the audio feed between the studio and the broadcast transmitter. The audio signal can be converted to digital form (if not already in such form), summed with a low level watermark signal, and converted back to analog form (if necessary). In such arrangements, the user device (e.g., receiver 14) can include a real time clock. When a user hears or sees a broadcast of interest, and operates the "Capture" button (or other user interface feature), time data from the clock is written into a memory. The time data, and the decoded station identifier, can then (or later) be forwarded to a remote database to which the broadcaster writes its play log. By indexing the broadcaster's play log with the captured time data, the audio (or video) selection being broadcast at that instant can be identified. The content identifier thereby obtained can then be utilized as above-described to augment the user's enjoyment of the broadcast.
From the foregoing, it will be recognized that certain embodiments of the present invention allow internet and broadcast audio/video to be used to invoke the presentation of ancillary promotions, merchandizing, supplemental information, and entertainment - all keyed off watermark data.
To provide a comprehensive disclosure without unduly lengthening this specification, the above-detailed patents and applications are incorporated herein by reference.
Having described and illustrated the principles of the invention with reference to illustrative embodiments, it should be recognized that the invention is not so limited.
For example, while the detailed embodiment included a watermark decoder as part of the broadcast receiver, this is not essential. In other embodiments the receiver may include, for example, a memory (e.g., RAM) in which sampled excerpts of received audio can be stored under control of an associated CPU. The stored audio can thereafter be transferred to the computer 16, and the watermark decoded therefrom at the computer. To save storage space in the receiver memory, the audio can be processed to reduce its size, without unduly impairing the watermark information conveyed thereby. One way this can be accomplished is to high pass filter the audio (e.g., with a cutoff frequency of one-fourth the sample frequency). Then the filtered audio can be quantized into a three state signal: -1, 0, or 1, depending on the polarity of the filtered signal. (Values within a predetermined threshold of 0 can be assigned a value of 0.) It will be recognized that such processing is a form of lossless compression - lossy because the process is not reversible. The watermark payload can be decoded from the resulting three-state signal (e.g., using the techniques disclosed in the cited patents and applications), even though the underlying audio carrier signal is essentially lost. This bit sequence can be further compressed using known lossless compression techniques (e.g., LZ77 or LZ78) to further save on storage requirements. The just-described processing technique is illustrative only. The high pass filtering can be used without the quantization, and vice versa. Still other compression techniques can naturally be used, provided same do not unduly impair the encoded watermark information. In one particular embodiment in which the receiver logs snippets of audio, all audio received by the receiver is digitized, and the last 5 seconds are always available in a FIFO RAM buffer. Upon activating the button 24 or other control, those 5 seconds of audio are copied into a separate retention memory, and the five next- following seconds of audio are likewise written into that retention memory, yielding 10 seconds of data from which the watermark can later be discerned. (The audio processing operation just described can be performed on-the-fly during such operation, or by post processing.) A number of such excerpts can be stored - one each time the button 24 is activated - depending on the capacity of the retention memory. Known user interface techniques can be employed to allow the user to manage this collection of data excerpts, e.g., controlling which are transmitted to the computer 16, which are invoked to obtain related internet content, which are permanently stored on-disk in the computer 16 to serve as long-term bookmarks to internet sites of particular interest, etc.
While receiver 14 and computer 16 are described as separate units, this need not be the case. The detailed functionality of these devices can be provided in a single unit. Similarly, while the detailed embodiments employ particular watermarking techniques detailed in the cited patents and applications, the principles are equally applicable with any other digital watermarking technology, including those that transform the audio or video signal to another domain (e.g., wavelet, DCT, etc.), and alter the signal representation by changing the signal coefficients in such domain. More generally, while the detailed embodiments have employed watermark technology, other arrangements can employ different auxiliary data-conveyal technologies, including SCA subcarriers, vertical blanking interval techniques, etc. While the detailed embodiments focused on audio broadcast applications, the same principles can be employed with television, e.g., by encoding the picture information or the accompanying sound information. And, as noted, the techniques are likewise applicable to the internet-delivery of content, not involving over-the-air broadcast.
While the detailed embodiments contemplated that the broadcast content would correspond to a single internet destination, in other embodiments this may not be the case. In some embodiments, a song or other content may correspond to links to several alternative destinations. The user can be presented a menu of such links from which to choose. Or a link to one of several alternative destinations may be automatically chosen based on the context or environment in which the content was encountered. (E.g., if a user activates the "Capture" button on a portable radio receiver, a different link may be pursued than if the user actives the button while using a desktop computer. In such cases, context information sufficient to distinguish such settings would be relayed from the device to the remote system.)
In some of the above-described embodiments, the augmentation of the broadcast content is initiated by a user action, e.g., activating a Capture button. In others, the augmentation is automatic (e.g., presentation of streaming media corresponding to a watermark decoded from received audio). Still other arrangements are possible. For example, the augmented information can be automatically retrieved, but not presented to the user unless called for. The augmentation data can be cached, e.g., on the user's device, and presented immediately, on demand. In one such arrangement, a user listening to an internet radio broadcast can summon additional information by using dropdown menus of the sort typically associated with Windows applications. A "More" menu could present options such as "About the artist," "Order this music," "Concert schedules," etc. Unless requested, such information stays hidden. But when such menu is activated, the corresponding information is delivered from the cache.
The particular combinations of elements and features in the above-detailed embodiments are exemplary only; the interchanging and substitution of these teachings with other teachings in this and the incorporated-by-reference patents/applications are also contemplated. In view of the wide variety of embodiments to which the principles and features discussed above can be applied, it should be apparent that the detailed embodiments are illustrative only and should not be taken as limiting the scope of the invention. Rather, we claim as our invention all such modifications as may come within the scope and spirit of the following claims and equivalents thereof.

Claims

WE CLAIM:
1. In a radio or television broadcasting system that conveys a content signal to an audience, an improvement comprising steganographically encoding the content signal with an in-band digital watermark prior to its broadcast, the digital watermark conveying a plural-bit identifier, the identifier serving to identify an internet-available resource to which a recipient of said content signal can refer to obtain additional information or commerce opportunities related to the broadcast.
2. The method of claim 1 in which the identifier does not convey a literal URL, but instead conveys a code that is mapped to a corresponding URL through a database.
3. The method of claim 1 in which said encoding includes processing with a shaped pseudo-random signal.
4. A broadcasting system that broadcasts beyond a single local area, according to claim 1, in which each of several local broadcast outlets to which the content is distributed encode the content with a different digital watermark, so that the internet-available resources identified thereby are customized to the outlets' respective localities.
5. The broadcasting system of claim 3 in which the local outlet encoding of said content with said watermark is performed in response to detection of a different watermark in an input content signal.
6. A broadcast receiver, the receiver having an RF amplifier, a mixer, an intermediate frequency amplifier, a detector, a speaker, and a watermark decoder, the watermark decoder serving to decode a plural-bit digital watermark steganographically encoded within a received broadcast signal, said plural-bit digital watermark serving to identify an internet-available resource to which a user of said receiver can refer to obtain additional information or commerce opportunities related to the broadcast.
7. The receiver of claim 6 in which the watermark decoder employs a shaped pseudo-random signal to decode said watermark.
8. The receiver of claim 6 in which the watermark decoder refers to a calibration signal embedded as part of the digital watermark in decoding said watermark.
9. The receiver of claim 6 in which the watermark decoder has an input coupled to an output of the detector.
10. The receiver of claim 6 in which the watermark decoder has said input coupled to the speaker.
11. A television receiver according to claim 6.
12. A radio receiver according to claim 6.
13. The receiver of claim 6 further including a control by which a user can cause the receiver to act upon a watermark in said received broadcast signal.
14. The receiver of claim 6 further comprising a memory, the receiver serving to store decoded watermark data in said memory.
15. The receiver of claim 14 further including a control by which a user can cause the receiver to store the decoded watermark data in said memory.
16. The receiver of claim 6, further including an interface permitting coupling of data from said receiver to a remote device.
17. The receiver of claim 16 in which the interface includes a wireless transmitter.
18. The receiver of claim 17 in which the wireless transmitter comprises an infrared transmitter.
19. The receiver of claim 16 in which the interface couples to a computer device.
20. The receiver of claim 6, further comprising a memory, the memory having data stored therein permitting decoded watermark data to be interpreted into human- understandable form.
21. The receiver of claim 20, further including a display on which data from said memory can be presented to a user.
22. The receiver of claim 20, further including an annunciator for announcing data from said memory to a user.
23. A method of operating a receiver comprising: listening to or viewing an output from said receiver until content of interest is presented; activating a control associated with said receiver, said activation initiating the following events: transmitting data corresponding to an in-band watermark detected in said content, from said receiver to an internet connected resource; and receiving information or a commerce opportunity relating to said content of interest from the internet
24. The method of claim 23 in which the events initiated by activation of said control including decoding a watermark from said content of interest.
25. The method of claim 24 in which said decoding includes processing with a shaped pseudo-random signal.
26. The method of claim 24 in which the decoding includes detecting a calibration signal encoded as part of said watermark.
27. The method of claim 23 in which the events initiated by activation of said control include reading earlier-decoded watermark data from a memory in said receiver for transmission to the internet connected resource.
28. The method of claim 23 that includes: receiving the transmitted data at a first internet-connected resource; identifying at said first resource a URL identifying a second internet- connected resource that corresponds to said transmitted data; and providing data from said URL to a user of the receiver.
29. The method of claim 28 that includes relaying said URL from the first internet-connected resource to a computer associated with the user, and directing a browser on said computer to said URL.
30. A broadcast receiver, the receiver having an RF amplifier, a mixer, an intermediate frequency amplifier, a detector, a speaker, a sampler, a processor, and a memory, the processor serving to selectively store data corresponding to a received broadcast to the memory, said data encoding a plural-bit digital watermark that identifies an internet-available resource to which a user of said receiver can refer to obtain additional information or commerce opportunities related to the broadcast.
31. The receiver of claim 30 in which the processor stores said sampled data in response to user activation of a control.
32. The receiver of claim 30 in which the data stored in the memory is not simply sampled broadcast data, but has been processed by the processor to reduce storage space while still permitting the watermark to be decoded therefrom.
33. A signal processor assembly comprising: an input for receiving a sampled content signal having a plural-bit digital watermark steganographically encoded therein; and a processor for processing the sampled content signal to remove low frequency components thereof, the processed signal nonetheless including said watermark therein.
34. The signal processor of claim 33 in which the processor performs a high pass filtering operation on the sampled content signal.
35. The signal processor of claim 33 in which the processor performs a three- state quantization operation on the sampled content signal.
36. A broadcast receiver according to claim 33, additionally including an RF amplifier, a mixer, an intermediate frequency amplifier, a detector, a speaker, and a sampler.
37. A method of signal processing, comprising: receiving a sampled content signal having a plural-bit digital watermark steganographically encoded therein; high pass filtering the sampled content signal to remove low frequency components thereof; and storing the filtered signal in a memory; and thereafter, providing the stored, filtered signal to a watermark decoder.
38. A computer device including a memory, an internet interface, and a watermark decoder, characterized in that the memory has a processed content signal stored therein that encodes a plural-bit digital watermark, the content signal corresponding to audio, video, or still image content, but being sufficiently processed that the signal is substantially unusable to render audio, video, or still image content to a user of the device, the watermark identifying an internet-available resource to which a user of said device can refer through said interface to obtain additional information or commerce opportunities related to the content.
PCT/US2000/017157 1999-06-28 2000-06-21 Digital watermarks in tv and radio broadcasts WO2001001331A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU57577/00A AU5757700A (en) 1999-06-28 2000-06-21 Digital watermarks in tv and radio broadcasts

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US14153899P 1999-06-28 1999-06-28
US60/141,538 1999-06-28
US14176399P 1999-06-30 1999-06-30
US60/141,763 1999-06-30

Publications (1)

Publication Number Publication Date
WO2001001331A1 true WO2001001331A1 (en) 2001-01-04

Family

ID=26839209

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/017157 WO2001001331A1 (en) 1999-06-28 2000-06-21 Digital watermarks in tv and radio broadcasts

Country Status (2)

Country Link
AU (1) AU5757700A (en)
WO (1) WO2001001331A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002035746A2 (en) * 2000-10-20 2002-05-02 Koninklijke Philips Electronics N.V. Method and arrangement for enabling disintermediation, and receiver for use thereby
WO2003017135A2 (en) * 2001-08-14 2003-02-27 Central Research Laboratories Limited Assisted web-browsing system
EP1457048A2 (en) * 2001-11-16 2004-09-15 Thales Control broadcast programme signal, control write and read systems, related production and broadcasting channel
US6957041B2 (en) 2000-09-13 2005-10-18 Stratosaudio, Inc. System and method for ordering and delivering media content
US7917130B1 (en) 2003-03-21 2011-03-29 Stratosaudio, Inc. Broadcast response method and system
US8032909B2 (en) 2001-07-05 2011-10-04 Digimarc Corporation Watermarking and electronic program guides
US8166081B2 (en) 2008-02-05 2012-04-24 Stratosaudio, Inc. System and method for advertisement transmission and display
US8542868B2 (en) 2007-12-17 2013-09-24 CSP—Innovazione Nelle ICT Scarl Embedding interactive data into an audiovisual content by watermarking
US8631448B2 (en) 2007-12-14 2014-01-14 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US8875188B2 (en) 2008-02-05 2014-10-28 Stratosaudio, Inc. Systems, methods, and devices for scanning broadcasts
US10448217B2 (en) 2013-09-15 2019-10-15 Technion Research & Development Foundation Limited Interactive channel
EP3609093A1 (en) 2018-08-09 2020-02-12 FRAUNHOFER-GESELLSCHAFT zur Förderung der angewandten Forschung e.V. Relay and receiving unit
US11252238B2 (en) 2007-12-14 2022-02-15 Stratosaudio, Inc. Systems and methods for outputting updated media

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5673316A (en) * 1996-03-29 1997-09-30 International Business Machines Corporation Creation and distribution of cryptographic envelope
US5742845A (en) * 1995-06-22 1998-04-21 Datascape, Inc. System for extending present open network communication protocols to communicate with non-standard I/O devices directly coupled to an open network
US5778102A (en) * 1995-05-17 1998-07-07 The Regents Of The University Of California, Office Of Technology Transfer Compression embedding
US5892900A (en) * 1996-08-30 1999-04-06 Intertrust Technologies Corp. Systems and methods for secure transaction management and electronic rights protection
US5900608A (en) * 1997-10-16 1999-05-04 Iida; Takahito Method of purchasing personal recording media, system for purchasing personal recording media, and media recorded with personal recording media purchasing program
US5915027A (en) * 1996-11-05 1999-06-22 Nec Research Institute Digital watermarking

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5778102A (en) * 1995-05-17 1998-07-07 The Regents Of The University Of California, Office Of Technology Transfer Compression embedding
US5742845A (en) * 1995-06-22 1998-04-21 Datascape, Inc. System for extending present open network communication protocols to communicate with non-standard I/O devices directly coupled to an open network
US5673316A (en) * 1996-03-29 1997-09-30 International Business Machines Corporation Creation and distribution of cryptographic envelope
US5892900A (en) * 1996-08-30 1999-04-06 Intertrust Technologies Corp. Systems and methods for secure transaction management and electronic rights protection
US5915027A (en) * 1996-11-05 1999-06-22 Nec Research Institute Digital watermarking
US5900608A (en) * 1997-10-16 1999-05-04 Iida; Takahito Method of purchasing personal recording media, system for purchasing personal recording media, and media recorded with personal recording media purchasing program

Cited By (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8467724B2 (en) 2000-09-13 2013-06-18 Stratosaudio, Inc. Broadcast response system
US10148376B1 (en) 2000-09-13 2018-12-04 Stratosaudio, Inc. Broadcast response system
US11265095B2 (en) 2000-09-13 2022-03-01 Stratosaudio, Inc. Broadcast response system
US9325440B2 (en) 2000-09-13 2016-04-26 Stratosaudio, Inc. Broadcast response system
US8688028B2 (en) 2000-09-13 2014-04-01 Stratosaudio, Inc. Broadcast response system
US6957041B2 (en) 2000-09-13 2005-10-18 Stratosaudio, Inc. System and method for ordering and delivering media content
US7415430B2 (en) 2000-09-13 2008-08-19 Stratosaudio, Inc. Broadcast response system
US10498472B2 (en) 2000-09-13 2019-12-03 Stratosaudio, Inc. Broadcast response system
US9998245B2 (en) 2000-09-13 2018-06-12 Stratosaudio, Inc. Broadcast response system
US8903307B2 (en) 2000-09-13 2014-12-02 Stratosaudio, Inc. Broadcast response system
US7773939B2 (en) 2000-09-13 2010-08-10 Stratosaudio, Inc. Broadcast response system
WO2002035746A2 (en) * 2000-10-20 2002-05-02 Koninklijke Philips Electronics N.V. Method and arrangement for enabling disintermediation, and receiver for use thereby
WO2002035746A3 (en) * 2000-10-20 2003-12-31 Koninkl Philips Electronics Nv Method and arrangement for enabling disintermediation, and receiver for use thereby
US8032909B2 (en) 2001-07-05 2011-10-04 Digimarc Corporation Watermarking and electronic program guides
WO2003017135A2 (en) * 2001-08-14 2003-02-27 Central Research Laboratories Limited Assisted web-browsing system
WO2003017135A3 (en) * 2001-08-14 2004-03-04 Central Research Lab Ltd Assisted web-browsing system
EP1457048A2 (en) * 2001-11-16 2004-09-15 Thales Control broadcast programme signal, control write and read systems, related production and broadcasting channel
US8200203B1 (en) 2003-03-21 2012-06-12 Stratosaudio, Inc. Broadcast response method and system
US7917130B1 (en) 2003-03-21 2011-03-29 Stratosaudio, Inc. Broadcast response method and system
US10439837B2 (en) 2003-03-21 2019-10-08 Stratosaudio, Inc. Broadcast response method and system
US9148292B2 (en) 2003-03-21 2015-09-29 Stratosaudio, Inc. Broadcast response method and system
US11265184B2 (en) 2003-03-21 2022-03-01 Stratosaudio, Inc. Broadcast response method and system
US9800426B2 (en) 2003-03-21 2017-10-24 Stratosaudio, Inc. Broadcast response method and system
US11706044B2 (en) 2003-03-21 2023-07-18 Stratosaudio, Inc. Broadcast response method and system
US8892458B2 (en) 2003-03-21 2014-11-18 Stratosaudio, Inc. Broadcast response method and system
US9549220B2 (en) 2007-12-14 2017-01-17 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US11778274B2 (en) 2007-12-14 2023-10-03 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US11882335B2 (en) 2007-12-14 2024-01-23 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US8631448B2 (en) 2007-12-14 2014-01-14 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US10524009B2 (en) 2007-12-14 2019-12-31 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US9143833B2 (en) 2007-12-14 2015-09-22 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US11252238B2 (en) 2007-12-14 2022-02-15 Stratosaudio, Inc. Systems and methods for outputting updated media
US10979770B2 (en) 2007-12-14 2021-04-13 Stratosaudio, Inc. Systems and methods for scheduling interactive media and events
US8542868B2 (en) 2007-12-17 2013-09-24 CSP—Innovazione Nelle ICT Scarl Embedding interactive data into an audiovisual content by watermarking
US9584843B2 (en) 2008-02-05 2017-02-28 Stratosaudio, Inc. Systems, methods, and devices for scanning broadcasts
US8166081B2 (en) 2008-02-05 2012-04-24 Stratosaudio, Inc. System and method for advertisement transmission and display
US10469888B2 (en) 2008-02-05 2019-11-05 Stratosaudio, Inc. Systems, methods, and devices for scanning broadcasts
US11257118B2 (en) 2008-02-05 2022-02-22 Stratosaudio, Inc. System and method for advertisement transmission and display
US10423981B2 (en) 2008-02-05 2019-09-24 Stratosaudio, Inc. System and method for advertisement transmission and display
US9953344B2 (en) 2008-02-05 2018-04-24 Stratosaudio, Inc. System and method for advertisement transmission and display
US9355405B2 (en) 2008-02-05 2016-05-31 Stratosaudio, Inc. System and method for advertisement transmission and display
US8875188B2 (en) 2008-02-05 2014-10-28 Stratosaudio, Inc. Systems, methods, and devices for scanning broadcasts
US9294806B2 (en) 2008-02-05 2016-03-22 Stratosaudio, Inc. Systems, methods, and devices for scanning broadcasts
US10448217B2 (en) 2013-09-15 2019-10-15 Technion Research & Development Foundation Limited Interactive channel
EP3609093A1 (en) 2018-08-09 2020-02-12 FRAUNHOFER-GESELLSCHAFT zur Förderung der angewandten Forschung e.V. Relay and receiving unit
WO2020030742A1 (en) 2018-08-09 2020-02-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Relay and receiving unit

Also Published As

Publication number Publication date
AU5757700A (en) 2001-01-31

Similar Documents

Publication Publication Date Title
US8122257B2 (en) Audio-based, location-related methods
USRE45089E1 (en) Program information broadcasting system, broadcasting device, and receiving terminal unit
US8155582B2 (en) Methods and systems employing digital content
JP4829455B2 (en) Connected audio and other media objects
US20010055391A1 (en) System and method for extracting, decoding, and utilizing hidden data embedded in audio signals
EP1329045B1 (en) Rendering device and arrangement
EP1113605A2 (en) Methods and apparatus for identification and purchase of broadcast digital music and other types of information
US20050028189A1 (en) System to provide access to information related to a broadcast signal
CN1541462A (en) Method and arrangement for enablning disintermediation, and receiver for use thereby
WO2001001331A1 (en) Digital watermarks in tv and radio broadcasts
US20030233282A1 (en) Process for automatically ordering permanent versions of individual songs or albums heard on satellite or digital radio stations
WO2001050665A1 (en) Watermark-based personal audio appliance
US8752118B1 (en) Audio and video content-based methods
US20030070179A1 (en) System and method for connecting end user with application based on broadcast code
WO2003017135A2 (en) Assisted web-browsing system
MXPA96004575A (en) A method and a system for the diffusion of digital audio information comprising data compression, encryption and the synthesis of

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP