CA1279124C - Program identification method and apparatus - Google Patents
Program identification method and apparatusInfo
- Publication number
- CA1279124C CA1279124C CA000480035A CA480035A CA1279124C CA 1279124 C CA1279124 C CA 1279124C CA 000480035 A CA000480035 A CA 000480035A CA 480035 A CA480035 A CA 480035A CA 1279124 C CA1279124 C CA 1279124C
- Authority
- CA
- Canada
- Prior art keywords
- event
- signal
- predetermined
- video
- detecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
- H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/59—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of video
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/90—Tape-like record carriers
Abstract
PROGRAM IDENTIFICATION METHOD AND APPARATUS Abstract of the Disclosure A method and apparatus for identifying programs such as television programs received from various sources detects the occurrence of predetermined events such as scene changes in a video signal and extracts a signature from the video signal. the signatures and the times of occurrence of the signatures are stored and subsequently compared with reference signatures to identify the program. The signatures may be compared in pairs to increase resolution, and the time interval between events or signatures may also be used to identify the program, either by themselves or in conjunction with the signatures.
Description
31.Z7~Z~
Fiel~ oe t~e Inventi~
This invention relates generally to methods and apparatus for identifying programs and the viewing habits of the public, and more particularly to a method and apparatus for identifying programs, such as tele-vision programs obtained from various sources, includ-ing video recorders.
DescriPtion_of the Prior Art Systems ~or identifying programs such as television programs that are broadcast or viewed are known. Such systems fall into various categories.
These categories include manual systems wherein the viewer keeps a diary indicating all of the programs viewed; mechanical, electromechanical and electronic systems that sense the channel to which a television receiver is tuned; systems that detect identifying signals present in the television broadcast signal;
and systems that monitor and analyze the program con-tent of the broadcast signal utilizing image proces-sing ànd correlation techniques to identify the pro-gram.
While all of these systems do provide a way to identify programs and to monitor the viewing habits of the public, the manual methods are slow in acquiring data and are prone to inaccuracies resulting from the entry of erroneous data that may be intentionally or unintentionally entered. Systems that monitor the channel to which a receiver is tuned overcome the drawbacks of the manual systems, but require access to the tuning mechanism of the receiver. Such access is becoming increasingly difficult with the advent of cable and pay television systems that utilize various converters and decoders, many of which are difficult to access. Moreover, such systems cannot identify ~79~24 programs played from a source such as a home video recorder. Systems that detect identification signals encoded on the broadcast signal overcome many of the accuracy and access disadvantages described above, but require the cooperation of tbe broadcasters who must encode the programs prior to broadcast for such systems to be effective. Consequently, such systems are useable only on a limited number of broadcasts, such as network broadcasts. Systems that monitor and analyze the content of the program itself theoretical-ly eliminate the disadvantages of the other systems, but heretofore the information processing requirements of such systems rendered such systems impractical or uneconomical because of the computing capacity requir-ed to analyze the vast quantity of information presentin a broadcast signals. Moreover, previous attempts to reduce the quantity of information processed tend-ed to introduce inaccuracies.
An example of a system that utilizes the program content of a broadcast signal to identify the program is described in United States Patent No.
3,919,479 to ~oon et al. The Moon et al. system utilizes a non-linear analog transform to produce a low frequency envelope waveform, and the information in the low frequency envelope of a predetermined time interval is digitized to generate a signature. The signatures thus generated are compared with reference signatures to identify the program. However, the ~oon et al. system generates the signatures continuous-ly, and consequently, requires a large computer toprocess the data thus generated.
Another system that monitors the program content of a broadcast signal is disclosed in United States Patent No. 4,230,990 to Lert Jr. et al~ The system disclosed in the Lert Jr. et al patent reduces ~Z7~Z~
the amount of data that must be processed, as compared to the data amount of processed by the Moon et al.
patent, by utilizing cues that are either externally generated or present in the program material to ini-tiate the signature generation and correlation process only after a cue has been detected. However, the system disclosed in the Lert Jr. et al. patent is designed to monitor the programs broadcast by broad-casting stations such as network affiliated stations in order to determine whether they are broadcasting the programs required by the networks to be broadcast, rather than as a system for determining the viewing habits of the public. Thus, many of the problems that occur when the habits of a television viewer are being monitored, such as, for example, frequent chan-nel changing, and the problems that occur in identify-ing programs that are recorded and subsequently play-ed back by a home video recorder are not addressed.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a method and apparatus for identifying pro-grams that overcome many of the disadvantages of the prior art systems.
It is another object of the present inven-tion to provide an improved methoa and apparatus for determining the viewing habits of the public that utilizes the content of the program being viewed.
It is another object of the present inven-tion to provide an improved method and apparatus for ~o~;~O~;v~,9, m~intaining broadcasts and determining whether broad-casting stations are bro~dcasting the programs and commercial messages that they are required to broad-cast.
It is yet another object of the present invention to provide a method and apparatus for iden-79~4 tifying previously recorded programs being viewed by a viewer.
It is still another object of the present invention to provide a system that accurately identi-fies programs with a minimal amount of computation utilizing data reduction and correlation techniques on the program material.
It is yet another object of the present invention to provide a program identification system that extracts program identifying signatures only upon the occurrence of certain predetermined events.
It is another object of the present inven-tion to provide a program identifying system that extracts program identifying signatures from the pro-gram material and compares the extracted signatures with reference signatures in pairs to provide more accurate identification.
It is yet another object of the present invention to provide a program identifying system 29 that monitors the program material for the occurrence of predetermined events, and monitors the time inter-val between such events to identify the program, utilizing the events either by themselves or in con-junction with the extracted signatures.
It is yet another object of the present invention to provide a system that alters the identi-fication criteria depending on whether the program being viewed is a broadcast program or a program pre-viously recorded by the viewer.
Therefore, in accordance with a preferred embodiment of the invention, there is provided a sys-tem having a home unit that monitors the viewing con-ditions in the home, for example, whether the televi-sion set is on or off, whether any home video recorder (e.g., a video cassette recorder or VCR) is on or off ~' lZ7~24 and the video signal being received. By monitoring the aforementioned signals and functions, the system determines whether no viewing is occurring, whether a television broadcast is being viewed, whether a tele-vision broadcast is being recorded, whether viewingand recording is occurring simultaneously, or whether a previously recorded program is being viewed. Once the viewing mode has been established, the program being viewed is identified by extracting a character-istic signature from the video signal and storing itfor subsequent comparison with reference signatures stored in a central office.
Once the mode of viewing has been determin-ed, a signature of the program material being viewed or recorded is extracted, provided certain predeter-mined events occur first. These events shall be re-ferred to as Event 1 and Event 2. Several events can serve as Event 1. These events mAy be a turn on of the television set, a channel change, a predetermined time interval, for example 5 to 10 minutes, since the occurrence of the previous Event 1, or a sudden change to a black scene. Events that can serve as an Event 2 include a scene change to a scene other than a black sc ne, a color change, which may be an overall color change or a color change of a predetermined line, a still picture as evidenced by several consecutive substantially identical frames, an audio level change, and others.
Upon the occurrence of an Event 1, the home unit monitors the broadcast for the occurrence of an Event 2, and extracts a pair of signatures from the video signal immediately following the next two Event 2s following an Event 1. Or, if a previously recorded program is being viewed, the system extracts three or more signatures from the video signal ~279~
immediately following the next three or more Event 2s following an Event 1. The signatures are extracted by detecting and digitizing the envelope of the video signal immediately following the Event 2s. The digi-tized signatures, as well as the times that thesignatures were extracted, are stored for future comparison with reference signals stored in a central location. The time intervals between Event 2s are also stored and used to identify the program either by themselves or in conjunction with extracted signatures. The time intervals between Event 2s are particularly useful for identifying the playback of previously recorded video tapes for reasons that will be discussed in a subsequent portion of the specification.
The unit used to acquire the reference sig-natures that are compared with the signatures received from the home units is similar to the home unit except that the reference signature acquisition unit monitors each broadcast continuously, and does not require an Event 1 to initiate a signature extraction. Therefore, each broadcast is continuously monitored and a signature is extracted each time an Event 2 is detected. The signatures, as well as the times of occurrence of the signatures are stored to form a library of reference signatures.
The stored signatures are compared with signatures obtained from the home unit that occurred at approximately the same time. The time intervals between Event 2s are also stored for comparison with corresponding time intervals received from the home units.
DESCRIPTION OF THE DRAWING
These and other objects and advantages of the present invention will become readily apparent .:
Z79~2~ .
upon consideration of the following detailed descrip-tion and attached drawing wherein:
FIG. 1 is a block diagram of the home unit of the program identification system according to the present invention;
FIG. 2 is a block diagr.am of the central office and reference signature e~traction portions of the system according to the invention;
FIG. 3 is a chart illustrating the variou~
modes of viewing and recording that can occur in a typical household;
FIGS. 4 and 5 are flow charts illustrating the logical steps performed by the home and central office units, respectively;
FIG. 6 is a flow chart illustrating the logical steps performed by the central office unit in identifying signa~ures; and FIG. 7 illustrates how signatures and scene changes may be extracted from the video envelope.
Referring now to the drawing, with particular attention to FIG. 1, there is illustrated a block diagram of the home unit of the system according to the invention generally designated by the reference numeral 10. The system 10 receives signals to be identified from a television receiver 12, and in many instances from a home video recorder, - such as a video cassette recorder or a VCR 14. In a typical home installation, the receiver 12 and ~he VCR 14 receive signal from a receiving antenna 16, and in many instances from a cable television system 18. These signals may be applied directly to the receiver 12 and to the VCR 14, but it is convenient to employ a sw:itching network 20 that selectively switches tbe receiver 12 and VCR 14 to the antenna 1 127~2~
and to the cable 18 in order to permit the viewing and recording of broadcasts received from the antenna 16 or from the cable 18. In addition, the switching network 20 may connect the VCR 14 to the receiver 12 to permit prerecorded or previously recorded tapes to be played back by the VCR and viewed by the receiver 12.
Video signals representative of the program applied to the receiver 12, as wlell as video signals representative of the signals being recorded by the VCR 14, are applied to a video processing circuit 22, for example, by a video switching circuit 24 which permits either the receiver 12 or the VCR 14, or both, to be monitored. The video processing circuit 22 includes a detector and a low pass filter (discussed subsequently in greater detail), and provides a signal representative of the envelope of the video signal to an analog-to-digital converter 25 which generates a digital representation of the video envelope. The digitized video envelope signal is applied to an events detector 26 which detects predetermined events that occur in the digitized video signal, and causes the signature of the digitized video signal to be extract-ed by signature extraction circuitry 28 upon tbe oc-currence of a predetermined sequence of events. The signature thus generated is stored in a data storage system 30 along with the time that the signature was extracted. The extraction times are provided by a clock 32 which provides a digital r~presentation of time to the data storage system 30 via, for example, a combining circuit 34. The clock 32 may be a real time clock or a relative time clock that is periodical-ly reset from a central location. The function of the events detector ~6, the signature extractor cir-cuitry 28, the data storage 30 and the clock 32 can g be performed by individual circuits as shown or by a microprocessor based system.
The home unit 10 is interrogated at periodic intervals, for example, once a day, by a central of-S fice unit, generally designated by the reference numer-al 40 (FIG. 2), which compares the signatures from the various home units with reference signatures in order to identify the signatures from the home unit.
The home units may be periodically interrogated by a data communications circuit 42 that accesses the vari-ous home units via a suitable communications system, for example, a plurality of telephone lines 44. The signatures thus collected are compared by a central computer system 4~ with signatures stored in a data base 46. Central computer system 48 controls the collection and classification of the signatures re-ceived from the home unit as well as the generation of reference signatures to be stored in the data base 46. The latter function is performed in conjunction with a plurality of reference signal extraction cir-cuits 50 that are located in the cities being monitor-ed. The reference signature extraction circuits moni-tor the various networks, cables and other signal sources in those cities, and extract reference signals, for example, whenever an Event 2 occurs in any of the signals being monitored. The reference signals thus extracted are transmitted to the central office unit 40 and stored in the data base 46 along with the times that such signatures are extracted, as provided by a clock 52. The clock 52 of FIG. 2 is similar to the clock 32 of the home unit and serves to indicate the time of occurrence of the reference signatures. The clock 52 may also be a real time clock or a relative time clock that is periodically set by the central office 40. A central reference signature extraction ~2~9~2~
circuit 54 and associated clock 56 serve to extract signatures and times of extraction of cable originated programs and signatures of prerecorded programs. A1-ternatively, extraction circuits may be placed at the head ends of cable system to extract reference signa-tures of cable programs. The signature extraction performed by the various extraction circuits and data storage is controlled by the central computer system 48.
The home unit of the system according to the invention monitors the mode of viewing by monitor-ing the on and off and other functions of the televi-sion receiver and any video recorder that may be used in the home. The various modes of viewing or recording are illustrated in FIG. 3. Mode 1 occurs when both the VCR and television receiver are both off, and indicates that no viewing is taking place. Mode 2 represents television viewing and occurs when the television receiver is on and the VCR is off. Mode 3 represents recording by the home VCR and occurs when the television receiver is off and the VCR is on.
Mode 4 occurs when the VCR and the television receiver are both on, and can represent one of three conditions.
The first condition, designated as mode 4.0, represents television viewin~ through the tuner of the VCR with-out recording. Mode 4.1 represents VCR recording and television viewing, while the third condition, desig-nated as Mode 4.2, represents VCR playback. Other modes of operation of the VCR, such as fast forward and rewind, are designated as Modes 4.3 and 4.4, respectively. Most of these modes can be easily de-tected by monitoring power line voltage or voltages elsewhere in the television set and the video recorder.
Modes 4.0, 4.3 and 4.4 can be detected by logic cir-cuitry.
~7~7~2~
As previously stated, the home unit 10 moni-tors the viewing mode and the video signal, and ex-tracts signatures from the video signal only if cer-tain events occur. The logic necessary to provide this ~unction is illustrated in FIG. 4. ~s is appar-ent from FIG. 4, the mode of operation is recorded whenever there is a change in the mode, such as, for example, a change from viewing to recording, etc.
Each time the mode changes, a determination is made in order to determine what the new mode is. This is accomplished by determining whether the television is on or off, whether the VCR is on or off, and whether the VCR is in a record or playback mode. Once it has been determined whether the television and VCR are on or off, and whether the VCR is in a record or playback mode, the mode can readily be determined by using a look-up table containing the information in FIG. 3, and the mode is recorded.
If the mode is determined to be Mode 1, indicating no viewing, no further action is taken until the mode changes again. If i~ is determined that the mode of operation is either Mode 2 or Mode 4, the system monitors the television receiver for the occurrence of an Event 1, which may, for example, be any one of the following:
1. television turn-on 2. a channel change 3. a predetermined time interval (e.g 5-10 minutes) since the previous Event 1 4. a sudden scene change to a black scene.
Fiel~ oe t~e Inventi~
This invention relates generally to methods and apparatus for identifying programs and the viewing habits of the public, and more particularly to a method and apparatus for identifying programs, such as tele-vision programs obtained from various sources, includ-ing video recorders.
DescriPtion_of the Prior Art Systems ~or identifying programs such as television programs that are broadcast or viewed are known. Such systems fall into various categories.
These categories include manual systems wherein the viewer keeps a diary indicating all of the programs viewed; mechanical, electromechanical and electronic systems that sense the channel to which a television receiver is tuned; systems that detect identifying signals present in the television broadcast signal;
and systems that monitor and analyze the program con-tent of the broadcast signal utilizing image proces-sing ànd correlation techniques to identify the pro-gram.
While all of these systems do provide a way to identify programs and to monitor the viewing habits of the public, the manual methods are slow in acquiring data and are prone to inaccuracies resulting from the entry of erroneous data that may be intentionally or unintentionally entered. Systems that monitor the channel to which a receiver is tuned overcome the drawbacks of the manual systems, but require access to the tuning mechanism of the receiver. Such access is becoming increasingly difficult with the advent of cable and pay television systems that utilize various converters and decoders, many of which are difficult to access. Moreover, such systems cannot identify ~79~24 programs played from a source such as a home video recorder. Systems that detect identification signals encoded on the broadcast signal overcome many of the accuracy and access disadvantages described above, but require the cooperation of tbe broadcasters who must encode the programs prior to broadcast for such systems to be effective. Consequently, such systems are useable only on a limited number of broadcasts, such as network broadcasts. Systems that monitor and analyze the content of the program itself theoretical-ly eliminate the disadvantages of the other systems, but heretofore the information processing requirements of such systems rendered such systems impractical or uneconomical because of the computing capacity requir-ed to analyze the vast quantity of information presentin a broadcast signals. Moreover, previous attempts to reduce the quantity of information processed tend-ed to introduce inaccuracies.
An example of a system that utilizes the program content of a broadcast signal to identify the program is described in United States Patent No.
3,919,479 to ~oon et al. The Moon et al. system utilizes a non-linear analog transform to produce a low frequency envelope waveform, and the information in the low frequency envelope of a predetermined time interval is digitized to generate a signature. The signatures thus generated are compared with reference signatures to identify the program. However, the ~oon et al. system generates the signatures continuous-ly, and consequently, requires a large computer toprocess the data thus generated.
Another system that monitors the program content of a broadcast signal is disclosed in United States Patent No. 4,230,990 to Lert Jr. et al~ The system disclosed in the Lert Jr. et al patent reduces ~Z7~Z~
the amount of data that must be processed, as compared to the data amount of processed by the Moon et al.
patent, by utilizing cues that are either externally generated or present in the program material to ini-tiate the signature generation and correlation process only after a cue has been detected. However, the system disclosed in the Lert Jr. et al. patent is designed to monitor the programs broadcast by broad-casting stations such as network affiliated stations in order to determine whether they are broadcasting the programs required by the networks to be broadcast, rather than as a system for determining the viewing habits of the public. Thus, many of the problems that occur when the habits of a television viewer are being monitored, such as, for example, frequent chan-nel changing, and the problems that occur in identify-ing programs that are recorded and subsequently play-ed back by a home video recorder are not addressed.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a method and apparatus for identifying pro-grams that overcome many of the disadvantages of the prior art systems.
It is another object of the present inven-tion to provide an improved methoa and apparatus for determining the viewing habits of the public that utilizes the content of the program being viewed.
It is another object of the present inven-tion to provide an improved method and apparatus for ~o~;~O~;v~,9, m~intaining broadcasts and determining whether broad-casting stations are bro~dcasting the programs and commercial messages that they are required to broad-cast.
It is yet another object of the present invention to provide a method and apparatus for iden-79~4 tifying previously recorded programs being viewed by a viewer.
It is still another object of the present invention to provide a system that accurately identi-fies programs with a minimal amount of computation utilizing data reduction and correlation techniques on the program material.
It is yet another object of the present invention to provide a program identification system that extracts program identifying signatures only upon the occurrence of certain predetermined events.
It is another object of the present inven-tion to provide a program identifying system that extracts program identifying signatures from the pro-gram material and compares the extracted signatures with reference signatures in pairs to provide more accurate identification.
It is yet another object of the present invention to provide a program identifying system 29 that monitors the program material for the occurrence of predetermined events, and monitors the time inter-val between such events to identify the program, utilizing the events either by themselves or in con-junction with the extracted signatures.
It is yet another object of the present invention to provide a system that alters the identi-fication criteria depending on whether the program being viewed is a broadcast program or a program pre-viously recorded by the viewer.
Therefore, in accordance with a preferred embodiment of the invention, there is provided a sys-tem having a home unit that monitors the viewing con-ditions in the home, for example, whether the televi-sion set is on or off, whether any home video recorder (e.g., a video cassette recorder or VCR) is on or off ~' lZ7~24 and the video signal being received. By monitoring the aforementioned signals and functions, the system determines whether no viewing is occurring, whether a television broadcast is being viewed, whether a tele-vision broadcast is being recorded, whether viewingand recording is occurring simultaneously, or whether a previously recorded program is being viewed. Once the viewing mode has been established, the program being viewed is identified by extracting a character-istic signature from the video signal and storing itfor subsequent comparison with reference signatures stored in a central office.
Once the mode of viewing has been determin-ed, a signature of the program material being viewed or recorded is extracted, provided certain predeter-mined events occur first. These events shall be re-ferred to as Event 1 and Event 2. Several events can serve as Event 1. These events mAy be a turn on of the television set, a channel change, a predetermined time interval, for example 5 to 10 minutes, since the occurrence of the previous Event 1, or a sudden change to a black scene. Events that can serve as an Event 2 include a scene change to a scene other than a black sc ne, a color change, which may be an overall color change or a color change of a predetermined line, a still picture as evidenced by several consecutive substantially identical frames, an audio level change, and others.
Upon the occurrence of an Event 1, the home unit monitors the broadcast for the occurrence of an Event 2, and extracts a pair of signatures from the video signal immediately following the next two Event 2s following an Event 1. Or, if a previously recorded program is being viewed, the system extracts three or more signatures from the video signal ~279~
immediately following the next three or more Event 2s following an Event 1. The signatures are extracted by detecting and digitizing the envelope of the video signal immediately following the Event 2s. The digi-tized signatures, as well as the times that thesignatures were extracted, are stored for future comparison with reference signals stored in a central location. The time intervals between Event 2s are also stored and used to identify the program either by themselves or in conjunction with extracted signatures. The time intervals between Event 2s are particularly useful for identifying the playback of previously recorded video tapes for reasons that will be discussed in a subsequent portion of the specification.
The unit used to acquire the reference sig-natures that are compared with the signatures received from the home units is similar to the home unit except that the reference signature acquisition unit monitors each broadcast continuously, and does not require an Event 1 to initiate a signature extraction. Therefore, each broadcast is continuously monitored and a signature is extracted each time an Event 2 is detected. The signatures, as well as the times of occurrence of the signatures are stored to form a library of reference signatures.
The stored signatures are compared with signatures obtained from the home unit that occurred at approximately the same time. The time intervals between Event 2s are also stored for comparison with corresponding time intervals received from the home units.
DESCRIPTION OF THE DRAWING
These and other objects and advantages of the present invention will become readily apparent .:
Z79~2~ .
upon consideration of the following detailed descrip-tion and attached drawing wherein:
FIG. 1 is a block diagram of the home unit of the program identification system according to the present invention;
FIG. 2 is a block diagr.am of the central office and reference signature e~traction portions of the system according to the invention;
FIG. 3 is a chart illustrating the variou~
modes of viewing and recording that can occur in a typical household;
FIGS. 4 and 5 are flow charts illustrating the logical steps performed by the home and central office units, respectively;
FIG. 6 is a flow chart illustrating the logical steps performed by the central office unit in identifying signa~ures; and FIG. 7 illustrates how signatures and scene changes may be extracted from the video envelope.
Referring now to the drawing, with particular attention to FIG. 1, there is illustrated a block diagram of the home unit of the system according to the invention generally designated by the reference numeral 10. The system 10 receives signals to be identified from a television receiver 12, and in many instances from a home video recorder, - such as a video cassette recorder or a VCR 14. In a typical home installation, the receiver 12 and ~he VCR 14 receive signal from a receiving antenna 16, and in many instances from a cable television system 18. These signals may be applied directly to the receiver 12 and to the VCR 14, but it is convenient to employ a sw:itching network 20 that selectively switches tbe receiver 12 and VCR 14 to the antenna 1 127~2~
and to the cable 18 in order to permit the viewing and recording of broadcasts received from the antenna 16 or from the cable 18. In addition, the switching network 20 may connect the VCR 14 to the receiver 12 to permit prerecorded or previously recorded tapes to be played back by the VCR and viewed by the receiver 12.
Video signals representative of the program applied to the receiver 12, as wlell as video signals representative of the signals being recorded by the VCR 14, are applied to a video processing circuit 22, for example, by a video switching circuit 24 which permits either the receiver 12 or the VCR 14, or both, to be monitored. The video processing circuit 22 includes a detector and a low pass filter (discussed subsequently in greater detail), and provides a signal representative of the envelope of the video signal to an analog-to-digital converter 25 which generates a digital representation of the video envelope. The digitized video envelope signal is applied to an events detector 26 which detects predetermined events that occur in the digitized video signal, and causes the signature of the digitized video signal to be extract-ed by signature extraction circuitry 28 upon tbe oc-currence of a predetermined sequence of events. The signature thus generated is stored in a data storage system 30 along with the time that the signature was extracted. The extraction times are provided by a clock 32 which provides a digital r~presentation of time to the data storage system 30 via, for example, a combining circuit 34. The clock 32 may be a real time clock or a relative time clock that is periodical-ly reset from a central location. The function of the events detector ~6, the signature extractor cir-cuitry 28, the data storage 30 and the clock 32 can g be performed by individual circuits as shown or by a microprocessor based system.
The home unit 10 is interrogated at periodic intervals, for example, once a day, by a central of-S fice unit, generally designated by the reference numer-al 40 (FIG. 2), which compares the signatures from the various home units with reference signatures in order to identify the signatures from the home unit.
The home units may be periodically interrogated by a data communications circuit 42 that accesses the vari-ous home units via a suitable communications system, for example, a plurality of telephone lines 44. The signatures thus collected are compared by a central computer system 4~ with signatures stored in a data base 46. Central computer system 48 controls the collection and classification of the signatures re-ceived from the home unit as well as the generation of reference signatures to be stored in the data base 46. The latter function is performed in conjunction with a plurality of reference signal extraction cir-cuits 50 that are located in the cities being monitor-ed. The reference signature extraction circuits moni-tor the various networks, cables and other signal sources in those cities, and extract reference signals, for example, whenever an Event 2 occurs in any of the signals being monitored. The reference signals thus extracted are transmitted to the central office unit 40 and stored in the data base 46 along with the times that such signatures are extracted, as provided by a clock 52. The clock 52 of FIG. 2 is similar to the clock 32 of the home unit and serves to indicate the time of occurrence of the reference signatures. The clock 52 may also be a real time clock or a relative time clock that is periodically set by the central office 40. A central reference signature extraction ~2~9~2~
circuit 54 and associated clock 56 serve to extract signatures and times of extraction of cable originated programs and signatures of prerecorded programs. A1-ternatively, extraction circuits may be placed at the head ends of cable system to extract reference signa-tures of cable programs. The signature extraction performed by the various extraction circuits and data storage is controlled by the central computer system 48.
The home unit of the system according to the invention monitors the mode of viewing by monitor-ing the on and off and other functions of the televi-sion receiver and any video recorder that may be used in the home. The various modes of viewing or recording are illustrated in FIG. 3. Mode 1 occurs when both the VCR and television receiver are both off, and indicates that no viewing is taking place. Mode 2 represents television viewing and occurs when the television receiver is on and the VCR is off. Mode 3 represents recording by the home VCR and occurs when the television receiver is off and the VCR is on.
Mode 4 occurs when the VCR and the television receiver are both on, and can represent one of three conditions.
The first condition, designated as mode 4.0, represents television viewin~ through the tuner of the VCR with-out recording. Mode 4.1 represents VCR recording and television viewing, while the third condition, desig-nated as Mode 4.2, represents VCR playback. Other modes of operation of the VCR, such as fast forward and rewind, are designated as Modes 4.3 and 4.4, respectively. Most of these modes can be easily de-tected by monitoring power line voltage or voltages elsewhere in the television set and the video recorder.
Modes 4.0, 4.3 and 4.4 can be detected by logic cir-cuitry.
~7~7~2~
As previously stated, the home unit 10 moni-tors the viewing mode and the video signal, and ex-tracts signatures from the video signal only if cer-tain events occur. The logic necessary to provide this ~unction is illustrated in FIG. 4. ~s is appar-ent from FIG. 4, the mode of operation is recorded whenever there is a change in the mode, such as, for example, a change from viewing to recording, etc.
Each time the mode changes, a determination is made in order to determine what the new mode is. This is accomplished by determining whether the television is on or off, whether the VCR is on or off, and whether the VCR is in a record or playback mode. Once it has been determined whether the television and VCR are on or off, and whether the VCR is in a record or playback mode, the mode can readily be determined by using a look-up table containing the information in FIG. 3, and the mode is recorded.
If the mode is determined to be Mode 1, indicating no viewing, no further action is taken until the mode changes again. If i~ is determined that the mode of operation is either Mode 2 or Mode 4, the system monitors the television receiver for the occurrence of an Event 1, which may, for example, be any one of the following:
1. television turn-on 2. a channel change 3. a predetermined time interval (e.g 5-10 minutes) since the previous Event 1 4. a sudden scene change to a black scene.
5. loss of synchronization for an appreci-able period of time.
Such Event ls are relatively easy to detect. For example, television turn on can be detected simply by monitoring an appropriate voltage or current. Televi-sion turn-on is not used as an Event 1 in the system illustrated in FIG. 4 but may be used in other systems, particularly systems that do not monitor a VCR and consequently need not employ mode logic. A channel change can be detected by monitoring the position of the tuner mechanism when mechanical tuners are used, by monitoring tuning voltage in electrically tuned tuners, by monitoring local oscillator frequency, or even more simply by monitoring the video synchroni-zation pulses, preferably the vertical syncronization pulses and indicating a channel change in the event of a loss or a change in the syncronization pulse for a short time interval. The predetermined time interval can readily be determined from a clock, and a sudden scene change to black can be readily detected by moni-toring the average value of the video signal and indi-cating a change to a black scene wben the average value becomes that representative of an all black scene. A loss of synchronization for an appreciable length of time (longer than that caused by a channel change) indicates fast forward or rewind mode of opera-tion of a VCR (Mode 4.3 or 4.4) or the loss of the video signal (e.g. station off the air).
As long as no Event 1 occurs, the home unit records no new data; however, upon the occurrence of an Event 1, the system is conditioned to extract a signature upon the occurrence of the next two consecu-tive Event 2s, with an Event 2 being defined as:
1. a scene change to a scene other than a black scene 2. a color change in successive frames or portions ~hereof 3. a still picture 4. an audio level change.
- ~7~
Ways of detecting ths various Event 2s described above, as well as ways for extracting signatures will be discussed in a subsequent portion of the specification.
Upon tbe occurrence of an Event 1, a counter is set to zero and the video signal is monitored to determine if the television synchronization or sync signal is stable. This is accomplished, for example, by monitoring the vertical synchronization pulses and waiting until a predetermined number, for example, 16, consecutive stable vertical sync pulses are detect-ed before the unit is permitted to detect an Event 2.
If the synchronization has not been stable for a signi-ficant period of time, more than five seconds, this period will be marked either as television station is off the air or VCR fast forward or rewind.
Once the sync has been stable for the requir-ed number of pulses, the system monitors the video signal for the occurrence of an Event 2. Whenever such an Event 2 change is detected, the time of the occurrence of the Event 2 is recorded as is the time interval since the previous Event 2, if the time in-tervals between Event 2s are to be used as a means of program identification. The signature of the first frame following the last detected Event 2 change is then extracted. Since a standard broadcast television frame consists of two interlaced fields, and since the two fields that form a frame are quite similar, it is not necessary to analyze both fields of the frame to obtain a signature. Typically, a satisfactory signature is obtained from only a single field, for example, the first field of a frame. The method of extracting the signature will be discussed in greater detail in a subsequent portion of the detailed descrip-tion, as will the method of detecting an Event 2.
lZ791Z~
Once the signature has been extracted, the counter is incremented by 1. If the count in the counter is less than two, indicating that more signa-tures are needed, the system is conditioned to respond to another Event 2 to extract and record another signa-ture. If the count in the counter is two ~or the required number of signatures) or greater, indicating that the signatures required have been extracted, the system is conditioned to require an Event 1 to occur before it responds to any further Event 2s.
IE it is determined that the mode of opera-tion is Mode 3, that is, VCR recording, it is not necessary for an Event 1 to occur before the signal is monitored for Event 2s. The only determination that is made is whether the synchronization is sta~le, and if so, the system looks for Event 2s continuously and extracts the signature and records the time of occurrence of the signature each time an Event 2 is detected. Thus, all signatures following every Event 2 are extracted and stored so that upon subsequent playback, the program may be identified even though . o~ t\~
only portions ~fthe tape may be played back.
The logic for extracting reference signa-tures is illustrated in FIG. 5. Each broadcast and cable channel is monitored continuously by the refer-ence signature extraction circuits 50 and 54, and a signature is extracted each time an Event 2 occurs to provide a reference library of reference signals.
Consequently, since it is desired to extract a signa-ture that occurs after every Event 2, Event ls arenot monitored. All that is required is that the sync be stable and that an Event 2 occur. Thus, whenever an Event 2 occurs, the time of occurrence of the Event 2 as well as the signature of the scene following the scene change is recorded for future comparison with ~ ~ 7~3~24 signatures received from the various home units. The time intervals between Event 2s may be recorded or obtained from the times of occurrence of the Event 2s.
The logic employed by the central computer system 48 of the central unit 40 in order to identify a program is illustrated in FIG. 6. As is illustrated in FIG. 6, two consecutive signatures from a home unit are selected. If there is not enough data to define two consecutive signatures, the next home unit is monitored. After twQ consecutive signatures are selected, a check is made to determine whether the signatures really are a pair, for example, that there is no Event 1 between the two signatures.
If the two signatures are a pair, the time associated with the first home unit signature is read~
All reference unit signatures in the data base 46 that occurred within a predetermined time interval of the occurrence of the first home unit signature, for example, plus or minus eight seconds, are selected for comparison, and the correlation coefficient be-tween the first home unit signature and the selected reference unit signatures are computed. If one of the correlation coefficient exceeds a predetermined threshhold, the time associated with the second home unit signature is read. The next several, for example, six, reference unit signatures that occur, for example, within a predetermined time interval, for example, plus or minus eight seconds of the time associated with the second home unit signature are selected, and the correlation coefficients between the second home unit signature and the reference unit signatures are computed. If one of the correlations coefficient exceeds the predetermined threshhold, an identifica-1~79~Z~
tion is made and stored, and printed out, if neces-sary.
As discussed above, the system according to the inven~ion utilizes a time reference to access reference signatures that occurred at approximately the same time as the home unit: signature being evalu-ated in order to eliminate the need for comparing the home unit signature with all of the reference signa-tures in the data base 46. However, when a previous-ly recorded program is being played back, the timetha~ the signature occurs during playback cannot be used to locate the reference signal. Thus, in accordance with another important aspect of the present invention, the times of occurrence of signa-tures that occur when programs are being recorded arealso stored. The times of occurrence of signatures that occur in Mode 3 (recording) are kept in a separ-ate recording time file in the data base ~6. Similar-ly, in Mode 4.1 (viewing and recording) the times of signatures are also kept in the recording time file.
Thus, when the broadcast is played back (Mode 4.2), even though the recorded signatures cannot be matched to signatures stored in the reference unit during playback, the signature can still be identified by utilizing the recording time instead of the playback time to retrieve the corresponding reference signa-tures from the reference signature data base 46.
Thus, by keeping signatures relating to programs that were broadcast several days or weeks ago within the data base 4~, such previously recorded and subsequent-ly played back broadcasts can be readily identified.
Alternatively, in order to identify the playback of previously recorded programs, instead of comparing the~o~tained during playback with reference ~e signatures that represent the programs broadcast 127.~
several days or weeks ago stored in the recording time file of the reference signature data base 46 (FI~. 2) of the central office unit, the played back signatures may be compared with signatures obtained by the home unit previously during VCR recording (Mode 3) and stored in the data storage 30 (FIG. 1) of the bome unit. If desired, the signatures may also be sent to the central office, as are the signatures obtained during normal television viewing, but these signatures would be labeled as VCR recording, and may be stored in the recording time file. However, when playback occurs, the played back signatures would be compared with the signatures stored in the home unit data storage. Only if a match occurred, would the signatures be sent to the central office and compared with the signatures stored in the central office data base 46 to identify the program. If no match occurred, the signatures would'be sent. This is because what-` - ever is being played back cannot be identified, and may be something like, for example, a home movie.
Thus, the system eliminates the need to search the entire recording file of the data ~ase 46 in an attempt to identify something that cannot be identified.
In the playback mode, when attempting to match the signatures obtained during playback with the signatures stored in the data storage 30, it is convenient to use the time intervals between the occur-rence of the signatures (or Event 2s~ to generate a time interval signature, TIS, (discussed in greater detail in a subsequent portion of the specification) to obtain the match. When using a time interval signa-ture for matching, three or more consecutive signatures are extracted, and the time intervals between the signatures are compared with the time intervals between signatures stored in the data storage 30. When a ~;Z7~'Z4 corresponding pair of consecutive time intervals is found, a match is indicated. If greater accuracy is desired, more than three consecutive signatures may be extracted to provide more than two consecutive time intervals.
Event 2s may be detected in a variety of ways. For example, the video signal may be low pass filtered, for example, through a low pass filter hav-ing a cut-off frequency on the order of approximately 2 to 6 kiloHertz, and its average amplitude detected.
The signal may be diqitized by assigning a number representative of the average amplitude of the video signal for each frame. The numbers thus obtained may be compared in various ways. For example, the numbers obtained from different frames may be compared, and if the numbers are substantially different, a scene change will be indicated. The numbers compared may be obtained from consecutive frames or from non-conse-cuti~e frames, for example, frames spaced by a 20 to 40 frame interval, depending on the type of event that has been defined as the Event 2. Alternatively, a moving average of the numbers representative of the video amplitudes of the last several frames may be calculated, and the number representative of the aver age amplitude of the last detected frame compared with the moving average to indicàte a scene change if the number associated with the last frame substantial-ly differs from the moving average.
The various comparing schemes are useful for identifying various different types of Event 2s.
For example, comparing the number associated with a particular frame with the number associated with a previous frame is useful for detecting an Event 2 that may be termed an instant scene change. A moving average comparison or a comparison with frames that ~z~9~Z4 occurred several frames ago is useful for detecting an Event 2 that may be termed a fade type scene change wherein one scene is gradually faded in and the pre-vious scene is gradually fadecl out. Because in a fade type scene change, the change occurs gradually, there is no drastic change in the number associated with consecutive rames, and consequently, such a scene change cannot readily be detected by a system that compares immediately successive frames. Numbers that are substantially identical for several consecu-tive frames may be used to indicated a still picture.
Other methods of detectiny an Event 2 in-clude detecting a color change, for example, by de-tecting the average amplitude of a particular color component, such as, for example, a red component, of each frame or a particular line or lines of each frame, and making comparisons of the types described above.
Alternatively, different color components or an aver-age of the three color signals can be monitored for each frame and comparisons made. In addition, rather than monitoring an entire frame, only portions of a frame may be monitored. These portions may be select-ed to be those portions of a frame that normally do not change unless a scene change occurs. Such portions 2~ may occur near the top or bottom of the screen because such areas are less likely to be affected by action or movement occurring within a scene. The Event 2s may be detected electronically by monitoring the video envelope, or by monitoring the cathode ray tube, for example, by placing a light sensitive photo~lectric device 36 (FIG. 1) in proximity with the cathode ray tu~e, preferably in one corner thereof. Alternatively, the audio signal may be monitored by an audio proces-sing circuit 3~ and applied to the analog-to-digital ~2~3~2~
converter 25 to generate an Event 2 when the audio signal departs from a predetermined level.
In accordance with an alternative embodiment of the present invention that is particularly suitable for identifying prerecorded programs, the time inter-vals between events, or in changes in one or more predetermined parameters, can be used to define a feature string. Such a system can be used either alone, or in combination with a signature extracting system to identify the program. When used alone, the amount of data generated by the system is less than that generated by a signature generating system, and therefore, does not require much computation time to obtain a correlation. Consequently, it is not necessary to store the time of occurrenGe of each change (unless it is desired for other reasons), but rather, only the elapsed time between such changes need be stored. Such a system is particularly useful in identi~ying the playback of prerecorded programs, or delayed broadcast programs because real time data is not necessary to make the identification.
In a system wherein the intervals between predetermined changes in predetermined events are used to generate a time interval signature (TIS)~
~e_ Thc time interval signature, which can be represented as a digital code sequence, can be constructed by measuring the time intervals between the sequential occurrences of regularly occurring events in a broad-cast. Preferably, the chosen events should have the following properties:
1. Be readily measurable automatically.
2. occur at a sufficiently high rate that enough intervals are available to allow unique identi-fication of the signal.
3. Always be present ~Z'~9~3L2~
~. Cannot be controlled by program origi-nators to render identification vulnerable to changes in programming methods.
Typical events that can be used as the events to generate a time interval string includes scene changes to black, Event 2s, including shifts in the average amplitude of the video signal, departures in the amplitude o~ the instantaneous video signal from the average, shifts in the video color balance, changes in the average color of a predetermined line, for example, a line near the top of the screen, a predeter-mined audio power level, for example, silence, etc.
Thus, to define a time interval string, the home unit would a generate time interval string (TIS) by detect-ing one of the predetermined events, for example, an Event 2 such as a scene change, and store the time intervals between consecutive changes.
The monitoring of events can be done continu-ously to generate a long TIS without requiring an excessive memory capacity because such changes occur relatively infrequently, and the time intervals there-between can ~e defined by only a few bits. The TIS's thus obtained from the home unit are compared with reference TIS's stored in the central unit.
However, in ord~r further to reduce the amount of data that must be stored, the time intervals between the events being monitored may be monitored only after the occurrence of another predetermined event, such as an Event l; and it has been found that satisfactory identification can be obtained by gener-ating a feature string consisting of three time inter-vals between changes in the monitored variable, such as a scene change or other Event 2. The time interval strings thus generated are matched with reference time interval strings that are obtained in much the lZ79:~LZ4 same way as those generated by the home units except that the reference time interval strings are continu-ously generated for each broadcast or other program source being monitored.
Referring now to Fig. 7, there is shown a video envelope 100 as provided from the video proces-sing circuit 22 (Fig. 1) to the analog-to-digital converter 25. The analog-to-digital converter 25 takes a plurality of samples 102 (Fig. 7) for example, 80 samples during a single frame interval, and gener-ates a digital value representative of the amplitude of each of the samples 102. The digital values thus genera~ed are applied to the events detector 26 (Fig.
1) and to the signature extraction circuit 28 and used to detect the various events and to extract sig-natures.
In order to detect an Event 2, for example, a scene change, the events detector 26 compares each of the digiti~ed samples 102 of a current frame with a corresponding digitized sample 102 of a previous frame, either the immediately preceding frame or another previous frame, depending on the t~pe of scene change to be detected. The counterpart samples are then compared to determine whether a scene change has occurred. More specifically, the detection of a scene change occurs as follows:
1. Take, for example, 80 samples of the video envelope of each frame 2. Compare counterpart samples of a cur-rent frame and a previous frame 3. Take the absolute value of the differ-ence of each of the counterpart samples 4. Take the average of the absolute values 5. Indicate a scene change if the average ~Z~tlZ4 of the absolute values exceeds a pre-determined threshhold.
The indication of a scene change is applied to the signature extraction circuit 28 (Fig. 1~ to cause the signature extraction circuit 28 to operate on the digiti~ed samples 102 to extract the signature.
The signature extraction circuit 28 operates on the digitized samples 102 by taking the average value of consecutive samples ~02, for example, eight consecutive samples to generate a total of, for example, ten features 104 that comprise an image signature.
Typically, four bits define a feature, and consequent-ly, an image signature can be defined by forty bits of data for the example discussed above; however, in some instances more features and more data may be required.
Both the home unit 10 (Fig. 1) and the refer-ence signature extraction circuits 50 and 54 (Fig. 2) operate in the same manner to extract signatures, the only difference in operation being that the signature extraction circuit 28 (Fig. 1) requires an Event 2 to be preceded by an Event 1 before signature extraction occurs; but the reference signature extraction cir-cuits 50 and 54 (Fig. 2) do not require an Event 1 to precede an Event 2, but rather extract a reference signature each time an Event 2 occurs.
Once the home unit signatures and the refer-ence signatures are obtained, the home unit signatures will be compared with the reference unit signatures, normall~ with those signatures occurring in correspond-ing time intervals. The correlation coefficients between the home unit signatures and the reference unit signatures will be compared, and the reference signature that has the best correlation to the home unit signature will be used to identify the program 2 7~4 being viewed, provided that the correlation coef-ficient exceeds a minimum threshhold. If it does not, no match will be indicated.
Obviously, modifications and variations of the present invention are possible in light of the above teachings. Thus, it is to be understood that, within the scope of the appendèd claims, the invention may be practiced otherwise than as specifically de-scribed above.
. .
Such Event ls are relatively easy to detect. For example, television turn on can be detected simply by monitoring an appropriate voltage or current. Televi-sion turn-on is not used as an Event 1 in the system illustrated in FIG. 4 but may be used in other systems, particularly systems that do not monitor a VCR and consequently need not employ mode logic. A channel change can be detected by monitoring the position of the tuner mechanism when mechanical tuners are used, by monitoring tuning voltage in electrically tuned tuners, by monitoring local oscillator frequency, or even more simply by monitoring the video synchroni-zation pulses, preferably the vertical syncronization pulses and indicating a channel change in the event of a loss or a change in the syncronization pulse for a short time interval. The predetermined time interval can readily be determined from a clock, and a sudden scene change to black can be readily detected by moni-toring the average value of the video signal and indi-cating a change to a black scene wben the average value becomes that representative of an all black scene. A loss of synchronization for an appreciable length of time (longer than that caused by a channel change) indicates fast forward or rewind mode of opera-tion of a VCR (Mode 4.3 or 4.4) or the loss of the video signal (e.g. station off the air).
As long as no Event 1 occurs, the home unit records no new data; however, upon the occurrence of an Event 1, the system is conditioned to extract a signature upon the occurrence of the next two consecu-tive Event 2s, with an Event 2 being defined as:
1. a scene change to a scene other than a black scene 2. a color change in successive frames or portions ~hereof 3. a still picture 4. an audio level change.
- ~7~
Ways of detecting ths various Event 2s described above, as well as ways for extracting signatures will be discussed in a subsequent portion of the specification.
Upon tbe occurrence of an Event 1, a counter is set to zero and the video signal is monitored to determine if the television synchronization or sync signal is stable. This is accomplished, for example, by monitoring the vertical synchronization pulses and waiting until a predetermined number, for example, 16, consecutive stable vertical sync pulses are detect-ed before the unit is permitted to detect an Event 2.
If the synchronization has not been stable for a signi-ficant period of time, more than five seconds, this period will be marked either as television station is off the air or VCR fast forward or rewind.
Once the sync has been stable for the requir-ed number of pulses, the system monitors the video signal for the occurrence of an Event 2. Whenever such an Event 2 change is detected, the time of the occurrence of the Event 2 is recorded as is the time interval since the previous Event 2, if the time in-tervals between Event 2s are to be used as a means of program identification. The signature of the first frame following the last detected Event 2 change is then extracted. Since a standard broadcast television frame consists of two interlaced fields, and since the two fields that form a frame are quite similar, it is not necessary to analyze both fields of the frame to obtain a signature. Typically, a satisfactory signature is obtained from only a single field, for example, the first field of a frame. The method of extracting the signature will be discussed in greater detail in a subsequent portion of the detailed descrip-tion, as will the method of detecting an Event 2.
lZ791Z~
Once the signature has been extracted, the counter is incremented by 1. If the count in the counter is less than two, indicating that more signa-tures are needed, the system is conditioned to respond to another Event 2 to extract and record another signa-ture. If the count in the counter is two ~or the required number of signatures) or greater, indicating that the signatures required have been extracted, the system is conditioned to require an Event 1 to occur before it responds to any further Event 2s.
IE it is determined that the mode of opera-tion is Mode 3, that is, VCR recording, it is not necessary for an Event 1 to occur before the signal is monitored for Event 2s. The only determination that is made is whether the synchronization is sta~le, and if so, the system looks for Event 2s continuously and extracts the signature and records the time of occurrence of the signature each time an Event 2 is detected. Thus, all signatures following every Event 2 are extracted and stored so that upon subsequent playback, the program may be identified even though . o~ t\~
only portions ~fthe tape may be played back.
The logic for extracting reference signa-tures is illustrated in FIG. 5. Each broadcast and cable channel is monitored continuously by the refer-ence signature extraction circuits 50 and 54, and a signature is extracted each time an Event 2 occurs to provide a reference library of reference signals.
Consequently, since it is desired to extract a signa-ture that occurs after every Event 2, Event ls arenot monitored. All that is required is that the sync be stable and that an Event 2 occur. Thus, whenever an Event 2 occurs, the time of occurrence of the Event 2 as well as the signature of the scene following the scene change is recorded for future comparison with ~ ~ 7~3~24 signatures received from the various home units. The time intervals between Event 2s may be recorded or obtained from the times of occurrence of the Event 2s.
The logic employed by the central computer system 48 of the central unit 40 in order to identify a program is illustrated in FIG. 6. As is illustrated in FIG. 6, two consecutive signatures from a home unit are selected. If there is not enough data to define two consecutive signatures, the next home unit is monitored. After twQ consecutive signatures are selected, a check is made to determine whether the signatures really are a pair, for example, that there is no Event 1 between the two signatures.
If the two signatures are a pair, the time associated with the first home unit signature is read~
All reference unit signatures in the data base 46 that occurred within a predetermined time interval of the occurrence of the first home unit signature, for example, plus or minus eight seconds, are selected for comparison, and the correlation coefficient be-tween the first home unit signature and the selected reference unit signatures are computed. If one of the correlation coefficient exceeds a predetermined threshhold, the time associated with the second home unit signature is read. The next several, for example, six, reference unit signatures that occur, for example, within a predetermined time interval, for example, plus or minus eight seconds of the time associated with the second home unit signature are selected, and the correlation coefficients between the second home unit signature and the reference unit signatures are computed. If one of the correlations coefficient exceeds the predetermined threshhold, an identifica-1~79~Z~
tion is made and stored, and printed out, if neces-sary.
As discussed above, the system according to the inven~ion utilizes a time reference to access reference signatures that occurred at approximately the same time as the home unit: signature being evalu-ated in order to eliminate the need for comparing the home unit signature with all of the reference signa-tures in the data base 46. However, when a previous-ly recorded program is being played back, the timetha~ the signature occurs during playback cannot be used to locate the reference signal. Thus, in accordance with another important aspect of the present invention, the times of occurrence of signa-tures that occur when programs are being recorded arealso stored. The times of occurrence of signatures that occur in Mode 3 (recording) are kept in a separ-ate recording time file in the data base ~6. Similar-ly, in Mode 4.1 (viewing and recording) the times of signatures are also kept in the recording time file.
Thus, when the broadcast is played back (Mode 4.2), even though the recorded signatures cannot be matched to signatures stored in the reference unit during playback, the signature can still be identified by utilizing the recording time instead of the playback time to retrieve the corresponding reference signa-tures from the reference signature data base 46.
Thus, by keeping signatures relating to programs that were broadcast several days or weeks ago within the data base 4~, such previously recorded and subsequent-ly played back broadcasts can be readily identified.
Alternatively, in order to identify the playback of previously recorded programs, instead of comparing the~o~tained during playback with reference ~e signatures that represent the programs broadcast 127.~
several days or weeks ago stored in the recording time file of the reference signature data base 46 (FI~. 2) of the central office unit, the played back signatures may be compared with signatures obtained by the home unit previously during VCR recording (Mode 3) and stored in the data storage 30 (FIG. 1) of the bome unit. If desired, the signatures may also be sent to the central office, as are the signatures obtained during normal television viewing, but these signatures would be labeled as VCR recording, and may be stored in the recording time file. However, when playback occurs, the played back signatures would be compared with the signatures stored in the home unit data storage. Only if a match occurred, would the signatures be sent to the central office and compared with the signatures stored in the central office data base 46 to identify the program. If no match occurred, the signatures would'be sent. This is because what-` - ever is being played back cannot be identified, and may be something like, for example, a home movie.
Thus, the system eliminates the need to search the entire recording file of the data ~ase 46 in an attempt to identify something that cannot be identified.
In the playback mode, when attempting to match the signatures obtained during playback with the signatures stored in the data storage 30, it is convenient to use the time intervals between the occur-rence of the signatures (or Event 2s~ to generate a time interval signature, TIS, (discussed in greater detail in a subsequent portion of the specification) to obtain the match. When using a time interval signa-ture for matching, three or more consecutive signatures are extracted, and the time intervals between the signatures are compared with the time intervals between signatures stored in the data storage 30. When a ~;Z7~'Z4 corresponding pair of consecutive time intervals is found, a match is indicated. If greater accuracy is desired, more than three consecutive signatures may be extracted to provide more than two consecutive time intervals.
Event 2s may be detected in a variety of ways. For example, the video signal may be low pass filtered, for example, through a low pass filter hav-ing a cut-off frequency on the order of approximately 2 to 6 kiloHertz, and its average amplitude detected.
The signal may be diqitized by assigning a number representative of the average amplitude of the video signal for each frame. The numbers thus obtained may be compared in various ways. For example, the numbers obtained from different frames may be compared, and if the numbers are substantially different, a scene change will be indicated. The numbers compared may be obtained from consecutive frames or from non-conse-cuti~e frames, for example, frames spaced by a 20 to 40 frame interval, depending on the type of event that has been defined as the Event 2. Alternatively, a moving average of the numbers representative of the video amplitudes of the last several frames may be calculated, and the number representative of the aver age amplitude of the last detected frame compared with the moving average to indicàte a scene change if the number associated with the last frame substantial-ly differs from the moving average.
The various comparing schemes are useful for identifying various different types of Event 2s.
For example, comparing the number associated with a particular frame with the number associated with a previous frame is useful for detecting an Event 2 that may be termed an instant scene change. A moving average comparison or a comparison with frames that ~z~9~Z4 occurred several frames ago is useful for detecting an Event 2 that may be termed a fade type scene change wherein one scene is gradually faded in and the pre-vious scene is gradually fadecl out. Because in a fade type scene change, the change occurs gradually, there is no drastic change in the number associated with consecutive rames, and consequently, such a scene change cannot readily be detected by a system that compares immediately successive frames. Numbers that are substantially identical for several consecu-tive frames may be used to indicated a still picture.
Other methods of detectiny an Event 2 in-clude detecting a color change, for example, by de-tecting the average amplitude of a particular color component, such as, for example, a red component, of each frame or a particular line or lines of each frame, and making comparisons of the types described above.
Alternatively, different color components or an aver-age of the three color signals can be monitored for each frame and comparisons made. In addition, rather than monitoring an entire frame, only portions of a frame may be monitored. These portions may be select-ed to be those portions of a frame that normally do not change unless a scene change occurs. Such portions 2~ may occur near the top or bottom of the screen because such areas are less likely to be affected by action or movement occurring within a scene. The Event 2s may be detected electronically by monitoring the video envelope, or by monitoring the cathode ray tube, for example, by placing a light sensitive photo~lectric device 36 (FIG. 1) in proximity with the cathode ray tu~e, preferably in one corner thereof. Alternatively, the audio signal may be monitored by an audio proces-sing circuit 3~ and applied to the analog-to-digital ~2~3~2~
converter 25 to generate an Event 2 when the audio signal departs from a predetermined level.
In accordance with an alternative embodiment of the present invention that is particularly suitable for identifying prerecorded programs, the time inter-vals between events, or in changes in one or more predetermined parameters, can be used to define a feature string. Such a system can be used either alone, or in combination with a signature extracting system to identify the program. When used alone, the amount of data generated by the system is less than that generated by a signature generating system, and therefore, does not require much computation time to obtain a correlation. Consequently, it is not necessary to store the time of occurrenGe of each change (unless it is desired for other reasons), but rather, only the elapsed time between such changes need be stored. Such a system is particularly useful in identi~ying the playback of prerecorded programs, or delayed broadcast programs because real time data is not necessary to make the identification.
In a system wherein the intervals between predetermined changes in predetermined events are used to generate a time interval signature (TIS)~
~e_ Thc time interval signature, which can be represented as a digital code sequence, can be constructed by measuring the time intervals between the sequential occurrences of regularly occurring events in a broad-cast. Preferably, the chosen events should have the following properties:
1. Be readily measurable automatically.
2. occur at a sufficiently high rate that enough intervals are available to allow unique identi-fication of the signal.
3. Always be present ~Z'~9~3L2~
~. Cannot be controlled by program origi-nators to render identification vulnerable to changes in programming methods.
Typical events that can be used as the events to generate a time interval string includes scene changes to black, Event 2s, including shifts in the average amplitude of the video signal, departures in the amplitude o~ the instantaneous video signal from the average, shifts in the video color balance, changes in the average color of a predetermined line, for example, a line near the top of the screen, a predeter-mined audio power level, for example, silence, etc.
Thus, to define a time interval string, the home unit would a generate time interval string (TIS) by detect-ing one of the predetermined events, for example, an Event 2 such as a scene change, and store the time intervals between consecutive changes.
The monitoring of events can be done continu-ously to generate a long TIS without requiring an excessive memory capacity because such changes occur relatively infrequently, and the time intervals there-between can ~e defined by only a few bits. The TIS's thus obtained from the home unit are compared with reference TIS's stored in the central unit.
However, in ord~r further to reduce the amount of data that must be stored, the time intervals between the events being monitored may be monitored only after the occurrence of another predetermined event, such as an Event l; and it has been found that satisfactory identification can be obtained by gener-ating a feature string consisting of three time inter-vals between changes in the monitored variable, such as a scene change or other Event 2. The time interval strings thus generated are matched with reference time interval strings that are obtained in much the lZ79:~LZ4 same way as those generated by the home units except that the reference time interval strings are continu-ously generated for each broadcast or other program source being monitored.
Referring now to Fig. 7, there is shown a video envelope 100 as provided from the video proces-sing circuit 22 (Fig. 1) to the analog-to-digital converter 25. The analog-to-digital converter 25 takes a plurality of samples 102 (Fig. 7) for example, 80 samples during a single frame interval, and gener-ates a digital value representative of the amplitude of each of the samples 102. The digital values thus genera~ed are applied to the events detector 26 (Fig.
1) and to the signature extraction circuit 28 and used to detect the various events and to extract sig-natures.
In order to detect an Event 2, for example, a scene change, the events detector 26 compares each of the digiti~ed samples 102 of a current frame with a corresponding digitized sample 102 of a previous frame, either the immediately preceding frame or another previous frame, depending on the t~pe of scene change to be detected. The counterpart samples are then compared to determine whether a scene change has occurred. More specifically, the detection of a scene change occurs as follows:
1. Take, for example, 80 samples of the video envelope of each frame 2. Compare counterpart samples of a cur-rent frame and a previous frame 3. Take the absolute value of the differ-ence of each of the counterpart samples 4. Take the average of the absolute values 5. Indicate a scene change if the average ~Z~tlZ4 of the absolute values exceeds a pre-determined threshhold.
The indication of a scene change is applied to the signature extraction circuit 28 (Fig. 1~ to cause the signature extraction circuit 28 to operate on the digiti~ed samples 102 to extract the signature.
The signature extraction circuit 28 operates on the digitized samples 102 by taking the average value of consecutive samples ~02, for example, eight consecutive samples to generate a total of, for example, ten features 104 that comprise an image signature.
Typically, four bits define a feature, and consequent-ly, an image signature can be defined by forty bits of data for the example discussed above; however, in some instances more features and more data may be required.
Both the home unit 10 (Fig. 1) and the refer-ence signature extraction circuits 50 and 54 (Fig. 2) operate in the same manner to extract signatures, the only difference in operation being that the signature extraction circuit 28 (Fig. 1) requires an Event 2 to be preceded by an Event 1 before signature extraction occurs; but the reference signature extraction cir-cuits 50 and 54 (Fig. 2) do not require an Event 1 to precede an Event 2, but rather extract a reference signature each time an Event 2 occurs.
Once the home unit signatures and the refer-ence signatures are obtained, the home unit signatures will be compared with the reference unit signatures, normall~ with those signatures occurring in correspond-ing time intervals. The correlation coefficients between the home unit signatures and the reference unit signatures will be compared, and the reference signature that has the best correlation to the home unit signature will be used to identify the program 2 7~4 being viewed, provided that the correlation coef-ficient exceeds a minimum threshhold. If it does not, no match will be indicated.
Obviously, modifications and variations of the present invention are possible in light of the above teachings. Thus, it is to be understood that, within the scope of the appendèd claims, the invention may be practiced otherwise than as specifically de-scribed above.
. .
Claims (64)
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:
1. A method of identifying a signal received by an audience member's television receiver for determining audience ratings comprising the steps of: detecting the occurrence of a first event in the functional operations of the audience member's television receiver; detecting the occurrence of a second event after the detected first event in the signal to be identified;
extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event; storing the signature and the time of occurrence thereof; and comparing the stored signature with reference signatures that occurred at approximately the same time as the stored signature.
extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event; storing the signature and the time of occurrence thereof; and comparing the stored signature with reference signatures that occurred at approximately the same time as the stored signature.
2. The method recited in claim 1 wherein said signal is a television video signal and said second event is a scene change from one video scene to another video scene.
3. The method recited in claim 1 wherein said signal is a color television video signal and said second event is a change in the color of at least a portion of successive frames.
4. The method recited in claim 1 wherein said signal is a television video signal and said second event is a still picture.
5. The method recited in claim 1 wherein said signal is an audio signal said second event is a predetermined change in the magnitude in the audio signal.
6. The method recited in claim 1 wherein said signal is a television signal received by a television signal receiver and wherein said first event is the turn-on of the television receiver.
7. The method recited in claim 1 wherein said signal is a television signal received by a television signal receiver and wherein said first event is a change in the channel to which the television signal receiver is tuned.
8. The method recited in claim 1 wherein said first event is the elapse of a predetermined length of time after the occur-rence of the previous first event.
9. The method recited in claim 8 wherein said predeter-mined length of time is approximately 5 to 10 minutes.
10. The method recited in claim 1 wherein said signal is a television signal and said step of extracting said signature includes the step of low pass filtering a video signal of the television signal to provide a video envelope signal, periodically sampling said video envelope signal to provide a series of video samples, and digitizing said video samples to provide said signa-ture.
11. The method recited in claim 10 wherein said step of low pass filtering said video signal includes the step of passing the video signal through a low pass filter having a cut-off fre-quency of approximately 2 to 6 kHz.
12. The method recited in claim 11 wherein the step of sampling said video envelope signal includes the step of taking eighty samples of said video envelope signal and taking the aver-age of every eight consecutive samples to generate ten features that comprise the feature string.
13. The method recited in claim 10 wherein the step of sampling said video envelope signal includes the step of taking a predetermined number of samples of said video envelope signal and taking the averages of predetermined consecutive samples to gener-ate a plurality of average signals, each average signal defining one of the features that comprises the feature string.
14. A system for identifying program material received by an audience member's television receiver for determining audience ratings comprising: means for detecting a first predetermined event in the functional operations of the audience member's tele-vision receiver; means for detecting a second predetermined event in the program material; means for extracting at least one pre-determined characteristic of the program material from a single frame of a video signal; means for storing the predetermined characteristic and the time that the predetermined characteristic is extracted; and means for comparing the recorded predetermined characteristic and its time of occurrence with reference predeter-mined characteristics that occurred at substantially the same time to identify the program.
15. A system for identifying a signal received by an audience member's television receiver for determining audience ratings comprising: means for detecting the occurrence of a first event in the functional operations of the audience member's tele vision receiver; means responsive to the detected first event for detecting the occurrence of a second event in the signal to be identified; means for extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event; means for storing the signature and the time of occurrence thereof; and means for comparing the stored signature with reference signatures that occur at approximately the same time as the stored signature.
16. The system recited in claim 15 wherein said signal is a television video signal and said second event detecting means includes means for detecting a scene change from one video scene to another video scene.
17. A system as recited in claim 16 wherein said television signal is received by a television signal receiver, and wherein said means for detecting said first event includes means for detecting the turn-on of the television receiver.
18. A system as recited in claim 15 wherein said signal is a television signal received by a television signal receiver, and wherein said first event detecting means includes means for detec-ting a change in the channel to which the television signal receiver is tuned.
19. A system as recited in claim 15 wherein said first event detecting means includes means for detecting the elapse of a predetermined length of time after the occurrence of the pre-vious first event.
20. A system as recited in claim 19 wherein said detecting means includes means for setting the predetermined length of time to approximately 5 to 10 minutes.
21. A system as recited in claim 15 wherein said signal is a television signal and said means for extracting said signature includes means for low pass filtering a video signal of the television signal to provide a video envelope signal, means for periodically sampling said video envelope signal to provide a series of video samples, and means for digitizing said video sam-ples to provide said signature.
22. A system as recited in claim 21 wherein said low pass filtering means has a cut-off on the order frequency of approxi-mately 2 to 6 kHz.
23. A system as recited in claim 22 wherein said video envelope signal sampling means includes means for taking approx-imately eighty samples of said video envelope signal and means for taking the average of every eight consecutive samples to gen-erate ten features that comprise the feature string.
24. A system as recited in claim 21 wherein said video envelope signal sampling means includes means for taking a pre-determined number of samples of said video envelope signal and means for taking the averages of predetermined consecutive sam-ples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.
25. A system for identifying program material received by an audience member's television receiver for determining audience ratings comprising: means for detecting a first predetermined event in the functional operations of the audience member's tele-vision receiver; means responsive to the detected first predeter-mined event for detecting at least one second predetermined event in the programmed material; means for extracting at least one predetermined characteristic of the program material from a single frame of a video signal after the occurrence of a predetermined number of said first and second events, and means for recording the predetermined characteristic and the time of occurrence of the predetermined characteristic.
26. The system recited in claim 25 wherein said system further includes a central unit, means for transmitting the recor-ded predetermined characteristics and times to the central unit, wherein the central unit includes means for comparing the recorded predetermined characteristics and their times of occurrence with reference predetermined characteristics that occurred at substan-tially the same times to identify the program.
27. The system recited in claim 26 further including means for generating said reference predetermined characteristics, wherein said reference predetermined characteristic generating means includes means for receiving signals representative of various programs to be monitored and means for continuously ex-tracting and storing said predetermined characteristics of the programs being monitored to generate said reference predetermined characteristics.
28. A method of identifying a television signal received from either a television receiver or a video recorder for deter-mining audience viewing habits comprising the steps of: detecting predetermined operational modes of the audience member's tele-vision receiver and the video recorder; detecting the occurrence of a first event in one of the operational modes; detecting the occurrence of a second event in the signal to be identified;
extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event; and stor-ing the extracted signature, the time of the signature extraction and the detected operational mode.
extracting a signature from a single frame of the video signal to be identified after the occurrence of the second event; and stor-ing the extracted signature, the time of the signature extraction and the detected operational mode.
29. The method recited in claim 28 further including the step of comparing the extracted signature with reference signatures.
30. The method recited in claim 29 wherein said reference signatures are extracted by the steps of: monitoring a known sig-nal; detecting the occurrence of said second event in the known signal; extracting a reference signature from the known signal after the occurrence of a second event; and storing the reference signature and the time of occurrence thereof.
31. The method recited in claim 30 wherein the step of comparing includes the step of comparing the extracted signature with reference signatures that occurred at approximately the same time as the extracted signature.
32. The method recited in claim 28 wherein said second event is a scene change from one video scene to another video scene.
33. The method recited in claim 28 wherein said television signal is a color television video signal and said second event is a change in the color of at least a portion of successive frames.
34. The method recited in claim 28 wherein said second event is a still picture.
35. The method recited in claim 28 wherein said second event is a predetermined change in the magnitude in an audio signal of the television signal.
36. The method recited in claim 28 wherein said first event is the turn-on of the television receiver.
37. The method recited in claim 28 wherein said first event is a change in the channel to which the television signal receiver is tuned.
38. The method recited in claim 28 wherein said first event is the elapse of a predetermined length of time after the occurrence of the previous first event.
39. The method recited in claim 38 wherein said predeter-mined length of time is approximately 5 to 10 minutes.
40. The method recited in claim 28 wherein said step of extracting said signature includes the step of low pass filtering a video signal of the television signal to provide a video envelope signal, periodically sampling said video envelope signal to pro-vide a series of video samples, and digitizing said video samples to provide said signature.
41. The method recited in claim 40 wherein said step of low pass filtering said video signal includes the step of passing the video signal through a low pass filter having a cut-off frequency of approximately 2 to 6 kHz.
42. The method recited in claim 41 wherein the step of sampling said video envelope signal includes the step of taking eighty samples of said video envelope signal and taking the average of every eight consecutive samples to generate ten features that comprise the feature string.
43. The method recited in claim 41 wherein the step of sampling said video envelope signal includes the step of taking a predetermined number of samples of said video envelope signal and taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal de-fining one of the features that comprises the feature string.
44. A system for identifying program material viewed on a television receiver or recorded by a video recorder for determining audience viewing habits comprising: means for detecting predeter-mined operational modes of the television receiver and the video recorder; means for detecting a first predetermined event in one of the operational modes; means for detecting a second predeter-mined event in the program material, means responsive to the detected predetermined operational modes for extracting a predeter-mined characteristic of the program material from a single frame of a video signal after the occurrence of said second predetermined event; and means for storing the predetermined characteristic, the time the predetermined characteristic is extracted and the detec-ted predetermined operational mode.
45. A system as recited in claim 44 wherein said extracting means includes means for extracting said predetermined character-istic upon the second occurrence of the second predetermined event following the occurrence of said first event.
46. A system as recited in claim 45 wherein said extracting means includes means responsive to a detected recording operational mode for extracting said predetermined characteristic upon each occurrence of the second predetermined event, and wherein the predetermined characteristic further includes the time interval between the second event and the immediately preceding second event.
47. A system as recited in claim 44 further including means for comparing the extracted predetermined characteristics with stored reference predetermined characteristics to identify the program material.
48. A system for identifying a television signal received from both a television receiver and a video recorder for deter-mining audience viewing habits comprising: means for detecting predetermined changes in the operational modes of the television receiver and the video recorder; means for detecting the occurrence of a first event in one of the operational modes; means responsive to both the detection of a first event and a detected viewing operational mode for detecting the occurrence of a second event in the signal to be identified; means responsive to a detected record-ing operational mode for detecting the occurrence of a second event in the signal to be identified; means responsive to the detection of a second event for extracting a signature from a single frame of the video signal to be identified after the occur-rence of the second event; and means for storing the extracted signature and the detected operational mode.
49. A system as recited in claim 48 further including means for comparing said stored signatures with reference sig-natures obtained from known signals to identify the signal.
50. A system as recited in claim 49 further including means for obtaining the reference signatures, said reference signal ob-taining means including means for monitoring known signals, means for detecting the occurrence of second events in said known signals, and means responsive to the detection of the second events for extracting reference signatures from the known signals because real time data is not necessary to make the identification.
51. A system as recited in claim 50 wherein said comparing means includes means for comparing an extracted signature with reference signatures that occurred at approximately the same time.
52. The system recited in claim 48 wherein said second event detecting means includes means for detecting a scene change from one video scene to another video scene.
53. A system as recited in claim 49 wherein said means for detecting said first event includes means for detecting the turn-on of the television receiver.
54. A system as recited in claim 48 wherein said first event detecting means includes means for detecting a change in the chan-nel to which the television signal receiver is tuned.
55. A system as recited in claim 48 wherein said first event detecting means includes means for detecting the elapse of a pre-determined length of time after the occurrence of the previous first event.
56. A system as recited in claim 55 wherein said detecting means includes means for setting the predetermined length of time to approximately 5 to 10 minutes.
57. A system as recited in claim 48 wherein said means for extracting said signature includes means for low pass filter-ing a video signal of the television signal to provide a video envelope signal, means for periodically sampling said video envel-ope signal to provide a series of video samples, and means for digitizing said video samples to provide said signature.
58. A system as recited in claim 57 wherein said low pass filtering means has a cut-off on the order frequency of approx-imately 2 to 6 kHz.
59. A system as recited in claim 58 wherein said video envelope signal sampling means includes means for taking approx-imately eighty samples of said video envelope signal and means for taking the average of every eight consecutive samples to generate ten features that comprise the feature string.
60. A system as recited in claim 57 wherein said video envelope signal sampling means includes means for taking a pre-determined number of samples of said video envelope signal and means for taking the averages of predetermined consecutive samples to generate a plurality of average signals, each average signal defining one of the features that comprises the feature string.
61. In a system for identifying programs viewed on a tele-vision receiver, wherein the programs are obtained from a video recorder and from an external program source, the improvement comprising: means responsive to the on/off condition of the television receiver; means responsive to the on/off condition and the play/record condition of the video recorder; logic means responsive to the television receiver condition responsive means and the video recorder condition responsive means for providing an indication if the program being viewed is being obtained from the video recorder or from the external program source; means for identifying the program being viewed, said identifying means being responsive to said logic means and operative to identify said program according to two different criteria depending on whether the program being viewed is obtained from the external program source or from the video recorder.
62. The improvement recited in claim 61 further including means responsive to said video recorder condition responsive means for storing data representative of the program being viewed in two different manners depending on whether or not the program being viewed is being recorded.
63. In a system for determining the viewing habits of a household having a video recorder capable of recording programs obtained from an external program source and playing video pro-grams, and a television receiver for viewing programs obtained from the external program source and from the video recorder, said system having a home unit and a central unit, the improvement comprising: means responsive to predetermined operating conditions of said television receiver and said video recorder to provide signals representative of television viewing, recording, and play-back; means for detecting during viewing a first predetermined event in the program material; means responsive to the detection of said first predetermined event for detecting during viewing a second predetermined event in the program material; means respon-sive to the detection of said second predetermined event for extracting during viewing at least one predetermined character-istic of the program material; means for storing at the home unit the predetermined characteristic of the viewed program material and the time that the predetermined characteristic is extracted;
means for continuously detecting during recording the second pre-determined events in the program material; means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material; means for storing during recording the predeter-mined characteristics and the times that the predetermined char-acteristics are extracted; means for comparing the predetermined characteristics stored during viewing and recording and their times of occurrence with reference predetermined characteristics stored in the central unit that occurred at substantially the same time to identify the programs viewed and recorded; means for detecting during playback the first predetermined event in the program material; means responsive to the detection of said first pre-determined event for detecting during playback the second predeter-mined event in the program material; means responsive to the detec-tion of said second predetermined event for extracting during playback at least one predetermined characteristic of the program material; means for recording during playback the predetermined characteristic; and means for comparing the predetermined char-acteristic recorded during playback with reference predetermined characteristics stored at the central unit at the time of recor-ding to identify the program.
means for continuously detecting during recording the second pre-determined events in the program material; means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material; means for storing during recording the predeter-mined characteristics and the times that the predetermined char-acteristics are extracted; means for comparing the predetermined characteristics stored during viewing and recording and their times of occurrence with reference predetermined characteristics stored in the central unit that occurred at substantially the same time to identify the programs viewed and recorded; means for detecting during playback the first predetermined event in the program material; means responsive to the detection of said first pre-determined event for detecting during playback the second predeter-mined event in the program material; means responsive to the detec-tion of said second predetermined event for extracting during playback at least one predetermined characteristic of the program material; means for recording during playback the predetermined characteristic; and means for comparing the predetermined char-acteristic recorded during playback with reference predetermined characteristics stored at the central unit at the time of recor-ding to identify the program.
64 . In a system for determining the viewing habits of a household having a video recorder and a television receiver, said system having a home unit and a central unit, the improvement comprising: means responsive to predetermined parameters of said television receiver and said video recorder to provide signals representative of television viewing, playback and recording;
means for detecting during viewing a first predetermined event in the program material; means responsive to the detection of said first predetermined event for detecting during viewing a second predetermined event in the program material; means responsive to the detection of said second predetermined event for extracting during viewing at least one predetermined characteristic of the program material; means at the home unit for storing during viewing the predetermined characteristic and the time that the predeter mined characteristic is extracted; means for continuously detect-ing during recording the second predetermined events in the pro-gram material; means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material; means at the home unit for storing during recording the predetermined characteristics and the times of occurrence thereof; means at the home unit for determining time intervals between the detected predetermined second events during recording; means for detecting during playback the second predetermined events in the program material; means responsive to the detection of said second pre-determined events for extracting during playback at least one predetermined characteristic of the program material; means at the home-unit for determining time intervals between the detected predetermined second events during playback; means at the home unit for comparing the time intervals between the detected events during playback and the time intervals between the events stored during recording; and means responsive to a match provided by the comparing means for comparing the predetermined characteristics extracted during recording with reference characteristics stored in the central unit to identify the program.
means for detecting during viewing a first predetermined event in the program material; means responsive to the detection of said first predetermined event for detecting during viewing a second predetermined event in the program material; means responsive to the detection of said second predetermined event for extracting during viewing at least one predetermined characteristic of the program material; means at the home unit for storing during viewing the predetermined characteristic and the time that the predeter mined characteristic is extracted; means for continuously detect-ing during recording the second predetermined events in the pro-gram material; means responsive to the detection of said second predetermined events for extracting during recording at least one predetermined characteristic of the program material; means at the home unit for storing during recording the predetermined characteristics and the times of occurrence thereof; means at the home unit for determining time intervals between the detected predetermined second events during recording; means for detecting during playback the second predetermined events in the program material; means responsive to the detection of said second pre-determined events for extracting during playback at least one predetermined characteristic of the program material; means at the home-unit for determining time intervals between the detected predetermined second events during playback; means at the home unit for comparing the time intervals between the detected events during playback and the time intervals between the events stored during recording; and means responsive to a match provided by the comparing means for comparing the predetermined characteristics extracted during recording with reference characteristics stored in the central unit to identify the program.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA000615693A CA1290052C (en) | 1984-04-26 | 1990-04-04 | Program identification method and apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US06/604,367 | 1984-04-26 | ||
US06/604,367 US4697209A (en) | 1984-04-26 | 1984-04-26 | Methods and apparatus for automatically identifying programs viewed or recorded |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA000615693A Division CA1290052C (en) | 1984-04-26 | 1990-04-04 | Program identification method and apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
CA1279124C true CA1279124C (en) | 1991-01-15 |
Family
ID=24419321
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA000480035A Expired - Lifetime CA1279124C (en) | 1984-04-26 | 1985-04-25 | Program identification method and apparatus |
Country Status (8)
Country | Link |
---|---|
US (1) | US4697209A (en) |
EP (2) | EP0161512B1 (en) |
JP (1) | JPS60236331A (en) |
AT (1) | ATE44849T1 (en) |
BR (2) | BR8501965A (en) |
CA (1) | CA1279124C (en) |
DE (1) | DE3571733D1 (en) |
ES (5) | ES8700531A1 (en) |
Families Citing this family (394)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4677466A (en) * | 1985-07-29 | 1987-06-30 | A. C. Nielsen Company | Broadcast program identification method and apparatus |
US4739398A (en) * | 1986-05-02 | 1988-04-19 | Control Data Corporation | Method, apparatus and system for recognizing broadcast segments |
JPS6356091A (en) * | 1986-08-26 | 1988-03-10 | Video Res:Kk | Recognition device for television commercial broadcasting |
US5034902A (en) * | 1986-12-09 | 1991-07-23 | Srg Schweizerische Radio-Und Fernsehgesellschaft | Method and system for ascertaining the consumption habits of a test population |
US4843562A (en) * | 1987-06-24 | 1989-06-27 | Broadcast Data Systems Limited Partnership | Broadcast information classification system and method |
US4847685A (en) * | 1987-08-07 | 1989-07-11 | Audience Information Measurement System | Audience survey system |
US4943963A (en) * | 1988-01-19 | 1990-07-24 | A. C. Nielsen Company | Data collection and transmission system with real time clock |
JPH01284092A (en) * | 1988-01-26 | 1989-11-15 | Integrated Circuit Technol Ltd | Method and apparatus for discriminating and eliminating specific data from video signal |
US4955070A (en) * | 1988-06-29 | 1990-09-04 | Viewfacts, Inc. | Apparatus and method for automatically monitoring broadcast band listening habits |
US4858000A (en) * | 1988-09-14 | 1989-08-15 | A. C. Nielsen Company | Image recognition audience measurement system and method |
US5019899A (en) * | 1988-11-01 | 1991-05-28 | Control Data Corporation | Electronic data encoding and recognition system |
US4857999A (en) * | 1988-12-20 | 1989-08-15 | Peac Media Research, Inc. | Video monitoring system |
US4972503A (en) * | 1989-08-08 | 1990-11-20 | A. C. Nielsen Company | Method and apparatus for determining audience viewing habits by jamming a control signal and identifying the viewers command |
JPH0666738B2 (en) * | 1990-04-06 | 1994-08-24 | 株式会社ビデオ・リサーチ | CM automatic confirmation device |
US5210820A (en) * | 1990-05-02 | 1993-05-11 | Broadcast Data Systems Limited Partnership | Signal recognition system and method |
CA2036205C (en) * | 1990-06-01 | 1996-11-19 | Russell J. Welsh | Program monitoring unit |
US5165069A (en) * | 1990-07-30 | 1992-11-17 | A. C. Nielsen Company | Method and system for non-invasively identifying the operational status of a VCR |
FR2681997A1 (en) * | 1991-09-30 | 1993-04-02 | Arbitron Cy | METHOD AND DEVICE FOR AUTOMATICALLY IDENTIFYING A PROGRAM COMPRISING A SOUND SIGNAL |
US6400996B1 (en) | 1999-02-01 | 2002-06-04 | Steven M. Hoffberg | Adaptive pattern recognition based control system and method |
US6850252B1 (en) | 1999-10-05 | 2005-02-01 | Steven M. Hoffberg | Intelligent electronic appliance system and method |
US6081750A (en) * | 1991-12-23 | 2000-06-27 | Hoffberg; Steven Mark | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US10361802B1 (en) * | 1999-02-01 | 2019-07-23 | Blanding Hovenweep, Llc | Adaptive pattern recognition based control system and method |
US8352400B2 (en) | 1991-12-23 | 2013-01-08 | Hoffberg Steven M | Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore |
USRE48056E1 (en) | 1991-12-23 | 2020-06-16 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5903454A (en) | 1991-12-23 | 1999-05-11 | Hoffberg; Linda Irene | Human-factored interface corporating adaptive pattern recognition based controller apparatus |
US6418424B1 (en) | 1991-12-23 | 2002-07-09 | Steven M. Hoffberg | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US7242988B1 (en) | 1991-12-23 | 2007-07-10 | Linda Irene Hoffberg | Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore |
US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
USRE47908E1 (en) | 1991-12-23 | 2020-03-17 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
USRE46310E1 (en) | 1991-12-23 | 2017-02-14 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5436653A (en) * | 1992-04-30 | 1995-07-25 | The Arbitron Company | Method and system for recognition of broadcast segments |
US6301369B2 (en) | 1992-07-31 | 2001-10-09 | Digimarc Corporation | Image marking to permit later identification |
US5721788A (en) | 1992-07-31 | 1998-02-24 | Corbis Corporation | Method and system for digital image signatures |
GB9221678D0 (en) * | 1992-10-15 | 1992-11-25 | Taylor Nelson Group Limited | Identifying a received programme stream |
NZ259776A (en) * | 1992-11-16 | 1997-06-24 | Ceridian Corp | Identifying recorded or broadcast audio signals by mixing with encoded signal derived from code signal modulated by narrower bandwidth identification signal |
US7509270B1 (en) | 1992-12-09 | 2009-03-24 | Discovery Communications, Inc. | Electronic Book having electronic commerce features |
US7835989B1 (en) | 1992-12-09 | 2010-11-16 | Discovery Communications, Inc. | Electronic book alternative delivery systems |
US6463585B1 (en) | 1992-12-09 | 2002-10-08 | Discovery Communications, Inc. | Targeted advertisement using television delivery systems |
ATE183352T1 (en) * | 1992-12-09 | 1999-08-15 | Discovery Communicat Inc | IMPROVED TOP-UP TERMINAL FOR CABLE TELEVISION DISTRIBUTION SYSTEMS |
US7336788B1 (en) | 1992-12-09 | 2008-02-26 | Discovery Communicatoins Inc. | Electronic book secure communication with home subsystem |
US7849393B1 (en) | 1992-12-09 | 2010-12-07 | Discovery Communications, Inc. | Electronic book connection to world watch live |
US5600364A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Network controller for cable television delivery systems |
US7168084B1 (en) | 1992-12-09 | 2007-01-23 | Sedna Patent Services, Llc | Method and apparatus for targeting virtual objects |
US5600573A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Operations center with video storage for a television program packaging and delivery system |
US7401286B1 (en) | 1993-12-02 | 2008-07-15 | Discovery Communications, Inc. | Electronic book electronic links |
US5986690A (en) * | 1992-12-09 | 1999-11-16 | Discovery Communications, Inc. | Electronic book selection and delivery system |
US5659350A (en) | 1992-12-09 | 1997-08-19 | Discovery Communications, Inc. | Operations center for a television program packaging and delivery system |
US8073695B1 (en) | 1992-12-09 | 2011-12-06 | Adrea, LLC | Electronic book with voice emulation features |
US5798785A (en) | 1992-12-09 | 1998-08-25 | Discovery Communications, Inc. | Terminal for suggesting programs offered on a television program delivery system |
US7073187B1 (en) | 1992-12-09 | 2006-07-04 | Sedna Patent Services, Llc | Menu-driven television program access system and method |
US7269841B1 (en) | 1992-12-09 | 2007-09-11 | Sedna Patent Services, Llc | Digital cable headend for cable television delivery system |
US9286294B2 (en) * | 1992-12-09 | 2016-03-15 | Comcast Ip Holdings I, Llc | Video and digital multimedia aggregator content suggestion engine |
US6181335B1 (en) | 1992-12-09 | 2001-01-30 | Discovery Communications, Inc. | Card for a set top terminal |
US5696866A (en) * | 1993-01-08 | 1997-12-09 | Srt, Inc. | Method and apparatus for eliminating television commercial messages |
US5987210A (en) * | 1993-01-08 | 1999-11-16 | Srt, Inc. | Method and apparatus for eliminating television commercial messages |
US5333091B2 (en) * | 1993-01-08 | 1996-12-17 | Arthur D Little Enterprises | Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages |
EP0693215B1 (en) * | 1993-01-08 | 1998-11-25 | Arthur D. Little Enterprises, Inc. | Method and apparatus for eliminating television commercial messages |
US5692093A (en) * | 1993-01-08 | 1997-11-25 | Srt, Inc. | Method and apparatus for eliminating television commercial messages |
CH689662A5 (en) * | 1993-01-13 | 1999-07-30 | Sieghard Dr Gall | Listener choice detection among simultaneously available broadcasts |
DE4401571C2 (en) * | 1993-01-20 | 1995-05-04 | Sieghard Dr Gall | Procedures for the assessment of sound and / or image sequence |
AU6097294A (en) * | 1993-02-17 | 1994-09-14 | Ameritech Services, Inc. | Universal tv interface and related method |
DE4312185A1 (en) * | 1993-04-14 | 1994-10-20 | Thomas Hohenacker | Device for storing image information displayed on a monitor |
US5404160A (en) * | 1993-06-24 | 1995-04-04 | Berkeley Varitronics Systems, Inc. | System and method for identifying a television program |
US5355161A (en) * | 1993-07-28 | 1994-10-11 | Concord Media Systems | Identification system for broadcast program segments |
US5483276A (en) * | 1993-08-02 | 1996-01-09 | The Arbitron Company | Compliance incentives for audience monitoring/recording devices |
US5485518A (en) * | 1993-09-30 | 1996-01-16 | Yellowstone Environmental Science, Inc. | Electronic media program recognition and choice |
JP3340532B2 (en) * | 1993-10-20 | 2002-11-05 | 株式会社日立製作所 | Video search method and apparatus |
US5481294A (en) * | 1993-10-27 | 1996-01-02 | A. C. Nielsen Company | Audience measurement system utilizing ancillary codes and passive signatures |
US7313251B2 (en) | 1993-11-18 | 2007-12-25 | Digimarc Corporation | Method and system for managing and controlling electronic media |
US5822436A (en) * | 1996-04-25 | 1998-10-13 | Digimarc Corporation | Photographic products and methods employing embedded information |
US5748763A (en) | 1993-11-18 | 1998-05-05 | Digimarc Corporation | Image steganography system featuring perceptually adaptive and globally scalable signal embedding |
US6983051B1 (en) | 1993-11-18 | 2006-01-03 | Digimarc Corporation | Methods for audio watermarking and decoding |
US6611607B1 (en) | 1993-11-18 | 2003-08-26 | Digimarc Corporation | Integrating digital watermarks in multimedia content |
US6424725B1 (en) | 1996-05-16 | 2002-07-23 | Digimarc Corporation | Determining transformations of media signals with embedded code signals |
US6614914B1 (en) | 1995-05-08 | 2003-09-02 | Digimarc Corporation | Watermark embedder and reader |
US5768426A (en) | 1993-11-18 | 1998-06-16 | Digimarc Corporation | Graphics processing system employing embedded code signals |
US6944298B1 (en) | 1993-11-18 | 2005-09-13 | Digimare Corporation | Steganographic encoding and decoding of auxiliary codes in media signals |
US5841978A (en) * | 1993-11-18 | 1998-11-24 | Digimarc Corporation | Network linking method using steganographically embedded data objects |
US6122403A (en) | 1995-07-27 | 2000-09-19 | Digimarc Corporation | Computer system linked by using information in data objects |
US6408082B1 (en) | 1996-04-25 | 2002-06-18 | Digimarc Corporation | Watermark detection using a fourier mellin transform |
US6449377B1 (en) | 1995-05-08 | 2002-09-10 | Digimarc Corporation | Methods and systems for watermark processing of line art images |
US7171016B1 (en) | 1993-11-18 | 2007-01-30 | Digimarc Corporation | Method for monitoring internet dissemination of image, video and/or audio files |
US6757406B2 (en) | 1993-11-18 | 2004-06-29 | Digimarc Corporation | Steganographic image processing |
US6516079B1 (en) | 2000-02-14 | 2003-02-04 | Digimarc Corporation | Digital watermark screening and detecting strategies |
US7861166B1 (en) | 1993-12-02 | 2010-12-28 | Discovery Patent Holding, Llc | Resizing document pages to fit available hardware screens |
US8095949B1 (en) | 1993-12-02 | 2012-01-10 | Adrea, LLC | Electronic book with restricted access features |
US7865567B1 (en) | 1993-12-02 | 2011-01-04 | Discovery Patent Holdings, Llc | Virtual on-demand electronic book |
US9053640B1 (en) | 1993-12-02 | 2015-06-09 | Adrea, LLC | Interactive electronic book |
US5581658A (en) * | 1993-12-14 | 1996-12-03 | Infobase Systems, Inc. | Adaptive system for broadcast program identification and reporting |
US5450490A (en) * | 1994-03-31 | 1995-09-12 | The Arbitron Company | Apparatus and methods for including codes in audio signals and decoding |
WO1995027349A1 (en) * | 1994-03-31 | 1995-10-12 | The Arbitron Company, A Division Of Ceridian Corporation | Apparatus and methods for including codes in audio signals and decoding |
US5594934A (en) * | 1994-09-21 | 1997-01-14 | A.C. Nielsen Company | Real time correlation meter |
US8094949B1 (en) | 1994-10-21 | 2012-01-10 | Digimarc Corporation | Music methods and systems |
US6560349B1 (en) | 1994-10-21 | 2003-05-06 | Digimarc Corporation | Audio monitoring using steganographic information |
US7724919B2 (en) * | 1994-10-21 | 2010-05-25 | Digimarc Corporation | Methods and systems for steganographic processing |
US5790169A (en) * | 1994-11-03 | 1998-08-04 | Hohenacker; Thomas | Device for storing picture or code information displayed on a screen, carrier cards for such devices and method for the transmission of a code |
TW250616B (en) | 1994-11-07 | 1995-07-01 | Discovery Communicat Inc | Electronic book selection and delivery system |
GB9425333D0 (en) * | 1994-12-15 | 1995-02-15 | Philips Electronics Uk Ltd | Telivision receiver |
US7486799B2 (en) | 1995-05-08 | 2009-02-03 | Digimarc Corporation | Methods for monitoring audio and images on the internet |
US7224819B2 (en) | 1995-05-08 | 2007-05-29 | Digimarc Corporation | Integrating digital watermarks in multimedia content |
US6760463B2 (en) * | 1995-05-08 | 2004-07-06 | Digimarc Corporation | Watermarking methods and media |
US7805500B2 (en) | 1995-05-08 | 2010-09-28 | Digimarc Corporation | Network linking methods and apparatus |
US6411725B1 (en) | 1995-07-27 | 2002-06-25 | Digimarc Corporation | Watermark enabled video objects |
US6577746B1 (en) | 1999-12-28 | 2003-06-10 | Digimarc Corporation | Watermark-based object linking and embedding |
US7711564B2 (en) | 1995-07-27 | 2010-05-04 | Digimarc Corporation | Connected audio and other media objects |
US6829368B2 (en) | 2000-01-26 | 2004-12-07 | Digimarc Corporation | Establishing and interacting with on-line media collections using identifiers in media signals |
US6965682B1 (en) * | 1999-05-19 | 2005-11-15 | Digimarc Corp | Data transmission by watermark proxy |
US6505160B1 (en) | 1995-07-27 | 2003-01-07 | Digimarc Corporation | Connected audio and other media objects |
US7562392B1 (en) | 1999-05-19 | 2009-07-14 | Digimarc Corporation | Methods of interacting with audio and ambient music |
US5649283A (en) * | 1995-09-28 | 1997-07-15 | Lucent Technologies Inc. | Program verification for cable television at a consumer location |
JP3534368B2 (en) * | 1996-04-03 | 2004-06-07 | 株式会社東芝 | Moving image processing method and moving image processing apparatus |
US5767922A (en) * | 1996-04-05 | 1998-06-16 | Cornell Research Foundation, Inc. | Apparatus and process for detecting scene breaks in a sequence of video frames |
US7505605B2 (en) * | 1996-04-25 | 2009-03-17 | Digimarc Corporation | Portable devices and methods employing digital watermarking |
US8180844B1 (en) | 2000-03-18 | 2012-05-15 | Digimarc Corporation | System for linking from objects to remote resources |
JP3625344B2 (en) * | 1996-11-05 | 2005-03-02 | 株式会社ビデオリサーチ | Viewing channel detector |
US6381341B1 (en) | 1996-05-16 | 2002-04-30 | Digimarc Corporation | Watermark encoding method exploiting biases inherent in original signal |
US5889548A (en) * | 1996-05-28 | 1999-03-30 | Nielsen Media Research, Inc. | Television receiver use metering with separate program and sync detectors |
US6647548B1 (en) * | 1996-09-06 | 2003-11-11 | Nielsen Media Research, Inc. | Coded/non-coded program audience measurement system |
US5999689A (en) * | 1996-11-01 | 1999-12-07 | Iggulden; Jerry | Method and apparatus for controlling a videotape recorder in real-time to automatically identify and selectively skip segments of a television broadcast signal during recording of the television signal |
US6002443A (en) | 1996-11-01 | 1999-12-14 | Iggulden; Jerry | Method and apparatus for automatically identifying and selectively altering segments of a television broadcast signal in real-time |
US6771316B1 (en) | 1996-11-01 | 2004-08-03 | Jerry Iggulden | Method and apparatus for selectively altering a televised video signal in real-time |
US7269330B1 (en) | 1996-11-01 | 2007-09-11 | Televentions, Llc | Method and apparatus for controlling a video recorder/player to selectively alter a video signal |
US6604242B1 (en) * | 1998-05-18 | 2003-08-05 | Liberate Technologies | Combining television broadcast and personalized/interactive information |
US7617508B2 (en) | 2003-12-12 | 2009-11-10 | At&T Intellectual Property I, L.P. | Methods and systems for collaborative capture of television viewer generated clickstreams |
US6983478B1 (en) * | 2000-02-01 | 2006-01-03 | Bellsouth Intellectual Property Corporation | Method and system for tracking network use |
WO1998031114A1 (en) | 1997-01-06 | 1998-07-16 | Bellsouth Corporation | Method and system for tracking network use |
US20060253884A1 (en) * | 1997-01-06 | 2006-11-09 | Gray James H | Methods and systems for network based capture of television viewer generated clickstreams |
US8677384B2 (en) | 2003-12-12 | 2014-03-18 | At&T Intellectual Property I, L.P. | Methods and systems for network based capture of television viewer generated clickstreams |
US7020652B2 (en) * | 2001-12-21 | 2006-03-28 | Bellsouth Intellectual Property Corp. | System and method for customizing content-access lists |
US20060075456A1 (en) * | 1997-01-06 | 2006-04-06 | Gray James Harold | Methods and systems for collaborative capture of television viewer generated clickstreams |
US7802276B2 (en) | 1997-01-06 | 2010-09-21 | At&T Intellectual Property I, L.P. | Systems, methods and products for assessing subscriber content access |
US7587323B2 (en) | 2001-12-14 | 2009-09-08 | At&T Intellectual Property I, L.P. | System and method for developing tailored content |
US8640160B2 (en) | 1997-01-06 | 2014-01-28 | At&T Intellectual Property I, L.P. | Method and system for providing targeted advertisements |
US6675383B1 (en) * | 1997-01-22 | 2004-01-06 | Nielsen Media Research, Inc. | Source detection apparatus and method for audience measurement |
AU764269B2 (en) * | 1997-01-22 | 2003-08-14 | Nielsen Media Research, Inc. | Source detection apparatus and method for audience measurement |
CA2196930C (en) * | 1997-02-06 | 2005-06-21 | Nael Hirzalla | Video sequence recognition |
US6326970B1 (en) | 1997-05-16 | 2001-12-04 | Liberate Technologies | TV centric layout |
GB2327167A (en) * | 1997-07-09 | 1999-01-13 | Register Group Limited The | Identification of television commercials |
US7003790B1 (en) * | 1998-01-31 | 2006-02-21 | Sony Corporation | Broadcast-program selection history information acquisition apparatus and its method |
US7689532B1 (en) | 2000-07-20 | 2010-03-30 | Digimarc Corporation | Using embedded data with file sharing |
CA2289519C (en) * | 1998-05-12 | 2001-04-10 | Nielsen Media Research, Inc. | Audience measurement system for digital television |
US5974299A (en) | 1998-05-27 | 1999-10-26 | Massetti; Enrico Emilio | Audience rating system for digital television and radio |
US6163510A (en) * | 1998-06-30 | 2000-12-19 | International Business Machines Corporation | Multimedia search and indexing system and method of operation using audio cues with signal thresholds |
US9009773B1 (en) | 1998-06-30 | 2015-04-14 | Cox Communications, Inc. | Method and apparatus for providing broadcast data services |
US7006555B1 (en) | 1998-07-16 | 2006-02-28 | Nielsen Media Research, Inc. | Spectral audio encoding |
US7558472B2 (en) | 2000-08-22 | 2009-07-07 | Tivo Inc. | Multimedia signal processing system |
US6233389B1 (en) | 1998-07-30 | 2001-05-15 | Tivo, Inc. | Multimedia time warping system |
US8332478B2 (en) | 1998-10-01 | 2012-12-11 | Digimarc Corporation | Context sensitive connected content |
AU2047100A (en) | 1998-12-07 | 2000-06-26 | Index Systems, Inc. | System and method for generating video taping reminders |
US7421723B2 (en) * | 1999-01-07 | 2008-09-02 | Nielsen Media Research, Inc. | Detection of media links in broadcast signals |
US8364136B2 (en) | 1999-02-01 | 2013-01-29 | Steven M Hoffberg | Mobile system, a method of operating mobile system and a non-transitory computer readable medium for a programmable control of a mobile system |
US7904187B2 (en) | 1999-02-01 | 2011-03-08 | Hoffberg Steven M | Internet appliance system and method |
US6289514B1 (en) | 1999-03-29 | 2001-09-11 | Qcom Tv, Inc. | System and method for the near-real time capture and reporting of large population consumer behaviors concerning television use |
US8095796B2 (en) | 1999-05-19 | 2012-01-10 | Digimarc Corporation | Content identifiers |
US20020032734A1 (en) | 2000-07-26 | 2002-03-14 | Rhoads Geoffrey B. | Collateral data combined with user characteristics to select web site |
US7302574B2 (en) | 1999-05-19 | 2007-11-27 | Digimarc Corporation | Content identifiers triggering corresponding responses through collaborative processing |
US7565294B2 (en) | 1999-05-19 | 2009-07-21 | Digimarc Corporation | Methods and systems employing digital content |
US6906733B1 (en) | 1999-05-21 | 2005-06-14 | Gateway, Inc. | Method, signal, system, and interface for display week-at-a-glance per-network electronic program guide grid |
US6717590B1 (en) | 1999-05-21 | 2004-04-06 | Gateway, Inc. | Verified scheduling of recurrent program recording operations |
US6871180B1 (en) | 1999-05-25 | 2005-03-22 | Arbitron Inc. | Decoding of information in audio signals |
US6549929B1 (en) | 1999-06-02 | 2003-04-15 | Gateway, Inc. | Intelligent scheduled recording and program reminders for recurring events |
AU3712300A (en) | 1999-06-11 | 2001-01-02 | Liberate Technologies | Hierarchical open security information delegation and acquisition |
US6957445B1 (en) | 1999-06-16 | 2005-10-18 | Gateway Inc. | Method, system, software, and signal for performing events for related programs |
US7284255B1 (en) * | 1999-06-18 | 2007-10-16 | Steven G. Apel | Audience survey system, and system and methods for compressing and correlating audio signals |
US6523175B1 (en) | 1999-08-02 | 2003-02-18 | Nielsen Media Research, Inc. | Methods and apparatus for identifying the source of a user selected signal via an intermediate frequency probe |
US6591421B1 (en) | 1999-08-25 | 2003-07-08 | Spotware Technologies, Inc. | System and method for automatically detecting and generating electronic program guide entries of future programming |
US8326584B1 (en) | 1999-09-14 | 2012-12-04 | Gracenote, Inc. | Music searching methods based on human perception |
US6684399B1 (en) | 1999-09-17 | 2004-01-27 | Spotware Technologies, Inc. | Electronic program guide including live network multimedia broadcast channels |
WO2001022729A1 (en) | 1999-09-20 | 2001-03-29 | Tivo, Inc. | Closed caption tagging system |
US7174293B2 (en) * | 1999-09-21 | 2007-02-06 | Iceberg Industries Llc | Audio identification system and method |
US7194752B1 (en) | 1999-10-19 | 2007-03-20 | Iceberg Industries, Llc | Method and apparatus for automatically recognizing input audio and/or video streams |
US7444661B1 (en) | 1999-09-30 | 2008-10-28 | Gateway Inc. | Electronic program guide utilizing multiple tuning sources |
US6469749B1 (en) * | 1999-10-13 | 2002-10-22 | Koninklijke Philips Electronics N.V. | Automatic signature-based spotting, learning and extracting of commercials and other video content |
CA2809775C (en) * | 1999-10-27 | 2017-03-21 | The Nielsen Company (Us), Llc | Audio signature extraction and correlation |
US6862741B1 (en) | 1999-12-22 | 2005-03-01 | Gateway, Inc. | System and method for displaying event related electronic program guide data on intelligent remote devices |
US6577346B1 (en) * | 2000-01-24 | 2003-06-10 | Webtv Networks, Inc. | Recognizing a pattern in a video segment to identify the video segment |
US6771885B1 (en) * | 2000-02-07 | 2004-08-03 | Koninklijke Philips Electronics N.V. | Methods and apparatus for recording programs prior to or beyond a preset recording time period |
US20040255334A1 (en) * | 2000-03-28 | 2004-12-16 | Gotuit Audio, Inc. | Methods and apparatus for seamlessly changing volumes during playback using a compact disk changer |
US6968564B1 (en) | 2000-04-06 | 2005-11-22 | Nielsen Media Research, Inc. | Multi-band spectral audio encoding |
US7466742B1 (en) | 2000-04-21 | 2008-12-16 | Nielsen Media Research, Inc. | Detection of entropy in connection with audio signals |
US8121843B2 (en) | 2000-05-02 | 2012-02-21 | Digimarc Corporation | Fingerprint methods and systems for media signals |
KR100443673B1 (en) | 2000-07-13 | 2004-08-09 | 엘지전자 주식회사 | Multimedia Service System Based On User History |
US6879652B1 (en) * | 2000-07-14 | 2005-04-12 | Nielsen Media Research, Inc. | Method for encoding an input signal |
ES2414650T3 (en) | 2000-08-23 | 2013-07-22 | Gracenote, Inc. | Procedure and system for obtaining information |
US8010988B2 (en) * | 2000-09-14 | 2011-08-30 | Cox Ingemar J | Using features extracted from an audio and/or video work to obtain information about the work |
US8205237B2 (en) | 2000-09-14 | 2012-06-19 | Cox Ingemar J | Identifying works, using a sub-linear time search, such as an approximate nearest neighbor search, for initiating a work-based action, such as an action on the internet |
US7129972B2 (en) * | 2000-09-25 | 2006-10-31 | Canon Kabushiki Kaisha | Image sensing device for transmitting images |
US6965683B2 (en) | 2000-12-21 | 2005-11-15 | Digimarc Corporation | Routing networks for use with watermark systems |
WO2002051063A1 (en) | 2000-12-21 | 2002-06-27 | Digimarc Corporation | Methods, apparatus and programs for generating and utilizing content signatures |
US8103877B2 (en) | 2000-12-21 | 2012-01-24 | Digimarc Corporation | Content identification and electronic tickets, coupons and credits |
US20020114299A1 (en) * | 2000-12-27 | 2002-08-22 | Daozheng Lu | Apparatus and method for measuring tuning of a digital broadcast receiver |
DE60228202D1 (en) | 2001-02-12 | 2008-09-25 | Gracenote Inc | METHOD FOR GENERATING AN IDENTIFICATION HASH FROM THE CONTENTS OF A MULTIMEDIA FILE |
DE60215357T2 (en) * | 2001-02-23 | 2007-08-23 | Popcatcher Ab | Method for receiving a media signal |
DE10117871C1 (en) * | 2001-04-10 | 2002-07-04 | Fraunhofer Ges Forschung | Signal identification extraction method for identification of audio data uses coordinate points provided by frequency values and their occurence points |
US7046819B2 (en) | 2001-04-25 | 2006-05-16 | Digimarc Corporation | Encoded reference signal for digital watermarks |
US8572640B2 (en) * | 2001-06-29 | 2013-10-29 | Arbitron Inc. | Media data use measurement with remote decoding/pattern matching |
WO2003009277A2 (en) * | 2001-07-20 | 2003-01-30 | Gracenote, Inc. | Automatic identification of sound recordings |
US7908628B2 (en) | 2001-08-03 | 2011-03-15 | Comcast Ip Holdings I, Llc | Video and digital multimedia aggregator content coding and formatting |
US7793326B2 (en) | 2001-08-03 | 2010-09-07 | Comcast Ip Holdings I, Llc | Video and digital multimedia aggregator |
JP4191397B2 (en) * | 2001-08-23 | 2008-12-03 | 富士通株式会社 | Information processing system and information processing apparatus |
US7012653B1 (en) * | 2001-11-30 | 2006-03-14 | Bellsouth Intellectual Property Corporation | Program restart and commercial ending notification method and system |
US7444658B1 (en) * | 2001-12-14 | 2008-10-28 | At&T Intellectual Property I, L.P. | Method and system to perform content targeting |
US7212979B1 (en) | 2001-12-14 | 2007-05-01 | Bellsouth Intellectuall Property Corporation | System and method for identifying desirable subscribers |
US9967633B1 (en) | 2001-12-14 | 2018-05-08 | At&T Intellectual Property I, L.P. | System and method for utilizing television viewing patterns |
US20110178877A1 (en) | 2001-12-14 | 2011-07-21 | Swix Scott R | Advertising and content management systems and methods |
US7086075B2 (en) | 2001-12-21 | 2006-08-01 | Bellsouth Intellectual Property Corporation | Method and system for managing timed responses to A/V events in television programming |
US8086491B1 (en) | 2001-12-31 | 2011-12-27 | At&T Intellectual Property I, L. P. | Method and system for targeted content distribution using tagged data streams |
US20030131350A1 (en) | 2002-01-08 | 2003-07-10 | Peiffer John C. | Method and apparatus for identifying a digital audio signal |
WO2003062960A2 (en) * | 2002-01-22 | 2003-07-31 | Digimarc Corporation | Digital watermarking and fingerprinting including symchronization, layering, version control, and compressed embedding |
JP2005517211A (en) | 2002-02-05 | 2005-06-09 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Efficient storage of fingerprints |
US20030154493A1 (en) * | 2002-02-14 | 2003-08-14 | Kagle Jonathan C. | Identifying unique broadcasts |
US7461392B2 (en) | 2002-07-01 | 2008-12-02 | Microsoft Corporation | System and method for identifying and segmenting repeating media objects embedded in a stream |
US7239981B2 (en) | 2002-07-26 | 2007-07-03 | Arbitron Inc. | Systems and methods for gathering audience measurement data |
US7222071B2 (en) * | 2002-09-27 | 2007-05-22 | Arbitron Inc. | Audio data receipt/exposure measurement with code monitoring and signature extraction |
US8959016B2 (en) | 2002-09-27 | 2015-02-17 | The Nielsen Company (Us), Llc | Activating functions in processing devices using start codes embedded in audio |
US9711153B2 (en) | 2002-09-27 | 2017-07-18 | The Nielsen Company (Us), Llc | Activating functions in processing devices using encoded audio and detecting audio signatures |
AU2003275382A1 (en) * | 2002-10-02 | 2004-04-23 | Nielsen Media Research, Inc. | Methods and apparatus to present survey information |
JP3861790B2 (en) * | 2002-10-09 | 2006-12-20 | ソニー株式会社 | Data management system, data management method, client terminal, and server device |
ES2507642T3 (en) | 2002-10-15 | 2014-10-15 | Verance Corporation | Media supervision, management and information system |
US20040098744A1 (en) * | 2002-11-18 | 2004-05-20 | Koninklijke Philips Electronics N.V. | Creation of a stereotypical profile via image based clustering |
US8204353B2 (en) * | 2002-11-27 | 2012-06-19 | The Nielsen Company (Us), Llc | Apparatus and methods for tracking and analyzing digital recording device event sequences |
US7483835B2 (en) * | 2002-12-23 | 2009-01-27 | Arbitron, Inc. | AD detection using ID code and extracted signature |
EP1586045A1 (en) | 2002-12-27 | 2005-10-19 | Nielsen Media Research, Inc. | Methods and apparatus for transcoding metadata |
US7248777B2 (en) | 2003-04-17 | 2007-07-24 | Nielsen Media Research, Inc. | Methods and apparatus to detect content skipping by a consumer of a recorded program |
AU2003249319A1 (en) | 2003-06-20 | 2005-01-28 | Nielsen Media Research, Inc | Signature-based program identification apparatus and methods for use with digital broadcast systems |
WO2005011294A1 (en) * | 2003-07-28 | 2005-02-03 | Nec Corporation | Broadcast viewing survey system |
US20050044561A1 (en) * | 2003-08-20 | 2005-02-24 | Gotuit Audio, Inc. | Methods and apparatus for identifying program segments by detecting duplicate signal patterns |
AU2003263033A1 (en) * | 2003-08-29 | 2005-04-14 | Nielsen Media Research, Inc. | Audio based methods and apparatus for detecting a channel change event |
WO2005036877A1 (en) | 2003-09-12 | 2005-04-21 | Nielsen Media Research, Inc. | Digital video signature apparatus and methods for use with video program identification systems |
WO2005034395A2 (en) * | 2003-09-17 | 2005-04-14 | Nielsen Media Research, Inc. | Methods and apparatus to operate an audience metering device with voice commands |
US9027043B2 (en) * | 2003-09-25 | 2015-05-05 | The Nielsen Company (Us), Llc | Methods and apparatus to detect an operating state of a display |
US7786987B2 (en) * | 2003-09-25 | 2010-08-31 | The Nielsen Company (Us), Llc | Methods and apparatus to detect an operating state of a display based on visible light |
US9055239B2 (en) | 2003-10-08 | 2015-06-09 | Verance Corporation | Signal continuity assessment using embedded watermarks |
US20070039018A1 (en) * | 2005-08-09 | 2007-02-15 | Verance Corporation | Apparatus, systems and methods for broadcast advertising stewardship |
KR101244308B1 (en) * | 2003-12-08 | 2013-03-18 | 삼성전자주식회사 | Encoding Method for moving picture file and the Digital right management using the same |
AU2005214965B2 (en) * | 2004-02-17 | 2011-05-19 | The Nielsen Company (Us), Llc | Methods and apparatus to determine audience viewing of recorded programs |
WO2005079941A1 (en) | 2004-02-17 | 2005-09-01 | Nielsen Media Research, Inc. Et Al. | Methods and apparatus for monitoring video games |
AU2011213735B2 (en) * | 2004-02-17 | 2013-07-11 | The Nielsen Company (Us), Llc | Methods and Apparatus to Determine Audience Viewing of Recorded Programs |
US7594242B2 (en) * | 2004-02-23 | 2009-09-22 | The Nielsen Company (Us), Llc | Methods and apparatus to detect an internally generated signal mode of a local media playback device |
US20050193426A1 (en) * | 2004-02-27 | 2005-09-01 | Raja Neogi | System and method to control fingerprint processing in a media network |
US7483975B2 (en) | 2004-03-26 | 2009-01-27 | Arbitron, Inc. | Systems and methods for gathering data concerning usage of media data |
US8738763B2 (en) | 2004-03-26 | 2014-05-27 | The Nielsen Company (Us), Llc | Research data gathering with a portable monitor and a stationary device |
BRPI0401757C1 (en) * | 2004-05-14 | 2006-01-17 | Ibope Pesquisa De Midia Ltda | Audience measurement system and method |
US20050267750A1 (en) * | 2004-05-27 | 2005-12-01 | Anonymous Media, Llc | Media usage monitoring and measurement system and method |
US20150051967A1 (en) | 2004-05-27 | 2015-02-19 | Anonymous Media Research, Llc | Media usage monitoring and measurment system and method |
AU2005269957B2 (en) * | 2004-07-02 | 2011-09-22 | The Nielsen Company (Us), Llc | Methods and apparatus for identifying viewing information associated with a digital media device |
CN101077014B (en) | 2004-08-09 | 2013-09-25 | 尼尔森(美国)有限公司 | Methods and apparatus to monitor audio/visual content from various sources |
MX2007002071A (en) * | 2004-08-18 | 2007-04-24 | Nielsen Media Res Inc | Methods and apparatus for generating signatures. |
US7623823B2 (en) * | 2004-08-31 | 2009-11-24 | Integrated Media Measurement, Inc. | Detecting and measuring exposure to media content items |
US9967534B1 (en) | 2004-11-19 | 2018-05-08 | Tivo Solutions Inc. | Digital video recorder video editing system |
EP3591864B1 (en) * | 2004-11-22 | 2022-04-27 | Nielsen Media Research, Inc. | Apparatus and method to identify a media time shift |
US20060167458A1 (en) * | 2005-01-25 | 2006-07-27 | Lorenz Gabele | Lock and release mechanism for a sternal clamp |
CN2792450Y (en) * | 2005-02-18 | 2006-07-05 | 冯锦满 | Energy-focusing healthy equipment |
WO2007022250A2 (en) | 2005-08-16 | 2007-02-22 | Nielsen Media Research, Inc. | Display device on/off detection methods and apparatus |
CN103000210A (en) | 2005-10-21 | 2013-03-27 | 尼尔逊媒介研究股份有限公司 | Methods and apparatus for metering portable media players |
CN101371472B (en) * | 2005-12-12 | 2017-04-19 | 尼尔逊媒介研究股份有限公司 | Systems and methods to wirelessly meter audio/visual devices |
US9015740B2 (en) | 2005-12-12 | 2015-04-21 | The Nielsen Company (Us), Llc | Systems and methods to wirelessly meter audio/visual devices |
WO2007073484A2 (en) * | 2005-12-20 | 2007-06-28 | Arbitron Inc. | Methods and systems for conducting research operations |
PT1826932E (en) | 2006-02-22 | 2011-10-03 | Media Evolution Technologies Inc | Method and apparatus for generating digital audio signatures |
KR101583268B1 (en) | 2006-03-27 | 2016-01-08 | 닐슨 미디어 리서치 인코퍼레이티드 | Methods and systems to meter media content presented on a wireless communication device |
US7735101B2 (en) | 2006-03-28 | 2010-06-08 | Cisco Technology, Inc. | System allowing users to embed comments at specific points in time into media presentation |
EP2030439B1 (en) | 2006-06-15 | 2018-09-19 | The Nielsen Company (US), LLC | Methods and apparatus to meter content exposure using closed caption information |
US8019162B2 (en) * | 2006-06-20 | 2011-09-13 | The Nielsen Company (Us), Llc | Methods and apparatus for detecting on-screen media sources |
US7661121B2 (en) * | 2006-06-22 | 2010-02-09 | Tivo, Inc. | In-band data recognition and synchronization system |
US7873982B2 (en) * | 2006-06-22 | 2011-01-18 | Tivo Inc. | Method and apparatus for creating and viewing customized multimedia segments |
KR20090031771A (en) | 2006-07-12 | 2009-03-27 | 아비트론 인코포레이티드 | Methods and systems for compliance confirmation and incentives |
US20080051029A1 (en) * | 2006-08-25 | 2008-02-28 | Bradley James Witteman | Phone-based broadcast audio identification |
JP4728197B2 (en) * | 2006-09-28 | 2011-07-20 | 株式会社ビデオリサーチ | Viewing channel determination method and system, terminal device, and center device |
EP1933482A1 (en) * | 2006-12-13 | 2008-06-18 | Taylor Nelson Sofres Plc | audience measurement system, fixed and portable monitoring devices |
US20090041100A1 (en) | 2006-12-13 | 2009-02-12 | Viasat, Inc. | Link aware mobile data network |
US10885543B1 (en) * | 2006-12-29 | 2021-01-05 | The Nielsen Company (Us), Llc | Systems and methods to pre-scale media content to facilitate audience measurement |
AU2008218716B2 (en) | 2007-02-20 | 2012-05-10 | The Nielsen Company (Us), Llc | Methods and apparatus for characterizing media |
CA2702847A1 (en) * | 2007-02-23 | 2008-08-28 | Mediciones Electricas De Andalucia, S.L. | Device for measuring consumption patterns through the electric network and method for the use thereof |
ES2324443B1 (en) * | 2007-02-23 | 2010-06-01 | Mediciones Electricas De Andalucia, S.L. | DEVICE FOR MEASURING PATTERNS OF CONSUMPTION THROUGH THE ELECTRICAL NETWORK. |
US8077930B2 (en) * | 2007-04-13 | 2011-12-13 | Atg Advanced Swiss Technology Group Ag | Method for recognizing content in an image sequence |
US10489795B2 (en) * | 2007-04-23 | 2019-11-26 | The Nielsen Company (Us), Llc | Determining relative effectiveness of media content items |
WO2008137385A2 (en) | 2007-05-02 | 2008-11-13 | Nielsen Media Research, Inc. | Methods and apparatus for generating signatures |
US20080274687A1 (en) | 2007-05-02 | 2008-11-06 | Roberts Dale T | Dynamic mixed media package |
JP4428424B2 (en) * | 2007-08-20 | 2010-03-10 | ソニー株式会社 | Information processing apparatus, information processing method, program, and recording medium |
AU2013260728B2 (en) * | 2007-10-18 | 2015-08-06 | The Nielsen Company (U.S.), Inc. | Methods and apparatus to create a media measurement reference database from a plurality of distributed source |
US20090106297A1 (en) * | 2007-10-18 | 2009-04-23 | David Howell Wright | Methods and apparatus to create a media measurement reference database from a plurality of distributed sources |
CA2858944C (en) | 2007-11-12 | 2017-08-22 | The Nielsen Company (Us), Llc | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
US8136140B2 (en) * | 2007-11-20 | 2012-03-13 | Dish Network L.L.C. | Methods and apparatus for generating metadata utilized to filter content from a video stream using text data |
US8165451B2 (en) | 2007-11-20 | 2012-04-24 | Echostar Technologies L.L.C. | Methods and apparatus for displaying information regarding interstitials of a video stream |
US8165450B2 (en) * | 2007-11-19 | 2012-04-24 | Echostar Technologies L.L.C. | Methods and apparatus for filtering content in a video stream using text data |
JP4556990B2 (en) * | 2007-11-29 | 2010-10-06 | ソニー株式会社 | Information recording apparatus, information recording system, and information recording method |
US8280905B2 (en) * | 2007-12-21 | 2012-10-02 | Georgetown University | Automated forensic document signatures |
US8312023B2 (en) * | 2007-12-21 | 2012-11-13 | Georgetown University | Automated forensic document signatures |
AU2008347134A1 (en) | 2007-12-31 | 2009-07-16 | Arbitron, Inc. | Survey data acquisition |
US8930003B2 (en) | 2007-12-31 | 2015-01-06 | The Nielsen Company (Us), Llc | Data capture bridge |
US8457951B2 (en) | 2008-01-29 | 2013-06-04 | The Nielsen Company (Us), Llc | Methods and apparatus for performing variable black length watermarking of media |
CN102982810B (en) * | 2008-03-05 | 2016-01-13 | 尼尔森(美国)有限公司 | Generate the method and apparatus of signature |
US8606085B2 (en) | 2008-03-20 | 2013-12-10 | Dish Network L.L.C. | Method and apparatus for replacement of audio data in recorded audio/video stream |
US8156520B2 (en) | 2008-05-30 | 2012-04-10 | EchoStar Technologies, L.L.C. | Methods and apparatus for presenting substitute content in an audio/video stream using text data |
US20090307061A1 (en) * | 2008-06-10 | 2009-12-10 | Integrated Media Measurement, Inc. | Measuring Exposure To Media |
US20090307084A1 (en) * | 2008-06-10 | 2009-12-10 | Integrated Media Measurement, Inc. | Measuring Exposure To Media Across Multiple Media Delivery Mechanisms |
US8180712B2 (en) | 2008-09-30 | 2012-05-15 | The Nielsen Company (Us), Llc | Methods and apparatus for determining whether a media presentation device is in an on state or an off state |
US8359205B2 (en) | 2008-10-24 | 2013-01-22 | The Nielsen Company (Us), Llc | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
US8121830B2 (en) | 2008-10-24 | 2012-02-21 | The Nielsen Company (Us), Llc | Methods and apparatus to extract data encoded in media content |
US9667365B2 (en) | 2008-10-24 | 2017-05-30 | The Nielsen Company (Us), Llc | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
US8108887B2 (en) | 2008-10-30 | 2012-01-31 | The Nielsen Company (Us), Llc | Methods and apparatus for identifying media content using temporal signal characteristics |
US9124769B2 (en) * | 2008-10-31 | 2015-09-01 | The Nielsen Company (Us), Llc | Methods and apparatus to verify presentation of media content |
US8793717B2 (en) | 2008-10-31 | 2014-07-29 | The Nielsen Company (Us), Llc | Probabilistic methods and apparatus to determine the state of a media device |
US10567823B2 (en) | 2008-11-26 | 2020-02-18 | Free Stream Media Corp. | Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device |
US8180891B1 (en) | 2008-11-26 | 2012-05-15 | Free Stream Media Corp. | Discovery, access control, and communication with networked services from within a security sandbox |
US9519772B2 (en) | 2008-11-26 | 2016-12-13 | Free Stream Media Corp. | Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device |
US10631068B2 (en) | 2008-11-26 | 2020-04-21 | Free Stream Media Corp. | Content exposure attribution based on renderings of related content across multiple devices |
US9026668B2 (en) | 2012-05-26 | 2015-05-05 | Free Stream Media Corp. | Real-time and retargeted advertising on multiple screens of a user watching television |
US10977693B2 (en) | 2008-11-26 | 2021-04-13 | Free Stream Media Corp. | Association of content identifier of audio-visual data with additional data through capture infrastructure |
US9154942B2 (en) | 2008-11-26 | 2015-10-06 | Free Stream Media Corp. | Zero configuration communication between a browser and a networked media device |
US9961388B2 (en) | 2008-11-26 | 2018-05-01 | David Harrison | Exposure of public internet protocol addresses in an advertising exchange server to improve relevancy of advertisements |
US10419541B2 (en) | 2008-11-26 | 2019-09-17 | Free Stream Media Corp. | Remotely control devices over a network without authentication or registration |
US9986279B2 (en) | 2008-11-26 | 2018-05-29 | Free Stream Media Corp. | Discovery, access control, and communication with networked services |
US10880340B2 (en) | 2008-11-26 | 2020-12-29 | Free Stream Media Corp. | Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device |
US10334324B2 (en) | 2008-11-26 | 2019-06-25 | Free Stream Media Corp. | Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device |
US9386356B2 (en) | 2008-11-26 | 2016-07-05 | Free Stream Media Corp. | Targeting with television audience data across multiple screens |
US8508357B2 (en) | 2008-11-26 | 2013-08-13 | The Nielsen Company (Us), Llc | Methods and apparatus to encode and decode audio for shopper location and advertisement presentation tracking |
US9390167B2 (en) | 2010-07-29 | 2016-07-12 | Soundhound, Inc. | System and methods for continuous audio matching |
US8407735B2 (en) | 2008-12-24 | 2013-03-26 | Echostar Technologies L.L.C. | Methods and apparatus for identifying segments of content in a presentation stream using signature data |
US8510771B2 (en) | 2008-12-24 | 2013-08-13 | Echostar Technologies L.L.C. | Methods and apparatus for filtering content from a presentation stream using signature data |
US8588579B2 (en) | 2008-12-24 | 2013-11-19 | Echostar Technologies L.L.C. | Methods and apparatus for filtering and inserting content into a presentation stream using signature data |
US8156517B2 (en) | 2008-12-30 | 2012-04-10 | The Nielsen Company (U.S.), Llc | Methods and apparatus to enforce a power off state of an audience measurement device during shipping |
US20100169908A1 (en) * | 2008-12-30 | 2010-07-01 | Nielsen Christen V | Methods and apparatus to enforce a power off state of an audience measurement device during shipping |
US8375404B2 (en) * | 2008-12-30 | 2013-02-12 | The Nielsen Company (Us), Llc | Methods and apparatus to enforce a power off state of an audience measurement device during shipping |
US8326127B2 (en) * | 2009-01-30 | 2012-12-04 | Echostar Technologies L.L.C. | Methods and apparatus for identifying portions of a video stream based on characteristics of the video stream |
US8438596B2 (en) | 2009-04-08 | 2013-05-07 | Tivo Inc. | Automatic contact information transmission system |
AU2010242814B2 (en) * | 2009-05-01 | 2014-07-31 | The Nielsen Company (Us), Llc | Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content |
CN102461066B (en) | 2009-05-21 | 2015-09-09 | 数字标记公司 | Differentiate the method for content signal |
US10949458B2 (en) | 2009-05-29 | 2021-03-16 | Inscape Data, Inc. | System and method for improving work load management in ACR television monitoring system |
US10116972B2 (en) | 2009-05-29 | 2018-10-30 | Inscape Data, Inc. | Methods for identifying video segments and displaying option to view from an alternative source and/or on an alternative device |
US9055335B2 (en) * | 2009-05-29 | 2015-06-09 | Cognitive Networks, Inc. | Systems and methods for addressing a media database using distance associative hashing |
US9449090B2 (en) | 2009-05-29 | 2016-09-20 | Vizio Inscape Technologies, Llc | Systems and methods for addressing a media database using distance associative hashing |
US8769584B2 (en) | 2009-05-29 | 2014-07-01 | TVI Interactive Systems, Inc. | Methods for displaying contextually targeted content on a connected television |
US10375451B2 (en) | 2009-05-29 | 2019-08-06 | Inscape Data, Inc. | Detection of common media segments |
US8437617B2 (en) | 2009-06-17 | 2013-05-07 | Echostar Technologies L.L.C. | Method and apparatus for modifying the presentation of content |
GB2474508B (en) * | 2009-10-16 | 2015-12-09 | Norwell Sa | Audience measurement system |
US20110090346A1 (en) * | 2009-10-16 | 2011-04-21 | At&T Intellectual Property I, L.P. | Remote video device monitoring |
US8925024B2 (en) | 2009-12-31 | 2014-12-30 | The Nielsen Company (Us), Llc | Methods and apparatus to detect commercial advertisements associated with media presentations |
US8934758B2 (en) | 2010-02-09 | 2015-01-13 | Echostar Global B.V. | Methods and apparatus for presenting supplemental content in association with recorded content |
US9026034B2 (en) | 2010-05-04 | 2015-05-05 | Project Oda, Inc. | Automatic detection of broadcast programming |
US10192138B2 (en) | 2010-05-27 | 2019-01-29 | Inscape Data, Inc. | Systems and methods for reducing data density in large datasets |
US9838753B2 (en) | 2013-12-23 | 2017-12-05 | Inscape Data, Inc. | Monitoring individual viewing of television events using tracking pixels and cookies |
US9047371B2 (en) | 2010-07-29 | 2015-06-02 | Soundhound, Inc. | System and method for matching a query against a broadcast stream |
GB2483250A (en) * | 2010-08-31 | 2012-03-07 | British Broadcasting Corp | Producing edit decision list by comparing edited video with source video |
US8978086B2 (en) | 2011-07-06 | 2015-03-10 | Symphony Advanced Media | Media content based advertising survey platform apparatuses and systems |
US10142687B2 (en) | 2010-11-07 | 2018-11-27 | Symphony Advanced Media, Inc. | Audience content exposure monitoring apparatuses, methods and systems |
US9380356B2 (en) | 2011-04-12 | 2016-06-28 | The Nielsen Company (Us), Llc | Methods and apparatus to generate a tag for media content |
US9035163B1 (en) | 2011-05-10 | 2015-05-19 | Soundbound, Inc. | System and method for targeting content based on identified audio and multimedia |
US8955003B2 (en) * | 2011-05-19 | 2015-02-10 | Echostar Technologies L.L.C. | Apparatus, systems and methods for a media device pre-operation |
US9515904B2 (en) | 2011-06-21 | 2016-12-06 | The Nielsen Company (Us), Llc | Monitoring streaming media content |
US9209978B2 (en) | 2012-05-15 | 2015-12-08 | The Nielsen Company (Us), Llc | Methods and apparatus to measure exposure to streaming media |
US8732739B2 (en) | 2011-07-18 | 2014-05-20 | Viggle Inc. | System and method for tracking and rewarding media and entertainment usage including substantially real time rewards |
US9696336B2 (en) | 2011-11-30 | 2017-07-04 | The Nielsen Company (Us), Llc | Multiple meter detection and processing using motion data |
CA2859560A1 (en) | 2011-12-19 | 2013-06-27 | The Nielsen Company (Us), Llc | Methods and apparatus for crediting a media presentation device |
US9332363B2 (en) | 2011-12-30 | 2016-05-03 | The Nielsen Company (Us), Llc | System and method for determining meter presence utilizing ambient fingerprints |
US9692535B2 (en) | 2012-02-20 | 2017-06-27 | The Nielsen Company (Us), Llc | Methods and apparatus for automatic TV on/off detection |
JP5967990B2 (en) * | 2012-03-16 | 2016-08-10 | 株式会社ビデオリサーチ | Investigation system and method, and investigation apparatus |
US8681950B2 (en) | 2012-03-28 | 2014-03-25 | Interactive Intelligence, Inc. | System and method for fingerprinting datasets |
US8843952B2 (en) | 2012-06-28 | 2014-09-23 | Google Inc. | Determining TV program information based on analysis of audio fingerprints |
US9113203B2 (en) * | 2012-06-28 | 2015-08-18 | Google Inc. | Generating a sequence of audio fingerprints at a set top box |
US10957310B1 (en) | 2012-07-23 | 2021-03-23 | Soundhound, Inc. | Integrated programming framework for speech and text understanding with meaning parsing |
US9282366B2 (en) | 2012-08-13 | 2016-03-08 | The Nielsen Company (Us), Llc | Methods and apparatus to communicate audience measurement information |
US9661361B2 (en) | 2012-09-19 | 2017-05-23 | Google Inc. | Systems and methods for live media content matching |
US9992729B2 (en) | 2012-10-22 | 2018-06-05 | The Nielsen Company (Us), Llc | Systems and methods for wirelessly modifying detection characteristics of portable devices |
US9106953B2 (en) | 2012-11-28 | 2015-08-11 | The Nielsen Company (Us), Llc | Media monitoring based on predictive signature caching |
CN104520719B (en) | 2012-11-30 | 2017-12-08 | 尼尔森(美国)有限公司 | Use more gauge checks of exercise data and processing |
US9183849B2 (en) | 2012-12-21 | 2015-11-10 | The Nielsen Company (Us), Llc | Audio matching with semantic audio recognition and report generation |
US9158760B2 (en) | 2012-12-21 | 2015-10-13 | The Nielsen Company (Us), Llc | Audio decoding with supplemental semantic audio recognition and report generation |
US9195649B2 (en) | 2012-12-21 | 2015-11-24 | The Nielsen Company (Us), Llc | Audio processing techniques for semantic audio recognition and report generation |
US9313544B2 (en) | 2013-02-14 | 2016-04-12 | The Nielsen Company (Us), Llc | Methods and apparatus to measure exposure to streaming media |
US9325381B2 (en) | 2013-03-15 | 2016-04-26 | The Nielsen Company (Us), Llc | Methods, apparatus and articles of manufacture to monitor mobile devices |
US20150039321A1 (en) | 2013-07-31 | 2015-02-05 | Arbitron Inc. | Apparatus, System and Method for Reading Codes From Digital Audio on a Processing Device |
US9711152B2 (en) | 2013-07-31 | 2017-07-18 | The Nielsen Company (Us), Llc | Systems apparatus and methods for encoding/decoding persistent universal media codes to encoded audio |
US9507849B2 (en) | 2013-11-28 | 2016-11-29 | Soundhound, Inc. | Method for combining a query and a communication command in a natural language computer system |
US9955192B2 (en) | 2013-12-23 | 2018-04-24 | Inscape Data, Inc. | Monitoring individual viewing of television events using tracking pixels and cookies |
US9292488B2 (en) | 2014-02-01 | 2016-03-22 | Soundhound, Inc. | Method for embedding voice mail in a spoken utterance using a natural language processing computer system |
US11295730B1 (en) | 2014-02-27 | 2022-04-05 | Soundhound, Inc. | Using phonetic variants in a local context to improve natural language understanding |
US9699499B2 (en) | 2014-04-30 | 2017-07-04 | The Nielsen Company (Us), Llc | Methods and apparatus to measure exposure to streaming media |
US9564123B1 (en) | 2014-05-12 | 2017-02-07 | Soundhound, Inc. | Method and system for building an integrated user profile |
US9583121B2 (en) * | 2014-05-16 | 2017-02-28 | Alphonso Inc. | Apparatus and method for determining co-location of services |
US9179184B1 (en) * | 2014-06-20 | 2015-11-03 | Google Inc. | Methods, systems, and media for detecting a presentation of media content on a display device |
US9905233B1 (en) | 2014-08-07 | 2018-02-27 | Digimarc Corporation | Methods and apparatus for facilitating ambient content recognition using digital watermarks, and related arrangements |
CA2973740C (en) | 2015-01-30 | 2021-06-08 | Inscape Data, Inc. | Methods for identifying video segments and displaying option to view from an alternative source and/or on an alternative device |
US9924224B2 (en) | 2015-04-03 | 2018-03-20 | The Nielsen Company (Us), Llc | Methods and apparatus to determine a state of a media presentation device |
CN107949849B (en) | 2015-04-17 | 2021-10-08 | 构造数据有限责任公司 | System and method for reducing data density in large data sets |
US9762965B2 (en) | 2015-05-29 | 2017-09-12 | The Nielsen Company (Us), Llc | Methods and apparatus to measure exposure to streaming media |
US9848222B2 (en) | 2015-07-15 | 2017-12-19 | The Nielsen Company (Us), Llc | Methods and apparatus to detect spillover |
US11308144B2 (en) | 2015-07-16 | 2022-04-19 | Inscape Data, Inc. | Systems and methods for partitioning search indexes for improved efficiency in identifying media segments |
BR112018000716B1 (en) | 2015-07-16 | 2023-03-28 | Inscape Data, Inc | COMPUTING METHOD AND DEVICE FOR DETECTING COMMON MEDIA SEGMENTS |
EP3323054A1 (en) | 2015-07-16 | 2018-05-23 | Inscape Data, Inc. | Prediction of future views of video segments to optimize system resource utilization |
US10080062B2 (en) | 2015-07-16 | 2018-09-18 | Inscape Data, Inc. | Optimizing media fingerprint retention to improve system resource utilization |
CA3058975A1 (en) | 2017-04-06 | 2018-10-11 | Inscape Data, Inc. | Systems and methods for improving accuracy of device maps using media viewing data |
GB2562515A (en) | 2017-05-17 | 2018-11-21 | Snell Advanced Media Ltd | Generation of audio or video hash |
US11172269B2 (en) | 2020-03-04 | 2021-11-09 | Dish Network L.L.C. | Automated commercial content shifting in a video streaming system |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3737566A (en) * | 1968-01-15 | 1973-06-05 | Sanders Associates Inc | Television coder and decoder |
GB1282641A (en) * | 1969-05-14 | 1972-07-19 | Thomas Patterson | Speech encoding and decoding |
US3742463A (en) * | 1970-03-02 | 1973-06-26 | Nielsen A C Co | Data storage and transmission system |
US3906450A (en) * | 1970-10-09 | 1975-09-16 | Jr Eduardo Da Silva Prado | Electronic system for the recording of periodically sampled variables |
US3919479A (en) * | 1972-09-21 | 1975-11-11 | First National Bank Of Boston | Broadcast signal identification system |
US3849729A (en) * | 1972-12-14 | 1974-11-19 | Intomart Nv | System for determining the listening and viewing habits of wave signal receiver users |
US4230990C1 (en) * | 1979-03-16 | 2002-04-09 | John G Lert Jr | Broadcast program identification method and system |
SE8106186L (en) * | 1981-10-20 | 1983-04-21 | Hans Olof Kohler | PROCEDURE AND DEVICE FOR DETERMINING THE COMPLIANCE OF AN ANALYTICAL SIGNAL WITH AT LEAST ONE REFERENCE SIGNAL |
US4449190A (en) * | 1982-01-27 | 1984-05-15 | Bell Telephone Laboratories, Incorporated | Silence editing speech processor |
US4450531A (en) * | 1982-09-10 | 1984-05-22 | Ensco, Inc. | Broadcast signal recognition system and method |
GB2138642B (en) * | 1983-04-22 | 1986-08-20 | Video Res | Audience rating measuring system for television receivers and video tape recorders |
-
1984
- 1984-04-26 US US06/604,367 patent/US4697209A/en not_active Expired - Lifetime
-
1985
- 1985-04-16 EP EP85104566A patent/EP0161512B1/en not_active Expired
- 1985-04-16 DE DE8585104566T patent/DE3571733D1/en not_active Expired
- 1985-04-16 EP EP87118133A patent/EP0283570A3/en not_active Withdrawn
- 1985-04-16 AT AT85104566T patent/ATE44849T1/en not_active IP Right Cessation
- 1985-04-25 BR BR8501965A patent/BR8501965A/en unknown
- 1985-04-25 ES ES542578A patent/ES8700531A1/en not_active Expired
- 1985-04-25 BR BR8501964A patent/BR8501964A/en unknown
- 1985-04-25 CA CA000480035A patent/CA1279124C/en not_active Expired - Lifetime
- 1985-04-26 JP JP60090767A patent/JPS60236331A/en active Pending
-
1986
- 1986-06-02 ES ES555622A patent/ES8708110A1/en not_active Expired
- 1986-06-02 ES ES555624A patent/ES8800468A1/en not_active Expired
- 1986-06-02 ES ES555623A patent/ES8802095A1/en not_active Expired
- 1986-06-02 ES ES555621A patent/ES8800813A1/en not_active Expired
Also Published As
Publication number | Publication date |
---|---|
EP0161512A1 (en) | 1985-11-21 |
EP0283570A3 (en) | 1988-10-12 |
ATE44849T1 (en) | 1989-08-15 |
ES555623A0 (en) | 1988-03-16 |
EP0283570A2 (en) | 1988-09-28 |
ES555621A0 (en) | 1987-12-01 |
ES542578A0 (en) | 1986-09-16 |
ES8802095A1 (en) | 1988-03-16 |
EP0161512B1 (en) | 1989-07-19 |
ES8800813A1 (en) | 1987-12-01 |
ES8800468A1 (en) | 1987-11-01 |
ES8700531A1 (en) | 1986-09-16 |
DE3571733D1 (en) | 1989-08-24 |
US4697209A (en) | 1987-09-29 |
BR8501965A (en) | 1985-12-24 |
JPS60236331A (en) | 1985-11-25 |
ES8708110A1 (en) | 1987-09-01 |
ES555622A0 (en) | 1987-09-01 |
ES555624A0 (en) | 1987-11-01 |
BR8501964A (en) | 1985-12-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA1279124C (en) | Program identification method and apparatus | |
JP3512419B2 (en) | Audience measurement system | |
US7958526B2 (en) | Source detection apparatus and method for audience measurement | |
EP0450631B1 (en) | Automatic commercial message recognition device | |
US20020114299A1 (en) | Apparatus and method for measuring tuning of a digital broadcast receiver | |
EP0745308B1 (en) | Television receiver | |
US6856758B2 (en) | Method and apparatus for insuring complete recording of a television program | |
CN1505408A (en) | Coded/non-coded program audience measurement system | |
JP2003523692A (en) | Audience measurement system and method for digital broadcasting | |
US5034902A (en) | Method and system for ascertaining the consumption habits of a test population | |
CA1290052C (en) | Program identification method and apparatus | |
EP0382996A1 (en) | Method and system for ascertaining the consumption habits of a test population | |
US4613902A (en) | Method of broadcasting an encoded video signal and a receiving apparatus for decoding the signal | |
AU764269B2 (en) | Source detection apparatus and method for audience measurement | |
AU2003262297A1 (en) | Source detection apparatus and method for audience measurement | |
KR970050944A (en) | Method and apparatus for judging or not watching video tape |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MKLA | Lapsed | ||
MKLA | Lapsed |
Effective date: 20060116 |