Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS20080056384 A1
Publication typeApplication
Application numberUS 11/929,380
Publication date6 Mar 2008
Filing date30 Oct 2007
Priority date18 Aug 2003
Also published asEP1668884A2, EP1668884A4, US7330511, US9247197, US20050055156, US20070226508, WO2005036867A2, WO2005036867A3, WO2005036867B1
Publication number11929380, 929380, US 2008/0056384 A1, US 2008/056384 A1, US 20080056384 A1, US 20080056384A1, US 2008056384 A1, US 2008056384A1, US-A1-20080056384, US-A1-2008056384, US2008/0056384A1, US2008/056384A1, US20080056384 A1, US20080056384A1, US2008056384 A1, US2008056384A1
InventorsAlan Maltagliati, James Withers, Jesse Chounard
Original AssigneeKoplar Interactive Systems International, L.L.C.
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Method and system for embedding device positional data in video signals
US 20080056384 A1
Abstract
A system for embedding positional data (20) in a video signal (18), the system having a mobile object (4), a positioning receiver (10) associated with the mobile object (4) for obtaining positional data (20) on the mobile object (4) from a plurality of positioning satellites (6), a video camera (16) associated with the mobile object (4) for creating the video signal (18), an encoder (12) for receiving the video signal (18) from the video camera (16) and the positional data (20) from the positioning receiver (10) and modulating the positional data (20) within the video signal (18) thereby creating a modulated video signal (22), and a video recorder (15) associated with the mobile object (4) for storing the modulated video signal (22) on a recording medium (14).
Images(12)
Previous page
Next page
Claims(20)
1. A method comprising:
receiving a video signal, the video signal depicting a recording subject;
receiving positional data from a positioning receiver, the positional data being for a location associated with the positioning receiver, the recording subject being viewable from the location; and
encoding the positional data into a video portion of the video signal to produce a modulated video signal.
2. The method of claim 1, wherein the encoding of the positional data comprises:
modulating the video signal with the positional data by altering the luminance of the video signal.
3. The method of claim 1, wherein the encoding of the positional data comprises:
selecting one or more selected fields of the video signal for modulation; and
modulating the one or more selected fields of the video signal with the positional data.
4. The method of claim 1, further comprising:
broadcasting the modulated video signal to a playback device.
5. The method of claim 1, further comprising:
storing the modulated video signal on a recording medium.
6. A method comprising:
capturing a digital image, the digital image depicting a recording subject;
receiving positional data from a positioning receiver, the positional data being for a location, the recording subject being viewable from the location; and
encoding the positional data into an image portion of the digital image to produce an encoded digital image, the encoded digital image capable of being decoded to present the digital image and utilize the positional data.
7. The method of claim 6, wherein the encoding of the positional data comprises:
modulating the digital image with the positional data in a substantially invisible manner.
8. The method of claim 6, wherein the digital image is a frame of a video signal.
9. A method comprising:
accessing a modulated video signal, the modulated video signal depicting a recording subject, the modulated video signal including positional data encoded into a visual portion of the modulated video signal, the positional data being for a location;
decoding the modulated video signal to obtain the positional data;
presenting the modulated video signal for display; and
utilizing the positional data during the presenting of the modulated video signal.
10. The method of claim 9, wherein the decoding of the modulated signal comprises:
detecting a portion of the modulated video signal having altered intensity; and
decoding the modulated video signal to obtain the positional data in accordance with the detecting of the portion.
11. The method of claim 9, wherein the utilizing of the positional data comprises:
presenting the positional data for reproduction.
12. The method of claim 9, wherein the utilizing of the positional data comprises:
synchronously depicting the location on a map at a time the modulated video signal was recorded during the presenting of the modulated video signal.
13. A method comprising:
accessing an encoded digital image, the encoded digital image depicting a recording subject, the encoded digital image including positional data encoded into an image portion of the encoded digital image, the positional data being for a location;
decoding the encoded digital image to obtain the positional data;
presenting the encoded digital image for display; and
utilizing the positional data during the presenting of the encoded digital image.
14. The method of claim 13, wherein the positional data is Global Positioning System (GPS) location data.
15. The method of claim 13, wherein the positional data is triangulation location data.
16. A method comprising:
accessing an encoded digital image, the encoded digital image depicting a recording subject, the encoded digital image including environmental data encoded into an image portion of the encoded digital image, the environmental data being associated with an environment in which encoded digital image of the recording subject was created;
decoding the encoded digital image to obtain the environmental data; and
verifying the encoded digital image utilizing the environmental data.
17. The method of claim 16, wherein the verifying of the encoded digital image comprises:
verifying at least one of timing, location, authenticity or combinations thereof utilizing the environmental data.
18. The method of claim 16, further comprising:
presenting the encoded digital image for display.
19. The method of claim 16, wherein the environmental data includes at least one of:
positional data for a location,
vehicle data associated with the environment of a vehicle,
train data associated with the environment of a train,
tank data associated with the environment of a tank,
watercraft data associated with the environment of a watercraft,
airplane data associated with the environment of an airplane,
missile data associated with the environment of a watercraft,
video camera data associated with the environment of a video camera, or combinations thereof.
20. The method of claim 16, wherein the recording subject includes at least one of an object, a person, terrain, or combinations thereof.
Description
    CROSS-REFERENCE TO RELATED APPLICATION
  • [0001]
    This application is a Continuation of U.S. application Ser. No. 10/888,292, filed on Jul. 9, 2004, which claims the benefit of priority to U.S. Provisional Patent Application Ser. No. 60/495,902, Filed 18 Aug. 2003, which applications are herein incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • [0002]
    The present invention relates to a system for embedding device positional data in video signals, and more particularly to a system for encoding positional data for a mobile object in a video signal for subsequent synchronized reproduction of the video signal and the positional data.
  • [0003]
    Various methods exist in the art for transmitting data along with video signals, wherein the data is received and then used by the viewer of the video signals. Several of these methods transmit data in the video signals by replacing active portions of the video signal with data, such that users who view the video signal on their display devices will see the effect of the data in the form of an icon, dot or other visual image or disturbance in the picture. Other methods transmit data in non-viewable scan lines of the video signal, such as in the vertical blanking interval (VBI). However, these scan lines may already contain other data, such as a secondary audio program and are prone to being stripped by programming operators prior to broadcast.
  • [0004]
    Another method for transmitting auxiliary data in video signals is described in U.S. Pat. No. 4,807,031 to Broughton et al. (“Broughton”) entitled “Interactive Video Method and Apparatus”, which relates generally to in-band video broadcasting of commands and other encoded information to interactive devices and is incorporated by reference herein. The invention described therein relates generally to interactive educational and entertainment systems, and is described in one embodiment in the context of television program control of toys located where there is a television receiver, as within a residence.
  • [0005]
    To encode control data capable of providing a benefit to a user, Broughton discloses a novel method of luminance or chrominance modulation of a video signal that creates a composite video signal, wherein the video signal is modulated with control data. The novel modulation method alternately raises and lowers the luminance/chrominance of adjacent horizontal scan lines to create a video subcarrier that contains the control data.
  • [0006]
    In Broughton, the video signal is not being replaced with other data, nor is the data being added as a separate signal along with the video signal. Rather, the video signal itself is modulated to carry the control data. Therefore, the control data is a part of, or contained within, the video signal and yet is imperceptible to the human eye. The encoding method also includes preview and remove circuitry to ensure suitability or the presence of data encoding and removal of data encoding, respectively.
  • [0007]
    The control data is transmitted either by television broadcast means, or by pre-recorded video players that are connected to a video display. The control data is then received by the video display where at least one video field of the video display is modulated by control data. The control data is then detected with either optoelectronic or radio frequency (RF) detection means that discriminate between the program material and the control data to detect the control data. The detected control data is further reproduced so that the control data can be used with an interactive device.
  • [0008]
    Improvements on the method of modulation described in Broughton are described in U.S. Pat. No. 6,094,228 to Ciardullo et al. and U.S. Pat. No. 6,229,572 to Ciardullo et al. (referred to collectively herein as “Ciardullo”). Both Ciardullo patents describe improved methods of modulation wherein control data is inserted on the visual portion of a video signal by changing the luminance of paired lines in opposite directions, thus allowing larger amounts of data to be modulated in a signal. Broughton and Ciardullo, which are owned by the assignee of the present invention, are incorporated by reference herein.
  • [0009]
    Prior efforts by the assignee of the present patent application also include U.S. patent application entitled “Interactive Optical Cards and Other Hand-Held Devices with Increased Connectivity”, Ser. No. 09/489,373, filed Jan. 21, 2000, of Edward J. Koplar and Daniel A. Ciardullo (referred to hereinafter as “Koplar I”), which is incorporated by reference herein. Koplar I relates to various hand-held device embodiments and methods of use involving the reception of auxiliary data (i.e., control data) from a signal source and providing the user of the hand-held device with various promotional opportunities, such as interactive advertising and gaming, as a result of receiving the auxiliary data.
  • [0010]
    Another patent application by the assignees of the present invention is U.S. patent application entitled “Universal Methods and Device for Hand-Held Promotional Opportunities”, Ser. No. 09/829,223, filed Apr. 9, 2001, of Edward J. Koplar, Daniel A. Ciardullo, James G. Withers and Christopher E. Chupp (referred to hereinafter as “Koplar II”), which is incorporated by reference herein. Koplar II describes additional methods of providing auxiliary data to hand-held devices for the purpose of providing a user of the hand-held device with promotional opportunities, as well as apparatuses for use with same.
  • [0011]
    Yet another patent application by the assignees of the present invention is U.S. patent application entitled “RBDS Method and Device for Processing Promotional Opportunities”, Ser. No. 10/126,770, filed on Apr. 19, 2002, of James G. Withers and Alan G. Maltagliati (referred to hereinafter as “Withers I”), which is incorporated by reference herein. Withers I describes further improvements to Koplar I and Koplar II including the transmission of auxiliary data to a hand-held device by use of the RBDS system.
  • [0012]
    Still another patent application by the assignees of the present invention is U.S. patent application entitled “Method and Apparatus for Modulating a Video Signal With Data”, Ser. No. 10/676,940, filed on Oct. 1, 2003, of Yousri H. Barsoum, Alan G. Maltagliati, Daniel A. Ciardullo and Christopher E. Chupp (the application being herein referred to as “Barsoum”), which is incorporated by reference herein. Barsoum describes the use of a memory card coupled to a slotted hand-held device for receiving video signals by use of the memory card, transmitting the signals from the card to the slotted hand-held device, decoding auxiliary data from the video signals on the slotted hand-held device and providing the user of the slotted hand-held device with a benefit from the reception of the auxiliary data. Barsoum also describes a method of improving the reliability and speed of the transmission and reception of auxiliary data by storing data in video frames split into multiple fields and encoding complementary data bits in each field.
  • [0013]
    Still another patent application by the assignees of the present invention is U.S. patent application entitled “A Method And System Of Transmitting Auxiliary Data From A Digital Display Device”, Ser. No. 10/817,109, filed on Apr. 2, 2004, of James G. Withers, Yousri H. Barsoum, Edward J. Koplar and Michael C. Reynolds (the application being herein termed “Withers II”), which is incorporated by reference herein. Withers II describes several methods and apparatus for modulating auxiliary data for use on digital display devices.
  • [0014]
    The aforementioned improvements to Broughton along with other technology that encodes data in video signals have been disclosed for use with a variety of applications. However, to date video signals have not been encoded with data relating to the location of an object.
  • [0015]
    Several methods exist in the art for determining the location of objects on the earth or relative to other objects. For example, police officers may triangulate the signal of a distress cellular telephone call between several cellular phone towers to determine the location of the caller. Also, an underground invisible fence emits a field that causes a dog that wears a collar with a receiver to receive a warning beep and then a correction (i.e., a shock) via their collar depending on the dogs distance from the field. However, neither of these technologies provided for a divergent and wide-scale use in a variety of consumer applications.
  • [0016]
    The Global Positioning System (GPS) is a satellite-based navigation system owned and operated by the U.S. Department of Defense (DOD). It comprises a network of 24 satellites that orbit the earth and make it possible for people with ground receivers to pinpoint their geographical location. The 24 satellites orbit the earth in a “constellation” arrangement and are approximately 11,000 miles above the earth. GPS was originally intended for military applications, but the DOD made the GPS system freely available for public use.
  • [0017]
    GPS satellites circle the earth twice a day and transmit signals with positioning information back to earth, with four satellites always visible from the horizon. GPS receivers contain electronics that “triangulate” the position of a GPS receiver by receiving the signals from at least three satellites. The result is a geographical position (i.e., longitude, latitude and altitude) that may be used with a display to show the receiver's position on a map or for other purposes.
  • [0018]
    At the present time, GPS receivers are most typically used as an optional feature in many automobiles and may also be added aftermarket. They are also widely used in maritime and aircraft positioning and navigation and military uses. Automotive GPS receivers, for example, are capable of not only determining an automobile's current location, but also of providing driving directions and a real-time map from the current location to a desired location. GPS receivers are also available for hand-held use by hikers, explorers and fisherman. Because of affordability and availability of the GPS receivers, they are becoming more desirable and widely used by consumers.
  • [0019]
    The GPS system is especially valuable to the military, as it in provides much needed location information in a variety of applications including tracking friendly and non-friendly vehicles and troops, targeting locations, and for other general mapping and locating purposes. Military uses may also retain the data received from the GPS receiver for use with compiling locations for later use such as with reconstructing scenarios for future training exercises or internal investigations.
  • [0020]
    The military also records video signals by use of video cameras for various purposes including to verify completion of various tasks, track locations, and provide news organizations with footage for newscasts. Presently, the GPS data and the video signals are retained on separate storage devices. Typically, GPS data and video signals are presented in an unsynchronized manner as it is difficult to later associate GPS data with a video signal because of the enormous amount of video signals and data that are recorded during conflicts.
  • [0021]
    Law enforcement personnel also utilize GPS receivers in their automobiles to obtain directions to locations received from dispatch. Frequently, such personnel record video signals to demonstrate to judges and juries that they acted within the law, as when they arrest a suspect or follow a suspicious automobile. However, these recorded video signals may still be subject to challenge based on factors including timing, location, and authenticity of the source video signal.
  • [0022]
    There is a need in the art to simultaneously record positional data and video signals in a single recording medium such that playback of the medium will reproduce synchronized positional data and video signals, whereby the video signals must not be altered to reproduce the positional data.
  • SUMMARY OF THE INVENTION
  • [0023]
    In brief summary, the present invention overcomes and substantially alleviates the deficiencies in the prior art by providing a method for embedding synchronized positional data in a video signal for subsequent playback. The positioning system first comprises a mobile object connected to a positioning receiver and a video camera. The positioning system may optionally comprise one or more auxiliary sources, each of which measure an attribute of the mobile object.
  • [0024]
    The positioning receiver obtains positioning information regarding the mobile object from one or more positioning satellites. The recording by the video camera of the recording subject produces the video signal, which is provided to the encoder. The auxiliary source is connected to and obtains information regarding mobile object and provides the information to the encoder in the form of supplemental data.
  • [0025]
    The encoder encodes the positional data and the supplemental data in the video signal thereby creating a modulated video signal. Thereafter, the modulated video signal is stored on the recording medium by the video recorder.
  • [0026]
    The modulated video signal is reproduced from the recording medium by a playback unit. The decoder obtains the positional data and the optional supplemental data from the modulated video signal. Thereafter, the display device presents the modulated video signal while the presentation device synchronously presents the positional data and the supplemental device presents the supplemental data if present.
  • [0027]
    Additional advantages and novel features of the invention will be set forth in the description which follows, and will become apparent to those skilled in the art upon examination of the following more detailed description and drawings in which like elements of the invention are similarly numbered throughout.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0028]
    FIG. 1 is a block diagram of the positioning system components of the present invention.
  • [0029]
    FIG. 2 is a block diagram of the embedding components of the present invention.
  • [0030]
    FIG. 3 is a block diagram of the decoding components of the present invention.
  • [0031]
    FIG. 4 is a block diagram of an encoder of the present invention.
  • [0032]
    FIG. 5 is a block diagram of a decoder of the present invention.
  • [0033]
    FIG. 6 is a block diagram of a positioning receiver of the present invention.
  • [0034]
    FIG. 7 is a block diagram of an auxiliary source of the present invention.
  • [0035]
    FIG. 8 is a flowchart of the encoding method of the present invention.
  • [0036]
    FIG. 9 is a flowchart of the modulating method of the present invention.
  • [0037]
    FIG. 10 is a flowchart of the method of obtaining supplemental data of the present invention.
  • [0038]
    FIG. 11 is a flowchart of the decoding method of the present invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • [0039]
    Referring to the drawings, the preferred embodiment of a system for synchronously embedding positional data of a mobile object in a video signal for subsequent playback of the video signal and positional data of the present invention is illustrated in FIGS. 1-11.
  • [0040]
    Referring to FIG. 1, a positioning system 2 is shown to comprise a mobile object 4 connected to a positioning receiver 10 and a video camera 16. Mobile object 4 is an object whose physical location is desirous of being altered and tracked such as a vehicle, camcorder, train, tank, watercraft, airplane or missile. Positioning receiver 10 is a device that is capable of determining the geographic location of mobile object 10 as is described in greater detail below. Video camera 16 is a portable video recorder that by use of a lens and other electronics converts optical signals into video signals may be controlled by a user, in a fixed position on mobile object 4, or otherwise controlled by mobile object 4. Positioning system 2 may optionally comprise one or more auxiliary sources 11, each of which measure an attribute of mobile object 4 as is described in greater detail below.
  • [0041]
    Referring to FIG. 2, the embedding components of the present invention first comprise positioning receiver 10 obtaining positioning information regarding mobile object 4 from one or more positioning satellites 6. In the preferred embodiment, positioning receiver 10 utilizes the positioning information to calculate its location (i.e., the location of mobile object 4) in the form of positional data 20 received. Positional data 20 is preferably GPS location data comprising latitude and longitude, but alternatively may be in other useful forms including latitude, longitude and altitude. Positioning satellites 6 are preferably GPS satellites that provide positioning information, but other pluralities of objects that when used collectively provide positioning information are also felt to fall within the present invention including cellular phone towers. Positioning receiver 10 is preferably a portable GPS receiver as will be known in the art of electronic tracking devices, but may also be other devices that derive positional data 20. After calculation, positional data 20 is provided to encoder 12.
  • [0042]
    The recording by video camera 16 of recording subject 8 produces video signal 18, which is provided to encoder 12. Recording subject 8 is any matter of a perceivable size and color that is capable of being recorded by video camera 16 including terrain, objects and people.
  • [0043]
    Auxiliary source 11 is connected to and obtains information regarding mobile object 4 and provides the information to encoder 12 in the form of supplemental data 21. The process of one or more auxiliary sources 11 each providing supplementary data 21 to encoder 12 is described in greater detail below.
  • [0044]
    Encoder 12, as described in greater detail below, encodes positional data 20 and optional supplemental data 21 in video signal 18 thereby creating a modulated video signal 22. Thereafter, modulated video signal 22 is stored on recording medium 14 by video recorder 15. Preferably, recording medium 14 is a standard VHS tape and video recorder 15 is a standard VHS tape recorder. However, it should be appreciated in the art of video recording that alternative recording medium 14 and video recorder 15 may be used in combination, such as a digital versatile disc (DVD) and a DVD recorder. In addition, modulated video signal 22 may alternatively be remotely broadcast to video recorder 15 or directly to playback unit 17 (as described below).
  • [0045]
    In an alternate embodiment of the present invention, video camera 16 and video recorder 15 are combined into a single unit, such that the combined single unit still utilizes an external positioning receiver 12, optional one or more external auxiliary sources 11, and encoder 12.
  • [0046]
    In yet a further embodiment of the present invention, video camera 16, video recorder 15 and positioning receiver 10 are combined into a single unit, such that the combined single unit still utilizes an external optional one or more external auxiliary sources 11 and encoder 12.
  • [0047]
    In still another embodiment of the present invention, video camera 16, positioning receiver 10 and encoder 12 are combined together as a single unit. In addition, the alternate embodiment may further include video recorder 15.
  • [0048]
    Referring to FIG. 3, modulated video signal 22 is reproduced from recording medium 14 for a user by playback unit 17. Playback unit 17 is preferably a VHS tape player, but may vary depending on the video recorder 15 and recording medium 14 used.
  • [0049]
    Decoder 13 obtains positional data 20 and optional supplemental data 21 from modulated video signal 22. Thereafter, display device 26 presents modulated video signal 22 while presentation device 24 synchronously presents positional data 20 and supplemental device 25 presents supplemental data 21. Presentation device 24 and supplemental device 25 are preferably combined into a single computer or computer-like device running a computer program that generates a map depicting the location of mobile object 4 at the time the modulated video signal 22 was recorded along with the supplementary information. It should be appreciated that display device 26 may be combined with presentation device 24 and/or supplemental device 25, such as by use of a computer with video capture card.
  • [0050]
    Referring to FIG. 4, the preferred embodiment of encoder 12 is shown to first comprise a digital video input 30 that is capable of receiving video signal 18 from signal source 10 and passing it to encoder micro-controller 36. However, encoder 12 may receive an analog video signal 18 via analog video input 32 and analog to digital converter 34. Analog to digital converter 34 digitizes the analog video signal 18 according to known techniques such that it may be provided to encoder micro-controller 36 for use with the present invention.
  • [0051]
    Encoder micro-controller 36 is electronically connected to one or more data inputs 38. Data input 38 receives positional data 20 from positioning receiver 10, and when supplemental data 21 is present additional data inputs 38 from auxiliary source 11.
  • [0052]
    When encoder micro-controller 36 receives information from one or more data inputs 38 and video signal 18, software 50 manages further operation of encoder 12 and directs encoder micro-controller 36 to store the chrominance information (and/or luminance information as desired) of video signal 18 in storage 40. Storage 40 has the capacity to hold and retain signals (e.g., frames of video signal 18 and corresponding audio signals) in an electromagnetic form for access by encoder micro-controller 36. Storage 40 may be primary storage and/or secondary storage, and include memory and hard disk drive.
  • [0053]
    Encoder electronics 42 at the direction of software 50 and encoder micro-controller 36 use the methods of the present invention as will be described in greater detail below to modulate positional data 20 and supplemental data 21 into the luminance of video signal 18 thereby creating modulated video signal 22. The resulting modulated video signal 22 is then sent digitally from encoder 12 by digital video output 44, or in analog form by converting the resulting digital signal with digital to analog converter 46 and outputting modulated video signal 22 by analog video output 48. However, it should be appreciated that encoder 12 (and decoder 13 as described below) need not comprise both digital video input 30 and digital video output 44 in combination with analog video input 32 and analog video output 48, and the one selection of inputs and outputs may be selected for encoder 13.
  • [0054]
    Encoder micro-controller 36 may consist of more than one processor and/or microprocessor to manage the various processing and input/output of the present invention, but preferably consists of a single processor. Moreover, the specific electronics and software used by encoder 12 may differ when its technology is included in a pre-existing device (e.g., built into video camera 16) such as opposed to a stand alone device custom device. Encoder 12 may comprise varying degrees of hardware and software, as various components may interchangeably be used.
  • [0055]
    Referring to FIG. 5, decoder 13 receives modulated video signal 22 by analog video input 32 when modulated video signal 22 is analog, and by digital video input 30 when modulated video signal 22 is digital. Digital video input 30 directly passes modulated video signal 22 to decoder processor 60, while analog video input 32 digitizes modulated video signal 22 by use of analog to digital converter 34 before passing modulated video signal 22 to decoder processor 60.
  • [0056]
    In the preferred embodiment, decoder processor 60 stores the chrominance of modulated video signal 22 in storage 40 while decoder electronics 62 detects scan lines or portions of modulated video signal 22 thereof that have increased or decreased intensity. The preferred embodiment of the decoding scheme used with the present invention is described below.
  • [0057]
    Positional data 20 is transferred from decoder 13 to signaled device 24 by a data output 68, and optional supplemental data 21 is transferred from one or more additional data outputs 68 to one or more supplemental device 25. Decoder 13 also outputs modulated video signal 22 in digital format via digital video output 44, and modulated video signal 22 in analog format by first converting signal 22 from the digital to analog format by use of digital to analog converter 46, and then outputting signal 22 via analog video output 48.
  • [0058]
    Referring to FIG. 6, the preferred embodiment of positioning receiver 10 may be observed to comprise a positioning micro-controller 70, which directs the operation of positional receiver 10. Positioning electronics 72 is electronically coupled to positioning micro-controller 70 and contains circuitry necessary to implement positioning receiver 10. Positioning data receiver 74 is electrically coupled to positioning micro-controller 70 and receives positioning information from positioning satellites 6. Data output 68 outputs positional data 20 in computer readable format via a serial port or other data communication output. Optional positioning display 76 is coupled to positioning micro-controller 70 and visually presents to a user of positional data receiver 12 the location of positioning receiver 10 on a map. Optional positioning interface 73 is coupled to positioning micro-controller 70 and provides controls that enable a user to interact with positioning receiver 10. Preferably, positioning receiver 10 is a GPS receiver.
  • [0059]
    Referring to FIG. 7, auxiliary source 11 comprises an electro-mechanical component 80 that has an attribute that is capable of being measured as will be further describe below. Component measure 82 is either physically or electronically coupled to electro-mechanical component 80 to obtain a measurement of an attribute of electro-mechanical component 80, such as the temperature of an engine, the speed of a vehicle, or the rotation of a camera lens. Data output 68 is coupled to component measure 82 and outputs supplemental data 21 to encoder 12.
  • [0060]
    Referring to FIG. 8, the method for data encoding (i.e., embedding) comprises a first step 90 where encoder 12 obtains video signal 18 depicting recording subject 8 from video camera 16. Thereafter, encoder 12 at step 92 obtains the positional data 20 from positioning receiver 10.
  • [0061]
    Encoder 12 at decision point 94 determines whether supplemental data 21 is available to be provided to encoder 12. If yes, encoder 12 proceeds to step 96 to obtain supplemental data 21 from auxiliary source 11. If no, encoder 12 proceeds directly to step 98.
  • [0062]
    Encoder 12 at step 98 modulates video signal 18 with positional data 20 and supplemental data 21 when present as described in greater detail below. After modulation, modulated video signal 22 is stored on recording medium 14 by video recorder 15.
  • [0063]
    Referring to FIG. 9, the process of modulating video signal 18 comprises a first step 100 where encoder 12 determines which fields of video signal 18 to modulate so as to encode positional data 20 and supplemental data 21 within video signal 18. The process of which fields to modulate depends on the encoding scheme chosen with a particular embodiment of the present invention. In the preferred embodiment, the encoding scheme of Ciardullo is utilized to encode the fields of video signal 18 in a substantially invisible manner. However, it should be appreciated that other schemes for encoding data in video signal 18 may also be used with the present invention.
  • [0064]
    Encoder 12 at decision point 102 determines whether it is to encode the current field of video signal 18. If yes, encoder 12 at step 104 modulates the current field of video signal 18 so that it contains a carrier signal representing data and proceeds to decision point 106. If no, encoder 12 proceeds directly to decision point 106.
  • [0065]
    Encoder 12 at decision point 106 determines whether there are additional fields of video signal 18 left to encode. If yes, encoder 12 advances to the next field in video signal 18 at step 108 and thereafter returns to decision point 102. If no, the process of modulating video signal 18 is complete.
  • [0066]
    Referring to FIG. 10, the method of obtaining supplemental data 21 from auxiliary source 11 is shown to comprise a first step 110 where component measure 82 obtains a reading of an attribute of electrical/mechanical component 80. Thereafter, component measure 82 at step 112 coverts the reading of the attribute into supplemental data 21, such that the reading may be used by the present invention. Component measure 82 transfers supplemental data 21 through data output 68 at step 114.
  • [0067]
    Referring to FIG. 11, the decoding method of the present invention is shown to first comprise a step 120 where decoder 13 obtains video signal 18 (i.e., modulated video signal 22) from recording medium 14 by playback unit 17. Thereafter, decoder 13 at step 122 reads video signal 18 to determine if a carrier signal is present within video signal 18 that reflects that data is present in video signal 18.
  • [0068]
    Decoder 13 at decision point 124 determines whether the carrier signal is present in video signal 18. If yes, decoder 13 obtains positional data 20 and supplemental data 21 from modulated video signal 22 at step 126. Decoder 13 then at step 128 distributes positional data 20 and supplemental data 21 to presentation device 24 and supplemental device 25 respectively in synchronization with modulated video signal 22. Thereafter, decoder 13 after decision point 124 or step 128 provides video signal 18 (or modulated video signal 22 if the carrier signal was present in video signal 18) to display device 26 at step 130.
  • [0069]
    It should be appreciated that other methods and technologies may also be utilized for encoding and decoding including VBI, Broughton and Withers II.
  • [0070]
    It should be understood from the foregoing that, while particular embodiments of the invention have been illustrated and described, various modifications can be made thereto without departing from the spirit and scope of the invention. Therefore, it is not intended that the invention be limited by the specification; instead, the scope of the present invention is intended to be limited only by the appended claims.
Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US4101927 *23 Dec 197618 Jul 1978Sony CorporationVir control apparatus for color television receiver
US4503288 *31 Aug 19815 Mar 1985Novation, Inc.Intelligent telephone
US4540880 *11 Jul 198310 Sep 1985Beatrice Foods, Co.Universal product code scannable coupon
US4590519 *4 May 198320 May 1986Regency Electronics, Inc.Television signal scrambling/descrambling system
US4620877 *4 Feb 19854 Nov 1986Tropicana Products, Inc.UPC scannable marking composition and applications thereof
US4642682 *27 Apr 198410 Feb 1987Vta Technologies, Inc.Phase responsive composite video signal control system
US4688102 *9 Nov 198318 Aug 1987Canon Kabushiki KaishaColor video signal mixing system
US4691245 *3 Dec 19841 Sep 1987Eastman Kodak CompanyMethod and apparatus for combining two color video signals
US4745468 *10 Mar 198617 May 1988Kohorn H VonSystem for evaluation and recording of responses to broadcast transmissions
US4789371 *29 Sep 19876 Dec 1988The Quaker Oats CompanySimulated toy flash camera
US4807031 *20 Oct 198721 Feb 1989Interactive Systems, IncorporatedInteractive video method and apparatus
US4876592 *10 May 198824 Oct 1989Henry Von KohornSystem for merchandising and the evaluation of responses to broadcast transmissions
US4926255 *10 May 198815 May 1990Kohorn H VonSystem for evaluation of response to broadcast transmissions
US5034807 *19 Oct 198923 Jul 1991Kohorn H VonSystem for evaluation and rewarding of responses and predictions
US5206907 *30 Apr 199127 Apr 1993Pioneer Electronic CorporationTelevision signal scrambling method and apparatus
US5214792 *5 Nov 199125 May 1993Alwadish David JBroadcasting system with supplemental data transmission and storge
US5227874 *15 Oct 199113 Jul 1993Kohorn H VonMethod for measuring the effectiveness of stimuli on decisions of shoppers
US5233423 *26 Nov 19903 Aug 1993North American Philips CorporationEmbedded commericals within a television receiver using an integrated electronic billboard
US5249044 *5 May 199228 Sep 1993Kohorn H VonProduct information storage, display, and coupon dispensing system
US5253345 *31 Jul 199212 Oct 1993Sears, Roebuck & Co.Point of sale register system
US5262860 *23 Apr 199216 Nov 1993International Business Machines CorporationMethod and system communication establishment utilizing captured and processed visually perceptible data within a broadcast video signal
US5283734 *19 Sep 19911 Feb 1994Kohorn H VonSystem and method of communication with authenticated wagering participation
US5287181 *20 Aug 199215 Feb 1994Holman Michael JElectronic redeemable coupon system and television
US5301353 *29 Jul 19935 Apr 1994Motorola, Inc.Communication system and apparatus
US5410326 *4 Dec 199225 Apr 1995Goldstein; Steven W.Programmable remote control device for interacting with a plurality of remotely controlled devices
US5423555 *14 Apr 199313 Jun 1995Kidrin; ThomInteractive television and video game system
US5443227 *15 Oct 199322 Aug 1995Hughes Aircraft CompanySwitching control for multiple fiber-guided missile systems
US5461426 *20 Aug 199324 Oct 1995Samsung Electronics Co., Ltd.Apparatus for processing modified NTSC television signals, with digital signals buried therewithin
US5467274 *16 Mar 199214 Nov 1995Rada Electronic Industries, Ltd.Method of debriefing multi aircraft operations
US5483276 *2 Aug 19939 Jan 1996The Arbitron CompanyCompliance incentives for audience monitoring/recording devices
US5488423 *17 Nov 199430 Jan 1996U.S. Narrow Networks, Inc.Home communication method and apparatus
US5488571 *22 Nov 199330 Jan 1996Timex CorporationMethod and apparatus for downloading information from a controllable light source to a portable information device
US5500681 *24 May 199419 Mar 1996Jones; Charles P.Apparatus and method for generating product coupons in response to televised offers
US5510845 *23 Dec 199423 Apr 1996Samsung Electronics Co., Ltd.Receivers for digital signals buried within the trace and retrace intervals of NTSC television signals
US5523794 *16 Apr 19934 Jun 1996Mankovitz; Roy J.Method and apparatus for portable storage and use of data transmitted by television signal
US5526035 *1 Jun 199411 Jun 1996Zing Systems, L.P.Transaction based interactive television system
US5535147 *5 Jun 19959 Jul 1996Timex CorporationMethod and apparatus for downloading information from a controllable light source to a portable information device
US5550578 *6 Oct 199427 Aug 1996Ictv, Inc.Interactive and conventional television information system
US5555024 *7 Sep 199510 Sep 1996Samsung Electronics Co., Ltd.Transmitters for burying digital signals within the trace and retrace intervals of NTSC television signals
US5557333 *24 Feb 199417 Sep 1996Wavephore, Inc.System for transparent transmission and reception of a secondary data signal with a video signal in the video band
US5561467 *26 Mar 19901 Oct 1996Nippon Hoso KyokaiReceiver and channel compatible encoding/decoding system for high definition video
US5577266 *27 Oct 199519 Nov 1996Digital D.J. Inc.Broadcast system with associated data capabilities
US5594493 *19 Jan 199414 Jan 1997Nemirofsky; Frank R.Television signal activated interactive smart card system
US5617475 *18 Nov 19941 Apr 1997General Instrument Corporation, G.I. Communications DivisionScrambling and descrambling of video signals using horizontal line combinations
US5697844 *8 Mar 199616 Dec 1997Response Reward Systems, L.C.System and method for playing games and rewarding successful players
US5708476 *22 Jul 199613 Jan 1998Microsoft CorporationSystem and method for inserting and recovering a data signal for transmission with a video signal
US5734413 *30 Nov 199331 Mar 1998Thomson Multimedia S.A.Transaction based interactive television system
US5737417 *24 Apr 19957 Apr 1998Technicolor Videocassette, Inc.Videotape anti-copying encryption scheme
US5739866 *25 Nov 199614 Apr 1998Microsoft CorporationSystem and method for inserting and recovering an on data signal for transmission with a video signal
US5764275 *7 Jun 19959 Jun 1998Thomson Multimedia S.A.Interactive television security through transaction time stamping
US5767896 *7 Sep 199516 Jun 1998Smart Tv LlcTelevision signal activated interactive smart card system
US5768633 *3 Sep 199616 Jun 1998Eastman Kodak CompanyTradeshow photographic and data transmission system
US5815127 *24 Jun 199629 Sep 1998Timex CorporationMethod and apparatus for downloading information from a controllable light source to a portable information device
US5831679 *28 Oct 19963 Nov 1998Wavephore, Inc.Network for retrieval and video transmission of information
US5835388 *26 Mar 199610 Nov 1998Timex CorporationApparatus and method for optical transmission of serial data using a serial communications port
US5880769 *10 Apr 19959 Mar 1999Smarttv Co.Interactive smart card system for integrating the provision of remote and local services
US5907350 *23 Apr 199725 May 1999Smart T.V. LlcTelevision signal activated interactive smart card system
US5953047 *21 Oct 199614 Sep 1999Smart Tv LlcTelevision signal activated interactive smart card system
US6016338 *22 Mar 199918 Jan 2000At&T Corp.Lottery method and apparatus having a tiered prize scheme
US6023241 *13 Nov 19988 Feb 2000Intel CorporationDigital multimedia navigation player/recorder
US6091822 *8 Jan 199818 Jul 2000Macrovision CorporationMethod and apparatus for recording scrambled video audio signals and playing back said video signal, descrambled, within a secure environment
US6094228 *23 Mar 199825 Jul 2000Ciardullo; Daniel AndrewMethod for transmitting data on viewable portion of a video signal
US6097877 *19 May 19951 Aug 2000Sharp Kabushiki KaishaDigital recording and reproducing apparatus which multiplexes and records HDTV, SDTV and trick play data together on a magnetic tape
US6100883 *4 Jun 19968 Aug 2000Ictv, Inc.Home interface controller for providing interactive cable television
US6104334 *31 Dec 199715 Aug 2000Eremote, Inc.Portable internet-enabled controller and information browser for consumer devices
US6175717 *21 Mar 199416 Jan 2001Trans Video Electronics, Inc.Global mobile video communications system
US6188939 *18 Aug 199713 Feb 2001The Texas A&M University SystemAdvanced law enforcement and response technology
US6223348 *3 Sep 199724 Apr 2001Universal Electronics Inc.Universal remote control system
US6229572 *27 Mar 20008 May 2001Koplar Interactive International, LlcMethod for transmitting data on viewable portion of a video signal
US6253238 *2 Dec 199826 Jun 2001Ictv, Inc.Interactive cable television system with frame grabber
US6256019 *30 Mar 19993 Jul 2001Eremote, Inc.Methods of using a controller for controlling multi-user access to the functionality of consumer devices
US6256070 *13 Oct 19983 Jul 2001Ati International SrlConcurrent discrete time oscillators (DTO) for video and closed caption encoding
US6337951 *21 Nov 19978 Jan 2002Fuji Photo Film Co., Ltd.Camera and photo data input system for camera
US6351289 *24 Nov 199826 Feb 2002Winbond Electronics Corp.Method and apparatus that generates VBI data coding waveforms
US6396537 *24 Nov 199728 May 2002Eastman Kodak CompanyPhotographic system for enabling interactive communication between a camera and an attraction site
US6400767 *18 Sep 19984 Jun 2002General Instrument CorporationCommunication of HBI data in digital television data streams
US6472771 *31 Jul 200029 Oct 2002Robert Bosch GmbhMotor vehicle having a vehicle electronics system, interface for the vehicle electronics system and a method for operating the vehicle electronics system
US6530782 *1 Mar 200111 Mar 2003The United States Of America As Represented By The Secretary Of The NavyLauncher training system
US6681160 *11 Feb 200220 Jan 2004Andian Technologies Ltd.Geometric track and track/vehicle analyzers and methods for controlling railroad systems
US6681905 *30 Nov 200127 Jan 2004Visteon Global Technologies, Inc.Magnetorheological fluid-controlled vehicle suspension damper
US6720879 *3 Aug 200113 Apr 2004Time-N-Space Technology, Inc.Animal collar including tracking and location device
US6741790 *29 May 199825 May 2004Red Hen Systems, Inc.GPS video mapping system
US7123935 *21 Sep 200117 Oct 2006Canon Kabushiki KaishaCommunication device, imaging device, communication method, and recording medium storing program to execute communication method in computer readable state
US7213254 *9 Apr 20011 May 2007Koplar Interactive Systems International LlcUniversal methods and device for hand-held promotional opportunities
US7265779 *20 Mar 20014 Sep 2007Fuji Photo Film Co., Ltd.Electronic camera, information obtaining system and print order system
US7330511 *9 Jul 200412 Feb 2008Koplar Interactive Systems International, L.L.C.Method and system for embedding device positional data in video signals
US7333153 *9 Aug 200219 Feb 2008Dotcast, Inc.Expanded information capacity for existing communication transmission systems
US20020016674 *21 May 20017 Feb 2002Rudow Richard W.Golf course yardage and information system having improved zone information and display characteristics
US20020045987 *11 Jul 200118 Apr 2002Tadahiro OhataDigital broadcast signal processing apparatus and digital broadcast signal processing method
US20020047921 *19 Jun 200125 Apr 2002Harris CorporationSystem and method for encoding information into a video signal
US20020059215 *29 Oct 200116 May 2002Takuya KotaniData search apparatus and method
US20020085118 *19 Jul 20014 Jul 2002Harris Frederic JoelSystem and method for nondisruptively embedding an OFDM modulated data signal into in a composite video signal
US20020112250 *9 Apr 200115 Aug 2002Koplar Edward J.Universal methods and device for hand-held promotional opportunities
US20030081127 *9 Aug 20021 May 2003Kirmuss Charles BrunoMobile digital video recording with pre-event recording
US20030087635 *2 Dec 20028 May 2003At & T Wireless Services, Inc.Method and system for optimizing performance of a mobile communications system
US20030152145 *15 Nov 200114 Aug 2003Kevin KawakitaCrash prevention recorder (CPR)/video-flight data recorder (V-FDR)/cockpit-cabin voice recorder for light aircraft with an add-on option for large commercial jets
US20040117856 *1 Oct 200317 Jun 2004Barsoum Yousri H.Method and apparatus for modulating a video signal with data
US20070157259 *14 Mar 20075 Jul 2007Koplar Interactive Systems International Llc D/B/A Veil Interactive Tec.Universal methods and device for hand-held promotional opportunities
US20070226508 *2 Apr 200727 Sep 2007Koplar Interactive Systems International Llc D/B/A Veil Interactive Tec.Systems and methods for subscriber authentication
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
CN104794776A *17 Apr 201522 Jul 2015巫立斌Driving recorder based on Internet of Things
CN105006034A *23 Jun 201528 Oct 2015陈元喜Automobile data recorder with automatic alarm function
Classifications
U.S. Classification375/240.26, 348/E07.024
International ClassificationG01C21/28, G07C5/08, H04N, H04N11/02, H04N7/08
Cooperative ClassificationH04N21/25841, H04N7/185, G07C5/0891, H04N7/08, H04N7/18
European ClassificationH04N21/258C4, H04N7/08, H04N7/18, H04N7/18D2
Legal Events
DateCodeEventDescription
18 Feb 2013ASAssignment
Owner name: KOPLAR INTERACTIVE SYSTEMS INTERNATIONAL, L.L.C.,
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MALTAGLIATI, ALAN G.;WITHERS, JAMES G.;CHOUNARD, JESSE J., II;SIGNING DATES FROM 20040707 TO 20040709;REEL/FRAME:029824/0781