WO1998008218A1 - System for combining digital and audio signals - Google Patents

System for combining digital and audio signals Download PDF

Info

Publication number
WO1998008218A1
WO1998008218A1 PCT/US1996/013496 US9613496W WO9808218A1 WO 1998008218 A1 WO1998008218 A1 WO 1998008218A1 US 9613496 W US9613496 W US 9613496W WO 9808218 A1 WO9808218 A1 WO 9808218A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
analog
attenuating
digital
analog signal
Prior art date
Application number
PCT/US1996/013496
Other languages
French (fr)
Inventor
Robert W. Moses
Norman Durkee
Charles H. Hustig
Original Assignee
Moses Robert W
Norman Durkee
Hustig Charles H
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US08/270,252 priority Critical patent/US5612943A/en
Application filed by Moses Robert W, Norman Durkee, Hustig Charles H filed Critical Moses Robert W
Priority to AU69558/96A priority patent/AU6955896A/en
Priority to PCT/US1996/013496 priority patent/WO1998008218A1/en
Publication of WO1998008218A1 publication Critical patent/WO1998008218A1/en

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/02Analogue recording or reproducing
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/281Protocol or standard connector for transmission of analog or digital data to or from an electrophonic musical instrument
    • G10H2240/311MIDI transmission

Definitions

  • This invention relates generally to a signal processing system, and more particularly to a signal processing system for transparently transporting a digital signal in an audio signal.
  • Signals may be represented mathematically as functions of time and, more particularly as either analog (continuous -time) signals or digital (discrete-time) signals.
  • analog signals are defined for a continuum of time values and may be represented, for example, by a continuously time-varying electrical voltage.
  • Digital signals in contrast, .are defined only at discrete points in time and may, for example, be represented by a series of electrical voltage pulses.
  • Each pulse represents a bit (i.e., a 0 or a 1), and accordingly, the series of pulses or bits is described as a bitstream, or a series of O's and l's.
  • the bitstream may represent data or it may represent, numerically, the strength or amplitude, of a continuous signal at discrete points in time.
  • CD compact disc
  • magnetic tape may be used to store music (analog audio) simultaneously with a standardized protocol
  • a CD player or magnetic tape may interface with a computer to control synchronously, using digital data, events in a computer game while generating audio sounds.
  • Other examples include the display of text (e.g., lyrics, using digital data) with music, the combination of speech and text for educational purposes (e.g., language or reading instruction) or entertainment (e.g., "talking books"), the compression of musical instrument digital interface (MIDI) data with recorded audio, the synchronous control of lights with music using simple lighting control protocols, the synchronization of music with computer-controlled water fountains using a simple control protocol, the control of slides and other audio-visual equipment during a prerecorded presentation, and the transmission of data over analog audio broadcast links.
  • MIDI musical instrument digital interface
  • One such technique requires that the analog audio signal be converted to a digital audio signal and then combined with the digital data signal (by interleaving digital data bits) to form a single digital composite signal.
  • This is exemplified by Furukawa in U.S. Patent No. 4,731,774, which discloses a technique for inserting digital data into the digital subcode bits of a CD digital audio bitstream.
  • a disadvantage of Furukawa's technique is that, to retrieve the embedded data, a special CD player having a digital output such as the Sony Philips Digital Interface (“SPDIF”) must be used. Furthermore, special hardware must then be used to extract the data from the SPDIF signal. Compared to analog-only systems, such techniques are complicated and expensive to implement.
  • analog audio signals and digital data signals may be combined by first converting the digital data signal to an analog data signal and then combining it with the analog audio signal to form a single analog composite signal.
  • This has been done on an elementary scale with slide projectors in which an audible tone, for advancing slides, is incorporated into an associated recorded narrative.
  • Two disadvantages of this technique are that the data signal is audible and the data transfer rate is too limited for many of the applications described above.
  • Another technique that may be used to form a single composite analog signal developed by a co-inventor of the present invention and disclosed in U.S. Patent No. 4,672,605, is to use a spread spectrum "data-over-voice" system in which alarm messages and other data are transmitted over telephone wires simultaneously with voice conversations.
  • the data signal in the spread spectrum system is audible, and is limited to extremely low data rates.
  • an economical signal processing system that can transparently record and retrieve, inaudibly and at flexible transfer rates, digital data within an analog audio signal.
  • a digital data signal is converted (modulated) to an analog data signal at an inaudible frequency band.
  • the analog data signal is then combined with the analog audio signal to form a single composite analog signal.
  • filters are used to retrieve and separate the audio signal and the analog data signal from the composite signal.
  • the analog data signal is then demodulated to a digital data signal.
  • the digital data signal and the analog audio signal are then supplied to appropriate processing equipment via digital and analog outputs respectively.
  • an encoding portion of the system which portion combines a first analog (audio) signal and a digital signal, comprises a modulator for modulating a digital signal to a second analog signal.
  • the first and second analog signals are filtered and then summed to form a single composite analog signal, which composite analog signal may then be recorded onto a standard analog recording medium, or digitized and recorded onto a digital recording medium.
  • the composite signal is retrieved from the recording medium by a playback device. Filters are used to extract the first and second analog signals from the composite signal.
  • the second analog signal is then demodulated to the original digital signal.
  • An advantage achieved with the invention is that the digital signal may be modulated onto a frequency band which is inaudible to the human ear.
  • a further advantage achieved with the invention is that, because the composite signal is analog and fits within the audio bandwidth, it may be recorded and played back using techniques commonly used with audio signals.
  • a further advantage achieved with the invention is that the format of the data is arbitrary, allowing open-ended systems to carry multiple data types.
  • a further advantage achieved with the invention is that the data transfer rate is flexible.
  • the portion of the audio bandwidth allocated for the transmission of data, as well as the modulation scheme utilized, may be adjusted to support a number of different data rates and audio bandwidths.
  • the available bandwidth may, therefore, be optimized for a number of different applications.
  • Another advantage achieved is that the system is economical because specialized technology, such as SPDIF, is not required, and simple technology, such as FSK, may be utilized to modulate digital signals.
  • FIG. 1 is a functional block diagram of a preferred embodiment of a signal processing system embodying features of the present invention
  • FIG. 2 is a functional block diagram of an encoding portion of the signal processing system of FIG. 1;
  • FIG. 3 is a functional block diagram of a decoding portion of the signal processing system of FIG. 1;
  • FIG. 4 is a schematic drawing of an analog frequency shift keying modulator circuit of FIG. 2;
  • FIG. 5 is a schematic drawing of the circuits of FIG. 3;
  • FIG. 6 is a schematic drawing of processing equipment circuitry that may be connected to the digital data output of the decoder of FIGS. 3 and 5;
  • FIGS. 7-9 are a flowcharts illustrating respective SPI, SSI, and timer interrupt processes utilized in an alternate embodiment of FIG. 2;
  • FIG. 10A is a waveform of an exemplary analog audio signal input to the encoder of FIG. 2;
  • FIG. 10B is a waveform of an exemplary digital data signal input to the encoder of FIG. 2;
  • FIG. IOC is a waveform of the analog audio signal of FIG. 10A after being filtered by the encoder of FIG. 2;
  • FIG. 10D is a waveform of the digital data signal of FIG. 10B after it is modulated by the encoder of FIG. 2; and FIG. 10E is a composite analog signal waveform in which the signal waveforms of FIGS. IOC and 10D are combined.
  • the reference numeral 10 designates a signal processing system of the present invention which is utilized for transparently recording and retrieving, inaudibly and at flexible transfer rates, digital data within an analog audio signal.
  • the system 10 includes an encoder 12 and a decoder 14.
  • An analog, audio signal on line 16 and a digital data signal on line 18 are input to the encoder 12 and combined therein to produce a composite analog audio signal in which the data portion thereof is inaudible to the human ear.
  • the composite signal is output from the encoder 12, as represented by line 20, to an audio recorder 22.
  • the audio recorder 22 records the composite signal onto a standard audio storage medium 24 which is used to store the signal and subsequently play it back to the audio player 26, as represented by lines 28 and 30, respectively.
  • the composite signal is output from the audio player 26, as represented by line 32, to the decoder 14.
  • the decoder 14 separates the composite signal into its original analog audio and digital data components. Lines 34 and 36 output from the decoder analog audio and digital data signals, respectively.
  • audiovisual equipment 38 is connected by the lines 34, 36 to the system 10 and the system is utilized to control equipment in the delivery of a multimedia presentation.
  • the analog signal input on line 16 to the system 10 may be a radio or television broadcast signal, video, music, speech or any other signal in the form of analog information.
  • the digital data input on line 18 may include ASCII encoded text or other messaging protocol information for use in queuing the equipment 38 for selected functions at selected time intervals of the multimedia presentation of the analog information.
  • the equipment 38 includes glasses (FIG. 6) to be worn by the user for producing visual effects during the playback of audio information from the medium 22.
  • the medium 22 comprises a compact disk (CD) which has been recorded using the system 10 so that it includes both audio information and inaudible data information.
  • CD compact disk
  • the audio information is heard by the user and the digital information is used to queue the equipment 38 to provide visual effects (through the glasses, FIG. 6) to the user corresponding to the audible information.
  • Applications other than the foregoing are contemplated and are also described more fully below.
  • FIG. 2 illustrates components of the encoder 12.
  • the encoder 12 comprises a frequency selective filter 200, a frequency shift keying (FSK) modulator 202, a frequency selective filter 204, and a summer 206.
  • the filter 200 exemplified by a low pass filter or a notch filter, receives the analog audio signal on the line 16 and substantially attenuates portions of the signal having frequencies above a -3 dB cutoff frequency of 18 kHz.
  • the filtered signal is output on a line 208 to the summer 206.
  • the modulator 202 receives the digital data signal on the line 18 and modulates the data signal to an analog data signal having carrier frequencies substantially between 18 kHz and 20 kHz, such as 18.5 kHz and 19.5 kHz for representing a binary 0 and 1 respectively.
  • the modulated data signal is output on a line 210 to the filter 204, which filter is exemplified by a high pass filter or a band pass filter.
  • the filter 204 substantially attenuates portions of the signal having frequencies below 18 kHz, and has a stopband with at least 20 dB of rejection.
  • the filtered data signal from the filter 204 is output onto a line 212 to the summer 206.
  • the summer 206 combines, or "sums," the audio signal on the line 208 and the data signal on the line 212 to form a single composite analog signal, which is output on a line 20.
  • the composite signal on the line 20 thus comprises two
  • a first component defined by the audio signal substantially below 18 kHz
  • a second component defined by the modulated data signal between 18 kHz and 20 kHz.
  • the composite signal on the line 20 generated by the summer 206 is input to the audio recorder 22 which records the composite signal onto the standard audio storage medium 24, such as a compact disc (CD) or magnetic tape via a line 28.
  • the standard audio storage medium 24 such as a compact disc (CD) or magnetic tape
  • FIGS. 3 illustrates components of the decoder 14.
  • the decoder 14 comprises frequency selective filters 300 and 302 and an FSK demodulator 304.
  • the audio player 26 retrieves the composite signal recorded on the standard audio storage medium 24 and outputs it to the filters 300, 302 via lines 32a and 32b, respectively.
  • the filter 300 exemplified by a low pass filter, outputs onto the line 34 substantially only portions of the composite signal having frequencies below a -3 dB cutoff frequency of 18 kHz.
  • the filtered signal on the line 34 which is substantially similar to the bandlimited audio signal on the line 208 (FIG. 2), may be output to audio processing equipment, such as an amplifier and loudspeakers (not shown).
  • the filter 302 outputs on a line 306 substantially only portions of the composite signal having frequencies above 18 kHz and, preferably, below 20 kHz, with at least 20 dB of rejection in the stopband.
  • the filtered signal on the Une 306 is input to the FSK demodulator 304, which outputs a digital data signal on a line 36 substantially similar to the data signal received on the line 18 (FIGS. 1, 2).
  • the data signal on the line 36 is output to digital processing equipment.
  • FIGS. 4-6 illustrate in greater detail a presently preferred implementation of a signal processing system in accordance with the present invention. In the accompanying drawings, part numbers and values of components are set forth, which parts and components are commercially available at the present time from commercial vendors.
  • the circuitry 202 comprises an input connector 400, a 32 MHz oscillator 402, a divider network 404, a four-bit binary counter 406, a resister array 408, a low pass filter 410, and an output connector 412.
  • the connector 400 receives data bits from the line 18 at, for example, 1200 baud, and outputs the bits serially to the divider network 404.
  • the divider network 404 receives a 32 MHz signal from the oscillator 402 and outputs to the counter 406 either a 296 (16 X 18.5) or a 312 (16 X 19.5) kHz clock signal, depending on whether the last bit received from the connector 400 was a 0 or a 1, respectively.
  • the counter 406 outputs four signals on four lines to the resister array 408 for each clock cycle that it receives from the network 404.
  • the output from the array 408 then traces, as a function of time, a 16 step sine wave at a rate of 18.5 or 19.5 kHz, the rate depending on whether the last bit received from the connector 400 was a 0 or a 1, respectively.
  • the stepped sine wave output from the array 408 is then passed through the filter 410 which "smooths" the waveform, the waveform representing the modulated data input to the connector 400, and then outputs the smoothed waveform onto the line 210 via the connector 412.
  • FIG. 5 depicts in greater detail the decoder portion 14 of the present invention comprising the input line 30, the audio player circuitry 26, the low pass filter circuitry 300, high pass filter circuitry 302, the FSK demodulator circuitry 304, and the output line 36.
  • the filter 300 includes two channels for processing stereo audio as depicted by low pass filters 158a, 158b, headphone stereo amplifier 158c, and headphone output 500.
  • FIG. 6 depicts a schematic of digital processing circuitry that may be connected to receive the digital data signal output on the line 36 (FIGS. 3, 5). Included in FIG. 6 is a microprocessor 600 and image glasses 602, which glasses have eight light emitting diodes (LED's) that are illuminated at various intensities in response to the digital data signal received on the line 36. The intensity of the LED's is controlled by an array 602 of transistors and resisters which are controlled by the microprocessor 600. By controlling the audio and the intensity of the lights, a number of various effects may be created.
  • LED's light emitting diodes
  • the internal processing of the encoder 10 is performed using digital signal processing (DSP) technology.
  • DSP digital signal processing
  • the functional blocks shown in FIG. 2 relating to the previous embodiment are the same except that an analog to digital converter (ADC, not shown) is employed to digitize the analog audio input signal before it is applied to the line 14.
  • ADC analog to digital converter
  • the filters 200, 202, the FSK modulator 202, and the summer 206 of the preferred embodiment are contained on a single DSP microprocessor chip (not shown).
  • FIG. 7 is a flow chart illustrating a serial peripheral interface (SPI) interrupt service routine which performs the functions of the filter 200 and summer 206 in a DSP embodiment.
  • SPI serial peripheral interface
  • 44,100 samples of the digitized analog audio signal are input from the above-mentioned ADC onto the line 14 every second, each sample of which typically comprises 16 bits.
  • an interrupt is generated for each new sample that is input.
  • the low pass filter typically a FIR - finite impulse response - filter
  • Each iteration includes shifting, in a first in, first out (FIFO) manner, previous samples stored in the filter so that the new sample can be stored, multiplying every sample by a coefficient, and then summing the results of all the multiplications to form an output sample.
  • Execution then proceeds to step 704, in which the output sample is output to the summer 206 - a binary adder - which adds the output sample to a "current FSK sample" (which FSK sample will be described with reference to FIGS. 8 and 9) stored in a memory (not shown), forming thereby a summed result.
  • Execution then proceeds to step 706, and the summed result is output to the audio recorder 22 via the line 20 and the storage medium 24 via the line 28. If the audio recorder 36 or the audio storage medium 40 is analog, then an appropriate digital to analog converter (DAC) would be necessary.
  • DAC digital to analog converter
  • FIGS. 8 and 9 are flow charts illustrating, respectively, synchronous serial interface (SSI) and timer interrupt service routines which generate an FSK signal simultaneously while the SPI interrupt service routine is processing audio input.
  • SSI synchronous serial interface
  • FIGS. 8 and 9 are flow charts illustrating, respectively, synchronous serial interface (SSI) and timer interrupt service routines which generate an FSK signal simultaneously while the SPI interrupt service routine is processing audio input.
  • SSI interrupt is generated in step 800.
  • Execution then proceeds to step 802 where a determination is made to set the timer either to 18.5 kHz in step 804 if the bit on the line 18 equals zero, or to 19.5 kHz in step 806 if the bit equals one.
  • a timer (not shown) then counts a number of clock cycles until it "times out," which number is a function of the timer rate most recently set in step 804 or 806 (FIG. 8).
  • step 900 When the timer times out, an interrupt is generated in step 900. Execution then proceeds to step 902 in which a "look-up" table having sine wave samples is looked up (referenced). In step 904, the next sine wave sample looked up becomes the "current FSK sample” and is copied to the memory address accessed in step 704. Thus, either an 18.5 or a 19.5 kHz carrier frequency, and thus FSK modulation, is generated from the data bits input on the line 18. The carrier frequency generated is filtered using an FIR filter analogous to the filter.
  • FIGS. 10A-10E illustrate waveforms of typical signals output onto various lines in the present invention as described herein.
  • FIG. 10A depicts the waveform of an analog audio signal input onto the line 16.
  • FIG. 10B depicts the waveform of a digital data signal input onto the line 18, and output onto the line 36.
  • FIG. 10C depicts the waveform of the analog audio signal of FIG. 10A after being filtered by the filters 200 and 300 and output onto the lines 208 and 34 respectively.
  • FIG. 10D depicts the waveform of the digital data signal of FIG. 10B after being modulated by the modulator 202 and output onto the line 210, and after being filtered by the filter 302 and output onto the line 306.
  • FIG. 10A depicts the waveform of an analog audio signal input onto the line 16.
  • FIG. 10B depicts the waveform of a digital data signal input onto the line 18, and output onto the line 36.
  • FIG. 10C depicts the waveform of the analog audio signal of FIG. 10A after being filtered by the filters 200
  • FIG. 10D depicts the waveform of a composite analog signal in which the signal waveforms of FIGS. IOC and 10D are combined by the summer 206 and output onto the line 20.
  • the embodiments of the present invention as described herein have many advantages over the prior art, including the ability to incorporate, within an audio signal, an inaudible data signal, forming thereby a single composite analog signal.
  • a further advantage achieved is that, because the composite signal is analog, it may be recorded using techniques commonly used with audio signals.
  • Another advantage achieved is that the format of the data is arbitrary, allowing open-ended systems to carry multiple data types for "multimedia" systems.
  • the data transfer rate is flexible and may be adjusted by utilizing different modulation schemes and/or adjusting the portion of the audio bandwidth allocated for the transmission of data.
  • Another advantage achieved is that the system is economical because specialized technology, such as SPDIF, is not required, and simple technology, such as FSK, may be utilized to modulate digital signals.
  • DSP digital signal processor
  • a further advantage is achieved by employing DSP in the encoder 10 to greatly increase the effectiveness of the filters 16 and 30. It is understood that the present invention can take many forms and embodiments. The embodiments shown herein are intended to illustrate rather than to limit the invention, it being appreciated that variations may be made without departing from the spirit or the scope of the invention. For example, any or all of the filters 16, 30, 58, 64 could be removed altogether for greater economy, albeit very low quality audio and data transmission.
  • the analog signal may represent a video or image signal instead of, or in addition to, an audio signal.
  • Filter bandwidths may also vary accordingly for different applications.
  • Other modulation techniques such as Phase Shift Keying (PSK) or Quadrature Phase Shift Keying (QPSK) techniques, while more expensive and complex than FSK techniques, may be used by the modulator 202 and the demodulator 304 to improve the data transfer rate for a given bandwidth.
  • the medium 24 may be a number of different types of analog or digital media, such as CD's, LP records, magnetic tape, or any other means of recording or broadcasting analog signals.
  • the storage medium 24 may be used to store music (analog audio) simultaneously with a standardized protocol (digital data) to control other equipment (e.g., audio processors, lights) in a home entertainment system or a live performance system.
  • the medium may interface with a computer to control synchronously, using digital data, events in a computer game while generating audio sounds.
  • Other embodiments include the display of text (e.g., lyrics, using digital data) with music, the combination of speech and text for educational purposes (e.g., language or reading instruction) or entertainment (e.g., "talking books"), the compression of musical instrument digital interface (MIDI) data with recorded audio, the synchronous control of lights with music using simple lighting control protocols, the synchronization of music with computer- controlled water fountains using a simple control protocol, the control of slides and other audio-visual equipment during a prerecorded presentation, the transmission of data over analog audio broadcast links, and the simulation of physical tremors from such events as earthquakes during video presentations of such.
  • MIDI musical instrument digital interface

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)

Abstract

A signal processing system comprises inputs for an analog audio signal (16) and a digital data signal (18). The digital data signal (18) is modulated to an analog data signal in an inaudible frequency band. Filters are used to ensure that the audio signal is restricted to audible frequencies and that the analog data signal is restricted to inaudible frequencies. The two analog signals are then combined into a composite analog signal (20). The composite signal (20) is stored on a medium (24) such as a compact disc. Filters are used to extract and separate the two analog signals from the composite signal stored on the medium. The analog data signal is demodulated to retrieve the original digital data signal (36).

Description

SYSTEM FOR COMBINING DIGITAL AND AUDIO SIGNALS
Technical Field
This invention relates generally to a signal processing system, and more particularly to a signal processing system for transparently transporting a digital signal in an audio signal.
Background of the Invention
Signals may be represented mathematically as functions of time and, more particularly as either analog (continuous -time) signals or digital (discrete-time) signals. As used herein, analog signals are defined for a continuum of time values and may be represented, for example, by a continuously time-varying electrical voltage. Digital signals, in contrast, .are defined only at discrete points in time and may, for example, be represented by a series of electrical voltage pulses. Each pulse represents a bit (i.e., a 0 or a 1), and accordingly, the series of pulses or bits is described as a bitstream, or a series of O's and l's. The bitstream may represent data or it may represent, numerically, the strength or amplitude, of a continuous signal at discrete points in time.
It is useful in many applications to combine analog and digital signals into a single composite signal. Furthermore, there is a particular need in numerous applications to combine an analog signal representing audio, with a digital signal representing data. For example, a compact disc (CD) or magnetic tape may be used to store music (analog audio) simultaneously with a standardized protocol
(digital data) to control other equipment (e.g., audio processors, lights) in a home entertainment system or a live performance system. Similarly, a CD player or magnetic tape may interface with a computer to control synchronously, using digital data, events in a computer game while generating audio sounds. Other examples include the display of text (e.g., lyrics, using digital data) with music, the combination of speech and text for educational purposes (e.g., language or reading instruction) or entertainment (e.g., "talking books"), the compression of musical instrument digital interface (MIDI) data with recorded audio, the synchronous control of lights with music using simple lighting control protocols, the synchronization of music with computer-controlled water fountains using a simple control protocol, the control of slides and other audio-visual equipment during a prerecorded presentation, and the transmission of data over analog audio broadcast links. Several techniques have been developed to address the need for combining analog audio signals and digital data signals. One such technique requires that the analog audio signal be converted to a digital audio signal and then combined with the digital data signal (by interleaving digital data bits) to form a single digital composite signal. This is exemplified by Furukawa in U.S. Patent No. 4,731,774, which discloses a technique for inserting digital data into the digital subcode bits of a CD digital audio bitstream. A disadvantage of Furukawa's technique is that, to retrieve the embedded data, a special CD player having a digital output such as the Sony Philips Digital Interface ("SPDIF") must be used. Furthermore, special hardware must then be used to extract the data from the SPDIF signal. Compared to analog-only systems, such techniques are complicated and expensive to implement.
Alternatively, analog audio signals and digital data signals may be combined by first converting the digital data signal to an analog data signal and then combining it with the analog audio signal to form a single analog composite signal. This has been done on an elementary scale with slide projectors in which an audible tone, for advancing slides, is incorporated into an associated recorded narrative. Two disadvantages of this technique are that the data signal is audible and the data transfer rate is too limited for many of the applications described above. Another technique that may be used to form a single composite analog signal, developed by a co-inventor of the present invention and disclosed in U.S. Patent No. 4,672,605, is to use a spread spectrum "data-over-voice" system in which alarm messages and other data are transmitted over telephone wires simultaneously with voice conversations. As in the technique described above for controlling a slide projector, the data signal in the spread spectrum system is audible, and is limited to extremely low data rates.
For the foregoing reasons, there is a need for a cost-effective signal processing system that can record and retrieve, inaudibly and at flexible transfer rates, digital data within an analog audio signal. Summary of the Invention
The foregoing problems are solved and a technical advance is achieved by an economical signal processing system that can transparently record and retrieve, inaudibly and at flexible transfer rates, digital data within an analog audio signal. In a departure from the art, in an encoding portion of the signal processing system, a digital data signal is converted (modulated) to an analog data signal at an inaudible frequency band. The analog data signal is then combined with the analog audio signal to form a single composite analog signal. In a decoding portion of the signal processing system, filters are used to retrieve and separate the audio signal and the analog data signal from the composite signal. The analog data signal is then demodulated to a digital data signal. The digital data signal and the analog audio signal are then supplied to appropriate processing equipment via digital and analog outputs respectively.
In an illustrative embodiment of the invention, an encoding portion of the system, which portion combines a first analog (audio) signal and a digital signal, comprises a modulator for modulating a digital signal to a second analog signal. The first and second analog signals are filtered and then summed to form a single composite analog signal, which composite analog signal may then be recorded onto a standard analog recording medium, or digitized and recorded onto a digital recording medium. In a decoding portion of the system, the composite signal is retrieved from the recording medium by a playback device. Filters are used to extract the first and second analog signals from the composite signal. The second analog signal is then demodulated to the original digital signal.
An advantage achieved with the invention is that the digital signal may be modulated onto a frequency band which is inaudible to the human ear.
A further advantage achieved with the invention is that, because the composite signal is analog and fits within the audio bandwidth, it may be recorded and played back using techniques commonly used with audio signals.
A further advantage achieved with the invention is that the format of the data is arbitrary, allowing open-ended systems to carry multiple data types.
A further advantage achieved with the invention is that the data transfer rate is flexible. The portion of the audio bandwidth allocated for the transmission of data, as well as the modulation scheme utilized, may be adjusted to support a number of different data rates and audio bandwidths. The available bandwidth may, therefore, be optimized for a number of different applications. Another advantage achieved is that the system is economical because specialized technology, such as SPDIF, is not required, and simple technology, such as FSK, may be utilized to modulate digital signals.
Brief Description of the Drawings FIG. 1 is a functional block diagram of a preferred embodiment of a signal processing system embodying features of the present invention;
FIG. 2 is a functional block diagram of an encoding portion of the signal processing system of FIG. 1;
FIG. 3 is a functional block diagram of a decoding portion of the signal processing system of FIG. 1;
FIG. 4 is a schematic drawing of an analog frequency shift keying modulator circuit of FIG. 2;
FIG. 5 is a schematic drawing of the circuits of FIG. 3;
FIG. 6 is a schematic drawing of processing equipment circuitry that may be connected to the digital data output of the decoder of FIGS. 3 and 5;
FIGS. 7-9 are a flowcharts illustrating respective SPI, SSI, and timer interrupt processes utilized in an alternate embodiment of FIG. 2;
FIG. 10A is a waveform of an exemplary analog audio signal input to the encoder of FIG. 2; FIG. 10B is a waveform of an exemplary digital data signal input to the encoder of FIG. 2;
FIG. IOC is a waveform of the analog audio signal of FIG. 10A after being filtered by the encoder of FIG. 2;
FIG. 10D is a waveform of the digital data signal of FIG. 10B after it is modulated by the encoder of FIG. 2; and FIG. 10E is a composite analog signal waveform in which the signal waveforms of FIGS. IOC and 10D are combined.
Detailed Description of a Preferred Embodiment In FIG. 1, the reference numeral 10 designates a signal processing system of the present invention which is utilized for transparently recording and retrieving, inaudibly and at flexible transfer rates, digital data within an analog audio signal. The system 10 includes an encoder 12 and a decoder 14. An analog, audio signal on line 16 and a digital data signal on line 18 are input to the encoder 12 and combined therein to produce a composite analog audio signal in which the data portion thereof is inaudible to the human ear. The composite signal is output from the encoder 12, as represented by line 20, to an audio recorder 22. The audio recorder 22 records the composite signal onto a standard audio storage medium 24 which is used to store the signal and subsequently play it back to the audio player 26, as represented by lines 28 and 30, respectively. The composite signal is output from the audio player 26, as represented by line 32, to the decoder 14. The decoder 14 separates the composite signal into its original analog audio and digital data components. Lines 34 and 36 output from the decoder analog audio and digital data signals, respectively.
In a preferred embodiment, audiovisual equipment 38 is connected by the lines 34, 36 to the system 10 and the system is utilized to control equipment in the delivery of a multimedia presentation. For example, the analog signal input on line 16 to the system 10 may be a radio or television broadcast signal, video, music, speech or any other signal in the form of analog information. The digital data input on line 18 may include ASCII encoded text or other messaging protocol information for use in queuing the equipment 38 for selected functions at selected time intervals of the multimedia presentation of the analog information. In particular, and as will be subsequently described, the equipment 38 includes glasses (FIG. 6) to be worn by the user for producing visual effects during the playback of audio information from the medium 22. In an exemplary application, the medium 22 comprises a compact disk (CD) which has been recorded using the system 10 so that it includes both audio information and inaudible data information. Upon playback, the audio information is heard by the user and the digital information is used to queue the equipment 38 to provide visual effects (through the glasses, FIG. 6) to the user corresponding to the audible information. Applications other than the foregoing are contemplated and are also described more fully below.
FIG. 2 illustrates components of the encoder 12. The encoder 12 comprises a frequency selective filter 200, a frequency shift keying (FSK) modulator 202, a frequency selective filter 204, and a summer 206. The filter 200, exemplified by a low pass filter or a notch filter, receives the analog audio signal on the line 16 and substantially attenuates portions of the signal having frequencies above a -3 dB cutoff frequency of 18 kHz. The filtered signal is output on a line 208 to the summer 206.
The modulator 202 receives the digital data signal on the line 18 and modulates the data signal to an analog data signal having carrier frequencies substantially between 18 kHz and 20 kHz, such as 18.5 kHz and 19.5 kHz for representing a binary 0 and 1 respectively. The modulated data signal is output on a line 210 to the filter 204, which filter is exemplified by a high pass filter or a band pass filter. The filter 204 substantially attenuates portions of the signal having frequencies below 18 kHz, and has a stopband with at least 20 dB of rejection. The filtered data signal from the filter 204 is output onto a line 212 to the summer 206.
The summer 206 combines, or "sums," the audio signal on the line 208 and the data signal on the line 212 to form a single composite analog signal, which is output on a line 20. The composite signal on the line 20 thus comprises two
components: a first component defined by the audio signal substantially below 18 kHz, and a second component defined by the modulated data signal between 18 kHz and 20 kHz.
The composite signal on the line 20 generated by the summer 206 is input to the audio recorder 22 which records the composite signal onto the standard audio storage medium 24, such as a compact disc (CD) or magnetic tape via a line 28.
FIGS. 3 illustrates components of the decoder 14. The decoder 14 comprises frequency selective filters 300 and 302 and an FSK demodulator 304. The audio player 26 retrieves the composite signal recorded on the standard audio storage medium 24 and outputs it to the filters 300, 302 via lines 32a and 32b, respectively.
The filter 300, exemplified by a low pass filter, outputs onto the line 34 substantially only portions of the composite signal having frequencies below a -3 dB cutoff frequency of 18 kHz. The filtered signal on the line 34, which is substantially similar to the bandlimited audio signal on the line 208 (FIG. 2), may be output to audio processing equipment, such as an amplifier and loudspeakers (not shown).
The filter 302 outputs on a line 306 substantially only portions of the composite signal having frequencies above 18 kHz and, preferably, below 20 kHz, with at least 20 dB of rejection in the stopband. The filtered signal on the Une 306 is input to the FSK demodulator 304, which outputs a digital data signal on a line 36 substantially similar to the data signal received on the line 18 (FIGS. 1, 2). The data signal on the line 36 is output to digital processing equipment. The circuitry set forth in FIGS. 4-6 illustrate in greater detail a presently preferred implementation of a signal processing system in accordance with the present invention. In the accompanying drawings, part numbers and values of components are set forth, which parts and components are commercially available at the present time from commercial vendors. FIG. 4 illustrates in greater detail the FSK modulator circuitry 202 of the encoder portion 12 of the present invention. The circuitry 202 comprises an input connector 400, a 32 MHz oscillator 402, a divider network 404, a four-bit binary counter 406, a resister array 408, a low pass filter 410, and an output connector 412. The connector 400 receives data bits from the line 18 at, for example, 1200 baud, and outputs the bits serially to the divider network 404. The divider network 404 receives a 32 MHz signal from the oscillator 402 and outputs to the counter 406 either a 296 (16 X 18.5) or a 312 (16 X 19.5) kHz clock signal, depending on whether the last bit received from the connector 400 was a 0 or a 1, respectively. The counter 406 outputs four signals on four lines to the resister array 408 for each clock cycle that it receives from the network 404. The output from the array 408 then traces, as a function of time, a 16 step sine wave at a rate of 18.5 or 19.5 kHz, the rate depending on whether the last bit received from the connector 400 was a 0 or a 1, respectively. The stepped sine wave output from the array 408 is then passed through the filter 410 which "smooths" the waveform, the waveform representing the modulated data input to the connector 400, and then outputs the smoothed waveform onto the line 210 via the connector 412.
FIG. 5 depicts in greater detail the decoder portion 14 of the present invention comprising the input line 30, the audio player circuitry 26, the low pass filter circuitry 300, high pass filter circuitry 302, the FSK demodulator circuitry 304, and the output line 36. The filter 300 includes two channels for processing stereo audio as depicted by low pass filters 158a, 158b, headphone stereo amplifier 158c, and headphone output 500.
FIG. 6 depicts a schematic of digital processing circuitry that may be connected to receive the digital data signal output on the line 36 (FIGS. 3, 5). Included in FIG. 6 is a microprocessor 600 and image glasses 602, which glasses have eight light emitting diodes (LED's) that are illuminated at various intensities in response to the digital data signal received on the line 36. The intensity of the LED's is controlled by an array 602 of transistors and resisters which are controlled by the microprocessor 600. By controlling the audio and the intensity of the lights, a number of various effects may be created. For example, people could be entertained or healed, virtual reality could be effected, learning could be stimulated by enhancing a person's concentration, or drug addicts could be aided in recovery by being able to electronically simulate and control hallucinations. In an alternative embodiment of the present invention, the internal processing of the encoder 10 is performed using digital signal processing (DSP) technology. The functional blocks shown in FIG. 2 relating to the previous embodiment are the same except that an analog to digital converter (ADC, not shown) is employed to digitize the analog audio input signal before it is applied to the line 14. The filters 200, 202, the FSK modulator 202, and the summer 206 of the preferred embodiment are contained on a single DSP microprocessor chip (not shown). Because the operation of the individual components described herein is understood by those skilled in the art based on this disclosure, such operation will only be briefly discussed here. FIG. 7 is a flow chart illustrating a serial peripheral interface (SPI) interrupt service routine which performs the functions of the filter 200 and summer 206 in a DSP embodiment. Typically, 44,100 samples of the digitized analog audio signal are input from the above-mentioned ADC onto the line 14 every second, each sample of which typically comprises 16 bits. In step 700, an interrupt is generated for each new sample that is input. In step 702, the low pass filter (typically a FIR - finite impulse response - filter) is then iterated. Each iteration includes shifting, in a first in, first out (FIFO) manner, previous samples stored in the filter so that the new sample can be stored, multiplying every sample by a coefficient, and then summing the results of all the multiplications to form an output sample. Execution then proceeds to step 704, in which the output sample is output to the summer 206 - a binary adder - which adds the output sample to a "current FSK sample" (which FSK sample will be described with reference to FIGS. 8 and 9) stored in a memory (not shown), forming thereby a summed result. Execution then proceeds to step 706, and the summed result is output to the audio recorder 22 via the line 20 and the storage medium 24 via the line 28. If the audio recorder 36 or the audio storage medium 40 is analog, then an appropriate digital to analog converter (DAC) would be necessary.
FIGS. 8 and 9 are flow charts illustrating, respectively, synchronous serial interface (SSI) and timer interrupt service routines which generate an FSK signal simultaneously while the SPI interrupt service routine is processing audio input. When a digital data bit is input on the line 18, an SSI interrupt is generated in step 800. Execution then proceeds to step 802 where a determination is made to set the timer either to 18.5 kHz in step 804 if the bit on the line 18 equals zero, or to 19.5 kHz in step 806 if the bit equals one. A timer (not shown) then counts a number of clock cycles until it "times out," which number is a function of the timer rate most recently set in step 804 or 806 (FIG. 8). When the timer times out, an interrupt is generated in step 900. Execution then proceeds to step 902 in which a "look-up" table having sine wave samples is looked up (referenced). In step 904, the next sine wave sample looked up becomes the "current FSK sample" and is copied to the memory address accessed in step 704. Thus, either an 18.5 or a 19.5 kHz carrier frequency, and thus FSK modulation, is generated from the data bits input on the line 18. The carrier frequency generated is filtered using an FIR filter analogous to the filter.
FIGS. 10A-10E illustrate waveforms of typical signals output onto various lines in the present invention as described herein. Specifically, FIG. 10A depicts the waveform of an analog audio signal input onto the line 16. FIG. 10B depicts the waveform of a digital data signal input onto the line 18, and output onto the line 36. FIG. 10C depicts the waveform of the analog audio signal of FIG. 10A after being filtered by the filters 200 and 300 and output onto the lines 208 and 34 respectively. FIG. 10D depicts the waveform of the digital data signal of FIG. 10B after being modulated by the modulator 202 and output onto the line 210, and after being filtered by the filter 302 and output onto the line 306. FIG. 10D depicts the waveform of a composite analog signal in which the signal waveforms of FIGS. IOC and 10D are combined by the summer 206 and output onto the line 20. The embodiments of the present invention as described herein have many advantages over the prior art, including the ability to incorporate, within an audio signal, an inaudible data signal, forming thereby a single composite analog signal. A further advantage achieved is that, because the composite signal is analog, it may be recorded using techniques commonly used with audio signals. Another advantage achieved is that the format of the data is arbitrary, allowing open-ended systems to carry multiple data types for "multimedia" systems. Furthermore, the data transfer rate is flexible and may be adjusted by utilizing different modulation schemes and/or adjusting the portion of the audio bandwidth allocated for the transmission of data. Another advantage achieved is that the system is economical because specialized technology, such as SPDIF, is not required, and simple technology, such as FSK, may be utilized to modulate digital signals. A further advantage is achieved by employing DSP in the encoder 10 to greatly increase the effectiveness of the filters 16 and 30. It is understood that the present invention can take many forms and embodiments. The embodiments shown herein are intended to illustrate rather than to limit the invention, it being appreciated that variations may be made without departing from the spirit or the scope of the invention. For example, any or all of the filters 16, 30, 58, 64 could be removed altogether for greater economy, albeit very low quality audio and data transmission.
In still further embodiments, the analog signal may represent a video or image signal instead of, or in addition to, an audio signal. Filter bandwidths may also vary accordingly for different applications. Other modulation techniques, such as Phase Shift Keying (PSK) or Quadrature Phase Shift Keying (QPSK) techniques, while more expensive and complex than FSK techniques, may be used by the modulator 202 and the demodulator 304 to improve the data transfer rate for a given bandwidth. The medium 24 may be a number of different types of analog or digital media, such as CD's, LP records, magnetic tape, or any other means of recording or broadcasting analog signals. In still further embodiments, the storage medium 24 may be used to store music (analog audio) simultaneously with a standardized protocol (digital data) to control other equipment (e.g., audio processors, lights) in a home entertainment system or a live performance system. Similarly, the medium may interface with a computer to control synchronously, using digital data, events in a computer game while generating audio sounds. Other embodiments include the display of text (e.g., lyrics, using digital data) with music, the combination of speech and text for educational purposes (e.g., language or reading instruction) or entertainment (e.g., "talking books"), the compression of musical instrument digital interface (MIDI) data with recorded audio, the synchronous control of lights with music using simple lighting control protocols, the synchronization of music with computer- controlled water fountains using a simple control protocol, the control of slides and other audio-visual equipment during a prerecorded presentation, the transmission of data over analog audio broadcast links, and the simulation of physical tremors from such events as earthquakes during video presentations of such. Al though illustrative embodiments of the invention have been shown and described, a wide range of modification, change, and substitution is intended in the foregoing disclosure and in some instances, some features of the present invention may be employed without a corresponding use of the other features. Accordingly, it is appropriate that the appended claims be construed broadly and in a manner consistent with the scope of the invention.

Claims

WHAT IS CLAIMED IS:
1. A signal processing system comprising: means for modulating a digital signal to a first analog signal consisting essentially of frequencies contained within a first frequency band; and means for combining said first analog signal and a second analog signal to form a single composite analog signal, said second analog signal consisting essentially of frequencies contained within a second frequency band, said first and second frequency bands being nonoverlapping.
2. The system of claim 1, further comprising: a filter for attenuating, in said second frequency band, the amplitude of said composite signal to extract said first analog signal; and means for demodulating said first analog signal to said digital signal.
3. A system for combining a first analog signal and a digital signal, said system comprising: means for modulating said digital signal to a second analog signal; a first filter for attenuating, in a first frequency band, the amplitude of said second analog signal; a second filter for attenuating, in a second frequency band, the amplitude of said first analog signal, said first and second bands being nonoverlapping; and means for combining said first and second filtered analog signals to form a single composite analog signal.
4. The system of claim 3, further comprising: a third filter for attenuating, in said second frequency band, the amplitude of said composite signal to extract said first analog signal; a fourth filter for attenuating, in said first frequency band, the amplitude of said composite signal to extract said second analog signal; and means for demodulating said second analog signal to said digital signal.
5. The system of claim 4, further comprising: storage medium for storing said composite signal; means for storing said composite signal to said storage medium; and means for retrieving said composite signal from said storage means and passing said composite signal to said third and fourth filters.
6. The system of claim 5, wherein said storage medium is magnetic tape.
7. The system of claim 5, wherein said storage medium is a compact disc.
8. The system of claim 4, wherein said first band consists of frequencies below a -3 dB cutoff frequency, said second band consists of frequencies above said cutoff frequency, said first signal consists essentially of frequencies contained within said first
band, and said second signal consists essentially of frequencies contained within said
second band.
9. The system of claim 8, wherein said cutoff frequency is 18 kHz.
10. The system of claim 4, wherein said modulator and said demodulator utilize phase shift keying technology, and said first, second, third, and fourth filters are operatively based upon analog processing technology.
11. The system of claim 4, wherein said modulator and said demodulator utilize quadrature phase shift keying technology, and said first, second, third, and fourth filters are operatively based upon analog processing technology.
12. The system of claim 4, wherein said modulator and said demodulator utilize frequency shift keying technology, and said first, second, third, and fourth filters are operatively based upon analog processing technology.
13. The system of claim 4, wherein said modulator and said demodulator utilize phase shift keying technology, and said first, second, third, and fourth filters are operatively based upon digital processing technology.
14. The system of claim 4, wherein said modulator and said demodulator utilize quadrature phase shift keying technology, and said first, second, third, and fourth filters are operatively based upon digital processing technology.
15. The system of claim 4, wherein said modulator and said demodulator utilize frequency shift keying technology, and said first, second, third, and fourth filters are operatively based upon digital processing technology.
16. A method for combining a first analog signal and a digital signal, said process comprising: modulating said digital signal to a second analog signal; attenuating, in a first frequency band, the amplitude of said second analog signal; attenuating, in a second frequency band, the amplitude of said first analog signal, said' first and second bands being nonoverlapping; and combining said first and second analog signals to form a single composite analog signal.
17. The method of claim 16, further comprising: attenuating, in said second frequency band, the amplitude of said composite signal to extract said first analog signal; attenuating, in said first frequency band, the amplitude of said composite signal to extract said second analog signal; and demodulating said second analog signal to said digital signal.
18. The method of claim 17, further comprising: storing said composite signal to a medium; and retrieving said composite signal from said medium.
19. The method of claim 17, wherein: said first band consists of frequencies below a -3 dB cutoff frequency , said second band consists of frequencies above said cutoff frequency, said first signal consists essentially of frequencies contained within said first band, and said second signal consists essentially of frequencies contained within said second band.
20. The method of claim 19, wherein said cutoff frequency is 18 kHz.
21. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing phase shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing analog technology.
22. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing quadrature phase shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing analog technology.
23. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing frequency shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing analog technology.
24. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing phase shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing digital technology.
25. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing quadrature phase shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing digital technology.
26. The method of claim 17, wherein: the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing frequency shift keying technology; and the steps of attenuating said first and second analog signals and of attenuating said composite signal in said first and second frequency bands are performed utilizing digital technology.
27. The method of claim 17, wherein the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing phase shift keying technology.
28. The method of cl m 17, wherein the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing quadrature phase shift keying technology.
29. The method of claim 17, wherein the steps of modulating said digital signal, and of demodulating said second analog signal are performed utilizing frequency shift keying technology.
PCT/US1996/013496 1994-07-05 1996-08-21 System for combining digital and audio signals WO1998008218A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US08/270,252 US5612943A (en) 1994-07-05 1994-07-05 System for carrying transparent digital data within an audio signal
AU69558/96A AU6955896A (en) 1996-08-21 1996-08-21 System for combining digital and audio signals
PCT/US1996/013496 WO1998008218A1 (en) 1994-07-05 1996-08-21 System for combining digital and audio signals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/270,252 US5612943A (en) 1994-07-05 1994-07-05 System for carrying transparent digital data within an audio signal
PCT/US1996/013496 WO1998008218A1 (en) 1994-07-05 1996-08-21 System for combining digital and audio signals

Publications (1)

Publication Number Publication Date
WO1998008218A1 true WO1998008218A1 (en) 1998-02-26

Family

ID=26791201

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/013496 WO1998008218A1 (en) 1994-07-05 1996-08-21 System for combining digital and audio signals

Country Status (2)

Country Link
US (1) US5612943A (en)
WO (1) WO1998008218A1 (en)

Families Citing this family (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6424725B1 (en) 1996-05-16 2002-07-23 Digimarc Corporation Determining transformations of media signals with embedded code signals
US6944298B1 (en) 1993-11-18 2005-09-13 Digimare Corporation Steganographic encoding and decoding of auxiliary codes in media signals
US5748763A (en) 1993-11-18 1998-05-05 Digimarc Corporation Image steganography system featuring perceptually adaptive and globally scalable signal embedding
US6983051B1 (en) * 1993-11-18 2006-01-03 Digimarc Corporation Methods for audio watermarking and decoding
US6516079B1 (en) 2000-02-14 2003-02-04 Digimarc Corporation Digital watermark screening and detecting strategies
US7676059B2 (en) * 1994-10-21 2010-03-09 Digimarc Corporation Video steganography or encoding
US6611607B1 (en) 1993-11-18 2003-08-26 Digimarc Corporation Integrating digital watermarks in multimedia content
US7171016B1 (en) 1993-11-18 2007-01-30 Digimarc Corporation Method for monitoring internet dissemination of image, video and/or audio files
US6122403A (en) 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US6408082B1 (en) 1996-04-25 2002-06-18 Digimarc Corporation Watermark detection using a fourier mellin transform
US6449377B1 (en) 1995-05-08 2002-09-10 Digimarc Corporation Methods and systems for watermark processing of line art images
US6757406B2 (en) 1993-11-18 2004-06-29 Digimarc Corporation Steganographic image processing
US6614914B1 (en) 1995-05-08 2003-09-02 Digimarc Corporation Watermark embedder and reader
US6869023B2 (en) * 2002-02-12 2005-03-22 Digimarc Corporation Linking documents through digital watermarking
US7039214B2 (en) * 1999-11-05 2006-05-02 Digimarc Corporation Embedding watermark components during separate printing stages
US6882738B2 (en) * 1994-03-17 2005-04-19 Digimarc Corporation Methods and tangible objects employing textured machine readable data
US6560349B1 (en) 1994-10-21 2003-05-06 Digimarc Corporation Audio monitoring using steganographic information
DE19503213C2 (en) * 1995-02-02 1996-10-17 Becker Gmbh Method for the joint transmission of digital source and control data between data sources and sinks connected via data lines
US20030133592A1 (en) * 1996-05-07 2003-07-17 Rhoads Geoffrey B. Content objects with computer instructions steganographically encoded therein, and associated methods
US6738495B2 (en) * 1995-05-08 2004-05-18 Digimarc Corporation Watermarking enhanced to withstand anticipated corruptions
JPH0917159A (en) * 1995-06-30 1997-01-17 Pioneer Electron Corp Data-recording apparatus, data-reproducing apparatus and data-recording medium
US6408331B1 (en) * 1995-07-27 2002-06-18 Digimarc Corporation Computer linking methods using encoded graphics
US6411725B1 (en) * 1995-07-27 2002-06-25 Digimarc Corporation Watermark enabled video objects
US7003731B1 (en) 1995-07-27 2006-02-21 Digimare Corporation User control and activation of watermark enabled objects
US6381341B1 (en) 1996-05-16 2002-04-30 Digimarc Corporation Watermark encoding method exploiting biases inherent in original signal
US8005254B2 (en) * 1996-11-12 2011-08-23 Digimarc Corporation Background watermark processing
US6020839A (en) * 1997-10-27 2000-02-01 Int Labs, Inc. Analog technique to detect asymmetric radio frequency pulses
US6233633B1 (en) * 1998-03-05 2001-05-15 Sony Corporation Data transfer between a computer and a digital storage device using a computer sound card to convert the processed digital data to analog form
US7602940B2 (en) * 1998-04-16 2009-10-13 Digimarc Corporation Steganographic data hiding using a device clock
US6782115B2 (en) 1998-04-16 2004-08-24 Digimarc Corporation Watermark holograms
US6608911B2 (en) * 2000-12-21 2003-08-19 Digimarc Corporation Digitally watermaking holograms for use with smart cards
US6965873B1 (en) 1998-04-16 2005-11-15 Digimarc Corporation Electronic commerce using optical input device
EP1080548A4 (en) * 1998-05-18 2004-03-31 Digital Harmony Technologies I Combined analog/digital data transmission system
US7006555B1 (en) 1998-07-16 2006-02-28 Nielsen Media Research, Inc. Spectral audio encoding
US7055034B1 (en) * 1998-09-25 2006-05-30 Digimarc Corporation Method and apparatus for robust embedded data
GB2363300B (en) 1998-12-29 2003-10-01 Kent Ridge Digital Labs Digital audio watermarking using content-adaptive multiple echo hopping
US20010034705A1 (en) * 1999-05-19 2001-10-25 Rhoads Geoffrey B. Payment-based systems for internet music
US7164413B2 (en) * 1999-05-19 2007-01-16 Digimarc Corporation Enhanced input peripheral
US7502759B2 (en) * 1999-08-30 2009-03-10 Digimarc Corporation Digital watermarking methods and related toy and game applications
US6571144B1 (en) 1999-10-20 2003-05-27 Intel Corporation System for providing a digital watermark in an audio signal
JP2001256731A (en) * 2000-01-07 2001-09-21 Sony Corp Information recording medium, information reproducing device, information reproducing method, information recording device and information recording method
US7206272B2 (en) * 2000-04-20 2007-04-17 Yamaha Corporation Method for recording asynchronously produced digital data codes, recording unit used for the method, method for reproducing the digital data codes, playback unit used for the method and information storage medium
US6674876B1 (en) 2000-09-14 2004-01-06 Digimarc Corporation Watermarking in the time-frequency domain
WO2002033954A2 (en) 2000-10-17 2002-04-25 Digimarc Corporation User control and activation of watermark enabled objects
US7046819B2 (en) 2001-04-25 2006-05-16 Digimarc Corporation Encoded reference signal for digital watermarks
US7063264B2 (en) 2001-12-24 2006-06-20 Digimarc Corporation Covert variable information on identification documents and methods of making same
ATE509326T1 (en) 2001-12-18 2011-05-15 L 1 Secure Credentialing Inc MULTIPLE IMAGE SECURITY FEATURES FOR IDENTIFYING DOCUMENTS AND METHOD FOR PRODUCING THEM
US7728048B2 (en) 2002-12-20 2010-06-01 L-1 Secure Credentialing, Inc. Increasing thermal conductivity of host polymer used with laser engraving methods and compositions
US7793846B2 (en) 2001-12-24 2010-09-14 L-1 Secure Credentialing, Inc. Systems, compositions, and methods for full color laser engraving of ID documents
US20030131350A1 (en) 2002-01-08 2003-07-10 Peiffer John C. Method and apparatus for identifying a digital audio signal
US20040125707A1 (en) * 2002-04-05 2004-07-01 Rodolfo Vargas Retrieving content of various types with a conversion device attachable to audio outputs of an audio CD player
US7824029B2 (en) 2002-05-10 2010-11-02 L-1 Secure Credentialing, Inc. Identification card printer-assembler for over the counter card issuing
US20040091111A1 (en) * 2002-07-16 2004-05-13 Levy Kenneth L. Digital watermarking and fingerprinting applications
US20040034655A1 (en) * 2002-07-17 2004-02-19 Tecu Kirk Steven Multimedia system and method
US7376126B1 (en) 2002-09-06 2008-05-20 At&T Delaware Intellectual Property, Inc. Systems and methods for messaging using a broadband connection
NZ539596A (en) 2002-10-23 2008-11-28 Nielsen Media Res Inc Digital data insertion apparatus and methods for use with compressed audio/video data
US7804982B2 (en) 2002-11-26 2010-09-28 L-1 Secure Credentialing, Inc. Systems and methods for managing and detecting fraud in image databases used with identification documents
US7712673B2 (en) 2002-12-18 2010-05-11 L-L Secure Credentialing, Inc. Identification document with three dimensional image of bearer
EP1614064B1 (en) 2003-04-16 2010-12-08 L-1 Secure Credentialing, Inc. Three dimensional data storage
US7706565B2 (en) 2003-09-30 2010-04-27 Digimarc Corporation Multi-channel digital watermarking
US7744002B2 (en) 2004-03-11 2010-06-29 L-1 Secure Credentialing, Inc. Tamper evident adhesive and identification document including same
US20070183455A1 (en) * 2004-03-12 2007-08-09 Koninklijke Philips Electronics, N.V. Method of inserting digital watermarks in one-bit audio files
TWI404419B (en) 2004-04-07 2013-08-01 Nielsen Media Res Inc Data insertion methods , sysytems, machine readable media and apparatus for use with compressed audio/video data
US7668334B2 (en) * 2004-07-02 2010-02-23 Digimarc Corp Conditioning imagery to better receive steganographic encoding
US20080178726A1 (en) * 2005-09-30 2008-07-31 Burgett, Inc. System and method for adjusting midi volume levels based on response to the characteristics of an analog signal
US7531736B2 (en) * 2005-09-30 2009-05-12 Burgett, Inc. System and method for adjusting MIDI volume levels based on response to the characteristics of an analog signal
US7563976B2 (en) * 2007-07-18 2009-07-21 Creative Technology Ltd Apparatus and method for processing at least one MIDI signal
CN101983403B (en) 2008-07-29 2013-05-22 雅马哈株式会社 Performance-related information output device, system provided with performance-related information output device, and electronic musical instrument
EP2770751B1 (en) * 2008-07-30 2017-09-06 Yamaha Corporation Audio signal processing device, audio signal processing system, and audio signal processing method
US20110046758A1 (en) * 2009-08-21 2011-02-24 Sampson Soo Audio-controlling system
JP5782677B2 (en) * 2010-03-31 2015-09-24 ヤマハ株式会社 Content reproduction apparatus and audio processing system
US8380334B2 (en) * 2010-09-07 2013-02-19 Linear Acoustic, Inc. Carrying auxiliary data within audio signals
US20120197648A1 (en) * 2011-01-27 2012-08-02 David Moloney Audio annotation
EP2573761B1 (en) 2011-09-25 2018-02-14 Yamaha Corporation Displaying content in relation to music reproduction by means of information processing apparatus independent of music reproduction apparatus
JP5494677B2 (en) 2012-01-06 2014-05-21 ヤマハ株式会社 Performance device and performance program
US10460709B2 (en) * 2017-06-26 2019-10-29 The Intellectual Property Network, Inc. Enhanced system, method, and devices for utilizing inaudible tones with music
GB2612569B (en) 2021-06-24 2023-11-29 Blackstar Amplification Ltd Transmiter devices, receiver devices, and systems

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4382299A (en) * 1980-11-07 1983-05-03 Rca Corporation Disc record system employing signal redundancy
US5062007A (en) * 1988-12-16 1991-10-29 Nissan Motor Company, Limited Digital signal magnetic recording/reproducing apparatus

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5018020A (en) * 1979-08-15 1991-05-21 Discovision Associates Record disc for storing separate video and audio information
US4752953A (en) * 1983-05-27 1988-06-21 M/A-Com Government Systems, Inc. Digital audio scrambling system with pulse amplitude modulation
JPH0634301B2 (en) * 1983-07-30 1994-05-02 ソニー株式会社 Disk playback device
JPH0634304B2 (en) * 1983-09-01 1994-05-02 ソニー株式会社 Disk playback device
JPS6052960A (en) * 1983-09-01 1985-03-26 Sony Corp Disk reproducer
JPH0611114B2 (en) * 1984-12-31 1994-02-09 ティアツク株式会社 Analog-digital converter
JPH0611117B2 (en) * 1984-12-31 1994-02-09 ティアツク株式会社 Digital-analog converter
US4763207A (en) * 1985-10-15 1988-08-09 R. R. Donnelley & Sons Company Digital method and system for reproducing analog data
US4851931A (en) * 1987-02-20 1989-07-25 1K Music International Ltd. Method and apparatus for producing an audio magnetic tape recording at high speed from a preselected music library
US5012352A (en) * 1987-08-10 1991-04-30 Canon Kabushiki Kaisha Digital signal recording apparatus time-division multiplexing video and audio signals
US5101274A (en) * 1987-08-10 1992-03-31 Canon Kabushiki Kaisha Digital signal recording apparatus time-division multiplexing video and audio signals
KR900003880A (en) * 1988-08-23 1990-03-27 안시환 DAT system with CD
JPH04195824A (en) * 1990-11-27 1992-07-15 Matsushita Electric Ind Co Ltd Optical disk, optical disk recorder, and optical disk reproducing device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4382299A (en) * 1980-11-07 1983-05-03 Rca Corporation Disc record system employing signal redundancy
US5062007A (en) * 1988-12-16 1991-10-29 Nissan Motor Company, Limited Digital signal magnetic recording/reproducing apparatus

Also Published As

Publication number Publication date
US5612943A (en) 1997-03-18

Similar Documents

Publication Publication Date Title
US5612943A (en) System for carrying transparent digital data within an audio signal
Watkinson Art of digital audio
US4937807A (en) System for encoding sound recordings for high-density storage and high-speed transfers
WO1997037448A2 (en) Apparatus and method for encoding and decoding supplementary data in analog signals
JPS63501988A (en) Recording and retrieval of digital information using video signals
DE69618722T2 (en) Recording medium, recording device and playback device
Torick Highlights in the history of multichannel sound
EP0283727A3 (en) Method and apparatus for producing an audio magnetic tape recording at high speed from a preselected music libray
EP1780710A1 (en) Method for recording, reproducing and handling audio data in a data recording medium
US5079647A (en) Method and apparatus for recording/reproducing monaural audio signal mixed with the clock and data signals
JP2001134295A (en) Encoder and encoding method, recorder and recording method, transmitter and transmission method, decoder and decoding method, reproducing device and reproducing method, and recording medium
Kefauver et al. Fundamentals of digital audio
US20040054525A1 (en) Encoding method and decoding method for digital voice data
Komamura Wide-band and wide-dynamic-range recording and reproduction of digital audio
JP3441343B2 (en) Copyright information embedding device, recording medium and copyright data reproducing method
Nilsson Tech talk: all about audio.
ODI Rane Professional Audio Reference
JPH0721742A (en) Audio editing system and audio reproducing system
Yelick The authoring of optical videodiscs with digital data
JP3724712B2 (en) Audio signal transmission method and method of reproducing transmitted data
JP3727023B2 (en) Audio signal encoding method and reproducing apparatus
JP3726805B2 (en) Audio signal encoding method and reproducing apparatus
JPH02262710A (en) Digital signal processor, optical recorder, digital signal reproducing device, digital signal transmitter, and digital signal receiver
JP3726806B2 (en) Audio signal encoding method and reproducing apparatus
CA2175349A1 (en) Method and apparatus for storing and presenting visual and audible information to an individual

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE HU IL IS JP KE KG KP KR KZ LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TR TT UA UG US UZ VN AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 1998510683

Format of ref document f/p: F

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA