WO1985002022A1 - Acoustic direction identification system - Google Patents
Acoustic direction identification system Download PDFInfo
- Publication number
- WO1985002022A1 WO1985002022A1 PCT/US1984/001584 US8401584W WO8502022A1 WO 1985002022 A1 WO1985002022 A1 WO 1985002022A1 US 8401584 W US8401584 W US 8401584W WO 8502022 A1 WO8502022 A1 WO 8502022A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sound
- signal
- pulse
- speech
- sound source
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
- G01S3/802—Systems for determining direction or deviation from predetermined direction
- G01S3/808—Systems for determining direction or deviation from predetermined direction using transducers spaced apart and measuring phase or time difference between signals therefrom, i.e. path-difference systems
- G01S3/8083—Systems for determining direction or deviation from predetermined direction using transducers spaced apart and measuring phase or time difference between signals therefrom, i.e. path-difference systems determining direction of source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
- H04R2201/403—Linear arrays of transducers
Definitions
- This invention relates to acoustic signal processing and more particularly to signal discriminating arrangements for identification and verification of the direction of sound sources.
- conferencing arrangements for example, a plurality of speakers in a room are served by a speakerphone set.
- the direction of sound is variable and the room reflections are generally not controlled. Consequently, adverse effects are distinctly noticeable and some electronic arrangement must be used to reduce noise and reverberation without changing room conditions.
- One type of system in the known art for reducing multipath reverberative interference utilizes two or more spatially separated microphones, each receiving different versions of the same sound. The microphone outputs are directly combined so that reverberative effects are minimized.
- the signals from a plurality of spatially separated microphones are processed to select the signal having the least reverberative interference.
- Each one of the speech signals is transformed into an envelope representative signal having rapid increases responsive to direct-path and echo energy bursts from the sound source and exponential decaying portions between energy bursts.
- a first pulse corresponding to a sound source direct-path energy burst is generated responsive to the first speech signal exceeding its envelope representative signal, and further first pulses corresponding to echo bursts are inhibited for a predetermined time.
- a second pulse corresponding to the sound source direct-path energy burst is generated responsive to the second speech signal exceeding its envelope representative signal, and further second pulses corresponding to echo bursts are inhibited for a predetermined time.
- the first and second speech signals are aligned in phase responsive to the time difference between said first and second pulses.
- the invention is directed to an acoustic signal processing system which utilizes a pair of spatially separated microphones to obtain the direction of origin of speech signals from a common sound source.
- the speech signal from each microphone is transformed into a pulse representative signal having a rapid increase responsive to pitch peaks or energy bursts from the sound source.
- the corresponding pulses of the two speech signals are phase related and transformed into a signal that is insensitive to nonspeech sounds and is used in determining the direction to the common sound source.
- Operation of the invention is such to give strong preference to direct-path early arriving energy bursts over later arriving reflections thereby providing audio signal discrimination, and to produce a stream of pulses whose cross-correlation is employed in building time interval histograms which are periodically read to identify the direction to a person speaking.
- This system thus allows for operations such as mechanical or electrical aiming in real time of directional microphones and thereby significantly reduces noise and reverberations by excluding sounds from all but the direction of origin of the desired source. Automatically aiming of a close-up television camera of the type used in video teleconferencing is also possible.
- FIG. 1 is a functional block representation of an acoustic direction identification system operative in accordance with the principles of the present invention?
- FIG. 2 shows a schematic diagram of a microphone preamplifier section and a bandpass filter section suitable for use in this invention
- FIG. 3 is a schematic diagram of an envelope generator employed in this invention.
- FIG. 4 is a schematic diagram of event detectors and dual monostable multivibrators employed in this invention.
- FIG. 5 is a schematic diagram of a level indication circuit employed in this invention.
- FIG. 6 shows a microcomputer and associated memory and timing circuitry suitable for use in this invention
- FIG. 7 shows a schematic diagram of a position display suitable for use in this invention.
- FIG. 8 illustrates the spatial arrangements of FIGS. 3 through 8;
- FIG. 9 illustrates in flowchart form a process in accordance with the principles of this invention, such process may be embodied in the structure illustrated in FIG. 1?
- FIG. 10 shows waveforms which illustrate the operation of the circuitry of FIGS. 2 and 3;
- FIG. 11 shows waveforms which illustrate the operation of the circuitry of FIG. 4.
- FIG. 12 shows waveforms which illustrate the operation of the microcomputer circuitry of FIG. 6 when employing the flowchart of FIG. 9.
- FIG. 1 is a functional block representation of an acoustic direction identification system operative in accordance with the principles of the invention.
- the identification system comprises microphones 101 and 102 that are respectively connected to amplifiers 200 and 210. These microphones are located a reasonable distance apart, typically 2-1/2 feet, to aid in the identification and verification of the direction of sound sources.
- This system is divided into two channels with microphone 101 providing the input to channel 1 and microphone 102 providing the input to channel 2.
- preamplifiers 200 and 210 are employed to respectively increase the signal levels from microphones 101 and 102 to a reasonable level.
- preamplifiers 200 and 210 are respectively provided to associated bandpass filters 250 and 260 for removing the low-frequency components of speech which are often out of phase with the higher frequency components, and to reduce the width of the peaks for later ease of detection. These filters also eliminate high- frequency noise which can produce unwanted spurious events.
- Amplifier 310 provides some additional filtering and impedance buffering for the signal in channel 1 as it couples the signal from bandpass filter 250 to a Stefan all-pass network 330.
- amplifier 320 processes the signal in channel 2 as it couples the signal from the bandpass filter 260 to a Stefan all-pass network 340.
- the bandpassed speech in the two channels is separately Hubert transformed by the Stefan all-pass networks 330 and 340 to produce two signals with the same amplitude but phased 90 degrees apart from each other. These signals are next separately squared by associated squarer circuits 350, 355, 360 and 365. The signals for channel 1 are then summed in summer 370 and those for channel 2 summed in summer 375.
- the phase splitting, squaring and summing of the bandpassed speech provide a waveform which has a very sharp rise in time at the actual
- the outputs of the summers 370 and 375 are jointly coupled to a level indication circuit 500.
- This circuit operates as a six-level detector providing six levels of sensitivity for both channels 1 and 2.
- the summers 370 and 375 are also coupled to event detectors 401 and 402, respectively. These event detectors transform the pitch peaks in the speech envelope into energy burst coincident pulses. In order to avoid nonpitched spurious events being detected by the system, and also in order to increase the insensitivity to nonspeech sounds, the outputs of the event detectors 401 and 402 are respectively coupled to dual monostable multivibrators 450 and 460. These multivibrators each provide a digital pulse train of energy burst pulses in which the time delay between corresponding pitch peaks impinging upon the two microphones gives the sought after time delay between microphones.
- Microcomputer 610 processes in real time the two digital pulse trains from the dual monostable multivibrators 450 and 460. Through use of histograms, which are continually updated memories reflecting the time delay occurring for each correlated event, the identification and verification of the direction of sound sources is available to a high degree of accuracy in real time. Under the control of timing circuitry 630 the microcomputer 610 uses random access memory circuitry 620 to store initial data reflecting the direction of origin of speech sound. As the speech sound continues to occur from the same source, all in a very short time period, the microcomputer 610 accumulates this subsequent data and combines it with the earlier data in building a time interval histogram. As the value of the stored data exceeds a predetermined threshold for identification, good
- JJRE i identification is assumed to be made by the microcomputer.
- a signal output corresponding to the speaker's direction is then provided to an output " connector 720 for connecting to other systems for transmission to remote locations or other uses as desired.
- an output " connector 720 for connecting to other systems for transmission to remote locations or other uses as desired.
- a position display 730 for reflecting the angular location from the microphones to a person speaking in a room is provided.
- FIG. 2 there is shown a microphone preamplifier section 220 and a bandpass filter section 270 both suitable for use in the arrangement of
- FIG. 1 as preamplifiers 200 and 210 and bandpass filters 250 and 260, respectively. Reference to the waveforms shown in FIG. 10 is also recommended for ease in understanding the operation of these sections. Operation of the acoustic direction identification system relies upon the presence of periodic.peaks in the input speech signal as are shown in waveform 1001 of FIG. 10. The speech signal containing these peaks is provided via input lines 103 and 104 to lines 105 and 106 for transmission to remote locations as desired, and to a transformer 221.
- the transformer 221 couples the audio signal to a low noise operational amplifier circuit consisting of amplifier 222, resistors 223 through 226 and capacitors 227 through 229.
- the output of the microphone preamplifier section 220 is coupled to the input of bandpass filter section 270 which may be conveniently obtained in integrated circuit form with resistors 271 through 276 having values set to give 6 dB fall-off points at 1 kHz and 8 kHz.
- This filter section removes the low-frequency components of speech which are often out of phase with the higher frequency components, and reduces the width of the signal peaks aiding in their detection.
- the bandpass filter also eliminates high-frequency noise and thereby avoids producing unwanted spurious events.
- Waveform 1005 in FIG. 10 shows the bandpassed speech signal output present on line 108 of FIG. 2.
- FIG. 3 Shown in FIG. 3 is an envelope generator which provides very sharp peaks for accurately marking the occurrence of the pitch peaks in speech.
- This envelope generator comprises amplifiers 310 and 320, Stefan all-pass networks 330 and 340, squarer circuits 350, 355, 360 and 365, and two summer circuits 370 and 375.
- the generator uses as input a pair of bandpassed speech signals such as that provided by the preamplifier section 220 and bandpass filter section 270 of FIG. 2. These input signals are provided over input lines 110 and 111 as channel 1 and channel 2, respectively, with both having a common ground reference.
- the envelope * detector circuitry of channel 1 and channel 2 are identical with channel 1 being described in detail herein. For an understanding of the operation of the circuitry of channel 2, reference to the same named or similar configurated component of channel 1 is recommended.
- the input signal on channel 1 is coupled to the amplifier 310 via a variable resistor 301 which is used for adjusting the level of the input speech signal.
- Amplifier 310 comprises operational amplifier 311, which is used in a follower configuration to provide a high output impedance, and also operational amplifier 312, which provides additional filtering to the speech signal. Also included in amplifier 310 are capacitor 313 and resistors 314 and 315 which are associated with operational amplifier 311, and capacitor 316 which is associated with operational amplifier 312.
- the output of amplifier 310 is coupled over line 112 to the Stefan all-pass network 330 where it is first Hubert transformed to produce two signals with the same amplitude but phased 90 degrees apart over the bandpassed frequency range of 1 kHz to 8 kHz.
- One of these signals is
- OMPI considered a zero-degree phase shifted signal and is provided over line 114 to squarer circuit 350.
- the other is considered a 90-degree phase shifted signal and is provided over line 116 to squarer circuit 355.
- Each of these signals are squared in the squarer circuits 350 and 355 which comprise four quadrant analog multipliers that are commercially available from Motorola as part No. MC1494.
- the squared signals are then summed in the summer circuit 370 creating the envelope shown in waveform 1010 of FIG. 10 which has a very sharp rise in time at the actual locations of the pitch peaks of speech.
- FIG. 4 shows an event detector for transforming the pitch peaks in the speech envelope into energy burst coincident pulses.
- the event detector comprises analog switches 410 and 420 and comparators 430 and 440.
- the speech envelope signal generated by the envelope detector of FIG. 3 is coupled to the event detector over lines 118 through 121.
- the speech envelope signals for channel 1 are on lines 118 and 120 and those for channel 2 are on lines 119 and 121.
- Identical event detecting circuitry is used for channels 1 and 2, with only the operation of the circuitry in channel 1 being described herein in detail. Reference to the waveforms depicted in FIG. 10 and FIG. 11 is also recommended.
- the speech envelope signal having the waveform 1010 as shown in FIG. 10 is applied to the analog switch 410 and the comparator 430. These signals are identical in envelope representation.
- the signal line 118 has any positive dc offset voltage nulled by the negative dc voltage applied through resistor 380 shown in FIG. 3.
- the comparator 430 turns on and closes the analog switch 410 allowing a capacitor 411 to charge to the potential of the speech envelope level.
- the capacitor 411 in combination with resistor 412 provides an RC time constant that discharges to ground when the potential is removed. This combination produces a decaying envelope which will charge to the speech envelope level when the speech envelope level rises above the decaying envelope level and will decay exponentially when the speech envelope signal falls below the decaying envelope.
- the speech envelope signal, waveform 1010 of FIG. 10 is shown again as waveform 1101 of FIG. 11 along with the superimposed decaying envelope signal present on line 122 of FIG. 4 and labeled as 1102 in FIG. 11.
- the event detecting circuitry decides that a probable event has occurred, an event being a detectable audio signal received at the microphones such that it arrives at one of the microphones at a given time before it arrives at the other.
- Digital pulses as shown in waveform 1105 of FIG. 11 are produced in synchronism with such events.
- the output from the comparator 430 is therefore a digital pulse train which is synchronized to the rising edge of the pitch peaks in the speech envelope signal.
- a noise calibration circuit for each channel is also included in the event detecting circuitry of FIG. 4.
- This circuit is provided for setting the sensitivity of the identification system circuitry so that the system is insensitive to ambient room noise. This is achieved by having all participants in the room remain silent for a moment while the noise threshold potentiometers 380 and 381 are adjusted such that no events occur in the system from local air conditioning or any other ambient noise present. Events are viewed using the lighting of light- emitting diodes 471 and 472.
- the output of comparator 430 is provided to a dual monostable multivibrator 450 capable of being retriggered while activated from a previous triggering signal.
- the first multivibrator eliminates any pulses not preceded by a silent period of at least 3 milliseconds without pulses. How this is achieved becomes apparent from an examination of the waveforms in FIG. 11.
- the pulses in waveform 1110 are those found on line 124 and can only occur a minimum of 3 milliseconds apart. Thus the two spurious event pulses depicted in waveform 1105 and labeled 1106 are not reproduced by the first multivibrator as is seen in waveform 1110.
- the second multivibrator creates the final output pulse that has a uniform width of 100 microseconds. This provides a uniform pulse width for all the information coupled to a microcomputer 610 to be later described.
- Waveform 1115 shows pulses being generated on line 125 by the pitch peaks detected in channel 2 and how they are delayed, in this example, with respect to the pulses in channel 1.
- the output of channel 1 of the envelope detector of FIG. 3 is connected to the level indication circuit 500 over line 120 and the output of channel 2 is connected over line 121.
- the level indication circuit operates as a six- level detector providing six levels of sensitivity for both channels 1 and 2. It comprises 12 comparators; comparators 511 through 516, are used in channel 1 and
- OMPI comparators 530 through 536 are used in channel 2.
- through Vg is assigned a comparator both in channel 1 and in channel 2 and connected to one of the assigned comparators' two inputs. These voltages are assigned increasing values with V-
- These same reference voltages are also provided to the opposite side of one of multiple resistors 517 through 522 and 537 through 542 which, in turn, are each connected to the output of an associated comparator. And the signal level on line 120 or 121 comprises the other input to the comparators.
- the output of the comparing comparator is high and the associated one of multiple light-emitting diodes 523 through 528 and 543 through 548 is turned on. As the signal level exceeds the compared reference level, the output level of that comparator goes to a low level turning off the associated light-emitting diode.
- the series of digital pulses from the dual monostable multivibrators 450 and 460 are respectively coupled over lines 124 and 125 to a microcomputer 610 for processing.
- a microcomputer suitable for the application described herein is available from INTEL Corporation as Part No. 8748 and can be used with the proper programming.
- timing circuitry 630 which comprises a first clock 631 and a second clock 636.
- the first clock with its associated components, resistors 632 and 633 and capacitor 634, provides a 100 kHz reference frequency used by the microcomputer in obtaining the delay between events, that is, the time between the occurrence of an event in channel 1 and an event in channel 2 , or vice versa.
- the clock rate at 100 kHz for example allows for 256 pulses in the time T ma ⁇ w hich is 2.56 milliseconds or the time required for sound to travel between the two microphones when they are spaced 2-1/2 feet apart and set to measure a range of angles between zero and 180 degrees.
- the computer 610 is easily programmed to reject events with time delays greater than T_ -ilid_x_.. p 0 r those reported events having delays less than ⁇ he events are considered correlated by the microcomputer 610 and the three least significant bits of the eight bit count are shifted out so as to give a total of 32 possible time divisions.
- the correct histogram element is found by subtracting the delay from 32 if channel 1 has the first event, or adding it to 32 if channel 2 was first.
- the second clock 636 with resistors 637 and 638 and capacitor 639 is externally adjustable from 2 to 20 Hertz and is used to govern the frequency of reading and reporting out the contents of the histograms. This clock provides a 1-millisecond pulse to the microcomputer interrupt line whenever it is time to report out the results of a given histogram as is later described in greater detail herein.
- the microcomputer 610 calculates a digital signal which indicates the direction from which the incoming speech originated. And it is known that the angle of origin of the speech is proportional to the arc cosine of the time delay.
- look-up tables with the range of angles desired are programmed into an electrical programmable read only memory section of the microcomputer allowing for the arc cosine of the corresponding time delays to be obtained.
- a second frequently used look-up table embodied in this invention has possible arc cosine values from 45 to 135 degrees for the locating of a sound source originating within this range of angles. And by proper programming, any sound source originating outside of a desired range such as this second range of angles will be ignored by the system. This has the particular advantage of identifying only those people talking from locations prearranged to be valid within a room.
- a local position display such as is available with light-emitting dioctes is provided and shown in FIG. 7. This position display circuitry is connected to the microcomputer 610 via data bus 130.
- the five most significant bits from the microcomputer are provided to a buffer and inverter circuit 710 and to an output connector 720 for providing an output signal for the various applications described herein.
- the output of the buffer and inverter circuit is provided to a demultiplexer circuit 730 which takes the five bits of binary data and decodes it into 32 separate outputs. These 32 outputs each drive light-emitting diodes that are activated to reflect the angular location of a speaker in a room.
- comparator 740 When used in a teleconferencing arrangement, it is desirable to disable the system when a voice signal from a remote location is being received. This is accomplished by comparator 740 along with its associated components, resistors 741 through 743, which compare the switch guard voltage in a teleconferencing set with a fixed voltage threshold provided by the resistor divider network comprising resistors 741 and 742. The output of comparator 740 provides this signal to the microcomputer 610 over line 131 and has the effect of causing the microcomputer to ignore any events found and thus cannot identify the loudspeaker.
- FIG. 9 is a flowchart illustrating the operation of the acoustic direction identification system.
- the functions provided by microcomputer 610 are advantageously determined by a process or program stored in the processor portion of the microcomputer 610.
- the units in an element in a histogram is found to exceed a previously stored accept/reject threshold for identification, then identification of that element is assigned as the speaker's position, and the processor outputs the time delay corresponding to the speaker's position.
- the histogram is cleared and a pedestal unit to be later described is left in the selected element corresponding to the speaker's position.
- the acoustic direction identification system is shown in FIG. 10 utilizing four 63-element histograms 1201
- ___OM WIP through 1204 which are read cyclicly.
- Four histograms allow quick identification, in the ⁇ . , from one report to the next when the density of events is high, while still providing identification in times as long as 4T rt if the density of events is low as usually is the case with low level talkers. It will become obvious to those skilled in the art, however, that any number of histograms other than four can be utilized in practicing this invention.
- the number of elements in a histogram can also be other than 63. Hence, it is not intended nor should the invention be construed as being limited to any particular number of histograms with a fixed number of elements contained therein.
- the time delay range spanned by the 63 elements is from -tma consultx to +tmax which also for illustration purposes are shown in the present system to correspond to angles of zero through 180 degrees.
- the processor increments each of the four histograms by placing a unit level therein. In that the process of incrementing all four histograms takes approximately 200 microseconds, all of the correlated events occurring are detected. With each correlated event found, all four histograms are incremented in the appropriate element which is illustrated on the horizontal axis numbering 1 through 63 in the waveforms 1201 through 1204 in FIG. 12 and corresponds to the time delay measured. In the reading of a histogram, all of the elements are examined and the one that has the most correlated events stored therein reflects the time delay between the two microphones or the angle from which the speech is coming. In order to ensure that what is being detected is speech and not a correlated event from the air conditioner, a presettable accept/reject threshold 1205 is provided for comparing the level of the incremented
- OMPI elements in the histograms By this comparison, a determination is made as to whether the information present is sufficient to consider it as being derived from speech sounds.
- This accept/reject threshold in combination with the 3 millisecond filtering provided by the dual monostable multivibrators 450 and 460 provides a system that is essentially unresponsive to nonspeech sounds.
- each histogram is read sequentially at a much slower rate than they are incremented.
- the first one of the four histograms is read.
- the element having the largest number of units in this histogram is determined.
- an identification is made as to that being a valid location for a person speaking as is the case for pedestal 1206.
- the entire histogram is then cleared by zeroing out all the elements and a pedestal such as 1207 or 1208 inserted in the location where the identification was made.
- the same pedestal is also added to the three other histograms. The purpose of this pedestal is to give an advantage to the same talker and aid in reidentifying that talker if he or she continues to speak from the same or a different location.
- the system collects data and increments the proper element in all four histograms every time a correlated event occurs.
- T the second histogram is examined. The same process is followed in this histogram as in the first. It is examined, the element with the greatest number of units compared with the threshold, the histogram cleared and a pedestal added if a valid identification is made. The process continues for the next 1/10th of a second collecting data and incrementing all four histograms for each valid correlated event found.
- T is
- OMPI 2/10ths of a second the third histogram is examined, at time T equals 3/10ths of a second the fourth histogram is examined, and at time T equals 4/10ths of a second the cycle repeats beginning with the examination of the first histogram.
- the pedestal unit left in the histograms after a successful identification contains a unit value in the selected element and one-half of that unit value in each adjacent element.
- a video cursor for use with a remote blackboard is possible.
- the cursor In response to a control signal from the acoustic direction identification system, the cursor would be able to identify participants at a first location for a second location by having the cursor on the blackboard at the second location move to a prearranged position on the blackboard whenever a person speaks from a particular position at the first location.
- acoustic direction identification system with a slow scan television is also possible.
- a remote video cursor is aligned with a particular camera and lens and whoever talks from a given position in the room will cause the cursor to appear above that position on the
- Another possible application would be in an audio switching arrangement for improving the audio in teleconferences.
- Methods of directing the audio from remote locations into two or more loudspeakers are possible to give the illusion of spatial position to remote talkers.
- the acoustic direction identification system allows for this without additional audio channels.
- acoustic direction identification system wherein the combination of two such systems are usable to determine both the azimuth angle and distance to a sound source or, alternatively, the azimuth angle and elevation of the sound source.
- one of the present systems for switching cameras in the PICTUREPHONE® Meeting Service conferencing system relies on voice switching from individual lavalier microphones hung around the necks of the conferees.
- the acoustic direction identification system would eliminate the need for individual microphones, and truly allow "hands free telephony" for PICTUREPHONE Meeting Service.
Abstract
A system insensitive to nonspeech sounds utilizes a pair or spatially separated microphones (101, 102) to obtain the direction of origin of speech signals from a common sound source. The speech signal from each microphone is transformed (330, 340, 350, 355, 360, 365, 370, 375) into a pulse representative signal having a rapid increase responsive to pitch peaks of energy from the sound source. The cross correlation of these pulses accurately reflects the phase relationship between the speech signals arriving at the microphones. The cross correlation is implemented (450, 460) as time interval histograms which are periodically read to identify the direction of the common sound source.
Description
ACOUSTIC DIRECTION IDENTIFICATION SYSTEM
Background of the Invention
1. Technical Field This invention relates to acoustic signal processing and more particularly to signal discriminating arrangements for identification and verification of the direction of sound sources.
2. Description of the Prior Art In telephone and other audio communication systems, sound applied to an electroacoustic transducer from a single source may traverse a plurality of diverse paths between the source and the transducer. In addition to the direct-path signal, other signals caused by delay reflections from surrounding surfaces, as well as extraneous sounds, reach the transducer. The combination of direct, reflected and-extraneous signals degrade the quality of the communication system. These effects are particularly noticeable in environments such as classrooms, conference rooms or auditoriums. To maintain good quality, it is a common practice to use transducers such as standard microphones in close proximity to the sound source or to use directional microphones. These practices enhance the direct-path acoustic signal with respect to noise and reverberation signals.
There are many systems, however, in which the direction of the sound source is variable or unpredictable. In conferencing arrangements, for example, a plurality of speakers in a room are served by a speakerphone set. The direction of sound is variable and the room reflections are generally not controlled. Consequently, adverse effects are distinctly noticeable and some electronic arrangement must be used to reduce noise and reverberation without changing room conditions. One type of system in the known art for reducing multipath reverberative interference utilizes two or more spatially separated microphones, each receiving different
versions of the same sound. The microphone outputs are directly combined so that reverberative effects are minimized. In another arrangement, the signals from a plurality of spatially separated microphones are processed to select the signal having the least reverberative interference. These arrangements, however, require that one microphone be substantially closer to the sound source than the other microphones of the system. Other techniques use spectral analysis to select spectral portions of each of a plurality of microphone signals. The selected spectral portions are combined to produce a composite signal with reduced reverberation. The spectral techniques, however, employ relatively complex apparatus to partially reduce the echo effects. A more direct solution to the reverberative interference problems is disclosed in United States Patent No. 4,131,760, issued tς S. W. Christensen et al. on December 26, 1978 and is assigned to the same assignee, in accordance with this patent, sound from a source is received by a pair of spatially separated microphones to obtain speech signals. Each one of the speech signals is transformed into an envelope representative signal having rapid increases responsive to direct-path and echo energy bursts from the sound source and exponential decaying portions between energy bursts. A first pulse corresponding to a sound source direct-path energy burst is generated responsive to the first speech signal exceeding its envelope representative signal, and further first pulses corresponding to echo bursts are inhibited for a predetermined time. A second pulse corresponding to the sound source direct-path energy burst is generated responsive to the second speech signal exceeding its envelope representative signal, and further second pulses corresponding to echo bursts are inhibited for a predetermined time. The first and second speech signals are aligned in phase responsive to the time difference between said first and second pulses.
The foregoing solutions to the noise and dereverberation problems are satisfactory as long as the individual sound sources are well separated. Where it is necessary to conference a large number of individuals, for example, the audience in an auditorium, the foregoing methods do allow noise and reverberation to affect the sound source somewhat since these techniques are not arranged to exclude sounds from all but the direction of origin of a desired source. It is thus desirable to provid an arrangement with improved audio signal discrimination in identification and verification of the direction of a desired sound source in a noisy reverberant environment. Summary of the Invention
The invention is directed to an acoustic signal processing system which utilizes a pair of spatially separated microphones to obtain the direction of origin of speech signals from a common sound source. The speech signal from each microphone is transformed into a pulse representative signal having a rapid increase responsive to pitch peaks or energy bursts from the sound source. The corresponding pulses of the two speech signals are phase related and transformed into a signal that is insensitive to nonspeech sounds and is used in determining the direction to the common sound source. Operation of the invention is such to give strong preference to direct-path early arriving energy bursts over later arriving reflections thereby providing audio signal discrimination, and to produce a stream of pulses whose cross-correlation is employed in building time interval histograms which are periodically read to identify the direction to a person speaking. This system thus allows for operations such as mechanical or electrical aiming in real time of directional microphones and thereby significantly reduces noise and reverberations by excluding sounds from all but the direction of origin of the desired source. Automatically aiming of a close-up television camera of the type used in video teleconferencing is also possible.
OMPI
Brief Description of the Drawing
The invention and its mode of operation will be more clearly understood from the following detailed description when read with the appended drawing in which: FIG. 1 is a functional block representation of an acoustic direction identification system operative in accordance with the principles of the present invention?
FIG. 2 shows a schematic diagram of a microphone preamplifier section and a bandpass filter section suitable for use in this invention;
FIG. 3 is a schematic diagram of an envelope generator employed in this invention;
FIG. 4 is a schematic diagram of event detectors and dual monostable multivibrators employed in this invention;
FIG. 5 is a schematic diagram of a level indication circuit employed in this invention;
FIG. 6 shows a microcomputer and associated memory and timing circuitry suitable for use in this invention;
FIG. 7 shows a schematic diagram of a position display suitable for use in this invention;
FIG. 8 illustrates the spatial arrangements of FIGS. 3 through 8; FIG. 9 illustrates in flowchart form a process in accordance with the principles of this invention, such process may be embodied in the structure illustrated in FIG. 1?
FIG. 10 shows waveforms which illustrate the operation of the circuitry of FIGS. 2 and 3;
FIG. 11 shows waveforms which illustrate the operation of the circuitry of FIG. 4; and
FIG. 12 shows waveforms which illustrate the operation of the microcomputer circuitry of FIG. 6 when employing the flowchart of FIG. 9.
, __OMPI ^ WIPO
Detailed Description
FIG. 1 is a functional block representation of an acoustic direction identification system operative in accordance with the principles of the invention. As shown, the identification system comprises microphones 101 and 102 that are respectively connected to amplifiers 200 and 210. These microphones are located a reasonable distance apart, typically 2-1/2 feet, to aid in the identification and verification of the direction of sound sources. This system is divided into two channels with microphone 101 providing the input to channel 1 and microphone 102 providing the input to channel 2. And preamplifiers 200 and 210 are employed to respectively increase the signal levels from microphones 101 and 102 to a reasonable level. The output of preamplifiers 200 and 210 is respectively provided to associated bandpass filters 250 and 260 for removing the low-frequency components of speech which are often out of phase with the higher frequency components, and to reduce the width of the peaks for later ease of detection. These filters also eliminate high- frequency noise which can produce unwanted spurious events.
Amplifier 310 provides some additional filtering and impedance buffering for the signal in channel 1 as it couples the signal from bandpass filter 250 to a Stefan all-pass network 330. Similarly, amplifier 320 processes the signal in channel 2 as it couples the signal from the bandpass filter 260 to a Stefan all-pass network 340.
The bandpassed speech in the two channels is separately Hubert transformed by the Stefan all-pass networks 330 and 340 to produce two signals with the same amplitude but phased 90 degrees apart from each other. These signals are next separately squared by associated squarer circuits 350, 355, 360 and 365. The signals for channel 1 are then summed in summer 370 and those for channel 2 summed in summer 375. The phase splitting, squaring and summing of the bandpassed speech provide a waveform which has a very sharp rise in time at the actual
"STTREX;
OMPI
location of the pitch peaks of speech and thereby facilitate in accurately detecting the delay in the time it takes sound impinging first upon one microphone to reach the other. The outputs of the summers 370 and 375 are jointly coupled to a level indication circuit 500. This circuit operates as a six-level detector providing six levels of sensitivity for both channels 1 and 2.
The summers 370 and 375 are also coupled to event detectors 401 and 402, respectively. These event detectors transform the pitch peaks in the speech envelope into energy burst coincident pulses. In order to avoid nonpitched spurious events being detected by the system, and also in order to increase the insensitivity to nonspeech sounds, the outputs of the event detectors 401 and 402 are respectively coupled to dual monostable multivibrators 450 and 460. These multivibrators each provide a digital pulse train of energy burst pulses in which the time delay between corresponding pitch peaks impinging upon the two microphones gives the sought after time delay between microphones.
Microcomputer 610 processes in real time the two digital pulse trains from the dual monostable multivibrators 450 and 460. Through use of histograms, which are continually updated memories reflecting the time delay occurring for each correlated event, the identification and verification of the direction of sound sources is available to a high degree of accuracy in real time. Under the control of timing circuitry 630 the microcomputer 610 uses random access memory circuitry 620 to store initial data reflecting the direction of origin of speech sound. As the speech sound continues to occur from the same source, all in a very short time period, the microcomputer 610 accumulates this subsequent data and combines it with the earlier data in building a time interval histogram. As the value of the stored data exceeds a predetermined threshold for identification, good
JJRE i
identification is assumed to be made by the microcomputer.
A signal output corresponding to the speaker's direction is then provided to an output "connector 720 for connecting to other systems for transmission to remote locations or other uses as desired. To aid in setup and verifying proper operation, a position display 730 for reflecting the angular location from the microphones to a person speaking in a room is provided.
Referring now to FIG. 2, there is shown a microphone preamplifier section 220 and a bandpass filter section 270 both suitable for use in the arrangement of
FIG. 1 as preamplifiers 200 and 210 and bandpass filters 250 and 260, respectively. Reference to the waveforms shown in FIG. 10 is also recommended for ease in understanding the operation of these sections. Operation of the acoustic direction identification system relies upon the presence of periodic.peaks in the input speech signal as are shown in waveform 1001 of FIG. 10. The speech signal containing these peaks is provided via input lines 103 and 104 to lines 105 and 106 for transmission to remote locations as desired, and to a transformer 221.
Although the system operates satisfactorily with a pair of standard microphones, operation is enhanced with a linear array microphone of the type disclosed in United States Patent No. 4,311,874, issued to R. L. Wallace on
January 19, 1982. The transformer 221 couples the audio signal to a low noise operational amplifier circuit consisting of amplifier 222, resistors 223 through 226 and capacitors 227 through 229. The output of the microphone preamplifier section 220 is coupled to the input of bandpass filter section 270 which may be conveniently obtained in integrated circuit form with resistors 271 through 276 having values set to give 6 dB fall-off points at 1 kHz and 8 kHz. This filter section removes the low-frequency components of speech which are often out of phase with the higher frequency components, and reduces the width of the
signal peaks aiding in their detection. The bandpass filter also eliminates high-frequency noise and thereby avoids producing unwanted spurious events. Waveform 1005 in FIG. 10 shows the bandpassed speech signal output present on line 108 of FIG. 2.
Shown in FIG. 3 is an envelope generator which provides very sharp peaks for accurately marking the occurrence of the pitch peaks in speech. This envelope generator comprises amplifiers 310 and 320, Stefan all-pass networks 330 and 340, squarer circuits 350, 355, 360 and 365, and two summer circuits 370 and 375. The generator uses as input a pair of bandpassed speech signals such as that provided by the preamplifier section 220 and bandpass filter section 270 of FIG. 2. These input signals are provided over input lines 110 and 111 as channel 1 and channel 2, respectively, with both having a common ground reference. The envelope*detector circuitry of channel 1 and channel 2 are identical with channel 1 being described in detail herein. For an understanding of the operation of the circuitry of channel 2, reference to the same named or similar configurated component of channel 1 is recommended.
The input signal on channel 1 is coupled to the amplifier 310 via a variable resistor 301 which is used for adjusting the level of the input speech signal. Amplifier 310 comprises operational amplifier 311, which is used in a follower configuration to provide a high output impedance, and also operational amplifier 312, which provides additional filtering to the speech signal. Also included in amplifier 310 are capacitor 313 and resistors 314 and 315 which are associated with operational amplifier 311, and capacitor 316 which is associated with operational amplifier 312.
The output of amplifier 310 is coupled over line 112 to the Stefan all-pass network 330 where it is first Hubert transformed to produce two signals with the same amplitude but phased 90 degrees apart over the bandpassed frequency range of 1 kHz to 8 kHz. One of these signals is
OMPI
considered a zero-degree phase shifted signal and is provided over line 114 to squarer circuit 350. The other is considered a 90-degree phase shifted signal and is provided over line 116 to squarer circuit 355. Each of these signals are squared in the squarer circuits 350 and 355 which comprise four quadrant analog multipliers that are commercially available from Motorola as part No. MC1494. The squared signals are then summed in the summer circuit 370 creating the envelope shown in waveform 1010 of FIG. 10 which has a very sharp rise in time at the actual locations of the pitch peaks of speech.
Some positive dc voltage offset will usually occur on the speech envelope. For example, a pure sinusoid input sin w t, will produce sin w t and cos w t as the zero-degree and 90-degree phase shifted signals. And squaring and summing these produces a dc voltage. To counteract this voltage, a negative dc voltage is also added to output line 118 through adjustable resistor 380. FIG. 4 shows an event detector for transforming the pitch peaks in the speech envelope into energy burst coincident pulses. The event detector comprises analog switches 410 and 420 and comparators 430 and 440. The speech envelope signal generated by the envelope detector of FIG. 3 is coupled to the event detector over lines 118 through 121. The speech envelope signals for channel 1 are on lines 118 and 120 and those for channel 2 are on lines 119 and 121. Identical event detecting circuitry is used for channels 1 and 2, with only the operation of the circuitry in channel 1 being described herein in detail. Reference to the waveforms depicted in FIG. 10 and FIG. 11 is also recommended.
The speech envelope signal having the waveform 1010 as shown in FIG. 10 is applied to the analog switch 410 and the comparator 430. These signals are identical in envelope representation. The signal line 118, however, has any positive dc offset voltage nulled by the negative dc voltage applied through resistor 380 shown in FIG. 3.
By way of operation, when a pitch peak occurs in the envelope signal, the comparator 430 turns on and closes the analog switch 410 allowing a capacitor 411 to charge to the potential of the speech envelope level. The capacitor 411 in combination with resistor 412 provides an RC time constant that discharges to ground when the potential is removed. This combination produces a decaying envelope which will charge to the speech envelope level when the speech envelope level rises above the decaying envelope level and will decay exponentially when the speech envelope signal falls below the decaying envelope.
The speech envelope signal, waveform 1010 of FIG. 10 is shown again as waveform 1101 of FIG. 11 along with the superimposed decaying envelope signal present on line 122 of FIG. 4 and labeled as 1102 in FIG. 11. Each time the decaying envelope switches from its exponential decay to its rise, the event detecting circuitry decides that a probable event has occurred, an event being a detectable audio signal received at the microphones such that it arrives at one of the microphones at a given time before it arrives at the other. Digital pulses as shown in waveform 1105 of FIG. 11 are produced in synchronism with such events. The output from the comparator 430 is therefore a digital pulse train which is synchronized to the rising edge of the pitch peaks in the speech envelope signal.
A noise calibration circuit for each channel is also included in the event detecting circuitry of FIG. 4. This circuit is provided for setting the sensitivity of the identification system circuitry so that the system is insensitive to ambient room noise. This is achieved by having all participants in the room remain silent for a moment while the noise threshold potentiometers 380 and 381 are adjusted such that no events occur in the system from local air conditioning or any other ambient noise present. Events are viewed using the lighting of light-
emitting diodes 471 and 472.
To obtain an insensitivity to other than speech sounds, the output of comparator 430 is provided to a dual monostable multivibrator 450 capable of being retriggered while activated from a previous triggering signal. In that normal pitches of the human voice, both male and female, fall between 3 and 10 milliseconds, any pulse spacing shorter than 3 milliseconds is probably from a spurious noise source and not from speech sounds. To avoid these spurious or nonpitch events, the first multivibrator eliminates any pulses not preceded by a silent period of at least 3 milliseconds without pulses. How this is achieved becomes apparent from an examination of the waveforms in FIG. 11. The pulses in waveform 1110 are those found on line 124 and can only occur a minimum of 3 milliseconds apart. Thus the two spurious event pulses depicted in waveform 1105 and labeled 1106 are not reproduced by the first multivibrator as is seen in waveform 1110.
The second multivibrator creates the final output pulse that has a uniform width of 100 microseconds. This provides a uniform pulse width for all the information coupled to a microcomputer 610 to be later described. Waveform 1115 shows pulses being generated on line 125 by the pitch peaks detected in channel 2 and how they are delayed, in this example, with respect to the pulses in channel 1. At this point in the circuitry of the acoustic direction identification system, there are two digital pulse trains of events in which the time delay between corresponding events in the two channels gives the sought after time delay between microphones.
The output of channel 1 of the envelope detector of FIG. 3 is connected to the level indication circuit 500 over line 120 and the output of channel 2 is connected over line 121. The level indication circuit operates as a six- level detector providing six levels of sensitivity for both channels 1 and 2. It comprises 12 comparators; comparators 511 through 516, are used in channel 1 and
OMPI
comparators 530 through 536 are used in channel 2. One of six possible reference voltages V-| through Vg is assigned a comparator both in channel 1 and in channel 2 and connected to one of the assigned comparators' two inputs. These voltages are assigned increasing values with V-| being the lowest and Vg being the highest. These same reference voltages are also provided to the opposite side of one of multiple resistors 517 through 522 and 537 through 542 which, in turn, are each connected to the output of an associated comparator. And the signal level on line 120 or 121 comprises the other input to the comparators. As long as the signal level is less than the particular reference voltage level being compared to, the output of the comparing comparator is high and the associated one of multiple light-emitting diodes 523 through 528 and 543 through 548 is turned on. As the signal level exceeds the compared reference level, the output level of that comparator goes to a low level turning off the associated light-emitting diode. As seen in FIG. 6, the series of digital pulses from the dual monostable multivibrators 450 and 460 are respectively coupled over lines 124 and 125 to a microcomputer 610 for processing. Such a microcomputer suitable for the application described herein is available from INTEL Corporation as Part No. 8748 and can be used with the proper programming. Also included in the design for operation of the microcomputer 610 is an external memory section 620 which has 256 bytes of memory for storing four histograms, each having 63 elements for the system. Providing the necessary timing for the microcomputer 610 is timing circuitry 630 which comprises a first clock 631 and a second clock 636. The first clock with its associated components, resistors 632 and 633 and capacitor 634, provides a 100 kHz reference frequency used by the microcomputer in obtaining the delay between events, that is, the time between the occurrence of an event in channel 1 and an event in channel 2 , or vice versa.
_ O PI
Setting the clock rate at 100 kHz, for example allows for 256 pulses in the time Tmaχ which is 2.56 milliseconds or the time required for sound to travel between the two microphones when they are spaced 2-1/2 feet apart and set to measure a range of angles between zero and 180 degrees. The computer 610 is easily programmed to reject events with time delays greater than T_ -ilid_x_.. p0r those reported events having delays less than ^he events are considered correlated by the microcomputer 610 and the three least significant bits of the eight bit count are shifted out so as to give a total of 32 possible time divisions. The correct histogram element is found by subtracting the delay from 32 if channel 1 has the first event, or adding it to 32 if channel 2 was first. The second clock 636 with resistors 637 and 638 and capacitor 639 is externally adjustable from 2 to 20 Hertz and is used to govern the frequency of reading and reporting out the contents of the histograms. This clock provides a 1-millisecond pulse to the microcomputer interrupt line whenever it is time to report out the results of a given histogram as is later described in greater detail herein.
For setting the common histogram accept/reject threshold, four single-pole double-throw switches 611 through 614 corresponding to binary levels of 16, 8, 4 and 2 are used. The adjustment of these switches is made in conjunction with the report frequency adjustment as the quantity of importance is the number of correlated events per reporting interval. From the information provided, the microcomputer 610 calculates a digital signal which indicates the direction from which the incoming speech originated. And it is known that the angle of origin of the speech is proportional to the arc cosine of the time delay. Thus, in order to report out the direction in equal angular increments, look-up tables with the range of angles desired are programmed into an electrical
programmable read only memory section of the microcomputer allowing for the arc cosine of the corresponding time delays to be obtained. This provides an equal angular distribution for the different time delays. In addition to a zero to 180 degree look-up table, a second frequently used look-up table embodied in this invention has possible arc cosine values from 45 to 135 degrees for the locating of a sound source originating within this range of angles. And by proper programming, any sound source originating outside of a desired range such as this second range of angles will be ignored by the system. This has the particular advantage of identifying only those people talking from locations prearranged to be valid within a room. In order to aid in setup and verifying proper operation, a local position display such as is available with light-emitting dioctes is provided and shown in FIG. 7. This position display circuitry is connected to the microcomputer 610 via data bus 130. The five most significant bits from the microcomputer are provided to a buffer and inverter circuit 710 and to an output connector 720 for providing an output signal for the various applications described herein. The output of the buffer and inverter circuit is provided to a demultiplexer circuit 730 which takes the five bits of binary data and decodes it into 32 separate outputs. These 32 outputs each drive light-emitting diodes that are activated to reflect the angular location of a speaker in a room.
When used in a teleconferencing arrangement, it is desirable to disable the system when a voice signal from a remote location is being received. This is accomplished by comparator 740 along with its associated components, resistors 741 through 743, which compare the switch guard voltage in a teleconferencing set with a fixed voltage threshold provided by the resistor divider network comprising resistors 741 and 742. The output of comparator 740 provides this signal to the
microcomputer 610 over line 131 and has the effect of causing the microcomputer to ignore any events found and thus cannot identify the loudspeaker.
FIG. 9 is a flowchart illustrating the operation of the acoustic direction identification system. The functions provided by microcomputer 610 are advantageously determined by a process or program stored in the processor portion of the microcomputer 610.
For ease of understanding the flowchart of FIG. 9, reference also to FIG. 10 and the waveforms depicted thereon is suggested. The main loop A in the process looks for events in either channel 1 or channel 2 or a flag from step 905 to signal it is time for step 920 to report out results. If an event is found in one of the channels, for example channel 1, step 910 starts a timer indicated as step 925 and the system will begin looking for an event in the other channel at step 915. If one is found as per step 930, the timer is stopped, the time delay read, and the reading used by step 940 to address the correct elements in the histograms that are used for correlated event memory. These elements are then incremented with the appropriate unit and the system returned to loop A. If no second event is found before the time t = tmax, which is the maximum time delay possible between the two microphones, step 935 causes the program to return to loop A without changing the histograms.
If during the reporting step 920, the units in an element in a histogram is found to exceed a previously stored accept/reject threshold for identification, then identification of that element is assigned as the speaker's position, and the processor outputs the time delay corresponding to the speaker's position. The histogram is cleared and a pedestal unit to be later described is left in the selected element corresponding to the speaker's position.
The acoustic direction identification system is shown in FIG. 10 utilizing four 63-element histograms 1201
___OM WIP
through 1204 which are read cyclicly. Four histograms allow quick identification, in the Ε . , from one report to the next when the density of events is high, while still providing identification in times as long as 4T rt if the density of events is low as usually is the case with low level talkers. It will become obvious to those skilled in the art, however, that any number of histograms other than four can be utilized in practicing this invention. In addition, the number of elements in a histogram can also be other than 63. Hence, it is not intended nor should the invention be construed as being limited to any particular number of histograms with a fixed number of elements contained therein. The time delay range spanned by the 63 elements is from -tma„x to +tmax which also for illustration purposes are shown in the present system to correspond to angles of zero through 180 degrees.
Referring now in greater detail to the operation of the processor in collecting and reporting out data, every time a correlated event is found, the processor increments each of the four histograms by placing a unit level therein. In that the process of incrementing all four histograms takes approximately 200 microseconds, all of the correlated events occurring are detected. With each correlated event found, all four histograms are incremented in the appropriate element which is illustrated on the horizontal axis numbering 1 through 63 in the waveforms 1201 through 1204 in FIG. 12 and corresponds to the time delay measured. In the reading of a histogram, all of the elements are examined and the one that has the most correlated events stored therein reflects the time delay between the two microphones or the angle from which the speech is coming. In order to ensure that what is being detected is speech and not a correlated event from the air conditioner, a presettable accept/reject threshold 1205 is provided for comparing the level of the incremented
_JIE_
OMPI
elements in the histograms. By this comparison, a determination is made as to whether the information present is sufficient to consider it as being derived from speech sounds. This accept/reject threshold in combination with the 3 millisecond filtering provided by the dual monostable multivibrators 450 and 460 provides a system that is essentially unresponsive to nonspeech sounds.
Under the control of the report clock 636, each histogram is read sequentially at a much slower rate than they are incremented. By way of example, assuming a sampling time of 1/10th of a second and a time of T equals zero, the first one of the four histograms is read. The element having the largest number of units in this histogram is determined. As earlier indicated, if the units in the element exceed the threshold, an identification is made as to that being a valid location for a person speaking as is the case for pedestal 1206. The entire histogram is then cleared by zeroing out all the elements and a pedestal such as 1207 or 1208 inserted in the location where the identification was made. The same pedestal is also added to the three other histograms. The purpose of this pedestal is to give an advantage to the same talker and aid in reidentifying that talker if he or she continues to speak from the same or a different location.
Between time T equals zero and T equals 1/10th of a second, the system collects data and increments the proper element in all four histograms every time a correlated event occurs. At time T equals 1/10th of a second, the second histogram is examined. The same process is followed in this histogram as in the first. It is examined, the element with the greatest number of units compared with the threshold, the histogram cleared and a pedestal added if a valid identification is made. The process continues for the next 1/10th of a second collecting data and incrementing all four histograms for each valid correlated event found. At time T equals
OMPI
2/10ths of a second the third histogram is examined, at time T equals 3/10ths of a second the fourth histogram is examined, and at time T equals 4/10ths of a second the cycle repeats beginning with the examination of the first histogram.
When the histograms are incremented after a correlated event, it was experimentally determined that by incrementing by two the element corresponding to the time delay found, and adjacent elements by one, faster identifications which were also less affected by talker head movements were produced. Thus, as disclosed in this invention, the pedestal unit left in the histograms after a successful identification contains a unit value in the selected element and one-half of that unit value in each adjacent element. Hence, each time a report is required, one of the four histograms is read and 4/10ths of a second worth of information is collected. Moreover, only 1/10th of a second will have elapsed since the last reading was taken. Thus, the system can respond quickly where needed and also can collect data over a long time if necessary. In addition to those already mentioned, many other applications of this acoustic direction identification system are contemplated and may obviously be implemented by those skilled in the art. For example, a video cursor for use with a remote blackboard is possible. In response to a control signal from the acoustic direction identification system, the cursor would be able to identify participants at a first location for a second location by having the cursor on the blackboard at the second location move to a prearranged position on the blackboard whenever a person speaks from a particular position at the first location.
Using the acoustic direction identification system with a slow scan television is also possible. A remote video cursor is aligned with a particular camera and lens and whoever talks from a given position in the room will cause the cursor to appear above that position on the
OMPI "
slow scan monitor at the remote location.
Another possible application would be in an audio switching arrangement for improving the audio in teleconferences. Methods of directing the audio from remote locations into two or more loudspeakers are possible to give the illusion of spatial position to remote talkers. The acoustic direction identification system allows for this without additional audio channels.
Still further is an expanded application of the acoustic direction identification system wherein the combination of two such systems are usable to determine both the azimuth angle and distance to a sound source or, alternatively, the azimuth angle and elevation of the sound source. Finally, one of the present systems for switching cameras in the PICTUREPHONE® Meeting Service conferencing system relies on voice switching from individual lavalier microphones hung around the necks of the conferees. The acoustic direction identification system would eliminate the need for individual microphones, and truly allow "hands free telephony" for PICTUREPHONE Meeting Service.
Modifications of this acoustic direction identification system are also possible and may obviously be implemented by those skilled in the art without departing from the spirit and scope of the invention. It is to be understood, therefore, that within the scope of the appended claims, the invention maybe practiced otherwise than as specifically described.
Claims
1. A signal processing arrangement having first and second spatially separated sound detecting devices responsive to sound from a common sound source, CHARACTERIZED IN THAT a first pulse and a second pulse corresponding to energy bursts of sound detected in the respective detecting device (101, 102) are generated, the phase relationship between the energy bursts of sound is determined (610) from said first and second pulses, and an output signal (720) identifying the angular position of the common sound source is formed in response to both the phase relationship between the energy bursts and the accumulated value of multiple energy bursts within a predetermined time interval exceeding the value of a predetermined sound threshold level.
2. The signal processing arrangement in accordance with claim 1 further CHARACTERIZED IN THAT the time differential between the occurrence of the first pulse and the occurrence of the second pulse measures the phase relationship between respective energy bursts of sound.
3. The signal processing arrangement in accordance with claim 2 further CHARACTERIZED IN THAT a timer (631) within the pulse detecting means begins to count upon detection of the occurrence of the first pulse and stops counting upon detection of the occurrence of the second pulse, the value of the count being indicative of the angular position of the common sound source with respect to the sound detecting devices.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE8484903834T DE3477846D1 (en) | 1983-11-04 | 1984-10-04 | Acoustic direction identification system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US549,258 | 1983-11-04 | ||
US06/549,258 US4581758A (en) | 1983-11-04 | 1983-11-04 | Acoustic direction identification system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1985002022A1 true WO1985002022A1 (en) | 1985-05-09 |
Family
ID=24192261
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US1984/001584 WO1985002022A1 (en) | 1983-11-04 | 1984-10-04 | Acoustic direction identification system |
Country Status (6)
Country | Link |
---|---|
US (1) | US4581758A (en) |
EP (1) | EP0162858B1 (en) |
JP (1) | JPS61500329A (en) |
CA (1) | CA1230666A (en) |
DE (1) | DE3477846D1 (en) |
WO (1) | WO1985002022A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0219339A2 (en) * | 1985-10-14 | 1987-04-22 | Gec Avionics Limited | Acoustic direction finder for use as an active range finder |
WO1994026075A1 (en) * | 1993-05-03 | 1994-11-10 | The University Of British Columbia | Tracking platform system |
EP0723733A1 (en) * | 1993-10-05 | 1996-07-31 | Picturetel Corporation | Microphone system for teleconferencing system |
GB2364121A (en) * | 2000-06-30 | 2002-01-16 | Mitel Corp | Locating a talker |
WO2002039783A1 (en) * | 2000-11-13 | 2002-05-16 | Holly, John, Anthony | Directional microphone |
GB2375698A (en) * | 2001-02-07 | 2002-11-20 | Canon Kk | Audio signal processing apparatus |
US7130797B2 (en) | 2001-08-22 | 2006-10-31 | Mitel Networks Corporation | Robust talker localization in reverberant environment |
EP2381439A1 (en) * | 2009-01-22 | 2011-10-26 | Panasonic Corporation | Stereo acoustic signal encoding apparatus, stereo acoustic signal decoding apparatus, and methods for the same |
Families Citing this family (81)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3509358A1 (en) * | 1984-03-27 | 1985-11-14 | Head Stereo GmbH Kopfbezogene Aufnahme- und Wiedergabetechnik, 8000 München | SIMULATION METHOD AND DEVICE (ELECTRONIC ART HEAD) FOR IMPROVING THE TRANSMISSION PROPERTIES OF THE HUMAN OUTER EAR IN THE SPACE |
US4802227A (en) * | 1987-04-03 | 1989-01-31 | American Telephone And Telegraph Company | Noise reduction processing arrangement for microphone arrays |
DE3742929C1 (en) * | 1987-12-18 | 1988-09-29 | Daimler Benz Ag | Method for improving the reliability of voice controls of functional elements and device for carrying it out |
DE59008583D1 (en) * | 1989-10-18 | 1995-04-06 | Siemens Ag | Method for automatic switching of messages and circuit arrangement for carrying out the method. |
US5020098A (en) * | 1989-11-03 | 1991-05-28 | At&T Bell Laboratories | Telephone conferencing arrangement |
US5058419A (en) * | 1990-04-10 | 1991-10-22 | Earl H. Ruble | Method and apparatus for determining the location of a sound source |
US5319359A (en) * | 1992-04-10 | 1994-06-07 | Sony Electronics Inc. | Cross fade indicators |
US5335011A (en) * | 1993-01-12 | 1994-08-02 | Bell Communications Research, Inc. | Sound localization system for teleconferencing using self-steering microphone arrays |
JPH07264452A (en) * | 1994-02-03 | 1995-10-13 | Samsung Electron Co Ltd | Built-in camera type magnetic recording/reproducing device, and method therefor |
CA2148631C (en) * | 1994-06-20 | 2000-06-13 | John J. Hildin | Voice-following video system |
CA2149680A1 (en) * | 1994-06-30 | 1995-12-31 | John Charles Baumhauer Jr. | Direction finder |
US5828997A (en) * | 1995-06-07 | 1998-10-27 | Sensimetrics Corporation | Content analyzer mixing inverse-direction-probability-weighted noise to input signal |
US5694474A (en) * | 1995-09-18 | 1997-12-02 | Interval Research Corporation | Adaptive filter for signal processing and method therefor |
US7012630B2 (en) * | 1996-02-08 | 2006-03-14 | Verizon Services Corp. | Spatial sound conference system and apparatus |
US5778082A (en) * | 1996-06-14 | 1998-07-07 | Picturetel Corporation | Method and apparatus for localization of an acoustic source |
US5825898A (en) * | 1996-06-27 | 1998-10-20 | Lamar Signal Processing Ltd. | System and method for adaptive interference cancelling |
US6178248B1 (en) | 1997-04-14 | 2001-01-23 | Andrea Electronics Corporation | Dual-processing interference cancelling system and method |
US6016449A (en) | 1997-10-27 | 2000-01-18 | Neuropace, Inc. | System for treatment of neurological disorders |
US6198693B1 (en) * | 1998-04-13 | 2001-03-06 | Andrea Electronics Corporation | System and method for finding the direction of a wave source using an array of sensors |
JP4467802B2 (en) * | 1998-11-11 | 2010-05-26 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Improved signal localization device |
US6363345B1 (en) | 1999-02-18 | 2002-03-26 | Andrea Electronics Corporation | System, method and apparatus for cancelling noise |
US6463414B1 (en) * | 1999-04-12 | 2002-10-08 | Conexant Systems, Inc. | Conference bridge processing of speech in a packet network environment |
US6594367B1 (en) | 1999-10-25 | 2003-07-15 | Andrea Electronics Corporation | Super directional beamforming design and implementation |
US6973184B1 (en) * | 2000-07-11 | 2005-12-06 | Cisco Technology, Inc. | System and method for stereo conferencing over low-bandwidth links |
US7039198B2 (en) * | 2000-11-10 | 2006-05-02 | Quindi | Acoustic source localization system and method |
US20020140804A1 (en) * | 2001-03-30 | 2002-10-03 | Koninklijke Philips Electronics N.V. | Method and apparatus for audio/image speaker detection and locator |
US20030050777A1 (en) * | 2001-09-07 | 2003-03-13 | Walker William Donald | System and method for automatic transcription of conversations |
US6792118B2 (en) * | 2001-11-14 | 2004-09-14 | Applied Neurosystems Corporation | Computation of multi-sensor time delays |
US20040024596A1 (en) * | 2002-07-31 | 2004-02-05 | Carney Laurel H. | Noise reduction system |
ATE449561T1 (en) * | 2002-10-15 | 2009-12-15 | Medtronic Inc | PHASE SHIFT OF NEUROLOGICAL SIGNALS IN A MEDICAL DEVICE SYSTEM |
EP1558130A4 (en) * | 2002-10-15 | 2009-01-28 | Medtronic Inc | Screening techniques for management of a nervous system disorder |
US8543214B2 (en) * | 2002-10-15 | 2013-09-24 | Medtronic, Inc. | Configuring and testing treatment therapy parameters for a medical device system |
WO2004036370A2 (en) * | 2002-10-15 | 2004-04-29 | Medtronic Inc. | Channel-selective blanking for a medical device system |
WO2004036372A2 (en) * | 2002-10-15 | 2004-04-29 | Medtronic Inc. | Scoring of sensed neurological signals for use with a medical device system |
AU2003287159A1 (en) * | 2002-10-15 | 2004-05-04 | Medtronic Inc. | Synchronization and calibration of clocks for a medical device and calibrated clock |
US7933646B2 (en) * | 2002-10-15 | 2011-04-26 | Medtronic, Inc. | Clustering of recorded patient neurological activity to determine length of a neurological event |
EP1583464B1 (en) * | 2002-10-15 | 2014-04-09 | Medtronic, Inc. | Clustering of recorded patient neurological activity to determine length of a neurological event |
AU2003285889A1 (en) * | 2002-10-15 | 2004-05-04 | Medtronic Inc. | Control of treatment therapy during start-up and during operation of a medical device system |
EP1629341A4 (en) * | 2002-10-15 | 2008-10-15 | Medtronic Inc | Multi-modal operation of a medical device system |
US20040138647A1 (en) * | 2002-10-15 | 2004-07-15 | Medtronic, Inc. | Cycle mode providing redundant back-up to ensure termination of treatment therapy in a medical device system |
AU2003278006A1 (en) * | 2002-10-15 | 2004-05-04 | Creo Inc. | Automated information management system and methods |
AU2003286451A1 (en) * | 2002-10-15 | 2004-05-04 | Medtronic Inc. | Signal quality monitoring and control for a medical device system |
TWI235844B (en) * | 2003-05-07 | 2005-07-11 | Sunplus Technology Co Ltd | Device and method to identify the direction of sound |
GB0324536D0 (en) | 2003-10-21 | 2003-11-26 | Mitel Networks Corp | Detecting acoustic echoes using microphone arrays |
EP1705911A1 (en) * | 2005-03-24 | 2006-09-27 | Alcatel | Video conference system |
US8457614B2 (en) * | 2005-04-07 | 2013-06-04 | Clearone Communications, Inc. | Wireless multi-unit conference phone |
DE102005057569A1 (en) * | 2005-12-02 | 2007-06-06 | Robert Bosch Gmbh | Device for monitoring with at least one video camera |
US8345890B2 (en) | 2006-01-05 | 2013-01-01 | Audience, Inc. | System and method for utilizing inter-microphone level differences for speech enhancement |
DE602006001051T2 (en) * | 2006-01-09 | 2009-07-02 | Honda Research Institute Europe Gmbh | Determination of the corresponding measurement window for sound source location in echo environments |
US8204252B1 (en) | 2006-10-10 | 2012-06-19 | Audience, Inc. | System and method for providing close microphone adaptive array processing |
US8744844B2 (en) | 2007-07-06 | 2014-06-03 | Audience, Inc. | System and method for adaptive intelligent noise suppression |
US8194880B2 (en) * | 2006-01-30 | 2012-06-05 | Audience, Inc. | System and method for utilizing omni-directional microphones for speech enhancement |
US9185487B2 (en) * | 2006-01-30 | 2015-11-10 | Audience, Inc. | System and method for providing noise suppression utilizing null processing noise subtraction |
US8326431B2 (en) * | 2006-04-28 | 2012-12-04 | Medtronic, Inc. | Implantable medical device for the concurrent treatment of a plurality of neurological disorders and method therefore |
US8150065B2 (en) * | 2006-05-25 | 2012-04-03 | Audience, Inc. | System and method for processing an audio signal |
US8934641B2 (en) * | 2006-05-25 | 2015-01-13 | Audience, Inc. | Systems and methods for reconstructing decomposed audio signals |
US8849231B1 (en) | 2007-08-08 | 2014-09-30 | Audience, Inc. | System and method for adaptive power control |
US8949120B1 (en) | 2006-05-25 | 2015-02-03 | Audience, Inc. | Adaptive noise cancelation |
US8204253B1 (en) | 2008-06-30 | 2012-06-19 | Audience, Inc. | Self calibration of audio device |
EP1862813A1 (en) * | 2006-05-31 | 2007-12-05 | Honda Research Institute Europe GmbH | A method for estimating the position of a sound source for online calibration of auditory cue to location transformations |
AU2007221976B2 (en) | 2006-10-19 | 2009-12-24 | Polycom, Inc. | Ultrasonic camera tracking system and associated methods |
DE102007002905A1 (en) * | 2007-01-19 | 2008-07-24 | Siemens Ag | Method and device for recording a speech signal |
US8259926B1 (en) | 2007-02-23 | 2012-09-04 | Audience, Inc. | System and method for 2-channel and 3-channel acoustic echo cancellation |
JP4697810B2 (en) * | 2007-03-05 | 2011-06-08 | パナソニック株式会社 | Automatic tracking device and automatic tracking method |
TWI327230B (en) * | 2007-04-03 | 2010-07-11 | Ind Tech Res Inst | Sound source localization system and sound soure localization method |
US8189766B1 (en) | 2007-07-26 | 2012-05-29 | Audience, Inc. | System and method for blind subband acoustic echo cancellation postfiltering |
US8180064B1 (en) | 2007-12-21 | 2012-05-15 | Audience, Inc. | System and method for providing voice equalization |
US8143620B1 (en) | 2007-12-21 | 2012-03-27 | Audience, Inc. | System and method for adaptive classification of audio sources |
US8194882B2 (en) | 2008-02-29 | 2012-06-05 | Audience, Inc. | System and method for providing single microphone noise suppression fallback |
US8355511B2 (en) | 2008-03-18 | 2013-01-15 | Audience, Inc. | System and method for envelope-based acoustic echo cancellation |
US8521530B1 (en) | 2008-06-30 | 2013-08-27 | Audience, Inc. | System and method for enhancing a monaural audio signal |
US8774423B1 (en) | 2008-06-30 | 2014-07-08 | Audience, Inc. | System and method for controlling adaptivity of signal modification using a phantom coefficient |
US20100008515A1 (en) * | 2008-07-10 | 2010-01-14 | David Robert Fulton | Multiple acoustic threat assessment system |
US9008329B1 (en) | 2010-01-26 | 2015-04-14 | Audience, Inc. | Noise reduction using multi-feature cluster tracker |
JP2013135325A (en) * | 2011-12-26 | 2013-07-08 | Fuji Xerox Co Ltd | Voice analysis device |
JP5867066B2 (en) * | 2011-12-26 | 2016-02-24 | 富士ゼロックス株式会社 | Speech analyzer |
JP6031761B2 (en) * | 2011-12-28 | 2016-11-24 | 富士ゼロックス株式会社 | Speech analysis apparatus and speech analysis system |
US9640194B1 (en) | 2012-10-04 | 2017-05-02 | Knowles Electronics, Llc | Noise suppression for speech processing based on machine-learning mask estimation |
US9536540B2 (en) | 2013-07-19 | 2017-01-03 | Knowles Electronics, Llc | Speech signal separation and synthesis based on auditory scene analysis and speech modeling |
CN106797512B (en) | 2014-08-28 | 2019-10-25 | 美商楼氏电子有限公司 | Method, system and the non-transitory computer-readable storage medium of multi-source noise suppressed |
US11722763B2 (en) | 2021-08-06 | 2023-08-08 | Motorola Solutions, Inc. | System and method for audio tagging of an object of interest |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3559161A (en) * | 1967-07-24 | 1971-01-26 | Honeywell Inc | Acoustic position reference system |
GB1318044A (en) * | 1970-06-05 | 1973-05-23 | British Aircraft Corp Ltd | Sonar apparatus |
US4131760A (en) * | 1977-12-07 | 1978-12-26 | Bell Telephone Laboratories, Incorporated | Multiple microphone dereverberation system |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3878381A (en) * | 1966-12-07 | 1975-04-15 | Us Navy | Correlation circuit including vernier |
US4031501A (en) * | 1975-02-04 | 1977-06-21 | The United States Of America As Represented By The Secretary Of The Army | Apparatus for electronically locating analog signals |
-
1983
- 1983-11-04 US US06/549,258 patent/US4581758A/en not_active Expired - Lifetime
-
1984
- 1984-10-04 WO PCT/US1984/001584 patent/WO1985002022A1/en active IP Right Grant
- 1984-10-04 EP EP84903834A patent/EP0162858B1/en not_active Expired
- 1984-10-04 DE DE8484903834T patent/DE3477846D1/en not_active Expired
- 1984-10-04 JP JP59503834A patent/JPS61500329A/en active Granted
- 1984-10-15 CA CA000465450A patent/CA1230666A/en not_active Expired
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3559161A (en) * | 1967-07-24 | 1971-01-26 | Honeywell Inc | Acoustic position reference system |
GB1318044A (en) * | 1970-06-05 | 1973-05-23 | British Aircraft Corp Ltd | Sonar apparatus |
US4131760A (en) * | 1977-12-07 | 1978-12-26 | Bell Telephone Laboratories, Incorporated | Multiple microphone dereverberation system |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0219339A2 (en) * | 1985-10-14 | 1987-04-22 | Gec Avionics Limited | Acoustic direction finder for use as an active range finder |
EP0219339A3 (en) * | 1985-10-14 | 1988-03-23 | Gec Avionics Limited | Acoustic direction finder for use as an active range finder |
WO1994026075A1 (en) * | 1993-05-03 | 1994-11-10 | The University Of British Columbia | Tracking platform system |
US5526433A (en) * | 1993-05-03 | 1996-06-11 | The University Of British Columbia | Tracking platform system |
EP0723733A1 (en) * | 1993-10-05 | 1996-07-31 | Picturetel Corporation | Microphone system for teleconferencing system |
EP0723733A4 (en) * | 1993-10-05 | 1997-11-05 | Picturetel Corp | Microphone system for teleconferencing system |
GB2364121A (en) * | 2000-06-30 | 2002-01-16 | Mitel Corp | Locating a talker |
GB2364121B (en) * | 2000-06-30 | 2004-11-24 | Mitel Corp | Method and apparatus for locating a talker |
US7251336B2 (en) | 2000-06-30 | 2007-07-31 | Mitel Corporation | Acoustic talker localization |
WO2002039783A1 (en) * | 2000-11-13 | 2002-05-16 | Holly, John, Anthony | Directional microphone |
GB2375698A (en) * | 2001-02-07 | 2002-11-20 | Canon Kk | Audio signal processing apparatus |
US7171007B2 (en) | 2001-02-07 | 2007-01-30 | Canon Kabushiki Kaisha | Signal processing system |
US7130797B2 (en) | 2001-08-22 | 2006-10-31 | Mitel Networks Corporation | Robust talker localization in reverberant environment |
EP2381439A1 (en) * | 2009-01-22 | 2011-10-26 | Panasonic Corporation | Stereo acoustic signal encoding apparatus, stereo acoustic signal decoding apparatus, and methods for the same |
EP2381439A4 (en) * | 2009-01-22 | 2016-06-29 | Panasonic Ip Corp America | Stereo acoustic signal encoding apparatus, stereo acoustic signal decoding apparatus, and methods for the same |
Also Published As
Publication number | Publication date |
---|---|
JPS61500329A (en) | 1986-02-27 |
JPH0546910B2 (en) | 1993-07-15 |
EP0162858A1 (en) | 1985-12-04 |
US4581758A (en) | 1986-04-08 |
CA1230666A (en) | 1987-12-22 |
EP0162858B1 (en) | 1989-04-19 |
DE3477846D1 (en) | 1989-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US4581758A (en) | Acoustic direction identification system | |
US6185152B1 (en) | Spatial sound steering system | |
US5940118A (en) | System and method for steering directional microphones | |
US5778082A (en) | Method and apparatus for localization of an acoustic source | |
US4054908A (en) | Videotelephone conference system | |
US4184048A (en) | System of audioconference by telephone link up | |
US6137887A (en) | Directional microphone system | |
US7227566B2 (en) | Communication apparatus and TV conference apparatus | |
NO333056B1 (en) | Directional microphone | |
JP4411959B2 (en) | Audio collection / video imaging equipment | |
CA2485728C (en) | Detecting acoustic echoes using microphone arrays | |
JP4281568B2 (en) | Telephone device | |
EP1266538B1 (en) | Spatial sound steering system | |
JP4269854B2 (en) | Telephone device | |
JP2005181391A (en) | Device and method for speech processing | |
Bian et al. | Sound source localization in domestic environment | |
CN213213667U (en) | Interactive conference device based on visual and sound fusion | |
US10389325B1 (en) | Automatic microphone equalization | |
JPH09163334A (en) | Speaker detection circuit and video conference system | |
Grove | Effects of thresholding on a small-scale matched filter array | |
JP2005057450A (en) | Microphone-speaker integrated speech unit | |
JP2005057400A (en) | Microphone-speaker integrated speech unit | |
Sachar | Some important algorithms for large-aperture microphone arrays: Calibration and determination of talker orientation | |
Loy et al. | Localization and recall of the spatial position of sounds | |
Whitlock et al. | Preamplifiers and Mixers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Designated state(s): JP |
|
AL | Designated countries for regional patents |
Designated state(s): AT BE CH DE FR GB LU NL SE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1984903834 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1984903834 Country of ref document: EP |
|
WWG | Wipo information: grant in national office |
Ref document number: 1984903834 Country of ref document: EP |