US20160118062A1 - Robust Voice Activity Detector System for Use with an Earphone - Google Patents

Robust Voice Activity Detector System for Use with an Earphone Download PDF

Info

Publication number
US20160118062A1
US20160118062A1 US14/922,475 US201514922475A US2016118062A1 US 20160118062 A1 US20160118062 A1 US 20160118062A1 US 201514922475 A US201514922475 A US 201514922475A US 2016118062 A1 US2016118062 A1 US 2016118062A1
Authority
US
United States
Prior art keywords
signal
filtered
microphone
time weighted
electronic device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US14/922,475
Other versions
US10163453B2 (en
Inventor
John Usher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Staton Techiya LLC
Original Assignee
Personics Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US14/922,475 priority Critical patent/US10163453B2/en
Application filed by Personics Holdings Inc filed Critical Personics Holdings Inc
Assigned to PERSONICS HOLDINGS, LLC reassignment PERSONICS HOLDINGS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: USHER, JOHN
Publication of US20160118062A1 publication Critical patent/US20160118062A1/en
Assigned to STATON TECHIYA, LLC reassignment STATON TECHIYA, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
Assigned to DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD. reassignment DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PERSONICS HOLDINGS, INC., PERSONICS HOLDINGS, LLC
Assigned to STATON TECHIYA, LLC reassignment STATON TECHIYA, LLC CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 042992 FRAME 0524. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST AND GOOD WILL. Assignors: DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
Assigned to DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD. reassignment DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD. CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 042992 FRAME: 0493. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: PERSONICS HOLDINGS, INC., PERSONICS HOLDINGS, LLC
Priority to US16/227,695 priority patent/US10824388B2/en
Publication of US10163453B2 publication Critical patent/US10163453B2/en
Application granted granted Critical
Priority to US17/013,538 priority patent/US11693617B2/en
Priority to US18/111,671 priority patent/US20230280965A1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G10L25/84—Detection of presence or absence of voice signals for discriminating voice from noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L21/0224—Processing in the time domain
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0264—Noise filtering characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
    • G10L21/0324—Details of processing therefor
    • G10L21/034—Automatic adjustment
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03G—CONTROL OF AMPLIFICATION
    • H03G3/00—Gain control in amplifiers or frequency changers without distortion of the input signal
    • H03G3/20—Automatic control
    • H03G3/30—Automatic control in amplifiers having semiconductor devices
    • H03G3/34—Muting amplifier when no signal is present or when only weak signals are present, or caused by the presence of noise signals, e.g. squelch systems
    • H03G3/341—Muting when no signals or only weak signals are present
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00—Monitoring arrangements; Testing arrangements
    • H04R29/004—Monitoring arrangements; Testing arrangements for microphones
    • H04R29/005—Microphone arrays
    • H04R29/006—Microphone matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the present embodiments relate to detection of voice activity in noisy environments.
  • a method of adjusting a gain on a voice operated control system can include receiving a first microphone signal, receiving a second microphone signal, updating a slow time weighted ratio of the filtered first and second signals, and updating a fast time weighted ratio of the filtered first and second signals.
  • the method can further include calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio, comparing the absolute difference with a threshold, and increasing the gain when the absolute difference is greater than the threshold.
  • the threshold can be fixed.
  • the method can further include band limiting or band pass filtering the first microphone signal to provide a filtered first signal, band limiting or band pass filtering the second microphone signal to provide a filtered second signal, calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal, and calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal.
  • the threshold is dependent on the slow time weighted average.
  • the threshold value is set to a time averaged value of the absolute difference and in some embodiments the threshold value is set to the time averaged value of the absolute difference using a leaky integrator used for time smoothing.
  • the step of band limiting or band pass filtering can use a weighted fast Fourier transform operation.
  • the method can further include determining a current voice activity status based on the comparison step. In some embodiments, the method can further include determining a current voice activity status using Singular Value Decomposition, a neural net system, or a bounded probability value.
  • the embodiments can also include an electronic device for adjusting a gain on a voice operated control system which can include one or more processors and a memory having computer instructions.
  • the instructions when executed by the one or more processors causes the one or more processors to perform the operations of receiving a first microphone signal, receiving a second microphone signal, updating a slow time weighted ratio of the filtered first and second signals, and updating a fast time weighted ratio of the filtered first and second signals.
  • the one or more processors can further perform the operations of calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio, comparing the absolute difference with a threshold, and increasing the gain when the absolute difference is greater than the threshold.
  • adjusting or increasing the gain involves adjusting a gain of an overall system or of a total output. In some embodiments, adjusting the gain involves adjusting the gain from a first microphone, from a second microphone or from both. In some embodiments, adjusting the gain involves adjusting the gain at the output of a VAD or comparator or other output. In some embodiments, adjusting the gain can involve any combination of gain adjustment mentioned above.
  • electronic device can further include the memory having instructions when executed by the one or more processors to cause the one or more processors to perform the operations of band limiting or band pass filtering the first microphone signal to provide filtered first signal, band limiting or band pass filtering the second microphone signal to provide a filtered second signal, calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal, and calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal.
  • the threshold is fixed or the threshold is dependent on the slow time weighted average.
  • the first microphone signal is received by an ambient signal microphone and the second microphone signal is received by a ear canal microphone.
  • the ambient signal microphone and the ear canal microphone can be part of an earphone device having a sound isolating barrier or a partially sound isolating barrier to isolate the ear canal microphone from an ambient environment.
  • the earphone device can be any number of devices including, but not limited to a headset, earpiece, headphone, ear bud or other type of earphone device.
  • the sound isolating barrier or partially sound isolating barrier is an inflatable balloon or foam plug.
  • the memory further includes instructions causing the operation of determining a current voice activity status based on the comparison step.
  • the memory further includes instructions causing the operation of determining a current voice activity status using Singular Value Decomposition, neural net systems, or a bounded probability value.
  • the first microphone signal is optionally processed using an analog or a digital band-pass filter and in some embodiments the second microphone signal is optionally processed using an analog or a digital band-pass filter.
  • at least one characteristic of the first or second microphone signals includes a short-term power estimate.
  • FIG. 1 is a block diagram of a voice activity detector system in accordance with an embodiment
  • FIG. 2 is a flow chart of a method for determining voice activity status in accordance with an embodiment herein;
  • FIG. 3 is an overview block diagram of a system for determining voice activity status in accordance with an embodiment herein.
  • a new method and system is presented to robustly determined voice activity using typically two microphones mounted in a small earpiece.
  • the determined voice activity status can be used to control the gain on a voice operated control system to gate the level of a signal directed to a second voice receiving system.
  • This voice receiving system can be a voice communication system (eg radio or telephone system), a voice recording system, a speech to text system, a voice machine-control system.
  • the gain of the voice operated control system is typically set to zero when no voice active is detected, and set to unity otherwise.
  • the overall data rate in a voice communication system can therefore be adjusted, and large data rate reductions are possible: thereby increasing the number of voice communications channels and/or increasing the voice quality for each voice communication channel.
  • the voice activity status can also be used to adjust the power used in a wireless voice communication system, thereby extending the battery life of the system.
  • FIG. 1 describes an exemplary overview or system 10 of an embodiment in accordance the present invention.
  • two microphones in an earphone are used to determine voice activity of the earphone wearer.
  • the first microphone 12 is an ambient sound microphone, detecting sound in the ambient environment of the earphone wearer.
  • the second microphone 13 is an ear-canal microphone detecting sound in the ear canal of the earphone wearer.
  • the earphone incorporates a sound isolating or a partially sound isolating barrier to isolate the ear canal microphone from the ambient environment, where this barrier can be an inflatable balloon or foam plug.
  • the microphones 12 and 13 can serve as inputs to a voice activity detector or VAD 14 .
  • the voice activity detector 14 can provide a VAD status to a gain update module 15 .
  • the gain update module 15 and the ear canal microphone 13 can provide inputs to an amplifier 16 .
  • the output from the gain update module 15 serves as the voice controller gain input signal to the amplifier 16 .
  • the amplifier 16 can provide an output signal 17 which can be used by a speaker 18 for example.
  • FIG. 2 describes a method 20 for determining the status of user voice activity of the earphone system in FIG. 1 .
  • the first and second microphone signals are received at 21 and 22 and are band pass filtered (or “band limited”) and a power estimate of these filtered first and second microphone signals are calculated at 23 and 24 respectively.
  • the band pass filtering is accomplished by a weighted FFT operation, familiar to those skilled in the art, with the signal power estimated between approximately 100 Hz and 2 kHz.
  • P_1(t) is the weighted power estimate of signal microphone 1 at time t.
  • W is a frequency weighting vector
  • FFT( ) is a Fast Fourier Transform operation.
  • M_1(t) is the signal from the first microphone at time t.
  • M_2(t) is the signal from the second microphone at time t.
  • a fast-time weighted average of the two band pass filtered power estimates is calculated at 25 and 26 respectively, with a fast time constant which in the preferred embodiment is equal to 45 ms.
  • AV_M1_fast(t) is the fast time weighted average of the first band pass filtered microphone signal.
  • AV_M2_fast(t) is the fast time weighted average of the second band pass filtered microphone signal.
  • a is a fast time weighting coefficient
  • a slow-time weighted average of the two band pass filtered power estimates is calculated at 27 and 28 respectively, with a fast time constant which in the preferred embodiment is equal to 500 ms.
  • AV_M1_slow(t) is the slow time weighted average of the first band pass filtered microphone signal.
  • AV_M2_slow(t) is the slow time weighted average of the second band pass filtered microphone signal.
  • b is a slow time weighting coefficient, where a>b.
  • the ratio of the two fast time weighted power estimates is calculated at 30 (i.e., the fast weighted power of the second microphone divided by the fast weighted power of the first microphone).
  • ratio_fast( t ) AV _ M 2_fast( t )/ AV _ M 1_fast( t )
  • the ratio of the two slow time weighted power estimates is calculated at 29 (ie the slow weighted power of the second microphone divided by the slow weighted power of the first microphone).
  • ratio_slow( t ) AV _ M 2_slow( t )/ AV _ M 1_slow( t )
  • the updating of the slow time weighted ratio in one embodiment is of the first filtered signal and the second filtered signal where the first filtered signal and the second filtered signal are the slow weighted powers of the first and second microphone signals.
  • updating of the fast time weighted ratio is of the first filtered signal and the second filtered signal where the first filtered signal and the second filtered signals are the fast weighted powers of the first and second microphone signals.
  • the absolute differences between the fast time weighted ratio and the slow time weighted ratios are calculated to provide a value.
  • This value is then compared with a threshold at 32 , and if the value diff(t) is greater than this threshold, then we determine that voice activity is current in an active mode at 33 , and the VOX gain value is updated at 34 or in this example increased (up to a maximum value of unity).
  • the threshold value is fixed.
  • the threshold value is dependent on the slow weighted level AV_M1 slow.
  • the threshold value is set to be equal to the time averaged value of the diff(t), for example calculated according to the following:
  • threshold( t ) c *threshold( t ⁇ 1)+( c ⁇ 1)*diff( t )
  • c is a time smoothing coefficient such that the time smoothing is a leaky integrator type with a smoothing time of approximately 500 ms.
  • FIG. 3 is a diagram showing a high level overview of a system 35 to detect voice activity status.
  • the signal analysis system 41 can utilize the previously described method, where 2 input signals from a single earphone are used to determine a voice activity status.
  • Alternative methods for determining voice activity can include algorithms using Singular Value Decomposition (SVD) or neural net systems.
  • Singular Value Decomposition Singular Value Decomposition

Abstract

An electronic device or method for adjusting a gain on a voice operated control system can include one or more processors and a memory having computer instructions. The instructions, when executed by the one or more processors causes the one or more processors to perform the operations of receiving a first microphone signal, receiving a second microphone signal, updating a slow time weighted ratio of the filtered first and second signals, and updating a fast time weighted ratio of the filtered first and second signals. The one or more processors can further perform the operations of calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio, comparing the absolute difference with a threshold, and increasing the gain when the absolute difference is greater than the threshold. Other embodiments are disclosed.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This Application claims the priority benefit of Provisional Application No. 62/068,273 filed on Oct. 24, 2014, the entire disclosure of which is incorporated herein by reference
    • FIELD
  • The present embodiments relate to detection of voice activity in noisy environments.
    • BACKGROUND
  • Robust voice activity detection in noisy sound environments is a very difficult problem when using a small device mounted in the ear. Such systems that rely on using fixed thresholds often suffer from false positives and false negatives.
    • SUMMARY
  • A method of adjusting a gain on a voice operated control system can include receiving a first microphone signal, receiving a second microphone signal, updating a slow time weighted ratio of the filtered first and second signals, and updating a fast time weighted ratio of the filtered first and second signals. The method can further include calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio, comparing the absolute difference with a threshold, and increasing the gain when the absolute difference is greater than the threshold. In some embodiments the threshold can be fixed. In some embodiments the method can further include band limiting or band pass filtering the first microphone signal to provide a filtered first signal, band limiting or band pass filtering the second microphone signal to provide a filtered second signal, calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal, and calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal. In some embodiments the threshold is dependent on the slow time weighted average. In some embodiments, the threshold value is set to a time averaged value of the absolute difference and in some embodiments the threshold value is set to the time averaged value of the absolute difference using a leaky integrator used for time smoothing. The step of band limiting or band pass filtering can use a weighted fast Fourier transform operation. In some embodiments, the method can further include determining a current voice activity status based on the comparison step. In some embodiments, the method can further include determining a current voice activity status using Singular Value Decomposition, a neural net system, or a bounded probability value.
  • The embodiments can also include an electronic device for adjusting a gain on a voice operated control system which can include one or more processors and a memory having computer instructions. The instructions, when executed by the one or more processors causes the one or more processors to perform the operations of receiving a first microphone signal, receiving a second microphone signal, updating a slow time weighted ratio of the filtered first and second signals, and updating a fast time weighted ratio of the filtered first and second signals. The one or more processors can further perform the operations of calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio, comparing the absolute difference with a threshold, and increasing the gain when the absolute difference is greater than the threshold. In some embodiments, adjusting or increasing the gain involves adjusting a gain of an overall system or of a total output. In some embodiments, adjusting the gain involves adjusting the gain from a first microphone, from a second microphone or from both. In some embodiments, adjusting the gain involves adjusting the gain at the output of a VAD or comparator or other output. In some embodiments, adjusting the gain can involve any combination of gain adjustment mentioned above.
  • In some embodiments, electronic device can further include the memory having instructions when executed by the one or more processors to cause the one or more processors to perform the operations of band limiting or band pass filtering the first microphone signal to provide filtered first signal, band limiting or band pass filtering the second microphone signal to provide a filtered second signal, calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal, and calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal. In some embodiments the threshold is fixed or the threshold is dependent on the slow time weighted average. In some embodiments, the first microphone signal is received by an ambient signal microphone and the second microphone signal is received by a ear canal microphone. The ambient signal microphone and the ear canal microphone can be part of an earphone device having a sound isolating barrier or a partially sound isolating barrier to isolate the ear canal microphone from an ambient environment. The earphone device can be any number of devices including, but not limited to a headset, earpiece, headphone, ear bud or other type of earphone device. In some embodiments, the sound isolating barrier or partially sound isolating barrier is an inflatable balloon or foam plug. In some embodiments, the memory further includes instructions causing the operation of determining a current voice activity status based on the comparison step. In some embodiments, the memory further includes instructions causing the operation of determining a current voice activity status using Singular Value Decomposition, neural net systems, or a bounded probability value. In some embodiments, the first microphone signal is optionally processed using an analog or a digital band-pass filter and in some embodiments the second microphone signal is optionally processed using an analog or a digital band-pass filter. In some embodiments, at least one characteristic of the first or second microphone signals includes a short-term power estimate.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention may be understood from the following detailed description when read in connection with the accompanying drawing. It is emphasized, according to common practice, that various features of the drawings may not be drawn to scale. On the contrary, the dimensions of the various features may be arbitrarily expanded or reduced for clarity. Moreover, in the drawing, common numerical references are used to represent like features. Included in the drawing are the following figures:
  • FIG. 1 is a block diagram of a voice activity detector system in accordance with an embodiment;
  • FIG. 2 is a flow chart of a method for determining voice activity status in accordance with an embodiment herein; and
  • FIG. 3 is an overview block diagram of a system for determining voice activity status in accordance with an embodiment herein.
    •  DETAILED DESCRIPTION OF THE INVENTION
  • A new method and system is presented to robustly determined voice activity using typically two microphones mounted in a small earpiece. The determined voice activity status can be used to control the gain on a voice operated control system to gate the level of a signal directed to a second voice receiving system. This voice receiving system can be a voice communication system (eg radio or telephone system), a voice recording system, a speech to text system, a voice machine-control system. The gain of the voice operated control system is typically set to zero when no voice active is detected, and set to unity otherwise. The overall data rate in a voice communication system can therefore be adjusted, and large data rate reductions are possible: thereby increasing the number of voice communications channels and/or increasing the voice quality for each voice communication channel. The voice activity status can also be used to adjust the power used in a wireless voice communication system, thereby extending the battery life of the system.
  • FIG. 1 describes an exemplary overview or system 10 of an embodiment in accordance the present invention. In one exemplary embodiment, two microphones in an earphone are used to determine voice activity of the earphone wearer. The first microphone 12 is an ambient sound microphone, detecting sound in the ambient environment of the earphone wearer. The second microphone 13 is an ear-canal microphone detecting sound in the ear canal of the earphone wearer. In a preferred embodiment, the earphone incorporates a sound isolating or a partially sound isolating barrier to isolate the ear canal microphone from the ambient environment, where this barrier can be an inflatable balloon or foam plug. The microphones 12 and 13 can serve as inputs to a voice activity detector or VAD 14. The voice activity detector 14 can provide a VAD status to a gain update module 15. The gain update module 15 and the ear canal microphone 13 can provide inputs to an amplifier 16. The output from the gain update module 15 serves as the voice controller gain input signal to the amplifier 16. The amplifier 16 can provide an output signal 17 which can be used by a speaker 18 for example.
  • FIG. 2 describes a method 20 for determining the status of user voice activity of the earphone system in FIG. 1. The first and second microphone signals are received at 21 and 22 and are band pass filtered (or “band limited”) and a power estimate of these filtered first and second microphone signals are calculated at 23 and 24 respectively. In the preferred embodiment, the band pass filtering is accomplished by a weighted FFT operation, familiar to those skilled in the art, with the signal power estimated between approximately 100 Hz and 2 kHz.

  • P_1(t)=W*FFT(M_1(t)

  • P_2(t)=W*FFT(M_2(t)
    • Where
  • P_1(t) is the weighted power estimate of signal microphone 1 at time t.
  • W is a frequency weighting vector.
  • FFT( ) is a Fast Fourier Transform operation.
  • M_1(t) is the signal from the first microphone at time t.
  • M_2(t) is the signal from the second microphone at time t.
  • A fast-time weighted average of the two band pass filtered power estimates is calculated at 25 and 26 respectively, with a fast time constant which in the preferred embodiment is equal to 45 ms.

  • AV_M1fast(t)=a*AV_M1_fast(t−1)+(a−1)*P_1(t)

  • AV_M2fast(t)=a*AV_M2_fast(t−1)+(a−1)*P_1(t)
    • Where
  • AV_M1_fast(t) is the fast time weighted average of the first band pass filtered microphone signal.
  • AV_M2_fast(t) is the fast time weighted average of the second band pass filtered microphone signal.
  • a is a fast time weighting coefficient.
  • A slow-time weighted average of the two band pass filtered power estimates is calculated at 27 and 28 respectively, with a fast time constant which in the preferred embodiment is equal to 500 ms.

  • AV_M1slow(t)=b*AV_M1_slow(t−1)+(b−1)*P_1(t)

  • AV_M2slow(t)=b*AV_M2_slow(t−1)+(b−1)*P_1(t)
    • Where
  • AV_M1_slow(t) is the slow time weighted average of the first band pass filtered microphone signal.
  • AV_M2_slow(t) is the slow time weighted average of the second band pass filtered microphone signal.
  • b is a slow time weighting coefficient, where a>b.
  • The ratio of the two fast time weighted power estimates is calculated at 30 (i.e., the fast weighted power of the second microphone divided by the fast weighted power of the first microphone).

  • ratio_fast(t)=AV_M2_fast(t)/AV_M1_fast(t)
  • The ratio of the two slow time weighted power estimates is calculated at 29 (ie the slow weighted power of the second microphone divided by the slow weighted power of the first microphone).

  • ratio_slow(t)=AV_M2_slow(t)/AV_M1_slow(t)
  • The absolute difference of the two above ratio values is then calculated at 31.

  • diff(t)=abs(ratio_fast(t)−ratio_slow(t))
  • Note that the updating of the slow time weighted ratio in one embodiment is of the first filtered signal and the second filtered signal where the first filtered signal and the second filtered signal are the slow weighted powers of the first and second microphone signals. Similarly, updating of the fast time weighted ratio is of the first filtered signal and the second filtered signal where the first filtered signal and the second filtered signals are the fast weighted powers of the first and second microphone signals. As noted above, the absolute differences between the fast time weighted ratio and the slow time weighted ratios are calculated to provide a value.
  • This value is then compared with a threshold at 32, and if the value diff(t) is greater than this threshold, then we determine that voice activity is current in an active mode at 33, and the VOX gain value is updated at 34 or in this example increased (up to a maximum value of unity).
  • In one exemplary embodiment the threshold value is fixed.
  • In a second embodiment the threshold value is dependent on the slow weighted level AV_M1 slow.
  • In a third embodiment the threshold value is set to be equal to the time averaged value of the diff(t), for example calculated according to the following:

  • threshold(t)=c*threshold(t−1)+(c−1)*diff(t)
  • where c is a time smoothing coefficient such that the time smoothing is a leaky integrator type with a smoothing time of approximately 500 ms.
  • FIG. 3 is a diagram showing a high level overview of a system 35 to detect voice activity status. The system 35 uses a signal analysis system 41 to analyze at least 2 audio input signals (e.g., 37, 38, 39, and 40) to determine a voice activity status at 42, where this status can be a binary value (e.g., 0=“no voice activity” and 1=“voice activity”, or the status can be a bounded probability value, e.g., between 0% and 100%, where the value is a probability likelihood of voice activity. The signal analysis system 41 can utilize the previously described method, where 2 input signals from a single earphone are used to determine a voice activity status. Alternative methods for determining voice activity can include algorithms using Singular Value Decomposition (SVD) or neural net systems.
  • Although the invention is illustrated and described herein with reference to specific embodiments, the invention is not intended to be limited to the details shown. Rather, various modifications may be made in the details within the scope and range of equivalents of the claims and without departing from the embodiments claimed.

Claims (20)

What is claimed:
1. A method of adjusting a gain on a voice operated control system, comprising:
receiving a first microphone signal;
receiving a second microphone signal;
updating a slow time weighted ratio of the filtered first and second signals;
updating a fast time weighted ratio of the filtered first and second signals;
calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio;
comparing the absolute difference with a threshold; and
increasing the gain when the absolute difference is greater than the threshold.
2. The method of claim 1, wherein the threshold is fixed.
3. The method of claim 1, further comprising:
band limiting or band pass filtering the first microphone signal to provide a filtered first signal;
band limiting or band pass filtering the second microphone signal to provide a filtered second signal;
calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal; and
calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal.
4. The method of claim 3, wherein the threshold is dependent on the slow time weighted average.
5. The method of claim 1, wherein the threshold value is set to a time averaged value of the absolute difference.
6. The method of claim 5, wherein the threshold value is set to the time averaged value of the absolute difference using a leaky integrator used for time smoothing.
7. The method of claim 3, wherein the step of band limiting or band pass filtering uses a weighted fast Fourier transform operation.
8. The method of claim 1, wherein the method further comprises determining a current voice activity status based on the comparison step.
9. The method of claim 1, wherein the method further comprises determining a current voice activity status using Singular Value Decomposition, a neural net system, or a bounded probability value.
10. An electronic device for adjusting a gain on a voice operated control system, comprising:
one or more processors; and
a memory having computer instructions, the instructions when executed by the one or more processors causes the one or more processors to perform the operations of:
receiving a first microphone signal;
receiving a second microphone signal;
updating a slow time weighted ratio of the filtered first and second signals;
updating a fast time weighted ratio of the filtered first and second signals;
calculating an absolute difference between the fast time weighted ratio and the slow time weighted ratio;
comparing the absolute difference with a threshold; and
increasing the gain when the absolute difference is greater than the threshold.
11. The electronic device of claim 10, further comprising instructions when executed by the one or more processors causes the one or more processors to perform the operations of:
band limiting or band pass filtering the first microphone signal to provide filtered first signal;
band limiting or band pass filtering the second microphone signal to provide a filtered second signal;
calculating a power estimate of the filtered first signal including a fast time weighted average and a slow time weighted average of the filtered first signal;
calculating a power estimate of the filtered second signal including a fast time weighted average and a slow time weighed average of the filtered second signal;
Figure US20160118062A1-20160428-P00999
12. The electronic device of claim 11, wherein the threshold is fixed or the threshold is dependent on the slow time weighted average.
13. The electronic device of claim 10, wherein the first microphone signal is received by an ambient signal microphone and the second microphone signal is received by a ear canal microphone.
14. The electronic device of claim 13, wherein the ambient signal microphone and the ear canal microphone are part of a earphone device having a sound isolating barrier or a partially sound isolating barrier to isolate the ear canal microphone from an ambient environment.
15. The electronic device of claim 10, wherein the electronic device is one of a headphone, a headset, an earpiece, or an ear bud.
16. The electronic device of claim 10, further comprising instructions when executed by the one or more processors causing the one or more processors to perform the operation of determining a current voice activity status based on the comparison step.
17. The electronic device of claim 10, wherein the instructions further comprising instructions when executed by the one or more processors to perform the operation of determining a current voice activity status using Singular Value Decomposition, to neural net systems, or a bounded probability value.
18. The electronic device of claim 10, wherein at least one of the first microphone signal or the second microphone signal, or both are processed using an analog or a digital band-pass filter.
19. The electronic device of claim 10, wherein increasing the gain comprises increasing the gain of first microphone signal, the second microphone signal, an output of a voice activity detector, an output of the voice operated control system, an output of the electronic device, or any combination hereof.
20. The electronic device of claim 10, wherein at least one characteristic of the first and second microphone signals comprises a short-term power estimate.
US14/922,475 2014-10-24 2015-10-26 Robust voice activity detector system for use with an earphone Active 2036-02-19 US10163453B2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US14/922,475 US10163453B2 (en) 2014-10-24 2015-10-26 Robust voice activity detector system for use with an earphone
US16/227,695 US10824388B2 (en) 2014-10-24 2018-12-20 Robust voice activity detector system for use with an earphone
US17/013,538 US11693617B2 (en) 2014-10-24 2020-09-05 Method and device for acute sound detection and reproduction
US18/111,671 US20230280965A1 (en) 2014-10-24 2023-02-20 Robust voice activity detector system for use with an earphone

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462068273P 2014-10-24 2014-10-24
US14/922,475 US10163453B2 (en) 2014-10-24 2015-10-26 Robust voice activity detector system for use with an earphone

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/227,695 Continuation US10824388B2 (en) 2014-10-24 2018-12-20 Robust voice activity detector system for use with an earphone

Publications (2)

Publication Number Publication Date
US20160118062A1 true US20160118062A1 (en) 2016-04-28
US10163453B2 US10163453B2 (en) 2018-12-25

Family

ID=55792477

Family Applications (4)

Application Number Title Priority Date Filing Date
US14/922,475 Active 2036-02-19 US10163453B2 (en) 2014-10-24 2015-10-26 Robust voice activity detector system for use with an earphone
US16/227,695 Active US10824388B2 (en) 2014-10-24 2018-12-20 Robust voice activity detector system for use with an earphone
US17/013,538 Active 2036-02-08 US11693617B2 (en) 2014-10-24 2020-09-05 Method and device for acute sound detection and reproduction
US18/111,671 Pending US20230280965A1 (en) 2014-10-24 2023-02-20 Robust voice activity detector system for use with an earphone

Family Applications After (3)

Application Number Title Priority Date Filing Date
US16/227,695 Active US10824388B2 (en) 2014-10-24 2018-12-20 Robust voice activity detector system for use with an earphone
US17/013,538 Active 2036-02-08 US11693617B2 (en) 2014-10-24 2020-09-05 Method and device for acute sound detection and reproduction
US18/111,671 Pending US20230280965A1 (en) 2014-10-24 2023-02-20 Robust voice activity detector system for use with an earphone

Country Status (1)

Country Link
US (4) US10163453B2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160253997A1 (en) * 2015-02-27 2016-09-01 Imagination Technologies Limited Low power detection of a voice control activation phrase
CN108806714A (en) * 2018-07-19 2018-11-13 北京小米智能科技有限公司 The method and apparatus for adjusting volume
WO2019186403A1 (en) * 2018-03-29 2019-10-03 3M Innovative Properties Company Voice-activated sound encoding for headsets using frequency domain representations of microphone signals
CN113099338A (en) * 2021-03-08 2021-07-09 头领科技（昆山）有限公司 Intelligent control's audio chip and wireless earphone of making an uproar that falls
US11164592B1 (en) * 2019-05-09 2021-11-02 Amazon Technologies, Inc. Responsive automatic gain control

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3700411A4 (en) * 2017-10-27 2021-07-28 Ecole de Technologie Supérieure In-ear nonverbal audio events classification system and method
US10972834B1 (en) 2019-10-28 2021-04-06 Amazon Technologies, Inc. Voice detection using ear-based devices

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5459814A (en) * 1993-03-26 1995-10-17 Hughes Aircraft Company Voice activity detector for speech signals in variable background noise
US5533133A (en) * 1993-03-26 1996-07-02 Hughes Aircraft Company Noise suppression in digital voice communications systems
US6088670A (en) * 1997-04-30 2000-07-11 Oki Electric Industry Co., Ltd. Voice detector
US20030012388A1 (en) * 2001-07-16 2003-01-16 Takefumi Ura Howling detecting and suppressing apparatus, method and computer program product
US20030055636A1 (en) * 2001-09-17 2003-03-20 Matsushita Electric Industrial Co., Ltd. System and method for enhancing speech components of an audio signal
US20070126503A1 (en) * 2005-11-25 2007-06-07 Hon Hai Precision Industry Co., Ltd. Audio processing system and method for automatically adjusting volume
US20090016541A1 (en) * 2007-05-04 2009-01-15 Personics Holdings Inc. Method and Device for Acoustic Management Control of Multiple Microphones
US20110035213A1 (en) * 2007-06-22 2011-02-10 Vladimir Malenovsky Method and Device for Sound Activity Detection and Sound Signal Classification
US20120123772A1 (en) * 2010-11-12 2012-05-17 Broadcom Corporation System and Method for Multi-Channel Noise Suppression Based on Closed-Form Solutions and Estimation of Time-Varying Complex Statistics
US20130013304A1 (en) * 2011-07-05 2013-01-10 Nitish Krishna Murthy Method and Apparatus for Environmental Noise Compensation
US20130024194A1 (en) * 2010-11-25 2013-01-24 Goertek Inc. Speech enhancing method and device, and nenoising communication headphone enhancing method and device, and denoising communication headphones
US20130272540A1 (en) * 2010-12-29 2013-10-17 Telefonaktiebolaget L M Ericsson (Publ) Noise suppressing method and a noise suppressor for applying the noise suppressing method
US20130297305A1 (en) * 2012-05-02 2013-11-07 Gentex Corporation Non-spatial speech detection system and method of using same
US20140188467A1 (en) * 2009-05-01 2014-07-03 Aliphcom Vibration sensor and acoustic voice activity detection systems (vads) for use with electronic systems
US20140316774A1 (en) * 2011-12-30 2014-10-23 Huawei Technologies Co., Ltd. Method, Apparatus, and System for Processing Audio Data
US20140341380A1 (en) * 2013-05-16 2014-11-20 Qualcomm Incorporated Automated gain matching for multiple microphones
US20150221322A1 (en) * 2014-01-31 2015-08-06 Apple Inc. Threshold adaptation in two-channel noise estimation and voice activity detection
US20160155448A1 (en) * 2013-07-05 2016-06-02 Dolby International Ab Enhanced sound field coding using parametric component generation

Family Cites Families (218)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3876843A (en) 1973-01-02 1975-04-08 Textron Inc Directional hearing aid with variable directivity
US4088849A (en) 1975-09-30 1978-05-09 Victor Company Of Japan, Limited Headphone unit incorporating microphones for binaural recording
JPS5944639B2 (en) 1975-12-02 1984-10-31 フジゼロツクス カブシキガイシヤ Standard pattern update method in voice recognition method
US4947440A (en) 1988-10-27 1990-08-07 The Grass Valley Group, Inc. Shaping of automatic audio crossfade
US5208867A (en) 1990-04-05 1993-05-04 Intelex, Inc. Voice transmission system and method for high ambient noise conditions
US5267321A (en) 1991-11-19 1993-11-30 Edwin Langberg Active sound absorber
US5887070A (en) 1992-05-08 1999-03-23 Etymotic Research, Inc. High fidelity insert earphones and methods of making same
US5251263A (en) 1992-05-22 1993-10-05 Andrea Electronics Corporation Adaptive noise cancellation and speech enhancement system and apparatus therefor
WO1993026085A1 (en) 1992-06-05 1993-12-23 Noise Cancellation Technologies Active/passive headset with speech filter
US5317273A (en) 1992-10-22 1994-05-31 Liberty Mutual Hearing protection device evaluation apparatus
US5524056A (en) 1993-04-13 1996-06-04 Etymotic Research, Inc. Hearing aid having plural microphones and a microphone switching system
US6553130B1 (en) 1993-08-11 2003-04-22 Jerome H. Lemelson Motor vehicle warning and control system and method
US5479522A (en) * 1993-09-17 1995-12-26 Audiologic, Inc. Binaural hearing aid
US5550923A (en) 1994-09-02 1996-08-27 Minnesota Mining And Manufacturing Company Directional ear device with adaptive bandwidth and gain control
JPH0877468A (en) 1994-09-08 1996-03-22 Ono Denki Kk Monitor device
US5577511A (en) 1995-03-29 1996-11-26 Etymotic Research, Inc. Occlusion meter and associated method for measuring the occlusion of an occluding object in the ear canal of a subject
US5903868A (en) 1995-11-22 1999-05-11 Yuen; Henry C. Audio recorder with retroactive storage
DE19630109A1 (en) 1996-07-25 1998-01-29 Siemens Ag Method for speaker verification using at least one speech signal spoken by a speaker, by a computer
FI108909B (en) 1996-08-13 2002-04-15 Nokia Corp Earphone element and terminal
US5946050A (en) 1996-10-04 1999-08-31 Samsung Electronics Co., Ltd. Keyword listening device
JPH10162283A (en) 1996-11-28 1998-06-19 Hitachi Ltd Road condition monitoring device
US5878147A (en) 1996-12-31 1999-03-02 Etymotic Research, Inc. Directional microphone assembly
US6021325A (en) 1997-03-10 2000-02-01 Ericsson Inc. Mobile telephone having continuous recording capability
US6021207A (en) 1997-04-03 2000-02-01 Resound Corporation Wireless open ear canal earpiece
US6056698A (en) 1997-04-03 2000-05-02 Etymotic Research, Inc. Apparatus for audibly monitoring the condition in an ear, and method of operation thereof
US6163338A (en) 1997-12-11 2000-12-19 Johnson; Dan Apparatus and method for recapture of realtime events
JP3353701B2 (en) 1998-05-12 2002-12-03 ヤマハ株式会社 Self-utterance detection device, voice input device and hearing aid
US6028514A (en) 1998-10-30 2000-02-22 Lemelson Jerome H. Personal emergency, safety warning system and method
US6400652B1 (en) 1998-12-04 2002-06-04 At&T Corp. Recording system having pattern recognition
US6359993B2 (en) 1999-01-15 2002-03-19 Sonic Innovations Conformal tip for a hearing aid with integrated vent and retrieval cord
US6408272B1 (en) 1999-04-12 2002-06-18 General Magic, Inc. Distributed voice user interface
US6549587B1 (en) * 1999-09-20 2003-04-15 Broadcom Corporation Voice and data exchange over a packet based network with timing recovery
US6804638B2 (en) 1999-04-30 2004-10-12 Recent Memory Incorporated Device and method for selective recall and preservation of events prior to decision to record the events
US6920229B2 (en) 1999-05-10 2005-07-19 Peter V. Boesen Earpiece with an inertial sensor
US6163508A (en) 1999-05-13 2000-12-19 Ericsson Inc. Recording method having temporary buffering
GB9922654D0 (en) 1999-09-27 1999-11-24 Jaber Marwan Noise suppression system
FI19992351A (en) 1999-10-29 2001-04-30 Nokia Mobile Phones Ltd voice recognizer
US7444353B1 (en) 2000-01-31 2008-10-28 Chen Alexander C Apparatus for delivering music and information
FR2805072B1 (en) 2000-02-16 2002-04-05 Touchtunes Music Corp METHOD FOR ADJUSTING THE SOUND VOLUME OF A DIGITAL SOUND RECORDING
US7050592B1 (en) 2000-03-02 2006-05-23 Etymotic Research, Inc. Hearing test apparatus and method having automatic starting functionality
GB2360165A (en) 2000-03-07 2001-09-12 Central Research Lab Ltd A method of improving the audibility of sound from a loudspeaker located close to an ear
US20010046304A1 (en) 2000-04-24 2001-11-29 Rast Rodger H. System and method for selective control of acoustic isolation in headsets
US8019091B2 (en) 2000-07-19 2011-09-13 Aliphcom, Inc. Voice activity detector (VAD) -based multiple-microphone acoustic noise suppression
US6567524B1 (en) 2000-09-01 2003-05-20 Nacre As Noise protection verification device
US6754359B1 (en) 2000-09-01 2004-06-22 Nacre As Ear terminal with microphone for voice pickup
US6661901B1 (en) 2000-09-01 2003-12-09 Nacre As Ear terminal with microphone for natural voice rendition
US6748238B1 (en) 2000-09-25 2004-06-08 Sharper Image Corporation Hands-free digital recorder system for cellular telephones
IL149968A0 (en) 2002-05-31 2002-11-10 Yaron Mayer System and method for improved retroactive recording or replay
US20020106091A1 (en) 2001-02-02 2002-08-08 Furst Claus Erdmann Microphone unit with internal A/D converter
US7660424B2 (en) * 2001-02-07 2010-02-09 Dolby Laboratories Licensing Corporation Audio channel spatial translation
US7206418B2 (en) 2001-02-12 2007-04-17 Fortemedia, Inc. Noise suppression for a wireless communication device
FR2820872B1 (en) 2001-02-13 2003-05-16 Thomson Multimedia Sa VOICE RECOGNITION METHOD, MODULE, DEVICE AND SERVER
US20020118798A1 (en) 2001-02-27 2002-08-29 Christopher Langhart System and method for recording telephone conversations
US6647368B2 (en) 2001-03-30 2003-11-11 Think-A-Move, Ltd. Sensor pair for detecting changes within a human ear and producing a signal corresponding to thought, movement, biological function and/or speech
US7158933B2 (en) 2001-05-11 2007-01-02 Siemens Corporate Research, Inc. Multi-channel speech enhancement system and method based on psychoacoustic masking effects
WO2002097590A2 (en) 2001-05-30 2002-12-05 Cameronsound, Inc. Language independent and voice operated information management system
US20030035551A1 (en) 2001-08-20 2003-02-20 Light John J. Ambient-aware headset
JP2003204282A (en) 2002-01-07 2003-07-18 Toshiba Corp Headset with radio communication function, communication recording system using the same and headset system capable of selecting communication control system
US7035091B2 (en) 2002-02-28 2006-04-25 Accenture Global Services Gmbh Wearable computer system and modes of operating the system
US6728385B2 (en) 2002-02-28 2004-04-27 Nacre As Voice detection and discrimination apparatus and method
US20040203351A1 (en) 2002-05-15 2004-10-14 Koninklijke Philips Electronics N.V. Bluetooth control device for mobile communication apparatus
EP1385324A1 (en) 2002-07-22 2004-01-28 Siemens Aktiengesellschaft A system and method for reducing the effect of background noise
US7536305B2 (en) * 2002-09-04 2009-05-19 Microsoft Corporation Mixed lossless audio compression
US7072482B2 (en) 2002-09-06 2006-07-04 Sonion Nederland B.V. Microphone with improved sound inlet port
DE60239534D1 (en) 2002-09-11 2011-05-05 Hewlett Packard Development Co Mobile terminal with bidirectional mode of operation and method for its manufacture
US7003099B1 (en) 2002-11-15 2006-02-21 Fortmedia, Inc. Small array microphone for acoustic echo cancellation and noise suppression
US7892180B2 (en) 2002-11-18 2011-02-22 Epley Research Llc Head-stabilized medical apparatus, system and methodology
US8086093B2 (en) 2002-12-05 2011-12-27 At&T Ip I, Lp DSL video service with memory manager
US20040125965A1 (en) 2002-12-27 2004-07-01 William Alberth Method and apparatus for providing background audio during a communication session
ATE430321T1 (en) 2003-02-25 2009-05-15 Oticon As METHOD FOR DETECTING YOUR OWN VOICE ACTIVITY IN A COMMUNICATION DEVICE
US20040190737A1 (en) 2003-03-25 2004-09-30 Volker Kuhnel Method for recording information in a hearing device as well as a hearing device
US7406179B2 (en) 2003-04-01 2008-07-29 Sound Design Technologies, Ltd. System and method for detecting the insertion or removal of a hearing instrument from the ear canal
US7430299B2 (en) 2003-04-10 2008-09-30 Sound Design Technologies, Ltd. System and method for transmitting audio via a serial data port in a hearing instrument
ATE527829T1 (en) 2003-06-24 2011-10-15 Gn Resound As BINAURAL HEARING AID SYSTEM WITH COORDINATED SOUND PROCESSING
US7433714B2 (en) 2003-06-30 2008-10-07 Microsoft Corporation Alert mechanism interface
US20050058313A1 (en) 2003-09-11 2005-03-17 Victorian Thomas A. External ear canal voice detection
US20090286515A1 (en) 2003-09-12 2009-11-19 Core Mobility, Inc. Messaging systems and methods
AU2003277877B2 (en) 2003-09-19 2006-11-27 Widex A/S A method for controlling the directionality of the sound receiving characteristic of a hearing aid and a signal processing apparatus for a hearing aid with a controllable directional characteristic
US20050071158A1 (en) 2003-09-25 2005-03-31 Vocollect, Inc. Apparatus and method for detecting user speech
US7190795B2 (en) 2003-10-08 2007-03-13 Henry Simon Hearing adjustment appliance for electronic audio equipment
ES2832803T3 (en) 2003-12-05 2021-06-11 3M Innovative Properties Co Method and apparatus for the objective evaluation of the acoustic performance of an in-ear device
DE102004011149B3 (en) 2004-03-08 2005-11-10 Infineon Technologies Ag Microphone and method of making a microphone
US7221902B2 (en) 2004-04-07 2007-05-22 Nokia Corporation Mobile station and interface adapted for feature extraction from an input media sample
US7899194B2 (en) 2005-10-14 2011-03-01 Boesen Peter V Dual ear voice communication device
US7778434B2 (en) 2004-05-28 2010-08-17 General Hearing Instrument, Inc. Self forming in-the-ear hearing aid with conical stent
US8189803B2 (en) 2004-06-15 2012-05-29 Bose Corporation Noise reduction headset
US7275049B2 (en) 2004-06-16 2007-09-25 The Boeing Company Method for speech-based data retrieval on portable devices
US20050281421A1 (en) 2004-06-22 2005-12-22 Armstrong Stephen W First person acoustic environment system and method
US7317932B2 (en) 2004-06-23 2008-01-08 Inventec Appliances Corporation Portable phone capable of being switched into hearing aid function
EP1612660A1 (en) 2004-06-29 2006-01-04 GMB Tech (Holland) B.V. Sound recording communication system and method
US7254535B2 (en) * 2004-06-30 2007-08-07 Motorola, Inc. Method and apparatus for equalizing a speech signal generated within a pressurized air delivery system
JP2006093792A (en) 2004-09-21 2006-04-06 Yamaha Corp Particular sound reproducing apparatus and headphone
US7914468B2 (en) 2004-09-22 2011-03-29 Svip 4 Llc Systems and methods for monitoring and modifying behavior
WO2006036262A2 (en) 2004-09-23 2006-04-06 Thomson Licensing Method and apparatus for controlling a headphone
US7602933B2 (en) 2004-09-28 2009-10-13 Westone Laboratories, Inc. Conformable ear piece and method of using and making same
WO2006037156A1 (en) 2004-10-01 2006-04-13 Hear Works Pty Ltd Acoustically transparent occlusion reduction system and method
US7715577B2 (en) 2004-10-15 2010-05-11 Mimosa Acoustics, Inc. System and method for automatically adjusting hearing aid based on acoustic reflectance
US7348895B2 (en) 2004-11-03 2008-03-25 Lagassey Paul J Advanced automobile accident detection, data recordation and reporting system
WO2006054698A1 (en) 2004-11-19 2006-05-26 Victor Company Of Japan, Limited Video/audio recording apparatus and method, and video/audio reproducing apparatus and method
US7450730B2 (en) 2004-12-23 2008-11-11 Phonak Ag Personal monitoring system for a user and method for monitoring a user
US7529379B2 (en) 2005-01-04 2009-05-05 Motorola, Inc. System and method for determining an in-ear acoustic response for confirming the identity of a user
US20070189544A1 (en) 2005-01-15 2007-08-16 Outland Research, Llc Ambient sound responsive media player
US8160261B2 (en) 2005-01-18 2012-04-17 Sensaphonics, Inc. Audio monitoring system
US20060195322A1 (en) 2005-02-17 2006-08-31 Broussard Scott J System and method for detecting and storing important information
DE102005032274B4 (en) 2005-07-11 2007-05-10 Siemens Audiologische Technik Gmbh Hearing apparatus and corresponding method for eigenvoice detection
US20070127757A2 (en) 2005-07-18 2007-06-07 Soundquest, Inc. Behind-The-Ear-Auditory Device
US7464029B2 (en) 2005-07-22 2008-12-09 Qualcomm Incorporated Robust separation of speech signals in a noisy environment
EP1934828A4 (en) 2005-08-19 2008-10-08 Gracenote Inc Method and system to control operation of a playback device
US7962340B2 (en) 2005-08-22 2011-06-14 Nuance Communications, Inc. Methods and apparatus for buffering data for use in accordance with a speech recognition system
US7707035B2 (en) 2005-10-13 2010-04-27 Integrated Wave Technologies, Inc. Autonomous integrated headset and sound processing system for tactical applications
US8270629B2 (en) 2005-10-24 2012-09-18 Broadcom Corporation System and method allowing for safe use of a headset
US7936885B2 (en) 2005-12-06 2011-05-03 At&T Intellectual Property I, Lp Audio/video reproducing systems, methods and computer program products that modify audio/video electrical signals in response to specific sounds/images
EP1801803B1 (en) 2005-12-21 2017-06-07 Advanced Digital Broadcast S.A. Audio/video device with replay function and method for handling replay function
EP1640972A1 (en) 2005-12-23 2006-03-29 Phonak AG System and method for separation of a users voice from ambient sound
US20070160243A1 (en) 2005-12-23 2007-07-12 Phonak Ag System and method for separation of a user's voice from ambient sound
US7756285B2 (en) 2006-01-30 2010-07-13 Songbird Hearing, Inc. Hearing aid with tuned microphone cavity
EP1985119B1 (en) 2006-02-06 2011-04-20 Koninklijke Philips Electronics N.V. Audio-video switch
US7477756B2 (en) 2006-03-02 2009-01-13 Knowles Electronics, Llc Isolating deep canal fitting earphone
US7903826B2 (en) 2006-03-08 2011-03-08 Sony Ericsson Mobile Communications Ab Headset with ambient sound
US20070253569A1 (en) 2006-04-26 2007-11-01 Bose Amar G Communicating with active noise reducing headset
EP2013871A4 (en) * 2006-04-27 2011-08-24 Technologies Humanware Inc Method for the time scaling of an audio signal
ES2359430T3 (en) 2006-04-27 2011-05-23 Mobiter Dicta Oy PROCEDURE, SYSTEM AND DEVICE FOR THE CONVERSION OF THE VOICE.
WO2007137232A2 (en) 2006-05-20 2007-11-29 Personics Holdings Inc. Method of modifying audio content
US7756281B2 (en) 2006-05-20 2010-07-13 Personics Holdings Inc. Method of modifying audio content
US8208644B2 (en) 2006-06-01 2012-06-26 Personics Holdings Inc. Earhealth monitoring system and method III
US8199919B2 (en) 2006-06-01 2012-06-12 Personics Holdings Inc. Earhealth monitoring system and method II
US8194864B2 (en) 2006-06-01 2012-06-05 Personics Holdings Inc. Earhealth monitoring system and method I
US7502484B2 (en) 2006-06-14 2009-03-10 Think-A-Move, Ltd. Ear sensor assembly for speech processing
US20080031475A1 (en) 2006-07-08 2008-02-07 Personics Holdings Inc. Personal audio assistant device and method
US7280849B1 (en) 2006-07-31 2007-10-09 At & T Bls Intellectual Property, Inc. Voice activated dialing for wireless headsets
US7773759B2 (en) 2006-08-10 2010-08-10 Cambridge Silicon Radio, Ltd. Dual microphone noise reduction for headset application
US20120170412A1 (en) 2006-10-04 2012-07-05 Calhoun Robert B Systems and methods including audio download and/or noise incident identification features
WO2008050583A1 (en) 2006-10-26 2008-05-02 Panasonic Electric Works Co., Ltd. Intercom device and wiring system using the same
US8014553B2 (en) 2006-11-07 2011-09-06 Nokia Corporation Ear-mounted transducer and ear-device
WO2008061260A2 (en) 2006-11-18 2008-05-22 Personics Holdings Inc. Method and device for personalized hearing
US20080130908A1 (en) 2006-12-05 2008-06-05 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Selective audio/sound aspects
DK2127467T3 (en) 2006-12-18 2015-11-30 Sonova Ag Active system for hearing protection
WO2008079112A1 (en) 2006-12-20 2008-07-03 Thomson Licensing Embedded audio routing switcher
US9135797B2 (en) 2006-12-28 2015-09-15 International Business Machines Corporation Audio detection using distributed mobile computing
US7983426B2 (en) 2006-12-29 2011-07-19 Motorola Mobility, Inc. Method for autonomously monitoring and reporting sound pressure level (SPL) exposure for a user of a communication device
US8150044B2 (en) 2006-12-31 2012-04-03 Personics Holdings Inc. Method and device configured for sound signature detection
US20080165988A1 (en) 2007-01-05 2008-07-10 Terlizzi Jeffrey J Audio blending
GB2441835B (en) 2007-02-07 2008-08-20 Sonaptic Ltd Ambient noise reduction system
US7920557B2 (en) 2007-02-15 2011-04-05 Harris Corporation Apparatus and method for soft media processing within a routing switcher
JP5530720B2 (en) 2007-02-26 2014-06-25 ドルビー ラボラトリーズ ライセンシング コーポレイション Speech enhancement method, apparatus, and computer-readable recording medium for entertainment audio
US20080221901A1 (en) 2007-03-07 2008-09-11 Joseph Cerra Mobile general search environment speech processing facility
US8949266B2 (en) 2007-03-07 2015-02-03 Vlingo Corporation Multiple web-based content category searching in mobile search application
US8625819B2 (en) 2007-04-13 2014-01-07 Personics Holdings, Inc Method and device for voice operated control
US8611560B2 (en) 2007-04-13 2013-12-17 Navisense Method and device for voice operated control
WO2008134642A1 (en) 2007-04-27 2008-11-06 Personics Holdings Inc. Method and device for personalized voice operated control
WO2008137872A1 (en) 2007-05-04 2008-11-13 Personics Holdings Inc. Earguard sealing system i: multi-chamber systems
US9191740B2 (en) 2007-05-04 2015-11-17 Personics Holdings, Llc Method and apparatus for in-ear canal sound suppression
US8526645B2 (en) * 2007-05-04 2013-09-03 Personics Holdings Inc. Method and device for in ear canal echo suppression
US8855719B2 (en) 2009-05-08 2014-10-07 Kopin Corporation Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands
US8657064B2 (en) 2007-06-17 2014-02-25 Personics Holdings, Inc. Earpiece sealing system
US8678011B2 (en) 2007-07-12 2014-03-25 Personics Holdings, Inc. Expandable earpiece sealing devices and methods
US20090024234A1 (en) 2007-07-19 2009-01-22 Archibald Fitzgerald J Apparatus and method for coupling two independent audio streams
US8018337B2 (en) 2007-08-03 2011-09-13 Fireear Inc. Emergency notification device and system
WO2009023784A1 (en) 2007-08-14 2009-02-19 Personics Holdings Inc. Method and device for linking matrix control of an earpiece ii
US8047207B2 (en) 2007-08-22 2011-11-01 Personics Holdings Inc. Orifice insertion devices and methods
US20090071487A1 (en) 2007-09-12 2009-03-19 Personics Holdings Inc. Sealing devices
US8718313B2 (en) 2007-11-09 2014-05-06 Personics Holdings, LLC. Electroactive polymer systems
US8855343B2 (en) 2007-11-27 2014-10-07 Personics Holdings, LLC. Method and device to maintain audio content level reproduction
US8251925B2 (en) 2007-12-31 2012-08-28 Personics Holdings Inc. Device and method for radial pressure determination
US9757069B2 (en) 2008-01-11 2017-09-12 Staton Techiya, Llc SPL dose data logger system
US8208652B2 (en) 2008-01-25 2012-06-26 Personics Holdings Inc. Method and device for acoustic sealing
WO2009105677A1 (en) 2008-02-20 2009-08-27 Personics Holdings Inc. Method and device for acoustic sealing
US9113240B2 (en) 2008-03-18 2015-08-18 Qualcomm Incorporated Speech enhancement using multiple microphones on multiple devices
WO2009158624A1 (en) 2008-06-26 2009-12-30 Personics Holdings Inc. Occlusion effect mitigation and sound isolation device for orifice inserted systems
EP2309955A4 (en) 2008-07-06 2014-01-22 Personics Holdings Inc Pressure regulating systems for expandable insertion devices
EP2146519B1 (en) 2008-07-16 2012-06-06 Nuance Communications, Inc. Beamforming pre-processing for speaker localization
US8600067B2 (en) 2008-09-19 2013-12-03 Personics Holdings Inc. Acoustic sealing analysis system
US8243937B2 (en) * 2008-10-03 2012-08-14 Adaptive Sound Technologies, Inc. Adaptive ambient audio transformation
US8280068B2 (en) * 2008-10-03 2012-10-02 Adaptive Sound Technologies, Inc. Ambient audio transformation using transformation audio
US8992710B2 (en) 2008-10-10 2015-03-31 Personics Holdings, LLC. Inverted balloon system and inflation management system
US8554350B2 (en) 2008-10-15 2013-10-08 Personics Holdings Inc. Device and method to reduce ear wax clogging of acoustic ports, hearing aid sealing system, and feedback reduction system
EP2396976A4 (en) 2009-02-13 2013-04-03 Personics Holdings Inc Method and device for acoustic sealing and occlusion effect mitigation
US9138353B2 (en) 2009-02-13 2015-09-22 Personics Holdings, Llc Earplug and pumping systems
US9219964B2 (en) 2009-04-01 2015-12-22 Starkey Laboratories, Inc. Hearing assistance system with own voice detection
US8477973B2 (en) 2009-04-01 2013-07-02 Starkey Laboratories, Inc. Hearing assistance system with own voice detection
US9202456B2 (en) 2009-04-23 2015-12-01 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for automatic control of active noise cancellation
US8407623B2 (en) 2009-06-25 2013-03-26 Apple Inc. Playback control using a touch interface
US20140026665A1 (en) 2009-07-31 2014-01-30 John Keady Acoustic Sensor II
JP5499633B2 (en) 2009-10-28 2014-05-21 ソニー株式会社 REPRODUCTION DEVICE, HEADPHONE, AND REPRODUCTION METHOD
US8437480B2 (en) * 2009-12-17 2013-05-07 Stmicroelectronics Asia Pacific Pte Ltd. Adaptive loudness levelling for digital audio signals
US8437492B2 (en) 2010-03-18 2013-05-07 Personics Holdings, Inc. Earpiece and method for forming an earpiece
CN102884575A (en) 2010-04-22 2013-01-16 高通股份有限公司 Voice activity detection
US9053697B2 (en) 2010-06-01 2015-06-09 Qualcomm Incorporated Systems, methods, devices, apparatus, and computer program products for audio equalization
US20130149192A1 (en) 2011-09-08 2013-06-13 John P. Keady Method and structure for generating and receiving acoustic signals and eradicating viral infections
US8550206B2 (en) 2011-05-31 2013-10-08 Virginia Tech Intellectual Properties, Inc. Method and structure for achieving spectrum-tunable and uniform attenuation
US20180220239A1 (en) 2010-06-04 2018-08-02 Hear Llc Earplugs, earphones, and eartips
US9123323B2 (en) 2010-06-04 2015-09-01 John P. Keady Method and structure for inducing acoustic signals and attenuating acoustic signals
US20140373854A1 (en) 2011-05-31 2014-12-25 John P. Keady Method and structure for achieveing acoustically spectrum tunable earpieces, panels, and inserts
US20160295311A1 (en) 2010-06-04 2016-10-06 Hear Llc Earplugs, earphones, panels, inserts and safety methods
WO2012097150A1 (en) 2011-01-12 2012-07-19 Personics Holdings, Inc. Automotive sound recognition system for enhanced situation awareness
US9037458B2 (en) 2011-02-23 2015-05-19 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for spatially selective audio augmentation
US10356532B2 (en) 2011-03-18 2019-07-16 Staton Techiya, Llc Earpiece and method for forming an earpiece
FR2976111B1 (en) 2011-06-01 2013-07-05 Parrot AUDIO EQUIPMENT COMPRISING MEANS FOR DEBRISING A SPEECH SIGNAL BY FRACTIONAL TIME FILTERING, IN PARTICULAR FOR A HANDS-FREE TELEPHONY SYSTEM
US8838445B1 (en) * 2011-10-10 2014-09-16 The Boeing Company Method of removing contamination in acoustic noise measurements
US8183997B1 (en) 2011-11-14 2012-05-22 Google Inc. Displaying sound indications on a wearable computing system
EP2613566B1 (en) * 2012-01-03 2016-07-20 Oticon A/S A listening device and a method of monitoring the fitting of an ear mould of a listening device
DK2613567T3 (en) * 2012-01-03 2014-10-27 Oticon As Method for improving a long-term feedback path estimate in a listening device
CN103325386B (en) * 2012-03-23 2016-12-21 杜比实验室特许公司 The method and system controlled for signal transmission
US9401685B2 (en) * 2012-06-08 2016-07-26 Apple Inc. Systems and methods for adjusting automatic gain control
US9532139B1 (en) 2012-09-14 2016-12-27 Cirrus Logic, Inc. Dual-microphone frequency amplitude response self-calibration
WO2014046941A1 (en) 2012-09-19 2014-03-27 Dolby Laboratories Licensing Corporation Method and system for object-dependent adjustment of levels of audio objects
US20140278389A1 (en) 2013-03-12 2014-09-18 Motorola Mobility Llc Method and Apparatus for Adjusting Trigger Parameters for Voice Recognition Processing Based on Noise Characteristics
US9741350B2 (en) * 2013-02-08 2017-08-22 Qualcomm Incorporated Systems and methods of performing gain control
US9257952B2 (en) * 2013-03-13 2016-02-09 Kopin Corporation Apparatuses and methods for multi-channel signal compression during desired voice activity detection
US9338551B2 (en) 2013-03-15 2016-05-10 Broadcom Corporation Multi-microphone source tracking and noise suppression
CN104078050A (en) * 2013-03-26 2014-10-01 杜比实验室特许公司 Device and method for audio classification and audio processing
CN104080024B (en) * 2013-03-26 2019-02-19 杜比实验室特许公司 Volume leveller controller and control method and audio classifiers
US9940897B2 (en) 2013-05-24 2018-04-10 Awe Company Limited Systems and methods for a shared mixed reality experience
EP2819429B1 (en) 2013-06-28 2016-06-22 GN Netcom A/S A headset having a microphone
US20160058378A1 (en) 2013-10-24 2016-03-03 JayBird LLC System and method for providing an interpreted recovery score
EP2882203A1 (en) 2013-12-06 2015-06-10 Oticon A/s Hearing aid device for hands free communication
US20150172807A1 (en) 2013-12-13 2015-06-18 Gn Netcom A/S Apparatus And A Method For Audio Signal Processing
US20160165361A1 (en) 2014-12-05 2016-06-09 Knowles Electronics, Llc Apparatus and method for digital signal processing with microphones

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5533133A (en) * 1993-03-26 1996-07-02 Hughes Aircraft Company Noise suppression in digital voice communications systems
US5459814A (en) * 1993-03-26 1995-10-17 Hughes Aircraft Company Voice activity detector for speech signals in variable background noise
US6088670A (en) * 1997-04-30 2000-07-11 Oki Electric Industry Co., Ltd. Voice detector
US20030012388A1 (en) * 2001-07-16 2003-01-16 Takefumi Ura Howling detecting and suppressing apparatus, method and computer program product
US20030055636A1 (en) * 2001-09-17 2003-03-20 Matsushita Electric Industrial Co., Ltd. System and method for enhancing speech components of an audio signal
US20070126503A1 (en) * 2005-11-25 2007-06-07 Hon Hai Precision Industry Co., Ltd. Audio processing system and method for automatically adjusting volume
US20090016541A1 (en) * 2007-05-04 2009-01-15 Personics Holdings Inc. Method and Device for Acoustic Management Control of Multiple Microphones
US20110035213A1 (en) * 2007-06-22 2011-02-10 Vladimir Malenovsky Method and Device for Sound Activity Detection and Sound Signal Classification
US20140188467A1 (en) * 2009-05-01 2014-07-03 Aliphcom Vibration sensor and acoustic voice activity detection systems (vads) for use with electronic systems
US20120123772A1 (en) * 2010-11-12 2012-05-17 Broadcom Corporation System and Method for Multi-Channel Noise Suppression Based on Closed-Form Solutions and Estimation of Time-Varying Complex Statistics
US20130024194A1 (en) * 2010-11-25 2013-01-24 Goertek Inc. Speech enhancing method and device, and nenoising communication headphone enhancing method and device, and denoising communication headphones
US20130272540A1 (en) * 2010-12-29 2013-10-17 Telefonaktiebolaget L M Ericsson (Publ) Noise suppressing method and a noise suppressor for applying the noise suppressing method
US20130013304A1 (en) * 2011-07-05 2013-01-10 Nitish Krishna Murthy Method and Apparatus for Environmental Noise Compensation
US20140316774A1 (en) * 2011-12-30 2014-10-23 Huawei Technologies Co., Ltd. Method, Apparatus, and System for Processing Audio Data
US20130297305A1 (en) * 2012-05-02 2013-11-07 Gentex Corporation Non-spatial speech detection system and method of using same
US20140341380A1 (en) * 2013-05-16 2014-11-20 Qualcomm Incorporated Automated gain matching for multiple microphones
US20160155448A1 (en) * 2013-07-05 2016-06-02 Dolby International Ab Enhanced sound field coding using parametric component generation
US20150221322A1 (en) * 2014-01-31 2015-08-06 Apple Inc. Threshold adaptation in two-channel noise estimation and voice activity detection

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160253997A1 (en) * 2015-02-27 2016-09-01 Imagination Technologies Limited Low power detection of a voice control activation phrase
US9767798B2 (en) * 2015-02-27 2017-09-19 Imagination Technologies Limited Low power detection of a voice control activation phrase
US10115397B2 (en) * 2015-02-27 2018-10-30 Imagination Technologies Limited Low power detection of a voice control activation phrase
US10720158B2 (en) 2015-02-27 2020-07-21 Imagination Technologies Limited Low power detection of a voice control activation phrase
WO2019186403A1 (en) * 2018-03-29 2019-10-03 3M Innovative Properties Company Voice-activated sound encoding for headsets using frequency domain representations of microphone signals
CN111919253A (en) * 2018-03-29 2020-11-10 3M创新有限公司 Voice-controlled sound encoding using frequency domain representation of microphone signals for headphones
AU2019244700B2 (en) * 2018-03-29 2021-07-22 3M Innovative Properties Company Voice-activated sound encoding for headsets using frequency domain representations of microphone signals
RU2756385C1 (en) * 2018-03-29 2021-09-29 3М Инновейтив Пропертиз Компани Voice-activated sound conversion for headsets using the representation of signals of the microphone in the frequency domain
US11418866B2 (en) 2018-03-29 2022-08-16 3M Innovative Properties Company Voice-activated sound encoding for headsets using frequency domain representations of microphone signals
CN108806714A (en) * 2018-07-19 2018-11-13 北京小米智能科技有限公司 The method and apparatus for adjusting volume
US11164592B1 (en) * 2019-05-09 2021-11-02 Amazon Technologies, Inc. Responsive automatic gain control
CN113099338A (en) * 2021-03-08 2021-07-09 头领科技（昆山）有限公司 Intelligent control's audio chip and wireless earphone of making an uproar that falls

Also Published As

Publication number Publication date
US10163453B2 (en) 2018-12-25
US20200401368A1 (en) 2020-12-24
US20190146747A1 (en) 2019-05-16
US11693617B2 (en) 2023-07-04
US10824388B2 (en) 2020-11-03
US20230280965A1 (en) 2023-09-07

Similar Documents

Publication Publication Date Title
US11693617B2 (en) Method and device for acute sound detection and reproduction
US11363390B2 (en) Perceptually guided speech enhancement using deep neural networks
US10535362B2 (en) Speech enhancement for an electronic device
US10848887B2 (en) Blocked microphone detection
CN111149369B (en) On-ear state detection for a headset
KR101260131B1 (en) Audio source proximity estimation using sensor array for noise reduction
US20090010453A1 (en) Intelligent gradient noise reduction system
EP2107558A1 (en) Communication apparatus
WO2009128853A1 (en) Method and device for voice operated control
US11664042B2 (en) Voice signal enhancement for head-worn audio devices
US11553286B2 (en) Wearable hearing assist device with artifact remediation
CN113194372B (en) Earphone control method and device and related components
US10595117B2 (en) Annoyance noise suppression
US11894006B2 (en) Compressor target curve to avoid boosting noise
US9680999B2 (en) Apparatus and method for removing acoustic echo in teleconference system
US20210329389A1 (en) Personal communication device as a hearing aid with real-time interactive user interface
EP4287657A1 (en) Hearing device with own-voice detection

Legal Events

Date Code Title Description
AS Assignment

Owner name: PERSONICS HOLDINGS, LLC, FLORIDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:USHER, JOHN;REEL/FRAME:036921/0181

Effective date: 20150824

AS Assignment

Owner name: DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD., FLORIDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PERSONICS HOLDINGS, INC.;PERSONICS HOLDINGS, LLC;REEL/FRAME:042992/0493

Effective date: 20170620

Owner name: STATON TECHIYA, LLC, FLORIDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.;REEL/FRAME:042992/0524

Effective date: 20170621

Owner name: DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PERSONICS HOLDINGS, INC.;PERSONICS HOLDINGS, LLC;REEL/FRAME:042992/0493

Effective date: 20170620

AS Assignment

Owner name: DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD., FLORIDA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 042992 FRAME: 0493. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:PERSONICS HOLDINGS, INC.;PERSONICS HOLDINGS, LLC;REEL/FRAME:043392/0961

Effective date: 20170620

Owner name: DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 042992 FRAME: 0493. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:PERSONICS HOLDINGS, INC.;PERSONICS HOLDINGS, LLC;REEL/FRAME:043392/0961

Effective date: 20170620

Owner name: STATON TECHIYA, LLC, FLORIDA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 042992 FRAME 0524. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST AND GOOD WILL;ASSIGNOR:DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.;REEL/FRAME:043393/0001

Effective date: 20170621

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4