US9542924B2 - Apparatus, system and method for noise cancellation and communication for incubators and related devices - Google Patents

Apparatus, system and method for noise cancellation and communication for incubators and related devices Download PDF

Info

Publication number
US9542924B2
US9542924B2 US14/965,176 US201514965176A US9542924B2 US 9542924 B2 US9542924 B2 US 9542924B2 US 201514965176 A US201514965176 A US 201514965176A US 9542924 B2 US9542924 B2 US 9542924B2
Authority
US
United States
Prior art keywords
enclosure
noise
incubator
signals
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14/965,176
Other versions
US20160093281A1 (en
Inventor
Sen M. Kuo
Lichuan Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northern Illinois Research Foundation
Original Assignee
Northern Illinois Research Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/952,250 external-priority patent/US8325934B2/en
Application filed by Northern Illinois Research Foundation filed Critical Northern Illinois Research Foundation
Priority to US14/965,176 priority Critical patent/US9542924B2/en
Assigned to BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY reassignment BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KUO, SEN M., LIU, LICHUAN
Assigned to NORTHERN ILLINOIS RESEARCH FOUNDATION reassignment NORTHERN ILLINOIS RESEARCH FOUNDATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY
Publication of US20160093281A1 publication Critical patent/US20160093281A1/en
Priority to US15/365,496 priority patent/US9858915B2/en
Application granted granted Critical
Publication of US9542924B2 publication Critical patent/US9542924B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785Methods, e.g. algorithms; Devices
    • G10K11/17853Methods, e.g. algorithms; Devices of the filter
    • G10K11/17854Methods, e.g. algorithms; Devices of the filter the filter being an adaptive filter
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47GHOUSEHOLD OR TABLE EQUIPMENT
    • A47G9/00Bed-covers; Counterpanes; Travelling rugs; Sleeping rugs; Sleeping bags; Pillows
    • A47G9/10Pillows
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61GTRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G11/00Baby-incubators; Couveuses
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17823Reference signals, e.g. ambient acoustic environment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1783Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions
    • G10K11/17837Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions by retaining part of the ambient acoustic environment, e.g. speech or alarm signals that the user needs to hear
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785Methods, e.g. algorithms; Devices
    • G10K11/17855Methods, e.g. algorithms; Devices for improving speed or power requirements
    • G10K11/1786
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17879General system configurations using both a reference signal and an error signal
    • G10K11/17881General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17885General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/002Damping circuit arrangements for transducers, e.g. motional feedback circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47GHOUSEHOLD OR TABLE EQUIPMENT
    • A47G9/00Bed-covers; Counterpanes; Travelling rugs; Sleeping rugs; Sleeping bags; Pillows
    • A47G2009/006Bed-covers; Counterpanes; Travelling rugs; Sleeping rugs; Sleeping bags; Pillows comprising sound equipment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10Applications
    • G10K2210/108Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081Earphones, e.g. for telephones, ear protectors or headsets
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10Applications
    • G10K2210/116Medical; Dental
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3014Adaptive noise equalizers [ANE], i.e. where part of the unwanted sound is retained

Definitions

  • the present disclosure relates to an electronic enclosure or encasement advantageously configured for an incubator or similar device, where excessive noise may be an issue.
  • the present disclosure relates to an electronic enclosure including active noise control, and communication.
  • Newborn babies, and particularly premature, ill, and low birth weight infants are often placed in special units, such as neonatal intensive care units (NICUs) where they require specific environments for medical attention.
  • Devices such as incubators have greatly increased the survival of very low birth weight and premature infants.
  • high levels of noise in the NICU have been shown to result in numerous adverse health effects, including hearing loss, sleep disturbance and other forms of stress.
  • an important relationship during infancy is the attachment or bonding to a caregiver, such as a mother and/or father. This is due to the fact that this relationship may determine the biological and emotional ‘template’ for future relationships and well-being. It is generally known that healthy attachment to the caregiver through bonding experiences during infancy may provide a foundation for future healthy relationships.
  • the soft palate and epiglottis provide a “double seal,” and liquids can flow around the relatively small larynx into the esophagus while air moves through the nose, through the larynx and trachea into the lungs.
  • the anatomy of the upper airways in newborn infants is “matched” to a neural control system (newborn infants are obligated nose breathers). They normally will not breathe through their mouths even in instances where their noses may be blocked.
  • the unique configuration of the vocal tract is the reason for the extremely nasalized cry of the infant.
  • the cry serves as the primary means of communication for infants. While it is possible for experts (experienced parents and child care specialists) to distinguish infant cries though training and experience, it is difficult for new parents and for inexperienced child care workers to interpret infant cries. Accordingly, techniques are needed to extract audio features from the infant cry so that different communicated states for an infant may be determined.
  • Cry TranslatorTM a commercially available product known in the art, claims to be able to identify five distinct cries: hunger, sleep, discomfort, stress and boredom.
  • An exemplary description of the product may be found in US Pat. Pub. No. 2008/0284409, titled “Signal Recognition Method With a Low-Cost Microcontroller,” which is incorporated by reference herein.
  • Such configurations are less robust, provide limited information, are not necessarily suitable for NICU applications, and do not provide integrated noise reduction.
  • an infant's cry as a diagnostic tool may play an important role in determining infant voice communication, and for determining emotional, pathological and even medical conditions, such as SIDS, problems in developmental outcome and colic, medical problems in which early detection is possible only by invasive procedures such as chromosomal abnormalities, etc. Additionally, related techniques are needed for analyzing medical problems which may be readily identified, but would benefit from an improved ability to define prognosis (e.g., prognosis of long term developmental outcome in cases of prematurity and drug exposure).
  • prognosis e.g., prognosis of long term developmental outcome in cases of prematurity and drug exposure
  • an enclosure such as an incubator and the like, comprising a noise cancellation portion, comprising a controller unit, configured to be operatively coupled to one or more error microphones and a reference sensing unit, wherein the controller unit processes signals received from one or more error microphones and reference sensing unit to reduce noise in an area within the enclose using one or more speakers.
  • the enclosure includes a communications portion, comprising a sound analyzer and transmitter, wherein the communication portion is operatively coupled to the noise cancellation portion, said communications portion being configured to receive a voice signal from the enclosure and transform the voice signal to identify characteristics thereof.
  • a method for providing noise cancellation and communication within an enclosure, where the method includes the steps of processing signals, received from one or more error microphones and reference sensing unit, in a controller of a noise cancellation portion to reduce noise in an area within the enclose using one or more speakers; receiving internal voice signals from the enclosure; transforming the internal voice signals; and identifying characteristics of the voice signals based on the sound analyzing.
  • an enclosure comprising a noise cancellation portion, comprising a controller unit, configured to be operatively coupled to one or more error microphones and a reference sensing unit, wherein the controller unit processes signals received from one or more error microphones and reference sensing unit to reduce noise in an area within the enclose using one or more speakers; a communications portion, comprising a sound analyzer and transmitter, wherein the communication portion is operatively coupled to the noise cancellation portion, said communications portion being configured to receive a voice signal from the enclosure and transform the voice signal to identify characteristics thereof; and a voice input apparatus operatively coupled to the noise cancellation portion, wherein the voice input apparatus is configured to receive external voice signals for reproduction on the one or more speakers.
  • the communications/signal recognition portion described above may be configured to transform the voice signal from a time domain to a frequency domain, wherein the transformation comprises at least one of linear predictive coding (LPC), Mel-frequency cepstral coefficients (MFCC), Bark-frequency cepstral coefficients (BFCC) and short-time zero crossing.
  • LPC linear predictive coding
  • MFCC Mel-frequency cepstral coefficients
  • BFCC Bark-frequency cepstral coefficients
  • the communications portion may be further configured to identify characteristics of the transformed voice signal using at least one of a Gaussian mixture model (GMM), hidden Markov model (HMM), and artificial neural network (ANN).
  • GBM Gaussian mixture model
  • HMM hidden Markov model
  • ANN artificial neural network
  • the enclosure described above may include a voice input operatively coupled to the noise cancellation portion, wherein the voice input is configured to receive external voice signals for reproduction on the one or more speakers, wherein the noise cancellation portion is configured to filter the external voice signals to minimize interference with signals received from one or more error microphones and reference sensing unit for reducing noise in the area within the enclose.
  • FIG. 1 is an exemplary block diagram of a controller unit under one embodiment
  • FIG. 2 is a functional diagram of an exemplary multiple-channel feed-forward ANC system using adaptive FIR filters with the 1 ⁇ 2 ⁇ 2 FXLMS algorithm under one embodiment
  • FIG. 3 illustrates a wireless communication integrated ANC system 300 , combining wireless communication and ANC algorithms for an enclosure under one embodiment
  • FIG. 4 illustrates a general multi-channel ANC system suitable for the embodiment of FIG. 3 under one embodiment
  • FIG. 5 illustrates a general multi-channel ANC system combined with the external voice communication for an enclosure under one exemplary embodiment
  • FIGS. 6A and 6B illustrate spectra of error signals and noise cancellation before and after ANC for error microphones under one exemplary embodiment
  • FIG. 7 is a chart illustrating a relationship between a bit error rate (BER) and signal-to-noise ratios (SNR) under one exemplary embodiment
  • FIG. 8 illustrates an exemplary MFCC feature extraction procedure under one exemplary embodiment
  • FIG. 9 illustrates one effect of convoluting a power spectrum with a Mel scaled triangular filter bank under one embodiment
  • FIG. 10 illustrates an exemplary nonlinear Mel frequency curve under one embodiment
  • FIG. 11 illustrates an exemplary linear vector quantization (LVQ) neural network model Architecture under one embodiment
  • FIGS. 12A-D illustrate various voice feature identification characteristics under one exemplary embodiment.
  • noise reduction may be enabled in an electronic encasement comprising an encasement unit (e.g., pillow) in electrical connection with a controller unit and a reference sensing unit.
  • the encasement unit may comprise at least one error microphone and at least one loudspeaker that are in electrical connection with the controller unit.
  • two error microphones may be used, positioned to be close to the ears of a subject (i.e., human).
  • the error microphones may be configured to detect various signals or noises created by the user and relay these signals to the controller unit for processing.
  • the error microphones may be configured to detect speech sounds from the user when the electronic encasement is used as a hands-free communication device.
  • the error microphones may also be configured to detect noises that the user hears, such as snoring or other environmental noises when the electronic encasement is used for ANC.
  • a quiet zone created by ANC is centered at the error microphones. Accordingly, placing the error microphones inside the encasement below the user's ears, generally around a middle third of the encasement, may ensure that the user is close to the center of a quiet zone that has a higher degree of noise reduction.
  • loudspeakers there may be one or more loudspeakers in the encasement, also preferably configured to be relatively close to the user's ears. More or fewer loudspeakers can be used depending on the desired function. Under a preferred embodiment, the loudspeakers are configured to produce various sounds. For example, the loudspeakers can produce speech sound when the electronic encasement acts as a hands-free communication device, and/or can produce anti-noise to abate any undesired noise. In another example, the loudspeakers can produce audio sound for entertainment or masking of residual noise. Preferably, the loudspeakers are small enough so as not to be noticeable.
  • the controller unit 14 is a signal processing unit for sending and receiving signals as well as processing and analyzing signals.
  • the controller unit 14 may include various processing components such as, but not limited to, a power supply, amplifiers, computer processor with memory, and input/output channels.
  • the controller unit 14 can be contained within an enclosure, discussed in greater detail below (see FIG. 3 ), or it can be located outside of the enclosure.
  • the controller unit 14 further includes a power source 24 .
  • the power source 24 can be AC such as a cord to plug into a wall socket or battery power such as a rechargeable battery pack.
  • the input channels 32 may be analog, and include signal conditioning circuitry, a preamplifier 34 with adequate gain, an anti-aliasing lowpass filter 36 , and an analog-to-digital converter (ADC) 38 .
  • the input channels 32 receive signals (or noise) from the error microphones and the reference microphones.
  • the number of output channels 40 may be equal to the number of loudspeakers in the enclosure.
  • the output channels 40 are preferably analog, and include a digital-to-analog converter (DAC) 42 , smoothing (reconstruction) lowpass filter 44 , and power amplifier 46 to drive the loudspeakers.
  • the output channels 40 are configured to send a signal to the loudspeakers to make sound.
  • Digital signal processing unit (DSP) 48 generally includes a processor with memory. The DSP receives signals from the input channels 32 and sends signals to the output channels 40 . The DSP can also interface (i.e.
  • DSP 48 may also includes one or more algorithms for operation of the electronic enclosure.
  • the algorithm(s) may controls interactions between the error microphones, the loudspeakers, and reference microphones.
  • the algorithm(s) may be one of (a) multiple-channel broadband feed-forward active noise control for reducing noise, (b) adaptive acoustic echo cancellation, (c) signal detection to avoid recording silence periods and sound recognition for non-invasive detection, or (d) integration of active noise control and acoustic echo cancellation.
  • the DSP can also include other functions such as non-invasive monitoring using microphone signals and an alarm to alert or call caregivers for emergency situations.
  • the reference sensing unit includes at least one reference microphone.
  • the reference microphones are wireless for ease of placement, but they can also be wired.
  • the reference microphones are used to detect the particular noise that is desired to be abated and are therefore placed near that sound. For example, if it is desired to abate noises in an enclosure from other rooms that can be heard through a door, the reference microphone may be placed directly on the door.
  • the reference microphone may advantageously be placed near a noise source in order to minimize such noises near an enclosure.
  • an enclosure equipped with noise-cancellation hardware may be used for a variety of methods in conjunction with the algorithms.
  • the enclosure can be used in a method of abating unwanted noise by detecting an unwanted noise with a reference microphone, analyzing the unwanted noise, producing an anti-noise corresponding to the unwanted noise in the enclosure, and abating the unwanted noise.
  • the reference microphone(s) may be placed wherever the noise to be abated is located. These reference microphones detect the unwanted noise and the error microphones 20 detect the unwanted noise levels at the enclosure's location, both reference microphones send signals to the input channels 32 of the controller unit 14 , the signals are analyzed with an algorithm in the DSP, and signals are sent from the output channels 40 to the loudspeakers. The loudspeakers then produce an anti-noise (which may be produced by an anti-noise generator) that abates the unwanted noise.
  • the algorithm of multiple-channel broadband feed-forward active noise control for reducing noise is used to control the enclosure.
  • the enclosure can also be used in a method of communication by sending and receiving sound waves through the enclosure in connection with a communication interface.
  • the method operates essentially as described above; however, the error microphones are used to detect speech and the loudspeakers may broadcast vocal sounds.
  • the algorithm of adaptive acoustic echo cancellation for communications may be used to control the enclosure, as described above, and this algorithm can be combined with active noise control as well.
  • the configuration for the enclosure may be used in a method of recording and monitoring disorders, by recording noises produced by within the enclosure with microphones encased within a pillow. Again, this method operates essentially as described above; however, the error microphones are used to record sounds in the enclosure to diagnose sleep disorders.
  • the algorithm of signal detection to avoid recording silence periods and sound recognition for non-invasive detection is used to control the enclosure.
  • the enclosure can further be used in a method of providing real-time response to emergencies by detecting a noise with a reference microphone in an enclosure, analyzing the noise, and providing real-time response to an emergency indicated by the analyzed noise.
  • the method is performed essentially as described above.
  • Certain noises detected are categorized as potential emergency situations, such as, but not limited to, the cessation of breathing, extremely heavy breathing, choking sounds, and cries for help. Detecting such a noise prompts the performance of real-time response action, such as producing a noise with the loudspeakers, or by notifying caregivers or emergency responders of the emergency. Notification can occur in conjunction with the communications features of the enclosure, i.e.
  • the enclosure may also be used in a method of playing audio sound by playing audio sound through the loudspeakers of the enclosure.
  • the audio sound can be any, such as soothing music or nature sounds. This method can also be used to abate unwanted noise, as the audio sound masks environmental noises. Also, by locating the loudspeakers inside the enclosure, lower volume can be used to play the audio sound.
  • FIG. 2 an exemplary illustration is provided for performing Multiple-Channel Broadband Feed-forward Active Noise Control for an enclosure.
  • a multiple-channel feed-forward ANC system is configured with one reference microphone, two loudspeakers and two error microphones independently.
  • the multiple-channel ANC system uses the adaptive FIR filters with the 1 ⁇ 2 ⁇ 2 FXLMS algorithm.
  • the reference signal x(n) is sensed by reference microphones in the reference sensing unit.
  • Two error microphones located in the pillow unit
  • the system is thus able to form two individual quiet zones centered at the error microphones that are close to the ears of sleeper.
  • the ANC algorithm used two adaptive filters W 1 (z) and W 2 (z) to generate two anti-snores y 1 (n) and y 2 (n) to drive the two independent loudspeakers (also embedded inside the pillow unit).
  • ⁇ 11 (z), ⁇ 12 (z), ⁇ 21 (z), and ⁇ 22 (z) are the estimates of the secondary path transfer functions using both on-line or offline secondary path modeling techniques.
  • FIG. 3 one example of a wireless communication integrated ANC system 300 , combining wireless communication and ANC algorithms for an incubator enclosure is disclosed.
  • the ANC may be configured to cancel unwanted noises and the wireless communication can provide two way communications between parents and infants.
  • the embodiment of FIG. 3 is preferably comprises a sound analysis and communications portion 301 , including (1) a ANC portion ( 302 , 305 , 306 , 311 ) for reducing external noise for the infant incubator, and (2) a wireless communication portion ( 303 , 304 ) integrated with ANC system to provide communication between infants and their parents or caregivers.
  • the desired speech signal such as, mother's voice may be picked up in receiver 302 , processed and played to infant through the loudspeaker 311 inside the incubator.
  • the infant audio signals such as crying, breathing, and cooing, will be picked up by the error microphone inside the incubator 310 , processed, and played externally.
  • the noise abatement of system 300 may be viewed as comprising four modules or units including (1) a noise control acoustic unit, (2) a electronic controller unit, (3) a reference sensors unit, and (4) a communication unit.
  • the noise control acoustic unit includes one or more anti-noise loudspeakers 311 , at least partially operated by anti-noise generator 306 , and microphones (error microphone 307 , and reference microphone 308 ), operatively coupled to an electronic controller which may be part of unit 306 and/or 301 .
  • the controller may include a power supply and amplifiers, a processor with memory, and input/output channels for performing signal processing tasks.
  • the reference sensing unit may comprise wired or wireless microphones ( 308 ), which can be placed outside the incubator 310 for abating outside noise 311 , or alternately on windows for abating environmental noises, or doors for reducing noise from other rooms, or on other known noise sources.
  • the wireless communication unit may include wireless or wired transmitter and receivers ( 302 , 304 ) for communication purposes.
  • FIG. 4 A general multi-channel ANC system suitable for the embodiment of FIG. 3 is illustrated in FIG. 4 , where the embodiment is configured with the assumption that there are J reference sensors (microphones), K secondary sources and M error sensors (microphones).
  • y K ( n )] T where y k (n) is the signal of kth output channel at time n.
  • Both the primary noise d(n) and the cancelling noise d′(n) are vectors with M elements at the locations of M error sensors
  • Primary paths impulse responses ( 402 ) can be expressed by a matrix as
  • P ⁇ ( n ) [ p 11 ⁇ ( n ) p 12 ⁇ ( n ) ... p 1 , J ⁇ ( n ) p 21 ⁇ ( n ) p 22 ⁇ ( n ) ... p 2 , J ⁇ ( n ) ⁇ ⁇ ⁇ ⁇ p M ⁇ ⁇ 1 ⁇ ( n ) p M ⁇ ⁇ 1 ⁇ ( n ) ⁇ p MJ ⁇ ( n ) ]
  • p mj (n) is the impulse response function from the jth reference sensor to the mth error sensor.
  • the matrix of secondary path impulse response functions ( 405 ) may be given by
  • Matrix A(n) may comprise feed-forward adaptive finite impulse response (FIR) filters impulse response functions ( 403 ), which has J inputs, K outputs, and filter order L,
  • the secondary sources may be driven by the summation ( 406 ) of the feed-forward and feedback filters outputs. That is
  • d(n) is the primary noise vector
  • y′(n) is the canceling signal vector at the error sensors.
  • the filter coefficients are iteratively updated to minimize a defined criterion.
  • the sum of the mean square errors may be used as the cost function defined as
  • LMS least mean square
  • a ( n+ 1) A ( n ) ⁇ a X ′( n ) e ( n )
  • ⁇ a and ⁇ b are the step sizes for feedforward and feedback ANC systems, respectively.
  • different values may be used to improve convergence speed:
  • the updated adaptive filter's coefficients can be expressed,
  • FIG. 3 may be advantageously configured to provide a level of communication for an infant.
  • a desired audio signal such as a mother's voice is picked up by receiver 302 , processed, and reproduced to an infant through the anti-noise loudspeaker 311 inside incubator 310 .
  • infant audio signals such as crying, breathing, and cooing, will be picked up by the error microphone 307 inside incubator 310 , processed ( 303 , 304 ), and reproduced via a separate speaker (not shown), where an emotional or physiological state may also be displayed via visual or audio indicia (e.g., screen, lights, automated voice, etc.).
  • This configuration may allow parents outside the NICU to communicate to and listen from the infant inside the incubator, thus improves bonding for parents without visiting NICU with limited time periods.
  • DS/SS direct-sequence spread spectrum
  • OFDM orthogonal frequency-division multiplexing
  • UWB ultra-wideband
  • c(n) is used instead of c(n, l) for simplicity.
  • FIG. 5 An embodiment for combining/integrating ANC with the aforementioned communications is illustrated in FIG. 5 .
  • voice signal v(n) is added to the adaptive filter output y(n), then the mixed signal propagates through the secondary path S(z) to generate anti-noise y′(n).
  • the primary noise d(n) is canceled by the anti-noise, resulting in the error signal e v (n) sensed by the error microphone, which contains the residual noise and the audio signal.
  • the audio signal v(n) is filtered through the secondary-path estimate ⁇ (z) and subtracted from e v (n) to get the true error signal e(n) for updating the adaptive filter A(z).
  • E(z) may be expressed as
  • the integrated ANC system provides audio comfort signal from the wireless communication devices, (ii) it masks residual noise after noise cancellation, (iii) it eliminates the interference of audio on the performance of ANC system, and (iv) it integrates with the existing ANC's audio hardware such as amplifiers and loudspeakers for saving overall system cost.
  • the spectra of error signals before and after ANC at the error microphones are illustrated in FIGS. 6A and 6B . It can be seen that there is a meaningful reduction of the recorded incubator noises over the entire frequency range of interest. Average noise cancellation was found to be 30 dB at a first error microphone ( FIG. 6A ), and 35 dB at a second error microphone ( FIG. 6B ).
  • FIG. 7 illustrates the BER vs. SNR results, where it can be seen that the results shows a good match with the analytical result.
  • sound analysis can be performed on the emanating audio signal (e.g., cry, coo, etc.) in order to characterize a voice signal.
  • a baby cry and similar voice communication
  • short time analysis and threshold method are used to detect the pair of boundary points-start point and end point of each cry word.
  • Feature extraction of each baby cry word is important in classification and recognition, and numerous algorithms can be used to extract features, such as: linear predictive coding (LPC), Mel-frequency cepstral coefficients (MFCC), Bark-frequency cepstral coefficients (BFCC), and some other frequency extraction of stationary features.
  • LPC linear predictive coding
  • MFCC Mel-frequency cepstral coefficients
  • BFCC Bark-frequency cepstral coefficients
  • 10 order Mel-frequency cepstral coefficient (MFCC-10) having 10 coefficients is used as a feature pattern for each cry word. It should be understood by those skilled in the art that other numbers of coefficients may be used as well.
  • ANN is utilized for baby cry causes recognition.
  • GMM Gaussian Mixture Model
  • HMM Hidden Markov Models
  • ANN Artificial Neural Network
  • ANN is utilized for baby cry causes recognition.
  • ANN imitates how human brain neurons work to perform certain task, and it can be considered as a parallel processing network system with a large number of connections.
  • ANN can learn a rule from examples and generalize relationships between inputs and outputs, or in other words, find patterns of data.
  • a Learning Vector Quantization (LVQ) model can be used to implement the classification of multi-class issue.
  • LVQ Learning Vector Quantization
  • the objective of using LVQ ANN model for baby-cry-cause recognition is to develop a plurality (e.g., 3) feature patterns which represent cluster centroids of each baby-cry-cause: draw attention cry, wet diaper cry, and hungry cry, as an example.
  • a speech signal of comprehensible length is typically a non-stationary signal that cannot be processed by stationary signal processing methods. However, during a limited short-time interval, the speech waveform can be considered stationary. Because of the physical limitation of human vocal cord vibration, in practical applications 10-30 milliseconds (ms) duration interval may used to complete short-time speech analysis, although other intervals may be used as well.
  • a speech signal may be thought of as comprising a voiced speech component with vocal cord vibration and an unvoiced speech component without vocal cord vibration.
  • a cry word can be defined as the speech waveform duration between a start point and an end point of a voiced speech component. Voiced speech and unvoiced speech have different short-time characteristics, which can be used to detect the boundary points of baby cry words.
  • Short-time energy is defined as the average of the square of the sample values in a suitable window, which may be expressed as:
  • w(m) the window coefficient correspond with signal sample
  • N window length.
  • w(m) the window coefficient correspond with signal sample
  • STE short-time energy
  • a Hamming window may be chosen as it minimizes the maximum side lobe in the frequency domain and can be described as:
  • short-time processing of speech may preferably take place during segments between 10-30 ms in length.
  • a window of 128 samples may be used.
  • STE estimation is useful as a speech detector because there is a noticeable difference between the average energy between voiced and unvoiced speech, and between speech and silence. Accordingly, this technique may be paired with short-time zero crossing for a robust detection scheme.
  • STZC Short-time zero crossing
  • STZC estimation is useful as a speech detector because there are noticeable fewer zero crossings in voiced speech as compared with unvoiced speech.
  • STZC is advantageous in that it is capable of predicting cry signal start and endpoints.
  • Significant short-time zero crossing effectively describes the envelope of a non-silent signal and combined with short-time energy, can effectively track instances of potentially voiced signals that are the signals of interest for analysis.
  • a desired cry may be defined as a voiced segment of sufficiently long duration. Two quantifiable threshold conditions that are needed to be met to constitute a desired voiced may be:
  • a window length N may be chosen as 128, which translates to a 17.4 ms short-time interval.
  • the STE In order to detect the boundary points of cry words by setting a proper threshold value, the STE must be normalized into range from 0 to 1 by dividing the maximum STE value of whole duration. To eliminate unvoiced artifact of low STE or very short duration high energy impulse, two quantifiable thresholds should be set to detect the cry word boundary points. Those two threshold conditions are:
  • Short-time segment of speech can be considered stationary.
  • Stationary feature extraction techniques can be compartmentalized into either cepstral based (taking the Fourier transform of the decibel spectrum) or linear predictor (determining the current speech sample based on a linear combination of prior samples) based algorithms.
  • the mel-frequency cepstrum MFC
  • MFC mel-frequency cepstrum
  • MFCC Mel-frequency cepstral coefficients
  • the mel frequency cepstrum is a representation of the short-time power spectrum of a sound based on a linear cosine transform of a log spectrum on a non-linear mel scale of frequency.
  • the mel scale is a perceptual scale of pitches. It is based upon the human perception of the separation on a scale of pitches.
  • the reference of the mel scale with standard frequency may be defined by 1000 Hz tone 40 dB above the listeners threshold and is equivalent to a pitch of 1000 mels.
  • What the mel frequency cepstrum provides is a tool that describes the tonal characteristics of a signal that is warped such that it better matches human perceptual hearing of tones (or pitches).
  • the conversion between mel (m) and Hertz (f) can be described as
  • the mel frequency cepstrum may be obtained through the following steps.
  • the frequency portion of the spectrum is then mapped to the mel scale perceptual filter bank with the equation above using 18 triangle band pass filters equally spaced on the mel range of frequency F(m).
  • These triangle band pass filters smooth the magnitude spectrum such that the harmonics are flattened in order to obtain the envelope of the spectrum with harmonics. This indicates that the pitch of a speech signal is generally not present in MFCC.
  • a recognition system will behave more or less the same when the input utterances are of the same timbre but with different tones/pitch. This also serves to reduce the size of the features involved, making the classification simpler.
  • MFCC frequency cepstrum
  • the power cepstrum may possesses the same sampling rate as the signal, so the MFLPCC is obtained by performing an LPC algorithm on the power cepstrum in 128 sample frames.
  • the MFLPCC encodes the cepstrum waveform in a more compact fashion that may make it more suitable for a baby cry classification scheme.
  • FIG. 8 An exemplary MFCC feature extract procedure is illustrated in FIG. 8 .
  • the procedure shown in the figure can be implemented step by steps as follows:
  • the number of subband filters is 10, and P(k) are binned onto the mel scaled frequency using 10 overlapped triangular filter.
  • binning means that each P(k) is multiplied by the corresponding filter gain and the results accumulated as energy in each band.
  • the relationship between frequency and Mel scale can be expressed as follows:
  • a Linear vector quantization (LVQ) neural network model is used.
  • a self organizing neural network has the ability to assess the input patterns presented to the network, organize itself to learn from the collective set of inputs, and categorize them into groups of similar patterns.
  • self-organized learning involves the frequent modification of the network's synaptic weights in response to a set of input patterns.
  • LVQ is such a self organizing neural network model that can be used to classify the different baby cry causes.
  • LVQ may be considered a kind of feed-forward ANN, and is advantageously used in areas of pattern recognition or optimization.
  • the objective of classification is to determine a general feature pattern that is a kind of MFCC “codebook” from example training feature data for a specific baby cry cause, such as “draw attention” cry, “need to change wet diaper” cry, “hungry” cry, etc. Subsequently the unknown cause baby cry may be recognized by finding out the shortest distance between the input unknown cry word MFCC-10 feature vector and every class “codebook” respectively.
  • a LVQ algorithm may be used to complete a baby-cry-cause classification, where a plurality of baby-cry-causes may be taken into consideration (e.g., draw attention, diaper change needed, hungry, etc.).
  • a plurality of baby-cry-causes may be taken into consideration (e.g., draw attention, diaper change needed, hungry, etc.).
  • an exemplary LVQ neural network would have a plurality (e.g., 3) output classes which would corresponding to the main baby-cry-causes:
  • FIG. 11 An exemplary LVQ architecture is shown in FIG. 11 .
  • W 1 [w 1 1 w 1 2 . . . w 1 10 ] T represents the pattern “codebook” of draw attention cry
  • W 2 [w 2 1 w 2 2 . . . w 2 10 ] T represents the pattern “codebook” of diaper change needed cry
  • W 3 [w 3 1 w 3 2 . . . w 3 10 ] T represents the pattern “codebook” of hungry cry.
  • the exemplary LVQ neural network model may be trained using the follows steps:
  • FIGS. 12A-C The “draw attention cry words,” “diaper change needed cry words,” and “hungry cry words” MFCC-10 features of 4 different babies are illustrated in FIGS. 12A-C , respectively.
  • the value of weights vectors W 1 , W 2 , W 3 which present the centroid of each different cause class are fixed, and the centroid curves of each class are shown in FIG. 12D .
  • linear predictive coding may be utilized to obtain baby cry characteristics.
  • the waveforms of two similar sounds will also show similar characteristics. If two infant cries have very similar waveforms, it stands to reason that they should possess the same impetus. However, it is impractical to conduct a sample by sample full comparison between cry signals due to the complexity inherent in having audio signals of around 1 second in length at a sampling rate of 8 kHz. In order to improve the solution of the time domain comparison of infant cry signals, linear predictive coding (LPC) is applied.
  • acoustic sources associated with voiced and unvoiced speech, respectively.
  • Voiced speech is caused by the vibration of the vocal cords in response to airflow from the lung and this vibration is periodic in nature while unvoiced speech is caused by constrictions in the air tract resulting in random airflow.
  • the basis of the source-filter model of speech is that speech can be synthesized by generating an acoustic source and passing it through an all-pole filter.
  • the linear predictive coding (LPC) algorithm produces a vector of coefficients that represent a spectral shaping filter.
  • An input signal to this filter is either a pitch train for voiced sounds, or white noise for unvoiced sounds.
  • This shaping filter may be an all-pole filter represented as:
  • a present sample of speech may be represented as a linear combination of the past M samples of the speech such that:
  • the error between the actual and predicted signal can be defined as
  • R [ R ⁇ ( 0 ) R ⁇ ( 1 ) ... R ⁇ ( n - 1 ) R ⁇ ( 1 ) R ⁇ ( 0 ) ⁇ ⁇ ⁇ ⁇ ⁇ R ⁇ ( n - 1 ) ... ... R ⁇ ( 0 ) ]
  • This can be achieved by using a Toeplitz autocorrelation matrix R to find the LPC parameters and using the Levinson-Durbin recursion to solve the Toeplitz matrix.
  • LPCC LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ LPCC - ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇
  • 10 LPCC or LPC-10 may be used to describe each 128 sample frame which corresponds to 16 ms and is assumed to be short-time stationary. Instead of computing the difference between windowed segments of 128 samples in length, only comparisons of segments of the LPC-10 values are needed. Furthermore, during signal preprocessing, a first order low pass filter can be used to brighten the signal such that components due to non-vocal tract speech can be attenuated.
  • cepstrum analysis may be used to obtain baby cry characteristics.
  • F ⁇ ⁇ the Fourier transform of the log spectrum as if it were a signal as well.
  • 2 the cepstrum provides information about the rate of change in the different spectrum bands. This attribute can be exploited as a pitch detector.
  • Cepstrum pitch determination is particularly effective because the effects of the vocal excitation (pitch) and vocal tract (formants) are additive in the logarithm of the power spectrum and thus clearly separate. This trait makes cepstrum analysis of audio signals more robust than processing normal frequency or time domain samples.
  • Another technique used to improve the accuracy of feature extraction of cepstrum based techniques is liftering. Liftering applies a low order low pass filter to the cepstrum in order to smooth it out and help with the Discrete Cosine Transform (DCT) analysis for feature extraction techniques in ensuing sections.
  • DCT Discrete Cosine Transform
  • LPCC linear predictive cepstral coefficients
  • LPCCs may be used for audio feature extraction. LPCCs may be obtained by applying linear predictive coding on the cepstrum.
  • the cepstrum is a measure of the rate of change in spectrum bands over windowed segments of individual cries. Applying LPC to the cepstrum yields a vector of values for a 10-tap filter that would synthesize the cepstrum wave form.
  • the bark frequency cepstral coefficients warps the power cepstrum such that it matches human perception of loudness.
  • the methodology of obtaining the BFCC is similar to that of the MFCC except for two differences.
  • the frequencies are converted to bark scale according to:
  • b 13 ⁇ ⁇ tan - 1 ⁇ ( .00076 ⁇ f ) + 3.5 ⁇ ⁇ tan - 1 ⁇ [ ( f 7500 ) 2 ] , where b denotes bark frequency and f is frequency in hertz.
  • the mapped bark frequency is passed through a plurality (e.g., 18) of triangle band pass filters.
  • the center frequencies of these triangular band pass filters correspond to the first 18 of the 24 critical frequency bands of hearing (where the band edges are at 20, 100, 200, 300, 400, 510, 630, 770, 920, 1080, 1270, 1480, 1720, 2000, 2320, 2700, 3150, 3700, 4400, 5300, 6400, 7700, 9500, 12000 and 15500 Hz). This is done because frequencies above 4 kHz may be attenuated by the low pass anti-aliasing filter described in signal preprocessing. This also allows for a more comparable comparison between the MFLPCC and BFLPCC later on.
  • the BFCC is obtained by taking the DCT of the bark frequency cepstrum and the 10 DCT coefficients describe the amplitudes of the cepstrum.
  • the power cepstrum also possesses the same sampling rate as the signal, so the BFLPCC is obtained by performing the LPC algorithm on the power cepstrum in 128 sample frames.
  • the BFLPCC encodes the cepstrum waveform in a more compact fashion that may make it more suitable for a baby-cry classification scheme.
  • Kalman filters may be utilized for baby voice feature extraction.
  • One characteristic of analog generated sources of noise is that no two signals are identical. As similar as two sounds may be, they will inherently vary to some degree in pitch, volume and intonation. Regardless, it can be said that adjoining infant cries are highly similar and most likely have the same meaning.
  • Kalman filter formulation may be used.
  • x(n) is arranged as an AR(p) (auto-regressive process of order p), it may be generated according to
  • T is a vector noise process and c is a unit vector of length p.
  • the present disclosure provides innovative systems, apparatuses and methods for electronic devices that integrate active noise control (ANC) techniques for abating environmental noises, with a communication system that communicates to and from an infant.
  • ANC active noise control
  • the wireless communication system can also provide communication between infants to their parents/caregivers/nurses, patients/family members/nurses/physicians, and also provide intelligent digital monitoring hat provide non-invasive detection and classification of infant's audio signals/other audio signals.

Abstract

Systems, apparatuses and methods for integrating adaptive noise cancellation (ANC) with communication features in an enclosure, such as an incubator, bed, and the like. Utilizing one or more error and reference microphones, a controller for a noise cancellation portion reduces noise within a quiet area of the enclosure. Voice communications are provided to allow external voice signals to be transmitted to the enclosure with minimized interference with noise processing. Vocal communications from within the enclosure may be processed to determine certain characteristics/features of the vocal communications. Using these characteristics, certain emotive and/or physiological states may be identified.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 13/837,242, titled “Apparatus, System and Method for Noise Cancellation and Communication For Incubators and Related Devices,” filed on Apr. 23, 2013, which is a continuation-in part of U.S. patent application Ser. No. 13/673,005, titled “Encasement for Abating Environmental Noise, Hand-Free Communication and Non-Invasive Monitoring and Recording,” filed on Nov. 9, 2012, which is a continuation of U.S. patent application Ser. No. 11/952,250 (now U.S. Pat. No. 8,325,934), titled “Electronic Pillow for Abating Snoring/Environmental Noises, Hands-Free Communications, And Non-Invasive Monitoring And Recording,” filed Dec. 7, 2007. The disclosures set forth in the referenced applications are incorporated herein by reference in their entireties.
This invention was made with government support under grant number 7R03DC009673-04 awarded by the National Institutes of Health. The U. S. Government has certain rights in the invention.
BACKGROUND
The present disclosure relates to an electronic enclosure or encasement advantageously configured for an incubator or similar device, where excessive noise may be an issue. In particular, the present disclosure relates to an electronic enclosure including active noise control, and communication.
In U.S. patent application Ser. No. 11/952,250, referenced above and assigned to the assignee of the present application, techniques were disclosed for abating noise, such as snoring, in the vicinity of a human head by utilizing Adaptive Noise Control (ANC). More specifically, utilizing a multiple-channel feed-forward ANC system using adaptive FIR filters with an 1×2×2 FXLMS algorithm, a noise suppression system may be particularly effective at reducing snoring noises. While noise suppression is desirous for adult humans, special requirements may be needed in the cases of babies, infants, and other life forms that may have sensitivity to noise.
Newborn babies, and particularly premature, ill, and low birth weight infants are often placed in special units, such as neonatal intensive care units (NICUs) where they require specific environments for medical attention. Devices such as incubators have greatly increased the survival of very low birth weight and premature infants. However, high levels of noise in the NICU have been shown to result in numerous adverse health effects, including hearing loss, sleep disturbance and other forms of stress. At the same time, an important relationship during infancy is the attachment or bonding to a caregiver, such as a mother and/or father. This is due to the fact that this relationship may determine the biological and emotional ‘template’ for future relationships and well-being. It is generally known that healthy attachment to the caregiver through bonding experiences during infancy may provide a foundation for future healthy relationships. However, infants admitted to an NICU may lose such experiences in their earliest life due to limited interaction their parents due to noise and/or means of communication. Therefore, it is important to reduce noise level inside incubator and increase bonding opportunities for NICU babies and their parents. In addition, there are advantages for newborns inside the incubators to hear their mothers' voice which can help release the stress and improve language development. Communicating with NICU babies can also benefit the new mothers, such as, preventing postpartum depression, improving bonding, etc.
Regarding communication, it would be advantageous to provide “cues” to a caregiver based on an infant's cry, so that the infant may be understood, albeit on a rudimentary level. These cues may be advantageous for interpreting a likely condition of the infant via its vocal communication. Unlike adults, the airways of newborn infants are quite different from those of adults. The larynx in newborn infants is positioned close to the base of the skull. The high position of the larynx in the newborn is similar to its position in other animals and allows the newborn human to form a sealed airway from the nose to the lungs. The soft palate and epiglottis provide a “double seal,” and liquids can flow around the relatively small larynx into the esophagus while air moves through the nose, through the larynx and trachea into the lungs. The anatomy of the upper airways in newborn infants is “matched” to a neural control system (newborn infants are obligated nose breathers). They normally will not breathe through their mouths even in instances where their noses may be blocked. The unique configuration of the vocal tract is the reason for the extremely nasalized cry of the infant.
From one perspective, the increasing alertness and decreasing crying as part of the sleep/wakefulness cycle suggests that there may be a balanced exchange between crying and attention. The change from sleep/cry to sleep/alert/cry necessitates the development of control mechanisms to modulate arousal. The infant must increase arousal more gradually, in smaller increments, to maintain states of attention for longer periods. Crying is a heightened state of arousal produced by nervous system excitation triggered by some form of perceived threat, such as hunger, pain, or sickness, or individual differences in thresholds for stimulation. Crying is modulated and developmentally facilitated by control mechanisms to enable the infant to maintain non-crying states.
The cry serves as the primary means of communication for infants. While it is possible for experts (experienced parents and child care specialists) to distinguish infant cries though training and experience, it is difficult for new parents and for inexperienced child care workers to interpret infant cries. Accordingly, techniques are needed to extract audio features from the infant cry so that different communicated states for an infant may be determined. Cry Translator™, a commercially available product known in the art, claims to be able to identify five distinct cries: hunger, sleep, discomfort, stress and boredom. An exemplary description of the product may be found in US Pat. Pub. No. 2008/0284409, titled “Signal Recognition Method With a Low-Cost Microcontroller,” which is incorporated by reference herein. However, such configurations are less robust, provide limited information, are not necessarily suitable for NICU applications, and do not provide integrated noise reduction.
Accordingly, there is a need for infant voice analysis, as well as a need to coupled voice analysis with noise reduction. Using an infant's cry as a diagnostic tool may play an important role in determining infant voice communication, and for determining emotional, pathological and even medical conditions, such as SIDS, problems in developmental outcome and colic, medical problems in which early detection is possible only by invasive procedures such as chromosomal abnormalities, etc. Additionally, related techniques are needed for analyzing medical problems which may be readily identified, but would benefit from an improved ability to define prognosis (e.g., prognosis of long term developmental outcome in cases of prematurity and drug exposure).
SUMMARY
Under one exemplary embodiment, an enclosure, such as an incubator and the like, is disclosed comprising a noise cancellation portion, comprising a controller unit, configured to be operatively coupled to one or more error microphones and a reference sensing unit, wherein the controller unit processes signals received from one or more error microphones and reference sensing unit to reduce noise in an area within the enclose using one or more speakers. The enclosure includes a communications portion, comprising a sound analyzer and transmitter, wherein the communication portion is operatively coupled to the noise cancellation portion, said communications portion being configured to receive a voice signal from the enclosure and transform the voice signal to identify characteristics thereof.
In another exemplary embodiment, a method is disclosed for providing noise cancellation and communication within an enclosure, where the method includes the steps of processing signals, received from one or more error microphones and reference sensing unit, in a controller of a noise cancellation portion to reduce noise in an area within the enclose using one or more speakers; receiving internal voice signals from the enclosure; transforming the internal voice signals; and identifying characteristics of the voice signals based on the sound analyzing.
In a further exemplary embodiment, an enclosure is disclosed comprising a noise cancellation portion, comprising a controller unit, configured to be operatively coupled to one or more error microphones and a reference sensing unit, wherein the controller unit processes signals received from one or more error microphones and reference sensing unit to reduce noise in an area within the enclose using one or more speakers; a communications portion, comprising a sound analyzer and transmitter, wherein the communication portion is operatively coupled to the noise cancellation portion, said communications portion being configured to receive a voice signal from the enclosure and transform the voice signal to identify characteristics thereof; and a voice input apparatus operatively coupled to the noise cancellation portion, wherein the voice input apparatus is configured to receive external voice signals for reproduction on the one or more speakers.
In still further exemplary embodiments, the communications/signal recognition portion described above may be configured to transform the voice signal from a time domain to a frequency domain, wherein the transformation comprises at least one of linear predictive coding (LPC), Mel-frequency cepstral coefficients (MFCC), Bark-frequency cepstral coefficients (BFCC) and short-time zero crossing. The communications portion may be further configured to identify characteristics of the transformed voice signal using at least one of a Gaussian mixture model (GMM), hidden Markov model (HMM), and artificial neural network (ANN). In yet another exemplary embodiment, the enclosure described above may include a voice input operatively coupled to the noise cancellation portion, wherein the voice input is configured to receive external voice signals for reproduction on the one or more speakers, wherein the noise cancellation portion is configured to filter the external voice signals to minimize interference with signals received from one or more error microphones and reference sensing unit for reducing noise in the area within the enclose.
BRIEF DESCRIPTION OF THE DRAWINGS
Other advantages will be readily appreciated as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:
FIG. 1 is an exemplary block diagram of a controller unit under one embodiment;
FIG. 2 is a functional diagram of an exemplary multiple-channel feed-forward ANC system using adaptive FIR filters with the 1×2×2 FXLMS algorithm under one embodiment;
FIG. 3 illustrates a wireless communication integrated ANC system 300, combining wireless communication and ANC algorithms for an enclosure under one embodiment;
FIG. 4 illustrates a general multi-channel ANC system suitable for the embodiment of FIG. 3 under one embodiment;
FIG. 5 illustrates a general multi-channel ANC system combined with the external voice communication for an enclosure under one exemplary embodiment;
FIGS. 6A and 6B illustrate spectra of error signals and noise cancellation before and after ANC for error microphones under one exemplary embodiment;
FIG. 7 is a chart illustrating a relationship between a bit error rate (BER) and signal-to-noise ratios (SNR) under one exemplary embodiment;
FIG. 8 illustrates an exemplary MFCC feature extraction procedure under one exemplary embodiment;
FIG. 9 illustrates one effect of convoluting a power spectrum with a Mel scaled triangular filter bank under one embodiment;
FIG. 10 illustrates an exemplary nonlinear Mel frequency curve under one embodiment;
FIG. 11 illustrates an exemplary linear vector quantization (LVQ) neural network model Architecture under one embodiment; and
FIGS. 12A-D illustrate various voice feature identification characteristics under one exemplary embodiment.
DETAILED DESCRIPTION
As is known from U.S. patent application Ser. No. 11/952,250, noise reduction may be enabled in an electronic encasement comprising an encasement unit (e.g., pillow) in electrical connection with a controller unit and a reference sensing unit. The encasement unit may comprise at least one error microphone and at least one loudspeaker that are in electrical connection with the controller unit. Under a preferred embodiment, two error microphones may be used, positioned to be close to the ears of a subject (i.e., human). The error microphones may be configured to detect various signals or noises created by the user and relay these signals to the controller unit for processing. For example, the error microphones may be configured to detect speech sounds from the user when the electronic encasement is used as a hands-free communication device. The error microphones may also be configured to detect noises that the user hears, such as snoring or other environmental noises when the electronic encasement is used for ANC. A quiet zone created by ANC is centered at the error microphones. Accordingly, placing the error microphones inside the encasement below the user's ears, generally around a middle third of the encasement, may ensure that the user is close to the center of a quiet zone that has a higher degree of noise reduction.
Additionally, there may be one or more loudspeakers in the encasement, also preferably configured to be relatively close to the user's ears. More or fewer loudspeakers can be used depending on the desired function. Under a preferred embodiment, the loudspeakers are configured to produce various sounds. For example, the loudspeakers can produce speech sound when the electronic encasement acts as a hands-free communication device, and/or can produce anti-noise to abate any undesired noise. In another example, the loudspeakers can produce audio sound for entertainment or masking of residual noise. Preferably, the loudspeakers are small enough so as not to be noticeable. There are advantages to placing the loudspeakers relatively close to ears of a user, as the level of anti-noise generated by the loudspeakers is maximized compared to configurations where loudspeakers are placed in more remote locations. Lower noise levels also tend to reduce power consumption and reduce undesired acoustic feedback from the loudspeakers back to the reference sensing unit. The configurations described above may be equally applicable to enclosures, such as an incubator, as well as encasements. Also, it should be understood by those skilled in the art that use of the term “enclosure” does not necessarily mean that an area around noise cancellation is fully enclosed. Partial enclosures, partitions, walls, rails, dividers etc. are equally contemplated herein.
Turning to FIG. 1, the controller unit 14 is a signal processing unit for sending and receiving signals as well as processing and analyzing signals. The controller unit 14 may include various processing components such as, but not limited to, a power supply, amplifiers, computer processor with memory, and input/output channels. The controller unit 14 can be contained within an enclosure, discussed in greater detail below (see FIG. 3), or it can be located outside of the enclosure. The controller unit 14 further includes a power source 24. The power source 24 can be AC such as a cord to plug into a wall socket or battery power such as a rechargeable battery pack. The embodiment of FIG. 1 preferably has at least one input channel 32, where the number of input channels 32 may be equal to the total number of error microphones in the enclosure and reference microphones in the reference sensing unit. The input channels 32 may be analog, and include signal conditioning circuitry, a preamplifier 34 with adequate gain, an anti-aliasing lowpass filter 36, and an analog-to-digital converter (ADC) 38. The input channels 32 receive signals (or noise) from the error microphones and the reference microphones.
In the embodiment of FIG. 1, there may be at least one output channel 40. The number of output channels 40 may be equal to the number of loudspeakers in the enclosure. The output channels 40 are preferably analog, and include a digital-to-analog converter (DAC) 42, smoothing (reconstruction) lowpass filter 44, and power amplifier 46 to drive the loudspeakers. The output channels 40 are configured to send a signal to the loudspeakers to make sound. Digital signal processing unit (DSP) 48 generally includes a processor with memory. The DSP receives signals from the input channels 32 and sends signals to the output channels 40. The DSP can also interface (i.e. input and output) with other digital systems 50, such as, but not limited to, audio players for entertainment and/or for creating environmental sounds (e.g., waves, rainfall), digital storage devices for sound recording, communication interfaces, or diagnostic equipment. DSP 48 may also includes one or more algorithms for operation of the electronic enclosure.
Generally speaking, the algorithm(s) may controls interactions between the error microphones, the loudspeakers, and reference microphones. Preferably, the algorithm(s) may be one of (a) multiple-channel broadband feed-forward active noise control for reducing noise, (b) adaptive acoustic echo cancellation, (c) signal detection to avoid recording silence periods and sound recognition for non-invasive detection, or (d) integration of active noise control and acoustic echo cancellation. Each of these algorithms are described more fully below. The DSP can also include other functions such as non-invasive monitoring using microphone signals and an alarm to alert or call caregivers for emergency situations.
The reference sensing unit includes at least one reference microphone. Preferably, the reference microphones are wireless for ease of placement, but they can also be wired. The reference microphones are used to detect the particular noise that is desired to be abated and are therefore placed near that sound. For example, if it is desired to abate noises in an enclosure from other rooms that can be heard through a door, the reference microphone may be placed directly on the door. The reference microphone may advantageously be placed near a noise source in order to minimize such noises near an enclosure. As will be described in further detail below, an enclosure equipped with noise-cancellation hardware may be used for a variety of methods in conjunction with the algorithms. For example, the enclosure can be used in a method of abating unwanted noise by detecting an unwanted noise with a reference microphone, analyzing the unwanted noise, producing an anti-noise corresponding to the unwanted noise in the enclosure, and abating the unwanted noise. Again, the reference microphone(s) may be placed wherever the noise to be abated is located. These reference microphones detect the unwanted noise and the error microphones 20 detect the unwanted noise levels at the enclosure's location, both reference microphones send signals to the input channels 32 of the controller unit 14, the signals are analyzed with an algorithm in the DSP, and signals are sent from the output channels 40 to the loudspeakers. The loudspeakers then produce an anti-noise (which may be produced by an anti-noise generator) that abates the unwanted noise. With this method, the algorithm of multiple-channel broadband feed-forward active noise control for reducing noise is used to control the enclosure.
The enclosure can also be used in a method of communication by sending and receiving sound waves through the enclosure in connection with a communication interface. The method operates essentially as described above; however, the error microphones are used to detect speech and the loudspeakers may broadcast vocal sounds. With this method, the algorithm of adaptive acoustic echo cancellation for communications may be used to control the enclosure, as described above, and this algorithm can be combined with active noise control as well. The configuration for the enclosure may be used in a method of recording and monitoring disorders, by recording noises produced by within the enclosure with microphones encased within a pillow. Again, this method operates essentially as described above; however, the error microphones are used to record sounds in the enclosure to diagnose sleep disorders. With this method, the algorithm of signal detection to avoid recording silence periods and sound recognition for non-invasive detection is used to control the enclosure.
The enclosure can further be used in a method of providing real-time response to emergencies by detecting a noise with a reference microphone in an enclosure, analyzing the noise, and providing real-time response to an emergency indicated by the analyzed noise. The method is performed essentially as described above. Certain noises detected are categorized as potential emergency situations, such as, but not limited to, the cessation of breathing, extremely heavy breathing, choking sounds, and cries for help. Detecting such a noise prompts the performance of real-time response action, such as producing a noise with the loudspeakers, or by notifying caregivers or emergency responders of the emergency. Notification can occur in conjunction with the communications features of the enclosure, i.e. by sending a message over telephone lines, wireless signal or by any other warning signals sent to the caregivers. The enclosure may also be used in a method of playing audio sound by playing audio sound through the loudspeakers of the enclosure. The audio sound can be any, such as soothing music or nature sounds. This method can also be used to abate unwanted noise, as the audio sound masks environmental noises. Also, by locating the loudspeakers inside the enclosure, lower volume can be used to play the audio sound.
Turning to FIG. 2, an exemplary illustration is provided for performing Multiple-Channel Broadband Feed-forward Active Noise Control for an enclosure. In this example a multiple-channel feed-forward ANC system is configured with one reference microphone, two loudspeakers and two error microphones independently. The multiple-channel ANC system uses the adaptive FIR filters with the 1×2×2 FXLMS algorithm. The reference signal x(n) is sensed by reference microphones in the reference sensing unit. Two error microphones (located in the pillow unit) obtain the error signals e1(n) and e2(n), and the system is thus able to form two individual quiet zones centered at the error microphones that are close to the ears of sleeper. The ANC algorithm used two adaptive filters W1(z) and W2(z) to generate two anti-snores y1(n) and y2(n) to drive the two independent loudspeakers (also embedded inside the pillow unit). Ŝ11(z), Ŝ12(z), Ŝ21(z), and Ŝ22(z) are the estimates of the secondary path transfer functions using both on-line or offline secondary path modeling techniques.
The 1×2×2 FXLMS algorithm may be summarized as follows:
y 1(n)=w 1 T(n)x(n),i=1,2  (1)
w 1(n+1)=w 1(n)+μ1 [e 1(n)x(n)*ŝ 11(n)+e 2(n)x(n)*ŝ 21(n)]  (2)
w 2(n+1)=w 2(n)+μ2 [e 1(n)x(n)*ŝ 12(n)+e 2(n)x(n)*ŝ 22(n)]  (3)
where w1(n) and w2(n) are coefficient vectors and μ1 and μ2 are the step sizes of the adaptive filters W1(z) and W2(z), respectively, and ŝ11(n), ŝ21(n), ŝ12(n) and ŝ22(n) are the impulse responses of the secondary path estimates Ŝ11(z), Ŝ12(z), Ŝ21(z), and Ŝ22(z) respectively.
Configurations directed to adaptive acoustic echo cancellation and integration of active noise control with acoustic echo cancellation are disclosed in U.S. patent application Ser. No. 11/952,250, and will not be repeated here for the sake of brevity. However, it should be understood by those skilled in the art that the techniques described therein may be applicable to the present disclosure, depending on the needs of the enclosure designer.
Turning to FIG. 3, one example of a wireless communication integrated ANC system 300, combining wireless communication and ANC algorithms for an incubator enclosure is disclosed. Here, the ANC may be configured to cancel unwanted noises and the wireless communication can provide two way communications between parents and infants. The embodiment of FIG. 3 is preferably comprises a sound analysis and communications portion 301, including (1) a ANC portion (302, 305, 306, 311) for reducing external noise for the infant incubator, and (2) a wireless communication portion (303, 304) integrated with ANC system to provide communication between infants and their parents or caregivers. In order to comfort infants, the desired speech signal, such as, mother's voice may be picked up in receiver 302, processed and played to infant through the loudspeaker 311 inside the incubator. The infant audio signals such as crying, breathing, and cooing, will be picked up by the error microphone inside the incubator 310, processed, and played externally.
The noise abatement of system 300 may be viewed as comprising four modules or units including (1) a noise control acoustic unit, (2) a electronic controller unit, (3) a reference sensors unit, and (4) a communication unit. The noise control acoustic unit includes one or more anti-noise loudspeakers 311, at least partially operated by anti-noise generator 306, and microphones (error microphone 307, and reference microphone 308), operatively coupled to an electronic controller which may be part of unit 306 and/or 301. The controller may include a power supply and amplifiers, a processor with memory, and input/output channels for performing signal processing tasks. The reference sensing unit may comprise wired or wireless microphones (308), which can be placed outside the incubator 310 for abating outside noise 311, or alternately on windows for abating environmental noises, or doors for reducing noise from other rooms, or on other known noise sources. The wireless communication unit may include wireless or wired transmitter and receivers (302, 304) for communication purposes.
A general multi-channel ANC system suitable for the embodiment of FIG. 3 is illustrated in FIG. 4, where the embodiment is configured with the assumption that there are J reference sensors (microphones), K secondary sources and M error sensors (microphones). The J channels reference signals may be expressed as:
x(n)=[x 1 T(n)x 2 T(n) . . . x J T(n)]T
with xj(n) is the jth-channel reference of signal of length L. The secondary sources have K channels, or
y(n)=[y 1(n)y 2(n) . . . y K(n)]T,
where yk(n) is the signal of kth output channel at time n. The error signals have M channels, or
e(n)=[e 1(n)e 2(n) . . . e M(n)]T
where em(n) is the error signal of mth error channel at time n. Both the primary noise d(n) and the cancelling noise d′(n) are vectors with M elements at the locations of M error sensors
Primary paths impulse responses (402) can be expressed by a matrix as
P ( n ) = [ p 11 ( n ) p 12 ( n ) p 1 , J ( n ) p 21 ( n ) p 22 ( n ) p 2 , J ( n ) p M 1 ( n ) p M 1 ( n ) p MJ ( n ) ]
where pmj (n) is the impulse response function from the jth reference sensor to the mth error sensor. The matrix of secondary path impulse response functions (405) may be given by
S ( n ) = [ s 11 ( n ) s 12 ( n ) s 1 K ( n ) s 21 ( n ) s 22 ( n ) s 2 K ( n ) s M 1 ( n ) s M 2 ( n ) s MK ( n ) ]
where smk(n) is the impulse response function from the kth secondary source to the mth error sensor. An estimate of S(n), denoted as Ŝ(n) (401) can be similarly defined.
Matrix A(n) may comprise feed-forward adaptive finite impulse response (FIR) filters impulse response functions (403), which has J inputs, K outputs, and filter order L,
A(n)=[A 1 T(n)A 2 T(n) . . . A K T(n)]T, where
A k(n)=[A k,1 T(n)A k,2 T(n) . . . A k,J T(n)]T ,k=1,2, . . . ,K
is the weight vector of the kth feedforward FIR adaptive filter with J input signals defined as
A k,j(n)=[a k,j,1(n)a k,j,2(n) . . . a k,j,L(n)]T,
which is the feed-forward FIR weight vector form jth input to kth output.
The secondary sources may be driven by the summation (406) of the feed-forward and feedback filters outputs. That is
y k ( n ) = j = 1 J x j T ( n ) A k , j ( n ) = x T ( n ) A k ( n )
The error signal vector measured by M sensors is
e ( n ) = d ( n ) + y ( n ) = d ( n ) + S ( n ) * [ X T ( n ) A ( n ) ]
where d(n) is the primary noise vector and y′(n) is the canceling signal vector at the error sensors.
The filter coefficients are iteratively updated to minimize a defined criterion. The sum of the mean square errors may be used as the cost function defined as
ξ ( n ) = m = 1 M E { e m 2 ( n ) } = e T ( n ) e ( n )
The least mean square (LMS) adaptive algorithm (404) uses a steepest descent approach to adjust the coefficients of the feed-forward and feedback adaptive FIR filters in order to minimize (n) as follows:
A(n+1)=A(n)−μa X′(n)e(n)
where μa and μb are the step sizes for feedforward and feedback ANC systems, respectively. In another embodiment, different values may be used to improve convergence speed:
X ( n ) = [ S ( n ) * X T ( n ) ] T = [ [ s ^ 11 ( n ) s ^ 12 ( n ) s ^ 1 K ( n ) s ^ 21 ( n ) s ^ 22 ( n ) s ^ 2 K ( n ) s ^ M 1 ( n ) s ^ M 2 ( n ) s ^ MK ( n ) ] * [ x ( n ) 0 0 0 x ( n ) 0 0 0 0 x ( n ) ] T ] T
that is
= [ x 11 ( n ) x 12 ( n ) x 1 M ( n ) x 21 ( n ) x 22 ( n ) x 2 M ( n ) x K 1 ( n ) x K 2 ( n ) x KM ( n ) ] and x km ( n ) = s mk ( n ) * x ( n ) = [ s mk ( n ) * x 1 T ( n ) s mk ( n ) * x 2 T ( n ) s mk ( n ) * x J T ( n ) ] = [ x km 1 T ( n ) x km 2 T ( n ) x kmJ T ( n ) ]
The updated adaptive filter's coefficients can be expressed,
A k ( n + 1 ) = A k ( n ) - μ m = 1 M x km ( n ) e m ( n )
and it can be further expended as
A k , j ( n + 1 ) = A k , j ( n ) - μ m = 1 M x km ( n ) e m ( n ) = A k , j ( n ) - μ m = 1 M [ s mk ( n ) * x j ( n ) ] e m ( n )
In addition to noise reduction, the embodiment of FIG. 3 may be advantageously configured to provide a level of communication for an infant. In order to comfort infants, a desired audio signal, such as a mother's voice is picked up by receiver 302, processed, and reproduced to an infant through the anti-noise loudspeaker 311 inside incubator 310. In turn, infant audio signals such as crying, breathing, and cooing, will be picked up by the error microphone 307 inside incubator 310, processed (303, 304), and reproduced via a separate speaker (not shown), where an emotional or physiological state may also be displayed via visual or audio indicia (e.g., screen, lights, automated voice, etc.). This configuration may allow parents outside the NICU to communicate to and listen from the infant inside the incubator, thus improves bonding for parents without visiting NICU with limited time periods.
Under one embodiment, direct-sequence spread spectrum (DS/SS) techniques may be used to conduct wireless communication. In another embodiment; orthogonal frequency-division multiplexing (OFDM) or ultra-wideband (UWB) techniques may be used. For DS/SS communications, each information symbol may be spread using a length-L spreading code. That is,
d(k)=v(n)c(n,l)  (7)
where v(n) is the symbol-rate information bearing voice signal, and c(n, l) is the binary spreading sequence of the nth symbol. In one embodiment, c(n) is used instead of c(n, l) for simplicity. The received chip-rate matched filtered and sampled data sequence can be expressed as the product of the chip-rate sequence d(k) and its spatial signature h,
p(k)=d(k)h  (8)
Within a symbol interval, after chip-rate processing received data becomes
r=p+w  (9)
where the L by 1 vector p contains signal of interest, and w is the white noise
An embodiment for combining/integrating ANC with the aforementioned communications is illustrated in FIG. 5. Here, voice signal v(n) is added to the adaptive filter output y(n), then the mixed signal propagates through the secondary path S(z) to generate anti-noise y′(n). At the quiet zone (309), the primary noise d(n) is canceled by the anti-noise, resulting in the error signal ev(n) sensed by the error microphone, which contains the residual noise and the audio signal. To avoid the interference of the audio on the performance of ANC, the audio signal v(n) is filtered through the secondary-path estimate Ŝ(z) and subtracted from ev(n) to get the true error signal e(n) for updating the adaptive filter A(z).
Using a z-domain notations, Ev(z) can be expressed as
Ev(z)=D(z)−S(z)[Y(z)+V(z)],  (10)
Where the actual error signal E(z) may be expressed as
E ( z ) = Ev ( z ) + S ^ ( z ) V ( z ) = D ( z ) - S ( z ) [ Y ( z ) + V ( z ) ] + S ^ ( z ) V ( z ) . ( 11 )
Assuming that the perfect secondary-path model is available, i.e., Ŝ(z)=S(z), we have
E(z)=D(z)−S(z)Y(z).  (12)
This shows that the true error signal is obtained in the integrated ANC system, where the voice signal is removed from the signal ev(n) picked up by the error microphone. Therefore, the audio components won't degrade the performance of the noise control filter A(z). Thus, some of the advantages of the integrated ANC system are that (i) it provides audio comfort signal from the wireless communication devices, (ii) it masks residual noise after noise cancellation, (iii) it eliminates the interference of audio on the performance of ANC system, and (iv) it integrates with the existing ANC's audio hardware such as amplifiers and loudspeakers for saving overall system cost.
A multiple-channel ANC system such as the one illustrated in FIG. 5 was evaluated with J=1, K=2 and M=2 when the primary noise is recorded incubator noise. The spectra of error signals before and after ANC at the error microphones are illustrated in FIGS. 6A and 6B. It can be seen that there is a meaningful reduction of the recorded incubator noises over the entire frequency range of interest. Average noise cancellation was found to be 30 dB at a first error microphone (FIG. 6A), and 35 dB at a second error microphone (FIG. 6B). For the wireless communication system, a single user configuration was simulated and analyzed with Rayleigh channel and the DS/SS signal uses Gold code of length L=15. FIG. 7 illustrates the BER vs. SNR results, where it can be seen that the results shows a good match with the analytical result.
In addition to the audio signals being transmitted from the infant's incubator, sound analysis (303) can be performed on the emanating audio signal (e.g., cry, coo, etc.) in order to characterize a voice signal. Although it does not have a conventional language form, a baby cry (and similar voice communication) may be considered a kind of speech signal, the character of which is non-stationary and time varying. Under one embodiment, short time analysis and threshold method are used to detect the pair of boundary points-start point and end point of each cry word. Feature extraction of each baby cry word is important in classification and recognition, and numerous algorithms can be used to extract features, such as: linear predictive coding (LPC), Mel-frequency cepstral coefficients (MFCC), Bark-frequency cepstral coefficients (BFCC), and some other frequency extraction of stationary features. In this exemplary embodiment, 10 order Mel-frequency cepstral coefficient (MFCC-10) having 10 coefficients is used as a feature pattern for each cry word. It should be understood by those skilled in the art that other numbers of coefficients may be used as well.
Once features are extracted, different statistical methods can be utilized to effect baby cry cause recognition, such as Gaussian Mixture Model (GMM), Hidden Markov Models (HMM), and Artificial Neural Network (ANN). In one embodiment discussed herein, ANN is utilized for baby cry causes recognition. ANN imitates how human brain neurons work to perform certain task, and it can be considered as a parallel processing network system with a large number of connections. ANN can learn a rule from examples and generalize relationships between inputs and outputs, or in other words, find patterns of data. A Learning Vector Quantization (LVQ) model can be used to implement the classification of multi-class issue. The objective of using LVQ ANN model for baby-cry-cause recognition is to develop a plurality (e.g., 3) feature patterns which represent cluster centroids of each baby-cry-cause: draw attention cry, wet diaper cry, and hungry cry, as an example.
With regards to baby cry classification and recognition techniques, baby cry word boundary points detection may be advantageously employed. A speech signal of comprehensible length is typically a non-stationary signal that cannot be processed by stationary signal processing methods. However, during a limited short-time interval, the speech waveform can be considered stationary. Because of the physical limitation of human vocal cord vibration, in practical applications 10-30 milliseconds (ms) duration interval may used to complete short-time speech analysis, although other intervals may be used as well. A speech signal may be thought of as comprising a voiced speech component with vocal cord vibration and an unvoiced speech component without vocal cord vibration. A cry word can be defined as the speech waveform duration between a start point and an end point of a voiced speech component. Voiced speech and unvoiced speech have different short-time characteristics, which can be used to detect the boundary points of baby cry words.
Short-time energy (STE) is defined as the average of the square of the sample values in a suitable window, which may be expressed as:
E ( n ) = 1 N m = 0 N - 1 [ w ( m ) x ( n - m ) ] 2
where w(m) is the window coefficient correspond with signal sample, and N is window length. The most obvious difference is that voiced speech has higher short-time energy (STE), but unvoiced speech has lower STE. In one embodiment, a Hamming window may be chosen as it minimizes the maximum side lobe in the frequency domain and can be described as:
w ( m ) = .54 - .46 cos ( 2 π m N - 1 )
As previously mentioned, short-time processing of speech may preferably take place during segments between 10-30 ms in length. For a signals of 8 kHz sampling frequency, a window of 128 samples (˜16 ms) may be used. STE estimation is useful as a speech detector because there is a noticeable difference between the average energy between voiced and unvoiced speech, and between speech and silence. Accordingly, this technique may be paired with short-time zero crossing for a robust detection scheme.
Short-time zero crossing (STZC) may be defined as the rate at which the signal changes sign. It can be mathematically described as:
Z ( n ) = 1 N m = 0 N - 1 sign ( x ( n - m ) ) - sign ( x ( n - m - 1 ) ) , where sign ( x ( m ) ) = 1 , if x ( m ) 0 = - 1 , otherwise
STZC estimation is useful as a speech detector because there are noticeable fewer zero crossings in voiced speech as compared with unvoiced speech. STZC is advantageous in that it is capable of predicting cry signal start and endpoints. Significant short-time zero crossing effectively describes the envelope of a non-silent signal and combined with short-time energy, can effectively track instances of potentially voiced signals that are the signals of interest for analysis.
There are some false positive cries that may be detected, as not all signals bounded by the STZC boundary contain cries. Large STZC envelopes with low energy tended to contain cry precursors such as whimpers and breathing events. Not all signals with non-negligible STE contained cries as well. Infant coughing events may be bounded by a STZC boundary and contained a noticeable STE. In order to consistently pick up desired cry events, a desired cry may be defined as a voiced segment of sufficiently long duration. Two quantifiable threshold conditions that are needed to be met to constitute a desired voiced may be:
    • 1) Normalized energy>0.05 (To eliminate non-voiced artifacts such as breathing/whimpering and to supersede cry precursors)
    • 2) Signal envelope period>0.1 seconds (To eliminate impulsive voiced artifacts such as coughing)
Returning back to STE processing, as baby cry signals may be down sampled from 44.1 kHz to 7350 Hz, a window length N may be chosen as 128, which translates to a 17.4 ms short-time interval. In order to detect the boundary points of cry words by setting a proper threshold value, the STE must be normalized into range from 0 to 1 by dividing the maximum STE value of whole duration. To eliminate unvoiced artifact of low STE or very short duration high energy impulse, two quantifiable thresholds should be set to detect the cry word boundary points. Those two threshold conditions are:
    • (1) Normalized STE>0.05 (to eliminate unvoiced artifact such as whimper, breathing), and
    • (2) Interval between start point and end point of a cry word>0.14 second (at least about 1024 signal samples to eliminate impulsive voiced artifact such as coughing)
      Those voiced speech component start points and end points can be detected by normalized STE threshold, and some short duration false cry words detected can be eliminated by interval threshold.
Short-time segment of speech can be considered stationary. Stationary feature extraction techniques can be compartmentalized into either cepstral based (taking the Fourier transform of the decibel spectrum) or linear predictor (determining the current speech sample based on a linear combination of prior samples) based algorithms. In sound processing, the mel-frequency cepstrum (MFC) is a representation of the short-term power spectrum of a sound, based on a linear cosine transform of a log power spectrum on a nonlinear mel-scale of frequency. In practical application of speech recognition, Mel-frequency cepstral coefficients (MFCC) is considered the best characteristic parameter which is closest to the non-linear low and high frequency perception of human ear.
In sound processing, the mel frequency cepstrum is a representation of the short-time power spectrum of a sound based on a linear cosine transform of a log spectrum on a non-linear mel scale of frequency. The mel scale is a perceptual scale of pitches. It is based upon the human perception of the separation on a scale of pitches. The reference of the mel scale with standard frequency may be defined by 1000 Hz tone 40 dB above the listeners threshold and is equivalent to a pitch of 1000 mels. What the mel frequency cepstrum provides is a tool that describes the tonal characteristics of a signal that is warped such that it better matches human perceptual hearing of tones (or pitches). The conversion between mel (m) and Hertz (f) can be described as
m = 2595 log 10 [ f 700 + 1 ] .
The mel frequency cepstrum may be obtained through the following steps. A short-time Fourier transform of the signal is taken in order to obtain the quasi-stationary short-time power spectrum F(f)=F{f(t)}. The frequency portion of the spectrum is then mapped to the mel scale perceptual filter bank with the equation above using 18 triangle band pass filters equally spaced on the mel range of frequency F(m). These triangle band pass filters smooth the magnitude spectrum such that the harmonics are flattened in order to obtain the envelope of the spectrum with harmonics. This indicates that the pitch of a speech signal is generally not present in MFCC. As a result, a recognition system will behave more or less the same when the input utterances are of the same timbre but with different tones/pitch. This also serves to reduce the size of the features involved, making the classification simpler.
The log of this filtered spectrum is taken and then the Fourier transform of the log spectrum squared results in the power cepstrum of the signal, or
|F{log(|F(m)|2)}|2.
At this point, the discrete cosine transform (DCT)
X k = n = 0 N - 1 x n cos [ π N ( N + 1 2 ) k ]
of the power cepstrum is taken to obtain the MFCC, which may be used to measure audio signal similarity. The DCT coefficients are retained as they represent the power amplitudes of the mel frequency cepstrum. To keep the codebook length similar, an nth (e.g., 10th) order MFCC may be obtained. However, in addition to the MFCC, and in order to have a more similar basis in algorithm for comparison in feature classification, the MFLPCC may be used as well. The power cepstrum may possesses the same sampling rate as the signal, so the MFLPCC is obtained by performing an LPC algorithm on the power cepstrum in 128 sample frames. The MFLPCC encodes the cepstrum waveform in a more compact fashion that may make it more suitable for a baby cry classification scheme.
An exemplary MFCC feature extract procedure is illustrated in FIG. 8. The procedure shown in the figure can be implemented step by steps as follows:
    • Step 1. Take discrete Fourier transform (DFT) of signal 801, where N points DFT can be expressed as follows:
X ( k ) = n = 0 N - 1 x ( n ) - j2 π k N
    • Step 2. Square each spectrum amplitude value 802 to get power spectrum:
      P(k)=|X(k)|2
    • Step 3. Convolute the power spectrum P(k) with a Mel scaled triangular filter bank 803, which is shown in FIG. 9.
Again, for this example, the number of subband filters is 10, and P(k) are binned onto the mel scaled frequency using 10 overlapped triangular filter. Here binning means that each P(k) is multiplied by the corresponding filter gain and the results accumulated as energy in each band. The relationship between frequency and Mel scale can be expressed as follows:
Mel ( f ) = 259.5 log 10 ( 1 + f 700 )
The resulting nonlinear Mel frequency curve is illustrated in FIG. 10.
    • Step 4. Take logarithm 804:
L m = log ( k = 0 N - 1 X ( k ) 2 H m ( k ) ) , 0 m < M
where N is the number of DFT points, and M=10.
    • Step 5. Take discrete cosine transform (DCT) 805 to get MFCC:
C m = n = 0 M - 1 L m cos ( π m ( n + 0.5 ) M ) , 0 m < M
where MFCC order M is 10.
In one embodiment, a Linear vector quantization (LVQ) neural network model is used. A self organizing neural network has the ability to assess the input patterns presented to the network, organize itself to learn from the collective set of inputs, and categorize them into groups of similar patterns. In general, self-organized learning involves the frequent modification of the network's synaptic weights in response to a set of input patterns. LVQ is such a self organizing neural network model that can be used to classify the different baby cry causes. LVQ may be considered a kind of feed-forward ANN, and is advantageously used in areas of pattern recognition or optimization.
Different baby-cry-causes may be assumed to have different feature patterns; as such, the objective of classification is to determine a general feature pattern that is a kind of MFCC “codebook” from example training feature data for a specific baby cry cause, such as “draw attention” cry, “need to change wet diaper” cry, “hungry” cry, etc. Subsequently the unknown cause baby cry may be recognized by finding out the shortest distance between the input unknown cry word MFCC-10 feature vector and every class “codebook” respectively.
A LVQ algorithm may be used to complete a baby-cry-cause classification, where a plurality of baby-cry-causes may be taken into consideration (e.g., draw attention, diaper change needed, hungry, etc.). Thus, an exemplary LVQ neural network would have a plurality (e.g., 3) output classes which would corresponding to the main baby-cry-causes:
    • Class 1: Draw attention cry
    • Class 2: Diaper change needed cry
    • Class 3: Hungry cry
An exemplary LVQ architecture is shown in FIG. 11. The input vector in this example is a 10-dimension cry word MFCC-10 feature which can be expressed as:
X=[x 1 x 2 . . . x 10]T
where all the weights in response to the input vector and output classes can be expressed as:
W = [ W 1 W 2 W 3 ] = [ w 11 w 31 w 110 w 310 ]
where W1=[w1 1w1 2 . . . w1 10]T represents the pattern “codebook” of draw attention cry, W2=[w2 1w2 2 . . . w2 10]T represents the pattern “codebook” of diaper change needed cry, and W3=[w3 1 w3 2 . . . w3 10]T represents the pattern “codebook” of hungry cry.
The exemplary LVQ neural network model may be trained using the follows steps:
    • Step 1. Initialize all weight vectors W1(0), W2(0), and W3(0) choosing a cry word MFCC-10 from each baby cry cause class. Initialize the adaptive learning step size
μ ( k ) = μ ( 0 ) k , μ ( 0 ) = 0 , 1 , and k = 1, 2, , N ,
and k=1, 2, . . . N,
where N is the number of iteration.
    • Step 2. For each training input vector X, perform step 3 and step 4:
    • Step 3. Determine the weight vector index j such that the Euclidean distance
      X(k)−W j(k)∥2
      is minimal, and
    • Step 4. Update the appropriate weight vector Wj(k) as follows:
{ W j ( k + 1 ) = W j ( k ) + μ ( k ) [ X ( k ) - W j ( k ) ] , C W j ( k ) = C X ( k ) W j ( k + 1 ) = W j ( k ) - μ ( k ) [ X ( k ) - W j ( k ) ] , C W j ( k ) C X ( k )
Where CX(k) is the known class index of input X at time k, for example, if input X(k) is MFCC-10 of a hungry cry word, CX(k)=3. Preferably, only Wj is updated and the updating rule depends on whether the class index of input pattern equals to the index j obtained in Step 4.
    • Step 5. Repeat step 2, 3, 4, until k=N.
      After finishing training, W1(N), W2(N), W3(N) may be considered the pattern “codebook” for three baby-cry-causes exemplified above, respectively.
The “draw attention cry words,” “diaper change needed cry words,” and “hungry cry words” MFCC-10 features of 4 different babies are illustrated in FIGS. 12A-C, respectively. After numerous (e.g., 300) iterations, the value of weights vectors W1, W2, W3 which present the centroid of each different cause class are fixed, and the centroid curves of each class are shown in FIG. 12D.
In another embodiment, linear predictive coding (LPC) may be utilized to obtain baby cry characteristics. In certain cases, the waveforms of two similar sounds will also show similar characteristics. If two infant cries have very similar waveforms, it stands to reason that they should possess the same impetus. However, it is impractical to conduct a sample by sample full comparison between cry signals due to the complexity inherent in having audio signals of around 1 second in length at a sampling rate of 8 kHz. In order to improve the solution of the time domain comparison of infant cry signals, linear predictive coding (LPC) is applied.
As mentioned previously, there may be two acoustic sources associated with voiced and unvoiced speech, respectively. Voiced speech is caused by the vibration of the vocal cords in response to airflow from the lung and this vibration is periodic in nature while unvoiced speech is caused by constrictions in the air tract resulting in random airflow. The basis of the source-filter model of speech is that speech can be synthesized by generating an acoustic source and passing it through an all-pole filter. The linear predictive coding (LPC) algorithm produces a vector of coefficients that represent a spectral shaping filter. An input signal to this filter is either a pitch train for voiced sounds, or white noise for unvoiced sounds. This shaping filter may be an all-pole filter represented as:
H ( z ) = 1 1 - i = 1 M a i z - i ,
where {ai} are the linear prediction coefficients and M is the number of poles (the roots of the denominators in the z transform). A present sample of speech may be represented as a linear combination of the past M samples of the speech such that:
x ^ ( n ) = a 1 x ( n - 1 ) + a 2 x ( n - 2 ) + + a M x ( n - M ) = i = 1 M a i x ( n - i ) ,
where {circumflex over (x)}(n) is the predicted value of x(n).
The error between the actual and predicted signal can be defined as
ɛ ( n ) = x ( n ) - x ^ ( n ) = x ( n ) - i = 1 M a i x ( n - i ) .
The smaller the error, the better the spectral shaping filter is at synthesizing the appropriate signal. Taking the derivative of the above equation with respect to ai and equating to 0 yields:
ɛ ( n ) , x ( n ) = i = 1 M e [ n ] x [ n - 1 ] = 0
Minimization of error yields sets of linear equations in the form of the error between the actual and predicted signal, expressed above. To obtain the minimum mean square error, an autocorrelation method where the minimum is found by applying the principle of orthogonality as the predictor coefficients that minimize the prediction error must be orthogonal to the past vectors.
R = [ R ( 0 ) R ( 1 ) R ( n - 1 ) R ( 1 ) R ( 0 ) R ( n - 1 ) R ( 0 ) ]
This can be achieved by using a Toeplitz autocorrelation matrix R to find the LPC parameters and using the Levinson-Durbin recursion to solve the Toeplitz matrix.
Effectively, the purpose of LPCC is to take a waveform of a large size in unit samples and then compress it into a more manageable form. Because similar waveforms should also result in similar acoustic output, LPC serves as a time domain measure of how close two different waveforms are.
Because of the sampling rate of 8 kHz and the generalization that f/1000+2 LPC coefficients are the minimum required to decompose a waveform, 10 LPCC or LPC-10 may be used to describe each 128 sample frame which corresponds to 16 ms and is assumed to be short-time stationary. Instead of computing the difference between windowed segments of 128 samples in length, only comparisons of segments of the LPC-10 values are needed. Furthermore, during signal preprocessing, a first order low pass filter can be used to brighten the signal such that components due to non-vocal tract speech can be attenuated.
In another embodiment, cepstrum analysis may be used to obtain baby cry characteristics. To obtain the frequency spectrum F(w), a Fourier transform, denoted by F{ }, must be performed on the time domain signal f(t) as F(w)=F{f(t)}. However, it is possible to take the Fourier transform of the log spectrum as if it were a signal as well. The result of this transformation moves one from the frequency spectrum domain to the power cepstrum domain described by
|F{log(|F{f(t)}|2)}|2.
The cepstrum provides information about the rate of change in the different spectrum bands. This attribute can be exploited as a pitch detector. For example, if the sampling rate of a cry signal is 8 kHz and there is a large peak in the spectrum where the quefrency (x-axis frequency analog in spectrum domain) is 20 samples, the peak indicates the existence of a pitch of 8000/20=400 hz. This peak occurs in the cepstrum because the harmonics in the spectrum are periodic, and the period corresponds to the pitch.
Cepstrum pitch determination is particularly effective because the effects of the vocal excitation (pitch) and vocal tract (formants) are additive in the logarithm of the power spectrum and thus clearly separate. This trait makes cepstrum analysis of audio signals more robust than processing normal frequency or time domain samples. Another technique used to improve the accuracy of feature extraction of cepstrum based techniques is liftering. Liftering applies a low order low pass filter to the cepstrum in order to smooth it out and help with the Discrete Cosine Transform (DCT) analysis for feature extraction techniques in ensuing sections. Additionally, linear predictive cepstral coefficients (LPCC) may be used for audio feature extraction. LPCCs may be obtained by applying linear predictive coding on the cepstrum. As mentioned above, the cepstrum is a measure of the rate of change in spectrum bands over windowed segments of individual cries. Applying LPC to the cepstrum yields a vector of values for a 10-tap filter that would synthesize the cepstrum wave form.
Similar to the MFCC, the bark frequency cepstral coefficients (BFCC) warps the power cepstrum such that it matches human perception of loudness. The methodology of obtaining the BFCC is similar to that of the MFCC except for two differences. The frequencies are converted to bark scale according to:
b = 13 tan - 1 ( .00076 f ) + 3.5 tan - 1 [ ( f 7500 ) 2 ] ,
where b denotes bark frequency and f is frequency in hertz. The mapped bark frequency is passed through a plurality (e.g., 18) of triangle band pass filters. The center frequencies of these triangular band pass filters correspond to the first 18 of the 24 critical frequency bands of hearing (where the band edges are at 20, 100, 200, 300, 400, 510, 630, 770, 920, 1080, 1270, 1480, 1720, 2000, 2320, 2700, 3150, 3700, 4400, 5300, 6400, 7700, 9500, 12000 and 15500 Hz). This is done because frequencies above 4 kHz may be attenuated by the low pass anti-aliasing filter described in signal preprocessing. This also allows for a more comparable comparison between the MFLPCC and BFLPCC later on.
The BFCC is obtained by taking the DCT of the bark frequency cepstrum and the 10 DCT coefficients describe the amplitudes of the cepstrum. The power cepstrum also possesses the same sampling rate as the signal, so the BFLPCC is obtained by performing the LPC algorithm on the power cepstrum in 128 sample frames. The BFLPCC encodes the cepstrum waveform in a more compact fashion that may make it more suitable for a baby-cry classification scheme.
In another exemplary embodiment, Kalman filters may be utilized for baby voice feature extraction. One characteristic of analog generated sources of noise is that no two signals are identical. As similar as two sounds may be, they will inherently vary to some degree in pitch, volume and intonation. Regardless, it can be said that adjoining infant cries are highly similar and most likely have the same meaning. In order to estimate the true cry from the recorded cries, Kalman filter formulation may be used.
If x(n) is arranged as an AR(p) (auto-regressive process of order p), it may be generated according to
x ( n ) = k = 1 p a ( k ) x ( n - k ) + w ( n ) . ( A )
Supposing that x(n) is measured in the presence of additive noise, then
y(n)=x(n)+v(n)  (B)
If we let x(n) be the p-dimensional state vector
x ( n ) = [ x ( n ) x ( n - 1 ) x ( n - p + 1 ) ]
then (A) and (B) can be expressed in terms of x(n) as
x ( n ) = [ a ( 1 ) a ( 2 ) a ( p - 1 ) a ( p ) 1 0 0 0 0 1 0 0 0 0 1 0 ] x ( n - 1 ) + [ 1 0 0 0 ] w ( n ) and ( C ) y ( n ) = [ 1 , 0 , , 0 ] x ( n ) + v ( n ) ( D )
Equations (C) and (D) can be simplified using matrix notation:
x(n)=Ax(n−1)+w(n)
y(n)=c T x(n)+v(n)  (E)
where A is a p×p state transition matrix, w(n)=[w(n), 0, . . . , 0]T is a vector noise process and c is a unit vector of length p. Even though it is applicable primarily in stationary AR(p) processes, (D) can be generalized to a non-stationary process by letting x(n) be a state vector of dimension p that evolves according to the difference equation
x(n)=A(n−1)x(n−1)+w(n)
where A(n−1) is a time varying p×p state transition matrix and w(n) is a vector of zero-mean white noise processes and let y(n) be a vector of observations that are formed according to
y(n)=C(n)x(n)+v(n)
where y(n) is a vector of length q, C(n) is a time varying q×p matrix and v(n) is a vector of zero mean white noise processes that are statistically independent of w(n).
It can be appreciated by those skilled in the art that the present disclosure provides innovative systems, apparatuses and methods for electronic devices that integrate active noise control (ANC) techniques for abating environmental noises, with a communication system that communicates to and from an infant. Such configurations may be advantageously used for infant incubators, hospital beds, and the like. The wireless communication system can also provide communication between infants to their parents/caregivers/nurses, patients/family members/nurses/physicians, and also provide intelligent digital monitoring hat provide non-invasive detection and classification of infant's audio signals/other audio signals.
In the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.

Claims (16)

What is claimed is:
1. An enclosure, comprising:
a noise cancellation portion, comprising a controller unit, operatively coupled to one or more error microphones and a reference sensing unit, wherein the controller unit processes signals received from one or more error microphones and reference sensing unit to reduce noise in an area within the enclosure using one or more speakers; and
an external voice input apparatus operatively coupled to the noise cancellation portion, wherein the external voice input apparatus is configured to receive external voice signals and reproduce the external voice signals on the one or more speakers, wherein the external voice signals are external to the area within the enclosure,
wherein the external voice input apparatus comprises a sound analyzer configured to analyze the external voice signals and determine whether the external voice signals are desired speech signals.
2. The enclosure of claim 1, wherein the desired speech signals are a parent's voice.
3. The enclosure of claim 1, wherein the external voice input apparatus further comprises a transmitter and wherein the controller unit reproduces the desired speech signals using the one or more speakers.
4. The enclosure of claim 3, wherein the reference sensing unit includes a microphone for receiving the external voice signals.
5. The enclosure of claim 4, wherein the microphone is a wireless microphone that is not placed on or within the enclosure.
6. The enclosure of claim 1, wherein the external voice input apparatus is further configured to receive an interior audio signal, wherein the interior audio signal originates inside the enclosure.
7. The enclosure of claim 6, wherein the controller unit of the enclosure, based on the interior audio signal, detects an emergency noise.
8. The enclosure of claim 7, further comprising a transmitter;
wherein the enclosure, in response to the emergency noise, sends an emergency message via the transmitter.
9. An incubator for reducing unwanted noises and reproducing desired voice signals, the incubator comprising:
an interior space within the incubator;
a noise reduction portion, comprising:
one or more speakers;
an error microphone;
a reference sensing unit; and
a controller unit operatively coupled to the error microphone and the reference sensing unit, wherein the controller unit processes signals received from the error microphone and the reference sensing unit to reduce unwanted noise in the interior space using one or more speakers; and
a communication portion configured to reproduce a desired voice signal within the interior space, wherein the communication portion is operatively coupled to the noise reduction portion and wherein the desired voice signal originates outside of the incubator;
wherein the communication portion comprises a receiver configured to receive an external audio signal;
wherein the external audio signal originates outside of the incubator; and
wherein the communication portion comprises a sound analyzer configured to analyze the external audio signal and determine whether the external audio signal is the desired voice signal.
10. The incubator of claim 9, wherein the desired voice signal is a parent's voice.
11. The incubator of claim 9, wherein the communication portion further comprises a transmitter that transmits the desired voice signal to the controller unit, and wherein the controller unit reproduces the desired voice signal using the one or more speakers.
12. The incubator of claim 11, wherein the reference sensing unit includes a microphone for receiving an audio signal.
13. The incubator of claim 12, wherein the microphone is a wireless microphone that is not placed on or within the incubator.
14. The incubator of claim 9, wherein the communication portion is further configured to receive an interior audio signal, wherein the interior audio signal originates inside the incubator.
15. The incubator of claim 14, wherein the controller unit of the incubator, based on the interior audio signal, detects an emergency noise.
16. The incubator of claim 15, further comprising a transmitter; and
wherein the incubator, in response to the emergency noise, sends an emergency message via the transmitter.
US14/965,176 2007-12-07 2015-12-10 Apparatus, system and method for noise cancellation and communication for incubators and related devices Active US9542924B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/965,176 US9542924B2 (en) 2007-12-07 2015-12-10 Apparatus, system and method for noise cancellation and communication for incubators and related devices
US15/365,496 US9858915B2 (en) 2007-12-07 2016-11-30 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US11/952,250 US8325934B2 (en) 2007-12-07 2007-12-07 Electronic pillow for abating snoring/environmental noises, hands-free communications, and non-invasive monitoring and recording
US13/673,005 US20130070934A1 (en) 2007-12-07 2012-11-09 Encasement for abating environmental noise, hand-free communication and non-invasive monitoring and recording
US13/837,242 US9247346B2 (en) 2007-12-07 2013-03-15 Apparatus, system and method for noise cancellation and communication for incubators and related devices
US14/965,176 US9542924B2 (en) 2007-12-07 2015-12-10 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/837,242 Continuation US9247346B2 (en) 2007-12-07 2013-03-15 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/365,496 Continuation US9858915B2 (en) 2007-12-07 2016-11-30 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Publications (2)

Publication Number Publication Date
US20160093281A1 US20160093281A1 (en) 2016-03-31
US9542924B2 true US9542924B2 (en) 2017-01-10

Family

ID=48903682

Family Applications (3)

Application Number Title Priority Date Filing Date
US13/837,242 Active 2028-10-29 US9247346B2 (en) 2007-12-07 2013-03-15 Apparatus, system and method for noise cancellation and communication for incubators and related devices
US14/965,176 Active US9542924B2 (en) 2007-12-07 2015-12-10 Apparatus, system and method for noise cancellation and communication for incubators and related devices
US15/365,496 Active US9858915B2 (en) 2007-12-07 2016-11-30 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/837,242 Active 2028-10-29 US9247346B2 (en) 2007-12-07 2013-03-15 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/365,496 Active US9858915B2 (en) 2007-12-07 2016-11-30 Apparatus, system and method for noise cancellation and communication for incubators and related devices

Country Status (1)

Country Link
US (3) US9247346B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170084264A1 (en) * 2007-12-07 2017-03-23 Northern Illinois Research Foundation Apparatus, system and method for noise cancellation and communication for incubators and related devices
US10339911B2 (en) 2016-11-01 2019-07-02 Stryker Corporation Person support apparatuses with noise cancellation
US11240590B2 (en) 2019-07-31 2022-02-01 Merit Zone Limited Baby monitor system with noise filtering
US11875769B2 (en) 2019-07-31 2024-01-16 Kelvin Ka Fai CHAN Baby monitor system with noise filtering and method thereof

Families Citing this family (108)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8798992B2 (en) * 2010-05-19 2014-08-05 Disney Enterprises, Inc. Audio noise modification for event broadcasting
US11278461B2 (en) 2010-07-07 2022-03-22 Aspect Imaging Ltd. Devices and methods for a neonate incubator, capsule and cart
US10499830B2 (en) 2010-07-07 2019-12-10 Aspect Imaging Ltd. Premature neonate life support environmental chamber for use in MRI/NMR devices
US10076266B2 (en) 2010-07-07 2018-09-18 Aspect Imaging Ltd. Devices and methods for a neonate incubator, capsule and cart
IL226488A (en) 2013-05-21 2016-07-31 Aspect Imaging Ltd Cradle for neonates
US10794975B2 (en) 2010-09-16 2020-10-06 Aspect Imaging Ltd. RF shielding channel in MRI-incubator's closure assembly
DE202011051313U1 (en) 2010-09-16 2011-11-23 Aspect Magnet Technologies Ltd. Closed life support system for premature babies
US8775341B1 (en) 2010-10-26 2014-07-08 Michael Lamport Commons Intelligent control with hierarchical stacked neural networks
US9015093B1 (en) 2010-10-26 2015-04-21 Michael Lamport Commons Intelligent control with hierarchical stacked neural networks
TWI474315B (en) * 2012-05-25 2015-02-21 Univ Nat Taiwan Normal Infant cries analysis method and system
US11278446B2 (en) 2013-09-02 2022-03-22 Aspect Imaging Ltd. Active thermo-regulated neonatal transportable incubator
DE202013104934U1 (en) 2013-11-03 2013-11-20 Aspect Imaging Ltd. Patiententransportinkubator
US10383782B2 (en) 2014-02-17 2019-08-20 Aspect Imaging Ltd. Incubator deployable multi-functional panel
US20150250978A1 (en) * 2014-03-04 2015-09-10 Jill Pelsue Infant Incubator Audio Therapy System
CA2938789A1 (en) * 2014-04-09 2015-10-15 Nestec S.A. Technique for determining a swallowing deficiency
US9319784B2 (en) * 2014-04-14 2016-04-19 Cirrus Logic, Inc. Frequency-shaped noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices
CA2900913C (en) 2014-08-20 2023-03-21 Dreamwell, Ltd. Smart pillows and processes for providing active noise cancellation and biofeedback
EP2996352B1 (en) * 2014-09-15 2019-04-17 Nxp B.V. Audio system and method using a loudspeaker output signal for wind noise reduction
US9659578B2 (en) * 2014-11-27 2017-05-23 Tata Consultancy Services Ltd. Computer implemented system and method for identifying significant speech frames within speech signals
IL236506A0 (en) * 2014-12-29 2015-04-30 Netanel Eyal Wearable noise cancellation deivce
US9666183B2 (en) 2015-03-27 2017-05-30 Qualcomm Incorporated Deep neural net based filter prediction for audio event classification and extraction
US9559736B2 (en) * 2015-05-20 2017-01-31 Mediatek Inc. Auto-selection method for modeling secondary-path estimation filter for active noise control system
US9666175B2 (en) * 2015-07-01 2017-05-30 zPillow, Inc. Noise cancelation system and techniques
US9734815B2 (en) 2015-08-20 2017-08-15 Dreamwell, Ltd Pillow set with snoring noise cancellation
US9949008B2 (en) 2015-08-29 2018-04-17 Bragi GmbH Reproduction of ambient environmental sound for acoustic transparency of ear canal device system and method
US9843853B2 (en) 2015-08-29 2017-12-12 Bragi GmbH Power control for battery powered personal area network device system and method
US9972895B2 (en) 2015-08-29 2018-05-15 Bragi GmbH Antenna for use in a wearable device
US9905088B2 (en) 2015-08-29 2018-02-27 Bragi GmbH Responsive visual communication system and method
US9949013B2 (en) 2015-08-29 2018-04-17 Bragi GmbH Near field gesture control system and method
US10152960B2 (en) * 2015-09-22 2018-12-11 Cirrus Logic, Inc. Systems and methods for distributed adaptive noise cancellation
JP6604113B2 (en) * 2015-09-24 2019-11-13 富士通株式会社 Eating and drinking behavior detection device, eating and drinking behavior detection method, and eating and drinking behavior detection computer program
US9980189B2 (en) 2015-10-20 2018-05-22 Bragi GmbH Diversity bluetooth system and method
US10104458B2 (en) 2015-10-20 2018-10-16 Bragi GmbH Enhanced biometric control systems for detection of emergency events system and method
US9980033B2 (en) 2015-12-21 2018-05-22 Bragi GmbH Microphone natural speech capture voice dictation system and method
US9939891B2 (en) 2015-12-21 2018-04-10 Bragi GmbH Voice dictation systems using earpiece microphone system and method
US10085091B2 (en) 2016-02-09 2018-09-25 Bragi GmbH Ambient volume modification through environmental microphone feedback loop system and method
US10264030B2 (en) 2016-02-22 2019-04-16 Sonos, Inc. Networked microphone device control
US10095470B2 (en) 2016-02-22 2018-10-09 Sonos, Inc. Audio response playback
US9772817B2 (en) 2016-02-22 2017-09-26 Sonos, Inc. Room-corrected voice detection
US10085082B2 (en) 2016-03-11 2018-09-25 Bragi GmbH Earpiece with GPS receiver
US10045116B2 (en) 2016-03-14 2018-08-07 Bragi GmbH Explosive sound pressure level active noise cancellation utilizing completely wireless earpieces system and method
US10251002B2 (en) * 2016-03-21 2019-04-02 Starkey Laboratories, Inc. Noise characterization and attenuation using linear predictive coding
US10052065B2 (en) 2016-03-23 2018-08-21 Bragi GmbH Earpiece life monitor with capability of automatic notification system and method
US10015579B2 (en) 2016-04-08 2018-07-03 Bragi GmbH Audio accelerometric feedback through bilateral ear worn device system and method
US10013542B2 (en) 2016-04-28 2018-07-03 Bragi GmbH Biometric interface system and method
US10238341B2 (en) 2016-05-24 2019-03-26 Graco Children's Products Inc. Systems and methods for autonomously soothing babies
US10201309B2 (en) 2016-07-06 2019-02-12 Bragi GmbH Detection of physiological data using radar/lidar of wireless earpieces
US10045110B2 (en) 2016-07-06 2018-08-07 Bragi GmbH Selective sound field environment processing system and method
US10115400B2 (en) 2016-08-05 2018-10-30 Sonos, Inc. Multiple voice services
US11287497B2 (en) 2016-08-08 2022-03-29 Aspect Imaging Ltd. Device, system and method for obtaining a magnetic measurement with permanent magnets
US10224135B2 (en) 2016-08-08 2019-03-05 Aspect Imaging Ltd. Device, system and method for obtaining a magnetic measurement with permanent magnets
US10137029B2 (en) * 2016-10-13 2018-11-27 Andrzej Szarek Anti-snoring device
US10181323B2 (en) 2016-10-19 2019-01-15 Sonos, Inc. Arbitration-based voice recognition
US10062373B2 (en) 2016-11-03 2018-08-28 Bragi GmbH Selective audio isolation from body generated sound system and method
US10058282B2 (en) 2016-11-04 2018-08-28 Bragi GmbH Manual operation assistance with earpiece with 3D sound cues
US10045117B2 (en) 2016-11-04 2018-08-07 Bragi GmbH Earpiece with modified ambient environment over-ride function
US10045112B2 (en) 2016-11-04 2018-08-07 Bragi GmbH Earpiece with added ambient environment
US10063957B2 (en) 2016-11-04 2018-08-28 Bragi GmbH Earpiece with source selection within ambient environment
US10771881B2 (en) 2017-02-27 2020-09-08 Bragi GmbH Earpiece with audio 3D menu
US11544104B2 (en) 2017-03-22 2023-01-03 Bragi GmbH Load sharing between wireless earpieces
US11694771B2 (en) 2017-03-22 2023-07-04 Bragi GmbH System and method for populating electronic health records with wireless earpieces
US11380430B2 (en) 2017-03-22 2022-07-05 Bragi GmbH System and method for populating electronic medical records with wireless earpieces
US10575086B2 (en) 2017-03-22 2020-02-25 Bragi GmbH System and method for sharing wireless earpieces
WO2018184174A1 (en) * 2017-04-06 2018-10-11 Zte Corporation Method and apparatus for wireless communication waveform generation
US10708699B2 (en) 2017-05-03 2020-07-07 Bragi GmbH Hearing aid with added functionality
US11116415B2 (en) 2017-06-07 2021-09-14 Bragi GmbH Use of body-worn radar for biometric measurements, contextual awareness and identification
US11013445B2 (en) 2017-06-08 2021-05-25 Bragi GmbH Wireless earpiece with transcranial stimulation
WO2019005835A1 (en) * 2017-06-26 2019-01-03 Invictus Medical, Inc. Active noise control microphone array
US10699691B1 (en) * 2017-06-29 2020-06-30 Amazon Technologies, Inc. Active noise cancellation for bone conduction speaker of a head-mounted wearable device
US10475449B2 (en) 2017-08-07 2019-11-12 Sonos, Inc. Wake-word detection suppression
US10048930B1 (en) 2017-09-08 2018-08-14 Sonos, Inc. Dynamic computation of system response volume
US10344960B2 (en) 2017-09-19 2019-07-09 Bragi GmbH Wireless earpiece controlled medical headlight
US11272367B2 (en) 2017-09-20 2022-03-08 Bragi GmbH Wireless earpieces for hub communications
US10446165B2 (en) * 2017-09-27 2019-10-15 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US10325588B2 (en) 2017-09-28 2019-06-18 International Business Machines Corporation Acoustic feature extractor selected according to status flag of frame of acoustic signal
US10482868B2 (en) 2017-09-28 2019-11-19 Sonos, Inc. Multi-channel acoustic echo cancellation
US10621981B2 (en) 2017-09-28 2020-04-14 Sonos, Inc. Tone interference cancellation
US10466962B2 (en) 2017-09-29 2019-11-05 Sonos, Inc. Media playback system with voice assistance
US10403303B1 (en) * 2017-11-02 2019-09-03 Gopro, Inc. Systems and methods for identifying speech based on cepstral coefficients and support vector machines
JP7246851B2 (en) * 2017-11-20 2023-03-28 ユニ・チャーム株式会社 Program, childcare support method, and childcare support system
US11052016B2 (en) 2018-01-18 2021-07-06 Aspect Imaging Ltd. Devices, systems and methods for reducing motion artifacts during imaging of a neonate
US11175880B2 (en) 2018-05-10 2021-11-16 Sonos, Inc. Systems and methods for voice-assisted media content selection
US10959029B2 (en) 2018-05-25 2021-03-23 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
WO2020012145A1 (en) * 2018-07-12 2020-01-16 Source to Site Accessories Limited System for identifying electrical devices
US10587430B1 (en) 2018-09-14 2020-03-10 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
US11024331B2 (en) 2018-09-21 2021-06-01 Sonos, Inc. Voice detection optimization using sound metadata
US11100923B2 (en) 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US11183183B2 (en) 2018-12-07 2021-11-23 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11132989B2 (en) 2018-12-13 2021-09-28 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US11545126B2 (en) * 2019-01-17 2023-01-03 Gulfstream Aerospace Corporation Arrangements and methods for enhanced communication on aircraft
US10867604B2 (en) 2019-02-08 2020-12-15 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11166677B2 (en) 2019-03-06 2021-11-09 General Electric Company Systems and methods for monitoring a patient
CN110021289B (en) * 2019-03-28 2021-08-31 腾讯科技(深圳)有限公司 Sound signal processing method, device and storage medium
TWI689897B (en) * 2019-04-02 2020-04-01 中原大學 Portable smart electronic device for noise attenuating and audio broadcasting
US11120794B2 (en) 2019-05-03 2021-09-14 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
CN114286700B (en) * 2019-06-28 2023-03-24 瑞思迈传感器技术有限公司 System and method for triggering sound to mask noise from a respiratory system and components thereof
US10741162B1 (en) * 2019-07-02 2020-08-11 Harman International Industries, Incorporated Stored secondary path accuracy verification for vehicle-based active noise control systems
US10871943B1 (en) 2019-07-31 2020-12-22 Sonos, Inc. Noise classification for event detection
EP4031087A4 (en) 2019-09-15 2023-09-20 Invictus Medical, Inc. Incubator noise control support
US10832535B1 (en) * 2019-09-26 2020-11-10 Bose Corporation Sleepbuds for parents
US11189286B2 (en) 2019-10-22 2021-11-30 Sonos, Inc. VAS toggle based on device orientation
US11200900B2 (en) 2019-12-20 2021-12-14 Sonos, Inc. Offline voice control
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11556787B2 (en) 2020-05-27 2023-01-17 International Business Machines Corporation AI-assisted detection and prevention of unwanted noise
WO2023077252A1 (en) * 2021-11-02 2023-05-11 华为技术有限公司 Fxlms structure-based active noise reduction system, method, and device

Citations (108)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3342285A (en) 1966-12-19 1967-09-19 Standard Systems Comm Corp Combination pillow speaker and control unit
US3998209A (en) 1975-12-16 1976-12-21 Macvaugh Gilbert S Snoring deconditioning system and method
US4038499A (en) 1976-02-02 1977-07-26 Yeaple Corporation Stereophonic pillow speaker system
EP0133195A1 (en) 1983-06-28 1985-02-20 Ruf-Technik GmbH Anti-snoring pillow
US4941478A (en) 1986-02-19 1990-07-17 Shohei Takeuchi Pillow for controlling snoring
US4985925A (en) 1988-06-24 1991-01-15 Sensor Electronics, Inc. Active noise reduction system
US5133017A (en) 1990-04-09 1992-07-21 Active Noise And Vibration Technologies, Inc. Noise suppression system
US5313678A (en) 1993-01-08 1994-05-24 Redewill Frances H Acoustical pillow
US5327496A (en) * 1993-06-30 1994-07-05 Iowa State University Research Foundation, Inc. Communication device, apparatus, and method utilizing pseudonoise signal for acoustical echo cancellation
US5359662A (en) 1992-04-29 1994-10-25 General Motors Corporation Active noise control system
US5444786A (en) 1993-02-09 1995-08-22 Snap Laboratories L.L.C. Snoring suppression system
US5473684A (en) 1994-04-21 1995-12-05 At&T Corp. Noise-canceling differential microphone assembly
JPH0883080A (en) 1994-09-12 1996-03-26 Matsushita Electric Ind Co Ltd Muffler
US5502770A (en) 1993-11-29 1996-03-26 Caterpillar Inc. Indirectly sensed signal processing in active periodic acoustic noise cancellation
JPH08140807A (en) 1994-11-24 1996-06-04 Brother Ind Ltd Silencing pillow
US5559893A (en) 1992-07-22 1996-09-24 Sinvent A/S Method and device for active noise reduction in a local area
US5581833A (en) 1994-11-04 1996-12-10 Zenoff; Andrew R. Support pillow with lumbar support for use in nursing and other applications
US5602928A (en) * 1995-01-05 1997-02-11 Digisonix, Inc. Multi-channel communication system
US5721771A (en) 1994-07-13 1998-02-24 Mitsubishi Denki Kabushiki Kaisha Hands-free speaking device with echo canceler
US5844996A (en) 1993-02-04 1998-12-01 Sleep Solutions, Inc. Active electronic noise suppression system and method for reducing snoring noise
US5940519A (en) 1996-12-17 1999-08-17 Texas Instruments Incorporated Active noise control system and method for on-line feedback path modeling and on-line secondary path modeling
US5991418A (en) 1996-12-17 1999-11-23 Texas Instruments Incorporated Off-line path modeling circuitry and method for off-line feedback path modeling and off-line secondary path modeling
US6097823A (en) 1996-12-17 2000-08-01 Texas Instruments Incorporated Digital hearing aid and method for feedback path modeling
US6182312B1 (en) 2000-02-02 2001-02-06 Lionel A. Walpin Orthopedic head and neck support pillow that requires no break-in period
US6198828B1 (en) 1996-12-17 2001-03-06 Texas Instruments Incorporated Off-line feedback path modeling circuitry and method for off-line feedback path modeling
US20010031052A1 (en) 2000-03-07 2001-10-18 Lock Christopher Colin Noise suppression loudspeaker
US6363345B1 (en) 1999-02-18 2002-03-26 Andrea Electronics Corporation System, method and apparatus for cancelling noise
US6418227B1 (en) 1996-12-17 2002-07-09 Texas Instruments Incorporated Active noise control system and method for on-line feedback path modeling
US20020106092A1 (en) 1997-06-26 2002-08-08 Naoshi Matsuo Microphone array apparatus
US6668407B1 (en) 2002-03-25 2003-12-30 Rita K Reitzel Audio pillow with sun shield
US6757395B1 (en) 2000-01-12 2004-06-29 Sonic Innovations, Inc. Noise reduction apparatus and method
US20040234079A1 (en) 2003-03-31 2004-11-25 Todd Schneider Method and system for acoustic shock protection
US6917688B2 (en) 2002-09-11 2005-07-12 Nanyang Technological University Adaptive noise cancelling microphone system
US20050201549A1 (en) 2004-03-10 2005-09-15 Mitel Networks Corporation Method and apparatus for optimizing speakerphone performance based on tilt angle
US7000273B2 (en) 2003-07-17 2006-02-21 Deborah Rivera-Wienhold Shaped body pillows and pillowcases
US7020288B1 (en) * 1999-08-20 2006-03-28 Matsushita Electric Industrial Co., Ltd. Noise reduction apparatus
JP2006293145A (en) 2005-04-13 2006-10-26 Nissan Motor Co Ltd Unit and method for active vibration control
JP2007089814A (en) 2005-09-28 2007-04-12 Toshiba Corp Functional pillow system
WO2007038922A1 (en) 2005-10-03 2007-04-12 Maysound Aps A system for providing a reduction of audiable noise perception for a human user
US20070239225A1 (en) 2006-02-28 2007-10-11 Saringer John H Training device and method to suppress sounds caused by sleep and breathing disorders
US7526428B2 (en) 2003-10-06 2009-04-28 Harris Corporation System and method for noise cancellation with noise ramp tracking
US20090147965A1 (en) 2007-12-07 2009-06-11 Kuo Sen M Electronic pillow for abating snoring/environmental noises, hands-free communications, and non-invasive monitoring and recording
US20090323976A1 (en) 2008-06-27 2009-12-31 Sony Corporation Noise reduction audio reproducing device and noise reduction audio reproducing method
US20100022280A1 (en) 2008-07-16 2010-01-28 Qualcomm Incorporated Method and apparatus for providing sidetone feedback notification to a user of a communication device with multiple microphones
US20100061564A1 (en) * 2007-02-07 2010-03-11 Richard Clemow Ambient noise reduction system
US7697699B2 (en) 2004-04-12 2010-04-13 Sony Corporation Method of and apparatus for reducing noise
US7742790B2 (en) 2006-05-23 2010-06-22 Alon Konchitsky Environmental noise reduction and cancellation for a communication device including for a wireless and cellular telephone
US20100278355A1 (en) 2009-04-29 2010-11-04 Yamkovoy Paul G Feedforward-Based ANR Adjustment Responsive to Environmental Noise Levels
US20110007907A1 (en) 2009-07-10 2011-01-13 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation
US20110026724A1 (en) * 2009-07-30 2011-02-03 Nxp B.V. Active noise reduction method using perceptual masking
US7930175B2 (en) 2006-07-10 2011-04-19 Nuance Communications, Inc. Background noise reduction system
US20110158419A1 (en) * 2009-12-30 2011-06-30 Lalin Theverapperuma Adaptive digital noise canceller
US20110182436A1 (en) 2010-01-26 2011-07-28 Carlo Murgia Adaptive Noise Reduction Using Level Cues
US20110206214A1 (en) 2010-02-25 2011-08-25 Markus Christoph Active noise reduction system
US20110235813A1 (en) 2005-05-18 2011-09-29 Gauger Jr Daniel M Adapted Audio Masking
US8045724B2 (en) 2007-11-13 2011-10-25 Wolfson Microelectronics Plc Ambient noise-reduction system
US20110299695A1 (en) 2010-06-04 2011-12-08 Apple Inc. Active noise cancellation decisions in a portable audio device
US8077874B2 (en) 2006-04-24 2011-12-13 Bose Corporation Active noise reduction microphone placing
US20110305345A1 (en) 2009-02-03 2011-12-15 University Of Ottawa Method and system for a multi-microphone noise reduction
US20120014532A1 (en) * 2010-07-15 2012-01-19 Kabushiki Kaisha Audio-Technica Noise-canceling headphone
US20120020489A1 (en) 2009-01-06 2012-01-26 Tomohiro Narita Noise canceller and noise cancellation program
US20120051548A1 (en) 2010-02-18 2012-03-01 Qualcomm Incorporated Microphone array subset selection for robust noise reduction
US8131541B2 (en) 2008-04-25 2012-03-06 Cambridge Silicon Radio Limited Two microphone noise reduction system
US20120057722A1 (en) 2010-09-07 2012-03-08 Sony Corporation Noise removing apparatus and noise removing method
US20120057720A1 (en) 2009-05-11 2012-03-08 Koninklijke Philips Electronics N.V. Audio noise cancelling
US8155334B2 (en) 2009-04-28 2012-04-10 Bose Corporation Feedforward-based ANR talk-through
US8175871B2 (en) 2007-09-28 2012-05-08 Qualcomm Incorporated Apparatus and method of noise and echo reduction in multiple microphone audio systems
US8184822B2 (en) 2009-04-28 2012-05-22 Bose Corporation ANR signal processing topology
US20120128176A1 (en) 2005-12-22 2012-05-24 Microsoft Corporation Spatial noise suppression for a microphone array
US8204242B2 (en) 2008-02-29 2012-06-19 Bose Corporation Active noise reduction adaptive filter leakage adjusting
US20120155667A1 (en) 2010-12-16 2012-06-21 Nair Vijayakumaran V Adaptive noise cancellation
US20120155666A1 (en) 2010-12-16 2012-06-21 Nair Vijayakumaran V Adaptive noise cancellation
US8208650B2 (en) 2009-04-28 2012-06-26 Bose Corporation Feedback-based ANR adjustment responsive to environmental noise levels
US20120163623A1 (en) 2010-12-22 2012-06-28 Alon Konchitsky Wideband noise reduction system and a method thereof
US20120162471A1 (en) 2010-12-28 2012-06-28 Toshiyuki Sekiya Audio signal processing device, audio signal processing method, and program
US20120163614A1 (en) 2010-12-24 2012-06-28 Sony Corporation Sound signal output device, speaker device, sound output device, and sound signal output method
US20120170766A1 (en) 2011-01-05 2012-07-05 Cambridge Silicon Radio Limited ANC For BT Headphones
US20120197638A1 (en) 2009-12-28 2012-08-02 Goertek Inc. Method and Device for Noise Reduction Control Using Microphone Array
US8255209B2 (en) 2004-11-18 2012-08-28 Samsung Electronics Co., Ltd. Noise elimination method, apparatus and medium thereof
US8280066B2 (en) 2009-04-28 2012-10-02 Bose Corporation Binaural feedforward-based ANR
US8280069B2 (en) 2009-02-16 2012-10-02 Panasonic Corporation Noise reduction apparatus
US20120250873A1 (en) 2011-03-31 2012-10-04 Bose Corporation Adaptive feed-forward noise reduction
US20120278070A1 (en) 2011-04-26 2012-11-01 Parrot Combined microphone and earphone audio headset having means for denoising a near speech signal, in particular for a " hands-free" telephony system
US20120275620A1 (en) 2011-04-28 2012-11-01 Fujitsu Limited Microphone array apparatus and storage medium storing sound signal processing program
US8320591B1 (en) 2007-07-15 2012-11-27 Lightspeed Aviation, Inc. ANR headphones and headsets
US20120308022A1 (en) 2011-06-06 2012-12-06 Sony Corporation Signal processing device and signal processing method
EP2533239A1 (en) 2009-04-28 2012-12-12 Bose Corporation Anr with adaptive gain
US8335318B2 (en) 2009-03-20 2012-12-18 Bose Corporation Active noise reduction adaptive filtering
US20130022213A1 (en) 2011-07-18 2013-01-24 Incus Laboratories Limited Digital noise-cancellation
US20130028435A1 (en) 2011-07-26 2013-01-31 Markus Christoph Noise reducing sound-reproduction
US8401205B2 (en) 2006-11-07 2013-03-19 Sony Corporation Noise canceling system and noise canceling method
US8416960B2 (en) 2009-08-18 2013-04-09 Bose Corporation Feedforward ANR device cover
US20130108068A1 (en) 2011-10-27 2013-05-02 Research In Motion Limited Headset with two-way multiplexed communication
US20130121498A1 (en) 2011-11-11 2013-05-16 Qsound Labs, Inc. Noise reduction using microphone array orientation information
US20130129106A1 (en) 2011-11-22 2013-05-23 Roman Sapiejewski Adjusting Noise Reduction in Headphones
US20130142349A1 (en) 2011-09-05 2013-06-06 Goertek Inc. Method, device and system for eliminating noises with multi-microphone array
US8472636B2 (en) 2006-01-26 2013-06-25 Wolfson Microelectronics Plc Ambient noise reduction arrangements
US20130177163A1 (en) 2012-01-05 2013-07-11 Richtek Technology Corporation Noise reduction using a speaker as a microphone
US8515090B2 (en) 2009-07-01 2013-08-20 Yamaha Corporation Ambient noise removal device
US20130216060A1 (en) 2012-02-21 2013-08-22 Wolfson Microelectronics Plc Noise cancellation system
EP2642481A1 (en) 2009-04-28 2013-09-25 Bose Corporation Circuit and method for active noise reduction
US20140003614A1 (en) * 2011-12-12 2014-01-02 Alex Levitov Neonatal incubator
US20140072135A1 (en) 2012-09-10 2014-03-13 Apple Inc. Prevention of anc instability in the presence of low frequency noise
US20140086425A1 (en) 2012-09-24 2014-03-27 Apple Inc. Active noise cancellation using multiple reference microphone signals
US20140169579A1 (en) * 2012-12-18 2014-06-19 Apple Inc. Hybrid adaptive headphone
US8958571B2 (en) * 2011-06-03 2015-02-17 Cirrus Logic, Inc. MIC covering detection in personal audio devices
US9082389B2 (en) * 2012-03-30 2015-07-14 Apple Inc. Pre-shaping series filter for active noise cancellation adaptive filter
US9247346B2 (en) * 2007-12-07 2016-01-26 Northern Illinois Research Foundation Apparatus, system and method for noise cancellation and communication for incubators and related devices

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5033082A (en) * 1989-07-31 1991-07-16 Nelson Industries, Inc. Communication system with active noise cancellation
US8447045B1 (en) * 2010-09-07 2013-05-21 Audience, Inc. Multi-microphone active noise cancellation system

Patent Citations (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3342285A (en) 1966-12-19 1967-09-19 Standard Systems Comm Corp Combination pillow speaker and control unit
US3998209A (en) 1975-12-16 1976-12-21 Macvaugh Gilbert S Snoring deconditioning system and method
US4038499A (en) 1976-02-02 1977-07-26 Yeaple Corporation Stereophonic pillow speaker system
EP0133195A1 (en) 1983-06-28 1985-02-20 Ruf-Technik GmbH Anti-snoring pillow
US4941478A (en) 1986-02-19 1990-07-17 Shohei Takeuchi Pillow for controlling snoring
US4985925A (en) 1988-06-24 1991-01-15 Sensor Electronics, Inc. Active noise reduction system
US5133017A (en) 1990-04-09 1992-07-21 Active Noise And Vibration Technologies, Inc. Noise suppression system
US5359662A (en) 1992-04-29 1994-10-25 General Motors Corporation Active noise control system
US5559893A (en) 1992-07-22 1996-09-24 Sinvent A/S Method and device for active noise reduction in a local area
US5313678A (en) 1993-01-08 1994-05-24 Redewill Frances H Acoustical pillow
US5844996A (en) 1993-02-04 1998-12-01 Sleep Solutions, Inc. Active electronic noise suppression system and method for reducing snoring noise
US5444786A (en) 1993-02-09 1995-08-22 Snap Laboratories L.L.C. Snoring suppression system
US5327496A (en) * 1993-06-30 1994-07-05 Iowa State University Research Foundation, Inc. Communication device, apparatus, and method utilizing pseudonoise signal for acoustical echo cancellation
US5502770A (en) 1993-11-29 1996-03-26 Caterpillar Inc. Indirectly sensed signal processing in active periodic acoustic noise cancellation
US5473684A (en) 1994-04-21 1995-12-05 At&T Corp. Noise-canceling differential microphone assembly
US5721771A (en) 1994-07-13 1998-02-24 Mitsubishi Denki Kabushiki Kaisha Hands-free speaking device with echo canceler
JPH0883080A (en) 1994-09-12 1996-03-26 Matsushita Electric Ind Co Ltd Muffler
US5581833A (en) 1994-11-04 1996-12-10 Zenoff; Andrew R. Support pillow with lumbar support for use in nursing and other applications
JPH08140807A (en) 1994-11-24 1996-06-04 Brother Ind Ltd Silencing pillow
US5602928A (en) * 1995-01-05 1997-02-11 Digisonix, Inc. Multi-channel communication system
US6418227B1 (en) 1996-12-17 2002-07-09 Texas Instruments Incorporated Active noise control system and method for on-line feedback path modeling
US5940519A (en) 1996-12-17 1999-08-17 Texas Instruments Incorporated Active noise control system and method for on-line feedback path modeling and on-line secondary path modeling
US5991418A (en) 1996-12-17 1999-11-23 Texas Instruments Incorporated Off-line path modeling circuitry and method for off-line feedback path modeling and off-line secondary path modeling
US6097823A (en) 1996-12-17 2000-08-01 Texas Instruments Incorporated Digital hearing aid and method for feedback path modeling
US6198828B1 (en) 1996-12-17 2001-03-06 Texas Instruments Incorporated Off-line feedback path modeling circuitry and method for off-line feedback path modeling
US20020106092A1 (en) 1997-06-26 2002-08-08 Naoshi Matsuo Microphone array apparatus
US6363345B1 (en) 1999-02-18 2002-03-26 Andrea Electronics Corporation System, method and apparatus for cancelling noise
US7020288B1 (en) * 1999-08-20 2006-03-28 Matsushita Electric Industrial Co., Ltd. Noise reduction apparatus
US6757395B1 (en) 2000-01-12 2004-06-29 Sonic Innovations, Inc. Noise reduction apparatus and method
US6182312B1 (en) 2000-02-02 2001-02-06 Lionel A. Walpin Orthopedic head and neck support pillow that requires no break-in period
US20010031052A1 (en) 2000-03-07 2001-10-18 Lock Christopher Colin Noise suppression loudspeaker
US6668407B1 (en) 2002-03-25 2003-12-30 Rita K Reitzel Audio pillow with sun shield
US6917688B2 (en) 2002-09-11 2005-07-12 Nanyang Technological University Adaptive noise cancelling microphone system
US20040234079A1 (en) 2003-03-31 2004-11-25 Todd Schneider Method and system for acoustic shock protection
US7000273B2 (en) 2003-07-17 2006-02-21 Deborah Rivera-Wienhold Shaped body pillows and pillowcases
US7526428B2 (en) 2003-10-06 2009-04-28 Harris Corporation System and method for noise cancellation with noise ramp tracking
US20050201549A1 (en) 2004-03-10 2005-09-15 Mitel Networks Corporation Method and apparatus for optimizing speakerphone performance based on tilt angle
US7697699B2 (en) 2004-04-12 2010-04-13 Sony Corporation Method of and apparatus for reducing noise
US8255209B2 (en) 2004-11-18 2012-08-28 Samsung Electronics Co., Ltd. Noise elimination method, apparatus and medium thereof
JP2006293145A (en) 2005-04-13 2006-10-26 Nissan Motor Co Ltd Unit and method for active vibration control
US20110235813A1 (en) 2005-05-18 2011-09-29 Gauger Jr Daniel M Adapted Audio Masking
JP2007089814A (en) 2005-09-28 2007-04-12 Toshiba Corp Functional pillow system
WO2007038922A1 (en) 2005-10-03 2007-04-12 Maysound Aps A system for providing a reduction of audiable noise perception for a human user
US20120128176A1 (en) 2005-12-22 2012-05-24 Microsoft Corporation Spatial noise suppression for a microphone array
US8472636B2 (en) 2006-01-26 2013-06-25 Wolfson Microelectronics Plc Ambient noise reduction arrangements
US20070239225A1 (en) 2006-02-28 2007-10-11 Saringer John H Training device and method to suppress sounds caused by sleep and breathing disorders
US8077874B2 (en) 2006-04-24 2011-12-13 Bose Corporation Active noise reduction microphone placing
US7742790B2 (en) 2006-05-23 2010-06-22 Alon Konchitsky Environmental noise reduction and cancellation for a communication device including for a wireless and cellular telephone
US7930175B2 (en) 2006-07-10 2011-04-19 Nuance Communications, Inc. Background noise reduction system
US8401205B2 (en) 2006-11-07 2013-03-19 Sony Corporation Noise canceling system and noise canceling method
US20100061564A1 (en) * 2007-02-07 2010-03-11 Richard Clemow Ambient noise reduction system
US8320591B1 (en) 2007-07-15 2012-11-27 Lightspeed Aviation, Inc. ANR headphones and headsets
US8175871B2 (en) 2007-09-28 2012-05-08 Qualcomm Incorporated Apparatus and method of noise and echo reduction in multiple microphone audio systems
US8045724B2 (en) 2007-11-13 2011-10-25 Wolfson Microelectronics Plc Ambient noise-reduction system
US20090147965A1 (en) 2007-12-07 2009-06-11 Kuo Sen M Electronic pillow for abating snoring/environmental noises, hands-free communications, and non-invasive monitoring and recording
US9247346B2 (en) * 2007-12-07 2016-01-26 Northern Illinois Research Foundation Apparatus, system and method for noise cancellation and communication for incubators and related devices
US8204242B2 (en) 2008-02-29 2012-06-19 Bose Corporation Active noise reduction adaptive filter leakage adjusting
US8131541B2 (en) 2008-04-25 2012-03-06 Cambridge Silicon Radio Limited Two microphone noise reduction system
US20090323976A1 (en) 2008-06-27 2009-12-31 Sony Corporation Noise reduction audio reproducing device and noise reduction audio reproducing method
US20100022280A1 (en) 2008-07-16 2010-01-28 Qualcomm Incorporated Method and apparatus for providing sidetone feedback notification to a user of a communication device with multiple microphones
US20120020489A1 (en) 2009-01-06 2012-01-26 Tomohiro Narita Noise canceller and noise cancellation program
US20110305345A1 (en) 2009-02-03 2011-12-15 University Of Ottawa Method and system for a multi-microphone noise reduction
US8280069B2 (en) 2009-02-16 2012-10-02 Panasonic Corporation Noise reduction apparatus
US8335318B2 (en) 2009-03-20 2012-12-18 Bose Corporation Active noise reduction adaptive filtering
EP2533239A1 (en) 2009-04-28 2012-12-12 Bose Corporation Anr with adaptive gain
US8208650B2 (en) 2009-04-28 2012-06-26 Bose Corporation Feedback-based ANR adjustment responsive to environmental noise levels
US8155334B2 (en) 2009-04-28 2012-04-10 Bose Corporation Feedforward-based ANR talk-through
US8184822B2 (en) 2009-04-28 2012-05-22 Bose Corporation ANR signal processing topology
US8280066B2 (en) 2009-04-28 2012-10-02 Bose Corporation Binaural feedforward-based ANR
EP2642481A1 (en) 2009-04-28 2013-09-25 Bose Corporation Circuit and method for active noise reduction
US20100278355A1 (en) 2009-04-29 2010-11-04 Yamkovoy Paul G Feedforward-Based ANR Adjustment Responsive to Environmental Noise Levels
US20120057720A1 (en) 2009-05-11 2012-03-08 Koninklijke Philips Electronics N.V. Audio noise cancelling
US8515090B2 (en) 2009-07-01 2013-08-20 Yamaha Corporation Ambient noise removal device
US20110007907A1 (en) 2009-07-10 2011-01-13 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation
US20110026724A1 (en) * 2009-07-30 2011-02-03 Nxp B.V. Active noise reduction method using perceptual masking
US8416960B2 (en) 2009-08-18 2013-04-09 Bose Corporation Feedforward ANR device cover
US8571228B2 (en) 2009-08-18 2013-10-29 Bose Corporation Feedforward ANR device acoustics
US20120197638A1 (en) 2009-12-28 2012-08-02 Goertek Inc. Method and Device for Noise Reduction Control Using Microphone Array
US20110158419A1 (en) * 2009-12-30 2011-06-30 Lalin Theverapperuma Adaptive digital noise canceller
US20110182436A1 (en) 2010-01-26 2011-07-28 Carlo Murgia Adaptive Noise Reduction Using Level Cues
US20120051548A1 (en) 2010-02-18 2012-03-01 Qualcomm Incorporated Microphone array subset selection for robust noise reduction
US20110206214A1 (en) 2010-02-25 2011-08-25 Markus Christoph Active noise reduction system
US20130252675A1 (en) 2010-06-04 2013-09-26 Apple Inc. Active noise cancellation decisions in a portable audio device
US20110299695A1 (en) 2010-06-04 2011-12-08 Apple Inc. Active noise cancellation decisions in a portable audio device
US20120014532A1 (en) * 2010-07-15 2012-01-19 Kabushiki Kaisha Audio-Technica Noise-canceling headphone
US20120057722A1 (en) 2010-09-07 2012-03-08 Sony Corporation Noise removing apparatus and noise removing method
US20120155666A1 (en) 2010-12-16 2012-06-21 Nair Vijayakumaran V Adaptive noise cancellation
US20120155667A1 (en) 2010-12-16 2012-06-21 Nair Vijayakumaran V Adaptive noise cancellation
US20120163623A1 (en) 2010-12-22 2012-06-28 Alon Konchitsky Wideband noise reduction system and a method thereof
US20120163614A1 (en) 2010-12-24 2012-06-28 Sony Corporation Sound signal output device, speaker device, sound output device, and sound signal output method
US20120162471A1 (en) 2010-12-28 2012-06-28 Toshiyuki Sekiya Audio signal processing device, audio signal processing method, and program
US8718291B2 (en) * 2011-01-05 2014-05-06 Cambridge Silicon Radio Limited ANC for BT headphones
US20120170766A1 (en) 2011-01-05 2012-07-05 Cambridge Silicon Radio Limited ANC For BT Headphones
US20120250873A1 (en) 2011-03-31 2012-10-04 Bose Corporation Adaptive feed-forward noise reduction
US20120278070A1 (en) 2011-04-26 2012-11-01 Parrot Combined microphone and earphone audio headset having means for denoising a near speech signal, in particular for a " hands-free" telephony system
US20120275620A1 (en) 2011-04-28 2012-11-01 Fujitsu Limited Microphone array apparatus and storage medium storing sound signal processing program
US8958571B2 (en) * 2011-06-03 2015-02-17 Cirrus Logic, Inc. MIC covering detection in personal audio devices
US20120308022A1 (en) 2011-06-06 2012-12-06 Sony Corporation Signal processing device and signal processing method
US20130022213A1 (en) 2011-07-18 2013-01-24 Incus Laboratories Limited Digital noise-cancellation
US20130028435A1 (en) 2011-07-26 2013-01-31 Markus Christoph Noise reducing sound-reproduction
US20130142349A1 (en) 2011-09-05 2013-06-06 Goertek Inc. Method, device and system for eliminating noises with multi-microphone array
US20130108068A1 (en) 2011-10-27 2013-05-02 Research In Motion Limited Headset with two-way multiplexed communication
US20130121498A1 (en) 2011-11-11 2013-05-16 Qsound Labs, Inc. Noise reduction using microphone array orientation information
US20130129106A1 (en) 2011-11-22 2013-05-23 Roman Sapiejewski Adjusting Noise Reduction in Headphones
US20140003614A1 (en) * 2011-12-12 2014-01-02 Alex Levitov Neonatal incubator
US20130177163A1 (en) 2012-01-05 2013-07-11 Richtek Technology Corporation Noise reduction using a speaker as a microphone
US20130216060A1 (en) 2012-02-21 2013-08-22 Wolfson Microelectronics Plc Noise cancellation system
US9082389B2 (en) * 2012-03-30 2015-07-14 Apple Inc. Pre-shaping series filter for active noise cancellation adaptive filter
US20140072135A1 (en) 2012-09-10 2014-03-13 Apple Inc. Prevention of anc instability in the presence of low frequency noise
US20140086425A1 (en) 2012-09-24 2014-03-27 Apple Inc. Active noise cancellation using multiple reference microphone signals
US20140169579A1 (en) * 2012-12-18 2014-06-19 Apple Inc. Hybrid adaptive headphone

Non-Patent Citations (90)

* Cited by examiner, † Cited by third party
Title
Akhtar et al., "A New Structure for Feedforward Active Noise Control Systems With Improved Online Secondary Path Modeling," Published in Speech and Audio Processing, IEEE Transactions, vol. 13(5): 1082-1088 (Sep. 2005).
Beemanpally, "Multiple-Channel Hybrid Active Noise Control Systems with Infant Cry Detection for Infant Incubators," UMI No. 1494385 (2010).
Chang et al., "Active Noise Cancellation Without Secondary Path Identification by Using an Adaptive Genetic Algorithm," IEEE Trans. on Instrumentation and Measurement, 59(9): 2315-2327 (2010).
Das et al., "New Block Filtered-X LMS Algorithms for Active Noise Control Systems," IET Signal Processing, 1(2): 73-81 (2007).
Gan et al., "Adaptive Feedback Active Noise Control Headsets: Implementation, Evaluation and Its Extensions" IEEE Trans. on Consumer Electronics, 51(3): 975-982 (2005).
Gan et al., "An Integrated Audio and Active Noise Control Headsets," IEEE Trans. on Consumer Electronics, 48(2): 242-247 (2002).
Gan et al., "Audio Projection: Directional Sound and Its Application in Immersive Communication," IEEE Signal Processing Magazine, 29(1): 43-57 (2011).
Gan et al., "Embedded Signal Processing with the Micro Signal Architecture," John Wiley & Sons, Hoboken, NJ, pp. v-xix (2007).
Gan et al., "Teaching DSP Software Development: From Design to Fixed-Point Implementations," IEEE Trans. on Education, 49(1): 122-131 (2006).
Gan et al., "Transition from Simulink to MATLAB in Real-Time Digital Signal Processing Education," International Journal on Engineering Education, 21(3): 587-595 (2005).
Gan et al., "Virtual Bass for Home Entertainment, Multimedia PC, Game Station and Portable Audio Systems," IEEE Trans. on Consumer Electronics, 47(4): 787-794 (2001).
Greenwood et al. "Implementation of the Fractal-Based Random-Iterated Function System Decoding on the AT&T DSP32C," Chapter 4 in Progress in Computer Graphics, Edited by C. Sabharwal and G. Zobrist, pp. 127-163, Ablex Publishing Co., Norwood, NJ, 1992.
Gujjula, "Real-Time Audio-Integrated Active Noise Control System for Infant Incubators," UMI No. 1460212 (2008).
Gupta et al., "Active Vibration Control of a Structure by Implementing Filtered-X LMS Algorithm for Active Vibration Control," Noise Control Engineering Journal, 54(6): 396-405 (2006).
Gupta et al., "Digital Implementation of Active Vibration Control of a Structure," Journal of Low Frequency Noise, Vibration and Active Control, 26(2): 135-141 (2007).
International Search Report issued in PCT/US2008/085293 dated Jan. 29, 2009.
Jeon et al., "A Narrowband Active Noise Control System with Frequency Corrector," IEEE Trans. Audio, Speech and Language Processing, 19(4): 990-1002 (2011).
Jeon et al., "Analysis of Frequency Mismatch in Narrowband Active Noise Control," IEEE Trans. Audio, Speech and Language Processing, 18(6): 1632-1642 (2010).
Kong et al., "Analysis of Asymmetric Out-of-Band Overshoot in Narrowband Active Noise Control Systems," IEEE Trans. on Speech Audio Processing, 7(5): 587-591 (1999).
Kong et al., "Multiple Channel Hybrid Active Noise Control Systems," IEEE Trans. on Control Systems Technology, 6(6): 719-729 (1998).
Kong et al., "Study of Causality Constraint on Feed-forward Active Noise Control Systems," IEEE Trans. on Circuits and Systems, 46(2): 183-186 (1999).
Kuo et al, "Active Noise Control Systems-Algorithms and DSP Implementations," John Wiley & Sons, New York, NY (1996).
Kuo et al., "A Secondary Path Modeling Technique for Active Noise Control Systems," IEEE Trans. on Speech and Audio Processing, 5(4): 374-377 (1997).
Kuo et al., "Acoustic Noise and Echo Cancellation Microphone System for Videoconferencing," IEEE Trans. on Consumer Electronics, 41(4): 1150-1158 (1995).
Kuo et al., "Acoustical Mechanisms and Performance of Various Active Duct Noise Control Systems," Applied Acoustics, 41(1): 81-91 (1994).
Kuo et al., "Active Noise Control System for Headphone Applications," IEEE Trans. on Control Systems Technology, 14(2): 331-335 (2006).
Kuo et al., "Active Noise Control System with Parallel On-Line Error-Path Modeling Algorithm," Noise Control Engineering Journal, Institute of Noise Control Engineering, 39(3): 119-127 (1992).
Kuo et al., "Active Noise Control," Chapter 49 in Springer Handbook of Speech Processing and Speech Communications, Edited by J. Benesty, Y. Huang, and M. Sondhi, pp. 1001-1017, Berlin Heidelberg: Springer-Verlag, 2008.
Kuo et al., "Active Noise Control: A Tutorial Review," Proceedings of the IEEE, 87(6): 943-973 (1999).
Kuo et al., "Active Snore Noise Control Systems," Noise Control Engineering Journal, 56(1): 16-24 (2008).
Kuo et al., "Adaptive Acoustic Echo Cancellation Microphone," Journal of Acoustical Society of America, 93(3): 1629-1636 (1993).
Kuo et al., "Adaptive Active Noise Control Systems," Chapter 2 in Digital Signal Processing Technology, Edited by P. Papamichalis and R. Kerwin, vol. CR57, pp. 23-49, SPIE Press, Bellingham, Washington, 1995.
Kuo et al., "Adaptive Algorithms and Experimental Verification of Feedback Active Noise Control Systems," Noise Control Engineering Journal, 42(2): 37-46 (1994).
Kuo et al., "Adaptive Noise and Acoustic Echo Cancellation Techniques for the Hands-Free Cellular Phone System," Applied Signal Processing, 1: 217-227 (1994).
Kuo et al., "An Acoustic Echo Canceler Adaptable During Double-Talk Periods Using Two Microphones," Acoustics Letters, 15(9): 175-178 (1992).
Kuo et al., "An Innovative Course Emphasizing Real-Time Digital Signal Processing Applications," IEEE Trans. on Education, 39(2): 109-113 (1996).
Kuo et al., "Analysis of Finite Length Acoustic Echo Cancellation System," Speech Communication, European Association for Signal Processing and European Speech Communication Association, 16(3): 255-260 (1995).
Kuo et al., "Applications of Adaptive Feedback Active Noise Control System," IEEE Trans. on Control Systems Technology, 11(2): 216-220 (2003).
Kuo et al., "Broadband Adaptive Noise Equalizer," IEEE Signal Processing Letters, 3(8): 234-235 (1996).
Kuo et al., "Convergence Analysis of Narrowband Active Noise Control Systems," IEEE Trans. on Circuits and Systems-I: Analog and Digital System Processing, 46(2): 220-223 (1999).
Kuo et al., "Design of Active Noise Control Systems with the TMS320 Family," Application Book, Texas Instruments, SPRA042 (1996).
Kuo et al., "Development and Analysis of an Adaptive Noise Equalizer," IEEE Trans. on Speech and Audio Processing, 3(3): 217-222 (1995).
Kuo et al., "Development and Analysis of Distributed Acoustic Echo Cancellation Microphone System," Signal Processing, European Association for Signal Processing, 37(3): 333-344 (1994).
Kuo et al., "Development and Application of Audio-Integrated Active Noise Control System for Infant Incubators," Noise Control Engineering Journal, 58(2): 163-175 (2010).
Kuo et al., "Development and Experiment of Narrowband Active Noise Equalizer," Noise Control Engineering Journal, 41(1): 281-288 (1993).
Kuo et al., "Development of Adaptive Algorithm for Active Sound Quality Control," Journal of Sound and Vibration, 299: 12-21 (2007).
Kuo et al., "Digital Hearing Aid with the Lapped Transform," Digital Signal Processing, 3(4): 228-239 (1993).
Kuo et al., "Digital Signal Processors: Architectures, Implementations, and Applications," Prentice Hall, Upper Saddle River, NJ (2005).
Kuo et al., "Distributed Acoustic Echo Cancellation System With Double-Talk Detector," Journal of Acoustical Society of America, 94(6): 3057-3060 (1993).
Kuo et al., "Dual-Channel Audio Equalization and Cross-Talk Cancellation for 3-D Sound Reproduction," IEEE Trans. on Consumer Electronics, 43(4): 1189-1196 (1997).
Kuo et al., "Effects of Frequency Separation in Periodic Active Noise Control Systems," IEEE Trans. on Audio, Speech, and Language Processing, 14(5): 1857-1866 (2006).
Kuo et al., "Frequency-Domain Delayless Active Sound Quality Control Algorithms," Journal of Sound and Vibration, 318: 715-724 (2008).
Kuo et al., "Frequency-Domain Periodic Active Noise Control and Equalization," IEEE Trans. on Speech and Audio Processing, 5(4): 348-358 (1997).
Kuo et al., "Implementation of Adaptive Filtering with the TMS320C25 or the TMS320C30," Chapter 7 in Digital Signal Processing Applications with the TMS320 Family, Edited by P. Papamichalis, vol. III, pp. 191-271, Prentice-Hall, Englewood Cliffs, NJ 1990.
Kuo et al., "Integrated Automotive Signal Processing and Audio System," IEEE Trans. on Consumer Electronics, 39(3): 522-532 (1993).
Kuo et al., "Integrated Frequency-Domain Digital Hearing Aid with the Lapped Transform," Electronics Letters. 28(23): 2117-2118 (1992).
Kuo et al., "Multipath Acoustic Echo Canceler with New PAP Structure and TW-LMS Algorithm," Acoustic Letters, 16(12): 270-273 (1993).
Kuo et al., "Multiple Reference Subband Adaptive Noise Canceler for Hands-free Cellular Phone Applications," Journal of the Franklin Institute, 333(B)(5): 669-686 (1996).
Kuo et al., "Multiple-Microphone Acoustic Echo Cancellation System with the Partial Adaptive Process," Digital Signal Processing, 3(1): 54-63 (1993).
Kuo et al., "Narrowband Active Noise Control Using Adaptive Delay Filter," IEEE Signal Processing Letters, 5(12): 309-311 (1998).
Kuo et al., "New Adaptive IIR Notch Filter and Its Application to Howling Control in Speakerphone System," Electronics Letters, 28(8): 764-766 (1992).
Kuo et al., "Nonlinear Adaptive Bilinear Filters for Active Noise Control Systems," IEEE Trans. on Circuits and Systems, Part I: Regular Papers, 52(3): 617-624 (2005).
Kuo et al., "On-Line Modeling and Feedback Compensation for Multiple-Channel Active Noise Control Systems," Applied Signal Processing, 1(2): 64-75 (1994).
Kuo et al., "Parallel Adaptive On-Line Error-Path Modeling Algorithm for Active Noise Control System," Electronics Letters, 28(4): 375-377 (1992).
Kuo et al., "Passband Disturbance Reduction in Periodic Active Noise Control System," IEEE Trans. on Speech and Audio Processing, 4(2): 96-103(1996).
Kuo et al., "Performance Analysis of Acoustic Echo Cancellation Microphone," Acoustics Letters, 16(7): 151-156 (1993).
Kuo et al., "Principle and Application of Adaptive Noise Equalizer," IEEE Trans. on Circuits and Systems, 41(7): 471-474 (1994).
Kuo et al., "Principle and Applications of Asymmetric Crosstalk-Resistant Adaptive Noise Canceler," Journal of the Franklin Institute, 337: 57-71 (2000).
Kuo et al., "Real-Time Digital Signal Processing: Implementations and Applications," John Wiley & Sons, West Sussex (2006).
Kuo et al., "Residual Noise Shaping Technique for Active Noise Control Systems," Journal of Acoustical Society of America, 95(3): 1665-1668 (1994).
Kuo et al., "Saturation Effects in Active Noise Control Systems," IEEE Trans. on Circuits and Systems, Part 1: Regular Papers, 51(6): 1163-1171 (2004).
Kuo et al., "Three-Stage Algorithm for Transformer Active Noise Control," Applied Signal Processing, 4(1): 27-38 (1997).
Kuo et al., Real-Time Digital Signal Processing: Implementations, Applications, and Experiments with the TMS320C55x, John Wiley & Sons, Chichester, (2001).
Lau et al., "Noise, Engineering Acoustics, Physical Acoustics, and Signal Processing in Acoustics: Active Noise Control I," J. Acoust. Soc. Am, 131(4): 3379-3381 (2012).
Lee et al., "Subband Adaptive Filtering: Theory and Implementation," John Wiley & Sons, West Sussex, (2009).
Liu et al. "Multi-Channel Real Time Active Noise Control System for Infant Incubators," 31st Annual International Conference of the IEEE EMBS, 935-938 (2009).
Liu et al. "Still in Womb: Intrauterine Acoustic Embedded Active Noise Control for Infant Incubators," Advances in Acoustics and Vibration, 2008(495317): 1-9 (2008).
Liu et al., "Active Noise Control for Motorcycle Helmet," International Journal of Information and Communication Engineering, 6(2): 103-108 (2010).
Liu et al., "An Audio Integrated Motorcycle Helmet," J. of Low Frequency Noise, Vibration and Active Control, 29(3): 161-170 (2010).
Liu et al., "Real-time Experiments of ANC Systems for Infant Incubators," Noise Control Engineering Journal, 60(1): 36-41 (2012).
Office Action issued in Japanese Patent App. No. 2010-537019 (Aug. 14, 2012).
Song et al., "A Robust Hybrid Feedback Active Noise Cancellation Headset," IEEE Trans. on Speech and Audio Processing, 13(4) 607-617 (2005).
Sun et al., "Active Narrowband Noise Control Systems Using Cascading Adaptive Filters," IEEE Trans. on Audio, Speech, and Language Processing, 15(2): 586-592 (2007).
Sun et al., "Adaptive Algorithm for Active Control of Impulsive Noise," Journal of Sound and Vibration, 291: 516-522 (2006).
Supplementary European Search Report issued in EP08856447 dated Apr. 5, 2011.
U.S. Appl. No. 13/673,005, filed Nov. 9, 2012.
Wang et al., "Integration of Bass Enhancement and Active Noise Control System in Automobile Cabin," Advances in Acoustics and Vibration, 2008: Article ID 869130 (2008).
Wu et al., "Teaching Challenge in Hands-on DSP Experiments for Night-School Students," EURASIP Journal on Advances in Signal Processing, 2008: Article ID 570896 (2008).
Yang et al., "Analysis of Narrowband Active Noise and Vibration Control Systems Using Parallel Adaptive Notch Filters," Journal of Vibration and Control, 14(7): 931-951 (2008).
Yu et al., "Active Noise Control for Infant Incubators," 31st Annual International Conference of the IEEE EMBS, 2531-2534 (2009).

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170084264A1 (en) * 2007-12-07 2017-03-23 Northern Illinois Research Foundation Apparatus, system and method for noise cancellation and communication for incubators and related devices
US9858915B2 (en) * 2007-12-07 2018-01-02 Northern Illinois Research Foundation Apparatus, system and method for noise cancellation and communication for incubators and related devices
US10339911B2 (en) 2016-11-01 2019-07-02 Stryker Corporation Person support apparatuses with noise cancellation
US11240590B2 (en) 2019-07-31 2022-02-01 Merit Zone Limited Baby monitor system with noise filtering
US11875769B2 (en) 2019-07-31 2024-01-16 Kelvin Ka Fai CHAN Baby monitor system with noise filtering and method thereof

Also Published As

Publication number Publication date
US20130204617A1 (en) 2013-08-08
US20170084264A1 (en) 2017-03-23
US9247346B2 (en) 2016-01-26
US9858915B2 (en) 2018-01-02
US20160093281A1 (en) 2016-03-31

Similar Documents

Publication Publication Date Title
US9858915B2 (en) Apparatus, system and method for noise cancellation and communication for incubators and related devices
US10765399B2 (en) Programmable electronic stethoscope devices, algorithms, systems, and methods
Mehta et al. Mobile voice health monitoring using a wearable accelerometer sensor and a smartphone platform
Istrate et al. Information extraction from sound for medical telemonitoring
Shin et al. Automatic detection system for cough sounds as a symptom of abnormal health condition
Lee et al. Fetuses respond to father's voice but prefer mother's voice after birth
JP2021507775A (en) Devices, systems and methods for motion sensing
US11399772B2 (en) Stethographic device
TWI749663B (en) Method for monitoring phonation and system thereof
Dupont et al. Combined use of close-talk and throat microphones for improved speech recognition under non-stationary background noise
Usman et al. Speech as A Biomarker for COVID-19 detection using machine learning
Patil “Cry Baby”: Using Spectrographic Analysis to Assess Neonatal Health Status from an Infant’s Cry
Cheyne Estimating glottal voicing source characteristics by measuring and modeling the acceleration of the skin on the neck
WO2022012777A1 (en) A computer-implemented method of providing data for an automated baby cry assessment
Liu et al. Infant cry classification integrated ANC system for infant incubators
US20220409063A1 (en) Diagnosis of medical conditions using voice recordings and auscultation
Silva et al. Infant cry detection system with automatic soothing and video monitoring functions
Chittora et al. Spectral analysis of infant cries and adult speech
Dai et al. An improved model of masking effects for robust speech recognition system
Cruz et al. An incremental algorithm based on multichannel non-negative matrix partial co-factorization for ambient denoising in auscultation
Liu et al. Real-time experiments of ANC systems for infant incubators
Beemanpally Multiple-channel hybrid active noise control systems with infant cry detection for infant incubators
Su Communication-integrated Multi-channel ANC System for ICU Environment
Hirahara et al. Acoustic characteristics of non-audible murmur
Vaishnavi et al. An automatic approach to extract features from the infant’s cry signals

Legal Events

Date Code Title Description
AS Assignment

Owner name: BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY,

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KUO, SEN M.;LIU, LICHUAN;REEL/FRAME:037262/0131

Effective date: 20130502

AS Assignment

Owner name: NORTHERN ILLINOIS RESEARCH FOUNDATION, ILLINOIS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BOARD OF TRUSTEES OF NORTHERN ILLINOIS UNIVERSITY;REEL/FRAME:037285/0236

Effective date: 20141121

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4