US20090116666A1 - Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port - Google Patents
Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port Download PDFInfo
- Publication number
- US20090116666A1 US20090116666A1 US11/934,404 US93440407A US2009116666A1 US 20090116666 A1 US20090116666 A1 US 20090116666A1 US 93440407 A US93440407 A US 93440407A US 2009116666 A1 US2009116666 A1 US 2009116666A1
- Authority
- US
- United States
- Prior art keywords
- seal
- degree
- speaker
- speaker port
- ear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims description 17
- 238000005070 sampling Methods 0.000 claims description 6
- 230000003247 decreasing effect Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 11
- 238000013459 approach Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 7
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004913 activation Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 241001183191 Sclerophthora macrospora Species 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Definitions
- This disclosure relates to adjusting the acoustic output of a speaker based upon an estimated degree of seal of an ear about a speaker port.
- Electronic devices that generate acoustic output (e.g. human speech) through a speaker typically comprise a housing having a speaker port and a speaker mounted within the housing in alignment with the speaker port.
- the term “speaker port” refers to aperture(s) or other structure that serve(s) as a pathway for sound from a transducer or diaphragm of the speaker (e.g. a hole or set of holes in the receiver portion of a cellular telephone).
- a user may need to situate the speaker port near his or her ear so as to be able to hear the acoustic output. There are many different orientations in which the user may hold the device near his or her ear.
- the user may press the speaker port against his or her ear such that his ear substantially surrounds the speaker port.
- the speaker plays into a small contained volume of air within the ear cavity. This is known as a sealed condition or as a “high degree of seal”.
- the user may only touch part of his ear to the speaker port such that the speaker is substantially open to the environment. In that case, the speaker plays into a much larger volume of air. This is known as a leak condition or as a “low degree of seal”.
- a listener may perceive a change in the acoustic output of a speaker depending upon whether a leak or sealed condition exists. In the leak condition, a listener may perceive a loss of lower frequencies. Conversely, in a sealed condition, the listener may perceive an amplification of lower frequencies.
- FIG. 1 shows an exemplary electronic device with a speaker port and touch sensors mounted in fixed relation to the speaker port;
- FIG. 2 is a simplified block diagram of the device of FIG. 1 ;
- FIG. 3 shows the device of FIG. 1 with an ear touching the device at regions north and south of the speaker port, demonstrating a sealed condition
- FIG. 4 shows the device of FIG. 1 with an ear touching the device at a region west of the speaker port, demonstrating a leak condition
- FIG. 5 is a flow diagram illustrating operation of the electronic device of FIG. 1 ;
- FIG. 6 shows an embodiment of an electronic device with a speaker port and touch screen sensors surrounding the speaker port
- FIG. 7A illustrates regions of touch contact of an ear about a speaker port of an electronic device
- FIG. 7B shows an approach for assessing the touch contact of FIG. 7A as indicating a sealed condition
- FIG. 7C shows an approach for assessing the touch contact of FIG. 7A as indicating a leak condition
- FIG. 8A shows an alternative approach for estimating a sealed condition
- FIG. 8B shows an alternative approach for estimating a leak condition
- FIG. 9 illustrates a possible touch sensor arrangement
- FIGS. 10A and 10B illustrate different shapes for the touch sensors of FIG. 9 ;
- FIG. 11 shows an alternate embodiment of an electronic device with a speaker port and one touch sensor which surrounds the speaker port.
- a method of adjusting the acoustic output of a speaker comprising: detecting touch contact between an ear and at least one touch sensor in fixed relation to a speaker port for the speaker; based on the detecting, estimating a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjusting the acoustic output of the speaker.
- an electronic device comprising: a housing having a speaker port; a speaker within said housing for providing acoustic output through the speaker port; at least one touch sensor in fixed relation to the speaker port; and a processor operable to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker.
- a machine-readable medium storing instructions which, when executed by a processor of an electronic device having a speaker and at least one touch sensor in fixed relation to a speaker port for the speaker, causes said processor to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker.
- a method of operating an electronic device comprising: a housing having a speaker port; a speaker within the housing for providing acoustic output through the speaker port; at least one touch sensor in fixed relation to the speaker port; a memory; and a processor in communication with the memory operable to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker, the method comprising: causing the speaker to provide acoustic output through the speaker port; during or subsequent to the providing of the acoustic output, receiving user input indicating that the degree of seal of the ear about the speaker port is currently high; upon the receiving, sampling a degree of touch contact with the at least one touch sensor, the sampling resulting in a generated sample; and storing the generated sample in the memory for use during the estimating.
- FIG. 1 shows an exemplary electronic device 10 , which in the present embodiment, is a telecommunications device.
- the telecommunications device may for example be a cellular telephone, smart phone, dual-mode telephone, WiFi telephone, cordless telephone, two-way pager with voice capability, or the like.
- the device 10 includes a housing 11 with a speaker port 12 , a speaker 9 mounted within the housing, four touch sensors 13 A, 13 B, 13 C, and 13 D (collectively or individually sensors 13 ), a display (screen 16 ), an input device (keypad 14 ) and a microphone 18 .
- Speaker 9 is a conventional speaker that emits acoustic output, which in the present embodiment may be voice output.
- the speaker 9 (not visible in FIG. 1 ) is fixedly mounted within the housing in alignment with the speaker port 12 .
- the speaker port 12 includes numerous small holes and generally has a circular shape, although it may have other shapes in other embodiments.
- Touch sensors 13 A, 13 B, 13 C and 13 D are mounted to housing 11 in fixed relation to speaker port 12 in the north, east, south and west directions respectively.
- touch sensors 13 A- 13 D are rectangular and are mounted flush with the surface of housing 11 , so that the speaker port 12 and the sensors are substantially coplanar.
- Each sensor has two operational states: on (when any part of the exposed sensor surface is touched) and off (when no part of the exposed sensor surface is touched).
- Each sensor 13 A- 13 D may be on or off independently of the on or off states of the other sensors.
- the sensors 13 are used to detect touch contact of a user's ear about the speaker port 12 . Based on the touch contact detected by sensors 13 , a degree of seal of an ear about the speaker port 12 can be estimated.
- Screen 16 is a conventional screen such as a Liquid Crystal Display (LCD).
- LCD Liquid Crystal Display
- Other types of screens may be used in other embodiments (e.g. touch screen).
- Keypad 14 is a conventional keypad by which numeric digits or text may be entered.
- the input devices may vary in other embodiments (e.g. may be a full QWERTY keyboard).
- Microphone 18 is a conventional microphone that receives acoustic input, for example, voice input.
- FIG. 2 is a simplified block diagram illustrating select components of device 10 .
- device 10 includes a microprocessor 21 interconnected with a speaker 9 , sensors 13 and memory 15 .
- Microprocessor 21 generally controls operation of the device 10 through the execution of software stored in memory 15 .
- the memory 15 which may comprise volatile memory, non-volatile memory or both, stores operating system software 27 and application software 29 .
- operating system software 27 includes instructions which, when executed by microprocessor 21 , adapt device 10 to adjust the acoustic output of speaker 12 based on an estimated degree of seal of an ear about the speaker port 12 .
- the rationale for including these instructions within operating system software 27 may be to permit multiple applications at the device to benefit from this functionality.
- the instructions are not necessarily part of the operating system software of all embodiments.
- those instructions may form part of application software 29 , which may be a telephony application, voice recording application, music player application or the like.
- the operation may be effected elsewhere in other embodiments (e.g. in firmware) or may be effected through instructions contained on a computer readable medium 22 .
- the interconnection between microprocessor 21 and sensors 13 permits the microprocessor 21 to dynamically determine which sensor(s) 13 A- 13 D (if any) are presently being touched by an ear of a user, as will be described.
- FIGS. 3 and 4 illustrate two different ways (of many) in which an ear of a user of device 10 may contact touch sensors 13 during use.
- FIG. 3 is exemplary of a sealed condition
- FIG. 4 is exemplary of a leak condition.
- operation 500 for adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port is illustrated. It is assumed that the touch sensors 13 A- 13 D are initially in an off state, i.e., are not being touched.
- the speaker port 12 When a user wishing to listen to acoustic output from the device 10 (e.g. upon receipt of a telephone call) places the device 10 against his or her ear 30 , the speaker port 12 will be aligned, more or less, with the ear. Depending upon the alignment of the ear 30 with the speaker port 12 and the orientation of the device 10 relative to the user's head, the ear 30 may touch one or more sensors 13 , causing a transition of the sensor(s) from the off state to the on state. This is detected (S 501 ) at the microprocessor 21 ( FIG. 2 ), e.g., in the form of one or more interrupts generated in response to sensor activation.
- the microprocessor engages in processing for estimating the degree of seal of the ear about the speaker port (S 502 , FIG. 5 ).
- this processing is capable of estimating two degrees of seal: high (i.e. a sealed condition) or low (i.e. a leak condition).
- the degree of seal is estimated to be high when two sensors located on opposite sides of speaker port 12 are on simultaneously. This scenario is illustrated in FIG. 3 . As illustrated, an ear 30 of the user contacts region 44 within the boundaries of touch sensor 13 A and region 42 within the boundaries of opposing touch sensor 13 C, thus activating both sensors. On the basis of this simultaneous activation, a high degree of seal is estimated to exist. The conclusion would be the same if opposing sensors 13 B and 13 D had been simultaneously in the on state. As long as two opposing sensors are simultaneously on, the degree of seal is estimated to be high regardless of the on or off state of the other sensors.
- the acoustic output of speaker 9 is adjusted by attenuating low frequencies (S 504 , FIG. 5 ), e.g., between 300 Hz and 1 KHz.
- This has the result of improving the quality of the sound perceived by the user, as the overall audio response perceived by the user will be equalized to a flat response, e.g., across the typical telephony frequency range of 300 Hz to 4 KHz.
- This is analogous to lowering the “low frequency” slider of a graphic equalizer audio component of a stereo system in order for the user to perceive the sound as though the slider knobs of the graphic equalizer were actually horizontally aligned (“flat response”).
- the degree of seal is estimated to be low when the user's ear 30 touches only one of the sensors 13 or only two sensors that are adjacent to one another.
- This scenario which may be described as the sensors on only “one side” (or on the “same side”) of the speaker port 12 being on, is shown in FIG. 4 .
- there is only one region 32 of contact between the ear 30 and sensors 13 namely, within the boundaries of sensor 13 B. Based on the activation of only sensor 13 B and none of sensors 13 A, 13 C or 13 D, the degree of seal is estimated to be low.
- the acoustic output of speaker 9 is adjusted by amplifying low frequencies (S 506 ), e.g., between 300 Hz and 1 KHz. This similarly has the result of improving the quality of the sound perceived by the user, again because the overall audio response perceived by the user will be equalized to a flat response.
- This is analogous to raising the “low frequency” slider of a graphic equalizer audio component in order for the user to perceive the sound as though the slider knobs of the graphic equalizer were actually horizontally aligned.
- operating system software 27 may contain a function, for example, degreeOfSeal(sensor 0 , sensor 1 , sensor 2 , sensor 3 ), which takes four parameters, sensor 0 , sensor 1 , sensor 2 and sensor 3 , corresponding to touch sensors 13 A, 13 B, 13 C and 13 D, respectively.
- Each of parameters sensor 0 , sensor 1 , sensor 2 and sensor 3 contains the value “1” when its corresponding sensor is one and contains the value “0” when its corresponding sensor is off (of course, the parameters may take on values other than “1” and “0” to indicated the on/off states).
- the degreeOfSeal function Based upon the input parameters, the degreeOfSeal function outputs whether the degree of seal is estimated to be high or low. Specifically, the degreeOfSeal function returns HIGH when the input parameters indicate that a high degree of seal is estimated to exist, and returns LOW otherwise, indicating that a low degree of seal is estimated to exist.
- the following pseudocode shows an exemplary implementation of the degreeOfSeal function.
- the degreeOfSeal function would be invoked as follows: degreeOfSeal(1, 0, 1, 0), and the function would return HIGH since the values of sensor 0 and sensor 2 are both “1”.
- the degreeOfSeal function would be invoked as follows: degreeOfSeal(0, 0, 0, 1). Because only sensor 3 (corresponding to touch sensor 13 D) contains the value “1”, the degreeOfSeal function would return LOW.
- step S 501 , S 502 , and S 504 or S 506 is repeated. This repetition allows the acoustic output to be dynamically adjusted during the period of contact between the ear 30 and at least one touch sensor 13 .
- Periodic estimation of degree of ear seal may be desirable because it is atypical for a person to hold a telecommunications device in the same position throughout the duration of a phone call.
- changing characteristics of the environment e.g. a degree of background noise
- the rate of sampling of ear position may be pre-set or may be set in other manners, for example, by the user through a GUI.
- a user may trigger re-estimation of ear seal by, for example, pressing a button.
- operation 500 terminates.
- the operation 500 may be repeated when touch contact is again detected.
- operation 500 may terminate upon completion of S 504 or S 506 .
- more than four touch sensors may be used. For example, eight, twelve or sixteen sensors (or more) arranged around the speaker port 12 may be used.
- the general approach of distinguishing a high degree of seal from a low degree of seal i.e. detecting touch contact on opposite sides of the speaker port versus touch contact on only one side of the speaker port, is the same.
- the degreeOfSeal function would require modification.
- the degree of seal could be estimated to be high if opposing sensors are simultaneously on, and low otherwise.
- activation of two (or more) adjacent sensors may be understood to represent a continuous area of contact.
- FIG. 6 An embodiment utilizing such a touchscreen is illustrated in FIG. 6 .
- the electronic device 68 is has a housing 70 and speaker port 71 similar to the housing 11 and speaker port 12 of device 10 ( FIG. 1 ).
- device 68 instead of display 16 and sensors 13 , device 68 has a touchscreen 72 with a lower portion 75 and an upper portion 73 .
- the lower portion 75 of touchscreen 72 may fulfill the same role as display 16 of FIG. 1 , i.e. may be capable of displaying a GUI and may receive user input in the form of stylus or finger contact.
- the upper portion 73 surrounds the speaker port 71 and fulfills the role of sensors 13 .
- the upper portion 73 of touchscreen 72 is capable of simultaneously detecting multiple areas of touch within its boundaries.
- touchscreen 72 has a plurality of touch sensors 74 arranged in a grid pattern.
- Each touch sensor may be generally identified by its Cartesian coordinates, namely, its x and y coordinates.
- a sensor transitions from the “off” state to the “on” state. This transition is indicated to microprocessor 21 .
- the x and y coordinates of each activated sensor may for example be communicated to the microprocessor 21 . This permits the microprocessor to detect multiple regions of touch contact within the upper portion 73 of touchscreen 72 .
- This information is used to estimate a degree of seal of the ear about the speaker port 71 , so that the acoustic output of the speaker may be appropriately adjusted as described above in conjunction with FIG. 5 .
- the general approach for identifying a high degree of seal is to detect touch contact on opposite sides of the speaker port.
- areas of touch contact may not occur on exactly opposite sides of the speaker port. For instance, as illustrated in FIG.
- FIG. 7B illustrates the speaker port 12 of FIG. 7A , with its center labeled C.
- the two regions of touch contact 82 , 84 of FIG. 7A are also illustrated in FIG. 7B , but ear 81 is omitted for clarity.
- a notional circle 86 is centered about the center C of the speaker port 12 .
- the circle occupies a plane within which the speaker port 12 and surface(s) of the touch sensor(s) also substantially reside (i.e. the plane within which the speaker port and touch sensor(s) reside are substantially coplanar).
- a high degree of seal is estimated to exist. Otherwise, a low degree of seal is estimated to exist.
- the value of a should be less than 90 degrees. For example, in FIG. 7A , a is just under 90 degrees (e.g. 89 degrees). Because region 82 occurs within sector 90 and region 84 occurs within sector 92 (at least partly), the degree of seal is estimated to be high.
- the outcome may differ.
- the span a of each of the sectors 100 , 102 is only 30 degrees.
- the directly opposing sectors 100 , 102 cannot be rotated about the center C of circle 86 so that the touch contact 82 and touch contact 84 (which is the same as in FIG. 7B ) occurs in opposing sectors, even in part.
- the degree of seal is estimated to be low, not high. This illustrates the configurability of the “high degree of seal” versus “low degree of seal” determination through of adjustment of a.
- a GUI may be provided to facilitate such adjustment.
- the touch contact may be required to occur either entirely within directly opposing sectors or primarily within directly opposing sectors, in order for the degree of seal to be estimated as high.
- an alternative approach is used wherein the size of an arc of substantially continuous touch contact between the ear and the touch sensor(s) about the center of a speaker port forms the basis for distinguishing a high degree of seal from a low degree of seal. This is illustrated in FIGS. 8A and 8B .
- a device having a speaker port 12 and at least one flush mounted touch sensor (not expressly illustrated) in fixed relation to the speaker port is shown positioned so that the speaker port 12 is aligned, more or less, with ear 91 .
- the totality of touch sensor contact is determined to be substantially continuous over an arc of a notional circle concentric with speaker port 12 , that spans E degrees.
- the touch contact is considered to be substantially continuous over the E degree arc despite the existence of gap 96 .
- gap 96 between regions 92 , 94 wherein the ear 91 does not contact the touch sensor(s) forms less than a predetermined percentage P (e.g. 50%) of that arc.
- the percentage P may vary in different embodiments.
- each sensor 110 has a truncated wedge shape, with the narrower truncated end closest to the speaker port, and may occupy an angular segment, e.g. a 30 degree arc (or less, for greater precision), of a notional circle 112 that is concentric with the speaker port 12 , as shown in FIG. 9 .
- the arc is estimated to be 60 degrees.
- the use of sensors shaped and arranged as shown in FIG. 9 so as to “radiate” from the speaker port may permit touch contact to be detected regardless of the exact proximity of the touch contact to the center of the speaker port. This may contribute to the capacity of the device 10 to estimate degrees of seal for ears of different sizes, whose points of contact with the sensors 110 may vary in distance from the center of the speaker port.
- the shape of an individual sensor 110 is shown in greater detail in FIG. 10A .
- the shape is a plane figure bounded by two radii 120 , 122 and two arcs 124 , 126 . Put another way, the shape is a sector of a circle with the narrow end truncated to accommodate speaker 12 .
- the boundaries of the plane figure at its narrow end 128 and its wide end 129 are not necessarily arcs in all embodiments.
- the boundaries may be straight lines 130 , 132 , as shown in FIG. 10B .
- Other shapes for these boundaries, and for the sensor 110 as a whole, are possible.
- the value E is compared to a predetermined threshold T 1 (e.g. 90 degrees) used for identifying a low degree of seal.
- T 1 may vary between embodiments (e.g. it may be user-configurable via a GUI). If E is less than the T 1 value of 90 degrees (as in the example of FIG. 8A ), the degree of seal is estimated to be low.
- ⁇ is not less than T 1 , as shown in FIG. 8B for example, another comparison is made with a second predetermined threshold T 2 (e.g. 120 degrees) used for identifying a high degree of seal.
- T 2 may also vary between embodiments (e.g. it may also be user-configurable via a GUI). If ⁇ is greater than the T 2 value of 120 degrees (as in the example of FIG. 8B ), the degree of seal is estimated to be high. It is noted that the existence of a second gap 97 between regions 94 and 98 of touch contact does not preclude the conclusion that the contact within the arc is substantially continuous, because the extent of the gaps 96 and 97 does not exceed the above-noted, predetermined percentage P of the arc.
- a GUI may be provided whereby the user may specify his or her user characteristics (e.g. ear size) and preferences (e.g. ear seal estimation “sampling rate” or desired type of acoustic modification).
- a voice sample may be output through speaker port 12 and the user may be asked to adjust his or her ear relative to speaker port 12 until the user is satisfied with the clarity of the voice sample or when it is at its loudest.
- the user may be directed to “press one's ear tightly against the device” and then activate a switch or other control (e.g. depress a button).
- the device 10 may sample the sensor(s) and store in memory the particular combination of sensors or sensor area(s) that are activated/deactivated, i.e. the combination indicative of a high degree of ear seal for that specific user. This information may thereafter be used to configure the mechanism used to estimate a high degree of ear seal. For example, if the sampled sensors show that ⁇ spans only 110 degrees and threshold T 2 for determining a high degree of ear seal has a current or default value of 120 degrees, the threshold T 2 may be reduced to 100 degrees (given that span of only 110 degrees, which has been confirmed by the user to represent a high degree of seal, would otherwise fail to exceed the threshold T 2 and would therefore not properly result in an estimated high degree of seal).
- an electronic device may have one circular touch sensor 62 that substantially surrounds speaker port 12 ( FIG. 10 ).
- the touch sensor should be capable of detecting multiple areas of touch simultaneously.
- operation 500 may vary in alternate embodiments. For instance, it may be appreciated that there may be a spectrum of degrees of seal between a fully sealed condition and a full leak condition. Accordingly, the degreeOfSeal function described above may be modified such that instead of returning a binary (i.e. LOW/HIGH) value, it returns an indication along a continuum of the degree of seal (e.g. an integer between 0 and 100 where 0 indicates a full leak condition and 100 indicates a full seal).
- a binary i.e. LOW/HIGH
- the estimated degree of seal may based upon experimental models. For example, experiments may be performed on a simulated ear (the simulated ear being representative, for example, of an average human ear) to derive the relationship between ear position relative to the speaker port 12 (as determined by the regions of touch detected by the one or more touch sensors) and the degree of seal. However, it may be appreciated that models derived from other sources may be employed.
- the estimated degree of seal may be a function of the X, Y (Cartesian) coordinates on the surface of the ear and force against the ear, with force possibly being related to the surface area touching the device.
- operating system software 27 may also incorporate models dictating how the acoustic output should be modified to compensate for a detected degree of seal. Again, the manner and degree to which the acoustic output should be modified may be determined through experimental models. For example, operating system software 27 may adjust certain frequencies of the acoustic output by causing the acoustic output to be passed through an appropriate filter prior to its output from speaker 9 . It will be appreciated that the specific type of filter employed may be determined by the desired adjustment of the acoustic output. For example, a band pass filter may be used if it is desired that frequencies within a certain range (such as high frequencies) be output while frequencies outside that range (such as low frequencies) be attenuated. The filters may be implemented in software, hardware or firmware. An equalization filter may be used for this purpose; this may be a simple high/low/bandpass or shelf filter or a more complex multiband parametric filter.
- characteristics of the acoustic output other than frequency may be modified based on the estimated degree of seal. For instance, instead of attenuating low frequencies in a sealed condition, higher frequencies could be amplified to compensate for the perceived amplification of low frequencies. Other characteristics of the acoustic output may also be adjusted. For example, upon estimating a low degree of seal, the volume of the acoustic output may be increased to compensate for the leaky condition. Upon estimating a high degree of seal, the volume of the acoustic output may be decreased to in view of the estimated sealed condition. These characteristics and associated adjustments may similarly be determined through experimental models.
- operation 500 may be effected by processor-executable instructions stored within device 10 in, for example, ROM.
- the instructions may be loaded onto device 10 from a computer-readable medium such as an optical disc 22 ( FIG. 2 ), magnetic storage medium or by way of an over-the-air download from a wireless network.
- a computer-readable medium such as an optical disc 22 ( FIG. 2 ), magnetic storage medium or by way of an over-the-air download from a wireless network.
- different acoustic filters and different acoustic compensation models could be integrated with the executable instructions, or could be separately loaded on device 10 as desired.
- the operations described above as performed by operating system 27 could be performed by application software 29 hardware or firmware.
Abstract
Description
- This disclosure relates to adjusting the acoustic output of a speaker based upon an estimated degree of seal of an ear about a speaker port.
- Electronic devices (e.g. telecommunications device) that generate acoustic output (e.g. human speech) through a speaker typically comprise a housing having a speaker port and a speaker mounted within the housing in alignment with the speaker port. The term “speaker port” refers to aperture(s) or other structure that serve(s) as a pathway for sound from a transducer or diaphragm of the speaker (e.g. a hole or set of holes in the receiver portion of a cellular telephone). When using such an electronic device, a user may need to situate the speaker port near his or her ear so as to be able to hear the acoustic output. There are many different orientations in which the user may hold the device near his or her ear. For example, the user may press the speaker port against his or her ear such that his ear substantially surrounds the speaker port. In that case, the speaker plays into a small contained volume of air within the ear cavity. This is known as a sealed condition or as a “high degree of seal”. Alternatively, the user may only touch part of his ear to the speaker port such that the speaker is substantially open to the environment. In that case, the speaker plays into a much larger volume of air. This is known as a leak condition or as a “low degree of seal”.
- A listener may perceive a change in the acoustic output of a speaker depending upon whether a leak or sealed condition exists. In the leak condition, a listener may perceive a loss of lower frequencies. Conversely, in a sealed condition, the listener may perceive an amplification of lower frequencies.
- It has been proposed to distinguish between a sealed and leak condition by detecting the degree of movement of a speaker diaphragm as the speaker generates acoustic output. In a sealed condition, the diaphragm is more resistant to movement than in a leak condition. Thus, by detecting the degree of movement of the diaphragm, it may be possible to distinguish between the two conditions. In practice, however, detecting the degree of movement of the diaphragm may not be easily realizable. Because the degree of movement of the diaphragm is very slight, detecting fine differences in amplitude of a vibrating diaphragm may be problematic. This problem may be especially pronounced in the context of miniature speakers such as those found in mobile telecommunications devices. Moreover, different speakers, and even different models of the same type of speaker, may possess different characteristics of movement and therefore, knowledge of the characteristics of a particular speaker is often required.
- An alternative approach for distinguishing between the sealed and leak conditions would be desirable. It would also be desirable to address the perceived degradation of sound quality that may result from these conditions.
- Aspects and features of the disclosed method and device will become apparent to those of ordinary skill in the art upon review of the following description of specific embodiments in conjunction with the accompanying figures. In the figures which illustrate example embodiments:
-
FIG. 1 shows an exemplary electronic device with a speaker port and touch sensors mounted in fixed relation to the speaker port; -
FIG. 2 is a simplified block diagram of the device ofFIG. 1 ; -
FIG. 3 shows the device ofFIG. 1 with an ear touching the device at regions north and south of the speaker port, demonstrating a sealed condition; -
FIG. 4 shows the device ofFIG. 1 with an ear touching the device at a region west of the speaker port, demonstrating a leak condition; -
FIG. 5 is a flow diagram illustrating operation of the electronic device ofFIG. 1 ; -
FIG. 6 shows an embodiment of an electronic device with a speaker port and touch screen sensors surrounding the speaker port; -
FIG. 7A illustrates regions of touch contact of an ear about a speaker port of an electronic device; -
FIG. 7B shows an approach for assessing the touch contact ofFIG. 7A as indicating a sealed condition; -
FIG. 7C shows an approach for assessing the touch contact ofFIG. 7A as indicating a leak condition; -
FIG. 8A shows an alternative approach for estimating a sealed condition; -
FIG. 8B shows an alternative approach for estimating a leak condition; -
FIG. 9 illustrates a possible touch sensor arrangement; -
FIGS. 10A and 10B illustrate different shapes for the touch sensors ofFIG. 9 ; and -
FIG. 11 shows an alternate embodiment of an electronic device with a speaker port and one touch sensor which surrounds the speaker port. - In one aspect of the below described embodiment, there is provided a method of adjusting the acoustic output of a speaker, comprising: detecting touch contact between an ear and at least one touch sensor in fixed relation to a speaker port for the speaker; based on the detecting, estimating a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjusting the acoustic output of the speaker.
- In another aspect of the below described embodiment, there is provided an electronic device comprising: a housing having a speaker port; a speaker within said housing for providing acoustic output through the speaker port; at least one touch sensor in fixed relation to the speaker port; and a processor operable to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker.
- In yet another aspect of the below described embodiment, there is provided a machine-readable medium storing instructions which, when executed by a processor of an electronic device having a speaker and at least one touch sensor in fixed relation to a speaker port for the speaker, causes said processor to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker.
- In yet another aspect of the below described embodiment, there is provided a method of operating an electronic device, the device comprising: a housing having a speaker port; a speaker within the housing for providing acoustic output through the speaker port; at least one touch sensor in fixed relation to the speaker port; a memory; and a processor in communication with the memory operable to: receive data representing touch contact between an ear and the at least one touch sensor; based on the received data, estimate a degree of seal of the ear about the speaker port; and based on the estimated degree of seal, adjust the acoustic output of the speaker, the method comprising: causing the speaker to provide acoustic output through the speaker port; during or subsequent to the providing of the acoustic output, receiving user input indicating that the degree of seal of the ear about the speaker port is currently high; upon the receiving, sampling a degree of touch contact with the at least one touch sensor, the sampling resulting in a generated sample; and storing the generated sample in the memory for use during the estimating.
-
FIG. 1 shows an exemplaryelectronic device 10, which in the present embodiment, is a telecommunications device. The telecommunications device may for example be a cellular telephone, smart phone, dual-mode telephone, WiFi telephone, cordless telephone, two-way pager with voice capability, or the like. Thedevice 10 includes ahousing 11 with aspeaker port 12, aspeaker 9 mounted within the housing, fourtouch sensors microphone 18. - Speaker 9 is a conventional speaker that emits acoustic output, which in the present embodiment may be voice output. The speaker 9 (not visible in
FIG. 1 ) is fixedly mounted within the housing in alignment with thespeaker port 12. Thespeaker port 12 includes numerous small holes and generally has a circular shape, although it may have other shapes in other embodiments. -
Touch sensors housing 11 in fixed relation tospeaker port 12 in the north, east, south and west directions respectively. In the illustrated embodiment,touch sensors 13A-13D are rectangular and are mounted flush with the surface ofhousing 11, so that thespeaker port 12 and the sensors are substantially coplanar. Each sensor has two operational states: on (when any part of the exposed sensor surface is touched) and off (when no part of the exposed sensor surface is touched). Eachsensor 13A-13D may be on or off independently of the on or off states of the other sensors. As will be appreciated, thesensors 13 are used to detect touch contact of a user's ear about thespeaker port 12. Based on the touch contact detected bysensors 13, a degree of seal of an ear about thespeaker port 12 can be estimated. -
Screen 16,keypad 14 andmicrophone 18, although not a focus of this description, are illustrated for the sake of completeness.Screen 16 is a conventional screen such as a Liquid Crystal Display (LCD). Other types of screens may be used in other embodiments (e.g. touch screen). -
Keypad 14 is a conventional keypad by which numeric digits or text may be entered. The input devices may vary in other embodiments (e.g. may be a full QWERTY keyboard). -
Microphone 18 is a conventional microphone that receives acoustic input, for example, voice input. -
FIG. 2 is a simplified block diagram illustrating select components ofdevice 10. As illustrated,device 10 includes amicroprocessor 21 interconnected with aspeaker 9,sensors 13 andmemory 15.Microprocessor 21 generally controls operation of thedevice 10 through the execution of software stored inmemory 15. Thememory 15, which may comprise volatile memory, non-volatile memory or both, stores operatingsystem software 27 andapplication software 29. In the present embodiment,operating system software 27 includes instructions which, when executed bymicroprocessor 21, adaptdevice 10 to adjust the acoustic output ofspeaker 12 based on an estimated degree of seal of an ear about thespeaker port 12. The rationale for including these instructions withinoperating system software 27 may be to permit multiple applications at the device to benefit from this functionality. However, the instructions are not necessarily part of the operating system software of all embodiments. For example, in some embodiments, those instructions may form part ofapplication software 29, which may be a telephony application, voice recording application, music player application or the like. Alternatively, the operation may be effected elsewhere in other embodiments (e.g. in firmware) or may be effected through instructions contained on a computerreadable medium 22. The interconnection betweenmicroprocessor 21 andsensors 13 permits themicroprocessor 21 to dynamically determine which sensor(s) 13A-13D (if any) are presently being touched by an ear of a user, as will be described. -
FIGS. 3 and 4 illustrate two different ways (of many) in which an ear of a user ofdevice 10 may contacttouch sensors 13 during use.FIG. 3 is exemplary of a sealed condition andFIG. 4 is exemplary of a leak condition. These figures will be described in the context of the following description of device operation. - Referring to
FIG. 5 ,operation 500 for adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port is illustrated. It is assumed that thetouch sensors 13A-13D are initially in an off state, i.e., are not being touched. - When a user wishing to listen to acoustic output from the device 10 (e.g. upon receipt of a telephone call) places the
device 10 against his or herear 30, thespeaker port 12 will be aligned, more or less, with the ear. Depending upon the alignment of theear 30 with thespeaker port 12 and the orientation of thedevice 10 relative to the user's head, theear 30 may touch one ormore sensors 13, causing a transition of the sensor(s) from the off state to the on state. This is detected (S501) at the microprocessor 21 (FIG. 2 ), e.g., in the form of one or more interrupts generated in response to sensor activation. - Responsive to the detection of touch contact between the
ear 30 and at least one of thesensors 13, the microprocessor engages in processing for estimating the degree of seal of the ear about the speaker port (S502,FIG. 5 ). In the present embodiment, this processing is capable of estimating two degrees of seal: high (i.e. a sealed condition) or low (i.e. a leak condition). - The degree of seal is estimated to be high when two sensors located on opposite sides of
speaker port 12 are on simultaneously. This scenario is illustrated inFIG. 3 . As illustrated, anear 30 of theuser contacts region 44 within the boundaries oftouch sensor 13A andregion 42 within the boundaries of opposingtouch sensor 13C, thus activating both sensors. On the basis of this simultaneous activation, a high degree of seal is estimated to exist. The conclusion would be the same if opposingsensors - Based on fact that the degree of seal is estimated to be high, the acoustic output of
speaker 9 is adjusted by attenuating low frequencies (S504,FIG. 5 ), e.g., between 300 Hz and 1 KHz. This has the result of improving the quality of the sound perceived by the user, as the overall audio response perceived by the user will be equalized to a flat response, e.g., across the typical telephony frequency range of 300 Hz to 4 KHz. This is analogous to lowering the “low frequency” slider of a graphic equalizer audio component of a stereo system in order for the user to perceive the sound as though the slider knobs of the graphic equalizer were actually horizontally aligned (“flat response”). - In contrast, the degree of seal is estimated to be low when the user's
ear 30 touches only one of thesensors 13 or only two sensors that are adjacent to one another. This scenario, which may be described as the sensors on only “one side” (or on the “same side”) of thespeaker port 12 being on, is shown inFIG. 4 . As illustrated inFIG. 4 , there is only oneregion 32 of contact between theear 30 andsensors 13, namely, within the boundaries ofsensor 13B. Based on the activation ofonly sensor 13B and none ofsensors - Based on fact that the degree of seal is estimated to be low, the acoustic output of
speaker 9 is adjusted by amplifying low frequencies (S506), e.g., between 300 Hz and 1 KHz. This similarly has the result of improving the quality of the sound perceived by the user, again because the overall audio response perceived by the user will be equalized to a flat response. This is analogous to raising the “low frequency” slider of a graphic equalizer audio component in order for the user to perceive the sound as though the slider knobs of the graphic equalizer were actually horizontally aligned. - To assist in the identification of high versus low degrees of seal as described above,
operating system software 27 may contain a function, for example, degreeOfSeal(sensor0, sensor1, sensor2, sensor3), which takes four parameters, sensor0, sensor1, sensor2 and sensor3, corresponding to touchsensors -
degreeOfSeal( sensor0, sensor1, sensor2, sensor3 ){ if( (sensor0==1 &sensor2==1) OR (sensor1==1 &sensor3==1) ){ return HIGH; } else { return LOW; } } - Thus, in the situation shown in
FIG. 3 , the degreeOfSeal function would be invoked as follows: degreeOfSeal(1, 0, 1, 0), and the function would return HIGH since the values of sensor0 and sensor2 are both “1”. In contrast, in the situation shown inFIG. 4 , the degreeOfSeal function would be invoked as follows: degreeOfSeal(0, 0, 0, 1). Because only sensor3 (corresponding to touchsensor 13D) contains the value “1”, the degreeOfSeal function would return LOW. - If touch contact between
ear 30 and sensor(s) 13 persists (S508), then operation S501, S502, and S504 or S506 is repeated. This repetition allows the acoustic output to be dynamically adjusted during the period of contact between theear 30 and at least onetouch sensor 13. Periodic estimation of degree of ear seal may be desirable because it is atypical for a person to hold a telecommunications device in the same position throughout the duration of a phone call. Moreover, changing characteristics of the environment (e.g. a degree of background noise) may influence the position in which the user holds the device (e.g. a user may press the speaker port tighter to his or her ear when moving into a noisy environment). The rate of sampling of ear position may be pre-set or may be set in other manners, for example, by the user through a GUI. Alternatively, a user may trigger re-estimation of ear seal by, for example, pressing a button. - When touch contact between
ear 30 and touch sensor(s) 13 is no longer detected (S508),operation 500 terminates. Theoperation 500 may be repeated when touch contact is again detected. - In some embodiments, it may be sufficient to estimate a degree of seal and to adjust acoustic output accordingly only once, e.g., at the beginning of a telephone call. In such embodiments,
operation 500 may terminate upon completion of S504 or S506. - If it is desired to better localize a point or points of contact between an ear and the device, more than four touch sensors may be used. For example, eight, twelve or sixteen sensors (or more) arranged around the
speaker port 12 may be used. In such embodiments, the general approach of distinguishing a high degree of seal from a low degree of seal, i.e. detecting touch contact on opposite sides of the speaker port versus touch contact on only one side of the speaker port, is the same. However, in view of the greater number of sensors, the degreeOfSeal function would require modification. Generally, the degree of seal could be estimated to be high if opposing sensors are simultaneously on, and low otherwise. In such embodiments, activation of two (or more) adjacent sensors may be understood to represent a continuous area of contact. - It is possible that some embodiments could employ a single touchscreen capable of detecting multiple areas of touch contact. Although such touchscreens are not readily available in the marketplace at the time of this writing, it is envisioned that they may become readily available. An embodiment utilizing such a touchscreen is illustrated in
FIG. 6 . As illustrated, theelectronic device 68 is has ahousing 70 andspeaker port 71 similar to thehousing 11 andspeaker port 12 of device 10 (FIG. 1 ). However, instead ofdisplay 16 andsensors 13,device 68 has atouchscreen 72 with alower portion 75 and anupper portion 73. Thelower portion 75 oftouchscreen 72 may fulfill the same role asdisplay 16 ofFIG. 1 , i.e. may be capable of displaying a GUI and may receive user input in the form of stylus or finger contact. Theupper portion 73 surrounds thespeaker port 71 and fulfills the role ofsensors 13. Theupper portion 73 oftouchscreen 72 is capable of simultaneously detecting multiple areas of touch within its boundaries. - As illustrated in
FIG. 6 ,touchscreen 72 has a plurality oftouch sensors 74 arranged in a grid pattern. Each touch sensor may be generally identified by its Cartesian coordinates, namely, its x and y coordinates. When touched, a sensor transitions from the “off” state to the “on” state. This transition is indicated tomicroprocessor 21. When a region of touch spansmultiple sensors 74 or when there are multiple regions of touch within theupper portion 73 of the touchscreen, the x and y coordinates of each activated sensor may for example be communicated to themicroprocessor 21. This permits the microprocessor to detect multiple regions of touch contact within theupper portion 73 oftouchscreen 72. This information is used to estimate a degree of seal of the ear about thespeaker port 71, so that the acoustic output of the speaker may be appropriately adjusted as described above in conjunction withFIG. 5 . - As noted above, the general approach for identifying a high degree of seal (although not the only approach, as described below) is to detect touch contact on opposite sides of the speaker port. However, it will be appreciated that areas of touch contact may not occur on exactly opposite sides of the speaker port. For instance, as illustrated in
FIG. 7A , when a device having aspeaker port 12 and at least one touch sensor (not expressly illustrated) mounted in fixed relation to the speaker port is positioned so that thespeaker port 12 is aligned, more or less, withear 81, and so that there are tworegions regions speaker port 12 could be answered in the affirmative or in the negative depending upon one's definition of “opposite” (i.e. depending upon how much offset of the speaker port from a position directly between the regions is permissible). In order to permit the degree of “oppositeness” required for a conclusion of a high degree of ear seal to be adjusted, the technique illustrated inFIGS. 7B and 7C may be used. -
FIG. 7B illustrates thespeaker port 12 ofFIG. 7A , with its center labeled C. The two regions oftouch contact FIG. 7A are also illustrated inFIG. 7B , butear 81 is omitted for clarity. To estimate a high degree of seal (at S502,FIG. 5 ), anotional circle 86 is centered about the center C of thespeaker port 12. The circle occupies a plane within which thespeaker port 12 and surface(s) of the touch sensor(s) also substantially reside (i.e. the plane within which the speaker port and touch sensor(s) reside are substantially coplanar). If two directly opposingsectors FIG. 7A , a is just under 90 degrees (e.g. 89 degrees). Becauseregion 82 occurs withinsector 90 andregion 84 occurs within sector 92 (at least partly), the degree of seal is estimated to be high. - When the value of a is reduced, however, the outcome may differ. For example, in
FIG. 7C the span a of each of thesectors sectors circle 86 so that thetouch contact 82 and touch contact 84 (which is the same as inFIG. 7B ) occurs in opposing sectors, even in part. As a result, the degree of seal is estimated to be low, not high. This illustrates the configurability of the “high degree of seal” versus “low degree of seal” determination through of adjustment of a. A GUI may be provided to facilitate such adjustment. - In some embodiments, the touch contact may be required to occur either entirely within directly opposing sectors or primarily within directly opposing sectors, in order for the degree of seal to be estimated as high.
- In some embodiments, instead of basing the high versus low degree of seal determination of S502 (
FIG. 5 ) upon whether touch contact occurs on opposite sides of a speaker port (as disclosed above), an alternative approach is used wherein the size of an arc of substantially continuous touch contact between the ear and the touch sensor(s) about the center of a speaker port forms the basis for distinguishing a high degree of seal from a low degree of seal. This is illustrated inFIGS. 8A and 8B . - Referring to
FIG. 8A , a device having aspeaker port 12 and at least one flush mounted touch sensor (not expressly illustrated) in fixed relation to the speaker port is shown positioned so that thespeaker port 12 is aligned, more or less, withear 91. The ear touches the touch sensor(s) in only tworegions FIG. 5 ), the totality of touch sensor contact is determined to be substantially continuous over an arc of a notional circle concentric withspeaker port 12, that spans E degrees. The touch contact is considered to be substantially continuous over the E degree arc despite the existence ofgap 96. The reason is thatgap 96 betweenregions ear 91 does not contact the touch sensor(s) (possibly due to irregular ear shape) forms less than a predetermined percentage P (e.g. 50%) of that arc. The percentage P may vary in different embodiments. - In order to facilitate the determination (or at least estimation of), the size E of the substantially continuous arc of ear-sensor touch contact about the center of the speaker port, sensors having a truncated wedge shape may be arranged about the speaker port as shown in
FIG. 9 . Referring toFIG. 9 , eachsensor 110 has a truncated wedge shape, with the narrower truncated end closest to the speaker port, and may occupy an angular segment, e.g. a 30 degree arc (or less, for greater precision), of anotional circle 112 that is concentric with thespeaker port 12, as shown inFIG. 9 . In this example, if two adjacent sensors (and no other sensors) are activated (by touch contact anywhere within their boundaries), the arc is estimated to be 60 degrees. Advantageously, the use of sensors shaped and arranged as shown inFIG. 9 so as to “radiate” from the speaker port may permit touch contact to be detected regardless of the exact proximity of the touch contact to the center of the speaker port. This may contribute to the capacity of thedevice 10 to estimate degrees of seal for ears of different sizes, whose points of contact with thesensors 110 may vary in distance from the center of the speaker port. - The shape of an
individual sensor 110 is shown in greater detail inFIG. 10A . The shape is a plane figure bounded by tworadii arcs speaker 12. The boundaries of the plane figure at itsnarrow end 128 and itswide end 129 are not necessarily arcs in all embodiments. For example, in an alternative embodiment, the boundaries may bestraight lines FIG. 10B . Other shapes for these boundaries, and for thesensor 110 as a whole, are possible. - Referring again to
FIG. 9 , once determined, the value E is compared to a predetermined threshold T1 (e.g. 90 degrees) used for identifying a low degree of seal. T1 may vary between embodiments (e.g. it may be user-configurable via a GUI). If E is less than the T1 value of 90 degrees (as in the example ofFIG. 8A ), the degree of seal is estimated to be low. - If θ is not less than T1, as shown in
FIG. 8B for example, another comparison is made with a second predetermined threshold T2 (e.g. 120 degrees) used for identifying a high degree of seal. T2 may also vary between embodiments (e.g. it may also be user-configurable via a GUI). If θ is greater than the T2 value of 120 degrees (as in the example ofFIG. 8B ), the degree of seal is estimated to be high. It is noted that the existence of asecond gap 97 betweenregions gaps - In order of comparison of θ with thresholds T1 and T2 may be reversed in alternative embodiments.
- In another aspect of the present disclosure, a GUI may be provided whereby the user may specify his or her user characteristics (e.g. ear size) and preferences (e.g. ear seal estimation “sampling rate” or desired type of acoustic modification). In addition, or in combination, a voice sample may be output through
speaker port 12 and the user may be asked to adjust his or her ear relative tospeaker port 12 until the user is satisfied with the clarity of the voice sample or when it is at its loudest. At this point, the user may be directed to “press one's ear tightly against the device” and then activate a switch or other control (e.g. depress a button). In response, thedevice 10 may sample the sensor(s) and store in memory the particular combination of sensors or sensor area(s) that are activated/deactivated, i.e. the combination indicative of a high degree of ear seal for that specific user. This information may thereafter be used to configure the mechanism used to estimate a high degree of ear seal. For example, if the sampled sensors show that θ spans only 110 degrees and threshold T2 for determining a high degree of ear seal has a current or default value of 120 degrees, the threshold T2 may be reduced to 100 degrees (given that span of only 110 degrees, which has been confirmed by the user to represent a high degree of seal, would otherwise fail to exceed the threshold T2 and would therefore not properly result in an estimated high degree of seal). - As will be appreciated by those skilled in the art, various modifications can be made to the above-described embodiments. For example, in some embodiments, instead of having multiple touch sensors, an electronic device may have one
circular touch sensor 62 that substantially surrounds speaker port 12 (FIG. 10 ). The touch sensor should be capable of detecting multiple areas of touch simultaneously. - It will be appreciated that certain aspects of
operation 500 may vary in alternate embodiments. For instance, it may be appreciated that there may be a spectrum of degrees of seal between a fully sealed condition and a full leak condition. Accordingly, the degreeOfSeal function described above may be modified such that instead of returning a binary (i.e. LOW/HIGH) value, it returns an indication along a continuum of the degree of seal (e.g. an integer between 0 and 100 where 0 indicates a full leak condition and 100 indicates a full seal). - The estimated degree of seal may based upon experimental models. For example, experiments may be performed on a simulated ear (the simulated ear being representative, for example, of an average human ear) to derive the relationship between ear position relative to the speaker port 12 (as determined by the regions of touch detected by the one or more touch sensors) and the degree of seal. However, it may be appreciated that models derived from other sources may be employed. The estimated degree of seal may be a function of the X, Y (Cartesian) coordinates on the surface of the ear and force against the ear, with force possibly being related to the surface area touching the device.
- Moreover,
operating system software 27 may also incorporate models dictating how the acoustic output should be modified to compensate for a detected degree of seal. Again, the manner and degree to which the acoustic output should be modified may be determined through experimental models. For example,operating system software 27 may adjust certain frequencies of the acoustic output by causing the acoustic output to be passed through an appropriate filter prior to its output fromspeaker 9. It will be appreciated that the specific type of filter employed may be determined by the desired adjustment of the acoustic output. For example, a band pass filter may be used if it is desired that frequencies within a certain range (such as high frequencies) be output while frequencies outside that range (such as low frequencies) be attenuated. The filters may be implemented in software, hardware or firmware. An equalization filter may be used for this purpose; this may be a simple high/low/bandpass or shelf filter or a more complex multiband parametric filter. - Additionally, characteristics of the acoustic output other than frequency may be modified based on the estimated degree of seal. For instance, instead of attenuating low frequencies in a sealed condition, higher frequencies could be amplified to compensate for the perceived amplification of low frequencies. Other characteristics of the acoustic output may also be adjusted. For example, upon estimating a low degree of seal, the volume of the acoustic output may be increased to compensate for the leaky condition. Upon estimating a high degree of seal, the volume of the acoustic output may be decreased to in view of the estimated sealed condition. These characteristics and associated adjustments may similarly be determined through experimental models.
- Generally,
operation 500 may be effected by processor-executable instructions stored withindevice 10 in, for example, ROM. The instructions may be loaded ontodevice 10 from a computer-readable medium such as an optical disc 22 (FIG. 2 ), magnetic storage medium or by way of an over-the-air download from a wireless network. Moreover, different acoustic filters and different acoustic compensation models could be integrated with the executable instructions, or could be separately loaded ondevice 10 as desired. Also, the operations described above as performed by operatingsystem 27 could be performed byapplication software 29 hardware or firmware. - Of course, the above described embodiments are intended to be illustrative only and in no way limiting. The described embodiments are susceptible to many modifications of form, arrangement of parts, details and order of operation. The disclosed embodiments are rather intended to encompass all such modification within the scope, as defined by the claims.
Claims (25)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/934,404 US8144897B2 (en) | 2007-11-02 | 2007-11-02 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
US13/372,957 US8798279B2 (en) | 2007-11-02 | 2012-02-14 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/934,404 US8144897B2 (en) | 2007-11-02 | 2007-11-02 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/372,957 Continuation US8798279B2 (en) | 2007-11-02 | 2012-02-14 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
Publications (3)
Publication Number | Publication Date |
---|---|
US20090116666A1 true US20090116666A1 (en) | 2009-05-07 |
US20100166223A9 US20100166223A9 (en) | 2010-07-01 |
US8144897B2 US8144897B2 (en) | 2012-03-27 |
Family
ID=40588116
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/934,404 Active 2031-01-25 US8144897B2 (en) | 2007-11-02 | 2007-11-02 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
US13/372,957 Active 2028-12-08 US8798279B2 (en) | 2007-11-02 | 2012-02-14 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/372,957 Active 2028-12-08 US8798279B2 (en) | 2007-11-02 | 2012-02-14 | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port |
Country Status (1)
Country | Link |
---|---|
US (2) | US8144897B2 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010145031A1 (en) * | 2009-06-19 | 2010-12-23 | Research In Motion Limited | Portable electronic device with face touch detection |
US20110136479A1 (en) * | 2009-12-04 | 2011-06-09 | Kim Mi Jeong | Mobile terminal and method of controlling the same |
US20120169620A1 (en) * | 2011-01-05 | 2012-07-05 | Motorola-Mobility, Inc. | User Interface and Method for Locating an Interactive Element Associated with a Touch Sensitive Interface |
US20130259221A1 (en) * | 2010-03-30 | 2013-10-03 | Fujitsu Limited | Telephone and voice adjustment method for telephone |
WO2014063755A1 (en) * | 2012-10-26 | 2014-05-01 | Huawei Technologies Co., Ltd. | Portable electronic device with audio rendering means and audio rendering method |
EP2830326A1 (en) * | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio prcessor for object-dependent processing |
US20170180896A1 (en) * | 2015-12-17 | 2017-06-22 | Sony Mobile Communications Inc. | Method for diagnosing sealing properties of microphone and/or loudspeaker seals in an electronic device |
US9699546B2 (en) | 2015-09-16 | 2017-07-04 | Apple Inc. | Earbuds with biometric sensing |
WO2018028630A1 (en) * | 2016-08-11 | 2018-02-15 | 华为技术有限公司 | Ear coupling detection method, and terminal |
EP2957109B1 (en) * | 2013-02-12 | 2019-04-10 | QUALCOMM Incorporated | Speaker equalization for mobile devices |
US10681445B2 (en) | 2016-09-06 | 2020-06-09 | Apple Inc. | Earphone assemblies with wingtips for anchoring to a user |
US10856068B2 (en) | 2015-09-16 | 2020-12-01 | Apple Inc. | Earbuds |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102404430A (en) * | 2010-09-13 | 2012-04-04 | 富泰华工业(深圳)有限公司 | Mobile communication device and method for improving speech quality thereof |
US9189109B2 (en) | 2012-07-18 | 2015-11-17 | Sentons Inc. | Detection of type of object used to provide a touch contact input |
US11327599B2 (en) | 2011-04-26 | 2022-05-10 | Sentons Inc. | Identifying a contact type |
US9639213B2 (en) | 2011-04-26 | 2017-05-02 | Sentons Inc. | Using multiple signals to detect touch input |
US9477350B2 (en) | 2011-04-26 | 2016-10-25 | Sentons Inc. | Method and apparatus for active ultrasonic touch devices |
US10198097B2 (en) | 2011-04-26 | 2019-02-05 | Sentons Inc. | Detecting touch input force |
CN103493508B (en) * | 2011-05-13 | 2017-02-15 | 索尼爱立信移动通讯有限公司 | Electronic devices for reducing acoustic leakage effects and related methods |
US10235004B1 (en) | 2011-11-18 | 2019-03-19 | Sentons Inc. | Touch input detector with an integrated antenna |
KR101803261B1 (en) | 2011-11-18 | 2017-11-30 | 센톤스 아이엔씨. | Detecting touch input force |
KR101960836B1 (en) | 2011-11-18 | 2019-03-22 | 센톤스 아이엔씨. | Localized haptic feedback |
US9348468B2 (en) | 2013-06-07 | 2016-05-24 | Sentons Inc. | Detecting multi-touch inputs |
US9078066B2 (en) | 2012-07-18 | 2015-07-07 | Sentons Inc. | Touch input surface speaker |
US9459715B1 (en) | 2013-09-20 | 2016-10-04 | Sentons Inc. | Using spectral control in detecting touch input |
CN204119279U (en) * | 2014-06-18 | 2015-01-21 | 锤子科技(北京)有限公司 | A kind of mobile terminal |
US9571968B1 (en) * | 2015-07-21 | 2017-02-14 | International Business Machines Corporation | Geo-fence management using a cluster analysis technique |
US10048811B2 (en) | 2015-09-18 | 2018-08-14 | Sentons Inc. | Detecting touch input provided by signal transmitting stylus |
US20170195811A1 (en) * | 2015-12-30 | 2017-07-06 | Knowles Electronics Llc | Audio Monitoring and Adaptation Using Headset Microphones Inside User's Ear Canal |
US10908741B2 (en) | 2016-11-10 | 2021-02-02 | Sentons Inc. | Touch input detection along device sidewall |
US10296144B2 (en) | 2016-12-12 | 2019-05-21 | Sentons Inc. | Touch input detection with shared receivers |
US10126877B1 (en) | 2017-02-01 | 2018-11-13 | Sentons Inc. | Update of reference data for touch input detection |
US10585522B2 (en) | 2017-02-27 | 2020-03-10 | Sentons Inc. | Detection of non-touch inputs using a signature |
CN109308176B (en) * | 2017-07-26 | 2021-08-10 | 昆山纬绩资通有限公司 | Electronic device capable of being operated by gestures and operation method thereof |
US11009411B2 (en) | 2017-08-14 | 2021-05-18 | Sentons Inc. | Increasing sensitivity of a sensor using an encoded signal |
US11580829B2 (en) | 2017-08-14 | 2023-02-14 | Sentons Inc. | Dynamic feedback for haptics |
US10834494B1 (en) | 2019-12-13 | 2020-11-10 | Bestechnic (Shanghai) Co., Ltd. | Active noise control headphones |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020068537A1 (en) * | 2000-12-04 | 2002-06-06 | Mobigence, Inc. | Automatic speaker volume and microphone gain control in a portable handheld radiotelephone with proximity sensors |
US20020101441A1 (en) * | 2001-01-31 | 2002-08-01 | Microsoft Corporation | Input device with pattern and tactile feedback for computer input and control |
US20030108209A1 (en) * | 2001-12-11 | 2003-06-12 | Mcintosh Jason Darrell | Communication device with active equalization and method therefor |
US20040259513A1 (en) * | 2003-06-23 | 2004-12-23 | Lg Electronics Inc. | Apparatus and method for automatically controlling speaker volume for a mobile terminal |
US20070113681A1 (en) * | 2005-11-22 | 2007-05-24 | Nishimura Ken A | Pressure distribution sensor and sensing method |
US7522065B2 (en) * | 2004-10-15 | 2009-04-21 | Microsoft Corporation | Method and apparatus for proximity sensing in a portable electronic device |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI99062C (en) | 1995-10-05 | 1997-09-25 | Nokia Mobile Phones Ltd | Voice signal equalization in a mobile phone |
US20040184623A1 (en) | 2003-03-07 | 2004-09-23 | Leif Johannsen | Speaker unit with active leak compensation |
-
2007
- 2007-11-02 US US11/934,404 patent/US8144897B2/en active Active
-
2012
- 2012-02-14 US US13/372,957 patent/US8798279B2/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020068537A1 (en) * | 2000-12-04 | 2002-06-06 | Mobigence, Inc. | Automatic speaker volume and microphone gain control in a portable handheld radiotelephone with proximity sensors |
US20020101441A1 (en) * | 2001-01-31 | 2002-08-01 | Microsoft Corporation | Input device with pattern and tactile feedback for computer input and control |
US20030108209A1 (en) * | 2001-12-11 | 2003-06-12 | Mcintosh Jason Darrell | Communication device with active equalization and method therefor |
US6639987B2 (en) * | 2001-12-11 | 2003-10-28 | Motorola, Inc. | Communication device with active equalization and method therefor |
US20040259513A1 (en) * | 2003-06-23 | 2004-12-23 | Lg Electronics Inc. | Apparatus and method for automatically controlling speaker volume for a mobile terminal |
US7522065B2 (en) * | 2004-10-15 | 2009-04-21 | Microsoft Corporation | Method and apparatus for proximity sensing in a portable electronic device |
US20070113681A1 (en) * | 2005-11-22 | 2007-05-24 | Nishimura Ken A | Pressure distribution sensor and sensing method |
US7331245B2 (en) * | 2005-11-22 | 2008-02-19 | Avago Technologies Ecbu Ip Pte Ltd | Pressure distribution sensor and sensing method |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9075475B2 (en) | 2009-06-19 | 2015-07-07 | Blackberry Limited | Portable electronic device including touch-sensitive display and method of determining when to turn off the touch sensitive dispay |
US20100321321A1 (en) * | 2009-06-19 | 2010-12-23 | Research In Motion Limited | Portable electronic device and method of controlling same |
US8717311B2 (en) | 2009-06-19 | 2014-05-06 | Blackberry Limited | Portable electronic device including touch-sensitive display and method of determining when to turn off the touch sensitive display |
WO2010145031A1 (en) * | 2009-06-19 | 2010-12-23 | Research In Motion Limited | Portable electronic device with face touch detection |
US20110136479A1 (en) * | 2009-12-04 | 2011-06-09 | Kim Mi Jeong | Mobile terminal and method of controlling the same |
US20130259221A1 (en) * | 2010-03-30 | 2013-10-03 | Fujitsu Limited | Telephone and voice adjustment method for telephone |
US8774397B2 (en) * | 2010-03-30 | 2014-07-08 | Fujitsu Limited | Telephone and voice adjustment method for telephone |
US20120169620A1 (en) * | 2011-01-05 | 2012-07-05 | Motorola-Mobility, Inc. | User Interface and Method for Locating an Interactive Element Associated with a Touch Sensitive Interface |
US8797284B2 (en) * | 2011-01-05 | 2014-08-05 | Motorola Mobility Llc | User interface and method for locating an interactive element associated with a touch sensitive interface |
WO2014063755A1 (en) * | 2012-10-26 | 2014-05-01 | Huawei Technologies Co., Ltd. | Portable electronic device with audio rendering means and audio rendering method |
EP2957109B1 (en) * | 2013-02-12 | 2019-04-10 | QUALCOMM Incorporated | Speaker equalization for mobile devices |
WO2015011026A1 (en) * | 2013-07-22 | 2015-01-29 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio processor for object-dependent processing |
US9980071B2 (en) | 2013-07-22 | 2018-05-22 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Audio processor for orientation-dependent processing |
EP2830326A1 (en) * | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio prcessor for object-dependent processing |
US10484783B2 (en) | 2015-09-16 | 2019-11-19 | Apple Inc. | Earbuds with compliant member |
US9699546B2 (en) | 2015-09-16 | 2017-07-04 | Apple Inc. | Earbuds with biometric sensing |
US9716937B2 (en) | 2015-09-16 | 2017-07-25 | Apple Inc. | Earbuds with biometric sensing |
US9838775B2 (en) * | 2015-09-16 | 2017-12-05 | Apple Inc. | Earbuds with biometric sensing |
US11678106B2 (en) | 2015-09-16 | 2023-06-13 | Apple Inc. | Earbuds |
US10856068B2 (en) | 2015-09-16 | 2020-12-01 | Apple Inc. | Earbuds |
US10149041B2 (en) | 2015-09-16 | 2018-12-04 | Apple Inc. | Earbuds with compliant member |
US20170180896A1 (en) * | 2015-12-17 | 2017-06-22 | Sony Mobile Communications Inc. | Method for diagnosing sealing properties of microphone and/or loudspeaker seals in an electronic device |
US10009699B2 (en) * | 2015-12-17 | 2018-06-26 | Sony Mobile Communications Inc. | Method for diagnosing sealing properties of microphone and/or loudspeaker seals in an electronic device |
WO2018028630A1 (en) * | 2016-08-11 | 2018-02-15 | 华为技术有限公司 | Ear coupling detection method, and terminal |
US10681445B2 (en) | 2016-09-06 | 2020-06-09 | Apple Inc. | Earphone assemblies with wingtips for anchoring to a user |
Also Published As
Publication number | Publication date |
---|---|
US20120140954A1 (en) | 2012-06-07 |
US20100166223A9 (en) | 2010-07-01 |
US8144897B2 (en) | 2012-03-27 |
US8798279B2 (en) | 2014-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8144897B2 (en) | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port | |
US20140044286A1 (en) | Dynamic speaker selection for mobile computing devices | |
US10051396B2 (en) | Automatic microphone switching | |
US8189429B2 (en) | Microphone proximity detection | |
US10045141B2 (en) | Detection of a microphone | |
CN106953990A (en) | The incoming call sound method and mobile terminal of mobile terminal | |
JP2016136722A (en) | Headphones with integral image display | |
CN104320527B (en) | It is a kind of to improve the method and device that mobile phone send words effect | |
US10878833B2 (en) | Speech processing method and terminal | |
JP2010506317A (en) | How to output an alert signal | |
US20110003615A1 (en) | Apparatus and method for detecting usage profiles of mobile devices | |
JP2008503983A (en) | Method and apparatus for improved mobile station and hearing aid compatibility | |
JP7271699B2 (en) | Mobile terminal and voice output control method | |
US20160080552A1 (en) | Methods and systems for user feature tracking on a mobile device | |
KR20140053867A (en) | A system and apparatus for controlling a user interface with a bone conduction transducer | |
US10121491B2 (en) | Intelligent volume control interface | |
US20070293159A1 (en) | Apparatus and method for reducing background noise | |
CA2642410C (en) | Adjusting acoustic speaker output based on an estimated degree of seal of an ear about a speaker port | |
CN108769364B (en) | Call control method, device, mobile terminal and computer readable medium | |
CN110392334A (en) | A kind of microphone array audio signal adaptive processing method, device and medium | |
US20130266148A1 (en) | Electronic Devices for Reducing Acoustic Leakage Effects and Related Methods and Computer Program Products | |
CN112689051B (en) | Audio playing control method and device, mobile terminal and storage medium | |
KR20120115941A (en) | Apparatus and method for auto adjustment of volume in a portable terminal | |
US10396835B2 (en) | System and method for reducing noise from time division multiplexing of a cellular communications transmitter | |
US20210012787A1 (en) | Detection and restoration of distorted signals of blocked microphones |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: RESEARCH IN MOTION LIMITED, CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RANTA, CRAIG ERIC;REEL/FRAME:020070/0166 Effective date: 20071026 Owner name: RESEARCH IN MOTION LIMITED,CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RANTA, CRAIG ERIC;REEL/FRAME:020070/0166 Effective date: 20071026 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
AS | Assignment |
Owner name: BLACKBERRY LIMITED, ONTARIO Free format text: CHANGE OF NAME;ASSIGNOR:RESEARCH IN MOTION LIMITED;REEL/FRAME:033134/0228 Effective date: 20130709 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
AS | Assignment |
Owner name: MALIKIE INNOVATIONS LIMITED, IRELAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BLACKBERRY LIMITED;REEL/FRAME:064104/0103 Effective date: 20230511 |
|
AS | Assignment |
Owner name: MALIKIE INNOVATIONS LIMITED, IRELAND Free format text: NUNC PRO TUNC ASSIGNMENT;ASSIGNOR:BLACKBERRY LIMITED;REEL/FRAME:064270/0001 Effective date: 20230511 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |