WO2007117649A2 - Systems and methods for enhanced haptic effects - Google Patents
Systems and methods for enhanced haptic effects Download PDFInfo
- Publication number
- WO2007117649A2 WO2007117649A2 PCT/US2007/008659 US2007008659W WO2007117649A2 WO 2007117649 A2 WO2007117649 A2 WO 2007117649A2 US 2007008659 W US2007008659 W US 2007008659W WO 2007117649 A2 WO2007117649 A2 WO 2007117649A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- haptic
- actuator
- format
- signal
- data
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1037—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/204—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/013—Force feedback applied to a game
Definitions
- the present invention generally relates to haptic control technology. More particularly, the present invention relates to systems and methods for haptic effects.
- Portable devices are rapidly evolving into multi-function devices, which incorporate computing, communication, and entertainment functions in one device. Tactile feedback is increasingly incorporated into these portable devices, such as mobile phones, personal digital assistants, and other devices. Historically, however, portable devices have only featured basic vibration functionality. For example, mobile phones may only have the ability to pulse a vibration actuator on and off at a single amplitude.
- MFT Multi-Function Transducer
- Embodiments of the present invention provide systems and methods for enhanced haptic effects.
- One embodiment of the present invention implements a method comprising receiving an input signal formatted in a first format, the input signal having multimedia data and haptic information, decoding the haptic information, determining a parameter associated with an actuator in a haptic device, and generating an actuator signal based at least in part on the parameter and the haptic information.
- the method further comprises generating an output signal comprising the multimedia data and the actuator signal, the output signal formatted in a second format.
- the method further comprises producing a haptic effect based at least in part on the output signal.
- a computer readable medium comprises program code for carrying out such a method.
- Figure 1 is an illustration of a device for providing enhanced haptic feedback in one embodiment of the present invention
- Figure 2 is a second illustration of a device for providing enhanced haptic feedback in one embodiment of the present invention
- Figure 3 is a block diagram illustrating a system for providing enhanced haptic feedback in one embodiment of the present invention.
- Figure 4 is a flow diagram illustrating a method for providing enhanced haptic feedback in one embodiment of the present invention.
- a computer-readable medium stores information relating to the performance of a haptic device.
- a processor receives a media stream with haptic information encoded at a predetermined frequency.
- a processor uses a band pass filter to extract the haptic information from the media stream.
- the processor then generates an actuator signal for producing a haptic effect associated with the haptic information.
- the actuator signal is based, at least in part, on the information stored in the computer readable medium and related to the performance of a specific haptic device.
- the processor After generating an actuator signal, the processor generates an output signal comprising the multimedia data and the actuator signal.
- the output signal is in the same format as the input signal.
- the haptic device may use an actuator to provide a haptic effect.
- a portable music player may be configured to play sound through a speaker and produce haptic effects with an actuator.
- the portable music player may comprise a processor configured to receive input data comprising audio data and haptic data. The processor extracts the haptic data from the input data. The processor then analyzes parameters associated with the actuator, such as the actuator's resonant frequency, and generates an actuator signal based at least in part on the haptic data and the parameters. The processor may then be further configured to output the audio data to the speaker to produce a sound and to transmit the actuator signal to the actuator to provide a haptic effect.
- the actuator signal and the audio data may be transmitted such that the haptic effect is substantially synchronized with the sound.
- Such an illustrative embodiment may be advantageously employed to play audio files in which haptic effects may be encoded along with audio data.
- Such audio files may provide music for a user to listen to, as well as synchronized haptic effects to enhance the experience of listening to music.
- Such an illustrative embodiment may also include video data, for example, to provide haptic effects synchronized with both sound and video.
- haptic effects may be used to enhance the experience of watching a movie or playing a video game.
- This second example is also given to introduce the reader to the general subject matter discussed herein. The invention is not limited to these examples.
- the following sections describe various embodiments of systems and methods for enhanced haptic feedback.
- FIG. 1 is an illustration of a device for providing enhanced haptic feedback in one embodiment of the present invention.
- the device in Figure 1 comprises a mobile phone 102 having a display 104, a keypad 106, and a speaker 108. While the embodiment shown in Figure 1 comprises a mobile phone, other embodiments may comprise other devices. For example, other embodiments may comprise a personal digital assistant (PDA), a beeper, a portable music or video player, a game controller or other manipulandum, a portable game system, or a portable navigation device.
- PDA personal digital assistant
- Figure 2 is a second illustration of a device for providing enhanced haptic feedback in one embodiment of the present invention.
- Figure 2 represents a perspective view of the interior of the mobile phone 102 shown in Figure 1.
- the mobile phone 102 includes a processor 204 and an actuator 206.
- the processor 204 is in communication with the actuator 206.
- the processor 204 is configured to receive an input signal formatted in a first format, the input signal having multimedia data and haptic information.
- the processor 204 is also configured to generate an output signal formatted in a second format.
- the output signal may comprise multimedia data and an actuator signal.
- the second format of the output signal may be the same as the first format of the input signal.
- the output signal may be transmitted to one or more elements of the mobile phone 102, such as the speaker 108 or the actuator 206. In one embodiment, the output signal may be transmitted to the speaker 108 and the actuator 206 at substantially the same time.
- the speaker 108 of the mobile phone 102 may play a sound based at least in part on the multimedia data, and the actuator 206 may produce a haptic effect based at least in part on the actuator signal.
- the haptic effect and the audio may be synchronized.
- the speaker 108 may play the sound substantially simultaneously with the haptic effect produced by the actuator 206.
- the haptic effect may not be synchronized with the sound.
- the actuator signal may be configured to generate no haptic effect. For example, if the haptic information is not recognized or is not useable, the actuator signal may be configured to generate no haptic effect.
- processor 204 may comprise a computer-readable medium, such as a random access memory (RAM) coupled to the processor.
- RAM random access memory
- the processor executes computer-executable program instructions stored in memory, such as executing one or more computer programs for generating vibrotactile or other haptic effects.
- processors may comprise a microprocessor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), field programmable gate arrays (FPGAs), and state machines.
- DSP digital signal processor
- ASIC application-specific integrated circuit
- FPGAs field programmable gate arrays
- Such processors may further comprise programmable electronic devices such as PLCs, programmable interrupt controllers (PICs), programmable logic devices (PLDs), programmable read-only memories (PROMs), electronically programmable read-only memories (EPROMs or EEPROMs), or other similar devices.
- PLCs programmable interrupt controllers
- PLDs programmable logic devices
- PROMs programmable read-only memories
- EPROMs or EEPROMs electronically programmable read-only memories
- Such processors may comprise, or may be in communication with, media, for example computer-readable media, that may store instructions that, when executed by the processor, can cause the processor to perform the steps described herein as carried out, or assisted, by a processor.
- Embodiments of computer-readable media may comprise, but are not limited to, an electronic, optical, magnetic, or other storage or transmission device capable of providing a processor, such as the processor in a web server, with computer- readable instructions.
- Other examples of media comprise, but are not limited to, a floppy disk, CD-ROM, magnetic disk, memory chip, ROM, RAM, ASIC, configured processor, all optical media, all magnetic tape or other magnetic media, or any other medium from which a computer processor can read.
- various other forms of computer-readable media may transmit or carry instructions to a computer, such as a router, private or public network, or other transmission device or channel.
- the processor, and the processing, described may be in one or more structures, and may be dispersed through one or more structures.
- the processor may comprise code for carrying out one or more of the methods (or parts of methods) described herein.
- the instructions can comprise code from any suitable computer- programming language, including, for example, C, C+, C++, Visual Basic, Java, Python, and JavaScript.
- the actuator 206 can be any of a variety of different types of actuators, including an eccentric rotating mass (ERM) actuator, a MFT, a linear mass actuator, an electro-magnetic actuator, a motor, a voice coil, a pneumatic or hydraulic actuator, an electro-active polymer, or any other suitable actuator.
- actuator 206 may comprise a plurality of actuators. For example, in one embodiment, two actuators may be employed. A first actuator may be configured to provide vibrotactile or other haptic effects having a high frequency of vibration (e.g. greater than 200Hz), while a second actuator may be configured to provide vibrotactile or other haptic effects having a low frequency of vibration (e.g. less than 200Hz).
- a first actuator and a second actuator may be employed to provide haptic effects to simulate a directional effect.
- the first and second actuators may be located on opposite sides of a device and may be actuated to provide haptic effects that appear to move from one side of the device to the other, or provide an indication of direction of a source of a vibration synchronized with an image on a screen.
- FIG. 3 is a block diagram illustrating a system for providing enhanced haptic feedback in one embodiment of the present invention.
- the system comprises a media player 302, a network 320, and a design tool 322.
- the media player 302 comprises a media stream decoder 304, a haptic media engine 306, an actuator 310, a multi- function transducer 312, a display 314, and a speaker 316.
- the media player 302 may be configured to play audio through the speaker 316 and/or video through the display 314. In one embodiment, the media player 302 may be configured to provide haptic effects to a user with the MFT 312. In another embodiment, the media player 302 may be configured to provide haptic effects to a user with the actuator 310.
- the media player 302 may have a combination of one or more of the multi-function transducers 312 and one or more of the actuators 310. In one embodiment the media player 302 may comprise a full-fidelity vibrotactile player that may be capable of producing a wide range of vibrotactile and other haptic effects having varying strength, frequency, duration, rhythm, intonation, and other dynamics.
- the media player 302 may be configured to receive an input signal having haptic information and multimedia data.
- the multimedia data may be a multimedia file, containing one or more media streams, such as an audio stream and a video stream.
- the input signal is received over a network 320, including without limitation the Internet or a cellular phone network.
- the media player 302 may receive the input signal wirelessly, such as through a wireless network (such as 802.11), cellular network, Bluetooth, infra-red, or other means for wireless transmission of data.
- the media player 302 may receive the input signal over a direct electrical connection, such as Ethernet, Universal Serial Bus (USB), Fire Wire, parallel, or serial connection.
- USB Universal Serial Bus
- the input signal is received from a local memory (not shown).
- the media player 302 may also be configured to receive the input signal from an application.
- the media player 302 may receive the input signal from a design tool 322 for creating content, including haptic information.
- Media player 302 comprises a media stream decoder 304.
- media stream decoder 304 comprises program code executed by a processor (not shown).
- a media player 302 may comprise a processor and a memory.
- the memory may comprise program code comprising the media stream decoder 304.
- Media stream decoder 304 may comprise program code for receiving an input signal having haptic information and multimedia data, where the input signal may be formatted in a first format.
- the first format may be a multimedia format.
- the input signal comprises audio data formatted using the Motion Picture Experts Group- 1 Audio Layer 3 (MP3) format.
- the input signal may comprise video and/or data formatted using an Motion Picture Experts Group (MPEG) format.
- MPEG Motion Picture Experts Group
- other multimedia formats for audio and/or video data may be used, including Waveform Audio Format (WAV), Musical Instrument Digital Interface (MIDI), Ogg, DivXTM, QuickTimeTM, MP3, AppleTM's MPEG-4 Part 3 (M4P), Advanced Audio Coding (AAC) format, or any other format for encoding audio and/or video data.
- WAV Waveform Audio Format
- MIDI Musical Instrument Digital Interface
- Ogg DivXTM
- QuickTimeTM QuickTimeTM
- AAC Advanced Audio Coding
- the input signal may be associated with a single media, such as an audio file.
- the media stream may be a multimedia file, such as a movie file with audio and video
- the input signal also includes haptic information.
- the haptic information may be stored as an independent media stream in the multimedia data.
- the haptic information may be embedded within the media, for example as a package within an existing multimedia file.
- the embedded haptic information may be placed within the input data in such a way as to make the haptic content invisible to media players that are not designed to recognize the haptic data.
- the format of the input signal may be extended to include haptic data, such that a media player designed to recognize haptic information may choose to ignore or play the haptic information.
- the haptic information is encoded within a particular media stream. For example, the haptic information may be converted from its native format into the same format as the multimedia data.
- the haptic data may be encoded as amplitude or frequency modulated data at one or more frequencies of the media stream data.
- haptic data may be encoded as amplitude modulated data on a carrier wave having a frequency of 140 Hz, then mixed into the existing audio stream.
- haptic data may be encoded as frequency modulated data.
- the haptic data may be encoded at a frequency that is not recognized by the speakers of the haptic device. For example, if the speakers of the haptic device do not recognize frequencies below 135 Hz, the haptic information may be encoded at 130 Hz.
- the haptic data may be encoded as information describing a haptic effect.
- haptic data may comprise data specifying a frequency, amplitude, duration, period, pulse width, envelope, and/or other information associated with a haptic effect to be output.
- the haptic data may comprise a waveform to be output as a haptic effect.
- data points defining a digitized actuator signal itself may be encoded as haptic data.
- haptic data may comprise both information describing an actuator signal and data points defining at least part of a digitized actuator signal.
- synchronization data may be embedded into the input signal to synchronize the haptic effects with audio and/or video.
- Co-pending U.S. patent application serial No. 11/583,483, filed on October 18, 2006 describes methods for synchronization of haptic effect data in a media transport stream, the entirety of which is herein incorporated by reference.
- haptic information in a series of frames in a multimedia data stream may be associated with corresponding time stamps.
- the time stamps may be used to synchronize the actuator signal with the multimedia data, such that an actuator that receives the output signal provides a haptic effect at the same time a drum beat is played on a speaker.
- the media player 302 may comprise a touch-sensitive screen, such as a touch screen.
- a user may select an object, such as a selection box, a window, or a particular file, through contact with the touch screen. For instance, a user may push a virtual button on the touch screen.
- the media player 302 may then simultaneously play a sound effect and generate a haptic effect associated with the selection. In other embodiments, the media player 302 may then generate a haptic effect without playing a sound effect or other media.
- input data may comprise audio data and haptic data, wherein the haptic data is configured to provide haptic effects synchronized with a drum beat within the audio data.
- haptic data may be inferred from audio data.
- media stream decoder 304 may be configured to analyze audio and/or video data to determine frequency patterns associated with haptic events.
- media stream decoder 304 may be configured to analyze audio data for low-frequency, high-amplitude signals that may be associated with an explosion and generate an associated haptic effect.
- the media stream decoder 304 may further comprise program code for decoding the haptic information from the input signal.
- the media stream decoder 304 comprises a haptic media engine 306.
- the haptic media engine 306 may have access to information describing the performance of the haptic device, and the capability to reformat the haptic information from the input signal to account for the specific parameters of the haptic device.
- the haptic media engine 306 may be configured to decode haptic information from the input signal.
- the haptic media engine 306 may be configured to extract information describing an actuator signal or data points defining a digitized actuator signal from the input data.
- the haptic media engine 306 may be configured to extract haptic information from the input data at a specific predetermined frequency.
- haptic media engine 306 may be configured to decode amplitude modulated data from a carrier wave having a specified frequency within the input data.
- haptic media engine 306 may be configured to extract frequency modulated data from the input data.
- haptic data is encoded in the input signal at a predetermined frequency, for example, 140 hertz.
- the haptic media engine 306 may comprise a band pass filter.
- the band pass filter may decode haptic data at the predetermined frequency of the input signal.
- the media stream decoder 304 may further comprise program code for determining a parameter associated with an actuator in a haptic device.
- haptic media engine 306 may determine a resonant frequency for the actuator 310 or multifunction transducer 312.
- Parameter data may comprise, such as, for example and without limitation, a resonant frequency of the actuator, a maximum peak-to-peak amplitude or magnitude of the actuator, or a minimum actuator response time.
- the parameter data may also include data associated with other components of the media player, such as audio frequencies for which the speaker 316 has poor frequency response.
- the haptic media engine 306 further comprises program code for generating an actuator signal based at least in part on the parameter and the haptic information.
- the haptic media engine 306 may use the parameter associated with the actuator, such as the resonant frequency of the actuator.
- the haptic media engine 306 may generate an actuator signal having a frequency approximately equal to the resonant frequency of the actuator and with characteristics associated with the haptic information.
- the actuator signal may be configured with amplitude and duration based at least in part on the haptic information.
- the haptic information may comprise data points defining a digitized actuator signal.
- the haptic media engine 306 may generate an actuator signal having a frequency approximately equal to the resonant frequency of the actuator and having a waveform defined by the data points from the haptic information. In one embodiment, the haptic media engine 306 may generate an actuator signal having an amplitude equal to the maximum peak-to-peak amplitude of the actuator. In one embodiment, the haptic media engine 306 may generate an actuator signal based on the minimum response time of the actuator.
- the media stream decoder 304 further comprises program code for generating an output signal comprising the multimedia data and the actuator signal, the output signal encoded in a second format.
- the second format may be a multimedia format, such as WAV, MIDI, Ogg, DivXTM, QuickTimeTM, MP3, M4P, AAC, or any other format for encoding audio and/or video data.
- the output signal may formatted as an actuator signal.
- the second format may be the same as the first format.
- the actuator signal portion of the output signal may be transmitted directly to the actuator.
- the output signal may be formatted as a direct voltage actuator signal, which is played directly to the actuator.
- the media player 302 may generate the output signal for use with a media mixer.
- a media mixer may receive various types of media and transmit the media to the appropriate devices.
- the media mixer may consolidate multiple incoming media into one output.
- the media player 302 may generate the output signal on an actuator drive circuit or a media drive circuit.
- the media player 302 is configured to receive data and use the data to play audio/video and to produce haptic effects.
- the media player 302 comprises a media stream decoder 304 application.
- the media stream decoder 304 shown in Figure 3 is a software application configured to reside in memory within the media player 302 and to execute on a processor within the media player 302.
- the media stream decoder 304 may comprise code for receiving data from a data source, reading data stored in memory in the media player 302, and code for outputting data to an output device, such as actuator 310, multi-function transducer 312, speaker 316, and/or display 314.
- the media player 302 may comprise non- volatile memory, such as flash memory, which may store parameters associated with one or more output devices, such as the actuator 310 or multi-function transducer 312.
- the media stream decoder also comprises a haptic media engine 306.
- the haptic media engine 306 may be a dedicated application for extracting haptic information from input data, determining an actuator signal based at least in part on the haptic information and a parameter associated with the actuator 310, determining an output signal based at least in part on the actuator signal and the multimedia data, and outputting the actuator signal.
- the haptic media engine 306 may also be configured to read data stored in memory (not shown) within the media player 302.
- the haptic media engine 306 may be configured to read data comprising parameters associated with the actuator 310 or multi-function transducer 312.
- the haptic media engine 306 may operate in coordination with the media stream decoder 304 to provide haptic effects encoded within a stream of multimedia data received by the media stream decoder 304.
- the media stream decoder 304 may comprise code for interacting with a data source, such as, for example and without limitation, a hard drive, a CD player, a DVD player, a flash drive, memory, or a network connection.
- the media stream decoder is configured to receive data from memory, such as a ring tone.
- a ring tone may comprise a sound file formatted to play on a mobile phone or other device, which is played to indicate an incoming phone call.
- the media stream decoder may read ring tone data associated with the ring tone.
- the media stream decoder may extract and process audio data within the ring tone data.
- the media stream decoder 304 may construct an audio signal to be output to the speaker 316 based at least in part on the ring tone data.
- the media stream decoder may also provide the ring tone data to the haptic media engine 306.
- the haptic media engine 306 may extract haptic information from the ring tone data.
- the haptic media engine 306 may also read parameter data associated with the actuator 310 from memory local to the media player 302. The haptic media engine 306 may construct an actuator signal based at least in part on the haptic information. The haptic media engine 306 may then modify the actuator signal based at least on the parameter data associated with the actuator.
- the ring tone data may comprise a digitized waveform to generate a haptic effect, wherein the waveform has a frequency of 200 Hz.
- the haptic media engine 306 may calculate a new actuator signal having a frequency approximately equal to a resonant frequency of the actuator 310, such as, for example, 140Hz.
- the haptic media engine 306 may also normalize the amplitude of the digitized waveform to correspond to the performance characteristics of the actuator 310 and the media player 302. For example, actuator 310 may be constrained to input actuator signals having a maximum peak-to-peak amplitude of 3 volts. If the digitized waveform comprises a maximum peak-to-peak amplitude of 5 volts, the haptic media engine 306 may normalize the digitized waveform to have a 3 volt peak-to-peak maximum amplitude. Other characteristics associated with the actuator 310 may be used to modify haptic information. For example, actuator 310 may have a large eccentric mass resulting in an actuator that takes longer to accelerate and decelerate.
- the haptic media engine 306 may re-shape the actuator signal constructed from the haptic information to conform to the performance characteristics of the actuator. For example, the haptic media engine 306 may combine three short pulses having a pulse width smaller than the smallest pulse the actuator is capable of generating to create two pulses.
- the haptic media engine 306 may transmit the actuator signal to the media stream decoder 304, which may then output both the audio signal and the actuator signal to provide a haptic effect substantially synchronized with the audio.
- the haptic media engine 306 may receive a command from the media stream decoder 304 to output the actuator signal.
- the haptic media engine 306 may output the actuator signal directly to the actuator 310 without a command from the media stream decoder 304.
- the haptic media engine 306 may be configured to generate an output signal comprising the multimedia data and the actuator signal.
- the output signal may be in the same format as the input data received by the media stream decoder 304.
- the output signal may be a mp4 file with media and haptic information.
- the output signal may be optimized for a specific haptic device. If an output signal is optimized for playback on a specific device, the device receiving the output signal may be capable of playing the output signal using multiple components of the device, such as a display, a speaker, and one or more actuators.
- the haptic media engine 306 may encode the haptic drive signal at a specific frequency which is not processed by the speaker of a haptic device.
- the output signal may be played on a haptic device such that a speaker of the haptic device would play the output signal, and because the speaker is not responsive to the frequency on which the actuator signal is coded, minimal audio distortion while an actuator would interpret the haptic portion of the output signal.
- the haptic media engine 306 may generate the output signal based at least in part on a user preference.
- a user preference may indicate one volume level for audio, a brightness level for video, and a vibration level for haptic effects.
- the haptic media engine 306 may be capable of maximizing the strength of the haptic portion of the output signal while halving the audio portion of the output signal.
- FIG. 4 is a flow diagram illustrating a method for providing enhanced haptic feedback in one embodiment of the present invention.
- an input signal is received by the media player 302.
- the media player 302 may receive the input signal as a digital signal.
- the media player 302 may receive the input signal as an analog signal.
- the input signal may comprise haptic information and multimedia data.
- the signal may be formatted in a multimedia format, such as the MP3 format.
- the media stream decoder 304 decodes the haptic information from the input signal.
- the haptic information may be encoded in the input signal at a specific frequency.
- the haptic information may be interlaced in the input signal with the multimedia data.
- the input data may comprise multimedia data and haptic information, wherein the multimedia data and haptic information alternate positions within the input data.
- multimedia data may comprise packets of data having a first fixed number bytes of data per packet
- haptic information may comprise packets of data having a second fixed number of bytes of data per packet.
- Input data may comprise a series of packets of data wherein every packet of multimedia data is followed by one packet of haptic information.
- the multimedia data may be interlaced with the haptic information with different orderings and numbers of multimedia data and haptic information.
- the haptic media engine 306 determines a parameter associated with a haptic device.
- the haptic media engine 306 may determine a plurality of parameters associated with a haptic. device.
- the parameters may be stored locally by the haptic media engine 306.
- the haptic media engine 306 may access such locally stored parameter to generate an actuator signal.
- the haptic media engine 306 may access a configuration file stored in a local memory to determine a parameter associated with a haptic device.
- the haptic media engine 306 may determine a parameter associated with a Haptic Device by calculating the parameter.
- the haptic media engine 306 may calculate a default parameter for a class of actuators 310 used in the media player 302.
- the haptic media engine 306 generates an actuator signal based at least in part on the parameter and the haptic information.
- the actuator signal may be specific to an actuator on the media player 302.
- the actuator signal may be a raw vibration drive signal stream.
- the haptic media engine 306 may generate an actuator signal having a frequency approximately equal to the resonant frequency of the actuator and with characteristics associated with the haptic information.
- the haptic media engine 306 generates an output signal comprising the actuator control signal.
- the actuator control signal is formatted in the same format as the input signal. In another embodiment, the actuator control signal is formatted in a different format than the input signal.
- the actuator control signal may be transmitted directly to the actuator drive hardware.
- the actuator control signal may be transmitted to a media stream mixer.
- audio data from the audio stream may be mixed with the actuator control signal and transmitted to a multi-function transducer, which produces both sound and vibration.
- the media player 302 In step 412, the media player 302 generates a haptic effect based at least in part on the output signal. In one embodiment, the media player 302 may generate a haptic effect by transmitting the output signal to an actuator 310. In another embodiment, the media player 302 may generate a haptic effect by transmitting the output signal to a multi-function transducer 312.
- the haptic effect may be generated 412 at substantially the same time as the output the multimedia data is played by the device. In one embodiment, the haptic effect may be generated at the same time the display 314 reproduces video data. As another example, in one embodiment the media player 302 vibrates at the same time the media player 302 plays a drum beat through a speaker 316. Alternatively, in other embodiments, the haptic effect is generated slightly before or slightly after the multimedia data is played.
- the haptic effect produced 412 may be a kinesthetic feedback effect. In other embodiments, the haptic effect produced 412 may be a vibrotactile feedback effect, such as a vibration. In some embodiments, the haptic effect produced 412 is a combination of effects.
- Embodiments of the present invention provide various advantages over conventional systems and methods for providing haptic feedback. For instance some embodiments output actuator signals with full fidelity. Further, some embodiments provide a wide range of control over the strength, frequency, duration, rhythm, intonation and dynamics, including the ability to ramp vibration output up and down and stop it sharply. Through such enhanced haptic effects, devices of the present invention may be easier to use, and capable of generating realistic, entertaining haptic simulation of events and emotions.
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020087027127A KR101384434B1 (en) | 2006-04-06 | 2007-04-06 | Systems and methods for enhanced haptic effects, and recording medium |
EP07755062A EP2002323A2 (en) | 2006-04-06 | 2007-04-06 | Systems and methods for enhanced haptic effects |
JP2009504334A JP5025721B2 (en) | 2006-04-06 | 2007-04-06 | System and method for enhancing haptic effects |
CN200780012335.3A CN101416139B (en) | 2006-04-06 | 2007-04-06 | Systems and methods for enhanced haptic effects |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US79040806P | 2006-04-06 | 2006-04-06 | |
US60/790,408 | 2006-04-06 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2007117649A2 true WO2007117649A2 (en) | 2007-10-18 |
WO2007117649A3 WO2007117649A3 (en) | 2008-09-12 |
Family
ID=38474143
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2007/008659 WO2007117649A2 (en) | 2006-04-06 | 2007-04-06 | Systems and methods for enhanced haptic effects |
Country Status (6)
Country | Link |
---|---|
US (2) | US10152124B2 (en) |
EP (2) | EP3287874A1 (en) |
JP (2) | JP5025721B2 (en) |
KR (1) | KR101384434B1 (en) |
CN (2) | CN104063056B (en) |
WO (1) | WO2007117649A2 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009136345A1 (en) * | 2008-05-09 | 2009-11-12 | Koninklijke Philips Electronics N.V. | Method and system for conveying an emotion |
WO2012001587A1 (en) * | 2010-06-28 | 2012-01-05 | Koninklijke Philips Electronics N.V. | Enhancing content viewing experience |
US20120092146A1 (en) * | 2009-12-11 | 2012-04-19 | Gwangju Institute Of Science And Technology | Method for expressing haptic information using control information, and system for transmitting haptic information |
US8880156B2 (en) | 2008-05-08 | 2014-11-04 | Koninklijke Philips N.V. | Method and system for determining a physiological condition using a two-dimensional representation of R-R intervals |
JP2014229312A (en) * | 2013-05-17 | 2014-12-08 | イマージョン コーポレーションImmersion Corporation | Low-frequency effects haptic conversion system |
US10152127B2 (en) | 2012-02-10 | 2018-12-11 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vibration transfer between vibration devices |
US11138984B2 (en) | 2016-12-05 | 2021-10-05 | Sony Corporation | Information processing apparatus and information processing method for generating and processing a file including speech waveform data and vibration waveform data |
Families Citing this family (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007030603A2 (en) | 2005-09-08 | 2007-03-15 | Wms Gaming Inc. | Gaming machine having display with sensory feedback |
US8210942B2 (en) * | 2006-03-31 | 2012-07-03 | Wms Gaming Inc. | Portable wagering game with vibrational cues and feedback mechanism |
KR101134926B1 (en) * | 2006-11-03 | 2012-04-17 | 엘지전자 주식회사 | Broadcast Terminal And Method Of Controlling Vibration Of Broadcast Terminal |
KR101131856B1 (en) * | 2006-11-03 | 2012-03-30 | 엘지전자 주식회사 | Apparatus For Transmitting Broadcast Signal And Method Of Transmitting And Receiving Broadcast Signal Using Same |
US8199033B2 (en) * | 2007-07-06 | 2012-06-12 | Pacinian Corporation | Haptic keyboard systems and methods |
US8248277B2 (en) * | 2007-07-06 | 2012-08-21 | Pacinian Corporation | Haptic keyboard systems and methods |
US7741979B2 (en) | 2007-07-06 | 2010-06-22 | Pacinian Corporation | Haptic keyboard systems and methods |
US20090088220A1 (en) * | 2007-10-01 | 2009-04-02 | Sony Ericsson Mobile Communications Ab | Cellular terminals and other electronic devices and methods using electroactive polymer transducer indicators |
US8253686B2 (en) * | 2007-11-26 | 2012-08-28 | Electronics And Telecommunications Research Institute | Pointing apparatus capable of providing haptic feedback, and haptic interaction system and method using the same |
US8310444B2 (en) | 2008-01-29 | 2012-11-13 | Pacinian Corporation | Projected field haptic actuation |
US8294600B2 (en) * | 2008-02-15 | 2012-10-23 | Cody George Peterson | Keyboard adaptive haptic response |
US8203531B2 (en) | 2008-03-14 | 2012-06-19 | Pacinian Corporation | Vector-specific haptic feedback |
US9056549B2 (en) | 2008-03-28 | 2015-06-16 | Denso International America, Inc. | Haptic tracking remote control for driver information center system |
US8347210B2 (en) * | 2008-09-26 | 2013-01-01 | Apple Inc. | Synchronizing video with audio beats |
US9400555B2 (en) * | 2008-10-10 | 2016-07-26 | Internet Services, Llc | System and method for synchronization of haptic data and media data |
KR100926046B1 (en) * | 2008-10-16 | 2009-11-11 | 솔로몬유(주) | A doll having mp3 player |
US20120126959A1 (en) * | 2008-11-04 | 2012-05-24 | Bayer Materialscience Ag | Electroactive polymer transducers for tactile feedback devices |
US8515239B2 (en) * | 2008-12-03 | 2013-08-20 | D-Box Technologies Inc. | Method and device for encoding vibro-kinetic data onto an LPCM audio stream over an HDMI link |
US20100152620A1 (en) * | 2008-12-12 | 2010-06-17 | Immersion Corporation | Method and Apparatus for Providing A Haptic Monitoring System Using Multiple Sensors |
KR101030389B1 (en) | 2008-12-17 | 2011-04-20 | 삼성전자주식회사 | Haptic function control method for portable terminal |
US8760413B2 (en) * | 2009-01-08 | 2014-06-24 | Synaptics Incorporated | Tactile surface |
US10007340B2 (en) | 2009-03-12 | 2018-06-26 | Immersion Corporation | Systems and methods for interfaces featuring surface-based haptic effects |
US9746923B2 (en) | 2009-03-12 | 2017-08-29 | Immersion Corporation | Systems and methods for providing features in a friction display wherein a haptic effect is configured to vary the coefficient of friction |
KR101324687B1 (en) * | 2009-08-10 | 2013-11-04 | 한국과학기술원 | Method of encoding haptic information on image, method of decoding haptic information from image and apparatus for processing haptic information for the same |
US8624839B2 (en) | 2009-10-15 | 2014-01-07 | Synaptics Incorporated | Support-surface apparatus to impart tactile feedback |
US10068728B2 (en) | 2009-10-15 | 2018-09-04 | Synaptics Incorporated | Touchpad with capacitive force sensing |
US8902050B2 (en) * | 2009-10-29 | 2014-12-02 | Immersion Corporation | Systems and methods for haptic augmentation of voice-to-text conversion |
US20110115709A1 (en) * | 2009-11-17 | 2011-05-19 | Immersion Corporation | Systems And Methods For Increasing Haptic Bandwidth In An Electronic Device |
KR101640043B1 (en) * | 2010-04-14 | 2016-07-15 | 삼성전자주식회사 | Method and Apparatus for Processing Virtual World |
US9733705B2 (en) | 2010-04-26 | 2017-08-15 | Nokia Technologies Oy | Apparatus, method, computer program and user interface |
US9791928B2 (en) | 2010-04-26 | 2017-10-17 | Nokia Technologies Oy | Apparatus, method, computer program and user interface |
US9715275B2 (en) | 2010-04-26 | 2017-07-25 | Nokia Technologies Oy | Apparatus, method, computer program and user interface |
KR100986681B1 (en) * | 2010-05-06 | 2010-10-08 | (주)이미지스테크놀로지 | Apparatus for controlling multi acutator drive for generating touch feeling |
JP2012010212A (en) * | 2010-06-28 | 2012-01-12 | Casio Comput Co Ltd | Image display device and program |
US8309870B2 (en) | 2011-01-04 | 2012-11-13 | Cody George Peterson | Leveled touchsurface with planar translational responsiveness to vertical travel |
US8912458B2 (en) | 2011-01-04 | 2014-12-16 | Synaptics Incorporated | Touchsurface with level and planar translational travel responsiveness |
US8847890B2 (en) | 2011-01-04 | 2014-09-30 | Synaptics Incorporated | Leveled touchsurface with planar translational responsiveness to vertical travel |
US8717152B2 (en) | 2011-02-11 | 2014-05-06 | Immersion Corporation | Sound to haptic effect conversion system using waveform |
US9448626B2 (en) | 2011-02-11 | 2016-09-20 | Immersion Corporation | Sound to haptic effect conversion system using amplitude value |
US20120224719A1 (en) * | 2011-03-04 | 2012-09-06 | Sony Mobile Communications Ab | Vibration control |
US9448713B2 (en) * | 2011-04-22 | 2016-09-20 | Immersion Corporation | Electro-vibrotactile display |
US20120302323A1 (en) | 2011-05-23 | 2012-11-29 | Wms Gaming Inc. | Haptic gaming chairs and wagering game systems and machines with a haptic gaming chair |
US9449456B2 (en) | 2011-06-13 | 2016-09-20 | Bally Gaming, Inc. | Automated gaming chairs and wagering game systems and machines with an automated gaming chair |
US10013857B2 (en) * | 2011-12-21 | 2018-07-03 | Qualcomm Incorporated | Using haptic technologies to provide enhanced media experiences |
US9715276B2 (en) * | 2012-04-04 | 2017-07-25 | Immersion Corporation | Sound to haptic effect conversion system using multiple actuators |
WO2013156819A1 (en) | 2012-04-19 | 2013-10-24 | Nokia Corporation | A display apparatus |
US9218927B2 (en) | 2012-08-06 | 2015-12-22 | Synaptics Incorporated | Touchsurface assembly with level and planar translational responsiveness via a buckling elastic component |
US9324515B2 (en) | 2012-08-06 | 2016-04-26 | Synaptics Incorporated | Touchsurface assembly utilizing magnetically enabled hinge |
US9177733B2 (en) | 2012-08-06 | 2015-11-03 | Synaptics Incorporated | Touchsurface assemblies with linkages |
US9040851B2 (en) | 2012-08-06 | 2015-05-26 | Synaptics Incorporated | Keycap assembly with an interactive spring mechanism |
US9092059B2 (en) * | 2012-10-26 | 2015-07-28 | Immersion Corporation | Stream-independent sound to haptic effect conversion system |
CN103034331B (en) * | 2012-12-12 | 2016-06-29 | 中兴通讯股份有限公司 | A kind of haptic feedback devices and terminal |
US9202350B2 (en) | 2012-12-19 | 2015-12-01 | Nokia Technologies Oy | User interfaces and associated methods |
US9128523B2 (en) | 2012-12-20 | 2015-09-08 | Amazon Technologies, Inc. | Dynamically generating haptic effects from audio data |
US9261960B2 (en) | 2013-01-24 | 2016-02-16 | Immersion Corporation | Haptic sensation recording and playback |
US8866601B2 (en) * | 2013-02-05 | 2014-10-21 | Immersion Corporation | Overdrive voltage for an actuator to generate haptic effects |
US9384919B2 (en) | 2013-03-14 | 2016-07-05 | Synaptics Incorporated | Touchsurface assembly having key guides formed in a sheet metal component |
US9992491B2 (en) * | 2013-03-15 | 2018-06-05 | Immersion Corporation | Method and apparatus for encoding and decoding haptic information in multi-media files |
US9064385B2 (en) * | 2013-03-15 | 2015-06-23 | Immersion Corporation | Method and apparatus to generate haptic feedback from video content analysis |
US9997032B2 (en) | 2013-04-09 | 2018-06-12 | Immersion Corporation | Offline haptic conversion system |
US20160054820A1 (en) * | 2013-04-14 | 2016-02-25 | Koc Universitesi | A stylus providing haptic feedback |
US9213372B2 (en) | 2013-04-19 | 2015-12-15 | Synaptics Incorporated | Retractable keyboard keys |
US9274603B2 (en) * | 2013-05-24 | 2016-03-01 | Immersion Corporation | Method and apparatus to provide haptic feedback based on media content and one or more external parameters |
JP6411069B2 (en) * | 2013-05-24 | 2018-10-24 | イマージョン コーポレーションImmersion Corporation | Method and system for encoding and streaming haptic data |
JP6667987B2 (en) * | 2013-09-06 | 2020-03-18 | イマージョン コーポレーションImmersion Corporation | Method and apparatus for converting a control track to provide haptic feedback |
US9443401B2 (en) | 2013-09-06 | 2016-09-13 | Immersion Corporation | Automatic remote sensing and haptic conversion system |
US9317120B2 (en) * | 2013-09-06 | 2016-04-19 | Immersion Corporation | Multiplexing and demultiplexing haptic signals |
US9245429B2 (en) * | 2013-09-06 | 2016-01-26 | Immersion Corporation | Haptic warping system |
US9213408B2 (en) | 2013-10-08 | 2015-12-15 | Immersion Corporation | Generating haptic effects while minimizing cascading |
WO2015057679A1 (en) | 2013-10-14 | 2015-04-23 | Nike Innovate C.V. | Calculating pace and energy expenditure from athletic movement attributes |
CN104683781B (en) * | 2013-11-26 | 2016-08-17 | 深圳市快播科技有限公司 | Video playback processing method and processing device |
KR20150110356A (en) | 2014-03-21 | 2015-10-02 | 임머숀 코퍼레이션 | Systems and methods for converting sensory data to haptic effects |
US20150323994A1 (en) * | 2014-05-07 | 2015-11-12 | Immersion Corporation | Dynamic haptic effect modification |
US9330547B2 (en) * | 2014-05-20 | 2016-05-03 | Immersion Corporation | Haptic effect authoring tool based on a haptification model |
KR20170030510A (en) * | 2014-07-07 | 2017-03-17 | 임머숀 코퍼레이션 | Second screen haptics |
KR101641418B1 (en) * | 2014-07-25 | 2016-07-20 | 포항공과대학교 산학협력단 | Method for haptic signal generation based on auditory saliency and apparatus therefor |
US9812165B2 (en) | 2014-12-19 | 2017-11-07 | Immersion Corporation | Systems and methods for recording haptic data for use with multi-media data |
US9891714B2 (en) * | 2014-12-24 | 2018-02-13 | Immersion Corporation | Audio enhanced simulation of high bandwidth haptic effects |
JP6445921B2 (en) * | 2015-04-21 | 2018-12-26 | 任天堂株式会社 | Vibration signal generation program, vibration signal generation system, vibration signal generation device, vibration signal generation method, and data output program |
US20160366450A1 (en) * | 2015-06-12 | 2016-12-15 | Immersion Corporation | Broadcast haptics architectures |
CN105245704A (en) * | 2015-09-25 | 2016-01-13 | 努比亚技术有限公司 | Call reminding method and device for mobile terminal |
US9847000B2 (en) * | 2015-10-29 | 2017-12-19 | Immersion Corporation | Ambient triggered notifications for rendering haptic effects |
CN108290289B (en) * | 2015-11-16 | 2022-02-25 | 迪宝克技术公司 | Method and system for synchronizing vibro-kinetic effects with virtual reality sessions |
US10031580B2 (en) * | 2016-01-13 | 2018-07-24 | Immersion Corporation | Systems and methods for haptically-enabled neural interfaces |
CN105975053A (en) * | 2016-05-11 | 2016-09-28 | 乐视控股(北京)有限公司 | Virtual helmet control method and device, and virtual helmet |
US10210724B2 (en) | 2016-06-29 | 2019-02-19 | Immersion Corporation | Real-time patterned haptic effect generation using vibrations |
EP3321933B1 (en) * | 2016-11-14 | 2021-08-25 | Goodix Technology (HK) Company Limited | Linear resonant actuator controller |
US10564725B2 (en) * | 2017-03-23 | 2020-02-18 | Immerson Corporation | Haptic effects using a high bandwidth thin actuation system |
JP2018185704A (en) * | 2017-04-27 | 2018-11-22 | 日本電信電話株式会社 | Living body electrical stimulation device, living body electrical stimulation system, and living body electrical stimulation method |
US10409376B2 (en) * | 2017-10-04 | 2019-09-10 | Immersion Corporation | Haptic actuator having a smart material actuation component and an electromagnet actuation component |
CN109407832B (en) * | 2018-09-29 | 2021-06-29 | 维沃移动通信有限公司 | Terminal device control method and terminal device |
JP6721664B2 (en) * | 2018-11-30 | 2020-07-15 | 任天堂株式会社 | Data output program, data output device, and data output method |
CN113196210A (en) * | 2018-12-13 | 2021-07-30 | 索尼集团公司 | Information processing apparatus, information processing system, information processing method, and program |
US20240045504A1 (en) * | 2019-09-13 | 2024-02-08 | Nippon Telegraph And Telephone Corporation | Tactile Presentation Device and Tactile Presentation Method |
CN111766946B (en) * | 2020-06-30 | 2023-12-01 | 瑞声科技(新加坡)有限公司 | Haptic effect optimization method and device, and computer-readable storage medium |
US20230059333A1 (en) * | 2021-08-18 | 2023-02-23 | Cirrus Logic International Semiconductor Ltd. | Haptics signal generation |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5436622A (en) * | 1993-07-06 | 1995-07-25 | Motorola, Inc. | Variable frequency vibratory alert method and structure |
US5524061A (en) * | 1994-08-29 | 1996-06-04 | Motorola, Inc. | Dual mode transducer for a portable receiver |
WO1997019398A1 (en) * | 1995-11-24 | 1997-05-29 | Philips Electronics N.V. | A method for presenting virtual reality enhanced with tactile stimuli, and a system for executing the method |
EP1351118A2 (en) * | 2002-03-20 | 2003-10-08 | Seiko Epson Corporation | Power control device for computing unit, power-saving decoder, power control program for computing unit, and power control method for computting unit |
US20040125120A1 (en) * | 2001-06-08 | 2004-07-01 | Michael Weiner | Method and apparatus for interactive transmission and reception of tactile information |
US20050235032A1 (en) * | 2004-04-15 | 2005-10-20 | Mason Wallace R Iii | System and method for haptic based conferencing |
Family Cites Families (122)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3618070A (en) | 1969-07-03 | 1971-11-02 | Bell & Howell Comm Co | Vibratory alerting devices |
US3911416A (en) | 1974-08-05 | 1975-10-07 | Motorola Inc | Silent call pager |
US4028502A (en) | 1976-02-13 | 1977-06-07 | Inventive Industries, Inc. | Apparatus for adapting multi-line telephone instrument for use by the blind |
US4278920A (en) | 1976-07-26 | 1981-07-14 | The Bendix Corporation | Method and apparatus for generating position or path control programs using force feedback |
FR2419548A1 (en) | 1978-03-09 | 1979-10-05 | Materiel Telephonique | ELECTRO-HYDRAULIC FLIGHT CONTROL SIMULATOR |
US4262549A (en) | 1978-05-10 | 1981-04-21 | Schwellenbach Donald D | Variable mechanical vibrator |
JPS5853782Y2 (en) | 1979-01-08 | 1983-12-07 | 日本電気株式会社 | Personal selection call receiver |
US4464117A (en) | 1980-08-27 | 1984-08-07 | Dr. Ing. Reiner Foerst Gmbh | Driving simulator apparatus |
US4333070A (en) | 1981-02-06 | 1982-06-01 | Barnes Robert W | Motor vehicle fuel-waste indicator |
US4436188A (en) | 1981-11-18 | 1984-03-13 | Jones Cecil R | Controlled motion apparatus |
US4421953A (en) | 1981-12-07 | 1983-12-20 | Northern Telecom Limited | Telephone tactile alert system |
US4484191A (en) | 1982-06-14 | 1984-11-20 | Vavra George S | Tactile signaling systems for aircraft |
US4964004A (en) | 1983-12-02 | 1990-10-16 | Lex Computer And Management Corporation | Video composition method and apparatus employing visual and tactile feedback |
JPS60159500U (en) | 1984-03-31 | 1985-10-23 | 星野楽器株式会社 | electronic drum pad |
US4603284A (en) | 1984-06-05 | 1986-07-29 | Unimation, Inc. | Control system for manipulator apparatus with resolved compliant motion control |
JPH0763193B2 (en) | 1986-05-30 | 1995-07-05 | 日本電気株式会社 | Individual selective call receiver |
US4853674A (en) | 1986-07-21 | 1989-08-01 | Kiss Michael Z | Signalling apparatus for hearing impaired persons |
US4794392A (en) | 1987-02-20 | 1988-12-27 | Motorola, Inc. | Vibrator alert device for a communication receiver |
US4823634A (en) | 1987-11-03 | 1989-04-25 | Culver Craig F | Multifunction tactile manipulatable control |
US5844498A (en) | 1987-11-13 | 1998-12-01 | Nec Corporation | Paging receiver with a message selection circuit |
US4931765A (en) | 1989-02-09 | 1990-06-05 | Motorola, Inc. | Unitized housing for silent and tone pager alerting system |
JPH0727741Y2 (en) | 1989-10-23 | 1995-06-21 | フクダ電子株式会社 | Portable radio paging receiver with waveform display |
US5117449A (en) | 1989-11-03 | 1992-05-26 | Motorola, Inc. | Dual receiver apparatus for integrated paging and radiotelephone functions |
US5189389A (en) | 1990-04-23 | 1993-02-23 | Motorola, Inc. | Electronic device having position selectable alert modes |
US5165897A (en) | 1990-08-10 | 1992-11-24 | Tini Alloy Company | Programmable tactile stimulator array system and method of operation |
JP2643619B2 (en) | 1991-02-19 | 1997-08-20 | 日本電気株式会社 | Radio selective call receiver |
US5351412A (en) | 1991-06-11 | 1994-10-04 | International Business Machines Corporation | Micro positioning device |
US5175459A (en) | 1991-08-19 | 1992-12-29 | Motorola, Inc. | Low profile vibratory alerting device |
US5889670A (en) | 1991-10-24 | 1999-03-30 | Immersion Corporation | Method and apparatus for tactilely responsive user interface |
US5220260A (en) | 1991-10-24 | 1993-06-15 | Lex Computer And Management Corporation | Actuator having electronically controllable tactile responsiveness |
WO1993015590A1 (en) | 1992-01-22 | 1993-08-05 | Motorola, Inc. | Radio with silent and audible alerts |
JPH05218947A (en) | 1992-02-05 | 1993-08-27 | Nec Corp | Radio selective calling receiver |
US5368484A (en) | 1992-05-22 | 1994-11-29 | Atari Games Corp. | Vehicle simulator with realistic operating feedback |
US5366376A (en) | 1992-05-22 | 1994-11-22 | Atari Games Corporation | Driver training system and method with performance data feedback |
US5437607A (en) | 1992-06-02 | 1995-08-01 | Hwe, Inc. | Vibrating massage apparatus |
US5296871A (en) | 1992-07-27 | 1994-03-22 | Paley W Bradford | Three-dimensional mouse with tactile feedback |
US5283970A (en) | 1992-09-25 | 1994-02-08 | Strombecker Corporation | Toy guns |
US5666473A (en) | 1992-10-08 | 1997-09-09 | Science & Technology Corporation & Unm | Tactile computer aided sculpting device |
US5389865A (en) | 1992-12-02 | 1995-02-14 | Cybernet Systems Corporation | Method and system for providing a tactile virtual reality and manipulator defining an interface device therefor |
US6131097A (en) | 1992-12-02 | 2000-10-10 | Immersion Corporation | Haptic authoring |
US5629594A (en) | 1992-12-02 | 1997-05-13 | Cybernet Systems Corporation | Force feedback system |
US6433771B1 (en) | 1992-12-02 | 2002-08-13 | Cybernet Haptic Systems Corporation | Haptic device attribute control |
JP2518525B2 (en) | 1993-06-28 | 1996-07-24 | 日本電気株式会社 | Wireless selective call receiver |
US5731804A (en) | 1995-01-18 | 1998-03-24 | Immersion Human Interface Corp. | Method and apparatus for providing high bandwidth, low noise mechanical I/O for computer systems |
US5625576A (en) | 1993-10-01 | 1997-04-29 | Massachusetts Institute Of Technology | Force reflecting haptic interface |
WO1995020787A1 (en) | 1994-01-27 | 1995-08-03 | Exos, Inc. | Multimode feedback display technology |
US5482051A (en) | 1994-03-10 | 1996-01-09 | The University Of Akron | Electromyographic virtual reality system |
IL109943A (en) * | 1994-06-08 | 2006-08-01 | Develogen Israel Ltd | Conformationally constrained backbone cyclized peptide analogs |
US5575761A (en) | 1994-07-27 | 1996-11-19 | Hajianpour; Mohammed-Ali | Massage device applying variable-frequency vibration in a variable pulse sequence |
AU3329595A (en) | 1994-08-18 | 1996-03-14 | Interval Research Corporation | Content-based haptic input device for video |
KR100368508B1 (en) | 1994-09-07 | 2005-10-25 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Information processing system interacts with virtual workspaces with user-programmable tactile feedback |
US5619181A (en) | 1994-11-21 | 1997-04-08 | Motorola, Inc. | Vibratory alerting device with audible sound generator |
US5646589A (en) | 1994-12-19 | 1997-07-08 | Lucent Technologies Inc. | Electronic device having selectable alert modes |
US5856004A (en) | 1995-03-31 | 1999-01-05 | Akzo Nobel Nv | Cellulose yarn and cord for industrial application |
US5867796A (en) | 1995-04-28 | 1999-02-02 | Nec Corporation | Portable telephone set capable of being put in a holding mode by operation of a vibration unit which is for announcing reception of an incoming call to a user |
US5754096A (en) | 1995-05-26 | 1998-05-19 | Seiko Instruments Inc. | Electronic apparatus with vibration informing function |
JPH08331212A (en) | 1995-06-01 | 1996-12-13 | Nec Corp | Portable telephone terminal with vibrator |
JPH0918966A (en) | 1995-06-30 | 1997-01-17 | Sony Corp | Receiver |
JP2852205B2 (en) | 1995-07-13 | 1999-01-27 | 静岡日本電気株式会社 | Radio selective call receiver |
US5642413A (en) | 1995-08-07 | 1997-06-24 | Little; Randall P. | Telephone call alert device with selectable alert modes |
US6473069B1 (en) | 1995-11-13 | 2002-10-29 | Cirque Corporation | Apparatus and method for tactile feedback from input device |
US5956484A (en) | 1995-12-13 | 1999-09-21 | Immersion Corporation | Method and apparatus for providing force feedback over a computer network |
US5729589A (en) | 1995-12-14 | 1998-03-17 | Oraelectronics, Inc. | Apparatus and method for incoming call detection and alarm circuitry for cellular telephones |
JP2693941B2 (en) | 1995-12-25 | 1997-12-24 | 静岡日本電気株式会社 | Radio selective call receiver |
US5692956A (en) | 1996-02-09 | 1997-12-02 | Mattel, Inc. | Combination computer mouse and game play control |
US6374255B1 (en) | 1996-05-21 | 2002-04-16 | Immersion Corporation | Haptic authoring |
JPH09308768A (en) * | 1996-05-24 | 1997-12-02 | Ikyo Kk | Game machine |
JPH09321682A (en) * | 1996-05-27 | 1997-12-12 | Sony Corp | Communication system, communication method and terminal equipment |
JP2834085B2 (en) | 1996-07-16 | 1998-12-09 | 静岡日本電気株式会社 | Wireless device reporting device |
US6061451A (en) * | 1996-09-03 | 2000-05-09 | Digital Vision Laboratories Corporation | Apparatus and method for receiving and decrypting encrypted data and protecting decrypted data from illegal use |
GB9622556D0 (en) | 1996-10-30 | 1997-01-08 | Philips Electronics Nv | Cursor control with user feedback mechanism |
US6118979A (en) | 1996-11-22 | 2000-09-12 | Robert B. Nicholson, III | Method for signaling an incoming telephone call without an audible signal |
CA2278726C (en) | 1997-01-27 | 2004-08-31 | Immersion Corporation | Method and apparatus for providing high bandwidth, realistic force feedback including an improved actuator |
US5966655A (en) | 1997-04-30 | 1999-10-12 | Lucent Technologies Inc. | Automatic determination of audio or vibration alerting for an incoming call in a wireless handset |
US5887995A (en) | 1997-09-23 | 1999-03-30 | Compaq Computer Corporation | Touchpad overlay with tactile response |
US5917906A (en) | 1997-10-01 | 1999-06-29 | Ericsson Inc. | Touch pad with tactile feature |
US6448977B1 (en) | 1997-11-14 | 2002-09-10 | Immersion Corporation | Textures and other spatial sensations for a relative haptic interface device |
JP3148174B2 (en) | 1998-01-14 | 2001-03-19 | 日本電気株式会社 | Radio selective call receiver |
US6300938B1 (en) | 1998-04-13 | 2001-10-09 | Immersion Corporation | Multiple-cylinder control device for computers and other electronic apparatus |
US6087942A (en) | 1998-05-18 | 2000-07-11 | Jb Research, Inc. | Tactile alert and massaging system |
US6686901B2 (en) | 1998-06-23 | 2004-02-03 | Immersion Corporation | Enhancing inertial tactile feedback in computer interface devices having increased mass |
US6563487B2 (en) | 1998-06-23 | 2003-05-13 | Immersion Corporation | Haptic feedback for directional control pads |
JP2000023253A (en) | 1998-06-26 | 2000-01-21 | Nec Corp | Multimode mobile radio device and multimode radio device, and incoming call information method for the same |
WO2000017739A1 (en) * | 1998-09-22 | 2000-03-30 | Yasufumi Mase | Information processor for visually disabled person and tactile input/output device |
US6218958B1 (en) | 1998-10-08 | 2001-04-17 | International Business Machines Corporation | Integrated touch-skin notification system for wearable computing devices |
US6373463B1 (en) | 1998-10-14 | 2002-04-16 | Honeywell International Inc. | Cursor control system with tactile feedback |
US6218966B1 (en) | 1998-11-05 | 2001-04-17 | International Business Machines Corporation | Tactile feedback keyboard |
US6373465B2 (en) * | 1998-11-10 | 2002-04-16 | Lord Corporation | Magnetically-controllable, semi-active haptic interface system and apparatus |
US6650338B1 (en) | 1998-11-24 | 2003-11-18 | Interval Research Corporation | Haptic interaction with video and image data |
US6113459A (en) | 1998-12-21 | 2000-09-05 | Nammoto; Mikio | Remote toy steering mechanism |
US6091321A (en) | 1998-12-30 | 2000-07-18 | Karell; Manuel L | Method and apparatus of a vibratory indicator for use in vehicles |
JP2000299575A (en) | 1999-04-12 | 2000-10-24 | Sony Corp | Input device |
US6337678B1 (en) | 1999-07-21 | 2002-01-08 | Tactiva Incorporated | Force feedback computer input and output device with coordinated haptic elements |
JP2001100879A (en) * | 1999-09-27 | 2001-04-13 | Olympus Optical Co Ltd | Information reading system |
DE20080209U1 (en) | 1999-09-28 | 2001-08-09 | Immersion Corp | Control of haptic sensations for interface devices with vibrotactile feedback |
US6424251B1 (en) | 1999-11-10 | 2002-07-23 | Matthew T. Byrne | Personal electronic device notification system |
US6822635B2 (en) * | 2000-01-19 | 2004-11-23 | Immersion Corporation | Haptic interface for laptop computers and other portable devices |
EP1303853A4 (en) | 2000-05-24 | 2009-03-11 | Immersion Corp | Haptic devices using electroactive polymers |
JP3949912B2 (en) | 2000-08-08 | 2007-07-25 | 株式会社エヌ・ティ・ティ・ドコモ | Portable electronic device, electronic device, vibration generator, notification method by vibration and notification control method |
EP1330101B1 (en) | 2000-09-25 | 2008-04-16 | Yamaha Corporation | Mobile terminal device |
AU2001294852A1 (en) | 2000-09-28 | 2002-04-08 | Immersion Corporation | Directional tactile feedback for haptic feedback interface devices |
JP2002119912A (en) | 2000-10-12 | 2002-04-23 | Nec Saitama Ltd | Compound acoustic actuator drive circuit and portable information terminal |
US6418323B1 (en) | 2001-01-22 | 2002-07-09 | Wildseed, Ltd. | Wireless mobile phone with Morse code and related capabilities |
JP4308448B2 (en) * | 2001-04-11 | 2009-08-05 | セイコーエプソン株式会社 | Content generation according to the output device |
US7154470B2 (en) * | 2001-07-17 | 2006-12-26 | Immersion Corporation | Envelope modulator for haptic feedback devices |
US7269334B2 (en) * | 2001-07-27 | 2007-09-11 | Thomson Licensing | Recording and playing back multiple programs |
US7623114B2 (en) * | 2001-10-09 | 2009-11-24 | Immersion Corporation | Haptic feedback sensations based on audio output from computer devices |
US6703550B2 (en) * | 2001-10-10 | 2004-03-09 | Immersion Corporation | Sound data output and manipulation using haptic feedback |
JP2003198680A (en) * | 2001-12-28 | 2003-07-11 | Nec Tokin Corp | Mobile communication device and mounting method for multifunctional vibrating actuator |
US7250846B2 (en) | 2002-03-05 | 2007-07-31 | International Business Machines Corporation | Method and apparatus for providing dynamic user alert |
US6904823B2 (en) | 2002-04-03 | 2005-06-14 | Immersion Corporation | Haptic shifting devices |
JP4555072B2 (en) * | 2002-05-06 | 2010-09-29 | シンクロネイション インコーポレイテッド | Localized audio network and associated digital accessories |
US8031059B2 (en) | 2002-05-31 | 2011-10-04 | Motorola Mobility, Inc. | Communication system |
CA2764614C (en) * | 2002-10-18 | 2016-08-23 | Cel-Kom Llc | Direct manual examination of remote patient with virtual examination functionality |
US8276091B2 (en) | 2003-09-16 | 2012-09-25 | Ram Consulting | Haptic response system and method of use |
US20060015560A1 (en) * | 2004-05-11 | 2006-01-19 | Microsoft Corporation | Multi-sensory emoticons in a communication system |
US8115091B2 (en) * | 2004-07-16 | 2012-02-14 | Motorola Mobility, Inc. | Method and device for controlling vibrational and light effects using instrument definitions in an audio file format |
US9046922B2 (en) | 2004-09-20 | 2015-06-02 | Immersion Corporation | Products and processes for providing multimodal feedback in a user interface device |
JP4350627B2 (en) * | 2004-09-27 | 2009-10-21 | ソフトバンクモバイル株式会社 | Streaming data reception / playback terminal |
JP2006163579A (en) * | 2004-12-03 | 2006-06-22 | Sony Corp | Information processing system, information processor and information processing method |
JP2006201912A (en) * | 2005-01-19 | 2006-08-03 | Nippon Telegr & Teleph Corp <Ntt> | Processing method for three-dimensional virtual object information providing service, three-dimensional virtual object providing system, and program |
KR20060024807A (en) * | 2005-12-19 | 2006-03-17 | 노키아 코포레이션 | Mobile device for mapping sms characters to e.g. sound, vibration, or graphical effects |
-
2007
- 2007-04-06 US US11/697,374 patent/US10152124B2/en not_active Expired - Fee Related
- 2007-04-06 CN CN201410255319.9A patent/CN104063056B/en not_active Expired - Fee Related
- 2007-04-06 EP EP17189500.6A patent/EP3287874A1/en not_active Withdrawn
- 2007-04-06 WO PCT/US2007/008659 patent/WO2007117649A2/en active Application Filing
- 2007-04-06 KR KR1020087027127A patent/KR101384434B1/en active IP Right Grant
- 2007-04-06 JP JP2009504334A patent/JP5025721B2/en not_active Expired - Fee Related
- 2007-04-06 EP EP07755062A patent/EP2002323A2/en not_active Ceased
- 2007-04-06 CN CN200780012335.3A patent/CN101416139B/en not_active Expired - Fee Related
-
2012
- 2012-06-21 JP JP2012139630A patent/JP5385430B2/en not_active Expired - Fee Related
-
2018
- 2018-11-13 US US16/188,720 patent/US20190079586A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5436622A (en) * | 1993-07-06 | 1995-07-25 | Motorola, Inc. | Variable frequency vibratory alert method and structure |
US5524061A (en) * | 1994-08-29 | 1996-06-04 | Motorola, Inc. | Dual mode transducer for a portable receiver |
WO1997019398A1 (en) * | 1995-11-24 | 1997-05-29 | Philips Electronics N.V. | A method for presenting virtual reality enhanced with tactile stimuli, and a system for executing the method |
US20040125120A1 (en) * | 2001-06-08 | 2004-07-01 | Michael Weiner | Method and apparatus for interactive transmission and reception of tactile information |
EP1351118A2 (en) * | 2002-03-20 | 2003-10-08 | Seiko Epson Corporation | Power control device for computing unit, power-saving decoder, power control program for computing unit, and power control method for computting unit |
US20050235032A1 (en) * | 2004-04-15 | 2005-10-20 | Mason Wallace R Iii | System and method for haptic based conferencing |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8880156B2 (en) | 2008-05-08 | 2014-11-04 | Koninklijke Philips N.V. | Method and system for determining a physiological condition using a two-dimensional representation of R-R intervals |
WO2009136345A1 (en) * | 2008-05-09 | 2009-11-12 | Koninklijke Philips Electronics N.V. | Method and system for conveying an emotion |
KR20110008316A (en) * | 2008-05-09 | 2011-01-26 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Method and system for conveying an emotion |
US8952888B2 (en) | 2008-05-09 | 2015-02-10 | Koninklijke Philips N.V. | Method and system for conveying an emotion |
KR101630864B1 (en) * | 2008-05-09 | 2016-06-16 | 코닌클리케 필립스 엔.브이. | Method and system for conveying an emotion |
US20120092146A1 (en) * | 2009-12-11 | 2012-04-19 | Gwangju Institute Of Science And Technology | Method for expressing haptic information using control information, and system for transmitting haptic information |
US9030305B2 (en) * | 2009-12-11 | 2015-05-12 | Gwangju Institute Of Science And Technology | Method for expressing haptic information using control information, and system for transmitting haptic information |
WO2012001587A1 (en) * | 2010-06-28 | 2012-01-05 | Koninklijke Philips Electronics N.V. | Enhancing content viewing experience |
CN103003775A (en) * | 2010-06-28 | 2013-03-27 | Tp视觉控股有限公司 | Enhancing content viewing experience |
US10152127B2 (en) | 2012-02-10 | 2018-12-11 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vibration transfer between vibration devices |
JP2014229312A (en) * | 2013-05-17 | 2014-12-08 | イマージョン コーポレーションImmersion Corporation | Low-frequency effects haptic conversion system |
US11138984B2 (en) | 2016-12-05 | 2021-10-05 | Sony Corporation | Information processing apparatus and information processing method for generating and processing a file including speech waveform data and vibration waveform data |
Also Published As
Publication number | Publication date |
---|---|
KR20080109907A (en) | 2008-12-17 |
US20190079586A1 (en) | 2019-03-14 |
CN101416139B (en) | 2014-07-09 |
JP2009532808A (en) | 2009-09-10 |
CN104063056B (en) | 2018-04-20 |
EP3287874A1 (en) | 2018-02-28 |
US10152124B2 (en) | 2018-12-11 |
KR101384434B1 (en) | 2014-04-10 |
EP2002323A2 (en) | 2008-12-17 |
JP5385430B2 (en) | 2014-01-08 |
WO2007117649A3 (en) | 2008-09-12 |
US20070236449A1 (en) | 2007-10-11 |
JP2012230690A (en) | 2012-11-22 |
JP5025721B2 (en) | 2012-09-12 |
CN101416139A (en) | 2009-04-22 |
CN104063056A (en) | 2014-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190079586A1 (en) | Systems and methods for enhanced haptic effects | |
US10467870B2 (en) | Sound to haptic effect conversion system using multiple actuators | |
US10339772B2 (en) | Sound to haptic effect conversion system using mapping | |
EP2624099B1 (en) | Method and system for sound to haptic effect conversion using waveform | |
CN103793048A (en) | Stream-independent sound to haptic effect conversion system | |
KR20130075323A (en) | Apparatus and method for gernerating vibration by using sound characteristics | |
US8494206B2 (en) | Electronic device and method thereof | |
WO2007076498A2 (en) | A method and apparatus for a user interface | |
WO2022264537A1 (en) | Haptic signal generation device, haptic signal generation method, and program | |
CN117708492A (en) | Vibration control method, vibration control device, electronic apparatus, and computer-readable storage medium | |
TW202403508A (en) | Method and apparatus of encoding/decoding haptic data | |
Kinsley et al. | Making Things Go Boom |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07755062 Country of ref document: EP Kind code of ref document: A2 |
|
REEP | Request for entry into the european phase |
Ref document number: 2007755062 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007755062 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009504334 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200780012335.3 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020087027127 Country of ref document: KR |