US20070030246A1 - Tactile feedback man-machine interface device - Google Patents
Tactile feedback man-machine interface device Download PDFInfo
- Publication number
- US20070030246A1 US20070030246A1 US11/580,452 US58045206A US2007030246A1 US 20070030246 A1 US20070030246 A1 US 20070030246A1 US 58045206 A US58045206 A US 58045206A US 2007030246 A1 US2007030246 A1 US 2007030246A1
- Authority
- US
- United States
- Prior art keywords
- vibrotactile
- mass
- user
- body part
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/32—Constructional details
- G10H1/34—Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/321—Garment sensors, i.e. musical control means with trigger surfaces or joint angle sensors, worn as a garment by the player, e.g. bracelet, intelligent clothing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Definitions
- This invention relates to a man-machine interface and in particular to an interface that provides tactile sensation to a user.
- Virtual reality is an immersive environment which is created by a computer and with which users have real-time, multisensorial interactions. Typically, these interactions involve some or all of the human senses through either visual feedback, sound, force and tactile feedback (i.e. reflection), smell and even taste.
- the key to immersive realism is the capacity of the user to use his/her hand to interactively manipulate virtual objects.
- Unfortunately the majority of existing commercial virtual reality systems use hand-sensing devices that provide no haptic feedback. Nevertheless, some efforts have been made to provide means for presenting force and tactile information to the user's hand.
- force information it is meant the application of a set force to a selected part of the hand, for example, a finger.
- tactile information it is meant the application of a stimuli, e.g., a vibration, to a selected part of the hand, e.g., a fingertip pad.
- a stimuli e.g., a vibration
- This stimulus could simulate surface texture or dynamic conditions at the contact, for example.
- a few examples of existing force reflecting devices are the EXOS SAFiRETM, the Master II Hand Master device at Rutgers university, the PERCRO Force-Reflecting Hand Master and the Sarcos TOPS Force-Reflecting Hand Master.
- Some tactile feedback devices that have been developed include the PERCRO Position-Sensing and Tactile Feedback Hand Master and the EXOS TouchMasterTM.
- Virtual reality is not the only field where it is desirable to feed back force and tactile information to a human user/operator.
- Another common area is telerobotics.
- Some of the devices mentioned above are also often used as telerobotics interfaces.
- Some examples in the literature of feedback devices designed more specifically for telerobotics include the tactile shape sensing and display system developed by Kontarinis et al., the voice-coil based tactile feedback device used by Patrick et al. and the pin-based tactile display array developed by Kaczmarek and Bach-y-rita.
- Other applications for a vibrotactile unit of the subject invention include, but are not limited to, gesture recognition, music generation, entertainment and medical applications.
- An object of the invention is a man-machine interface which may be employed in such areas as interactive computer applications, telerobotics, gesture recognition, music generation, entertainment, medical applications and the like.
- Another object of the invention is a mass which is moved by a “mass-moving actuator” which generates a vibration that a user can feel.
- Yet another object of the invention is the generation of an activating signal to produce the vibrations either as a result of the user's state or as a result of environmental conditions, whether virtual or physical.
- Still another object of the invention is vibrating the bone structure of a sensing body part, as well as skin mechanoreceptors, to provide feedback.
- Yet still another object of the invention is the complex actuation of vibratory devices.
- the vibrotactile device comprises a mass connected eccentrically to a mass-moving actuator shaft (i.e. the center of mass of the mass is offset from the axis of rotation). Energizing the mass-moving actuator causes the shaft to turn, which rotates the eccentric mass. This rotating mass causes a corresponding rotating force vector. A rapidly rotating force vector feels to the user as a vibration. A slowly rotating force vector feels like a series of individual impulses. For a small number of rapid rotations, the rotating force vector feels like a single impulse.
- vibration a change in force vector (i.e., direction or magnitude).
- vibrations include, but are not limited to a single impulse, a sinusoidal force magnitude, and other functions of the force vector.
- tactile sensation to refer to the feeling perceived by a user when their sensing body part experiences vibrations induced by a vibrotactile unit.
- a signal processor interprets a state signal and produces an activating signal to drive the mass-moving actuator.
- the variable components of the state signal may be physical (e.g., measured), or virtual (e.g. simulated, or internally generated); they may vary with time (e.g., the state variables may represent processes); and they may be integer-valued (e.g., binary or discrete) or real-valued (e.g., continuous).
- the signal processor may or may not comprise a computer which interprets and further processes the state signal.
- the signal processor comprises a signal driver which produces an activating signal supplying power to, or controlling the power drawn by, the vibrotactile unit.
- the power may be, but is not restricted to, electric, pneumatic, hydraulic, and combustive types.
- the driver may be, but is not restricted to, an electric motor controller comprising a current amp and sensor for closed loop control, a flow valve controlling the amount of a pressurized fluid or gas, a flow valve controlling the amount of fuel to a combustion engine and the like.
- an electric motor controller comprising a current amp and sensor for closed loop control, a flow valve controlling the amount of a pressurized fluid or gas, a flow valve controlling the amount of fuel to a combustion engine and the like.
- the state signal may be generated in response to a variety of conditions.
- one or more sensors measuring physical conditions of the user and/or the user's environment may generate one or more components of a physical state signal.
- a computer simulation may determine the one or more components of a virtual state signal from a simulated (e.g., virtual) state or condition.
- the virtual state may optionally be influenced by a physical state.
- the virtual state includes anything that a computer or timing system can generate including, but not restricted to, a fixed time from a previous event; the position, velocity, acceleration (or other dynamic quantity) of one or more virtual objects in a simulation; the collision of two virtual objects in a simulation; the start or finishing of a computer job or process; the setting of a flag by another process or simulation; combinations of situations; and the like.
- the virtual state signal is a machine-readable measurement of the virtual state variables.
- the physical state signal is measured from physical state variables. These variables have relevance to the physical state of a body part of the user or the user's physical environment.
- the physical state variables includes any measurable parameter in the environment or any measurable parameter relating to a body part of the user. Some examples of measurable physical parameters in an environment include but are not restricted to, the state of a body part, the position of objects in the environment, the amount of energy imparted to an object in the environment, the existence of an object or objects in the environment, the chemical state of an object, the temperature in the environment, and the like.
- the state of a body part may include the physical position, velocity, or acceleration of the body part relative to another body part or relative to a point in the environment.
- the state of a body part may also include any bodily function, where the measured state signal may include the output from an electroencephalograph (EEG), electrocardiograph (ECG), electromyograph (EMG), electrooptigraph (EOG) or eye-gaze sensor, and sensors which measure joint angle, heart rate, dermal or subdermal temperature, blood pressure, blood oxygen content (or any measurable blood chemical), digestive action, stress level, voice activation or voice recognition, and the like.
- EEG electroencephalograph
- ECG electrocardiograph
- EMG electromyograph
- EOG electrooptigraph
- eye-gaze sensor sensors which measure joint angle, heart rate, dermal or subdermal temperature, blood pressure, blood oxygen content (or any measurable blood chemical), digestive action, stress level, voice activation or voice recognition, and the like.
- the user's voice may constitute a measured physical state variable, where his spoken words are sensed and/or recognized to generate a corresponding activating signal.
- the physical state signal is a machine-readable measurement of the physical state variables.
- the state signal is presented to the signal processor which interprets the state, and then determines how and when to activate the vibrotactile units accordingly.
- the signal processor produces an activating signal which may be in response to an event it interprets from the state signal. Examples of events include contact, gestures, spoken words, onset of panic or unconsciousness, and the like.
- the interpretation of the state signal may or may not be a binary event, i.e. the simple changing of state between two values. An example of a binary event is contact vs. non-contact between two virtual or real objects.
- the process of interpreting may include any general function of state variable components.
- the interpretation function may produce an output control value which is integer or real-valued.
- a non-binary-valued interpretation output typically relates to the signal processor producing a non-binary activation signal.
- the type of feedback that the vibrotactile device generates may also be varied.
- the device may generate a complex tactile sensation, which is defined to be a non-binary signal from a single or multiple vibrotactile units.
- complex tactile sensations include (1) varying the amplitude of vibration with a profile which is non-uniform over time; (2) varying the frequency of vibration; (3) varying the duration of impulses; (4) varying the combination of amplitude and frequency; (5) vibrating two or more vibrotactile units with a uniform or non-uniform amplitude profile; (6) sequencing multiple vibrotactile units with different amplitude or frequency profiles; and the like.
- the frequency and amplitude of the vibration or impulse may be changed by modifying the activating signal to the mass-moving actuator.
- the frequency and amplitude may also be controlled by increasing the mass or by changing the radius of gyration (e.g. changing its eccentricity).
- the mass may be changed by pumping fluid into an eccentrically rotating container.
- the sense of frequency that the user perceives may be changed independently of the amplitude by modulating the power to the vibrotactile unit at a variable frequency. This technique is called amplitude modulation, which is common knowledge to those skilled in the art. This change in frequency and amplitude may be used to convey complex, compound or other forms of information to the user.
- Sensors may be mounted on the vibrotactile unit or the sensing body part to determine the frequency and amplitude of vibration sensed by the user.
- a feedback control loop may be added which uses this information to more tightly control the frequency and amplitude, or to reach peak efficiency at the resonant frequency of the collective vibrating device-body system.
- Examples of a sensing body part on which the vibrotactile unit may be mounted, or in functional relation to the vibrotactile unit include, but are not limited to: the distal part of a digit, the dorsal (back) side of a phalanx or metacarpus, palm, forearm, humerus, underarm, shoulder, back, chest, nipples, abdomen, head, nose, chin, groin, genitals, thigh, calf, shin, foot, toes, and the like.
- a plurality of vibrotactile units may be disposed on or near different sensing body parts, and may be activated in unison or independently.
- Each vibrotactile unit may be affixed to the body by a fastening means.
- the fastening means is defined to be the means of attaching the vibrotactile unit to a sensing body part, transmitting (and possibly modifying) the vibrations created by the vibrotactile unit.
- This means may be one that is flexible such as a strap made of cloth or soft polymer, or rigid, such as metal or hard polymer which grabs or pinches the flesh, skin or hair.
- the fastening means may also include gluing or taping to the skin or hair, or tying with a string or rope around a limb, or attaching to clothes with Velcro® or similarly functional means.
- a vibrotactile unit may also be attached to another structure which is then attached to the body part with the same means just mentioned.
- the vibrations generated by the actuator may be transmitted to the sensing body part by the structure (rigid or non-rigid), or through a linkage transmission or a fluid transmission.
- the eccentric mass need not be mounted directly onto a motor shaft.
- a mechanical transmission may rotate the mass on a different shaft than the motor shaft.
- the mass-moving actuator rotates this shaft.
- Fluids such as air and liquids may also transmit the motion from a power source to the rotating eccentric mass.
- Changing magnetic fields may also be employed to induce vibration of a ferrous mass.
- state signals may relate to a physical or virtual state.
- the subject invention includes a state measurement sensor which produces a state signal.
- This state measurement sensor may measure some property of the sensing body part.
- the sensing body part the body part associated with receiving the vibrotactile stimulation
- the body part associated with producing the activating signal is called the measured body part.
- the signal processor may receive signals from this sensor such as a tactile, position, bend, velocity, acceleration or temperature sensor and generate an activating signal.
- the user may receive feedback based on his actions or physical state.
- the vibrotactile device may be used to train the user to do some physical motion task.
- the position or motion of the body part which is to do the motion task is measured by the state measurement sensor and is also the sensing body part.
- Direct stimulation to the body part being trained enhances the training of the task.
- Complex actuation in the form of a function of different levels of frequency or amplitude may inform the user whether his actions are correct or incorrect; the level of correctness may correspond to the level of frequency or amplitude.
- the sensing body part (which is also the measured body part) may have a graphical representation shown to the user.
- the user may also be presented with visual, auditory, taste, smell, force and/or temperature cues to his actions in combination with the vibrotactile cues provided by the subject invention.
- the user may be immersed in a virtual environment.
- the user may see a graphical representation of his/her body part interact with virtual objects and simultaneously feel a corresponding tactile sensation simulating the interaction.
- a user may have his/her fingers be the sensing and measured body parts.
- the user may then see his/her virtual hand in the virtual environment contact a virtual object.
- the user would then feel an increasing vibratory stimulation on his/her physical fingertip as he increased the virtual pressure on the virtual object using the virtual fingertip.
- a user may receive tactile sensations based on the state of his body parts.
- the state included the position, and other dynamic quantities, of the body parts.
- the measured body part is the same as the sensing body part (the list of possible sensing body parts mentioned earlier also applies to measured body parts); in other applications they are different body parts.
- the subject invention acts as a coupling device which relates the sensing body part and the measured body part.
- the user may receive tactile feedback as a result of the conditions of a computer simulated environment, not necessarily related to the user's actions or state.
- the vibrotactile units with varying actuation levels may be used to simulate a variety of contact situations, e.g., contact with fluids and solids, and contacts which are momentary or continuous.
- a user immersed in a computer simulated virtual environment may feel simulated fluid (like air or water) across his body.
- an array of vibrotactile units may vibrate in sequence to correspond to a pressure wave hitting the corresponding parts of the body; the amplitude of the vibration may vary to correspond to different levels of pressure being simulated.
- a user may also feel a virtual object that comes into contact with a portion of his virtual body.
- the user may feel a virtual bug crawl up his virtual arm by sequencing an array of vibrotactile units.
- the user may be presented with visual, auditory, taste, smell, force, temperature and other forms of feedback in order to enhance the realism of the simulated environment.
- a group of users may receive tactile sensations.
- users may wear individual vibrotactile units, or they may also share vibrotactile units as follows.
- a tactile sensation may be shared by one or more users making physical contact with the sensing body part of another user.
- one user may wear vibrotactile units on the backs of his fingers.
- a second user not wearing any vibrotactile units, may obtain vibrotactile feedback transmitted via the first user when the first user places the palmar side of his fingers on a sensing body part of the second user.
- the activating signal for each vibrotactile unit may be computer controlled via either user's actions or through a computer simulated event.
- a group of users may each receive identical tactile feedback through individually mounted vibrotactile units.
- the common activating signal may correspond to measured body parts from a single, optionally separate, user.
- Different users may also be responsible for producing the common activating signal for one or more vibrotactile units. For instance, the movement of one user's arm may control the vibrotactile unit on each user's arm; and the voice of a second user may control the vibrotactile unit on each user's back; the eye-gaze of three other users may control the vibrotactile unit upon which they stare in unison.
- An example application of a single user controlling many user's vibrotactile sensations is a new form of entertainment where a performer creates vibrotactile sensations for an audience.
- the vibrotactile units are affixed to an instrumented glove, such as the CyberGloveTM manufactured by Virtual Technologies of Palo Alto, Calif., USA.
- the CyberGlove has sensors in it which measure the angles of the joints of the hand.
- the fingertips of the CyberGlove are open so that the user may reliably handle physical objects while wearing the glove.
- the open fingertips allow the user to feel the sensations of real objects in conjunction with the generated vibrotactile sensations.
- the fingertips need not be open, they may be fully enclosed as in the 22-sensor model of the CyberGlove.
- each vibrotactile unit is encased in a cylindrical housing and mounted onto the glove on each of the fingers and thumb, and on the palmar side of the hand.
- Each mass-moving actuator is composed of a small DC motor with an eccentric mass mounted rigidly onto the shaft of the motor.
- the casing is made of tubular plastic and serves to protect the motion of the mass from the user and protect the user from the rotating mass.
- the casing may be made of any rigid or semi-rigid material including but not limited to steel, aluminum, brass, copper, plastic, rubber, wood, composite, fiberglass, glass, cardboard, and the like.
- the casing may form a solid barrier, a wire-mesh, grid or column-like support capable of transmitting vibrations from the mass-moving actuator to the fastening means.
- the instrumented glove informs a computer of the position of the user's hand and fingers.
- the computer which is part of the signal processor, then interprets this hand state signal (and any virtual state signal if the application calls for it).
- the computer then generates a control signal, which when processed by the driver, activates the actuators to create tactile sensations.
- One feature of the embodiment of the subject invention just described, which employs an eccentric mass, is that the energy imparted into the system can be less than the energy required when using electromagnetic coils (such as the speaker voice coils used by Patrick et al. and the EXOS TouchMaster). Energy is stored as rotational inertia in the eccentric mass, whereas the voice-coil-based systems lose all inertial energy each time the coil change directions.
- electromagnetic coils such as the speaker voice coils used by Patrick et al. and the EXOS TouchMaster
- Another feature of the subject invention is that vibrating the bone structure of a body part, as well as skin mechanoreceptors, has an advantage over stimulating just the skin mechanoreceptors (such as Meissner, Merkel, Ruffini and Pacinian corpuscles) in that the nerves do not get easily overstimulated and do not become numb.
- the form of information to the user is closer to a physical contact sensation where the muscles and joints are stimulated, as is done by full force feedback systems.
- the vibrotactile units need not be attached to a body part which has sensitive skin mechanoreceptors.
- a vibrotactile unit may be attached to a fingernail or an elbow.
- actuation of vibrotactile units can approximate the sensation of touching physical objects as full force feedback devices do.
- the deep impulsive sensation in the muscles and joints generated by the vibrotactile units simulates the change in proprioceptive state as the user touches a virtual object.
- the subject invention provides numerous advantages over a sustained force feedback device. For example, because of its simplicity, the vibrotactile device of the subject invention can be made smaller, lighter, less encumbering, more robustly and cheaper.
- the subject invention may be used in combination with a sustained force feedback device as provided by Kramer in U.S. Pat. No. 5,184,319, Kramer in U.S. patent application Ser. No. 08/373,531 (allowed), Zarudiansky in U.S. Pat. No. 4,302,138, Burdea in U.S. Pat. No. 5,354,162, and Jacobus in U.S. Pat. No. 5,389,865. These patents and patent applications are incorporated herein by reference. Such a combination can give a higher frequency response than that capable of being generated by the sustained force feedback device and/or to reduce the cost and/or size of the full system.
- the subject invention may also be used in combination with other tactile feedback devices such as heating or cooling devices, bladder devices or voice coils.
- FIG. 1 a is a perspective view of an electric mass-moving actuator with an eccentric mass attached to its shaft.
- FIG. 1 b is a perspective view of a mass-moving linear actuator with a mass attached to its shaft.
- FIGS. 2 a and 2 b are a cross-sectional side view and a perspective view respectively of an example of a vibrotactile unit.
- FIG. 3 is a perspective view of the vibrotactile unit shown in FIG. 2 b where the vibrotactile unit is attached to the palmar side of the fingertip.
- FIG. 4 is another perspective view of a vibrotactile unit attached to the dorsal side of the fingertip, where it makes contact with the nail.
- FIG. 5 is a perspective view of a vibrotactile unit attached to the dorsal side of the proximal phalanx.
- FIG. 6 is a perspective view of a vibrotactile unit attached to the palm of the hand
- FIG. 7 is a perspective view of a vibrotactile unit attached to the dorsal side of the metacarpus (the back of the hand).
- FIG. 8 is a perspective view of a vibrotactile unit attached to the top of the foot.
- FIG. 9 is a side view of a multitude of vibrotactile units attached to a variety of places on the head.
- FIGS. 10 a and 10 b are front and back views respectively, of a multitude of vibrotactile units attached to a variety of places on the body.
- FIGS. 11 a and 11 b are perspective and front views respectively of a fastening means where the palmar side of the fingertip receives greater stimulation without the vibrotactile unit getting in the way of manipulation.
- FIGS. 12 a and 12 b are perspective and front views respectively of a fastening means where the palmar side of the fingertip receives greater stimulation without the vibrotactile unit getting in the way of manipulation.
- FIG. 13 is a perspective view of a fastening means where no casing is required for the vibrotactile unit because the moving mass is mounted away from the finger thus reducing the possibility of interference.
- FIG. 14 is a side view of an another fastening means where no casing is required for the vibrotactile unit because the moving mass is mounted away from the finger thus reducing the possibility of interference.
- FIG. 15 is a perspective view of a fastening means where the vibrotactile unit is attached to the body via a spring that is used to alter the amplitude and frequency of the sensed oscillations.
- FIGS. 16 a , 16 b and 16 c are front schematic views and 16 d is a perspective view of a vibrotactile unit where the radius of the gyration of the eccentric mass increases as the angular velocity of the shaft increases.
- FIGS. 16 a , 16 b , and 16 c illustrate the principle, where w 2 >w 1 >0.
- FIG. 17 is a schematic electrical-mechanical signal propagation diagram.
- FIGS. 18 a and 18 b show an instrumented glove, in this case the Virtual Technologies CyberGloveTM, with both position sensors and vibrotactile units.
- FIGS. 19 a and 19 b show schematically two applications using a sensing glove with vibrotactile units attached to the fingers and back of the hand.
- FIG. 19 a shows a virtual reality application.
- FIG. 19 b shows a telerobotic application.
- FIG. 20 illustrates schematically an example of a virtual environment with separate sensing and measured body parts.
- FIGS. 21 a and 21 b are perspective drawings showing two applications of the invention for gesture recognition.
- the gesture is static and in FIG. 21 b , the gesture is dynamic (the index finger is moving in a pre-determined fashion).
- FIG. 22 is a schematic drawing showing a musical application.
- FIG. 23 is a schematic drawing showing an entertainment or relaxation application.
- FIG. 24 is a schematic drawing showing a medical application.
- FIGS. 25 a , 25 b and 25 c are a schematic drawings illustrating an amplitude decoupling method.
- FIG. 26 a is a perspective drawing and FIG. 26 b is a side view of a vibrotactile unit with a controllable eccentricity.
- FIG. 26 c is an alternative transmission method that can be used to control the eccentricity of the mass.
- FIG. 27 is an exemplary diagrammatic view of an application comprising the vibrotactile device, a virtual simulation and a physical simulation.
- FIG. 1 a shows one embodiment of a vibrotactile unit obtained by attaching an eccentric mass ( 101 ) to the shaft ( 102 ) of a small d.c. electric motor ( 100 ) which serves as the mass-moving actuator.
- the mass is pie-shaped, however any other shape which offsets the center of gravity from the axis of rotation, and thus provides eccentricity, may be used. This eccentricity causes the force vector to change directions during rotation and thus induces vibrations in the unit.
- the mass may be made of any material like steel, aluminium, plastic or fluid encased in a container, to name a few.
- FIG. 1 b shows another embodiment of a vibrotactile unit obtained by attaching a mass ( 103 ) to the shaft ( 104 ) of a linear mass-moving actuator ( 105 ).
- the mass is disk-shaped, however any other shape may be used.
- the linear actuator moves the mass back and forth and thus induces vibrations in the unit by suddenly accelerating and decelerating it.
- the mass may be made of any material like steel, aluminium, plastic or fluid encased in a container, to name a few.
- FIG. 2 a and FIG. 2 b are cross-sectional and perspective drawings respectively of an example of a casing ( 200 ) in which a mass-moving actuator ( 202 ) and a mass ( 201 ) are contained.
- the eccentric mass ( 201 ) is attached to the shaft ( 204 ) of the electric motor.
- the casing has a hole for the motor leads ( 203 ) to escape.
- the casing protects the moving mass from being disturbed by the user. It also protects the user from being hit by the mass.
- the casing may be made from any rigid material, or variety of materials, such as aluminum, steel, plastic, glass, glass fiber composite etc.
- FIG. 3 illustrates one fastening means for attaching the vibrotactile unit to a finger.
- the vibrotactile unit ( 300 ) is attached directly to the palmar side of the fingertip using a fastening means ( 301 ).
- the fastening means may be made of either flexible material, such as cloth, fabric, tape, Velcro® or a soft polymer, or it may be made of a rigid material such as a metal, hard polymer or wood, to name a few.
- the fastening means need not encircle the finger entirely, it may grab the finger by clamping or pinching, or by sticking to it such as with glue or tape.
- the vibrotactile unit may also be sewn onto the glove or bonded to it and need not be affixed directly to the hand. This will also be the case in the following figures which illustrate various ways to position the vibrotactile unit on the human body.
- FIG. 4 illustrates another way of mounting the vibrotactile unit ( 400 ) onto the finger using a fastening means ( 401 ).
- the unit is positioned directly above the fingernail on the dorsal side of the fingertip (the sensing body part) in order to provide a distinctive tactile sensation, or vibratory stimulus.
- the unit may vibrate the nail, the flesh underneath and the bone with sufficient amplitude that the sensation is felt throughout the finger, not just locally at the skin.
- FIG. 5 illustrates another way of mounting the vibrotactile unit ( 500 ) onto the finger using a fastening means ( 501 ).
- the unit is positioned on the dorsal side of the proximal phalanx. Since the unit gives sensation throughout the entire finger, touching virtual objects with the palmar side of the hand will still give sensations to that side even though it is mounted on the back. When used in conjunction with manipulating physical objects with the palmar side, the vibrational sensation on the palmar side is enhanced.
- These features are not limited to the proximal phalanx. Mounting to the dorsal side of any phalanx or limb will produce the same effect.
- FIG. 6 illustrates another way of mounting the vibrotactile unit ( 600 ) onto the user using a fastening means ( 601 ).
- the unit is positioned in the palm of the user's hand. If a glove (instrumented or not) is worn, then the unit may also be mounted inside or outside of the glove in a pocket-like cavity, and need not be explicitly affixed to the hand.
- FIG. 7 illustrates another way of mounting the vibrotactile unit ( 700 ) onto the user using a fastening means ( 701 ).
- the unit is positioned on the dorsal side of the metacarpus, or the back of the hand.
- the unit may also be mounted inside or outside of the glove in a pocket-like cavity, and need not be explicitly affixed to the hand.
- FIG. 8 illustrates another way of mounting the vibrotactile unit ( 800 ) onto the user using a fastening means ( 801 ).
- the unit is positioned on the top of the user's foot. If a sock-like garment (instrumented or not) is worn, then the unit may also be mounted inside or outside of the garment in a pocket-like cavity, and need not be explicitly affixed to the foot.
- FIG. 9 illustrates another way of mounting vibrotactile units ( 900 ) onto the user.
- the units are positioned on the user's head. If a hat-like garment (instrumented or not) is worn, then the units may also be mounted inside or outside of the suit in pocket-like cavities, and need not be explicitly affixed to the body. Examples of locations include, but are not limited to, the temples ( 900 ), the forehead ( 901 ), the top of the head ( 902 ) and the back of the head ( 903 ).
- FIG. 10 a illustrates another way of fastening vibrotactile units ( 1000 - 1012 ) onto the user.
- the units are positioned all over the front and the side of the user's body. If a body suit (instrumented or not) is worn, then the units may also be mounted inside or outside of the suit in pocket-like cavities, and need not be explicitly affixed to the body.
- the perception of the localization of the tactile sensation may be controlled. For example, if the actuators on the forearm ( 1007 ) and on the humerus ( 1005 ) actuate with equal intensity, the user may have the perception that there is a single source of sensation originating in-between the two.
- Some of these positions include, but are not limited to, the forehead ( 1000 ), the shoulders ( 1001 ), the side of the arm ( 1003 ), the humerus ( 1005 ), the chest ( 1002 ), the nipples ( 1004 ), the abdomen ( 1006 ), the forearm ( 1007 ), the groin ( 1008 ), the hips ( 1009 ), the thighs ( 1010 ), the knees ( 1011 ) and the shins ( 1012 ).
- FIG. 10 b illustrates another way of fastening vibrotactile units ( 1020 - 1028 ) onto the user.
- the vibrotactile units are positioned all over the back of the user's body. If a body suit (instrumented or not) is worn, then the vibrotactile units may also be mounted inside or outside the body suit in pocket-like cavities, and need not be explicitly affixed to the body.
- the vibrotactile units displayed in the figure show examples of a variety of candidate positions for attaching the units to the body.
- Some of these positions include, but are not limited to, the back of the head ( 1020 ), the base of the neck ( 1021 ), between the shoulder blades ( 1022 ), the back of the humerus ( 1023 ), the back of the forearm ( 1025 ), the lower back ( 1024 ), the buttocks ( 1026 ), the back of the thighs ( 1027 ) and the calves ( 1028 ).
- the vibrotactile units in FIG. 10 b may be combined with those in FIG. 10 a as well. This plurality of vibrotactile units shows one way that complex tactile sensations may be generated with multiple vibrotactile units.
- FIGS. 11 a and 11 b show a vibrotactile unit mounted in such a way that the fingertip may be stimulated without the unit getting in the way of manipulation with the fingers.
- FIG. 11 a shows a perspective view of the invention and
- FIG. 11 b shows a frontal view.
- a structure ( 1102 ) which may be opened or closed at the end, surrounds the fingertip.
- the fastening means is comprised of three parts: part one affixing the finger to the structure; part two affixing the vibrotactile unit to the structure; part three is the structure ( 1102 ).
- Part one of the fastening means ( 1103 ) which can be a flexible or rigid membrane, holds the finger against the structure on the palmar side of the fingertip.
- This part can be adjustable, fixed, flexible or stretchable.
- the vibrotactile unit ( 1100 ) is mounted atop the structure, away from the palmar side of the fingertip, using a means ( 1101 ) which can be a flexible or rigid membrane. In this manner, the vibrations from the vibrotactile unit may be transmitted through the structure directly to the palmar side of the finger to provide a greater stimulation of the nerves local to the palmar side.
- the structure ( 1102 ) and the vibrotactile unit casing ( 1100 ) can be made of one part, thus eliminating the need for a part two of the fastening means ( 1101 ).
- FIGS. 12 a and 12 b show the vibrotactile unit mounted such that the fingertip can be stimulated without the unit getting in the way of manipulation with the fingers.
- FIG. 12 a shows a perspective view of the invention and
- FIG. 12 b shows a side view.
- a structure ( 1202 ) is attached to the palmar side of the fingertip.
- the fastening means is comprised of three parts: part one, affixing the finger to the structure; part two, affixing the vibrotactile unit to the structure; part three which is the structure ( 1202 ).
- Part one ( 1203 ) may be a flexible or rigid membrane. This part may be adjustable, fixed, flexible or stretchable.
- the vibrotactile unit ( 1200 ) is mounted atop the structure, away from the palmar side of the fingertip, using a means ( 1201 ) which can be a flexible or rigid membrane.
- a means ( 1201 ) which can be a flexible or rigid membrane.
- the structure ( 1202 ) and the vibrotactile unit casing ( 1200 ) can be made of one part, thus eliminating the need for part two of the fastening means ( 1201 ).
- FIG. 13 shows a vibrotactile unit and fastening means where no casing is required for the mass-moving actuator/mass assembly.
- a small rigid or semi-rigid structure ( 1302 ) elevates the vibrotactile unit above the fingertip in such a way that the finger cannot interfere with the rotation of the eccentric mass ( 1301 ) about the main axis of the shaft ( 1304 ) of the mass-moving motor ( 1300 ).
- the structure ( 1302 ) is attached to the fingertip using a strap ( 1303 ) which can be rigid or flexible and which can be either an integral or separate part of the structure.
- FIG. 14 shows another vibrotactile unit and fastening means where no casing is required for the mass-moving actuator/mass assembly.
- a small rigid or semi-rigid structure ( 1404 ) elevates the vibrotactile unit above the middle phalanx in such a way that the finger cannot interfere with the rotation of the eccentric mass ( 1402 ) about the main axis of the shaft ( 1403 ) of the mass-moving actuator ( 1401 ).
- the structure ( 1404 ) is attached to the middle phalanx using a strap ( 1405 ) which can be rigid or flexible and which can be either an integral or separate part of the structure.
- FIG. 15 shows yet another vibrotactile unit ( 1500 ) and fastening means such that the vibrotactile unit is connected to the fingertip via a form of spring ( 1501 ) in order to alter the amplitude and frequency of the perceived vibrations.
- a strap ( 1502 ) which can be a flexible or rigid membrane holds the spring against the fingertip.
- the spring changes the natural frequency of the vibrotactile unit.
- the vibrotactile unit/spring apparatus could be attached below the finger instead of above it.
- the spring may also be replaced by some form of actuator to again control the amplitude and frequency and/or to extend the range of amplitude and frequency.
- a damper may be introduced in combination with the spring or actuation system to further control and/or extend the amplitude and frequency of the perceived vibrations.
- An electro-rheological fluid may used in the damper to control the damping term in the mechanical system.
- FIGS. 16 a , 16 b , 16 c , and 16 d illustrate a modification to the way the eccentric mass is mounted to a shaft.
- the radius of the gyration K of the eccentric mass increases as the angular velocity of the shaft increases.
- the top three drawings ( FIGS. 16 a , 16 b , 16 c ) illustrate the principle, where w 2 >w 1 >0, and the bottom perspective drawing ( FIG. 16 d ) provides an implementation.
- a structure ( 1601 ) is attached the shaft ( 1602 ) of the mass-moving actuator ( 1600 ).
- the structure comprises a spring ( 1604 ) and mass ( 1603 ) assembly.
- the spring is attached to the inside of the structure and at the other end it is attached to the mass.
- the mass is free to move towards and away from the shaft inside a guide in the structure.
- the radius of gyration K is the distance between the center of gravity of the mass ( 1603 ) and the main axis of the mass-moving actuator shaft ( 1602 ).
- This apparatus minimizes the angular inertia of the device at start-up and then gradually increases the eccentricity of the mass so that larger vibrations can be obtained at higher angular velocities.
- the passive spring may be replaced by an active device which controls or sets the radius of gyration of the mass.
- the active device may comprise a shape memory alloy actuator or any other mechanism capable of controlling the position of the mass.
- FIG. 17 shows how the electrical and mechanical signals propagate through the tactile feedback control system in a preferred embodiment of the invention.
- the embodiment shown employs a d.c. servo motor ( 1701 ) as the mass-moving actuator of a vibrotactile unit.
- a computer ( 1707 ), or other signal processing means sends a digital value representing the desired actuation level control signal to the digital-to-analog convert, D/A ( 1703 ).
- the analog output of the D/A is then amplified by a variable gain amplifier ( 1704 ) to produce an analog voltage activation signal. This voltage is placed across the servo motor, driving the motor at a desired angular velocity.
- the voltage signal may alternately be converted to a current activation signal for driving the motor at a desired torque.
- Velocity damping of the servo control loop may be performed by tachometer feedback (not shown).
- the computer ( 1707 ), digital-to-analog converter ( 1703 ), analog-to-digital converter, A/D ( 1702 ), bus ( 1709 ) and variable gain amplifier ( 1704 ) may be elements of a signal processor. Digitized values from A/D ( 1702 ) from analog joint angle sensors ( 1705 ) provide the position information of the fingers (measured body parts) to the computer as a physical state signal. In a virtual environment application, the physical state signal may cause motion in a corresponding virtual hand.
- the computer calculates the virtual force to be applied to the virtual digit using knowledge of the virtual object's shape and compliance. The computer then causes an activation signal to be sent to the vibrotactile units mounted on the user's fingers (sensing body part) to convey tactile information about that virtual force.
- Strain gage, fiber optic, potentiometric, or other angle sensors may be used as analog joint angle sensors ( 1705 ). Strain gage angle sensors are disclosed in the Kramer et al. U.S. Pat. Nos. Nos. 5,047,952 and 5,280,265, which patents are incorporated herein by reference.
- FIG. 18 a and FIG. 18 b illustrate a preferred embodiment of the invention.
- An instrumented glove 1820
- sensors 1807 - 1819
- the fingertips of the glove are open so that the user may handle physical objects while using the glove. This allows the user to feel the tactile sensations of real objects which may then be used in conjunction with tactile sensations generated from the subject invention.
- the vibrotactile units ( 1801 - 1806 ) are encased in cylindrical housings and fastened to the glove on each of the fingers ( 1801 - 1804 ), the thumb ( 1805 ) and on the palmar ( 1806 ) side of the hand.
- the vibrotactile units are composed of a d.c. motor (item 202 in FIG. 2 ) with an eccentric mass (item 201 in FIG. 2 ) mounted onto its shaft (item 204 in FIG. 2 ).
- the casing is made of tubular plastic and serves to protect the motion of the mass from the user and protect the user from the rotating mass.
- FIG. 19 a shows a user wearing a sensing glove ( 1900 ) which can measure hand formations as well as the spatial placement of the hand.
- the sensing glove has vibrotactile units ( 1901 ) fastened to the fingers and to the back of the hand.
- the user receives visual feedback through a graphical representation of his hand on the computer monitor ( 1908 ).
- the computer ( 1904 ) receives the state signal (information about the spatial placement of the user's hand) through the sensors mounted on the glove via a glove sensor interface ( 1902 ).
- the computer sends a control signal to the vibrotactile unit driver ( 1903 ) which then sends the activation signal to the vibrotactile units ( 1901 ).
- FIG. 19 b shows the same glove ( 1900 ) and computer interface remotely controlling a robotic arm ( 1911 ) instead of a graphic display.
- the robot has contact sensors on its gripper ( 1912 ) that detect when the robot touches physical objects ( 1913 ).
- the user controls the robot arm through the sensors on the glove which produce position readings of the fingers (measured body parts) which are sent to the glove interface device ( 1902 ) and then outputted to the computer ( 1904 ) which in turn sends the appropriate commands to the robot.
- Robot position and contact information ( 1910 ) is then fed back to the computer as the state signal.
- the computer interprets this signal and decides what kind of vibrational feedback should be sent to the vibrotactile unit ( 1901 ) (other vibrotactile units not shown) on the user via the vibrotactile unit driver ( 1903 ).
- Force or pressure sensors may be mounted on the gripper instead of contact sensors.
- the user then receives vibrational feedback of varying levels depending on the force or pressure on the object. This allows a teleoperator to perform tasks more efficiently and safely, especially in handling delicate objects that would break under certain grip forces.
- the user does not necessarily need to control the robot or the objects of contact in order to use the tactile feedback.
- the vibrotactile device may act simply to inform the user of contact with the object whether or not as a result of the user's actions.
- FIG. 20 illustrates an embodiment in a virtual reality context where the measured body part ( 2003 ) is the foot, however, the vibrotactile unit ( 2001 ) is mounted on the finger which acts as the sensing body part ( 2002 ).
- the foot has a graphical object ( 2004 ) associated with it in the computer simulation. In this case, the graphical object looks like a foot as well. Motions of the foot are sent to the computer ( 2008 ) via the body sensor interface ( 2006 ) and are reflected on the computer monitor ( 2009 ).
- the computer interprets this state signal and sends a control signal to the vibrotactile unit driver ( 2007 ) to activate the vibrotactile unit ( 2001 ) on the finger.
- This may be due to the user moving his foot so that the graphical foot contacts ( 2005 ) the virtual object, or the virtual object moving into the graphical foot independent of the user's actions.
- the user then needs to correlate the contact of the virtual object with the sensation at the fingertip. While this does not seem as natural as vibrating the foot as it makes contact, this illustrates the sensing body part separate from the measured body part. This is necessary if the measuring body part cannot coincide with the sensing body part, for example if the measured body part is the eye-ball or if the measured body part is on another user.
- FIG. 21 a and FIG. 21 b illustrate a glove ( 2101 ) which contains both position sensors and vibrotactile units ( 2100 ).
- the Virtual Technologies CyberGloveTM is an example of a glove with appropriate position sensors. The sensors measure the spacial placement of the hand and fingers.
- a computer uses gesture recognition software to determine if a pre-specified hand formation or motion has been gesticulated.
- the vibrotactile unit signals the user that a particular static pose has been detected.
- a different vibrotactile sensation can be generated in response to a recognized moving hand or arm gesture that includes dynamic motions ( FIG. 21 b ). This may also be useful in training the gesture recognition software for the gestures to be recognized.
- a user In training the software, a user must repeatedly make the same gesture to obtain some sort of average position since humans cannot repeat gestures exactly. With the vibrotactile feedback, the user may be trained to better repeat his gestures while at the same time training the recognition software to recognize his gestures. Better repetition of the gestures reduces the statistical distribution of the sensor readings for a given hand gesture which in turn may improve the performance of the recognition system.
- FIG. 22 illustrates vibrotactile units in a musical application.
- the units are attached to a body suit or mounted directly onto the user's clothing.
- Different regions on the body ( 2200 - 2210 ), which contain groupings of vibrotactile units ( 2211 ), may correspond to different musical instruments in an orchestra and serve to enhance the musical experience.
- music produced by a cello produces proportional vibrations on the user's thigh ( 2204 ) through the vibrotactile units located in that body region.
- the drums induce vibrations in the units that stimulate the chest area ( 2201 ) and so on.
- Sections of the body containing multiple vibrotactile units corresponding to one instrument type may have individual vibrotactile units corresponding to individual instruments.
- the cello section of the body is shown to have the first chair cello on the upper thigh, and the second chair cello on the lower thigh.
- the user may either be a passive listener “feeling” the instruments as well, or he may be an active participant in creating the music, receiving the vibrotactile sensations as feedback.
- FIG. 23 illustrates an entertainment application.
- an array of vibrotactile units simulates water flow or wind.
- a user is lying on a couch ( 2300 ) and is immersed in a virtual beach scene and sees the beach through a head-mounted display ( 2302 ).
- the user hears ocean sounds through head-mounted earphones ( 2301 ) and feels warmth from the sun through heat lamps ( 2303 ).
- the user then feels wind simulated by the vibrotactile units as they are pulsed in sequence creating “waves” of sensation.
- the wind could flow from head to toes by alternatively pulsing the vibrotactile units starting with the ones on the head ( 2304 ) and ending with the ones on the toes ( 2305 ).
- water is felt as pulsed waves (although perhaps of larger amplitude), as the user swims through the virtual water. In this fashion, the user may be relaxed or entertained.
- FIG. 24 a and FIG. 24 b illustrate a medical application where, for example, a user has injured a knee.
- a vibrotactile unit ( 2401 ) is used in conjunction with bend sensors ( 2400 ) mounted on the knee during physical therapy sessions as shown in FIG. 24 a .
- the vibrotactile unit notifies the user when the knee is exercised appropriately and alerts the user if the knee is flexed further than a safe limit prescribed by a doctor and thus improve recovery as is illustrated in FIG. 24 b .
- the vibrotactile units, in conjunction with other sensors may be used in any biofeedback application.
- FIGS. 25 a , 25 b and 25 c illustrate an approach for decoupling the amplitude and frequency components of the vibrations generated by an eccentric mass-based vibrotactile unit.
- the vibrotactile unit comprises a rotary electric motor ( 2501 ), a mass mounted eccentrically ( 2500 ), a sensor ( 2503 ) mounted on the shaft ( 2502 ) to determine the angular position of the shaft and a closed-loop control system.
- Any other control law may be used that achieves a single rotation of the shaft.
- FIG. 26 a is a perspective drawing and FIG. 26 b is a side view of a vibrotactile unit with controllable eccentricity.
- a structure such as a slip-disk ( 2602 ), is mounted on the shaft ( 2601 ) and is free to slide back and forth along the shaft.
- the slip-disk is attached to a linkage ( 2605 ) which connects it to the eccentric mass ( 2604 ).
- a positioning device ( 2603 ) controls the position of the slip-disk on the shaft, which in turn affects the position of the mass (via the linkage) and thus its eccentricity.
- FIG. 26 c is an alternative transmission method that can be used to control the eccentricity of the mass.
- FIG. 26 c is an alternative transmission method that can be used to control the eccentricity of the mass.
- the transmission comprises element ( 2606 ), which may be a flexible membrane or fluid inside a hollow shaft ( 2601 ) that is connected to the eccentric mass ( 2604 ) at one end and the sliding slip-disk ( 2602 ) at the other. Again, controlling the position of the disk along the shaft using the positioning device ( 2603 ) affects the eccentricity of the mass.
- Element 2606 may also be a fluid and 2604 a hollow container. As the fluid is forced through the tube ( 2601 ) by the slip-disk ( 2602 ), or by some other pressure generating means, the container ( 2604 ) is filled with the fluid, thus, increasing the effective radius of gyration of the center of mass of the fluid. By increasing the radius of gyration, by whichever means, it is possible to independently control the amplitude and frequency of vibration of the vibrotactile unit.
- FIG. 27 provides an exemplary block diagram of the components and functional relationship between the components comprising the vibrotactile device when used in an application. Although some components are shown interrelated with a unidirectional arrow, the arrows may be bidirectional to provide bidirectional flow of information. Additional arrows may be added between blocks to provide for communication between components.
- An application may include presenting vibrotactile sensation to a body part of a user, where the vibrotactile sensation is associated with a virtual environment simulation (virtual simulation) and/or the physical state of a body (physical simulation), which may be the user's body, or another person's body.
- One or more virtual simulations may co-exist with one or more physical simulations, and may be combined with further types of simulations to yield a vibrotactile sensation.
- the exemplary virtual simulation ( 2722 ) of FIG. 27 comprises a computer ( 2706 ) with computer monitor ( 2709 ).
- the computer typically generates, processes, executes or runs a computer simulation ( 2705 ) which is typically in the form of a computer software program.
- the computer produces a graphical display of a virtual measured body part on the monitor, where the body part is shown to be a fingertip ( 2707 ) on a virtual hand ( 2708 ).
- the virtual simulation may internally generate an internal state with a variety of state variables which comprise a virtual state signal ( 2703 ) to provide to a signal processor ( 2700 ).
- Exemplary virtual state variables include position, velocity, acceleration, mass, compliance, size, applying force or torque, composition, temperature, moisture, smell, taste and other dynamical, structural, physical, electrical metabolical, moodal, cognitive, biological and chemical properties of various portions internal to, and on the surface of, a virtual measured body part.
- States variables may also denote functions of state variables, such as contact of various parts of the virtual hand.
- FIG. 27 also provides an exemplary physical simulation ( 2723 ) comprising a state sensor ( 2718 ) and a physical measured body part ( 2717 ).
- the physical measured body part is depicted as a fingertip ( 2717 ) on a physical hand ( 2716 ).
- the state sensor measures the physical state ( 2719 ) of the physical measured body part and produces a physical state signal ( 2720 ) to provide to the signal processor ( 2700 ).
- the physical state signal ( 2720 ) is optionally provided to the computer ( 2706 ) and/or computer simulation ( 2705 ) of a virtual simulation ( 2722 ).
- Exemplary physical state variables include position, velocity, acceleration, mass, compliance, size, applying force or torque, composition, temperature, moisture, smell, taste and other dynamical, structural, physical, electrical, metabolical, moodal, cognitive, biological and chemical properties of various portions internal to, and on the surface of, a physical measured body part. States variables may also denote functions of state variables, such as contact of various parts of the physical hand.
- the signal processor ( 2700 ) receives a state signal and produces an activating signal ( 2704 ).
- the state signal is the virtual state signal ( 2703 );
- the state signal is the physical state signal ( 2720 ).
- both a virtual state signal and a physical state signal may be presented to the signal processor.
- the signal processor may employ a digital or analog computer ( 2701 ) to interpret one or more input state signals (e.g., a virtual or physical state signal) and produce a control signal ( 2721 ) which becomes the input signal to a driver ( 2702 ). Using the control signal, the driver produces the activating signal ( 2704 ). When the computer is absent from the signal processor, the driver determines the activating signal from the state signal or signals. Whether or not the computer is present in the signal processor, the activating signal is provided in a form for use by the mass-moving actuator ( 2710 ).
- the driver may comprise a motion control module, an operational amplifier, a transistor, a fluidic valve, a pump, a governor, carburetor, and the like.
- the activating signal may be a voltage or current with sufficient electrical power or current drive to cause the motor to turn.
- the mass-moving actuator ( 2710 ) is shown to be an electric motor which turns a shaft ( 2712 ) and an eccentric mass ( 2711 ). As the mass is rotated, the entire assembly of 2710 , 2711 and 2712 vibrates, producing vibrations ( 2713 ). Such vibrations are transmitted to a sensing body part of a user who perceives a tactile sensation.
- the sensing body part is exemplified as the fingertip ( 2715 ) of a hand ( 2714 ).
- a fingertip of a physical hand corresponds to both the sensing body part ( 2715 ) and the physical measured body part ( 2717 ).
- An instrumented glove optionally comprising a joint angle sensor and spatial position sensor, produces a physical state signal ( 2720 ) corresponding to the position of the physical fingertip.
- the fingertip position is provided via a wire (e.g., electrical or optical), computer bus or other electrical or optical connecting means to a computer ( 2706 ) running a computer simulation ( 2705 ) in software.
- the fingertip position is often provided in the form of digital values, typically as joint angles and/or values corresponding to the six possible spatial degrees of freedom.
- the fingertip position may also be in the form of an analog voltage.
- the computer simulation uses the physical state signal ( 2720 ) corresponding to the physical fingertip position ( 2719 ) to simulate the position and motion of a virtual hand ( 2708 ) and fingertip ( 2707 ).
- the computer simulation displays the virtual hand on a computer monitor ( 2709 ), in addition to displaying a second virtual object whose attributes may correspond to a second physical measured object, such as a block, ball, car interior, engineering part, or other object.
- the computer monitor may be a desk-top monitor, head-mounted monitor, projection monitor, holographic monitor, or any other computer generated display means.
- the second physical measured object may also be a body part of the user or a second user.
- the computer simulation detects a level of virtual contact between the virtual fingertip ( 2707 ) and the second virtual object.
- the computer simulation then produces a virtual state signal ( 2703 ) where one state variable denotes the level (e.g., amount of force) of the virtual contact of the virtual fingertip.
- the virtual state signal is transmitted to the signal processor ( 2721 ) via a wire (e.g., electrical or optical), computer bus or other electrical or optical connecting means.
- the signal processor may exist in the computer ( 2706 ), in which case the virtual state signal is typically transmitted via the computer bus. When the signal processor exists in a separate enclosure from the computer, the virtual state signal is typically transmitted via a wire.
- the signal processor may convert the state variable level of virtual contact into an activating signal voltage proportional to the level of virtual contact force using a digital-to-analog converter followed by an operational amplifier.
- the voltage is presented to the mass-moving actuator ( 2710 ) typically by a wire (e.g., electrical or optical) or other electrical or optical connecting means.
- the mass-moving actuator may be a variable speed electric motor which spins eccentric mass ( 2711 ) on its shaft ( 2712 ).
- the electric motor with eccentric mass are housed in a plastic housing or casing which is affixed to the dorsal portion of the instrumented glove surrounding the fingertip, which fingertip corresponds to both the physical measured body part and the sensing body part.
- the affixing is typically done with straps, sewing, gluing and the like.
- the electric motor, mass, casing and sensing body part all vibrate, typically at a common frequency.
- there is little vibrational attenuation between the mass and the sensing body part such that as the eccentric mass rotates, the electric motor, mass, casing and sensing body part all vibrate with the same amplitude.
- the user may perceive a cause-and-effect relationship between motion of his fingertip and the level of vibration he feels.
- the position, compliance, mass, shape and other attributes of a virtual object may be detected by movement of the user's fingertip, or by movement of the virtual object, inducing various vibrotactile responses.
- the vibrotactile device of the subject invention promotes a sensation of immersion in a virtual environment where the user is able to interact with virtual objects as if he were interacting with physical objects in a physical environment.
Abstract
A man-machine interface which provides tactile feedback to various sensing body parts is disclosed. The device employs one or more vibrotactile units, where each unit comprises a mass and a mass-moving actuator. As the mass is accelerated by the mass-moving actuator, the entire vibrotactile unit vibrates. Thus, the vibrotactile unit transmits a vibratory stimulus to the sensing body part to which it is affixed. The vibrotactile unit may be used in conjunction with a spatial placement sensing device which measures the spatial placement of a measured body part. A computing device uses the spatial placement of the measured body part to determine the desired vibratory stimulus to be provided by the vibrotactile unit. In this manner, the computing device may control the level of vibratory feedback perceived by the corresponding sensing body part in response to the motion of the measured body part. The sensing body part and the measured body part may be separate or the same body part.
Description
- This application is a continuation of prior application Ser. No. 10/460,157, filed Jun. 16, 2003, which is a continuation application of U.S. application Ser. No. 10/186,342, filed on Jun. 27, 2002, abandoned; which is a continuation of prior U.S. application Ser. No. 09/838,052, filed on Apr. 18, 2001 now U.S. Pat. No. 6,424,333; which is a continuation of prior U.S. application Ser. No. 09/561,782, filed on May 1, 2000 now U.S. Pat. No. 6,275,213; which is a continuation of prior U.S. patent application Ser. No. 09/066,608, filed on Apr. 24, 1998 now U.S. Pat. No. 6,088,017; which is a continuation of U.S. patent application Ser. No. 08/565,102, filed Nov. 30, 1995, abandoned; and all of which are incorporated herein by reference.
- This invention relates to a man-machine interface and in particular to an interface that provides tactile sensation to a user.
- Virtual reality (VR) is an immersive environment which is created by a computer and with which users have real-time, multisensorial interactions. Typically, these interactions involve some or all of the human senses through either visual feedback, sound, force and tactile feedback (i.e. reflection), smell and even taste. The key to immersive realism is the capacity of the user to use his/her hand to interactively manipulate virtual objects. Unfortunately, the majority of existing commercial virtual reality systems use hand-sensing devices that provide no haptic feedback. Nevertheless, some efforts have been made to provide means for presenting force and tactile information to the user's hand. By force information, it is meant the application of a set force to a selected part of the hand, for example, a finger. By tactile information, it is meant the application of a stimuli, e.g., a vibration, to a selected part of the hand, e.g., a fingertip pad. This stimulus, could simulate surface texture or dynamic conditions at the contact, for example. A few examples of existing force reflecting devices are the EXOS SAFiRE™, the Master II Hand Master device at Rutgers university, the PERCRO Force-Reflecting Hand Master and the Sarcos TOPS Force-Reflecting Hand Master. Some tactile feedback devices that have been developed include the PERCRO Position-Sensing and Tactile Feedback Hand Master and the EXOS TouchMaster™.
- Virtual reality is not the only field where it is desirable to feed back force and tactile information to a human user/operator. Another common area is telerobotics. Some of the devices mentioned above are also often used as telerobotics interfaces. Some examples in the literature of feedback devices designed more specifically for telerobotics include the tactile shape sensing and display system developed by Kontarinis et al., the voice-coil based tactile feedback device used by Patrick et al. and the pin-based tactile display array developed by Kaczmarek and Bach-y-rita. Other applications for a vibrotactile unit of the subject invention include, but are not limited to, gesture recognition, music generation, entertainment and medical applications.
- In an ideal case, it would be desirable to provide full force and tactile feedback to a user to make the virtual reality or telerobotic experience as realistic as possible. Unfortunately, most force feedback devices are cumbersome, heavy, expensive and difficult to put on and remove. Many of the tactile feedback solutions are also cumbersome, complex and fragile. Additionally, some of the tactile feedback devices described in the literature, such as small voice coils mounted to directly contact the skin, tend to numb the skin after only a few seconds of operation and then become ineffective as feedback devices.
- An object of the invention is a man-machine interface which may be employed in such areas as interactive computer applications, telerobotics, gesture recognition, music generation, entertainment, medical applications and the like. Another object of the invention is a mass which is moved by a “mass-moving actuator” which generates a vibration that a user can feel. Yet another object of the invention is the generation of an activating signal to produce the vibrations either as a result of the user's state or as a result of environmental conditions, whether virtual or physical. Still another object of the invention is vibrating the bone structure of a sensing body part, as well as skin mechanoreceptors, to provide feedback. Yet still another object of the invention is the complex actuation of vibratory devices.
- The tactile sensation that a user feels is generated by a vibrotactile unit mounted on, or in functional relation to, a sensing body part of a user by a fastening means. In one embodiment, the vibrotactile device comprises a mass connected eccentrically to a mass-moving actuator shaft (i.e. the center of mass of the mass is offset from the axis of rotation). Energizing the mass-moving actuator causes the shaft to turn, which rotates the eccentric mass. This rotating mass causes a corresponding rotating force vector. A rapidly rotating force vector feels to the user as a vibration. A slowly rotating force vector feels like a series of individual impulses. For a small number of rapid rotations, the rotating force vector feels like a single impulse. We will use the term “vibration” to denote a change in force vector (i.e., direction or magnitude). Examples of vibrations include, but are not limited to a single impulse, a sinusoidal force magnitude, and other functions of the force vector. We use the term “tactile sensation” to refer to the feeling perceived by a user when their sensing body part experiences vibrations induced by a vibrotactile unit.
- A signal processor interprets a state signal and produces an activating signal to drive the mass-moving actuator. The variable components of the state signal may be physical (e.g., measured), or virtual (e.g. simulated, or internally generated); they may vary with time (e.g., the state variables may represent processes); and they may be integer-valued (e.g., binary or discrete) or real-valued (e.g., continuous). The signal processor may or may not comprise a computer which interprets and further processes the state signal. The signal processor comprises a signal driver which produces an activating signal supplying power to, or controlling the power drawn by, the vibrotactile unit. The power may be, but is not restricted to, electric, pneumatic, hydraulic, and combustive types. The driver may be, but is not restricted to, an electric motor controller comprising a current amp and sensor for closed loop control, a flow valve controlling the amount of a pressurized fluid or gas, a flow valve controlling the amount of fuel to a combustion engine and the like. The details of such a signal processor and mass-moving actuator are common knowledge to someone skilled in the art.
- The state signal may be generated in response to a variety of conditions. In one embodiment, one or more sensors measuring physical conditions of the user and/or the user's environment may generate one or more components of a physical state signal. In another embodiment, a computer simulation may determine the one or more components of a virtual state signal from a simulated (e.g., virtual) state or condition. The virtual state may optionally be influenced by a physical state. The virtual state includes anything that a computer or timing system can generate including, but not restricted to, a fixed time from a previous event; the position, velocity, acceleration (or other dynamic quantity) of one or more virtual objects in a simulation; the collision of two virtual objects in a simulation; the start or finishing of a computer job or process; the setting of a flag by another process or simulation; combinations of situations; and the like. The virtual state signal is a machine-readable measurement of the virtual state variables.
- The physical state signal is measured from physical state variables. These variables have relevance to the physical state of a body part of the user or the user's physical environment. The physical state variables includes any measurable parameter in the environment or any measurable parameter relating to a body part of the user. Some examples of measurable physical parameters in an environment include but are not restricted to, the state of a body part, the position of objects in the environment, the amount of energy imparted to an object in the environment, the existence of an object or objects in the environment, the chemical state of an object, the temperature in the environment, and the like. The state of a body part may include the physical position, velocity, or acceleration of the body part relative to another body part or relative to a point in the environment. The state of a body part may also include any bodily function, where the measured state signal may include the output from an electroencephalograph (EEG), electrocardiograph (ECG), electromyograph (EMG), electrooptigraph (EOG) or eye-gaze sensor, and sensors which measure joint angle, heart rate, dermal or subdermal temperature, blood pressure, blood oxygen content (or any measurable blood chemical), digestive action, stress level, voice activation or voice recognition, and the like. The user's voice may constitute a measured physical state variable, where his spoken words are sensed and/or recognized to generate a corresponding activating signal. The physical state signal is a machine-readable measurement of the physical state variables.
- The state signal is presented to the signal processor which interprets the state, and then determines how and when to activate the vibrotactile units accordingly. The signal processor produces an activating signal which may be in response to an event it interprets from the state signal. Examples of events include contact, gestures, spoken words, onset of panic or unconsciousness, and the like. The interpretation of the state signal may or may not be a binary event, i.e. the simple changing of state between two values. An example of a binary event is contact vs. non-contact between two virtual or real objects. The process of interpreting may include any general function of state variable components. The interpretation function may produce an output control value which is integer or real-valued. A non-binary-valued interpretation output typically relates to the signal processor producing a non-binary activation signal.
- By varying the functional form of the activation signal, the type of feedback that the vibrotactile device generates may also be varied. The device may generate a complex tactile sensation, which is defined to be a non-binary signal from a single or multiple vibrotactile units. Examples of complex tactile sensations include (1) varying the amplitude of vibration with a profile which is non-uniform over time; (2) varying the frequency of vibration; (3) varying the duration of impulses; (4) varying the combination of amplitude and frequency; (5) vibrating two or more vibrotactile units with a uniform or non-uniform amplitude profile; (6) sequencing multiple vibrotactile units with different amplitude or frequency profiles; and the like.
- The frequency and amplitude of the vibration or impulse may be changed by modifying the activating signal to the mass-moving actuator. The frequency and amplitude may also be controlled by increasing the mass or by changing the radius of gyration (e.g. changing its eccentricity). For example, the mass may be changed by pumping fluid into an eccentrically rotating container. The sense of frequency that the user perceives may be changed independently of the amplitude by modulating the power to the vibrotactile unit at a variable frequency. This technique is called amplitude modulation, which is common knowledge to those skilled in the art. This change in frequency and amplitude may be used to convey complex, compound or other forms of information to the user.
- Sensors may be mounted on the vibrotactile unit or the sensing body part to determine the frequency and amplitude of vibration sensed by the user. A feedback control loop may be added which uses this information to more tightly control the frequency and amplitude, or to reach peak efficiency at the resonant frequency of the collective vibrating device-body system.
- Examples of a sensing body part on which the vibrotactile unit may be mounted, or in functional relation to the vibrotactile unit, include, but are not limited to: the distal part of a digit, the dorsal (back) side of a phalanx or metacarpus, palm, forearm, humerus, underarm, shoulder, back, chest, nipples, abdomen, head, nose, chin, groin, genitals, thigh, calf, shin, foot, toes, and the like. A plurality of vibrotactile units may be disposed on or near different sensing body parts, and may be activated in unison or independently.
- Each vibrotactile unit may be affixed to the body by a fastening means. The fastening means is defined to be the means of attaching the vibrotactile unit to a sensing body part, transmitting (and possibly modifying) the vibrations created by the vibrotactile unit. This means may be one that is flexible such as a strap made of cloth or soft polymer, or rigid, such as metal or hard polymer which grabs or pinches the flesh, skin or hair. The fastening means may also include gluing or taping to the skin or hair, or tying with a string or rope around a limb, or attaching to clothes with Velcro® or similarly functional means. A vibrotactile unit may also be attached to another structure which is then attached to the body part with the same means just mentioned. The vibrations generated by the actuator may be transmitted to the sensing body part by the structure (rigid or non-rigid), or through a linkage transmission or a fluid transmission.
- The eccentric mass need not be mounted directly onto a motor shaft. A mechanical transmission may rotate the mass on a different shaft than the motor shaft. The mass-moving actuator rotates this shaft. Fluids such as air and liquids may also transmit the motion from a power source to the rotating eccentric mass. Changing magnetic fields may also be employed to induce vibration of a ferrous mass.
- As previously mentioned, state signals may relate to a physical or virtual state. When the state represents a physical condition, the subject invention includes a state measurement sensor which produces a state signal. This state measurement sensor may measure some property of the sensing body part. Recall that the body part associated with receiving the vibrotactile stimulation is called the sensing body part, the body part associated with producing the activating signal is called the measured body part. The signal processor may receive signals from this sensor such as a tactile, position, bend, velocity, acceleration or temperature sensor and generate an activating signal. In this way, the user may receive feedback based on his actions or physical state. For example, the vibrotactile device may be used to train the user to do some physical motion task. In this case, the position or motion of the body part which is to do the motion task is measured by the state measurement sensor and is also the sensing body part. Direct stimulation to the body part being trained enhances the training of the task. Complex actuation in the form of a function of different levels of frequency or amplitude may inform the user whether his actions are correct or incorrect; the level of correctness may correspond to the level of frequency or amplitude.
- In addition, the sensing body part (which is also the measured body part) may have a graphical representation shown to the user. The user may also be presented with visual, auditory, taste, smell, force and/or temperature cues to his actions in combination with the vibrotactile cues provided by the subject invention. The user may be immersed in a virtual environment. The user may see a graphical representation of his/her body part interact with virtual objects and simultaneously feel a corresponding tactile sensation simulating the interaction. For example a user may have his/her fingers be the sensing and measured body parts. The user may then see his/her virtual hand in the virtual environment contact a virtual object. The user would then feel an increasing vibratory stimulation on his/her physical fingertip as he increased the virtual pressure on the virtual object using the virtual fingertip.
- As previously discussed, using the vibrotactile device of the subject invention, a user may receive tactile sensations based on the state of his body parts. In the previous case the state included the position, and other dynamic quantities, of the body parts. In certain applications, the measured body part is the same as the sensing body part (the list of possible sensing body parts mentioned earlier also applies to measured body parts); in other applications they are different body parts. When the measured body part is different than the sensing body part, the subject invention acts as a coupling device which relates the sensing body part and the measured body part.
- In another application, the user may receive tactile feedback as a result of the conditions of a computer simulated environment, not necessarily related to the user's actions or state. The vibrotactile units with varying actuation levels may be used to simulate a variety of contact situations, e.g., contact with fluids and solids, and contacts which are momentary or continuous. For example, a user immersed in a computer simulated virtual environment may feel simulated fluid (like air or water) across his body. In such a simulation, an array of vibrotactile units may vibrate in sequence to correspond to a pressure wave hitting the corresponding parts of the body; the amplitude of the vibration may vary to correspond to different levels of pressure being simulated. A user may also feel a virtual object that comes into contact with a portion of his virtual body. The user may feel a virtual bug crawl up his virtual arm by sequencing an array of vibrotactile units. To accompany the tactile sensations received by the user which are uncorrelated with his actions, the user may be presented with visual, auditory, taste, smell, force, temperature and other forms of feedback in order to enhance the realism of the simulated environment.
- In yet another application of the vibrotactile device, a group of users may receive tactile sensations. In one example, users may wear individual vibrotactile units, or they may also share vibrotactile units as follows. A tactile sensation may be shared by one or more users making physical contact with the sensing body part of another user. For example, one user may wear vibrotactile units on the backs of his fingers. A second user, not wearing any vibrotactile units, may obtain vibrotactile feedback transmitted via the first user when the first user places the palmar side of his fingers on a sensing body part of the second user. The activating signal for each vibrotactile unit may be computer controlled via either user's actions or through a computer simulated event. In a second example, a group of users may each receive identical tactile feedback through individually mounted vibrotactile units. The common activating signal may correspond to measured body parts from a single, optionally separate, user. Different users may also be responsible for producing the common activating signal for one or more vibrotactile units. For instance, the movement of one user's arm may control the vibrotactile unit on each user's arm; and the voice of a second user may control the vibrotactile unit on each user's back; the eye-gaze of three other users may control the vibrotactile unit upon which they stare in unison. An example application of a single user controlling many user's vibrotactile sensations is a new form of entertainment where a performer creates vibrotactile sensations for an audience.
- In a preferred embodiment, the vibrotactile units are affixed to an instrumented glove, such as the CyberGlove™ manufactured by Virtual Technologies of Palo Alto, Calif., USA. The CyberGlove has sensors in it which measure the angles of the joints of the hand. The fingertips of the CyberGlove are open so that the user may reliably handle physical objects while wearing the glove. The open fingertips allow the user to feel the sensations of real objects in conjunction with the generated vibrotactile sensations. The fingertips need not be open, they may be fully enclosed as in the 22-sensor model of the CyberGlove. The mass-moving actuator of each vibrotactile unit is encased in a cylindrical housing and mounted onto the glove on each of the fingers and thumb, and on the palmar side of the hand. Each mass-moving actuator is composed of a small DC motor with an eccentric mass mounted rigidly onto the shaft of the motor. The casing is made of tubular plastic and serves to protect the motion of the mass from the user and protect the user from the rotating mass. The casing may be made of any rigid or semi-rigid material including but not limited to steel, aluminum, brass, copper, plastic, rubber, wood, composite, fiberglass, glass, cardboard, and the like. The casing may form a solid barrier, a wire-mesh, grid or column-like support capable of transmitting vibrations from the mass-moving actuator to the fastening means. The instrumented glove informs a computer of the position of the user's hand and fingers. The computer, which is part of the signal processor, then interprets this hand state signal (and any virtual state signal if the application calls for it). The computer then generates a control signal, which when processed by the driver, activates the actuators to create tactile sensations.
- One feature of the embodiment of the subject invention just described, which employs an eccentric mass, is that the energy imparted into the system can be less than the energy required when using electromagnetic coils (such as the speaker voice coils used by Patrick et al. and the EXOS TouchMaster). Energy is stored as rotational inertia in the eccentric mass, whereas the voice-coil-based systems lose all inertial energy each time the coil change directions.
- Another feature of the subject invention is that vibrating the bone structure of a body part, as well as skin mechanoreceptors, has an advantage over stimulating just the skin mechanoreceptors (such as Meissner, Merkel, Ruffini and Pacinian corpuscles) in that the nerves do not get easily overstimulated and do not become numb. In addition, the form of information to the user is closer to a physical contact sensation where the muscles and joints are stimulated, as is done by full force feedback systems. As a result, the vibrotactile units need not be attached to a body part which has sensitive skin mechanoreceptors. For example, a vibrotactile unit may be attached to a fingernail or an elbow.
- In an embodiment in which a user is immersed in a computer simulated environment, actuation of vibrotactile units can approximate the sensation of touching physical objects as full force feedback devices do. The deep impulsive sensation in the muscles and joints generated by the vibrotactile units simulates the change in proprioceptive state as the user touches a virtual object. The subject invention provides numerous advantages over a sustained force feedback device. For example, because of its simplicity, the vibrotactile device of the subject invention can be made smaller, lighter, less encumbering, more robustly and cheaper.
- The subject invention may be used in combination with a sustained force feedback device as provided by Kramer in U.S. Pat. No. 5,184,319, Kramer in U.S. patent application Ser. No. 08/373,531 (allowed), Zarudiansky in U.S. Pat. No. 4,302,138, Burdea in U.S. Pat. No. 5,354,162, and Jacobus in U.S. Pat. No. 5,389,865. These patents and patent applications are incorporated herein by reference. Such a combination can give a higher frequency response than that capable of being generated by the sustained force feedback device and/or to reduce the cost and/or size of the full system. The subject invention may also be used in combination with other tactile feedback devices such as heating or cooling devices, bladder devices or voice coils.
-
FIG. 1 a is a perspective view of an electric mass-moving actuator with an eccentric mass attached to its shaft. -
FIG. 1 b is a perspective view of a mass-moving linear actuator with a mass attached to its shaft. -
FIGS. 2 a and 2 b are a cross-sectional side view and a perspective view respectively of an example of a vibrotactile unit. -
FIG. 3 is a perspective view of the vibrotactile unit shown inFIG. 2 b where the vibrotactile unit is attached to the palmar side of the fingertip. -
FIG. 4 is another perspective view of a vibrotactile unit attached to the dorsal side of the fingertip, where it makes contact with the nail. -
FIG. 5 is a perspective view of a vibrotactile unit attached to the dorsal side of the proximal phalanx. -
FIG. 6 is a perspective view of a vibrotactile unit attached to the palm of the hand -
FIG. 7 is a perspective view of a vibrotactile unit attached to the dorsal side of the metacarpus (the back of the hand). -
FIG. 8 is a perspective view of a vibrotactile unit attached to the top of the foot. -
FIG. 9 is a side view of a multitude of vibrotactile units attached to a variety of places on the head. -
FIGS. 10 a and 10 b are front and back views respectively, of a multitude of vibrotactile units attached to a variety of places on the body. -
FIGS. 11 a and 11 b are perspective and front views respectively of a fastening means where the palmar side of the fingertip receives greater stimulation without the vibrotactile unit getting in the way of manipulation. -
FIGS. 12 a and 12 b are perspective and front views respectively of a fastening means where the palmar side of the fingertip receives greater stimulation without the vibrotactile unit getting in the way of manipulation. -
FIG. 13 is a perspective view of a fastening means where no casing is required for the vibrotactile unit because the moving mass is mounted away from the finger thus reducing the possibility of interference. -
FIG. 14 is a side view of an another fastening means where no casing is required for the vibrotactile unit because the moving mass is mounted away from the finger thus reducing the possibility of interference. -
FIG. 15 is a perspective view of a fastening means where the vibrotactile unit is attached to the body via a spring that is used to alter the amplitude and frequency of the sensed oscillations. -
FIGS. 16 a, 16 b and 16 c are front schematic views and 16 d is a perspective view of a vibrotactile unit where the radius of the gyration of the eccentric mass increases as the angular velocity of the shaft increases.FIGS. 16 a, 16 b, and 16 c illustrate the principle, where w2>w1>0. -
FIG. 17 is a schematic electrical-mechanical signal propagation diagram. -
FIGS. 18 a and 18 b show an instrumented glove, in this case the Virtual Technologies CyberGlove™, with both position sensors and vibrotactile units. -
FIGS. 19 a and 19 b show schematically two applications using a sensing glove with vibrotactile units attached to the fingers and back of the hand.FIG. 19 a shows a virtual reality application.FIG. 19 b shows a telerobotic application. -
FIG. 20 illustrates schematically an example of a virtual environment with separate sensing and measured body parts. -
FIGS. 21 a and 21 b are perspective drawings showing two applications of the invention for gesture recognition. InFIG. 21 a, the gesture is static and inFIG. 21 b, the gesture is dynamic (the index finger is moving in a pre-determined fashion). -
FIG. 22 is a schematic drawing showing a musical application. -
FIG. 23 is a schematic drawing showing an entertainment or relaxation application. -
FIG. 24 is a schematic drawing showing a medical application. -
FIGS. 25 a, 25 b and 25 c are a schematic drawings illustrating an amplitude decoupling method. -
FIG. 26 a is a perspective drawing andFIG. 26 b is a side view of a vibrotactile unit with a controllable eccentricity.FIG. 26 c is an alternative transmission method that can be used to control the eccentricity of the mass. -
FIG. 27 is an exemplary diagrammatic view of an application comprising the vibrotactile device, a virtual simulation and a physical simulation. -
FIG. 1 a shows one embodiment of a vibrotactile unit obtained by attaching an eccentric mass (101) to the shaft (102) of a small d.c. electric motor (100) which serves as the mass-moving actuator. Here the mass is pie-shaped, however any other shape which offsets the center of gravity from the axis of rotation, and thus provides eccentricity, may be used. This eccentricity causes the force vector to change directions during rotation and thus induces vibrations in the unit. The mass may be made of any material like steel, aluminium, plastic or fluid encased in a container, to name a few. -
FIG. 1 b shows another embodiment of a vibrotactile unit obtained by attaching a mass (103) to the shaft (104) of a linear mass-moving actuator (105). Here the mass is disk-shaped, however any other shape may be used. The linear actuator moves the mass back and forth and thus induces vibrations in the unit by suddenly accelerating and decelerating it. The mass may be made of any material like steel, aluminium, plastic or fluid encased in a container, to name a few. -
FIG. 2 a andFIG. 2 b are cross-sectional and perspective drawings respectively of an example of a casing (200) in which a mass-moving actuator (202) and a mass (201) are contained. Again, the eccentric mass (201) is attached to the shaft (204) of the electric motor. The casing has a hole for the motor leads (203) to escape. The casing protects the moving mass from being disturbed by the user. It also protects the user from being hit by the mass. The casing may be made from any rigid material, or variety of materials, such as aluminum, steel, plastic, glass, glass fiber composite etc. It is typically desirable to have a small light weight mass-moving actuator, mass, casing and fastening means so that the device may be as unencumbering as possible. From here on, this embodiment of the invention will serve as the sample vibrotactile unit used in many of the subsequent figures. -
FIG. 3 illustrates one fastening means for attaching the vibrotactile unit to a finger. In this example, the vibrotactile unit (300) is attached directly to the palmar side of the fingertip using a fastening means (301). The fastening means may be made of either flexible material, such as cloth, fabric, tape, Velcro® or a soft polymer, or it may be made of a rigid material such as a metal, hard polymer or wood, to name a few. The fastening means need not encircle the finger entirely, it may grab the finger by clamping or pinching, or by sticking to it such as with glue or tape. Also, if the user is wearing a glove, the vibrotactile unit may also be sewn onto the glove or bonded to it and need not be affixed directly to the hand. This will also be the case in the following figures which illustrate various ways to position the vibrotactile unit on the human body. -
FIG. 4 illustrates another way of mounting the vibrotactile unit (400) onto the finger using a fastening means (401). In this case the unit is positioned directly above the fingernail on the dorsal side of the fingertip (the sensing body part) in order to provide a distinctive tactile sensation, or vibratory stimulus. The unit may vibrate the nail, the flesh underneath and the bone with sufficient amplitude that the sensation is felt throughout the finger, not just locally at the skin. -
FIG. 5 illustrates another way of mounting the vibrotactile unit (500) onto the finger using a fastening means (501). In this case the unit is positioned on the dorsal side of the proximal phalanx. Since the unit gives sensation throughout the entire finger, touching virtual objects with the palmar side of the hand will still give sensations to that side even though it is mounted on the back. When used in conjunction with manipulating physical objects with the palmar side, the vibrational sensation on the palmar side is enhanced. These features are not limited to the proximal phalanx. Mounting to the dorsal side of any phalanx or limb will produce the same effect. -
FIG. 6 illustrates another way of mounting the vibrotactile unit (600) onto the user using a fastening means (601). In this case the unit is positioned in the palm of the user's hand. If a glove (instrumented or not) is worn, then the unit may also be mounted inside or outside of the glove in a pocket-like cavity, and need not be explicitly affixed to the hand. -
FIG. 7 illustrates another way of mounting the vibrotactile unit (700) onto the user using a fastening means (701). In this case the unit is positioned on the dorsal side of the metacarpus, or the back of the hand. Again, if a glove (instrumented or not) is worn, then the unit may also be mounted inside or outside of the glove in a pocket-like cavity, and need not be explicitly affixed to the hand. -
FIG. 8 illustrates another way of mounting the vibrotactile unit (800) onto the user using a fastening means (801). In this case the unit is positioned on the top of the user's foot. If a sock-like garment (instrumented or not) is worn, then the unit may also be mounted inside or outside of the garment in a pocket-like cavity, and need not be explicitly affixed to the foot. -
FIG. 9 illustrates another way of mounting vibrotactile units (900) onto the user. In this example, the units are positioned on the user's head. If a hat-like garment (instrumented or not) is worn, then the units may also be mounted inside or outside of the suit in pocket-like cavities, and need not be explicitly affixed to the body. Examples of locations include, but are not limited to, the temples (900), the forehead (901), the top of the head (902) and the back of the head (903). -
FIG. 10 a illustrates another way of fastening vibrotactile units (1000-1012) onto the user. In these examples the units are positioned all over the front and the side of the user's body. If a body suit (instrumented or not) is worn, then the units may also be mounted inside or outside of the suit in pocket-like cavities, and need not be explicitly affixed to the body. By actuating a combination of actuators, the perception of the localization of the tactile sensation may be controlled. For example, if the actuators on the forearm (1007) and on the humerus (1005) actuate with equal intensity, the user may have the perception that there is a single source of sensation originating in-between the two. This may apply to any combination of vibrotactile units located anywhere on the body. This effect is also apparent when multiple vibrotactile units are activated in sequence. There is a perception that a single vibration has “moved” between the activating vibrotactile units. The vibrotactile units displayed in the figure show examples of a variety of candidate positions for attaching the units. Some of these positions include, but are not limited to, the forehead (1000), the shoulders (1001), the side of the arm (1003), the humerus (1005), the chest (1002), the nipples (1004), the abdomen (1006), the forearm (1007), the groin (1008), the hips (1009), the thighs (1010), the knees (1011) and the shins (1012). -
FIG. 10 b illustrates another way of fastening vibrotactile units (1020-1028) onto the user. In these examples the vibrotactile units are positioned all over the back of the user's body. If a body suit (instrumented or not) is worn, then the vibrotactile units may also be mounted inside or outside the body suit in pocket-like cavities, and need not be explicitly affixed to the body. The vibrotactile units displayed in the figure show examples of a variety of candidate positions for attaching the units to the body. Some of these positions include, but are not limited to, the back of the head (1020), the base of the neck (1021), between the shoulder blades (1022), the back of the humerus (1023), the back of the forearm (1025), the lower back (1024), the buttocks (1026), the back of the thighs (1027) and the calves (1028). The vibrotactile units inFIG. 10 b may be combined with those inFIG. 10 a as well. This plurality of vibrotactile units shows one way that complex tactile sensations may be generated with multiple vibrotactile units. -
FIGS. 11 a and 11 b show a vibrotactile unit mounted in such a way that the fingertip may be stimulated without the unit getting in the way of manipulation with the fingers.FIG. 11 a shows a perspective view of the invention andFIG. 11 b shows a frontal view. A structure (1102), which may be opened or closed at the end, surrounds the fingertip. The fastening means is comprised of three parts: part one affixing the finger to the structure; part two affixing the vibrotactile unit to the structure; part three is the structure (1102). Part one of the fastening means (1103), which can be a flexible or rigid membrane, holds the finger against the structure on the palmar side of the fingertip. This part can be adjustable, fixed, flexible or stretchable. In part two, the vibrotactile unit (1100) is mounted atop the structure, away from the palmar side of the fingertip, using a means (1101) which can be a flexible or rigid membrane. In this manner, the vibrations from the vibrotactile unit may be transmitted through the structure directly to the palmar side of the finger to provide a greater stimulation of the nerves local to the palmar side. In another embodiment, the structure (1102) and the vibrotactile unit casing (1100) can be made of one part, thus eliminating the need for a part two of the fastening means (1101). -
FIGS. 12 a and 12 b show the vibrotactile unit mounted such that the fingertip can be stimulated without the unit getting in the way of manipulation with the fingers.FIG. 12 a shows a perspective view of the invention andFIG. 12 b shows a side view. A structure (1202) is attached to the palmar side of the fingertip. The fastening means is comprised of three parts: part one, affixing the finger to the structure; part two, affixing the vibrotactile unit to the structure; part three which is the structure (1202). Part one (1203) may be a flexible or rigid membrane. This part may be adjustable, fixed, flexible or stretchable. In part two, the vibrotactile unit (1200) is mounted atop the structure, away from the palmar side of the fingertip, using a means (1201) which can be a flexible or rigid membrane. In another embodiment, the structure (1202) and the vibrotactile unit casing (1200) can be made of one part, thus eliminating the need for part two of the fastening means (1201). -
FIG. 13 shows a vibrotactile unit and fastening means where no casing is required for the mass-moving actuator/mass assembly. A small rigid or semi-rigid structure (1302) elevates the vibrotactile unit above the fingertip in such a way that the finger cannot interfere with the rotation of the eccentric mass (1301) about the main axis of the shaft (1304) of the mass-moving motor (1300). The structure (1302) is attached to the fingertip using a strap (1303) which can be rigid or flexible and which can be either an integral or separate part of the structure. -
FIG. 14 shows another vibrotactile unit and fastening means where no casing is required for the mass-moving actuator/mass assembly. A small rigid or semi-rigid structure (1404) elevates the vibrotactile unit above the middle phalanx in such a way that the finger cannot interfere with the rotation of the eccentric mass (1402) about the main axis of the shaft (1403) of the mass-moving actuator (1401). The structure (1404) is attached to the middle phalanx using a strap (1405) which can be rigid or flexible and which can be either an integral or separate part of the structure. -
FIG. 15 shows yet another vibrotactile unit (1500) and fastening means such that the vibrotactile unit is connected to the fingertip via a form of spring (1501) in order to alter the amplitude and frequency of the perceived vibrations. A strap (1502) which can be a flexible or rigid membrane holds the spring against the fingertip. The spring changes the natural frequency of the vibrotactile unit. Alternatively, the vibrotactile unit/spring apparatus could be attached below the finger instead of above it. The spring may also be replaced by some form of actuator to again control the amplitude and frequency and/or to extend the range of amplitude and frequency. In addition a damper may be introduced in combination with the spring or actuation system to further control and/or extend the amplitude and frequency of the perceived vibrations. An electro-rheological fluid may used in the damper to control the damping term in the mechanical system. -
FIGS. 16 a, 16 b, 16 c, and 16 d illustrate a modification to the way the eccentric mass is mounted to a shaft. The radius of the gyration K of the eccentric mass increases as the angular velocity of the shaft increases. The top three drawings (FIGS. 16 a, 16 b, 16 c) illustrate the principle, where w2>w1>0, and the bottom perspective drawing (FIG. 16 d) provides an implementation. InFIG. 16 d, a structure (1601) is attached the shaft (1602) of the mass-moving actuator (1600). The structure comprises a spring (1604) and mass (1603) assembly. At one end, the spring is attached to the inside of the structure and at the other end it is attached to the mass. The mass is free to move towards and away from the shaft inside a guide in the structure. The radius of gyration K is the distance between the center of gravity of the mass (1603) and the main axis of the mass-moving actuator shaft (1602). As the angular velocity of the shaft increases, the centrifugal forces felt by the mass increase, causing it to stretch the spring further and increase the radius of gyration. This apparatus minimizes the angular inertia of the device at start-up and then gradually increases the eccentricity of the mass so that larger vibrations can be obtained at higher angular velocities. This relieves the stress on the bearings that hold the shaft and reduces the larger initial torque required to initiate rotation (as opposed to the torque required to maintain rotation). Alternatively, the passive spring may be replaced by an active device which controls or sets the radius of gyration of the mass. The active device may comprise a shape memory alloy actuator or any other mechanism capable of controlling the position of the mass. -
FIG. 17 shows how the electrical and mechanical signals propagate through the tactile feedback control system in a preferred embodiment of the invention. The embodiment shown employs a d.c. servo motor (1701) as the mass-moving actuator of a vibrotactile unit. A computer (1707), or other signal processing means, sends a digital value representing the desired actuation level control signal to the digital-to-analog convert, D/A (1703). The analog output of the D/A is then amplified by a variable gain amplifier (1704) to produce an analog voltage activation signal. This voltage is placed across the servo motor, driving the motor at a desired angular velocity. The voltage signal may alternately be converted to a current activation signal for driving the motor at a desired torque. Velocity damping of the servo control loop may be performed by tachometer feedback (not shown). The computer (1707), digital-to-analog converter (1703), analog-to-digital converter, A/D (1702), bus (1709) and variable gain amplifier (1704) may be elements of a signal processor. Digitized values from A/D (1702) from analog joint angle sensors (1705) provide the position information of the fingers (measured body parts) to the computer as a physical state signal. In a virtual environment application, the physical state signal may cause motion in a corresponding virtual hand. If one of the digits of the virtual hand is found to be intersecting a virtual object, the computer calculates the virtual force to be applied to the virtual digit using knowledge of the virtual object's shape and compliance. The computer then causes an activation signal to be sent to the vibrotactile units mounted on the user's fingers (sensing body part) to convey tactile information about that virtual force. Strain gage, fiber optic, potentiometric, or other angle sensors may be used as analog joint angle sensors (1705). Strain gage angle sensors are disclosed in the Kramer et al. U.S. Pat. Nos. Nos. 5,047,952 and 5,280,265, which patents are incorporated herein by reference. -
FIG. 18 a andFIG. 18 b illustrate a preferred embodiment of the invention. An instrumented glove (1820) such as the CyberGlove™ manufactured by Virtual Technologies of Palo Alto Calif., USA, has sensors (1807-1819) on it which measure the angles of the joints of the hand (the measured body parts). In the figures, the fingertips of the glove are open so that the user may handle physical objects while using the glove. This allows the user to feel the tactile sensations of real objects which may then be used in conjunction with tactile sensations generated from the subject invention. The vibrotactile units (1801-1806) are encased in cylindrical housings and fastened to the glove on each of the fingers (1801-1804), the thumb (1805) and on the palmar (1806) side of the hand. The vibrotactile units are composed of a d.c. motor (item 202 inFIG. 2 ) with an eccentric mass (item 201 inFIG. 2 ) mounted onto its shaft (item 204 inFIG. 2 ). The casing is made of tubular plastic and serves to protect the motion of the mass from the user and protect the user from the rotating mass. -
FIG. 19 a shows a user wearing a sensing glove (1900) which can measure hand formations as well as the spatial placement of the hand. The sensing glove has vibrotactile units (1901) fastened to the fingers and to the back of the hand. The user receives visual feedback through a graphical representation of his hand on the computer monitor (1908). The computer (1904) receives the state signal (information about the spatial placement of the user's hand) through the sensors mounted on the glove via a glove sensor interface (1902). When the virtual graphical hand (1906) touches (1907) a virtual object (1905) on the monitor, the computer sends a control signal to the vibrotactile unit driver (1903) which then sends the activation signal to the vibrotactile units (1901). - In a similar setup,
FIG. 19 b shows the same glove (1900) and computer interface remotely controlling a robotic arm (1911) instead of a graphic display. The robot has contact sensors on its gripper (1912) that detect when the robot touches physical objects (1913). The user controls the robot arm through the sensors on the glove which produce position readings of the fingers (measured body parts) which are sent to the glove interface device (1902) and then outputted to the computer (1904) which in turn sends the appropriate commands to the robot. Robot position and contact information (1910) is then fed back to the computer as the state signal. The computer interprets this signal and decides what kind of vibrational feedback should be sent to the vibrotactile unit (1901) (other vibrotactile units not shown) on the user via the vibrotactile unit driver (1903). Force or pressure sensors may be mounted on the gripper instead of contact sensors. The user then receives vibrational feedback of varying levels depending on the force or pressure on the object. This allows a teleoperator to perform tasks more efficiently and safely, especially in handling delicate objects that would break under certain grip forces. The user does not necessarily need to control the robot or the objects of contact in order to use the tactile feedback. The vibrotactile device may act simply to inform the user of contact with the object whether or not as a result of the user's actions. -
FIG. 20 illustrates an embodiment in a virtual reality context where the measured body part (2003) is the foot, however, the vibrotactile unit (2001) is mounted on the finger which acts as the sensing body part (2002). The foot has a graphical object (2004) associated with it in the computer simulation. In this case, the graphical object looks like a foot as well. Motions of the foot are sent to the computer (2008) via the body sensor interface (2006) and are reflected on the computer monitor (2009). When the computer (2008) determines that the graphical foot (2004) contacts a virtual object (2010), the computer interprets this state signal and sends a control signal to the vibrotactile unit driver (2007) to activate the vibrotactile unit (2001) on the finger. This may be due to the user moving his foot so that the graphical foot contacts (2005) the virtual object, or the virtual object moving into the graphical foot independent of the user's actions. The user then needs to correlate the contact of the virtual object with the sensation at the fingertip. While this does not seem as natural as vibrating the foot as it makes contact, this illustrates the sensing body part separate from the measured body part. This is necessary if the measuring body part cannot coincide with the sensing body part, for example if the measured body part is the eye-ball or if the measured body part is on another user. -
FIG. 21 a andFIG. 21 b illustrate a glove (2101) which contains both position sensors and vibrotactile units (2100). The Virtual Technologies CyberGlove™ is an example of a glove with appropriate position sensors. The sensors measure the spacial placement of the hand and fingers. A computer uses gesture recognition software to determine if a pre-specified hand formation or motion has been gesticulated. InFIG. 21 a, the vibrotactile unit signals the user that a particular static pose has been detected. A different vibrotactile sensation can be generated in response to a recognized moving hand or arm gesture that includes dynamic motions (FIG. 21 b). This may also be useful in training the gesture recognition software for the gestures to be recognized. In training the software, a user must repeatedly make the same gesture to obtain some sort of average position since humans cannot repeat gestures exactly. With the vibrotactile feedback, the user may be trained to better repeat his gestures while at the same time training the recognition software to recognize his gestures. Better repetition of the gestures reduces the statistical distribution of the sensor readings for a given hand gesture which in turn may improve the performance of the recognition system. -
FIG. 22 illustrates vibrotactile units in a musical application. The units are attached to a body suit or mounted directly onto the user's clothing. Different regions on the body (2200-2210), which contain groupings of vibrotactile units (2211), may correspond to different musical instruments in an orchestra and serve to enhance the musical experience. For example, music produced by a cello produces proportional vibrations on the user's thigh (2204) through the vibrotactile units located in that body region. Similarly, the drums induce vibrations in the units that stimulate the chest area (2201) and so on. Sections of the body containing multiple vibrotactile units corresponding to one instrument type may have individual vibrotactile units corresponding to individual instruments. For example, the cello section of the body is shown to have the first chair cello on the upper thigh, and the second chair cello on the lower thigh. The user may either be a passive listener “feeling” the instruments as well, or he may be an active participant in creating the music, receiving the vibrotactile sensations as feedback. -
FIG. 23 illustrates an entertainment application. In this case an array of vibrotactile units simulates water flow or wind. In this illustration a user is lying on a couch (2300) and is immersed in a virtual beach scene and sees the beach through a head-mounted display (2302). The user hears ocean sounds through head-mounted earphones (2301) and feels warmth from the sun through heat lamps (2303). The user then feels wind simulated by the vibrotactile units as they are pulsed in sequence creating “waves” of sensation. For example, the wind could flow from head to toes by alternatively pulsing the vibrotactile units starting with the ones on the head (2304) and ending with the ones on the toes (2305). Similarly, water is felt as pulsed waves (although perhaps of larger amplitude), as the user swims through the virtual water. In this fashion, the user may be relaxed or entertained. -
FIG. 24 a andFIG. 24 b illustrate a medical application where, for example, a user has injured a knee. A vibrotactile unit (2401) is used in conjunction with bend sensors (2400) mounted on the knee during physical therapy sessions as shown inFIG. 24 a. The vibrotactile unit notifies the user when the knee is exercised appropriately and alerts the user if the knee is flexed further than a safe limit prescribed by a doctor and thus improve recovery as is illustrated inFIG. 24 b. Furthermore, the vibrotactile units, in conjunction with other sensors, may be used in any biofeedback application. -
FIGS. 25 a, 25 b and 25 c illustrate an approach for decoupling the amplitude and frequency components of the vibrations generated by an eccentric mass-based vibrotactile unit. In this embodiment, the vibrotactile unit comprises a rotary electric motor (2501), a mass mounted eccentrically (2500), a sensor (2503) mounted on the shaft (2502) to determine the angular position of the shaft and a closed-loop control system. Any other control law may be used that achieves a single rotation of the shaft. One example is shown inFIG. 25 a. The vertical axis of the graph represents a normalized current, the horizontal axis represents the rotation of the axis in radians. This corresponds to the following non-linear control law:
I=1, (δ≧θ>π)
I=−1, (π≧θ>2π−δ)
I=0, (−δ>θ>δ) - With the initial conditions set so that the velocity is zero and rotational position of the mass, θ, (in radians) is equal to a small value, δ, (
FIG. 25 b) sending current, I, to the motor in this manner would cause the mass to accelerate for half of a full rotation, up to θ+δ (FIG. 25 c), and decelerate for the other half of the rotation coming to a stop between the −δ and +δ position in the ideal case. The actual position of the −δ and the +δ position may have to vary depending on the bandwidth of the control loop and the friction and damping of the system. The magnitude of vibration or impulse is set by the amplitude of the current, the frequency is set by repeating the above control at the desired frequency. A simple feedback control loop (PID for example) could ensure the initial conditions are correct before each pulse. The details of this are common knowledge to those skilled in the art. -
FIG. 26 a is a perspective drawing andFIG. 26 b is a side view of a vibrotactile unit with controllable eccentricity. A structure, such as a slip-disk (2602), is mounted on the shaft (2601) and is free to slide back and forth along the shaft. The slip-disk is attached to a linkage (2605) which connects it to the eccentric mass (2604). A positioning device (2603) controls the position of the slip-disk on the shaft, which in turn affects the position of the mass (via the linkage) and thus its eccentricity.FIG. 26 c is an alternative transmission method that can be used to control the eccentricity of the mass. InFIG. 26 c, the transmission comprises element (2606), which may be a flexible membrane or fluid inside a hollow shaft (2601) that is connected to the eccentric mass (2604) at one end and the sliding slip-disk (2602) at the other. Again, controlling the position of the disk along the shaft using the positioning device (2603) affects the eccentricity of the mass.Element 2606 may also be a fluid and 2604 a hollow container. As the fluid is forced through the tube (2601) by the slip-disk (2602), or by some other pressure generating means, the container (2604) is filled with the fluid, thus, increasing the effective radius of gyration of the center of mass of the fluid. By increasing the radius of gyration, by whichever means, it is possible to independently control the amplitude and frequency of vibration of the vibrotactile unit. -
FIG. 27 provides an exemplary block diagram of the components and functional relationship between the components comprising the vibrotactile device when used in an application. Although some components are shown interrelated with a unidirectional arrow, the arrows may be bidirectional to provide bidirectional flow of information. Additional arrows may be added between blocks to provide for communication between components. An application may include presenting vibrotactile sensation to a body part of a user, where the vibrotactile sensation is associated with a virtual environment simulation (virtual simulation) and/or the physical state of a body (physical simulation), which may be the user's body, or another person's body. One or more virtual simulations may co-exist with one or more physical simulations, and may be combined with further types of simulations to yield a vibrotactile sensation. - The exemplary virtual simulation (2722) of
FIG. 27 comprises a computer (2706) with computer monitor (2709). To produce the virtual simulation, the computer typically generates, processes, executes or runs a computer simulation (2705) which is typically in the form of a computer software program. In the exemplary virtual simulation, the computer produces a graphical display of a virtual measured body part on the monitor, where the body part is shown to be a fingertip (2707) on a virtual hand (2708). The virtual simulation may internally generate an internal state with a variety of state variables which comprise a virtual state signal (2703) to provide to a signal processor (2700). Exemplary virtual state variables include position, velocity, acceleration, mass, compliance, size, applying force or torque, composition, temperature, moisture, smell, taste and other dynamical, structural, physical, electrical metabolical, moodal, cognitive, biological and chemical properties of various portions internal to, and on the surface of, a virtual measured body part. States variables may also denote functions of state variables, such as contact of various parts of the virtual hand. -
FIG. 27 also provides an exemplary physical simulation (2723) comprising a state sensor (2718) and a physical measured body part (2717). In this example, the physical measured body part is depicted as a fingertip (2717) on a physical hand (2716). The state sensor measures the physical state (2719) of the physical measured body part and produces a physical state signal (2720) to provide to the signal processor (2700). The physical state signal (2720) is optionally provided to the computer (2706) and/or computer simulation (2705) of a virtual simulation (2722). Exemplary physical state variables include position, velocity, acceleration, mass, compliance, size, applying force or torque, composition, temperature, moisture, smell, taste and other dynamical, structural, physical, electrical, metabolical, moodal, cognitive, biological and chemical properties of various portions internal to, and on the surface of, a physical measured body part. States variables may also denote functions of state variables, such as contact of various parts of the physical hand. - As shown in
FIG. 27 , for both the virtual simulation and the physical simulation, the signal processor (2700) receives a state signal and produces an activating signal (2704). For the virtual simulation, the state signal is the virtual state signal (2703); for the physical simulation, the state signal is the physical state signal (2720). When the application comprises both a virtual simulation and a physical simulation, both a virtual state signal and a physical state signal may be presented to the signal processor. - The signal processor may employ a digital or analog computer (2701) to interpret one or more input state signals (e.g., a virtual or physical state signal) and produce a control signal (2721) which becomes the input signal to a driver (2702). Using the control signal, the driver produces the activating signal (2704). When the computer is absent from the signal processor, the driver determines the activating signal from the state signal or signals. Whether or not the computer is present in the signal processor, the activating signal is provided in a form for use by the mass-moving actuator (2710). For example, the driver may comprise a motion control module, an operational amplifier, a transistor, a fluidic valve, a pump, a governor, carburetor, and the like. In the case where the mass-moving actuator is an electric motor, the activating signal may be a voltage or current with sufficient electrical power or current drive to cause the motor to turn.
- In
FIG. 27 , the mass-moving actuator (2710) is shown to be an electric motor which turns a shaft (2712) and an eccentric mass (2711). As the mass is rotated, the entire assembly of 2710, 2711 and 2712 vibrates, producing vibrations (2713). Such vibrations are transmitted to a sensing body part of a user who perceives a tactile sensation. In the figure, the sensing body part is exemplified as the fingertip (2715) of a hand (2714). - An exemplary application which comprises a virtual simulation and a physical simulation is summarized as follows:
- A fingertip of a physical hand corresponds to both the sensing body part (2715) and the physical measured body part (2717). An instrumented glove, optionally comprising a joint angle sensor and spatial position sensor, produces a physical state signal (2720) corresponding to the position of the physical fingertip. The fingertip position is provided via a wire (e.g., electrical or optical), computer bus or other electrical or optical connecting means to a computer (2706) running a computer simulation (2705) in software. The fingertip position is often provided in the form of digital values, typically as joint angles and/or values corresponding to the six possible spatial degrees of freedom. The fingertip position may also be in the form of an analog voltage.
- The computer simulation uses the physical state signal (2720) corresponding to the physical fingertip position (2719) to simulate the position and motion of a virtual hand (2708) and fingertip (2707). The computer simulation displays the virtual hand on a computer monitor (2709), in addition to displaying a second virtual object whose attributes may correspond to a second physical measured object, such as a block, ball, car interior, engineering part, or other object. The computer monitor may be a desk-top monitor, head-mounted monitor, projection monitor, holographic monitor, or any other computer generated display means. The second physical measured object may also be a body part of the user or a second user.
- When the user moves his hand, producing a movement of the virtual hand, the computer simulation detects a level of virtual contact between the virtual fingertip (2707) and the second virtual object. The computer simulation then produces a virtual state signal (2703) where one state variable denotes the level (e.g., amount of force) of the virtual contact of the virtual fingertip. The virtual state signal is transmitted to the signal processor (2721) via a wire (e.g., electrical or optical), computer bus or other electrical or optical connecting means. The signal processor may exist in the computer (2706), in which case the virtual state signal is typically transmitted via the computer bus. When the signal processor exists in a separate enclosure from the computer, the virtual state signal is typically transmitted via a wire.
- The signal processor may convert the state variable level of virtual contact into an activating signal voltage proportional to the level of virtual contact force using a digital-to-analog converter followed by an operational amplifier. The voltage is presented to the mass-moving actuator (2710) typically by a wire (e.g., electrical or optical) or other electrical or optical connecting means. The mass-moving actuator may be a variable speed electric motor which spins eccentric mass (2711) on its shaft (2712). The electric motor with eccentric mass are housed in a plastic housing or casing which is affixed to the dorsal portion of the instrumented glove surrounding the fingertip, which fingertip corresponds to both the physical measured body part and the sensing body part. The affixing is typically done with straps, sewing, gluing and the like. As the eccentric mass rotates, the electric motor, mass, casing and sensing body part all vibrate, typically at a common frequency. Ideally, there is little vibrational attenuation between the mass and the sensing body part such that as the eccentric mass rotates, the electric motor, mass, casing and sensing body part all vibrate with the same amplitude.
- In the application just described, the user may perceive a cause-and-effect relationship between motion of his fingertip and the level of vibration he feels. Thus, the position, compliance, mass, shape and other attributes of a virtual object may be detected by movement of the user's fingertip, or by movement of the virtual object, inducing various vibrotactile responses. The vibrotactile device of the subject invention promotes a sensation of immersion in a virtual environment where the user is able to interact with virtual objects as if he were interacting with physical objects in a physical environment.
- Any publication or patent described in the specification is hereby included by reference as if completely set forth in the specification.
- While the invention has been described with reference to specific embodiments, the description is illustrative of the invention and is not to be construed as limiting the invention. Thus, various modifications and amplifications may occur to those skilled in the art without departing from the true spirit and scope of the invention as defined by the appended claims.
Claims (1)
1. An apparatus for providing a tactile sensation to a sensing body part in relation to a virtual state signal, said apparatus comprising at least one vibrotactile unit, wherein each unit comprises:
a mass-moving actuator comprising a shaft and an eccentric mass mounted on said shaft, said mass-moving actuator rotating said shaft;
fastening means for holding said mass-moving actuator in relation to said sensing body part for transmitting vibrations to said sensing body part; and
wherein said apparatus further comprises a signal processor for interpreting said virtual state signal to produce an activating signal and transmitting said activating signal to said mass-moving actuator for activating said mass-moving actuator.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/580,452 US20070030246A1 (en) | 1995-11-30 | 2006-10-13 | Tactile feedback man-machine interface device |
US11/981,256 US8368641B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US11/981,228 US7969416B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US14/340,185 US9690379B2 (en) | 1995-11-30 | 2014-07-24 | Tactile feedback interface device |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US56510295A | 1995-11-30 | 1995-11-30 | |
US09/066,608 US6088017A (en) | 1995-11-30 | 1998-04-24 | Tactile feedback man-machine interface device |
US09/561,782 US6275213B1 (en) | 1995-11-30 | 2000-05-01 | Tactile feedback man-machine interface device |
US09/838,052 US6424333B1 (en) | 1995-11-30 | 2001-04-18 | Tactile feedback man-machine interface device |
US10/186,342 US20030016207A1 (en) | 1995-11-30 | 2002-06-27 | Tactile feedback man-machine interface device |
US10/460,157 US7755602B2 (en) | 1995-11-30 | 2003-06-13 | Tactile feedback man-machine interface device |
US11/580,452 US20070030246A1 (en) | 1995-11-30 | 2006-10-13 | Tactile feedback man-machine interface device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/460,157 Continuation US7755602B2 (en) | 1995-11-30 | 2003-06-13 | Tactile feedback man-machine interface device |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/981,228 Continuation US7969416B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US11/981,256 Continuation US8368641B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US14/340,185 Division US9690379B2 (en) | 1995-11-30 | 2014-07-24 | Tactile feedback interface device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070030246A1 true US20070030246A1 (en) | 2007-02-08 |
Family
ID=24257222
Family Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/066,608 Expired - Lifetime US6088017A (en) | 1995-11-30 | 1998-04-24 | Tactile feedback man-machine interface device |
US09/561,782 Expired - Lifetime US6275213B1 (en) | 1995-11-30 | 2000-05-01 | Tactile feedback man-machine interface device |
US09/838,052 Expired - Lifetime US6424333B1 (en) | 1995-11-30 | 2001-04-18 | Tactile feedback man-machine interface device |
US10/186,342 Abandoned US20030016207A1 (en) | 1995-11-30 | 2002-06-27 | Tactile feedback man-machine interface device |
US10/460,157 Expired - Fee Related US7755602B2 (en) | 1995-11-30 | 2003-06-13 | Tactile feedback man-machine interface device |
US11/580,452 Abandoned US20070030246A1 (en) | 1995-11-30 | 2006-10-13 | Tactile feedback man-machine interface device |
US11/981,256 Expired - Fee Related US8368641B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US11/981,228 Expired - Fee Related US7969416B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US14/340,185 Expired - Fee Related US9690379B2 (en) | 1995-11-30 | 2014-07-24 | Tactile feedback interface device |
Family Applications Before (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/066,608 Expired - Lifetime US6088017A (en) | 1995-11-30 | 1998-04-24 | Tactile feedback man-machine interface device |
US09/561,782 Expired - Lifetime US6275213B1 (en) | 1995-11-30 | 2000-05-01 | Tactile feedback man-machine interface device |
US09/838,052 Expired - Lifetime US6424333B1 (en) | 1995-11-30 | 2001-04-18 | Tactile feedback man-machine interface device |
US10/186,342 Abandoned US20030016207A1 (en) | 1995-11-30 | 2002-06-27 | Tactile feedback man-machine interface device |
US10/460,157 Expired - Fee Related US7755602B2 (en) | 1995-11-30 | 2003-06-13 | Tactile feedback man-machine interface device |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/981,256 Expired - Fee Related US8368641B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US11/981,228 Expired - Fee Related US7969416B2 (en) | 1995-11-30 | 2007-10-30 | Tactile feedback man-machine interface device |
US14/340,185 Expired - Fee Related US9690379B2 (en) | 1995-11-30 | 2014-07-24 | Tactile feedback interface device |
Country Status (5)
Country | Link |
---|---|
US (9) | US6088017A (en) |
EP (1) | EP0864145A4 (en) |
JP (7) | JP2000501033A (en) |
AU (1) | AU1328597A (en) |
WO (1) | WO1997020305A1 (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090153365A1 (en) * | 2004-11-18 | 2009-06-18 | Fabio Salsedo | Portable haptic interface |
US20110074733A1 (en) * | 2008-05-19 | 2011-03-31 | Maekinen Ville | Interface apparatus for touch input and tactile output communication |
CN102156540A (en) * | 2011-03-29 | 2011-08-17 | 南京航空航天大学 | Three-dimensional somatosensory man-machine interactive system with vibrotactile feedback and interactive method thereof |
CN102360248A (en) * | 2011-10-11 | 2012-02-22 | 高长江 | Close fitting calculation and memory device |
US8834266B2 (en) | 1994-09-21 | 2014-09-16 | Craig Thorner | Methods and apparatuses for generating tactile feedback for games and simulations |
US8941475B2 (en) | 2007-09-18 | 2015-01-27 | Senseg Oy | Method and apparatus for sensory stimulation |
US20150205352A1 (en) * | 2013-12-29 | 2015-07-23 | Immersion Corporation | Distributed control architecture for haptic devices |
US20190004604A1 (en) * | 2017-06-29 | 2019-01-03 | Apple Inc. | Finger-Mounted Device With Sensors and Haptics |
US10579099B2 (en) | 2018-04-30 | 2020-03-03 | Apple Inc. | Expandable ring device |
JP2020061184A (en) * | 2007-09-14 | 2020-04-16 | 国立研究開発法人産業技術総合研究所 | Method and apparatus for inducing illusionary tactile sense |
US11037415B2 (en) | 2018-01-19 | 2021-06-15 | Toyoda Gosei Co., Ltd. | Tactile presentation device |
US11287886B1 (en) | 2020-09-15 | 2022-03-29 | Apple Inc. | Systems for calibrating finger devices |
US11709554B1 (en) | 2020-09-14 | 2023-07-25 | Apple Inc. | Finger devices with adjustable housing structures |
US11755107B1 (en) | 2019-09-23 | 2023-09-12 | Apple Inc. | Finger devices with proximity sensors |
Families Citing this family (544)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5631861A (en) * | 1990-02-02 | 1997-05-20 | Virtual Technologies, Inc. | Force feedback and texture simulating interface device |
US5889670A (en) | 1991-10-24 | 1999-03-30 | Immersion Corporation | Method and apparatus for tactilely responsive user interface |
US6222525B1 (en) | 1992-03-05 | 2001-04-24 | Brad A. Armstrong | Image controllers with sheet connected sensors |
US6801008B1 (en) | 1992-12-02 | 2004-10-05 | Immersion Corporation | Force feedback system and actuator power management |
US7345672B2 (en) * | 1992-12-02 | 2008-03-18 | Immersion Corporation | Force feedback system and actuator power management |
US5805140A (en) | 1993-07-16 | 1998-09-08 | Immersion Corporation | High bandwidth force feedback interface using voice coils and flexures |
US5734373A (en) | 1993-07-16 | 1998-03-31 | Immersion Human Interface Corporation | Method and apparatus for controlling force feedback interface systems utilizing a host computer |
US6437771B1 (en) | 1995-01-18 | 2002-08-20 | Immersion Corporation | Force feedback device including flexure member between actuator and user object |
US5691898A (en) | 1995-09-27 | 1997-11-25 | Immersion Human Interface Corp. | Safe and low cost computer peripherals with force feedback for consumer applications |
US5959613A (en) | 1995-12-01 | 1999-09-28 | Immersion Corporation | Method and apparatus for shaping force signals for a force feedback device |
US5754023A (en) | 1995-10-26 | 1998-05-19 | Cybernet Systems Corporation | Gyro-stabilized platforms for force-feedback applications |
US6639581B1 (en) | 1995-11-17 | 2003-10-28 | Immersion Corporation | Flexure mechanism for interface device |
US5825308A (en) | 1996-11-26 | 1998-10-20 | Immersion Human Interface Corporation | Force feedback interface having isotonic and isometric functionality |
US6704001B1 (en) | 1995-11-17 | 2004-03-09 | Immersion Corporation | Force feedback device including actuator with moving magnet |
AU1328597A (en) * | 1995-11-30 | 1997-06-19 | Virtual Technologies, Inc. | Tactile feedback man-machine interface device |
US8508469B1 (en) | 1995-12-01 | 2013-08-13 | Immersion Corporation | Networked applications including haptic feedback |
US6028593A (en) | 1995-12-01 | 2000-02-22 | Immersion Corporation | Method and apparatus for providing simulated physical interactions within computer generated environments |
US6161126A (en) | 1995-12-13 | 2000-12-12 | Immersion Corporation | Implementing force feedback over the World Wide Web and other computer networks |
US6300936B1 (en) | 1997-11-14 | 2001-10-09 | Immersion Corporation | Force feedback system including multi-tasking graphical host environment and interface device |
SE519661C2 (en) * | 1996-02-23 | 2003-03-25 | Immersion Corp | Pointing devices and method for marking graphic details on a display with sensory feedback upon finding said detail |
US8016598B2 (en) | 1996-05-08 | 2011-09-13 | Gaumard Scientific Company, Inc. | Interactive education system for teaching patient care |
US8696362B2 (en) * | 1996-05-08 | 2014-04-15 | Gaumard Scientific Company, Inc. | Interactive education system for teaching patient care |
US7811090B2 (en) | 1996-05-08 | 2010-10-12 | Gaumard Scientific Company, Inc. | Interactive education system for teaching patient care |
US20090148822A1 (en) * | 2007-12-07 | 2009-06-11 | Gaumard Scientific Company, Inc. | Interactive Education System for Teaching Patient Care |
US7976312B2 (en) * | 1996-05-08 | 2011-07-12 | Gaumard Scientific Company, Inc. | Interactive education system for teaching patient care |
US6374255B1 (en) * | 1996-05-21 | 2002-04-16 | Immersion Corporation | Haptic authoring |
US8674932B2 (en) | 1996-07-05 | 2014-03-18 | Anascape, Ltd. | Image controller |
US6411276B1 (en) | 1996-11-13 | 2002-06-25 | Immersion Corporation | Hybrid control of haptic feedback for host computer and interface device |
US6686911B1 (en) | 1996-11-26 | 2004-02-03 | Immersion Corporation | Control knob with control modes and force feedback |
US6020876A (en) | 1997-04-14 | 2000-02-01 | Immersion Corporation | Force feedback interface with selective disturbance filter |
US6050962A (en) * | 1997-04-21 | 2000-04-18 | Virtual Technologies, Inc. | Goniometer-based body-tracking device and method |
US6292170B1 (en) | 1997-04-25 | 2001-09-18 | Immersion Corporation | Designing compound force sensations for computer applications |
US6285351B1 (en) | 1997-04-25 | 2001-09-04 | Immersion Corporation | Designing force sensations for computer applications including sounds |
US7472047B2 (en) * | 1997-05-12 | 2008-12-30 | Immersion Corporation | System and method for constraining a graphical hand from penetrating simulated graphical objects |
CA2277826A1 (en) * | 1997-11-14 | 1999-05-27 | William M. Jenkins | A computerized device for improving motor control in an individual by sensory training |
US6252583B1 (en) | 1997-11-14 | 2001-06-26 | Immersion Corporation | Memory and force output management for a force feedback system |
US6243078B1 (en) | 1998-06-23 | 2001-06-05 | Immersion Corporation | Pointing device with forced feedback button |
US6448977B1 (en) | 1997-11-14 | 2002-09-10 | Immersion Corporation | Textures and other spatial sensations for a relative haptic interface device |
US6211861B1 (en) | 1998-06-23 | 2001-04-03 | Immersion Corporation | Tactile mouse device |
US6256011B1 (en) | 1997-12-03 | 2001-07-03 | Immersion Corporation | Multi-function control device with force feedback |
IL123073A0 (en) | 1998-01-26 | 1998-09-24 | Simbionix Ltd | Endoscopic tutorial system |
WO1999040504A1 (en) * | 1998-02-03 | 1999-08-12 | Invibro Ltd. | System and method for vibro generations |
USH2017H1 (en) * | 1998-04-02 | 2002-04-02 | The United States Of America As Represented By The Secretary Of The Air Force | Virtual reality force emulation |
KR100261883B1 (en) * | 1998-04-03 | 2000-07-15 | 정명세 | A method and an apparatus for reproducing texture |
US6717573B1 (en) * | 1998-06-23 | 2004-04-06 | Immersion Corporation | Low-cost haptic mouse implementations |
US6429846B2 (en) | 1998-06-23 | 2002-08-06 | Immersion Corporation | Haptic feedback for touchpads and other touch controls |
US6184868B1 (en) | 1998-09-17 | 2001-02-06 | Immersion Corp. | Haptic feedback control devices |
US6697043B1 (en) | 1999-12-21 | 2004-02-24 | Immersion Corporation | Haptic interface device and actuator assembly providing linear haptic sensations |
US6707443B2 (en) | 1998-06-23 | 2004-03-16 | Immersion Corporation | Haptic trackball device |
US7036094B1 (en) | 1998-08-10 | 2006-04-25 | Cybernet Systems Corporation | Behavior recognition system |
US20010008561A1 (en) * | 1999-08-10 | 2001-07-19 | Paul George V. | Real-time object tracking system |
FR2782813B1 (en) * | 1998-08-26 | 2000-10-13 | Francois Louis Edmond Minon | AN INTERFACE DEVICE BETWEEN A MACHINE AND AN OPERATOR USING THE MODIFICATIONS OF THE CHARACTERISTICS OF A FORCE EXERCISED BY THE MACHINE ON THE OPERATOR |
US6233502B1 (en) * | 1998-10-16 | 2001-05-15 | Xerox Corporation | Fault tolerant connection system for transiently connectable modular elements |
US6243622B1 (en) * | 1998-10-16 | 2001-06-05 | Xerox Corporation | Touchable user interface using self movable robotic modules |
US6233503B1 (en) * | 1998-10-16 | 2001-05-15 | Xerox Corporation | Space filling robotic polyhedra modules |
FR2786899B1 (en) * | 1998-12-03 | 2006-09-29 | Jean Bonnard | MOVEMENT INDICATOR FOR SOFTWARE |
US6483484B1 (en) | 1998-12-18 | 2002-11-19 | Semiconductor Energy Laboratory Co., Ltd. | Goggle type display system |
US6415188B1 (en) * | 1998-12-23 | 2002-07-02 | Dennis Sunga Fernandez | Method and apparatus for multi-sensor processing |
GB2345628A (en) * | 1999-01-12 | 2000-07-19 | British Aerospace | Device for indicating relative location to a user |
US7749089B1 (en) | 1999-02-26 | 2010-07-06 | Creative Kingdoms, Llc | Multi-media interactive play system |
EP1035463A1 (en) * | 1999-03-11 | 2000-09-13 | British Aerospace Public Limited Company | Device for indicating relative location to a user |
US6243624B1 (en) * | 1999-03-19 | 2001-06-05 | Northwestern University | Non-Linear muscle-like compliant controller |
US6424356B2 (en) | 1999-05-05 | 2002-07-23 | Immersion Corporation | Command of force sensations in a forceback system using force effect suites |
US6903721B2 (en) * | 1999-05-11 | 2005-06-07 | Immersion Corporation | Method and apparatus for compensating for position slip in interface devices |
AUPQ047899A0 (en) * | 1999-05-21 | 1999-06-10 | Cooke, Michael | A device for use with computer games |
JP2000343037A (en) * | 1999-06-04 | 2000-12-12 | Alps Electric Co Ltd | Vibration generator and input device for game equipment using the same |
US7561142B2 (en) * | 1999-07-01 | 2009-07-14 | Immersion Corporation | Vibrotactile haptic feedback devices |
US8169402B2 (en) * | 1999-07-01 | 2012-05-01 | Immersion Corporation | Vibrotactile haptic feedback devices |
DE20022244U1 (en) * | 1999-07-01 | 2001-11-08 | Immersion Corp | Control of vibrotactile sensations for haptic feedback devices |
US6693622B1 (en) * | 1999-07-01 | 2004-02-17 | Immersion Corporation | Vibrotactile haptic feedback devices |
US7050606B2 (en) * | 1999-08-10 | 2006-05-23 | Cybernet Systems Corporation | Tracking and gesture recognition system particularly suited to vehicular control applications |
AU6787700A (en) * | 1999-08-18 | 2001-03-13 | Immersion Corporation | Vibrotactile haptic feedback devices |
US20030031993A1 (en) * | 1999-08-30 | 2003-02-13 | Carla Pugh | Medical examination teaching and measurement system |
AU1251101A (en) * | 1999-09-09 | 2001-04-10 | Rutgers, The State Of University Of New Jersey | Remote mechanical mirroring using controlled stiffness and actuators (memica) |
DE20080209U1 (en) * | 1999-09-28 | 2001-08-09 | Immersion Corp | Control of haptic sensations for interface devices with vibrotactile feedback |
US6680729B1 (en) * | 1999-09-30 | 2004-01-20 | Immersion Corporation | Increasing force transmissibility for tactile feedback interface devices |
US7663648B1 (en) * | 1999-11-12 | 2010-02-16 | My Virtual Model Inc. | System and method for displaying selected garments on a computer-simulated mannequin |
US6743104B1 (en) | 1999-11-18 | 2004-06-01 | Nintendo Co., Ltd. | Portable game machine |
US6693626B1 (en) * | 1999-12-07 | 2004-02-17 | Immersion Corporation | Haptic feedback using a keyboard device |
US6976215B1 (en) * | 1999-12-20 | 2005-12-13 | Vulcan Patents Llc | Pushbutton user interface with functionality preview |
US6822635B2 (en) | 2000-01-19 | 2004-11-23 | Immersion Corporation | Haptic interface for laptop computers and other portable devices |
US7445550B2 (en) | 2000-02-22 | 2008-11-04 | Creative Kingdoms, Llc | Magical wand and interactive play experience |
US7878905B2 (en) | 2000-02-22 | 2011-02-01 | Creative Kingdoms, Llc | Multi-layered interactive play experience |
US6761637B2 (en) | 2000-02-22 | 2004-07-13 | Creative Kingdoms, Llc | Method of game play using RFID tracking device |
US20030098774A1 (en) * | 2000-03-21 | 2003-05-29 | Chornenky Todd E. | Security apparatus |
US6943665B2 (en) | 2000-03-21 | 2005-09-13 | T. Eric Chornenky | Human machine interface |
JP2001282140A (en) * | 2000-03-31 | 2001-10-12 | Sony Corp | Information receiving display device |
US6557853B2 (en) * | 2000-04-09 | 2003-05-06 | John D. Huettlinger | Strap device for use with a video game |
US6924787B2 (en) * | 2000-04-17 | 2005-08-02 | Immersion Corporation | Interface for controlling a graphical image |
JP3409160B2 (en) * | 2000-04-26 | 2003-05-26 | 独立行政法人産業技術総合研究所 | Grasping data input device |
US7196688B2 (en) * | 2000-05-24 | 2007-03-27 | Immersion Corporation | Haptic devices using electroactive polymers |
US7109970B1 (en) * | 2000-07-01 | 2006-09-19 | Miller Stephen S | Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements |
US7269573B1 (en) * | 2000-07-13 | 2007-09-11 | Symbol Technologies, Inc. | Virtual-product presentation system |
US7976313B2 (en) * | 2000-08-17 | 2011-07-12 | Gaumard Scientific Company, Inc. | Interactive education system for teaching patient care |
US7117136B1 (en) * | 2000-08-18 | 2006-10-03 | Linden Research, Inc. | Input and feedback system |
US7084854B1 (en) | 2000-09-28 | 2006-08-01 | Immersion Corporation | Actuator for providing tactile sensations and device for directional tactile sensations |
EP1330811B1 (en) * | 2000-09-28 | 2012-08-22 | Immersion Corporation | Directional tactile feedback for haptic feedback interface devices |
US7066781B2 (en) | 2000-10-20 | 2006-06-27 | Denise Chapman Weston | Children's toy with wireless tag/transponder |
US9625905B2 (en) * | 2001-03-30 | 2017-04-18 | Immersion Corporation | Haptic remote control for toys |
KR20020076816A (en) * | 2001-03-30 | 2002-10-11 | 주식회사 에이전텍 | The method for game using low frequency and thereof device |
US7202851B2 (en) | 2001-05-04 | 2007-04-10 | Immersion Medical Inc. | Haptic interface for palpation simulation |
IL143255A (en) | 2001-05-20 | 2015-09-24 | Simbionix Ltd | Endoscopic ultrasonography simulation |
JP4613449B2 (en) * | 2001-06-01 | 2011-01-19 | セイコーエプソン株式会社 | Output service providing system, virtual object management terminal, moving object, virtual object management terminal program, moving object program, and output service providing method |
US20020191011A1 (en) * | 2001-06-04 | 2002-12-19 | Firooz Rasouli | Virtual remote touch system |
JP2003006175A (en) * | 2001-06-26 | 2003-01-10 | Hitachi Ltd | Process-scheduling method based on program operation characteristics in performing process, program using the same and data processor |
US6937033B2 (en) | 2001-06-27 | 2005-08-30 | Immersion Corporation | Position sensor with resistive element |
US20030001874A1 (en) * | 2001-06-27 | 2003-01-02 | International Business Machines Corporation | Method and apparatus for computer input using the skin as sensory feedback |
US7056123B2 (en) | 2001-07-16 | 2006-06-06 | Immersion Corporation | Interface apparatus with cable-driven force feedback and grounded actuators |
KR20030024358A (en) * | 2001-09-18 | 2003-03-26 | 장창익 | A system for feeling virtual reality |
US7623114B2 (en) * | 2001-10-09 | 2009-11-24 | Immersion Corporation | Haptic feedback sensations based on audio output from computer devices |
US6703550B2 (en) | 2001-10-10 | 2004-03-09 | Immersion Corporation | Sound data output and manipulation using haptic feedback |
WO2003049293A1 (en) * | 2001-11-30 | 2003-06-12 | Second Sight, Llc | Floating gate digital-to-analog converter |
US20030184574A1 (en) * | 2002-02-12 | 2003-10-02 | Phillips James V. | Touch screen interface with haptic feedback device |
US20070066396A1 (en) | 2002-04-05 | 2007-03-22 | Denise Chapman Weston | Retail methods for providing an interactive product to a consumer |
US6967566B2 (en) | 2002-04-05 | 2005-11-22 | Creative Kingdoms, Llc | Live-action interactive adventure game |
US7369115B2 (en) * | 2002-04-25 | 2008-05-06 | Immersion Corporation | Haptic devices having multiple operational modes including at least one resonant mode |
US7161580B2 (en) * | 2002-04-25 | 2007-01-09 | Immersion Corporation | Haptic feedback using rotary harmonic moving mass |
EP1505484B1 (en) * | 2002-05-16 | 2012-08-15 | Sony Corporation | Inputting method and inputting apparatus |
WO2003103761A1 (en) * | 2002-06-07 | 2003-12-18 | Anthrotronix, Inc. | Wearable interface control unit |
US8316298B2 (en) * | 2002-06-18 | 2012-11-20 | Aaron Conti | Method and apparatus for providing entertainment through an interactive device |
US7161579B2 (en) * | 2002-07-18 | 2007-01-09 | Sony Computer Entertainment Inc. | Hand-held computer interactive device |
US7623115B2 (en) | 2002-07-27 | 2009-11-24 | Sony Computer Entertainment Inc. | Method and apparatus for light input device |
US8797260B2 (en) | 2002-07-27 | 2014-08-05 | Sony Computer Entertainment Inc. | Inertially trackable hand-held controller |
US7646372B2 (en) | 2003-09-15 | 2010-01-12 | Sony Computer Entertainment Inc. | Methods and systems for enabling direction detection when interfacing with a computer program |
US7102615B2 (en) | 2002-07-27 | 2006-09-05 | Sony Computer Entertainment Inc. | Man-machine interface using a deformable device |
US7883415B2 (en) | 2003-09-15 | 2011-02-08 | Sony Computer Entertainment Inc. | Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion |
US7760248B2 (en) | 2002-07-27 | 2010-07-20 | Sony Computer Entertainment Inc. | Selective sound source listening in conjunction with computer interactive processing |
US9474968B2 (en) | 2002-07-27 | 2016-10-25 | Sony Interactive Entertainment America Llc | Method and system for applying gearing effects to visual tracking |
US8686939B2 (en) | 2002-07-27 | 2014-04-01 | Sony Computer Entertainment Inc. | System, method, and apparatus for three-dimensional input control |
US8570378B2 (en) | 2002-07-27 | 2013-10-29 | Sony Computer Entertainment Inc. | Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera |
US7627139B2 (en) * | 2002-07-27 | 2009-12-01 | Sony Computer Entertainment Inc. | Computer image and audio processing of intensity and input devices for interfacing with a computer program |
US8313380B2 (en) | 2002-07-27 | 2012-11-20 | Sony Computer Entertainment America Llc | Scheme for translating movements of a hand-held controller into inputs for a system |
US9393487B2 (en) | 2002-07-27 | 2016-07-19 | Sony Interactive Entertainment Inc. | Method for mapping movements of a hand-held controller to game commands |
US9682319B2 (en) | 2002-07-31 | 2017-06-20 | Sony Interactive Entertainment Inc. | Combiner method for altering game gearing |
US7674184B2 (en) | 2002-08-01 | 2010-03-09 | Creative Kingdoms, Llc | Interactive water attraction and quest game |
US7082570B1 (en) * | 2002-08-29 | 2006-07-25 | Massachusetts Institute Of Technology | Distributed haptic interface system and method |
US20070135943A1 (en) * | 2002-09-18 | 2007-06-14 | Seiko Epson Corporation | Output service providing system that updates information based on positional information, terminal and method of providing output service |
WO2004037119A2 (en) | 2002-10-23 | 2004-05-06 | Mako Surgical Corp. | Modular femoral component for a total knee joint replacement for minimally invasive implantation |
AU2003279475A1 (en) * | 2002-12-04 | 2004-06-23 | Koninklijke Philips Electronics N.V. | Graphic user interface having touch detectability |
US8830161B2 (en) | 2002-12-08 | 2014-09-09 | Immersion Corporation | Methods and systems for providing a virtual touch haptic effect to handheld communication devices |
US8059088B2 (en) | 2002-12-08 | 2011-11-15 | Immersion Corporation | Methods and systems for providing haptic messaging to handheld communication devices |
US20060136630A1 (en) | 2002-12-08 | 2006-06-22 | Immersion Corporation, A Delaware Corporation | Methods and systems for providing haptic messaging to handheld communication devices |
US20060136631A1 (en) | 2002-12-08 | 2006-06-22 | Immersion Corporation, A Delaware Corporation | Methods and systems for providing haptic messaging to handheld communication devices |
GB2413416B8 (en) | 2002-12-08 | 2006-09-07 | Immersion Corp | Haptic massaging in handheld communication devices |
KR100537503B1 (en) * | 2002-12-31 | 2005-12-19 | 삼성전자주식회사 | Method for configuring 3D information input device, method for reconfiguring 3D information input device, method for recognizing wearable information input device, and the apparatus therefor |
US9177387B2 (en) | 2003-02-11 | 2015-11-03 | Sony Computer Entertainment Inc. | Method and apparatus for real time motion capture |
US9063633B2 (en) * | 2006-03-30 | 2015-06-23 | Arjuna Indraeswaran Rajasingham | Virtual navigation system for virtual and real spaces |
US9446319B2 (en) | 2003-03-25 | 2016-09-20 | Mq Gaming, Llc | Interactive gaming toy |
FR2853983A1 (en) * | 2003-04-17 | 2004-10-22 | Philippe Bellanger | Manual gesture assisting and training device for design field, has stimuli generator to inform position of tool relative to material, to operator by increase of reality of actions that his job implies |
CA2468481A1 (en) * | 2003-05-26 | 2004-11-26 | John T. Forbis | Multi-position rail for a barrier |
US8072470B2 (en) | 2003-05-29 | 2011-12-06 | Sony Computer Entertainment Inc. | System and method for providing a real-time three-dimensional interactive environment |
US7046151B2 (en) * | 2003-07-14 | 2006-05-16 | Michael J. Dundon | Interactive body suit and interactive limb covers |
US7850456B2 (en) | 2003-07-15 | 2010-12-14 | Simbionix Ltd. | Surgical simulation device, system and method |
US8287373B2 (en) | 2008-12-05 | 2012-10-16 | Sony Computer Entertainment Inc. | Control device for communicating visual information |
US7874917B2 (en) | 2003-09-15 | 2011-01-25 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
US9573056B2 (en) | 2005-10-26 | 2017-02-21 | Sony Interactive Entertainment Inc. | Expandable control device via hardware attachment |
US8323106B2 (en) | 2008-05-30 | 2012-12-04 | Sony Computer Entertainment America Llc | Determination of controller three-dimensional location using image analysis and ultrasonic communication |
US10279254B2 (en) | 2005-10-26 | 2019-05-07 | Sony Interactive Entertainment Inc. | Controller having visually trackable object for interfacing with a gaming system |
US8276091B2 (en) * | 2003-09-16 | 2012-09-25 | Ram Consulting | Haptic response system and method of use |
US20050080366A1 (en) * | 2003-10-09 | 2005-04-14 | Cushman William B. | Pneumatic stimulator array |
EP1524586A1 (en) * | 2003-10-17 | 2005-04-20 | Sony International (Europe) GmbH | Transmitting information to a user's body |
KR100581060B1 (en) * | 2003-11-12 | 2006-05-22 | 한국전자통신연구원 | Apparatus and method for transmission synchronized the five senses with A/V data |
JP2005151043A (en) * | 2003-11-13 | 2005-06-09 | Pioneer Electronic Corp | Data collection system and data transfer method |
US10936074B2 (en) | 2003-11-20 | 2021-03-02 | National Institute Of Advanced Industrial Science And Technology | Haptic information presentation system and method |
JP4111278B2 (en) | 2003-11-20 | 2008-07-02 | 独立行政法人産業技術総合研究所 | Haptic information presentation system |
US10416767B2 (en) | 2003-11-20 | 2019-09-17 | National Institute Of Advanced Industrial Science And Technology | Haptic information presentation system and method |
US10589087B2 (en) | 2003-11-26 | 2020-03-17 | Wicab, Inc. | Systems and methods for altering brain and body functions and for treating conditions and diseases of the same |
US20090326604A1 (en) * | 2003-11-26 | 2009-12-31 | Wicab, Inc. | Systems and methods for altering vestibular biology |
US8600550B2 (en) * | 2003-12-12 | 2013-12-03 | Kurzweil Technologies, Inc. | Virtual encounters |
US20050130108A1 (en) * | 2003-12-12 | 2005-06-16 | Kurzweil Raymond C. | Virtual encounters |
US9971398B2 (en) * | 2003-12-12 | 2018-05-15 | Beyond Imagination Inc. | Virtual encounters |
US9841809B2 (en) * | 2003-12-12 | 2017-12-12 | Kurzweil Technologies, Inc. | Virtual encounters |
US9948885B2 (en) * | 2003-12-12 | 2018-04-17 | Kurzweil Technologies, Inc. | Virtual encounters |
US7438724B2 (en) * | 2003-12-12 | 2008-10-21 | Motion Control, Inc. | System and method for force feedback |
US7742036B2 (en) | 2003-12-22 | 2010-06-22 | Immersion Corporation | System and method for controlling haptic devices having multiple operational modes |
US7112737B2 (en) * | 2003-12-31 | 2006-09-26 | Immersion Corporation | System and method for providing a haptic effect to a musical instrument |
US7663689B2 (en) | 2004-01-16 | 2010-02-16 | Sony Computer Entertainment Inc. | Method and apparatus for optimizing capture device settings through depth information |
US7289106B2 (en) * | 2004-04-01 | 2007-10-30 | Immersion Medical, Inc. | Methods and apparatus for palpation simulation |
KR20050102803A (en) * | 2004-04-23 | 2005-10-27 | 삼성전자주식회사 | Apparatus, system and method for virtual user interface |
JP4171046B2 (en) * | 2004-05-25 | 2008-10-22 | 株式会社ソニー・コンピュータエンタテインメント | Input device and method, character input method |
US7376903B2 (en) * | 2004-06-29 | 2008-05-20 | Ge Medical Systems Information Technologies | 3D display system and method |
US20050285853A1 (en) * | 2004-06-29 | 2005-12-29 | Ge Medical Systems Information Technologies, Inc. | 3D display system and method |
US20050285854A1 (en) * | 2004-06-29 | 2005-12-29 | Ge Medical Systems Information Technologies, Inc. | 3D display system and method |
US20050285844A1 (en) * | 2004-06-29 | 2005-12-29 | Ge Medical Systems Information Technologies, Inc. | 3D display system and method |
US20060017691A1 (en) | 2004-07-23 | 2006-01-26 | Juan Manuel Cruz-Hernandez | System and method for controlling audio output associated with haptic effects |
US20060025690A1 (en) * | 2004-07-27 | 2006-02-02 | Guigne Jacques Y | Acoustic body examination |
CA2578653A1 (en) | 2004-07-29 | 2006-02-09 | Kevin Ferguson | A human movement measurement system |
US20110191674A1 (en) * | 2004-08-06 | 2011-08-04 | Sensable Technologies, Inc. | Virtual musical interface in a haptic virtual environment |
US8547401B2 (en) | 2004-08-19 | 2013-10-01 | Sony Computer Entertainment Inc. | Portable augmented reality device and method |
KR100594117B1 (en) * | 2004-09-20 | 2006-06-28 | 삼성전자주식회사 | Apparatus and method for inputting key using biosignal in HMD information terminal |
JP4860625B2 (en) | 2004-10-08 | 2012-01-25 | イマージョン コーポレーション | Haptic feedback for simulating buttons and scrolling motion on touch input devices |
EP1834127A4 (en) * | 2005-01-04 | 2012-08-15 | Coactive Drive Corp | Vibration device |
US20060229058A1 (en) * | 2005-10-29 | 2006-10-12 | Outland Research | Real-time person-to-person communication using geospatial addressing |
US7562117B2 (en) | 2005-09-09 | 2009-07-14 | Outland Research, Llc | System, method and computer program product for collaborative broadcast media |
US7489979B2 (en) | 2005-01-27 | 2009-02-10 | Outland Research, Llc | System, method and computer program product for rejecting or deferring the playing of a media file retrieved by an automated process |
US20060195361A1 (en) * | 2005-10-01 | 2006-08-31 | Outland Research | Location-based demographic profiling system and method of use |
US20070189544A1 (en) | 2005-01-15 | 2007-08-16 | Outland Research, Llc | Ambient sound responsive media player |
US20060161621A1 (en) * | 2005-01-15 | 2006-07-20 | Outland Research, Llc | System, method and computer program product for collaboration and synchronization of media content on a plurality of media players |
US7542816B2 (en) | 2005-01-27 | 2009-06-02 | Outland Research, Llc | System, method and computer program product for automatically selecting, suggesting and playing music media files |
US20060179056A1 (en) * | 2005-10-12 | 2006-08-10 | Outland Research | Enhanced storage and retrieval of spatially associated information |
US20060173828A1 (en) * | 2005-02-01 | 2006-08-03 | Outland Research, Llc | Methods and apparatus for using personal background data to improve the organization of documents retrieved in response to a search query |
US20060179044A1 (en) * | 2005-02-04 | 2006-08-10 | Outland Research, Llc | Methods and apparatus for using life-context of a user to improve the organization of documents retrieved in response to a search query from that user |
US20060253210A1 (en) * | 2005-03-26 | 2006-11-09 | Outland Research, Llc | Intelligent Pace-Setting Portable Media Player |
US20060223637A1 (en) * | 2005-03-31 | 2006-10-05 | Outland Research, Llc | Video game system combining gaming simulation with remote robot control and remote robot feedback |
US20060223635A1 (en) * | 2005-04-04 | 2006-10-05 | Outland Research | method and apparatus for an on-screen/off-screen first person gaming experience |
US20080174566A1 (en) * | 2005-04-21 | 2008-07-24 | Maria Fernanda Zuniga Zabala | System For the Perception of Images Through Touch |
US20060241864A1 (en) * | 2005-04-22 | 2006-10-26 | Outland Research, Llc | Method and apparatus for point-and-send data transfer within an ubiquitous computing environment |
BRPI0612446A2 (en) * | 2005-05-12 | 2010-11-23 | Stimtrainer Inc | frequency stimulation instructor |
US20060256007A1 (en) * | 2005-05-13 | 2006-11-16 | Outland Research, Llc | Triangulation method and apparatus for targeting and accessing spatially associated information |
US20060271286A1 (en) * | 2005-05-27 | 2006-11-30 | Outland Research, Llc | Image-enhanced vehicle navigation systems and methods |
KR100703701B1 (en) * | 2005-06-14 | 2007-04-06 | 삼성전자주식회사 | Method and apparatus for providing tactile information effectively |
US20060186197A1 (en) * | 2005-06-16 | 2006-08-24 | Outland Research | Method and apparatus for wireless customer interaction with the attendants working in a restaurant |
US8981682B2 (en) | 2005-06-27 | 2015-03-17 | Coactive Drive Corporation | Asymmetric and general vibration waveforms from multiple synchronized vibration actuators |
JP5275025B2 (en) | 2005-06-27 | 2013-08-28 | コアクティヴ・ドライヴ・コーポレイション | Synchronous vibrator for tactile feedback |
US9764357B2 (en) | 2005-06-27 | 2017-09-19 | General Vibration Corporation | Synchronized array of vibration actuators in an integrated module |
US11203041B2 (en) | 2005-06-27 | 2021-12-21 | General Vibration Corporation | Haptic game controller with dual linear vibration actuators |
US9802225B2 (en) * | 2005-06-27 | 2017-10-31 | General Vibration Corporation | Differential haptic guidance for personal navigation |
US9459632B2 (en) | 2005-06-27 | 2016-10-04 | Coactive Drive Corporation | Synchronized array of vibration actuators in a network topology |
US7519537B2 (en) | 2005-07-19 | 2009-04-14 | Outland Research, Llc | Method and apparatus for a verbo-manual gesture interface |
US8139803B2 (en) * | 2005-08-15 | 2012-03-20 | Immerz, Inc. | Systems and methods for haptic sound |
US7927216B2 (en) | 2005-09-15 | 2011-04-19 | Nintendo Co., Ltd. | Video game system with wireless modular handheld controller |
US8313379B2 (en) | 2005-08-22 | 2012-11-20 | Nintendo Co., Ltd. | Video game system with wireless modular handheld controller |
JP4805633B2 (en) | 2005-08-22 | 2011-11-02 | 任天堂株式会社 | Game operation device |
US7942745B2 (en) | 2005-08-22 | 2011-05-17 | Nintendo Co., Ltd. | Game operating device |
US8870655B2 (en) | 2005-08-24 | 2014-10-28 | Nintendo Co., Ltd. | Wireless game controllers |
JP4262726B2 (en) | 2005-08-24 | 2009-05-13 | 任天堂株式会社 | Game controller and game system |
US8308563B2 (en) | 2005-08-30 | 2012-11-13 | Nintendo Co., Ltd. | Game system and storage medium having game program stored thereon |
WO2007030603A2 (en) | 2005-09-08 | 2007-03-15 | Wms Gaming Inc. | Gaming machine having display with sensory feedback |
US8157651B2 (en) | 2005-09-12 | 2012-04-17 | Nintendo Co., Ltd. | Information processing program |
US8176101B2 (en) | 2006-02-07 | 2012-05-08 | Google Inc. | Collaborative rejection of media for physical establishments |
US7917148B2 (en) * | 2005-09-23 | 2011-03-29 | Outland Research, Llc | Social musical media rating system and method for localized establishments |
US7577522B2 (en) * | 2005-12-05 | 2009-08-18 | Outland Research, Llc | Spatially associated personal reminder system and method |
US7586032B2 (en) | 2005-10-07 | 2009-09-08 | Outland Research, Llc | Shake responsive portable media player |
US20070083323A1 (en) * | 2005-10-07 | 2007-04-12 | Outland Research | Personal cuing for spatially associated information |
US20070178966A1 (en) * | 2005-11-03 | 2007-08-02 | Kip Pohlman | Video game controller with expansion panel |
US20070123390A1 (en) * | 2005-11-29 | 2007-05-31 | Mathis Christopher E | Exercise equipment with interactive gaming component |
US20070132722A1 (en) * | 2005-12-08 | 2007-06-14 | Electronics And Telecommunications Research Institute | Hand interface glove using miniaturized absolute position sensors and hand interface system using the same |
US20070145680A1 (en) * | 2005-12-15 | 2007-06-28 | Outland Research, Llc | Shake Responsive Portable Computing Device for Simulating a Randomization Object Used In a Game Of Chance |
US7811239B2 (en) * | 2005-12-29 | 2010-10-12 | Intrapartum, Llc | Cervical dilation measurement apparatus |
US7978081B2 (en) | 2006-01-09 | 2011-07-12 | Applied Technology Holdings, Inc. | Apparatus, systems, and methods for communicating biometric and biomechanical information |
JP4151982B2 (en) | 2006-03-10 | 2008-09-17 | 任天堂株式会社 | Motion discrimination device and motion discrimination program |
JP4684147B2 (en) | 2006-03-28 | 2011-05-18 | 任天堂株式会社 | Inclination calculation device, inclination calculation program, game device, and game program |
WO2007117418A2 (en) * | 2006-03-31 | 2007-10-18 | Wms Gaming Inc. | Portable wagering game with vibrational cues and feedback mechanism |
JP5714226B2 (en) * | 2006-05-09 | 2015-05-07 | ディズニー エンタープライゼス インコーポレイテッド | Interactive animation control method, storage medium, and control system |
JP2007331066A (en) * | 2006-06-15 | 2007-12-27 | Canon Inc | Contact presenting device and method |
WO2007148266A1 (en) * | 2006-06-19 | 2007-12-27 | Ambx Uk Limited | Game enhancer |
US20110044501A1 (en) * | 2006-07-14 | 2011-02-24 | Ailive, Inc. | Systems and methods for personalized motion control |
US8781151B2 (en) | 2006-09-28 | 2014-07-15 | Sony Computer Entertainment Inc. | Object detection using video input combined with tilt angle information |
US8310656B2 (en) | 2006-09-28 | 2012-11-13 | Sony Computer Entertainment America Llc | Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen |
USRE48417E1 (en) | 2006-09-28 | 2021-02-02 | Sony Interactive Entertainment Inc. | Object direction using video input combined with tilt angle information |
JP4926799B2 (en) * | 2006-10-23 | 2012-05-09 | キヤノン株式会社 | Information processing apparatus and information processing method |
JP4921113B2 (en) * | 2006-10-25 | 2012-04-25 | キヤノン株式会社 | Contact presentation apparatus and method |
TWI434718B (en) * | 2006-12-07 | 2014-04-21 | Cel Kom Llc | Tactile wearable gaming device |
WO2008087629A2 (en) | 2007-01-16 | 2008-07-24 | Simbionix Ltd. | Preoperative surgical simulation |
US8543338B2 (en) | 2007-01-16 | 2013-09-24 | Simbionix Ltd. | System and method for performing computerized simulations for image-guided procedures using a patient specific model |
JP5127242B2 (en) | 2007-01-19 | 2013-01-23 | 任天堂株式会社 | Acceleration data processing program and game program |
KR100860412B1 (en) * | 2007-02-02 | 2008-09-26 | 한국전자통신연구원 | System and Method for haptic experience service |
US7830361B2 (en) * | 2007-03-30 | 2010-11-09 | Sony Corporation | Haptic interface system for video systems |
US8203530B2 (en) * | 2007-04-24 | 2012-06-19 | Kuo-Ching Chiang | Method of controlling virtual object by user's figure or finger motion for electronic device |
US8621348B2 (en) * | 2007-05-25 | 2013-12-31 | Immersion Corporation | Customizing haptic effects on an end user device |
US9268401B2 (en) | 2007-07-30 | 2016-02-23 | University Of Utah Research Foundation | Multidirectional controller with shear feedback |
WO2009018330A2 (en) * | 2007-07-30 | 2009-02-05 | University Of Utah Research Foundation | Shear tactile display system for communicating direction and other tactile cues |
US7850537B2 (en) * | 2007-08-21 | 2010-12-14 | Stern Ben D | Vibration-based training device and method |
JP4989383B2 (en) | 2007-09-10 | 2012-08-01 | キヤノン株式会社 | Information processing apparatus and information processing method |
KR101366077B1 (en) * | 2007-12-06 | 2014-02-21 | 삼성전자주식회사 | Module for measuring character linked to exercise, system for analyzing character linked to exercise with the module, and method for applying the module |
US8542907B2 (en) | 2007-12-17 | 2013-09-24 | Sony Computer Entertainment America Llc | Dynamic three-dimensional object mapping for user-defined control device |
KR100941638B1 (en) * | 2007-12-18 | 2010-02-11 | 한국전자통신연구원 | Touching behavior recognition system and method |
WO2009082682A1 (en) * | 2007-12-21 | 2009-07-02 | Virginia Commonwealth University | Kinesthetically concordant optical, haptic image sensing device |
US8123660B2 (en) | 2007-12-28 | 2012-02-28 | Immersion Corporation | Method and apparatus for providing communications with haptic cues |
US9274612B2 (en) | 2008-01-04 | 2016-03-01 | Tactus Technology, Inc. | User interface system |
US9423875B2 (en) | 2008-01-04 | 2016-08-23 | Tactus Technology, Inc. | Dynamic tactile interface with exhibiting optical dispersion characteristics |
US9612659B2 (en) | 2008-01-04 | 2017-04-04 | Tactus Technology, Inc. | User interface system |
US9588683B2 (en) | 2008-01-04 | 2017-03-07 | Tactus Technology, Inc. | Dynamic tactile interface |
US8243038B2 (en) | 2009-07-03 | 2012-08-14 | Tactus Technologies | Method for adjusting the user interface of a device |
US9013417B2 (en) | 2008-01-04 | 2015-04-21 | Tactus Technology, Inc. | User interface system |
US8587541B2 (en) | 2010-04-19 | 2013-11-19 | Tactus Technology, Inc. | Method for actuating a tactile interface layer |
US8922502B2 (en) | 2008-01-04 | 2014-12-30 | Tactus Technology, Inc. | User interface system |
US9760172B2 (en) | 2008-01-04 | 2017-09-12 | Tactus Technology, Inc. | Dynamic tactile interface |
US8922510B2 (en) | 2008-01-04 | 2014-12-30 | Tactus Technology, Inc. | User interface system |
US9367132B2 (en) | 2008-01-04 | 2016-06-14 | Tactus Technology, Inc. | User interface system |
US8553005B2 (en) | 2008-01-04 | 2013-10-08 | Tactus Technology, Inc. | User interface system |
US8154527B2 (en) | 2008-01-04 | 2012-04-10 | Tactus Technology | User interface system |
US8456438B2 (en) | 2008-01-04 | 2013-06-04 | Tactus Technology, Inc. | User interface system |
US9720501B2 (en) | 2008-01-04 | 2017-08-01 | Tactus Technology, Inc. | Dynamic tactile interface |
US9063627B2 (en) | 2008-01-04 | 2015-06-23 | Tactus Technology, Inc. | User interface and methods |
US9557915B2 (en) | 2008-01-04 | 2017-01-31 | Tactus Technology, Inc. | Dynamic tactile interface |
US8547339B2 (en) | 2008-01-04 | 2013-10-01 | Tactus Technology, Inc. | System and methods for raised touch screens |
US9052790B2 (en) | 2008-01-04 | 2015-06-09 | Tactus Technology, Inc. | User interface and methods |
US9298261B2 (en) | 2008-01-04 | 2016-03-29 | Tactus Technology, Inc. | Method for actuating a tactile interface layer |
US8570295B2 (en) | 2008-01-04 | 2013-10-29 | Tactus Technology, Inc. | User interface system |
US8947383B2 (en) | 2008-01-04 | 2015-02-03 | Tactus Technology, Inc. | User interface system and method |
US9552065B2 (en) | 2008-01-04 | 2017-01-24 | Tactus Technology, Inc. | Dynamic tactile interface |
US9372565B2 (en) | 2008-01-04 | 2016-06-21 | Tactus Technology, Inc. | Dynamic tactile interface |
KR100927009B1 (en) * | 2008-02-04 | 2009-11-16 | 광주과학기술원 | Haptic interaction method and system in augmented reality |
CN102016877B (en) | 2008-02-27 | 2014-12-10 | 索尼计算机娱乐美国有限责任公司 | Methods for capturing depth data of a scene and applying computer actions |
US8326462B1 (en) * | 2008-03-12 | 2012-12-04 | University Of Utah Research Foundation | Tactile contact and impact displays and associated methods |
US8203529B2 (en) * | 2008-03-13 | 2012-06-19 | International Business Machines Corporation | Tactile input/output device and system to represent and manipulate computer-generated surfaces |
US8350843B2 (en) * | 2008-03-13 | 2013-01-08 | International Business Machines Corporation | Virtual hand: a new 3-D haptic interface and system for virtual environments |
US8368753B2 (en) | 2008-03-17 | 2013-02-05 | Sony Computer Entertainment America Llc | Controller with an integrated depth camera |
US20110032090A1 (en) * | 2008-04-15 | 2011-02-10 | Provancher William R | Active Handrest For Haptic Guidance and Ergonomic Support |
US9274601B2 (en) * | 2008-04-24 | 2016-03-01 | Blackberry Limited | System and method for generating a feedback signal in response to an input signal provided to an electronic device |
DE602008005110D1 (en) | 2008-04-24 | 2011-04-07 | Research In Motion Ltd | A system and method for generating a feedback signal in response to an input signal to an electronic device |
JP4645678B2 (en) * | 2008-05-08 | 2011-03-09 | ソニー株式会社 | Information input / output device, information input / output method, and computer program |
US8880156B2 (en) | 2008-05-08 | 2014-11-04 | Koninklijke Philips N.V. | Method and system for determining a physiological condition using a two-dimensional representation of R-R intervals |
CN102016759A (en) * | 2008-05-09 | 2011-04-13 | 皇家飞利浦电子股份有限公司 | Method and system for conveying an emotion |
US20100013613A1 (en) * | 2008-07-08 | 2010-01-21 | Jonathan Samuel Weston | Haptic feedback projection system |
US8380561B1 (en) * | 2008-07-30 | 2013-02-19 | Immersion Corporation | Method and apparatus for scoring haptic devices |
US10532466B2 (en) * | 2008-08-22 | 2020-01-14 | Titan Medical Inc. | Robotic hand controller |
US8332072B1 (en) | 2008-08-22 | 2012-12-11 | Titan Medical Inc. | Robotic hand controller |
MX2011003854A (en) * | 2008-10-10 | 2011-06-09 | Internet Services Llc | Haptic otuput device for use with haptic encoded media. |
JP4793422B2 (en) * | 2008-10-10 | 2011-10-12 | ソニー株式会社 | Information processing apparatus, information processing method, information processing system, and information processing program |
KR101557025B1 (en) * | 2008-11-14 | 2015-10-05 | 삼성전자주식회사 | 3 3d interface apparatus and interface method using the same |
US8961313B2 (en) | 2009-05-29 | 2015-02-24 | Sony Computer Entertainment America Llc | Multi-positional three-dimensional controller |
US20100146395A1 (en) * | 2008-12-08 | 2010-06-10 | Gustavo De Los Reyes | Method and System for Exploiting Interactions Via A Virtual Environment |
US8362882B2 (en) * | 2008-12-10 | 2013-01-29 | Immersion Corporation | Method and apparatus for providing Haptic feedback from Haptic textile |
US7843277B2 (en) * | 2008-12-16 | 2010-11-30 | Immersion Corporation | Haptic feedback generation based on resonant frequency |
EP2380074B1 (en) | 2008-12-19 | 2016-11-16 | Koninklijke Philips N.V. | Apparatus and method for providing a user interface to an information processing system |
US20100167820A1 (en) * | 2008-12-29 | 2010-07-01 | Houssam Barakat | Human interface device |
US9588684B2 (en) | 2009-01-05 | 2017-03-07 | Tactus Technology, Inc. | Tactile interface for a computing device |
KR20100088094A (en) * | 2009-01-29 | 2010-08-06 | 삼성전자주식회사 | Device for object manipulation with multi-input sources |
US8610548B1 (en) | 2009-02-03 | 2013-12-17 | University Of Utah Research Foundation | Compact shear tactile feedback device and related methods |
US9171531B2 (en) * | 2009-02-13 | 2015-10-27 | Commissariat À L'Energie et aux Energies Alternatives | Device and method for interpreting musical gestures |
US10007340B2 (en) | 2009-03-12 | 2018-06-26 | Immersion Corporation | Systems and methods for interfaces featuring surface-based haptic effects |
US9746923B2 (en) | 2009-03-12 | 2017-08-29 | Immersion Corporation | Systems and methods for providing features in a friction display wherein a haptic effect is configured to vary the coefficient of friction |
US9696803B2 (en) | 2009-03-12 | 2017-07-04 | Immersion Corporation | Systems and methods for friction displays and additional haptic effects |
US8527657B2 (en) | 2009-03-20 | 2013-09-03 | Sony Computer Entertainment America Llc | Methods and systems for dynamically adjusting update rates in multi-player network gaming |
US8698736B2 (en) * | 2009-03-24 | 2014-04-15 | Immersion Corporation | Handheld computer interface with haptic feedback |
US20100262047A1 (en) * | 2009-04-08 | 2010-10-14 | Drexel University | Physical therapy systems and methods |
US8342963B2 (en) | 2009-04-10 | 2013-01-01 | Sony Computer Entertainment America Inc. | Methods and systems for enabling control of artificial intelligence game characters |
US8393964B2 (en) | 2009-05-08 | 2013-03-12 | Sony Computer Entertainment America Llc | Base station for position location |
US8142288B2 (en) | 2009-05-08 | 2012-03-27 | Sony Computer Entertainment America Llc | Base station movement detection and compensation |
KR101045825B1 (en) | 2009-05-20 | 2011-07-01 | 한국과학기술연구원 | Display system for transmitting the sense of touch and its operation method |
CN102227696B (en) * | 2009-05-21 | 2014-09-24 | 松下电器产业株式会社 | Tactile sensation processing device |
US20100306825A1 (en) * | 2009-05-27 | 2010-12-02 | Lucid Ventures, Inc. | System and method for facilitating user interaction with a simulated object associated with a physical location |
JP2012532384A (en) | 2009-07-03 | 2012-12-13 | タクタス テクノロジー | User interface expansion system |
JP5342354B2 (en) * | 2009-07-17 | 2013-11-13 | 日本放送協会 | Haptic presentation device and haptic presentation program |
CN102473034B (en) | 2009-07-22 | 2015-04-01 | 意美森公司 | System and method for providing complex haptic stimulation during input of control gestures, and relating to control of virtual equipment |
US9030404B2 (en) * | 2009-07-23 | 2015-05-12 | Qualcomm Incorporated | Method and apparatus for distributed user interfaces using wearable devices to control mobile and consumer electronic devices |
KR101107182B1 (en) | 2009-10-01 | 2012-01-25 | 충남대학교산학협력단 | Full-body Haptic Suit |
US8902050B2 (en) * | 2009-10-29 | 2014-12-02 | Immersion Corporation | Systems and methods for haptic augmentation of voice-to-text conversion |
US20110115709A1 (en) * | 2009-11-17 | 2011-05-19 | Immersion Corporation | Systems And Methods For Increasing Haptic Bandwidth In An Electronic Device |
US8994665B1 (en) | 2009-11-19 | 2015-03-31 | University Of Utah Research Foundation | Shear tactile display systems for use in vehicular directional applications |
GB0920249D0 (en) * | 2009-11-19 | 2010-01-06 | Mactaggart Scott | Actuator |
US8542105B2 (en) * | 2009-11-24 | 2013-09-24 | Immersion Corporation | Handheld computer interface with haptic feedback |
AU2010327313B2 (en) * | 2009-12-03 | 2016-01-14 | Carla Barosso | Keyboard musical instrument learning aid |
US8421634B2 (en) * | 2009-12-04 | 2013-04-16 | Microsoft Corporation | Sensing mechanical energy to appropriate the body for data input |
CN102782617B (en) | 2009-12-21 | 2015-10-07 | 泰克图斯科技公司 | User interface system |
US9239623B2 (en) | 2010-01-05 | 2016-01-19 | Tactus Technology, Inc. | Dynamic tactile interface |
US9436280B2 (en) * | 2010-01-07 | 2016-09-06 | Qualcomm Incorporated | Simulation of three-dimensional touch sensation using haptics |
IT1397737B1 (en) | 2010-01-18 | 2013-01-24 | Giovanni Saggio | EQUIPMENT AND METHOD OF DETECTION, TRAINING AND TRAINING OF MOTOR ACTIVITIES |
US8619035B2 (en) | 2010-02-10 | 2013-12-31 | Tactus Technology, Inc. | Method for assisting user input to a device |
US20110243537A1 (en) * | 2010-02-16 | 2011-10-06 | Wilson Robert P | Motion control of impedance-type haptic devices |
TW201205346A (en) * | 2010-03-17 | 2012-02-01 | Bayer Materialscience Ag | Statistic analysis of audio signals for generation of discernable feedback |
US8540571B2 (en) * | 2010-03-31 | 2013-09-24 | Immersion Corporation | System and method for providing haptic stimulus based on position |
KR20110117534A (en) * | 2010-04-21 | 2011-10-27 | 삼성전자주식회사 | Vibration control device and method |
US8655461B2 (en) * | 2010-05-25 | 2014-02-18 | Siemens Product Lifecycle Management Software Inc. | Method, system, and non-transitory computer readable storage medium for generating code for a closed-loop controller |
US20110307268A1 (en) * | 2010-06-11 | 2011-12-15 | Bright Cloud International Corp | Remote Drug Clinical Trials and Safety Monitoring Support System |
US9132352B1 (en) | 2010-06-24 | 2015-09-15 | Gregory S. Rabin | Interactive system and method for rendering an object |
CN103003775A (en) * | 2010-06-28 | 2013-03-27 | Tp视觉控股有限公司 | Enhancing content viewing experience |
FR2962566B1 (en) | 2010-07-06 | 2013-05-17 | Commissariat Energie Atomique | SIMULATION SYSTEM FOR CONTACT WITH A SURFACE BY TOUCH STIMULATION |
KR20140043697A (en) | 2010-10-20 | 2014-04-10 | 택투스 테크놀로지, 아이엔씨. | User interface system and method |
WO2012054780A1 (en) | 2010-10-20 | 2012-04-26 | Tactus Technology | User interface system |
US8692845B2 (en) * | 2010-10-28 | 2014-04-08 | Eastman Kodak Company | Head-mounted display control with image-content analysis |
US9335181B2 (en) * | 2010-11-10 | 2016-05-10 | Qualcomm Incorporated | Haptic based personal navigation |
EP2453428A1 (en) * | 2010-11-12 | 2012-05-16 | EADS Construcciones Aeronauticas, S.A. | Simulation methods and systems for the control panels of complex systems |
US8606403B2 (en) | 2010-12-14 | 2013-12-10 | Harris Corporation | Haptic interface handle with force-indicating trigger mechanism |
US8918214B2 (en) * | 2011-01-19 | 2014-12-23 | Harris Corporation | Telematic interface with directional translation |
US8918215B2 (en) * | 2011-01-19 | 2014-12-23 | Harris Corporation | Telematic interface with control signal scaling based on force sensor feedback |
WO2013039510A1 (en) * | 2011-09-16 | 2013-03-21 | Empire Technology Development Llc | Remote movement guidance |
US9349301B2 (en) | 2011-01-28 | 2016-05-24 | Empire Technology Development Llc | Sensor-based movement guidance |
EP2689304A4 (en) | 2011-03-21 | 2014-09-10 | Assa Abloy Ab | System and method of secure data entry |
US9205555B2 (en) | 2011-03-22 | 2015-12-08 | Harris Corporation | Manipulator joint-limit handling algorithm |
US9448713B2 (en) * | 2011-04-22 | 2016-09-20 | Immersion Corporation | Electro-vibrotactile display |
US8694134B2 (en) | 2011-05-05 | 2014-04-08 | Harris Corporation | Remote control interface |
US8639386B2 (en) | 2011-05-20 | 2014-01-28 | Harris Corporation | Haptic device for manipulator and vehicle control |
US9058714B2 (en) | 2011-05-23 | 2015-06-16 | Wms Gaming Inc. | Wagering game systems, wagering gaming machines, and wagering gaming chairs having haptic and thermal feedback |
US9104271B1 (en) * | 2011-06-03 | 2015-08-11 | Richard Adams | Gloved human-machine interface |
US9142083B2 (en) | 2011-06-13 | 2015-09-22 | Bally Gaming, Inc. | Convertible gaming chairs and wagering game systems and machines with a convertible gaming chair |
US9026250B2 (en) | 2011-08-17 | 2015-05-05 | Harris Corporation | Haptic manipulation system for wheelchairs |
WO2013035587A1 (en) * | 2011-09-07 | 2013-03-14 | 日本電気株式会社 | Tactile presentation system |
US9342108B2 (en) * | 2011-09-16 | 2016-05-17 | Apple Inc. | Protecting an electronic device |
US8994659B2 (en) * | 2011-09-20 | 2015-03-31 | Sony Computer Entertainment Inc. | Methods for shape detection correlated with position detection and systems for processing the same |
DE102011114535A1 (en) * | 2011-09-29 | 2013-04-04 | Eads Deutschland Gmbh | Data glove with tactile feedback information and procedures |
JP2013091114A (en) * | 2011-10-05 | 2013-05-16 | Kyokko Denki Kk | Interaction operating system |
US8996244B2 (en) | 2011-10-06 | 2015-03-31 | Harris Corporation | Improvised explosive device defeat system |
AU2012328519A1 (en) * | 2011-10-26 | 2014-06-12 | Jj Acquisition, Llc | Systems, devices, and methods for personal massage |
WO2013063394A1 (en) * | 2011-10-26 | 2013-05-02 | Cambridge Research & Development, Llc | Device for providing tactile feedback for robotic apparatus using actuation |
US9582178B2 (en) | 2011-11-07 | 2017-02-28 | Immersion Corporation | Systems and methods for multi-pressure interaction on touch-sensitive surfaces |
KR20130092189A (en) * | 2012-02-10 | 2013-08-20 | 삼성전자주식회사 | Apparatus and method for tactitle feedback |
KR102024006B1 (en) | 2012-02-10 | 2019-09-24 | 삼성전자주식회사 | Apparatus and method for controlling vibration flow between vibration devices |
US8493354B1 (en) | 2012-08-23 | 2013-07-23 | Immersion Corporation | Interactivity model for shared feedback on mobile devices |
US8711118B2 (en) * | 2012-02-15 | 2014-04-29 | Immersion Corporation | Interactivity model for shared feedback on mobile devices |
KR101850179B1 (en) | 2012-05-08 | 2018-04-18 | 노키아 테크놀로지스 오와이 | Method and apparatus for providing immersive interaction via everyday devices |
US9142105B1 (en) * | 2012-06-01 | 2015-09-22 | Jonathan M. Crofford | Haptic device capable of managing distributed force |
US9858774B1 (en) * | 2012-06-01 | 2018-01-02 | Jonathan M. Crofford | Haptic device capable of managing distributed force |
ES2435508B2 (en) * | 2012-06-19 | 2014-10-01 | Robomotion S.L. | Mobile robot with teleoperated arm through inertial motion capture system |
KR101348940B1 (en) | 2012-06-26 | 2014-01-09 | 한국과학기술연구원 | Sensory Reproduction System to transmit physical intercations in whole-body remote control of Robot |
US20140002336A1 (en) * | 2012-06-27 | 2014-01-02 | Greg D. Kaine | Peripheral device for visual and/or tactile feedback |
US9019088B2 (en) * | 2012-06-29 | 2015-04-28 | Lenovo (Singapore) Pte. Ltd. | Modulation of haptic feedback |
US9384639B2 (en) | 2012-07-05 | 2016-07-05 | Michael Joseph White | Rigid fixture for coupling one or more transducers to the upper back of the human body |
EP2875491A4 (en) * | 2012-07-19 | 2016-06-15 | Gaurav Vats | User-controlled 3d simulation for providing realistic and enhanced digital object viewing and interaction experience |
JP5978828B2 (en) * | 2012-07-25 | 2016-08-24 | 富士通株式会社 | Haptic presentation device, haptic presentation method, and haptic presentation system |
US9245428B2 (en) | 2012-08-02 | 2016-01-26 | Immersion Corporation | Systems and methods for haptic remote control gaming |
US8819812B1 (en) * | 2012-08-16 | 2014-08-26 | Amazon Technologies, Inc. | Gesture recognition for device input |
EP2895120A4 (en) | 2012-09-11 | 2016-05-25 | Erik J Shahoian | Systems and methods for haptic stimulation |
US9405417B2 (en) | 2012-09-24 | 2016-08-02 | Tactus Technology, Inc. | Dynamic tactile interface and methods |
CN104662497A (en) | 2012-09-24 | 2015-05-27 | 泰克图斯科技公司 | Dynamic tactile interface and methods |
US8954195B2 (en) | 2012-11-09 | 2015-02-10 | Harris Corporation | Hybrid gesture control haptic system |
US9046926B2 (en) | 2012-12-17 | 2015-06-02 | International Business Machines Corporation | System and method of dynamically generating a frequency pattern to realize the sense of touch in a computing device |
US9323327B2 (en) * | 2012-12-22 | 2016-04-26 | Intel Corporation | System and method for providing tactile feedback |
US9466187B2 (en) * | 2013-02-04 | 2016-10-11 | Immersion Corporation | Management of multiple wearable haptic devices |
US8965620B2 (en) | 2013-02-07 | 2015-02-24 | Harris Corporation | Systems and methods for controlling movement of unmanned vehicles |
US10315220B2 (en) | 2014-02-11 | 2019-06-11 | Vibrant Composites Inc. | Complex mass trajectories for improved haptic effect |
US10710118B2 (en) | 2014-02-11 | 2020-07-14 | Vibrant Composites Inc. | Complex mass trajectories for improved haptic effect |
US9833697B2 (en) * | 2013-03-11 | 2017-12-05 | Immersion Corporation | Haptic sensations as a function of eye gaze |
US9432492B2 (en) | 2013-03-11 | 2016-08-30 | Apple Inc. | Drop countermeasures for electronic device |
US9505032B2 (en) | 2013-03-14 | 2016-11-29 | Apple Inc. | Dynamic mass reconfiguration |
WO2014147946A1 (en) * | 2013-03-21 | 2014-09-25 | ソニー株式会社 | Acceleration sensation presentation device, acceleration sensation presentation method, and acceleration sensation presentation system |
KR102138503B1 (en) * | 2013-04-09 | 2020-07-28 | 엘지전자 주식회사 | Smart watch |
WO2014172514A1 (en) * | 2013-04-19 | 2014-10-23 | The Trustees Of The University Of Pennsylvania | Electrocautery tactile feedback systems and methods |
US20220084430A9 (en) * | 2013-05-03 | 2022-03-17 | John James Daniels | Accelerated Learning, Entertainment and Cognitive Therapy Using Augmented Reality Comprising Combined Haptic, Auditory, and Visual Stimulation |
KR102171873B1 (en) * | 2013-05-08 | 2020-10-29 | 삼성전자주식회사 | Haptic glove and Surgical robot system |
LT6113B (en) * | 2013-05-13 | 2015-02-25 | Uždaroji Akcinė Bendrovė "My Research" | A servomechanism with proportionally controlled impact force |
KR101415739B1 (en) * | 2013-06-21 | 2014-07-04 | 재단법인 실감교류인체감응솔루션연구단 | Apparatus for generating tactile sensation by using magnetic field |
US9557813B2 (en) | 2013-06-28 | 2017-01-31 | Tactus Technology, Inc. | Method for reducing perceived optical distortion |
WO2015002850A1 (en) | 2013-07-05 | 2015-01-08 | Rubin Jacob A | Whole-body human-computer interface |
US10228242B2 (en) | 2013-07-12 | 2019-03-12 | Magic Leap, Inc. | Method and system for determining user input based on gesture |
JP2015035039A (en) * | 2013-08-08 | 2015-02-19 | ソニー株式会社 | Acceleration sensation presentation device, acceleration sensation presentation method, and acceleration sensation presentation system |
US9273928B1 (en) * | 2013-09-13 | 2016-03-01 | Steven K. Uhlmann | Device for cyclically operating a firearm trigger |
US9213408B2 (en) | 2013-10-08 | 2015-12-15 | Immersion Corporation | Generating haptic effects while minimizing cascading |
US9189022B2 (en) * | 2013-11-13 | 2015-11-17 | Symbol Technologies, Llc | Wearable glove electronic device |
US9671826B2 (en) * | 2013-11-27 | 2017-06-06 | Immersion Corporation | Method and apparatus of body-mediated digital content transfer and haptic feedback |
US9198824B2 (en) * | 2013-12-10 | 2015-12-01 | G-Lovin' Enterprisess Llc | Stimulator |
US9664512B2 (en) * | 2013-12-23 | 2017-05-30 | Tilak SRINIVASAN | Orientation indication device |
US9128507B2 (en) | 2013-12-30 | 2015-09-08 | Harris Corporation | Compact haptic interface |
JP6270557B2 (en) | 2014-03-13 | 2018-01-31 | 臼田総合研究所株式会社 | Information input / output device and information input / output method |
US10032345B2 (en) * | 2014-04-02 | 2018-07-24 | Immersion Corporation | Wearable device with flexibly mounted haptic output device |
US9715257B2 (en) | 2014-04-18 | 2017-07-25 | Apple Inc. | Active screen protection for electronic device |
US9579799B2 (en) * | 2014-04-30 | 2017-02-28 | Coleman P. Parker | Robotic control system using virtual reality input |
US9372095B1 (en) * | 2014-05-08 | 2016-06-21 | Google Inc. | Mobile robots moving on a visual display |
JP6386781B2 (en) * | 2014-05-12 | 2018-09-05 | 日本放送協会 | Haptic display device |
US10379614B2 (en) * | 2014-05-19 | 2019-08-13 | Immersion Corporation | Non-collocated haptic cues in immersive environments |
US9696806B2 (en) | 2014-07-02 | 2017-07-04 | Immersion Corporation | Systems and methods for multi-output electrostatic haptic effects |
US9838009B2 (en) | 2014-08-27 | 2017-12-05 | Continental Automotive Systems, Inc. | Switch with user feedback |
WO2016038953A1 (en) * | 2014-09-10 | 2016-03-17 | ソニー株式会社 | Detection device, detection method, control device, and control method |
US9720500B2 (en) | 2014-11-07 | 2017-08-01 | Faurecia Interior Systems, Inc | Haptic touch panel assembly for a vehicle |
US9910493B2 (en) | 2014-11-07 | 2018-03-06 | Faurecia Interior Systems, Inc. | Suspension component for a haptic touch panel assembly |
FR3028745B1 (en) | 2014-11-24 | 2021-07-23 | Inst Nat Sante Rech Med | VIBROTACTILE STIMULATION DEVICE |
FR3028742B1 (en) * | 2014-11-24 | 2016-12-30 | Inst Nat Sante Rech Med | VIBROTACTILE STIMULATION DEVICE |
JP6341294B2 (en) * | 2014-12-05 | 2018-06-13 | 富士通株式会社 | Tactile sensation providing system and tactile sensation providing apparatus |
CN105807907B (en) * | 2014-12-30 | 2018-09-25 | 富泰华工业(深圳)有限公司 | Body-sensing symphony performance system and method |
US9645948B2 (en) * | 2015-01-16 | 2017-05-09 | Hamilton Sundstrand Corporation | Access key generation for computer-readable memory |
US10065113B1 (en) * | 2015-02-06 | 2018-09-04 | Gary Mostovoy | Virtual reality system with enhanced sensory effects |
US10589169B2 (en) * | 2015-02-27 | 2020-03-17 | Sony Corporation | Information processing apparatus, information processing method, and information processing system |
US9600094B2 (en) * | 2015-03-04 | 2017-03-21 | Lenovo (Singapore) Pte. Ltd. | Apparatus, method, and program product for directing motion of a writing device |
US10684485B2 (en) | 2015-03-06 | 2020-06-16 | Sony Interactive Entertainment Inc. | Tracking system for head mounted display |
US10466790B2 (en) * | 2015-03-17 | 2019-11-05 | Whirlwind VR, Inc. | System and method for processing an audio and video input in a point of view program for haptic delivery |
US10768704B2 (en) * | 2015-03-17 | 2020-09-08 | Whirlwind VR, Inc. | System and method for modulating a peripheral device based on an unscripted feed using computer vision |
US10296086B2 (en) * | 2015-03-20 | 2019-05-21 | Sony Interactive Entertainment Inc. | Dynamic gloves to convey sense of touch and movement for virtual objects in HMD rendered environments |
US10146310B2 (en) * | 2015-03-26 | 2018-12-04 | Intel Corporation | Haptic user interface control |
US10613629B2 (en) | 2015-03-27 | 2020-04-07 | Chad Laurendeau | System and method for force feedback interface devices |
KR101658513B1 (en) * | 2015-04-23 | 2016-09-21 | 한국과학기술연구원 | Tactile transmission device and User interface system having the same |
WO2016187375A1 (en) | 2015-05-19 | 2016-11-24 | Sparq Laboratories, Llc | Male and female sexual aid with wireless capabilities |
US10275025B2 (en) * | 2015-06-14 | 2019-04-30 | Sony Interactive Entertainment Inc. | Gloves that include haptic feedback for use with HMD systems |
GB2556545A (en) * | 2015-06-24 | 2018-05-30 | Baker Hughes A Ge Co Llc | Integration of heads up display with data processing |
GB201514721D0 (en) * | 2015-08-19 | 2015-09-30 | Morgan Innovation & Technology Ltd | Haptic stimulation apparatus |
US10109161B2 (en) | 2015-08-21 | 2018-10-23 | Immersion Corporation | Haptic driver with attenuation |
KR20180044946A (en) * | 2015-08-25 | 2018-05-03 | 카와사키 주코교 카부시키 카이샤 | Information sharing system and information sharing method between a plurality of robot systems |
US9802314B2 (en) * | 2015-10-01 | 2017-10-31 | Disney Enterprises, Inc. | Soft body robot for physical interaction with humans |
US10025386B2 (en) | 2015-11-09 | 2018-07-17 | Oculus Vr, Llc | Providing tactile feedback to a user through actuators moving a portion of the user's skin |
HUP1500528A1 (en) * | 2015-11-10 | 2017-05-29 | Axs Motionsystem Kft | Evaluating sensor device for digitalization of motions |
US10055948B2 (en) | 2015-11-30 | 2018-08-21 | Nike, Inc. | Apparel with ultrasonic position sensing and haptic feedback for activities |
US10025387B2 (en) * | 2015-12-08 | 2018-07-17 | Oculus Vr, Llc | Resisting user movement using actuated tendons |
JP6809712B2 (en) * | 2015-12-11 | 2021-01-06 | 学校法人慶應義塾 | Tactile presentation system, tactile presentation method, and tactile presentation program |
TWI583357B (en) | 2015-12-17 | 2017-05-21 | 財團法人工業技術研究院 | System and method for processing muscle vibration signal |
WO2017118939A1 (en) * | 2016-01-07 | 2017-07-13 | Shrivastava Harshit | Intent based inputs and forced feedback system for a virtual reality system |
US10031580B2 (en) * | 2016-01-13 | 2018-07-24 | Immersion Corporation | Systems and methods for haptically-enabled neural interfaces |
US10427038B2 (en) | 2016-01-21 | 2019-10-01 | Toccata Gaming International, Llc | Game console incorporating beam-splitter display and real world objects |
US10509468B2 (en) * | 2016-01-27 | 2019-12-17 | Tactai, Inc. | Providing fingertip tactile feedback from virtual objects |
US20180345491A1 (en) * | 2016-01-29 | 2018-12-06 | Mitsubishi Electric Corporation | Robot teaching device, and method for generating robot control program |
CN105575219A (en) * | 2016-03-07 | 2016-05-11 | 钦赛勇 | Intelligent glove |
US10317997B2 (en) * | 2016-03-11 | 2019-06-11 | Sony Interactive Entertainment Inc. | Selection of optimally positioned sensors in a glove interface object |
JP2017182495A (en) * | 2016-03-30 | 2017-10-05 | ソニー株式会社 | Information processing device, information processing method and program |
DE202016003692U1 (en) * | 2016-06-10 | 2017-09-12 | Kuka Roboter Gmbh | Haptic feedback devices for a manipulator system |
DE102016111634B4 (en) * | 2016-06-24 | 2019-04-25 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Apparatus and method for generating a tactile stimulus |
US10642356B1 (en) | 2016-06-26 | 2020-05-05 | Apple Inc. | Wearable interactive user interface |
KR101801128B1 (en) | 2016-07-07 | 2017-11-24 | 인하대학교 산학협력단 | Holistic tactile realizing system |
WO2018035019A1 (en) | 2016-08-17 | 2018-02-22 | Racing Optics, Inc. | Mobile device impact protection |
US10331218B2 (en) * | 2016-09-15 | 2019-06-25 | Real Simple Ideas, Llc | Gyroscope motion feedback device |
US9940847B1 (en) * | 2016-10-01 | 2018-04-10 | Anton Zavoyskikh | Virtual reality exercise device |
WO2018068203A1 (en) | 2016-10-11 | 2018-04-19 | Sunland Information Technology Co., Ltd. | A smart detecting and feedback system for smart piano |
US10427039B2 (en) * | 2016-12-08 | 2019-10-01 | Immersion Corporation | Haptic surround functionality |
WO2018112216A1 (en) * | 2016-12-15 | 2018-06-21 | Intuitive Surgical Operations, Inc. | Detection of user touch on controller handle |
US10627909B2 (en) * | 2017-01-10 | 2020-04-21 | Disney Enterprises, Inc. | Simulation experience with physical objects |
US10055022B2 (en) * | 2017-01-11 | 2018-08-21 | International Business Machines Corporation | Simulating obstruction in a virtual environment |
JPWO2018143021A1 (en) * | 2017-02-06 | 2019-07-04 | アルプスアルパイン株式会社 | Tactile display device |
US10123753B2 (en) * | 2017-03-28 | 2018-11-13 | Coleridge Design Associates Llc | Haptic feedback and interface systems for reproducing internal body sounds |
US10223821B2 (en) | 2017-04-25 | 2019-03-05 | Beyond Imagination Inc. | Multi-user and multi-surrogate virtual encounters |
JP6936976B2 (en) * | 2017-05-24 | 2021-09-22 | 株式会社村田製作所 | Stimulation transmitter |
US10627906B2 (en) | 2017-06-02 | 2020-04-21 | International Business Machines Corporation | Tactile display using microscale electrostatic accelerators |
KR101917101B1 (en) | 2017-06-05 | 2018-11-09 | 한국과학기술연구원 | Vibrating apparatus, system and method for generating tactile stimulation |
US10761605B1 (en) | 2017-06-08 | 2020-09-01 | Apple Inc. | Knit data input glove |
US10180721B2 (en) | 2017-06-14 | 2019-01-15 | Apple Inc. | Fabric-based devices with force sensing |
US10945484B1 (en) | 2017-06-28 | 2021-03-16 | Apple Inc. | Haptic output devices |
RU2708949C2 (en) * | 2017-07-26 | 2019-12-12 | Фёдор Валентинович Беломоев | Device and method for simulating and transmitting contact exteroceptive sensations |
US10712931B2 (en) * | 2017-08-29 | 2020-07-14 | Apple Inc. | Systems for modifying finger sensations during finger press input events |
DE102017121991A1 (en) * | 2017-09-22 | 2019-03-28 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Sensor arrangement for detecting movements of the thumb and input device and method for detecting hand and / or finger movements |
US10845876B2 (en) * | 2017-09-27 | 2020-11-24 | Contact Control Interfaces, LLC | Hand interface device utilizing haptic force gradient generation via the alignment of fingertip haptic units |
EP3731922B1 (en) | 2017-10-23 | 2024-02-21 | DataFeel Inc. | Communication devices, methods, and systems |
US10871829B2 (en) | 2017-12-05 | 2020-12-22 | Tactai, Inc. | Touch enabling process, haptic accessory, and core haptic engine to enable creation and delivery of tactile-enabled experiences with virtual objects |
CN107825393A (en) * | 2017-12-14 | 2018-03-23 | 北京工业大学 | A kind of total joint measurement type data glove |
WO2019133521A1 (en) * | 2017-12-27 | 2019-07-04 | Adesanya Olaoluwa O | Wearable computing apparatus for augmented reality, virtual reality and artificial intelligence interactions, and methods relating thereto |
US10558267B2 (en) | 2017-12-28 | 2020-02-11 | Immersion Corporation | Systems and methods for long-range interactions for virtual reality |
EP3732551A4 (en) * | 2017-12-29 | 2021-12-08 | HAPTX Inc. | Haptic feedback glove |
US10795438B2 (en) | 2018-04-05 | 2020-10-06 | Apple Inc. | Electronic finger devices with charging and storage systems |
JP6863927B2 (en) | 2018-04-25 | 2021-04-21 | ファナック株式会社 | Robot simulation device |
JP2019189159A (en) * | 2018-04-27 | 2019-10-31 | 日本電産コパル株式会社 | Seat belt vibration unit and seat belt device |
WO2019216947A1 (en) | 2018-05-09 | 2019-11-14 | Apple Inc. | Finger-mounted device with fabric |
JP6762993B2 (en) * | 2018-07-24 | 2020-09-30 | 株式会社ミツトヨ | Information transmission gloves |
GB2575820B (en) * | 2018-07-24 | 2022-11-30 | Sony Interactive Entertainment Inc | Robot interaction system and method |
JP2021192130A (en) | 2018-08-29 | 2021-12-16 | ソニーグループ株式会社 | Tactile presentation device and tactile presentation system |
US10890974B2 (en) | 2018-11-07 | 2021-01-12 | Microsoft Technology Licensing, Llc | Electromagnetically actuating a haptic feedback system |
US10529198B1 (en) * | 2018-12-27 | 2020-01-07 | Immersion Corporation | Tunable resonance haptic device |
CN110011591B (en) * | 2018-12-31 | 2022-07-05 | 瑞声科技(新加坡)有限公司 | Motor drive signal generation method, electronic device, and storage medium |
US10838486B2 (en) | 2019-02-28 | 2020-11-17 | Microsoft Technology Licensing, Llc | Virtual reality controller |
CA3074973A1 (en) * | 2019-03-08 | 2020-09-08 | Alberto Navas-Roch | Skin interface system |
US11009959B1 (en) * | 2019-05-09 | 2021-05-18 | Facebook Technologies, Llc | Haptic vibrotactile actuators on inflatable bladders and related systems and methods |
US11287505B2 (en) * | 2019-05-13 | 2022-03-29 | Cast Group Of Companies Inc. | Electronic tracking device and related system |
JP2021018546A (en) * | 2019-07-18 | 2021-02-15 | トヨタ自動車株式会社 | Communication device for vehicle and communication system for vehicle |
CN112584280B (en) * | 2019-09-27 | 2022-11-29 | 百度在线网络技术(北京)有限公司 | Control method, device, equipment and medium for intelligent equipment |
US11599257B2 (en) * | 2019-11-12 | 2023-03-07 | Cast Group Of Companies Inc. | Electronic tracking device and charging apparatus |
WO2021102291A1 (en) * | 2019-11-21 | 2021-05-27 | General Vibration Corporation | Systems and methods for producing a pure vibration force from a synchronized dual array of eccentric rotating masses |
KR20210069491A (en) * | 2019-12-03 | 2021-06-11 | 삼성전자주식회사 | Electronic apparatus and Method for controlling the display apparatus thereof |
WO2021141533A1 (en) * | 2020-01-06 | 2021-07-15 | National University Of Singapore | Glove-based human machine interface |
US11478606B1 (en) | 2020-01-08 | 2022-10-25 | New Heights Energy, LLC | Wearable devices and methods for providing therapy to a user and/or for measuring physiological parameters of the user |
EP4099135A4 (en) * | 2020-03-24 | 2023-10-11 | Sony Group Corporation | Information processing device, information processing method, computer program, and augmented reality sensing system |
JP6890355B1 (en) * | 2020-03-24 | 2021-06-18 | 株式会社エヌアンドエヌ | Information transmission device and information transmission system |
US20210326594A1 (en) * | 2020-04-17 | 2021-10-21 | James Patrick COSTELLO | Computer-generated supplemental content for video |
US20230259211A1 (en) * | 2020-09-09 | 2023-08-17 | Sony Group Corporation | Tactile presentation apparatus, tactile presentation system, tactile presentation control method, and program |
US11544343B1 (en) * | 2020-10-16 | 2023-01-03 | Splunk Inc. | Codeless anchor generation for detectable features in an environment |
EP4232886A1 (en) | 2020-10-22 | 2023-08-30 | Haptx, Inc. | Actuator and retraction mechanism for force feedback exoskeleton |
US11934583B2 (en) | 2020-10-30 | 2024-03-19 | Datafeel Inc. | Wearable data communication apparatus, kits, methods, and systems |
JPWO2022145258A1 (en) * | 2020-12-28 | 2022-07-07 | ||
US20230053132A1 (en) * | 2021-08-12 | 2023-02-16 | Triton Systems, Inc. | Arm-mounted hands-free haptic display |
Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4444205A (en) * | 1980-05-31 | 1984-04-24 | University Of Strathclyde | Apparatus for assessing joint mobility |
US4604016A (en) * | 1983-08-03 | 1986-08-05 | Joyce Stephen A | Multi-dimensional force-torque hand controller having force feedback |
US4655673A (en) * | 1983-05-10 | 1987-04-07 | Graham S. Hawkes | Apparatus providing tactile feedback to operators of remotely controlled manipulators |
US4771344A (en) * | 1986-11-13 | 1988-09-13 | James Fallacaro | System for enhancing audio and/or visual presentation |
US4917516A (en) * | 1987-02-18 | 1990-04-17 | Retter Dale J | Combination computer keyboard and mouse data entry system |
US5047952A (en) * | 1988-10-14 | 1991-09-10 | The Board Of Trustee Of The Leland Stanford Junior University | Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove |
US5184319A (en) * | 1990-02-02 | 1993-02-02 | Kramer James F | Force feedback and textures simulating interface device |
US5184009A (en) * | 1989-04-10 | 1993-02-02 | Wright Scott M | Optical attenuator movement detection system |
US5185561A (en) * | 1991-07-23 | 1993-02-09 | Digital Equipment Corporation | Torque motor as a tactile feedback device in a computer system |
US5288938A (en) * | 1990-12-05 | 1994-02-22 | Yamaha Corporation | Method and apparatus for controlling electronic tone generation in accordance with a detected type of performance gesture |
US5354162A (en) * | 1991-02-26 | 1994-10-11 | Rutgers University | Actuator system for providing force feedback to portable master support |
US5421590A (en) * | 1993-07-23 | 1995-06-06 | Commodore Electronics Limited | Multiple linked game controllers |
US5437608A (en) * | 1991-05-03 | 1995-08-01 | Jb Research, Inc. | Massaging apparatus with sequential vibration |
US5451924A (en) * | 1993-01-14 | 1995-09-19 | Massachusetts Institute Of Technology | Apparatus for providing sensory substitution of force feedback |
US5454043A (en) * | 1993-07-30 | 1995-09-26 | Mitsubishi Electric Research Laboratories, Inc. | Dynamic and static hand gesture recognition through low-level image analysis |
US5512919A (en) * | 1992-03-31 | 1996-04-30 | Pioneer Electronic Corporation | Three-dimensional coordinates input apparatus |
US5583478A (en) * | 1995-03-01 | 1996-12-10 | Renzi; Ronald | Virtual environment tactile system |
US5588139A (en) * | 1990-06-07 | 1996-12-24 | Vpl Research, Inc. | Method and system for generating objects for a multi-person virtual world using data flow networks |
US5625575A (en) * | 1993-08-03 | 1997-04-29 | Lucent Technologies Inc. | Apparatus for modelling interaction of rigid bodies |
US5631861A (en) * | 1990-02-02 | 1997-05-20 | Virtual Technologies, Inc. | Force feedback and texture simulating interface device |
US5674127A (en) * | 1995-03-07 | 1997-10-07 | Habilas, Inc. | Multisite multiplayer interactive electronic entertainment system having a partially player defined universe |
US5691898A (en) * | 1995-09-27 | 1997-11-25 | Immersion Human Interface Corp. | Safe and low cost computer peripherals with force feedback for consumer applications |
US5742278A (en) * | 1994-01-27 | 1998-04-21 | Microsoft Corporation | Force feedback joystick with digital signal processor controlled by host processor |
US5767839A (en) * | 1995-01-18 | 1998-06-16 | Immersion Human Interface Corporation | Method and apparatus for providing passive force feedback to human-computer interface systems |
US5831408A (en) * | 1992-12-02 | 1998-11-03 | Cybernet Systems Corporation | Force feedback system |
US5912658A (en) * | 1993-10-08 | 1999-06-15 | Scuola Superiore Di Studi Universitari E Di Perfezionamento S. Anna | Device operable to supply a force feedback to a physiological unit to be used in particular as an advanced interface for machines and computers |
US6037927A (en) * | 1994-07-14 | 2000-03-14 | Immersion Corporation | Method and apparatus for providing force feedback to the user of an interactive computer simulation |
US6246390B1 (en) * | 1995-01-18 | 2001-06-12 | Immersion Corporation | Multiple degree-of-freedom mechanical interface to a computer system |
US6697748B1 (en) * | 1995-08-07 | 2004-02-24 | Immersion Corporation | Digitizing system and rotary table for determining 3-D geometry of an object |
Family Cites Families (252)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3397352A (en) | 1965-03-19 | 1968-08-13 | American Standard Inc | Fan speed control means employing a vibrating contact |
US3623064A (en) | 1968-10-11 | 1971-11-23 | Bell & Howell Co | Paging receiver having cycling eccentric mass |
US3863098A (en) | 1970-09-04 | 1975-01-28 | Measurement Systems Inc | Two-axis positioning control |
US3919691A (en) | 1971-05-26 | 1975-11-11 | Bell Telephone Labor Inc | Tactile man-machine communication system |
US3875488A (en) | 1973-02-15 | 1975-04-01 | Raytheon Co | Inertially stabilized gimbal platform |
US3902687A (en) | 1973-06-25 | 1975-09-02 | Robert E Hightower | Aircraft indicator system |
US3911416A (en) | 1974-08-05 | 1975-10-07 | Motorola Inc | Silent call pager |
US4030208A (en) | 1976-01-15 | 1977-06-21 | The Singer Company | Seat vibration system for simulating aircraft buffeting |
US4115755A (en) | 1976-06-11 | 1978-09-19 | United Technologies Corporation | Aerodynamic surface load sensing |
US4052981A (en) | 1976-08-03 | 1977-10-11 | Bachmann Robert J | Massaging method and apparatus |
US4148014A (en) | 1977-04-06 | 1979-04-03 | Texas Instruments Incorporated | System with joystick to control velocity vector of a display cursor |
FR2411603A2 (en) * | 1977-12-19 | 1979-07-13 | Zarudiansky Alain | DEVICE AND METHOD FOR RECORDING OF RESTITUTION AND SYNTHESIS OF TACTILE SENSATIONS |
US4262549A (en) | 1978-05-10 | 1981-04-21 | Schwellenbach Donald D | Variable mechanical vibrator |
US4464117A (en) | 1980-08-27 | 1984-08-07 | Dr. Ing. Reiner Foerst Gmbh | Driving simulator apparatus |
NL8006091A (en) | 1980-11-07 | 1982-06-01 | Fokker Bv | FLIGHTMATTER. |
US4333070A (en) | 1981-02-06 | 1982-06-01 | Barnes Robert W | Motor vehicle fuel-waste indicator |
US4436188A (en) | 1981-11-18 | 1984-03-13 | Jones Cecil R | Controlled motion apparatus |
JPS58502189A (en) | 1981-12-24 | 1983-12-22 | ブロンベルグ ロボテルテクニ−ク ジ−エム ビ− エイチ | assembly robot |
EP0085518B1 (en) | 1982-01-22 | 1989-08-16 | British Aerospace Public Limited Company | Control apparatus |
US4560983A (en) | 1982-09-17 | 1985-12-24 | Ampex Corporation | Dynamically interactive responsive control device and system |
US4477043A (en) | 1982-12-15 | 1984-10-16 | The United States Of America As Represented By The Secretary Of The Air Force | Biodynamic resistant control stick |
US4794384A (en) | 1984-09-27 | 1988-12-27 | Xerox Corporation | Optical translator device |
US4712101A (en) | 1984-12-04 | 1987-12-08 | Cheetah Control, Inc. | Control mechanism for electronic apparatus |
US4782327A (en) | 1985-01-02 | 1988-11-01 | Victor B. Kley | Computer control |
US4791416A (en) | 1985-02-05 | 1988-12-13 | Zenith Electronics Corporation | Touch control system for controllable apparatus |
JPH0537531Y2 (en) | 1985-06-11 | 1993-09-22 | ||
DE3523188A1 (en) | 1985-06-28 | 1987-01-08 | Zeiss Carl Fa | CONTROL FOR COORDINATE MEASURING DEVICES |
GB2179775B (en) * | 1985-08-30 | 1989-01-25 | Unisys Corp | Tactile alarm system for gaining the attention of an individual |
US5103404A (en) * | 1985-12-06 | 1992-04-07 | Tensor Development, Inc. | Feedback for a manipulator |
JPS62194389A (en) | 1986-02-21 | 1987-08-26 | ミクストン株式会社 | Rotary rising and falling door |
JPS62194389U (en) | 1986-05-31 | 1987-12-10 | ||
NL8602624A (en) | 1986-10-20 | 1988-05-16 | Oce Nederland Bv | INPUT DEVICE WITH TAKTILE FEEDBACK. |
KR880005759A (en) * | 1986-10-22 | 1988-06-30 | 빈센트 죠셉 로너 | Alarm Generation Module for Paging Receiver |
NL8602697A (en) | 1986-10-27 | 1988-05-16 | Huka Bv Developments | JOYSTICK. |
US4795296A (en) | 1986-11-17 | 1989-01-03 | California Institute Of Technology | Hand-held robot end effector controller having movement and force control |
US4800721A (en) | 1987-02-13 | 1989-01-31 | Caterpillar Inc. | Force feedback lever |
US4988981B1 (en) * | 1987-03-17 | 1999-05-18 | Vpl Newco Inc | Computer data entry and manipulation apparatus and method |
US5986643A (en) | 1987-03-24 | 1999-11-16 | Sun Microsystems, Inc. | Tactile feedback mechanism for a data processing system |
US4839838A (en) | 1987-03-30 | 1989-06-13 | Labiche Mitchell | Spatial input apparatus |
US4961138A (en) | 1987-05-01 | 1990-10-02 | General Datacomm, Inc. | System and apparatus for providing three dimensions of input into a host processor |
US4868549A (en) | 1987-05-18 | 1989-09-19 | International Business Machines Corporation | Feedback mouse |
US4874998A (en) | 1987-06-11 | 1989-10-17 | International Business Machines Corporation | Magnetically levitated fine motion robot wrist with programmable compliance |
US5047942A (en) | 1987-08-06 | 1991-09-10 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Airplane takeoff and landing performance monitoring system |
JPH0191888A (en) * | 1987-10-02 | 1989-04-11 | Namco Ltd | Game machine for commercial use |
JPH0191887A (en) * | 1987-10-02 | 1989-04-11 | Namco Ltd | Game machine for commercial use |
US4823634A (en) | 1987-11-03 | 1989-04-25 | Culver Craig F | Multifunction tactile manipulatable control |
US4896554A (en) | 1987-11-03 | 1990-01-30 | Culver Craig F | Multifunction tactile manipulatable control |
US4856078A (en) | 1988-03-23 | 1989-08-08 | Zenith Electronics Corporation | DC fan speed control |
GB2220252A (en) | 1988-05-27 | 1990-01-04 | Creative Devices Res Ltd | Control device for data processing apparatus |
US4885565A (en) | 1988-06-01 | 1989-12-05 | General Motors Corporation | Touchscreen CRT with tactile feedback |
NL8801653A (en) | 1988-06-29 | 1990-01-16 | Stork Kwant Bv | OPERATING SYSTEM. |
US4857881A (en) | 1988-07-08 | 1989-08-15 | Hayes Technology | Joystick with spring disconnect |
JP2605826B2 (en) | 1988-09-16 | 1997-04-30 | 松下電器産業株式会社 | Simulated fishing equipment |
FR2638010B1 (en) | 1988-10-13 | 1991-01-18 | Acroe | MODULAR RETROACTIVE KEYBOARD AND FLAT MODULAR ACTUATOR |
US5044956A (en) | 1989-01-12 | 1991-09-03 | Atari Games Corporation | Control device such as a steering wheel for video vehicle simulator with realistic feedback forces |
US4949119A (en) | 1989-01-12 | 1990-08-14 | Atari Games Corporation | Gearshift for a vehicle simulator using computer controlled realistic real world forces |
JPH02185278A (en) | 1989-01-12 | 1990-07-19 | Taito Corp | Light beam gun shooting game device |
US5186695A (en) | 1989-02-03 | 1993-02-16 | Loredan Biomedical, Inc. | Apparatus for controlled exercise and diagnosis of human performance |
GB8904955D0 (en) | 1989-03-03 | 1989-04-12 | Atomic Energy Authority Uk | Multi-axis hand controller |
JP2868274B2 (en) | 1989-04-04 | 1999-03-10 | 旭光学工業株式会社 | Scanning exposure equipment |
US4983901A (en) | 1989-04-21 | 1991-01-08 | Allergan, Inc. | Digital electronic foot control for medical apparatus and the like |
JP2751383B2 (en) | 1989-05-09 | 1998-05-18 | オムロン株式会社 | Control device for operating feeling |
JP2819639B2 (en) | 1989-08-02 | 1998-10-30 | 日本電気株式会社 | Ink pressurization and ink supply stop mechanism |
US5076517A (en) | 1989-08-14 | 1991-12-31 | United Technologies Corporation | Programmable, linear collective control system for a helicopter |
JPH0397485A (en) | 1989-09-10 | 1991-04-23 | Jiyareko:Kk | Video game device |
JP2768771B2 (en) * | 1989-11-30 | 1998-06-25 | 有限会社アルトロン | Video game console |
US5072361A (en) | 1990-02-01 | 1991-12-10 | Sarcos Group | Force-reflective teleoperation control system |
US5255211A (en) * | 1990-02-22 | 1993-10-19 | Redmond Productions, Inc. | Methods and apparatus for generating and processing synthetic and absolute real time environments |
JPH0685820B2 (en) | 1990-04-25 | 1994-11-02 | 株式会社エポック社 | Experience game machine |
US5022384A (en) | 1990-05-14 | 1991-06-11 | Capitol Systems | Vibrating/massage chair |
GB9014130D0 (en) | 1990-06-25 | 1990-08-15 | Hewlett Packard Co | User interface |
US5547382A (en) | 1990-06-28 | 1996-08-20 | Honda Giken Kogyo Kabushiki Kaisha | Riding simulation system for motorcycles |
US5197003A (en) | 1990-08-01 | 1993-03-23 | Atari Games Corporation | Gearshift for a vehicle simulator having a solenoid for imposing a resistance force |
JPH0492691A (en) | 1990-08-07 | 1992-03-25 | Taito Corp | Steering operating device |
US5165897A (en) | 1990-08-10 | 1992-11-24 | Tini Alloy Company | Programmable tactile stimulator array system and method of operation |
JP3278150B2 (en) * | 1990-08-30 | 2002-04-30 | セイコーエプソン株式会社 | Virtual input device |
JPH04133858A (en) | 1990-09-22 | 1992-05-07 | Toyoda Gosei Co Ltd | Device for providing counter-steering force |
WO1992007350A1 (en) | 1990-10-15 | 1992-04-30 | National Biomedical Research Foundation | Three-dimensional cursor control device |
US5209661A (en) | 1990-10-29 | 1993-05-11 | Systems Control Technology, Inc. | Motor control desired dynamic load of a simulating system and method |
GB2249410B (en) * | 1990-10-30 | 1994-08-03 | Rank Cintel Ltd | Control system, especially for film and video tape transport |
US5193963A (en) | 1990-10-31 | 1993-03-16 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Force reflecting hand controller |
ATE134294T1 (en) | 1990-11-16 | 1996-03-15 | Procter & Gamble | COMPOSITION WITH PSYLLIUM |
US5059150A (en) | 1990-11-26 | 1991-10-22 | Kuo Tien H | Vibrating and sonic device for toy gun |
NL194053C (en) | 1990-12-05 | 2001-05-03 | Koninkl Philips Electronics Nv | Device with a rotationally symmetrical body. |
JP3190359B2 (en) | 1990-12-28 | 2001-07-23 | 株式会社ナムコ | Steering reaction force generator and driving method for driving simulator |
US5223776A (en) | 1990-12-31 | 1993-06-29 | Honeywell Inc. | Six-degree virtual pivot controller |
US5204600A (en) | 1991-02-06 | 1993-04-20 | Hewlett-Packard Company | Mechanical detent simulating system |
US5841423A (en) | 1991-02-15 | 1998-11-24 | Carroll, Jr.; George L. | Multifunction space bar for video screen graphics cursor control |
US5212473A (en) | 1991-02-21 | 1993-05-18 | Typeright Keyboard Corp. | Membrane keyboard and method of using same |
US5143505A (en) | 1991-02-26 | 1992-09-01 | Rutgers University | Actuator system for providing force feedback to a dextrous master glove |
JPH04291289A (en) | 1991-03-20 | 1992-10-15 | Nec Corp | Three-dimensional object tactile system |
US5203563A (en) | 1991-03-21 | 1993-04-20 | Atari Games Corporation | Shaker control device |
JP3067238B2 (en) | 1991-04-08 | 2000-07-17 | スズキ株式会社 | Motorcycle brake disc cover |
GB9108497D0 (en) | 1991-04-20 | 1991-06-05 | Ind Limited W | Human/computer interface |
GB2255808B (en) | 1991-05-16 | 1995-04-19 | Goodfire Stoves Corp | A compact turbine assembly |
JPH06508222A (en) | 1991-05-23 | 1994-09-14 | アタリ ゲームズ コーポレーション | modular display simulator |
US5146566A (en) | 1991-05-29 | 1992-09-08 | Ibm Corporation | Input/output system for computer user interface using magnetic levitation |
US5388992A (en) * | 1991-06-19 | 1995-02-14 | Audiological Engineering Corporation | Method and apparatus for tactile transduction of acoustic signals from television receivers |
JPH0523095A (en) | 1991-07-17 | 1993-02-02 | Fuji Oil Co Ltd | Production of baked confection |
JP2550201Y2 (en) * | 1991-07-30 | 1997-10-08 | 株式会社セガ・エンタープライゼス | Seat swing system, driving method thereof, and game apparatus having seat swing system |
US5175459A (en) | 1991-08-19 | 1992-12-29 | Motorola, Inc. | Low profile vibratory alerting device |
JPH0525470U (en) * | 1991-08-19 | 1993-04-02 | 本田技研工業株式会社 | Riding simulation unit |
US5186629A (en) | 1991-08-22 | 1993-02-16 | International Business Machines Corporation | Virtual graphics display capable of presenting icons and windows to the blind computer user and method |
JPH0552085A (en) | 1991-08-22 | 1993-03-02 | Mitsubishi Heavy Ind Ltd | All-casing boring machine |
JPH0549668A (en) | 1991-08-28 | 1993-03-02 | Nippon Soken Inc | Vehicle seat |
US5220260A (en) | 1991-10-24 | 1993-06-15 | Lex Computer And Management Corporation | Actuator having electronically controllable tactile responsiveness |
US5889670A (en) | 1991-10-24 | 1999-03-30 | Immersion Corporation | Method and apparatus for tactilely responsive user interface |
JPH05122991A (en) * | 1991-10-29 | 1993-05-18 | Matsushita Electric Ind Co Ltd | Motor driver |
US5228356A (en) | 1991-11-25 | 1993-07-20 | Chuang Keh Shih K | Variable effort joystick |
US5309140A (en) | 1991-11-26 | 1994-05-03 | The United States Of America As Represented By The Secretary Of The Navy | Feedback system for remotely operated vehicles |
JPH05192449A (en) | 1992-01-20 | 1993-08-03 | Taito Corp | Video type rifle-shooting battle game machine and its control method |
JPH05236785A (en) * | 1992-02-18 | 1993-09-10 | Sony Corp | Drive circuit for brushless motor |
DE4205875A1 (en) | 1992-02-26 | 1993-09-02 | Vdo Schindling | Rotary selector e.g. for manual input of data in to electronic equipment - has movement of rotary input knob controlled by motor and generator with positions defined by load data in memory |
US5559432A (en) | 1992-02-27 | 1996-09-24 | Logue; Delmar L. | Joystick generating a polar coordinates signal utilizing a rotating magnetic field within a hollow toroid core |
CA2062147C (en) | 1992-03-02 | 1995-07-25 | Kenji Hara | Multi-axial joy stick device |
US5589828A (en) | 1992-03-05 | 1996-12-31 | Armstrong; Brad A. | 6 Degrees of freedom controller with capability of tactile feedback |
JP3258125B2 (en) * | 1992-03-18 | 2002-02-18 | シチズン時計株式会社 | Electronic device with vibration alarm |
WO1993019404A1 (en) | 1992-03-18 | 1993-09-30 | Citizen Watch Co., Ltd. | Electronic machine with vibratory alarm |
JP2677315B2 (en) | 1992-04-27 | 1997-11-17 | 株式会社トミー | Driving toys |
US5368484A (en) | 1992-05-22 | 1994-11-29 | Atari Games Corp. | Vehicle simulator with realistic operating feedback |
US5366376A (en) | 1992-05-22 | 1994-11-22 | Atari Games Corporation | Driver training system and method with performance data feedback |
JP3170875B2 (en) * | 1992-05-30 | 2001-05-28 | ソニー株式会社 | Input device |
US5437607A (en) | 1992-06-02 | 1995-08-01 | Hwe, Inc. | Vibrating massage apparatus |
US5327790A (en) | 1992-06-19 | 1994-07-12 | Massachusetts Institute Of Technology | Reaction sensing torque actuator |
JPH0618341A (en) | 1992-07-02 | 1994-01-25 | Fuji Electric Co Ltd | Tactual sense transmission device |
WO1994001042A1 (en) | 1992-07-06 | 1994-01-20 | Kramer James F | Determination of kinematically constrained multi-articulated structures |
US5245320A (en) | 1992-07-09 | 1993-09-14 | Thrustmaster, Inc. | Multiport game card with configurable address |
US5313230A (en) | 1992-07-24 | 1994-05-17 | Apple Computer, Inc. | Three degree of freedom graphic object controller |
US5296871A (en) | 1992-07-27 | 1994-03-22 | Paley W Bradford | Three-dimensional mouse with tactile feedback |
JPH0647573A (en) | 1992-07-30 | 1994-02-22 | Hitachi Constr Mach Co Ltd | Device and method for machining with laser beam |
US5283970A (en) | 1992-09-25 | 1994-02-08 | Strombecker Corporation | Toy guns |
US5264768A (en) | 1992-10-06 | 1993-11-23 | Honeywell, Inc. | Active hand controller feedback loop |
US5286203A (en) | 1992-10-07 | 1994-02-15 | Aai Microflite Simulation International | Simulating horizontal stabilizer trimming in an aircraft |
US5666473A (en) | 1992-10-08 | 1997-09-09 | Science & Technology Corporation & Unm | Tactile computer aided sculpting device |
JPH06131114A (en) * | 1992-10-19 | 1994-05-13 | Res Dev Corp Of Japan | Three-dimensional data input device |
US5790108A (en) | 1992-10-23 | 1998-08-04 | University Of British Columbia | Controller |
US6131097A (en) | 1992-12-02 | 2000-10-10 | Immersion Corporation | Haptic authoring |
US5389865A (en) | 1992-12-02 | 1995-02-14 | Cybernet Systems Corporation | Method and system for providing a tactile virtual reality and manipulator defining an interface device therefor |
US5355148A (en) | 1993-01-14 | 1994-10-11 | Ast Research, Inc. | Fingerpoint mouse |
US5389849A (en) | 1993-01-20 | 1995-02-14 | Olympus Optical Co., Ltd. | Tactility providing apparatus and manipulating device using the same |
EP0607580A1 (en) | 1993-01-21 | 1994-07-27 | International Business Machines Corporation | Tactile feedback mechanism for cursor control |
FR2701583B1 (en) * | 1993-02-10 | 1995-09-22 | Crde | INFORMATION TRANSMISSION SYSTEM ESPECIALLY APPLICABLE TO PEOPLE WITH REDUCED SENSORY FUNCTIONS. |
JP3331353B2 (en) * | 1993-02-15 | 2002-10-07 | 株式会社セガ | Simulated steering device |
JP3362898B2 (en) * | 1993-03-03 | 2003-01-07 | オリンパス光学工業株式会社 | Artificial reality system |
US5541831A (en) | 1993-04-16 | 1996-07-30 | Oliver Manufacturing Co., Inc. | Computer controlled separator device |
US5456341A (en) | 1993-04-23 | 1995-10-10 | Moog Inc. | Method and apparatus for actively adjusting and controlling a resonant mass-spring system |
JP3686686B2 (en) * | 1993-05-11 | 2005-08-24 | 松下電器産業株式会社 | Haptic device, data input device, and data input device device |
JPH06324622A (en) * | 1993-05-11 | 1994-11-25 | Matsushita Electric Ind Co Ltd | Force sense indication device |
US5429140A (en) | 1993-06-04 | 1995-07-04 | Greenleaf Medical Systems, Inc. | Integrated virtual reality rehabilitation system |
US5405152A (en) | 1993-06-08 | 1995-04-11 | The Walt Disney Company | Method and apparatus for an interactive video game with physical feedback |
US5396266A (en) | 1993-06-08 | 1995-03-07 | Technical Research Associates, Inc. | Kinesthetic feedback apparatus and method |
US5513100A (en) | 1993-06-10 | 1996-04-30 | The University Of British Columbia | Velocity controller with force feedback stiffness control |
JP3105131B2 (en) * | 1993-07-02 | 2000-10-30 | 松下電器産業株式会社 | Virtual experience-based virtual experience device |
JPH0720978A (en) * | 1993-07-05 | 1995-01-24 | Sony Corp | Virtual reality device |
US5436622A (en) | 1993-07-06 | 1995-07-25 | Motorola, Inc. | Variable frequency vibratory alert method and structure |
US5466213A (en) | 1993-07-06 | 1995-11-14 | Massachusetts Institute Of Technology | Interactive robotic therapist |
JP2856036B2 (en) | 1993-07-12 | 1999-02-10 | 株式会社セガ・エンタープライゼス | Gun unit for game machine provided with slide type vibration mechanism and game device |
US5701140A (en) | 1993-07-16 | 1997-12-23 | Immersion Human Interface Corp. | Method and apparatus for providing a cursor control interface with force feedback |
US5805140A (en) | 1993-07-16 | 1998-09-08 | Immersion Corporation | High bandwidth force feedback interface using voice coils and flexures |
US5734373A (en) | 1993-07-16 | 1998-03-31 | Immersion Human Interface Corporation | Method and apparatus for controlling force feedback interface systems utilizing a host computer |
US5724264A (en) | 1993-07-16 | 1998-03-03 | Immersion Human Interface Corp. | Method and apparatus for tracking the position and orientation of a stylus and for digitizing a 3-D object |
US5721566A (en) | 1995-01-18 | 1998-02-24 | Immersion Human Interface Corp. | Method and apparatus for providing damping force feedback |
US6057828A (en) | 1993-07-16 | 2000-05-02 | Immersion Corporation | Method and apparatus for providing force sensations in virtual environments in accordance with host software |
US5739811A (en) | 1993-07-16 | 1998-04-14 | Immersion Human Interface Corporation | Method and apparatus for controlling human-computer interface systems providing force feedback |
EP0640902A3 (en) | 1993-08-26 | 1996-11-06 | Faro Technologies | Method for programming computer controlled multi-axis devices. |
US5659691A (en) * | 1993-09-23 | 1997-08-19 | Virtual Universe Corporation | Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements |
US5488362A (en) | 1993-10-01 | 1996-01-30 | Anaphase Unlimited, Inc. | Apparatus for controlling a video game |
US5625576A (en) | 1993-10-01 | 1997-04-29 | Massachusetts Institute Of Technology | Force reflecting haptic interface |
JPH07113703A (en) * | 1993-10-14 | 1995-05-02 | Fuji Electric Co Ltd | Tactile sense transmitting device |
JPH07112071A (en) * | 1993-10-18 | 1995-05-02 | Sega Enterp Ltd | Electronic game equipment provided with physical strength difference correcting mechanism |
DE4400790A1 (en) | 1993-11-10 | 1995-05-18 | Johannes Dipl Ing Geisen | GUI computer mouse with force feed back and position data |
US5473235A (en) | 1993-12-21 | 1995-12-05 | Honeywell Inc. | Moment cell counterbalance for active hand controller |
US5461711A (en) | 1993-12-22 | 1995-10-24 | Interval Research Corporation | Method and system for spatial accessing of time-based information |
JP2658851B2 (en) * | 1993-12-27 | 1997-09-30 | 日本電気株式会社 | Input device |
JP3391071B2 (en) | 1993-12-27 | 2003-03-31 | 株式会社セガ | game machine |
JPH07204345A (en) * | 1994-01-24 | 1995-08-08 | Sega Enterp Ltd | Tv game machine |
US5438529A (en) | 1994-01-26 | 1995-08-01 | Immersion Human Interface Corporation | Percussion input device for personal computer systems |
WO1995020788A1 (en) | 1994-01-27 | 1995-08-03 | Exos, Inc. | Intelligent remote multimode sense and display system utilizing haptic information compression |
JPH07219704A (en) | 1994-02-02 | 1995-08-18 | Namco Ltd | Virtual world expression device and game machine |
JP3630712B2 (en) * | 1994-02-03 | 2005-03-23 | キヤノン株式会社 | Gesture input method and apparatus |
JPH07244558A (en) * | 1994-03-07 | 1995-09-19 | Sharp Corp | Touch sense presenting device |
JPH07248873A (en) * | 1994-03-08 | 1995-09-26 | Sharp Corp | Controller using myoelectric signal |
US5482051A (en) | 1994-03-10 | 1996-01-09 | The University Of Akron | Electromyographic virtual reality system |
JP3389314B2 (en) * | 1994-03-28 | 2003-03-24 | オリンパス光学工業株式会社 | Tactile transmission device |
JPH07281818A (en) * | 1994-04-08 | 1995-10-27 | Canon Inc | Three-dimensional virtual instruction input system |
JP2665313B2 (en) | 1994-04-22 | 1997-10-22 | 国際電業株式会社 | Reaction force generator |
JPH07289736A (en) * | 1994-04-25 | 1995-11-07 | Namco Ltd | Game system and entry method to game system |
JP3406374B2 (en) * | 1994-04-30 | 2003-05-12 | 東京パーツ工業株式会社 | Small vibration motor with eccentric armature core |
US6004134A (en) | 1994-05-19 | 1999-12-21 | Exos, Inc. | Interactive simulation including force feedback |
US6160489A (en) | 1994-06-23 | 2000-12-12 | Motorola, Inc. | Wireless communication device adapted to generate a plurality of distinctive tactile alert patterns |
US5821920A (en) | 1994-07-14 | 1998-10-13 | Immersion Human Interface Corporation | Control input device for interfacing an elongated flexible object with a computer system |
US5575761A (en) | 1994-07-27 | 1996-11-19 | Hajianpour; Mohammed-Ali | Massage device applying variable-frequency vibration in a variable pulse sequence |
DE69514926T2 (en) | 1994-08-18 | 2000-10-05 | Interval Research Corp | INPUT DEVICE FOR VIDEO WITH TACTILE FEEDBACK DEPENDING ON THE CONTENT OF THE VIDEO |
WO1996007965A2 (en) | 1994-09-07 | 1996-03-14 | Philips Electronics N.V. | Virtual workspace with user-programmable tactile feedback |
US5565840A (en) * | 1994-09-21 | 1996-10-15 | Thorner; Craig | Tactile sensation generator |
US5684722A (en) | 1994-09-21 | 1997-11-04 | Thorner; Craig | Apparatus and method for generating a control signal for a tactile sensation generator |
US5669818A (en) | 1995-03-23 | 1997-09-23 | Thorner; Craig | Seat-based tactile sensation generator |
US5642469A (en) | 1994-11-03 | 1997-06-24 | University Of Washington | Direct-drive manipulator for pen-based force display |
US5666138A (en) | 1994-11-22 | 1997-09-09 | Culver; Craig F. | Interface control |
JP3236180B2 (en) | 1994-12-05 | 2001-12-10 | 日本電気株式会社 | Coordinate pointing device |
US5592401A (en) | 1995-02-28 | 1997-01-07 | Virtual Technologies, Inc. | Accurate, rapid, reliable position sensing using multiple sensing technologies |
US5930741A (en) | 1995-02-28 | 1999-07-27 | Virtual Technologies, Inc. | Accurate, rapid, reliable position sensing using multiple sensing technologies |
JPH10500516A (en) | 1995-03-13 | 1998-01-13 | フィリップス エレクトロニクス ネムローゼ フェンノートシャップ | Enables true 3D input by vertical movement of mouse or trackball |
US5542672A (en) | 1995-03-17 | 1996-08-06 | Meredith; Chris | Fishing rod and reel electronic game controller |
US5882206A (en) | 1995-03-29 | 1999-03-16 | Gillio; Robert G. | Virtual surgery system |
US5601529A (en) | 1995-04-17 | 1997-02-11 | Hwe, Inc. | Finger massage apparatus |
US5736978A (en) | 1995-05-26 | 1998-04-07 | The United States Of America As Represented By The Secretary Of The Air Force | Tactile graphics display |
US6166723A (en) | 1995-11-17 | 2000-12-26 | Immersion Corporation | Mouse interface device providing force feedback |
US5589854A (en) | 1995-06-22 | 1996-12-31 | Tsai; Ming-Chang | Touching feedback device |
DE19528457C2 (en) | 1995-08-03 | 2001-03-08 | Mannesmann Vdo Ag | Control device |
US5999168A (en) | 1995-09-27 | 1999-12-07 | Immersion Corporation | Haptic accelerator for force feedback computer peripherals |
MX9704155A (en) | 1995-10-09 | 1997-09-30 | Nintendo Co Ltd | Three-dimensional image processing system. |
US5754023A (en) | 1995-10-26 | 1998-05-19 | Cybernet Systems Corporation | Gyro-stabilized platforms for force-feedback applications |
US6100874A (en) | 1995-11-17 | 2000-08-08 | Immersion Corporation | Force feedback mouse interface |
US6639581B1 (en) | 1995-11-17 | 2003-10-28 | Immersion Corporation | Flexure mechanism for interface device |
US6704001B1 (en) | 1995-11-17 | 2004-03-09 | Immersion Corporation | Force feedback device including actuator with moving magnet |
US6061004A (en) | 1995-11-26 | 2000-05-09 | Immersion Corporation | Providing force feedback using an interface device including an indexing function |
AU1328597A (en) * | 1995-11-30 | 1997-06-19 | Virtual Technologies, Inc. | Tactile feedback man-machine interface device |
US6028593A (en) * | 1995-12-01 | 2000-02-22 | Immersion Corporation | Method and apparatus for providing simulated physical interactions within computer generated environments |
US5973670A (en) | 1996-12-31 | 1999-10-26 | International Business Machines Corporation | Tactile feedback controller for computer cursor control device |
US6211861B1 (en) | 1998-06-23 | 2001-04-03 | Immersion Corporation | Tactile mouse device |
WO1999040504A1 (en) | 1998-02-03 | 1999-08-12 | Invibro Ltd. | System and method for vibro generations |
US6912287B1 (en) * | 1998-03-18 | 2005-06-28 | Nippon Telegraph And Telephone Corporation | Wearable communication device |
US6198206B1 (en) | 1998-03-20 | 2001-03-06 | Active Control Experts, Inc. | Inertial/audio unit and construction |
US6184868B1 (en) | 1998-09-17 | 2001-02-06 | Immersion Corp. | Haptic feedback control devices |
AU6059400A (en) | 1999-07-01 | 2001-01-22 | Immersion Corporation | Controlling vibrotactile sensations for haptic feedback devices |
WO2001024158A1 (en) | 1999-09-28 | 2001-04-05 | Immersion Corporation | Controlling haptic sensations for vibrotactile feedback interface devices |
JP2001356849A (en) * | 2000-05-08 | 2001-12-26 | Ken Tamada | Business model for human interface and hardware |
JP4111013B2 (en) | 2003-03-11 | 2008-07-02 | 住友電気工業株式会社 | Wafer holder for semiconductor manufacturing apparatus and semiconductor manufacturing apparatus equipped with the same |
JP4092691B2 (en) | 2003-03-28 | 2008-05-28 | 株式会社ダイフク | Transport platform |
JP3097485U (en) | 2003-04-28 | 2004-01-29 | 花田 弘子 | apron |
JP4008381B2 (en) | 2003-05-09 | 2007-11-14 | リンナイ株式会社 | Stove top |
JP4133858B2 (en) | 2004-02-10 | 2008-08-13 | 本田技研工業株式会社 | Bicycle transmission |
JP4291289B2 (en) | 2005-03-17 | 2009-07-08 | Necシステムテクノロジー株式会社 | Electronic medical record display device, electronic medical record system, electronic medical record display method, and electronic medical record display program |
JP5052085B2 (en) | 2005-09-29 | 2012-10-17 | 株式会社半導体エネルギー研究所 | Pickup device |
JP4232829B2 (en) | 2007-02-06 | 2009-03-04 | ヤマハ株式会社 | Electronic keyboard instrument |
JP5049668B2 (en) | 2007-06-21 | 2012-10-17 | 株式会社ブリヂストン | Molding equipment |
US8638301B2 (en) * | 2008-07-15 | 2014-01-28 | Immersion Corporation | Systems and methods for transmitting haptic messages |
JP5192449B2 (en) | 2009-06-18 | 2013-05-08 | 中外炉工業株式会社 | Steel strip heating device |
JP5333171B2 (en) | 2009-11-20 | 2013-11-06 | トヨタ自動車株式会社 | Variable compression ratio engine |
JP6047573B2 (en) | 2011-09-02 | 2016-12-21 | エーエスエムエル ネザーランズ ビー.ブイ. | Radiation source |
JP6023879B2 (en) * | 2012-05-18 | 2016-11-09 | アップル インコーポレイテッド | Apparatus, method and graphical user interface for operating a user interface based on fingerprint sensor input |
US8842882B2 (en) * | 2012-06-29 | 2014-09-23 | Apple Inc. | Individualizing generic communications |
US11372536B2 (en) * | 2012-11-20 | 2022-06-28 | Samsung Electronics Company, Ltd. | Transition and interaction model for wearable electronic device |
US10551928B2 (en) * | 2012-11-20 | 2020-02-04 | Samsung Electronics Company, Ltd. | GUI transitions on wearable electronic device |
US9117451B2 (en) * | 2013-02-20 | 2015-08-25 | Google Inc. | Methods and systems for sharing of adapted voice profiles |
US20140282275A1 (en) * | 2013-03-15 | 2014-09-18 | Qualcomm Incorporated | Detection of a zooming gesture |
JP6131114B2 (en) | 2013-06-13 | 2017-05-17 | ルネサスエレクトロニクス株式会社 | Semiconductor device and manufacturing method thereof |
US9606721B2 (en) * | 2013-07-22 | 2017-03-28 | Lg Electronics Inc. | Mobile terminal and control method thereof |
JP6018341B2 (en) | 2013-08-21 | 2016-11-02 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Monitoring device |
US20150193102A1 (en) * | 2014-01-08 | 2015-07-09 | Microsoft Corporation | Multi-mode display system |
US10691332B2 (en) * | 2014-02-28 | 2020-06-23 | Samsung Electronics Company, Ltd. | Text input on an interactive display |
-
1996
- 1996-12-02 AU AU13285/97A patent/AU1328597A/en not_active Abandoned
- 1996-12-02 JP JP9520741A patent/JP2000501033A/en active Pending
- 1996-12-02 EP EP96944744A patent/EP0864145A4/en not_active Ceased
- 1996-12-02 WO PCT/US1996/019209 patent/WO1997020305A1/en not_active Application Discontinuation
-
1998
- 1998-04-24 US US09/066,608 patent/US6088017A/en not_active Expired - Lifetime
-
2000
- 2000-05-01 US US09/561,782 patent/US6275213B1/en not_active Expired - Lifetime
-
2001
- 2001-04-18 US US09/838,052 patent/US6424333B1/en not_active Expired - Lifetime
-
2002
- 2002-06-27 US US10/186,342 patent/US20030016207A1/en not_active Abandoned
-
2003
- 2003-06-13 US US10/460,157 patent/US7755602B2/en not_active Expired - Fee Related
-
2006
- 2006-10-13 US US11/580,452 patent/US20070030246A1/en not_active Abandoned
-
2007
- 2007-10-30 US US11/981,256 patent/US8368641B2/en not_active Expired - Fee Related
- 2007-10-30 US US11/981,228 patent/US7969416B2/en not_active Expired - Fee Related
- 2007-12-25 JP JP2007333078A patent/JP2008176779A/en active Pending
-
2009
- 2009-08-14 JP JP2009187992A patent/JP4782859B2/en not_active Expired - Lifetime
-
2010
- 2010-01-29 JP JP2010018916A patent/JP4938870B2/en not_active Expired - Lifetime
-
2011
- 2011-05-23 JP JP2011114707A patent/JP4808285B2/en not_active Expired - Lifetime
- 2011-12-06 JP JP2011267055A patent/JP5616317B2/en not_active Expired - Lifetime
- 2011-12-06 JP JP2011267054A patent/JP5449301B2/en not_active Expired - Lifetime
-
2014
- 2014-07-24 US US14/340,185 patent/US9690379B2/en not_active Expired - Fee Related
Patent Citations (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4444205A (en) * | 1980-05-31 | 1984-04-24 | University Of Strathclyde | Apparatus for assessing joint mobility |
US4655673A (en) * | 1983-05-10 | 1987-04-07 | Graham S. Hawkes | Apparatus providing tactile feedback to operators of remotely controlled manipulators |
US4604016A (en) * | 1983-08-03 | 1986-08-05 | Joyce Stephen A | Multi-dimensional force-torque hand controller having force feedback |
US4771344A (en) * | 1986-11-13 | 1988-09-13 | James Fallacaro | System for enhancing audio and/or visual presentation |
US4917516A (en) * | 1987-02-18 | 1990-04-17 | Retter Dale J | Combination computer keyboard and mouse data entry system |
US5280265A (en) * | 1988-10-14 | 1994-01-18 | The Board Of Trustees Of The Leland Stanford Junior University | Strain-sensing goniometers, systems and recognition algorithms |
US5047952A (en) * | 1988-10-14 | 1991-09-10 | The Board Of Trustee Of The Leland Stanford Junior University | Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove |
US5442729A (en) * | 1988-10-14 | 1995-08-15 | The Board Of Trustees Of The Leland Stanford Junior University | Strain-sensing goniometers, systems and recognition algorithms |
US5184009A (en) * | 1989-04-10 | 1993-02-02 | Wright Scott M | Optical attenuator movement detection system |
US5184319A (en) * | 1990-02-02 | 1993-02-02 | Kramer James F | Force feedback and textures simulating interface device |
US5631861A (en) * | 1990-02-02 | 1997-05-20 | Virtual Technologies, Inc. | Force feedback and texture simulating interface device |
US5588139A (en) * | 1990-06-07 | 1996-12-24 | Vpl Research, Inc. | Method and system for generating objects for a multi-person virtual world using data flow networks |
US5288938A (en) * | 1990-12-05 | 1994-02-22 | Yamaha Corporation | Method and apparatus for controlling electronic tone generation in accordance with a detected type of performance gesture |
US5354162A (en) * | 1991-02-26 | 1994-10-11 | Rutgers University | Actuator system for providing force feedback to portable master support |
US5437608A (en) * | 1991-05-03 | 1995-08-01 | Jb Research, Inc. | Massaging apparatus with sequential vibration |
US5185561A (en) * | 1991-07-23 | 1993-02-09 | Digital Equipment Corporation | Torque motor as a tactile feedback device in a computer system |
US5512919A (en) * | 1992-03-31 | 1996-04-30 | Pioneer Electronic Corporation | Three-dimensional coordinates input apparatus |
US5831408A (en) * | 1992-12-02 | 1998-11-03 | Cybernet Systems Corporation | Force feedback system |
US5451924A (en) * | 1993-01-14 | 1995-09-19 | Massachusetts Institute Of Technology | Apparatus for providing sensory substitution of force feedback |
US5421590A (en) * | 1993-07-23 | 1995-06-06 | Commodore Electronics Limited | Multiple linked game controllers |
US5454043A (en) * | 1993-07-30 | 1995-09-26 | Mitsubishi Electric Research Laboratories, Inc. | Dynamic and static hand gesture recognition through low-level image analysis |
US5625575A (en) * | 1993-08-03 | 1997-04-29 | Lucent Technologies Inc. | Apparatus for modelling interaction of rigid bodies |
US5912658A (en) * | 1993-10-08 | 1999-06-15 | Scuola Superiore Di Studi Universitari E Di Perfezionamento S. Anna | Device operable to supply a force feedback to a physiological unit to be used in particular as an advanced interface for machines and computers |
US5742278A (en) * | 1994-01-27 | 1998-04-21 | Microsoft Corporation | Force feedback joystick with digital signal processor controlled by host processor |
US6037927A (en) * | 1994-07-14 | 2000-03-14 | Immersion Corporation | Method and apparatus for providing force feedback to the user of an interactive computer simulation |
US5767839A (en) * | 1995-01-18 | 1998-06-16 | Immersion Human Interface Corporation | Method and apparatus for providing passive force feedback to human-computer interface systems |
US6246390B1 (en) * | 1995-01-18 | 2001-06-12 | Immersion Corporation | Multiple degree-of-freedom mechanical interface to a computer system |
US5583478A (en) * | 1995-03-01 | 1996-12-10 | Renzi; Ronald | Virtual environment tactile system |
US5674127A (en) * | 1995-03-07 | 1997-10-07 | Habilas, Inc. | Multisite multiplayer interactive electronic entertainment system having a partially player defined universe |
US6697748B1 (en) * | 1995-08-07 | 2004-02-24 | Immersion Corporation | Digitizing system and rotary table for determining 3-D geometry of an object |
US5691898A (en) * | 1995-09-27 | 1997-11-25 | Immersion Human Interface Corp. | Safe and low cost computer peripherals with force feedback for consumer applications |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8834266B2 (en) | 1994-09-21 | 2014-09-16 | Craig Thorner | Methods and apparatuses for generating tactile feedback for games and simulations |
US20090153365A1 (en) * | 2004-11-18 | 2009-06-18 | Fabio Salsedo | Portable haptic interface |
JP2020061184A (en) * | 2007-09-14 | 2020-04-16 | 国立研究開発法人産業技術総合研究所 | Method and apparatus for inducing illusionary tactile sense |
US8941475B2 (en) | 2007-09-18 | 2015-01-27 | Senseg Oy | Method and apparatus for sensory stimulation |
US9454880B2 (en) | 2007-09-18 | 2016-09-27 | Senseg Oy | Method and apparatus for sensory stimulation |
US20110074733A1 (en) * | 2008-05-19 | 2011-03-31 | Maekinen Ville | Interface apparatus for touch input and tactile output communication |
US9123258B2 (en) * | 2008-05-19 | 2015-09-01 | Senseg Ltd. | Interface apparatus for touch input and tactile output communication |
CN102156540A (en) * | 2011-03-29 | 2011-08-17 | 南京航空航天大学 | Three-dimensional somatosensory man-machine interactive system with vibrotactile feedback and interactive method thereof |
CN102360248A (en) * | 2011-10-11 | 2012-02-22 | 高长江 | Close fitting calculation and memory device |
US20150205352A1 (en) * | 2013-12-29 | 2015-07-23 | Immersion Corporation | Distributed control architecture for haptic devices |
US11914780B2 (en) | 2017-06-29 | 2024-02-27 | Apple Inc. | Finger-mounted device with sensors and haptics |
US20190004604A1 (en) * | 2017-06-29 | 2019-01-03 | Apple Inc. | Finger-Mounted Device With Sensors and Haptics |
US11416076B2 (en) * | 2017-06-29 | 2022-08-16 | Apple Inc. | Finger-mounted device with sensors and haptics |
TWI706313B (en) * | 2017-06-29 | 2020-10-01 | 美商蘋果公司 | Finger-mounted device with sensors and haptics |
US10838499B2 (en) * | 2017-06-29 | 2020-11-17 | Apple Inc. | Finger-mounted device with sensors and haptics |
US11037415B2 (en) | 2018-01-19 | 2021-06-15 | Toyoda Gosei Co., Ltd. | Tactile presentation device |
US10739820B2 (en) | 2018-04-30 | 2020-08-11 | Apple Inc. | Expandable ring device |
US10579099B2 (en) | 2018-04-30 | 2020-03-03 | Apple Inc. | Expandable ring device |
US11755107B1 (en) | 2019-09-23 | 2023-09-12 | Apple Inc. | Finger devices with proximity sensors |
US11709554B1 (en) | 2020-09-14 | 2023-07-25 | Apple Inc. | Finger devices with adjustable housing structures |
US11714495B2 (en) | 2020-09-14 | 2023-08-01 | Apple Inc. | Finger devices with adjustable housing structures |
US11287886B1 (en) | 2020-09-15 | 2022-03-29 | Apple Inc. | Systems for calibrating finger devices |
Also Published As
Publication number | Publication date |
---|---|
JP2008176779A (en) | 2008-07-31 |
US20080055248A1 (en) | 2008-03-06 |
US6424333B1 (en) | 2002-07-23 |
EP0864145A4 (en) | 1998-12-16 |
EP0864145A1 (en) | 1998-09-16 |
JP2012074076A (en) | 2012-04-12 |
JP4782859B2 (en) | 2011-09-28 |
US20040046777A1 (en) | 2004-03-11 |
US20080059138A1 (en) | 2008-03-06 |
AU1328597A (en) | 1997-06-19 |
JP2010134955A (en) | 2010-06-17 |
JP2000501033A (en) | 2000-02-02 |
JP2010003312A (en) | 2010-01-07 |
US6275213B1 (en) | 2001-08-14 |
US6088017A (en) | 2000-07-11 |
US20030016207A1 (en) | 2003-01-23 |
US8368641B2 (en) | 2013-02-05 |
JP5449301B2 (en) | 2014-03-19 |
US7755602B2 (en) | 2010-07-13 |
US9690379B2 (en) | 2017-06-27 |
US7969416B2 (en) | 2011-06-28 |
JP5616317B2 (en) | 2014-10-29 |
WO1997020305A1 (en) | 1997-06-05 |
JP2012074075A (en) | 2012-04-12 |
JP4938870B2 (en) | 2012-05-23 |
US20140337724A1 (en) | 2014-11-13 |
JP2011210272A (en) | 2011-10-20 |
JP4808285B2 (en) | 2011-11-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9690379B2 (en) | Tactile feedback interface device | |
JP2000501033A5 (en) | ||
JP7169590B2 (en) | Method for inducing illusionary tactile force sense and device for inducing illusionary tactile force sense | |
Pacchierotti et al. | Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives | |
Jones | Haptics | |
Bark et al. | Comparison of skin stretch and vibrotactile stimulation for feedback of proprioceptive information | |
Chen et al. | Haptivec: Presenting haptic feedback vectors in handheld controllers using embedded tactile pin arrays | |
Adilkhanov et al. | Haptic devices: Wearability-based taxonomy and literature review | |
Caldwell et al. | Mechano thermo and proprioceptor feedback for integrated haptic feedback | |
Tanaka et al. | Wearable haptic display for immersive virtual environment | |
Caldwell et al. | Tactile perception and its application to the design of multi-modal cutaneous feedback systems | |
JP2020528628A (en) | Devices and methods for simulating and transmitting non-contact receptive sensations | |
Najdovski et al. | Extending haptic device capability for 3D virtual grasping | |
Takahashi et al. | Haptic interface using tendon electrical stimulation with consideration of multimodal presentation | |
Salazar et al. | Motion guidance using haptic feedback based on vibrotactile illusions | |
Sawada et al. | A haptic device driven by grasping force for hand gesture tele-communication | |
Konyo et al. | EAP application to artificial tactile feel display of virtual reality | |
Albuquerque | Mechano Thermo and Proprioceptor Feedback for Integrated Haptic Feedback | |
Koike | Rehabilitation training using EMG interface | |
Raisamo et al. | TACTILE FEEDBACK |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: VIRTUAL TECHNOLOGIES, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TREMBLAY, MARC R.;YIM, MARK H.;REEL/FRAME:020439/0821 Effective date: 19951130 |
|
AS | Assignment |
Owner name: IMMERSION CORPORATION, CALIFORNIA Free format text: ASSIGNMENT AGREEMENT;ASSIGNOR:VIRTUAL TECHNOLOGIES, INC.;REEL/FRAME:020529/0715 Effective date: 20020211 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |