WO2000021203A1 - A method to use acoustic signals for computer communications - Google Patents

A method to use acoustic signals for computer communications Download PDF

Info

Publication number
WO2000021203A1
WO2000021203A1 PCT/IL1999/000521 IL9900521W WO0021203A1 WO 2000021203 A1 WO2000021203 A1 WO 2000021203A1 IL 9900521 W IL9900521 W IL 9900521W WO 0021203 A1 WO0021203 A1 WO 0021203A1
Authority
WO
WIPO (PCT)
Prior art keywords
computer
acoustic
microphone
sound
information
Prior art date
Application number
PCT/IL1999/000521
Other languages
French (fr)
Inventor
Alon Atsmon
Amit Antebi
Nathan Altman
Zvi Lev
Moshe Cohen
Original Assignee
Comsense Technologies, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/IL1999/000470 external-priority patent/WO2000013039A2/en
Priority claimed from PCT/IL1999/000506 external-priority patent/WO2000015316A2/en
Priority to AU59968/99A priority Critical patent/AU5996899A/en
Priority to EP99970221A priority patent/EP1121763A1/en
Priority to US09/806,618 priority patent/US7383297B1/en
Priority to CA002345736A priority patent/CA2345736A1/en
Priority to JP2000575224A priority patent/JP2002527926A/en
Application filed by Comsense Technologies, Ltd. filed Critical Comsense Technologies, Ltd.
Priority to CA002345745A priority patent/CA2345745A1/en
Priority to JP2000575071A priority patent/JP2002527012A/en
Priority to AU59972/99A priority patent/AU5997299A/en
Priority to US09/806,789 priority patent/US7334735B1/en
Priority to PCT/IL1999/000525 priority patent/WO2000021020A2/en
Priority to EP99970188A priority patent/EP1116155A2/en
Priority to PCT/IB1999/002110 priority patent/WO2000029920A2/en
Priority to EP99968002A priority patent/EP1192520A2/en
Priority to AU24557/00A priority patent/AU2455700A/en
Priority to CA002350761A priority patent/CA2350761A1/en
Priority to US09/831,935 priority patent/US7260221B1/en
Priority to JP2000582865A priority patent/JP2003531505A/en
Publication of WO2000021203A1 publication Critical patent/WO2000021203A1/en
Priority to US09/570,399 priority patent/US6607136B1/en
Priority to US10/618,962 priority patent/US7706838B2/en
Priority to US11/339,275 priority patent/US7480692B2/en
Priority to US12/007,441 priority patent/US8544753B2/en
Priority to US12/079,000 priority patent/US20100030838A1/en
Priority to US12/272,828 priority patent/US7941480B2/en
Priority to US12/752,181 priority patent/US8078136B2/en
Priority to US13/083,643 priority patent/US8935367B2/en
Priority to US13/316,710 priority patent/US8509680B2/en
Priority to US13/964,208 priority patent/US20130332355A1/en
Priority to US14/033,579 priority patent/US9361444B2/en
Priority to US14/176,278 priority patent/US8843057B2/en
Priority to US14/492,030 priority patent/US20150012441A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/30Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327Short range or proximity payments by means of M-devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/12Payment architectures specially adapted for electronic shopping systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B11/00Transmission systems employing sonic, ultrasonic or infrasonic waves

Definitions

  • the present invention relates generally to method of interaction with a computer and especially to methods that use acoustic signals for such communications.
  • Computer network components that communicate using RF radiation, wires or IR radiation are well known.
  • some home appliances are controlled using an ultrasonic remote control.
  • Other types of dedicated ultrasonic acoustic links are also known.
  • One object of some preferred embodiments of the invention is to simplify interaction between electronic devices by removing a common requirement of installing dedicated communication hardware on the devices.
  • Some suitable electronic devices include: computers (e.g., desktop and laptop), televisions, watches, PDAs (Personal Digital Assistant), organizers, electronic toys, electronic games, voice-responsive appliances, wireless communication devices, answering machines and desktop telephones.
  • the term "electronic device” is used to encompass a broad range of electronics-including devices. In some of the embodiments described below, a particular type of electronic device is singled out, for example a computer or a toy, as some of the below-described embodiments are more useful for some types of electronic devices, than for other types of electronic devices.
  • An object of some preferred embodiments of the invention is allowing electronic devices to communicate using an input and/or output channel, preferably an acoustic channel, but possibly a visual channel, which was designed for communication with human users and not for communication with electronic devices.
  • the communication channel is not originally intended for communication with outside components at all, for example, a diskette drive.
  • An object of some preferred embodiments of the invention is to allow a smart card to be read by and written to using standard computer hardware without requiring an installation of specialized hardware. This is especially useful for electronic wallets and Internet commerce, where the cost of installing dedicated hardware may prevent wide acceptance of these commercial methods. Additionally, using a smart card can provide methods of solving the security and accountability issues entailed in electronic commerce.
  • An aspect of some preferred embodiments of the invention relates to communicating with a computer using a sound card installed on the computer.
  • the installation is permanent, for example as part of the motherboard chip-set.
  • a device preferably a smart card, transmits information to the sound card's microphone and receives information from the computer using the sound card's (or the computer's) loudspeaker.
  • the transmission uses non- audible acoustic frequencies, for example ultrasonic or infrasonic frequencies.
  • standard music cards are designed for music generation, and specifically for audible audio frequencies, such as between 20 Hz and 16 kHz, however, they have a limited reception and transmission ability in the near-ultrasonic (e.g., between 16 kHz and 50 kHz) and infrasonic (e.g., 0.01 Hz to 20 or 40 Hz) frequency ranges.
  • the definition of audible frequencies will usually depend on the user and this, may, in some embodiments, impact on the selection of frequencies for use. Possibly, a personalization software for selecting the frequencies will be provided.
  • the higher end of the audible range may be used, for example 14 kHz - 16 kHz, as the sensitivity to these frequencies is quite low, even in those individuals that can detect them.
  • Ultrasonic communication has several advantages over audio communication: (a) smaller transducers can be used; (b) transmission is more efficient;
  • the ultrasonic frequencies used are low ultrasonic frequencies or high audible frequencies, for example between 15 kHz and 24 kHz, more preferably between 17 kHz and 20 kHz and, in some preferred embodiments, between 21 and 23 kHz.
  • these frequencies can be transmitted and/or received using standard audio components. For this reason, lower frequencies may be preferred over higher frequencies, even though the lower frequencies typically afford a lower data rate and are more easily disrupted.
  • These particular frequencies are suggested because they match industry standards for sampling in audio cards (e.g., "SoundBlaster"). If other sampling frequencies are available, the preferred frequency may adjusted accordingly.
  • a minimum frequency used is selected so that it is inaudible to a human. In some cases, the frequency selection may depend on the age of the human.
  • a benefit of ultrasound over RF transmission is that the range of the ultrasonic transmission can easily be controlled by varying its amplitude.
  • ultrasonic transmissions do not pass through walls, potentially providing increased security by limiting eavesdropping and inference from outside the room.
  • ultrasonic transmissions do not usually interfere with the operation of electronic equipment, even when used at a high power setting.
  • ultrasonic communication is better suited for people with pacemakers and for hospital settings.
  • Another advantage of acoustic transmission is a reduced perceived and actual health danger to the user.
  • An aspect of some preferred embodiments of the invention relates to communication between electronic devices using acoustics.
  • electronic devices may communicate using acoustics, in accordance with preferred embodiments of the invention.
  • one communication direction is acoustic and the other is non- acoustic, for example RF or IR, for example when communicating with a set-top box in accordance with a preferred embodiment of the invention (one way acoustic from the TV and the other way IR, in the same manner as with an IR remote control).
  • the acoustic waves used for communications are incorporated in sounds used for regular operation of the device which generates the sounds, for example by modulating beeps.
  • the sounds are inaudible, for example being ultrasonic, infrasonic, of a low amplitude and/or causing only small changes in amplitude and or frequency of an existing sounded signal.
  • a microphone and/or a speaker are used to communicate with the device.
  • an acoustic smart card (or an "electronic wallet” card) communicates with such a device using sound and/or ultrasound.
  • Such a smart card may transmit information stored thereon. Possibly, the information is encrypted, for example, using RSA or DSA encryption.
  • a smart card may be "swiped" at many existing computers and electronic devices, possibly requiring a simple software installation, but no hardware installation (assuming some acoustic hardware exists). Such simple swiping should ease acceptance of the card by Internet browsing home shoppers.
  • the swiping software may be downloaded as a Java Applet or as a script in a different network programming language.
  • a cellular telephone and a PDA each of which includes a microphone and a speaker
  • Another example is programming a cellular telephone with names and numbers stored in a PDA or for the cellular telephone to interrogate the PDA regarding a particular telephone number.
  • a network may be formed of a plurality of such devices, possibly, with one device forwarding messages from a first device to a second device.
  • peripherals may be connected to a computer using an acoustic connection, without requiring wiring or special hardware.
  • a single acoustic transducer microphone or speaker
  • a wireless telephone is realized using ultrasonic communication between a base station and the hand set.
  • the base station is embodied in a computer, which communicates with the telephone.
  • the wireless communication uses the same loudspeaker and/or microphone as used for communication with a person using the telephone and or the computer.
  • the handset is used for Internet telephony, via the computer without a cradle or other special connection between the computer and the telephone.
  • An aspect of some preferred embodiments of the invention relates to interfacing a device (possibly a toy) with a computer system without installing special or dedicated hardware on the computer.
  • Such interfacing may use EM-coupling into cables attached to the computer, detection of RF signals from a computer or direct input into a mouse or a keyboard.
  • the loudspeakers already installed on a computer, are used to interrogate an identification device, using ultrasound.
  • the computer's microphone is used to detect a response from the interrogated device.
  • the interrogation may comprise audible sounds.
  • ultrasonic communications may be used to download a program and or music file to a toy or other devices.
  • the program and/or music file are directly downloaded from an Internet as sound files, possibly reducing or obviating the need for a dedicated toy (or device) programming software interface.
  • the toy and/or device generate sounds in response, which sounds are transmitted back through the Internet.
  • the acoustic waves used for communication or, possibly, another set of acoustic waves may be used to determine the relative position and/or orientation of electronic devices.
  • a touch screen is emulated by interrogating a transponder on a pointing implement, using built-in speakers of an electronic device, to detect the position, orientation and/or motion of the implement, thereby identifying a location which is "touched" or pointed to.
  • the transponder is embodied using a speaker and a microphone of the pointing implement, for example if the implement is a cellular telephone.
  • one or more of the following sound generators may be available in a personal computer: built-in speaker, modem speaker and sounds generated by mechanical devices, such as a hard disk drive or a diskette drive. These sound generators may also be used for transmitting information.
  • An aspect of some preferred embodiments of the invention relates to visual communication between devices, using built in hardware.
  • a video camera which is provided with many computers, can be used to accept visual signaling from a second device.
  • Such visual signaling may be temporal, for example by flashing a screen or a LED.
  • the signaling uses a spatial code, for example, by the remote camera identifying visual spatial patterns on a screen, for example using OCR techniques.
  • the frequency of flashes is higher than perceived by a human observer, in order to reduce distraction.
  • communication between a screen and a video camera enables a wide bandwidth and/or enhanced error correction, due to the large number of transmission and reception pixels available.
  • an existing IR port is used as a source, which source is detectable by many CCD cameras.
  • An aspect of some preferred embodiments of the invention relates to communicating with a device using RF, rather than acoustics.
  • the RF generated by a computer speaker is detected by a second device.
  • a smart-card detects the RF generated by a telephone loudspeaker, rather than sounds.
  • a device may induce electric fields in a microphone by transmitting RF fields at ultrasonic or sonic frequencies.
  • a computer can produce measurable and encodable electromagnetic waves by transmitting information on a plurality of data buses simultaneously, so that a stronger signal is detected outside the computer.
  • An aspect of some preferred embodiments of the invention relates to detecting the simultaneous generation of RF and acoustic pulses to determine a distance between objects. If the two pulses are generated simultaneously, the delay between their detection is dependent on the distance between the objects.
  • the two pulses may be generated by a single device, such as a computer speaker or they may be generated by separate devices, such as a computer speaker and a BlueTooth RF link.
  • a computer speaker generates the two pulses simultaneously and a microphone on a smart card detects two pulses, one corresponding to the RF and one corresponding to the acoustics.
  • two sensors are provided on the card, one for each modality, however, a combined sensor, such as a piezoelectric microphone is preferred.
  • the processing may be on the smart card. Alternatively, the acquired signals may be forwarded to a computer for processing.
  • One exemplary method of determining the delay is by autocorrelation of the received signal.
  • the pulses used may be temporally symmetric or a
  • An aspect of some preferred embodiments of the invention relates to using a computer microphone to acquire ambient sounds, then analyzing these sounds using a computer, and then using the analysis to determine events occurring in its neighborhood.
  • these sounds are transmitted to remote location, either as sound files or as data files for basic and or further analysis.
  • electronic devices are designed and/or programmed to generate sounds (possibly in the ultrasonic range), which sounds represent their current state or particular events. Thus, by eavesdropping on these sounds it is possible to determine the status of electronic devices.
  • a malfunctioning fax machine will generate one hum and/or an arriving fax on an operating fax machine will generate a different hum or sound pattern.
  • a computer near the fax machine can determine the status and events and transmit this information, possibly using a computer network, to a user of the information.
  • the existing sounds generated by a fax can be identified by the computer, without need for special programming of the fax machine to generate novel sounds.
  • An aspect of some preferred embodiments of the invention relates to interrogating an electronic device using an acoustic channel. Such interrogation should not adversely affect the operation of the devices.
  • the device is a network component, such as a hub.
  • the device is a computer.
  • the acoustic channel is controlled by the computer (analysis of incoming information, generation of outgoing transmissions, and possibly execution of certain software) without interfering with the work of a person using that computer, for example word processing work.
  • An aspect of some preferred embodiments of the invention relates to communicating with a speaker and/or a microphone using non-airborne transmission of the sounds.
  • sounds are transmitted over electrical cabling in a home, for example between two wall sockets.
  • the casing of a device and/or cables attached thereto are used to propagate sonic or ultrasonic signals to a microphone or from a loudspeaker.
  • An aspect of some preferred embodiments of the invention relates to a thin-client architecture in which a thin client is displays information and or transmits input to a controller of the thin client using ultrasonic waves.
  • the controller may be any suitable electronic device which has a speaker, with some suitable software modifications or with a suitable hardware attachment.
  • a user can use a watch like instrument to display the status and/or control a home automation system.
  • the watch can sound radio transmissions (or other messages) which are forwarded by ultrasound to the watch, for example by a computer with a radio card or by a digital radio.
  • the instrument includes one or more inputs which can be forwarded to the controller, again, preferably by ultrasound.
  • a method of communicating with an electronic device comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone; transmitting from a source at least one ultrasonic acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone, to be detected by said computer.
  • a method of communicating with an electronic device comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one first acoustic signal, encoded with information to the computer; receiving said at least one signal by said microphone, to be detected by said computer; and transmitting to said source, using said loudspeaker, at least a second acoustic signal, encoded with information, in response with said detected signal.
  • at least one of said at least one first signal and at least a second signal comprise an ultrasonic signal.
  • a method of communicating with an electronic device comprising: providing an electronic device having a sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one ultrasonic acoustic signal, encoded with information, to the electronic device; receiving said at least one signal by said microphone, to be detected by said electronic device; and transmitting to said source, using said loudspeaker, at least a second ultrasonic acoustic signal, encoded with information, in response with said detected signal.
  • said electronic device comprises a computer.
  • a method of communicating with an electronic device comprising: providing a telephone having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the telephone; and receiving said at least one signal by said microphone, to be used to control said telephone.
  • said acoustic signal comprises an ultrasonic signal.
  • a method of communicating with an electronic device comprising: providing a computer having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone; and forwarding an indication of said information to a remote computer, over an Internet.
  • said indication comprises a sound file.
  • said indication comprises a data file.
  • said acoustic signal comprises an ultrasonic signal.
  • said computer comprises a PDA, personal digital assistant.
  • said computer comprises a portable computer.
  • said computer comprises a desk-top computer.
  • the method comprises processing said at least one sound by said computer.
  • processing comprises extracting said encoded information.
  • said processing comprises determining a distance between said microphone and said source.
  • said processing comprises determining movement of said microphone relative to said source.
  • said movement comprises angular movement.
  • said movement comprises translation.
  • said processing comprises determining a spatial position of said microphone relative to said source.
  • said spatial position is a one-dimensional spatial position.
  • said spatial position is a two-dimensional spatial position.
  • said spatial position is a three-dimensional spatial position.
  • said processing comprises emulating a touch screen using said received at least one sound.
  • said processing comprises emulating a pointing device using said received at least one sound.
  • the method comprises controlling at least one action of a toy, responsive to said received at least one sound.
  • said electronic device comprises a wireless communication device.
  • said device comprises a toy.
  • said electronic device comprises a computer peripheral.
  • said peripheral comprises a printer.
  • said information comprises programming information.
  • said information comprises music.
  • said source comprises a toy.
  • said information comprises stored player input.
  • said source comprises a smart card.
  • said source comprises a wireless communication device.
  • said source comprises a computer.
  • said source comprises a computer peripheral.
  • said information comprises personal information.
  • the method comprises logging into a computer system responsive to said at least transmitted signal.
  • the method comprises transmitting at least a second acoustical signal responsive to said received at least one signal.
  • said acoustic signal comprises human audible sound.
  • said sound has a main frequency over 10kHz.
  • said sound has a main frequency which is infra-sonic.
  • said information is encoded using below human-threshold amplitude signals.
  • said information is encoded using below human-threshold amplitude variations.
  • said sound is generated at a frequency outside a normal operating frequency for said sound subsystem.
  • said sound subsystem is designed for generating musical sounds.
  • said sound subsystem comprises a sound card.
  • said sound card comprises a SoundBlaster compatible sound card.
  • said sound sub-system is designed for audible sound communication with a human operator.
  • said ultrasonic signal has a main frequency below 70, 60 or 50 kHz. Alternatively or additionally, said ultrasonic signal has a main frequency below 35kHz. Alternatively or additionally, said ultrasonic signal has a main frequency below 25kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 21kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 20kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 19kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of below 18kHz.
  • a method of creating a smart card terminal comprising: providing a general purpose computer having a general-purpose sound sub-system; and loading a smart-card terminal software on said computer, wherein said software controls said sound system to receive acoustic waves from a smart card and transmit acoustic waves to the smart card.
  • said software analyses said received acoustic waves to determine information encoded by said acoustic waves.
  • said software retransmits said acoustic waves to a remote computer which analyses said received acoustic waves to determine information encoded by said acoustic waves.
  • loading a smart-card terminal software comprises downloading the software over an Internet.
  • said acoustic waves comprise ultrasonic waves.
  • said smart-card comprises a memory for storing a monetary balance.
  • said software encrypts information encoded by said transmitted acoustic waves.
  • said smart card comprises a memory for storing identification information for a card owner.
  • said smart card comprises a processor for analyzing information received from said computer and for generating a response to said computer.
  • a computer system comprises: a processor; a sound sub-system, designed for generating music, comprising: a speaker which generates acoustic waves; and a microphone which detects acoustic waves; a memory; and a software installed in said memory, wherein said software analyses acoustic waves received by said microphone to recognize information encoded by said acoustic waves and wherein said software uses said speaker to transmit information encoding acoustic waves responsive to said recognized information.
  • said acoustic waves comprise ultrasonic acoustic waves.
  • a method of attaching a peripheral to a computer comprising: providing a general purpose computer including a sound generating and receiving subsystem; analyzing, at said computer, sounds received by said subsystem to detect acoustic transmissions from said peripheral; and transmitting, from said computer and using said subsystem, information to said peripheral using encoded sound transmissions.
  • method of communicating with a computer comprising: generating by a computer an electromagnetic field by driving a computer component not designed for field generation in a manner which generates a parasitic electromagnetic field, wherein said field is encoded with information by said generation; and receiving said encoded field by an electronic device.
  • said electronic device receives said wave using an RF antenna.
  • said electronic device receives said wave using a microphone.
  • said computer component comprises a speaker.
  • said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz.
  • a method of detecting electromagnetic radiation by a computer comprising: generating an electro magnetic field which encodes information; sampling a microphone channel associated with said computer to detect artifacts caused by said field; and decoding said information by said computer.
  • said associated computer is physically connected to said microphone channel.
  • said associated computer is connected to said microphone channel by a computer network connection.
  • said electromagnetic field is a side-effect of driving a speaker.
  • said electromagnetic field is a side-effect of driving a speaker.
  • said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz.
  • a method of emulating a microphone using a speaker comprising: providing a computer having a speaker channel and a microphone channel; coupling a computer speaker to the microphone channel; and receiving signals for said microphone channel via said speaker.
  • coupling comprises coupling using a coupler.
  • a coupler for an audio channel comprising: a first connector for selectively driving a speaker or receiving input from a microphone; a second connector for sending signals to a microphone channel; a third connector for receiving speaker-driving signals from a speaker channel; and circuitry for selectively driving said speaker or receiving signals from said microphone, using said first connector.
  • said circuitry receives switching instructions via said speaker channel.
  • a method of determining a status of an electronic device comprising: receiving information encoding acoustic signals generated by said device; and analyzing said signals to determine an operational status associated with said device responsive to said information.
  • said status comprises a status of said device.
  • said status comprises a status of a second device attached by computer communications with said device.
  • said status comprises a status of a network that said device is part of.
  • said analyzing comprises analyzing on a computer separate from a circuitry used for acquiring said signals.
  • said signals are generated by said device responsive to an interrogation by a second device which performs said receiving.
  • said interrogation does not interrupt other activities of said device.
  • said signals are generated by said device independent of an intenogation by a second device.
  • said signals are sonic.
  • said signals are ultrasonic.
  • the method comprises programming an existing device to generate said signals using an existing speaker which, when the device was designed, was not designated for communication with a second device.
  • said programming comprises software programming in which only memory storage locations are modified.
  • said programming comprises hardware programming in which electronic circuitry of the device is modified.
  • said electronic device comprises a computer.
  • said electronic device comprises a network hub.
  • said electronic device comprises a network switch.
  • said electronic device comprises a network router.
  • a method of accessing a single user computer by a second user, without interrupting the activities of the first user comprising: transmitting an acoustically encoded command by the second user to the computer; receiving said command by the computer; and executing the command by the computer.
  • said command is ultrasonically encoded.
  • said receiving comprises receiving using a microphone connected to a sound card of said computer, which sound card is designed for audio applications.
  • a computer networking method comprising: providing first, second and third computers; and transmitting a message encoding data from the first computer to the third computer via the second computer by acoustic transmission between the computers.
  • said acoustic transmissions utilize sound cards designed specifically for processing audible sounds.
  • said acoustic transmissions utilize are ultrasonic having a frequency of less than 50 kHz.
  • a wireless peripheral for an electronic device comprising: a microphone for receiving ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; circuitry for processing said transmission; and a display for displaying a result of said processing.
  • said peripheral comprises an input element and a speaker for transmitting sound to said electronic device responsive to input from said input element.
  • said peripheral comprises a printing engine for printing a result of said processing.
  • said processing comprises merely of converting the signals from an acoustic encoding format to a format suitable for said display.
  • said processing comprises processing the information encoded by said transmissions.
  • said electronic device comprises a computer.
  • said electronic device comprises a radio.
  • said peripheral comprises a speaker for said electronic device.
  • said peripheral comprises a time display which presents a time signal generated by said electronic device.
  • said peripheral comprises a status display which presents a status signal generated by said electronic device.
  • a wireless peripheral for an electronic device comprising: a speaker for transmitting ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; and circuitry for generating said transmissions; and an input element for receiving input to be encoded by said transmissions.
  • the peripheral comprises a microphone for receiving ultrasonic transmissions from said electronic device.
  • said input element comprises a bar-code reader.
  • said input element comprises a smart card reader.
  • said input element comprises a pointing device.
  • said input element comprises a keyboard.
  • a method of communicating with a computer comprising: providing a computer having a data line attached to at least one particular peripheral; sending a data transmission to the computer by injecting a signal into said data line using an electromagnetic coupler; and identifying by said computer the source of said data transmission.
  • a method of communicating with a computer comprising: providing a computer having a data line attached to at least one particular peripheral; generating by said computer a data transmission directed to a different peripheral; and receiving said data transmission from the computer by eavesdropping on said data line using an electromagnetic coupler.
  • a method of injecting data into a computer from an uncoupled peripheral comprising: transmitting said data from the uncoupled peripheral to a tap; and physically activating a peripheral coupled to said computer, by said tap.
  • physically activating comprises activating keys in a keyboard.
  • physically activating comprises activating vibrating a mouse.
  • a method of communicating with a computer comprising: generating by a computer a data transmission; controlling, by said computer, a component not designated for data transmission, to effect a transmission of said data; and receiving said data transmission from the computer by a second device.
  • said computer controls an activation of a mechanical component of said computer to transmit said data by modulation of mechanical sounds generated by said computer.
  • said computer controls an activation of a status LEDs of said computer to transmit said data by modulation of illumination of said LEDs.
  • said computer controls an activation of an electrical component of said computer to transmit said data by modulation of parasitic RF signals generated by said computer.
  • a method of transmitting data over a computer network comprising: providing a sound file at a first location; transmitting said sound file to a second location via said computer network; and transmitting said sound file as acoustic sounds to a processor at a third location.
  • a method of transmitting data over a computer network comprising: encoding data as acoustic sounds at a first location; transmitting said sound file to a second location as acoustic sounds; and transmitting said acoustic sounds as a sound file to a third location, via said network.
  • said network comprises an Internet.
  • a method of analyzing acoustic signals comprising: receiving said signals using a microphone which microphone converts the signals into analog electrical signals; driving at least one digital data lead of an integrated circuit using said analog signals; and processing said signals using said integrated circuit.
  • the method comprises amplifying said electrical signals prior to said driving.
  • a method of determining a time of flight of a pulse between two electronic devices comprising: simultaneously generating an acoustic pulse and an electromagnetic pulse using a speaker of a first electronic device; detecting, using a single detector associated with a second electronic device, both the acoustic pulse and the electromagnetic pulse; and determining a time of flight of said acoustic pulse the two devices based on a delay between the reception of the two pulses.
  • a method of acoustic communication comprising: estimating an echo duration for an acoustic band; and transmitting data using the acoustic band, wherein between data elements a period of silence is provided, having a duration responsive to said echo duration.
  • the data elements are encoded using individual frequencies in an FSK encoding protocol.
  • estimating comprises estimating based on an expected communication geometry.
  • estimating comprises estimating a duration based on at least one acoustic calibration generated adjacent to said data transmission.
  • Fig. 1 is a schematic illustration of a computer and an electronic device that are operative to communicate using sound waves, in accordance with a preferred embodiment of the invention
  • FIG. 2 is a schematic illustration of two communicating electronic devices, in accordance with a preferred embodiment of the invention.
  • FIG. 3 is a schematic illustration of a smart card communicating with a computer, in accordance with a preferred embodiment of the invention.
  • Fig. 4 is a schematic illustration of a smart-card reader in accordance with a preferred embodiment of the invention.
  • FIG. 5 is a schematic illustration of a method of tapping into a computer, without requiring complicated installation of hardware, in accordance with a preferred embodiment of the invention
  • Fig. 6 is a schematic illustration of an unobtrusive computer checkup in accordance with a preferred embodiment of the invention.
  • Fig. 7 is a schematic illustration of a computer communication setup using acoustics, in accordance with a preferred embodiment of the invention.
  • Fig. 1 is a schematic illustration of a computer 20 and an electronic device 30, which are operative to communicate using sound waves, in accordance with a preferred embodiment of the invention.
  • Most computers currently on sale include a sound system 24, usually a sound card, connected to at least one microphone 26 and at least one speaker 28.
  • Many electronic devices include a microphone 34 and a speaker 36.
  • computer 20 and electronic device 30 communicate using these standard components, which are usually not designed for computer communication but for human communication.
  • the electronic device (or the computer) may include a jack to which one or more speakers and one or more microphones may be connected.
  • such connected acoustic elements are positioned on a difficult to obstruct portion of the device, preferably at positions where the elements have a wide field of view.
  • a standard sound card such as the popular "Sound-Blaster” is used to generate sonic and/or ultrasonic signals to (and to receive them from) an electronic device, a toy and/or another object.
  • the acoustic signal may be audible or inaudible, for example having mainly ultrasonic or infrasonic frequencies.
  • frequencies of about 22kHz and 24kHz and 32 kHz are used, since a standard sound card provides these sampling rates (and/or their multiples, e.g., 44 kHz and 48kHz).
  • the term "main frequency" is used to describe the frequency band in which most of the energy of the information carrying signal is concentrated. In some cases, the information carrying portion of the signal is not at the main frequency generated by the card, for example when an ultrasonic signal is overlaid on a different audible sound.
  • a sound card is adapted to work in the near ultrasonic range, for example by increasing its sampling frequency.
  • the microphone and loudspeaker used for a computer system can support low frequency ultrasound with sufficient fidelity without adaptation.
  • a special ultrasound-sensitive microphone or ultrasound- effective speaker may be used.
  • the sensitivity of a particular microphone and/or loudspeaker maybe determined prior to or during communication with an electronic device.
  • the frequency sensitivity (and or directional sensitively) of a microphone may be determined.
  • a computer may generate these sounds and the signals detected by the device analyzed to determine output characteristics of the particular loudspeaker used.
  • a self- calibration procedure may be performed by listening to the computer's output using the computer's microphone.
  • both the device and the computer sound systems can be calibrated by combining self testing and cross-testing.
  • the microphone and/or the sound card are sensitive enough to receive, from the object, an RF signal associated with generating the acoustic signals, even if an acoustic signal is not sent (e.g., no loudspeaker is present).
  • the object may detect RF signals generated by the speaker or sound card while generating the ultrasound. These RF signals are generally less affected by lack of line of sight than ultrasonic signals.
  • a device for communication with a telephone handset (or other devices where the speaker and microphone are displaced), can be made small, by allowing the detection of sounds from the telephone to be emulated by the detection of RF fields from the telephone speaker.
  • a smart-card can be made small and placed against the telephone microphone and still receive signals from the telephone loudspeaker.
  • the device may transmit RF fields to generate an electrical signals at the telephone microphone.
  • These transmitted and received signals may be ultrasonic or they may be sonic, for example DTMF or DTMF-like signals as known in the art.
  • such an acoustic communication may be used to program a toy and or retrieve information from a toy, for example replacing an RF link for this purpose as described in US patent number 5,752,880, the disclosure of which is incorporated herein by reference.
  • music may be downloaded from the Internet, directly to the toy, for example by modulating an ultrasonic signal to carry MP3 sound files.
  • such a link may be used for real-time communication with the toy.
  • FIG. 2 is a schematic illustration of two communicating electronic devices 30 and 30'.
  • a PDA communicates with a printer.
  • an organizer communicates with a satellite telephone. Possibly, such communication is used to exchange data files and/or to share capabilities, such as modem connections.
  • a port adapter may be required to be plugged into a port, for example a sonic-to-parallel adapter, which converts between acoustic signals and parallel port signals.
  • a computer network in accordance with a preferred embodiment of the invention, utilizes sound waves transmitted between computers for communication, using existing hardware, such as an audio card, loudspeakers and a microphone.
  • the sound waves are ultrasound waves.
  • a computer network is used to connect a PDA or a portable computer to a different computer, for example for data transfer or for sharing peripherals, such as a modem, a printer or a storage device.
  • an existing PDA which includes a loudspeaker and a microphone
  • a modem of a desktop computer without requiring additional hardware in the PDA, possibly requiring only a small software change.
  • This software change may be in application software on the PDA or in the operating system software (or both), depending on the implementation.
  • an acoustic-enabled smart-card (such as that described below), can print, or backup information using a standard desktop computer.
  • such a network may be used in a small office, for example for file or printer sharing.
  • a standard communication protocol language is defined, so that many types of devices can communicate and or share resources using the standard language.
  • an existing networking language may be used.
  • sonic and/or ultrasonic communication is used for paying a toll or a fee (human, package or vehicle), utilizing a reactive component, possibly a passive transponder, on the tolled item.
  • a reactive component possibly a passive transponder
  • such communication is used to pay a transportation fee, for example on a subway or a bus.
  • an acoustic mechanism as described herein is used to open vehicle barriers, for example at entrances to apartment complexes or to open garage doors.
  • the acoustic mechanism is used for automatic refueling/billing systems, possibly transmitting billing and/or mileage information to a pump receiver, controlling the fuel flow and or verifying the fuel type.
  • a car dashboard speaker, a car horn, an alarm speaker, a car radio speaker or a dedicated speaker is used to sound the required sonic and/or ultrasonic signals.
  • it is the RF signals generated by the speaker which are detected.
  • a car radio speaker is made to generate the required sounds by transmitting an electromagnetic wave to the radio or to its loudspeaker, from a specialized electronic device.
  • a set-top box of a cable TV system, for example, is used to transmit and/or receive acoustic signals.
  • a microphone is connected to the set-top box.
  • the transmission back to the set-top box uses an ER. signal, which is detectable by the set-top box.
  • the set-top box includes software that analyzes signals. Such signals may comprise responses of electronic devices and/or toys to sounds generated by the television or by the set-top box.
  • the set-top box adds sounds (or ultrasonic waves) to a video and/or audio stream decompressed by the set-top box.
  • the set-top box adds temporal and/or spatial optical modulations to a video stream, for an optically-sensitive electronic device to detect.
  • the detection of a signal by an electronic device comprises a binary detection of the signal, e.g., an on/off state.
  • more complex signal detection and analysis techniques may be implemented, for example, detection of signal amplitude, frequency, frequency spectrum, Doppler shift, change in amplitude and/or duration, detection of a number of repetitions, voice and/or other pattern recognition in the sound.
  • Various information encoding protocols may be used, including AM, FM, PSK, QPSK and/or pulse length encoding.
  • the transmitted signal may include one or more of information about the sending device's activities, location, environment, nearby devices, locally sensed information, logic state, readiness, requests for information and/or answers to such requests.
  • microphone 34 comprises a directional microphone, for example a stereophonic microphone or a microphone in which the frequency response is spatially non-uniform, to aid in determining the direction of the sound source or to reduce noise.
  • PCT application PCT/IL98/00450 titled "The Control of Toys and Devices by Sounds", filed September 16, 1998, in the Israeli receiving office, the disclosure of which is incorporated herein by reference, describes sound actuated toys.
  • the application describes various sound makers that generate sounds inadvertently as a result of motion, for example beads in a box or noise form a crinkle material.
  • Such a sound maker is connected to and/or mounted on a toy, so that when the toy moves a signal will be generated for another toy or device to acquire.
  • This PCT application also describes detecting the direction and/or position of a sound, using directional microphones and/or a stereophonic microphone including two or more microphone elements. Additionally or alternatively, a relative distance is determined based on amplitude of the sound.
  • Fig. 3 is a schematic illustration of a smart card 40 that communicates with a computer.
  • a smart card is a special case of an electronic device, it is noted that typical smart cards do not include an acoustic input/output channel, especially not an ultrasonic one, in the low ultrasonic frequencies.
  • smart card 40 comprises an acoustic element 42, a processor 44 that controls the acoustic element and a memory 46 for storing information.
  • a smart card may use a single piezoelectric transducer (possibly a film layer) for both transmission and reception.
  • a smart card may communicate with any such device that has suitable software. Due to the decreasing size of electronics, in some cases, a smart card may be emulated using a PDA or other electronic means (or vice-versa), with regard to both size and functionality. Additionally or alternatively, such smart card functionality may be exhibited by a cellular telephone or a lap top computer. A benefit of a lap top computer and of a PDA is their convenient user-interface. A benefit of a cellular telephone is the possibility of real-time and/or off-line communication with a central location. A particular desirable use for such a smart card is for authentication, e.g., using a digital signature method, of e-commerce transactions.
  • the card may be used to supply encrypted or signed information, to a vendor, over the Internet or over the telephone, by transmitting sound wave to the computer from the sound card. These sound waves can forwarded to the vendor or a verifier as sound files or as data files.
  • the smart card may generate the information responsive to information presented by the computer, either acoustically to the smart card or using a human to enter data into the sound file.
  • Fig. 4 is a schematic illustration of a smart-card docking station 110 in accordance with a preferred embodiment of the invention.
  • a smart card 112 is inserted into the reader 110.
  • a portion 114 of the reader is configured to communicate with the smart card, for example using RF, magnetic fields, ultrasound, IR and/or any other communication protocols. Possibly, a plurality of such areas 114 are provided, each for a different physical protocol.
  • These communications with the card are preferably transformed, using an acoustic transducer 116, into acoustic communications to be transmitted to- and/or received by- a remote computer or other electronic device, using the methods as described herein.
  • an owner of a smart card can easily interact with a standard computer without installing a dedicated reader on the computer.
  • a smart card may be constructed to have an ultrasonic communication protocol, such that swiping can be performed without requiring a docking station 110.
  • docking station 110 is designed specifically for magnetic cards, such as common credit cards.
  • Station 110 preferably includes a sensitive magnetic field detector in area 114, so that when a card is inserted into the docking station, the magnetic strip is read. Consequently, it becomes possible to swipe a standard magnetic card at many existing electronic devices, without requiring special hardware to be connected.
  • a dedicated station may be made very thin, for example less than 10 mm or even less than 5 mm.
  • the docking station has a closed configuration, but an open docking station, comprising a sensor and a contra to hold the card against the sensor is also envisioned.
  • card swiping is a one-way communication process, in some cases two way communication may be desirable, for example for a user to collect information regarding purchases for example amounts, times, type and authentication confirmation. In some embodiments, this information may be accumulated by the station 110, as described below.
  • station 110 may be adapted to attach to a port of a PDA, cellular telephone, "organizer” or other portable electronic devices.
  • a station converts electronic signals at the port to sonic and/or ultrasonic acoustic signals that can be recognized by a computer.
  • a dedicated station may be manufactured for each device and smart card type.
  • a single station may be constructed for multiple device types and include an auto-sensing circuit for detecting the logic of the output port.
  • One example of such a detection is by "transmitting" a known signal from the device and determining the setting which allows the station to detect that signal.
  • Another example of automatic detection is by automatically recognizing characteristics of the device, such as transmission amplitude or geometry.
  • station 110 may include a switch or other user interface for manually selecting between different types of electronic devices.
  • acoustic communication is preferred for at least one communication direction (computer to smart-card or smart-card computer) one or both of the communication directions may utilize other technologies, temporarily or on a permanent basis.
  • the card may use the IRDA IR communications standard or the Bluetooth RF communications standard.
  • one of the directions may be manual, for example a device displaying to a user what he should enter into the other device.
  • station 110 may enhance the functionality of a device or a magnetic card, possibly elevating its functionality to that of a smart card, or enhancing the functionality of a less versatile smart card.
  • station 110 may provide authentication of vendor, by decoding an encrypted signal transmitted by the vendor (which a magnetic card is unable to read and or process).
  • station 110 may comprise a memory for tracking the use of a magnetic card.
  • station 100 may provide positioning capabilities.
  • spatial angles between a sound source and a plurality of microphones are determined by analyzing phase differences at the microphones. Alternatively or additionally, other methods known in the art may be used for positioning.
  • a relative location of a pulsing sound source and a plurality of microphones is determined by solving time of flight equations.
  • the relative location of an electronic device and or a computer, relative to another electronic device or smart card may be determined and used to control the operation and/or cooperation of one of the above electronic devices.
  • four microphones are used to determine a three-dimensional position.
  • the acoustic velocity, "c" may be known, for example based on a known velocity in air. Alternatively, it may be determined by measuring the time of flight between a sound source and a microphone having fixed and known relative locations.
  • N microphones there are N-l independent differences dD.
  • the four microphones located at vertexes of a tetrahedron may be used to determine the location of a source. From practical considerations, such an arrangement may not be possible.
  • more than four microphones are used, so that a higher resistance to noise and/or a higher localization precision may be achieved.
  • any other independent three pairs of microphones may be used.
  • one of the electronic devices operates as a transponder, which receives signals and sends back a signal indicative of the received signal and/or its time of flight.
  • the above positioning method may be applied using passive tags on the object whose position is to be detected.
  • such tags are powered by the computer speaker, using an RF field generated by the speaker.
  • this powering may be used to allow the tags to be responsive.
  • this powering may be used for other uses.
  • the powering may be by using a standard smart-cart RF- coupling peripheral.
  • Position determination may be based on transponding signals which impinge on objects.
  • an object may transmit a signal which encodes the time of arrival of the interrogating signal.
  • the accuracy of positioning can be higher than the frequency of the interrogation signal, assuming the object has a clock with a higher resolution than the frequency of the interrogation signal.
  • a touch screen in accordance with a preferred embodiment of the invention utilizes acoustic transmission to detect the location of a touch implement, such as a pen.
  • the position of the pen is determined using one or more microphones and or speakers mounted on the pen, which transmit and/or receive signals from a computer and/or other speaker and/or microphone controller.
  • a three-dimensional position of the touch implement is determined using four acoustic elements, such as two microphones and two speakers.
  • a computer typically includes a modem speaker, an internal speaker and/or optionally a keyboard speaker, as well as sound-card speakers. Lately, however, the internal speaker is not provided in standard installations.
  • some computers include an ultrasonic pointing device or other ultrasonic ports.
  • the smart card can communicate using this ultrasonic communication port.
  • a more basic type of position detection may be based on detecting an interruption by an object of an ultrasonic beam between a speaker and a microphone.
  • a radar- type position or distance detection may be used, in which a microphone of a computer detects the reflection of ultrasonic waves from an object, which waves are generated by a computer speaker. By detecting only relative differences between reflections from different objects, the relative distances of the objects can be determined without knowing the exact location of the sound source.
  • the microphone detects both an acoustic pulse and an electromagnetic pulse generated as a side effect of producing the acoustic pulse.
  • the electromagnetic pulse is substantially simultaneous it may be used as a clock or as a reference time for determining the time of flight of the acoustic pulse.
  • a transponder microphone may detect both kinds of pulses, it is possible to determine the component times of flight to a transponder and not just the sum time of flight, using a retransmission of the detected signals by the transponder.
  • location methods utilize a calibration process, in which the located implement is placed at one or more known location, so that it is possible to correct for the location of the speaker(s) and the microphone(s)/ Alternatively or additionally, the calibration procedure is used to correct for propagation times (of the acoustic waves and/or of electronic signals which generate sounds) and/or for reflections, wavelength dependent attenuation and or broadband attenuation.
  • a different type of touch screen detects the location of a touch implement based on the detection and position determination (2D or 3D) of sounds generated when the touch implement touches the "touch sensitive" surface.
  • This surface may be coated with a sound generating material, such as crinkle-paper, to provide a distinctive sound.
  • an interrogated object receives the ultrasound signal and sends it back to a microphone of the computer.
  • the computer analyses the time of flight and/or other attributes of the transmission and determines a distance from, position to, velocity of motion and/or other spatial attributes of the object.
  • a plurality of sources or receivers may be placed on the object, to assist in determining angular motion of the object.
  • Doppler analysis of the response may be used to detect changes in distance.
  • changes in distance are detected by comparing two consecutive measured distances.
  • the plurality of sources may be differentiated, for example, by timing of signal generation, frequency band used and/or encoding of the transmitted signal.
  • the object responds immediately to the interrogation signal.
  • the object delays its response to an interrogation signal, for example for a few milliseconds.
  • the object transmits at a different frequency from the received frequency, for example at 24kHz in response to a 20kHz query.
  • the signal transmitted by the object is received by a transducer which then transmits the signal to the computer, for example acoustically or using electromagnetic coupling.
  • the object may respond with an identification code.
  • the object modulates its transmission with an envelope, which envelope preferable serves as an identification code and/or for transmission of information regarding a status of the object, for example a position of an arm of a toy.
  • the object relays information from a more remote object.
  • the object may send an ID code even without prompting from the computer, for example periodically or by a user pressing a button on the object (or by flexing the object).
  • the object amplifies the signal it receives using a discharge of a coil through a transistor, where the transistor serves as a variable resistor and or as a wave-form controller.
  • the generated sounds are transmitted indirectly via an existing network.
  • a suitable network is a telephone network, preferably a digital network, with the sounds being forwarded from one telephone to another.
  • Another example of a suitable network is an intercom system.
  • Another example of a suitable network is a LAN or an Internet.
  • the ultrasonic waves may be transmitted (as acoustics, not electromagnetic) over wiring, such as electrical wiring or over pipes, such as water and gas pipes.
  • a wireless telephone system uses handsets which communicate with base stations, for example computers or telephones, using ultrasonic communication, as described herein.
  • an office telephone or computer network can serve as a local cellular network for communication, by keeping track of which base-stations are in communication with which handsets and by providing the ability for a base station to locate handsets and for a handset to change base stations.
  • the different devices coordinate so that they do not both transmit at a same time.
  • a central computer assigns time, frequency or coding (CDMA) slots.
  • CDMA time, frequency or coding
  • an ALOHA algorithm is used to avoid collisions.
  • FIG. 5 is a schematic block diagram of a communications tap 102 for a computer 100, in accordance with a preferred embodiment of the invention.
  • a tap is preferably placed on communication line to an existing peripheral 104.
  • An electronic device 106, a toy and/or a smart-card preferably send and/or receive signals from tap 102.
  • device 106 may use one tap for receiving and one for sending. Possibly, a device uses taps only for one direction of communication.
  • the tap is placed on a cable to a printer, a network cable, a camera cable and/or a SCSI connection. Additionally or alternatively, the tap is placed on a serial cable, for example a mouse cable. Additionally or alternatively, the tap is placed on a modem line, for example on a telephone line or by plugging the tap into another telephone socket, to be received by the modem. Additionally or alternatively, the tap is placed on a game controller line. Additionally or altematively, the tap is placed on a loudspeaker line. This type of tap can detect signals that cannot be reproduced by the loudspeaker, for example very high frequencies, for example higher than 50 kHz.
  • the tap is placed on a microphone line, possibly using the microphone line and/or the microphone itself as a sonic, ultrasonic or non-acoustic antenna (e.g., RF). Additionally or altematively, the tap is placed on a display cable line.
  • a microphone line possibly using the microphone line and/or the microphone itself as a sonic, ultrasonic or non-acoustic antenna (e.g., RF).
  • the tap is placed on a display cable line.
  • the tap includes an electro-magnetic coupler, which can induce signals in a cable that passes through or near the tap. Additionally or altematively, the tap can detect signals in the line and transmit them to device 106. In a preferred embodiment of the invention, the signals are at a different carrier frequency and/or signal frequency than the usual signals passed along the line. Additionally or alternatively, the signals travel in an opposite direction (input signals on an output line, such as a printer or output signals on an input line, such as a mouse). Additionally or alternatively, the signals encode information which information is detected and removed from the data stream in the computer. Additionally or alternatively, the signals are asynchronic on a synchronic line. Additionally or alternatively, the signals are transmitted only when no signal is expected by the computer and/or the peripheral.
  • a piezoelectric actuator (or other vibrating element) is connected to a mouse (or a microphone).
  • the actuator causes the mouse to shake at an amplitude of one or two screen pixels (or less) and the shaking is detected by software in the computer as signals from the toy.
  • a return signal may be transmitted to a tap associated with the actuator, along the serial cable, with the signal preferably being coded to be recognized by the tap and/or ignored by the mouse.
  • device 106 sends signals to computer
  • actuation may be, for example, mechanical or magnetic (e.g., on magnetic switched keyboards).
  • key used is a shift key.
  • signals from the computer are detected by detecting illumination of LEDs on the keyboard, for example a "Num Lock" LED.
  • the tap detects illumination of other LEDs on a computer, for example power, sleep, CD-ROM and/or hard disk LEDs. Alternatively or additionally, the tap detects information transmitted via noise or vibration generated by activation and/or modulation of the activity of mechanical components of the computer, for example diskette drives, disk drives and CD-ROM drives. Altematively or additionally, the tap detects an electromagnetic signal generated by power surges to the devices, for example a CD-ROM when it is powered or variations in RF amplitude and/or frequency of the CPU, for example those caused by entering a sleep mode.
  • a tap "learns" the electromagnetic and/or acoustic profile of a particular computer or portion thereof and learns the effects of various commands on this profile.
  • a computer desires to communicate with a tap, it preferably modifies the profile using those commands which are determined to have the greatest, most noticeable and or fastest effect on the profile.
  • device 106 utilizes a transducer which plugs into a parallel port, a serial port and/or is optically coupled or placed near an IR port.
  • the transducer is a pass-through transducer, through which a printer and or other peripherals may communicate normally with a computer. This transducer can then transmit the signals by wired or wireless methods to a remote device.
  • the tap and or transducer can automatically detect which type of cable is tapped/port is connected to.
  • a tap preferably includes a microprocessor or an integrated circuit to analyze signals on the cable, rather than solely a transducer for coupling signals to and from the cable.
  • detection is by analyzing amplitude, frequency and/or synchronization of signals passing through the lines.
  • the computer detects which line is tapped, by detecting particular inferences on that line.
  • software on the computer sends test signals along the lines, to be detected by the tap.
  • the tap can detect the signals even without being programmed with the type of line on which the signals are transmitted.
  • a configuration program is run so that a user can define to the tap and/or the computer what is being tapped.
  • a smart card directly taps the computer, for example using a RF antenna embedded in the smart card to detect signals being transmitted over data lines, e.g., to a peripheral or another computer or for the use of the smart card.
  • a pass-through hasp is provided, which is connected to a port.
  • the hasp uses power from the power lines but does not interact with data flowing through the port.
  • Authentication of software using the hasp preferably utilizes acoustic communication between the hasp and the computer's microphone and/or speaker.
  • the hasp may interact with signals that flow through the port, which signals are not suitable for use as data, for example the signals using a wrong protocol, having an incorrect CRC, being asynchronous in a synchronous connection or having an incorrect frequency.
  • Such a hasp may also be used to protect an easily stolen device, such as a PDA or a laptop computer, which can use their internal speakers and/or microphones to detect the proximity of a required ID tag. If the ID tag is not detected the device can fail to work, work incorrectly or it can report that it is stolen.
  • suitable software is installed on computer 100.
  • the software is self installing.
  • the computer is not used for any other use while device 106 is communicating with it.
  • the software can differentiate between "regular" signals and signals related to the tap.
  • a provided keyboard driver may detected special codes and/or data sequences on the keyboard line and remove them from the received data, passing only the rest of the received data to an operating system of computer 100.
  • a provided mouse driver may detect spurious and/or small mouse movements, and recognize them as being tap- related signals, as described above.
  • a printer driver can recognize data on the cable as not coming from the printer but from a tap.
  • data sent to the tap is preferably sent as data which will be rejected or ignored by the peripheral, for example having incorrect parity settings or other intentional errors.
  • a tap for communication with a toy such a tap may be used to attach a peripheral to computer 100.
  • the tap may include a processing element so that the signals coupled to the cables do not interfere with the normal operation of the cable, for example being transmitted when there are no others signals on the cable.
  • processing may be performed by a device which uses the tap.
  • the signal received on the computer is used to modify an executing program and/or to generate commands to other electronic device, preferably using sounds generated by the computer but possibly using a dedicated connection.
  • a computer game in which a computer display responds to external sounds, such as bowling pins falling, is provided.
  • the acoustic communication may also be used to communicate between an input device and a computer program, for example between a wireless keyboard or mouse and a computer.
  • a light-pen transmits to the play-station a signal responsive to pixel intensities which are detected by a photo-detector thereon.
  • a synchronization signal is transmitted from a computer and or a set-top box to the pen, to synchronize the pixel detection with the TV raster scan. These transmissions may be additional to- or alternative to- transmission of position and/or orientation.
  • the input device transmits the status of controls thereon.
  • the transmission is used to transmit information to be displayed on an output device or an output portion of the input device, for example to light up lights thereon and/or drive text and/or graphics displays thereon.
  • FIG. 6 is a schematic illustration of an unobtrusive computer checkup in accordance with a preferred embodiment of the invention.
  • a user 142 is using a computer 140.
  • a user 146 wishes to interrogate computer 140, for example to analyze a networking problem.
  • a smart card 144 (or other electronic device) can communicate with computer 140 using an acoustical- or a tap- channel as described above, without interfering with the activities of user 142.
  • smart card 144 may be used to interrogate an interface-less device, such as a hub 148.
  • acoustical communication for these uses is that they do not generate a considerable amount of RF interference and do not require major (if any) changes in a (significant) install base of hardware.
  • hardware devices such as hub 148 and computer 140 continuously "hum" their status, in RF or in acoustics, so that the status can be discerned by eavesdropping on the hum, without needing to interrogate the hardware.
  • a card such as card 144 may also be used to give privileges to it's owner in the form of better service (e.g., priority at a file server, speed of connection to the Internet) and/or alleviate various security restrictions. For example, a manager can come to his employee desk, activates his card and previously unreachable files become available. It is noted that this process of changing the behavior of a computer does not require logging on to the computer (although such log-on is possible). Rather, the computer recognizes the manager even while it remains logged on to the other user.
  • a hysteresis-type logic when the card or other device is used for logging-on, a hysteresis-type logic is used, in which logging on requires a high quality definite signal, while logging-off (possibly automatic log-off) is delayed until there is substantially no contact with the card.
  • the lack of contact can be detected by the lack of detection of a periodic signal generated by the card.
  • FIG. 7 is a schematic illustration of a computer communication setup using acoustics, in accordance with a preferred embodiment of the invention.
  • a computer 152 includes a microphone 156 that is used for detecting activity sounds of other electronic and/or mechanical devices.
  • the activity sounds may comprise natural sounds, for example a page sorter being used in a photocopier. Alternatively or additionally, they may comprises indicator sounds, for example a beep generated by a fax machine 150 when a fax comes in. Fax machine 150 may be connected to a computer (as shown) or it may be unconnected. Alternatively or additionally, they may comprise artificial sounds, for example a special information carrying sound generated specifically for the benefit of computer 152.
  • a computer 152 transmits indications of the sensed activities to a remote computer, such as computer 154.
  • a remote computer such as computer 154.
  • a user at computer 154 can be informed of a fax coming in or of an unanswered telephone call even if he is in a different room and the fax machine is not connected to a standard computer network.
  • the analysis of sounds detected by microphone 156 can be used to determine other occurrences at computer 152.
  • microphone 156 can be used to log the habits of a user, including, telephone conversations, numbers dialed (by detecting the DTMF sounds), sounds of papers being shuffled, breathing sounds, snoring of a sleeping user, average number of rings until a call is answered, and typing habits. Altematively or additionally, microphone 156 can be used to detect an occupancy of a room or glass breakage, possibly serving as a burglar alarm.
  • the microphone may be used to detect electromagnetic impulses generated by operating devices.
  • each device has a different electromagnetic signature. Different signatures may be generated when the device is switched on or off, when the device is operated and/or for different modes of operation.
  • a computer-microphone combination can be used to detect the operation of devices, such as photocopies, door chimes and computers.
  • a video input card is used to analyze higher frequencies of electromagnetic radiation than those detectable by a microphone-sound card combination. It can thus be appreciated that noise signals which are usually rejected by signal processing algorithms may be analyzed to detect important information of activities in the vicinity of the microphone.
  • input/output filtration circuits are provided. These filtration circuits preferably comprise op- amplifiers with filters for specific frequencies for input and output, dependent on the communication protocol used. If non-audible frequencies are used, the filters should preferably decrease or block power at audible frequencies, to reduce annoyance of a user.
  • the communication protocol is preferably a digital binary code in which the bits are transmitted using Frequency Modulation, Pulse Width Modulation, On-Off Keying and or any combination of the above.
  • Error conection codes for example parity, Gray or Hamming codes, as known in the art may be used. It should be noted that the range of available frequencies may be limited if ultrasonic frequencies are used, due to degraded capabilities of the computer sound card.
  • the signals received by the device are convert them to data bits, either by time domain analysis or by Fourier analysis. Thereafter, error checking is preferably performed.
  • the received information may be decrypted (if necessary). Alternatively or additionally, the received information may be encrypted, verified and/or signed, in order to be stored in local memory.
  • the local memory may comprise ROM, RAM, EPROM, EPROM and/or other types of memory as known in the art.
  • Information to be transmitted may be encrypted before transmission.
  • the software on the computer receives a detected signal, filters it, and opens the protocol. Preferably, the software reduces noise using IIR. band pass and/or low pass filters.
  • the received and filtered signal is then demodulated, into data bits, for example, by time domain analysis or by Fourier analysis. Data transmission errors are preferably corrected.
  • the data may then be locally analyzed and/or transmitted to a remote location, for example a seller's computer.
  • this software is written in an Internet Language, such as Java or ActiveX.
  • the acoustical detection uses the maximum resolution and/or sensitivity afforded by the microphone, i.e., going below the noise threshold as defined for audio uses.
  • repeating and/or periodic ambient sounds are detected and removed or disregarded from the input signal.
  • ambient sounds are characterized as such during a calibration step which may be performed periodically.
  • one or more of the following problems may be encountered, including: echoes, interference (acoustic or electromagnetic), and, at higher frequencies (>10 kHz), problems of directionality and weak reception.
  • echoes acoustic or electromagnetic
  • many microphones and speakers behave badly or in an unstable manner at these frequencies.
  • the received sound signals are processed using known signal processing techniques, such as filtration, equalization and echo cancellation.
  • Preferred modulation methods used include PWM, FSK, QPSK and on-off keying.
  • Preferred frequency band types include a single band, a wide band spread-spectrum and frequency hopping bands.
  • Preferred protocols utilize one or more of start- stop synchronization bits, and constant and/or variable length messages.
  • the device and/or the computer include logic for determining the exact frequency used for transmission, for example to correct for frequency hopping, for frequency shifts caused by inaccurate manufacture and/or for environmental effects.
  • Error detection methods may be used, for example, CRC (preferably 32 bit), Parity, Checksum, Blowfish, Hamming Codes, Retransmit BCD Codes and Gray codes.
  • periods of silence are provided between data bits in protocols other than on-off keying.
  • an FSK protocol is provided with silence between the frequency pulses.
  • the duration of the silence is sufficient so that echoes (or other artifacts) from the original pulse do not overlap with a next pulse. This period may be fixed, for example based on an expected geometry of the electronic devices and where they are used. Alternatively, the protocol may be adapted based on the instant echo situation. Alternatively or additionally, the pulse duration may be modified to overcome noise, echo and/or other transmission problems.
  • a few calibration pulses are first sent to determine a desired silence and/or pulse duration. Possibly, different such durations are used for the two communication directions.
  • a feature of some embodiments of the invention is that a device can communicate with another device or computer over medium distances, such as 0.3-20 meters, more preferably, 2- 10 or about 7 meters.
  • a regular microphone and sound card including: (a) using a regular microphone and sound card; (b) using a regular sound card but with a special microphone (e.g., one that can be tuned to specific, even ultrasonic, frequencies); (c) using a speaker that can also be a microphone (one possibility is described in detail below); (d) using a microphone/receiver that connects to a dedicated channel such as an RS232 or parallel port, and that can optionally obtain power from the port; and (e) using a built in dedicated hardware port that can be implemented on the computer board.
  • a dedicated channel such as an RS232 or parallel port
  • the signals are transmitted and/or detected using RF antenna, or acoustic signal generation is detected using an acoustic antenna (or RF antenna) that detects the RF signature of the transmission.
  • the RF is used as a backup for the acoustic channel.
  • the incoming audio stream is sampled at lower than the carrier frequency.
  • a side effect of such sub-sampling, especially when there are no anti-aliasing filters, is that there may be confusion between audible and ultrasonic sounds.
  • more complex processing may be required to assure that the data transmission is acceptable.
  • synchronous detection or a more robust error detection method is used.
  • a specialized waveform with unique time/spectrum characteristics is used, for example one that repeats itself at both 1 and 4 kHz after the down-sampling. Thus, it can be better differentiated from the background.
  • a speaker is available for a computer but a microphone is not.
  • a speaker is used as a microphone.
  • the speaker is connected to the microphone port and/or line in port of a sound card, possibly through an adapting unit.
  • an adapting unit is provided, for example to serve for buffering, switching (between microphone and speaker functions) and/or for amplitude protection.
  • the adapting unit periodically checks for an incoming signal from outside the speaker or for a signal from the speaker channel.
  • the computer may generate a special signal via the speaker channel or possibly an audible signal to indicate that a mode switching is desired.
  • the speaker is connected in parallel to both microphone and loudspeaker channels, with electronic protection for the microphone so that the power to the speaker does not harm the channel.
  • some microphone types may be used as both a microphone and a speaker, if they are suitably driven.
  • a coupler is provided for driving the microphone using the speaker channel and or for automatically switching the microphone between modes based on the detection of an incoming signal or possibly periodically.
  • the coupling device can split the frequencies between the microphone and speaker functions, allowing a single element to operate simultaneously as a speaker and a microphone. For example, low frequencies are used for the speaker and high frequencies are used for the microphone. When a high frequency is detected by the coupler, it is passed to the microphone channel, when a low frequency is detected it is sounded on the speaker.
  • Another aspect of the invention relates to transmitting acoustic signals on solid cables, rather than in the air.
  • Such cables can include computer, communication and telephone cables, as well as electric power cables, for example inside a house.
  • the transmission along these cables is conducted to a microphone of the device, to which it is directed, where the transmission is analyzed.
  • transmission is via the box of the device and into the cable.
  • a dedicated coupler to the cable is provided for one or both of the transmission and reception. It is noted that a standard house is filled with this infrastructure in the form of power supply, water pipes, telephone lines, and cables.
  • the ultrasonic receiver/transmitter device is simple low-cost and can be very small.
  • the method can be used to achieve communication for low cost appliances, or to achieve a higher bandwidth of information.
  • the method permits multiple appliances talking together, broadcast of information and a network of smart appliances. It can be used to communicate also between computers, televisions and or VCRs. Every device can have its own id-number and a computer can control the operation of these devices. For some devices a dedicated controller is required, which receives the acoustic signal and, responsive to it, controls the device. Exemplary uses include ordering shutting off or lighting lights at certain time (by computer control) or from outside of home (by telephone or network to the computer) and ordering the VCR and/or television to cooperate in recording a specific TV program, again preferably under computer control.
  • a reader-type input device can read external static (as opposed to sound waves and temporal patterns) information, which information can be forwarded to an associated computer or another device.
  • Such an input device may also be integrated with a smart-card.
  • a simplest example is a wireless bar-code reader that reads bar codes and transmits them acoustically to a computer, preferably using methods as described herein.
  • the bar-code reading capability is embodied in a smart card, so that a multifunction device is provided.
  • a miniature device, such a ring is manufactured, for convenience or a user. Such a device may be useful during purchasing, to allow a user to review large and or personalized information regarding a product.
  • a magnetic strip reader which transmits read magnetic strips to the computer.
  • a single magnetic sensor or line sensor
  • the computer processing the detected signals to correct for non- constant motion of the sensor over the magnetic material.
  • an associated computer switches to a WWW page which displays details associated with the read information.
  • the computer may be a hand-held computer or PDA.
  • the computer is a standing or store provided computer.
  • the computer is on another side of a telephone line, which acoustic signals are transmitted over the telephone line to the computer, to cause certain speech to be transmitted back.
  • tags may be used for technical support (e.g., each home device or component has such a code and there is a help file or scripts associated with the code).
  • tags may be used for customer relations, for example to provide information to an interested user.
  • the computer and/or the tag reader can control the product using information read for the tag.
  • An exemplary situation is a computer device, on which a tag reader or a same or second computer can execute a diagnostic program responsive to the read tag.
  • An exemplary device consists of an acoustical transmitter, a tag-reading element, and some control logic.
  • the type of tag reading element used depends on the type of tag, for example, if it is optical or magnetic.
  • the tag itself may include bar codes, other optical coding or even text.
  • the tag may comprise magnetic ink.
  • the tags are of a type that can be printed using standard printers and/or inks. Thus, tags can be printed all over a book, magazine or other printed products. Alternatively or additionally, RF transponder tags as known in the art may be used.
  • the read information is deciphered by the reader. In other embodiments, partially or completely unanalyzed information is transmitted to the computer for analysis.

Abstract

A method of communicating with an electronic device, comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone; transmitting from a source at least one ultrasonic acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone, to be detected by said computer. Preferably, the ultrasonic frequency used is below 50 kHz.

Description

A METHOD TO USE ACOUSTIC SIGNALS FOR COMPUTER COMMUNICATIONS
RELATED APPLICATIONS
This application is a 119(e) of US provisional applications 60/115,231 , filed January 8, 1999 (attorney docket 100/00798), 60/122,687, filed March 3, 1999 (attorney docket 100/00809), 60/143,220, filed July, 9, 1999 (attorney docket 100/01200), 60/145,342, filed July 23, 1999 (attorney docket 100/01124) and an application titled "Card for Interaction with a Computer", filed September 14, 199 and having attorney docket 100/01300. This application is also a continuation-in-part of PCT applications PCT/IL99/00470, filed August 27, 1999 and PCT application PCTTL99/00506, filed September 16, 1999, both filed in the Israel receiving office by appHcant Comsense Technologies Ltd. and designating the US. The disclosures of all of these applications are incorporated herein by reference.
FIELD OF INVENTION The present invention relates generally to method of interaction with a computer and especially to methods that use acoustic signals for such communications. BACKGROUND OF THE INVENTION
Computer network components that communicate using RF radiation, wires or IR radiation are well known. In addition, some home appliances are controlled using an ultrasonic remote control. Other types of dedicated ultrasonic acoustic links are also known.
However, such dedicated communication mechanisms require that the computer network components have installed thereon specialized communication hardware. Installing such hardware on an existing computer may be expensive and/or problematic. Further, some electronic and/or computer embedded devices, for example cellular telephones may be
"sealed" products, to which it is impossible to add internal components.
PCT publications WO96/10880, WO94/17498, WO93/21720 and WO93/11619, the disclosures of which are incorporated herein by reference, describe an electronic device which transmits coded information to a microphone of a telephone using a DTMF-like encoding scheme. A WWW page addressed "http://www.encotone.com html/tech_def.html", available on February 1, 1999 and predated, suggests using such a device to transmit audible DTMF-like tones to a personal computer using the computer's sound card. Two way communications using audible DTMF-like tones, between a smart card and a telephone communication system is described in US patent 5,583,933, the disclosure of which is incorporated herein by reference.
SUMMARY OF THE INVENTION One object of some preferred embodiments of the invention is to simplify interaction between electronic devices by removing a common requirement of installing dedicated communication hardware on the devices. Some suitable electronic devices include: computers (e.g., desktop and laptop), televisions, watches, PDAs (Personal Digital Assistant), organizers, electronic toys, electronic games, voice-responsive appliances, wireless communication devices, answering machines and desktop telephones. As used herein the term "electronic device" is used to encompass a broad range of electronics-including devices. In some of the embodiments described below, a particular type of electronic device is singled out, for example a computer or a toy, as some of the below-described embodiments are more useful for some types of electronic devices, than for other types of electronic devices. However, such examples are not meant to limit the scope of the invention. An object of some preferred embodiments of the invention is allowing electronic devices to communicate using an input and/or output channel, preferably an acoustic channel, but possibly a visual channel, which was designed for communication with human users and not for communication with electronic devices. In other cases, the communication channel is not originally intended for communication with outside components at all, for example, a diskette drive.
An object of some preferred embodiments of the invention is to allow a smart card to be read by and written to using standard computer hardware without requiring an installation of specialized hardware. This is especially useful for electronic wallets and Internet commerce, where the cost of installing dedicated hardware may prevent wide acceptance of these commercial methods. Additionally, using a smart card can provide methods of solving the security and accountability issues entailed in electronic commerce.
An aspect of some preferred embodiments of the invention relates to communicating with a computer using a sound card installed on the computer. In some computer configurations the installation is permanent, for example as part of the motherboard chip-set. In a preferred embodiment of the invention, a device, preferably a smart card, transmits information to the sound card's microphone and receives information from the computer using the sound card's (or the computer's) loudspeaker. Preferably, the transmission uses non- audible acoustic frequencies, for example ultrasonic or infrasonic frequencies. It should be noted that standard music cards are designed for music generation, and specifically for audible audio frequencies, such as between 20 Hz and 16 kHz, however, they have a limited reception and transmission ability in the near-ultrasonic (e.g., between 16 kHz and 50 kHz) and infrasonic (e.g., 0.01 Hz to 20 or 40 Hz) frequency ranges. The definition of audible frequencies will usually depend on the user and this, may, in some embodiments, impact on the selection of frequencies for use. Possibly, a personalization software for selecting the frequencies will be provided. Also, in some applications, the higher end of the audible range may be used, for example 14 kHz - 16 kHz, as the sensitivity to these frequencies is quite low, even in those individuals that can detect them.
Ultrasonic communication has several advantages over audio communication: (a) smaller transducers can be used; (b) transmission is more efficient;
(c) lower noise levels are typical;
(d) resonant frequencies that have wavelengths on the order of a size of a credit card can be used; and
(e) higher data rates can be achieved. In a preferred embodiment of the invention, the ultrasonic frequencies used are low ultrasonic frequencies or high audible frequencies, for example between 15 kHz and 24 kHz, more preferably between 17 kHz and 20 kHz and, in some preferred embodiments, between 21 and 23 kHz. Often, these frequencies can be transmitted and/or received using standard audio components. For this reason, lower frequencies may be preferred over higher frequencies, even though the lower frequencies typically afford a lower data rate and are more easily disrupted. These particular frequencies are suggested because they match industry standards for sampling in audio cards (e.g., "SoundBlaster"). If other sampling frequencies are available, the preferred frequency may adjusted accordingly. Preferably, a minimum frequency used is selected so that it is inaudible to a human. In some cases, the frequency selection may depend on the age of the human.
A benefit of ultrasound over RF transmission is that the range of the ultrasonic transmission can easily be controlled by varying its amplitude. Typically, ultrasonic transmissions do not pass through walls, potentially providing increased security by limiting eavesdropping and inference from outside the room. In addition, ultrasonic transmissions do not usually interfere with the operation of electronic equipment, even when used at a high power setting. Thus, ultrasonic communication is better suited for people with pacemakers and for hospital settings. Another advantage of acoustic transmission is a reduced perceived and actual health danger to the user.
An aspect of some preferred embodiments of the invention relates to communication between electronic devices using acoustics. Alternatively or additionally to electronic devices communicating using RF; varying magnetic fields; IR; and visible light, electronic devices may communicate using acoustics, in accordance with preferred embodiments of the invention. In some cases, one communication direction is acoustic and the other is non- acoustic, for example RF or IR, for example when communicating with a set-top box in accordance with a preferred embodiment of the invention (one way acoustic from the TV and the other way IR, in the same manner as with an IR remote control). In a preferred embodiment of the invention, the acoustic waves used for communications are incorporated in sounds used for regular operation of the device which generates the sounds, for example by modulating beeps. Alternatively or additionally, the sounds are inaudible, for example being ultrasonic, infrasonic, of a low amplitude and/or causing only small changes in amplitude and or frequency of an existing sounded signal.
It is noted that many electronic devices include a microphone and/or a speaker. In a preferred embodiment of the invention, the microphone and/or speaker are used to communicate with the device. In one example, an acoustic smart card (or an "electronic wallet" card) communicates with such a device using sound and/or ultrasound. Such a smart card may transmit information stored thereon. Possibly, the information is encrypted, for example, using RSA or DSA encryption.
In a preferred embodiment of the invention, a smart card may be "swiped" at many existing computers and electronic devices, possibly requiring a simple software installation, but no hardware installation (assuming some acoustic hardware exists). Such simple swiping should ease acceptance of the card by Internet browsing home shoppers. In some cases, the swiping software may be downloaded as a Java Applet or as a script in a different network programming language.
In some embodiments other types of electronic devices communicate. For example, a cellular telephone and a PDA, each of which includes a microphone and a speaker, can communicate. Another example is programming a cellular telephone with names and numbers stored in a PDA or for the cellular telephone to interrogate the PDA regarding a particular telephone number. Alternatively or additionally, a network may be formed of a plurality of such devices, possibly, with one device forwarding messages from a first device to a second device. Alternatively or additionally, peripherals may be connected to a computer using an acoustic connection, without requiring wiring or special hardware. In some embodiments, a single acoustic transducer (microphone or speaker) may be controllable to act as both a receiver and a transmitter, by suitably programming the electronic device.
Many computers are sold with a Sound-Blaster Compatible sound subsystem, stereo speakers and a microphone. Some computers are provided with other types of sound systems, which types also support the application of preferred embodiments of the invention, possibly with a variation in frequencies to account for different circuit or sampling characteristics. Typically, this sound system is designed for generating music and other audible sounds. In addition, many computers include an internal speaker and a modem speaker. Some computers use USB speakers that are connected directly to the USB (Universal Serial Bus). It should be appreciated that in some embodiments of the invention the sound communication is directed at the device for its use, control and/or processing and is not meant for mere passing through the device. For example, a telephone may interpret computer- information encoding signals, rather than transmitting them on through the telephone network, as is done in the art. In a preferred embodiment of the invention, a wireless telephone is realized using ultrasonic communication between a base station and the hand set. In a preferred embodiment of the invention, the base station is embodied in a computer, which communicates with the telephone. Possibly, the wireless communication uses the same loudspeaker and/or microphone as used for communication with a person using the telephone and or the computer. Additionally or alternatively, the handset is used for Internet telephony, via the computer without a cradle or other special connection between the computer and the telephone.
An aspect of some preferred embodiments of the invention relates to interfacing a device (possibly a toy) with a computer system without installing special or dedicated hardware on the computer. Such interfacing may use EM-coupling into cables attached to the computer, detection of RF signals from a computer or direct input into a mouse or a keyboard. In one preferred embodiment, the loudspeakers, already installed on a computer, are used to interrogate an identification device, using ultrasound. Preferably, the computer's microphone is used to detect a response from the interrogated device. In some embodiments, especially for toys, the interrogation may comprise audible sounds. Thus, in a preferred embodiment of the invention, cheap and/or simple communication between a device and another device or a computer is feasible, since no special computer hardware is required. In addition, it becomes simpler to interface an input device with a computer program that responds to that input device. Additionally or alternatively, ultrasonic communications may be used to download a program and or music file to a toy or other devices. Possibly, the program and/or music file are directly downloaded from an Internet as sound files, possibly reducing or obviating the need for a dedicated toy (or device) programming software interface. Possibly, the toy and/or device generate sounds in response, which sounds are transmitted back through the Internet.
In a preferred embodiment of the invention, the acoustic waves used for communication or, possibly, another set of acoustic waves, may be used to determine the relative position and/or orientation of electronic devices. In a preferred embodiment of the invention, a touch screen is emulated by interrogating a transponder on a pointing implement, using built-in speakers of an electronic device, to detect the position, orientation and/or motion of the implement, thereby identifying a location which is "touched" or pointed to. In a preferred embodiment of the invention, the transponder is embodied using a speaker and a microphone of the pointing implement, for example if the implement is a cellular telephone.
For example, one or more of the following sound generators may be available in a personal computer: built-in speaker, modem speaker and sounds generated by mechanical devices, such as a hard disk drive or a diskette drive. These sound generators may also be used for transmitting information.
An aspect of some preferred embodiments of the invention relates to visual communication between devices, using built in hardware. In one example a video camera, which is provided with many computers, can be used to accept visual signaling from a second device. Such visual signaling may be temporal, for example by flashing a screen or a LED. Alternatively or additionally, the signaling uses a spatial code, for example, by the remote camera identifying visual spatial patterns on a screen, for example using OCR techniques. Possibly, the frequency of flashes is higher than perceived by a human observer, in order to reduce distraction. It is noted that communication between a screen and a video camera enables a wide bandwidth and/or enhanced error correction, due to the large number of transmission and reception pixels available. Alternatively or additionally, an existing IR port is used as a source, which source is detectable by many CCD cameras.
An aspect of some preferred embodiments of the invention relates to communicating with a device using RF, rather than acoustics. In a preferred embodiment of the invention, the RF generated by a computer speaker, rather than the generated sounds, is detected by a second device. In an exemplary embodiment, a smart-card detects the RF generated by a telephone loudspeaker, rather than sounds. Alternatively or additionally, a device may induce electric fields in a microphone by transmitting RF fields at ultrasonic or sonic frequencies. Alternatively or additionally, a computer can produce measurable and encodable electromagnetic waves by transmitting information on a plurality of data buses simultaneously, so that a stronger signal is detected outside the computer.
An aspect of some preferred embodiments of the invention relates to detecting the simultaneous generation of RF and acoustic pulses to determine a distance between objects. If the two pulses are generated simultaneously, the delay between their detection is dependent on the distance between the objects. The two pulses may be generated by a single device, such as a computer speaker or they may be generated by separate devices, such as a computer speaker and a BlueTooth RF link. In an exemplary application, a computer speaker generates the two pulses simultaneously and a microphone on a smart card detects two pulses, one corresponding to the RF and one corresponding to the acoustics. Possibly, two sensors are provided on the card, one for each modality, however, a combined sensor, such as a piezoelectric microphone is preferred. The processing may be on the smart card. Alternatively, the acquired signals may be forwarded to a computer for processing. One exemplary method of determining the delay is by autocorrelation of the received signal. The pulses used may be temporally symmetric or asymmetric.
An aspect of some preferred embodiments of the invention relates to using a computer microphone to acquire ambient sounds, then analyzing these sounds using a computer, and then using the analysis to determine events occurring in its neighborhood. Optionally, these sounds are transmitted to remote location, either as sound files or as data files for basic and or further analysis. In a preferred embodiment of the invention, electronic devices are designed and/or programmed to generate sounds (possibly in the ultrasonic range), which sounds represent their current state or particular events. Thus, by eavesdropping on these sounds it is possible to determine the status of electronic devices. In one example, a malfunctioning fax machine will generate one hum and/or an arriving fax on an operating fax machine will generate a different hum or sound pattern. A computer near the fax machine can determine the status and events and transmit this information, possibly using a computer network, to a user of the information. In some cases, the existing sounds generated by a fax (beeping, printing noises etc.) can be identified by the computer, without need for special programming of the fax machine to generate novel sounds.
An aspect of some preferred embodiments of the invention relates to interrogating an electronic device using an acoustic channel. Such interrogation should not adversely affect the operation of the devices. In one example, the device is a network component, such as a hub. In another example, the device is a computer. In a preferred embodiment of the invention, the acoustic channel is controlled by the computer (analysis of incoming information, generation of outgoing transmissions, and possibly execution of certain software) without interfering with the work of a person using that computer, for example word processing work. An aspect of some preferred embodiments of the invention relates to communicating with a speaker and/or a microphone using non-airborne transmission of the sounds. In an exemplary embodiment of the invention, sounds are transmitted over electrical cabling in a home, for example between two wall sockets. In another exemplary embodiment, the casing of a device and/or cables attached thereto are used to propagate sonic or ultrasonic signals to a microphone or from a loudspeaker.
An aspect of some preferred embodiments of the invention relates to a thin-client architecture in which a thin client is displays information and or transmits input to a controller of the thin client using ultrasonic waves. An advantage of such an architecture is that the controller may be any suitable electronic device which has a speaker, with some suitable software modifications or with a suitable hardware attachment. In an exemplary application, a user can use a watch like instrument to display the status and/or control a home automation system. Alternatively or additionally, the watch can sound radio transmissions (or other messages) which are forwarded by ultrasound to the watch, for example by a computer with a radio card or by a digital radio. Possibly, the instrument includes one or more inputs which can be forwarded to the controller, again, preferably by ultrasound. These inputs may be mapped to the controller's controls or they may interact with suitable software at the controller. Although software execution on the instrument is possible in some embodiments, it is not preferred. Alternatively or additionally, although acoustic transmission is preferred, in some preferred embodiments of the invention RF or other transmission methods are used. There is thus provided in accordance with a preferred embodiment of the invention, a method of communicating with an electronic device, comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone; transmitting from a source at least one ultrasonic acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone, to be detected by said computer.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with an electronic device, comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one first acoustic signal, encoded with information to the computer; receiving said at least one signal by said microphone, to be detected by said computer; and transmitting to said source, using said loudspeaker, at least a second acoustic signal, encoded with information, in response with said detected signal. Preferably, at least one of said at least one first signal and at least a second signal comprise an ultrasonic signal.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with an electronic device, comprising: providing an electronic device having a sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one ultrasonic acoustic signal, encoded with information, to the electronic device; receiving said at least one signal by said microphone, to be detected by said electronic device; and transmitting to said source, using said loudspeaker, at least a second ultrasonic acoustic signal, encoded with information, in response with said detected signal. Preferably, said electronic device comprises a computer.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with an electronic device, comprising: providing a telephone having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the telephone; and receiving said at least one signal by said microphone, to be used to control said telephone. Preferably, said acoustic signal comprises an ultrasonic signal.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with an electronic device, comprising: providing a computer having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone; and forwarding an indication of said information to a remote computer, over an Internet. Preferably, said indication comprises a sound file. Alternatively, said indication comprises a data file.
In a preferred embodiment of the invention, said acoustic signal comprises an ultrasonic signal.
In a preferred embodiment of the invention, said computer comprises a PDA, personal digital assistant. Alternatively, said computer comprises a portable computer. Alternatively, said computer comprises a desk-top computer.
In a preferred embodiment of the invention, the method comprises processing said at least one sound by said computer. Preferably, processing comprises extracting said encoded information. Alternatively or additionally, said processing comprises determining a distance between said microphone and said source. Alternatively or additionally, said processing comprises determining movement of said microphone relative to said source. Preferably, said movement comprises angular movement. Alternatively or additionally, said movement comprises translation.
In a preferred embodiment of the invention, said processing comprises determining a spatial position of said microphone relative to said source. Preferably, said spatial position is a one-dimensional spatial position. Alternatively, said spatial position is a two-dimensional spatial position. Alternatively, said spatial position is a three-dimensional spatial position.
In a preferred embodiment of the invention, said processing comprises emulating a touch screen using said received at least one sound. Alternatively or additionally, said processing comprises emulating a pointing device using said received at least one sound.
In a preferred embodiment of the invention, the method comprises controlling at least one action of a toy, responsive to said received at least one sound.
In a preferred embodiment of the invention, said electronic device comprises a wireless communication device. Alternatively, said device comprises a toy. In a preferred embodiment of the invention, said electronic device comprises a computer peripheral. Preferably, said peripheral comprises a printer.
In a preferred embodiment of the invention, said information comprises programming information. Alternatively or additionally, said information comprises music.
In a preferred embodiment of the invention, said source comprises a toy. Preferably, said information comprises stored player input.
In a preferred embodiment of the invention, said source comprises a smart card. Alternatively, said source comprises a wireless communication device. Alternatively, said source comprises a computer. Alternatively, said source comprises a computer peripheral.
In a preferred embodiment of the invention, said information comprises personal information.
In a preferred embodiment of the invention, the method comprises logging into a computer system responsive to said at least transmitted signal.
In a preferred embodiment of the invention, the method comprises transmitting at least a second acoustical signal responsive to said received at least one signal. In a preferred embodiment of the invention, said acoustic signal comprises human audible sound. Preferably, said sound has a main frequency over 10kHz.
Alternatively, said sound has a main frequency which is infra-sonic.
In a preferred embodiment of the invention, said information is encoded using below human-threshold amplitude signals. Alternatively or additionally, said information is encoded using below human-threshold amplitude variations.
In a preferred embodiment of the invention, said sound is generated at a frequency outside a normal operating frequency for said sound subsystem. Alternatively or additionally, said sound subsystem is designed for generating musical sounds.
In a preferred embodiment of the invention, said sound subsystem comprises a sound card. Preferably, said sound card comprises a SoundBlaster compatible sound card. In a preferred embodiment of the invention, said sound sub-system is designed for audible sound communication with a human operator.
In a preferred embodiment of the invention, said ultrasonic signal has a main frequency below 70, 60 or 50 kHz. Alternatively or additionally, said ultrasonic signal has a main frequency below 35kHz. Alternatively or additionally, said ultrasonic signal has a main frequency below 25kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 21kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 20kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of about 19kHz. Alternatively or additionally, said ultrasonic signal has a main frequency of below 18kHz.
There is also provided in accordance with a preferred embodiment of the invention, a method of creating a smart card terminal, comprising: providing a general purpose computer having a general-purpose sound sub-system; and loading a smart-card terminal software on said computer, wherein said software controls said sound system to receive acoustic waves from a smart card and transmit acoustic waves to the smart card. Preferably, said software analyses said received acoustic waves to determine information encoded by said acoustic waves.
Alternatively or additionally, said software retransmits said acoustic waves to a remote computer which analyses said received acoustic waves to determine information encoded by said acoustic waves. Alternatively or additionally, loading a smart-card terminal software comprises downloading the software over an Internet. Alternatively or additionally, said acoustic waves comprise ultrasonic waves. Alternatively or additionally, said smart-card comprises a memory for storing a monetary balance. Alternatively or additionally, said software encrypts information encoded by said transmitted acoustic waves. Alternatively or additionally, said smart card comprises a memory for storing identification information for a card owner. Alternatively or additionally, said smart card comprises a processor for analyzing information received from said computer and for generating a response to said computer.
There is also provided in accordance with a preferred embodiment of the invention, a computer system comprises: a processor; a sound sub-system, designed for generating music, comprising: a speaker which generates acoustic waves; and a microphone which detects acoustic waves; a memory; and a software installed in said memory, wherein said software analyses acoustic waves received by said microphone to recognize information encoded by said acoustic waves and wherein said software uses said speaker to transmit information encoding acoustic waves responsive to said recognized information. Preferably, said acoustic waves comprise ultrasonic acoustic waves.
There is also provided in accordance with a preferred embodiment of the invention, a method of attaching a peripheral to a computer, comprising: providing a general purpose computer including a sound generating and receiving subsystem; analyzing, at said computer, sounds received by said subsystem to detect acoustic transmissions from said peripheral; and transmitting, from said computer and using said subsystem, information to said peripheral using encoded sound transmissions.
There is also provided in accordance with a preferred embodiment of the invention, method of communicating with a computer, comprising: generating by a computer an electromagnetic field by driving a computer component not designed for field generation in a manner which generates a parasitic electromagnetic field, wherein said field is encoded with information by said generation; and receiving said encoded field by an electronic device. Preferably, said electronic device receives said wave using an RF antenna. Alternatively or additionally, said electronic device receives said wave using a microphone. Alternatively or additionally, said computer component comprises a speaker. Alternatively or additionally, said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz.
There is also provided in accordance with a preferred embodiment of the invention, a method of detecting electromagnetic radiation by a computer comprising: generating an electro magnetic field which encodes information; sampling a microphone channel associated with said computer to detect artifacts caused by said field; and decoding said information by said computer. Preferably, said associated computer is physically connected to said microphone channel. Alternatively, said associated computer is connected to said microphone channel by a computer network connection.
In a preferred embodiment of the invention, said electromagnetic field is a side-effect of driving a speaker. Preferably, said electromagnetic field is a side-effect of driving a speaker.
In a preferred embodiment of the invention, said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz. There is also provided in accordance with a preferred embodiment of the invention, a method of emulating a microphone using a speaker, comprising: providing a computer having a speaker channel and a microphone channel; coupling a computer speaker to the microphone channel; and receiving signals for said microphone channel via said speaker. Preferably, coupling comprises coupling using a coupler.
There is also provided in accordance with a preferred embodiment of the invention, a coupler for an audio channel, comprising: a first connector for selectively driving a speaker or receiving input from a microphone; a second connector for sending signals to a microphone channel; a third connector for receiving speaker-driving signals from a speaker channel; and circuitry for selectively driving said speaker or receiving signals from said microphone, using said first connector. Preferably, said circuitry receives switching instructions via said speaker channel.
There is also provided in accordance with a preferred embodiment of the invention, a method of determining a status of an electronic device, comprising: receiving information encoding acoustic signals generated by said device; and analyzing said signals to determine an operational status associated with said device responsive to said information. Preferably, said status comprises a status of said device. Alternatively or additionally, said status comprises a status of a second device attached by computer communications with said device. Alternatively or additionally, said status comprises a status of a network that said device is part of. Alternatively or additionally, said analyzing comprises analyzing on a computer separate from a circuitry used for acquiring said signals. Alternatively or additionally, said signals are generated by said device responsive to an interrogation by a second device which performs said receiving. Preferably, said interrogation does not interrupt other activities of said device.
Alternatively, said signals are generated by said device independent of an intenogation by a second device. In a preferred embodiment of the invention, said signals are sonic. Alternatively, said signals are ultrasonic.
In a preferred embodiment of the invention, the method comprises programming an existing device to generate said signals using an existing speaker which, when the device was designed, was not designated for communication with a second device. Preferably, said programming comprises software programming in which only memory storage locations are modified. Alternatively or additionally, said programming comprises hardware programming in which electronic circuitry of the device is modified.
In a preferred embodiment of the invention, said electronic device comprises a computer. Alternatively, said electronic device comprises a network hub. Alternatively, said electronic device comprises a network switch. Alternatively, said electronic device comprises a network router.
There is also provided in accordance with a preferred embodiment of the invention, a method of accessing a single user computer by a second user, without interrupting the activities of the first user, comprising: transmitting an acoustically encoded command by the second user to the computer; receiving said command by the computer; and executing the command by the computer. Preferably, said command is ultrasonically encoded. Alternatively or additionally, said receiving comprises receiving using a microphone connected to a sound card of said computer, which sound card is designed for audio applications.
There is also provided in accordance with a preferred embodiment of the invention, a computer networking method comprising: providing first, second and third computers; and transmitting a message encoding data from the first computer to the third computer via the second computer by acoustic transmission between the computers. Preferably, said acoustic transmissions utilize sound cards designed specifically for processing audible sounds.
Alternatively or additionally, said acoustic transmissions utilize are ultrasonic having a frequency of less than 50 kHz.
There is also provided in accordance with a preferred embodiment of the invention, a wireless peripheral for an electronic device, comprising: a microphone for receiving ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; circuitry for processing said transmission; and a display for displaying a result of said processing. Preferably, said peripheral comprises an input element and a speaker for transmitting sound to said electronic device responsive to input from said input element.
In a preferred embodiment of the invention, said peripheral comprises a printing engine for printing a result of said processing. Alternatively or additionally, said processing comprises merely of converting the signals from an acoustic encoding format to a format suitable for said display. Alternatively, said processing comprises processing the information encoded by said transmissions.
In a preferred embodiment of the invention, said electronic device comprises a computer. Alternatively or additionally, said electronic device comprises a radio. Alternatively or additionally, said peripheral comprises a speaker for said electronic device. Alternatively or additionally, said peripheral comprises a time display which presents a time signal generated by said electronic device. Alternatively or additionally, said peripheral comprises a status display which presents a status signal generated by said electronic device.
There is also provided in accordance with a preferred embodiment of the invention, a wireless peripheral for an electronic device, comprising: a speaker for transmitting ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; and circuitry for generating said transmissions; and an input element for receiving input to be encoded by said transmissions. Preferably, the peripheral comprises a microphone for receiving ultrasonic transmissions from said electronic device. Alternatively or additionally, said input element comprises a bar-code reader. Alternatively or additionally, said input element comprises a smart card reader. Alternatively or additionally, said input element comprises a pointing device. Alternatively or additionally, said input element comprises a keyboard.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with a computer, comprising: providing a computer having a data line attached to at least one particular peripheral; sending a data transmission to the computer by injecting a signal into said data line using an electromagnetic coupler; and identifying by said computer the source of said data transmission. There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with a computer, comprising: providing a computer having a data line attached to at least one particular peripheral; generating by said computer a data transmission directed to a different peripheral; and receiving said data transmission from the computer by eavesdropping on said data line using an electromagnetic coupler.
There is also provided in accordance with a preferred embodiment of the invention, a method of injecting data into a computer from an uncoupled peripheral, comprising: transmitting said data from the uncoupled peripheral to a tap; and physically activating a peripheral coupled to said computer, by said tap. Preferably, physically activating comprises activating keys in a keyboard. Alternatively, physically activating comprises activating vibrating a mouse.
There is also provided in accordance with a preferred embodiment of the invention, a method of communicating with a computer, comprising: generating by a computer a data transmission; controlling, by said computer, a component not designated for data transmission, to effect a transmission of said data; and receiving said data transmission from the computer by a second device. Preferably, said computer controls an activation of a mechanical component of said computer to transmit said data by modulation of mechanical sounds generated by said computer. Alternatively or additionally, said computer controls an activation of a status LEDs of said computer to transmit said data by modulation of illumination of said LEDs. Alternatively or additionally, said computer controls an activation of an electrical component of said computer to transmit said data by modulation of parasitic RF signals generated by said computer.
There is also provided in accordance with a preferred embodiment of the invention, a method of transmitting data over a computer network, comprising: providing a sound file at a first location; transmitting said sound file to a second location via said computer network; and transmitting said sound file as acoustic sounds to a processor at a third location.
There is also provided in accordance with a preferred embodiment of the invention, a method of transmitting data over a computer network, comprising: encoding data as acoustic sounds at a first location; transmitting said sound file to a second location as acoustic sounds; and transmitting said acoustic sounds as a sound file to a third location, via said network.
In a preferred embodiment of the invention, said network comprises an Internet. There is also provided in accordance with a preferred embodiment of the invention, a method of analyzing acoustic signals, comprising: receiving said signals using a microphone which microphone converts the signals into analog electrical signals; driving at least one digital data lead of an integrated circuit using said analog signals; and processing said signals using said integrated circuit. Preferably, the method comprises amplifying said electrical signals prior to said driving.
There is also provided in accordance with a preferred embodiment of the invention, a method of determining a time of flight of a pulse between two electronic devices, comprising: simultaneously generating an acoustic pulse and an electromagnetic pulse using a speaker of a first electronic device; detecting, using a single detector associated with a second electronic device, both the acoustic pulse and the electromagnetic pulse; and determining a time of flight of said acoustic pulse the two devices based on a delay between the reception of the two pulses.
There is also provided in accordance with a preferred embodiment of the invention, a method of acoustic communication, comprising: estimating an echo duration for an acoustic band; and transmitting data using the acoustic band, wherein between data elements a period of silence is provided, having a duration responsive to said echo duration. Preferably, the data elements are encoded using individual frequencies in an FSK encoding protocol. Alternatively or additionally, estimating comprises estimating based on an expected communication geometry. Alternatively, estimating comprises estimating a duration based on at least one acoustic calibration generated adjacent to said data transmission.
BRIEF DESCRIPTION OF THE DRAWINGS The invention will be more clearly understood with reference to the following detailed descriptions of non-limiting preferred embodiments of the invention in which:
Fig. 1 is a schematic illustration of a computer and an electronic device that are operative to communicate using sound waves, in accordance with a preferred embodiment of the invention;
Fig. 2 is a schematic illustration of two communicating electronic devices, in accordance with a preferred embodiment of the invention;
Fig. 3 is a schematic illustration of a smart card communicating with a computer, in accordance with a preferred embodiment of the invention;
Fig. 4 is a schematic illustration of a smart-card reader in accordance with a preferred embodiment of the invention;
Fig. 5 is a schematic illustration of a method of tapping into a computer, without requiring complicated installation of hardware, in accordance with a preferred embodiment of the invention;
Fig. 6 is a schematic illustration of an unobtrusive computer checkup in accordance with a preferred embodiment of the invention; and
Fig. 7 is a schematic illustration of a computer communication setup using acoustics, in accordance with a preferred embodiment of the invention. DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
Fig. 1 is a schematic illustration of a computer 20 and an electronic device 30, which are operative to communicate using sound waves, in accordance with a preferred embodiment of the invention. Most computers currently on sale include a sound system 24, usually a sound card, connected to at least one microphone 26 and at least one speaker 28. Many electronic devices include a microphone 34 and a speaker 36. In a preferred embodiment of the invention, computer 20 and electronic device 30 communicate using these standard components, which are usually not designed for computer communication but for human communication. In some cases, the electronic device (or the computer) may include a jack to which one or more speakers and one or more microphones may be connected. Preferably, such connected acoustic elements are positioned on a difficult to obstruct portion of the device, preferably at positions where the elements have a wide field of view.
In one preferred embodiment of the invention, a standard sound card, such as the popular "Sound-Blaster" is used to generate sonic and/or ultrasonic signals to (and to receive them from) an electronic device, a toy and/or another object. The acoustic signal may be audible or inaudible, for example having mainly ultrasonic or infrasonic frequencies. Preferably, frequencies of about 22kHz and 24kHz and 32 kHz are used, since a standard sound card provides these sampling rates (and/or their multiples, e.g., 44 kHz and 48kHz). As used herein the term "main frequency" is used to describe the frequency band in which most of the energy of the information carrying signal is concentrated. In some cases, the information carrying portion of the signal is not at the main frequency generated by the card, for example when an ultrasonic signal is overlaid on a different audible sound.
In some preferred embodiments of the invention, a sound card is adapted to work in the near ultrasonic range, for example by increasing its sampling frequency. Generally, the microphone and loudspeaker used for a computer system can support low frequency ultrasound with sufficient fidelity without adaptation. In some cases however, a special ultrasound-sensitive microphone or ultrasound- effective speaker may be used. In other cases, the sensitivity of a particular microphone and/or loudspeaker maybe determined prior to or during communication with an electronic device. In one example, if a device having known characteristics transmits an equally powerful signal at several frequencies, the frequency sensitivity (and or directional sensitively) of a microphone may be determined. In a similar manner, a computer may generate these sounds and the signals detected by the device analyzed to determine output characteristics of the particular loudspeaker used. In addition, a self- calibration procedure may be performed by listening to the computer's output using the computer's microphone. In some cases, both the device and the computer sound systems can be calibrated by combining self testing and cross-testing.
In some cases, the microphone and/or the sound card are sensitive enough to receive, from the object, an RF signal associated with generating the acoustic signals, even if an acoustic signal is not sent (e.g., no loudspeaker is present). Alternatively or additionally, the object may detect RF signals generated by the speaker or sound card while generating the ultrasound. These RF signals are generally less affected by lack of line of sight than ultrasonic signals. In an exemplary embodiment, a device for communication with a telephone handset (or other devices where the speaker and microphone are displaced), can be made small, by allowing the detection of sounds from the telephone to be emulated by the detection of RF fields from the telephone speaker. Thus, a smart-card can be made small and placed against the telephone microphone and still receive signals from the telephone loudspeaker. Alternatively or additionally, the device may transmit RF fields to generate an electrical signals at the telephone microphone. These transmitted and received signals may be ultrasonic or they may be sonic, for example DTMF or DTMF-like signals as known in the art.
In a preferred embodiment of the invention, such an acoustic communication may be used to program a toy and or retrieve information from a toy, for example replacing an RF link for this purpose as described in US patent number 5,752,880, the disclosure of which is incorporated herein by reference. In a particular embodiment, music may be downloaded from the Internet, directly to the toy, for example by modulating an ultrasonic signal to carry MP3 sound files. Alternatively or additionally, such a link may be used for real-time communication with the toy.
Some embodiments of the invention do not require that the electronic device communicate with a computer. Fig. 2 is a schematic illustration of two communicating electronic devices 30 and 30'. In one example, a PDA communicates with a printer. In another, an organizer communicates with a satellite telephone. Possibly, such communication is used to exchange data files and/or to share capabilities, such as modem connections. In some cases a port adapter may be required to be plugged into a port, for example a sonic-to-parallel adapter, which converts between acoustic signals and parallel port signals. A computer network, in accordance with a preferred embodiment of the invention, utilizes sound waves transmitted between computers for communication, using existing hardware, such as an audio card, loudspeakers and a microphone. Preferably, the sound waves are ultrasound waves. In a preferred embodiment of the invention, such a computer network is used to connect a PDA or a portable computer to a different computer, for example for data transfer or for sharing peripherals, such as a modem, a printer or a storage device. Thus, an existing PDA (which includes a loudspeaker and a microphone) can use a modem of a desktop computer, without requiring additional hardware in the PDA, possibly requiring only a small software change. This software change may be in application software on the PDA or in the operating system software (or both), depending on the implementation. In another example an acoustic-enabled smart-card (such as that described below), can print, or backup information using a standard desktop computer. Alternatively or additionally, such a network may be used in a small office, for example for file or printer sharing.
In a preferred embodiment of the invention, a standard communication protocol language is defined, so that many types of devices can communicate and or share resources using the standard language. Alternatively, an existing networking language may be used.
In a preferred embodiment of the invention, sonic and/or ultrasonic communication is used for paying a toll or a fee (human, package or vehicle), utilizing a reactive component, possibly a passive transponder, on the tolled item. In another example, such communication is used to pay a transportation fee, for example on a subway or a bus. Alternatively or additionally, an acoustic mechanism as described herein is used to open vehicle barriers, for example at entrances to apartment complexes or to open garage doors. Alternatively or additionally, the acoustic mechanism is used for automatic refueling/billing systems, possibly transmitting billing and/or mileage information to a pump receiver, controlling the fuel flow and or verifying the fuel type. Possibly, a car dashboard speaker, a car horn, an alarm speaker, a car radio speaker or a dedicated speaker, is used to sound the required sonic and/or ultrasonic signals. In some cases, as noted above, it is the RF signals generated by the speaker which are detected. In a preferred embodiment of the invention, a car radio speaker is made to generate the required sounds by transmitting an electromagnetic wave to the radio or to its loudspeaker, from a specialized electronic device.
Alternatively or additionally, to using a computer, in a preferred embodiment of the invention, a set-top box, of a cable TV system, for example, is used to transmit and/or receive acoustic signals. Preferably, a microphone is connected to the set-top box. Alternatively or additionally, the transmission back to the set-top box uses an ER. signal, which is detectable by the set-top box. In one example, the set-top box includes software that analyzes signals. Such signals may comprise responses of electronic devices and/or toys to sounds generated by the television or by the set-top box. Alternatively or additionally, the set-top box adds sounds (or ultrasonic waves) to a video and/or audio stream decompressed by the set-top box.
Alternatively or additionally, the set-top box adds temporal and/or spatial optical modulations to a video stream, for an optically-sensitive electronic device to detect. In a preferred embodiment of the invention, the detection of a signal by an electronic device (or a computer) comprises a binary detection of the signal, e.g., an on/off state. Additionally or alternatively, more complex signal detection and analysis techniques may be implemented, for example, detection of signal amplitude, frequency, frequency spectrum, Doppler shift, change in amplitude and/or duration, detection of a number of repetitions, voice and/or other pattern recognition in the sound. Various information encoding protocols may be used, including AM, FM, PSK, QPSK and/or pulse length encoding. The transmitted signal may include one or more of information about the sending device's activities, location, environment, nearby devices, locally sensed information, logic state, readiness, requests for information and/or answers to such requests.
Such signal detection and/or analysis may also be performed on a computer that is in communication with the electronic device. The physical detection circuit is preferably located on the device. Additionally or alternatively, the detection circuit is also located on the computer. In a preferred embodiment of the invention, microphone 34 (or microphone 26) comprises a directional microphone, for example a stereophonic microphone or a microphone in which the frequency response is spatially non-uniform, to aid in determining the direction of the sound source or to reduce noise.
PCT application PCT/IL98/00450, titled "The Control of Toys and Devices by Sounds", filed September 16, 1998, in the Israeli receiving office, the disclosure of which is incorporated herein by reference, describes sound actuated toys. In particular, the application describes various sound makers that generate sounds inadvertently as a result of motion, for example beads in a box or noise form a crinkle material. Such a sound maker is connected to and/or mounted on a toy, so that when the toy moves a signal will be generated for another toy or device to acquire. This PCT application also describes detecting the direction and/or position of a sound, using directional microphones and/or a stereophonic microphone including two or more microphone elements. Additionally or alternatively, a relative distance is determined based on amplitude of the sound.
Israel application 127,569, filed December 14, 1998, titled "Interactive Toys", the disclosure of which is incorporated herein by reference, describes various toys and electronic devices which interact using sound waves. These applications contain information useful in the design and use of acoustically controlled devices, and which may be applied towards some preferred embodiments of the invention.
Fig. 3 is a schematic illustration of a smart card 40 that communicates with a computer. Although a smart card is a special case of an electronic device, it is noted that typical smart cards do not include an acoustic input/output channel, especially not an ultrasonic one, in the low ultrasonic frequencies.
In a preferred embodiment of the invention, smart card 40 comprises an acoustic element 42, a processor 44 that controls the acoustic element and a memory 46 for storing information. Such a smart card may use a single piezoelectric transducer (possibly a film layer) for both transmission and reception.
As many electronic devices include a speaker and/or a microphone, such a card may communicate with any such device that has suitable software. Due to the decreasing size of electronics, in some cases, a smart card may be emulated using a PDA or other electronic means (or vice-versa), with regard to both size and functionality. Additionally or alternatively, such smart card functionality may be exhibited by a cellular telephone or a lap top computer. A benefit of a lap top computer and of a PDA is their convenient user-interface. A benefit of a cellular telephone is the possibility of real-time and/or off-line communication with a central location. A particular desirable use for such a smart card is for authentication, e.g., using a digital signature method, of e-commerce transactions. In such an application, the card may be used to supply encrypted or signed information, to a vendor, over the Internet or over the telephone, by transmitting sound wave to the computer from the sound card. These sound waves can forwarded to the vendor or a verifier as sound files or as data files. The smart card may generate the information responsive to information presented by the computer, either acoustically to the smart card or using a human to enter data into the sound file.
Fig. 4 is a schematic illustration of a smart-card docking station 110 in accordance with a preferred embodiment of the invention. A smart card 112 is inserted into the reader 110. A portion 114 of the reader is configured to communicate with the smart card, for example using RF, magnetic fields, ultrasound, IR and/or any other communication protocols. Possibly, a plurality of such areas 114 are provided, each for a different physical protocol. These communications with the card are preferably transformed, using an acoustic transducer 116, into acoustic communications to be transmitted to- and/or received by- a remote computer or other electronic device, using the methods as described herein. Thus, an owner of a smart card can easily interact with a standard computer without installing a dedicated reader on the computer. Rather, the smart card owner will carry around a miniature adapter 110 that can communicate with a computer in a wireless manner. Alternatively, a smart card may be constructed to have an ultrasonic communication protocol, such that swiping can be performed without requiring a docking station 110. Alternatively or additionally, docking station 110 is designed specifically for magnetic cards, such as common credit cards. Station 110 preferably includes a sensitive magnetic field detector in area 114, so that when a card is inserted into the docking station, the magnetic strip is read. Consequently, it becomes possible to swipe a standard magnetic card at many existing electronic devices, without requiring special hardware to be connected. A dedicated station may be made very thin, for example less than 10 mm or even less than 5 mm. Preferably the docking station has a closed configuration, but an open docking station, comprising a sensor and a contra to hold the card against the sensor is also envisioned. Although card swiping is a one-way communication process, in some cases two way communication may be desirable, for example for a user to collect information regarding purchases for example amounts, times, type and authentication confirmation. In some embodiments, this information may be accumulated by the station 110, as described below.
Alternatively or additionally, station 110 may be adapted to attach to a port of a PDA, cellular telephone, "organizer" or other portable electronic devices. Such a station converts electronic signals at the port to sonic and/or ultrasonic acoustic signals that can be recognized by a computer.
A dedicated station may be manufactured for each device and smart card type. Alternatively, a single station may be constructed for multiple device types and include an auto-sensing circuit for detecting the logic of the output port. One example of such a detection is by "transmitting" a known signal from the device and determining the setting which allows the station to detect that signal. Another example of automatic detection is by automatically recognizing characteristics of the device, such as transmission amplitude or geometry. Alternatively, station 110 may include a switch or other user interface for manually selecting between different types of electronic devices. It should be noted that although acoustic communication is preferred for at least one communication direction (computer to smart-card or smart-card computer) one or both of the communication directions may utilize other technologies, temporarily or on a permanent basis. For example, the card may use the IRDA IR communications standard or the Bluetooth RF communications standard. Alternatively, one of the directions may be manual, for example a device displaying to a user what he should enter into the other device.
In some embodiments of the invention, station 110 may enhance the functionality of a device or a magnetic card, possibly elevating its functionality to that of a smart card, or enhancing the functionality of a less versatile smart card. For example, station 110 may provide authentication of vendor, by decoding an encrypted signal transmitted by the vendor (which a magnetic card is unable to read and or process). In another example, station 110 may comprise a memory for tracking the use of a magnetic card. In another example, station 100 may provide positioning capabilities.
In a preferred embodiment of the invention, spatial angles between a sound source and a plurality of microphones are determined by analyzing phase differences at the microphones. Alternatively or additionally, other methods known in the art may be used for positioning. In a preferred embodiment of the invention, a relative location of a pulsing sound source and a plurality of microphones is determined by solving time of flight equations. Thus, the relative location of an electronic device and or a computer, relative to another electronic device or smart card, may be determined and used to control the operation and/or cooperation of one of the above electronic devices.
In a preferred embodiment of the invention, four microphones are used to determine a three-dimensional position. For a source at r=(xo,yo.zo) anc^ a plurality "i" of microphones at Mj=(xj,yi,zi), the distances between the source and the microphones are Dj=||r-Mi||. The acoustic velocity, "c", may be known, for example based on a known velocity in air. Alternatively, it may be determined by measuring the time of flight between a sound source and a microphone having fixed and known relative locations. A difference between distances is preferably defined as dD(i,j)=Di-Dj=c*dt(ij), where dt(ij) is defined as a difference between time of arrival at microphone i and time of arrival at microphone j. For N microphones there are N-l independent differences dD. In an optimal configuration, the four microphones located at vertexes of a tetrahedron may be used to determine the location of a source. From practical considerations, such an arrangement may not be possible. Preferably, more than four microphones are used, so that a higher resistance to noise and/or a higher localization precision may be achieved. In a preferred embodiment of the invention, the three dimensional position is determined by numerically or analytically solving three equations of the form: dD==c*dt(i,j)=||r-Mi||-||r-Mj||, where (ij) is preferably selected to be (1,2), (2,3) and (3,4). However any other independent three pairs of microphones may be used. In some cases it is useful if one of the electronic devices operates as a transponder, which receives signals and sends back a signal indicative of the received signal and/or its time of flight. In some embodiments of the invention, the above positioning method may be applied using passive tags on the object whose position is to be detected. In a preferred embodiment of the invention, such tags are powered by the computer speaker, using an RF field generated by the speaker. Alternatively, other RF-generating computer components may be used, this powering may be used to allow the tags to be responsive. Alternatively, this powering may be used for other uses. Alternatively, the powering may be by using a standard smart-cart RF- coupling peripheral.
Position determination may be based on transponding signals which impinge on objects. Alternatively, an object may transmit a signal which encodes the time of arrival of the interrogating signal. Thus, the accuracy of positioning can be higher than the frequency of the interrogation signal, assuming the object has a clock with a higher resolution than the frequency of the interrogation signal.
A touch screen in accordance with a preferred embodiment of the invention utilizes acoustic transmission to detect the location of a touch implement, such as a pen. In a preferred embodiment of the invention, the position of the pen is determined using one or more microphones and or speakers mounted on the pen, which transmit and/or receive signals from a computer and/or other speaker and/or microphone controller. Possibly, a three-dimensional position of the touch implement is determined using four acoustic elements, such as two microphones and two speakers. It is noted that a computer typically includes a modem speaker, an internal speaker and/or optionally a keyboard speaker, as well as sound-card speakers. Lately, however, the internal speaker is not provided in standard installations. In addition, some computers include an ultrasonic pointing device or other ultrasonic ports. In a preferred embodiment of the invention, the smart card can communicate using this ultrasonic communication port. A more basic type of position detection may be based on detecting an interruption by an object of an ultrasonic beam between a speaker and a microphone.
Alternatively or additionally to position detection using a responsive object, a radar- type position or distance detection may be used, in which a microphone of a computer detects the reflection of ultrasonic waves from an object, which waves are generated by a computer speaker. By detecting only relative differences between reflections from different objects, the relative distances of the objects can be determined without knowing the exact location of the sound source.
In some preferred embodiments of the invention, the microphone detects both an acoustic pulse and an electromagnetic pulse generated as a side effect of producing the acoustic pulse. As the electromagnetic pulse is substantially simultaneous it may be used as a clock or as a reference time for determining the time of flight of the acoustic pulse. Additionally, since a transponder microphone may detect both kinds of pulses, it is possible to determine the component times of flight to a transponder and not just the sum time of flight, using a retransmission of the detected signals by the transponder. In a preferred embodiment of the invention, location methods utilize a calibration process, in which the located implement is placed at one or more known location, so that it is possible to correct for the location of the speaker(s) and the microphone(s)/ Alternatively or additionally, the calibration procedure is used to correct for propagation times (of the acoustic waves and/or of electronic signals which generate sounds) and/or for reflections, wavelength dependent attenuation and or broadband attenuation.
A different type of touch screen, in accordance with a preferred embodiment of the invention, detects the location of a touch implement based on the detection and position determination (2D or 3D) of sounds generated when the touch implement touches the "touch sensitive" surface. This surface may be coated with a sound generating material, such as crinkle-paper, to provide a distinctive sound.
In a preferred embodiment of the invention, for example as described above, an interrogated object receives the ultrasound signal and sends it back to a microphone of the computer. In a preferred embodiment of the invention, the computer analyses the time of flight and/or other attributes of the transmission and determines a distance from, position to, velocity of motion and/or other spatial attributes of the object. In some cases, a plurality of sources or receivers may be placed on the object, to assist in determining angular motion of the object. Alternatively or additionally, Doppler analysis of the response may be used to detect changes in distance. Alternatively or additionally, changes in distance are detected by comparing two consecutive measured distances. The plurality of sources may be differentiated, for example, by timing of signal generation, frequency band used and/or encoding of the transmitted signal.
In a prefened embodiment of the invention, the object responds immediately to the interrogation signal. Alternatively, the object delays its response to an interrogation signal, for example for a few milliseconds. Alternatively or additionally, the object transmits at a different frequency from the received frequency, for example at 24kHz in response to a 20kHz query. Alternatively or additionally, the signal transmitted by the object is received by a transducer which then transmits the signal to the computer, for example acoustically or using electromagnetic coupling. Alternatively or additionally, the object may respond with an identification code. Alternatively or additionally, the object modulates its transmission with an envelope, which envelope preferable serves as an identification code and/or for transmission of information regarding a status of the object, for example a position of an arm of a toy. In some cases, the object relays information from a more remote object. In the case of identification, the object may send an ID code even without prompting from the computer, for example periodically or by a user pressing a button on the object (or by flexing the object). In a preferred embodiment of the invention, the object amplifies the signal it receives using a discharge of a coil through a transistor, where the transistor serves as a variable resistor and or as a wave-form controller.
In some preferred embodiments of the invention, the generated sounds are transmitted indirectly via an existing network. One example of a suitable network is a telephone network, preferably a digital network, with the sounds being forwarded from one telephone to another. Another example of a suitable network is an intercom system. Another example of a suitable network is a LAN or an Internet. Additionally, as described below, the ultrasonic waves may be transmitted (as acoustics, not electromagnetic) over wiring, such as electrical wiring or over pipes, such as water and gas pipes.
In a preferred embodiment of the invention, a wireless telephone system uses handsets which communicate with base stations, for example computers or telephones, using ultrasonic communication, as described herein. In a preferred embodiment of the invention, an office telephone or computer network can serve as a local cellular network for communication, by keeping track of which base-stations are in communication with which handsets and by providing the ability for a base station to locate handsets and for a handset to change base stations.
In many situations, there will be more than one active smart card (or other electronic device using ultrasonic waves for communication) in a region at a single time. In a preferred embodiment of the invention, the different devices coordinate so that they do not both transmit at a same time. In one example, a central computer assigns time, frequency or coding (CDMA) slots. In another example, an ALOHA algorithm is used to avoid collisions.
Some embodiments of the present invention contemplate other methods of communication with a computer (or other devices) without installing hardware. Fig. 5 is a schematic block diagram of a communications tap 102 for a computer 100, in accordance with a preferred embodiment of the invention. In the configuration of Fig. 5, a tap is preferably placed on communication line to an existing peripheral 104. Thus, a user may not be required to even access a back part of a computer, let alone a computer's internal workings. An electronic device 106, a toy and/or a smart-card preferably send and/or receive signals from tap 102. Additionally or alternatively, device 106 may use one tap for receiving and one for sending. Possibly, a device uses taps only for one direction of communication.
In a preferred embodiment of the invention, the tap is placed on a cable to a printer, a network cable, a camera cable and/or a SCSI connection. Additionally or alternatively, the tap is placed on a serial cable, for example a mouse cable. Additionally or alternatively, the tap is placed on a modem line, for example on a telephone line or by plugging the tap into another telephone socket, to be received by the modem. Additionally or alternatively, the tap is placed on a game controller line. Additionally or altematively, the tap is placed on a loudspeaker line. This type of tap can detect signals that cannot be reproduced by the loudspeaker, for example very high frequencies, for example higher than 50 kHz. Additionally or alternatively, the tap is placed on a microphone line, possibly using the microphone line and/or the microphone itself as a sonic, ultrasonic or non-acoustic antenna (e.g., RF). Additionally or altematively, the tap is placed on a display cable line.
In a preferred embodiment of the invention, the tap includes an electro-magnetic coupler, which can induce signals in a cable that passes through or near the tap. Additionally or altematively, the tap can detect signals in the line and transmit them to device 106. In a preferred embodiment of the invention, the signals are at a different carrier frequency and/or signal frequency than the usual signals passed along the line. Additionally or alternatively, the signals travel in an opposite direction (input signals on an output line, such as a printer or output signals on an input line, such as a mouse). Additionally or alternatively, the signals encode information which information is detected and removed from the data stream in the computer. Additionally or alternatively, the signals are asynchronic on a synchronic line. Additionally or alternatively, the signals are transmitted only when no signal is expected by the computer and/or the peripheral.
In an alternative embodiment of the invention, a piezoelectric actuator (or other vibrating element) is connected to a mouse (or a microphone). The actuator causes the mouse to shake at an amplitude of one or two screen pixels (or less) and the shaking is detected by software in the computer as signals from the toy. A return signal may be transmitted to a tap associated with the actuator, along the serial cable, with the signal preferably being coded to be recognized by the tap and/or ignored by the mouse. In an alternative embodiment of the invention, device 106 sends signals to computer
102 using a tap which actuates keys on a keyboard attached to computer 100. Such actuation may be, for example, mechanical or magnetic (e.g., on magnetic switched keyboards). Preferably the key used is a shift key. Additionally or alternatively, signals from the computer are detected by detecting illumination of LEDs on the keyboard, for example a "Num Lock" LED.
Altematively or additionally, the tap detects illumination of other LEDs on a computer, for example power, sleep, CD-ROM and/or hard disk LEDs. Alternatively or additionally, the tap detects information transmitted via noise or vibration generated by activation and/or modulation of the activity of mechanical components of the computer, for example diskette drives, disk drives and CD-ROM drives. Altematively or additionally, the tap detects an electromagnetic signal generated by power surges to the devices, for example a CD-ROM when it is powered or variations in RF amplitude and/or frequency of the CPU, for example those caused by entering a sleep mode.
In a preferred embodiment of the invention, a tap "learns" the electromagnetic and/or acoustic profile of a particular computer or portion thereof and learns the effects of various commands on this profile. When a computer desires to communicate with a tap, it preferably modifies the profile using those commands which are determined to have the greatest, most noticeable and or fastest effect on the profile.
Additionally or alternatively, device 106 utilizes a transducer which plugs into a parallel port, a serial port and/or is optically coupled or placed near an IR port. Preferably, the transducer is a pass-through transducer, through which a printer and or other peripherals may communicate normally with a computer. This transducer can then transmit the signals by wired or wireless methods to a remote device.
In a preferred embodiment of the invention, the tap and or transducer can automatically detect which type of cable is tapped/port is connected to. Such a tap preferably includes a microprocessor or an integrated circuit to analyze signals on the cable, rather than solely a transducer for coupling signals to and from the cable. Preferably, such detection is by analyzing amplitude, frequency and/or synchronization of signals passing through the lines. Additionally or alternatively, the computer detects which line is tapped, by detecting particular inferences on that line. Alternatively or additionally, software on the computer sends test signals along the lines, to be detected by the tap. Possibly, the tap can detect the signals even without being programmed with the type of line on which the signals are transmitted. Alternatively, when a tap is used, a configuration program is run so that a user can define to the tap and/or the computer what is being tapped. In a preferred embodiment of the invention, a smart card directly taps the computer, for example using a RF antenna embedded in the smart card to detect signals being transmitted over data lines, e.g., to a peripheral or another computer or for the use of the smart card.
In an exemplary embodiment of a device using tapping, a pass-through hasp is provided, which is connected to a port. In a preferred embodiment of the invention, the hasp uses power from the power lines but does not interact with data flowing through the port.
Authentication of software using the hasp preferably utilizes acoustic communication between the hasp and the computer's microphone and/or speaker. Altematively, the hasp may interact with signals that flow through the port, which signals are not suitable for use as data, for example the signals using a wrong protocol, having an incorrect CRC, being asynchronous in a synchronous connection or having an incorrect frequency. Such a hasp may also be used to protect an easily stolen device, such as a PDA or a laptop computer, which can use their internal speakers and/or microphones to detect the proximity of a required ID tag. If the ID tag is not detected the device can fail to work, work incorrectly or it can report that it is stolen.
In a preferred embodiment of the invention, suitable software is installed on computer 100. Preferably, the software is self installing. Preferably, the computer is not used for any other use while device 106 is communicating with it. Additionally or alternatively, the software can differentiate between "regular" signals and signals related to the tap. In one example, a provided keyboard driver may detected special codes and/or data sequences on the keyboard line and remove them from the received data, passing only the rest of the received data to an operating system of computer 100. Additionally or alternatively, a provided mouse driver may detect spurious and/or small mouse movements, and recognize them as being tap- related signals, as described above. Additionally or alternatively, a printer driver can recognize data on the cable as not coming from the printer but from a tap. Additionally or alternatively, data sent to the tap is preferably sent as data which will be rejected or ignored by the peripheral, for example having incorrect parity settings or other intentional errors. Alternatively or additionally to using a tap for communication with a toy, such a tap may be used to attach a peripheral to computer 100. As indicated above, the tap may include a processing element so that the signals coupled to the cables do not interfere with the normal operation of the cable, for example being transmitted when there are no others signals on the cable. Alternatively, such processing may be performed by a device which uses the tap.
In a preferred embodiment of the invention, the signal received on the computer is used to modify an executing program and/or to generate commands to other electronic device, preferably using sounds generated by the computer but possibly using a dedicated connection. In an exemplary application, a computer game in which a computer display responds to external sounds, such as bowling pins falling, is provided.
The acoustic communication may also be used to communicate between an input device and a computer program, for example between a wireless keyboard or mouse and a computer. In another example, a light-pen transmits to the play-station a signal responsive to pixel intensities which are detected by a photo-detector thereon. Altematively or additionally, a synchronization signal is transmitted from a computer and or a set-top box to the pen, to synchronize the pixel detection with the TV raster scan. These transmissions may be additional to- or alternative to- transmission of position and/or orientation. Alternatively or additionally, the input device transmits the status of controls thereon. Alternatively or additionally, the transmission is used to transmit information to be displayed on an output device or an output portion of the input device, for example to light up lights thereon and/or drive text and/or graphics displays thereon.
Fig. 6 is a schematic illustration of an unobtrusive computer checkup in accordance with a preferred embodiment of the invention. A user 142 is using a computer 140. A user 146 wishes to interrogate computer 140, for example to analyze a networking problem. In a preferred embodiment of the invention, a smart card 144 (or other electronic device) can communicate with computer 140 using an acoustical- or a tap- channel as described above, without interfering with the activities of user 142. Alternatively or additionally, smart card 144 may be used to interrogate an interface-less device, such as a hub 148. One advantage of acoustical communication for these uses is that they do not generate a considerable amount of RF interference and do not require major (if any) changes in a (significant) install base of hardware. In a preferred embodiment of the invention, hardware devices, such as hub 148 and computer 140 continuously "hum" their status, in RF or in acoustics, so that the status can be discerned by eavesdropping on the hum, without needing to interrogate the hardware.
A card such as card 144 may also be used to give privileges to it's owner in the form of better service (e.g., priority at a file server, speed of connection to the Internet) and/or alleviate various security restrictions. For example, a manager can come to his employee desk, activates his card and previously unreachable files become available. It is noted that this process of changing the behavior of a computer does not require logging on to the computer (although such log-on is possible). Rather, the computer recognizes the manager even while it remains logged on to the other user.
In a preferred embodiment of the invention, when the card or other device is used for logging-on, a hysteresis-type logic is used, in which logging on requires a high quality definite signal, while logging-off (possibly automatic log-off) is delayed until there is substantially no contact with the card. The lack of contact can be detected by the lack of detection of a periodic signal generated by the card. Thus, once logging on is achieved, maintaining the contact does not require a high quality connection.
Fig. 7 is a schematic illustration of a computer communication setup using acoustics, in accordance with a preferred embodiment of the invention. A computer 152 includes a microphone 156 that is used for detecting activity sounds of other electronic and/or mechanical devices. The activity sounds may comprise natural sounds, for example a page sorter being used in a photocopier. Alternatively or additionally, they may comprises indicator sounds, for example a beep generated by a fax machine 150 when a fax comes in. Fax machine 150 may be connected to a computer (as shown) or it may be unconnected. Alternatively or additionally, they may comprise artificial sounds, for example a special information carrying sound generated specifically for the benefit of computer 152. In a preferred embodiment of the invention, a computer 152 transmits indications of the sensed activities to a remote computer, such as computer 154. Thus, a user at computer 154 can be informed of a fax coming in or of an unanswered telephone call even if he is in a different room and the fax machine is not connected to a standard computer network. Alternatively or additionally, the analysis of sounds detected by microphone 156 can be used to determine other occurrences at computer 152. In one example, microphone 156 can be used to log the habits of a user, including, telephone conversations, numbers dialed (by detecting the DTMF sounds), sounds of papers being shuffled, breathing sounds, snoring of a sleeping user, average number of rings until a call is answered, and typing habits. Altematively or additionally, microphone 156 can be used to detect an occupancy of a room or glass breakage, possibly serving as a burglar alarm.
Alternatively or additionally, the microphone may be used to detect electromagnetic impulses generated by operating devices. Typically, each device has a different electromagnetic signature. Different signatures may be generated when the device is switched on or off, when the device is operated and/or for different modes of operation. Thus, a computer-microphone combination can be used to detect the operation of devices, such as photocopies, door chimes and computers. In a preferred embodiment of the invention, a video input card is used to analyze higher frequencies of electromagnetic radiation than those detectable by a microphone-sound card combination. It can thus be appreciated that noise signals which are usually rejected by signal processing algorithms may be analyzed to detect important information of activities in the vicinity of the microphone.
In an exemplary device which communicates with a computer using ultrasound, input/output filtration circuits are provided. These filtration circuits preferably comprise op- amplifiers with filters for specific frequencies for input and output, dependent on the communication protocol used. If non-audible frequencies are used, the filters should preferably decrease or block power at audible frequencies, to reduce annoyance of a user.
The communication protocol is preferably a digital binary code in which the bits are transmitted using Frequency Modulation, Pulse Width Modulation, On-Off Keying and or any combination of the above. Error conection codes, for example parity, Gray or Hamming codes, as known in the art may be used. It should be noted that the range of available frequencies may be limited if ultrasonic frequencies are used, due to degraded capabilities of the computer sound card.
In a reception process, the signals received by the device are convert them to data bits, either by time domain analysis or by Fourier analysis. Thereafter, error checking is preferably performed. The received information may be decrypted (if necessary). Alternatively or additionally, the received information may be encrypted, verified and/or signed, in order to be stored in local memory. The local memory may comprise ROM, RAM, EPROM, EPROM and/or other types of memory as known in the art. Information to be transmitted may be encrypted before transmission. The software on the computer receives a detected signal, filters it, and opens the protocol. Preferably, the software reduces noise using IIR. band pass and/or low pass filters.
The received and filtered signal is then demodulated, into data bits, for example, by time domain analysis or by Fourier analysis. Data transmission errors are preferably corrected. The data may then be locally analyzed and/or transmitted to a remote location, for example a seller's computer. In some embodiments, this software is written in an Internet Language, such as Java or ActiveX.
In a preferred embodiment of the invention, the acoustical detection uses the maximum resolution and/or sensitivity afforded by the microphone, i.e., going below the noise threshold as defined for audio uses. Alternatively or additionally, repeating and/or periodic ambient sounds are detected and removed or disregarded from the input signal. In a preferred embodiment of the invention, ambient sounds are characterized as such during a calibration step which may be performed periodically.
In some cases one or more of the following problems may be encountered, including: echoes, interference (acoustic or electromagnetic), and, at higher frequencies (>10 kHz), problems of directionality and weak reception. In addition, many microphones and speakers behave badly or in an unstable manner at these frequencies. It is noted, that by detecting RF rather than acoustic signals, acoustic interference is reduced and/or the reception may be less sensitive to range and directionality. In a preferred embodiment of the invention, the received sound signals are processed using known signal processing techniques, such as filtration, equalization and echo cancellation. Preferred modulation methods used include PWM, FSK, QPSK and on-off keying. Preferred frequency band types include a single band, a wide band spread-spectrum and frequency hopping bands. Preferred protocols utilize one or more of start- stop synchronization bits, and constant and/or variable length messages. Possibly the device and/or the computer include logic for determining the exact frequency used for transmission, for example to correct for frequency hopping, for frequency shifts caused by inaccurate manufacture and/or for environmental effects. Error detection methods may be used, for example, CRC (preferably 32 bit), Parity, Checksum, Blowfish, Hamming Codes, Retransmit BCD Codes and Gray codes.
In a preferred embodiment of the invention, periods of silence are provided between data bits in protocols other than on-off keying. In one example, an FSK protocol is provided with silence between the frequency pulses. Preferably, the duration of the silence is sufficient so that echoes (or other artifacts) from the original pulse do not overlap with a next pulse. This period may be fixed, for example based on an expected geometry of the electronic devices and where they are used. Alternatively, the protocol may be adapted based on the instant echo situation. Alternatively or additionally, the pulse duration may be modified to overcome noise, echo and/or other transmission problems. In a preferred embodiment of the invention, a few calibration pulses are first sent to determine a desired silence and/or pulse duration. Possibly, different such durations are used for the two communication directions.
A feature of some embodiments of the invention is that a device can communicate with another device or computer over medium distances, such as 0.3-20 meters, more preferably, 2- 10 or about 7 meters.
Several variations on the reception at the computer (or other electronic device) may be practiced according to some preferred embodiments of the invention, including: (a) using a regular microphone and sound card; (b) using a regular sound card but with a special microphone (e.g., one that can be tuned to specific, even ultrasonic, frequencies); (c) using a speaker that can also be a microphone (one possibility is described in detail below); (d) using a microphone/receiver that connects to a dedicated channel such as an RS232 or parallel port, and that can optionally obtain power from the port; and (e) using a built in dedicated hardware port that can be implemented on the computer board. Several variations on the transmission from a computer (or other electronic device) can also be practiced, including: (a) using one or two speakers, powered alternatively or possibly powered together, for example to increase the total power, to aid in noise cancellation and/or to aid in detecting echoes; (b) using an acoustic transducer connected to a standard port or possibly tapping the computer, as described above; thus, there may be no need for a sound card in the computer; and (c) as suggested above, at small distances there appears to be an overlap between acoustic and electromagnetic signals both with regard to transmission and with regard to reception. Thus, possibly some of the signals are transmitted and/or detected using RF antenna, or acoustic signal generation is detected using an acoustic antenna (or RF antenna) that detects the RF signature of the transmission. Alternatively or additionally, the RF is used as a backup for the acoustic channel.
In some cases, for example if the receiver has a reduced computing capacity, the incoming audio stream is sampled at lower than the carrier frequency. However, a side effect of such sub-sampling, especially when there are no anti-aliasing filters, is that there may be confusion between audible and ultrasonic sounds. Thus, more complex processing may be required to assure that the data transmission is acceptable. In one example, synchronous detection or a more robust error detection method is used. Alternatively or additionally, a specialized waveform with unique time/spectrum characteristics is used, for example one that repeats itself at both 1 and 4 kHz after the down-sampling. Thus, it can be better differentiated from the background. In many cases, a speaker is available for a computer but a microphone is not. In a preferred embodiment of the invention, a speaker is used as a microphone. Preferably, the speaker is connected to the microphone port and/or line in port of a sound card, possibly through an adapting unit. Apparently, many speakers can operate as a microphone if they are not connected to a power source. Preferably, an adapting unit is provided, for example to serve for buffering, switching (between microphone and speaker functions) and/or for amplitude protection. In some embodiments the adapting unit periodically checks for an incoming signal from outside the speaker or for a signal from the speaker channel. Alternatively or additionally, the computer may generate a special signal via the speaker channel or possibly an audible signal to indicate that a mode switching is desired. In one embodiment, the speaker is connected in parallel to both microphone and loudspeaker channels, with electronic protection for the microphone so that the power to the speaker does not harm the channel.
Alternatively or additionally, some microphone types may be used as both a microphone and a speaker, if they are suitably driven. Possibly, a coupler is provided for driving the microphone using the speaker channel and or for automatically switching the microphone between modes based on the detection of an incoming signal or possibly periodically.
In some embodiments, the coupling device can split the frequencies between the microphone and speaker functions, allowing a single element to operate simultaneously as a speaker and a microphone. For example, low frequencies are used for the speaker and high frequencies are used for the microphone. When a high frequency is detected by the coupler, it is passed to the microphone channel, when a low frequency is detected it is sounded on the speaker.
Another aspect of the invention relates to transmitting acoustic signals on solid cables, rather than in the air. Such cables can include computer, communication and telephone cables, as well as electric power cables, for example inside a house. In a preferred embodiment of the invention, the transmission along these cables is conducted to a microphone of the device, to which it is directed, where the transmission is analyzed. Alternatively or additionally, transmission is via the box of the device and into the cable. Altematively or additionally, a dedicated coupler to the cable is provided for one or both of the transmission and reception. It is noted that a standard house is filled with this infrastructure in the form of power supply, water pipes, telephone lines, and cables. The ultrasonic receiver/transmitter device is simple low-cost and can be very small. The method can be used to achieve communication for low cost appliances, or to achieve a higher bandwidth of information. The method permits multiple appliances talking together, broadcast of information and a network of smart appliances. It can be used to communicate also between computers, televisions and or VCRs. Every device can have its own id-number and a computer can control the operation of these devices. For some devices a dedicated controller is required, which receives the acoustic signal and, responsive to it, controls the device. Exemplary uses include ordering shutting off or lighting lights at certain time (by computer control) or from outside of home (by telephone or network to the computer) and ordering the VCR and/or television to cooperate in recording a specific TV program, again preferably under computer control.
In a preferred embodiment of the invention, a reader-type input device can read external static (as opposed to sound waves and temporal patterns) information, which information can be forwarded to an associated computer or another device. Such an input device may also be integrated with a smart-card. A simplest example is a wireless bar-code reader that reads bar codes and transmits them acoustically to a computer, preferably using methods as described herein. Preferably, the bar-code reading capability is embodied in a smart card, so that a multifunction device is provided. Alternatively, a miniature device, such a ring, is manufactured, for convenience or a user. Such a device may be useful during purchasing, to allow a user to review large and or personalized information regarding a product. Another example is a magnetic strip reader which transmits read magnetic strips to the computer. In the case of a magnetic strip reader, a single magnetic sensor (or line sensor) may be sufficient, with the computer processing the detected signals to correct for non- constant motion of the sensor over the magnetic material.
In one exemplary use, when the input device reads a tag, such a code or a description of a device, an associated computer switches to a WWW page which displays details associated with the read information. The computer may be a hand-held computer or PDA. Alternatively, the computer is a standing or store provided computer. Alternatively, the computer is on another side of a telephone line, which acoustic signals are transmitted over the telephone line to the computer, to cause certain speech to be transmitted back. Alternatively or additionally, such tags may be used for technical support (e.g., each home device or component has such a code and there is a help file or scripts associated with the code). Alternatively or additionally, such tags may be used for customer relations, for example to provide information to an interested user. In some types of products, the computer and/or the tag reader can control the product using information read for the tag. An exemplary situation is a computer device, on which a tag reader or a same or second computer can execute a diagnostic program responsive to the read tag.
An exemplary device consists of an acoustical transmitter, a tag-reading element, and some control logic. The type of tag reading element used depends on the type of tag, for example, if it is optical or magnetic. The tag itself may include bar codes, other optical coding or even text. In a magnetic example, the tag may comprise magnetic ink. Preferably, but not essentially, the tags are of a type that can be printed using standard printers and/or inks. Thus, tags can be printed all over a book, magazine or other printed products. Alternatively or additionally, RF transponder tags as known in the art may be used. In some embodiments, the read information is deciphered by the reader. In other embodiments, partially or completely unanalyzed information is transmitted to the computer for analysis.
Although an acoustic transmission of the tag information is preferred, RF transmission may also be practiced. In the above description, a large number of permutations and possible embodiments have been described. This type of description is utilized for the ease of describing the many different possible embodiments of the invention. It is appreciated by the inventors that some of the described combinations may be known in the art. This is not to be construed as an admission of equivalence of the different embodiments described. Moreover, even such combinations which may be known may find patentable utility from their application in particular situations.
The present invention has been described in terms of preferred, non-limiting embodiments thereof. It should be understood that features described with respect to one embodiment may be used with other embodiments and that not all embodiments of the invention have all of the features shown in a particular figure. In particular, the scope of the claimed invention is not limited by the preferred embodiments but by the following claims. Section titles, where they appear, are not to be construed in limiting subject matter described therein, rather section titles are meant only as an aid in browsing this specification. When used in the following claims, the terms "comprises", "comprising", "includes", "including" or the like means "including but not limited to" .

Claims

1. A method of communicating with an electronic device, comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone; transmitting from a source at least one ultrasonic acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone, to be detected by said computer.
2. A method of communicating with an electronic device, comprising: providing a computer having an audible sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one first acoustic signal, encoded with information to the computer; receiving said at least one signal by said microphone, to be detected by said computer; and transmitting to said source, using said loudspeaker, at least a second acoustic signal, encoded with information, in response with said detected signal.
3. A method according to claim 2, wherein at least one of said at least one first signal and at least a second signal comprise an ultrasonic signal.
4. A method of communicating with an electronic device, comprising: providing an electronic device having a sound receiving and generating sub-system including a microphone and a loudspeaker; transmitting from a source at least one ultrasonic acoustic signal, encoded with information, to the electronic device; receiving said at least one signal by said microphone, to be detected by said electronic device; and transmitting to said source, using said loudspeaker, at least a second ultrasonic acoustic signal, encoded with information, in response with said detected signal.
5. A method according to claim 4, wherein said electronic device comprises a computer.
6. A method of communicating with an electronic device, comprising: providing a telephone having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the telephone; and receiving said at least one signal by said microphone, to be used to control said telephone.
7. A method according to claim 6, wherein said acoustic signal comprises an ultrasonic signal.
8. A method of communicating with an electronic device, comprising: providing a computer having a sound receiving and generating sub-system including a microphone; transmitting from a source at least one acoustic signal, encoded with information to the computer; and receiving said at least one signal by said microphone; and forwarding an indication of said information to a remote computer, over an Internet.
9. A method according to claim 8, wherein said indication comprises a sound file.
10. A method according to claim 8, wherein said indication comprises a data file.
11. A method according to any of claims 8-10, wherein said acoustic signal comprises an ultrasonic signal.
12. A method according to any of claims 1,2,3,5 or 8-10, wherein said computer comprises a PDA, personal digital assistant.
13. A method according to any of claims 1,2,3,5 or 8-10, wherein said computer comprises a portable computer.
14. A method according to any of claims 1,2,3,5 or 8-10, wherein said computer comprises a desk-top computer.
15. A method according to any of claims 1,2,3,5 or 8-10, comprising processing said at least one sound by said computer.
16. A method according to claim 15, wherein processing comprises extracting said encoded information.
17. A method according to claim 15, wherein said processing comprises determining a distance between said microphone and said source.
18. A method according to claim 15, wherein said processing comprises determining movement of said microphone relative to said source.
19. A method according to claim 18 wherein said movement comprises angular movement.
20. A method according to claim 18, wherein said movement comprises translation.
21. A method according to claim 15, wherein said processing comprises determining a spatial position of said microphone relative to said source.
22. A method according to claim 21, wherein said spatial position is a one-dimensional spatial position.
23. A method according to claim 21, wherein said spatial position is a two-dimensional spatial position.
24. A method according to claim 21, wherein said spatial position is a three-dimensional spatial position.
25. A method according to claim 15, wherein said processing comprises emulating a touch screen using said received at least one sound.
26. A method according to claim 15, wherein said processing comprises emulating a pointing device using said received at least one sound.
27. A method according to claim 15, comprising controlling at least one action of a toy, responsive to said received at least one sound.
28. A method according to claim 5 or claim 6, wherein said electronic device comprises a wireless communication device.
29. A method according to claim 4, wherein said electronic device comprises a computer peripheral.
30. A method according to claim 29, wherein said peripheral comprises a printer.
31. A method according to claim 4, wherein said device comprises a toy.
32. A method according to any of claims 1-10 or 31, wherein said information comprises programming information.
33. A method according to claim 31, wherein said information comprises music.
34. A method according to any of claims 1-10, wherein said source comprises a toy.
35. A method according to claim 34, wherein said information comprises stored player input.
36. A method according to any of claims 1-10, wherein said source comprises a smart card.
37. A method according to any of claims 1-10, wherein said source comprises a wireless communication device.
38. A method according to any of claims 1-10, wherein said source comprises a computer.
39. A method according to any of claims 1-10, wherein said source comprises a computer peripheral.
40. A method according to any of claims 1-10, wherein said information comprises personal information.
41. A method according to any of claims 1-10, comprising logging into a computer system responsive to said at least transmitted signal.
42. A method according to any of claims 1 or 6-10, comprising transmitting at least a second acoustical signal responsive to said received at least one signal.
43. A method according to any of claims 2 or 5-10, wherein said acoustic signal comprises human audible sound.
44. A method according to claim 43, wherein said sound has a main frequency over 10kHz.
45. A method according to any of claims 2 or 5-10, wherein said sound has a main frequency which is infra-sonic.
46. A method according to any of claims 1-10, wherein said information is encoded using below human-threshold amplitude signals.
47. A method according to any of claims 1-10, wherein said information is encoded using below human-threshold amplitude variations.
48. A method according to any of claims 1-10, wherein said sound is generated at a frequency outside a normal operating frequency for said sound subsystem.
49. A method according to any of claims 1-10, wherein said sound subsystem is designed for generating musical sounds.
50. A method according to any of claims 1-10, wherein said sound subsystem comprises a sound card.
51. A method according to claim 50, wherein said sound card comprises a SoundBlaster compatible sound card.
52. A method according to any of claims 1-10, wherein said sound sub-system is designed for audible sound communication with a human operator.
53. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency below 50kHz.
54. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency below 35kHz.
55. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency below 25kHz.
56. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency of about 21kHz.
57. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency of about 20kHz.
58. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency of about 19kHz.
59. A method according to any of claims 1, 3 or 4, wherein said ultrasonic signal has a main frequency of below 18kHz.
60. A method of creating a smart card terminal, comprising: providing a general purpose computer having a general-purpose sound sub-system; and loading a smart-card terminal software on said computer, wherein said software controls said sound system to receive acoustic waves from a smart card and transmit acoustic waves to the smart card.
61. A method according to claim 60, wherein said software analyses said received acoustic waves to determine information encoded by said acoustic waves.
62. A method according to claim 60, wherein said software retransmits said acoustic waves to a remote computer which analyses said received acoustic waves to determine information encoded by said acoustic waves.
63. A method according to any of claims 60-62, wherein loading a smart-card terminal software comprises downloading the software over an Internet.
64. A method according to any of claims 60-62, wherein said acoustic waves comprise ultrasonic waves.
65. A method according to any of claims 60-62, wherein said smart-card comprises a memory for storing a monetary balance.
66. A method according to any of claims 60-62, wherein said software encrypts information encoded by said transmitted acoustic waves.
67. A method according to any of claims 60-62, wherein said smart card comprises a memory for storing identification information for a card owner.
68. A method according to any of claims 60-62, wherein said smart card comprises a processor for analyzing information received from said computer and for generating a response to said computer.
69. A computer system comprises: a processor; a sound sub-system, designed for generating music, comprising: a speaker which generates acoustic waves; and a microphone which detects acoustic waves; a memory; and a software installed in said memory, wherein said software analyses acoustic waves received by said microphone to recognize information encoded by said acoustic waves and wherein said software uses said speaker to transmit information encoding acoustic waves responsive to said recognized information.
70. A computer according to claim 69, wherein said acoustic waves comprise ultrasonic acoustic waves.
71. A method of attaching a peripheral to a computer, comprising: providing a general purpose computer including a sound generating and receiving subsystem; analyzing, at said computer, sounds received by said subsystem to detect acoustic transmissions from said peripheral; and transmitting, from said computer and using said subsystem, information to said peripheral using encoded sound transmissions.
72. A method of communicating with a computer, comprising: generating by a computer an electromagnetic field by driving a computer component not designed for field generation in a manner which generates a parasitic electromagnetic field, wherein said field is encoded with information by said generation; and receiving said encoded field by an electronic device.
73. A method according to claim 72, wherein said electronic device receives said wave using an RF antenna.
74. A method according to claim 72, wherein said electronic device receives said wave using a microphone.
75. A method according to any of claims 72-74, wherein said computer component comprises a speaker.
76. A method according to any of claims 72-74, wherein said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz.
77. A method of detecting electromagnetic radiation by a computer comprising: generating an electro magnetic field which encodes information; sampling a microphone channel associated with said computer to detect artifacts caused by said field; and decoding said information by said computer.
78. A method according to claim 77, wherein said associated computer is physically connected to said microphone channel.
79. A method according to claim 77, wherein said associated computer is connected to said microphone channel by a computer network connection.
80. A method according to any of claims 77-79, wherein said electromagnetic field is a side-effect of driving a speaker.
81. A method according to any of claims 77-79, wherein said electromagnetic field is a side-effect of driving a speaker.
82. A method according to any of claims 77-79, wherein said electromagnetic field has a main AC frequency of between 10 kHz and 100 kHz.
83. A method of emulating a microphone using a speaker, comprising: providing a computer having a speaker channel and a microphone channel; coupling a computer speaker to the microphone channel; and receiving signals for said microphone channel via said speaker.
84. A method according to claim 83, wherein coupling comprises coupling using a coupler.
85. A coupler for an audio channel, comprising: a first connector for selectively driving a speaker or receiving input from a microphone; a second connector for sending signals to a microphone channel; a third connector for receiving speaker-driving signals from a speaker channel; and circuitry for selectively driving said speaker or receiving signals from said microphone, using said first connector.
86. A coupler according to claim 85, wherein said circuitry receives switching instructions via said speaker channel.
87. A method of determining a status of an electronic device, comprising: receiving information encoding acoustic signals generated by said device; and analyzing said signals to determine an operational status associated with said device responsive to said information.
88. A method according to claim 87, wherein said status comprises a states of said device.
89. A method according to claim 87, wherein said status comprises a status of a second device attached by computer communications with said device.
90. A method according to claim 87, wherein said status comprises a status of a network that said device is part of.
91. A method according to any of claims 87-90, wherein said analyzing comprises analyzing on a computer separate from a circuitry used for acquiring said signals.
92. A method according to any of claims 87-90, wherein said signals are generated by said device responsive to an interrogation by a second device which performs said receiving.
93. A method according to claim 92, wherein said interrogation does not interrupt other activities of said device.
94. A method according to any of claims 87-90, wherein said signals are generated by said device independent of an interrogation by a second device.
95. A method according to any of claims 87-90, wherein said signals are sonic.
96. A method according to any of claims 87-90, wherein said signals are ultrasonic.
97. A method according to any of claims 87-90, comprising programming an existing device to generate said signals using an existing speaker which, when the device was designed, was not designated for communication with a second device.
98. A method according to claim 97, wherein said programming comprises software programming in which only memory storage locations are modified.
99. A method according to claim 97, wherein said programming comprises hardware programming in which electronic circuitry of the device is modified.
100. A method according to any of claims 87-90, wherein said electronic device comprises a computer.
101. A method according to any of claims 87-90, wherein said electronic device comprises a network hub.
102. A method according to any of claims 87-90, wherein said electronic device comprises a network switch.
103. A method according to any of claims 87-90, wherein said electronic device comprises a network router.
104. A method of accessing a single user computer by a second user, without interrupting the activities of the first user, comprising: transmitting an acoustically encoded command by the second user to the computer; receiving said command by the computer; and executing the command by the computer.
105. A method according to claim 104, wherein said command is ultrasonically encoded.
106. A method according to claim 104 or claim 105, wherein said receiving comprises receiving using a microphone connected to a sound card of said computer, which sound card is designed for audio applications.
107. A computer networking method comprising: providing first, second and third computers; and transmitting a message encoding data from the first computer to the third computer via the second computer by acoustic transmission between the computers.
108. A method according to claim 107, wherein said acoustic transmissions utilize sound cards designed specifically for processing audible sounds.
109. A method according to claim 107, wherein said acoustic transmissions utilize are ultrasonic having a frequency of less than 50 kHz.
110. A wireless peripheral for an electronic device, comprising: a microphone for receiving ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; circuitry for processing said transmission; and a display for displaying a result of said processing.
111. A peripheral according to claim 110, wherein said peripheral comprises an input element and a speaker for transmitting sound to said electronic device responsive to input from said input element.
112. A peripheral according to claim 110, comprising a printing engine for printing a result of said processing.
113. A peripheral according to any of claims 110-112, wherein said processing comprises merely of converting the signals from an acoustic encoding format to a format suitable for said display.
114. A peripheral according to any of claims 110-112, wherein said processing comprises processing the information encoded by said transmissions.
115. A peripheral according to any of claims 110-112, wherein said electronic device comprises a computer.
116. A peripheral according to any of claims 110-112, wherein said electronic device comprises a radio.
117. A peripheral according to any of claims 110-112, wherein said peripheral comprises a speaker for said electronic device.
118. A peripheral according to any of claims 110-112, wherein said peripheral comprises a time display which presents a time signal generated by said electronic device.
119. A peripheral according to any of claims 110-112, wherein said peripheral comprises a status display which presents a status signal generated by said electronic device.
120. A wireless peripheral for an electronic device, comprising: a speaker for transmitting ultrasonic acoustic transmissions having a frequency of less than 70 kHz from an electronic device; and circuitry for generating said transmissions; and an input element for receiving input to be encoded by said transmissions.
121. A peripheral according to claim 120, comprising a microphone for receiving ultrasonic transmissions from said electronic device.
122. A peripheral according to claim 120 or claim 121, wherein said input element comprises a bar-code reader.
123. A peripheral according to claim 120 or claim 121, wherein said input element comprises a smart card reader.
124. A peripheral according to claim 120 or claim 121, wherein said input element comprises a pointing device.
125. A peripheral according to claim 120 or claim 121, wherein said input element comprises a keyboard.
126. A method of communicating with a computer, comprising: providing a computer having a data line attached to at least one particular peripheral; sending a data transmission to the computer by injecting a signal into said data line using an electromagnetic coupler; and identifying by said computer the source of said data transmission.
127. A method of communicating with a computer, comprising: providing a computer having a data line attached to at least one particular peripheral; generating by said computer a data transmission directed to a different peripheral; and receiving said data transmission from the computer by eavesdropping on said data line using an electromagnetic coupler.
128. A method of injecting data into a computer from an uncoupled peripheral, comprising: transmitting said data from the uncoupled peripheral to a tap; and physically activating a peripheral coupled to said computer, by said tap.
129. A method according to claim 128, wherein physically activating comprises activating keys in a keyboard.
130. A method according to claim 128, wherein physically activating comprises activating vibrating a mouse.
131. A method of communicating with a computer, comprising: generating by a computer a data transmission; controlling, by said computer, a component not designated for data transmission, to effect a transmission of said data; and receiving said data transmission from the computer by a second device.
132. A method according to claim 131, wherein said computer controls an activation of a mechanical component of said computer to transmit said data by modulation of mechanical sounds generated by said computer.
133. A method according to claim 131, wherein said computer controls an activation of a status LEDs of said computer to transmit said data by modulation of illumination of said
LEDs.
134. A method according to claim 131, wherein said computer controls an activation of an electrical component of said computer to transmit said data by modulation of parasitic RF signals generated by said computer.
135. A method of transmitting data over a computer network, comprising: providing a sound file at a first location; transmitting said sound file to a second location via said computer network; and transmitting said sound file as acoustic sounds to a processor at a third location.
136. A method of transmitting data over a computer network, comprising: encoding data as acoustic sounds at a first location; transmitting said sound file to a second location as acoustic sounds; and transmitting said acoustic sounds as a sound file to a third location, via said network.
137. A method according to claim 135 or claim 136, wherein said network comprises an Internet.
138. A method of analyzing acoustic signals, comprising: receiving said signals using a microphone which microphone converts the signals into analog electrical signals; driving at least one digital data lead of an integrated circuit using said analog signals; and processing said signals using said integrated circuit.
139. A method according to claim 138, comprising amplifying said electrical signals prior to said driving.
140. A method of determining a time of flight of a pulse between two electronic devices, comprising: simultaneously generating an acoustic pulse and an electromagnetic pulse using a speaker of a first electronic device; detecting, using a single detector associated with a second electronic device, both the acoustic pulse and the electromagnetic pulse; and determining a time of flight of said acoustic pulse the two devices based on a delay between the reception of the two pulses.
141. A method of acoustic communication, comprising: estimating an echo duration for an acoustic band; and transmitting data using the acoustic band, wherein between data elements a period of silence is provided, having a duration responsive to said echo duration.
142. A method according to claim 141, wherein the data elements are encoded using individual frequencies in an FSK encoding protocol.
143. A method according to claim 141 or claim 142, wherein estimating comprises estimating based on an expected communication geometry.
144. A method according to claim 141 or claim 142, wherein estimating comprises estimating a duration based on at least one acoustic calibration generated adjacent to said data transmission.
PCT/IL1999/000521 1998-08-27 1999-10-01 A method to use acoustic signals for computer communications WO2000021203A1 (en)

Priority Applications (30)

Application Number Priority Date Filing Date Title
AU59968/99A AU5996899A (en) 1998-10-02 1999-10-01 A method to use acoustic signals for computer communications
EP99970221A EP1121763A1 (en) 1998-10-02 1999-10-01 A method to use acoustic signals for computer communications
US09/806,618 US7383297B1 (en) 1998-10-02 1999-10-01 Method to use acoustic signals for computer communications
CA002345736A CA2345736A1 (en) 1998-10-02 1999-10-01 A method to use acoustic signals for computer communications
JP2000575224A JP2002527926A (en) 1998-10-02 1999-10-01 How to use acoustic signals for computer communication
CA002345745A CA2345745A1 (en) 1998-10-02 1999-10-04 Card for interaction with a computer
EP99970188A EP1116155A2 (en) 1998-10-02 1999-10-04 Card for interaction with a computer
PCT/IL1999/000525 WO2000021020A2 (en) 1998-10-02 1999-10-04 Card for interaction with a computer
JP2000575071A JP2002527012A (en) 1998-10-02 1999-10-04 Card for interaction with computer
AU59972/99A AU5997299A (en) 1998-10-02 1999-10-04 Card for interaction with a computer
US09/806,789 US7334735B1 (en) 1998-10-02 1999-10-04 Card for interaction with a computer
US09/831,935 US7260221B1 (en) 1998-11-16 1999-11-16 Personal communicator authentication
JP2000582865A JP2003531505A (en) 1998-11-16 1999-11-16 Authentication method for personal communicator
EP99968002A EP1192520A2 (en) 1998-11-16 1999-11-16 Personal communicator authentication
CA002350761A CA2350761A1 (en) 1998-11-16 1999-11-16 Personal communicator authentication
PCT/IB1999/002110 WO2000029920A2 (en) 1998-11-16 1999-11-16 Personal communicator authentication
AU24557/00A AU2455700A (en) 1998-11-16 1999-11-16 Personal communicator authentication
US09/570,399 US6607136B1 (en) 1998-09-16 2000-05-12 Physical presence digital authentication system
US10/618,962 US7706838B2 (en) 1998-09-16 2003-07-14 Physical presence digital authentication system
US11/339,275 US7480692B2 (en) 1998-10-02 2006-01-25 Computer communications using acoustic signals
US12/007,441 US8544753B2 (en) 1998-10-02 2008-01-10 Card for interaction with a computer
US12/079,000 US20100030838A1 (en) 1998-08-27 2008-04-09 Method to use acoustic signals for computer communications
US12/272,828 US7941480B2 (en) 1998-10-02 2008-11-18 Computer communications using acoustic signals
US12/752,181 US8078136B2 (en) 1998-09-16 2010-04-01 Physical presence digital authentication system
US13/083,643 US8935367B2 (en) 1998-10-02 2011-04-11 Electronic device and method of configuring thereof
US13/316,710 US8509680B2 (en) 1998-09-16 2011-12-12 Physical presence digital authentication system
US13/964,208 US20130332355A1 (en) 1998-09-16 2013-08-12 Physical presence digital authentication system
US14/033,579 US9361444B2 (en) 1998-10-02 2013-09-23 Card for interaction with a computer
US14/176,278 US8843057B2 (en) 1998-09-16 2014-02-10 Physical presence digital authentication system
US14/492,030 US20150012441A1 (en) 1998-09-16 2014-09-21 Physical presence digital authentication system

Applications Claiming Priority (17)

Application Number Priority Date Filing Date Title
IL127072 1998-12-14
IL126444 1998-12-14
IL127569 1998-12-14
US11523199P 1999-01-08 1999-01-08
US60/115,231 1999-01-08
US12268799P 1999-03-03 1999-03-03
US60/122,687 1999-03-03
US14322099P 1999-07-09 1999-07-09
US60/143,220 1999-07-09
US14534299P 1999-07-23 1999-07-23
US60/145,342 1999-07-23
PCT/IL1999/000470 WO2000013039A2 (en) 1998-08-27 1999-08-27 Method and system for measuring the distance from a piezoelectric element
ILPCT/IL99/00470 1999-08-27
US15385899P 1999-09-14 1999-09-14
US60/153,858 1999-09-14
PCT/IL1999/000506 WO2000015316A2 (en) 1998-09-16 1999-09-16 Interactive toys
ILPCT/IL99/00506 1999-09-16

Related Parent Applications (5)

Application Number Title Priority Date Filing Date
PCT/IL1999/000470 Continuation-In-Part WO2000013039A2 (en) 1998-08-27 1999-08-27 Method and system for measuring the distance from a piezoelectric element
PCT/IL1999/000506 Continuation-In-Part WO2000015316A2 (en) 1998-08-27 1999-09-16 Interactive toys
PCT/IB1999/002110 Continuation-In-Part WO2000029920A2 (en) 1998-09-16 1999-11-16 Personal communicator authentication
US78726501A Continuation-In-Part 1998-08-27 2001-03-14
US76372701A Continuation-In-Part 1998-08-27 2001-10-01

Related Child Applications (8)

Application Number Title Priority Date Filing Date
PCT/IL1999/000470 Continuation-In-Part WO2000013039A2 (en) 1998-08-27 1999-08-27 Method and system for measuring the distance from a piezoelectric element
PCT/IL1999/000506 Continuation-In-Part WO2000015316A2 (en) 1998-08-27 1999-09-16 Interactive toys
US09/806,618 A-371-Of-International US7383297B1 (en) 1998-10-02 1999-10-01 Method to use acoustic signals for computer communications
US09/806,789 Continuation-In-Part US7334735B1 (en) 1998-10-02 1999-10-04 Card for interaction with a computer
PCT/IL1999/000525 Continuation-In-Part WO2000021020A2 (en) 1998-09-16 1999-10-04 Card for interaction with a computer
US10/618,962 Continuation-In-Part US7706838B2 (en) 1998-09-16 2003-07-14 Physical presence digital authentication system
US11/339,275 Division US7480692B2 (en) 1998-10-02 2006-01-25 Computer communications using acoustic signals
US12/079,000 Continuation US20100030838A1 (en) 1998-08-27 2008-04-09 Method to use acoustic signals for computer communications

Publications (1)

Publication Number Publication Date
WO2000021203A1 true WO2000021203A1 (en) 2000-04-13

Family

ID=27563011

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL1999/000521 WO2000021203A1 (en) 1998-08-27 1999-10-01 A method to use acoustic signals for computer communications

Country Status (1)

Country Link
WO (1) WO2000021203A1 (en)

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001093514A1 (en) * 2000-05-31 2001-12-06 National Semiconductor Corporation Method in a telecommunications network for connecting a device wirelessly to another
WO2003052743A1 (en) * 2001-12-17 2003-06-26 Sony Corporation Information transmitting system, information encoder and information decoder
WO2003088136A2 (en) * 2002-04-15 2003-10-23 Epos Technologies Limited Method and system for obtaining positioning data
WO2003091869A2 (en) * 2002-04-24 2003-11-06 Michael Beyo System and method for remotely producing a response in a computer using acoustic signaling
EP1738477A1 (en) * 2004-04-02 2007-01-03 Solitonix Co., Ltd. Circuit board for mobile communication terminal having ultrasonic wave speaker system
US7207941B2 (en) 2001-06-05 2007-04-24 Barnev Ltd. Birth monitoring system
US7324226B2 (en) 2000-05-31 2008-01-29 National Semiconductor Corporation Method, and arrangement in a communications network
JP2008219909A (en) * 2000-11-30 2008-09-18 Intrasonics Ltd Communication system
WO2008128989A1 (en) * 2007-04-19 2008-10-30 Epos Technologies Limited Voice and position localization
WO2009024784A2 (en) * 2007-08-20 2009-02-26 Sonitor Technologies As Ultrasound detectors
US7701895B2 (en) 2003-03-04 2010-04-20 Medit-Medical Interactive Technologies, Ltd. Method and system for acoustic communication
WO2011112158A1 (en) * 2010-03-10 2011-09-15 Margento R&D D.O.O. Wireless mobile transaction system and the procedure for carrying out transactions with a mobile phone
GB2484140A (en) * 2010-10-01 2012-04-04 Ucl Business Plc Communicating data between devices
US8248528B2 (en) 2001-12-24 2012-08-21 Intrasonics S.A.R.L. Captioning system
US8560913B2 (en) 2008-05-29 2013-10-15 Intrasonics S.A.R.L. Data embedding system
JP2014067441A (en) * 2013-12-16 2014-04-17 Nec Corp Communicable information storage medium, and secret information storage system using medium
US8843057B2 (en) 1998-09-16 2014-09-23 Dialware Inc. Physical presence digital authentication system
US8861312B2 (en) 2007-03-14 2014-10-14 Qualcomm Incorporated MEMS microphone
US8935367B2 (en) 1998-10-02 2015-01-13 Dialware Inc. Electronic device and method of configuring thereof
US8963890B2 (en) 2005-03-23 2015-02-24 Qualcomm Incorporated Method and system for digital pen assembly
US9159066B2 (en) 2009-07-29 2015-10-13 Shopkick, Inc. Method and system for adaptive offer determination
US9181555B2 (en) 2007-07-23 2015-11-10 Ramot At Tel-Aviv University Ltd. Photocatalytic hydrogen production and polypeptides capable of same
US9219708B2 (en) 2001-03-22 2015-12-22 DialwareInc. Method and system for remotely authenticating identification devices
EP2966792A1 (en) * 2015-06-17 2016-01-13 Nxp B.V. Ultra-sound communication system
CN105245290A (en) * 2014-07-06 2016-01-13 恩智浦有限公司 Ultra-Sound Communication System
US9264151B1 (en) 2009-07-29 2016-02-16 Shopkick, Inc. Method and system for presence detection
US9354310B2 (en) 2011-03-03 2016-05-31 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for source localization using audible sound and ultrasound
US9361444B2 (en) 1998-10-02 2016-06-07 Dialware Inc. Card for interaction with a computer
US9489949B2 (en) 1999-10-04 2016-11-08 Dialware Inc. System and method for identifying and/or authenticating a source of received electronic data by digital signal processing and/or voice authentication
CN108528331A (en) * 2018-03-30 2018-09-14 斑马网络技术有限公司 Vehicle, ultrasonic system and device and its information interacting method
US10671903B2 (en) 2012-10-17 2020-06-02 China Industries Limited Interactive toy
CN115662452A (en) * 2022-10-26 2023-01-31 江苏中信博新能源科技股份有限公司 Conduction-based photovoltaic support control box parameter debugging system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5423073A (en) * 1991-09-30 1995-06-06 Fuji Xerox Co., Ltd. Acoustic signal transmitting system
US5638047A (en) * 1995-05-10 1997-06-10 Fred M. Schildwachter & Sons, Inc. Sound activated transmitter
US5764763A (en) * 1994-03-31 1998-06-09 Jensen; James M. Apparatus and methods for including codes in audio signals and decoding
US5774791A (en) * 1993-07-02 1998-06-30 Phonic Ear Incorporated Low power wireless communication system employing magnetic control zones
US5786764A (en) * 1995-06-07 1998-07-28 Engellenner; Thomas J. Voice activated electronic locating systems
US5864794A (en) * 1994-03-18 1999-01-26 Mitsubishi Denki Kabushiki Kaisha Signal encoding and decoding system using auditory parameters and bark spectrum
US5921674A (en) * 1995-07-19 1999-07-13 Koczi; Wolfgang Optical signalling device, especially for an item of clothing

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5423073A (en) * 1991-09-30 1995-06-06 Fuji Xerox Co., Ltd. Acoustic signal transmitting system
US5774791A (en) * 1993-07-02 1998-06-30 Phonic Ear Incorporated Low power wireless communication system employing magnetic control zones
US5864794A (en) * 1994-03-18 1999-01-26 Mitsubishi Denki Kabushiki Kaisha Signal encoding and decoding system using auditory parameters and bark spectrum
US5764763A (en) * 1994-03-31 1998-06-09 Jensen; James M. Apparatus and methods for including codes in audio signals and decoding
US5638047A (en) * 1995-05-10 1997-06-10 Fred M. Schildwachter & Sons, Inc. Sound activated transmitter
US5786764A (en) * 1995-06-07 1998-07-28 Engellenner; Thomas J. Voice activated electronic locating systems
US5921674A (en) * 1995-07-19 1999-07-13 Koczi; Wolfgang Optical signalling device, especially for an item of clothing

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9275517B2 (en) 1998-09-16 2016-03-01 Dialware Inc. Interactive toys
US8843057B2 (en) 1998-09-16 2014-09-23 Dialware Inc. Physical presence digital authentication system
US9607475B2 (en) 1998-09-16 2017-03-28 Dialware Inc Interactive toys
US9830778B2 (en) 1998-09-16 2017-11-28 Dialware Communications, Llc Interactive toys
US9361444B2 (en) 1998-10-02 2016-06-07 Dialware Inc. Card for interaction with a computer
US8935367B2 (en) 1998-10-02 2015-01-13 Dialware Inc. Electronic device and method of configuring thereof
US9489949B2 (en) 1999-10-04 2016-11-08 Dialware Inc. System and method for identifying and/or authenticating a source of received electronic data by digital signal processing and/or voice authentication
US7324226B2 (en) 2000-05-31 2008-01-29 National Semiconductor Corporation Method, and arrangement in a communications network
WO2001093514A1 (en) * 2000-05-31 2001-12-06 National Semiconductor Corporation Method in a telecommunications network for connecting a device wirelessly to another
JP2008219909A (en) * 2000-11-30 2008-09-18 Intrasonics Ltd Communication system
US8185100B2 (en) 2000-11-30 2012-05-22 Intrasonics S.A.R.L. Communication system
US9219708B2 (en) 2001-03-22 2015-12-22 DialwareInc. Method and system for remotely authenticating identification devices
US7207941B2 (en) 2001-06-05 2007-04-24 Barnev Ltd. Birth monitoring system
US7415407B2 (en) 2001-12-17 2008-08-19 Sony Corporation Information transmitting system, information encoder and information decoder
WO2003052743A1 (en) * 2001-12-17 2003-06-26 Sony Corporation Information transmitting system, information encoder and information decoder
US8248528B2 (en) 2001-12-24 2012-08-21 Intrasonics S.A.R.L. Captioning system
AU2003219506B2 (en) * 2002-04-15 2009-02-05 Qualcomm Incorporated Method and system for obtaining positioning data
KR100974022B1 (en) 2002-04-15 2010-11-15 에포스 디벨롭먼트 리미티드 Method and system for obtaining positioning data
KR101027450B1 (en) 2002-04-15 2011-04-06 에포스 디벨롭먼트 리미티드 Method and system for obtaining positioning data
US9446520B2 (en) 2002-04-15 2016-09-20 Qualcomm Incorporated Method and system for robotic positioning
WO2003088136A3 (en) * 2002-04-15 2004-10-28 Epos Technologies Ltd Method and system for obtaining positioning data
US9195325B2 (en) 2002-04-15 2015-11-24 Qualcomm Incorporated Method and system for obtaining positioning data
WO2003088136A2 (en) * 2002-04-15 2003-10-23 Epos Technologies Limited Method and system for obtaining positioning data
WO2003091869A3 (en) * 2002-04-24 2004-04-29 Michael Beyo System and method for remotely producing a response in a computer using acoustic signaling
WO2003091869A2 (en) * 2002-04-24 2003-11-06 Michael Beyo System and method for remotely producing a response in a computer using acoustic signaling
US7701895B2 (en) 2003-03-04 2010-04-20 Medit-Medical Interactive Technologies, Ltd. Method and system for acoustic communication
EP1738477A4 (en) * 2004-04-02 2009-12-02 Solitonix Co Ltd Circuit board for mobile communication terminal having ultrasonic wave speaker system
EP1738477A1 (en) * 2004-04-02 2007-01-03 Solitonix Co., Ltd. Circuit board for mobile communication terminal having ultrasonic wave speaker system
US9632627B2 (en) 2005-03-23 2017-04-25 Qualcomm Incorporated Method and system for digital pen assembly
US8963890B2 (en) 2005-03-23 2015-02-24 Qualcomm Incorporated Method and system for digital pen assembly
US8861312B2 (en) 2007-03-14 2014-10-14 Qualcomm Incorporated MEMS microphone
CN101720558B (en) * 2007-04-19 2014-04-23 高通股份有限公司 Voice and position localization
US8787113B2 (en) 2007-04-19 2014-07-22 Qualcomm Incorporated Voice and position localization
WO2008128989A1 (en) * 2007-04-19 2008-10-30 Epos Technologies Limited Voice and position localization
KR101497644B1 (en) * 2007-04-19 2015-03-02 에포스 디벨롭먼트 리미티드 Voice and position localization
EP2528354A1 (en) * 2007-04-19 2012-11-28 Epos Development Ltd. Voice and position localization
US9181555B2 (en) 2007-07-23 2015-11-10 Ramot At Tel-Aviv University Ltd. Photocatalytic hydrogen production and polypeptides capable of same
AU2008290379B2 (en) * 2007-08-20 2013-10-03 Sonitor Technologies As Ultrasound detectors
CN101816135A (en) * 2007-08-20 2010-08-25 索尼特技术公司 ultrasound detectors
US8792305B2 (en) 2007-08-20 2014-07-29 Sonitor Technologies As Ultrasound detectors
WO2009024784A2 (en) * 2007-08-20 2009-02-26 Sonitor Technologies As Ultrasound detectors
WO2009024784A3 (en) * 2007-08-20 2009-06-25 Sonitor Technologies As Ultrasound detectors
US8560913B2 (en) 2008-05-29 2013-10-15 Intrasonics S.A.R.L. Data embedding system
US10304069B2 (en) 2009-07-29 2019-05-28 Shopkick, Inc. Method and system for presentment and redemption of personalized discounts
US9886696B2 (en) 2009-07-29 2018-02-06 Shopkick, Inc. Method and system for presence detection
US9264151B1 (en) 2009-07-29 2016-02-16 Shopkick, Inc. Method and system for presence detection
US10255614B2 (en) 2009-07-29 2019-04-09 Shopkick, Inc. Method and system for detecting presence using a WiFi network probe detector
US10909562B2 (en) 2009-07-29 2021-02-02 Shopkick, Inc. Method and system for presence detection
US9159066B2 (en) 2009-07-29 2015-10-13 Shopkick, Inc. Method and system for adaptive offer determination
WO2011112158A1 (en) * 2010-03-10 2011-09-15 Margento R&D D.O.O. Wireless mobile transaction system and the procedure for carrying out transactions with a mobile phone
US9189783B2 (en) 2010-03-10 2015-11-17 Margento R&D D.O.O Wireless mobile transaction system and the procedure for carrying out transactions with a mobile phone
GB2546025B (en) * 2010-10-01 2017-08-23 Asio Ltd A Transaction authenticating device and method
GB2546025A (en) * 2010-10-01 2017-07-05 Asio Ltd A Transaction authenticating device and method
GB2484140B (en) * 2010-10-01 2017-07-12 Asio Ltd Data communication system
GB2484140A (en) * 2010-10-01 2012-04-04 Ucl Business Plc Communicating data between devices
US9354310B2 (en) 2011-03-03 2016-05-31 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for source localization using audible sound and ultrasound
US10671903B2 (en) 2012-10-17 2020-06-02 China Industries Limited Interactive toy
JP2014067441A (en) * 2013-12-16 2014-04-17 Nec Corp Communicable information storage medium, and secret information storage system using medium
US20170032367A1 (en) * 2014-07-06 2017-02-02 Joost van Beek Ultra-sound communication system
CN105245290A (en) * 2014-07-06 2016-01-13 恩智浦有限公司 Ultra-Sound Communication System
EP2966792A1 (en) * 2015-06-17 2016-01-13 Nxp B.V. Ultra-sound communication system
CN108528331A (en) * 2018-03-30 2018-09-14 斑马网络技术有限公司 Vehicle, ultrasonic system and device and its information interacting method
CN115662452A (en) * 2022-10-26 2023-01-31 江苏中信博新能源科技股份有限公司 Conduction-based photovoltaic support control box parameter debugging system and method

Similar Documents

Publication Publication Date Title
US8935367B2 (en) Electronic device and method of configuring thereof
US7260221B1 (en) Personal communicator authentication
US20100030838A1 (en) Method to use acoustic signals for computer communications
WO2000021203A1 (en) A method to use acoustic signals for computer communications
US9361444B2 (en) Card for interaction with a computer
AU2455700A (en) Personal communicator authentication
US20130119133A1 (en) Method and device for identifying objects and triggering interactions by means of close-range coupling of acoustically modulated data signals
US7656397B2 (en) Pointing device with integrated audio input and associated methods
CN103413218A (en) Mobile terminal, NFC payment method, NFC payment device and NFC payment system
WO2001057625A3 (en) Physical presence digital authentication system (device-to-device)
CN101816135A (en) ultrasound detectors
US20070120961A1 (en) Voice and motion activated telephone
CN107483733A (en) volume adjusting method, device, terminal and storage medium
CN111247548A (en) Close range settlement system using sound wave communication
KR101754231B1 (en) Method, apparatus and computer program for bidirectional communication with using Dual interface NFC tag
WO1994029957A1 (en) Remote control system
WO2024035905A1 (en) System for transmitting object related data from a base unit to a mobile unit through a person's body
CN101094277A (en) Remote controller of supporting versatile plug and play protocol, and providing wireless communication service
JP2005326990A (en) Mark sensing card, and processing system for processing information of mark sensing card
CA2132932A1 (en) Wireless communication system between keypad and terminal
WO2003091869A2 (en) System and method for remotely producing a response in a computer using acoustic signaling

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US US US US US US US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 59968/99

Country of ref document: AU

ENP Entry into the national phase

Ref document number: 2345736

Country of ref document: CA

Ref country code: CA

Ref document number: 2345736

Kind code of ref document: A

Format of ref document f/p: F

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2000 575224

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1999970221

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1999970221

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 09806618

Country of ref document: US

WWW Wipo information: withdrawn in national office

Ref document number: 1999970221

Country of ref document: EP