US20050179540A1 - Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods - Google Patents
Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods Download PDFInfo
- Publication number
- US20050179540A1 US20050179540A1 US11/083,475 US8347505A US2005179540A1 US 20050179540 A1 US20050179540 A1 US 20050179540A1 US 8347505 A US8347505 A US 8347505A US 2005179540 A1 US2005179540 A1 US 2005179540A1
- Authority
- US
- United States
- Prior art keywords
- mobile data
- command
- user
- voice
- voice command
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000004891 communication Methods 0.000 claims abstract description 121
- 230000015654 memory Effects 0.000 claims abstract description 31
- 230000004044 response Effects 0.000 claims description 32
- 230000002708 enhancing effect Effects 0.000 claims description 27
- 230000006870 function Effects 0.000 claims description 23
- 238000004883 computer application Methods 0.000 claims description 8
- 230000003252 repetitive effect Effects 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 5
- 238000012795 verification Methods 0.000 claims description 5
- 230000035945 sensitivity Effects 0.000 claims description 4
- 238000011161 development Methods 0.000 claims description 2
- 238000007619 statistical method Methods 0.000 claims description 2
- 230000008859 change Effects 0.000 description 11
- 230000001755 vocal effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 7
- 230000004913 activation Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000012549 training Methods 0.000 description 5
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 4
- 241000283070 Equus zebra Species 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000013479 data entry Methods 0.000 description 3
- 230000000994 depressogenic effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000009849 deactivation Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000000981 bystander Effects 0.000 description 1
- ZPUCINDJVBIVPJ-LJISPDSOSA-N cocaine Chemical compound O([C@H]1C[C@@H]2CC[C@@H](N2C)[C@H]1C(=O)OC)C(=O)C1=CC=CC=C1 ZPUCINDJVBIVPJ-LJISPDSOSA-N 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000000881 depressing effect Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
- B60R16/0373—Voice control
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/221—Announcement of recognition results
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Definitions
- the present invention relates to the field of communications generally and, more particularly, to vehicle communication systems, program products, and associated methods.
- Law enforcement officers and other civil servants have long needed a cost-effective system which delivers data quickly, helps e.g., police officers save time in the performance of their duties, and accomplishes these goals without interfering with other officer duties or endangering the officer.
- Early officer data systems included human dispatchers in radio frequency (“RF”) communication with officers in vehicles. In these early systems, data requested by the officer was typically searched for by hand and read back to the officer over the radio and, therefore, suffered from slow delivery of data, costs associated with employing dispatchers, and a very limited database of available data.
- RF radio frequency
- the magnet stripe reader for reading driver's licenses poses an additional problem because the data obtained from the magnet stripe is often out of date, especially in states where licenses need not be renewed, and hence bar codes not being updated for many years. Further, the handheld unit required by such systems prevents the officer's hands from being free for other activities and can place the officer in dangerous situations such as when the officer's attention is devoted to the handheld unit instead of the officer's surroundings.
- Some systems such as the Premiere MDC system sold by Motorola Corporation of Straumberg, Illinois have a police department computer in communication with a police vehicle mobile data computer and a database of law enforcement data. These systems offer computer aided dispatching, computer generated reports to be filled out by the officer, and can transmit responses to officer requests for law enforcement data such as data associated with license plate numbers or driver's licenses.
- the vehicle mobile data computer software in the Premiere MDC system has a limited text-to-voice program for presenting data in audio rather than video format and is also capable of displaying maps using a global positioning system (“GPS”) unit to define the area to be displayed.
- GPS global positioning system
- Such systems conventionally transfer each element of written data or text-to-voice, e.g., including zip codes, extraneous information. Much of this information, however, is not needed by the officer and can be information overload for an officer. Further, because text-to-voice is typically monotone or lacking intonation, the officer must concentrate more attention on the transmission and may misunderstand portions of the transmission. Systems such as the Motorola system pose a still further problem because the officer must frequently focus attention on the computer screen while filling in forms and checking responses to queries. This substantially increases the danger to the officer as the officer cannot be aware of the surroundings at the same time.
- Applicant recognized as beneficial in co-pending U.S. application Ser. No. 10/656,487 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods” and U.S. Pat. No. 6,621,422 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” an apparatus and software for communicating with law enforcement during vehicle travel which: prioritizes pre-recorded human voice responses to officer queries that delivers rapid, easily comprehended responses that allow the officer to maintain visual awareness of the surroundings at all times; transmits audio alarms to the officer to give the officer immediate warning of degrees of law violation associated with a suspect; and provides cost effective quick mapping of incident locations.
- Such apparatus and software previously have been beneficially implemented in many vehicles.
- Speech recognition software generally receives a speech signal, determines which words constitute the speech signal, and apply the determined words to an application program either in the form of a command or in the form of text.
- Speech recognition systems generally compare an acoustic description of text stored in a vocabulary database against an acoustic signal generated by the utterance of the text to be recognized. The speech recognition system then determines if the words or text are commands vs. dictation, applying the words or text as commands if recognized as a command.
- problems can include difficulty in determining when an utterance has begun. This problem is significantly exacerbated in a high-background noise environment.
- Some systems use a statistically derived acoustic model of background noise to filter the incoming acoustic signal. These systems have met some success where the non-speech sounds consist mostly of background noise having a fairly constant frequency and amplitude not matching the spectral characteristics of the text stored in the vocabulary database.
- non-speech sounds including background noise
- speech recognition systems examine a very large database of words or text, attempting to match a detected sound to each word or text.
- speech recognition systems are likely to be falsely triggered into interpreting non-speech sounds as speech.
- resources of the associated computer system can be heavily taxed during such determination, thus causing a significant delay to the user. This can cause the user to lose track of what speech was provided to the speech recognition system, distracting the user, and negating the benefit of using a speech recognition system.
- Various vehicles e.g., law enforcement or other public service vehicles, present an extremely high-background noise environment from multiple sources, such as, for example, the road, the engine, the wind, the vehicle fan, and the vehicle radio and/or passengers. Due to the level of such noise, the typical voice recognition system would be overwhelmed, causing extended delays as high as 20 seconds or more attempting to match the speech to be recognized with the vocabulary database.
- a critical event such as, for example, a high-speed chase
- distraction caused by either having to change focus to the computer screen to verify correct data entry or determining if the system received a command provided in the officer's speech, can significantly increase the likelihood of a traffic accident. Nevertheless, attempts have been made to implement a vehicle voice recognition system. Such a system is known as “Project 54.”
- Project 54 requires its own specialized hardware, hardware interface, and software package, which must be shipped or otherwise physically delivered to the vehicle.
- a vehicle electrician must then install the hardware interface and additional hardware, such as, for example, a press-to-talk switch that must be both connected to a vehicle structure and electrically interfaced with one of the ports of the vehicle computer.
- the vehicles mobile client software application must then be replaced with that of Project 54.
- the operator of the vehicle must then be trained to use the Project 54 mobile client and must memorize the voice commands utilized by the Project 54 software package.
- Project 54 is extremely susceptible to noise signals encountered when the push-to-talk switch is engaged to allow the microphone to receive an audio signal, such as during delivery of a voice command.
- the vehicle computer system resources can be heavily taxed while attempting to recognize the voice command, causing a significant delay in either recognizing the voice command or failing to do so. This can result in a severe distraction to the user.
- the user is not provided a system ready status, and thus, may lose track of which voice command is being processed. As stated, such distractions negate the benefit of using voice recognition systems. Recognized by the Applicant is that such a system is wholly inadequate system for suppressing the effects of noise.
- the user must divert attention to the push-to-talk switch, provide voice commands during a relatively low-noise situation, and quickly release the switch to prevent extraneous noise from being received. Also recognized by the Applicant is that this limitation prevents the software from being operated in an entirely hands-free mode.
- any voice command interface related system to be used for in-vehicle applications should be capable of not only enhancing the user's voice, but also eliminating background noise and minimizing the effect of other non-speech sounds.
- embodiments of the present invention advantageously provide an apparatus, program product, and associated methods to communicate with a vehicle during vehicle travel that can enhance the flow of data to and from a vehicle driver or other user, such as a police officer.
- Embodiments of the present invention also provide an apparatus, including a voice command interface program product, that reduces the need to type commands into a computer and/or press keyboard keys or buttons that are difficult to access, especially when the vehicle is on the move.
- Embodiments of the present invention also provide an apparatus, including a voice command interface program product, that delivers audio feedback indicating the selection of a command input to a mobile data communications application program in the form of the voice command, returning the interpretation of the voice command so the vehicle user can determine if the command or text was interpreted correctly.
- the voice command interface program product can provide voice command recognition and can deliver an echo of each spoken voice command, or a subset thereof, either in the form of text-to-speech or in the form of a pre-recorded human voice.
- this negates the need for the vehicle user to remove his/her hands from the steering wheel while driving or to shift focus from the outside environment in order to receive feedback. This functionality is particularly beneficial to law-enforcement.
- a law-enforcement officer can be faced with situations, such as, for example, a high-speech chase or a vehicle stop, where even a momentary distraction causing the officer to focus visual attention on the computer can cause the officer to loose control of the situation, resulting in possible injury or death to either the officer or to a bystander.
- Embodiments of the present invention advantageously provide an apparatus, including a voice command interface program product, to communicate with a user during vehicle travel which can: receive voice commands to operate vehicle computer application programs including those that can transmit queries to a remote computer; echo the identified voice commands in either text-to-voice or pre-recorded human voice, as pre-selected by a user; and prioritize pre-recorded human voice responses to the transmitted queries, summarizing the responses, thereby delivering rapid, easily comprehended responses that allow the user to maintain visual awareness of the surroundings at all times.
- a voice command interface program product to communicate with a user during vehicle travel which can: receive voice commands to operate vehicle computer application programs including those that can transmit queries to a remote computer; echo the identified voice commands in either text-to-voice or pre-recorded human voice, as pre-selected by a user; and prioritize pre-recorded human voice responses to the transmitted queries, summarizing the responses, thereby delivering rapid, easily comprehended responses that allow the user to maintain visual awareness of the surroundings
- an apparatus to communicate with a user or users, e.g., law-enforcement, during remote vehicle operations that can enhance command communication, particularly in a high-noise environment.
- a vehicle mobile data computer system which includes a vehicle computer having memory to store data therein and adapted to be positioned within a user vehicle, such as, for example, a law enforcement or other civil service vehicle, to define a vehicle mobile data computer.
- the vehicle mobile data computer is in communication with a remote host computer, e.g., a department server, which is in communication with various external databases.
- the remote host computer When implemented with law enforcement, the remote host computer is in communication with law enforcement databases to supply law enforcement data to officers positioned in a law enforcement vehicle.
- the vehicle mobile data computer preferably uses radio frequency to transmit and to receive such data.
- the vehicle mobile data computer is also in communication with at least one but preferably a plurality of audio speakers and at least one audio input device.
- One or more vehicle mobile data computer application programs are stored in the memory of the mobile data computer. At least one of the vehicle mobile data computer application programs preferably is a mobile data communications application program adapted to communicate with the remote host computer through the vehicle mobile data computer, to thereby transmit and receive data through the remote host computer.
- a voice command interface program product stored in the memory of the vehicle mobile data computer and in communication with the vehicle mobile data communications application program, is provided to enhance user communication with the remote host computer through the mobile data computer.
- the voice command interface program product includes instructions to perform the operations of: receiving as audio input through the at least one audio input device a voice command from the user representing a command input; identifying the voice command by analyzing the received audio input; echoing the identified voice command through the at least one audio speaker; and transmitting or otherwise conveying the command input to the mobile data communications application program.
- the echo preferably includes a preselected audio message verbally representing the identified voice command.
- the audio message preferably include data representing or repeating the identified voice command in prerecorded human voice.
- an initializer is provided.
- the initializer is adapted to assign or provide assignment of a preferably very limited set of voice commands tailored to interface with various application programs for the vehicle mobile data computer system, e.g., a vehicle mobile data computer application program.
- the initializer can be implemented by an initialization program or initialization text file, such as an “.ini” file, or data entered into the Windows® registry.
- the voice command interface program product is responsive only to limited sets of unique voice commands each of which function to emulate a correspondingly unique keyboard key press or series of keystrokes.
- the initialization file can provide a set of unique user-defined voice commands (e.g., “license plate” or “plate”) assigned to a correspondingly unique set of keyboard keystrokes or series of keystrokes (e.g., “Alt-c, F4, F5, F11”) to select an application program page, frame, text entry field, or other graphical user interface input.
- a set of unique user-defined voice commands e.g., “license plate” or “plate” assigned to a correspondingly unique set of keyboard keystrokes or series of keystrokes (e.g., “Alt-c, F4, F5, F11”) to select an application program page, frame, text entry field, or other graphical user interface input.
- the initialization file can also assign the voice command interface program product to use a common spoken phonetic alphabet (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”), and Arabic numerals, e.g., “zero” to “nine” equating to a keystroke for corresponding numbers “0” to “9.”
- a common spoken phonetic alphabet e.g., “alpha” to “zulu” or “adam” to “zebra”
- Arabic numerals e.g., “zero” to “nine” equating to a keystroke for corresponding numbers “0” to “9.”
- a specific set of user-defined or specified voice commands assigned or defined by an initializer, and/or those alphanumeric descriptions of individual keys associated with the vehicle mobile data computer keyboard, are compared for voice command recognition by the voice command interface program product.
- This is a significant feature that advantageously substantially improves voice command recognition accuracy and processing time, especially in a high-noise environment.
- received audio input need only be compared to the specific commands necessary to operate each vehicle or public service department specific mobile data computer application or applications. Having such a limited vocabulary of voice commands and no dictation text to search advantageously reduces the probability that a noise signal will be interpreted as a voice command.
- the apparatus further preferably includes a communication enhancing program product stored in the memory of the vehicle mobile data computer and in communication with the vehicle mobile data communications application program to enhance communication with the remote host computer through the vehicle mobile data computer.
- the communications enhancing program product is positioned to transmit enhanced audio data, e.g., law-enforcement data received from the vehicle mobile data communications application program, to the user through the at least one audio speaker.
- the enhanced audio data preferably includes a plurality of preselected and prerecorded audio messages that are processed and played in response to the audio data received from the vehicle mobile data communications program product to thereby summarize and prioritize messages forming the requested audio data.
- Embodiments of the present invention also provide a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer.
- a method includes providing a voice command interface program product particularly adapted to interface with a vehicle mobile data computer running a vehicle mobile data computer application program requiring command input by providing vehicle mobile data computer input device emulation.
- the method also includes providing an initializer preferably in the form of a program or initialization file accessible by the voice command interface program product and configured to assign each of a plurality of preferably customer or user specific/specified voice command terms or phrases, defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding plurality of vehicle mobile data computer input device command inputs for the vehicle mobile data computer application program.
- the method also includes providing a plurality of phonetic alphabet data sets to provide command input of a plurality of letters corresponding to a plurality of vehicle mobile data computer input device inputs for the vehicle mobile data computer application program.
- the method also includes assigning to at least some of the assigned voice commands, and/or assigned letters and numbers, an audio message in the form of an echo to acknowledge the voice command received from the user.
- the echo is preferably in the form of a prerecorded human voice message.
- the method can further include editing by the user the initializer to: assign an additional voice command terms or phrases to a corresponding vehicle mobile data computer input device input, in response to a modification of the vehicle mobile data computer application program; or edit a pre-assigned voice command assignment to change a name of a voice command, change the command input (keystrokes), or change the audio data associated with the voice command, in order to suit user preferences.
- another method can include accessing through an area network a user accessible web site or file server to “download” or otherwise receive a voice command interface program product that is adapted to provide vehicle mobile data computer input device emulation for a vehicle mobile data computer application program installed on a vehicle mobile data computer.
- the voice command interface program product advantageously can be provided and received by a user, preferably directly through the vehicle mobile data computer, in the form of a single self-extracting executable program including the voice command interface program product, negating the requirement for delivery of other more physically embodied computer readable media, e.g., a CD, in order to install the voice command interface program product.
- the self-extracting executable program preferably also can include an initializer which is adapted to assign a plurality of preferably user-specified voice commands to a correspondingly unique set of keyboard key command inputs, i.e. keystrokes or series of keystrokes.
- the initializer can be pre-tailored for a specific users needs prior to downloading or can be tailored by the user thereafter.
- the method further includes executing the self-extracting executable program, to thereby install each of a plurality of components of the voice command interface program product and the initializer in memory of the vehicle mobile data computer.
- each of a plurality of user-tailored voice commands to be received as audio input from an audio input device and a phonetic alphabet, are assigned to a corresponding keyboard key command input to interface the voice commands with a vehicle mobile data computer application program, provide command input to the vehicle mobile data computer application program.
- the numbers “zero” to “nine” equating to a keystroke for corresponding numerals “0” to “9” can also be assigned accordingly if not already done so in an operating system speech application program interface (SAPI).
- SAPI operating system speech application program interface
- the initialization can also include assigning to at least some of the assigned voice commands, and/or assigned letters and numbers, an audio data message in the form of an echo, and preferably in the form of a prerecorded human voice message, to acknowledge the voice command received from the user.
- Another method of enhancing command communication in a high-noise environment user and a user vehicle mobile data computer includes receiving voice commands and/or noise as audio input from the user through an audio input device, and identifying the voice commands by analyzing the received audio input. This is typically accomplished by performing an acoustic description comparison, or other analysis known to those skilled in the art, on or for the received audio input. The analysis is preferably only performed for a maximum of a predetermined or preselected time delay or timeout.
- this functionality allows quick recognition of the voice command not accompanied by excessive noise, and provides an ability to suppress a noise signal that would otherwise cause excessive use of processor resources and excessively delay a user's ability to convey a voice command, potentially distracting the user.
- This functionality also provides a time limitation for when a very low voice signal-to-noise ratio is encountered to allow the voice command to be repeated, if necessary, substantially without delay, rather than causing the user to be distracted while waiting for the processor to try and likely fail to identify the voice command from amongst the noise signal.
- the voice command (or representation thereof) is echoed through the vehicle or computer audio speakers and the command input (e.g., keyboard emulation) corresponding to the identified voice command is sent to the vehicle mobile data computer application program.
- the echo preferably includes a preselected audio message, preferably prerecorded in human voice, verbally repeating a representation of the voice command.
- the vehicle mobile data application program can either access vehicle memory or access a remote computer to receive request data.
- the functionality of either receiving audio input or transmitting further identified voice commands to the vehicle mobile data computer application program is automatically disabled if after a preselected time delay no voice commands are identified.
- Embodiments of the present invention also include a computer readable medium that is readable by a computer to enhance command communication in a high-noise environment between user and a vehicle mobile data computer application program.
- the computer readable medium includes a set of instructions that, when executed by a computer, such as, for example, vehicle mobile data computer cause the computer to perform the operations of: extracting data from an initializer configured to assign a plurality of user-specific or user-specified voice command terms or phrases, defining a plurality of vehicle mobile data computer application program voice commands to a corresponding vehicle mobile data computer input device command input (e.g., keyboard keystroke or keystrokes) for the vehicle mobile data computer application program; and assigning the plurality of vehicle mobile data computer application program voice commands, responsive to the extracted data, to corresponding vehicle mobile data keyboard key command inputs to interface the voice commands with the vehicle mobile data computer application program.
- an initializer configured to assign a plurality of user-specific or user-specified voice command terms or phrases, defining a plurality of vehicle mobile data
- the instructions also include those to perform the operation of receiving audio input through an audio input device when in a high noise environment; and performing an acoustic description comparison on the received audio input, to thereby identify a set of preferably only the following voice commands: voice command terms assigned in the initializer, members of a phonetic alphabet associated to the initializer to provide command input of a plurality of letters each corresponding to separate keyboard key input, and a plurality of numbers each corresponding to a separate numerical keyboard key input, to identify each respective voice command, to thereby execute an associated vehicle mobile data computer application program command input.
- voice command recognition speed and accuracy is essential in order to prevent unwarranted distraction of an officer. Accordingly, by providing a very limited set of voice commands which are easy to assign and remember, the officer, even in a very high-stress situation, can easily convey, and the voice command interface program product can quickly recognize, all voice commands necessary to operate the mobile data communications application program or other application programs. Further, selection of the very limited set of necessary voice commands reduces the amount of system resources and time required to analyze the audio input.
- a computer readable medium includes instructions that, when executed by the vehicle mobile data computer, cause the computer to perform the operations of: receiving as audio input from the user through an audio input device, e.g., a stationary or wireless microphone, a voice command representing a vehicle mobile data computer application program command input; and identifying the voice command by analyzing the received audio input.
- the instructions also include those to perform the operations of: echoing the identified voice command through an audio speaker in response to identification of the received voice command and/or release of a push-to-talk control key; and transmitting the corresponding command input to the vehicle mobile data computer application program.
- the echo preferably includes preselected audio data associated with the identified voice command including a representation of the identified voice command, preferably in the form of prerecorded human voice audio message, verbalizing the representation of the identified voice command.
- a computer readable medium includes instructions that, when executed by a computer, e.g., the vehicle mobile data computer, cause the computer to perform the operations of: receiving through an audio input device audio input including a plurality of voice commands from the user; transmitting to the vehicle mobile data computer application program the plurality of voice commands from the user received as audio input; and disabling, responsive to a preselected time delay, transmitting the plurality of voice commands to the vehicle mobile data communications application program or receiving audio input from the audio input device.
- a computer readable medium includes instructions that, when executed by a computer, e.g., vehicle mobile data computer, cause the computer to perform the operations of: receiving an audio input from the user through an audio input device, e.g., a stationary or wireless microphone, that may or may not include a voice command representing a vehicle mobile data computer application program command input; and analyzing the received audio input to determine if the audio input includes a valid voice command from a user.
- the instructions also include those to perform the operation of rejecting the received audio input as including a voice command from the user after attempting to identify for a preselected or predetermined time period/delay period a valid assigned voice command.
- the instructions also include those to perform the operation of substantially immediately resuming awaiting receipt of a voice command in response to termination of the delay period.
- this functionality prevents the vehicle mobile data computer from excessively wasting system resources in order to attempt to identify either a noise signal as a voice command embedded among the noise signal or a voice command provided by the user but in such high noise environment that the voice command signal to noise ratio is extremely low, making identification of the voice command extremely difficult and unlikely.
- by quickly resetting to receive either an initial voice command or a repeat of a previously attempted voice command the user is provided with less distraction and increased voice command identification reliability.
- the voice command interface program product functions entirely in the “background,” without the need for direct user control.
- the voice command interface program product integrates with various Microsoft® SAPI engines and is compatible with various Windows® operating systems including Windows 95, Windows 98, Windows ME, Windows 2000, Windows NT, and Windows XP.
- the program product installer can be written using a common installation program, such as, for example, the Wise Installation System, InstallShield, available through Wise Solutions, Inc., Madison, Mich.
- the program product installer can also install both the voice command interface program product and selected Microsoft® SAPI engine, along with a user editable initializer.
- both the voice command interface program product and initializer are “plug-and-play” capable, and thus, are immediately ready to function.
- the user need not access any graphical user interface to utilize the functionality of the voice command interface program product.
- Microphone training can be accessed through either a voice command or a keystroke combination, but this need not be a prerequisite to immediate use.
- a system tray icon can be displayed to provide a ready visual reference of the operational status of the voice command interface program product, to thereby reduce any potential user confusion.
- a control selector e.g., left control key or external input device switch
- an initializer e.g., a “.ini” file
- audio data e.g., a short “.wav” file or files, can be assigned in the initializer to indicate manipulation of the control selector.
- the user may select various user-tailored configurations. For example, an “echo” can be selected or deselected for a specific command term or terms, and/or for letters or numbers. Also for example, the user can: add, modify, or delete voice command terms and their assigned keystroke combination; switch between phonetic alphabets; select or deselected key activation audio feedback; and assign or modify selection of a keyboard key to function as a push-to-talk key.
- an “echo” can be selected or deselected for a specific command term or terms, and/or for letters or numbers.
- the user can: add, modify, or delete voice command terms and their assigned keystroke combination; switch between phonetic alphabets; select or deselected key activation audio feedback; and assign or modify selection of a keyboard key to function as a push-to-talk key.
- FIG. 1 is an environmental perspective view of a vehicle having an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention
- FIG. 2 is a schematic block diagram of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention
- FIG. 3A is a schematic block diagram of a vehicle computer system of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention
- FIG. 3B is a schematic block diagram of a microphone to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention
- FIG. 4 is a schematic block diagram of memory of a vehicle computer of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention
- FIG. 5A is a table illustrating a portion of an initializer for initializing a voice command interface program product according to an embodiment of the present invention
- FIG. 5B is a table illustrating two phonetic alphabet examples assignable by the initializer of FIG. 5A according to an embodiment of the present invention
- FIG. 6 is a front plan view of a form portion selection GUI according to an embodiment of the present invention.
- FIG. 7 is a schematic flow diagram showing transmission of audio data representing an echo of an identified voice command according to an embodiment of the present invention.
- FIG. 8 is an environmental perspective view of a user in communication with the vehicle mobile data computer system illustrated in FIG. 1 according to an embodiment of the present invention
- FIG. 9 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention.
- FIG. 10 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention
- FIG. 11 is schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention.
- FIG. 12 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention.
- embodiments of the present invention provide an apparatus for communicating with a user or users, e.g., law-enforcement, during remote vehicle operations that can enhance command communication particularly in a high-noise environment.
- the apparatus 30 can provide for both enhanced transmission of data and superior organization, prioritization, and delivery of requested data.
- the apparatus 30 is preferably designed to be used in conjunction with existing mobile data communications systems such as, for example, the Premier MDC system manufactured by the Motorola Corporation of Schaumberg, Ill.
- the apparatus 30 can include a centrally located department server 35 having access to one or more databases 38 to supply a vehicle user with data requested by the vehicle user; a vehicle mobile data computer system 40 (see FIGS. 1 and 3 A) positioned in a vehicle V and having a mobile data computer application program 43 ( FIG.
- a voice command interface program product 45 to provide voice recognition of voice (verbal) commands to thereby provide enhanced voice command control of the mobile data application program 43 , particularly in a high-noise environment
- a communication enhancing program product 47 to transmit enhanced audio data received from the mobile data application program 43 to the vehicle user through an audio speaker 65 (see FIGS. 1 and 3 A).
- the apparatus 30 can include a remote host computer e.g., a department a department server 35 in communication with one or more remote vehicle mobile data computers 41 each positioned in a vehicle V.
- the department server 35 preferably uses radio frequency to transmit and receive data to the vehicle mobile data computer 41 .
- the department server 35 is also preferably in communication with at least one and preferably a plurality of remote computers, and possibly a local computer having data defining department databases 38 , through a communications network 50 such as the Internet or a local area network.
- the department databases 38 can include local, regional, or national law enforcement data such as the Department of Highway Safety and Motor Vehicles (DHSMV) database and the National Crime Data Center (NCIC) database, just to name a few. These databases can provide time critical information such as, for example, vehicle and individual background for law enforcement officers when positioned in vehicles as well as for law enforcement personnel in a headquarters or control center.
- DHSMV Department of Highway Safety and Motor Vehicles
- NCIC National Crime Data Center
- the vehicle mobile data computer system 40 includes vehicle mobile data computer 41 preferably having a processor 51 to process communications and other type of data, a display 53 in communication with the processor 51 to display data to a user, memory 55 , e.g., RAM and ROM, also in communication with the processor 51 for storing software and data therein, a power outlet 57 positioned to supply power to the processor 51 as well as other components of the vehicle mobile data computer 41 , a keyboard 59 in communication with the processor 51 to supply a user interface to the user.
- vehicle mobile data computer 41 preferably having a processor 51 to process communications and other type of data, a display 53 in communication with the processor 51 to display data to a user, memory 55 , e.g., RAM and ROM, also in communication with the processor 51 for storing software and data therein, a power outlet 57 positioned to supply power to the processor 51 as well as other components of the vehicle mobile data computer 41 , a keyboard 59 in communication with the processor 51 to supply a user interface to the user.
- the vehicle mobile data computer system 40 also preferably includes an RF transceiver 61 in communication with the processor 51 to transmit and receive data, and audio input device such as, for example, a microphone 63 (described in detail later) to provide voice command input to the vehicle mobile data computer 41 , and at least one but preferably a plurality of speakers 65 for providing voice command acknowledgments and for delivering department data in audio form.
- the speakers 65 are preferably external speakers but can be speakers built into the computer or a preexisting speaker associated with a non-computer dispatching system as understood by those skilled in the art.
- the vehicle mobile data computer system 40 also preferably includes one or more printers 67 or other computer peripherals in communication with the processor 51 . When used in a law enforcement vehicle, for example, these printers 67 can be used for printing accident reports, tickets, warnings, towing citations, or filling in or populating other law enforcement forms.
- the vehicle mobile data computer 41 preferably includes operating system and computer application programs known to those skilled in the art, such as, for example, a mobile data communications application program 43 , stored in memory 55 and provided to facilitate user communication with the department server 35 through the vehicle mobile data computer 41 and to transmit and receive department data from the one or more databases 38 through the department server 35 (see FIG. 2 ).
- the vehicle mobile data computer 41 can also include a communication enhancing program product 47 stored in memory 55 of the vehicle mobile data computer 41 and in communication with the mobile data computer application program 43 to enhance user communication with the department server 38 through the vehicle mobile data computer 41 .
- the communications enhancing program product 47 includes instructions to perform the operation of transmitting enhanced department audio data received from the mobile data computer application program 43 to the user through the audio speakers 65 .
- Such enhanced department data includes preselected and prerecorded audio messages provided in response to the department data received by the mobile data computer application program 43 from the department server 35 .
- One such apparatus or system providing such communications enhancing program product 47 is perhaps best described in co-pending U.S. patent application Ser. No. 10/656,487 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” and U.S. Pat. No. 6,621,422 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” each incorporated herein by reference in their entirety.
- the vehicle mobile data computer 41 includes a voice command interface program product 45 stored in the memory 55 of the vehicle mobile data computer 41 and in communication with the mobile data computer application program 43 to enhance officer communication with the department server 38 through the vehicle mobile data computer 41 .
- the voice command interface program product 45 can be in the form of microcode, programs, routines, and symbolic languages that provide a specific set for sets of ordered operations that control the functioning of the hardware and direct its operation, as known and understood by those skilled in the art.
- the voice command interface program product 45 includes instructions to perform the operation of receiving as audio input a verbal command from the user representing a corresponding command input from the user through the microphone 63 , and identifying the verbal command by analyzing the received audio input.
- an acoustic description of text corresponding to a specific set of voice commands stored in a vocabulary database is compared against an acoustic signal generated by the utterance of the voice command to be recognized.
- the audio input received by the microphone 63 includes not only verbal or voice commands representing a corresponding command input defined as one or a series of keyboard key inputs, but also noise including continuous and repetitive noise and noise caused by reverberation of the voice commands from adjacent vehicle V structures.
- the voice command interface program product 45 advantageously can distinguish between voice commands spoken by the user and noise. Proper selection of the microphone 63 can, however, significantly aid in performing such differentiation.
- microphone transducers used for a variety of applications. The most common distinctions between various microphones are: type of microphone, e.g., dynamic, boundary, condenser, ribbon, array, and directional pattern, e.g., unidirectional and omni-directional.
- the microphone 63 can be an Andrea DA-350 quad array microphone manufactured by Andrea Electronics Corp., Melville N.Y.
- the DA-350 microphone is specifically designed for use in a vehicle.
- This array microphone provides not only directional focusing on and enhancing of the user's voice, but also overcomes high-noise environment factors associated with a moving vehicle.
- the DA-350 array microphone utilizes multiple microphones (transducers), unique software algorithms, and a digital signal processor to adaptively focus microphone sensitivity on the driver's voice, to thereby enhance voice reception and reduce extraneous noise.
- the DA-350 microphone can analyze audio signals coming from each individual microphone transducers in order to create a narrow reception cone having an angle of reception of approximately 25 degrees either side of centerline (preselected azimuth) and forming an area of reception.
- This reception cone is characterized by having a voice frequency response of between approximately ⁇ 30 dBV and ⁇ 45 dBV between a frequency range of 1 kHz to 3 kHz within the area of reception, and having an extremely steep drop in noise frequency response outside the area of reception to that of approximately ⁇ 65 dBV to ⁇ 85 dBV in that same frequency range.
- the DA-350 microphone can differentiate between audio signals coming from its preselected azimuth, effectively rejecting noises or voices coming from other directions including those emanating from the audio speakers, other passengers, or due to reverberations. Further, the DA-350 microphone provides an ability to adjust focus to the movement of the speaker during dictation.
- the DA-350 microphone includes a digital signal processor which separates voice frequency from the noise, inverts the noise, and subtracts the noise from the voice signal, providing a reduction in noise sources of typically between 25 dB to 30 dB.
- other microphones such as, for example, the Andrea Superbeam® Array Microphone, also manufactured by Andrea Electronics Corp., provides a substitute having features similar to that described above.
- the microphone 63 can be configured as an array microphone adapted to be connected to a vehicle V structure, e.g., dashboard or visor, positioned separate and spaced apart from the user to allow hands-free operation when receiving voice commands from the user (see FIG. 1 ).
- the microphone 63 include at least two, but preferably four unidirectional microphone transducers 71 with individual audio channels adapted to provide a directional area of audio input sensitivity having an adjustable angle and area of reception. This type of array microphone enhances detection of the verbal commands by allowing the user to manually focus the microphone reception zone on the user, significantly eliminating background noise from the various sources such as, road, engine, wind, fan, and radio.
- the microphone 63 does not require individual user training.
- a different user can enter the vehicle V and be immediately ready to utilize the voice command interface program product 45 .
- the voice command interface program product 45 can include microphone training functionality preferably selectable through either a voice command or keystroke combination, e.g., ctrl-alt-m.
- an audio input processing (noise-canceling ) program product 73 adapted to interface with the microphone 63 .
- the audio input processing program product 73 includes instructions particularly adapted to enhance reception of the plurality of verbal commands to perform the operation of automatically adjusting or shaping the angle and area of reception of the audio input to the microphone 63 , responsive to detection of audio input from the user, to focus the array on the user's voice, substantially reducing reverberation and other non-repetitive extraneous noise; and by attenuating continuous and repetitive noise, substantially removing or reducing voice command recognition latency.
- the audio input processing program product 73 can be installed in the memory of a digital signal processor 64 associated with the microphone 63 or in memory, e.g., memory 55 , of the vehicle mobile data computer 41 .
- the combination of a unidirectional array microphone 63 and audio input processing program product 73 can enable near optimal performance by overcoming the high-noise environment of a moving vehicle V, advantageously providing the voice command interface program product 45 a substantially clear voice command signal.
- the combination can provide a significant differential in voice frequency response within the area of reception and background noise response outside the area of reception of, for example, approximately between 20 dBV and 35 dBV between the frequency range of 1 kHz to 3 kHz, and, for example, at least 25 dBV at the frequency of 1 kHz.
- the differential in voice frequency response within the area of reception and background noise response outside the area of reception is preferably at least 30 dBV at the frequency of 1 kHz, and more preferably at least 35 dBV at the frequency of 1 kHz.
- an initializer 75 is provided that can assign or provide assignment of a preferably very limited set of voice commands tailored to interface with various application programs for the vehicle mobile data computer system 40 , e.g., mobile data computer application program 43 . As perhaps best shown in FIGS.
- the initializer 75 can provide a set of unique voice commands (labels) 79 , e.g., “license plate” or “plate,” assigned to a correspondingly unique set of keyboard keystrokes or series of keystrokes 81 , e.g., “Alt-c, F4, F5, F11,” to select an application program page or frame 83 , data entry field 85 , or other graphical user interface input, and can assign the voice command interface program product 45 to use at least one of preferably the two most common spoken phonetic alphabets 87 ( FIG. 5B ), e.g., “alpha” to “zulu” or “adam” to “zebra,” equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”).
- labels e.g., “license plate” or “plate”
- keyboard keystrokes or series of keystrokes 81 e.g., “Alt-c, F4, F5, F11”
- the voice command interface program product 45 is particularly adapted to be operated on a Windows® operating system configured with a speech application program interface (SAPI) engine.
- SAPI speech application program interface
- the initializer 75 can be implemented by an initialization file, such as a “.ini” file, or data entered into the Windows® registry, or by various other means known to those skilled in the art.
- the initializer 75 is preferably fully editable by the user to provide the user an ability to tailor the various voice commands 79 to those typically familiar to the user and to add voice commands 79 to coincide with modifications or updates to the mobile data computer application program 43 or any other applications to be interfaced with the voice command interface program product 45 . Further, through editing of the initializer 75 , the user can change the selection between the at least two phonetic alphabets 87 , as desired.
- voice command interface program product 45 only a specific set of user-defined or specified voice commands assigned or defined by an initializer 75 , and/or alphanumeric descriptions of individual keys associated with the keyboard 59 , are compared for voice command recognition by the voice command interface program product 45 .
- This is a significant feature that advantageously substantially improves voice command recognition accuracy and processing time, especially in a high-noise environment.
- received audio input need only be compared to the specific commands necessary to operate the mobile data computer application program 43 . Having such a limited vocabulary of voice commands and no dictation text to search advantageously reduces the probability that a noise signal will be interpreted as a voice command.
- the voice command interface program product 45 can be implemented to only recognize voice commands listed as unique voice command (labels 79 ), e.g., “plate,” assigned to the correspondingly unique keyboard keystroke or series of keystrokes 81 (e.g., “Alt-c, F4, F5, F11”) to select an application program page or frame 83 to enter a license “plate” number 86 ; one of two spoken phonetic alphabets 87 as pre-selected in the initializer 75 (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”) to select alphabetical letters of the license “plate” number 86 ; and the spoken numbers “zero” to “nine” equating to a keystroke for the corresponding Arabic numerals (e.g., numerals “0” to “9
- the voice command interface program product 45 can provide an “echo” of the identified voice command through the audio speaker 65 , and preferably upon the user acknowledging that the voice command was correctly interpreted by the voice command interface program product 45 , in response to hearing the echo, transmitting the command input to the mobile data computer application program 43 .
- the echo preferably in the form of audio data, such as, for example, an audio file or combination of files 89 (e.g., .wav file) assigned to a voice command by the initializer 75 is outputted or otherwise transmitted or “played” on the audio speaker 65 .
- the echo can include a preselected and prerecorded audio message verbally repeating the identified verbal command to include individual letters from the phonetic alphabets 87 and numbers, described previously.
- at least portions of the audio data associated with the identified verbal command or command string can include an audio message representation of the identified command in prerecorded human (clear) voice.
- the voice command interface program product 45 can include a plurality of preselected and prerecorded human voice audio messages 77 preferably stored in memory 55 and assigned during initialization to various preselected voice commands.
- the echo for the various voice commands can be enabled or disabled either as a group or individually for selected individual voice commands, either within the initializer 75 or through use of a control selector key on keyboard 59 .
- audio data e.g., the human voice audio message 77
- assigned to individual voice commands can be modified or deleted and/or new or additional audio messages can be added to a particular voice command (label 79 ). This can be accomplished preferably through a user editing the initializer 75 .
- the voice command interface program product 45 preferably formulates the echo message to be transmitted by matching (block 101 ) the identified voice command (label 79 ) with the corresponding preselected and pre-recorded audio message 77 (see FIG. 5A ), rapidly returning or transmitting (block 103 ) an echo message to the user through the speakers 65 (see FIG. 1 ) to provide the user positive feedback.
- human voice audio messages 77 for at least the main portion of the voice command are preferred because human voice audio messages 77 can be much more intelligible and can be preselected to be male, female, soothing, urgent sounding or have other desired qualities in addition to selected languages, accents, intonations or other voice language benefits instead of what is often robotic, stiff or stilted sounding from conventional text-to-voice messages.
- noise can affect the ability of the voice command interface program product 45 to identify the predetermined or preselected voice commands. More particularly, some noise signals can have similar qualities as that of one or more voice commands. The result of such noise signals can be inefficient use of processor 51 resources in an attempt to identify the noise signals as a voice command. This can result in a significant distraction to a vehicle user because the user must generally either determine that the processor 51 is not busy prior to providing a voice command or provide such voice command, anticipating that the voice command will be properly received.
- an icon 93 ( FIG. 6 ) is provided on the graphical user interface of the video display 53 to show the status of the processor 51 with respect to receptiveness of receiving a voice command.
- the icon 93 can display various colors indicating system status, e.g., green to indicate ready to receive voice commands, yellow to indicate busy, and red to indicate an error has occurred, or can display any other combination of colors or symbols thereof.
- the voice command interface program product 45 can include instructions that are responsive to a preselected or predetermined time delay or time-out, e.g., less than approximately three seconds, to perform the operation of rejecting the received audio input as being a voice command from the user; and resetting to receive another voice command from the user.
- this functionality reduces the effect of noise by preventing inefficient use of the processor 51 resources in an attempt to identify the noise as a voice command, and enhances functionality of the voice command interface program product 45 by reducing confusion and distraction of the user, thus increasing reliability. If the audio input is merely noise, excessive use of resources of the processor 51 should be negated. If the audio input was a mix of noise and a voice command, if no echo is received after expiration of the preselected or predetermined time delay, intuitively the user will know that the voice command was not received or otherwise not identified, so that the user may repeat the voice command with little delay.
- the voice command interface program product 45 includes instructions that respond to user manipulation of a preselected control function selector, e.g., a keyboard key or an external input device (not shown), to perform the operation of enabling receiving audio input from the microphone 63 to transmit or otherwise provide to the mobile data computer application program 43 the command inputs received and identified as voice commands (audio input) by the voice command interface program product 45 .
- a preselected control function selector e.g., a keyboard key or an external input device (not shown
- the leftmost control key 91 of the keyboard 59 can be assigned to perform the function of a push-to-talk control selector. The user depresses the control key 91 , enabling the microphone 63 , and provides a voice command, which is received by the microphone 63 .
- the microphone 63 is disabled, disabling further audio input from the microphone 63 .
- the selection of which control selector provides the push-to-talk function and the functionality of the control, performed by the selected control selector are both fully editable by the user through editing the initializer 75 .
- a control selector such as the leftmost control key 91 of the keyboard 59
- a control selector can be assigned to perform the function of a push-to-talk control selector, whereby the user depresses the control key 91 to enable the microphone 63 .
- this function can be performed automatically in response to a preselected or a predetermined time delay or a time-out.
- the voice command interface program product 45 In response to identification of the voice command, the voice command interface program product 45 provides an echo of the voice command through the audio speakers 65 .
- the control input associated with the voice command can then be conveyed to the mobile data computer application program 43 , preferably after: receiving a confirmation voice command from the user, such as, for example, “send”; receiving a correction command, such as, for example, “clear” or “backspace”; or standing by and awaiting additional user input.
- a user gives the voice command “license plate” or “plate.”
- the voice command interface program product 45 provides an echo of the voice command back to the user and sends the corresponding command input to the mobile data computer application program 43 , the mobile data computer application program 43 will be awaiting entry of a license plate number 86 , e.g., “ABC 12D.”
- the mobile data computer application program 43 After the user verbally provides the license plate number 86 , e.g., “ABC 12D,” which can also be echoed, the mobile data computer application program 43 will be awaiting the command input corresponding to the “send” voice command.
- a series of command inputs can be concatenated by concatenating corresponding voice-commands.
- the user can state the combined voice commands of “plate”-“ABC 12D”-“send.”
- the voice command interface program product 45 can then provide an echo of either parts of the combined voice command or the whole combined voice command e.g., “plate”-“ABC 12D”-“send.”
- the vehicle mobile data computer 41 upon receiving the requested license plate number, through the communication enhancing program product 47 , can announce receipt of the requested information and await authorization to output such information through the speakers 65 ( FIG. 1 ), automatically output such information upon receipt, or perform a combination thereof.
- an indication preferably in the form of audio data such as, for example, an audio file (e.g., .wav file) can be assigned to the control selector to be outputted or otherwise transmitted or “played” on the audio speaker 65 upon activation of the respective control selector.
- an audio file e.g., .wav file
- a preferably moderately distinct set of audio data can be assigned to the control selector to indicate release or deactivation of section selector.
- providing such audible indications helps reduce the potential for a vehicle accident by negating any need for the user to look at the control selector to determine if it was properly manipulated.
- the functionality of providing an audible indication of activation of the preselected control selector can be, itself, controlled either by a separate control selector or a sequence of manipulations of the preselected control selector. This functionality can be assigned within the initializer 75 and edited by the user.
- the voice command interface program product 45 can include instructions to perform the operation of monitoring the audio input for a specific command assigned to perform the function of enabling receiving of other voice commands.
- a specific command assigned to perform the function of enabling receiving of other voice commands.
- the word “Christine” or other selected unique name for the “computer” can be assigned by the initializer 75 to perform the push-to-talk function.
- the user states “Christine” which can be identified and echoed through the area speaker 65 .
- this functionality allows entirely hands-free manipulation of the mobile data computer application program 43 while preventing inadvertent reception or misinterpretation of noise or voice commands embedded in conversational speech not directed to the mobile data computer application program 43 , such as speech with a passenger or radio dispatcher.
- the phrase “Christine standby” or other unique word or phrase can be assigned command disable the functionality of the voice command interface program product 45 , preferably with the exception of receipt and processing of the preselected “on” voice command, e.g., preferably another “Christine.”
- the voice command interface program product 45 can include instructions, responsive to a preselected time delay, such as, for example, 10 seconds of not receiving a voice command, to perform the operation of disabling the functionality of the voice command interface program product 45 . Again this disabling function is preferably implemented with the exception of allowing receipt and processing of the preselected “on” voice command, e.g., “Christine.”
- the apparatus 30 can also include a wireless microphone assembly 95 including a microphone 97 and audio speaker 98 adapted to provide wireless audio communication between the vehicle mobile data computer 41 and the user when outside the department vehicle V to transmit the voice commands from the user to the mobile data computer application program 43 (see FIG. 4 ) through the voice command interface program product 45 , to thereby provide command input to the mobile data computer application program 43 . Also provided is the ability to receive an audio echo for each of the voice commands, to thereby provide the user verification of correct identification of each respective voice command by the voice command interface program product 45 .
- the wireless microphone assembly 95 transmits data to, and receives data from, the vehicle transceiver 61 .
- the voice command interface program product 45 is preferably selected to be either continuously on, in which case, mute switch 99 can control audio input to the microphone 97 , or can be voice activated using a preselected “on” voice command.
- a method includes providing a voice command interface program product 45 (block 121 ) particularly adapted to interface with a vehicle mobile data computer 41 (see FIGS. 1 and 3 A) running a vehicle mobile data computer application program 43 (see FIG. 4 ) requiring command input by providing vehicle mobile data computer input device emulation.
- the method also includes providing an initializer 75 (block 123 ) accessible by the voice command interface program product 45 and configured to assign each of a plurality of preferably customer or user specific/specified voice command terms or phrases, e.g., labels 79 (see FIG. 5A ), defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding plurality of vehicle mobile data computer input device command inputs, e.g., keystrokes 81 , for the vehicle mobile data computer application program 43 (block 125 ).
- an initializer 75 (block 123 ) accessible by the voice command interface program product 45 and configured to assign each of a plurality of preferably customer or user specific/specified voice command terms or phrases, e.g., labels 79 (see FIG. 5A ), defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding plurality of vehicle mobile data computer input device command inputs, e.g., keystrokes 81 , for the vehicle mobile data computer application program 43 (block 125
- the initializer 75 can be in the form of a text file or a program which can assign the preselected set of voice commands to a corresponding set of keyboard keystrokes or series of keystrokes or other command inputs to thereby select an application program page or frame 83 (see FIG. 6 ), data entry fields 85 , or other graphical user interface input.
- the method also includes providing a plurality of phonetic alphabet data sets (see e.g., FIG. 5B ) to provide command input of a plurality of letters corresponding to a plurality of vehicle mobile data computer input device inputs for the vehicle mobile data computer application program 43 (block 127 ).
- the initializer 75 can assign (block 129 ) the voice command interface program product 45 to use at least one of preferably the two most common spoken phonetic alphabets 87 (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”).
- the numbers “zero” to “nine,” equating to a keystroke for corresponding numerals “0” to “9,” can also be assigned accordingly, if not already done so in an operating system SAPI.
- the method also includes assigning an audio message (block 131 ) in the form of an echo to at least some of the assigned voice commands, and/or assigned letters and numbers, to acknowledge the voice command received from the user (see FIG. 5A ).
- the audio message is preferably in the form of a prerecorded human voice message 77 (see FIG. 4 ) that is preferably activated by manipulation of a control function selector, e.g., left control key 91 (described further below), or by a time delay instituted after identifying the voice command. For example, as perhaps best illustrated in FIGS.
- the user depresses the left control key 91 and provides the voice command “plate.”
- the voice command interface program product 45 will activate a corresponding keystroke combination to access a corresponding application program screen or text entry field.
- the keystroke combination “Alt-c, F4, F5, F11” would be performed.
- FIG. 5A the keystroke combination “Alt-c, F4, F5, F11” would be performed.
- the user would then provide a voice command such as “Alpha”-“Bravo”-“Charlie”-“one”-“two”-“Delta” corresponding to license plate number “ABC12D.”
- the voice command interface program product 45 would then cause activation of the keystrokes “a”-“b”-“c”-“1”-“2”-“d,” and, if selected to do so, provide a corresponding echo of the license plate number.
- the license plate data can be either automatically transmitted to the department server 35 (see FIG. 2 ) or the user would then provide another voice command, such as “send,” to do so if the echo properly repeated the license plate number “ABC12D,” or “clear” or “backspace,” if the interpretation was incorrect.
- each voice command or a preselected subset of the voice commands could be echoed, if selected to do so. Further, the echo need not be an actual repeat of the actual voice command. For example, the voice command “send” can be returned as “sending.”
- the method can also include assigning or designating a control function selector (block 133 ), e.g., the left control key 91 of the keyboard 59 (see FIG. 1 ), or other input device of the vehicle mobile data computer 41 , as a voice command interface program product on-off operation control selector defining a push-to-talk switch.
- a control function selector e.g., the left control key 91 of the keyboard 59 (see FIG. 1 ), or other input device of the vehicle mobile data computer 41 , as a voice command interface program product on-off operation control selector defining a push-to-talk switch.
- An audible indication preferably in the form of an audio file to indicate activation and/or deactivation of the control selector, can also be assigned in order to aid the user in determining that the preselected control selector (e.g., left control key 91 ) was properly manipulated.
- the audio data or audio file assigned can be different depending upon the function performed, e.g., selection “on
- the method can further include editing the initializer 75 (see FIG. 5A ) by a user to assign an additional command term or phrase to a corresponding keyboard key or other vehicle mobile data computer input device input specifically tailored to the vehicle mobile data computer application program 43 ; or to change the command input, e.g., keystrokes 81 , for a pre-existing voice command term or phrase, in response to a modification of the vehicle mobile data computer application program 43 .
- a pre-assigned voice command can also be edited to change the identification or name of the voice command (label 79 ); to delete the voice command (label 79 ), in response to a desired grammatical change by the user; or to change the audio data, e.g., audio file 89 , associated with the voice command, in order to suit user preferences.
- a preferred methodology of performing the steps of providing a voice command interface program product 45 and providing initializer 75 includes accessing (block 141 ), preferably through a communications or area network 50 (see FIG. 2 ), a user accessible web site preferably positioned on a Web server (not shown), to “download” or otherwise receive (block 143 ) a voice command interface program product 45 (see FIG. 4 ) that is adapted to provide vehicle mobile data computer input device emulation for a vehicle mobile data computer application program 43 installed on a vehicle mobile data computer 41 (see FIG. 1 ).
- the voice command interface program product 45 can be provided and received by a user, preferably directly through the vehicle mobile data computer 41 , in the form of a single self-extracting executable program that includes the voice command interface program product 45 .
- the self-extracting executable program preferably installs an initializer 75 (see FIG. 5A ) which is adapted to assign a plurality of preferably user-specified voice commands to a correspondingly unique set of keyboard key command inputs, i.e. keystrokes or series of keystrokes 81 .
- the method includes executing or running the self-extracting executable program, to thereby install each of plurality of components (block 145 ) of the voice command interface program product 45 and the initializer 75 in memory 55 of the vehicle mobile data computer 41 .
- a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer 41 Preferably upon startup/initialization (block 151 ) of a voice command interface program product 45 (see FIG. 4 ), each of a plurality of user-tailored voice commands, to be received as audio input from a microphone 63 , 97 (see FIGS. 1 and 8 ), and a phonetic alphabet (see FIG. 5B ), are assigned to a corresponding keyboard key command input, e.g., keystrokes 81 , to interface the voice commands with a vehicle mobile data computer application program 43 , to thereby provide command input to the vehicle mobile data computer application program 43 .
- the numbers “zero” to “nine,” equating to a keystroke for corresponding numerals “0” to “9,” can also be assigned accordingly if not already done so in an operating system SAPI.
- the initialization can also include assigning, to at least some of the assigned voice commands and/or assigned letters and numbers, an audio data message in the form of an echo to acknowledge the voice command received from the user.
- the echo is preferably in the form of a prerecorded human voice audio message 77 .
- the initialization can further include designating a control function selector, e.g., the left control key 91 of the keyboard 59 (see FIG. 1 ), or other input device of the vehicle mobile data computer 41 , as a voice command interface program product on-off operation control selector defining a push-to-talk switch.
- the push-to-talk switch (control selector) can also be assigned audio data to indicate a change in state of the assigned control selector (see FIG. 5B ).
- the method can also include enabling an audio input device (block 153 ), e.g., the microphone 63 , 97 (see FIGS. 1 and 8 ), to allow the voice command interface program product 45 to provide a verbal interface with the vehicle computer application program 43 .
- an audio input device e.g., the microphone 63 , 97 (see FIGS. 1 and 8 )
- this is typically accomplished by depressing or otherwise manipulating the left control key 91 , if so assigned such function, but may include un-muting the microphone 63 , if so configured.
- the left control key 91 is depressed and held to allow the user to provide voice commands.
- the left control key 91 need only be depressed momentarily and released, the microphone 63 /audio input being enabled for a predetermined or preselected time delay, and disabled thereafter, or disabled after a predetermined or preselected time period without receiving a voice command from the user.
- the audio input remains enabled continuously.
- enabling the microphone 97 is typically accomplished by a combination of use of a power button (not shown) and mute switch 99 .
- the method includes receiving voice commands and/or noise as audio input from the user through the microphone 63 , 97 (block 155 ), and performing an acoustic description comparison or other analysis known to those skilled in the art on or for the received audio input (block 157 ). If the audio input is determined to include one or more voice commands assigned during initialization, a signal is transmitted to execute an associated one or more vehicle computer application program command inputs. The analysis is preferably only performed for a maximum of a predetermined or preselected time delay or timeout.
- this functionality allows quick recognition of the voice command not accompanied by excessive noise, and provides an ability to suppress a noise signal that would otherwise excessively use processor resources and/or excessively delay a user's ability to convey a voice command, potentially distracting the user.
- This functionality provides a time limitation to allow the voice command to be repeated, if necessary, substantially without delay, when a very low voice signal-to-noise ratio is encountered; rather than cause a distraction to the user while the user waits for the processor 51 to try, and likely fail, to identify the voice command from amongst the noise signal.
- a system tray icon 93 can be displayed to further indicate that audio input is being processed to further orient the user as to the availability of providing additional voice commands.
- a voice command is identified (block 159 ) and if the echo function is enabled and audio data is assigned to the respective voice command (block 161 ), preferably upon release of the left control key 91 or after a predetermined or preselected time delay, the voice command is echoed (block 163 ) through the audio speakers 65 (see FIG. 1 ) and the command input, e.g., keyboard emulation, is sent (block 165 ) to the vehicle computer application program 43 (see FIG. 4 ). The vehicle application program 43 can then either access vehicle memory 55 or access a department server 35 (see FIG. 2 ) to receive requested data (block 167 ). Audio data, indicating a change in state of the left control key 91 (see FIG.
- a communication enhancing program product 47 can extract the requested data, summarize the data, and verbally announce to the user the requested data (block 169 ).
- the user need only depress the left control key 91 once to enable system functionality, after which the user may provide voice commands, as desired, to further control access to such system functionality. This can be an important feature, especially when implemented in conjunction with a mobile or wireless microphone assembly 95 (see FIG. 8 ).
- the method includes: transmitting the voice commands to a vehicle computer application program 43 from outside the vehicle V through the microphone 97 ; providing command input to the vehicle computer application program 43 through a voice command interface program product 45 ; and receiving an audio echo of the voice commands through either an audio speaker 96 , 98 , also carried by the user, to thereby provide the user verification of correct receipt of each voice command, and thus, correct command input.
- the microphone assembly 95 is adapted to be carried by the user positioned outside a user vehicle V, to thereby provide the user a substantially hands-free ability to transmit voice commands to a receiver, such as, for example, either transceiver 61 (see FIG. 1 ) or an alternative transceiver (not shown) directly connected to the vehicle V and in communication with the vehicle mobile data computer 41 .
- a receiver such as, for example, either transceiver 61 (see FIG. 1 ) or an alternative transceiver (not shown) directly connected to the vehicle V and in communication with the vehicle mobile data computer 41 .
- the microphone assembly 95 need not remain continuously on, unless desired by the user.
- the microphone assembly 95 can include a mute button 99 and/or the voice command interface program product 45 can include functionality to allow specific commands to either activate or render dormant the voice command interface program product 45 .
- an embodiment of the present invention also includes a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer system which includes forming a log file to log each attempt at recognizing an audio input (block 181 ); and logging in the log file each attempt in response to receiving such respective audio input (block 183 ).
- Each entry into the log file can include data indicating the date, time (including seconds), and results of the audio input analysis.
- the method can also include requesting the log file from the user (block 185 ); and performing a statistical analysis on the log file to analyze recognition failure rates (block 187 ).
- such data allows for continuous enhancement and development of improved process steps and the voice command interface program product 45 .
- embodiments of the present invention also include a computer readable medium that is readable by a computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program.
- the computer readable medium includes a set of instructions that, when executed by the computer, such as, for example, vehicle mobile data computer 41 (see FIG. 1 ), cause the computer to perform the operation of extracting data from an initializer 75 (see FIG.
- the initializer 75 can be implemented by an initialization file such as, for example, an “.ini” file, through data entered into the Windows® registry, or by various other means known to the skilled in the art.
- the instructions also include those to perform the operation of assigning the voice commands to corresponding vehicle mobile data keyboard key command inputs to thereby interface with the vehicle mobile data computer application program 43 .
- the instructions can further include those to perform, when in a high noise environment, the operations of receiving, through an audio input device, e.g., microphone 63 , 97 , audio input including both voice commands from the user and noise from the vehicle V. Also included are instructions to perform the operation of performing an acoustic description comparison on the received audio input to thereby identify: voice commands assigned in or by the initializer 75 ; members of a phonetic alphabet associated to or with the initializer 75 to provide command input corresponding to a plurality of letters each corresponding to separate keyboard key input for keyboard 59 ; and a plurality of numbers each corresponding to a separate numerical keyboard key input for keyboard 59 .
- voice command recognition speed and accuracy is essential in order to prevent unwarranted distraction of an officer. Accordingly, by providing a very limited set of voice commands which are easy to assign and remember, the officer, even in a very high-stress situation, can easily convey, and the voice command interface program product can quickly recognize, all voice commands necessary to operate the mobile data communications application program or other application programs. Further, selection of the very limited set of voice commands: reduces the amount of system resources and time required to analyze the audio input; and increases the probability of accurately recognizing each particular voice command.
- the result of the acoustic description comparison is to identify one or more voice commands presented by the user to thereby execute an associated vehicle mobile data computer application program command input. For example, as perhaps best shown in FIG. 6 , rather than type a license plate number, the user annunciates corresponding letters of the assigned phonetic alphabet and the Arabic numerals corresponding to those letter and number keys on keyboard 59 . This license plate number is then sent, and data is returned by the mobile data communications application program 45 .
- a computer readable medium that is readable by a computer includes a set of instructions that, when executed by the vehicle mobile data computer 41 , cause the computer to perform the operations of: receiving as audio input from the user through the microphone 63 , 97 , a voice command representing a vehicle mobile data computer application program command input; and identifying the voice command by analyzing the received audio input.
- the instructions also include those to perform the operations of: echoing the identified voice command through an audio speaker 65 , in response to identification of the received voice command and/or release of a push-to-talk control key; and transmitting the corresponding command input to the vehicle mobile data computer application program 43 .
- the echo preferably includes preselected audio data associated with the identified voice command including a representation of the identified voice command, preferably in the form of a prerecorded human voice audio message 77 , verbalizing a representation the identified voice command.
- the audio input is preferably enabled and the echo is preferably initiated either through manipulation of a control key, such as, for example, left control key 91 .
- a control key such as, for example, left control key 91 .
- Other alternatives within the scope of the present invention include enabling audio input for a plurality of the voice commands through use of a unique enabling voice command, such as, for example, “computer,” “vehicle computer,” or “Christine.”
- audio input is disabled either through use of the left control key 91 , a preselected or predetermine time delay without receiving a voice command, and/or a disabling voice command such as, for example, “computer off.”
- Various combinations of this embodiment include, for example, enabling the receiving of audio input and/or transmission of command input associated with identified voice commands in response to activation of a control selector, e.g., left control key 91 , followed by disabling such functionality in response to a preselected or predetermined time delay.
- the functionality can then be reactivated through use of the left control key 91 or through use of an enabling voice command, e.g., “Christine.”
- the echo can be initiated for an identified voice command either through release of the left control key 91 , or a preselected or predetermined time delay after identifying the voice command.
- a computer readable medium that is readable by a vehicle mobile data computer 41 includes a set of instructions that, when executed by the vehicle mobile data computer 41 , cause the vehicle mobile data computer 41 to perform the operations of: receiving an audio input from the user through a microphone 63 , 97 , that may or may not include a voice command representing a vehicle mobile data computer application program command input; and analyzing the received audio input to determine if the audio input includes a voice command from a user.
- the instructions also include those to perform the operation of rejecting the received audio input as including a voice command from the user after attempting to identify a valid assigned voice command for a preselected or predetermined time period/delay period.
- the instructions also include those to perform the operation of substantially immediately resuming awaiting receipt of a voice command in response to termination of the delay period.
- This functionality advantageously prevents the vehicle mobile data computer 41 from excessively “tying-up” system resources in order to attempt to identify either a false voice command embedded among a noise signal or to identify a valid voice command provided by the user but uttered in such a high noise environment that the voice command signal-to-noise ratio is extremely low, making identification of the voice command extremely difficult and unlikely.
- the voice command interface program product 45 is quickly reset to receive a valid voice command. If the audio input included a voice command having a low signal-to-noise ratio, this functionality allows the user to provide an immediate repeat of the valid voice command rather wait through a lengthy delay typically resulting in both an unsuccessful attempt at identifying the voice command and an unnecessary distraction to the user. By quickly resetting to receive either an initial voice command or a repeat of a previously attempted voice command, the user is provided with not only less distraction but increased voice command identification reliability.
Abstract
Description
- This application is a continuation-in-part of and claims the benefit of U.S. patent application Ser. No. 10/656,487, filed on Sep. 5, 2003, which is a continuation of and claims the benefit of U.S. patent application Ser. No. 09/968,633, filed on Oct. 1, 2001, now U.S. Pat. No. 6,621,422, both of which are incorporated herein by reference in their entirety.
- 1 Field of the Invention
- The present invention relates to the field of communications generally and, more particularly, to vehicle communication systems, program products, and associated methods.
- 2 Description of the Related Art
- Law enforcement officers and other civil servants have long needed a cost-effective system which delivers data quickly, helps e.g., police officers save time in the performance of their duties, and accomplishes these goals without interfering with other officer duties or endangering the officer. Early officer data systems included human dispatchers in radio frequency (“RF”) communication with officers in vehicles. In these early systems, data requested by the officer was typically searched for by hand and read back to the officer over the radio and, therefore, suffered from slow delivery of data, costs associated with employing dispatchers, and a very limited database of available data.
- These early systems were gradually replaced by police department computer systems, typically including a main computer in a police department headquarters or control center in communication with a police vehicle mobile data computer and at least one law enforcement database, such as the system shown in U.S. Pat. No. 6,188,939, by Morgan et al. titled “Advanced Law Enforcement and Response Technology.” Systems of this type use a handheld input device having a magnet stripe reader for filling in forms with data held on a magnet stripe located on cards such as driver's licenses, transmitting these forms to the vehicle mobile data computer, and printing out these forms on a printer positioned in the vehicle. The magnet stripe reader for reading driver's licenses poses an additional problem because the data obtained from the magnet stripe is often out of date, especially in states where licenses need not be renewed, and hence bar codes not being updated for many years. Further, the handheld unit required by such systems prevents the officer's hands from being free for other activities and can place the officer in dangerous situations such as when the officer's attention is devoted to the handheld unit instead of the officer's surroundings.
- Some systems such as the Premiere MDC system sold by Motorola Corporation of Straumberg, Illinois have a police department computer in communication with a police vehicle mobile data computer and a database of law enforcement data. These systems offer computer aided dispatching, computer generated reports to be filled out by the officer, and can transmit responses to officer requests for law enforcement data such as data associated with license plate numbers or driver's licenses. The vehicle mobile data computer software in the Premiere MDC system has a limited text-to-voice program for presenting data in audio rather than video format and is also capable of displaying maps using a global positioning system (“GPS”) unit to define the area to be displayed. The presentation of this data, however, is often poorly organized and poorly prioritized, thereby requiring the officer to spend a long time finding the desired data and distracting the officer from other work. The text-to-voice software from the Motorola system allows the officer to be somewhat more aware of the surroundings but still endangers the officer as critical data, such as whether a suspect is believed to be dangerous, may not come until the middle or end of the audio transmission.
- Such systems conventionally transfer each element of written data or text-to-voice, e.g., including zip codes, extraneous information. Much of this information, however, is not needed by the officer and can be information overload for an officer. Further, because text-to-voice is typically monotone or lacking intonation, the officer must concentrate more attention on the transmission and may misunderstand portions of the transmission. Systems such as the Motorola system pose a still further problem because the officer must frequently focus attention on the computer screen while filling in forms and checking responses to queries. This substantially increases the danger to the officer as the officer cannot be aware of the surroundings at the same time.
- Applicant recognized as beneficial in co-pending U.S. application Ser. No. 10/656,487 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods” and U.S. Pat. No. 6,621,422 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” an apparatus and software for communicating with law enforcement during vehicle travel which: prioritizes pre-recorded human voice responses to officer queries that delivers rapid, easily comprehended responses that allow the officer to maintain visual awareness of the surroundings at all times; transmits audio alarms to the officer to give the officer immediate warning of degrees of law violation associated with a suspect; and provides cost effective quick mapping of incident locations. Such apparatus and software previously have been beneficially implemented in many vehicles.
- Also with recent advances in computer technology, microphone technology, and speech recognition algorithms, there has been an emergence of speech recognition software capable of providing discrete word and phrase recognition. Speech recognition software generally receives a speech signal, determines which words constitute the speech signal, and apply the determined words to an application program either in the form of a command or in the form of text. Speech recognition systems generally compare an acoustic description of text stored in a vocabulary database against an acoustic signal generated by the utterance of the text to be recognized. The speech recognition system then determines if the words or text are commands vs. dictation, applying the words or text as commands if recognized as a command.
- There are numerous problems encountered in the attempt to perfect speech recognition. For example, problems can include difficulty in determining when an utterance has begun. This problem is significantly exacerbated in a high-background noise environment. Some systems use a statistically derived acoustic model of background noise to filter the incoming acoustic signal. These systems have met some success where the non-speech sounds consist mostly of background noise having a fairly constant frequency and amplitude not matching the spectral characteristics of the text stored in the vocabulary database.
- Nevertheless, non-speech sounds, including background noise, are frequently detected as speech. This condition is problematic because the speech recognition systems examine a very large database of words or text, attempting to match a detected sound to each word or text. As such, speech recognition systems are likely to be falsely triggered into interpreting non-speech sounds as speech. Even if the speech recognition system is able to differentiate between the non-speech sounds and desired speech, resources of the associated computer system can be heavily taxed during such determination, thus causing a significant delay to the user. This can cause the user to lose track of what speech was provided to the speech recognition system, distracting the user, and negating the benefit of using a speech recognition system.
- Various vehicles, e.g., law enforcement or other public service vehicles, present an extremely high-background noise environment from multiple sources, such as, for example, the road, the engine, the wind, the vehicle fan, and the vehicle radio and/or passengers. Due to the level of such noise, the typical voice recognition system would be overwhelmed, causing extended delays as high as 20 seconds or more attempting to match the speech to be recognized with the vocabulary database. During a critical event such as, for example, a high-speed chase, distraction caused by either having to change focus to the computer screen to verify correct data entry or determining if the system received a command provided in the officer's speech, can significantly increase the likelihood of a traffic accident. Nevertheless, attempts have been made to implement a vehicle voice recognition system. Such a system is known as “Project 54.”
- Project 54, however, requires its own specialized hardware, hardware interface, and software package, which must be shipped or otherwise physically delivered to the vehicle. A vehicle electrician must then install the hardware interface and additional hardware, such as, for example, a press-to-talk switch that must be both connected to a vehicle structure and electrically interfaced with one of the ports of the vehicle computer. The vehicles mobile client software application must then be replaced with that of Project 54. The operator of the vehicle must then be trained to use the Project 54 mobile client and must memorize the voice commands utilized by the Project 54 software package.
- The Applicant has recognized, however, that the various law-enforcement and other public service departments throughout the country have varying requirements, and prefer to utilize different mobile client software applications, generally having similar functionality, but controlled by different function keys. Such public service departments generally do not have the time or resources to perform vehicle modifications. Further, requiring the different departments to re-train their personnel in use of software having unfamiliar characteristics would require additional training expenditures, interrupt scheduling, and may cause operating difficulties, especially during initial implementation, which could result in an inability to receive critical information.
- Also recognized by the Applicant is that Project 54, similar to the various speech recognition applications described previously, is extremely susceptible to noise signals encountered when the push-to-talk switch is engaged to allow the microphone to receive an audio signal, such as during delivery of a voice command. In such situations, the vehicle computer system resources can be heavily taxed while attempting to recognize the voice command, causing a significant delay in either recognizing the voice command or failing to do so. This can result in a severe distraction to the user. Further, the user is not provided a system ready status, and thus, may lose track of which voice command is being processed. As stated, such distractions negate the benefit of using voice recognition systems. Recognized by the Applicant is that such a system is wholly inadequate system for suppressing the effects of noise. The user must divert attention to the push-to-talk switch, provide voice commands during a relatively low-noise situation, and quickly release the switch to prevent extraneous noise from being received. Also recognized by the Applicant is that this limitation prevents the software from being operated in an entirely hands-free mode.
- Thus, recognized by the Applicant is the need for a voice command interface program product or software compatible with a multitude of law-enforcement or other vehicle based mobile data systems that enables a user to utilize voice commands to operate the vehicle mobile data system, that requires little or no user training, and that has a very high accuracy under the most arduous conditions. Also recognized is that any voice command interface related system to be used for in-vehicle applications should be capable of not only enhancing the user's voice, but also eliminating background noise and minimizing the effect of other non-speech sounds.
- With the foregoing in mind, embodiments of the present invention advantageously provide an apparatus, program product, and associated methods to communicate with a vehicle during vehicle travel that can enhance the flow of data to and from a vehicle driver or other user, such as a police officer. Embodiments of the present invention also provide an apparatus, including a voice command interface program product, that reduces the need to type commands into a computer and/or press keyboard keys or buttons that are difficult to access, especially when the vehicle is on the move. Embodiments of the present invention also provide an apparatus, including a voice command interface program product, that delivers audio feedback indicating the selection of a command input to a mobile data communications application program in the form of the voice command, returning the interpretation of the voice command so the vehicle user can determine if the command or text was interpreted correctly.
- Advantageously, the voice command interface program product can provide voice command recognition and can deliver an echo of each spoken voice command, or a subset thereof, either in the form of text-to-speech or in the form of a pre-recorded human voice. Advantageously, this negates the need for the vehicle user to remove his/her hands from the steering wheel while driving or to shift focus from the outside environment in order to receive feedback. This functionality is particularly beneficial to law-enforcement. Unlike in other professions, a law-enforcement officer can be faced with situations, such as, for example, a high-speech chase or a vehicle stop, where even a momentary distraction causing the officer to focus visual attention on the computer can cause the officer to loose control of the situation, resulting in possible injury or death to either the officer or to a bystander.
- Embodiments of the present invention advantageously provide an apparatus, including a voice command interface program product, to communicate with a user during vehicle travel which can: receive voice commands to operate vehicle computer application programs including those that can transmit queries to a remote computer; echo the identified voice commands in either text-to-voice or pre-recorded human voice, as pre-selected by a user; and prioritize pre-recorded human voice responses to the transmitted queries, summarizing the responses, thereby delivering rapid, easily comprehended responses that allow the user to maintain visual awareness of the surroundings at all times.
- More particularly, embodiments of the present invention provide an apparatus to communicate with a user or users, e.g., law-enforcement, during remote vehicle operations that can enhance command communication, particularly in a high-noise environment. For example, in an embodiment of the present invention, an apparatus includes a vehicle mobile data computer system which includes a vehicle computer having memory to store data therein and adapted to be positioned within a user vehicle, such as, for example, a law enforcement or other civil service vehicle, to define a vehicle mobile data computer. The vehicle mobile data computer is in communication with a remote host computer, e.g., a department server, which is in communication with various external databases. When implemented with law enforcement, the remote host computer is in communication with law enforcement databases to supply law enforcement data to officers positioned in a law enforcement vehicle. The vehicle mobile data computer preferably uses radio frequency to transmit and to receive such data. The vehicle mobile data computer is also in communication with at least one but preferably a plurality of audio speakers and at least one audio input device. One or more vehicle mobile data computer application programs are stored in the memory of the mobile data computer. At least one of the vehicle mobile data computer application programs preferably is a mobile data communications application program adapted to communicate with the remote host computer through the vehicle mobile data computer, to thereby transmit and receive data through the remote host computer.
- A voice command interface program product, stored in the memory of the vehicle mobile data computer and in communication with the vehicle mobile data communications application program, is provided to enhance user communication with the remote host computer through the mobile data computer. The voice command interface program product includes instructions to perform the operations of: receiving as audio input through the at least one audio input device a voice command from the user representing a command input; identifying the voice command by analyzing the received audio input; echoing the identified voice command through the at least one audio speaker; and transmitting or otherwise conveying the command input to the mobile data communications application program. The echo preferably includes a preselected audio message verbally representing the identified voice command. The audio message preferably include data representing or repeating the identified voice command in prerecorded human voice.
- According to an embodiment of the present invention, an initializer is provided. The initializer is adapted to assign or provide assignment of a preferably very limited set of voice commands tailored to interface with various application programs for the vehicle mobile data computer system, e.g., a vehicle mobile data computer application program. Advantageously, when operated on a Windows® operating system, the initializer can be implemented by an initialization program or initialization text file, such as an “.ini” file, or data entered into the Windows® registry. Also, advantageously, the voice command interface program product is responsive only to limited sets of unique voice commands each of which function to emulate a correspondingly unique keyboard key press or series of keystrokes. The initialization file can provide a set of unique user-defined voice commands (e.g., “license plate” or “plate”) assigned to a correspondingly unique set of keyboard keystrokes or series of keystrokes (e.g., “Alt-c, F4, F5, F11”) to select an application program page, frame, text entry field, or other graphical user interface input. The initialization file can also assign the voice command interface program product to use a common spoken phonetic alphabet (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”), and Arabic numerals, e.g., “zero” to “nine” equating to a keystroke for corresponding numbers “0” to “9.”
- In the preferred embodiment of the present invention, only a specific set of user-defined or specified voice commands assigned or defined by an initializer, and/or those alphanumeric descriptions of individual keys associated with the vehicle mobile data computer keyboard, are compared for voice command recognition by the voice command interface program product. This is a significant feature that advantageously substantially improves voice command recognition accuracy and processing time, especially in a high-noise environment. Rather than comparing the received audio input to a large database of terms or phrases as is necessary with typical speech recognition programs, according to embodiment of the present invention, received audio input need only be compared to the specific commands necessary to operate each vehicle or public service department specific mobile data computer application or applications. Having such a limited vocabulary of voice commands and no dictation text to search advantageously reduces the probability that a noise signal will be interpreted as a voice command.
- The apparatus further preferably includes a communication enhancing program product stored in the memory of the vehicle mobile data computer and in communication with the vehicle mobile data communications application program to enhance communication with the remote host computer through the vehicle mobile data computer. The communications enhancing program product is positioned to transmit enhanced audio data, e.g., law-enforcement data received from the vehicle mobile data communications application program, to the user through the at least one audio speaker. The enhanced audio data preferably includes a plurality of preselected and prerecorded audio messages that are processed and played in response to the audio data received from the vehicle mobile data communications program product to thereby summarize and prioritize messages forming the requested audio data.
- Embodiments of the present invention also provide a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer. For example, according to an embodiment of the present invention, a method includes providing a voice command interface program product particularly adapted to interface with a vehicle mobile data computer running a vehicle mobile data computer application program requiring command input by providing vehicle mobile data computer input device emulation. The method also includes providing an initializer preferably in the form of a program or initialization file accessible by the voice command interface program product and configured to assign each of a plurality of preferably customer or user specific/specified voice command terms or phrases, defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding plurality of vehicle mobile data computer input device command inputs for the vehicle mobile data computer application program. The method also includes providing a plurality of phonetic alphabet data sets to provide command input of a plurality of letters corresponding to a plurality of vehicle mobile data computer input device inputs for the vehicle mobile data computer application program.
- The method also includes assigning to at least some of the assigned voice commands, and/or assigned letters and numbers, an audio message in the form of an echo to acknowledge the voice command received from the user. The echo is preferably in the form of a prerecorded human voice message. The method can further include editing by the user the initializer to: assign an additional voice command terms or phrases to a corresponding vehicle mobile data computer input device input, in response to a modification of the vehicle mobile data computer application program; or edit a pre-assigned voice command assignment to change a name of a voice command, change the command input (keystrokes), or change the audio data associated with the voice command, in order to suit user preferences.
- According to an embodiment of the present invention, another method can include accessing through an area network a user accessible web site or file server to “download” or otherwise receive a voice command interface program product that is adapted to provide vehicle mobile data computer input device emulation for a vehicle mobile data computer application program installed on a vehicle mobile data computer. The voice command interface program product advantageously can be provided and received by a user, preferably directly through the vehicle mobile data computer, in the form of a single self-extracting executable program including the voice command interface program product, negating the requirement for delivery of other more physically embodied computer readable media, e.g., a CD, in order to install the voice command interface program product. The self-extracting executable program preferably also can include an initializer which is adapted to assign a plurality of preferably user-specified voice commands to a correspondingly unique set of keyboard key command inputs, i.e. keystrokes or series of keystrokes. Advantageously, the initializer can be pre-tailored for a specific users needs prior to downloading or can be tailored by the user thereafter. The method further includes executing the self-extracting executable program, to thereby install each of a plurality of components of the voice command interface program product and the initializer in memory of the vehicle mobile data computer.
- Preferably upon startup/initialization of a voice command interface program product, each of a plurality of user-tailored voice commands, to be received as audio input from an audio input device and a phonetic alphabet, are assigned to a corresponding keyboard key command input to interface the voice commands with a vehicle mobile data computer application program, provide command input to the vehicle mobile data computer application program. The numbers “zero” to “nine” equating to a keystroke for corresponding numerals “0” to “9” can also be assigned accordingly if not already done so in an operating system speech application program interface (SAPI). The initialization can also include assigning to at least some of the assigned voice commands, and/or assigned letters and numbers, an audio data message in the form of an echo, and preferably in the form of a prerecorded human voice message, to acknowledge the voice command received from the user.
- Another method of enhancing command communication in a high-noise environment user and a user vehicle mobile data computer includes receiving voice commands and/or noise as audio input from the user through an audio input device, and identifying the voice commands by analyzing the received audio input. This is typically accomplished by performing an acoustic description comparison, or other analysis known to those skilled in the art, on or for the received audio input. The analysis is preferably only performed for a maximum of a predetermined or preselected time delay or timeout. Advantageously, this functionality allows quick recognition of the voice command not accompanied by excessive noise, and provides an ability to suppress a noise signal that would otherwise cause excessive use of processor resources and excessively delay a user's ability to convey a voice command, potentially distracting the user. This functionality also provides a time limitation for when a very low voice signal-to-noise ratio is encountered to allow the voice command to be repeated, if necessary, substantially without delay, rather than causing the user to be distracted while waiting for the processor to try and likely fail to identify the voice command from amongst the noise signal.
- In an embodiment of the present invention, if a voice command is identified, and if an echo function is enabled and audio data is assigned to the respective voice command, the voice command (or representation thereof) is echoed through the vehicle or computer audio speakers and the command input (e.g., keyboard emulation) corresponding to the identified voice command is sent to the vehicle mobile data computer application program. The echo preferably includes a preselected audio message, preferably prerecorded in human voice, verbally repeating a representation of the voice command. When commanded to do so, the vehicle mobile data application program can either access vehicle memory or access a remote computer to receive request data. In another embodiment of the present invention, the functionality of either receiving audio input or transmitting further identified voice commands to the vehicle mobile data computer application program is automatically disabled if after a preselected time delay no voice commands are identified.
- Embodiments of the present invention also include a computer readable medium that is readable by a computer to enhance command communication in a high-noise environment between user and a vehicle mobile data computer application program. For example, in an embodiment of the present invention, the computer readable medium includes a set of instructions that, when executed by a computer, such as, for example, vehicle mobile data computer cause the computer to perform the operations of: extracting data from an initializer configured to assign a plurality of user-specific or user-specified voice command terms or phrases, defining a plurality of vehicle mobile data computer application program voice commands to a corresponding vehicle mobile data computer input device command input (e.g., keyboard keystroke or keystrokes) for the vehicle mobile data computer application program; and assigning the plurality of vehicle mobile data computer application program voice commands, responsive to the extracted data, to corresponding vehicle mobile data keyboard key command inputs to interface the voice commands with the vehicle mobile data computer application program.
- The instructions also include those to perform the operation of receiving audio input through an audio input device when in a high noise environment; and performing an acoustic description comparison on the received audio input, to thereby identify a set of preferably only the following voice commands: voice command terms assigned in the initializer, members of a phonetic alphabet associated to the initializer to provide command input of a plurality of letters each corresponding to separate keyboard key input, and a plurality of numbers each corresponding to a separate numerical keyboard key input, to identify each respective voice command, to thereby execute an associated vehicle mobile data computer application program command input.
- Particularly with respect to law-enforcement, voice command recognition speed and accuracy is essential in order to prevent unwarranted distraction of an officer. Accordingly, by providing a very limited set of voice commands which are easy to assign and remember, the officer, even in a very high-stress situation, can easily convey, and the voice command interface program product can quickly recognize, all voice commands necessary to operate the mobile data communications application program or other application programs. Further, selection of the very limited set of necessary voice commands reduces the amount of system resources and time required to analyze the audio input.
- According to another embodiment of the present invention, a computer readable medium includes instructions that, when executed by the vehicle mobile data computer, cause the computer to perform the operations of: receiving as audio input from the user through an audio input device, e.g., a stationary or wireless microphone, a voice command representing a vehicle mobile data computer application program command input; and identifying the voice command by analyzing the received audio input. The instructions also include those to perform the operations of: echoing the identified voice command through an audio speaker in response to identification of the received voice command and/or release of a push-to-talk control key; and transmitting the corresponding command input to the vehicle mobile data computer application program. The echo preferably includes preselected audio data associated with the identified voice command including a representation of the identified voice command, preferably in the form of prerecorded human voice audio message, verbalizing the representation of the identified voice command.
- According to another embodiment of the present invention, a computer readable medium includes instructions that, when executed by a computer, e.g., the vehicle mobile data computer, cause the computer to perform the operations of: receiving through an audio input device audio input including a plurality of voice commands from the user; transmitting to the vehicle mobile data computer application program the plurality of voice commands from the user received as audio input; and disabling, responsive to a preselected time delay, transmitting the plurality of voice commands to the vehicle mobile data communications application program or receiving audio input from the audio input device.
- According to another embodiment of the present invention, a computer readable medium includes instructions that, when executed by a computer, e.g., vehicle mobile data computer, cause the computer to perform the operations of: receiving an audio input from the user through an audio input device, e.g., a stationary or wireless microphone, that may or may not include a voice command representing a vehicle mobile data computer application program command input; and analyzing the received audio input to determine if the audio input includes a valid voice command from a user. The instructions also include those to perform the operation of rejecting the received audio input as including a voice command from the user after attempting to identify for a preselected or predetermined time period/delay period a valid assigned voice command. The instructions also include those to perform the operation of substantially immediately resuming awaiting receipt of a voice command in response to termination of the delay period. Advantageously, this functionality prevents the vehicle mobile data computer from excessively wasting system resources in order to attempt to identify either a noise signal as a voice command embedded among the noise signal or a voice command provided by the user but in such high noise environment that the voice command signal to noise ratio is extremely low, making identification of the voice command extremely difficult and unlikely. Advantageously, by quickly resetting to receive either an initial voice command or a repeat of a previously attempted voice command, the user is provided with less distraction and increased voice command identification reliability.
- Advantageously, according to various embodiments of the present invention, the voice command interface program product functions entirely in the “background,” without the need for direct user control. Also advantageously, the voice command interface program product integrates with various Microsoft® SAPI engines and is compatible with various Windows® operating
systems including Windows 95,Windows 98, Windows ME, Windows 2000, Windows NT, and Windows XP. Advantageously, the program product installer can be written using a common installation program, such as, for example, the Wise Installation System, InstallShield, available through Wise Solutions, Inc., Plymouth, Mich. Preferably the program product installer can also install both the voice command interface program product and selected Microsoft® SAPI engine, along with a user editable initializer. - Also advantageously, both the voice command interface program product and initializer are “plug-and-play” capable, and thus, are immediately ready to function. After initial installation of the voice command interface program product, the user need not access any graphical user interface to utilize the functionality of the voice command interface program product. Microphone training can be accessed through either a voice command or a keystroke combination, but this need not be a prerequisite to immediate use. When used with a Windows® operating system, a system tray icon can be displayed to provide a ready visual reference of the operational status of the voice command interface program product, to thereby reduce any potential user confusion. Further, advantageously, a control selector, e.g., left control key or external input device switch, assignable by an initializer, e.g., a “.ini” file, can be provided to control whether the computer accepts audio (voice) input. Also advantageously, audio data, e.g., a short “.wav” file or files, can be assigned in the initializer to indicate manipulation of the control selector.
- Still further, advantageously, the user may select various user-tailored configurations. For example, an “echo” can be selected or deselected for a specific command term or terms, and/or for letters or numbers. Also for example, the user can: add, modify, or delete voice command terms and their assigned keystroke combination; switch between phonetic alphabets; select or deselected key activation audio feedback; and assign or modify selection of a keyboard key to function as a push-to-talk key.
- So that the manner in which the features and advantages of the invention, as well as others which will become apparent, may be understood in more detail, a more particular description of the invention briefly summarized above may be had by reference to the embodiments thereof which are illustrated in the appended drawings, which form a part of this specification. It is to be noted, however, that the drawings illustrate only various embodiments of the invention and are therefore not to be considered limiting of the invention's scope as it may include other effective embodiments as well.
-
FIG. 1 is an environmental perspective view of a vehicle having an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention; -
FIG. 2 is a schematic block diagram of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention; -
FIG. 3A is a schematic block diagram of a vehicle computer system of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention; -
FIG. 3B is a schematic block diagram of a microphone to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention; -
FIG. 4 is a schematic block diagram of memory of a vehicle computer of an apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system according to an embodiment of the present invention; -
FIG. 5A is a table illustrating a portion of an initializer for initializing a voice command interface program product according to an embodiment of the present invention; -
FIG. 5B is a table illustrating two phonetic alphabet examples assignable by the initializer ofFIG. 5A according to an embodiment of the present invention; -
FIG. 6 is a front plan view of a form portion selection GUI according to an embodiment of the present invention; -
FIG. 7 is a schematic flow diagram showing transmission of audio data representing an echo of an identified voice command according to an embodiment of the present invention; -
FIG. 8 is an environmental perspective view of a user in communication with the vehicle mobile data computer system illustrated inFIG. 1 according to an embodiment of the present invention; -
FIG. 9 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention; -
FIG. 10 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention; -
FIG. 11 is schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention; and -
FIG. 12 is a schematic flow diagram of a method of enhancing command communication in a high-noise environment between a user and a mobile data computer system according to an embodiment of the present invention. - The present invention now will be described more fully hereinafter with reference to the accompanying drawings, which illustrate embodiments of the invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the illustrated embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Particularly, various embodiments of the present invention have been found to be effectively implemented with civil service organizations such as, for example, law enforcement, and thus readily provide for enhanced illustrations and descriptions. Such embodiments, unless specifically stated as such, are not limited to such organizations. Like numbers refer to like elements throughout. Prime notation, if used, indicates similar elements in alternative embodiments.
- As shown in
FIGS. 1-12 , embodiments of the present invention provide an apparatus for communicating with a user or users, e.g., law-enforcement, during remote vehicle operations that can enhance command communication particularly in a high-noise environment. According to embodiments of the present invention, theapparatus 30 can provide for both enhanced transmission of data and superior organization, prioritization, and delivery of requested data. Advantageously, theapparatus 30 is preferably designed to be used in conjunction with existing mobile data communications systems such as, for example, the Premier MDC system manufactured by the Motorola Corporation of Schaumberg, Ill. - As perhaps best shown in
FIGS. 1-4 , generally, according to various embodiments of the present invention, the apparatus 30 (seeFIG. 2 ) can include a centrally locateddepartment server 35 having access to one ormore databases 38 to supply a vehicle user with data requested by the vehicle user; a vehicle mobile data computer system 40 (seeFIGS. 1 and 3 A) positioned in a vehicle V and having a mobile data computer application program 43 (FIG. 4 ) to provide wireless communication with thedepartment server 35; a voice commandinterface program product 45 to provide voice recognition of voice (verbal) commands to thereby provide enhanced voice command control of the mobiledata application program 43, particularly in a high-noise environment; and optionally a communication enhancingprogram product 47 to transmit enhanced audio data received from the mobiledata application program 43 to the vehicle user through an audio speaker 65 (seeFIGS. 1 and 3 A). - More specifically, according to an embodiment of the present invention, the
apparatus 30 can include a remote host computer e.g., a department adepartment server 35 in communication with one or more remote vehiclemobile data computers 41 each positioned in a vehicle V. Thedepartment server 35 preferably uses radio frequency to transmit and receive data to the vehiclemobile data computer 41. Thedepartment server 35 is also preferably in communication with at least one and preferably a plurality of remote computers, and possibly a local computer having data definingdepartment databases 38, through acommunications network 50 such as the Internet or a local area network. Thedepartment databases 38, for example, can include local, regional, or national law enforcement data such as the Department of Highway Safety and Motor Vehicles (DHSMV) database and the National Crime Data Center (NCIC) database, just to name a few. These databases can provide time critical information such as, for example, vehicle and individual background for law enforcement officers when positioned in vehicles as well as for law enforcement personnel in a headquarters or control center. - As perhaps best shown in
FIG. 3A , the vehicle mobiledata computer system 40 includes vehiclemobile data computer 41 preferably having aprocessor 51 to process communications and other type of data, adisplay 53 in communication with theprocessor 51 to display data to a user,memory 55, e.g., RAM and ROM, also in communication with theprocessor 51 for storing software and data therein, apower outlet 57 positioned to supply power to theprocessor 51 as well as other components of the vehiclemobile data computer 41, akeyboard 59 in communication with theprocessor 51 to supply a user interface to the user. The vehicle mobiledata computer system 40 also preferably includes anRF transceiver 61 in communication with theprocessor 51 to transmit and receive data, and audio input device such as, for example, a microphone 63 (described in detail later) to provide voice command input to the vehiclemobile data computer 41, and at least one but preferably a plurality ofspeakers 65 for providing voice command acknowledgments and for delivering department data in audio form. Thespeakers 65 are preferably external speakers but can be speakers built into the computer or a preexisting speaker associated with a non-computer dispatching system as understood by those skilled in the art. As shown inFIGS. 1 and 3 A, the vehicle mobiledata computer system 40 also preferably includes one ormore printers 67 or other computer peripherals in communication with theprocessor 51. When used in a law enforcement vehicle, for example, theseprinters 67 can be used for printing accident reports, tickets, warnings, towing citations, or filling in or populating other law enforcement forms. - As perhaps best shown in
FIG. 4 , the vehiclemobile data computer 41 preferably includes operating system and computer application programs known to those skilled in the art, such as, for example, a mobile datacommunications application program 43, stored inmemory 55 and provided to facilitate user communication with thedepartment server 35 through the vehiclemobile data computer 41 and to transmit and receive department data from the one ormore databases 38 through the department server 35 (seeFIG. 2 ). The vehiclemobile data computer 41 can also include a communication enhancingprogram product 47 stored inmemory 55 of the vehiclemobile data computer 41 and in communication with the mobile datacomputer application program 43 to enhance user communication with thedepartment server 38 through the vehiclemobile data computer 41. - The communications enhancing
program product 47 includes instructions to perform the operation of transmitting enhanced department audio data received from the mobile datacomputer application program 43 to the user through theaudio speakers 65. Such enhanced department data includes preselected and prerecorded audio messages provided in response to the department data received by the mobile datacomputer application program 43 from thedepartment server 35. One such apparatus or system providing such communications enhancingprogram product 47 is perhaps best described in co-pending U.S. patent application Ser. No. 10/656,487 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” and U.S. Pat. No. 6,621,422 by Rubenstein titled “Apparatus for Communicating with Law Enforcement During Vehicle Travel and Associated Methods,” each incorporated herein by reference in their entirety. - The vehicle
mobile data computer 41 includes a voice commandinterface program product 45 stored in thememory 55 of the vehiclemobile data computer 41 and in communication with the mobile datacomputer application program 43 to enhance officer communication with thedepartment server 38 through the vehiclemobile data computer 41. The voice commandinterface program product 45 can be in the form of microcode, programs, routines, and symbolic languages that provide a specific set for sets of ordered operations that control the functioning of the hardware and direct its operation, as known and understood by those skilled in the art. - The voice command
interface program product 45 includes instructions to perform the operation of receiving as audio input a verbal command from the user representing a corresponding command input from the user through themicrophone 63, and identifying the verbal command by analyzing the received audio input. According to a preferred methodology, an acoustic description of text corresponding to a specific set of voice commands stored in a vocabulary database (not shown) is compared against an acoustic signal generated by the utterance of the voice command to be recognized. The audio input received by themicrophone 63 includes not only verbal or voice commands representing a corresponding command input defined as one or a series of keyboard key inputs, but also noise including continuous and repetitive noise and noise caused by reverberation of the voice commands from adjacent vehicle V structures. - The voice command
interface program product 45 advantageously can distinguish between voice commands spoken by the user and noise. Proper selection of themicrophone 63 can, however, significantly aid in performing such differentiation. There are numerous types of microphone transducers used for a variety of applications. The most common distinctions between various microphones are: type of microphone, e.g., dynamic, boundary, condenser, ribbon, array, and directional pattern, e.g., unidirectional and omni-directional. For example, in an embodiment of the present invention, themicrophone 63 can be an Andrea DA-350 quad array microphone manufactured by Andrea Electronics Corp., Melville N.Y. - Although embodiments of the present invention are not limited to the DA-350 array microphone, advantageously, the DA-350 microphone, for example, is specifically designed for use in a vehicle. This array microphone provides not only directional focusing on and enhancing of the user's voice, but also overcomes high-noise environment factors associated with a moving vehicle. The DA-350 array microphone utilizes multiple microphones (transducers), unique software algorithms, and a digital signal processor to adaptively focus microphone sensitivity on the driver's voice, to thereby enhance voice reception and reduce extraneous noise. The DA-350 microphone, for example, can analyze audio signals coming from each individual microphone transducers in order to create a narrow reception cone having an angle of reception of approximately 25 degrees either side of centerline (preselected azimuth) and forming an area of reception. This reception cone is characterized by having a voice frequency response of between approximately −30 dBV and −45 dBV between a frequency range of 1 kHz to 3 kHz within the area of reception, and having an extremely steep drop in noise frequency response outside the area of reception to that of approximately −65 dBV to −85 dBV in that same frequency range.
- The DA-350 microphone can differentiate between audio signals coming from its preselected azimuth, effectively rejecting noises or voices coming from other directions including those emanating from the audio speakers, other passengers, or due to reverberations. Further, the DA-350 microphone provides an ability to adjust focus to the movement of the speaker during dictation. The DA-350 microphone includes a digital signal processor which separates voice frequency from the noise, inverts the noise, and subtracts the noise from the voice signal, providing a reduction in noise sources of typically between 25 dB to 30 dB. Note, other microphones, such as, for example, the Andrea Superbeam® Array Microphone, also manufactured by Andrea Electronics Corp., provides a substitute having features similar to that described above.
- Accordingly, in an embodiment of the present invention, the
microphone 63 can be configured as an array microphone adapted to be connected to a vehicle V structure, e.g., dashboard or visor, positioned separate and spaced apart from the user to allow hands-free operation when receiving voice commands from the user (seeFIG. 1 ). Themicrophone 63 include at least two, but preferably fourunidirectional microphone transducers 71 with individual audio channels adapted to provide a directional area of audio input sensitivity having an adjustable angle and area of reception. This type of array microphone enhances detection of the verbal commands by allowing the user to manually focus the microphone reception zone on the user, significantly eliminating background noise from the various sources such as, road, engine, wind, fan, and radio. Further, according to this embodiment of the present invention, themicrophone 63 does not require individual user training. Thus, advantageously, a different user can enter the vehicle V and be immediately ready to utilize the voice commandinterface program product 45. Nevertheless, the voice commandinterface program product 45 can include microphone training functionality preferably selectable through either a voice command or keystroke combination, e.g., ctrl-alt-m. - To further enhance distinguishing the verbal commands uttered by the user from other noise, provided can be an audio input processing (noise-canceling )
program product 73 adapted to interface with themicrophone 63. The audio inputprocessing program product 73 includes instructions particularly adapted to enhance reception of the plurality of verbal commands to perform the operation of automatically adjusting or shaping the angle and area of reception of the audio input to themicrophone 63, responsive to detection of audio input from the user, to focus the array on the user's voice, substantially reducing reverberation and other non-repetitive extraneous noise; and by attenuating continuous and repetitive noise, substantially removing or reducing voice command recognition latency. The audio inputprocessing program product 73 can be installed in the memory of adigital signal processor 64 associated with themicrophone 63 or in memory, e.g.,memory 55, of the vehiclemobile data computer 41. The combination of aunidirectional array microphone 63 and audio inputprocessing program product 73 can enable near optimal performance by overcoming the high-noise environment of a moving vehicle V, advantageously providing the voice command interface program product 45 a substantially clear voice command signal. - Advantageously, the combination can provide a significant differential in voice frequency response within the area of reception and background noise response outside the area of reception of, for example, approximately between 20 dBV and 35 dBV between the frequency range of 1 kHz to 3 kHz, and, for example, at least 25 dBV at the frequency of 1 kHz. Further, as a result the combination, the differential in voice frequency response within the area of reception and background noise response outside the area of reception is preferably at least 30 dBV at the frequency of 1 kHz, and more preferably at least 35 dBV at the frequency of 1 kHz.
- According to an embodiment of the present invention, an
initializer 75 is provided that can assign or provide assignment of a preferably very limited set of voice commands tailored to interface with various application programs for the vehicle mobiledata computer system 40, e.g., mobile datacomputer application program 43. As perhaps best shown inFIGS. 5A, 5B , and 6, theinitializer 75 can provide a set of unique voice commands (labels) 79, e.g., “license plate” or “plate,” assigned to a correspondingly unique set of keyboard keystrokes or series ofkeystrokes 81, e.g., “Alt-c, F4, F5, F11,” to select an application program page orframe 83,data entry field 85, or other graphical user interface input, and can assign the voice commandinterface program product 45 to use at least one of preferably the two most common spoken phonetic alphabets 87 (FIG. 5B ), e.g., “alpha” to “zulu” or “adam” to “zebra,” equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”). - According to various embodiments of the present invention, the voice command
interface program product 45 is particularly adapted to be operated on a Windows® operating system configured with a speech application program interface (SAPI) engine. When so configured, theinitializer 75 can be implemented by an initialization file, such as a “.ini” file, or data entered into the Windows® registry, or by various other means known to those skilled in the art. Theinitializer 75 is preferably fully editable by the user to provide the user an ability to tailor the various voice commands 79 to those typically familiar to the user and to add voice commands 79 to coincide with modifications or updates to the mobile datacomputer application program 43 or any other applications to be interfaced with the voice commandinterface program product 45. Further, through editing of theinitializer 75, the user can change the selection between the at least twophonetic alphabets 87, as desired. - Advantageously, only a specific set of user-defined or specified voice commands assigned or defined by an
initializer 75, and/or alphanumeric descriptions of individual keys associated with thekeyboard 59, are compared for voice command recognition by the voice commandinterface program product 45. This is a significant feature that advantageously substantially improves voice command recognition accuracy and processing time, especially in a high-noise environment. Rather than comparing the received audio input to a large database of terms or phrases as is necessary with typical voice recognition programs, according to embodiment of the present invention, received audio input need only be compared to the specific commands necessary to operate the mobile datacomputer application program 43. Having such a limited vocabulary of voice commands and no dictation text to search advantageously reduces the probability that a noise signal will be interpreted as a voice command. - For example, as perhaps best shown in
FIG. 5A, 5B , and 6, the voice commandinterface program product 45 can be implemented to only recognize voice commands listed as unique voice command (labels 79), e.g., “plate,” assigned to the correspondingly unique keyboard keystroke or series of keystrokes 81 (e.g., “Alt-c, F4, F5, F11”) to select an application program page orframe 83 to enter a license “plate”number 86; one of two spokenphonetic alphabets 87 as pre-selected in the initializer 75 (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”) to select alphabetical letters of the license “plate”number 86; and the spoken numbers “zero” to “nine” equating to a keystroke for the corresponding Arabic numerals (e.g., numerals “0” to “9”) to select numerals of the license “plate”number 86. Note, alternative languages or numbering schemes are within the scope of the present invention. - After the voice command is identified by the voice command
interface program product 45, the voice commandinterface program product 45 can provide an “echo” of the identified voice command through theaudio speaker 65, and preferably upon the user acknowledging that the voice command was correctly interpreted by the voice commandinterface program product 45, in response to hearing the echo, transmitting the command input to the mobile datacomputer application program 43. The echo, preferably in the form of audio data, such as, for example, an audio file or combination of files 89 (e.g., .wav file) assigned to a voice command by theinitializer 75 is outputted or otherwise transmitted or “played” on theaudio speaker 65. The echo can include a preselected and prerecorded audio message verbally repeating the identified verbal command to include individual letters from thephonetic alphabets 87 and numbers, described previously. Particularly, at least portions of the audio data associated with the identified verbal command or command string can include an audio message representation of the identified command in prerecorded human (clear) voice. - According to embodiments of the present invention, the voice command
interface program product 45 can include a plurality of preselected and prerecorded humanvoice audio messages 77 preferably stored inmemory 55 and assigned during initialization to various preselected voice commands. According to another embodiment of the present invention, the echo for the various voice commands can be enabled or disabled either as a group or individually for selected individual voice commands, either within theinitializer 75 or through use of a control selector key onkeyboard 59. Further, audio data (e.g., the human voice audio message 77) assigned to individual voice commands can be modified or deleted and/or new or additional audio messages can be added to a particular voice command (label 79). This can be accomplished preferably through a user editing theinitializer 75. - As shown in
FIG. 7 , the voice commandinterface program product 45 preferably formulates the echo message to be transmitted by matching (block 101) the identified voice command (label 79) with the corresponding preselected and pre-recorded audio message 77 (seeFIG. 5A ), rapidly returning or transmitting (block 103) an echo message to the user through the speakers 65 (seeFIG. 1 ) to provide the user positive feedback. Although providing a text-to-voice echo message for the entire voice command is within the scope of various embodiments of the present invention, the humanvoice audio messages 77 for at least the main portion of the voice command are preferred because humanvoice audio messages 77 can be much more intelligible and can be preselected to be male, female, soothing, urgent sounding or have other desired qualities in addition to selected languages, accents, intonations or other voice language benefits instead of what is often robotic, stiff or stilted sounding from conventional text-to-voice messages. - As described previously, noise can affect the ability of the voice command
interface program product 45 to identify the predetermined or preselected voice commands. More particularly, some noise signals can have similar qualities as that of one or more voice commands. The result of such noise signals can be inefficient use ofprocessor 51 resources in an attempt to identify the noise signals as a voice command. This can result in a significant distraction to a vehicle user because the user must generally either determine that theprocessor 51 is not busy prior to providing a voice command or provide such voice command, anticipating that the voice command will be properly received. Thus, according to the preferred embodiment of the present invention, an icon 93 (FIG. 6 ) is provided on the graphical user interface of thevideo display 53 to show the status of theprocessor 51 with respect to receptiveness of receiving a voice command. For example, theicon 93 can display various colors indicating system status, e.g., green to indicate ready to receive voice commands, yellow to indicate busy, and red to indicate an error has occurred, or can display any other combination of colors or symbols thereof. - Where the voice command requires a call, such as, for example, “plate,” to go to a license
plate entry page 83, followed by a set of letters and numbers identifying thelicense plate number 86, e.g., “ABC 12D,” to be entered in atext field 85, the user may be confused as to which part of the voice command needs to be provided. Thus, according to another methodology of enhancing command communication, especially in a high-noise environment, the voice commandinterface program product 45 can include instructions that are responsive to a preselected or predetermined time delay or time-out, e.g., less than approximately three seconds, to perform the operation of rejecting the received audio input as being a voice command from the user; and resetting to receive another voice command from the user. Advantageously, this functionality reduces the effect of noise by preventing inefficient use of theprocessor 51 resources in an attempt to identify the noise as a voice command, and enhances functionality of the voice commandinterface program product 45 by reducing confusion and distraction of the user, thus increasing reliability. If the audio input is merely noise, excessive use of resources of theprocessor 51 should be negated. If the audio input was a mix of noise and a voice command, if no echo is received after expiration of the preselected or predetermined time delay, intuitively the user will know that the voice command was not received or otherwise not identified, so that the user may repeat the voice command with little delay. - According to embodiments of the present invention, the voice command
interface program product 45 includes instructions that respond to user manipulation of a preselected control function selector, e.g., a keyboard key or an external input device (not shown), to perform the operation of enabling receiving audio input from themicrophone 63 to transmit or otherwise provide to the mobile datacomputer application program 43 the command inputs received and identified as voice commands (audio input) by the voice commandinterface program product 45. For example, theleftmost control key 91 of thekeyboard 59 can be assigned to perform the function of a push-to-talk control selector. The user depresses thecontrol key 91, enabling themicrophone 63, and provides a voice command, which is received by themicrophone 63. Upon either initial release of thecontrol key 91 or again pressing and releasing thecontrol key 91, themicrophone 63 is disabled, disabling further audio input from themicrophone 63. Note, according to the preferred embodiment of the present invention, the selection of which control selector provides the push-to-talk function and the functionality of the control, performed by the selected control selector, are both fully editable by the user through editing theinitializer 75. - According to an alternative embodiment of the present invention, similar to that described above, a control selector, such as the
leftmost control key 91 of thekeyboard 59, can be assigned to perform the function of a push-to-talk control selector, whereby the user depresses thecontrol key 91 to enable themicrophone 63. Rather than disabling audio input from themicrophone 63 by releasing or again pressing and releasing thecontrol key 91, this function can be performed automatically in response to a preselected or a predetermined time delay or a time-out. - In response to identification of the voice command, the voice command
interface program product 45 provides an echo of the voice command through theaudio speakers 65. The control input associated with the voice command can then be conveyed to the mobile datacomputer application program 43, preferably after: receiving a confirmation voice command from the user, such as, for example, “send”; receiving a correction command, such as, for example, “clear” or “backspace”; or standing by and awaiting additional user input. For example, a user gives the voice command “license plate” or “plate.” After the voice commandinterface program product 45 provides an echo of the voice command back to the user and sends the corresponding command input to the mobile datacomputer application program 43, the mobile datacomputer application program 43 will be awaiting entry of alicense plate number 86, e.g., “ABC 12D.” - After the user verbally provides the
license plate number 86, e.g., “ABC 12D,” which can also be echoed, the mobile datacomputer application program 43 will be awaiting the command input corresponding to the “send” voice command. Advantageously, according to an embodiment of the present invention, a series of command inputs can be concatenated by concatenating corresponding voice-commands. For example, the user can state the combined voice commands of “plate”-“ABC 12D”-“send.” The voice commandinterface program product 45 can then provide an echo of either parts of the combined voice command or the whole combined voice command e.g., “plate”-“ABC 12D”-“send.” The vehiclemobile data computer 41, upon receiving the requested license plate number, through the communication enhancingprogram product 47, can announce receipt of the requested information and await authorization to output such information through the speakers 65 (FIG. 1 ), automatically output such information upon receipt, or perform a combination thereof. - In order to aid the user in determining that the preselected control selector (e.g., left control key 91) was properly depressed, an indication preferably in the form of audio data, such as, for example, an audio file (e.g., .wav file) can be assigned to the control selector to be outputted or otherwise transmitted or “played” on the
audio speaker 65 upon activation of the respective control selector. Correspondingly, a preferably moderately distinct set of audio data, also preferably in the form of an audio file, can be assigned to the control selector to indicate release or deactivation of section selector. Advantageously, providing such audible indications helps reduce the potential for a vehicle accident by negating any need for the user to look at the control selector to determine if it was properly manipulated. Note, according to an embodiment of the present invention, the functionality of providing an audible indication of activation of the preselected control selector (e.g., left control key 91) can be, itself, controlled either by a separate control selector or a sequence of manipulations of the preselected control selector. This functionality can be assigned within theinitializer 75 and edited by the user. - As an alternative to having to manipulate a control selector (e.g., control key 91) for each instance the user wishes to convey a voice command, the voice command
interface program product 45 can include instructions to perform the operation of monitoring the audio input for a specific command assigned to perform the function of enabling receiving of other voice commands. For example, the word “Christine” or other selected unique name for the “computer” can be assigned by theinitializer 75 to perform the push-to-talk function. Thus, in order to “turn on” the functionality of the voice commandinterface program product 45, the user states “Christine” which can be identified and echoed through thearea speaker 65. The user can then convey the other of the plurality of voice commands, e.g., “plate,” “cancel,” “clear,” “send.” In this configuration, prior to stating the voice command “Christine,” all other commands would be otherwise ignored even if received. Advantageously, this functionality allows entirely hands-free manipulation of the mobile datacomputer application program 43 while preventing inadvertent reception or misinterpretation of noise or voice commands embedded in conversational speech not directed to the mobile datacomputer application program 43, such as speech with a passenger or radio dispatcher. - Correspondingly, the phrase “Christine standby” or other unique word or phrase can be assigned command disable the functionality of the voice command
interface program product 45, preferably with the exception of receipt and processing of the preselected “on” voice command, e.g., preferably another “Christine.” Alternatively, the voice commandinterface program product 45 can include instructions, responsive to a preselected time delay, such as, for example, 10 seconds of not receiving a voice command, to perform the operation of disabling the functionality of the voice commandinterface program product 45. Again this disabling function is preferably implemented with the exception of allowing receipt and processing of the preselected “on” voice command, e.g., “Christine.” - As perhaps best shown in
FIG. 8 , theapparatus 30 can also include awireless microphone assembly 95 including amicrophone 97 andaudio speaker 98 adapted to provide wireless audio communication between the vehiclemobile data computer 41 and the user when outside the department vehicle V to transmit the voice commands from the user to the mobile data computer application program 43 (seeFIG. 4 ) through the voice commandinterface program product 45, to thereby provide command input to the mobile datacomputer application program 43. Also provided is the ability to receive an audio echo for each of the voice commands, to thereby provide the user verification of correct identification of each respective voice command by the voice commandinterface program product 45. In the preferred configuration, thewireless microphone assembly 95 transmits data to, and receives data from, thevehicle transceiver 61. Further, the voice commandinterface program product 45 is preferably selected to be either continuously on, in which case,mute switch 99 can control audio input to themicrophone 97, or can be voice activated using a preselected “on” voice command. - As shown in
FIGS. 1-12 , embodiments of the present invention provide a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer. For example, as perhaps best shown inFIG. 9 , according to an embodiment of the present invention, a method includes providing a voice command interface program product 45 (block 121) particularly adapted to interface with a vehicle mobile data computer 41 (seeFIGS. 1 and 3 A) running a vehicle mobile data computer application program 43 (seeFIG. 4 ) requiring command input by providing vehicle mobile data computer input device emulation. - The method also includes providing an initializer 75 (block 123) accessible by the voice command
interface program product 45 and configured to assign each of a plurality of preferably customer or user specific/specified voice command terms or phrases, e.g., labels 79 (seeFIG. 5A ), defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding plurality of vehicle mobile data computer input device command inputs, e.g.,keystrokes 81, for the vehicle mobile data computer application program 43 (block 125). Theinitializer 75 can be in the form of a text file or a program which can assign the preselected set of voice commands to a corresponding set of keyboard keystrokes or series of keystrokes or other command inputs to thereby select an application program page or frame 83 (seeFIG. 6 ), data entry fields 85, or other graphical user interface input. - The method also includes providing a plurality of phonetic alphabet data sets (see e.g.,
FIG. 5B ) to provide command input of a plurality of letters corresponding to a plurality of vehicle mobile data computer input device inputs for the vehicle mobile data computer application program 43 (block 127). Correspondingly, theinitializer 75 can assign (block 129) the voice commandinterface program product 45 to use at least one of preferably the two most common spoken phonetic alphabets 87 (e.g., “alpha” to “zulu” or “adam” to “zebra”) equating to a keystroke for corresponding letters of the alphabet (e.g., “A” to “Z”). The numbers “zero” to “nine,” equating to a keystroke for corresponding numerals “0” to “9,” can also be assigned accordingly, if not already done so in an operating system SAPI. - The method also includes assigning an audio message (block 131) in the form of an echo to at least some of the assigned voice commands, and/or assigned letters and numbers, to acknowledge the voice command received from the user (see
FIG. 5A ). The audio message is preferably in the form of a prerecorded human voice message 77 (seeFIG. 4 ) that is preferably activated by manipulation of a control function selector, e.g., left control key 91 (described further below), or by a time delay instituted after identifying the voice command. For example, as perhaps best illustrated inFIGS. 1, 5 , and 6, with respect to a typical law-enforcement vehicle mobile datacomputer application program 43, the user depresses theleft control key 91 and provides the voice command “plate.” Upon release of the key, a preselected time delay, or a combination thereof, the voice commandinterface program product 45 will activate a corresponding keystroke combination to access a corresponding application program screen or text entry field. In this example, as illustrated inFIG. 5A , the keystroke combination “Alt-c, F4, F5, F11” would be performed. As illustrated inFIG. 6 , the user would then provide a voice command such as “Alpha”-“Bravo”-“Charlie”-“one”-“two”-“Delta” corresponding to license plate number “ABC12D.” The voice commandinterface program product 45 would then cause activation of the keystrokes “a”-“b”-“c”-“1”-“2”-“d,” and, if selected to do so, provide a corresponding echo of the license plate number. The license plate data can be either automatically transmitted to the department server 35 (seeFIG. 2 ) or the user would then provide another voice command, such as “send,” to do so if the echo properly repeated the license plate number “ABC12D,” or “clear” or “backspace,” if the interpretation was incorrect. Note, each voice command or a preselected subset of the voice commands could be echoed, if selected to do so. Further, the echo need not be an actual repeat of the actual voice command. For example, the voice command “send” can be returned as “sending.” - As stated above, the method can also include assigning or designating a control function selector (block 133), e.g., the
left control key 91 of the keyboard 59 (seeFIG. 1 ), or other input device of the vehiclemobile data computer 41, as a voice command interface program product on-off operation control selector defining a push-to-talk switch. An audible indication, preferably in the form of an audio file to indicate activation and/or deactivation of the control selector, can also be assigned in order to aid the user in determining that the preselected control selector (e.g., left control key 91) was properly manipulated. The audio data or audio file assigned can be different depending upon the function performed, e.g., selection “on” or selection “off,” or can be the same file to indicate both selection and deselection. - The method can further include editing the initializer 75 (see
FIG. 5A ) by a user to assign an additional command term or phrase to a corresponding keyboard key or other vehicle mobile data computer input device input specifically tailored to the vehicle mobile datacomputer application program 43; or to change the command input, e.g.,keystrokes 81, for a pre-existing voice command term or phrase, in response to a modification of the vehicle mobile datacomputer application program 43. A pre-assigned voice command can also be edited to change the identification or name of the voice command (label 79); to delete the voice command (label 79), in response to a desired grammatical change by the user; or to change the audio data, e.g.,audio file 89, associated with the voice command, in order to suit user preferences. - As perhaps best shown in
FIG. 10 , a preferred methodology of performing the steps of providing a voice commandinterface program product 45 and providinginitializer 75 includes accessing (block 141), preferably through a communications or area network 50 (seeFIG. 2 ), a user accessible web site preferably positioned on a Web server (not shown), to “download” or otherwise receive (block 143) a voice command interface program product 45 (seeFIG. 4 ) that is adapted to provide vehicle mobile data computer input device emulation for a vehicle mobile datacomputer application program 43 installed on a vehicle mobile data computer 41 (seeFIG. 1 ). The voice commandinterface program product 45 can be provided and received by a user, preferably directly through the vehiclemobile data computer 41, in the form of a single self-extracting executable program that includes the voice commandinterface program product 45. The self-extracting executable program preferably installs an initializer 75 (seeFIG. 5A ) which is adapted to assign a plurality of preferably user-specified voice commands to a correspondingly unique set of keyboard key command inputs, i.e. keystrokes or series ofkeystrokes 81. The method includes executing or running the self-extracting executable program, to thereby install each of plurality of components (block 145) of the voice commandinterface program product 45 and theinitializer 75 inmemory 55 of the vehiclemobile data computer 41. - As perhaps best shown in
FIG. 11 , provided is a method of enhancing command communication in a high-noise environment between a user and a user vehiclemobile data computer 41. Preferably upon startup/initialization (block 151) of a voice command interface program product 45 (seeFIG. 4 ), each of a plurality of user-tailored voice commands, to be received as audio input from amicrophone 63, 97 (seeFIGS. 1 and 8 ), and a phonetic alphabet (seeFIG. 5B ), are assigned to a corresponding keyboard key command input, e.g.,keystrokes 81, to interface the voice commands with a vehicle mobile datacomputer application program 43, to thereby provide command input to the vehicle mobile datacomputer application program 43. The numbers “zero” to “nine,” equating to a keystroke for corresponding numerals “0” to “9,” can also be assigned accordingly if not already done so in an operating system SAPI. - The initialization can also include assigning, to at least some of the assigned voice commands and/or assigned letters and numbers, an audio data message in the form of an echo to acknowledge the voice command received from the user. The echo is preferably in the form of a prerecorded human
voice audio message 77. The initialization can further include designating a control function selector, e.g., theleft control key 91 of the keyboard 59 (seeFIG. 1 ), or other input device of the vehiclemobile data computer 41, as a voice command interface program product on-off operation control selector defining a push-to-talk switch. Note, the push-to-talk switch (control selector) can also be assigned audio data to indicate a change in state of the assigned control selector (seeFIG. 5B ). - The method can also include enabling an audio input device (block 153), e.g., the
microphone 63, 97 (seeFIGS. 1 and 8 ), to allow the voice commandinterface program product 45 to provide a verbal interface with the vehiclecomputer application program 43. With respect to the vehicle mountedmicrophone 63, this is typically accomplished by depressing or otherwise manipulating theleft control key 91, if so assigned such function, but may include un-muting themicrophone 63, if so configured. In one configuration, theleft control key 91 is depressed and held to allow the user to provide voice commands. In another configuration, theleft control key 91 need only be depressed momentarily and released, themicrophone 63/audio input being enabled for a predetermined or preselected time delay, and disabled thereafter, or disabled after a predetermined or preselected time period without receiving a voice command from the user. In still another configuration, the audio input remains enabled continuously. With respect to thewireless microphone assembly 95, enabling themicrophone 97 is typically accomplished by a combination of use of a power button (not shown) andmute switch 99. - Regardless of the configuration, the method includes receiving voice commands and/or noise as audio input from the user through the
microphone 63, 97 (block 155), and performing an acoustic description comparison or other analysis known to those skilled in the art on or for the received audio input (block 157). If the audio input is determined to include one or more voice commands assigned during initialization, a signal is transmitted to execute an associated one or more vehicle computer application program command inputs. The analysis is preferably only performed for a maximum of a predetermined or preselected time delay or timeout. Advantageously, this functionality allows quick recognition of the voice command not accompanied by excessive noise, and provides an ability to suppress a noise signal that would otherwise excessively use processor resources and/or excessively delay a user's ability to convey a voice command, potentially distracting the user. This functionality provides a time limitation to allow the voice command to be repeated, if necessary, substantially without delay, when a very low voice signal-to-noise ratio is encountered; rather than cause a distraction to the user while the user waits for theprocessor 51 to try, and likely fail, to identify the voice command from amongst the noise signal. Asystem tray icon 93 can be displayed to further indicate that audio input is being processed to further orient the user as to the availability of providing additional voice commands. - If a voice command is identified (block 159) and if the echo function is enabled and audio data is assigned to the respective voice command (block 161), preferably upon release of the
left control key 91 or after a predetermined or preselected time delay, the voice command is echoed (block 163) through the audio speakers 65 (seeFIG. 1 ) and the command input, e.g., keyboard emulation, is sent (block 165) to the vehicle computer application program 43 (seeFIG. 4 ). Thevehicle application program 43 can then eitheraccess vehicle memory 55 or access a department server 35 (seeFIG. 2 ) to receive requested data (block 167). Audio data, indicating a change in state of the left control key 91 (seeFIG. 1 ), can be sent to theaudio speakers 65, if such functionality was assigned. Also, according to an embodiment of the present invention, the user may manipulate other control keys, which can be assigned to control whether the audio data associated with thecontrol key 91 and/or theaudio messages 77 associated with the various voice commands, are enabled. Further, according to an alternative embodiment of the present invention, the enabling or disabling ofaudio messages 77 can be provided individually for each voice command in a subset of the plurality of assigned voice commands. Still further, a communication enhancingprogram product 47 can extract the requested data, summarize the data, and verbally announce to the user the requested data (block 169). - In an embodiment of the present invention, as described previously, rather than having to depress and hold the
left control key 91 or other selected control selector, in order to provide voice commands, the user need only depress theleft control key 91 once to enable system functionality, after which the user may provide voice commands, as desired, to further control access to such system functionality. This can be an important feature, especially when implemented in conjunction with a mobile or wireless microphone assembly 95 (seeFIG. 8 ). Correspondingly, in this embodiment of the present invention, the method includes: transmitting the voice commands to a vehiclecomputer application program 43 from outside the vehicle V through themicrophone 97; providing command input to the vehiclecomputer application program 43 through a voice commandinterface program product 45; and receiving an audio echo of the voice commands through either anaudio speaker - As perhaps best shown in
FIG. 8 , themicrophone assembly 95 is adapted to be carried by the user positioned outside a user vehicle V, to thereby provide the user a substantially hands-free ability to transmit voice commands to a receiver, such as, for example, either transceiver 61 (seeFIG. 1 ) or an alternative transceiver (not shown) directly connected to the vehicle V and in communication with the vehiclemobile data computer 41. Note, themicrophone assembly 95 need not remain continuously on, unless desired by the user. As described previously, to control or limit audio input to the vehiclemobile data computer 41, themicrophone assembly 95 can include amute button 99 and/or the voice commandinterface program product 45 can include functionality to allow specific commands to either activate or render dormant the voice commandinterface program product 45. - As shown in
FIG. 12 , advantageously, an embodiment of the present invention also includes a method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer system which includes forming a log file to log each attempt at recognizing an audio input (block 181); and logging in the log file each attempt in response to receiving such respective audio input (block 183). Each entry into the log file can include data indicating the date, time (including seconds), and results of the audio input analysis. The method can also include requesting the log file from the user (block 185); and performing a statistical analysis on the log file to analyze recognition failure rates (block 187). Advantageously, such data allows for continuous enhancement and development of improved process steps and the voice commandinterface program product 45. - It is important to note that while embodiments of the present invention have been described in the context of a fully functional system, those skilled in the art will appreciate that the mechanism of the present invention and/or aspects thereof are capable of being distributed in the form of a computer readable medium of instructions in a variety of forms for execution on a processor, processors, or the like, and that the present invention applies equally regardless of the particular type of signal bearing media used to actually carry out the distribution. Examples of computer readable media include: nonvolatile, hard-coded type media such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), recordable type media such as floppy disks, hard disk drives and CD-ROMs, and transmission type media such as digital and analog communication links, including those described previously.
- As shown in
FIGS. 1-12 , embodiments of the present invention also include a computer readable medium that is readable by a computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program. For example, in an embodiment of the present invention, the computer readable medium includes a set of instructions that, when executed by the computer, such as, for example, vehicle mobile data computer 41 (seeFIG. 1 ), cause the computer to perform the operation of extracting data from an initializer 75 (seeFIG. 5A ) configured to assign each of a plurality of user-specific or user-specified voice command terms or phrases, defining a plurality of vehicle mobile data computer application program voice commands, to a corresponding vehicle mobile data computer input device command input, e.g., keyboard keystroke or series of keystrokes, for the vehicle mobile datacomputer application program 43. Theinitializer 75 can be implemented by an initialization file such as, for example, an “.ini” file, through data entered into the Windows® registry, or by various other means known to the skilled in the art. The instructions also include those to perform the operation of assigning the voice commands to corresponding vehicle mobile data keyboard key command inputs to thereby interface with the vehicle mobile datacomputer application program 43. - In response to the initialization, the instructions can further include those to perform, when in a high noise environment, the operations of receiving, through an audio input device, e.g.,
microphone initializer 75; members of a phonetic alphabet associated to or with theinitializer 75 to provide command input corresponding to a plurality of letters each corresponding to separate keyboard key input forkeyboard 59; and a plurality of numbers each corresponding to a separate numerical keyboard key input forkeyboard 59. Particularly with respect to law-enforcement, voice command recognition speed and accuracy is essential in order to prevent unwarranted distraction of an officer. Accordingly, by providing a very limited set of voice commands which are easy to assign and remember, the officer, even in a very high-stress situation, can easily convey, and the voice command interface program product can quickly recognize, all voice commands necessary to operate the mobile data communications application program or other application programs. Further, selection of the very limited set of voice commands: reduces the amount of system resources and time required to analyze the audio input; and increases the probability of accurately recognizing each particular voice command. - The result of the acoustic description comparison is to identify one or more voice commands presented by the user to thereby execute an associated vehicle mobile data computer application program command input. For example, as perhaps best shown in
FIG. 6 , rather than type a license plate number, the user annunciates corresponding letters of the assigned phonetic alphabet and the Arabic numerals corresponding to those letter and number keys onkeyboard 59. This license plate number is then sent, and data is returned by the mobile datacommunications application program 45. - In an embodiment of the present invention, a computer readable medium that is readable by a computer, e.g., vehicle
mobile data computer 41, includes a set of instructions that, when executed by the vehiclemobile data computer 41, cause the computer to perform the operations of: receiving as audio input from the user through themicrophone audio speaker 65, in response to identification of the received voice command and/or release of a push-to-talk control key; and transmitting the corresponding command input to the vehicle mobile datacomputer application program 43. The echo preferably includes preselected audio data associated with the identified voice command including a representation of the identified voice command, preferably in the form of a prerecorded humanvoice audio message 77, verbalizing a representation the identified voice command. - The audio input is preferably enabled and the echo is preferably initiated either through manipulation of a control key, such as, for example, left
control key 91. Other alternatives within the scope of the present invention include enabling audio input for a plurality of the voice commands through use of a unique enabling voice command, such as, for example, “computer,” “vehicle computer,” or “Christine.” In this embodiment of the present invention, audio input is disabled either through use of theleft control key 91, a preselected or predetermine time delay without receiving a voice command, and/or a disabling voice command such as, for example, “computer off.” Various combinations of this embodiment include, for example, enabling the receiving of audio input and/or transmission of command input associated with identified voice commands in response to activation of a control selector, e.g., leftcontrol key 91, followed by disabling such functionality in response to a preselected or predetermined time delay. In such case, the functionality can then be reactivated through use of theleft control key 91 or through use of an enabling voice command, e.g., “Christine.” Similarly, the echo can be initiated for an identified voice command either through release of theleft control key 91, or a preselected or predetermined time delay after identifying the voice command. - In an embodiment of the present invention, a computer readable medium that is readable by a vehicle
mobile data computer 41 includes a set of instructions that, when executed by the vehiclemobile data computer 41, cause the vehiclemobile data computer 41 to perform the operations of: receiving an audio input from the user through amicrophone - This functionality advantageously prevents the vehicle
mobile data computer 41 from excessively “tying-up” system resources in order to attempt to identify either a false voice command embedded among a noise signal or to identify a valid voice command provided by the user but uttered in such a high noise environment that the voice command signal-to-noise ratio is extremely low, making identification of the voice command extremely difficult and unlikely. - If the audio input was strictly a result of noise, the voice command
interface program product 45 is quickly reset to receive a valid voice command. If the audio input included a voice command having a low signal-to-noise ratio, this functionality allows the user to provide an immediate repeat of the valid voice command rather wait through a lengthy delay typically resulting in both an unsuccessful attempt at identifying the voice command and an unnecessary distraction to the user. By quickly resetting to receive either an initial voice command or a repeat of a previously attempted voice command, the user is provided with not only less distraction but increased voice command identification reliability. - In the drawings and specification, there have been disclosed a typical preferred embodiment of the invention, and although specific terms are employed, the terms are used in a descriptive sense only and not for purposes of limitation. The invention has been described in considerable detail with specific reference to these illustrated embodiments. It will be apparent, however, that various modifications and changes can be made within the spirit and scope of the invention as described in the foregoing specification and as defined in the appended claims. For example, embodiments of the present invention are described as using phonetic alphabets and Arabic numerals commonly used in United States of America, however, use of other languages and numbering systems are within the scope of the present invention. Also for example, many of the example embodiments were illustrated with respect to communication with law-enforcement. Other uses include providing command, control, and communications between other organizations and include providing command and control input to the vehicle, itself. Further, various embodiments of the present invention can be tailored to function on different or unique computer operating systems.
Claims (29)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/083,475 US7026957B2 (en) | 2001-10-01 | 2005-03-18 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
US11/376,676 US20060190097A1 (en) | 2001-10-01 | 2006-03-16 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/968,633 US6621422B2 (en) | 2001-10-01 | 2001-10-01 | Apparatus for communicating with law enforcement during vehicle travel and associated methods |
US10/656,487 US6943703B2 (en) | 2001-10-01 | 2003-09-05 | Apparatus for communicating with law enforcement during vehicle travel and associated methods |
US11/083,475 US7026957B2 (en) | 2001-10-01 | 2005-03-18 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/656,487 Continuation-In-Part US6943703B2 (en) | 2001-10-01 | 2003-09-05 | Apparatus for communicating with law enforcement during vehicle travel and associated methods |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/376,676 Division US20060190097A1 (en) | 2001-10-01 | 2006-03-16 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
Publications (2)
Publication Number | Publication Date |
---|---|
US20050179540A1 true US20050179540A1 (en) | 2005-08-18 |
US7026957B2 US7026957B2 (en) | 2006-04-11 |
Family
ID=34841258
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/083,475 Expired - Lifetime US7026957B2 (en) | 2001-10-01 | 2005-03-18 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
US11/376,676 Abandoned US20060190097A1 (en) | 2001-10-01 | 2006-03-16 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/376,676 Abandoned US20060190097A1 (en) | 2001-10-01 | 2006-03-16 | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods |
Country Status (1)
Country | Link |
---|---|
US (2) | US7026957B2 (en) |
Cited By (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060019720A1 (en) * | 2004-06-09 | 2006-01-26 | Denso Corporation | Information registering and retrieving system, in-vehicle apparatus and portable apparatus |
US20060143178A1 (en) * | 2004-12-27 | 2006-06-29 | Chan Wilson W S | Dynamic remastering for a subset of nodes in a cluster environment |
US20080195396A1 (en) * | 2005-07-11 | 2008-08-14 | Mark Greene | System, method and computer program product for adding voice activation and voice control to a media player |
US20100097178A1 (en) * | 2008-10-17 | 2010-04-22 | Pisz James T | Vehicle biometric systems and methods |
US8073590B1 (en) | 2008-08-22 | 2011-12-06 | Boadin Technology, LLC | System, method, and computer program product for utilizing a communication channel of a mobile device by a vehicular assembly |
US8078397B1 (en) | 2008-08-22 | 2011-12-13 | Boadin Technology, LLC | System, method, and computer program product for social networking utilizing a vehicular assembly |
US8117225B1 (en) | 2008-01-18 | 2012-02-14 | Boadin Technology, LLC | Drill-down system, method, and computer program product for focusing a search |
US8117242B1 (en) | 2008-01-18 | 2012-02-14 | Boadin Technology, LLC | System, method, and computer program product for performing a search in conjunction with use of an online application |
US8131458B1 (en) | 2008-08-22 | 2012-03-06 | Boadin Technology, LLC | System, method, and computer program product for instant messaging utilizing a vehicular assembly |
US8190692B1 (en) | 2008-08-22 | 2012-05-29 | Boadin Technology, LLC | Location-based messaging system, method, and computer program product |
US20120185247A1 (en) * | 2011-01-14 | 2012-07-19 | GM Global Technology Operations LLC | Unified microphone pre-processing system and method |
US8265862B1 (en) | 2008-08-22 | 2012-09-11 | Boadin Technology, LLC | System, method, and computer program product for communicating location-related information |
US20130325461A1 (en) * | 2012-05-30 | 2013-12-05 | Guy Blank | Business platform voice interactions |
US20140074480A1 (en) * | 2012-09-11 | 2014-03-13 | GM Global Technology Operations LLC | Voice stamp-driven in-vehicle functions |
US20140168058A1 (en) * | 2012-12-18 | 2014-06-19 | Hyundai Motor Company | Apparatus and method for recognizing instruction using voice and gesture |
CN104332159A (en) * | 2014-10-30 | 2015-02-04 | 上海修源网络科技有限公司 | Vehicular voice-operated system man-machine interaction method and device |
US20150206531A1 (en) * | 2014-01-17 | 2015-07-23 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
US20150206532A1 (en) * | 2014-01-17 | 2015-07-23 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
US20150212791A1 (en) * | 2014-01-28 | 2015-07-30 | Oracle International Corporation | Voice recognition of commands extracted from user interface screen devices |
US20160004502A1 (en) * | 2013-07-16 | 2016-01-07 | Cloudcar, Inc. | System and method for correcting speech input |
US9250856B2 (en) * | 2014-04-21 | 2016-02-02 | Myine Electronics, Inc. | In-vehicle web presentation |
US20160284353A1 (en) * | 2010-06-24 | 2016-09-29 | Honda Motor Co., Ltd. | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system |
US20160299480A1 (en) * | 2014-10-30 | 2016-10-13 | Shenzhen Skyworth-Rgb Electronic Co., Ltd | Context awareness control device, system and method |
US9741343B1 (en) * | 2013-12-19 | 2017-08-22 | Amazon Technologies, Inc. | Voice interaction application selection |
US10525985B2 (en) * | 2016-03-30 | 2020-01-07 | Kawasaki Jukogyo Kabushiki Kaisha | Information output apparatus for saddle-type vehicle |
US20200073629A1 (en) * | 2018-08-30 | 2020-03-05 | Samsung Electronics Co., Ltd. | Electronic device and method for generating short cut of quick command |
CN111464250A (en) * | 2020-03-06 | 2020-07-28 | 上海博泰悦臻电子设备制造有限公司 | Channel searching method, system, medium, device and vehicle of radio |
US20210038170A1 (en) * | 2017-05-09 | 2021-02-11 | LifePod Solutions, Inc. | Voice controlled assistance for monitoring adverse events of a user and/or coordinating emergency actions such as caregiver communication |
US10950229B2 (en) * | 2016-08-26 | 2021-03-16 | Harman International Industries, Incorporated | Configurable speech interface for vehicle infotainment systems |
CN113348503A (en) * | 2019-01-29 | 2021-09-03 | 谷歌有限责任公司 | Detecting playback and/or accommodating misaligned playback in wireless speakers using structured audio output |
US11152011B2 (en) * | 2019-11-27 | 2021-10-19 | Summit Wireless Technologies, Inc. | Voice detection with multi-channel interference cancellation |
US11164578B2 (en) * | 2018-06-04 | 2021-11-02 | Honda Motor Co., Ltd. | Voice recognition apparatus, voice recognition method, and non-transitory computer-readable storage medium storing program |
CN114071318A (en) * | 2021-11-12 | 2022-02-18 | 阿波罗智联(北京)科技有限公司 | Voice processing method, terminal device and vehicle |
Families Citing this family (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6560461B1 (en) | 1997-08-04 | 2003-05-06 | Mundi Fomukong | Authorized location reporting paging system |
US7783508B2 (en) | 1999-09-20 | 2010-08-24 | Numerex Corp. | Method and system for refining vending operations based on wireless data |
US7323970B1 (en) | 2004-01-21 | 2008-01-29 | Numerex Corporation | Method and system for remote interaction with a vehicle via wireless communication |
US8270901B2 (en) * | 2004-12-17 | 2012-09-18 | Martin E. Hellman | Dropout-resistant media broadcasting system |
US8627354B2 (en) * | 2004-12-17 | 2014-01-07 | Martin E. Hellman | Tiered subscription broadcast system |
US7865917B2 (en) * | 2004-12-17 | 2011-01-04 | Martin E Hellman | Security enhanced tiered subscription broadcast system |
US7840178B2 (en) * | 2005-07-12 | 2010-11-23 | Martin E. Hellman | FM broadcast system competitive with satellite radio |
US10882399B2 (en) | 2005-11-17 | 2021-01-05 | Invently Automotive Inc. | Electric vehicle power management system |
US11084377B2 (en) | 2005-11-17 | 2021-08-10 | Invently Automotive Inc. | Vehicle power management system responsive to voice commands from a Gps enabled device |
US20080037727A1 (en) * | 2006-07-13 | 2008-02-14 | Clas Sivertsen | Audio appliance with speech recognition, voice command control, and speech generation |
US20080027990A1 (en) * | 2006-07-26 | 2008-01-31 | Kaplan Richard D | 4DHelp information data |
US7831431B2 (en) | 2006-10-31 | 2010-11-09 | Honda Motor Co., Ltd. | Voice recognition updates via remote broadcast signal |
US8599704B2 (en) | 2007-01-23 | 2013-12-03 | Microsoft Corporation | Assessing gateway quality using audio systems |
GB2447672B (en) | 2007-03-21 | 2011-12-14 | Ford Global Tech Llc | Vehicle manoeuvring aids |
US8090077B2 (en) * | 2007-04-02 | 2012-01-03 | Microsoft Corporation | Testing acoustic echo cancellation and interference in VoIP telephones |
US8694310B2 (en) * | 2007-09-17 | 2014-04-08 | Qnx Software Systems Limited | Remote control server protocol system |
DE602007004620D1 (en) * | 2007-10-01 | 2010-03-18 | Harman Becker Automotive Sys | Voice-controlled adjustment of vehicle parts |
US9135763B2 (en) * | 2007-12-19 | 2015-09-15 | Centurylink Intellectual Property Llc | System and method for wireless state identification |
EP2318807B1 (en) * | 2008-08-11 | 2012-12-26 | Telcordia Technologies, Inc. | System and method for using networked mobile devices in vehicles |
US8633836B1 (en) * | 2009-01-16 | 2014-01-21 | Lavonnia Ball | Vehicle locator |
US8554831B2 (en) * | 2009-06-02 | 2013-10-08 | Ford Global Technologies, Llc | System and method for executing hands-free operation of an electronic calendar application within a vehicle |
US20110131040A1 (en) * | 2009-12-01 | 2011-06-02 | Honda Motor Co., Ltd | Multi-mode speech recognition |
US8346310B2 (en) | 2010-02-05 | 2013-01-01 | Ford Global Technologies, Llc | Method and apparatus for communication between a vehicle based computing system and a remote application |
US9094436B2 (en) | 2010-05-27 | 2015-07-28 | Ford Global Technologies, Llc | Methods and systems for interfacing with a vehicle computing system over multiple data transport channels |
US8473575B2 (en) | 2010-08-26 | 2013-06-25 | Ford Global Technologies, Llc | Methods and apparatus for remote activation of an application |
US20120052907A1 (en) * | 2010-08-30 | 2012-03-01 | Sensory, Incorporated | Hands-Free, Eyes-Free Mobile Device for In-Car Use |
US10163273B2 (en) * | 2010-09-28 | 2018-12-25 | Ford Global Technologies, Llc | Method and system for operating mobile applications in a vehicle |
CN102541574A (en) * | 2010-12-13 | 2012-07-04 | 鸿富锦精密工业(深圳)有限公司 | Application program opening system and method |
US8560739B2 (en) | 2010-12-28 | 2013-10-15 | Ford Global Technologies, Llc | Methods and systems for regulating operation of one or more functions of a mobile application |
US9555832B2 (en) | 2011-04-19 | 2017-01-31 | Ford Global Technologies, Llc | Display system utilizing vehicle and trailer dynamics |
US9374562B2 (en) | 2011-04-19 | 2016-06-21 | Ford Global Technologies, Llc | System and method for calculating a horizontal camera to target distance |
US9854209B2 (en) | 2011-04-19 | 2017-12-26 | Ford Global Technologies, Llc | Display system utilizing vehicle and trailer dynamics |
US9248858B2 (en) | 2011-04-19 | 2016-02-02 | Ford Global Technologies | Trailer backup assist system |
US9290204B2 (en) | 2011-04-19 | 2016-03-22 | Ford Global Technologies, Llc | Hitch angle monitoring system and method |
US9969428B2 (en) | 2011-04-19 | 2018-05-15 | Ford Global Technologies, Llc | Trailer backup assist system with waypoint selection |
US9506774B2 (en) | 2011-04-19 | 2016-11-29 | Ford Global Technologies, Llc | Method of inputting a path for a vehicle and trailer |
US9926008B2 (en) | 2011-04-19 | 2018-03-27 | Ford Global Technologies, Llc | Trailer backup assist system with waypoint selection |
US9500497B2 (en) | 2011-04-19 | 2016-11-22 | Ford Global Technologies, Llc | System and method of inputting an intended backing path |
US20120306836A1 (en) * | 2011-06-01 | 2012-12-06 | Farrell Ackerman | Apparatus, System and Method for an Electro-Luminance Display on a Garment |
US20120310445A1 (en) | 2011-06-02 | 2012-12-06 | Ford Global Technologies, Llc | Methods and Apparatus for Wireless Device Application Having Vehicle Interaction |
US20120306741A1 (en) * | 2011-06-06 | 2012-12-06 | Gupta Kalyan M | System and Method for Enhancing Locative Response Abilities of Autonomous and Semi-Autonomous Agents |
US9529752B2 (en) | 2011-07-25 | 2016-12-27 | Ford Global Technologies, Llc | Method and apparatus for communication between a vehicle based computing system and a remote application |
US8694203B2 (en) | 2011-09-12 | 2014-04-08 | Ford Global Technologies, Llc | Method and apparatus for vehicle process emulation and configuration on a mobile platform |
US8892046B2 (en) * | 2012-03-29 | 2014-11-18 | Bose Corporation | Automobile communication system |
US9078088B2 (en) | 2012-07-12 | 2015-07-07 | Myine Electronics, Inc. | System and method for transport layer agnostic programming interface for use with smartphones |
US9224289B2 (en) | 2012-12-10 | 2015-12-29 | Ford Global Technologies, Llc | System and method of determining occupant location using connected devices |
US20140163771A1 (en) * | 2012-12-10 | 2014-06-12 | Ford Global Technologies, Llc | Occupant interaction with vehicle system using brought-in devices |
US9218805B2 (en) * | 2013-01-18 | 2015-12-22 | Ford Global Technologies, Llc | Method and apparatus for incoming audio processing |
US8981916B2 (en) | 2013-01-28 | 2015-03-17 | Ford Global Technologies, Llc | Method and apparatus for customized vehicle sound-based location |
US9592851B2 (en) | 2013-02-04 | 2017-03-14 | Ford Global Technologies, Llc | Control modes for a trailer backup assist system |
US9511799B2 (en) | 2013-02-04 | 2016-12-06 | Ford Global Technologies, Llc | Object avoidance for a trailer backup assist system |
US9146899B2 (en) | 2013-02-07 | 2015-09-29 | Ford Global Technologies, Llc | System and method of arbitrating audio source streamed by mobile applications |
US9538339B2 (en) | 2013-02-07 | 2017-01-03 | Ford Global Technologies, Llc | Method and system of outputting in a vehicle data streamed by mobile applications |
US9042603B2 (en) | 2013-02-25 | 2015-05-26 | Ford Global Technologies, Llc | Method and apparatus for estimating the distance from trailer axle to tongue |
US9479601B2 (en) | 2013-03-15 | 2016-10-25 | Ford Global Technologies, Llc | Method and apparatus for seamless application portability over multiple environments |
US8933822B2 (en) | 2013-03-15 | 2015-01-13 | Ford Global Technologies, Llc | Method and apparatus for extra-vehicular emergency updates following an accident |
US9197336B2 (en) | 2013-05-08 | 2015-11-24 | Myine Electronics, Inc. | System and method for providing customized audio content to a vehicle radio system using a smartphone |
US9514747B1 (en) * | 2013-08-28 | 2016-12-06 | Amazon Technologies, Inc. | Reducing speech recognition latency |
US9352777B2 (en) | 2013-10-31 | 2016-05-31 | Ford Global Technologies, Llc | Methods and systems for configuring of a trailer maneuvering system |
US9233710B2 (en) | 2014-03-06 | 2016-01-12 | Ford Global Technologies, Llc | Trailer backup assist system using gesture commands and method |
KR102245098B1 (en) | 2014-05-23 | 2021-04-28 | 삼성전자주식회사 | Mobile terminal and control method thereof |
US9686657B1 (en) * | 2014-07-10 | 2017-06-20 | Motorola Solutions, Inc. | Methods and systems for simultaneous talking in a talkgroup using a dynamic channel chain |
CN105334997A (en) * | 2014-08-12 | 2016-02-17 | 扬智科技股份有限公司 | Intelligent input apparatus as well as setting method and control method therefor |
US9533683B2 (en) | 2014-12-05 | 2017-01-03 | Ford Global Technologies, Llc | Sensor failure mitigation system and mode management |
US9522677B2 (en) | 2014-12-05 | 2016-12-20 | Ford Global Technologies, Llc | Mitigation of input device failure and mode management |
US9896130B2 (en) | 2015-09-11 | 2018-02-20 | Ford Global Technologies, Llc | Guidance system for a vehicle reversing a trailer along an intended backing path |
US10112646B2 (en) | 2016-05-05 | 2018-10-30 | Ford Global Technologies, Llc | Turn recovery human machine interface for trailer backup assist |
US11657655B2 (en) | 2020-11-13 | 2023-05-23 | Ford Global Technologies, Llc | Vehicle component fault detection |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4818010A (en) * | 1986-10-17 | 1989-04-04 | Automotive Prototypes & Equipment | Mounting system for equipment in police vehicles |
US20040059582A1 (en) * | 2002-09-19 | 2004-03-25 | International Business Machines Corporation | System and method for remotely enforcing operational protocols |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3899772A (en) | 1973-04-23 | 1975-08-12 | Kustom Electronics | Mobile computer terminal and system |
US4083003A (en) | 1973-11-05 | 1978-04-04 | Products Of Information Technology, Inc. | Vehicle location system |
US4152693A (en) | 1977-04-25 | 1979-05-01 | Audio Alert, Inc. | Vehicle locator system |
US4354252A (en) | 1977-09-27 | 1982-10-12 | Motorola, Inc. | Programmable digital data terminal for mobile radio transceivers |
US5263118A (en) | 1990-03-13 | 1993-11-16 | Applied Voice Technology, Inc. | Parking ticket enforcement system |
US5731785A (en) | 1994-05-13 | 1998-03-24 | Lemelson; Jerome H. | System and method for locating objects including an inhibiting feature |
JPH09114489A (en) * | 1995-10-16 | 1997-05-02 | Sony Corp | Device and method for speech recognition, device and method for navigation, and automobile |
US6049272A (en) | 1997-01-22 | 2000-04-11 | Boyd B. Moore et al. | Automated data transmission link to law enforcement and security personnel |
US6035016A (en) | 1997-01-22 | 2000-03-07 | Moore; Boyd B. | Supplemental data transmission system for a parallel, direct communication to law enforcement and security personnel when a signal from an emergency alarm is transmitted |
US6173284B1 (en) | 1997-05-20 | 2001-01-09 | University Of Charlotte City Of Charlotte | Systems, methods and computer program products for automatically monitoring police records for a crime profile |
US6188939B1 (en) | 1997-08-18 | 2001-02-13 | The Texas A&M University System | Advanced law enforcement and response technology |
US6161066A (en) | 1997-08-18 | 2000-12-12 | The Texas A&M University System | Advanced law enforcement and response technology |
US6078282A (en) | 1998-06-26 | 2000-06-20 | Casey; Paul J. | Data base for a locator system |
US6212408B1 (en) * | 1999-05-03 | 2001-04-03 | Innovative Global Solution, Inc. | Voice command system and method |
US6393360B1 (en) | 1999-11-17 | 2002-05-21 | Erjian Ma | System for automatically locating and directing a vehicle |
US6408304B1 (en) | 1999-12-17 | 2002-06-18 | International Business Machines Corporation | Method and apparatus for implementing an object oriented police patrol multifunction system |
US6317684B1 (en) | 1999-12-22 | 2001-11-13 | At&T Wireless Services Inc. | Method and apparatus for navigation using a portable communication device |
US6317685B1 (en) * | 2000-03-13 | 2001-11-13 | Navigation Technologies Corp. | Method and system for providing alternate routes with a navigation system |
JP2001331195A (en) * | 2000-05-19 | 2001-11-30 | Sony Corp | Onboard apparatus, car navigation system and monitor device |
JP4244514B2 (en) * | 2000-10-23 | 2009-03-25 | セイコーエプソン株式会社 | Speech recognition method and speech recognition apparatus |
US6621422B2 (en) | 2001-10-01 | 2003-09-16 | Advanced Public Safety, Inc. | Apparatus for communicating with law enforcement during vehicle travel and associated methods |
US7103542B2 (en) * | 2001-12-14 | 2006-09-05 | Ben Franklin Patent Holding Llc | Automatically improving a voice recognition system |
US7181392B2 (en) * | 2002-07-16 | 2007-02-20 | International Business Machines Corporation | Determining speech recognition accuracy |
US20060190262A1 (en) * | 2004-01-06 | 2006-08-24 | High Technology Solutions, Inc. | Voice recognition system and method for tactical response |
-
2005
- 2005-03-18 US US11/083,475 patent/US7026957B2/en not_active Expired - Lifetime
-
2006
- 2006-03-16 US US11/376,676 patent/US20060190097A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4818010A (en) * | 1986-10-17 | 1989-04-04 | Automotive Prototypes & Equipment | Mounting system for equipment in police vehicles |
US20040059582A1 (en) * | 2002-09-19 | 2004-03-25 | International Business Machines Corporation | System and method for remotely enforcing operational protocols |
Cited By (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7363061B2 (en) * | 2004-06-09 | 2008-04-22 | Denso Corporation | Information registering and retrieving system, in-vehicle apparatus and portable apparatus |
US20060019720A1 (en) * | 2004-06-09 | 2006-01-26 | Denso Corporation | Information registering and retrieving system, in-vehicle apparatus and portable apparatus |
US20060143178A1 (en) * | 2004-12-27 | 2006-06-29 | Chan Wilson W S | Dynamic remastering for a subset of nodes in a cluster environment |
US20080195396A1 (en) * | 2005-07-11 | 2008-08-14 | Mark Greene | System, method and computer program product for adding voice activation and voice control to a media player |
US8117225B1 (en) | 2008-01-18 | 2012-02-14 | Boadin Technology, LLC | Drill-down system, method, and computer program product for focusing a search |
US8117242B1 (en) | 2008-01-18 | 2012-02-14 | Boadin Technology, LLC | System, method, and computer program product for performing a search in conjunction with use of an online application |
US8265862B1 (en) | 2008-08-22 | 2012-09-11 | Boadin Technology, LLC | System, method, and computer program product for communicating location-related information |
US8073590B1 (en) | 2008-08-22 | 2011-12-06 | Boadin Technology, LLC | System, method, and computer program product for utilizing a communication channel of a mobile device by a vehicular assembly |
US8131458B1 (en) | 2008-08-22 | 2012-03-06 | Boadin Technology, LLC | System, method, and computer program product for instant messaging utilizing a vehicular assembly |
US8190692B1 (en) | 2008-08-22 | 2012-05-29 | Boadin Technology, LLC | Location-based messaging system, method, and computer program product |
US8078397B1 (en) | 2008-08-22 | 2011-12-13 | Boadin Technology, LLC | System, method, and computer program product for social networking utilizing a vehicular assembly |
US20100097178A1 (en) * | 2008-10-17 | 2010-04-22 | Pisz James T | Vehicle biometric systems and methods |
US10818286B2 (en) | 2010-06-24 | 2020-10-27 | Honda Motor Co., Ltd. | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system |
US20160284353A1 (en) * | 2010-06-24 | 2016-09-29 | Honda Motor Co., Ltd. | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system |
US9620121B2 (en) * | 2010-06-24 | 2017-04-11 | Honda Motor Co., Ltd. | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system |
US10269348B2 (en) | 2010-06-24 | 2019-04-23 | Honda Motor Co., Ltd. | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system |
US20120185247A1 (en) * | 2011-01-14 | 2012-07-19 | GM Global Technology Operations LLC | Unified microphone pre-processing system and method |
US9171551B2 (en) * | 2011-01-14 | 2015-10-27 | GM Global Technology Operations LLC | Unified microphone pre-processing system and method |
US9524713B2 (en) * | 2012-05-30 | 2016-12-20 | Sap Se | Business platform voice interactions |
US20130325461A1 (en) * | 2012-05-30 | 2013-12-05 | Guy Blank | Business platform voice interactions |
US20140074480A1 (en) * | 2012-09-11 | 2014-03-13 | GM Global Technology Operations LLC | Voice stamp-driven in-vehicle functions |
US20140168058A1 (en) * | 2012-12-18 | 2014-06-19 | Hyundai Motor Company | Apparatus and method for recognizing instruction using voice and gesture |
US20160004502A1 (en) * | 2013-07-16 | 2016-01-07 | Cloudcar, Inc. | System and method for correcting speech input |
US9741343B1 (en) * | 2013-12-19 | 2017-08-22 | Amazon Technologies, Inc. | Voice interaction application selection |
US9349371B2 (en) * | 2014-01-17 | 2016-05-24 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
JP2015135419A (en) * | 2014-01-17 | 2015-07-27 | 株式会社デンソー | Voice recognition terminal device, voice recognition system, and voice recognition method |
US9349370B2 (en) * | 2014-01-17 | 2016-05-24 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
US20150206531A1 (en) * | 2014-01-17 | 2015-07-23 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
US20150206532A1 (en) * | 2014-01-17 | 2015-07-23 | Denso Corporation | Speech recognition terminal device, speech recognition system, and speech recognition method |
JP2015135420A (en) * | 2014-01-17 | 2015-07-27 | 株式会社デンソー | Voice recognition terminal device, voice recognition system, and voice recognition method |
US9858039B2 (en) * | 2014-01-28 | 2018-01-02 | Oracle International Corporation | Voice recognition of commands extracted from user interface screen devices |
US20150212791A1 (en) * | 2014-01-28 | 2015-07-30 | Oracle International Corporation | Voice recognition of commands extracted from user interface screen devices |
US9680963B2 (en) | 2014-04-21 | 2017-06-13 | Livio, Inc. | In-vehicle web presentation |
US9250856B2 (en) * | 2014-04-21 | 2016-02-02 | Myine Electronics, Inc. | In-vehicle web presentation |
US20160299480A1 (en) * | 2014-10-30 | 2016-10-13 | Shenzhen Skyworth-Rgb Electronic Co., Ltd | Context awareness control device, system and method |
US10180671B2 (en) * | 2014-10-30 | 2019-01-15 | Shenzhen Skyworth-Rgb Electronic Co., Ltd | Context awareness control device, system and method |
CN104332159A (en) * | 2014-10-30 | 2015-02-04 | 上海修源网络科技有限公司 | Vehicular voice-operated system man-machine interaction method and device |
US10525985B2 (en) * | 2016-03-30 | 2020-01-07 | Kawasaki Jukogyo Kabushiki Kaisha | Information output apparatus for saddle-type vehicle |
US10950229B2 (en) * | 2016-08-26 | 2021-03-16 | Harman International Industries, Incorporated | Configurable speech interface for vehicle infotainment systems |
US20210038170A1 (en) * | 2017-05-09 | 2021-02-11 | LifePod Solutions, Inc. | Voice controlled assistance for monitoring adverse events of a user and/or coordinating emergency actions such as caregiver communication |
US11164578B2 (en) * | 2018-06-04 | 2021-11-02 | Honda Motor Co., Ltd. | Voice recognition apparatus, voice recognition method, and non-transitory computer-readable storage medium storing program |
US20200073629A1 (en) * | 2018-08-30 | 2020-03-05 | Samsung Electronics Co., Ltd. | Electronic device and method for generating short cut of quick command |
KR20200025377A (en) * | 2018-08-30 | 2020-03-10 | 삼성전자주식회사 | Electronic Device and the Method for Generating Short cut of Quick Command |
US11188298B2 (en) * | 2018-08-30 | 2021-11-30 | Samsung Electronics Co., Ltd. | Electronic device and method for generating short cut of quick command |
KR102563314B1 (en) * | 2018-08-30 | 2023-08-04 | 삼성전자주식회사 | Electronic Device and the Method for Generating Short cut of Quick Command |
US11868680B2 (en) | 2018-08-30 | 2024-01-09 | Samsung Electronics Co., Ltd. | Electronic device and method for generating short cut of quick command |
CN113348503A (en) * | 2019-01-29 | 2021-09-03 | 谷歌有限责任公司 | Detecting playback and/or accommodating misaligned playback in wireless speakers using structured audio output |
US11152011B2 (en) * | 2019-11-27 | 2021-10-19 | Summit Wireless Technologies, Inc. | Voice detection with multi-channel interference cancellation |
CN111464250A (en) * | 2020-03-06 | 2020-07-28 | 上海博泰悦臻电子设备制造有限公司 | Channel searching method, system, medium, device and vehicle of radio |
CN114071318A (en) * | 2021-11-12 | 2022-02-18 | 阿波罗智联(北京)科技有限公司 | Voice processing method, terminal device and vehicle |
Also Published As
Publication number | Publication date |
---|---|
US7026957B2 (en) | 2006-04-11 |
US20060190097A1 (en) | 2006-08-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7026957B2 (en) | Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods | |
US6542868B1 (en) | Audio notification management system | |
US9495957B2 (en) | Mobile systems and methods of supporting natural language human-machine interactions | |
US6996528B2 (en) | Method for efficient, safe and reliable data entry by voice under adverse conditions | |
CN106209138B (en) | Vehicle cautious emergency response system and method | |
JP4570176B2 (en) | An extensible speech recognition system that gives users audio feedback | |
US6298324B1 (en) | Speech recognition system with changing grammars and grammar help command | |
CA2231504C (en) | Process for automatic control of one or more devices by voice commands or by real-time voice dialog and apparatus for carrying out this process | |
EP1450349B1 (en) | Vehicle-mounted control apparatus and program that causes computer to execute method of providing guidance on the operation of the vehicle-mounted control apparatus | |
US6754627B2 (en) | Detecting speech recognition errors in an embedded speech recognition system | |
EP2051241B1 (en) | Speech dialog system with play back of speech output adapted to the user | |
US7747446B2 (en) | Voice recognition interactive system with a confirmation capability | |
JP4270611B2 (en) | Input system | |
US20080215336A1 (en) | Method and system for enabling a device function of a vehicle | |
JP2001517815A (en) | Similar speech recognition method and apparatus for language recognition | |
US20070073543A1 (en) | Supported method for speech dialogue used to operate vehicle functions | |
CN1920946A (en) | Automobile interface | |
WO2005052744A2 (en) | Wirelessly delivered owner's manual | |
Minker et al. | The SENECA spoken language dialogue system | |
US20040107097A1 (en) | Method and system for voice recognition through dialect identification | |
US6275803B1 (en) | Updating a language model based on a function-word to total-word ratio | |
Bengler | Automotive Speech-Recognition-Success Conditions Beyond Recognition Rates. | |
JPH05249996A (en) | Voice recognizing device | |
KR20220129366A (en) | Speech recognition system and method for controlling the same | |
KR20220150640A (en) | Vehicle and method for controlling thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ADVANCED PUBLIC SAFETY, INC., FLORIDA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RUBENSTEIN, JEFFREY D.;REEL/FRAME:016497/0512 Effective date: 20050314 |
|
AS | Assignment |
Owner name: TRIMBLE NAVIGATION LIMITED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ADVANCED PUBLIC SAFETY, INC.;REEL/FRAME:017586/0747 Effective date: 20060214 Owner name: TRIMBLE NAVIGATION LIMITED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ADVANCED PUBLIC SAFETY, INC.;REEL/FRAME:017586/0550 Effective date: 20060214 Owner name: TRIMBLE NAVIGATION LIMITED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ADVANCED PUBLIC SAFETY, INC.;REEL/FRAME:017575/0236 Effective date: 20060214 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
REFU | Refund |
Free format text: REFUND - SURCHARGE, PETITION TO ACCEPT PYMT AFTER EXP, UNINTENTIONAL (ORIGINAL EVENT CODE: R2551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: MORGAN STANLEY SENIOR FUNDING, INC., NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:APTEAN, INC.;APTEAN PARENT CO S.A.R.L.;REEL/FRAME:039308/0046 Effective date: 20160801 Owner name: MORGAN STANLEY SEINIOR FUNDING, INC., NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:APTEAN, INC.;APTEAN PARENT CO S.A.R.L.;REEL/FRAME:039308/0067 Effective date: 20160801 |
|
AS | Assignment |
Owner name: APTEAN, INC., GEORGIA Free format text: RELEASE OF FIRST LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0395 Effective date: 20161220 Owner name: GQ LIFE SCIENCES, INC., GEORGIA Free format text: RELEASE OF FIRST LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0395 Effective date: 20161220 Owner name: ACTIVPLANT CORPORATION, GEORGIA Free format text: RELEASE OF FIRST LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0395 Effective date: 20161220 Owner name: APTEAN SYSTEMS, LLC, GEORGIA Free format text: RELEASE OF FIRST LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0395 Effective date: 20161220 Owner name: ADVANCED PUBLIC SAFETY, INC., GEORGIA Free format text: RELEASE OF FIRST LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0395 Effective date: 20161220 Owner name: APTEAN, INC., GEORGIA Free format text: RELEASE OF SECOND LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0631 Effective date: 20161220 Owner name: ACTIVPLANT CORPORATION, GEORGIA Free format text: RELEASE OF SECOND LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0631 Effective date: 20161220 Owner name: ADVANCED PUBLIC SAFETY, INC., GEORGIA Free format text: RELEASE OF SECOND LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0631 Effective date: 20161220 Owner name: APTEAN SYSTEMS, LLC, GEORGIA Free format text: RELEASE OF SECOND LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0631 Effective date: 20161220 Owner name: GQ LIFE SCIENCES, INC., GEORGIA Free format text: RELEASE OF SECOND LIEN SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:041035/0631 Effective date: 20161220 |
|
AS | Assignment |
Owner name: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL Free format text: FIRST LIEN SECURITY AGREEMENT;ASSIGNORS:APTEAN, INC.;ACTIVPLANT CORPORATION;APTEAN SYSTEMS, LLC;AND OTHERS;REEL/FRAME:041085/0752 Effective date: 20161220 |
|
AS | Assignment |
Owner name: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL Free format text: SECOND LIEN SECURITY AGREEMENT;ASSIGNORS:APTEAN, INC.;ACTIVPLANT CORPORATION;APTEAN SYSTEMS, LLC;AND OTHERS;REEL/FRAME:041175/0370 Effective date: 20161220 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553) Year of fee payment: 12 |
|
AS | Assignment |
Owner name: ADVANCED PUBLIC SAFETY, INC., GEORGIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TRIMBLE NAVIGATION LIMITED;REEL/FRAME:043981/0222 Effective date: 20160607 |
|
AS | Assignment |
Owner name: ADVANCED PUBLIC SAFETY, LLC, GEORGIA Free format text: CERTIFICATE OF CONVERSION;ASSIGNOR:ADVANCED PUBLIC SAFETY, INC.;REEL/FRAME:046981/0721 Effective date: 20180611 |
|
AS | Assignment |
Owner name: ANTARES CAPITAL LP, AS COLLATERAL AGENT, ILLINOIS Free format text: FIRST LIEN PATENT SECURITY AGREEMENT;ASSIGNORS:ADVANCED PUBLIC SAFETY, LLC;JURISDICTION ONLINE, LLC;TRITECH SOFTWARE SYSTEMS;AND OTHERS;REEL/FRAME:046990/0175 Effective date: 20180831 Owner name: APTEAN, INC., GEORGIA Free format text: CORRECTIVE RELEASE OF SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:046992/0730 Effective date: 20180831 Owner name: ANTARES CAPITAL LP, AS COLLATERAL AGENT, ILLINOIS Free format text: SECOND LIEN PATENT SECURITY AGREEMENT;ASSIGNORS:ADVANCED PUBLIC SAFETY, LLC;JURISDICTION ONLINE, LLC;TRITECH SOFTWARE SYSTEMS;AND OTHERS;REEL/FRAME:047528/0561 Effective date: 20180831 Owner name: APTEAN, INC., GEORGIA Free format text: CORRECTIVE RELEASE OF SECURITY INTEREST;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC.;REEL/FRAME:047570/0696 Effective date: 20180831 |