WO2006009591A3 - Interactive manual, system and method for vehicles and other complex equipment - Google Patents

Interactive manual, system and method for vehicles and other complex equipment Download PDF

Info

Publication number
WO2006009591A3
WO2006009591A3 PCT/US2005/009304 US2005009304W WO2006009591A3 WO 2006009591 A3 WO2006009591 A3 WO 2006009591A3 US 2005009304 W US2005009304 W US 2005009304W WO 2006009591 A3 WO2006009591 A3 WO 2006009591A3
Authority
WO
WIPO (PCT)
Prior art keywords
manual
information
vehicles
speech
visual representation
Prior art date
Application number
PCT/US2005/009304
Other languages
French (fr)
Other versions
WO2006009591A2 (en
Inventor
Fuliang Weng
Hauke Schmidt
Gengyan Bei
Original Assignee
Bosch Gmbh Robert
Fuliang Weng
Hauke Schmidt
Gengyan Bei
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bosch Gmbh Robert, Fuliang Weng, Hauke Schmidt, Gengyan Bei filed Critical Bosch Gmbh Robert
Priority to KR1020077001067A priority Critical patent/KR101053748B1/en
Priority to EP05725969.9A priority patent/EP1766612B1/en
Priority to JP2007516462A priority patent/JP4689670B2/en
Publication of WO2006009591A2 publication Critical patent/WO2006009591A2/en
Publication of WO2006009591A3 publication Critical patent/WO2006009591A3/en

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1822—Parsing for meaning understanding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/228—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of application context

Abstract

A method and system of providing an interactive manual, including a speech engine to receive and process speech from a user (101), convert the speech into a word sequence, and identify meaning structures from the word sequence, a structured manual including information related to an operation of a device (107), a visual model to relate visual representation of the information (108), a dialog management arrangement (103) to interpret the meaning structures in a context and to extract pertinent information and the visual representation from the structured manual (104) and the visual model, and an output arrangement to output the information and visual representation (105).
PCT/US2005/009304 2004-06-17 2005-03-17 Interactive manual, system and method for vehicles and other complex equipment WO2006009591A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020077001067A KR101053748B1 (en) 2004-06-17 2005-03-17 Interactive manual systems and methods for vehicles and other complex equipment
EP05725969.9A EP1766612B1 (en) 2004-06-17 2005-03-17 Interactive manual, system and method for vehicles and other complex equipment
JP2007516462A JP4689670B2 (en) 2004-06-17 2005-03-17 Interactive manuals, systems and methods for vehicles and other complex devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/871,249 US7720680B2 (en) 2004-06-17 2004-06-17 Interactive manual, system and method for vehicles and other complex equipment
US10/871,249 2004-06-17

Publications (2)

Publication Number Publication Date
WO2006009591A2 WO2006009591A2 (en) 2006-01-26
WO2006009591A3 true WO2006009591A3 (en) 2006-12-14

Family

ID=35481748

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/009304 WO2006009591A2 (en) 2004-06-17 2005-03-17 Interactive manual, system and method for vehicles and other complex equipment

Country Status (5)

Country Link
US (2) US7720680B2 (en)
EP (1) EP1766612B1 (en)
JP (1) JP4689670B2 (en)
KR (1) KR101053748B1 (en)
WO (1) WO2006009591A2 (en)

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7672965B2 (en) * 2003-02-24 2010-03-02 Avaya, Inc. Finite-state machine augmented for multiple evaluations of text
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8320649B2 (en) 2006-05-25 2012-11-27 Elminda Ltd. Neuropsychological spatiotemporal pattern recognition
US9318108B2 (en) * 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
WO2009069135A2 (en) * 2007-11-29 2009-06-04 Elminda Ltd. System and method for neural modeling of neurophysiological data
US20080312929A1 (en) * 2007-06-12 2008-12-18 International Business Machines Corporation Using finite state grammars to vary output generated by a text-to-speech system
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US20100330909A1 (en) * 2009-06-25 2010-12-30 Blueant Wireless Pty Limited Voice-enabled walk-through pairing of telecommunications devices
US20100332236A1 (en) * 2009-06-25 2010-12-30 Blueant Wireless Pty Limited Voice-triggered operation of electronic devices
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9934306B2 (en) * 2014-05-12 2018-04-03 Microsoft Technology Licensing, Llc Identifying query intent
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9966065B2 (en) * 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US9552519B2 (en) * 2014-06-02 2017-01-24 General Motors Llc Providing vehicle owner's manual information using object recognition in a mobile device
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. Far-field extension for digital assistant services
US10633006B2 (en) * 2018-04-24 2020-04-28 Ford Global Technologies, Llc Method and apparatus for adaptive vehicle feature recommendations
US11842729B1 (en) * 2019-05-08 2023-12-12 Apple Inc. Method and device for presenting a CGR environment based on audio data and lyric data
US11631283B2 (en) * 2019-06-27 2023-04-18 Toyota Motor North America, Inc. Utilizing mobile video to provide support for vehicle manual, repairs, and usage
DE102019122730A1 (en) * 2019-08-23 2021-02-25 Bayerische Motoren Werke Aktiengesellschaft Electronic instruction manual
US11150923B2 (en) * 2019-09-16 2021-10-19 Samsung Electronics Co., Ltd. Electronic apparatus and method for providing manual thereof
KR20220060627A (en) * 2020-11-04 2022-05-12 현대자동차주식회사 Vehicle control system and vehicle control method
KR102465228B1 (en) * 2021-11-24 2022-11-09 인하대학교 산학협력단 Complex Machinery Training and Education and Advertising System in Mixed Reality Using Metaverse Platform
KR102438743B1 (en) 2022-03-02 2022-08-31 인하대학교 산학협력단 Method and Apparatus for Converting 3D Manuals into 2D Interactive Videos for Cloud Service

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050108249A1 (en) * 2003-11-19 2005-05-19 Atx Technologies, Inc. Wirelessly delivered owner's manual
US20050216458A1 (en) * 2004-03-25 2005-09-29 Morris Steven E Apparatus and methods for interactively displaying information relating to a vehicle

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781913A (en) * 1991-07-18 1998-07-14 Felsenstein; Lee Wearable hypermedium system
US5748841A (en) 1994-02-25 1998-05-05 Morin; Philippe Supervised contextual language acquisition system
US6418431B1 (en) 1998-03-30 2002-07-09 Microsoft Corporation Information retrieval and speech recognition based on language models
JPH11312032A (en) * 1998-04-28 1999-11-09 Hitachi Ltd Interactive help system, method therefor and storage medium stored with program related with the method
GB9821969D0 (en) * 1998-10-08 1998-12-02 Canon Kk Apparatus and method for processing natural language
US20050131695A1 (en) * 1999-02-04 2005-06-16 Mark Lucente System and method for bilateral communication between a user and a system
US6330499B1 (en) 1999-07-21 2001-12-11 International Business Machines Corporation System and method for vehicle diagnostics and health monitoring
US6526335B1 (en) 2000-01-24 2003-02-25 G. Victor Treyz Automobile personal computer systems
GB2366010B (en) 2000-03-23 2004-11-17 Canon Kk Machine interface
JP2002014751A (en) * 2000-06-28 2002-01-18 Nec Corp On-line help system
US20020154161A1 (en) * 2001-02-01 2002-10-24 Friedman Michael A. Method and system for providing universal remote control of computing devices
US20030155413A1 (en) * 2001-07-18 2003-08-21 Rozsa Kovesdi System and method for authoring and providing information relevant to a physical world
US6975994B2 (en) * 2001-09-12 2005-12-13 Technology Innovations, Llc Device for providing speech driven control of a media presentation
US7493559B1 (en) * 2002-01-09 2009-02-17 Ricoh Co., Ltd. System and method for direct multi-modal annotation of objects
US9374451B2 (en) * 2002-02-04 2016-06-21 Nokia Technologies Oy System and method for multimodal short-cuts to digital services
US6990639B2 (en) * 2002-02-07 2006-01-24 Microsoft Corporation System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration
US7552140B2 (en) * 2002-07-25 2009-06-23 Temic Automotive Of North America, Inc. Smart owner's manual
US7302383B2 (en) * 2002-09-12 2007-11-27 Luis Calixto Valles Apparatus and methods for developing conversational applications
JP2004139446A (en) * 2002-10-18 2004-05-13 Inst Of Physical & Chemical Res Secretary agent system for use with ordinary language computer system, secretary agent program, and method of planning dialogue
US6845338B1 (en) * 2003-02-25 2005-01-18 Symbol Technologies, Inc. Telemetric contextually based spatial audio system integrated into a mobile terminal wireless system
JP2005014751A (en) 2003-06-26 2005-01-20 Honda Motor Co Ltd Mounting device of wheel disk and axle hub in wheel
US7308341B2 (en) * 2003-10-14 2007-12-11 Donnelly Corporation Vehicle communication system
US20050131892A1 (en) * 2003-12-10 2005-06-16 Sbc Knowledge Ventures, L.P. Natural language web site interface
US20050203748A1 (en) * 2004-03-10 2005-09-15 Anthony Levas System and method for presenting and browsing information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050108249A1 (en) * 2003-11-19 2005-05-19 Atx Technologies, Inc. Wirelessly delivered owner's manual
US20050216458A1 (en) * 2004-03-25 2005-09-29 Morris Steven E Apparatus and methods for interactively displaying information relating to a vehicle

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1766612A4 *

Also Published As

Publication number Publication date
EP1766612A2 (en) 2007-03-28
EP1766612A4 (en) 2009-05-06
KR101053748B1 (en) 2011-08-02
WO2006009591A2 (en) 2006-01-26
JP4689670B2 (en) 2011-05-25
KR20070022393A (en) 2007-02-26
EP1766612B1 (en) 2018-09-12
US20050283363A1 (en) 2005-12-22
US9263037B2 (en) 2016-02-16
US20100250237A1 (en) 2010-09-30
JP2008507007A (en) 2008-03-06
US7720680B2 (en) 2010-05-18

Similar Documents

Publication Publication Date Title
WO2006009591A3 (en) Interactive manual, system and method for vehicles and other complex equipment
WO2004075027A3 (en) A method for form completion using speech recognition and text comparison
WO2002054033A3 (en) Hierarchical language models for speech recognition
AU2002211438A1 (en) Language independent voice-based search system
EP0955628A3 (en) A method of and a device for speech recognition employing neural network and Markov model recognition techniques
WO2008045144A3 (en) Gesture recognition method and apparatus
WO2004061820A3 (en) Method and apparatus for selective distributed speech recognition
WO2004086359A3 (en) System for speech recognition and correction, correction device and method for creating a lexicon of alternatives
WO2007134293A3 (en) Wordspotting system
WO2006099626A3 (en) System and method for providing interactive feature selection for training a document classification system
WO2008028029A3 (en) Method and system for providing an automated web transcription service
CN105095186A (en) Semantic analysis method and device
CA2520420A1 (en) Apparatus and method for spoken language understanding by using semantic role labeling
WO2006034200A3 (en) Method and system for the automatic generation of speech features for scoring high entropy speech
WO2006107586A3 (en) Method and system for interpreting verbal inputs in a multimodal dialog system
WO2005008465A3 (en) Method and system for integrating multi-modal data capture device inputs with multi-modal output capabilities
WO2006071357A3 (en) Method and system for resolving cross-modal references in user inputs
EP2306345A3 (en) Speech retrieval apparatus and speech retrieval method
WO2004066200A3 (en) Reactive animation
CN109241330A (en) The method, apparatus, equipment and medium of key phrase in audio for identification
WO2005055001A3 (en) Method for assisting in automated conversion of data and associated metadata
WO2007143262A3 (en) Interactive tool for semi-automatic generation of a natural language grammar from a device descriptor
WO2005013099A3 (en) A system and method for enabling automated dialogs
WO2004095419A3 (en) System and method for text-to-speech processing in a portable device
WO2004100126A3 (en) Method for statistical language modeling in speech recognition

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005725969

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007516462

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077001067

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 1020077001067

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2005725969

Country of ref document: EP