WO2011044429A1 - Speech generation device with separate display and processing units for use with wheelchairs - Google Patents

Speech generation device with separate display and processing units for use with wheelchairs Download PDF

Info

Publication number
WO2011044429A1
WO2011044429A1 PCT/US2010/051929 US2010051929W WO2011044429A1 WO 2011044429 A1 WO2011044429 A1 WO 2011044429A1 US 2010051929 W US2010051929 W US 2010051929W WO 2011044429 A1 WO2011044429 A1 WO 2011044429A1
Authority
WO
WIPO (PCT)
Prior art keywords
display unit
wheelchair
generation device
speech generation
display
Prior art date
Application number
PCT/US2010/051929
Other languages
French (fr)
Inventor
Bob Cunningham
Jeff Holt
Rick Severa
Dan Sweeney
Dave Lee
Jason Mccullough
Original Assignee
Dynavox Systems, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dynavox Systems, Llc filed Critical Dynavox Systems, Llc
Publication of WO2011044429A1 publication Critical patent/WO2011044429A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61GTRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G5/00Chairs or personal conveyances specially adapted for patients or disabled persons, e.g. wheelchairs
    • A61G5/04Chairs or personal conveyances specially adapted for patients or disabled persons, e.g. wheelchairs motor-driven
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61GTRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G2203/00General characteristics of devices
    • A61G2203/10General characteristics of devices characterised by specific control means, e.g. for adjustment or steering
    • A61G2203/18General characteristics of devices characterised by specific control means, e.g. for adjustment or steering by patient's head, eyes, facial muscles or voice

Definitions

  • the present invention generally pertains to speech generation devices, and more particularly to speech generation devices including separate display and processing units for use with wheelchairs.
  • Speech generation devices can include a variety of features to assist with a user's communication.
  • a speech generation device may include an electronic interface with specialized software configured to permit the creation and manipulation of digital messages that can be translated into audio speech output. Additional communication-related features may also be provided depending on user preferences and abilities. Users may provide input to a speech generation device by physical selection using a touch screen, mouse, joystick, physical switch inputs or the like or by other means such as eye tracking or head tracking.
  • the size of a conventional speech generation device is often quite substantial, having extended widths and/or profiles beyond that of the width or profile of the display unit to accommodate all the necessary and/or optional features of the SGD.
  • an SGD since an SGD must generally be disposed in a location that provides the user visual access to its display, such bulky devices may potentially block a user's view to other objects in his environment and may also obscure the user from others. This potential restriction of a user's visual vantage can sometimes be awkward for a user, particularly when the user's mobility within the wheelchair is limited (e.g., the ability of the user to adjust his seating position).
  • such integrated speech generation devices may restrict a user's ability to perform other tasks while using the SGD. Accordingly, a need exists to reduce the potential restriction of a user's view while utilizing an SGD.
  • conventional speech generation devices provide limited design flexibility pertaining to mounting or otherwise installing such devices on a wheelchair.
  • design options for current devices are, for the most part, limited to determining how to mount the integrated device with respect to the user.
  • integrated SGDs also make it more difficult for a user to upgrade specific components of the SGD without purchasing a brand new device, such as upgrading the size of the display unit.
  • a further need exists to increase the design flexibility related to configuring an SGD for installation on an wheelchair as well as to increase the upgradeability of an SGD.
  • the present subject matter is directed to various exemplary speech generation devices (SGDs) having separate display and processing units for use with wheelchair applications.
  • SGDs speech generation devices
  • exemplary speech generation devices in accordance with aspects of the presently disclosed technology may include a separate display unit mounted to a wheelchair.
  • the display unit may be mounted to the wheelchair in a location relative to its user so as to provide the user direct visual access to the display unit.
  • the SGD may include a processing unit provided in a distal relationship with the display unit.
  • the central processing unit may be disposed in a separate housing module located on or within the wheelchair.
  • the separate display unit and associated processing unit may enable the SGD to transmit and receive messages to assist a user in
  • the SGD may correspond to a particular special-purpose electronic device that permits a user to communicate with others by producing digitized or synthesized speech based on configured messages.
  • Such messages may be preconfigured and/or selected and/or composed by a user within a message window viewable on the display device associated with the speech generation device.
  • the separate display unit may be mounted to the wheelchair at numerous locations and may have varying mounting configurations.
  • a support member may be secured to a portion of the wheelchair and configured to support the SGD in a position providing visual access of the display unit to a user.
  • the support member may include adjustment features that permit the position of the display unit to be altered relative to the user and/or the wheelchair.
  • the support member may be hinged or include rotatable components.
  • the processing unit of the SGD may be disposed at varying locations relative to the display unit.
  • the processing unit may be housed in a housing module located on an exterior portion of the wheelchair, such as being mounted underneath an armrest of the wheelchair or being secured to the frame of the wheelchair, or within an interior portion of the wheelchair, such as the motor housing of the wheelchair.
  • the processing unit may be communicatively connected to the separately disposed display unit via a wired or wireless connection.
  • the disclosed SGD provides numerous advantages for a user confined to the wheelchair.
  • the SGD includes a display unit separate from the processing unit, the display unit may have a smaller profile than an integrated unit and, thus, may be less likely to block the user's field of view.
  • the separate display unit may be much lighter than an integrated SGD and thereby reduce the likelihood of damage to the SGD or harm to the user if it falls.
  • separation of the components of the SGD enables greater design flexibility for providing an SGD that may be customized to meet the demands of a particular user. This feature may also allow a greater of number of standard models to be offered to potential users (e.g., devices including differing display sizes and processor configurations) and may further permit existing users to upgrade their devices with greater ease and less expense.
  • a joystick of the wheelchair may be communicatively coupled to the processing unit of the
  • SGD and may permit a user to make input selections for the speech generation device.
  • Such dual function input devices may allow even further design flexibility for SGD providers and may also simplify operation of the SGD for a user.
  • the SGD may be configured to be powered via the same battery used to supply power to the wheelchair.
  • the disclosed SGD may enjoy a significantly longer battery life than most conventional SGDs.
  • the display unit may include a transparent OLED display, which may provide further benefits for the user of an SGD, Specifically, a user can interact with and use the speech generation device while eliminating or reducing the potential visual restriction that would accompany a non-transparent display. For example, the user could look at the transparent SGD display to view communication-related information and also be able to view his environment. In addition, other people in a user's environment may be better able to see and interact with the user due to the transparent display. Still further, the user may be better able to engage in other activities, for example watching television, making a phone call, holding a conversation, etc. while still having access to the communication functionality of his speech generation device.
  • the display unit may include a touch screen formed on one or more surfaces of the display.
  • the SGD may also be outfitted with eye tracking features that can sense a user's eye location and action (e.g., blinking, dwelling, etc.) such that the user can employ eye actions to cause input selection for the speech generation device.
  • eye tracking features e.g., blinking, dwelling, etc.
  • a variety of other physical input devices and software interface features may also be provided to facilitate the capture of user input to define what information should be displayed in a message window and ultimately communicated to others as spoken output, text message, phone call, e-mail or other outgoing communication.
  • the SGD may further include various communications devices and/or modules and related communications functionality,
  • FIG. 1 provides a side view of an embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 2 provides a perspective view of another embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 3 provides a perspective view of a further embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 4 provides a perspective view of yet another embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 5 provides a schematic diagram of hardware components that may be used within various embodiments of a speech generation device in accordance with aspects of the present subject matter
  • FIG. 6 provides a front view of an embodiment of a separate display unit for mounting on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 7 provides a front view of another embodiment of a separate display unit for mounting on a wheelchair in accordance with aspects of the present subject matter
  • FIG. 8 provides a front view of an embodiment of a transparent display unit having a front touch screen feature in accordance with aspects of the present subject matter
  • FIG. 9 provides a front view of an embodiment of a transparent display unit having a rear touch screen feature in accordance with aspects of the present subject matter
  • FIG. 10 provides a front view of an embodiment of a display unit having speakers and eye tracking features mounted within the display unit in accordance with aspects of the present subject matter.
  • FIGS. 1-4 illustrate exemplary embodiments of a speech generation device ("SGD") 100 as installed on an electric or power wheelchair 110 in accordance with aspects of the present subject matter.
  • SGD speech generation device
  • the SGD 100 may include a display unit 102 mounted to the wheelchair 1 10 and a central processing unit 104 provided in a distai relationship with the display unit 102.
  • the display unit 102 may be mounted in a location relative to a user 106 of the wheelchair 110 so as to provide the user 106 direct visual access to the display unit 02.
  • the central processing unit 104 generally may be disposed in a separate housing module 108 and may be configured to enable the SGD 100 to transmit and receive messages to assist the user 106 in communicating with others.
  • the SGD 100 may further include various other features and/or components disposed within the housing module 108, mounted or embedded within the display unit 102 or otherwise secured to portions of the wheelchair 110, as will be described in greater detail below.
  • FIGS. 1 -4 illustrate many of the typical features found in a power/electric wheelchair 10.
  • the wheelchair 1 10 may include a base or frame 112 and a seat 1 14 supported by the frame 112.
  • the seat 114 may be manufactured as several different components including a seat bottom, backrest, and headrest.
  • a pair of drive wheels 116 and at least one pair of driven wheels 118 may be rotatably connected to the frame 1 12. Additionally, at least one motor (not illustrated), disposed in a motor housing 120 under the seat 114, may be mechanically coupled to each drive wheel 1 16 through a shaft (not illustrated) to provide independent operation of the drive wheels 116 for desired steering. A battery (not illustrated) may also be installed within the motor housing 120 to supply power to the motors. Generally, during operation, steering and increases/decreases in speed may be effectuated by utilizing a joystick 122 mounted on or adjacent to one of the armrests 124 of the wheelchair 1 10. As is generally understood, the joystick 122 may be electrically coupled to a
  • microprocessor that controls the operation of the motors and any other associated steering and/or braking mechanisms.
  • a support member 130 may be provided between the wheelchair 1 10 and the display unit 102.
  • the support member 130 may comprise any structure or mechanism configured to support the display unit 102 in a position that provides the user visual access to the display unit 102,
  • a first end of the support member 130 may be rigidly secured to any portion of the wheelchair 110 including, but not limited to, the frame 112, motor housing 120, seat 114 or armrests 124 of the wheelchair 1 10 and a second end of the support member 130 may be rigidly secured to the display unit 102.
  • the support member 130 may be secured to the frame 1 12 of the wheelchair 110 and extend vertically along a side of the wheelchair 1 10, such as adjacent to one of the armrests 124, so as to properly position the display unit 102 relative to the user 106.
  • the support member 130 may be secured to the frame 112 and extend vertically along the back of the wheel chair 1 10, such as along the back of the seat 114, to enable the display unit 102 to be suspended in front of the user 106.
  • numerous other mounting configurations may be utilized to mount the display unit 102 to the wheelchair 1 10.
  • the support member 130 may be removably or non-removably secured to the wheelchair 1 10 and/or the display unit 102 by any suitable means, such as by welding, screws, bolts, clamps, mounting brackets or any other suitable attachment device and/or mechanism.
  • the support member 130 may include a plurality of arms 132 configured to be attached to one another.
  • a first arm 132a may be secured to the wheelchair 1 10 and extend outwardly therefrom.
  • a second arm 132b may be attached to the first arm 132a and may extend vertically to any desired height, such as a height substantially equal to that of the user's eye location 107 (FIG. 1 ) or some predetermined portion thereof.
  • the height of the second arm 132b may be configured to align the user's eye location 107 with any sensor and/or camera components of the eye tracker.
  • a third arm 132c may be attached to the second arm 132b and may extend horizontally across the wheelchair 110 to position the display unit 102 in front of the user 106.
  • the arms 132 of the support member 130 may be formed from any suitable material.
  • the arms 132 may be formed from a substantially rigid, durable material including, but not limited to, various plastics, thermoplastics, polymers, poiyethylenes, resins, metals, or any combinations thereof.
  • one or more of the arms 132 may be formed from a flexible material that permits the support member 130 to be bowed, bent or otherwise manipulated to assure proper positioning of the attached display unit 02.
  • the arms 132 may have any suitable cross-section.
  • the arms 132 may have a circular, elliptical, rectangular or similarly shaped cross-section that is either hollow, solid or semisolid.
  • the support member 130 may further include adjustment features that permit the position of the display unit 102 to be adjusted depending on, for example, the height, seating posture, and/or eye location 107 of the user 106.
  • the arms 132 of the support member 130 may be configured to have adjustable lengths.
  • one or more of the arms 132 may include telescoping features 133 or may otherwise be slidably mounted to an adjacent arm 132 to permit portions of the support member 130, generally illustrated by the arrows, to be extended or shortened as necessary to provide a user 106 optimal visual access to the display unit 102
  • the second arm 132b may include a telescoping feature 133 or other suitable adjustment mechanism that permits the vertical position of the display unit 102 to be adjusted relative to the user 106.
  • the third arm 132c may include a telescoping feature 133 or other suitable adjustment mechanism to allow the position of the display unit 102 to be altered horizontally (e.g., in a direction across the user's field of view).
  • the support member 30 may also include one or more pivoted or hinged attachment features 134 to allow further adjustments to be made to the position of the display unit 102 relative to the user 106.
  • the hinged features 134 may comprise any suitable mechanism known in the art for providing pivotal and/or hinged attachment between two components.
  • hinged attachment features 134 may be disposed between adjacent arms 132 of the support member 130 to permit the angle of one arm 132 to be adjusted relative to another.
  • a hinged attachment feature 134 may also be disposed at the interface of the display unit 102 and the support member 130 to permit the orientation of the display unit 102 to be adjusted relative to the support member 130.
  • the hinged attachment features 134 may include set screws, locking pins or other suitable locking devices to maintain the support member 130 and/or display unit 102 in a fixed location once desired positioning of the display unit 102 has been achieved.
  • the hinged attachment features 134 may be configured to maintain the support member 103 and/or display unit 102 in a fixed location absent an input force (e.g., a friction hinge or detent hinge).
  • the support member 130 may include one or more rotational attachment mechanisms 135 that allow the support member 130 and/or or the display unit 102 to be rotated relative to one another and/or relative to the user 106.
  • a rotational attachment mechanism 135, such as a shoulder joint or any other suitable mechanism for providing rotational attachment between two components, may be disposed between adjacent arms 132 to provide for rotation therebetween.
  • a rotational attachment mechanism 1335 such as a shoulder joint or any other suitable mechanism for providing rotational attachment between two components
  • the rotational attachment mechanism 135 may be disposed at the interface between the support member 130 and the display unit 102 to allow the display unit 102 to be rotated relative to the support member 130. Additionally, similar to hinged attachment features 134 described above, the rotational attachment mechanisms 135 may also include set screws, locking pins or other suitable locking devices to maintain the support member 130 and/or display unit 102 in a fixed location once desired positioning of the display unit 102 has been achieved. Alternatively, the rotational attachment mechanism 135 may simply be configured to maintain the support member 30 and/or display unit 102 in a fixed location absent an input force (e.g., due to frictional engagement of the components of the attachment mechanism).
  • the central processing unit 104 of the SGD 100 may generally be disposed within a housing module 108 which is physically separated from the display unit 102.
  • housing module 108 which is physically separated from the display unit 102.
  • the housing module 108 comprises a completely separate and detached component from the display unit 102.
  • the term "physically separated” does not mean that the housing module 108 may not be electrically and/or communicartively connected to the display unit 102, such as through a power and/or communciative cable.
  • the housing module 108 may be disposed at any location on or in the wheelchair 1 10 that permits communication between the processing unit 104 and display unit 102 via a wired or wireless communication.
  • the housing module 108 may be disposed, as shown in FIG. 2, under or behind the seat 1 14 of the wheelchair 1 10 or, as shown in FIG. 3 in a cut-away view, within the motor housing 120 of the wheel chair 110.
  • the housing module 108 may be secured to the underside of one of the armrests 124, as shown in FIG. 1 , or secured to the outside of the frame 1 12, as shown in FIG. 4.
  • the housing module 108 may be located at various other positions on the wheelchair 1 10.
  • the housing module 108 may generally form a protective casing or covering for the central processing unit 102 and any functional components and/or other features of the SGD 00 disposed therein or mounted thereon.
  • the housing module 108 be formed or molded from any substantially rigid and/or durable material.
  • the housing module 108 may be formed from a material such as but not limited to plastic, thermoplastic, polymer, polyethylene, metal, or resin materia!.
  • the housing module 108 may be formed from magnesium or an alloy thereof.
  • the housing module 108 when magnesium is used to make the housing module 108, it may provide several advantages for an SGD 100 including but not limited to additional conductive and radiated immunity, shielding from electromagnetic interference (EMI) signals, heat dissipation features for an SGD, and greater structural integrity with low weight. Additionally, it should be appreciated that, in one embodiment, the housing module 108 may be rendered liquid impermeable when formed. [0044] The housing module 108 may also define various openings to
  • openings may be defined through the housing module 108 to provide locations for power buttons, volume control knobs, USB ports for coupling any peripheral devices of the SGD 100 to the central processing unit 102 and various other data input/output ports. Further, openings may also be defined through the housing module 108 to permit the mounting or embedding of various output devices of the SGD 100. For example, as shown in FIG. 1 , one or more speakers 136 may be mounted within an opening defined in the housing module 108.
  • any buttons, control knobs, ports and the like may be provided in an alternative location more accessible to the user (e.g., on the display unit 102 or on the armrests 124 of the wheelchair) and then interfaced with the processing unit 102 within the housing module 108 by any suitable means.
  • an SGD 100 in accordance with aspects of the present subject matter will now be described with reference to FIG. 5.
  • the electronic components may include a combination of hardware, software and/or firmware elements, all of which either correspond to physical tangible apparatuses or which are embedded as instructions on a physical and tangible apparatus such as a computer-readable storage medium.
  • embodiments of the SGD 100 in accordance with the present subject matter should not be limited by the complete spectrum of hardware and software components described herein. Instead, an SGD 100 may selectively incorporate one or more of such disclosed features and steps and others to create additional and alternative embodiments.
  • the electronic components of an SGD 100 enable the device to transmit and receive messages to assist a user 106 in communicating with others.
  • the SGD 100 may correspond to a particular special-purpose electronic device that permits a user 106 to communicate with others by producing digitized or synthesized speech based on configured messages.
  • Such messages may be preconfigured and/or selected and/or composed by a user 106 within a message window provided as part of the speech generation device user interface, such as on the display unit 102.
  • a variety of physical input devices and software interface features may be provided to facilitate the capture of user input to define what information should be displayed in a message window of the display unit 102 and ultimately communicated to others as spoken output and/or other outgoing communication.
  • the SGD 100 may generally comprise a separate display unit 102 and a central processing unit 104 including a variety of internal components. As indicated above, the display unit 102 may be positioned relative to a user 106 so as to have distal relationship with the central processing unit 104 (indicated by the dashed line). Additionally, the SGD 100 may include a plurality of peripheral devices. Generally, it should be appreciated that, in addition to the specific devices discussed herein, any peripheral hardware device 48 may be provided and interfaced to the SGD 100 via a USB port 150 or other
  • Fig. 5 may be provided in different configurations and may be provided with different arrangements of direct and/or indirect physical and communicative links to perform the desired functionality of such components.
  • Power to the components of the SGD100 generally may be provided from a battery 140 such as but not limited to a lithium polymer battery or any other rechargeable energy source.
  • a battery 140 such as but not limited to a lithium polymer battery or any other rechargeable energy source.
  • power may be supplied to the central processing unit 104, the display unit 102, and any other components of the SGD 00 from the battery used to supply power to the wheelchair 110.
  • a suitable adaptor or converter may be coupled between the wheelchair battery and any powered components to provide stable DC electric power to such components at the required voltages.
  • the various components of the SGD 100 may be powered by a separate power supply, such as a battery 140 disposed within the housing module 108.
  • multiple power sources may be utilized to supply electric power to the various SGD components.
  • a first battery 140 may be provided to supply power to the display unit 102, while a second battery 140 supplies power to the processing unit 104 and any other peripheral devices.
  • a power switch or button 144 may be provided as an interface to toggle the power connection between the battery 140 and any powered components.
  • Such power button 144 in one embodiment, may be located in an opening defined in the housing module 108. In other embodiments, particularly when the housing module 108 is stored out of reach of the user 106, the power button 144 may be disposed at any location accessible to the user 106, such as on the display unit 102 or on portions of the wheelchair 1 10 (e.g., the armrests 124 or the joystick 122).
  • the central processing unit 104 is provided to function as the central controller within the SGD 100 and may generally include such components as at least one memory/media element or database for storing data and software instructions as well as at least one processor.
  • one or more processor(s) 138 and associated memory/media devices 142a and 142b are configured to perform a variety of computer-implemented functions (i.e., software- based data services).
  • One or more processor(s) 138 within the processing unit 104 may be configured for operation with any predetermined operating systems, such as but not limited to Windows XP, and thus is an open system that is capable of running any application that can be run on Windows XP.
  • Other possible operating systems include BSD UNIX, Darwin (Mac OS X), Linux, SunOS
  • At least one memory/media device (e.g., device 142a in Fig. 5) is dedicated to storing software and/or firmware in the form of computer-readable and executable instructions that will be implemented by the one or more
  • processor(s) 138 Other memory/media devices (e.g., memory/media devices 142b) are used to store data which also will be accessible by the processor(s) 138 and which will be acted on per the software instructions stored in memory/media device 142a.
  • the various memory/media devices of Fig. 5 may be provided as single or multiple portions of one or more varieties of computer-readable media, such as but not limited to any combination of volatile memory (e.g., random access memory (RAM), such as DRAM, SRAM, etc.) and nonvolatile memory (e.g., ROM, flash, hard drives, magnetic tapes, CD-ROM, DVD-ROM, etc.) or any other memory devices including diskettes, drives, other magnetic-based storage media, optical storage media and others.
  • volatile memory e.g., random access memory (RAM), such as DRAM, SRAM, etc.
  • nonvolatile memory e.g., ROM, flash, hard drives, magnetic tapes, CD-ROM, DVD-ROM, etc.
  • At least one memory device corresponds to an electromechanical hard drive and/or or a solid state drive (e.g., a flash drive) that easily withstands shocks, for example that may occur if the housing module 108 is dropped or falls from its position on the wheelchair 1 0.
  • a solid state drive e.g., a flash drive
  • FIG. 5 shows two separate memory/media devices 142a and 142b, the content dedicated to such devices may actually be stored in one memory/media device or in multiple devices. Any such possible variations and other variations of data storage will be appreciated by one of ordinary skill in the art.
  • a first portion of memory/media device 142b is configured to store input data received from a user 106 for performing the desired functional steps associated with a speech generation device 100.
  • data in memory 142b may include inputs received from one or more peripheral devices, including but not limited to a touch screen 146 of the display unit 102, a microphone 154 and other peripheral devices 152, which indicate a user's selections of text to be spoken by the SGD 100 or other related output actions.
  • Memory device 142a includes computer- executable software instructions that can be read and executed by processor(s) 138 to act on the data stored in memory/media device 142b to create new output data (e.g., audio signals, display signals, RF communication signals and the like) for temporary or permanent storage In one of the memory/media devices.
  • output data may be communicated to a peripheral output device, such as the display unit 102, the speakers 136, an antenna 156, a cellular phone or RF device 158, or a wireless network adapter 160, or as control signals to still further components.
  • the antenna 156 may be provided to facilitate wireless communications with other devices in accordance with one or more wireless communications protocols, including but not limited to BLUETOOTH, WI-FI (802.11 b/g) and 2IGBEE wireless communication protocols.
  • a dedicated communications interface module 162 may be provided within the central processing unit 102 to provide a software interface from the processing unit 102 to the communication device(s).
  • communications interface module 162 includes computer instructions stored on a computer- readable medium as previously described that instruct the communications devices how to send and receive communicated wireless or data signals.
  • various input devices may be part of an SGD 100 and thus coupled directly to the processing unit 104 or coupled indirectly to the processing unit 104 through another component, such as the display unit 102.
  • a touch screen 146 may be provided on the display unit 102 to capture user inputs directed to a display location by a user's hand or stylus.
  • a microphone 154 for example a surface mount CMOS/MEMS silicon-based microphone or others, may be provided to capture user audio inputs.
  • Other exemplary input devices e.g., peripheral device 152 may include but are not limited to a peripheral keyboard, peripheral touch-screen monitor, peripheral microphone, eye gaze controller, mouse and the like.
  • the different types of input devices are configured with software instructions to accept user inputs in accordance with one or more access methods.
  • a user input selection is made upon contact and/or release of contact with a touch screen 146.
  • switches in combination with visual scanning and/or auditory cues may be employed for user input selections.
  • eye tracking features are provided such that selections are made simply by gazing at the display unit 102 and implementing selection based on dwell time, eye blinking or external switch activation.
  • a joystick may be included as an optional peripheral device 138 for the SGD 100.
  • a joystick may be coupled to the processing unit 04, such as through a USB port 50, and used to move a pointer around the display unit 102, with selections being made with a button on the joystick.
  • the joystick 122 used to control the operation of the wheelchair 110 may also be configured to allow a user 106 to navigate through the communication pages provided by the display unit 102.
  • a switch may be provided in any convenient location on the wheelchair 110, such as on or adjacent to one of the armrests 124 or on or adjacent to the joystick 122, to permit a user 06 to toggle the electrical connection of the joystick 122 between the microprocessor controiling the motors of the wheelchair 110 and the central processing unit 104 of the SGD 100.
  • the wheelchair joystick 122 may also be modified to include a button or other input device to provide the user 106 a means for making selections based on options displayed on a communications page of the display unit 102.
  • the SGD hardware components may also include multiple output devices including but not limited to the display unit 102 and any speakers 136 necessary for transmitting speech output from the SGD 100.
  • the display unit 102 may include a display panel 170 that serves as the output feature for the display unit 102.
  • the display panel 1 0 may correspond to any suitable monitor, screen or other output device for presenting visual information to the user 106.
  • Suitable examples may include, but are not limited to, a light-emitting diode (LED) display, electroluminescent display (ELD), plasma display panel (PDP), and liquid crystal display (LCD).
  • LED light-emitting diode
  • ELD electroluminescent display
  • PDP plasma display panel
  • LCD liquid crystal display
  • One particular embodiment corresponds to an LCD such as an LW500AC9001 component offered for sale by Chi Mei Optoelectronics (CMO) of Taiwan.
  • CMO Chi Mei Optoelectronics
  • the display panel 170 of the display unit 102 may comprise an Organic Light-Emitting Diode (OLED) display.
  • OLED Organic Light-Emitting Diode
  • an OLED display employs an LED capable of light- emitting in one or more layers of organic material (i.e., the emissive layer(s)) by movement and re-combination of electrons (negative charges) with holes (positive charges).
  • voltage potential is applied to such a device, negatively charged electrons move from a cathode layer through an intermediate layer into the emissive layer(s).
  • positively charged holes move from an anode layer through an intermediate layer and into the same organic light-emitting layer.
  • the positive and negative charges meet in the emissive layer(s) of organic material, they combine and produce photons having a frequency falling within the spectrum of visible light to provide a desired display.
  • OLED displays may offer numerous advantages for an SGD 100 relative to conventional displays.
  • a display panel 170 configured as an OLED may generally require a low activation or driving voltage, thus providing for longer battery life, self-luminescence without necessitating a backlight, reduced thickness, wide viewing angle, fast response speed, high contrast, greater brightness and color, superior impact resistance, ease of handling, etc.
  • the reduced weight and power requirements of an OLED display provide particular advantages for the SGD 100 of the present subject matter. For example, a more lightweight and efficient device may help to increase a potential user's mobility and duration of assisted communication.
  • durability and impact resistance may also provide benefits for a display unit 102 incorporating a touch screen 146, especially for users 106 who may have trouble controlling input force applied to a speech generation device.
  • the display panel 170 of the display unit 102 may comprise an OLED configured as a transparent display.
  • a "transparent" display means a medium that is capable of transmitting at least some light so that objects or images can be seen fully or at least partially through the transparent display.
  • Transparent OLED devices i.e., TOLED devices
  • Such devices use transparent electrodes, substrates and other layers to ensure that the resulting display is at least partially and preferably fully transparent to a user 106.
  • a TOLED display may be fully transparent in the off-state and within a range of between about 50-80% transparent during active operation.
  • a transparent OLED (TOLED) display may provide additional benefits for the user 106 of a speech generation device 100.
  • a user 106 can interact with and use the speech generation device 100 while eliminating or reducing potential visual restriction that would accompany a non-transparent display.
  • a user 106 could look at the transparent SGD display to view communication-related information, optionally make visual input selections using eye tracking features associated with the SGD 100 and also be able to view his environment.
  • other people in a user's environment are better able to see and interact with the user 106 because of the transparent display.
  • a user will be better able to engage in other activities, for example watching television, making a phone call, holding a conversation, etc. while still having access to the communication functionality of his speech generation device 100.
  • the display unit 102 of the present subject matter may include a display frame 172 substantially surrounding and supporting the display panel 170.
  • the display frame 172 may be configured to provide a protective housing for the display panel 170.
  • the frame 172 may be formed from any suitable durable and/or substantially rigid material including, but not limited to, various plastics, thermoplastics, polymers, polyethylenes, metals, or resin materials.
  • the frame 72 may be further
  • the display frame 172 may be hingedly and/or rotatably attached to the support member 130 to allow proper positioning/adjustment of the display unit 102 relative to the user 106.
  • the support member 130 may be secured to the frame 170 at any location, including the top and sides of the frame, and, thus, need not be limited to being secured to the bottom of the frame 170 as shown in FIG. 6.
  • the display unit 102 may also include a back cover plate ⁇ not illustrated) that covers and/or protects the backside of the display panel 170 to prevent damage thereto.
  • the support member 130 may also be secured to the back cover plate to provide additional flexibility in mounting the display unit 102.
  • FIG. 7 A further embodiment of a display unit 102 is illustrated in FIG. 7.
  • the display unit 102 may be configured as a frameless OLED or TOLED display panel.
  • the display panel 170 corresponds to either a non-transparent OLED substrate or a substantially transparent OLED substrate that does not include any structural support or frame around the outer perimeter of the substrate as shown in FIG. 6.
  • a base element 174 may be provided along the entirety or just a portion of a single edge of the display panel 170.
  • Such base element 174 may be configured to provide mechanical support for the frameless display unit 102 and also may be configured to be secured to the support member 130 for mounting the display unit 102 to the wheelchair 110.
  • any functional components related to the display unit 102 such as but not limited to driving circuitry for the display panel 170, may be housed at any suitable location relative to the display unit 102.
  • the driving circuitry for the display panel 170 may be housed within the frame 172, the base element 174 or the display panel 170 itself.
  • the driving circuitry may be housed together with the processing unit 104 in the separate housing module 108 and may be
  • a cable 176 including one or more electrical wires insulated from one another, may be routed from the housing module 108 through a hollow cross-section of the support member 130 to enable the display panel 170 to be communicatively coupled to the processing unit 102 and/or any separately disposed driving circuitry.
  • the display unit 102 may be in communication with the processing unit 104 and any other SGD components through a wireless link, such as a BLUETOOTH, Wi-Fi or ZIGBEE connection.
  • any power supply features required to supply operating power to the display unit 102 may be housed within the display unit 102.
  • a battery 140 may be disposed within the display panel 170, the display frame 172, or the base element 174 to provide any necessary operating power.
  • the display unit 102 and the central processing unit 04 may share a single power supply, such as a battery 140 disposed in the housing module 108 or the battery used to supply power to the wheelchair 1 10.
  • a suitable wired connection may be formed from the power supply to the display unit 102. For example, as shown in FIG.
  • cable 176 may represent a power cable extending from a power source disposed in the housing module 108 of the SGD 100 or the motor housing 120 of the wheelchair 110 through the support member 130 to the display unit 102 to provide power thereto.
  • a battery 140 may be provided within the support member 130 to supply operating power to the display unit 102.
  • a battery 140 may generally be disposed within the support member 130 at or adjacent to the interface of the display unit 102 and the support member 130 and may be electrically coupled to the display unit 102 through a cable 176.
  • the battery 140 may be coupled to electrical contacts (e.g., spring-loaded contacts) disposed at the interface of the support member 130 and the display unit 102.
  • the display unit 102 may include corresponding electrical contacts such that, when the display unit 102 is attached onto the support member 130, an electrical connection is established between the display unit 102 and the battery 140.
  • a charging jack or other suitable means for permititng the battery 140 to be recharged may be provided on or within the support member 130.
  • a power cable may be coupled from the battery 140 through a suitable power adaptor or converter to the battery used to power the wheelchair to enable the battery 140 within the support member 130 to be recharged.
  • the display unit 102 may include a touch screen 146.
  • the touch screen 146 may generally serve as an input feature for SGD 100, while the display panel 170 generally serves as an output feature for SGD 100.
  • the touch screen 146 may comprise an outer, transparent cover layer of the display panel 170 such that the display panel 170 may be viewed through touch screen 146.
  • the touch screen 146 may correspond to one or more layers of transparent sensing material to implement a touch screen 146 in conjunction with the TOLED display such that the combination of layers remains transparent and functional.
  • the transparent sensing material forming the touch screen 146 may be applied to a front surface of the display panel 170 as shown in Fig. 8 such that a user 106 can make input selections via touch screen 146 by pressing his fingers or applying a stylus to the front of the display panel 170 as shown.
  • the transparent sensing material forming the touch screen 146 may additionally or alternatively be applied to a back surface of the TOLED display as shown in Fig. 9 such that a user 106 can make input selections via the touch screen 146 by pressing his fingers or applying a stylus to the rear of the display panel 170 as shown.
  • the embodiment depicted in Fig. 9 by which a user 106 can provide input selections from behind the display buttons/items as opposed to on top of the buttons eliminates or reduces the problem of obscuring buttons with a user's fingers or hands and allows for more precise selection and smaller potential selection targets.
  • the touch screen 146 used within the scope of the present subject matter may generally comprise any suitable touch screen known in the art.
  • the touch screen 146 may correspond to a resistive touch screen, a capacitive touch screen or a pressure sensitive configuration.
  • a capacitive touch screen that uses a sensor material such as indium tin oxide (ITO) may be particularly well suited as a transparent sensing material.
  • ITO indium tin oxide
  • a capacitive touch screen may also provide such advantages as overall thinness and light weight.
  • a capacitive touch panel requires no activation force but only a slight contact, which can be an advantage for a user 106 who may have motor control limitations.
  • Capacitive touch screens also
  • the SGD hardware components may further include one or more speakers 136.
  • the speakers 136 may correspond to any compact high power audio output device and may function as an audible interface for the SGD 100 when the computer processor(s) 138 of the processing unit 104 utilize text-to-speech functionality.
  • a user 106 provides text, symbols corresponding to text, and/or related or additional information in a "Message Window" which then may be interpreted by a text-to-speech engine and provided as audio output via the speakers 136.
  • Speech output may be generated in accordance with one or more preconfigured text-to-speech generation tools in male or female and adult or child voices, such as but not limited to such products as offered for sale by CereProc of Edinburgh, Scotland, Cepstral of Pittsburgh, PA, HQ Voices offered by Acapela Group of Mons, Belgium, Flexvoice offered by Mindmaker of San Jose, California, DECtalk offered by Fonix of Salt Lake City, Utah, products by Loquendo of Torino, Italy, VoiceText offered by NeoSpeech of Sunnyvale, California, AT&T's Natural Voices offered by Wizzard of Pittsburgh, Pennsylvania, Microsoft Voices, digitized voice (digitally recorded voice clips) or others.
  • a volume control module 164 may be controlled, in various embodiments, by one or more scrolling switches, touchscreen buttons, volume knobs, or the like.
  • the speakers 136 of the present subject matter may be mounted or otherwise disposed at any location on the wheelchair 110 or on the SGD 100.
  • the speakers 136 may be physically separated from both the display unit 102 and the housing module 108.
  • the speakers 136 may be mounted or embedded within the armrests 124, seat 114, or frame 1 12 of the wheelchair 1 10.
  • the speakers 136 may be mounted or otherwise disposed at any location on the wheelchair 110 or on the SGD 100.
  • the speakers 136 may be physically separated from both the display unit 102 and the housing module 108.
  • the speakers 136 may be mounted or embedded within the armrests 124, seat 114, or frame 1 12 of the wheelchair 1 10.
  • one or more speakers 136 may be embedded within the housing module 108 of the SGD 100.
  • the speakers 136 may be mounted within the display frame 172 of the display unit 102 or, in the event of a frameless configuration, within the base element 174 of the display unit 102.
  • the speakers 136 are disposed on a side of the display frame 170 facing the user 106.
  • speakers 36 may also be mounted or secured to the opposite side of the display unit 102 to enhance the ability of those to which a user 106 is communicating through the text-to-speech functionality of the SGD 100 to hear and understand any audio outputs from the speakers 136.
  • the speakers 136 may be in communication with the central processing unit 104 by any suitable means, including via a wired or wireless connection.
  • the speakers 136 may be communicatively coupled to the processing unit 104 through a Bluetooth connection or any other suitable wireless means.
  • a switch may be provided for users 106 to mechanically actuate a selection on the SGD 100 and then communicate that selection via Bluetooth protocols. Switching is often used when an SGD 100 operates in a user-input mode where choices are scanned across the display panel 170 as visual options or sequenced within an audio output and a user 106 then can select one of the scanned options upon selection by a switch. Scanning users often rely on switches located wherever the user 106 has consistent and reliable motor control. For example, switches may be located on the seat 1 14 (e.g., the head rest), the armrests 124 or leg support of the wheelchair 1 10.
  • Provision of a Bluetooth-communicating input switch eliminates the need for wire routing throughout wheelchair 110, thus providing a more convenient and safer environment for the user 106 in a wheelchair with moving parts.
  • Bluetooth communications features involves the benefits of a Bluetooth audio pathway.
  • Many users 106 utilize an option of auditory scanning to operate their SGD 100.
  • a user 106 can choose to use a Bluetooth-enabled headphone to listen to the scanning, thus affording a more private listening environment that eliminates or reduces potential disturbance in a classroom environment without public broadcasting of a user's communications.
  • a Bluetooth (or other wirelessly configured headset) can provide advantages over traditional wired headsets, again by overcoming the cumbersome nature of the traditional headsets and their associated wires.
  • an eye tracking device 178 with one or more light sources 180 and sensing elements, such as a camera 182, may be provided relative to the display panel 170 to capture a user's selections.
  • Processing functionality for the eye tracking device 178 may be provided by a microprocessor provided within the eye tracking device 178 or a separate peripheral processor, such as a processor 138 of the central processing unit 102, connected to the eye tracking device 178 via a wired or wireless connection.
  • connection between the eye tracking device 178 and the display panel 170 of the display unit 102 may be implemented via a wired or wireless connection.
  • a speech generation device 100 that can be controlled by an eye tracking device 178 generally may be of a type that provides a display panel 170 that displays visual objects that the user 106 can consider whether to select.
  • the selection software that implements the user's decision to select an object displayed on the display panel 170 is provided with the capability of using inputs from the eye tracking device 178 to effect the selection of the objects displayed on the display panel 170.
  • the selection software may include an algorithm in conjunction with one or more selection methods to select an object on the display panel 170 of the speech generation device 100 by taking some action with the user's eyes (e.g., blinking and/or gazing for a predetermined dwell time) with or without a combination of other actions (e.g., switch actuation, joystick control, or the like).
  • some action with the user's eyes e.g., blinking and/or gazing for a predetermined dwell time
  • other actions e.g., switch actuation, joystick control, or the like.
  • eye tracker elements of the eye tracking device 178 desirably may include a video camera 182 disposed within the display unit 102 and corresponding focusing lens mounted relative to an opening 184 defined in the display frame 172 as well as one or more light sources (e.g., a left infrared LED array 180 and a right infrared LED array 180) embedded within the display frame 172.
  • the focusing lens may be mounted in an adjustable lens housing and disposed in front of the video camera 182.
  • the adjustable lens housing can be mechanically locked into position so that the focus of the lens does not change with vibration or drops.
  • Each of the LEDs in each infrared LED array 180 desirably emits at a wavelength of about 880 nanometers, which is the shortest wavelength deemed suitable in one exemplary embodiment for use without distracting the user 106 (the shorter the wavelength, the more sensitive the sensor, i.e., video camera 182, of the eye tracker 178).
  • LEDs 180 operating at wavelengths other than about 880 nanometers easily can be substituted and may be desirable for certain users 106 and/or certain
  • a plurality of LEDs may be disposed in staggered, linear or other configurations in each array 180. Additionally, transparent protective covers may be provided over each of the LED arrays 180.
  • two spaced apart indicator lights 186a, 186b optionally may be disposed beneath the opening 184 defined in the display frame 172.
  • the processor associated with the eye tracking device 178 may be
  • each indicator light 186a, 186b configured to illuminate each indicator light 186a, 186b when the device 178 has acquired the location of the user's eye associated with that indicator light.
  • the eye tracker's acquisition of the location of the user's eye may require using the processing power of either a microprocessor of the speech generation device 100 or of a separate dedicated microprocessor for the eye tracking device 178, as the case may be. In each case for example, if the eye tracking device 178 has acquired the location of the user's left eye, then the device is configured to illuminate the left indicator light 186a. Similarly, if the eye tracking device 178 has acquired the location of the user's right eye, then the device is configured to illuminate the right indicator light 186b.
  • This feature of providing separate indicator lights 186a, 186b mounted on the front of the display unit 102 enables the eye tracking device 178 to avoid using part of the display panel 170 to show the user 106 if one or both of the user's eyes are being tracked. Accordingly, this indicator light feature conserves valuable space on the display panel 170. Additionally, it has also been observed that these indicators 186a, 186b act as a relaxation technique for otherwise hyper users.

Abstract

A speech generation device for use with a wheelchair is disclosed. The speech generation device may generally include a display unit mounted in a position relative to the wheelchair so as to provide a user of the wheelchair visual access to the display unit. The speech generation device may also include a separate processing unit disposed apart from display unit. The processing unit may generally include a processor and related computer-readable medium that configure the speech generation device to generate text-to-speech output.

Description

TITLE OF THE INVENTION
SPEECH GENERATION DEVICE WITH SEPARATE DISPLAY AND PROCESSING UNITS FOR USE WITH WHEELCHAIRS
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of previously filed U.S. Provisional Patent Application entitled "SPEECH GENERATION DEVICE WITH OLED
DISPLAY," assigned USSN 61/250,074, filed October 9, 2009 and U.S. Provisional Patent Application entitled "SPEECH GENERATION DEVICE WITH SEPARATE DISPLAY AND PROCESSING UNIT FOR USE WITH WHEELCHAIRS," assigned USSN 61/333,863, filed on May 2, 2010, both of which are fully incorporated herein by reference for all purposes.
BACKGROUND OF THE INVENTION
[0002] The present invention generally pertains to speech generation devices, and more particularly to speech generation devices including separate display and processing units for use with wheelchairs.
[0003] Various debilitating physical conditions, whether resulting from disease or injuries, can deprive the afflicted person of the ability to communicate audibly with persons or devices in one's environment in real time. For example, many individuals may experience speech and learning challenges as a result of preexisting or developed conditions such as autism, ALS, cerebral palsy, stroke, brain injury and others. In addition, accidents or injuries suffered during armed combat, whether by domestic police officers or by soldiers engaged in battle zones in foreign theaters, are swelling the population of potential users. Persons lacking the ability to communicate audibly can compensate for this deficiency by the use of speech generation devices.
[0004] Speech generation devices (SGDs), some embodiments of which may be known as Alternative and Augmentative Communications (AAC) devices, can include a variety of features to assist with a user's communication. In general, a speech generation device may include an electronic interface with specialized software configured to permit the creation and manipulation of digital messages that can be translated into audio speech output. Additional communication-related features may also be provided depending on user preferences and abilities. Users may provide input to a speech generation device by physical selection using a touch screen, mouse, joystick, physical switch inputs or the like or by other means such as eye tracking or head tracking.
[0005] It is estimated that less than ten percent (10%) of the potential users of speech generation devices currently is being served by conventional speech generation devices. This population is highly variable from the standpoint of a range in ages from preschool children through elderly adults and a variety of lifestyles, geographic locations, educational attainments, language sophistication, and available physical motor skills to operate the speech generation device. As such, a need exists for further refinements and improvements to speech
generation devices that continuously adapt such devices for a greater number and variety of users.
[0006] Conventional speech generation devices are generally used across a wide range of applications and settings. For example, some speech generation devices are used as desktop devices, while others are rendered portable by being mounted on vehicles such as wheelchairs. To accommodate such varied uses, the multitude of hardware and software features included in an SGD are typically built into a single integrated assembly. Thus, the onboard computers and other processing equipment are often disposed in a single housing together with the plethora of peripheral devices such as display units, touch screens, microphones, speakers as well as other features. While these integrated units may be ideal in many situations (e.g., use as a desktop device), such devices can cause
numerous problems and inconveniences for users confined to a wheelchair who must communicate using an SGD mounted to their wheelchair.
[0007] For example, as an integrated assembly, the size of a conventional speech generation device is often quite substantial, having extended widths and/or profiles beyond that of the width or profile of the display unit to accommodate all the necessary and/or optional features of the SGD. Thus, since an SGD must generally be disposed in a location that provides the user visual access to its display, such bulky devices may potentially block a user's view to other objects in his environment and may also obscure the user from others. This potential restriction of a user's visual vantage can sometimes be awkward for a user, particularly when the user's mobility within the wheelchair is limited (e.g., the ability of the user to adjust his seating position). In addition, such integrated speech generation devices may restrict a user's ability to perform other tasks while using the SGD. Accordingly, a need exists to reduce the potential restriction of a user's view while utilizing an SGD.
[0008] Moreover, conventional integrated units are often relatively heavy due to the plurality of hardware components incorporated therein. Thus, such devices are more likely to cause damage to the SGD when the device is dropped. Additionally, since such devices are typically mounted over at least a portion of the user's body, the user may be harmed in the event the SGD falls from its mounted position on the wheelchair. Thus, a need exists to generally reduce the weight of any mounted portions of the SGD.
[0009] Further, conventional speech generation devices provide limited design flexibility pertaining to mounting or otherwise installing such devices on a wheelchair. Specifically, design options for current devices are, for the most part, limited to determining how to mount the integrated device with respect to the user. Additionally, integrated SGDs also make it more difficult for a user to upgrade specific components of the SGD without purchasing a brand new device, such as upgrading the size of the display unit. As such, a further need exists to increase the design flexibility related to configuring an SGD for installation on an wheelchair as well as to increase the upgradeability of an SGD.
[001 ] In light of the above highlighted design concerns in the field of speech generation devices, a need continues to exist for refinements and improvements to address such concerns. While various implementations of speech generation devices and associated features have been developed, no design has emerged that is known to generally encompass all of the desired characteristics hereafter presented in accordance with aspects of the subject technology. BRIEF SUMMARY OF THE INVENTION
[0011] In general, the present subject matter is directed to various exemplary speech generation devices (SGDs) having separate display and processing units for use with wheelchair applications.
[0012] For example, exemplary speech generation devices in accordance with aspects of the presently disclosed technology may include a separate display unit mounted to a wheelchair. For example, the display unit may be mounted to the wheelchair in a location relative to its user so as to provide the user direct visual access to the display unit. Additionally, the SGD may include a processing unit provided in a distal relationship with the display unit. For instance, the central processing unit may be disposed in a separate housing module located on or within the wheelchair.
[0013] Generally, the separate display unit and associated processing unit may enable the SGD to transmit and receive messages to assist a user in
communicating with others. For example, the SGD may correspond to a particular special-purpose electronic device that permits a user to communicate with others by producing digitized or synthesized speech based on configured messages. Such messages may be preconfigured and/or selected and/or composed by a user within a message window viewable on the display device associated with the speech generation device.
[0014] According to several embodiments of the present subject matter, the separate display unit may be mounted to the wheelchair at numerous locations and may have varying mounting configurations. In one embodiment, a support member may be secured to a portion of the wheelchair and configured to support the SGD in a position providing visual access of the display unit to a user. In another embodiment, the support member may include adjustment features that permit the position of the display unit to be altered relative to the user and/or the wheelchair. For example, the support member may be hinged or include rotatable components. [0015] Additionally, in various embodiments, the processing unit of the SGD may be disposed at varying locations relative to the display unit. For example, the processing unit may be housed in a housing module located on an exterior portion of the wheelchair, such as being mounted underneath an armrest of the wheelchair or being secured to the frame of the wheelchair, or within an interior portion of the wheelchair, such as the motor housing of the wheelchair. Moreover, in one embodiment, the processing unit may be communicatively connected to the separately disposed display unit via a wired or wireless connection.
[0016] It should be appreciated that some embodiments of the present disclosed subject matter may equally concern the entire framework of the wheelchair including basic wheelchair components (e.g., the frame, seat, joystick, etc.), any required mounting components and basic SGD components.
[0017] In general, the disclosed SGD provides numerous advantages for a user confined to the wheelchair. In particular, because the SGD includes a display unit separate from the processing unit, the display unit may have a smaller profile than an integrated unit and, thus, may be less likely to block the user's field of view.
Additionally, the separate display unit may be much lighter than an integrated SGD and thereby reduce the likelihood of damage to the SGD or harm to the user if it falls. Moreover, separation of the components of the SGD enables greater design flexibility for providing an SGD that may be customized to meet the demands of a particular user. This feature may also allow a greater of number of standard models to be offered to potential users (e.g., devices including differing display sizes and processor configurations) and may further permit existing users to upgrade their devices with greater ease and less expense.
[0018] In various embodiments of the present subject matter, additional advantages may be provided by the integration of the disclosed SGD with preexisting wheelchair control and power systems. For example, the input device used to control the direction and/or speed of the wheelchair may also be
configured as an input device for the SGD. In a particular embodiment, a joystick of the wheelchair may be communicatively coupled to the processing unit of the
SGD and may permit a user to make input selections for the speech generation device. Such dual function input devices may allow even further design flexibility for SGD providers and may also simplify operation of the SGD for a user.
Moreover, in one embodiment, the SGD may be configured to be powered via the same battery used to supply power to the wheelchair. Thus, the disclosed SGD may enjoy a significantly longer battery life than most conventional SGDs.
[0019] In several embodiments of the present subject matter, the display unit may include a transparent OLED display, which may provide further benefits for the user of an SGD, Specifically, a user can interact with and use the speech generation device while eliminating or reducing the potential visual restriction that would accompany a non-transparent display. For example, the user could look at the transparent SGD display to view communication-related information and also be able to view his environment. In addition, other people in a user's environment may be better able to see and interact with the user due to the transparent display. Still further, the user may be better able to engage in other activities, for example watching television, making a phone call, holding a conversation, etc. while still having access to the communication functionality of his speech generation device.
[0020] In some embodiments of a speech generation device, additional components and features may be provided with the SGD. For example, the display unit may include a touch screen formed on one or more surfaces of the display. The SGD may also be outfitted with eye tracking features that can sense a user's eye location and action (e.g., blinking, dwelling, etc.) such that the user can employ eye actions to cause input selection for the speech generation device. A variety of other physical input devices and software interface features may also be provided to facilitate the capture of user input to define what information should be displayed in a message window and ultimately communicated to others as spoken output, text message, phone call, e-mail or other outgoing communication. Moreover, the SGD may further include various communications devices and/or modules and related communications functionality,
[0021] Additional aspects and advantages of the invention will be set forth in part in the description that follows, and in part will be obvious from the description, or may be learned by practice of the invention. The various aspects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly described below. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate at least one presently preferred embodiment of the invention as well as some alternative embodiments. These drawings, together with the description, serve to explain the principles of the invention but by no means are intended to be exhaustive of all of the possible manifestations of the invention.
[0023] FIG. 1 provides a side view of an embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter;
[0024] FIG. 2 provides a perspective view of another embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter;
[0025] FIG. 3 provides a perspective view of a further embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter;
[0026] FIG. 4 provides a perspective view of yet another embodiment of a speech generation device installed on a wheelchair in accordance with aspects of the present subject matter;
[0027] FIG. 5 provides a schematic diagram of hardware components that may be used within various embodiments of a speech generation device in accordance with aspects of the present subject matter;
[0028] FIG. 6 provides a front view of an embodiment of a separate display unit for mounting on a wheelchair in accordance with aspects of the present subject matter;
[0029] FIG. 7 provides a front view of another embodiment of a separate display unit for mounting on a wheelchair in accordance with aspects of the present subject matter;
[0030] FIG. 8 provides a front view of an embodiment of a transparent display unit having a front touch screen feature in accordance with aspects of the present subject matter; [0031] FIG. 9 provides a front view of an embodiment of a transparent display unit having a rear touch screen feature in accordance with aspects of the present subject matter; and
[0032] FIG. 10 provides a front view of an embodiment of a display unit having speakers and eye tracking features mounted within the display unit in accordance with aspects of the present subject matter.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0033] Reference now will be made in detail to the presently preferred embodiments of the invention, one or more examples of which are illustrated in the accompanying drawings. Each example is provided by way of explanation of the invention, which is not restricted to the specifics of the examples. In fact, it will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope or spirit of the invention. For instance, features illustrated or described as part of one
embodiment, can be used on another embodiment to yield a still further
embodiment. Thus, it is intended that the present invention cover such
modifications and variations as come within the scope of the appended claims and their equivalents. The same numerals are assigned to the same components throughout the drawings and description.
[0034] Referring to the drawings, FIGS. 1-4 illustrate exemplary embodiments of a speech generation device ("SGD") 100 as installed on an electric or power wheelchair 110 in accordance with aspects of the present subject matter.
Generally, the SGD 100 may include a display unit 102 mounted to the wheelchair 1 10 and a central processing unit 104 provided in a distai relationship with the display unit 102. For example, the display unit 102 may be mounted in a location relative to a user 106 of the wheelchair 110 so as to provide the user 106 direct visual access to the display unit 02. The central processing unit 104 generally may be disposed in a separate housing module 108 and may be configured to enable the SGD 100 to transmit and receive messages to assist the user 106 in communicating with others. The SGD 100 may further include various other features and/or components disposed within the housing module 108, mounted or embedded within the display unit 102 or otherwise secured to portions of the wheelchair 110, as will be described in greater detail below.
[0035] It should be appreciated that the power/electric wheelchair 1 10 described and depicted herein is provided for illustrative purposes only and should not be viewed as a limitation of the scope of the present subject matter. Rather, the disclosed SGD 100 may be utilized with any suitable wheelchair or any other personal mobility device generally known in the art, including wheelchairs having differing configurations and/or additional features than those described below. Thus, as an example, FIGS. 1 -4 illustrate many of the typical features found in a power/electric wheelchair 10. As shown, the wheelchair 1 10 may include a base or frame 112 and a seat 1 14 supported by the frame 112. In one embodiment, the seat 114 may be manufactured as several different components including a seat bottom, backrest, and headrest. A pair of drive wheels 116 and at least one pair of driven wheels 118 may be rotatably connected to the frame 1 12. Additionally, at least one motor (not illustrated), disposed in a motor housing 120 under the seat 114, may be mechanically coupled to each drive wheel 1 16 through a shaft (not illustrated) to provide independent operation of the drive wheels 116 for desired steering. A battery (not illustrated) may also be installed within the motor housing 120 to supply power to the motors. Generally, during operation, steering and increases/decreases in speed may be effectuated by utilizing a joystick 122 mounted on or adjacent to one of the armrests 124 of the wheelchair 1 10. As is generally understood, the joystick 122 may be electrically coupled to a
microprocessor that controls the operation of the motors and any other associated steering and/or braking mechanisms.
[0036] Generally, it should be appreciated that various suitable mounting configurations may be utilized to rigidly and securely mount the display unit 102 of the SGD 100 to a wheelchair 1 10. For example, as shown in FIGS. 1 -4, a support member 130 may be provided between the wheelchair 1 10 and the display unit 102. Generally, the support member 130 may comprise any structure or mechanism configured to support the display unit 102 in a position that provides the user visual access to the display unit 102, As such, a first end of the support member 130 may be rigidly secured to any portion of the wheelchair 110 including, but not limited to, the frame 112, motor housing 120, seat 114 or armrests 124 of the wheelchair 1 10 and a second end of the support member 130 may be rigidly secured to the display unit 102. Thus, in the embodiment illustrated in FIG. 2, the support member 130 may be secured to the frame 1 12 of the wheelchair 110 and extend vertically along a side of the wheelchair 1 10, such as adjacent to one of the armrests 124, so as to properly position the display unit 102 relative to the user 106. In an alternative embodiment, indicated by dashed lines, the support member 130 may be secured to the frame 112 and extend vertically along the back of the wheel chair 1 10, such as along the back of the seat 114, to enable the display unit 102 to be suspended in front of the user 106. Of course, it should be apparent to those of ordinary skill in the art that numerous other mounting configurations may be utilized to mount the display unit 102 to the wheelchair 1 10. For example, a suitable mounting apparatus and configuration that may be used within the scope of the present subject matter is disclosed in U.S. Pat. Application 2008/0302938 (Goodwin et al.), which is hereby incorporated by reference herein for all purposes. Additionally, it should be appreciated that the support member 130 may be removably or non-removably secured to the wheelchair 1 10 and/or the display unit 102 by any suitable means, such as by welding, screws, bolts, clamps, mounting brackets or any other suitable attachment device and/or mechanism.
[0037] Referring still to FIG. 2, in one embodiment, the support member 130 may include a plurality of arms 132 configured to be attached to one another. For instance, a first arm 132a may be secured to the wheelchair 1 10 and extend outwardly therefrom. A second arm 132b may be attached to the first arm 132a and may extend vertically to any desired height, such as a height substantially equal to that of the user's eye location 107 (FIG. 1 ) or some predetermined portion thereof. In some embodiments of the present subject matter in which the display unit 102 incorporates eye tracking features, the height of the second arm 132b may be configured to align the user's eye location 107 with any sensor and/or camera components of the eye tracker. A third arm 132c may be attached to the second arm 132b and may extend horizontally across the wheelchair 110 to position the display unit 102 in front of the user 106. It should be appreciated that the arms 132 of the support member 130 may be formed from any suitable material. For example, in one embodiment, the arms 132 may be formed from a substantially rigid, durable material including, but not limited to, various plastics, thermoplastics, polymers, poiyethylenes, resins, metals, or any combinations thereof. Alternatively, one or more of the arms 132 may be formed from a flexible material that permits the support member 130 to be bowed, bent or otherwise manipulated to assure proper positioning of the attached display unit 02. It should also be appreciated that the arms 132 may have any suitable cross-section. For instance, in varying embodiments, the arms 132 may have a circular, elliptical, rectangular or similarly shaped cross-section that is either hollow, solid or semisolid.
[0038] The support member 130 may further include adjustment features that permit the position of the display unit 102 to be adjusted depending on, for example, the height, seating posture, and/or eye location 107 of the user 106. For example, in the embodiment shown in FIG. 2, the arms 132 of the support member 130 may be configured to have adjustable lengths. Specifically, one or more of the arms 132 may include telescoping features 133 or may otherwise be slidably mounted to an adjacent arm 132 to permit portions of the support member 130, generally illustrated by the arrows, to be extended or shortened as necessary to provide a user 106 optimal visual access to the display unit 102, Specifically, in the illustrated embodiment, the second arm 132b may include a telescoping feature 133 or other suitable adjustment mechanism that permits the vertical position of the display unit 102 to be adjusted relative to the user 106. Similarly, the third arm 132c may include a telescoping feature 133 or other suitable adjustment mechanism to allow the position of the display unit 102 to be altered horizontally (e.g., in a direction across the user's field of view).
[0039] Referring now to FIG. 3, the support member 30 may also include one or more pivoted or hinged attachment features 134 to allow further adjustments to be made to the position of the display unit 102 relative to the user 106. Generally, the hinged features 134 may comprise any suitable mechanism known in the art for providing pivotal and/or hinged attachment between two components. For instance, in the illustrated embodiment, hinged attachment features 134 may be disposed between adjacent arms 132 of the support member 130 to permit the angle of one arm 132 to be adjusted relative to another. Additionally, a hinged attachment feature 134 may also be disposed at the interface of the display unit 102 and the support member 130 to permit the orientation of the display unit 102 to be adjusted relative to the support member 130. It should be appreciated that the hinged attachment features 134 may include set screws, locking pins or other suitable locking devices to maintain the support member 130 and/or display unit 102 in a fixed location once desired positioning of the display unit 102 has been achieved. Alternatively, the hinged attachment features 134 may be configured to maintain the support member 103 and/or display unit 102 in a fixed location absent an input force (e.g., a friction hinge or detent hinge).
[0040] Further, to provide even more flexibility in positioning the display unit 102, the support member 130 may include one or more rotational attachment mechanisms 135 that allow the support member 130 and/or or the display unit 102 to be rotated relative to one another and/or relative to the user 106. For example, as shown in FIG. 4, a rotational attachment mechanism 135, such as a shoulder joint or any other suitable mechanism for providing rotational attachment between two components, may be disposed between adjacent arms 132 to provide for rotation therebetween. In another embodiment, a rotational attachment
mechanism 135 may be disposed at the interface between the support member 130 and the display unit 102 to allow the display unit 102 to be rotated relative to the support member 130. Additionally, similar to hinged attachment features 134 described above, the rotational attachment mechanisms 135 may also include set screws, locking pins or other suitable locking devices to maintain the support member 130 and/or display unit 102 in a fixed location once desired positioning of the display unit 102 has been achieved. Alternatively, the rotational attachment mechanism 135 may simply be configured to maintain the support member 30 and/or display unit 102 in a fixed location absent an input force (e.g., due to frictional engagement of the components of the attachment mechanism).
[0041] Still referring to FIGS 1 -4, the central processing unit 104 of the SGD 100 may generally be disposed within a housing module 108 which is physically separated from the display unit 102. It should be appreciated that, by the term "physically separated," it is meant that no portion of the housing module 108 is mechanically or otherwise physically attached to a portion of the display unit 102. As such, the housing module 108 comprises a completely separate and detached component from the display unit 102. However, the term "physically separated" does not mean that the housing module 108 may not be electrically and/or communicartively connected to the display unit 102, such as through a power and/or communciative cable.
[0042] Generally, it should be appreciated that the housing module 108 may be disposed at any location on or in the wheelchair 1 10 that permits communication between the processing unit 104 and display unit 102 via a wired or wireless communication. For example, in one embodiment, it may be desirable to have the housing module 108 stored out of sight. Thus, the housing module 108 may be disposed, as shown in FIG. 2, under or behind the seat 1 14 of the wheelchair 1 10 or, as shown in FIG. 3 in a cut-away view, within the motor housing 120 of the wheel chair 110. Alternatively, the housing module 108 may be secured to the underside of one of the armrests 124, as shown in FIG. 1 , or secured to the outside of the frame 1 12, as shown in FIG. 4. Of course, it should be appreciated that the housing module 108 may be located at various other positions on the wheelchair 1 10.
[0043] The housing module 108 may generally form a protective casing or covering for the central processing unit 102 and any functional components and/or other features of the SGD 00 disposed therein or mounted thereon. As such, the housing module 108 be formed or molded from any substantially rigid and/or durable material. For example, in one embodiment, the housing module 108 may be formed from a material such as but not limited to plastic, thermoplastic, polymer, polyethylene, metal, or resin materia!. In another embodiment, the housing module 108 may be formed from magnesium or an alloy thereof. In particular, when magnesium is used to make the housing module 108, it may provide several advantages for an SGD 100 including but not limited to additional conductive and radiated immunity, shielding from electromagnetic interference (EMI) signals, heat dissipation features for an SGD, and greater structural integrity with low weight. Additionally, it should be appreciated that, in one embodiment, the housing module 108 may be rendered liquid impermeable when formed. [0044] The housing module 108 may also define various openings to
accommodate data input and output as well additional features of the SGD 100. For example, openings may be defined through the housing module 108 to provide locations for power buttons, volume control knobs, USB ports for coupling any peripheral devices of the SGD 100 to the central processing unit 102 and various other data input/output ports. Further, openings may also be defined through the housing module 108 to permit the mounting or embedding of various output devices of the SGD 100. For example, as shown in FIG. 1 , one or more speakers 136 may be mounted within an opening defined in the housing module 108. It should be appreciated that, in embodiments in which the housing module is generally not accessible to the user 106, any buttons, control knobs, ports and the like may be provided in an alternative location more accessible to the user (e.g., on the display unit 102 or on the armrests 124 of the wheelchair) and then interfaced with the processing unit 102 within the housing module 108 by any suitable means.
[0045] Electronic components intended for use with various embodiments an SGD 100 in accordance with aspects of the present subject matter will now be described with reference to FIG. 5. Generally, the electronic components may include a combination of hardware, software and/or firmware elements, all of which either correspond to physical tangible apparatuses or which are embedded as instructions on a physical and tangible apparatus such as a computer-readable storage medium. It should be appreciated that embodiments of the SGD 100 in accordance with the present subject matter should not be limited by the complete spectrum of hardware and software components described herein. Instead, an SGD 100 may selectively incorporate one or more of such disclosed features and steps and others to create additional and alternative embodiments.
[0046] In general, the electronic components of an SGD 100 enable the device to transmit and receive messages to assist a user 106 in communicating with others. For example, the SGD 100 may correspond to a particular special-purpose electronic device that permits a user 106 to communicate with others by producing digitized or synthesized speech based on configured messages. Such messages may be preconfigured and/or selected and/or composed by a user 106 within a message window provided as part of the speech generation device user interface, such as on the display unit 102. As will be described in more detail below, a variety of physical input devices and software interface features may be provided to facilitate the capture of user input to define what information should be displayed in a message window of the display unit 102 and ultimately communicated to others as spoken output and/or other outgoing communication.
[0047] Referring to Fig. 5, the SGD 100 may generally comprise a separate display unit 102 and a central processing unit 104 including a variety of internal components. As indicated above, the display unit 102 may be positioned relative to a user 106 so as to have distal relationship with the central processing unit 104 (indicated by the dashed line). Additionally, the SGD 100 may include a plurality of peripheral devices. Generally, it should be appreciated that, in addition to the specific devices discussed herein, any peripheral hardware device 48 may be provided and interfaced to the SGD 100 via a USB port 150 or other
communicative coupling. It should be further appreciated that the components shown in Fig. 5 may be provided in different configurations and may be provided with different arrangements of direct and/or indirect physical and communicative links to perform the desired functionality of such components.
[0048] Power to the components of the SGD100 generally may be provided from a battery 140 such as but not limited to a lithium polymer battery or any other rechargeable energy source. For example, in one embodiment, power may be supplied to the central processing unit 104, the display unit 102, and any other components of the SGD 00 from the battery used to supply power to the wheelchair 110. In such an embodiment, a suitable adaptor or converter may be coupled between the wheelchair battery and any powered components to provide stable DC electric power to such components at the required voltages. In an alternative embodiment, the various components of the SGD 100 may be powered by a separate power supply, such as a battery 140 disposed within the housing module 108. In a further embodiment, multiple power sources may be utilized to supply electric power to the various SGD components. For instance, a first battery 140 may be provided to supply power to the display unit 102, while a second battery 140 supplies power to the processing unit 104 and any other peripheral devices. Additionally, a power switch or button 144 may be provided as an interface to toggle the power connection between the battery 140 and any powered components. Such power button 144, in one embodiment, may be located in an opening defined in the housing module 108. In other embodiments, particularly when the housing module 108 is stored out of reach of the user 106, the power button 144 may be disposed at any location accessible to the user 106, such as on the display unit 102 or on portions of the wheelchair 1 10 (e.g., the armrests 124 or the joystick 122).
[0049] Referring more particularly to the exemplary hardware shown in Fig. 5, the central processing unit 104 is provided to function as the central controller within the SGD 100 and may generally include such components as at least one memory/media element or database for storing data and software instructions as well as at least one processor. In the particular example of Fig. 5, one or more processor(s) 138 and associated memory/media devices 142a and 142b are configured to perform a variety of computer-implemented functions (i.e., software- based data services). One or more processor(s) 138 within the processing unit 104 may be configured for operation with any predetermined operating systems, such as but not limited to Windows XP, and thus is an open system that is capable of running any application that can be run on Windows XP. Other possible operating systems include BSD UNIX, Darwin (Mac OS X), Linux, SunOS
(Solaris/OpenSolaris), and Windows NT (XP/Vista/7).
[0050] At least one memory/media device (e.g., device 142a in Fig. 5) is dedicated to storing software and/or firmware in the form of computer-readable and executable instructions that will be implemented by the one or more
processor(s) 138. Other memory/media devices (e.g., memory/media devices 142b) are used to store data which also will be accessible by the processor(s) 138 and which will be acted on per the software instructions stored in memory/media device 142a. The various memory/media devices of Fig. 5 may be provided as single or multiple portions of one or more varieties of computer-readable media, such as but not limited to any combination of volatile memory (e.g., random access memory (RAM), such as DRAM, SRAM, etc.) and nonvolatile memory (e.g., ROM, flash, hard drives, magnetic tapes, CD-ROM, DVD-ROM, etc.) or any other memory devices including diskettes, drives, other magnetic-based storage media, optical storage media and others. In some embodiments, at least one memory device corresponds to an electromechanical hard drive and/or or a solid state drive (e.g., a flash drive) that easily withstands shocks, for example that may occur if the housing module 108 is dropped or falls from its position on the wheelchair 1 0. Although Fig. 5 shows two separate memory/media devices 142a and 142b, the content dedicated to such devices may actually be stored in one memory/media device or in multiple devices. Any such possible variations and other variations of data storage will be appreciated by one of ordinary skill in the art.
[0051] In one particular embodiment of the present subject matter, a first portion of memory/media device 142b is configured to store input data received from a user 106 for performing the desired functional steps associated with a speech generation device 100. For example, data in memory 142b may include inputs received from one or more peripheral devices, including but not limited to a touch screen 146 of the display unit 102, a microphone 154 and other peripheral devices 152, which indicate a user's selections of text to be spoken by the SGD 100 or other related output actions. Memory device 142a includes computer- executable software instructions that can be read and executed by processor(s) 138 to act on the data stored in memory/media device 142b to create new output data (e.g., audio signals, display signals, RF communication signals and the like) for temporary or permanent storage In one of the memory/media devices. Such output data may be communicated to a peripheral output device, such as the display unit 102, the speakers 136, an antenna 156, a cellular phone or RF device 158, or a wireless network adapter 160, or as control signals to still further components. For example, the antenna 156 may be provided to facilitate wireless communications with other devices in accordance with one or more wireless communications protocols, including but not limited to BLUETOOTH, WI-FI (802.11 b/g) and 2IGBEE wireless communication protocols.. Additionally, when wireless communication devices are included within an SGD 100, a dedicated communications interface module 162 may be provided within the central processing unit 102 to provide a software interface from the processing unit 102 to the communication device(s). Specifically, in one embodiment, communications interface module 162 includes computer instructions stored on a computer- readable medium as previously described that instruct the communications devices how to send and receive communicated wireless or data signals.
[0052] Referring still to Fig. 5, various input devices may be part of an SGD 100 and thus coupled directly to the processing unit 104 or coupled indirectly to the processing unit 104 through another component, such as the display unit 102. For example, a touch screen 146 may be provided on the display unit 102 to capture user inputs directed to a display location by a user's hand or stylus. A microphone 154, for example a surface mount CMOS/MEMS silicon-based microphone or others, may be provided to capture user audio inputs. Other exemplary input devices (e.g., peripheral device 152) may include but are not limited to a peripheral keyboard, peripheral touch-screen monitor, peripheral microphone, eye gaze controller, mouse and the like.
[0053] In general, the different types of input devices (including optional peripheral devices) are configured with software instructions to accept user inputs in accordance with one or more access methods. In some embodiments, a user input selection is made upon contact and/or release of contact with a touch screen 146. In other embodiments, switches in combination with visual scanning and/or auditory cues may be employed for user input selections. In still further
embodiments, eye tracking features are provided such that selections are made simply by gazing at the display unit 102 and implementing selection based on dwell time, eye blinking or external switch activation.
[0054] User inputs may also be accepted through the use of a joystick. In one embodiment, a joystick may be included as an optional peripheral device 138 for the SGD 100. For example, a joystick may be coupled to the processing unit 04, such as through a USB port 50, and used to move a pointer around the display unit 102, with selections being made with a button on the joystick. In another embodiment, the joystick 122 used to control the operation of the wheelchair 110 may also be configured to allow a user 106 to navigate through the communication pages provided by the display unit 102. For example, a switch may be provided in any convenient location on the wheelchair 110, such as on or adjacent to one of the armrests 124 or on or adjacent to the joystick 122, to permit a user 06 to toggle the electrical connection of the joystick 122 between the microprocessor controiling the motors of the wheelchair 110 and the central processing unit 104 of the SGD 100. It should be appreciated that the wheelchair joystick 122 may also be modified to include a button or other input device to provide the user 106 a means for making selections based on options displayed on a communications page of the display unit 102.
[0055] As indicated above, in addition to the plurality of input devices, the SGD hardware components may also include multiple output devices including but not limited to the display unit 102 and any speakers 136 necessary for transmitting speech output from the SGD 100. Several varying embodiments of the display unit 102 of the present subject matter will now be described with reference to FIGS. 6- 9. Generally, the display unit 102 may include a display panel 170 that serves as the output feature for the display unit 102. Thus, the display panel 1 0 may correspond to any suitable monitor, screen or other output device for presenting visual information to the user 106. Suitable examples may include, but are not limited to, a light-emitting diode (LED) display, electroluminescent display (ELD), plasma display panel (PDP), and liquid crystal display (LCD). One particular embodiment corresponds to an LCD such as an LW500AC9001 component offered for sale by Chi Mei Optoelectronics (CMO) of Taiwan.
[0056] In an exemplary embodiment of the present subject matter, the display panel 170 of the display unit 102 may comprise an Organic Light-Emitting Diode (OLED) display. In general, an OLED display employs an LED capable of light- emitting in one or more layers of organic material (i.e., the emissive layer(s)) by movement and re-combination of electrons (negative charges) with holes (positive charges). When voltage potential is applied to such a device, negatively charged electrons move from a cathode layer through an intermediate layer into the emissive layer(s). At the same time, positively charged holes move from an anode layer through an intermediate layer and into the same organic light-emitting layer. When the positive and negative charges meet in the emissive layer(s) of organic material, they combine and produce photons having a frequency falling within the spectrum of visible light to provide a desired display.
[0057] OLED displays may offer numerous advantages for an SGD 100 relative to conventional displays. In particular, a display panel 170 configured as an OLED may generally require a low activation or driving voltage, thus providing for longer battery life, self-luminescence without necessitating a backlight, reduced thickness, wide viewing angle, fast response speed, high contrast, greater brightness and color, superior impact resistance, ease of handling, etc. The reduced weight and power requirements of an OLED display provide particular advantages for the SGD 100 of the present subject matter. For example, a more lightweight and efficient device may help to increase a potential user's mobility and duration of assisted communication. In addition, durability and impact resistance may also provide benefits for a display unit 102 incorporating a touch screen 146, especially for users 106 who may have trouble controlling input force applied to a speech generation device.
[0058] In a further embodiment of the present subject matter, the display panel 170 of the display unit 102 may comprise an OLED configured as a transparent display. As used herein, a "transparent" display means a medium that is capable of transmitting at least some light so that objects or images can be seen fully or at least partially through the transparent display. Transparent OLED devices (i.e., TOLED devices) are generally capable of emitting light from both the bottom and top surfaces of a device. Such devices use transparent electrodes, substrates and other layers to ensure that the resulting display is at least partially and preferably fully transparent to a user 106. In some embodiments, a TOLED display may be fully transparent in the off-state and within a range of between about 50-80% transparent during active operation.
[0059] A transparent OLED (TOLED) display may provide additional benefits for the user 106 of a speech generation device 100. A user 106 can interact with and use the speech generation device 100 while eliminating or reducing potential visual restriction that would accompany a non-transparent display. A user 106 could look at the transparent SGD display to view communication-related information, optionally make visual input selections using eye tracking features associated with the SGD 100 and also be able to view his environment. In addition, other people in a user's environment are better able to see and interact with the user 106 because of the transparent display. Still further, a user will be better able to engage in other activities, for example watching television, making a phone call, holding a conversation, etc. while still having access to the communication functionality of his speech generation device 100.
[0060] Referring now to Fig. 6, in one embodiment, the display unit 102 of the present subject matter may include a display frame 172 substantially surrounding and supporting the display panel 170. Generally, the display frame 172 may be configured to provide a protective housing for the display panel 170. As such, the frame 172 may be formed from any suitable durable and/or substantially rigid material including, but not limited to, various plastics, thermoplastics, polymers, polyethylenes, metals, or resin materials. The frame 72 may be further
configured to be attached to the support member 130 by any suitable means, such as by welding, screws, bolts or the like. In a particular embodiment, as described above, the display frame 172 may be hingedly and/or rotatably attached to the support member 130 to allow proper positioning/adjustment of the display unit 102 relative to the user 106. Of course, it should be appreciated that the support member 130 may be secured to the frame 170 at any location, including the top and sides of the frame, and, thus, need not be limited to being secured to the bottom of the frame 170 as shown in FIG. 6. Further, depending on the type of display panel 170 utilized, the display unit 102 may also include a back cover plate {not illustrated) that covers and/or protects the backside of the display panel 170 to prevent damage thereto. In such an embodiment, it should be appreciated that the support member 130 may also be secured to the back cover plate to provide additional flexibility in mounting the display unit 102.
[0061] A further embodiment of a display unit 102 is illustrated in FIG. 7.
Specifically, the display unit 102 may be configured as a frameless OLED or TOLED display panel. In such an embodiment, the display panel 170 corresponds to either a non-transparent OLED substrate or a substantially transparent OLED substrate that does not include any structural support or frame around the outer perimeter of the substrate as shown in FIG. 6. Rather, a base element 174 may be provided along the entirety or just a portion of a single edge of the display panel 170. Such base element 174 may be configured to provide mechanical support for the frameless display unit 102 and also may be configured to be secured to the support member 130 for mounting the display unit 102 to the wheelchair 110. [0062] It should be appreciated that any functional components related to the display unit 102, such as but not limited to driving circuitry for the display panel 170, may be housed at any suitable location relative to the display unit 102. For example, in several embodiments, the driving circuitry for the display panel 170 may be housed within the frame 172, the base element 174 or the display panel 170 itself. Alternatively, the driving circuitry may be housed together with the processing unit 104 in the separate housing module 108 and may be
communicatively coupled to the display unit 102 via a wired or wireless connection. For example, as shown in FIG. 6, a cable 176, including one or more electrical wires insulated from one another, may be routed from the housing module 108 through a hollow cross-section of the support member 130 to enable the display panel 170 to be communicatively coupled to the processing unit 102 and/or any separately disposed driving circuitry. Alternatively, the display unit 102 may be in communication with the processing unit 104 and any other SGD components through a wireless link, such as a BLUETOOTH, Wi-Fi or ZIGBEE connection.
[0063] Additionally, in one embodiment, any power supply features required to supply operating power to the display unit 102 may be housed within the display unit 102. For example, a battery 140 may be disposed within the display panel 170, the display frame 172, or the base element 174 to provide any necessary operating power. In another embodiment, as indicated above, the display unit 102 and the central processing unit 04 may share a single power supply, such as a battery 140 disposed in the housing module 108 or the battery used to supply power to the wheelchair 1 10. In such an embodiment, a suitable wired connection may be formed from the power supply to the display unit 102. For example, as shown in FIG. 6, cable 176 may represent a power cable extending from a power source disposed in the housing module 108 of the SGD 100 or the motor housing 120 of the wheelchair 110 through the support member 130 to the display unit 102 to provide power thereto. Alternatively, a battery 140 may be provided within the support member 130 to supply operating power to the display unit 102. For instance, as shown in FIG. 7, a battery 140 may generally be disposed within the support member 130 at or adjacent to the interface of the display unit 102 and the support member 130 and may be electrically coupled to the display unit 102 through a cable 176. As an alternative to using the cable 176, the battery 140 may be coupled to electrical contacts (e.g., spring-loaded contacts) disposed at the interface of the support member 130 and the display unit 102. In such an embodiment, the display unit 102 may include corresponding electrical contacts such that, when the display unit 102 is attached onto the support member 130, an electrical connection is established between the display unit 102 and the battery 140.
[0064] It should be appreciated that, when the battery 140 supplying power to the display unit 102 is disposed in the support member 130, a charging jack or other suitable means for permititng the battery 140 to be recharged may be provided on or within the support member 130. Alternatively, a power cable may be coupled from the battery 140 through a suitable power adaptor or converter to the battery used to power the wheelchair to enable the battery 140 within the support member 130 to be recharged.
[0065] Further, as indicated above, the display unit 102 may include a touch screen 146. In such an embodiment, the touch screen 146 may generally serve as an input feature for SGD 100, while the display panel 170 generally serves as an output feature for SGD 100. As is generally understood, the touch screen 146 may comprise an outer, transparent cover layer of the display panel 170 such that the display panel 170 may be viewed through touch screen 146. For example, when the display panel 170 corresponds to a TOLED display, the touch screen 146 may correspond to one or more layers of transparent sensing material to implement a touch screen 146 in conjunction with the TOLED display such that the combination of layers remains transparent and functional. As such, the transparent sensing material forming the touch screen 146 may be applied to a front surface of the display panel 170 as shown in Fig. 8 such that a user 106 can make input selections via touch screen 146 by pressing his fingers or applying a stylus to the front of the display panel 170 as shown. As another example, the transparent sensing material forming the touch screen 146 may additionally or alternatively be applied to a back surface of the TOLED display as shown in Fig. 9 such that a user 106 can make input selections via the touch screen 146 by pressing his fingers or applying a stylus to the rear of the display panel 170 as shown. The embodiment depicted in Fig. 9 by which a user 106 can provide input selections from behind the display buttons/items as opposed to on top of the buttons eliminates or reduces the problem of obscuring buttons with a user's fingers or hands and allows for more precise selection and smaller potential selection targets.
[0066] It should be appreciated that the touch screen 146 used within the scope of the present subject matter may generally comprise any suitable touch screen known in the art. For example, in several embodiments, the touch screen 146 may correspond to a resistive touch screen, a capacitive touch screen or a pressure sensitive configuration. A capacitive touch screen that uses a sensor material such as indium tin oxide (ITO) may be particularly well suited as a transparent sensing material. A capacitive touch screen may also provide such advantages as overall thinness and light weight. In addition, a capacitive touch panel requires no activation force but only a slight contact, which can be an advantage for a user 106 who may have motor control limitations. Capacitive touch screens also
accommodate multi-touch applications (i.e., a set of interaction techniques which allow a user 106 to control graphical applications with several fingers) as well as scrolling. Suitable examples of touch screens for use herein are disclosed in U.S. Patent Nos. 6,879,319; 6,885,157; 7,042,444; 7,106,307; 7,133,032, 7,202,856; and 7,230,608 all to Cok, all of which are hereby incorporated herein by reference for all purposes.
[0067] As indicated above, the SGD hardware components may further include one or more speakers 136. Generally, the speakers 136 may correspond to any compact high power audio output device and may function as an audible interface for the SGD 100 when the computer processor(s) 138 of the processing unit 104 utilize text-to-speech functionality. In accordance with the general functionality of an SGD 100, a user 106 provides text, symbols corresponding to text, and/or related or additional information in a "Message Window" which then may be interpreted by a text-to-speech engine and provided as audio output via the speakers 136. Speech output may be generated in accordance with one or more preconfigured text-to-speech generation tools in male or female and adult or child voices, such as but not limited to such products as offered for sale by CereProc of Edinburgh, Scotland, Cepstral of Pittsburgh, PA, HQ Voices offered by Acapela Group of Mons, Belgium, Flexvoice offered by Mindmaker of San Jose, California, DECtalk offered by Fonix of Salt Lake City, Utah, products by Loquendo of Torino, Italy, VoiceText offered by NeoSpeech of Sunnyvale, California, AT&T's Natural Voices offered by Wizzard of Pittsburgh, Pennsylvania, Microsoft Voices, digitized voice (digitally recorded voice clips) or others. A volume control module 164 may be controlled, in various embodiments, by one or more scrolling switches, touchscreen buttons, volume knobs, or the like.
[0068] It should be appreciated that the speakers 136 of the present subject matter may be mounted or otherwise disposed at any location on the wheelchair 110 or on the SGD 100. For example, in one embodiment, the speakers 136 may be physically separated from both the display unit 102 and the housing module 108. For instance, the speakers 136 may be mounted or embedded within the armrests 124, seat 114, or frame 1 12 of the wheelchair 1 10. In another
embodiment, illustrated in FIG. 1 , one or more speakers 136 may be embedded within the housing module 108 of the SGD 100. Alternatively, as shown in FIG. 10, the speakers 136 may be mounted within the display frame 172 of the display unit 102 or, in the event of a frameless configuration, within the base element 174 of the display unit 102. As shown in FIG. 10, the speakers 136 are disposed on a side of the display frame 170 facing the user 106. However, it should be
appreciated that speakers 36 may also be mounted or secured to the opposite side of the display unit 102 to enhance the ability of those to which a user 106 is communicating through the text-to-speech functionality of the SGD 100 to hear and understand any audio outputs from the speakers 136. Given the flexibility in locating the speakers 136 of the SGD 100, it should be appreciated that the speakers 136 may be in communication with the central processing unit 104 by any suitable means, including via a wired or wireless connection. For example, the speakers 136 may be communicatively coupled to the processing unit 104 through a Bluetooth connection or any other suitable wireless means.
[0069] In addition to providing wireless communication with the speakers 136 of the present subject matter, it should be appreciated that integrated Bluetooth features may also afford a user 106 the opportunity to take advantage of several optional Bluetooth accessories. For example, a switch may be provided for users 106 to mechanically actuate a selection on the SGD 100 and then communicate that selection via Bluetooth protocols. Switching is often used when an SGD 100 operates in a user-input mode where choices are scanned across the display panel 170 as visual options or sequenced within an audio output and a user 106 then can select one of the scanned options upon selection by a switch. Scanning users often rely on switches located wherever the user 106 has consistent and reliable motor control. For example, switches may be located on the seat 1 14 (e.g., the head rest), the armrests 124 or leg support of the wheelchair 1 10.
Provision of a Bluetooth-communicating input switch eliminates the need for wire routing throughout wheelchair 110, thus providing a more convenient and safer environment for the user 106 in a wheelchair with moving parts.
[0070] Another option afforded by Bluetooth communications features involves the benefits of a Bluetooth audio pathway. Many users 106 utilize an option of auditory scanning to operate their SGD 100. A user 106 can choose to use a Bluetooth-enabled headphone to listen to the scanning, thus affording a more private listening environment that eliminates or reduces potential disturbance in a classroom environment without public broadcasting of a user's communications. A Bluetooth (or other wirelessly configured headset) can provide advantages over traditional wired headsets, again by overcoming the cumbersome nature of the traditional headsets and their associated wires.
[0071] Referring now to FIG. 10, an embodiment of eye tracking features that may be used with the SGD 100 in accordance with aspects of the presently disclosed technology will now be discussed. In general, when eye tracking is used as an input selection mechanism for a speech generation device 100, an eye tracking device 178 with one or more light sources 180 and sensing elements, such as a camera 182, may be provided relative to the display panel 170 to capture a user's selections. Processing functionality for the eye tracking device 178 may be provided by a microprocessor provided within the eye tracking device 178 or a separate peripheral processor, such as a processor 138 of the central processing unit 102, connected to the eye tracking device 178 via a wired or wireless connection. Similarly, connection between the eye tracking device 178 and the display panel 170 of the display unit 102 may be implemented via a wired or wireless connection.
[0072] A speech generation device 100 that can be controlled by an eye tracking device 178 generally may be of a type that provides a display panel 170 that displays visual objects that the user 106 can consider whether to select. The selection software that implements the user's decision to select an object displayed on the display panel 170 is provided with the capability of using inputs from the eye tracking device 178 to effect the selection of the objects displayed on the display panel 170. The selection software may include an algorithm in conjunction with one or more selection methods to select an object on the display panel 170 of the speech generation device 100 by taking some action with the user's eyes (e.g., blinking and/or gazing for a predetermined dwell time) with or without a combination of other actions (e.g., switch actuation, joystick control, or the like).
[0073] In the particular embodiment of Fig. 10, eye tracker elements of the eye tracking device 178 desirably may include a video camera 182 disposed within the display unit 102 and corresponding focusing lens mounted relative to an opening 184 defined in the display frame 172 as well as one or more light sources (e.g., a left infrared LED array 180 and a right infrared LED array 180) embedded within the display frame 172. The focusing lens may be mounted in an adjustable lens housing and disposed in front of the video camera 182. The adjustable lens housing can be mechanically locked into position so that the focus of the lens does not change with vibration or drops. Each of the LEDs in each infrared LED array 180 desirably emits at a wavelength of about 880 nanometers, which is the shortest wavelength deemed suitable in one exemplary embodiment for use without distracting the user 106 (the shorter the wavelength, the more sensitive the sensor, i.e., video camera 182, of the eye tracker 178). However, LEDs 180 operating at wavelengths other than about 880 nanometers easily can be substituted and may be desirable for certain users 106 and/or certain
environments. A plurality of LEDs (e.g., ten-fifty LEDs) may be disposed in staggered, linear or other configurations in each array 180. Additionally, transparent protective covers may be provided over each of the LED arrays 180. [0074] As further shown in Fig. 10, two spaced apart indicator lights 186a, 186b optionally may be disposed beneath the opening 184 defined in the display frame 172. The processor associated with the eye tracking device 178 may be
configured to illuminate each indicator light 186a, 186b when the device 178 has acquired the location of the user's eye associated with that indicator light. The eye tracker's acquisition of the location of the user's eye may require using the processing power of either a microprocessor of the speech generation device 100 or of a separate dedicated microprocessor for the eye tracking device 178, as the case may be. In each case for example, if the eye tracking device 178 has acquired the location of the user's left eye, then the device is configured to illuminate the left indicator light 186a. Similarly, if the eye tracking device 178 has acquired the location of the user's right eye, then the device is configured to illuminate the right indicator light 186b. This feature of providing separate indicator lights 186a, 186b mounted on the front of the display unit 102 enables the eye tracking device 178 to avoid using part of the display panel 170 to show the user 106 if one or both of the user's eyes are being tracked. Accordingly, this indicator light feature conserves valuable space on the display panel 170. Additionally, it has also been observed that these indicators 186a, 186b act as a relaxation technique for otherwise hyper users.
[0075] Additional features, elements and steps that may be optionally incorporated into SGD 100 or other speech generation devices in accordance with the disclosed technology are disclosed in U.S. Provisional Patent Applications entitled "SEPARATELY PORTABLE DEVICE FOR IMPLEMENTING EYE GAZE CONTROL OF A SPEECH GENERATION DEVICE" corresponding to USSN 61/217,536, and "HAND-HELD SPEECH GENERATION DEVICE" corresponding to USSN 61/228,256, which are hereby incorporated herein by this reference in their entirety for all purposes.
[0076] While the present subject matter has been described in detail with respect to specific embodiments thereof, it will be appreciated that those skilled in the art, upon attaining an understanding of the foregoing may readily produce alterations to, variations of, and equivalents to such embodiments. Accordingly, the scope of the present disclosure is by way of example rather than by way of limitation, and the su bject disclosure does not preclude inclusion of such modifications, variations and/or additions to the present subject matter as would be readily apparent to one of ordinary skill in the art.

Claims

WHAT IS CLAIMED IS:
1. A speech generation device for use with a wheelchair, the speech generation device comprising:
a display unit having a display panel;
a support member connectable to the display unit and configured to position the display unit relative to the wheelchair so as to provide a user of the wheelchair visual access to the display panel of the display unit;
a housing module physically separated from the display unit;
a processing unit disposed within the housing module, the processing unit including a processor and a related computer-readable medium storing instructions executable by the processor,
wherein the instructions stored on the computer-readable medium configure the speech generation device to generate text-to-speech output.
2. The speech generation device of claim 1 , wherein the housing module is secured to an exterior portion of the wheelchair.
3. The speech generation device of claim 1 , wherein the housing module is located within an interior portion of the wheelchair.
4. The speech generation device of claim 1 , wherein the support member includes a first end attached to a portion of the wheelchair and a second end attached to the display unit.
5. The speech generation device of claim 1 , wherein the support member includes adjustment features that permit a position of the display unit to be adjusted relative to the wheelchair.
6. The speech generation device of claim 1 , further comprising a battery disposed within the support member, the battery supplying power to at least one of the display unit and the processing unit.
7. The speech generation device of claim 1 , wherein the processing unit is communicatively coupled to the display unit through a wired connection or a wireless connection.
8. The speech generation device of claim 7, wherein the processing unit is communicatively coupled to the display unit by a cable extending from the housing module through the support member to the display unit.
9. The speech generation device of claim 1 , further comprising at least one speaker, the at least one speaker being physically separated from the display unit and the housing module.
10. The speech generation device of claim 1 , wherein a joystick of the wheelchair is configured as an input device for the speech generation device, the joystick being communicatively coupled to the processing unit
11. The speech generation device of claim 1 , wherein a battery used to supply power to the wheelchair is also configured to supply power to at least one of the display unit and the processing unit.
12. The speech generation device of claim 1 , wherein the display panel of the display unit comprises a transparent organic light-emitting diode display.
13. A wheelchair including a speech generation device mounted thereon, the wheelchair comprising:
a frame;
a seat supported by the frame;
at least two wheels coupled to the frame;
a display unit having a display panel;
a support member having a first end attached to one of the frame and the seat and a second end attached to the display unit, the support member being configured to position the display unit relative to the seat so as to provide a user disposed within the wheelchair visual access to the display panel of the display unit;
a housing module physically separated from the display unit;
a processing unit disposed within the housing module and communicatively coupled to the display unit, the processing unit including a processor and a related computer-readable medium storing instructions executable by the processor,
wherein the instructions stored on the computer-readable medium configure the speech generation device to generate text-to-speech output.
14. The wheelchair of claim 13, wherein the housing module is secured to an exterior portion of the wheelchair or is located within an interior portion of the wheelchair.
15. The wheelchair of claim 13, wherein the support member includes adjustment features that permit a position of the display unit to be adjusted relative to the wheelchair.
16. The wheelchair of claim 13, further comprising a battery disposed within the support member, the battery supplying power to at least one of the display unit and the processing unit.
17. The wheelchair of claim 13, further comprising at least one speaker, the at least one speaker being physically separated from the display unit and the housing module.
18. The wheelchair of claim 13, wherein a joystick of the wheelchair is configured as an input device for the speech generation device, the joystick being communicatively coupled to the processing unit.
19. The wheelchair of claim 13, wherein a battery used to supply power to the wheelchair is also configured to supply power to at least one of the display unit and the processing unit.
20. The wheelchair of claim 13, wherein the display panel of the display unit comprises a transparent organic light-emitting diode display.
PCT/US2010/051929 2009-10-09 2010-10-08 Speech generation device with separate display and processing units for use with wheelchairs WO2011044429A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US25007409P 2009-10-09 2009-10-09
US61/250,074 2009-10-09
US33386310P 2010-05-12 2010-05-12
US61/333,863 2010-05-12

Publications (1)

Publication Number Publication Date
WO2011044429A1 true WO2011044429A1 (en) 2011-04-14

Family

ID=43857164

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/051929 WO2011044429A1 (en) 2009-10-09 2010-10-08 Speech generation device with separate display and processing units for use with wheelchairs

Country Status (1)

Country Link
WO (1) WO2011044429A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2506208A (en) * 2012-09-25 2014-03-26 Penny & Giles Controls Ltd Control module for electric wheelchair
WO2014200763A1 (en) * 2013-06-13 2014-12-18 Innovative Accessories, Llc Protective padded sleeve for hip restraints on golf carts
CN106309037A (en) * 2016-11-21 2017-01-11 徐兵 Intelligent electric wheelchair
CN106821628A (en) * 2017-04-12 2017-06-13 中国医学科学院生物医学工程研究所 A kind of controller system and its control method based on high speed SSVEP intelligent wheel chairs
US9760123B2 (en) 2010-08-06 2017-09-12 Dynavox Systems Llc Speech generation device with a projected display and optical inputs
WO2018044297A1 (en) * 2016-08-31 2018-03-08 Ford Global Technologies, Llc Wheelchair with weather shield
CN108852665A (en) * 2018-07-17 2018-11-23 郜鹏 A kind of seat of electric wheelchair

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5245558A (en) * 1992-03-11 1993-09-14 Synergy Computer system for disabled user
US6108592A (en) * 1998-05-07 2000-08-22 International Business Machines Corporation Voice-controlled motorized wheelchair with sensors and displays
US20080071543A1 (en) * 2004-05-12 2008-03-20 Carl Jarvis Secure Personal Health Information and Event Reminder System and Portable Electronic Device
US20090084617A1 (en) * 2007-10-01 2009-04-02 Curtis Instruments, Inc. Integrated reminder function in a personal mobility vehicle, such as a wheelchair

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5245558A (en) * 1992-03-11 1993-09-14 Synergy Computer system for disabled user
US6108592A (en) * 1998-05-07 2000-08-22 International Business Machines Corporation Voice-controlled motorized wheelchair with sensors and displays
US20080071543A1 (en) * 2004-05-12 2008-03-20 Carl Jarvis Secure Personal Health Information and Event Reminder System and Portable Electronic Device
US20090084617A1 (en) * 2007-10-01 2009-04-02 Curtis Instruments, Inc. Integrated reminder function in a personal mobility vehicle, such as a wheelchair

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9760123B2 (en) 2010-08-06 2017-09-12 Dynavox Systems Llc Speech generation device with a projected display and optical inputs
GB2506208A (en) * 2012-09-25 2014-03-26 Penny & Giles Controls Ltd Control module for electric wheelchair
WO2014200763A1 (en) * 2013-06-13 2014-12-18 Innovative Accessories, Llc Protective padded sleeve for hip restraints on golf carts
CN105338860A (en) * 2013-06-13 2016-02-17 创新配件有限责任公司 Protective padded sleeve for hip restraints on golf carts
US9573498B2 (en) 2013-06-13 2017-02-21 Innovative Accessories, Llc Protective padded sleeve for hip restraints on golf carts
CN105338860B (en) * 2013-06-13 2019-08-02 创新配件有限责任公司 The protection bushing of buttocks limited part on golf cart
WO2018044297A1 (en) * 2016-08-31 2018-03-08 Ford Global Technologies, Llc Wheelchair with weather shield
CN106309037A (en) * 2016-11-21 2017-01-11 徐兵 Intelligent electric wheelchair
CN106821628A (en) * 2017-04-12 2017-06-13 中国医学科学院生物医学工程研究所 A kind of controller system and its control method based on high speed SSVEP intelligent wheel chairs
CN108852665A (en) * 2018-07-17 2018-11-23 郜鹏 A kind of seat of electric wheelchair

Similar Documents

Publication Publication Date Title
WO2011044429A1 (en) Speech generation device with separate display and processing units for use with wheelchairs
US10031576B2 (en) Speech generation device with a head mounted display unit
US10897528B2 (en) Head-mounted display apparatus for retaining a portable electronic device with display
US10031554B2 (en) Display device, module, display system, and electronic device
KR101186530B1 (en) Electronic device and controling method thereof
US9760123B2 (en) Speech generation device with a projected display and optical inputs
US20170360999A1 (en) Instructional medical treatment system
WO2012009335A1 (en) A wearable speech generation device
US20080041282A1 (en) Modular multi-wall tray retrofitable to a wheelchair
US7593031B2 (en) Integrated desktop videoconferencing system
EP2626273B1 (en) Accessory cart
KR102209512B1 (en) Glasses type mobile terminal
WO2010062479A1 (en) System and apparatus for eyeglass appliance platform
TW201415113A (en) Adapter for eyewear
US20140133670A1 (en) Headphone device
JP2005244919A (en) Image display device and image display system
US20200237587A1 (en) Motorized wheelchair and control method thereof
KR101977079B1 (en) Mobile terminal
US20190341958A1 (en) Mobile device cover for use with a host mobile device
JP2002232810A (en) Head mounted video and audio reproduction system
GB2475977A (en) Height and rotatably adjustable support device for a display
US20190341957A1 (en) Mobile device cover for use with a host mobile device
WO2011044435A1 (en) Speech generation device with oled display
KR200471454Y1 (en) Robot Device for Advertisement
WO2017166799A1 (en) Head-mounted display apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10822745

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10822745

Country of ref document: EP

Kind code of ref document: A1