WO2010138743A3 - Spatial, multi-modal control device for use with spatial operating system - Google Patents

Spatial, multi-modal control device for use with spatial operating system Download PDF

Info

Publication number
WO2010138743A3
WO2010138743A3 PCT/US2010/036440 US2010036440W WO2010138743A3 WO 2010138743 A3 WO2010138743 A3 WO 2010138743A3 US 2010036440 W US2010036440 W US 2010036440W WO 2010138743 A3 WO2010138743 A3 WO 2010138743A3
Authority
WO
WIPO (PCT)
Prior art keywords
spatial
control device
operating system
orientation
input device
Prior art date
Application number
PCT/US2010/036440
Other languages
French (fr)
Other versions
WO2010138743A2 (en
Inventor
John S. Underkoffler
Carlton Sparrell
Harald Belker
Kwindla Hultman Kramer
Original Assignee
Oblong Industries, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/553,845 external-priority patent/US8531396B2/en
Application filed by Oblong Industries, Inc. filed Critical Oblong Industries, Inc.
Priority to JP2012513264A priority Critical patent/JP5782431B2/en
Priority to EP10781229.9A priority patent/EP2435986A4/en
Priority to CN201080033408.9A priority patent/CN102460510B/en
Priority to KR1020117030977A priority patent/KR101705924B1/en
Publication of WO2010138743A2 publication Critical patent/WO2010138743A2/en
Publication of WO2010138743A3 publication Critical patent/WO2010138743A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Abstract

A system comprising an input device includes a detector coupled to a processor. The detector detects an orientation of the input device. The input device has multiple modal orientations corresponding to the orientation. The modal orientations correspond to multiple input modes of a gestural control system. The detector is coupled to the gestural control system and automatically controls selection of an input mode in response to the orientation.
PCT/US2010/036440 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system WO2010138743A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2012513264A JP5782431B2 (en) 2009-05-27 2010-05-27 Spatial multi-mode control device for use with spatial motion systems
EP10781229.9A EP2435986A4 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system
CN201080033408.9A CN102460510B (en) 2009-05-27 2010-05-27 For the space multi-mode opertaing device used together with spatial operation system
KR1020117030977A KR101705924B1 (en) 2009-05-27 2010-05-27 Spatial, Multi-Modal Control Device for Use with Spatial Operating System

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US18162109P 2009-05-27 2009-05-27
US61/181,621 2009-05-27
US12/553,845 US8531396B2 (en) 2006-02-08 2009-09-03 Control system for navigating a principal dimension of a data space
US12/553,845 2009-09-03

Publications (2)

Publication Number Publication Date
WO2010138743A2 WO2010138743A2 (en) 2010-12-02
WO2010138743A3 true WO2010138743A3 (en) 2011-03-10

Family

ID=43223365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/036440 WO2010138743A2 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system

Country Status (5)

Country Link
EP (1) EP2435986A4 (en)
JP (1) JP5782431B2 (en)
KR (1) KR101705924B1 (en)
CN (1) CN102460510B (en)
WO (1) WO2010138743A2 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011017305A1 (en) * 2011-04-15 2012-10-18 Abb Technology Ag Operating and monitoring system for technical installations
US9571816B2 (en) 2012-11-16 2017-02-14 Microsoft Technology Licensing, Llc Associating an object with a subject
US9251701B2 (en) 2013-02-14 2016-02-02 Microsoft Technology Licensing, Llc Control device with passive reflector
US9906778B2 (en) 2013-02-19 2018-02-27 Mirama Service Inc. Calibration device, calibration program, and calibration method
JP6195893B2 (en) 2013-02-19 2017-09-13 ミラマ サービス インク Shape recognition device, shape recognition program, and shape recognition method
WO2014128752A1 (en) 2013-02-19 2014-08-28 株式会社ブリリアントサービス Display control device, display control program, and display control method
US10171800B2 (en) 2013-02-19 2019-01-01 Mirama Service Inc. Input/output device, input/output program, and input/output method that provide visual recognition of object to add a sense of distance
JP6177872B2 (en) 2013-02-19 2017-08-09 ミラマ サービス インク I / O device, I / O program, and I / O method
US10373304B2 (en) * 2014-11-05 2019-08-06 Illinois Tool Works Inc. System and method of arranging welding device markers
WO2016106287A1 (en) * 2014-12-22 2016-06-30 Trane International Inc. Occupancy sensing and building control using mobile devices
JP5988286B1 (en) * 2016-04-01 2016-09-07 株式会社Ｃｙｇａｍｅｓ Program and image processing apparatus
US10522251B2 (en) 2016-07-08 2019-12-31 International Business Machines Corporation Infrared detectors and thermal tags for real-time activity monitoring
US10311273B2 (en) * 2016-10-18 2019-06-04 International Business Machines Corporation Thermal tags for real-time activity monitoring and methods for detecting the same
WO2018167865A1 (en) 2017-03-15 2018-09-20 三菱電機株式会社 Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device
CN111104091B (en) * 2019-12-12 2021-11-26 北京科技大学 Detection and conversion method for precision specific calculation in dynamic floating point error analysis
CN112549010B (en) * 2020-12-22 2022-11-08 南昌大学 Design method of multi-joint snake-shaped robot self-adaptive trajectory tracking controller based on improved Serpenoid curve

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20040169594A1 (en) * 1994-05-14 2004-09-02 Synaptics (Uk) Limited Position detector
US20050143173A1 (en) * 2000-02-22 2005-06-30 Barney Jonathan A. Magical wand and interactive play experience
US20060082546A1 (en) * 2003-06-23 2006-04-20 Fun Wey Computer input device tracking six degrees of freedom
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
US20070193396A1 (en) * 2005-06-16 2007-08-23 Schlabach Roderic A Pedal assembly having a hysteresis mechanism

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3421167B2 (en) * 1994-05-03 2003-06-30 アイティユー リサーチ インコーポレイテッド Input device for contact control
JP2001216069A (en) * 2000-02-01 2001-08-10 Toshiba Corp Operation inputting device and direction detecting method
SE0000850D0 (en) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
WO2004104811A2 (en) * 2003-05-20 2004-12-02 Lego A/S Method and system for manipulating a digital representation of a three-dimensional object
US7545362B2 (en) * 2004-02-26 2009-06-09 Microsoft Corporation Multi-modal navigation in a graphical user interface computing system
US20050212753A1 (en) * 2004-03-23 2005-09-29 Marvit David L Motion controlled remote controller
PL1741088T3 (en) * 2004-04-30 2012-08-31 Hillcrest Lab Inc Free space pointing devices with tilt compensation and improved usability
KR101604565B1 (en) * 2005-03-04 2016-03-17 애플 인크. Multi-functional hand-held device
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040169594A1 (en) * 1994-05-14 2004-09-02 Synaptics (Uk) Limited Position detector
US20050143173A1 (en) * 2000-02-22 2005-06-30 Barney Jonathan A. Magical wand and interactive play experience
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
US20060082546A1 (en) * 2003-06-23 2006-04-20 Fun Wey Computer input device tracking six degrees of freedom
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US20070193396A1 (en) * 2005-06-16 2007-08-23 Schlabach Roderic A Pedal assembly having a hysteresis mechanism

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2435986A4 *

Also Published As

Publication number Publication date
EP2435986A2 (en) 2012-04-04
KR20120034672A (en) 2012-04-12
CN102460510A (en) 2012-05-16
CN102460510B (en) 2016-04-20
JP5782431B2 (en) 2015-09-24
EP2435986A4 (en) 2015-04-22
JP2012528405A (en) 2012-11-12
WO2010138743A2 (en) 2010-12-02
KR101705924B1 (en) 2017-02-10

Similar Documents

Publication Publication Date Title
WO2010138743A3 (en) Spatial, multi-modal control device for use with spatial operating system
USD916104S1 (en) Display panel of a programmed computer system with a graphical user interface
WO2011019155A3 (en) Remote control device and remote control method using the same
WO2014074781A3 (en) Hybrid gesture control haptic system
MX2014015128A (en) Remote control apparatus and control method thereof.
USD710876S1 (en) Display panel of a programmed computer system with a graphical user interface
USD695304S1 (en) Display panel of a programmed computer system with a graphical user interface
WO2012074256A3 (en) Portable device and method for providing user interface mode thereof
WO2010124061A3 (en) Firefighting monitor and control system therefor
WO2011068363A3 (en) Power control method of gesture recognition device by detecting presence of user
TW200802065A (en) Touch screen device and operating method thereof
WO2009148776A3 (en) Wireless communication device having deterministic control of foreground access of the user interface
WO2011156161A3 (en) Content gestures
WO2012009444A3 (en) Systems and methods for dual use remote-control devices
EP2579563A3 (en) Image forming apparatus
WO2013192500A3 (en) User interfaces for robot training
WO2010107629A3 (en) Dual module portable devices
WO2013096789A8 (en) Devices, methods and systems for wireless control of medical devices
EP2354904A3 (en) Multi-display device and method for controlling the same
IN2014DN09253A (en)
WO2015042160A3 (en) User experience for conferencing with a touch screen display
EP2369447A3 (en) Method and system for controlling functions in a mobile device by multi-inputs
WO2012135478A3 (en) Area selection for hand held devices with display
WO2010110962A3 (en) System and method of managing the execution of applications at a portable computing device and a portable computing device docking station
WO2008123223A1 (en) Information processing terminal, method for controlling information processing terminal, and program

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080033408.9

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10781229

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2012513264

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2010781229

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 10170/DELNP/2011

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 20117030977

Country of ref document: KR

Kind code of ref document: A