EP2435986A4 - Spatial, multi-modal control device for use with spatial operating system - Google Patents

Spatial, multi-modal control device for use with spatial operating system

Info

Publication number
EP2435986A4
EP2435986A4 EP10781229.9A EP10781229A EP2435986A4 EP 2435986 A4 EP2435986 A4 EP 2435986A4 EP 10781229 A EP10781229 A EP 10781229A EP 2435986 A4 EP2435986 A4 EP 2435986A4
Authority
EP
European Patent Office
Prior art keywords
spatial
control device
operating system
modal control
modal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10781229.9A
Other languages
German (de)
French (fr)
Other versions
EP2435986A2 (en
Inventor
John S Underkoffler
Carlton Sparrell
Harald Belker
Kwindla Hultman Kramer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oblong Industries Inc
Original Assignee
Oblong Industries Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/553,845 external-priority patent/US8531396B2/en
Application filed by Oblong Industries Inc filed Critical Oblong Industries Inc
Publication of EP2435986A2 publication Critical patent/EP2435986A2/en
Publication of EP2435986A4 publication Critical patent/EP2435986A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
EP10781229.9A 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system Withdrawn EP2435986A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US18162109P 2009-05-27 2009-05-27
US12/553,845 US8531396B2 (en) 2006-02-08 2009-09-03 Control system for navigating a principal dimension of a data space
PCT/US2010/036440 WO2010138743A2 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system

Publications (2)

Publication Number Publication Date
EP2435986A2 EP2435986A2 (en) 2012-04-04
EP2435986A4 true EP2435986A4 (en) 2015-04-22

Family

ID=43223365

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10781229.9A Withdrawn EP2435986A4 (en) 2009-05-27 2010-05-27 Spatial, multi-modal control device for use with spatial operating system

Country Status (5)

Country Link
EP (1) EP2435986A4 (en)
JP (1) JP5782431B2 (en)
KR (1) KR101705924B1 (en)
CN (1) CN102460510B (en)
WO (1) WO2010138743A2 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011017305A1 (en) * 2011-04-15 2012-10-18 Abb Technology Ag Operating and monitoring system for technical installations
US9571816B2 (en) 2012-11-16 2017-02-14 Microsoft Technology Licensing, Llc Associating an object with a subject
US9251701B2 (en) 2013-02-14 2016-02-02 Microsoft Technology Licensing, Llc Control device with passive reflector
US9906778B2 (en) 2013-02-19 2018-02-27 Mirama Service Inc. Calibration device, calibration program, and calibration method
JP6195893B2 (en) 2013-02-19 2017-09-13 ミラマ サービス インク Shape recognition device, shape recognition program, and shape recognition method
WO2014128752A1 (en) 2013-02-19 2014-08-28 株式会社ブリリアントサービス Display control device, display control program, and display control method
US10171800B2 (en) 2013-02-19 2019-01-01 Mirama Service Inc. Input/output device, input/output program, and input/output method that provide visual recognition of object to add a sense of distance
JP6177872B2 (en) 2013-02-19 2017-08-09 ミラマ サービス インク I / O device, I / O program, and I / O method
US10373304B2 (en) * 2014-11-05 2019-08-06 Illinois Tool Works Inc. System and method of arranging welding device markers
WO2016106287A1 (en) * 2014-12-22 2016-06-30 Trane International Inc. Occupancy sensing and building control using mobile devices
JP5988286B1 (en) * 2016-04-01 2016-09-07 株式会社Ｃｙｇａｍｅｓ Program and image processing apparatus
US10522251B2 (en) 2016-07-08 2019-12-31 International Business Machines Corporation Infrared detectors and thermal tags for real-time activity monitoring
US10311273B2 (en) * 2016-10-18 2019-06-04 International Business Machines Corporation Thermal tags for real-time activity monitoring and methods for detecting the same
WO2018167865A1 (en) 2017-03-15 2018-09-20 三菱電機株式会社 Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device
CN111104091B (en) * 2019-12-12 2021-11-26 北京科技大学 Detection and conversion method for precision specific calculation in dynamic floating point error analysis
CN112549010B (en) * 2020-12-22 2022-11-08 南昌大学 Design method of multi-joint snake-shaped robot self-adaptive trajectory tracking controller based on improved Serpenoid curve

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3421167B2 (en) * 1994-05-03 2003-06-30 アイティユー リサーチ インコーポレイテッド Input device for contact control
US20030062889A1 (en) * 1996-12-12 2003-04-03 Synaptics (Uk) Limited Position detector
JP2001216069A (en) * 2000-02-01 2001-08-10 Toshiba Corp Operation inputting device and direction detecting method
US7445550B2 (en) * 2000-02-22 2008-11-04 Creative Kingdoms, Llc Magical wand and interactive play experience
SE0000850D0 (en) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
WO2004104811A2 (en) * 2003-05-20 2004-12-02 Lego A/S Method and system for manipulating a digital representation of a three-dimensional object
SG115546A1 (en) * 2003-06-23 2005-10-28 Affineon Technologies Pte Ltd Computer input device tracking six degrees of freedom
US7545362B2 (en) * 2004-02-26 2009-06-09 Microsoft Corporation Multi-modal navigation in a graphical user interface computing system
US20050212753A1 (en) * 2004-03-23 2005-09-29 Marvit David L Motion controlled remote controller
PL1741088T3 (en) * 2004-04-30 2012-08-31 Hillcrest Lab Inc Free space pointing devices with tilt compensation and improved usability
CN101536494B (en) * 2005-02-08 2017-04-26 奥布隆工业有限公司 System and method for genture based control system
KR101604565B1 (en) * 2005-03-04 2016-03-17 애플 인크. Multi-functional hand-held device
EP1907244A4 (en) * 2005-06-16 2009-07-01 Wabash Technologies Inc Pedal assembly having a hysteresis mechanism

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030103091A1 (en) * 2001-11-30 2003-06-05 Wong Yoon Kean Orientation dependent functionality of an electronic device
US20070021208A1 (en) * 2002-07-27 2007-01-25 Xiadong Mao Obtaining input for controlling execution of a game program
WO2010030822A1 (en) * 2008-09-10 2010-03-18 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2010138743A2 *

Also Published As

Publication number Publication date
EP2435986A2 (en) 2012-04-04
KR20120034672A (en) 2012-04-12
CN102460510A (en) 2012-05-16
CN102460510B (en) 2016-04-20
JP5782431B2 (en) 2015-09-24
WO2010138743A3 (en) 2011-03-10
JP2012528405A (en) 2012-11-12
WO2010138743A2 (en) 2010-12-02
KR101705924B1 (en) 2017-02-10

Similar Documents

Publication Publication Date Title
EP2435986A4 (en) Spatial, multi-modal control device for use with spatial operating system
EP2311705A4 (en) Control device
EP2468599A4 (en) Vehicle control device
EP2392994A4 (en) Active touch control system
EP2402199A4 (en) Control device for vehicle
EP2474437A4 (en) Brake control device
EP2557302A4 (en) Vehicle control device
EP2549073A4 (en) Vehicle control device
EP2444638A4 (en) Control device for vehicle
GB201002315D0 (en) Control system
EP2489564A4 (en) Brake control device
EP2447498A4 (en) Control device for vehicle
EP2426023A4 (en) Control device for vehicle
EP2570320A4 (en) Vehicle control device
EP2472087A4 (en) Vehicle control device
EP2383863A4 (en) Demand control device, demand control system, and demand control program
GB2484847B (en) Fluid control system
EP2590077A4 (en) Control device
EP2543566A4 (en) Vehicle control device
EP2495143A4 (en) Brake control device
EP2415646A4 (en) Brake control device
EP2637259A4 (en) Control device
GB0807629D0 (en) Control system
EP2511123A4 (en) Propulsion control device
EP2386440A4 (en) Control device for vehicle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20111221

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/03 20060101ALI20141127BHEP

Ipc: G06F 3/0346 20130101ALI20141127BHEP

Ipc: G09G 5/00 20060101ALI20141127BHEP

Ipc: G06T 7/20 20060101AFI20141127BHEP

Ipc: G06F 3/01 20060101ALI20141127BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20150323

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/20 20060101AFI20150317BHEP

Ipc: G09G 5/00 20060101ALI20150317BHEP

Ipc: G06F 3/03 20060101ALI20150317BHEP

Ipc: G06F 3/0346 20130101ALI20150317BHEP

Ipc: G06F 3/01 20060101ALI20150317BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20181201