CN103336580B - A kind of cursor control method of head-wearing device - Google Patents
A kind of cursor control method of head-wearing device Download PDFInfo
- Publication number
- CN103336580B CN103336580B CN201310295425.5A CN201310295425A CN103336580B CN 103336580 B CN103336580 B CN 103336580B CN 201310295425 A CN201310295425 A CN 201310295425A CN 103336580 B CN103336580 B CN 103336580B
- Authority
- CN
- China
- Prior art keywords
- head
- eye
- module
- data
- dimensional coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention is the cursor control method of a kind of head-wearing device, comprises the following steps: headwork processes sensor and the head checked moves data is mapped as head and moves two-dimensional coordinate displacement and be sent to microprocessor；Meanwhile, the eye movement data checked is mapped as eye and moves two-dimensional coordinate displacement and be sent to microprocessor by eye tracker；Head is moved two-dimensional coordinate displacement by microprocessor and eye moves the displacement superposed two-dimensional coordinate moved for cursor of two-dimensional coordinate；Performing click event by sound recognition module, the two-dimensional coordinate that the event that will click on moves with cursor exports together.The present invention utilizes man day raw natural head eye shallow consciousness synergy movement behavior,, head dynamic by eye moves and the sampling identification of agomphiasis percussion carries out mouse control, realize body-worn smart machine while liberation both hands, accomplished that consciousness expression way is depending on i.e. being controlled the most directly and accurately, the operation light actuating quantity of nature is little, reduces the consumption of muscle power energy in operation and helps long-time operation and help people with disability to use.
Description
Technical field
The invention belongs to field of mobile communication, be specifically related to the cursor control method of a kind of head-wearing device.
Background technology
Most of mouses of prior art, touch pad, head move the cursor control method of mouse, eye tracker etc. all
It is at the one of human body or a kind of action output quantifies.
Wherein, the eye of prior art move identification be the estimation to pupil area of visual field, accuracy and degree of stability very
Difference, does not possess the condition substituting mouse.And eye moves and identifies the acknowledgement key function not having practicality, more importantly
Have ignored the body posture compensation behavior of ergonomics and visual psychology target error, so user uses
The most awkward, light standard exactness is inadequate simultaneously, forces use can cause body injury for a long time.
Therefore, prior art existing defects, need further improvement and development.
Summary of the invention
(1) goal of the invention: it is an object of the invention to provide that one eye is dynamic, head dynamic and agomphiasis realizes institute
Depending on being the cursor control method controlled, i.e. dynamic for eye identification, the dynamic identification of head and agomphiasis percussion identification are carried out by one
The head-wearing device that hommization is integrated；Utilize man day raw natural head eye shallow consciousness synergy movement behavior, based on right
Target error the caused subconsciousness feedback head body pose compensation behavior act of visual psychology, by the behavior heart
Reason compensatory movement identification and the application of Kalman filtering, set up a pullover dynamic eye and move cursor control program step,
Realize head eye cursor control method the most easily.
(2) technical scheme:
The cursor control method of a kind of head-wearing device, comprises the following steps:
Step A, headwork process sensor and the head checked moves data are mapped as head and move two-dimensional coordinate displacement
And it is sent to microprocessor；Meanwhile, the eye movement data checked is mapped as eye dynamic two dimension seat by described eye tracker
Marker displacement is also sent to described microprocessor；
Step B, described microprocessor head is moved two-dimensional coordinate displacement and eye to move two-dimensional coordinate displacement superposed for cursor
The two-dimensional coordinate of movement；
Step C, described microprocessor perform, by sound recognition module, the click thing that bone-conduction microphone sends
Part, the two-dimensional coordinate that the event that will click on moves with cursor exports together.
The cursor control method of described head-wearing device, wherein: in described step A, headwork processes sensor
Head moves data be mapped as head and move the process of two-dimensional coordinate displacement, specifically includes following steps:
Motion tracker real-time data collection is optimized to obtain the most dynamic data by A-h1, headwork sensor,
And head is moved data pass to attitude computing module；
Head is moved the angular velocity in data by A-h2, described attitude computing module and acceleration carry out shaking thresholding and
Weighted fusion algorithm algorithm, obtains optimum attitude data, and optimum attitude data are passed to described head moves plane
Map checking module；
A-h3, described head move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Optimum attitude data are mapped as head and move two-dimensional coordinate parameter, and the head of mapping is moved the transmission of two-dimensional coordinate parameter
To the psychological behaviors compensating module of described microprocessor；
Head is moved the head of Planar Mapping checking module mapping and moves two-dimensional coordinate parameter by described psychological behaviors compensating module
It is modified, and correction value is fed back to described head moves Planar Mapping checking module；Described head moves Planar Mapping
The corrected value that checking module feeds back according to described psychological behaviors compensating module is corrected, and by the head after correction
Dynamic two-dimensional coordinate parameter is passed to an eye movement and is worked in coordination with superposition calculation module.
The cursor control method of described head-wearing device, wherein: described in described step A, eye tracker will check
Eye movement data be mapped as eye and move the process of two-dimensional coordinate displacement, specifically include following steps:
A-e1, eye move identification module and gather eye movement data, and the eye movement data of collection is transferred to filter tracking
Module；
A-e2, described filter tracking module obtain the pupil heart and corneal reflection by characteristics of image filtering, pass through
Noise reduction and temporal tracking filtering obtain the pupil heart and follow the tracks of data；And pupil heart tracking data are passed to assignment smooth adjustment
Module；
A-e3, described assignment smooth smothing filtering value and noise reduction function that adjustment module set by user and carry out
Adjustment, and the pupil heart after adjustment is followed the tracks of data pass to eye and move Planar Mapping checking module；
A-e4, described eye move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Described pupil heart tracking data are mapped, and the pupil heart tracking data of mapping are sent to described psychological behaviors
Compensating module；The pupil heart of mapping is followed the tracks of data and is modified by described psychological behaviors compensating module, and will revise
Value of feedback be sent to described eye and move Planar Mapping checking module；
Described eye moves Planar Mapping checking module to be carried out the pupil heart tracking data of mapping according to the correction value of feedback
Correction, and corrected value is sent to described head eye movement works in coordination with superposition calculation module.
The cursor control method of described head-wearing device, wherein, the side of described psychological behaviors compensating module correction
Method comprises the following steps:
Described psychological behaviors compensating module: by screen center's normal direction line, customer location, screen center's point, head
Dynamic horizontal plane central point, eye move central point as fixed reference, then head moves eye moving axes displacement move with head eye
Make feature database contrast and find out difference.
The cursor control method of described head-wearing device, wherein: described head moves eye moving axes displacement and moves with head eye
The contrast making feature database includes: the tracking psychic feedback that contrast sensation target deviates from causes a body pose compensation
Action obtains error amount, the error amount of each margin of error calculation by mean square error recurrence estimation during deviating from
Method corrects.
The cursor control method of described head-wearing device, wherein: described step B specifically includes following steps:
The head eye movement of microprocessor is worked in coordination with superposition calculation module and the head of optimization is moved data and eye movement data is carried out
Dynamic proportion superposition, makes light be marked in different quadrant different motion pattern and uses different superposition ratio, and accompany
For psychological compensation module dynamic corrections.
The cursor control method of described head-wearing device, wherein:
In described step C, the click eventing step sent of microprocessor execution bone-conduction microphone is:
The most described bone-conduction microphone is close to above forehead, and the data gathering teeth cavity signal are passed to micro-place
The sound recognition module of reason device；
The most described sound recognition module draws the intent instructions of user by the contrast of bone conduction waveform characterization libraries, concurrently
Go out cursor click event command and send gesture execution module to；
C3. gesture execution module will click on event and exports together with cursor coordinates.
The cursor control method of described head-wearing device, wherein: described gesture performs module and will click on thing
The output of part includes performing gesture, and is sent by the first wireless transport module by gesture.
The cursor control method of described head-wearing device, wherein: send cursor by the first wireless transmission unit
Control instruction controls other computer terminal, and when its computer terminal uses fixed terminal display, needs user
And eye dynamic carry out terminal display correct dynamic respectively in the position that two or more is different looks at characteristic point interaction school straight
Right, the geometric maps adjustment parameter obtained and screen distance information.
The cursor control method of described head-wearing device, wherein: described motion tracker include three-axis gyroscope,
Three axis accelerometer and three axle magnetic strength instrument.
(3) beneficial effect: the cursor control method of a kind of head-wearing device of the present invention, utilizes the man day to be conigenous so
The shallow consciousness synergy movement behavior of head eye, dynamic by eye, head dynamic and the sampling identification of agomphiasis percussion carries out mouse
Control, it is achieved body-worn smart machine has accomplished to realize the most directly and accurately expression while liberation both hands
Mode is depending on i.e. being controlled, and the operation light actuating quantity of nature is little, and reducing the consumption of muscle power energy in operation has
Encourage time operation and help people with disability to use.
Accompanying drawing explanation
Fig. 1 is the structural representation of head-wearing device of the present invention；
Fig. 2 be head of the present invention move eye move cursor control program step block schematic illustration；
Fig. 3 is that the present invention obtains geometric maps adjustment parameter and the schematic diagram of screen distance information.
Detailed description of the invention
Below in conjunction with preferred embodiment, the present invention is described in further details.
A kind of head-wearing device that the present invention provides, as it is shown in figure 1, include headwork sensor, bone conduction
Mike and eye tracker, described headwork sensor, bone-conduction microphone and eye tracker connect micro-place respectively
Reason device, described microprocessor connects the first wireless transport module.
Described headwork sensor comprises motion tracker, described motion tracker include three-axis gyroscope,
Three axis accelerometer and three axle magnetic strength instrument, for gathering the motion of user's head.
Described microprocessor includes that superposition calculation module, cursor are worked in coordination with in psychological behaviors compensating module, head eye movement
Instruction performs module, sound recognition module, head eye motion characteristic storehouse, bone conduction waveform characterization libraries and gesture
Perform module.
Described headwork sensor, moves Planar Mapping school including motion tracker, attitude computing module and head
To module.
Described eye tracker includes that eye moves identification module, filter tracking module, assignment smooths adjustment module and eye moves
Planar Mapping checking module.
Described head-wearing device utilizes headwork sensor, eye tracker, bone-conduction microphone and microprocessor fortune
The cursor control method that the pullover dynamic eye of row one is dynamic, can move data and eye by the head that described action sensor obtains
The eye movement data that dynamic instrument obtains obtains cursor displacement, bone-conduction microphone pickup tooth sound by superposition calculation
Judge to draw cursor acknowledgement key action, then cursor information is reflected in head-mounted display, or by the
One other terminal of wireless transport module controlled in wireless.Such as, wearing sensor described in can be wireless by first
Cursor control information is sent to the second wireless transport module of computer terminal, described computer terminal by transport module
Cursor control information is sent on terminal display display.
The method that described headwork sensor and eye tracker carry out cursor control, as in figure 2 it is shown, specifically include
Following steps:
Step A, described headwork process sensor and the head checked moves data are mapped as head and move two-dimensional coordinate
Displacement is also sent to described microprocessor；Meanwhile, the eye movement data checked is mapped as eye by described eye tracker
Dynamic two-dimensional coordinate displacement is also sent to described microprocessor.
Step B, described microprocessor head is moved two-dimensional coordinate displacement and eye to move two-dimensional coordinate displacement superposed for cursor
The two-dimensional coordinate of movement, and move two-dimensional coordinate displacement to head and eye moves two-dimensional coordinate Displacement Feedback correction value simultaneously.
Step C, described microprocessor monitors, and perform bone-conduction microphone by described sound recognition module
The click event sent, the two-dimensional coordinate that the event that will click on moves with cursor exports the most immediately, performs cursor
Instruct or gesture is sent to other-end by described first wireless transport module.
The cursor control method of head-wearing device of the present invention, in described step A, headwork processes sensor
Head moves data be mapped as head and move the process of two-dimensional coordinate displacement, specifically includes following steps:
Motion tracker real-time data collection is optimized the most dynamic by A-h1, described headwork sensor
Data, and head is moved data pass to described attitude computing module.
Head is moved the angular velocity in data by A-h2, described attitude computing module and acceleration carry out shaking thresholding and
Weighted fusion algorithm algorithm, obtains optimum attitude data, and optimum attitude data are passed to described head moves plane
Map checking module.
A-h3, described head move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Optimum attitude data are mapped as head and move two-dimensional coordinate parameter, and the head of mapping is moved the transmission of two-dimensional coordinate parameter
To the psychological behaviors compensating module of described microprocessor.
Head is moved the head of Planar Mapping checking module mapping and moves two-dimensional coordinate parameter by described psychological behaviors compensating module
It is modified, and correction value is fed back to described head moves Planar Mapping checking module；Described head moves Planar Mapping
The corrected value that checking module feeds back according to described psychological behaviors compensating module is corrected, and by the head after correction
Dynamic two-dimensional coordinate parameter is passed to an eye movement and is worked in coordination with superposition calculation module.
The eye movement data checked is mapped as eye and moves two-dimensional coordinate displacement by eye tracker described in described step A
Process, specifically includes following steps:
A-e1, described eye move identification module and gather eye movement data, and eye is moved identification module collection by described eye tracker
Eye movement data be transferred to described filter tracking module.
A-e2, described filter tracking module obtain the pupil heart and corneal reflection by characteristics of image filtering, pass through
Noise reduction and temporal tracking filtering obtain the pupil heart and follow the tracks of data；And pupil heart tracking data are passed to described assignment smooth
Adjustment module.
A-e3, described assignment smooth smothing filtering value and noise reduction function that adjustment module set by user and carry out
Adjustment, and the pupil heart after adjustment is followed the tracks of data pass to described eye and move Planar Mapping checking module.
A-e4, described eye move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Described pupil heart tracking data are mapped, and the pupil heart tracking data of mapping are sent to described psychological behaviors
Compensating module；The pupil heart of mapping is followed the tracks of data and is modified by described psychological behaviors compensating module, and will revise
Value of feedback be sent to described eye and move Planar Mapping checking module.
Described eye moves Planar Mapping checking module to be carried out the pupil heart tracking data of mapping according to the correction value of feedback
Correction, and corrected value is sent to described head eye movement works in coordination with superposition calculation module.
Described psychological behaviors compensating module: by screen center's normal direction line, customer location, screen center's point, head
Dynamic horizontal plane central point, eye move central point as fixed reference, then head moves eye moving axes displacement move with head eye
Make feature database contrast and find out difference.
Described head moves the contrast in eye moving axes displacement and head eye motion characteristic storehouse and includes: contrast sensation target deviates from
Follow the trail of psychic feedback cause an action for body pose compensation, such as head move short distance repeatedly come and go, head move eye move
The improper analysis deviating from action etc. identifies the error amount obtained, the error amount of each margin of error during deviating from
Corrected by the algorithm of a set of mean square error recurrence estimation, and particular weights error correction values feedback is moved to the end
Planar Mapping checking module and eye move correction cursor movement error in Planar Mapping checking module, give head simultaneously
Superposition calculation module dynamic proportion superposition value is worked in coordination with in eye movement.
The core of described psychological behaviors compensating module is based on the caused subconsciousness of target error to visual psychology
Feedback head body pose compensation behavior act, by answering psychological behaviors compensatory movement identification and Kalman filtering
With.
In step B of the present invention, head is moved described microprocessor two-dimensional coordinate displacement and eye moves two-dimensional coordinate
The step of the displacement superposed two-dimensional coordinate moved for cursor is specific as follows:
Described head eye movement work in coordination with superposition calculation module the head of optimization is moved data and eye movement data dynamically than
Example superposition, the dynamic superposition ratio i.e. using psychological behaviors compensating module to provide, make light be marked on different quadrant not
With motor pattern uses different superposition ratio, and with behavior psychological compensation module dynamic corrections；Also may be used simultaneously
To be selected single to use head to move data or eye movement data to drive cursor by user.
In described step C, the click eventing step sent of microprocessor execution bone-conduction microphone is:
The most described bone-conduction microphone is close to above forehead, and the data gathering teeth cavity signal are passed to micro-place
The sound recognition module of reason device.
The most described sound recognition module draws the intent instructions of user by the contrast of bone conduction waveform characterization libraries, concurrently
Go out cursor click event command and send gesture execution module to.
C3. gesture execution module will click on event and the most immediately exports with cursor coordinates, can perform light
Mark instruction, it is also possible to gesture is sent by the first wireless transport module of telling a story.
The present invention is unable to escape meter Da Si contact problems in order to avoid eye moves cursor from sending instructions, and adds bone conduction wheat
Gram wind identifies teeth cavity and the sound of tooth conduction, if the knock of dental articulation be " left button is clicked ", " is engaged
+ occlusion " it is " left double click ", the sound of " bullet tongue " is " right button ", " playing tongue+conjunction tooth ", " conjunction tooth+
Play tongue+conjunction tooth " ... it is equal to the instruction of corresponding mouse control and combines.Due to agomphiasis be the initial demand of the mankind really
Recognize action, meet the nature of people.
The head-wearing device that the present invention provides sends cursor control instruction by the first wireless transmission unit and controls other
Computer terminal, and when other computer terminal uses fixed terminal display, need user different in two or more
Position correct dynamic respectively and eye is dynamic carries out terminal display direct-view characteristic point interaction check and correction, as it is shown on figure 3,
The geometric maps adjustment parameter obtained and screen distance information, in order to after head moves, pass through motion tracker
Follow the tracks of displacement, and variable parameter when being calculated new position, to ensure the accuracy of cursor action.
The head-wearing device that the present invention provides can provide one eye to move, head is dynamic and agomphiasis realizes depending on i.e. being controlled
Cursor control method, i.e. a kind of by dynamic for eye identifying, head dynamic identify and agomphiasis percussion identification to carry out hommization whole
The head-wearing device closed；Utilize man day raw natural head eye shallow consciousness synergy movement behavior, based on to visual psychology
Target error caused subconsciousness feedback head body pose compensation behavior act, by psychological behaviors is compensated dynamic
Make to identify and the application of Kalman filtering, set up a pullover dynamic eye and move cursor control program step, it is achieved head eye
Cursor control method the most easily.
A kind of head-wearing device of the present invention and the cursor control method of head-wearing device, utilize man day raw natural head eye
Shallow consciousness synergy movement behavior, head dynamic by eye moves and the sampling identification of agomphiasis percussion carries out mouse control,
Realize body-worn smart machine and accomplish to realize the most directly and accurately expression way while liberation both hands
Depending on i.e. being controlled, the operation light actuating quantity of nature is little, when in minimizing operation, the consumption of muscle power energy has growth encourage
Between operate and help people with disability to use.
Above content is the explanation to a preferred embodiment of the present invention, can help those skilled in the art more
It is completely understood by technical scheme.But, these embodiments are merely illustrative, it is impossible to assert
The detailed description of the invention of the present invention is only limitted to the explanation of these embodiments.General to the technical field of the invention
For logical technical staff, without departing from the inventive concept of the premise, it is also possible to make some simple deductions and
Conversion, all should be considered as belonging to protection scope of the present invention.
Claims (8)
1. a cursor control method for head-wearing device, comprises the following steps:
Step A, headwork process sensor and the head checked moves data are mapped as head and move two-dimensional coordinate displacement
And it is sent to microprocessor；Meanwhile, the eye movement data checked is mapped as eye and moves two-dimensional coordinate position by eye tracker
Move and be sent to described microprocessor；
Step B, described microprocessor head is moved two-dimensional coordinate displacement and eye to move two-dimensional coordinate displacement superposed for cursor
The two-dimensional coordinate of movement, described microprocessor also includes the behavior heart that correct dynamic two-dimensional coordinate parameter is modified
Reason compensating module；
Described psychological behaviors compensating module: by screen center's normal direction line, customer location, screen center's point, head
Dynamic horizontal plane central point, eye move central point as fixed reference, then head moves eye moving axes displacement move with head eye
Make feature database contrast and find out difference；
Described head moves the contrast in eye moving axes displacement and head eye motion characteristic storehouse and includes: contrast sensation target deviates from
Following the trail of psychic feedback causes an action for body pose compensation to obtain error amount, each margin of error during deviating from
Error amount is corrected by the algorithm of mean square error recurrence estimation；
Step C, described microprocessor perform, by sound recognition module, the click thing that bone-conduction microphone sends
Part, the two-dimensional coordinate that the event that will click on moves with cursor exports together.
The cursor control method of head-wearing device the most according to claim 1, it is characterised in that: described step
In rapid A, headwork processes sensor and head moves data is mapped as head and moves the process of two-dimensional coordinate displacement, specifically
Comprise the following steps:
Motion tracker real-time data collection is optimized to obtain the most dynamic data by A-h1, headwork sensor,
And head is moved data pass to attitude computing module；
Head is moved the angular velocity in data by A-h2, described attitude computing module and acceleration carry out shaking thresholding and
Weighted fusion algorithm algorithm, obtains optimum attitude data, and optimum attitude data are passed to head moves Planar Mapping
Checking module；
A-h3, described head move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Optimum attitude data are mapped as head and move two-dimensional coordinate parameter, and the head of mapping is moved the transmission of two-dimensional coordinate parameter
To the psychological behaviors compensating module of described microprocessor；
Head is moved the head of Planar Mapping checking module mapping and moves two-dimensional coordinate parameter by described psychological behaviors compensating module
It is modified, and correction value is fed back to described head moves Planar Mapping checking module；Described head moves Planar Mapping
The corrected value that checking module feeds back according to described psychological behaviors compensating module is corrected, and by the head after correction
Dynamic two-dimensional coordinate parameter is passed to an eye movement and is worked in coordination with superposition calculation module.
The cursor control method of head-wearing device the most according to claim 2, it is characterised in that: described step
Described in rapid A, the eye movement data checked is mapped as eye and moves the process of two-dimensional coordinate displacement, specifically by eye tracker
Comprise the following steps:
A-e1, eye move identification module and gather eye movement data, and the eye movement data of collection is transferred to filter tracking
Module；
A-e2, described filter tracking module obtain the pupil heart and corneal reflection by characteristics of image filtering, pass through
Noise reduction and temporal tracking filtering obtain the pupil heart and follow the tracks of data；And pupil heart tracking data are passed to assignment smooth adjustment
Module；
A-e3, described assignment smooth smothing filtering value and noise reduction function that adjustment module set by user and carry out
Adjustment, and the pupil heart after adjustment is followed the tracks of data pass to eye and move Planar Mapping checking module；
A-e4, described eye move the geometric maps adjustment parameter that Planar Mapping checking module is obtained by user interaction
Described pupil heart tracking data are mapped, and the pupil heart tracking data of mapping are sent to described psychological behaviors
Compensating module；The pupil heart of mapping is followed the tracks of data and is modified by described psychological behaviors compensating module, and will revise
Value of feedback be sent to described eye and move Planar Mapping checking module；
Described eye moves Planar Mapping checking module to be carried out the pupil heart tracking data of mapping according to the correction value of feedback
Correction, and corrected value is sent to described head eye movement works in coordination with superposition calculation module.
The cursor control method of head-wearing device the most according to claim 1, it is characterised in that: described
Step B specifically includes following steps:
The head eye movement of microprocessor is worked in coordination with superposition calculation module and the head of optimization is moved data and eye movement data is carried out
Dynamic proportion superposition, makes light be marked in different quadrant different motion pattern and uses different superposition ratio, and accompany
For psychological compensation module dynamic corrections.
The cursor control method of head-wearing device the most according to claim 4, it is characterised in that: described
In step C, the click eventing step sent of microprocessor execution bone-conduction microphone is:
The most described bone-conduction microphone is close to above forehead, and the data gathering teeth cavity signal are passed to micro-place
The sound recognition module of reason device；
The most described sound recognition module draws the intent instructions of user by the contrast of bone conduction waveform characterization libraries, concurrently
Go out cursor click event command and send gesture execution module to；
C3. gesture execution module will click on event and exports together with cursor coordinates.
The cursor control method of head-wearing device the most according to claim 5, it is characterised in that: described
Gesture performs module and will click on the output of event and include performing gesture, and by gesture by the
One wireless transport module sends.
The cursor control method of head-wearing device the most according to claim 6, it is characterised in that: pass through
First wireless transmission unit sends cursor control instruction and controls other computer terminal, and its computer terminal uses solid
When determining terminal display, need user correct dynamic respectively in the different position of two or more and eye is dynamic carries out terminal
Display direct-view characteristic point interaction check and correction, the geometric maps adjustment parameter obtained and screen distance information.
The cursor control method of head-wearing device the most according to claim 2, it is characterised in that: described
Motion tracker includes three-axis gyroscope, three axis accelerometer and three axle magnetic strength instrument.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310295425.5A CN103336580B (en) | 2013-07-16 | 2013-07-16 | A kind of cursor control method of head-wearing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310295425.5A CN103336580B (en) | 2013-07-16 | 2013-07-16 | A kind of cursor control method of head-wearing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103336580A CN103336580A (en) | 2013-10-02 |
| CN103336580B true CN103336580B (en) | 2016-08-24 |
Family
ID=49244768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310295425.5A Active CN103336580B (en) | 2013-07-16 | 2013-07-16 | A kind of cursor control method of head-wearing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103336580B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022155085A1 (en) * | 2021-01-15 | 2022-07-21 | Meta Platforms Technologies, Llc | System for non-verbal hands-free user input |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513770A (en) * | 2013-10-09 | 2014-01-15 | 中国科学院深圳先进技术研究院 | Man-machine interface equipment and man-machine interaction method based on three-axis gyroscope |
| CN103995607B (en) * | 2014-05-22 | 2018-09-07 | 百度在线网络技术（北京）有限公司 | Control method, control device and controlled method and controlled device |
| CN104571528B (en) * | 2015-01-27 | 2017-09-05 | 王露 | It is a kind of to realize that eyeball controls the device and method of intelligent terminal based on eyeball tracking |
| CN106156709B (en) * | 2015-04-20 | 2019-05-21 | 北京智谷睿拓技术服务有限公司 | Headwork determines method and apparatus |
| CN108153424B (en) * | 2015-06-03 | 2021-07-09 | 塔普翊海（上海）智能科技有限公司 | Eye movement and head movement interaction method of head display equipment |
| CN105078404B (en) * | 2015-09-02 | 2017-05-10 | 北京津发科技股份有限公司 | Fully automatic eye movement tracking distance measuring calibration instrument based on laser algorithm and use method of calibration instrument |
| CN105242790B (en) * | 2015-11-04 | 2019-06-21 | 钱雄 | A kind of smart machine control method and control device |
| CN106020452A (en) * | 2016-05-10 | 2016-10-12 | 北京行云时空科技有限公司 | Cursor movement method and system based on intelligent headset device |
| CN109032347A (en) * | 2018-07-06 | 2018-12-18 | 昆明理工大学 | One kind controlling mouse calibration method based on electro-ocular signal |
| CN110308794A (en) * | 2019-07-04 | 2019-10-08 | 郑州大学 | There are two types of the virtual implementing helmet of display pattern and the control methods of display pattern for tool |
| CN110727349B (en) * | 2019-09-29 | 2023-11-21 | 光感(上海)科技有限公司 | Human-computer interaction method and AR (augmented reality) glasses based on bone conduction interaction |
| CN112363621A (en) * | 2020-11-13 | 2021-02-12 | 北京达佳互联信息技术有限公司 | Terminal control method and device, electronic equipment and storage medium |
| CN113220183A (en) * | 2021-05-24 | 2021-08-06 | 中国银行股份有限公司 | System operation method and device, computer equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5513649A (en) * | 1994-03-22 | 1996-05-07 | Sam Technology, Inc. | Adaptive interference canceler for EEG movement and eye artifacts |
| CN101308400A (en) * | 2007-05-18 | 2008-11-19 | 肖斌 | Novel human-machine interaction device based on eye-motion and head motion detection |
| KR20110116580A (en) * | 2010-04-19 | 2011-10-26 | 국방과학연구소 | Line of sight tracking system integrated with head tracker and eye tracker and mehtod thereof |
| CN102930252A (en) * | 2012-10-26 | 2013-02-13 | 广东百泰科技有限公司 | Sight tracking method based on neural network head movement compensation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11281324A (en) * | 1998-03-30 | 1999-10-15 | Isuzu Motors Ltd | Measuring apparatus for line of sight |
| JP3525889B2 (en) * | 2000-11-28 | 2004-05-10 | 日本電気株式会社 | Notification method and processing system operated without being perceived by others around |
-
2013
- 2013-07-16 CN CN201310295425.5A patent/CN103336580B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5513649A (en) * | 1994-03-22 | 1996-05-07 | Sam Technology, Inc. | Adaptive interference canceler for EEG movement and eye artifacts |
| CN101308400A (en) * | 2007-05-18 | 2008-11-19 | 肖斌 | Novel human-machine interaction device based on eye-motion and head motion detection |
| KR20110116580A (en) * | 2010-04-19 | 2011-10-26 | 국방과학연구소 | Line of sight tracking system integrated with head tracker and eye tracker and mehtod thereof |
| CN102930252A (en) * | 2012-10-26 | 2013-02-13 | 广东百泰科技有限公司 | Sight tracking method based on neural network head movement compensation |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022155085A1 (en) * | 2021-01-15 | 2022-07-21 | Meta Platforms Technologies, Llc | System for non-verbal hands-free user input |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103336580A (en) | 2013-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103336580B (en) | A kind of cursor control method of head-wearing device | |
| US10970936B2 (en) | Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment | |
| JP2021535465A (en) | Camera-guided interpretation of neuromuscular signals | |
| US9798381B2 (en) | Hands-free pointer system | |
| CN103513770A (en) | Man-machine interface equipment and man-machine interaction method based on three-axis gyroscope | |
| US11262851B2 (en) | Target selection based on human gestures | |
| CN203417440U (en) | Composite sensing system for wearable pneumatic lower limb rehabilitation robot | |
| CN103677289A (en) | Intelligent interactive glove and interactive method | |
| CN110850987A (en) | Specific identification control method and device based on two-dimensional intention expressed by human body | |
| Jantz et al. | A brain-computer interface for extended reality interfaces | |
| CN101648076A (en) | Game controller and motion capture method using gyroscope | |
| WO2023087954A1 (en) | Upper limb rehabilitation training system for stroke patients | |
| CN104571837A (en) | Method and system for realizing human-computer interaction | |
| CN206048251U (en) | Gesture identification Apery manipulator system based on Multi-sensor Fusion | |
| Chen et al. | Application of wearable device HTC VIVE in upper limb rehabilitation training | |
| TWI505228B (en) | A self-care system for assisting quantitative assessment of rehabilitation movement | |
| US20240028129A1 (en) | Systems for detecting in-air and surface gestures available for use in an artificial-reality environment using sensors at a wrist-wearable device, and methods of use thereof | |
| CN111625098B (en) | Intelligent virtual avatar interaction method and device based on multi-channel information fusion | |
| Schäfer et al. | Feasibility analysis of sensor modalities to control a robot with eye and head movements for assistive tasks | |
| Yunardi et al. | Visual and gyroscope sensor for head movement controller system on meal-assistance application | |
| CN202929574U (en) | Mouse for disabled persons | |
| CN105536144A (en) | Device with man-machine interaction functions of game and massage | |
| US20240077949A1 (en) | Gesture and voice controlled interface device | |
| CN212460510U (en) | Data glove capable of operating AR glasses | |
| US11493994B2 (en) | Input device using bioelectric potential |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160819 Address after: 200235 Shanghai, Caobao Road, No. 120, building 38, building 3, building Patentee after: SHANGHAI TAPU INSTRUMENT MANUFACTURING CO., LTD. Address before: 556000, Qiandongnan Miao and Dong Autonomous Prefecture, Kaili, Beijing West Road, 43 (309) No. four, building, Guizhou Patentee before: Wei Rongjie |
|
| DD01 | Delivery of document by public notice |
Addressee: Taap Xiang Hai (Shanghai) Technology Co. Ltd. Document name: Notification that Application Deemed not to be Proposed |
|
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 201802 Shanghai, Jiading District, Shanghai Yi Road, building 412, room 5, 1082 Patentee after: Taap Yi Hai (Shanghai) Technology Co. Ltd. Address before: 200235 Shanghai, Caobao Road, No. 120, building 38, building 3, building Patentee before: SHANGHAI TAPU INSTRUMENT MANUFACTURING CO., LTD. |