CN105045503A - System and method for controlling non-contact touch screen - Google Patents

System and method for controlling non-contact touch screen Download PDF

Info

Publication number
CN105045503A
CN105045503A CN201510400378.5A CN201510400378A CN105045503A CN 105045503 A CN105045503 A CN 105045503A CN 201510400378 A CN201510400378 A CN 201510400378A CN 105045503 A CN105045503 A CN 105045503A
Authority
CN
China
Prior art keywords
gesture
action
screen
module
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510400378.5A
Other languages
Chinese (zh)
Inventor
陈海峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510400378.5A priority Critical patent/CN105045503A/en
Publication of CN105045503A publication Critical patent/CN105045503A/en
Pending legal-status Critical Current

Links

Abstract

The invention discloses a system and method for controlling a non-contact touch screen and relates to the technical field of touch screen control. The control system comprises a thermal induction module, a dynamic image recognition module, a dynamic image locking module, an image display module and a command conversion control module, wherein the command conversion control module is used for converting locked gesture images and actions into corresponding control commands to control actions of the touch screen. The control system is capable of realizing quick, accurate and non-contact control of the touch screen. As a result, the hand of a user can be effectively protected against bacteria and the safety and the stability of using the touch screen are improved.

Description

The control system of contactless touch-screen and method
Technical field
The present invention relates to touch-screen control technology field, particularly relate to a kind of control system and method for contactless touch-screen.
Background technology
At present, the electronic equipment such as smart mobile phone, automotive system, all trends towards using touch screen technology to carry out control operation.Although, the advantage of the man-machine interaction modes such as touch screen technology has simply, convenient, direct, it also exist security low, easily allow the hand of user be stained with the problems such as bacterium.Therefore, be necessary to research and develop a kind of control system that can solve touch screen technology the problems referred to above.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of control system and method for contactless touch-screen, described control system can realize quick, accurate, the contactless control to touch-screen, thus can effectively avoid the hand of user to be stained with bacterium, improve the safety and stability that touch-screen uses.
For solving the problems of the technologies described above, the technical solution used in the present invention is: a kind of control system of contactless touch-screen, is characterized in that: described control system comprises thermoinduction module, for responding to the relevant information of user's gesture, obtain the relevant information of gesture, wake screen up; Image Dynamic Recognition module, user's face and gesture information is caught by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then system can not be entered, if the face information of user, by checking, enters system, then Dynamic Recognition images of gestures and action, the images of gestures of identification and action are converted to corresponding image and action; The dynamic locking module of image, for locking the images of gestures and action that sense, judgement is which kind of gesture and action; Image display, for showing the images of gestures of locking and action on screen; Order conversion and control module, for converting the images of gestures of locking and action to corresponding control command, controls touch-screen action.
Further technical scheme is: described control system also comprises initialization module, for control system being initialised to the state started most.
Further technical scheme is: described control system also comprises interface display module, for the relevant information of display screen.
Further technical scheme is: thermoinduction module for responding to the action of user's gesture, Distance geometry positional information.
Further technical scheme is: carry out following associative operation in the gesture information of identification: palm from left to right slides, screen wakes up; Palm slides from right to left, and screen is closed; Palm vertical or along within the scope of 30 °-150 °, plane by left-to-right action, to the right page turning; Palm vertical or along within the scope of 30 °-150 °, plane by the right side to left action, left page turning.
Further technical scheme is: following several situation is considered as effectively sliding gesture operation:
Thumb and pinkie stretch, and the back of the hand, in the face of camera, recognizes gesture, and move past in journey dynamic, and during user operation gesture, left-leaning 60 degree, Right deviation 30, is considered as effective gesture;
Ok gesture, palmar aspect, to camera, recognizes gesture, and in moving process, left-leaning 60 degree, Right deviation 30, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, and forefinger refers to that abdomen is towards camera, recognize gesture, and in moving process, during user operation gesture, the angle of gesture and vertical direction, left avertence 60 degree, in right avertence 30 degree, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognize gesture, and in 1 second, have the displacement of continuous print to the left or to the right on a direction, the angle of gesture and vertical direction is in left avertence 45 degree of right avertence 30 degree, the track slided and the angle of horizontal direction, within the scope of 45 degree, are considered as once effective gesture operation;
Erect forefinger, forefinger is parallel with horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognizes gesture, and in 1 second, have the displacement of continuous print up or down on a direction, during user operation gesture, the angle of gesture and horizontal direction is under upper inclined 45 degree in inclined 30 degree, and the track of slip and the angle of vertical direction, within the scope of 45 degree, are considered as once effectively sliding gesture operation.
Further technical scheme is: when identifying gesture, hand range image acquisition module 20cm to 80cm.
Further technical scheme is: the response time of static gesture: user completes the mutual time and is no more than 500ms from operating gesture to application program.
Further technical scheme is: the response time of slide: the slip of gesture and the list rolling real-time synchronization of application program, if any time delay, be no more than 500ms; And speed and the amplitude of design lists rolling is come according to the speed that gesture is slided.
The invention also discloses a kind of control method of contactless touch-screen, it is characterized in that described method comprises the steps: the relevant information of thermoinduction module induction user gesture, obtain the relevant information of gesture, wake screen up; Image Dynamic Recognition module catches user's face and gesture information by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then system can not be entered, if the face information of user, by checking, enters system, then Dynamic Recognition images of gestures and action, converts corresponding image and action to by the images of gestures of identification and action; The dynamic locking module of image locks the images of gestures and action that sense, and judgement is which kind of gesture and action; The images of gestures of locking and action show by image display on screen; Order conversion and control module converts the images of gestures of locking and action to corresponding control command, controls touch-screen action.
The beneficial effect adopting technique scheme to produce is: described control system can realize quick, accurate, the contactless control to touch-screen, thus can effectively avoid the hand of user to be stained with bacterium, improves the safety and stability that touch-screen uses.
Accompanying drawing explanation
Fig. 1 is the theory diagram of system of the present invention;
Fig. 2 is the operational flow diagram of thermoinduction module in the present invention;
Fig. 3 is the operational flow diagram of image Dynamic Recognition module in the present invention;
Fig. 4 is the operational flow diagram of dynamic locking module in the present invention;
Fig. 5 is the operational flow diagram of screen display module;
Fig. 6 is the operational flow diagram of conversion and control module;
Fig. 7-8 is gesture function key diagrams.
Embodiment
In order to describe technical scheme of the present invention in detail, below in conjunction with the accompanying drawing of the embodiment of the present invention, clear, complete description is carried out to the technical scheme of the embodiment of the present invention.Obviously, described embodiment is a part of embodiment of the present invention, instead of whole embodiments.Based on described embodiments of the invention, the every other embodiment that those of ordinary skill in the art obtain under without the need to the prerequisite of creative work, all belongs to the scope of protection of the invention.
As shown in Figure 1, the invention discloses a kind of control system (touch-screen can be any a touch-screen of the prior art) of contactless touch-screen, described control system comprises thermoinduction module, for responding to the action of user's gesture, Distance geometry positional information, obtain the relevant information of gesture, wake screen up, as shown in Figure 2; Image Dynamic Recognition module, user's face and gesture information is caught by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then can not enter system, if the face information of user is by checking, enter system, then Dynamic Recognition images of gestures and action, the images of gestures of identification and action are converted to corresponding image and action, as shown in Figure 3; The dynamic locking module of image, for locking the images of gestures and action that sense, judgement is which kind of gesture and action, as shown in Figure 4; Image display, for the images of gestures of locking and action are shown on screen, as shown in Figure 5; Order conversion and control module, for converting the images of gestures of locking and action to corresponding control command, controls touch-screen action, as shown in Figure 6.
Corresponding with system, the invention also discloses a kind of control method of contactless touch-screen, described method comprises the steps: the relevant information of thermoinduction module induction user gesture, obtains the relevant information of gesture, wakes screen up; Image Dynamic Recognition module catches user's face and gesture information by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then system can not be entered, if the face information of user, by checking, enters system, then Dynamic Recognition images of gestures and action, converts corresponding image and action to by the images of gestures of identification and action; The dynamic locking module of image locks the images of gestures and action that sense, and judgement is which kind of gesture and action; The images of gestures of locking and action show by image display on screen; Order conversion and control module converts the images of gestures of locking and action to corresponding control command, controls touch-screen action.
Further, as shown in Figure 1, described control system also comprises initialization module, for control system being initialised to the state started most; And interface display module, for the relevant information of display screen, make user observe operation interface easily.
Palm from left to right slides, and screen wakes up; Palm slides from right to left, and screen is closed; Palm vertical or along within the scope of 30 °-150 °, plane by left-to-right action, to the right page turning; Palm vertical or along within the scope of 30 °-150 °, plane by the right side to left action, left page turning.Other concrete gesture function illustrates as Figure 7-8.
Several situation is considered as effectively sliding gesture operation below:
Thumb and pinkie stretch, and the back of the hand, in the face of camera, recognizes gesture, and move past in journey dynamic, and during user operation gesture, left-leaning 60 degree, Right deviation 30, is considered as effective gesture;
Ok gesture, palmar aspect, to camera, recognizes gesture, and in moving process, left-leaning 60 degree, Right deviation 30, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, and forefinger refers to that abdomen is towards camera, recognize gesture, and in moving process, during user operation gesture, the angle of gesture and vertical direction, left avertence 60 degree, in right avertence 30 degree, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognize gesture, and in 1 second, have the displacement of continuous print to the left or to the right on a direction, the angle of gesture and vertical direction is in left avertence 45 degree of right avertence 30 degree, the track slided and the angle of horizontal direction, within the scope of 45 degree, are considered as once effective gesture operation;
Erect forefinger, forefinger is parallel with horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognizes gesture, and in 1 second, have the displacement of continuous print up or down on a direction, during user operation gesture, the angle of gesture and horizontal direction is under upper inclined 45 degree in inclined 30 degree, and the track of slip and the angle of vertical direction, within the scope of 45 degree, are considered as once effectively sliding gesture operation.
When it is pointed out that for above identification gesture, hand range image acquisition module 20cm to 80cm, need accurately identify.
In order to product has more smooth interactive experience, the response time of gesture also there are some demands: the response time of static gesture: user completes the mutual time and is no more than 500ms from operating gesture to application program.The response time of slide: the slip of gesture and the list rolling real-time synchronization of application program, if any time delay, be no more than 500ms; And speed and the amplitude of design lists rolling is come according to the speed that gesture is slided.
Described control system can realize quick, accurate, the contactless control to touch-screen, thus can effectively avoid the hand of user to be stained with bacterium, improves the safety and stability that touch-screen uses.
Finally should be noted that; above embodiment is only in order to illustrate technical scheme of the present invention; but not limiting the scope of the invention; although done to explain to the present invention with reference to preferred embodiment; those of ordinary skill in the art is to be understood that; technical scheme of the present invention is modified or equivalent replacement, all belong to protection scope of the present invention.

Claims (10)

1. a control system for contactless touch-screen, is characterized in that: described control system comprises thermoinduction module, for responding to the relevant information of user's gesture, obtaining the relevant information of gesture, waking screen up; Image Dynamic Recognition module, user's face and gesture information is caught by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then system can not be entered, if the face information of user, by checking, enters system, then Dynamic Recognition images of gestures and action, the images of gestures of identification and action are converted to corresponding image and action; The dynamic locking module of image, for locking the images of gestures and action that sense, judgement is which kind of gesture and action; Image display, for showing the images of gestures of locking and action on screen; Order conversion and control module, for converting the images of gestures of locking and action to corresponding control command, controls touch-screen action.
2. the control system of contactless touch-screen according to claim 1, is characterized in that: described control system also comprises initialization module, for control system being initialised to the state started most.
3. the control system of contactless touch-screen according to claim 1, is characterized in that: described control system also comprises interface display module, for the relevant information of display screen.
4. the control system of contactless touch-screen according to claim 1, is characterized in that: thermoinduction module for responding to the action of user's gesture, Distance geometry positional information.
5. the control system of contactless touch-screen according to claim 1, is characterized in that carrying out following associative operation in the gesture information identified: palm from left to right slides, and screen wakes up; Palm slides from right to left, and screen is closed; Palm vertical or along within the scope of 30 °-150 °, plane by left-to-right action, to the right page turning; Palm vertical or along within the scope of 30 °-150 °, plane by the right side to left action, left page turning.
6. the control system of contactless touch-screen according to claim 1, is characterized in that following several situation is considered as effectively sliding gesture operation:
Thumb and pinkie stretch, and the back of the hand, in the face of camera, recognizes gesture, and move past in journey dynamic, and during user operation gesture, left-leaning 60 degree, Right deviation 30, is considered as effective gesture;
Ok gesture, palmar aspect, to camera, recognizes gesture, and in moving process, left-leaning 60 degree, Right deviation 30, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, and forefinger refers to that abdomen is towards camera, recognize gesture, and in moving process, during user operation gesture, the angle of gesture and vertical direction, left avertence 60 degree, in right avertence 30 degree, is considered as once effective gesture operation;
Erect forefinger, forefinger and horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognize gesture, and in 1 second, have the displacement of continuous print to the left or to the right on a direction, the angle of gesture and vertical direction is in left avertence 45 degree of right avertence 30 degree, the track slided and the angle of horizontal direction, within the scope of 45 degree, are considered as once effective gesture operation;
Erect forefinger, forefinger is parallel with horizontal line, other four fingers are fit, forefinger refers to that abdomen is towards camera, recognizes gesture, and in 1 second, have the displacement of continuous print up or down on a direction, during user operation gesture, the angle of gesture and horizontal direction is under upper inclined 45 degree in inclined 30 degree, and the track of slip and the angle of vertical direction, within the scope of 45 degree, are considered as once effectively sliding gesture operation.
7. the control system of contactless touch-screen according to claim 1, is characterized in that: when identifying gesture, hand range image acquisition module 20cm to 80cm.
8. the control system of contactless touch-screen according to claim 1, is characterized in that: the response time of static gesture: user completes the mutual time and is no more than 500ms from operating gesture to application program.
9. the control system of contactless touch-screen according to claim 1, is characterized in that: the response time of slide: the slip of gesture and the list rolling real-time synchronization of application program, if any time delay, be no more than 500ms; And speed and the amplitude of design lists rolling is come according to the speed that gesture is slided.
10. a control method for contactless touch-screen, is characterized in that described method comprises the steps: the relevant information of thermoinduction module induction user gesture, obtains the relevant information of gesture, wake screen up; Image Dynamic Recognition module catches user's face and gesture information by image capture module, and identify user's face and gesture information, if the face information of user is not by checking, then system can not be entered, if the face information of user, by checking, enters system, then Dynamic Recognition images of gestures and action, converts corresponding image and action to by the images of gestures of identification and action; The dynamic locking module of image locks the images of gestures and action that sense, and judgement is which kind of gesture and action; The images of gestures of locking and action show by image display on screen; Order conversion and control module converts the images of gestures of locking and action to corresponding control command, controls touch-screen action.
CN201510400378.5A 2015-07-09 2015-07-09 System and method for controlling non-contact touch screen Pending CN105045503A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510400378.5A CN105045503A (en) 2015-07-09 2015-07-09 System and method for controlling non-contact touch screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510400378.5A CN105045503A (en) 2015-07-09 2015-07-09 System and method for controlling non-contact touch screen

Publications (1)

Publication Number Publication Date
CN105045503A true CN105045503A (en) 2015-11-11

Family

ID=54452077

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510400378.5A Pending CN105045503A (en) 2015-07-09 2015-07-09 System and method for controlling non-contact touch screen

Country Status (1)

Country Link
CN (1) CN105045503A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106598240A (en) * 2016-12-06 2017-04-26 北京邮电大学 Menu item selection method and device
CN106777020A (en) * 2016-12-08 2017-05-31 深圳市小满科技有限公司 Display device and display methods
CN108268181A (en) * 2017-01-04 2018-07-10 奥克斯空调股份有限公司 A kind of control method and device of non-contact gesture identification
CN108519819A (en) * 2018-03-30 2018-09-11 北京金山安全软件有限公司 Intelligent device processing method and device, intelligent device and medium
CN110058777A (en) * 2019-03-13 2019-07-26 华为技术有限公司 The method and electronic equipment of shortcut function starting
CN111258430A (en) * 2020-01-21 2020-06-09 哈尔滨拓博科技有限公司 Desktop interaction system based on monocular gesture control
CN111679761A (en) * 2020-06-19 2020-09-18 深圳市宝佳终端科技有限公司 Control method and control device of touch display screen
CN115100779A (en) * 2022-06-06 2022-09-23 北京沃东天骏信息技术有限公司 Retail device
CN117373135A (en) * 2023-12-07 2024-01-09 湖北星纪魅族集团有限公司 Sliding gesture recognition method and system based on vision and related equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594469A (en) * 1995-02-21 1997-01-14 Mitsubishi Electric Information Technology Center America Inc. Hand gesture machine control system
CN103970260A (en) * 2013-01-31 2014-08-06 华为技术有限公司 Non-contact gesture control method and electronic terminal equipment
CN104301545A (en) * 2014-11-10 2015-01-21 上海斐讯数据通信技术有限公司 Circuit for realizing sleeping and awakening of mobile phone and sleeping and awakening method thereof
CN104573452A (en) * 2013-10-29 2015-04-29 大连生容享科技有限公司 Cell phone management system based on face recognition

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594469A (en) * 1995-02-21 1997-01-14 Mitsubishi Electric Information Technology Center America Inc. Hand gesture machine control system
CN103970260A (en) * 2013-01-31 2014-08-06 华为技术有限公司 Non-contact gesture control method and electronic terminal equipment
CN104573452A (en) * 2013-10-29 2015-04-29 大连生容享科技有限公司 Cell phone management system based on face recognition
CN104301545A (en) * 2014-11-10 2015-01-21 上海斐讯数据通信技术有限公司 Circuit for realizing sleeping and awakening of mobile phone and sleeping and awakening method thereof

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
(英)D.A.柯尔: "《汽车工程手册 美国版》", 31 January 2012, 北京:机械工业出版社 *
丰士昌等: "《苹果达人教你玩转全新iPad》", 31 August 2012, 北京:机械工业出版社 *
宋娴: "《新媒体与博物馆发展》", 30 June 2014, 上海:上海科技教育出版社 *
李书田: "《现代建筑新材料与施工》", 31 January 2006, 北京:中国水利水电出版社 *
王西颖等: "《基于HMM-FNN模型的复杂动态手势识别》《", 《JOURNAL OF SOFTWARE》 *
陈忠文等: "《Linux操作系统实训教程 第2版》", 31 August 2009, 北京:中国电力出版社 *
陶晓云: "《轻松玩转智能手机 iPhone+Android》", 30 April 2014, 南京:东南大学出版社 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106598240B (en) * 2016-12-06 2020-02-18 北京邮电大学 Menu item selection method and device
CN106598240A (en) * 2016-12-06 2017-04-26 北京邮电大学 Menu item selection method and device
CN106777020A (en) * 2016-12-08 2017-05-31 深圳市小满科技有限公司 Display device and display methods
CN108268181A (en) * 2017-01-04 2018-07-10 奥克斯空调股份有限公司 A kind of control method and device of non-contact gesture identification
CN108519819A (en) * 2018-03-30 2018-09-11 北京金山安全软件有限公司 Intelligent device processing method and device, intelligent device and medium
EP3916534A4 (en) * 2019-03-13 2022-04-13 Huawei Technologies Co., Ltd. Shortcut function activation method and electronic device
WO2020182065A1 (en) * 2019-03-13 2020-09-17 华为技术有限公司 Shortcut function activation method and electronic device
CN110058777A (en) * 2019-03-13 2019-07-26 华为技术有限公司 The method and electronic equipment of shortcut function starting
CN111258430A (en) * 2020-01-21 2020-06-09 哈尔滨拓博科技有限公司 Desktop interaction system based on monocular gesture control
CN111679761A (en) * 2020-06-19 2020-09-18 深圳市宝佳终端科技有限公司 Control method and control device of touch display screen
CN115100779A (en) * 2022-06-06 2022-09-23 北京沃东天骏信息技术有限公司 Retail device
CN117373135A (en) * 2023-12-07 2024-01-09 湖北星纪魅族集团有限公司 Sliding gesture recognition method and system based on vision and related equipment
CN117373135B (en) * 2023-12-07 2024-03-15 湖北星纪魅族集团有限公司 Sliding gesture recognition method and system based on vision and related equipment

Similar Documents

Publication Publication Date Title
CN105045503A (en) System and method for controlling non-contact touch screen
Sharma et al. Human computer interaction using hand gesture
US20140111416A1 (en) Electronic apparatus and handwritten document processing method
CN103294996B (en) A kind of 3D gesture identification method
US10366281B2 (en) Gesture identification with natural images
CN104809387A (en) Video image gesture recognition based non-contact unlocking method and device
CN102768595B (en) A kind of method and device identifying touch control operation instruction on touch-screen
CN103927119A (en) Method and system for switching to account interface
US20140104201A1 (en) Electronic apparatus and handwritten document processing method
US20140204015A1 (en) Gesture recognition module and gesture recognition method
CN102566744A (en) Mouse control method, mouse control device and terminal
Vivek Veeriah et al. Robust hand gesture recognition algorithm for simple mouse control
CN109189219A (en) The implementation method of contactless virtual mouse based on gesture identification
US9940536B2 (en) Electronic apparatus and method
CN104077513A (en) Information processing method and electronic equipment
Yamato et al. Hand gesture interaction with a low-resolution infrared image sensor on an inner wrist
CN103809912A (en) Tablet personal computer based on multi-touch screen
CN102749994B (en) The reminding method of the direction of motion of gesture and speed intensity in interactive system
CN103186264A (en) Touch control electronic device and touch control method thereof
CN104361273A (en) Intelligent page turning method and terminal
Barhate et al. A Survey of fingertip character identification in open-air using Image Processing and HCI
Ayachi et al. Analysis of the hand motion trajectories for recognition of air-drawn symbols
EP2843516A2 (en) Improved touch detection for a touch input device
Meshram et al. Gesture recognition technology
CN205942611U (en) Controlling means of no touch screen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20151111