US20070273642A1 - Method and apparatus for selecting information in multi-dimensional space - Google Patents
Method and apparatus for selecting information in multi-dimensional space Download PDFInfo
- Publication number
- US20070273642A1 US20070273642A1 US11/697,670 US69767007A US2007273642A1 US 20070273642 A1 US20070273642 A1 US 20070273642A1 US 69767007 A US69767007 A US 69767007A US 2007273642 A1 US2007273642 A1 US 2007273642A1
- Authority
- US
- United States
- Prior art keywords
- motion
- effective
- information
- unit
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0331—Finger worn pointing device
Definitions
- the present invention relates to an apparatus for sensing a motion for selecting information in a two- or three-dimensional space, and more particularly, to an information selection method and apparatus for determining whether a sensed motion is effective in a multi-dimensional space.
- Representative apparatuses for sensing a user's motion for pointing at or inputting information in a two- or three-dimensional space are handheld space-type input apparatuses, such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones; wireless portable pointing apparatuses, wireless portable keyboards; hand motion and gesture recognizing apparatuses; virtual musical playing apparatuses; computer game machines; virtual environment exercise and training apparatuses; virtual reality data gloves; mechanical impact and shake tracking and monitoring apparatuses; and robot motion information acquiring apparatuses.
- handheld space-type input apparatuses such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones
- wireless portable pointing apparatuses wireless portable keyboards
- hand motion and gesture recognizing apparatuses virtual musical playing apparatuses
- computer game machines virtual environment exercise and training apparatuses
- virtual reality data gloves virtual reality data gloves
- mechanical impact and shake tracking and monitoring apparatuses and robot motion information acquiring apparatuses.
- a mechanical switch or a pressure sensor is used in order to determine whether information generated by a user's motion using the above apparatuses is effective.
- a mechanical switch or a pressure sensor is used in order to determine whether information generated by a user's motion using the above apparatuses is effective.
- a switch or sensor is pushed or touched on a plane, an on/off signal is generated, and effective information is identified according to the on/off signal.
- whether a user's motion for selecting information is an effective one can be determined by contact on a plane, but whether a user's motion for selecting information in a three-dimensional space is an effective one cannot be determined via the same method.
- the present invention provides an information selection method through which information selected by a user can be exactly recognized from the user's motion for selecting information in a multi-dimensional space.
- the present invention also provides an information selection apparatus for performing the above information selection method in a multi-dimensional space.
- a method of selecting information in a multi-dimensional space includes the steps of (a) sensing the motion of a user for information selection; and (b) determining whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion.
- an apparatus for selecting information in a multi-dimensional space includes at least one motion unit moved by a user intending to select information; at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing; and at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal.
- FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention
- FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention
- FIG. 3 is a flowchart of a preferred embodiment of step 16 of FIG. 1 according to the present invention.
- FIG. 4 is a block diagram of a preferred embodiment of an effective signal detection unit of FIG. 2 according to the present invention.
- FIG. 5 is a block diagram of a first embodiment of a feature amount detector of FIG. 4 according to the present invention.
- FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector of FIG. 5 ;
- FIG. 7 is a block diagram of a second embodiment of a feature amount detector of FIG. 4 according to the present invention.
- FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7 ;
- FIG. 9 is a block diagram of a first embodiment of a signal extractor of FIG. 5 or 7 according to the present invention.
- FIG. 10 is a block diagram of a second embodiment of a signal extractor of FIG. 5 or 7 according to the present invention.
- FIG. 11 is a waveform diagram showing the first and second predetermined periods for explaining steps 74 and 76 shown in FIG. 3 ;
- FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated;
- FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention.
- FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated;
- FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention.
- FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated;
- FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention.
- FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated.
- FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention.
- FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention. The method includes identifying effective information depending on whether a user's motion is effective, in steps 10 through 18 .
- FIG. 2 is a block diagram of an information selection apparatus for performing the method of FIG. 1 according to the present invention.
- the information selection apparatus includes a motion unit 40 , a sensing unit 42 , a regularizing unit 44 , an analog-to-digital converter (ADC) 46 , an effective signal detection unit 48 , a motion amount detection unit 50 , a first comparator 52 , and an effective information determination unit 54 .
- ADC analog-to-digital converter
- At least one motion unit 40 shown in FIG. 2 is moved by a user.
- the user desires to select information, that is, when the user points at information or determines input of information, he/she moves the motion unit 40 in a two- or three-dimensional space.
- the user performs a clicking motion when determining the input of pointed information.
- the motion unit 40 may be attached to each finger performing the clicking motion.
- the motion unit 40 can be attached to a predetermined body part, for example, a hand, finger, foot, head, arm, or leg, of a user.
- the motion unit 40 may be a member (not shown) of a glove type which is directly installed on the hand or may be a manipulation member (not shown) which can be manipulated by the user without being directly attached to the user's predetermined body part.
- the manipulation member as the motion unit 40 can be realized in the form of a glove-puppet.
- At least one sensing unit 42 senses the motion of the motion unit 40 moved by a user desiring to select information and outputs the result of sensing the motion in step 10 .
- the sensing unit 42 can visually sense the motion of the motion unit 40 .
- the sensing unit 42 visually observes the motion of the motion unit 40 through a monitor (not shown) and outputs the result of observation as the motion of the motion unit 40 .
- the sensing unit 42 can sense the amount of motion of the motion unit 40 through the variation of acceleration, the variation of angular velocity, the variation of resistance, the variation of capacitance, the variation of a magnetic field, the direction of a magnetic field, or the variation of the number of pulses.
- the sensing unit 42 can be realized as a Micro ElectroMechanic System (MEMS) inertial sensor for sensing the variation of acceleration and angular velocity, a variable resistance sensor for sensing the variation of resistance, a variable capacity sensor for sensing the variation of capacitance, a magnetic sensor for sensing the variation of a magnetic field or the direction of a magnetic field, or a rotary encoder type sensor for sensing the variation of the number of pulses.
- MEMS Micro ElectroMechanic System
- the magnetic sensor can be realized as a giant magneto resistive (GMR) sensor.
- GMR giant magneto resistive
- the information selection apparatus of FIG. 2 can be provided with the regularizing unit 44 for the case where a plurality of motions are sensed by at least one sensing unit 42 .
- the information selection apparatus may not be provided with the regularizing unit 44 when only one motion is sensed by the sensing unit 42 .
- the regularizing unit 44 regularizes the result of sensing of the sensing unit 42 and outputs the result of regularization to the ADC 46 and the motion amount detection unit 50 .
- step 10 it is determined whether the amount of the sensed motion exceeds a predetermined amount in step 12 . If it is determined that the sensed motion amount exceeds the predetermined amount, an information selection method according to the present invention ends. However, if it is determined that the sensed motion amount does not exceed the predetermined amount, the procedure goes to step 14 .
- the information selection apparatus of FIG. 2 can be provided with the motion amount detection unit 50 and the first comparator 52 .
- the motion amount detection unit 50 detects a motion amount from the result of sensing of the sensing unit 42 and outputs the detected motion amount to the first comparator 52 .
- the motion amount detection unit 50 detects a motion amount from the result of regularization received from the regularizing unit 44 .
- the first comparator 52 compares the motion amount received from the motion amount detection unit 50 with a predetermined amount externally received and outputs the result of comparison to the effective signal detection unit 48 .
- the motion unit 40 is attached to each finger, and that a user selects information by moving a finger, that is, by bending or clicking the finger, the motion of a finger accompanied with a large motion of a user's hand to the front, to the back, to the left, to the right, up, or down is supposed not to be the user's intentional motion for selecting information.
- step 12 is performed. Accordingly, if it is determined that the motion amount exceeds the predetermined amount based on the result of comparison received from the first comparator 52 , the effective signal detection unit 48 does not generate an effective signal. According to the present invention, step 12 can be selectively provided. Consequently, the motion amount detection unit 50 and the first comparator 52 can also be selectively provided.
- the ADC 46 converts the result of sensing received from the sensing unit 42 from an analog form into a digital form in response to the result of comparison received from the first comparator 52 and outputs the result of conversion to the effective signal detection unit 48 in step 14 .
- the ADC 46 converts the result of regularization received from the regularizing unit 44 from an analog form into a digital form and outputs the result of conversion to the effective signal detection unit 48 .
- the ADC 46 converts the result of sensing from an analog form into a digital form only when it is recognized that the sensed motion amount does not exceed the predetermined amount based on the result of comparison received from the first comparator 52 .
- the ADC 46 can convert the result of sensing in an analog form into a digital form regardless of the result of comparison performed by the first comparator 52 .
- the effective signal detection unit 48 receiving the result of comparison performed by the first comparator 52 determines whether the result of conversion output from the ADC 46 is used for generating an effective signal.
- step 14 and the ADC 46 can be selectively provided.
- the ADC 46 when the result of sensing performed by the sensing unit 42 has an analog form and the effective signal detection unit 48 detects an effective signal in a digital form, the ADC 46 is provided. However, when the result of sensing performed by the sensing unit 42 has a digital form, the ADC 46 is not provided.
- step 14 can be provided between step 10 and step 12 .
- the result of sensing is converted from an analog form into a digital form, and the procedure goes to step 12 .
- the ADC 46 is provided between the sensing unit 42 and the regularizing unit 44 , so the result of sensing is converted from an analog form into a digital form either in response to the result of comparison performed by the first comparator 52 or regardless of the result of comparison performed by the first comparator 52 .
- the regularizing unit 44 regularizes a signal in a digital form resulting from the conversion performed by the ADC 46 and outputs the result of regularizing to the effective signal detection unit 48 and the motion amount detection unit 50 .
- step 14 it is determined whether the motion sensed by the sensing unit 42 is an effective one, i.e., the intended one for information selection when the user moves the motion unit, in step 16 .
- the effective signal detection unit 48 determines whether the motion of the motion unit 40 moved by the user is an effective one based on the result of sensing performed by the sensing unit 42 when the ADC 46 and the regularizing unit 44 are not provided, based on the result of conversion performed by the ADC 46 when the ADC 46 is provided as shown in FIG.
- the effective signal detection unit 48 controls the sensing unit 42 to sense a new motion. In contrast, if it is determined that the motion of the motion unit 40 is an effective one intended for information selection, the effective signal detection unit 48 generates an effective signal indicating that the motion of the motion unit 40 is an effective one and outputs the effective signal to the effective information determination unit 54 .
- step 16 shown in FIG. 1 a preferred embodiment of step 16 shown in FIG. 1 and the structure and operations of a preferred embodiment of the effective signal detection unit 48 shown in FIG. 2 will be described with reference to the attached drawings. Even if the regularizing unit 44 and/or the ADC 46 are provided, descriptions of the embodiments will be the same as in the case where the regularizing unit 44 and the ADC 46 are not provided, with the exception that not the result of sensing but the result of regularization or a signal in a digital form is input to the effective signal detection unit 48 .
- FIG. 3 is a flowchart of a preferred embodiment 16 A of step 16 of FIG. 1 according to the present invention.
- the embodiment 16 A of step 16 includes determining the sensed motion as an effective motion according to a feature amount detected from the result of sensing and a period for which the detected feature amount is maintained in steps 70 through 76 .
- FIG. 4 is a block diagram of a preferred embodiment 48 A of the effective signal detection unit 48 of FIG. 2 according to the present invention.
- the preferred embodiment 48 A of the effective signal detection unit 48 includes a feature amount detector 90 , a regularizing unit 92 , a second comparator 94 , a first counter 96 , a third comparator 98 , an effective signal generator 100 , and a fourth comparator 102 .
- the feature amount detector 90 of FIG. 4 extracts a portion having a change in size from the result of sensing received through an input terminal IN 2 as a feature amount and outputs the extracted feature amount in step 70 . If there is no motion of the motion unit 40 , the result of sensing has only a direct current component, so there is no portion having a change in the size of the result of sensing.
- the regularizing unit 92 may not be provided. However, if a plurality of motions are sensed by the sensing unit 42 , the regularizing unit 92 is provided as a substitute for the regularizing unit 44 of FIG. 2 . In other words, only one of the regularizing units 44 and 92 can be selectively provided.
- the regularizing unit 92 regularizes the portion having a change in size, which has been extracted by the feature amount detector 90 in step 70 , and outputs the result of regularization to the second comparator 94 .
- the functions and operations of the regularizing units 44 and 92 shown in FIGS. 2 and 4 , respectively, will be described in detail.
- the regularizing unit 44 or 92 regularizes input data and can be realized as a multiplier (not shown) for multiplying the received sensing result by a weight and outputting the multiplication result as the result of regularization.
- a multiplier for multiplying the received sensing result by a weight and outputting the multiplication result as the result of regularization.
- the motion unit 40 is provided at each of a thumb, index finger, middle finger, ring finger, and little finger, a different amount of a motion is generated when clicking each finger, so the result of sensing is regularized to detect only the component having a change in size from the result of sensing as a feature amount.
- a weight multiplied by the result of sensing the motion of the thumb is set to be larger than a weight multiplied by the result of sensing the motion of a finger other than the thumb, for example, the little finger.
- weights can be empirically determined in advance as having different values according to the motion degree of the motion unit 40 .
- the results of sensing the motions generated when clicking the thumb, index finger, middle finger, ring finger, and little finger, respectively are examined in advance, and the results of examinations are analyzed to set different weights for different fingers.
- different weights can be set depending on an angle at which each finger is bent regardless of the kind of finger. For example, all angles at which the thumb, index finger, middle finger, ring finger, and little finger can be bent are examined, and the results of examinations are analyzed to set different weights for different angles.
- FIG. 5 is a block diagram of a first embodiment 90 A of the feature amount detector 90 of FIG. 4 according to the present invention.
- the first embodiment 90 A of the feature amount detector 90 includes a low-pass filter 120 , a high-pass filter 122 , and a signal extractor 124 .
- FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector 90 A of FIG. 5 .
- FIG. 6A is a waveform diagram of a signal input to the low-pass filter 120 .
- FIG. 6B is a waveform diagram of a signal output from the low-pass filter 120 .
- FIG. 6C is a waveform diagram of a signal output from the high-pass filter 122 .
- a band pass filter 126 of the feature amount detector 90 A band-pass filters the result of sensing received through an input terminal IN 3 , as shown in FIG. 6A , and outputs the result of band-pass filtering as a feature amount to the signal extractor 124 .
- the band pass filter 126 can include the low-pass filter 120 and the high-pass filter 122 .
- the low-pass filter 120 low-pass filters the result of sensing, which is shown in FIG. 6A and input through the input terminal IN 3 , and outputs the result of low-pass filtering shown in FIG. 6B to the high-pass filter 122 .
- the high-pass filter 122 high-pass filters the result of low-pass filtering shown in FIG. 6B and outputs the result of high-pass filtering shown in FIG. 6C as a portion having a change in size of the result of sensing to the signal extractor 124 .
- the signal extractor 124 extracts only the positive or negative component from the portion having a change in size shown in FIG. 6C , which is output from the high-pass filter 122 , as a feature amount and outputs the extracted feature amount through an output terminal OUT 6 .
- FIG. 7 is a block diagram of a second embodiment 90 B of the feature amount detector 90 of FIG. 4 according to the present invention.
- the second embodiment 90 B of the feature amount detector 90 includes first and second filters 140 and 142 , a differential calculator 144 , and a signal extractor 146 .
- the first filter 140 of the feature amount detector 90 B filters a first frequency component of the result of sensing input through an input terminal IN 4 and outputs the result of filtering to the differential calculator 144 .
- the second filter 142 filters a second frequency component of the result of sensing input through the input terminal IN 4 and outputs the result of filtering to the differential calculator 144 .
- the differential calculator 144 calculates the difference between the result of filtering of the first filter 140 and the result of filtering of the second filter 142 and outputs the calculated difference to the signal extractor 146 .
- each of the first and second frequency components filtered by the first and second filters 140 and 142 may be a low-band component, a high-band component, or just a band component.
- the first and second frequency components may be a low-band component and a high-band component, respectively, a low-band component and a band component, respectively, or a high-band component and a band component, respectively.
- the feature amount detector 90 B of FIG. 7 generates a portion having a change in the size of the result of sensing as follows.
- FIGS. 8A through 8D are waveform diagrams of the respective parts of FIG. 7 .
- FIG. 8A is a waveform diagram of the result of sensing input to the first and second filters 140 and 142 .
- FIG. 8B is a waveform diagram of the result of low-pass filtering of the first filter 140 .
- FIG. 8C is a waveform diagram of the result of low-pass filtering of the second filter 142 .
- FIG. 8D is a waveform diagram of a difference component output from the differential calculator 144 .
- the first filter 140 having the cut-off frequency f c1 of 10 Hz low-pass filters the first frequency component of the result of sensing, which is input through the input terminal IN 4 and shown in FIG. 8A , and outputs the result of filtering shown in FIG. 8B to the differential calculator 144 .
- the second filter 142 having the cut-off frequency f c2 of 4 Hz low-pass filters the second frequency component of the result of sensing, which is input through the input terminal IN 4 and shown in FIG. 8A , and outputs the result of filtering shown in FIG. 8C to the differential calculator 144 .
- the differential calculator 144 calculates the difference between the result of filtering of the first filter 140 shown in FIG. 8B and the result of filtering of the second filter 142 shown in FIG.
- the signal extractor 146 extracts only the positive or negative component from the difference received from the differential calculator 144 as a feature amount and outputs the extracted feature amount through an output terminal OUT 7 .
- the motion unit 40 is attached to the thumb of a glove-shaped member (not shown) and a user wearing the glove-shaped member on his/her hand clicks information by moving his/her thumb to the left or right.
- the thumb since the thumb usually moves to the left and right when the user clicks the thumb, it is necessary to set only one direction effective in clicking. Otherwise, when the thumb is moved for one click, two clicks may be recognized.
- the signal extractor 124 or 146 shown in FIG. 5 or 7 extracts a negative or positive component as a feature amount from the portion having a change in size.
- FIG. 9 is a block diagram of a first embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention.
- the signal extractor 124 or 146 is realized as a first rectifier 160 .
- the first rectifier 160 shown in FIG. 9 rectifies the portion, which has a change in size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN 5 , or the difference received from the differential calculator 144 through the input terminal IN 5 and outputs the result of rectification as the feature amount through an output terminal OUT 8 . Accordingly, only the portion having a change in size of the result of sensing output from the high-pass filter 122 or only the positive component of the difference output from the differential calculator 144 can be extracted as the feature amount.
- FIG. 10 is a block diagram of a second embodiment of the signal extractor 124 or 146 of FIG. 5 or 7 according to the present invention.
- the signal extractor 124 or 146 includes a first inverter 180 , a second rectifier 182 , and a second inverter 184 .
- the first inverter 180 shown in FIG. 10 inverts the portion, which has a change in the size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN 6 , or the difference received from the differential calculator 144 through the input terminal IN 6 and outputs the result of inversion to the second rectifier 182 .
- the second rectifier 182 rectifies the result of inversion received from the first inverter 180 and outputs the result of rectification to the second inverter 184 .
- the second inverter 184 inverts the result of rectification received from the second rectifier 182 and outputs the result of inversion as the feature amount through an output terminal OUT 9 . Accordingly, only the size-changed portion of the result of sensing output from the high-pass filter 122 or only the negative component of the difference output from the differential calculator 144 can be extracted as the feature amount.
- a predetermined threshold is previously set according to the motion range of the motion unit 40 can be moved. For example, when the motion unit 40 is attached to a user's each finger, the amplitudes of feature amounts detected when each finger is clicked are acquired in advance, and the predetermined threshold can be set based on the result of analyzing the acquired amplitudes of the feature amounts, that is, the motion degrees of the fingers.
- the second comparator 94 compares the feature amount received from the feature amount detector 90 with the externally received predetermined threshold and outputs the result of comparison to the first counter 96 and to the sensing unit 42 through an output terminal OUT 2 . If it is determined that the feature amount is less than the predetermined threshold, the procedure goes to step 10 . For this, the sensing unit 42 senses a new motion of the motion unit 40 when the feature amount is recognized as being less than the predetermined threshold based on the result of comparison performed by the second comparator 94 .
- FIG. 11 is a waveform diagram showing first and second predetermined periods T 1 and T 2 for explaining steps 74 and 76 shown in FIG. 3 .
- the vertical axis refers to time, and the horizontal axis refers to amplitude values.
- the effective signal detection unit 48 A can be further provided with the first counter 96 and the third comparator 98 .
- the first counter 96 performs a counting operation in response to the result of comparison received from the second comparator 94 and outputs the result of counting to the third comparator 98 .
- the first counter 96 performs a counting operation when recognizing that the feature amount is at least of the same value as the predetermined threshold based on the result of comparison performed by the second comparator 94 and does not perform the counting operation when it is recognized that the feature amount 200 is less than the predetermined threshold.
- the third comparator 98 compares the result of counting received from the first counter 96 with the first predetermined period T 1 externally received and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT 3 .
- the procedure goes to step 10 .
- the sensing unit 42 senses a new motion of the motion unit 40 if it is determined that the feature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T 1 based on the resuit of comparison performed by the third comparator 98 . This is because a feature amount should be maintained to be at least a predetermined threshold for at least the first predetermined period T 1 in order to determine a user's motion as an intentional motion to select information. Otherwise, the user's motion is not determined as an intentional effective motion.
- the sensed motion of the motion unit 40 is determined as an effective motion in step 76 , and the procedure goes to step 18 .
- the first predetermined period T 1 is set to the minimum time taken for the user to move the motion unit 40 to intentionally select information.
- the effective signal generator 100 generates an effective signal indicating that the motion of the motion unit 40 is an effective motion in response to the result of comparison received from the third comparator 98 and outputs the effective signal to the effective information determination unit 54 through an output terminal OUT 4 .
- the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing.
- Step 74 may be selectively provided. Accordingly, the first counter 96 and the third comparator 98 of FIG. 4 may also be selectively provided.
- the effective signal generator 100 generates an effective signal in response to the result of comparison received from the second comparator 94 . For example, the effective signal generator 100 generates an effective signal if it is determined that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison received from the second comparator 94 and does not generate an effective signal if it is determined that the feature amount 200 is less than the predetermined threshold.
- the result of sensing obtained for a period other than the first predetermined period T 1 in the second predetermined period T 2 of FIG. 11 is not used because undesirable cross-talk or noise may occur when the user selects information.
- the ring finger may be moved together, which causes cross-talk occurrence.
- the effective signal detection unit 48 A can be provided with the fourth comparator 102 .
- the fourth comparator 102 compares the result of counting received from the first counter 96 with the second predetermined period T 2 received externally and outputs the result of comparison to the effective signal generator 100 and to the sensing unit 42 through an output terminal OUT 5 . Then, the effective signal generator 100 generates an effective signal in response to the result of comparison received from the fourth comparator 102 .
- the effective signal generator 100 does not generate a new effective signal even if it is recognized that the feature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison of the second comparator 94 .
- the sensing unit 42 may not sense a new motion of the motion unit 40 or may not output the result of sensing.
- the second predetermined period T 2 is set according to a time period for which the motion unit 40 may be unnecessarily moved when the user selects information.
- the second predetermined period T 2 may be set to be different depending on the type of motion unit 40 .
- the second predetermined period T 2 is set to be longer than it is set on the assumption that the clicking operation is performed by moving a finger other than the thumb, in order to prevent two feature amounts from being detected.
- the fourth comparator 102 shown in FIG. 4 can be selectively provided.
- the effective signal generator 100 generates an effective signal in response to only the result of comparison received from the third comparator 98 regardless of whether the second predetermined period T 2 has elapsed.
- the effective information determination unit 54 of FIG. 2 determines the information received through an input terminal IN 1 as effective information in response to the effective signal received from the effective signal detection unit 48 and outputs the effective information through an output terminal OUT 1 in step 18 . For example, if it is recognized that the motion of the motion unit 40 is an effective motion based on the effective signal, the effective information determination unit 54 determines the information, which is selected by the effective motion and received through the input terminal IN 1 , as effective information and outputs the determined information through the output terminal OUT 1 .
- the effective information determination unit 54 determines the information, which is selected by the motion of the motion unit 40 and received through the input terminal IN 1 , as ineffective information.
- the effective information determination unit 54 shown in FIG. 2 may be applied as an information selection unit which is disclosed in the Korean Patent Application No. 2001-41560 mentioned above.
- the effective information determination unit 54 establishes a one-dimensional position of an information screen from a first and/or second displacement and an angle, determines the information, which is located at the established one-dimensional position and received through the input terminal IN 1 , as effective information selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the established effective information through the output terminal OUT 1 .
- the effective information determination unit 54 acts as an information recognizer disclosed in the Korean Patent Application No. 2001-41560.
- the effective information determination unit 54 searches for the information which is mapped to a one-dimensional position designated by a user on the information screen, recognizes the searched information which is received through the input terminal IN 1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the recognized effective information through the output terminal OUT 1 .
- the effective information determination unit 54 searches for the information, which is mapped to the horizontal and vertical coordinate values corresponding to a two-dimensional position determined from the horizontal and vertical positions of information designated by the user on the information screen, recognizes the searched information which is received through the input terminal IN 1 as effective information which is selected by the user in response to the effective signal received from the effective signal detection unit 48 , and outputs the recognized effective information through the output terminal OUT 1 .
- At least two effective motions may be detected.
- the clicking motion of a middle finger can be accompanied with the motion of a ring finger and the motion of a little finger.
- the unintentional motions of the ring and little fingers must be considered as ineffective motions.
- the motions of the ring and little fingers may act as cross-talk when it is determined whether the motion of the middle finger is an effective motion.
- FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated.
- the information selection method includes determining effective information using one motion among a plurality of effective motions in steps 220 through 226 .
- FIG. 13 is a block diagram of an information selection apparatus for performing the method of FIG. 12 according to the present invention.
- the information selection apparatus includes a first storage unit 240 , a second counter 242 , a first feature amount selector 244 , and an effective information determination unit 246 .
- the second counter 242 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 8 and outputs the result of counting to the first feature amount selector 244 and to the effective information determination unit 246 .
- the first storage unit 240 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN 7 and stores the one or more feature amounts.
- the first feature amount selector 244 selects the biggest feature amount from the feature amounts stored in the first storage unit 240 in response to the result of counting received from the second counter 242 and outputs the selected feature amount to the effective information determination unit 246 . For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the second counter 242 , the first feature amount selector 244 performs step 224 .
- the steps 220 and 224 may be performed between steps 16 and 18 shown in FIG. 1 .
- the first storage unit 240 , the second counter 242 , and the first feature amount selector 244 shown in FIG. 13 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 .
- the effective information determination unit 246 acts as the effective information determination unit 54 .
- the effective information determination unit 246 determines the information, which is selected by a single effective motion and received through an input terminal IN 9 , as effective information and outputs the determined effective information through an output terminal OUT 10 in step 222 .
- the effective information determination unit 246 determines information, which is selected by an effective motion corresponding to the feature amount selected by the first feature amount selector 244 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 9 , as the effective information and outputs the determined effective information through the output terminal OUT 10 in step 226 .
- FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated.
- the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 260 through 266 .
- FIG. 15 is a block diagram of an information selection apparatus for performing the method of FIG. 14 according to the present invention.
- the information selection apparatus includes a second storage unit 280 , a third counter 282 , a first time selector 284 , and an effective information determination unit 286 .
- step 260 it is determined whether there are at least two effective motions in step 260 .
- the third counter 282 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 11 and outputs the result of counting to the first time selector 284 and to the effective information determination unit 286 .
- a first determined effective motion is selected from the effective motions in step 264 , and the procedure goes to step 266 .
- step 264 it is assumed that the motion unit 40 is attached to each finger of a user's hands intending to select information, and information is selected by moving one of the user's fingers.
- at least one finger near to a finger which is intentionally moved may be moved together or following with the intentionally moved finger regardless of the user's intention.
- the second storage unit 280 stores points (that is, instants of time) when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN 10 .
- the first time selector 284 selects an earliest time from the instants of time stored in the second storage unit 280 in response to the result of counting received from the third counter 282 and outputs the selected time to the effective information determination unit 286 . For example, only if it is recognized that there are at least two effective motions based on the result of counting received from the third counter 282 , the first time selector 284 performs step 264 . Steps 260 and 264 may be performed between steps 16 and 18 shown in FIG. 1 .
- the second storage unit 280 , the third counter 282 , and the first time selector 284 shown in FIG. 15 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 . In this case, the effective information determination unit 286 acts as the effective information determination unit 54 .
- the effective information determination unit 286 determines the information, which is selected by a single effective motion and received through an input terminal IN 12 , as effective information and outputs the determined effective information through an output terminal OUT 11 in step 262 .
- the effective information determination unit 286 determines the information, which is selected by the first determined effective motion corresponding to a feature amount generated at the time selected by the first time selector 284 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 12 , as the effective information and outputs the determined effective information through the output terminal OUT 11 in step 266 .
- FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated.
- the information selection method includes determining the effective information using one motion among a plurality of effective motions, in steps 300 through 310 .
- FIG. 17 is a block diagram of an information selection apparatus for performing the method of FIG. 16 according to the present invention.
- the information selection apparatus includes a third storage unit 330 , a fourth storage unit 332 , a fourth counter 334 , a fifth comparator 336 , a second feature amount selector 338 , a second time selector 340 , and an effective information determination unit 342 .
- the fourth counter 334 counts the number of effective signals received from the effective signal detection unit 48 through an input terminal IN 15 and outputs the result of counting to the fifth comparator 336 and to the effective information determination unit 342 .
- the fourth storage unit 332 stores instants of time when one or more feature amounts corresponding to one or more effective motions are received from the feature amount detector 90 through an input terminal IN 12 .
- the fifth comparator 336 compares the instants of time stored in the fourth storage unit 332 and outputs the result of comparison to the second feature amount selector 338 , the second time selector 340 , and the effective information determination unit 342 .
- the fifth comparator 336 may perform a comparison operation in response to the result of counting received from the fourth counter 334 . For example, if it is recognized that there are not at least two effective motions based on the result of counting performed by the fourth counter 334 , the fifth comparator 336 does not perform the comparison operation.
- step 306 is performed based on the fact that a feature amount corresponding to the first determined effective motion is first detected by the feature amount detector 90 .
- the second time selector 340 selects the earliest instant of time from the instants of time stored in the fourth storage unit 332 in response to the result of comparison received from the fifth comparator 336 and outputs the selected instant of time to the effective information determination unit 342 . For example, only if it is recognized that the effective motions are not determined simultaneously based on the result of comparison received from the fifth comparator 336 , the second time selector 340 performs step 306 .
- the third storage unit 330 receives one or more feature amounts corresponding to one or more effective motions from the feature amount detector 90 through an input terminal IN 13 and stores the one or more feature amounts.
- the second feature amount selector 338 selects a biggest feature amount from among the feature amounts stored in the third storage unit 330 in response to the result of comparison received from the fifth comparator 336 and outputs the selected feature amount to the effective information determination unit 342 . For example, only if it is recognized that the effective motions are determined simultaneously based on the result of comparison received from the fifth comparator 336 , the second feature amount selector 338 performs step 308 .
- the steps 300 through 308 may be performed between steps 16 and 18 shown in FIG. 1 .
- the third and fourth storage units 330 and 332 , the fourth counter 334 , the fifth comparator 336 , the second feature amount selector 338 , and the second time selector 340 shown in FIG. 17 may be provided between the effective signal detection unit 48 and the effective information determination unit 54 shown in FIG. 2 .
- the effective information determination unit 342 acts as the effective information determination unit 54 .
- the effective information determination unit 342 determines the information, which is selected by a single effective motion and received through an input terminal IN 16 , as effective information and outputs the determined effective information through an output terminal OUT 12 in step 302 .
- the effective information determination unit 342 determines the information, which is selected by the effective motion corresponding to the feature amount selected by the second feature amount selector 338 or the feature amount generated at the instant of time selected by the second time selector 340 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN 16 , as the effective information in response to the result of comparison received from the fifth comparator 336 and outputs the determined effective information through the output terminal OUT 12 in step 310 .
- FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated.
- the information selection method includes determining the effective information using one motion, among a plurality of effective motions, in steps 300 , 306 through 310 , and 370 .
- FIG. 19 is a block diagram of an information selection apparatus for performing the method of FIG. 18 according to the present invention.
- the information selection apparatus includes a third storage unit 330 , a fourth storage unit 332 , a fourth counter 334 , a sixth comparator 360 , a second feature amount selector 338 , a second time selector 340 , and an effective information determination unit 342 .
- the information selection method of FIG. 18 is the same as that of FIG. 16 with the exception that, step 370 in FIG. 18 is performed instead of step 304 .
- the structure and operations of the information selection apparatus shown in FIG. 19 are the same as those of the information selection apparatus shown in FIG. 17 with the exception that the sixth comparator 360 in FIG. 19 is used instead of the fifth comparator 336 . Accordingly, in describing FIGS. 18 and 19 , repeated portions will be omitted.
- step 370 if it is determined that there are at least two effective motions, it is determined in step 370 whether the amounts of the effective motions, that is, the degrees of the effective motions, are the same. If it is determined that the amounts of the effective motions are the same, the procedure goes to step 306 . If it is determined that the amounts of the effective motions are not the same, the procedure goes to step 308 .
- the sixth comparator 360 of FIG. 19 compares the feature amounts received from the third storage unit 330 and outputs the result of comparison to the second feature amount selector 338 , the second time selector 340 , and the effective information determination unit 342 .
- the second time selector 340 performs step 306 .
- the second feature amount selector 338 performs step 308 .
- the effective information determination unit 246 , 286 , or 342 shown in FIG. 13, 15 , 17 , or 19 may recognize which motion unit 40 among one or more motion units 40 generates the effective motion selected in step 224 , 264 , 306 , or 308 .
- the first or second feature amount selector 244 or 338 instead of outputting the selected feature amount, the first or second feature amount selector 244 or 338 outputs a unique identification number for identifying the motion unit 40 , which generates a motion corresponding to the selected feature amount, to the effective information determination unit 246 or 342 .
- the first or second time selector 284 or 340 outputs the unique identification number of the motion unit 40 , which generates a motion corresponding to the feature amount generated at the selected time, to the effective information determination unit 286 or 342 .
- the effective information determination unit 246 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first feature amount selector 244 .
- the effective information determination unit 286 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the first time selector 284 .
- the effective information determination unit 342 can recognize which motion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the second feature amount selector 338 or the second time selector 340 .
- the information selection apparatus shown in FIG. 2 may be provided with a separate communication unit (not shown) for converting the format of an effective signal received from the effective signal detection unit 48 , converting the signal having the converted format into a wireless signal, and wirelessly transmitting the wireless signal to the effective information determination unit 54 .
- the motion unit 40 can be attached to a user's predetermined body part.
- the sensing unit 42 senses the motion of a finger joint.
- the sensing unit 42 senses the motion of the wrist.
- the sensing unit 42 senses the motion of the neck joint.
- an information selection method and apparatus can be used for recognizing whether the clicking motion of a finger such as an index finger, middle finger, ring finger, or little finger is effective, because the third joint of a finger is usually moved when a user clicks a key on a widely known QWERY keyboard.
- an information selection method can be used for recognizing whether the information pointed at by the motion angle of a finger at its joint is effective or for recognizing whether a finger's clicking motion for determining the input of information pointed at by the finger is effective.
- an information selection method and apparatus can recognize whether the motion of the motion unit 40 is effective in apparatuses for sensing the motion of the motion unit 40 .
- a method and apparatus for selecting information in a multi-dimensional space detect, as a portion having a change in size, the difference between the results of filtering performed using the first and second filters 140 and 142 having different cut-off frequencies, thereby overcoming difficulty in setting a predetermined threshold to a single value.
- even the very slight motion of the motion unit 40 can be accurately detected without being influenced by gravity and offsets which can be provoked by using an inertial sensor as the sensing unit 42 .
- the present invention can accurately determine whether a user's two- or three-dimensional motion is an effective motion for selecting information and which motion unit 40 , among at least two motion units 40 , has generated the effective motion, thereby achieving a high correct recognition rate and high reliability and allowing a user to easily select the desired information.
Abstract
Method and apparatus for selecting information in a multi-dimensional space are provided. The method includes the steps of sensing the motion of a user intending to select information, and determining whether the sensed motion is an effective motion intended for information selection and returning to the sensing step if it is determined that the motion is not the effective one. Accordingly, difficulty in setting a predetermined threshold to a single value can be overcome. In addition, even a very slight motion can be accurately detected without being influenced by gravity and offsets. Moreover, it can be accurately determined whether a user's two- or three-dimensional motion is an effective motion for selecting information and which motion unit among at least two motion units has generated the effective motion, so that a high correct recognition rate for information and high reliability can be achieved, and a user is allowed to easily select information.
Description
- This application is a continuation of pending prior application Ser. No. 10/484,505 filed Jan. 22, 2005, which is a National Stage Application of PCT Application No. PCT/KR02/01369 filed Jul. 22, 2002, and claims benefit of priority based on Korean Patent Application No. 2001-44588, filed Jul. 24, 2001, the disclosures of which is incorporated herein in their entirety by reference.
- 1. Field of the Invention
- The present invention relates to an apparatus for sensing a motion for selecting information in a two- or three-dimensional space, and more particularly, to an information selection method and apparatus for determining whether a sensed motion is effective in a multi-dimensional space.
- 2. Description of the Related Art
- Representative apparatuses for sensing a user's motion for pointing at or inputting information in a two- or three-dimensional space are handheld space-type input apparatuses, such as personal computers (PCs), personal digital assistances (PDAs), and cellular phones; wireless portable pointing apparatuses, wireless portable keyboards; hand motion and gesture recognizing apparatuses; virtual musical playing apparatuses; computer game machines; virtual environment exercise and training apparatuses; virtual reality data gloves; mechanical impact and shake tracking and monitoring apparatuses; and robot motion information acquiring apparatuses.
- Usually, in order to determine whether information generated by a user's motion using the above apparatuses is effective, conventionally, a mechanical switch or a pressure sensor is used. In other words, according to a conventional method, when a switch or sensor is pushed or touched on a plane, an on/off signal is generated, and effective information is identified according to the on/off signal. Conventionally, whether a user's motion for selecting information is an effective one can be determined by contact on a plane, but whether a user's motion for selecting information in a three-dimensional space is an effective one cannot be determined via the same method.
- The present invention provides an information selection method through which information selected by a user can be exactly recognized from the user's motion for selecting information in a multi-dimensional space.
- The present invention also provides an information selection apparatus for performing the above information selection method in a multi-dimensional space.
- According to an aspect of the invention, there is provided a method of selecting information in a multi-dimensional space. The method includes the steps of (a) sensing the motion of a user for information selection; and (b) determining whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion.
- According to an aspect of the invention, there is provided an apparatus for selecting information in a multi-dimensional space. The apparatus includes at least one motion unit moved by a user intending to select information; at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing; and at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal.
- The above and other features and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which:
-
FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention; -
FIG. 2 is a block diagram of an information selection apparatus for performing the method ofFIG. 1 according to the present invention; -
FIG. 3 is a flowchart of a preferred embodiment ofstep 16 ofFIG. 1 according to the present invention; -
FIG. 4 is a block diagram of a preferred embodiment of an effective signal detection unit ofFIG. 2 according to the present invention; -
FIG. 5 is a block diagram of a first embodiment of a feature amount detector ofFIG. 4 according to the present invention; -
FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of the feature amount detector ofFIG. 5 ; -
FIG. 7 is a block diagram of a second embodiment of a feature amount detector ofFIG. 4 according to the present invention; -
FIGS. 8A through 8D are waveform diagrams of the respective parts ofFIG. 7 ; -
FIG. 9 is a block diagram of a first embodiment of a signal extractor ofFIG. 5 or 7 according to the present invention; -
FIG. 10 is a block diagram of a second embodiment of a signal extractor ofFIG. 5 or 7 according to the present invention; -
FIG. 11 is a waveform diagram showing the first and second predetermined periods for explainingsteps FIG. 3 ; -
FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated; -
FIG. 13 is a block diagram of an information selection apparatus for performing the method ofFIG. 12 according to the present invention; -
FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated; -
FIG. 15 is a block diagram of an information selection apparatus for performing the method ofFIG. 14 according to the present invention; -
FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated; -
FIG. 17 is a block diagram of an information selection apparatus for performing the method ofFIG. 16 according to the present invention; -
FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated; and -
FIG. 19 is a block diagram of an information selection apparatus for performing the method ofFIG. 18 according to the present invention. - Hereinafter, a method of selecting information in a multi-dimensional space according to the present invention and the structure and operations of an information selection apparatus for performing the above method according to the present invention will be described with reference to the attached drawings.
-
FIG. 1 is a flowchart of a method of selecting information in a multi-dimensional space according to the present invention. The method includes identifying effective information depending on whether a user's motion is effective, insteps 10 through 18. -
FIG. 2 is a block diagram of an information selection apparatus for performing the method ofFIG. 1 according to the present invention. The information selection apparatus includes amotion unit 40, asensing unit 42, a regularizingunit 44, an analog-to-digital converter (ADC) 46, an effectivesignal detection unit 48, a motionamount detection unit 50, afirst comparator 52, and an effectiveinformation determination unit 54. - At least one
motion unit 40 shown inFIG. 2 is moved by a user. When the user desires to select information, that is, when the user points at information or determines input of information, he/she moves themotion unit 40 in a two- or three-dimensional space. Generally, the user performs a clicking motion when determining the input of pointed information. To sense such a clicking motion, for example, themotion unit 40 may be attached to each finger performing the clicking motion. - In one embodiment of the present invention, the
motion unit 40 can be attached to a predetermined body part, for example, a hand, finger, foot, head, arm, or leg, of a user. Themotion unit 40 may be a member (not shown) of a glove type which is directly installed on the hand or may be a manipulation member (not shown) which can be manipulated by the user without being directly attached to the user's predetermined body part. For example, the manipulation member as themotion unit 40 can be realized in the form of a glove-puppet. - To perform a method of selecting information according to the present invention, at least one
sensing unit 42 senses the motion of themotion unit 40 moved by a user desiring to select information and outputs the result of sensing the motion instep 10. Thesensing unit 42 can visually sense the motion of themotion unit 40. For this, thesensing unit 42 visually observes the motion of themotion unit 40 through a monitor (not shown) and outputs the result of observation as the motion of themotion unit 40. In addition, thesensing unit 42 can sense the amount of motion of themotion unit 40 through the variation of acceleration, the variation of angular velocity, the variation of resistance, the variation of capacitance, the variation of a magnetic field, the direction of a magnetic field, or the variation of the number of pulses. For this, thesensing unit 42 can be realized as a Micro ElectroMechanic System (MEMS) inertial sensor for sensing the variation of acceleration and angular velocity, a variable resistance sensor for sensing the variation of resistance, a variable capacity sensor for sensing the variation of capacitance, a magnetic sensor for sensing the variation of a magnetic field or the direction of a magnetic field, or a rotary encoder type sensor for sensing the variation of the number of pulses. Here, the magnetic sensor can be realized as a giant magneto resistive (GMR) sensor. The examples of the structures and operations of these sensors are disclosed in Korean Patent Application No. 2001-41560, entitled “Information Input Apparatus and Method Using Body Angle at Joint”. - The information selection apparatus of
FIG. 2 can be provided with the regularizingunit 44 for the case where a plurality of motions are sensed by at least onesensing unit 42. The information selection apparatus may not be provided with the regularizingunit 44 when only one motion is sensed by thesensing unit 42. The regularizingunit 44 regularizes the result of sensing of thesensing unit 42 and outputs the result of regularization to theADC 46 and the motionamount detection unit 50. - If the regularizing
unit 44 is not provided, afterstep 10, it is determined whether the amount of the sensed motion exceeds a predetermined amount instep 12. If it is determined that the sensed motion amount exceeds the predetermined amount, an information selection method according to the present invention ends. However, if it is determined that the sensed motion amount does not exceed the predetermined amount, the procedure goes to step 14. To performstep 12, the information selection apparatus ofFIG. 2 can be provided with the motionamount detection unit 50 and thefirst comparator 52. Here, if the regularizingunit 44 is not provided, the motionamount detection unit 50 detects a motion amount from the result of sensing of thesensing unit 42 and outputs the detected motion amount to thefirst comparator 52. In contrast, if the regularizingunit 44 is provided, the motionamount detection unit 50 detects a motion amount from the result of regularization received from the regularizingunit 44. Thefirst comparator 52 compares the motion amount received from the motionamount detection unit 50 with a predetermined amount externally received and outputs the result of comparison to the effectivesignal detection unit 48. For example, when it is assumed that themotion unit 40 is attached to each finger, and that a user selects information by moving a finger, that is, by bending or clicking the finger, the motion of a finger accompanied with a large motion of a user's hand to the front, to the back, to the left, to the right, up, or down is supposed not to be the user's intentional motion for selecting information. Therefore, the result of sensing such an unintentional motion must not be used in an information selection method according to the present invention. For this, step 12 is performed. Accordingly, if it is determined that the motion amount exceeds the predetermined amount based on the result of comparison received from thefirst comparator 52, the effectivesignal detection unit 48 does not generate an effective signal. According to the present invention, step 12 can be selectively provided. Consequently, the motionamount detection unit 50 and thefirst comparator 52 can also be selectively provided. - If it is determined that the motion amount does not exceed the predetermined amount, when the regularizing
unit 44 is not provided, theADC 46 converts the result of sensing received from thesensing unit 42 from an analog form into a digital form in response to the result of comparison received from thefirst comparator 52 and outputs the result of conversion to the effectivesignal detection unit 48 instep 14. However, when the regularizingunit 44 is provided, theADC 46 converts the result of regularization received from the regularizingunit 44 from an analog form into a digital form and outputs the result of conversion to the effectivesignal detection unit 48. According to an embodiment of the present invention, theADC 46 converts the result of sensing from an analog form into a digital form only when it is recognized that the sensed motion amount does not exceed the predetermined amount based on the result of comparison received from thefirst comparator 52. However, according to another embodiment of the present invention, unlikeFIG. 2 , theADC 46 can convert the result of sensing in an analog form into a digital form regardless of the result of comparison performed by thefirst comparator 52. In this case, the effectivesignal detection unit 48 receiving the result of comparison performed by thefirst comparator 52 determines whether the result of conversion output from theADC 46 is used for generating an effective signal. - In addition, according to the present invention,
step 14 and theADC 46 can be selectively provided. In other words, when the result of sensing performed by thesensing unit 42 has an analog form and the effectivesignal detection unit 48 detects an effective signal in a digital form, theADC 46 is provided. However, when the result of sensing performed by thesensing unit 42 has a digital form, theADC 46 is not provided. - According to the present invention, unlike
FIG. 1 , step 14 can be provided betweenstep 10 andstep 12. For example, afterstep 10, the result of sensing is converted from an analog form into a digital form, and the procedure goes to step 12. For this, unlikeFIG. 2 , theADC 46 is provided between the sensingunit 42 and the regularizingunit 44, so the result of sensing is converted from an analog form into a digital form either in response to the result of comparison performed by thefirst comparator 52 or regardless of the result of comparison performed by thefirst comparator 52. Here, the regularizingunit 44 regularizes a signal in a digital form resulting from the conversion performed by theADC 46 and outputs the result of regularizing to the effectivesignal detection unit 48 and the motionamount detection unit 50. - After
step 14, it is determined whether the motion sensed by thesensing unit 42 is an effective one, i.e., the intended one for information selection when the user moves the motion unit, instep 16. For this, if it is recognized that the amount of the sensed motion does not exceed the predetermined amount based on the result of comparison received from thefirst comparator 52, the effectivesignal detection unit 48 determines whether the motion of themotion unit 40 moved by the user is an effective one based on the result of sensing performed by thesensing unit 42 when theADC 46 and the regularizingunit 44 are not provided, based on the result of conversion performed by theADC 46 when theADC 46 is provided as shown inFIG. 2 , based on the result of regularization performed by the regularizingunit 44 when theADC 46 is provided between the sensingunit 42 and the regularizingunit 44 inFIG. 2 , or based on the result of conversion performed by theADC 46 when the regularizingunit 44 is not provided inFIG. 2 . - If it is determined that the motion of the
motion unit 40 is not an effective one intended for information selection, the effectivesignal detection unit 48 controls thesensing unit 42 to sense a new motion. In contrast, if it is determined that the motion of themotion unit 40 is an effective one intended for information selection, the effectivesignal detection unit 48 generates an effective signal indicating that the motion of themotion unit 40 is an effective one and outputs the effective signal to the effectiveinformation determination unit 54. - For clarity of the present invention, on the assumption that the regularizing
unit 44 and theADC 46 are not provided, a preferred embodiment ofstep 16 shown inFIG. 1 and the structure and operations of a preferred embodiment of the effectivesignal detection unit 48 shown inFIG. 2 will be described with reference to the attached drawings. Even if the regularizingunit 44 and/or theADC 46 are provided, descriptions of the embodiments will be the same as in the case where the regularizingunit 44 and theADC 46 are not provided, with the exception that not the result of sensing but the result of regularization or a signal in a digital form is input to the effectivesignal detection unit 48. -
FIG. 3 is a flowchart of apreferred embodiment 16A ofstep 16 ofFIG. 1 according to the present invention. Theembodiment 16A ofstep 16 includes determining the sensed motion as an effective motion according to a feature amount detected from the result of sensing and a period for which the detected feature amount is maintained insteps 70 through 76. -
FIG. 4 is a block diagram of apreferred embodiment 48A of the effectivesignal detection unit 48 ofFIG. 2 according to the present invention. Thepreferred embodiment 48A of the effectivesignal detection unit 48 includes afeature amount detector 90, a regularizingunit 92, asecond comparator 94, afirst counter 96, athird comparator 98, aneffective signal generator 100, and afourth comparator 102. - The
feature amount detector 90 ofFIG. 4 extracts a portion having a change in size from the result of sensing received through an input terminal IN2 as a feature amount and outputs the extracted feature amount instep 70. If there is no motion of themotion unit 40, the result of sensing has only a direct current component, so there is no portion having a change in the size of the result of sensing. - If only one motion is always sensed by the
sensing unit 42 ofFIG. 2 , the regularizingunit 92 may not be provided. However, if a plurality of motions are sensed by thesensing unit 42, the regularizingunit 92 is provided as a substitute for the regularizingunit 44 ofFIG. 2 . In other words, only one of the regularizingunits unit 92 regularizes the portion having a change in size, which has been extracted by thefeature amount detector 90 instep 70, and outputs the result of regularization to thesecond comparator 94. The functions and operations of the regularizingunits FIGS. 2 and 4 , respectively, will be described in detail. - The regularizing
unit motion unit 40 is provided at each of a thumb, index finger, middle finger, ring finger, and little finger, a different amount of a motion is generated when clicking each finger, so the result of sensing is regularized to detect only the component having a change in size from the result of sensing as a feature amount. For this, a weight multiplied by the result of sensing the motion of the thumb is set to be larger than a weight multiplied by the result of sensing the motion of a finger other than the thumb, for example, the little finger. As described above, weights can be empirically determined in advance as having different values according to the motion degree of themotion unit 40. For example, the results of sensing the motions generated when clicking the thumb, index finger, middle finger, ring finger, and little finger, respectively, are examined in advance, and the results of examinations are analyzed to set different weights for different fingers. - Alternatively, according to the present invention, different weights can be set depending on an angle at which each finger is bent regardless of the kind of finger. For example, all angles at which the thumb, index finger, middle finger, ring finger, and little finger can be bent are examined, and the results of examinations are analyzed to set different weights for different angles.
- Meanwhile, the structures and operations of embodiments of the
feature amount detector 90 shown inFIG. 4 will be described with reference to the attached drawings. -
FIG. 5 is a block diagram of afirst embodiment 90A of thefeature amount detector 90 ofFIG. 4 according to the present invention. Thefirst embodiment 90A of thefeature amount detector 90 includes a low-pass filter 120, a high-pass filter 122, and asignal extractor 124. -
FIGS. 6A through 6C are waveform diagrams of signals input to or output from the respective parts of thefeature amount detector 90A ofFIG. 5 .FIG. 6A is a waveform diagram of a signal input to the low-pass filter 120.FIG. 6B is a waveform diagram of a signal output from the low-pass filter 120.FIG. 6C is a waveform diagram of a signal output from the high-pass filter 122. - According to this embodiment of the present invention, a
band pass filter 126 of thefeature amount detector 90A band-pass filters the result of sensing received through an input terminal IN3, as shown inFIG. 6A , and outputs the result of band-pass filtering as a feature amount to thesignal extractor 124. For this, as shown inFIG. 5 , theband pass filter 126 can include the low-pass filter 120 and the high-pass filter 122. The low-pass filter 120 low-pass filters the result of sensing, which is shown inFIG. 6A and input through the input terminal IN3, and outputs the result of low-pass filtering shown inFIG. 6B to the high-pass filter 122. The high-pass filter 122 high-pass filters the result of low-pass filtering shown inFIG. 6B and outputs the result of high-pass filtering shown inFIG. 6C as a portion having a change in size of the result of sensing to thesignal extractor 124. Thesignal extractor 124 extracts only the positive or negative component from the portion having a change in size shown inFIG. 6C , which is output from the high-pass filter 122, as a feature amount and outputs the extracted feature amount through an output terminal OUT6. -
FIG. 7 is a block diagram of asecond embodiment 90B of thefeature amount detector 90 ofFIG. 4 according to the present invention. Thesecond embodiment 90B of thefeature amount detector 90 includes first andsecond filters differential calculator 144, and asignal extractor 146. - According to this embodiment, the
first filter 140 of thefeature amount detector 90B filters a first frequency component of the result of sensing input through an input terminal IN4 and outputs the result of filtering to thedifferential calculator 144. Thesecond filter 142 filters a second frequency component of the result of sensing input through the input terminal IN4 and outputs the result of filtering to thedifferential calculator 144. Thedifferential calculator 144 calculates the difference between the result of filtering of thefirst filter 140 and the result of filtering of thesecond filter 142 and outputs the calculated difference to thesignal extractor 146. - According to the present invention, each of the first and second frequency components filtered by the first and
second filters first filter 140 is 10 Hz, and that the cut-off frequency fc2 of thesecond filter 142 is 4 Hz, thefeature amount detector 90B ofFIG. 7 generates a portion having a change in the size of the result of sensing as follows. -
FIGS. 8A through 8D are waveform diagrams of the respective parts ofFIG. 7 .FIG. 8A is a waveform diagram of the result of sensing input to the first andsecond filters FIG. 8B is a waveform diagram of the result of low-pass filtering of thefirst filter 140.FIG. 8C is a waveform diagram of the result of low-pass filtering of thesecond filter 142.FIG. 8D is a waveform diagram of a difference component output from thedifferential calculator 144. - The
first filter 140 having the cut-off frequency fc1 of 10 Hz low-pass filters the first frequency component of the result of sensing, which is input through the input terminal IN4 and shown inFIG. 8A , and outputs the result of filtering shown inFIG. 8B to thedifferential calculator 144. Thesecond filter 142 having the cut-off frequency fc2 of 4 Hz low-pass filters the second frequency component of the result of sensing, which is input through the input terminal IN4 and shown inFIG. 8A , and outputs the result of filtering shown inFIG. 8C to thedifferential calculator 144. Thedifferential calculator 144 calculates the difference between the result of filtering of thefirst filter 140 shown inFIG. 8B and the result of filtering of thesecond filter 142 shown inFIG. 8C and outputs the calculated difference shown inFIG. 8D as the portion having a change in size of the result of sensing to thesignal extractor 146. Thesignal extractor 146 extracts only the positive or negative component from the difference received from thedifferential calculator 144 as a feature amount and outputs the extracted feature amount through an output terminal OUT7. - Let us know suppose that the
motion unit 40 is attached to the thumb of a glove-shaped member (not shown) and a user wearing the glove-shaped member on his/her hand clicks information by moving his/her thumb to the left or right. Here, since the thumb usually moves to the left and right when the user clicks the thumb, it is necessary to set only one direction effective in clicking. Otherwise, when the thumb is moved for one click, two clicks may be recognized. To recognize an effective motion only, thesignal extractor FIG. 5 or 7 extracts a negative or positive component as a feature amount from the portion having a change in size. -
FIG. 9 is a block diagram of a first embodiment of thesignal extractor FIG. 5 or 7 according to the present invention. In this embodiment, thesignal extractor first rectifier 160. - The
first rectifier 160 shown inFIG. 9 rectifies the portion, which has a change in size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN5, or the difference received from thedifferential calculator 144 through the input terminal IN5 and outputs the result of rectification as the feature amount through an output terminal OUT8. Accordingly, only the portion having a change in size of the result of sensing output from the high-pass filter 122 or only the positive component of the difference output from thedifferential calculator 144 can be extracted as the feature amount. -
FIG. 10 is a block diagram of a second embodiment of thesignal extractor FIG. 5 or 7 according to the present invention. In this embodiment, thesignal extractor first inverter 180, asecond rectifier 182, and asecond inverter 184. - The
first inverter 180 shown inFIG. 10 inverts the portion, which has a change in the size of the result of sensing and is received from the high-pass filter 122 through an input terminal IN6, or the difference received from thedifferential calculator 144 through the input terminal IN6 and outputs the result of inversion to thesecond rectifier 182. Thesecond rectifier 182 rectifies the result of inversion received from thefirst inverter 180 and outputs the result of rectification to thesecond inverter 184. Thesecond inverter 184 inverts the result of rectification received from thesecond rectifier 182 and outputs the result of inversion as the feature amount through an output terminal OUT9. Accordingly, only the size-changed portion of the result of sensing output from the high-pass filter 122 or only the negative component of the difference output from thedifferential calculator 144 can be extracted as the feature amount. - Meanwhile, after
step 70 shown inFIG. 3 , it is determined whether the feature amount is equal to or greater than a predetermined threshold instep 72. The predetermined threshold is previously set according to the motion range of themotion unit 40 can be moved. For example, when themotion unit 40 is attached to a user's each finger, the amplitudes of feature amounts detected when each finger is clicked are acquired in advance, and the predetermined threshold can be set based on the result of analyzing the acquired amplitudes of the feature amounts, that is, the motion degrees of the fingers. - To perform
step 72, thesecond comparator 94 compares the feature amount received from thefeature amount detector 90 with the externally received predetermined threshold and outputs the result of comparison to thefirst counter 96 and to thesensing unit 42 through an output terminal OUT2. If it is determined that the feature amount is less than the predetermined threshold, the procedure goes to step 10. For this, thesensing unit 42 senses a new motion of themotion unit 40 when the feature amount is recognized as being less than the predetermined threshold based on the result of comparison performed by thesecond comparator 94. -
FIG. 11 is a waveform diagram showing first and second predetermined periods T1 and T2 for explainingsteps FIG. 3 . The vertical axis refers to time, and the horizontal axis refers to amplitude values. - Referring to
FIG. 11 , if it is determined that afeature amount 200 is at least of the same value as the predetermined threshold, it is determined whether thefeature amount 200 is maintained to be at least the predetermined threshold during the first predetermined period T1 instep 74. To performstep 74, the effectivesignal detection unit 48A can be further provided with thefirst counter 96 and thethird comparator 98. Thefirst counter 96 performs a counting operation in response to the result of comparison received from thesecond comparator 94 and outputs the result of counting to thethird comparator 98. For example, thefirst counter 96 performs a counting operation when recognizing that the feature amount is at least of the same value as the predetermined threshold based on the result of comparison performed by thesecond comparator 94 and does not perform the counting operation when it is recognized that thefeature amount 200 is less than the predetermined threshold. Then, thethird comparator 98 compares the result of counting received from thefirst counter 96 with the first predetermined period T1 externally received and outputs the result of comparison to theeffective signal generator 100 and to thesensing unit 42 through an output terminal OUT3. - If it is determined that the
feature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T1, the procedure goes to step 10. For this, thesensing unit 42 senses a new motion of themotion unit 40 if it is determined that thefeature amount 200 is not maintained to be at least the predetermined threshold for the first predetermined period T1 based on the resuit of comparison performed by thethird comparator 98. This is because a feature amount should be maintained to be at least a predetermined threshold for at least the first predetermined period T1 in order to determine a user's motion as an intentional motion to select information. Otherwise, the user's motion is not determined as an intentional effective motion. - In contrast, if it is determined that the
feature amount 200 is maintained to be at least the predetermined threshold for the first predetermined period T1, the sensed motion of themotion unit 40 is determined as an effective motion instep 76, and the procedure goes to step 18. Here, the first predetermined period T1 is set to the minimum time taken for the user to move themotion unit 40 to intentionally select information. For performingstep 76, theeffective signal generator 100 generates an effective signal indicating that the motion of themotion unit 40 is an effective motion in response to the result of comparison received from thethird comparator 98 and outputs the effective signal to the effectiveinformation determination unit 54 through an output terminal OUT4. Here, if it is determined that thefeature amount 200 is maintained to be at least the predetermined threshold for the first predetermined period T1 based on the result of comparison of thethird comparator 98, thesensing unit 42 may not sense a new motion of themotion unit 40 or may not output the result of sensing. -
Step 74 may be selectively provided. Accordingly, thefirst counter 96 and thethird comparator 98 ofFIG. 4 may also be selectively provided. In this case, theeffective signal generator 100 generates an effective signal in response to the result of comparison received from thesecond comparator 94. For example, theeffective signal generator 100 generates an effective signal if it is determined that thefeature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison received from thesecond comparator 94 and does not generate an effective signal if it is determined that thefeature amount 200 is less than the predetermined threshold. - Meanwhile, according to the present invention, when it is determined whether the sensed motion is effective in
step 16, the result of sensing obtained for a period other than the first predetermined period T1 in the second predetermined period T2 ofFIG. 11 is not used because undesirable cross-talk or noise may occur when the user selects information. For example, when the user having themotion unit 40 attached to each finger moves the middle finger in order to input desired information, the ring finger may be moved together, which causes cross-talk occurrence. To prevent such cross-talk from occurring, the effectivesignal detection unit 48A can be provided with thefourth comparator 102. Thefourth comparator 102 compares the result of counting received from thefirst counter 96 with the second predetermined period T2 received externally and outputs the result of comparison to theeffective signal generator 100 and to thesensing unit 42 through an output terminal OUT5. Then, theeffective signal generator 100 generates an effective signal in response to the result of comparison received from thefourth comparator 102. For example, if it is recognized that the second predetermined period T2 has not elapsed since the first predetermined period T1 elapsed, based on the result of comparison performed by thefourth comparator 102, theeffective signal generator 100 does not generate a new effective signal even if it is recognized that thefeature amount 200 is at least of the same value as the predetermined threshold based on the result of comparison of thesecond comparator 94. According to the present invention, if it is recognized that a current time is in the period other than the first predetermined period T1 in the second predetermined period T2 based on the result of comparison performed by thefourth comparator 102, thesensing unit 42 may not sense a new motion of themotion unit 40 or may not output the result of sensing. This is for preventing thesensing unit 42 from unnecessarily performing a sensing operation during the period other than the first predetermined period T1 in the second predetermined period T2. According to the present invention, the second predetermined period T2 is set according to a time period for which themotion unit 40 may be unnecessarily moved when the user selects information. Alternatively, the second predetermined period T2 may be set to be different depending on the type ofmotion unit 40. For example, when it is assumed that themotion unit 40 is attached to each finger of the user's hands and a clicking motion is performed by moving the thumb, the second predetermined period T2 is set to be longer than it is set on the assumption that the clicking operation is performed by moving a finger other than the thumb, in order to prevent two feature amounts from being detected. Here, since the thumb is moved two times to the left and right for the clicking motion unlike the other fingers, two feature amounts may be detected. According to the present invention, thefourth comparator 102 shown inFIG. 4 can be selectively provided. In this case, theeffective signal generator 100 generates an effective signal in response to only the result of comparison received from thethird comparator 98 regardless of whether the second predetermined period T2 has elapsed. - The effective
information determination unit 54 ofFIG. 2 determines the information received through an input terminal IN1 as effective information in response to the effective signal received from the effectivesignal detection unit 48 and outputs the effective information through an output terminal OUT1 instep 18. For example, if it is recognized that the motion of themotion unit 40 is an effective motion based on the effective signal, the effectiveinformation determination unit 54 determines the information, which is selected by the effective motion and received through the input terminal IN1, as effective information and outputs the determined information through the output terminal OUT1. However, if it is recognized that the motion of themotion unit 40 is not an effective motion based on the effective signal, the effectiveinformation determination unit 54 determines the information, which is selected by the motion of themotion unit 40 and received through the input terminal IN1, as ineffective information. - For example, the effective
information determination unit 54 shown inFIG. 2 may be applied as an information selection unit which is disclosed in the Korean Patent Application No. 2001-41560 mentioned above. In such an application, the effectiveinformation determination unit 54 establishes a one-dimensional position of an information screen from a first and/or second displacement and an angle, determines the information, which is located at the established one-dimensional position and received through the input terminal IN1, as effective information selected by the user in response to the effective signal received from the effectivesignal detection unit 48, and outputs the established effective information through the output terminal OUT1. - More specifically, the effective
information determination unit 54 acts as an information recognizer disclosed in the Korean Patent Application No. 2001-41560. In other words, the effectiveinformation determination unit 54 searches for the information which is mapped to a one-dimensional position designated by a user on the information screen, recognizes the searched information which is received through the input terminal IN1 as effective information which is selected by the user in response to the effective signal received from the effectivesignal detection unit 48, and outputs the recognized effective information through the output terminal OUT1. Alternatively, the effectiveinformation determination unit 54 searches for the information, which is mapped to the horizontal and vertical coordinate values corresponding to a two-dimensional position determined from the horizontal and vertical positions of information designated by the user on the information screen, recognizes the searched information which is received through the input terminal IN1 as effective information which is selected by the user in response to the effective signal received from the effectivesignal detection unit 48, and outputs the recognized effective information through the output terminal OUT1. - Meanwhile, at least two effective motions may be detected. For example, when the
motion unit 40 is provided at each finger, the clicking motion of a middle finger can be accompanied with the motion of a ring finger and the motion of a little finger. In this case, the unintentional motions of the ring and little fingers must be considered as ineffective motions. Otherwise, the motions of the ring and little fingers may act as cross-talk when it is determined whether the motion of the middle finger is an effective motion. - Hereinafter, in the case where at least two effective motions are generated, an information selection method according to the present invention and the structure and operations of an information selection apparatus according to the present invention for performing the above method will be described with reference to the attached drawings.
-
FIG. 12 is a flowchart of a first embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining effective information using one motion among a plurality of effective motions insteps 220 through 226. -
FIG. 13 is a block diagram of an information selection apparatus for performing the method ofFIG. 12 according to the present invention. The information selection apparatus includes afirst storage unit 240, asecond counter 242, a firstfeature amount selector 244, and an effectiveinformation determination unit 246. - If it is determined that the motion of the
motion unit 40 is an effective motion instep 16 shown inFIG. 1 , it is determined whether there are at least two effective motions instep 220. For this, thesecond counter 242 counts the number of effective signals received from the effectivesignal detection unit 48 through an input terminal IN8 and outputs the result of counting to the firstfeature amount selector 244 and to the effectiveinformation determination unit 246. - If it is determined that there are at least two effective motions, the largest effective motion is selected from the effective motions in
step 224. For this, thefirst storage unit 240 receives one or more feature amounts corresponding to one or more effective motions from thefeature amount detector 90 through an input terminal IN7 and stores the one or more feature amounts. The firstfeature amount selector 244 selects the biggest feature amount from the feature amounts stored in thefirst storage unit 240 in response to the result of counting received from thesecond counter 242 and outputs the selected feature amount to the effectiveinformation determination unit 246. For example, only if it is recognized that there are at least two effective motions based on the result of counting received from thesecond counter 242, the firstfeature amount selector 244 performsstep 224. - The
steps steps FIG. 1 . Thefirst storage unit 240, thesecond counter 242, and the firstfeature amount selector 244 shown inFIG. 13 may be provided between the effectivesignal detection unit 48 and the effectiveinformation determination unit 54 shown inFIG. 2 . In this case, the effectiveinformation determination unit 246 acts as the effectiveinformation determination unit 54. - Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the
second counter 242, the effectiveinformation determination unit 246 determines the information, which is selected by a single effective motion and received through an input terminal IN9, as effective information and outputs the determined effective information through an output terminal OUT10 instep 222. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by thesecond counter 242, afterstep 224, the effectiveinformation determination unit 246 determines information, which is selected by an effective motion corresponding to the feature amount selected by the firstfeature amount selector 244 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN9, as the effective information and outputs the determined effective information through the output terminal OUT10 instep 226. -
FIG. 14 is a flowchart of a second embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion among a plurality of effective motions, insteps 260 through 266. -
FIG. 15 is a block diagram of an information selection apparatus for performing the method ofFIG. 14 according to the present invention. The information selection apparatus includes asecond storage unit 280, athird counter 282, afirst time selector 284, and an effectiveinformation determination unit 286. - If it is determined that the motion of the
motion unit 40 is an effective motion instep 16 shown inFIG. 1 , it is determined whether there are at least two effective motions instep 260. For this, thethird counter 282 counts the number of effective signals received from the effectivesignal detection unit 48 through an input terminal IN11 and outputs the result of counting to thefirst time selector 284 and to the effectiveinformation determination unit 286. - If it is determined that there are at least two effective motions, a first determined effective motion is selected from the effective motions in
step 264, and the procedure goes to step 266. - For clarity of
step 264, it is assumed that themotion unit 40 is attached to each finger of a user's hands intending to select information, and information is selected by moving one of the user's fingers. Here, at least one finger near to a finger which is intentionally moved may be moved together or following with the intentionally moved finger regardless of the user's intention. Accordingly, instep 264 it is determined which finger is intentionally moved based on the fact that a feature amount generated by the motion of the intentionally moved finger is detected prior to a feature amount generated by the motion of a near finger. To performstep 264, thesecond storage unit 280 stores points (that is, instants of time) when one or more feature amounts corresponding to one or more effective motions are received from thefeature amount detector 90 through an input terminal IN10. Thefirst time selector 284 selects an earliest time from the instants of time stored in thesecond storage unit 280 in response to the result of counting received from thethird counter 282 and outputs the selected time to the effectiveinformation determination unit 286. For example, only if it is recognized that there are at least two effective motions based on the result of counting received from thethird counter 282, thefirst time selector 284 performsstep 264.Steps steps FIG. 1 . Thesecond storage unit 280, thethird counter 282, and thefirst time selector 284 shown inFIG. 15 may be provided between the effectivesignal detection unit 48 and the effectiveinformation determination unit 54 shown inFIG. 2 . In this case, the effectiveinformation determination unit 286 acts as the effectiveinformation determination unit 54. - Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the
third counter 282, the effectiveinformation determination unit 286 determines the information, which is selected by a single effective motion and received through an input terminal IN12, as effective information and outputs the determined effective information through an output terminal OUT11 instep 262. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by thethird counter 282, afterstep 264, the effectiveinformation determination unit 286 determines the information, which is selected by the first determined effective motion corresponding to a feature amount generated at the time selected by thefirst time selector 284 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN12, as the effective information and outputs the determined effective information through the output terminal OUT11 instep 266. -
FIG. 16 is a flowchart of a third embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion among a plurality of effective motions, insteps 300 through 310. -
FIG. 17 is a block diagram of an information selection apparatus for performing the method ofFIG. 16 according to the present invention. The information selection apparatus includes athird storage unit 330, afourth storage unit 332, afourth counter 334, afifth comparator 336, a secondfeature amount selector 338, asecond time selector 340, and an effectiveinformation determination unit 342. - If it is determined that the motion of the
motion unit 40 is an effective motion instep 16 shown inFIG. 1 , it is determined whether there are at least two effective motions instep 300. For this, thefourth counter 334 counts the number of effective signals received from the effectivesignal detection unit 48 through an input terminal IN15 and outputs the result of counting to thefifth comparator 336 and to the effectiveinformation determination unit 342. - If it is determined that there are at least two effective motions, it is determined whether the effective motions are determined simultaneously in
step 304. For this, thefourth storage unit 332 stores instants of time when one or more feature amounts corresponding to one or more effective motions are received from thefeature amount detector 90 through an input terminal IN12. Thefifth comparator 336 compares the instants of time stored in thefourth storage unit 332 and outputs the result of comparison to the secondfeature amount selector 338, thesecond time selector 340, and the effectiveinformation determination unit 342. According to the present invention, thefifth comparator 336 may perform a comparison operation in response to the result of counting received from thefourth counter 334. For example, if it is recognized that there are not at least two effective motions based on the result of counting performed by thefourth counter 334, thefifth comparator 336 does not perform the comparison operation. - If it is determined that the effective motions are not determined simultaneously, a first determined effective motion is selected from the effective motions in
step 306, and the procedure goes to step 310. Likestep 264,step 306 is performed based on the fact that a feature amount corresponding to the first determined effective motion is first detected by thefeature amount detector 90. To performstep 306, thesecond time selector 340 selects the earliest instant of time from the instants of time stored in thefourth storage unit 332 in response to the result of comparison received from thefifth comparator 336 and outputs the selected instant of time to the effectiveinformation determination unit 342. For example, only if it is recognized that the effective motions are not determined simultaneously based on the result of comparison received from thefifth comparator 336, thesecond time selector 340 performsstep 306. - If it is determined that the effective motions are determined simultaneously, the largest effective motion is selected from the effective motions in
step 308, and the procedure goes to step 310. For this, thethird storage unit 330 receives one or more feature amounts corresponding to one or more effective motions from thefeature amount detector 90 through an input terminal IN13 and stores the one or more feature amounts. The secondfeature amount selector 338 selects a biggest feature amount from among the feature amounts stored in thethird storage unit 330 in response to the result of comparison received from thefifth comparator 336 and outputs the selected feature amount to the effectiveinformation determination unit 342. For example, only if it is recognized that the effective motions are determined simultaneously based on the result of comparison received from thefifth comparator 336, the secondfeature amount selector 338 performsstep 308. - The
steps 300 through 308 may be performed betweensteps FIG. 1 . The third andfourth storage units fourth counter 334, thefifth comparator 336, the secondfeature amount selector 338, and thesecond time selector 340 shown inFIG. 17 may be provided between the effectivesignal detection unit 48 and the effectiveinformation determination unit 54 shown inFIG. 2 . In this case, the effectiveinformation determination unit 342 acts as the effectiveinformation determination unit 54. - Here, if it is determined that there are not at least two effective motions based on the result of counting performed by the
fourth counter 334, the effectiveinformation determination unit 342 determines the information, which is selected by a single effective motion and received through an input terminal IN16, as effective information and outputs the determined effective information through an output terminal OUT12 instep 302. Alternatively, if it is determined that there are at least two effective motions based on the result of counting performed by thefourth counter 334, afterstep information determination unit 342 determines the information, which is selected by the effective motion corresponding to the feature amount selected by the secondfeature amount selector 338 or the feature amount generated at the instant of time selected by thesecond time selector 340 from a plurality of pieces of information which are selected by the effective motions and received through the input terminal IN16, as the effective information in response to the result of comparison received from thefifth comparator 336 and outputs the determined effective information through the output terminal OUT12 instep 310. -
FIG. 18 is a flowchart of a fourth embodiment of an information selection method according to the present invention when at least two effective motions are generated. In this embodiment, the information selection method includes determining the effective information using one motion, among a plurality of effective motions, insteps -
FIG. 19 is a block diagram of an information selection apparatus for performing the method ofFIG. 18 according to the present invention. The information selection apparatus includes athird storage unit 330, afourth storage unit 332, afourth counter 334, a sixth comparator 360, a secondfeature amount selector 338, asecond time selector 340, and an effectiveinformation determination unit 342. - The information selection method of
FIG. 18 is the same as that ofFIG. 16 with the exception that,step 370 inFIG. 18 is performed instead ofstep 304. In addition, the structure and operations of the information selection apparatus shown inFIG. 19 are the same as those of the information selection apparatus shown inFIG. 17 with the exception that the sixth comparator 360 inFIG. 19 is used instead of thefifth comparator 336. Accordingly, in describingFIGS. 18 and 19 , repeated portions will be omitted. - Unlike the method shown in
FIG. 16 , in the information selection method shown inFIG. 18 , if it is determined that there are at least two effective motions, it is determined instep 370 whether the amounts of the effective motions, that is, the degrees of the effective motions, are the same. If it is determined that the amounts of the effective motions are the same, the procedure goes to step 306. If it is determined that the amounts of the effective motions are not the same, the procedure goes to step 308. For this, the sixth comparator 360 ofFIG. 19 compares the feature amounts received from thethird storage unit 330 and outputs the result of comparison to the secondfeature amount selector 338, thesecond time selector 340, and the effectiveinformation determination unit 342. Accordingly, if it is determined that the feature amounts corresponding to the effective motions are the same based on the result of comparison performed by the sixth comparator 360, that is, if it is determined that the degrees of the effective motions are the same, thesecond time selector 340 performsstep 306. In contrast, if it is determined that the feature amounts corresponding to the effective motions are not the same based on the result of comparison performed by the sixth comparator 360, the secondfeature amount selector 338 performsstep 308. - According to the present invention, the effective
information determination unit FIG. 13, 15 , 17, or 19 may recognize whichmotion unit 40 among one ormore motion units 40 generates the effective motion selected instep feature amount selector motion unit 40, which generates a motion corresponding to the selected feature amount, to the effectiveinformation determination unit second time selector motion unit 40, which generates a motion corresponding to the feature amount generated at the selected time, to the effectiveinformation determination unit information determination unit 246 can recognize whichmotion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the firstfeature amount selector 244. Similarly, the effectiveinformation determination unit 286 can recognize whichmotion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from thefirst time selector 284. The effectiveinformation determination unit 342 can recognize whichmotion unit 40 has generated a motion selected as an effective motion based on the unique identification number received from the secondfeature amount selector 338 or thesecond time selector 340. - The information selection apparatus shown in
FIG. 2 may be provided with a separate communication unit (not shown) for converting the format of an effective signal received from the effectivesignal detection unit 48, converting the signal having the converted format into a wireless signal, and wirelessly transmitting the wireless signal to the effectiveinformation determination unit 54. - As described above, the
motion unit 40 can be attached to a user's predetermined body part. In the case where the predetermined body part is a finger, thesensing unit 42 senses the motion of a finger joint. In the case where the predetermined body part is a hand, thesensing unit 42 senses the motion of the wrist. In the case where the predetermined body part is a neck, thesensing unit 42 senses the motion of the neck joint. In addition, in the case where thesensing unit 42 senses the motion of a third joint from the end of the finger, an information selection method and apparatus according to the present invention can be used for recognizing whether the clicking motion of a finger such as an index finger, middle finger, ring finger, or little finger is effective, because the third joint of a finger is usually moved when a user clicks a key on a widely known QWERY keyboard. - For example, let us assume that a user inputs information in a three-dimensional space by moving a glove-shaped member endowed with the
sensing unit 42, and thesensing unit 42 is composed of inertial sensors attached to fingers and the back of a hand. Here, an information selection method according to the present invention can be used for recognizing whether the information pointed at by the motion angle of a finger at its joint is effective or for recognizing whether a finger's clicking motion for determining the input of information pointed at by the finger is effective. - Consequently, when a user intends to point or input information by moving the
motion unit 40 in a two- or three-dimensional space, an information selection method and apparatus according to the present invention can recognize whether the motion of themotion unit 40 is effective in apparatuses for sensing the motion of themotion unit 40. - As described above, considering that a change in the size of the motion sensing result of the
motion unit 40 can be large or small when information is selected by slowly or quickly moving themotion unit 40, a method and apparatus for selecting information in a multi-dimensional space according to the present invention detect, as a portion having a change in size, the difference between the results of filtering performed using the first andsecond filters motion unit 40 can be accurately detected without being influenced by gravity and offsets which can be provoked by using an inertial sensor as thesensing unit 42. Moreover, the present invention can accurately determine whether a user's two- or three-dimensional motion is an effective motion for selecting information and whichmotion unit 40, among at least twomotion units 40, has generated the effective motion, thereby achieving a high correct recognition rate and high reliability and allowing a user to easily select the desired information.
Claims (22)
1. A method of selecting information in a multi-dimensional space, the method comprising the steps of:
(a) sensing the motion of a user for information selection;
(b) determining, using the amount of the sensed motion, whether the sensed motion is an effective motion of the intended information selection and returning to step (a) if it is determined that the motion is not the effective motion; and
(c) determining whether the amount of the sensed motion exceeds a predetermined amount after step (a) and going to step (b) if it is determined that the amount of the motion does not exceed the predetermined amount.
2. The method of claim 1 , further comprising the step of converting the result of sensing from an analog form into a digital one after step (a) and going to step (b), wherein step (b) comprises determining whether the motion is the effective motion based on the result of conversion.
3. The method of claim 1 , further comprising the step of (d) if it is determined that the motion is the effective motion in step (b), determining the information selected by the effective motion as effective information.
4. The method of claim 1 , wherein step (a) comprises visually sensing the motion.
5. The method of claim 1 , wherein the motion is a three-dimensional motion.
6. The method of claim 1 , wherein the motion is a two-dimensional motion.
7. The method of claim 1 , wherein the information selection implies pointing the information.
8. The method of claim 1 , wherein the information selection denotes inputting the information.
9. An apparatus for selecting information in a multi-dimensional space, the apparatus comprising:
at least one motion unit moved by a user intending to select information;
at least one sensing unit for sensing the motion of the motion unit and outputting the result of sensing;
at least one effective signal detection unit for checking whether the motion of the motion unit is an effective motion intending to select the information based on the result of sensing and outputting the result of checking as an effective signal;
a motion amount detection unit for detecting the amount of the motion from the result of sensing; and
a first comparator for comparing the amount of the motion received from the motion amount detection unit with a predetermined amount and outputting the result of comparison,
wherein the effective signal detection unit checks whether the motion of the motion unit is the effective motion in response to the result of comparison performed the first comparator.
10. The apparatus of claim 9 , further comprising an analog-to-digital converter for converting the sensing result from an analog form into a digital form and outputting the result of conversion to the effective signal detection unit,
wherein the effective signal detection unit checks whether the motion of the motion unit is the effective motion based on the result of conversion.
11. The apparatus of claim 10 , wherein the analog-to-digital converter converts the result of sensing from the analog form into the digital form in response to the result of comparison performed by the first comparator.
12. The apparatus of claim 9 , further comprising an effective information determination unit for determining information selected by the motion as effective information in response to the effective signal received from the effective signal detection unit.
13. The apparatus of claim 9 , wherein the sensing unit visually senses the motion of the motion unit.
14. The apparatus of claim 9 , wherein the motion unit is moved by the user in a three-dimensional space.
15. The apparatus of claim 9 , wherein the motion unit is moved by the user in a two-dimensional space.
16. The apparatus of claim 9 , wherein the selection of the information implies pointing the information.
17. The apparatus of claim 9 , wherein the selection of the information denotes inputting the information.
18. The apparatus of claim 9 , wherein the motion unit is attached to a predetermined body part of the user and moved by the user.
19. The apparatus of claim 9 , wherein the user points the information by moving the motion unit.
20. The apparatus of claim 9 , wherein the user determines input of the information by moving the motion unit.
21. The apparatus of claim 18 , wherein the predetermined body part is at least one hand.
22. The apparatus of claim 21 , wherein the motion corresponds to a third joint of a finger.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/697,670 US20070273642A1 (en) | 2001-07-24 | 2007-04-06 | Method and apparatus for selecting information in multi-dimensional space |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR2001-44588 | 2001-07-24 | ||
KR10-2001-0044588A KR100446612B1 (en) | 2001-07-24 | 2001-07-24 | Method and apparatus for selecting information in multi-dimensional space |
US10/484,505 US7259756B2 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
PCT/KR2002/001369 WO2003010652A1 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
US11/697,670 US20070273642A1 (en) | 2001-07-24 | 2007-04-06 | Method and apparatus for selecting information in multi-dimensional space |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/484,505 Continuation US7259756B2 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
PCT/KR2002/001369 Continuation WO2003010652A1 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070273642A1 true US20070273642A1 (en) | 2007-11-29 |
Family
ID=19712483
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/484,505 Expired - Fee Related US7259756B2 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
US11/697,670 Abandoned US20070273642A1 (en) | 2001-07-24 | 2007-04-06 | Method and apparatus for selecting information in multi-dimensional space |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/484,505 Expired - Fee Related US7259756B2 (en) | 2001-07-24 | 2002-07-22 | Method and apparatus for selecting information in multi-dimensional space |
Country Status (5)
Country | Link |
---|---|
US (2) | US7259756B2 (en) |
JP (1) | JP2004537055A (en) |
KR (1) | KR100446612B1 (en) |
CN (1) | CN1554044B (en) |
WO (1) | WO2003010652A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150084849A1 (en) * | 2013-09-23 | 2015-03-26 | Hyundai Motor Company | Vehicle operation device |
US20150219474A1 (en) * | 2014-01-31 | 2015-08-06 | Microchip Technology Incorporated | Digital period divider |
US11829531B2 (en) * | 2021-09-13 | 2023-11-28 | Htc Corporation | Human-computer interaction method and system and non-transitory computer readable storage medium |
Families Citing this family (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6834249B2 (en) | 2001-03-29 | 2004-12-21 | Arraycomm, Inc. | Method and apparatus for controlling a computing system |
US7184020B2 (en) * | 2002-10-30 | 2007-02-27 | Matsushita Electric Industrial Co., Ltd. | Operation instructing device, operation instructing method, and operation instructing program |
KR100501721B1 (en) * | 2003-03-19 | 2005-07-18 | 삼성전자주식회사 | Pen-shaped input device using magnetic sensor and method thereof |
KR100543710B1 (en) * | 2004-02-25 | 2006-01-20 | 삼성전자주식회사 | Spatial information input apparatus and method for recognizing an information-completion signal from a plurality of concurrent spatial motions |
JP4410051B2 (en) * | 2004-07-22 | 2010-02-03 | 本田技研工業株式会社 | Angular velocity measuring device and legged mobile robot |
NL1026945C2 (en) * | 2004-09-01 | 2006-03-02 | Access Engineering | Method and device for controlling a pointer on a computer screen by spatial movements such as head movements. |
US7539513B2 (en) * | 2005-02-02 | 2009-05-26 | National Telephone Products, Inc. | Portable phone with ergonomic image projection system |
KR100537279B1 (en) * | 2005-05-12 | 2005-12-16 | 삼성전자주식회사 | Portable terminal with motion detecting function and method of motion detecting thereof |
KR100651368B1 (en) * | 2005-09-15 | 2006-11-29 | 삼성전자주식회사 | Method for controlling image according to movement of wireless terminal |
TWI348639B (en) * | 2005-12-16 | 2011-09-11 | Ind Tech Res Inst | Motion recognition system and method for controlling electronic device |
US7903092B2 (en) * | 2006-05-25 | 2011-03-08 | Atmel Corporation | Capacitive keyboard with position dependent reduced keying ambiguity |
US8786554B2 (en) * | 2006-07-10 | 2014-07-22 | Atmel Corporation | Priority and combination suppression techniques (PST/CST) for a capacitive keyboard |
US20090146953A1 (en) * | 2006-10-30 | 2009-06-11 | Imu Solutions, Inc. | Methods for processing data from accelerometer in anticipating real-time cursor control movements |
EP2083276B1 (en) * | 2008-01-22 | 2014-10-29 | STMicroelectronics Srl | Method and device for detecting anomalous events for an electronic apparatus, in particular a portable apparatus |
TWI396967B (en) * | 2008-05-16 | 2013-05-21 | Htc Corp | Signal filtering method and electronic device and readable recording medium using the same |
US8508498B2 (en) * | 2009-04-27 | 2013-08-13 | Empire Technology Development Llc | Direction and force sensing input device |
US20100289743A1 (en) * | 2009-05-15 | 2010-11-18 | AFA Micro Co. | Laser pointer and gesture-based input device |
US8482678B2 (en) * | 2009-09-10 | 2013-07-09 | AFA Micro Co. | Remote control and gesture-based input device |
US8717291B2 (en) * | 2009-10-07 | 2014-05-06 | AFA Micro Co. | Motion sensitive gesture device |
US8494544B2 (en) * | 2009-12-03 | 2013-07-23 | Osocad Remote Limited Liability Company | Method, apparatus and computer program to perform location specific information retrieval using a gesture-controlled handheld mobile device |
KR101858531B1 (en) | 2011-01-06 | 2018-05-17 | 삼성전자주식회사 | Display apparatus controled by a motion, and motion control method thereof |
KR101795574B1 (en) | 2011-01-06 | 2017-11-13 | 삼성전자주식회사 | Electronic device controled by a motion, and control method thereof |
EP2686254B1 (en) * | 2011-03-17 | 2018-08-15 | SSI Schäfer Automation GmbH | Controlling and monitoring a storage and order-picking system by means of movement and speech |
CN103164049A (en) * | 2011-12-09 | 2013-06-19 | 捷达世软件(深圳)有限公司 | Swing identification control system and method of handheld action electronic device |
US9891718B2 (en) * | 2015-04-22 | 2018-02-13 | Medibotics Llc | Devices for measuring finger motion and recognizing hand gestures |
US20140085177A1 (en) * | 2012-09-21 | 2014-03-27 | Nokia Corporation | Method and apparatus for responding to input based upon relative finger position |
JP2014151149A (en) * | 2013-02-14 | 2014-08-25 | Seiko Epson Corp | Motion analysis apparatus and motion analysis method |
KR101550604B1 (en) | 2013-09-25 | 2015-09-07 | 현대자동차 주식회사 | Vehicle operation device |
CN105843429A (en) * | 2015-01-14 | 2016-08-10 | 深圳市华星光电技术有限公司 | Floating touch method |
TWI621968B (en) * | 2016-02-05 | 2018-04-21 | 財團法人工業技術研究院 | Method for controlling electronic equipment and wearable device |
US20170249561A1 (en) * | 2016-02-29 | 2017-08-31 | GM Global Technology Operations LLC | Robot learning via human-demonstration of tasks with force and position objectives |
US11294463B2 (en) | 2018-12-03 | 2022-04-05 | Microsoft Technology Licensing, Llc | Augmenting the functionality of user input devices using a digital glove |
US10564719B1 (en) | 2018-12-03 | 2020-02-18 | Microsoft Technology Licensing, Llc | Augmenting the functionality of user input devices using a digital glove |
US11314409B2 (en) | 2018-12-03 | 2022-04-26 | Microsoft Technology Licensing, Llc | Modeless augmentations to a virtual trackpad on a multiple screen computing device |
US11137905B2 (en) | 2018-12-03 | 2021-10-05 | Microsoft Technology Licensing, Llc | Modeless augmentations to a virtual trackpad on a multiple screen computing device |
US11199901B2 (en) * | 2018-12-03 | 2021-12-14 | Microsoft Technology Licensing, Llc | Augmenting the functionality of non-digital objects using a digital glove |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5146566A (en) * | 1991-05-29 | 1992-09-08 | Ibm Corporation | Input/output system for computer user interface using magnetic levitation |
US5982352A (en) * | 1992-09-18 | 1999-11-09 | Pryor; Timothy R. | Method for providing human input to a computer |
US6346929B1 (en) * | 1994-04-22 | 2002-02-12 | Canon Kabushiki Kaisha | Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process |
US6529130B2 (en) * | 2001-02-16 | 2003-03-04 | General Phosphorix Llc | System for detecting intruders |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH04137027A (en) * | 1990-09-28 | 1992-05-12 | Ezel Inc | Input device for computer |
JPH08272520A (en) * | 1995-03-29 | 1996-10-18 | Asako Hanno | Glove instruction call-originating equipment |
JP3777650B2 (en) * | 1995-04-28 | 2006-05-24 | 松下電器産業株式会社 | Interface equipment |
JPH0944297A (en) * | 1995-07-25 | 1997-02-14 | Canon Inc | Data inputting method and device |
JPH0981309A (en) * | 1995-09-13 | 1997-03-28 | Toshiba Corp | Input device |
JP3272960B2 (en) * | 1996-08-19 | 2002-04-08 | 株式会社データ・テック | Driving recorder and vehicle operation analyzer |
KR100221335B1 (en) * | 1996-12-26 | 1999-09-15 | 전주범 | Transmission system of glove sensor value in a virtual reality system and method thereof |
KR19980053567A (en) * | 1996-12-27 | 1998-09-25 | 배순훈 | Digital Glove Sensor |
KR100244523B1 (en) * | 1997-05-02 | 2000-02-01 | 정선종 | Real-time interfacing for virtual environment |
JPH11338614A (en) * | 1998-05-27 | 1999-12-10 | Noritz Corp | Operation input device |
CN1105347C (en) * | 1998-07-08 | 2003-04-09 | 大腾电子企业股份有限公司 | Computer input pointer device |
JP2000181601A (en) * | 1998-12-18 | 2000-06-30 | Fujitsu General Ltd | Information display system |
CN2396443Y (en) * | 1999-10-15 | 2000-09-13 | 曾信得 | Single-hole multi-roller signal input device |
KR100682579B1 (en) * | 2000-05-04 | 2007-02-15 | (주)태민메카트로닉스 | Pointing device |
-
2001
- 2001-07-24 KR KR10-2001-0044588A patent/KR100446612B1/en not_active IP Right Cessation
-
2002
- 2002-07-22 US US10/484,505 patent/US7259756B2/en not_active Expired - Fee Related
- 2002-07-22 JP JP2003515960A patent/JP2004537055A/en active Pending
- 2002-07-22 CN CN028177142A patent/CN1554044B/en not_active Expired - Fee Related
- 2002-07-22 WO PCT/KR2002/001369 patent/WO2003010652A1/en active Application Filing
-
2007
- 2007-04-06 US US11/697,670 patent/US20070273642A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5146566A (en) * | 1991-05-29 | 1992-09-08 | Ibm Corporation | Input/output system for computer user interface using magnetic levitation |
US5982352A (en) * | 1992-09-18 | 1999-11-09 | Pryor; Timothy R. | Method for providing human input to a computer |
US6346929B1 (en) * | 1994-04-22 | 2002-02-12 | Canon Kabushiki Kaisha | Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process |
US6529130B2 (en) * | 2001-02-16 | 2003-03-04 | General Phosphorix Llc | System for detecting intruders |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150084849A1 (en) * | 2013-09-23 | 2015-03-26 | Hyundai Motor Company | Vehicle operation device |
US20150219474A1 (en) * | 2014-01-31 | 2015-08-06 | Microchip Technology Incorporated | Digital period divider |
US10048089B2 (en) * | 2014-01-31 | 2018-08-14 | Microchip Technology Incorporated | Digital period divider |
US11829531B2 (en) * | 2021-09-13 | 2023-11-28 | Htc Corporation | Human-computer interaction method and system and non-transitory computer readable storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2003010652A1 (en) | 2003-02-06 |
KR20030009918A (en) | 2003-02-05 |
WO2003010652B1 (en) | 2004-04-08 |
CN1554044B (en) | 2012-07-04 |
US7259756B2 (en) | 2007-08-21 |
US20040169636A1 (en) | 2004-09-02 |
CN1554044A (en) | 2004-12-08 |
JP2004537055A (en) | 2004-12-09 |
KR100446612B1 (en) | 2004-09-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7259756B2 (en) | Method and apparatus for selecting information in multi-dimensional space | |
CN105824431B (en) | Message input device and method | |
EP0666544B1 (en) | Gesture input method and apparatus | |
EP1810217B1 (en) | Automated gesture recognition | |
CN108196668B (en) | Portable gesture recognition system and method | |
KR100674090B1 (en) | System for Wearable General-Purpose 3-Dimensional Input | |
US7427979B2 (en) | Pointing apparatus and method | |
KR100630806B1 (en) | Command input method using motion recognition device | |
US20030132950A1 (en) | Detecting, classifying, and interpreting input events based on stimuli in multiple sensory domains | |
US9619024B2 (en) | Virtual input device and virtual input method | |
WO2010084498A1 (en) | Device and method for monitoring an object's behavior | |
KR100777107B1 (en) | apparatus and method for handwriting recognition using acceleration sensor | |
KR20030008066A (en) | Information input method using wearable information input device | |
JP2002278673A (en) | System for inputting information using bio-feedback and method for the same | |
US10048768B2 (en) | Systems and methods for determining input movement | |
KR101553484B1 (en) | Apparatus for detecting hand motion and method thereof | |
CN111580660A (en) | Operation triggering method, device, equipment and readable storage medium | |
Yamagishi et al. | A system for controlling personal computers by hand gestures using a wireless sensor device | |
KR100480770B1 (en) | Method for pointing information in three-dimensional space | |
JPH1153104A (en) | Pen-type input device and pattern recognition method for the pen-type input device | |
CN106155277B (en) | Electronic equipment and information processing method | |
KR102322968B1 (en) | a short key instruction device using finger gestures and the short key instruction method using thereof | |
CN117055738B (en) | Gesture recognition method, wearable device and storage medium | |
KR101805111B1 (en) | Input interface apparatus by gripping and the method thereof | |
Hein et al. | Gesture spotting for controlling a mobile assistance system for service and maintenance |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |