VIRTUAL KEYBOARD INPUT SYSTEM USING POINTING APPARATUS IN DIGITAL
DEVICE
TECHNICAL FIELD
The present invention relates to a virtual keyboard input system using a pointing device in a digital device, and more particularly, to a virtual keyboard input system that sets a virtual keyboard using an absolute coordinate system to a two-dimensional pointi ng device, such as a touchpad or a touchscreen, and inputs letters by using the two-di mensional pointing device.
BACKGROUND ART
Computers can be used with the graphical user interface (GUI) systems via a mo use that can move a pointer that points to commands and indicates the position on a co mputer monitor. As the size of computers has become smaller nowadays, touchpads and pointin g sticks have been developed as built-in pointing devices to replace the mouse and imp rove user convenience.
Current portable digital devices, such as personal digital assistants (PDAs), porta ble multimedia players (PMPs), and even cellular phones, are becoming more like com puters.
However, such digital devices are too small to have a pointing device, and thus a re configured as user interface (Ul) systems using a screen touch method or at least th e cellular phones are operated using a keypad by which letters can be input.
Accordingly, portable digital devices having a Ul function like a notebook person al computer (PC) having an embedded pointing device have not been developed yet be cause of their small size. In particular, cellular phones which should allow numbers to be input are generally too small to have a pointing device, such as a touchpad, a pointi ng stick, or a trackball, and even though they have a pointing device, the pointing devic e just helps to more easily input numbers. Accordingly, the cellular phones have a key pad-oriented configuration.
DETAILED DESCRIPTION OF THE INVENTION
TECHNICAL PROBLEM
The present invention provides a virtual keyboard input system that can input lett ers, numbers, and so on by using a virtual keyboard alongside a two-dimensional pointi ng device.
TECHNICAL SOLUTION
According to an aspect of the present invention, there is provided a virtual keybo ard input system using a pointing device in a digital device. The virtual keyboard input s ystem comprises: a sensor unit sensing a contact and a two-dimensional contact positio n; a switch unit; and a control unit dividing a contact sensitive region of the sensor unit i
nto multiple division regions according to XY coordinates, assigning virtual keys of a virt ual keyboard to the division regions, and when the switch unit is turned on, controlling a n input of information for a virtual key assigned to a division region which is contacted a mong the division regions. The switch unit may comprise a first switch unit coupled with the first sensor unit to input the first virtual key set and a second switch unit coupled with the second sensor unit to input the second virtual key set. The switch unit may use a mechanical switch t hat is turned on by pressing. The sensor unit may be pressed by a user to a predeter mined depth, and the switch unit may be disposed adjacent to the sensor unit and may also be pressed when the sensor unit is pressed.
The sensor unit may sense the contact and the contact position by using a chan ge in electrostatic capacity due to contact.
The switch unit may be disposed at an edge of a surface opposite to a surface of the digital device where the sensor unit is disposed, such that when a user holds the di gital device in one hand and contacts the sensor unit with the thumb, the switch unit ca n be pressed with other fingers than the thumb.
The switch unit may comprise: a lower switch unit disposed on a top surface of th e sensor unit and including a group of lines that are arranged in parallel in a first axis; a nd an upper switch unit spaced apart from the lower switch unit and including a group o f lines that are arranged in parallel in a second axis different from the first axis and cont act the first lines of the lower switch unit due to a downward pressure, wherein the switc h unit detects a pressing by determining whether current flows when the lower switch u
nit and the upper switch unit contact each other. The lines of the lower switch unit ma y include negative power lines connected to a negative electrode, and positive power Hn es connected to a positive electrode, which are alternately arranged, wherein the secon d lines of the upper switch unit are conductive lines with no connection with power sour ce.
A switch used in the switch unit may be turned on or off in accordance with a cha nge in electrostatic capacity.
Uneven members may be formed as a guiding element on a surface of the sens or unit so as for a user to distinguish the division regions. At least a central row or colu mn of division regions may be larger than that of other division areas so as for a user to easily recognize the path through which the user' s thumb travels.
The control unitmay control information of a virtual key assigned to a division regi on which is contacted among the division regions to be displayed on a screen of the dig ital device. When a division region among the division regions of the sensing unit is contacte d, the control unit may make the division region to be expanded to have a greater area t han that before being contacted.
When a switch-on time for which the switch unit is turned on is less than a preset time i nterval, the control unit makes a primary information assigned to the virtual key is input while if the switch-on time is greater than the preset time interval a secondary informatio n which is different from the primary information is to be input. For example, an additi onal operation such as pressing shift key or space key which is needed before or after
a text input operation may be omitted since the longer pressing may assume that the vir tual key is pressed in the state where a shift key is pressed, or there follows a space ke y pressing .
A position of each of the division regions may be calibrated in accordance with a center position of the contacting area of a finger with the division region.
According to another aspect of the present invention, there is provided a virtual k eyboard input system using a pointing device in a digital device, the virtual keyboard inp ut system comprising: a sensor unit sensing a contact and a two-dimensional contact p osition in accordance with a change in electrostatic capacity and calculating a contact p ressure according to the change in the electrostatic capacity; and a control unit sensing region of the sensor unit into multiple division regions according to XY coordinates, assi gning virtual keys of a virtual keyboard to the division regions, and making information o f a virtual key assigned to a division region that is contacted be input when the calculate d contact pressure is greater than a pressing reference pressure. The control unit may make information of a virtual key assigned to a division regi on that is contacted while the contact pressure exceeds a pressing threshold pressure, be input , when the contact pressure exceeds the pressing reference pressure, and wh en a contact position, contacted when the contact pressure exceeds the pressing refere nee pressure, is different from a contact position, contacted when the contact pressure exceeds the pressing threshold pressure, wherein the pressing threshold pressure is a pressure between the pressing reference pressure and a touch pressure by which a tou ch is identified.
The pressing reference pressure may be set variably depending on a contact po sition. In a first mode for the right-handed, the pressing reference pressure for a left u pper region of the sensor unit may be set to be higher than the pressing reference pres sure for a right lower region of the sensor unit.
ADVANTAGEOUS EFFECTS
According to the present invention, since a virtual keyboard along with a two-dim ensional pointing device, such as a touchpad, is used, both pointing and text input funct ions can be performed by one device, thereby reducing the size of a digital device. Th e digital device according to the present invention becomes small but allows more conv enient and accurate text input than a digital device using a conventional keypad.
In principle, a virtual keyboard input system according to the present invention ca n use any of an electrostatic capacity-based method, a resistance-based method, a freq uency-based method, and so on, which can provide a coordinate system and a pointing function.
Currently, in order to replace keypads of cellular phones or keyboards, touchscre ens have been developed as pointing devices. However, since command button or a menu item on a touchscreen is handled by a finger, buttons or menu items should be Ia rge enough to prevent ambiguous point of contact by a finger. Accordingly, touchscre ens have a limitation in reducing the size of a digital device.
However, the virtual keyboard input system according to the present invention ca n be smaller than a system using a conventional touchscreen since, even though a fing
er touches several buttons or menu items on a touchpad, the touchpad calculates the p osition of the finger, which is indicated by a pointer on a screen, as one point.
As described above, even though a region corresponding to each key is much s mailer than a thumb and a finger touches several keys at once, it does not matter for th e virtual keyboard input system according to the present invention.
Due to this fact, with a pressure sensing device used as an input device for a por table digital device, there is a limitation in reducing the size of the portable digital device , since command buttons or menu items corresponding to respective commands to be e xecuted should be large enough to be distinguished by a finger. Accordingly, an input device for a digital device which can be held and operated in one hand has not been de veloped yet, but the virtual keyboard input system according to the present invention ca n be held and operated in one hand.
Accordingly, a user using a cellular phone to which the virtual keyboard input sys tern according to the present invention is applied can be free from problems that a conv entional QWERTY phone brings forth. That is, in the case of a QWERTY phone, a us er should raise his/her thumb to reduce a contact area with a keypad, select a target ke y, and carefully press the target key not to press other keys around the target key, there by leading to stress and fatigue in the thumb and inconvenience in use.
However, in the case of the virtual keyboard input system using the touchpad ac cording to the present invention, there is no need to carefully move a finger in order to d istinguish a target key from other keys on a keyboard, thereby ensuring fast text input w ithout fatigue.
Accordingly, since a virtual keyboard of the virtual keyboard input system accordi ng to the present invention can be easily used in a small space, a cellular phone emplo ying the virtual keyboard input system is no longer a simple voice telecommunication to ol but rather may act as a fingertop computer upgraded from a personal digital assistant (PDA) that is a palmtop computer.
This means that a user can carry a digital device anywhere anytime in ubiquitous computing environment. The virtual keyboard input system using the touchpad accor ding to the present invention can be applied to a remote controller having a text input fu nction used in a television (TV), a video cassette recorder (VCR), and a digital versatile disk (DVD) as well as to a portable digital electronic device.
That is, since not only a simple pointing function but also a text input function are performed, an electronic device having a monitor can have a graphical user interface (
GUI). Ultimately, the virtual keyboard input device according to the present invention c an be a hand-in ubiquitous input system that enables an electronic device to be comput erized and all electronic devices to be networked.
DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of a virtual keyboard input system according to an emb odiment of the present invention. FIGS.2 and 3 are cross-sectional views illustrating a mechanical switch used in a switch unit, disposed adjacent to a touchpad, and pressed when the touchpad s press ed.
FIG. 4 is a cross-sectional view illustrating dome switches disposed underneath a touchpad.
FIG. 5A illustrates a method of attaching a switch serving as a function button of a touchpad to the top surface of a touchpad. FIG. 5B illustrates the arrangement of lines.
FIG. 5C illustrates a switch circuit being shorted when a touchpad is pressed and switches are accordingly pressed.
FIG. 6 illustrates a touchpad and an input switch separated from each other. FIG . 7 illustrates a touchpad and an input switch associated with each other. FIGS. 7A and 7B illustrate the input switch pressed when the touchpad is pressed similarly to FIGS. 2 through 5. FIGS. 7C and 7D illustrate a cellular phone having a keypad. FIGS. 7E and 7 F illustrate the touchpad being pressed to perform a touchpad function and an input swi tch function.
FIG. 8 illustrates a virtual keyboard input system including two sensor units (touc hpads) according to an embodiment of the present invention.
FIGS. 9 through 11 illustrate the virtual keyboard input system of FIG. 8 used in different modes.
FIG. 12 is a cross-sectional view of touchpads and illustrates the arrangement of function buttons coupled to the touchpads. FIG. 13 illustrates switches disposed on both upper and lower ends of a rear surf ace of a cellular phone and performing the function of dome switches.
FIGS. 14 through 19 illustrate digital devices employing a virtual keyboard input
system according to embodiments of the present invention.
FIGS. 20 and 21 illustrate a digital device having two touchpads on which uneve n members are formed to distinguish division regions.
FIGS. 22 and 23 are views for explaining a method of inputting letters when divis ion regions of two touchpads have uniform areas according to an embodiment of the pr esent invention.
FIGS. 24 and 25 are views for explaining a method of inputting letters when divis ion regions of two touchpads have different areas according to an embodiment of the pr esent invention. FIG. 26 is a view for explaining a method of operating a cellular phone having th e touchpads of FIG. 22 for the call mode in the portrait mode.
FIGS. 27 and 28 are views for explaining a method of inputting text when divisio n regions of two touchpads used in a portrait mode have different areas according to an embodiment of the present invention. FIG. 29 illustrates a method of displaying cursors on a screen by using signals fr om two touchpads according to an embodiment of the present invention.
FIG. 30 is a view for explaining a method of calibrating a mismatch between the center of contact area and the reference point of the touchpad when user' s finger is pi aced on the reference point. FIG. 31 is a block diagram of a virtual keyboard input system according to anoth er embodiment of the present invention.
FIG. 32 illustrates three types of pressure change which occur when a finger con
tacts the touchpad to carry other functions than the pointing function of the touchpad.
FIG. 33 illustrates available regions for tapping in touchpads having a tapping fu nction of FIG. 32.
FIG. 34 illustrates an error which may arise when a touchpad works as a button on the basis of the pressure change during a pressing operation.
FIG. 35 is a flowchart illustrating a method of correcting letters according to an e mbodiment of the present invention.
FIG. 36 is a view for explaining a method of performing a function or inputting wh en there is a certain pattern of finger movement on the touchpad within a predetermine d time.
FIG. 37 is a flowchart illustrating a method of initializing a touchpad which is nee essary for the touchpad to do the function of a function button.
FIG. 38 illustrates contact areas between a finger and a sensor unit on several p ositions of the touchpad. FIG. 39 illustrates a contact pressure versus a pressing pressure at each positio n when a touchpad is held as shown in FIG. 38.
FIG. 40 is a flowchart illustrating a method of setting a pressing reference pressu re at each division region according to an embodiment of the present invention.
FIG. 41 illustrates a method of defining each key region of a virtual keyboard, wh erein once a key is selected, the region corresponding to the key is expanded.
BEST MODE
The present invention realizes a virtual keyboard alongside a two-dimensional po inting device, controls the position of a pointer in a relative coordinate system when an original pointing function of the pointing device is performed, and inputs letters into the virtual keyboard in an absolute coordinate system when a text input function is perform ed.
A virtual keyboard input system according to the present invention can be used a s an input device for a conventional desktop computer. But its main use is for a portable digital device, such as a cellular phone, a personal digital assistant (PDA), or a remote controller, to input letters, numbers, and so on.
FIG. 1 is a block diagram of a virtual keyboard input system using a pointing devi ce according to an embodiment of the present invention.
Referring to FIG. 1 , the virtual keyboard input system includes a sensor unit 110, a switch unit 120, and a control unit 130. The sensor unit 110 senses a contact occurrence and a contact position accordi ng to a change in electrostatic capacity.
The sensor unit 110 may be a general touchpad, a touchscreen, or the like. When the sensor unit 110 is a touchpad, the sensor unit 110 detects whether the re is a contact by detecting a change in electrostatic capacity which arises when a user ' s finger touches the sensor unit 110, and the sensor unit 110 detects the position of t he finger by using the point where the change in the electrostatic capacity occurs. Sue h a method of detecting a contact occurrence and a contact position according to a cha
nge in electrostatic capacity is already known widely, and thus a detailed explanation th ereof will not be given.
When the sensor unit 110 is a touchscreen, the sensor unit 110 may detect a co ntact occurrence and a contact position in the same manner as that used when the sen sor unit 110 is a touchpad. However, in general, since two groups of lines connected t o a positive power source and connected to a negative power source are alternately arr anged on a screen in parallel and over these lines another group of conductive lines are arranged perpendicular to the group of lines connected to the negative and positive po wer sources. When a user presses the screen, the conductive lines arranged across th e lines connected to the negative and positive power sources, thereby results in short-ci rcuit and changes the resistance. Accordingly, the sensor unit 110 detects a contact a nd a contact position by using a point where the shortcircuit bringing the resistance cha nge is caused.
Such a method of detecting a contact occurrence and a contact position accordin g to a change in resistance on a touchscreen or the like is also already known widely, a nd thus a detailed explanation thereof will not be given.
The switching unit 120 performs a function of a function button for a mouse in a pointing mode and performs a text input function in a text input mode in which letters, n umbers, and so on are input. A switch of the switch unit 120 used to determine an on or off state may be a me chanical switch, an electronic switch, which determines an on or off state by using a co
ntact occurrence like a touchpad or a touchscreen, or a piezoelectric switch, which sens es a pressure and generates a signal when sensing a pressure.
The control unit 130 divides a contact sensing region of the sensor unit 110 into a multiple division regions according to XY coordinates, assigns a virtual key of a virtual keyboard to each division region, and when the switch unit 120 is turned on, controls i nformation of a virtual key assigned to a division region that is contacted by a finger to b e input.
That is, the control unit 130 sets a position of each of virtual keys constituting the virtual keyboard to the sensor unit 110 and, when there is a contact on the position an d the switch unit 120 is turned on, makes a letter or the like for the virtual key correspon ding to the position to be input.
Also, the control unit 130 may display the arrangement of a virtual keyboard com prising a virtual key set assigned to the sensor unit 110 on a screen of a digital device
, and indicate a virtual key assigned to a position, which is contacted, of the sensor unit 110 on the virtual keyboard or in a separate location of the screen from the virtual key board.
A digital device, such as a cellular phone or a personal digital assistant (PDA), w hich has its own output window physically connected to the sensor unit 110, may displa y the virtual keyboard on the output window, and a digital device, such as a television ( TV) remote controller, which does not have its own output window wired to the sensor u nit 110, may display the virtual keyboard on a screen of a TV that wirelessly communica tes.
When the sensor unit 110 is a touchpad, a currently selected virtual key can be i ndicated on the virtual keyboard displayed on the screen. However, when the sensor unit 110 is a touchscreen, a currently selected virtual key displayed on the virtual keybo ard may be covered by a finger and thus it is preferred that the currently selected virtual key be displayed on another location separate from the virtual keyboard.
Also, even when the sensor unit 110 is a touchpad, in order to prevent the scree n from being occupied by the virtual keyboard and save a space for other contents to b e displayed, the virtual keyboard may not be displayed and only information for the curr ently selected virtual key may be displayed on a extra text-cursor supported area or a p redetermined position on the screen.
The function of each element will be explained in detail with other drawings. Sine e a touchpad is a representative sensor unit, the touchpad will be exemplarily explained but the present invention is applicable to other devices having a pointing function such as a touchscreen. FIGS. 2 and 3 illustrate a mechanical switch 202 used in the switch unit 120, dis posed adjacent to a touchpad 201 , and pressed as the touchpad 201 is pressed.
The touchpad body 201 is pressed by a user like a lever which accordingly press es the switch 202. Referring to FIG. 2, the switch 202 is disposed on an end of a lowe r portion of the touchpad 201 and pressed when the touchpad 201 is pressed. Referri ng to FIG. 3, the switch 202 is disposed beside the touchpad 201 and laterally pressed when the touchpad 201 is pressed.
FIG. 4 illustrates dome switches 403 disposed under a bottom surface of a touch pad 401. Since an insulating layer 402 covers and protects electrodes, other electroni c parts, and electric circuits mounted on the bottom surface of the touchpad 401 and an elastic spacer 405, 406 surrounds the touchpad 401 , the touchpad 401 can be verticall y moved and there exists no gap between the touchpad 401 and the cellular phone eve n when the touchpad 401 is pressed by a finger.
Since bottom surface member 404 is fixed, the dome switches 403 change from an off state to an on state when the touchpad 401 is pressed. The dome switches 403 may be arranged on an edge or on a central portion of the touchpad 401. The numb er and positions of the dome switches 403 may be determined so as for a user not to a pply an excessive force to operate the touchpad 401.
FIG. 5A illustrates a method of attaching the switch unit 120 to the top surface of the sensor unit 110. FIG. 5B illustrates the arrangement of lines. FIG. 5C illustrates a switch circuit before and after the touchpad is pressed and the switch unit 120 is acco rdingly turns to a shorted state when pressed.
When the sensor unit 110 is a touchpad that senses a contact position from a ch ange in electrostatic capacity, even though a user' s finger and a surface of the touchp ad do not directly contact each other, electrostatic capacity may be changed. Accordin gly, the switch unit 120 may be installed on the top surface of the sensor unit 110 as sh own in FIG. 39.
In detail, the switch unit 120 of FIG. 5 is disposed on the top surface of the senso r unit 110 and performs a switching function when an upper switch unit and an lower sw
itch unit disposed on the bottom surface 501 contact each other. The lower switch unit includes a group of lines including negative power lines 503 connected to a cathode a nd positive power lines 502 connected to an anode alternately arranged in parallel in a f irst axis. The upper switch unit includes multiple lines arranged in parallel in a second axis perpendicular to the first axis.
In detail, the bottom surface 501 of the switch unit 120 contacting the sensor unit 110 and a top surface 506 of the switch unit 120 exposed to the outside are formed of an insulating film, such as a polyester film, having durability and flexibility, and insulate conductive lines. The first group of lines including the negative power lines 503 and the positive po wer lines 502 are connected to power sources of opposite charge. For example, the n egative power lines 503 may be connected to a ground electrode, and the positive pow er lines 502 may be connected to a 5V electrode.
Conductive lines used as the first group lines may be attached to the bottom surf ace 501 formed of an insulating film to a thickness of 0.1 to 0.3 mm at intervals ΔL2 of 4 to 6 mm and arranged on the top surface of the touchpad.
Also, an elastic body 504, such as a polyurethane foam sponge, having a thickn ess of 1 mm or so is disposed between the negative power lines 503 and the positive p ower lines 502. The second group of lines 505, which are conductive with a thickness of 0.05 mm or less, are arranged on the elastic body 504 in a direction perpendicular to the first group of lines which are the negative and positive power lines and 502 and 503
connected to the electrodes. The top surface 506 formed of an insulating film is disp osed on the second group of lines 505.
The second lines 505 which have no connection with external electrodes makes the negative power lines 503 and the positive power lines 502 connected to the electro des be shorted when the touchpad is pressed.
The second group of lines 505 may be arranged at intervals of 1 mm smaller tha n that (4 mm) of the first group of lines. However, when the second group of lines 505 are too densely arranged, a change in electrostatic capacity between the touchpad and a finger is spread over all the touchpad instead of being localized on the contact area a nd, therefore, disables the pointing function of the touchpad.
The elastic body 504 interposed between the negative and positive power lines 5 02 and 503 separates the first group of lines 502 and 503 and the second group of lines 505, under no pressing and, makes them contact when the switch unit 120 is pressed as shown in FIG. 5C such that current flows between the first group of lines through sec ond group of lines.
Accordingly, even when the switch unit 120 is installed on the top surface of the sensor unit 110, the pointing function of the sensor unit 110 is not hindered and a signal of a function button is transmitted to the input control unit of a computer when the sens or unit 110 is pressed. Hence the switch can work as the function button. FIG. 6 illustrates a case in which a touchpad and an input switch are separated fr om each other and operated separately. FIG. 7 illustrates a case of a touchpad having
an input switch associated with it in such a way that the input switch is pressed when t he touchpad is pressed as shown in FIGS. 2 through 5.
In FIG. 6, the input switch separated from the touchpad may be a mechanical sw itch, a switch utilizing a change in electrostatic capacity like a general touchpad, or a sw itch utilizing a change in resistance like a general touchscreen.
FIG. 6 illustrates a one-hand operating procedure of a mobile phone having a poi nting device as an input device to input ' 47' .
Referring to FIG. 6A, a pointer is moved to ' 4' on a virtual keyboard 601 of a screen. Referring to FIG. 6B, a command button 603 is pressed with a user' s thumb to input ' 4' into the screen. Referring to FIG. 6C, the thumb is moved downward on the touchpad 602 to move the pointer to ' 7' on the screen. Referring to FIG. 6D, t he thumb is moved from the touchpad 602 to the command button 603, and the comma nd button 603 is pressed to input ' T into the screen.
FIG. 7 illustrates that the operating procedure for a cellular phone having a touch pad which works as a function button as shown in FIGS. 2 through 5 is the same as for conventional keypad mobile phone of Fig. 7c and 7d..
That is, since the touchpad of the cellular phone also serves as the function butt on, when ' 47' needs to be input, the operations of FIGS. 6B and 6D are not necessa ry and just the operations of FIGS. 6A and 6C are performed. Accordingly, referring t o FIG. 7A, a finger is moved around on the touchpad to select ' 4' on the screen and then the touchpad is pressed to input ' 4' , like in the conventional cellular phone of Fl G. 7C. Next, the finger is moved around on the touchapd to select ' T and then the
touchapd is pressed to input ' T , like in the case of the conventional cellular phone of FIG. 7D.
FIGS. 7E and 7F illustrate a touchpad in a touched state and in pressed state, re spectively to perform a pointing function and switch function. Even a conventional to uchpad works as an function button when the touchpad is tapped once or twice with a fi nger. In this case, as soon as the finger is separated from the touchapd, a pointer ma y be moved, thereby causing an error not to execute the desired command. Furtherm ore, due to such additional vertical motions of the finger for tapping, more energy and Io nger time is spent in the conventional touchpad to input a character than in a conventio nal keypad cellular phone, thereby lowering input efficiency.
The sensor unit 110 may be installed as two separate units, the first sensor unit and the second sensor unit.
When the two sensor units are used, letters can be more rapidly input by using b oth hands. That is, when one sensor unit is used, there is little difference in speed eve n though letters are input with both hands. However, in the case of two sensor units, I etters are input more rapidly with both hands, as follows ; while any one of virtual keys assigned to the first sensor unit is input with one hand, the other hand is placed on a ne xt virtual key to be input among virtual keys assigned to the second sensor unit and wh en it comes to the next virtual key turn, the switch unit 120 is just turned on, thereby incr easing a typing speed as compared to the case of one sensor.
At this time, each of the first and second sensor units may be provided with a se parate switch unit 120, or only one switch unit 120 may be shared by all the sensor unit
s. When the switch unit 120 is turned on by pressing the sensor unit 110, the switch u nit 120 is necessary to each of the sensor units separately. Otherwise, only one switc h unit 120 may be used.
Also, the two sensor units may be realized by using two separate touchpads, or by separating the virtual keyboard into two sections and assigning each section to a diff erent region of one touchpad.
FIG. 8 illustrates a virtual keyboard input system of two sensor units (touchpads) according to an embodiment of the present invention.
A cellular phone using two touchpads can be a folding- or a sliding-type cellular phone, and inputting letters is done with both hands and making calls with only one han d. Accordingly, both the voice communication function of the cellular phone and the te xt input function as a digital device can be easily performed.
In FIG. 8, the two touchpads are associated with two cursors in a text input mode , and the cursors cannot pass over a central border line and are respectively moved in t he left region and the right region. Each of the two touchapds has four function button s 802 through 805. The four function buttons perform different functions when the cell ular phone is used and are arranged to be operated easily with one hand or two hands. A conventional keyboard with four rows may be used for text input convenience as sho wn in FIG. 8A, or a shortened keyboard having three rows may be used as shown in Fl G. 8B.
FIGS. 9 through 11 illustrate the virtual keyboard input system of FIG. 8 used in different modes.
FIG. 9 illustrates a bar-type cellular phone in a vertical mode according to an em bodiment of the present invention which can be used with one hand to conveniently dial numbers and receive or make calls.
FIG. 10 illustrates a cellular phone in a horizontal mode according to an embodi ment of the present invention which can be used with both hands to input letters and ad opt a GUI system without difficulty.
FIG. 11 illustrates a double sliding-type cellular phone having two touchpads whi ch can be used in both horizontal and vertical modes respectively as shown in FIGS. 11 C and FIG. 11 B. FIG. 12 is a cross-sectional view of touchpads 1200L and 1200R and illustrates t he arrangement of function buttons accompanying the touchpads 1200L and 1200R. Referring to FIG. 12A, dome switches 1201 , 1202, and 1203 act as function buttons an d dome switches 1205 are also disposed under the touchpad 1200L and 1200R. Refe rring to FIG. 12B, edge portions (S)1 , (S)2, (S)3, (S)4, (S)5, and (S)6 of the touchpads 1200L and 1200R instead of mechanical buttons perform switch functions by using a ch ange in the electrostatic capacity of the touchpads 1200L and 1200R when the edge po rtions (S)1 , (S)2, (S)3, (S)4, (S)5, and (S)6 are tapped.
Since the edge portions (S)1 , (S)2, (S)3, (S)4, (S)5, and (S)6 are covered by a c ase body, tapping does not cause a movement of the dome switches 1205 and hence n o operation since they operate with a vertical movement of touchpad regions 1208L and 1208R.
FIG. 13 illustrates a case in which dome switches are not disposed under touchp ads 1301 L and 1301 R. Referring to FIG. 13B-(B), switches are disposed on a rear sur face of a cellular phone, that is, a surface opposite to a frontal surface where the touch pads 1301 K and 1301 R are placed. In detail, switches 1303L, 1030L' , 1303R, and 1 303R' are disposed on edges of upper and lower ends of the rear surface of the cellul ar phone.
When switches are disposed on edges of a rear surface of a cellular phone, a us er can more easily press the switches while holding the cellular phone in one hand than in the case where switches are disposed on other parts than the edges of the rear surf ace of the cellular phone.
The switches may include ' L' -shaped levers and dome switches 1304L and 1 304R and may be disposed on edges or other parts of the rear surface. FIG. 13C illust rates the switches pressed and operated with a hand or two hands.
The switches 1303L' and 1303R' disposed on the upper end of the rear surfa ce of the cellular phone may be omitted, or only the switches 1303L and 1303R except t he switches 1303L' and 1303R' may be programmed to be operated by a software.
FIGS. 13C-(A) illustrates the position of a finger for the right-handed in a horizont al(landscape) mode (text input mode). FIG. 13C-(B) and (C) illustrates the position of a finger for the right-handed in a vertical(portrait) mode (phone mode). Since thumbs can be freely moved and the switches 1303L and 1303R can be e asily operated in FIG. 13C, the same easiness as that obtained when switches are disp osed under touchpads can be obtained.
The virtual keyboard input system according to the present invention can perfor m both a text input function and a pointing function.
When a user uses a digital device including the virtual keyboard input system ac cording to the present invention, he/she may select a pointing mode or a text input mod e by using a separate switch or a menu icon on the screen and perform a correspondin g function.
FIG. 14 illustrates a operating procedure for a cellular phone employing a virtu al keyboard input system in a horizontal mode to use an E-mail program, like in a GUI s ystem of a conventional computer when two sensor units 110 are touchpads. Referring to FIG. 14A, the cellular phone is turned on to show a main screen. Referring to FIG. 14 B, a pointer is moved to an E-mail menu icon and a touchpad is quickly double clicked t o open the E-mail program. Referring to FIG. 14C, the pointer is moved to an outbox menu icon and select button 804L is double clicked to open the list of sent e-mails.
Referring to FIG. 14D, one item of the list is clicked to open the selected mail sue h that editing can be made to the mail. The pointer is moved to a position where letter s to be input and select button 804L is double clicked to display a text cursor.
Referring to FIG. 14E, text/GUI mode converting button 801 L is pressed to open a virtual keyboard at a lower portion of a screen such that the position where letters are to be input is placed right over the virtual keyboard. Referring to FIG. 14F, after title is input, the pointer is moved to a text body and t he select button 804L is double clicked to display a text cursor.
Referring to FIG. 14G, text/GUI mode converting button 801 L is pressed to show the virtual keyboard. Referring to FIG. 14H, the pointer is moved to a ' quit' button and the touchpad is clicked to end a text input mode. Referring to FIG. 141, text/GUI m ode converting button 801 L is clicked to change to a Ul mode. For example, the point er may be moved to ' file' and select button 804L may be pressed to open and execu te a menu, such as ' store' , ' send' , or ' end' . The ' end' menu may be sele cted and select button 804L may be clicked to return to the main screen.
FIG. 15A illustrates a virtual keyboard. FIG. 15A illustrates the virtual keyboard displayed on a screen in a text input mode where left and right pointers (cursors) are Io cated on ' f and ' j' , respectively. The two left and right pointers on the virtual ke yboard cannot cross over the central border and are respectively moved in a left region
1501 and a right region 1502.
Like in a computer keyboard, the left pointer is moved with the left thumb and the right pointer is moved with the right thumb to improve text input efficiency. Since the t wo pointers do not interfere with each other and are always moved in their own regions no matter how the touchpads are operated, both the thumbs can be freely moved and t he same text input efficiency as that of a QWERTY keyboard can be achieved.
Since the functions of ' enter' , ' Korean/English convert' , and ' caps (small/ capital letter convert)' buttons, which are often used to input letters as shown in FIG. 1 4G, are performed by function buttons around the touchpads at fixed positions, the func tion buttons can be operated easily and text input efficiency can be improved. When t
he ' caps' function button is pressed, a key of the virtual keyboard is changed to a ca pital letter mode (see FIG. 15B).
FIG. 16 illustrates a method of inputting the text " ... I am fine." . Referring to FIG. 16A, ' ... am' is already input. Referring to FIG. 16B, a spa ce function button is pressed to input a space. Referring to FIG. 16B, the right thumb i s moved to a right lower end of the touchpad and a space function button is pressed to i nput a space. Referring to FIG. 16C, cursors are located on ' f and ' i' to input ' fine' , and the left and right touchpads are sequentially pressed.
FIG. 17 illustrates a cellular phone having two touchpads and multiple function b uttons. The cellular phone can easily operate a GUI system like having a mouse.
Referring to FIG. 17A, a document is selected by using a right touchpad and an command button disposed under a left touchpad. Referring to FIG. 17B, the document is moved to a wastebasket by using the right touchpad while the command button is b eing pressed. When it is a system of one pointer and two pointing devices, the two poi nting devices are independently operated and thus can be conveniently used for both th e left- and right-handed people like having a mouse.
As shown in FIG. 17, a right-handed person may use the right touchpad and a lef t-handed person may use the left touchpad. When the select buttons 804L and 804R are switchable like in a mouse, the operation procedure for the right-handed person in F IG. 17B may be applied to the left-handed person.
FIG. 18 illustrates a procedure of operating a cellular phone in a vertical mode us ing a GUI system to make calls, wherein making calls using the GUI system is the same as that using a conventional cellular phone.
Referring to FIG. 18A, the cellular phone is turned on to show the initial screen. Referring to FIG. 18B, a pointer (cursor) is moved to a phone-mode icon and a touchpa d is double clicked to open a virtual keypad. Referring to FIG. 13C, the cursor is sequ entially moved to desired numbers and the touchpad is sequentially pressed to input 01 1-813-9715 into a screen. Referring to FIG. 18D, the cursor is moved to a ' call' key of the virtual keyboard and the touchapd is pressed to make a call. An ' end' key i s pressed to end the call.
Differently from a conventional cellular phone, even when a wrong number is inp ut, all previously input numbers do not need to be erased. Only the very wrong numbe r is selected, a ' cancel' key is pressed to erase the wrong number, and then a new n umber is input. The cellular phone of FIG. 18 inputs and corrects letters in the same m anner as that using a computer mouse. The cellular phone according to the present in vention can also be programmed to perform the function of a conventional cellular phon e.
Accordingly, if an existing calling method using a keypad is familiar, the cellular p hone can be programmed to use the existing calling method. For example, when only last 9715 are input, 011-813-9715 corresponding to the numbers 9715 may be shown o n the screen and a call may be made to 011-813-9715 by pressing the ' call' key. A
Iso, when ' 1 ' is pressed for a long time, that is, when the touchpad is pressed for a I
ong time, a call may be made to a previously input telephone number corresponding to " 1" . Referring to FIG. 18E, in order to return to the GUI system that is the initial mai n screen, a hidden menu is summoned, a cursor is moved to ' main screen' item in th e menu, and the touchpad is pressed. FIG. 19 illustrates an electronic dictionary employing a virtual keyboard input syst em according to an embodiment of the present invention. FIGS. 19A and 19B illustrat e an electronic dictionary having two touchpads. FIGS. 19C and 19D illustrate an elec tronic dictionary having one touchpad.
Since the electronic dictionary having the tocuhpad(s) is operated based on a G Ul system, internal dictionaries can be used in the same manner as computer applicatio n programs.
FIGS. 19C and 19D illustrate the electronic dictionary having only one touchpad.
In general, an electronic dictionary is often laid down on the bottom and used with on e hand. In this case, if a virtual keyboard is used as a Ul system using a single touchp ad, the electronic dictionary can more conveniently use the virtual keyboard like a mous e than a conventional electronic dictionary having a keyboard.
Uneven members, such as projections or grooves, may be formed on a surface o f the sensor unit 110 so that a user can easily distinguish division regions.
In the case of a touchpad that does not have to be transparent like a touchscree n, a virtual keyboard may be printed on the touchpad and a user may input letters while directly seeing the printed keyboard. However, the printed virtual keyboard may be co vered by the user' s hand sometimes, and when the user concentrates his/her attentio
n to a screen, he/she has no chance to see the touchpad. Accordingly, it is preferable that positions of desired virtual keys be perceived by fingers.
Such uneven members may have point shapes as shown in FIG. 20, or grid sha pes as shown in FIGS. 12 and 21. The uneven members used as reference points en able the user to easily know the positions of fingers on a touchpad such that he/she can move the fingers to desired letters or numbers to be input without seeing the screen.
FIG. 20 illustrates a cellular phone having two touchpads on which two or more r eference points are formed associated with two or more keys of a virtual keyboard to m ore easily input letters using the virtual keyboard. Referring to FIG. 2OA, when four reference points 2001 -L1 , 2001 -L2, 2001 -L3, 2
001 -L4, 2001 -R1 , 2001 -R2, 2001 -R3, and 2001 -R4 formed on left and right touchpads are respectively associated with s, e, f, c and j, I, I, and m of the virtual keyboard, letters to be input can be known without seeing a screen from relative positions from the refer ence points perceived by fingers. For example, when the virtual keyboard is started, pointers are automatically loc ated on ' f and ' j' of the virtual keyboard. Referring to FIG. 2OB, when fingers ar e located on the reference points 2001 -L1 and 2001 -R1 and the pointers begin to be m oved, the finger on the left touchpad is moved from the reference point 2001 -L1 to the r eference point 2001 -L3, and accordingly, the pointer is moved from ' f to ' s' on th e screen. In this condition, as the touchpad is pressed, ' s' is input.
That is, since relative positions from the reference points are perceived by finger s, how far and in which direction the fingers are to be moved can be known without seei ng the screen like using a real keyboard.
Accordingly, since the position of each key of the virtual keyboard is set with refe rence to the reference points, the virtual keyboard has the same convenience as that of the real keyboard, although there is a difference in that while the real keyboard is used with all five fingers, the virtual keyboard is used with only one finger.
FIGS. 2OB and 2OC illustrate the positions of fingers corresponding to the refere nee points on the touchpads and the positions of keys corresponding to the reference p oints on the virtual keyboard, respectively.
FIG. 21 illustrates a digital device having two touchpads on which crossword-puz zle-patterned projections are formed as reference points to easily perceive relative posit ions of keys in a virtual keyboard.
Since the crossword-puzzle-patterned projections guide fingers to linear moveme nts and help identify the positions of keys, the relative positions of the fingers for the virt ual keyboard can be easily recognized.
Dark square regions 2101 and 2102 correspond to ' a' and ' m' of the virtua I keyboard, respectively. Such square projections are shown in FIG. 21 B. The touch pads are lower than surroundings by 5 mm or less, edge portions of the touchpads guid e fingers, and the projections 2101 and 2102 protrude by 1 mm or less from the surroun dings and enable positions to be recognized without blocking the movements of the fing ers.
However, in order not to affect a change in the electrostatic capacity of the touch pads, the projections 2101 and 2102 may have a thickness of less than 0.5 mm, and pr eferably less than 0.1 mm. Since it is not desirable that a cellular phone gets thicker b ecause of a touchpad, a difference in height between the touchpads and the surroundin gs should be reduced as much as possible, and even when the difference is less than 1 mm, the projections 2101 and 2102 can guide fingers.
Referring to FIG. 12, since uneven members 1207L and 1207R reveals cross se ction of different heights in the x direction but flat in the y direction, positions in the x dir ection can be easily grasped and positions in the y direction can be easily grasped by u sing edge regions of the touchpad 1208L and 1208R. Only boundaries of the division regions may protrude in order to distinguish division regions. The shapes or types of t he uneven members used to distinguish the division regions are not limited to the illustr ations.
Also, besides the uneven members on the touchpads, corners of the touchpads contacting the surroundings may act as reference points. For example, the touchpads are divided into upper, middle, and lower zones, the upper and lower zones have corne rs acting as reference points, and thus the positions of the middle zones spaced apart fr om the corners can be easily known.
The division regions of the touchpads may have uniform areas or different areas.
FIG. 22 is a illustration to explain a method of inputting letters when division regi ons of two touchpads have uniform areas according to an embodiment of the present in vention.
FIGS. 22A and 22B illustrate coordinate systems of touchpads and of a virtual ke yboard, respectively which are the basis of the operating principle to be explained with r eference to FIG. 23 later.
Since the coordinate systems of the left and right touchpads are independently o perated, the coordinate systems are represented by L and R. However, the coordinate systems of the virtual keyboard are not divided, and range from -Xs to +xs. In the coordinate systems of the virtual keyboard of FIG. 22, Δ xi = Δ X2 = Δ X3 =
Δ X4 = Δ X5, and Δ yi = Δ y2 = Δ y3. Likewise, in the coordinate systems of the touchp ads, Δ X1 = Δ χ2 = Δ X3 = Δ χ4 = Δ χ5 and A Y1 = Δ γ2 = Δ Y3.
As described above, the operating principle of a touchpad according to the prese nt invention is different from the operating principle of a conventional touchpad in a poin ting mode. That is, in a conventional user interface (Ul) mode, the movement of a curs or is determined by receiving data corresponding to the displacement (Δ x, Δ y) of the c ursor in X and Y directions from a signal (Δ X, Δ Y), which corresponds to finger' s dis placement, generated from a touchpad or a mouse that is a pointer input device, and a new position for the cursor is determined by using a relative coordinate system. Howe ver, in a text input mode, according to the present invention, the movement of a cursor i s determined on the basis of an absolute coordinate system. That is, a point on a touc hpad corresponds to a point on a virtual keyboard. That is, the present invention uses
an absolute coordinate system in which coordinates on a touchpad and the position of a pointer on a screen correspond to each other in a one-to-one manner.
In other words, referring to FIG. 22B, when a pointer (crosshair cursor) is located as follows,
XL2 < X ≤ XL3 y2 < y ≤ y3, and an command button (a touchpad switch in FIGS. 2, 4, 12, and 13A, and a separa te switch in FIG. 13B) is pressed, ' d' is input. For this condition, fingers on the touch pads should be equally located as follows,
XL2 < X ≤ XL3 Y2 < Y < Y3.
That is, coordinates (x, y) of cursors are calculated from signals ((X, Y) -coordina tes of fingers) generated from the two-dimensional pointing devices like touchpads and the cursors are placed on the corresponding positions on the virtual keyboard. In the t ext input mode, key positions are determined by coordinates (x, y) of cursors correspon ding to coordinates (X, Y) of fingers when the left cursor is given by -Xs ≤ x < Xs, yo ≤ y ≤ y3 and the right cursor is given by -xs ≤ x ≤ Xs, yo ≤ y ≤ y3 , and a method of obta ining (X ->x, Y->y) using this method is shown in FIG. 23. For example, there is little difference between when the right thumb moves to ' y' while being touching ' p' on the right touchpad and when the right thumb moves t o ' y' after being separated from ' p' on the right touchpad in a text input mode. T
his is a difference between the operating principle of the conventional touchpad in a poi nting mode and the operating principle of the touchpad according to the present inventi on in the text input mode.
In a general Ul mode, not a text input mode, the displacement (Δ x, Δ y) of a cur sor is calculated from the displacement (Δ X, Δ Y) of a finger over a touchpad, and the r atio of the displacement (Δ x) of the cursor corresponding to the displacement (Δ X) of t he finger may be arbitrarily adjusted for user convenience. Such cursor operating prin ciple is shown in FIG. 23. Accordingly, when cursors on a screen are controlled by usi ng two touchpads according to the present invention, both a conventional relative coord inate signal method and an absolute coordinate signal method are used.
The conventional relative coordinate signal method and the absolute coordinate signal method used by the present invention will be explained with reference to FIG. 14.
Referring to FIG. 14A, a cellular phone employing a virtual keyboard input syste m is operated in a horizontal mode. A main screen and one pointer (cursor) are show n. Since the pointer can be moved over the whole screen, the pointer is referred to as a whole area cursor. The whole area cursor is controlled by matching the displacemen t (Δ X, Δ Y) of a finger to the displacement (Δ x, Δ y) of the pointer in the same manner as a pointing method of a conventional touchpad. A constant Q is a proportional const ant which determines the ratio between finger displacement and cursor displacement a s Δ x=QΔ X and may be adjusted according to user convenience.
While a ' whole area 1 cursor system' is operated as FIG. 14A and the operati
ng mode is changed to a text input mode as shown in FIG. 14G, the virtual keyboard in put system turns into a ' defined area 2 cursor system' in which two pointers are disp osed in left and right regions of a virtual keyboard and cannot pass over the central bor der line. FIG. 24 are views for explaining a method of inputting letters when division regio ns of a touchapd have different areas according to an embodiment of the present invent ion.
That is, coordinate systems of the touchpads and coordinate systems of cursors nonlinearly correspond to each other. Fingers operating the touchpads moves in a circular way due to their joints, and are actually difficult to move in a straight direction. When a finger move laterally from t he left to the right or in the reverse way on a touchpad, a vertical sway of a finger is una voidable due to this reason.
In general, in a horizontal mode, since a finger is moved in a large arc over a cen tral horizontal line, it is preferable that division regions in the middle row of a touchpad b e larger than in other rows. In a vertical mode, since a finger is moved in a large arc o ver a central vertical line, it is preferable that division regions in the middle column of to uchpad be larger than in other columns.
In detail, referring to FIG. 24B-(A), when a finger moves in a central row correspo nding to Δ Y2 of a touchpad, it sways vertically more than when it moves in regions Δ Y
1 and Δ Y3 in which the movement of a finger is guided by edges as reference line. Hen ce there is more chance that the region Δ Yi or Δ Y3 (corresponding to Y) may be selec
ted.
To solve the problem, referring to FIG. 24B-(B), the region Δ Y2 is increased so t hat despite the same finger movement as in Fig.24B-(A), the region corresponding to Δ V2 on a virtual keyboard is selected and " a, s, d, f, g, h, k, t , ?" in the region of Δ V2 can be more stably selected and input.
When the heights Δ y-i, Δ V2, Δ y3for rows of virtual keys on the virtual keyboard are the same but vertical widths of high, middle, and low regions of the touchpad corres ponding to the row of virtual keys on the virtual keyboard are different to satisfy Δ Yi = Δ Y3 < Δ Y2, a method of associating the movement of a cursor and the movement of a finger on the touchpad is shown in FIG. 25.
Y -> y conversion is not linear so that when finger position is within Δ Yi (Yo ≤ Y < Yi) and Δ Y3 (Y2 ≤ Y ≤ Y3), the cursor position is within Δ yi and Δ y3, respectively and when finger position is within Δ Y2 (Yi ≤ Y ≤ Y2), the cursor position is within Δ y 2. The advantage of this non-linear relationship is shown in FIG. 24B. That is, wh en there is the same finger movement, in the case of FIG. 24B-(A) where the central ro w of virtual keys have the same width (Δ Yi = Δ Y2 = Δ Y3), a cursor has a path of 'a' -> Y ->'?'. In the case of FIG. 24B-(B) where a central row of virtual keys have larger widt hs, a cursor has the path of 'a' -> 'k' ->'?'. In the case of FIG. 24B-(B), a finger can be more freely moved in a larger vertical range, and there is an advantage of keeping curs or' s trajectory within the middle row.
FIG. 26 is an illustration of operating a phone mode with a cellular phone having
touchpads of FIG. 22 in a vertical mode. FIG. 26A illustrates the cellular phone held in a hand and FIG. 26B illustrates the cellular phone changed to a phone mode. When
FIG. 26 and FIG. 18 are compared, FIG. 18A illustrates a cellular phone in a vertical mo de which is operated in a Ul mode that is a whole area mode, and FIG. 18B illustrates t he cellular phone changed to a phone mode.
A phone mode starts with a whole area mode. Referring to FIGS. 26B-(A) and 26B-(C), when a finger touches a whole area touchpad 2603, the whole mode is operat ed to display a whole area cursor 2602 on a screen. A text input mode is operated wh en a finger touches a text input touchpad 2606, and the cursor 2602 is changed to a tex t input cursor 2605. Referring to FIG. 26C, the whole area cursor and text input cursor are operated in an entire area 2601 and a keypad area 2604, respectively.
Referring to FIG. 26B, an inactive cursor is not shown while an active cursor is s hown. The whole area cursor may be operated by moving the whole area cursor from a position shown in FIG. 26C-(A) to a position in FIG. 26C-(B) where the text input curs or is located in order to select and press ' 5' . That is, the whole area cursor can be used to input letters. However, a touchpad controlling the whole area cursor is differen t from a touchpad in that it is operated in a relative coordinate system which provides si gnal corresponding to a displacement (Δ x, Δ y) while the text input cursor is operated i n the absolute coordinate system. Accordingly, two cursors are used in the phone mode of the present invention. O nly the active cursor may be shown on a screen. Or all the two cursors may be shown b ut operated alternately in a semi-dual cursor method in which active one is distinguishe
d from inactive one by color, shape etc. Although they are operated in different region s and by different touchpads, their functions as pointers are same.
Different brightness or color may be applied to cursors depending on active state s or an inactive cursor may be hidden from the screen in order to avoid user confusion.
When only one touchpad is used in a vertical mode as shown in FIG. 13C-(C), b oth a whole area mode and a text input mode may be switched for the same touchpad by pressing a button having a mode converting function.
FIG. 27 illustrates a coordinate system of the touchpad of FIG. 24 used in a verti cal mode. FIG. 28 is a flowchart of a method of calculating coordinates of a cursor.
Unlike in a horizontal mode, in a vertical mode, a finger sways laterally during a vertical movement. To solve the problem, a region Δ X2 is increased to be larger tha n regions Δ Xi and Δ X3. In this case, even though there is a lateral swaying of a finge r during a vertical movement as shown in FIG. 27B, the actual movement of a cursor is confined in region Δ X2 and a stable input can be done.
FIG. 29 illustrates a method of displaying cursors on a screen by using signals fr om two touchpads according to an embodiment of the present invention.
Each of the touchpads generates data (X, Y), and provides the same to a data pr ocessing apparatus. In a whole area mode, the data processing apparatus calculates the displacement (Δ x, Δ y) of a cursor and moves the cursor on a screen. In the text i nput mode, the data processing apparatus calculates coordinates (x, y) of a text input c ursor and moves the text input cursor.
In the text input mode in the horizontal mode, coordinates (xi, yi) and (X2, y2) of t wo text input cursors are calculated to move the two text input cursors. However, in a text input mode in the vertical mode, only one text input cursor is displayed. A Ul struc ture marked by a right dotted box is realized for a single touchpad system where only o ne touchpad is used.
Likewise, in the case of an electronic dictionary laid down on a flat surface and th en operated as shown in FIG. 19, letters are input by using a virtual keyboard using a U I system of a single touchpad. However, in this case, the Ul structure marked by the ri ght dotted box of FIG. 29 is used in the horizontal mode, not in the vertical mode. Regardless of a cellular phone or an electronic dictionary, since the virtual keybo ard input system according to the present invention inputs letters by using an absolute c oordinate system of a touchpad, the virtual keyboard input system can work as both a c onventional keyboard and a mouse, and can be installed in a small space on a portable electronic device such as a cellular phone or an electronic dictionary. Division regions on the sensor unit 110 may be defined during manufacture or m ay be modified by a user. That is, the center point of contact area between a touchpa d and a finger of a user may be different from a reference point of the touchpad. Accor dingly, the positions of division regions may be modified by reflecting this difference.
FIG. 30 is a view for explaining a method of calibrating the mismatch of the cente r point of contact area between a touchpad and a finger that is placed on a reference p oint of the touchpad and the reference point.
Referring to FIGS. 3OA and 3OB, although a finger (thumb) is placed on a referen
ce point Pk corresponding to ' k' of a virtual keyboard, the center point of the contact area, Pk.cai (X1, Y1), which is calculated by the sensor unit, namely touchpad, is different f rom the reference point Pk (X, Y).
This difference arises due to the procedure to calculate the contact point using a change in electrostatic capacity.
That is, when a touchpad utilizes an electrostatic capacity-based method, a cont act point (not area) is determined by calculating centroids(Xcentroid, Ycentroid) from electros tatic variation curves in X and Y axes, respectively, which result from the contact betwe en a finger and the touchpad. However, since people have different shapes of fingers and the contact area and shape also changes, even when people seem to touch the same point, electrostatic ca pacity curves formed are different depending on people, and accordingly, contact points calculated by a touchpad are different as well.
Accordingly, when coordinates of a cursor is calculated on the basis of the refere nee coordinate system of FIG. 22A and according to the method of FIG. 23, the cursor i s actually placed on a crossing point of Y O1 'k' and 'C ' as shown in FIG. 3OC, and ' k ' may not be input on the contrary to a user' s expectation.
Accordingly, in order to match Pk.cai with the reference point representing ' k' , t he reference coordinate system of the touchpad is moved by the difference (Δ Xk, Δ Yk) between Pk and Pk.cai, a new reference coordinate system (X'-Y1) is set, and Pk.cai mate hes with the reference point representing ' k' .
This method may be applied to just one reference key (division region) and the r
esult is applied to all virtual keys by moving the reference coordinate system according to the initial calibration. Or by calibration procedure may be applied to some keys which may serve as milestone keys with respect to X and Y axes.
As an example, for the calibration with regard to the X axis, the method may be p erformed for keys, "h
1,
1J', 'k', 'έ ', and '?'. The calculated coordinates of the central points for these keys, are used for the calculation Of X
1Ri, X'R2, X'R3, and X
1R
4 shown in FIG. 3 OC and X'RO and X'RS are extrapolated from X'RI and X
1R
4. Likewise, with respect to the Y axis, the method may be performed for keys, T, and ',' and the calculated coordina tes of these key plus Pk.caic. are used in calculating Y'i and Y
!2. Yo and Y
*3 are extrapolat
Another method will be explained with reference to FIG. 3OF. The method sets a region of a touchpad corresponding to each key region on a virtual keyboard in order t 0 match regions of the virtual keyboard with regions of the touchpad because shape of t he finger contacting the touchpad and also the contacting area changes depending on t he location of a key.
When the regions of the touchpad corresponding to the key regions of the virtual keyboard have uniform heights and widths like a checkerboard as shown in FIG. 3OA, t he center of a key of the virtual keyboard and that of corresponding key region of the to uchpad may not be matched. Accordingly, the center of each key of the virtual keyboard is set as shown in FIG
. 3OC, and rectangles formed by drawing horizontal and vertical lines which halves the Ii nes connecting the center point of the key with those of neighboring keys become the k
ey region of the touchpad corresponding to the corresponding key of the virtual keyboar d.
For example, a center point Pj
>caι of a key ' J' is set by the method of FIG. 3OC, center points (P
u,cai, Pk,cai, Pm.cai, Pn.cai) of neighboring keys are set in the same way. A horizontal line (Y = Y'2(uj), Y = Y'-iom))
and a vertical line (X =
X = X'R2GI<)) which hal ve the lines connecting the center point, P, with central points of the neighboring keys a re drawn, and a region 3002 for the key ' J' constructed with these halving lines is de fined on the touchpad.
Δ Y
U2 and
Δ Yj2 are equal in length since they are distances fro m the center of keys 'J
1 and
1U
1 to a horizontal line (Y = Y'2(uj)) which bisects the line con necting these center points.
Likewise, Δ Yji and Δ Ym2, which are distances from the center points of keys 'J' and 'M' to a horizontal line (Y = Y'i(jm)) bisecting the line connecting the central points, a re equal in length. Actually, Δ Yji and Δ Yj2 may be different from each other, and in th is case, a central point Pj of 1J1 may not be the center of the rectangle 3002. For the X axis as in the Y axis, Δ XM and Δ Xji, which are distances between the center points of keys 1H1 and 1J' to a vertical line (X = X'RI^J)) bisecting the line connecti ng the center points, are equal in length. Referring to FIG. 3OG, key regions formed in this way have overlapping regions 3004 and 3005, unlike the checkerboard-like region s of FIG. 3OA. That is, the region 3004 Ovjm is constructed because the key regions fo r ' J' and ' M' overlap, and the region 3005 Ovj is formed because the key regions for ' J' and ' ,' overlap. The overlapping regions 3004 and 3005 are invalid regio ns to which corresponding keys are not assigned and thus the keys are assigned to the
other regions excluding these overlapping regions.
That is, ' J' is input when the center of a finger is located on a rectangle region 3003 which excludes the overlapping regions 3004 and 3005.
A method of calculating coordinates of a cursor in a horizontal mode and a vertic al mode (phone mode) on the basis of a new reference coordinate system (X' -Y' ) is shown in FIGS. 3OD and 3OE.
In FIGS. 3OD and 3OE, an operation which is represented by ' changing an inpu t coordinate system' means the operation changing from a nominal reference coordin ate system (X-Y) of FIG. 3OA to an acting reference coordinate system (X'-Y1) of FIG. 3 OC.
FIG. 31 is a block diagram of a virtual keyboard input system according to anoth er embodiment of the present invention.
The virtual keyboard input system of FIG. 31 is different from the virtual keyboard input system of FIG. 1 in that a sensor unit 3101 acts as a switch unit. That is, the sen sor unit 3101 senses a pressure and determines whether to perform a switch function a ccording to the pressure, thereby making a separate switch unit unnecessary.
Except for the fact that the sensor unit 3101 performs a switch function and thus a switch unit is not necessary, the virtual keyboard input system of FIG. 31 is identical t o the virtual keyboard input system of FIG. 1. Hence the various embodiments derived f or the virtual keyboard input system of FIG. 1 may be applied to the virtual keyboard inp ut system of FIG. 31.
How the sensor unit 3101 performs a switch function will be explained with refere
nce to FIG. 32.
FIG. 32 illustrates three types of pressure change during a contact of a finger wit h the touchpad when a touchpad functions other than a pointing.
In detail, FIG. 32A illustrates a pressure change during a conventional pointing o peration. FIG. 32B illustrates a pressure change during a pressing operation. FIG. 3 2C illustrates a pressure change during a tapping operation.
When a finger applies a pressure to the touchpad, the area of the finger contacti ng the touchpad is increased and the electrostatic capacity of the touchpad is changed. Hence a change in pressure is calculated by using the change in electrostatic capacit y.
Referring to FIG. 32A, when a finger moves on the touchpad for a pointing job, th ere is a small change in pressure. However, referring to FIG. 32B, when a pressing is performed, the pressure is increased to Zp,maχthat is higher than Zt.max (pressure at touc h). Accordingly, if the sensor unit 3101 performs a switch function when the pressur e is higher than a pressing reference pressure Z°pr. the switch unit of FIGS. 2 and 4 whi ch performs a pressing function may not be necessary.
Here, a pressing reference pressure may be a pressure arbitrarily set by a user b etween a minimum pressure Zp,min which is generated when the user presses the touch pad and a touch pressure, so that the sensor unit 1301 can perform a switch function wi th even a minimum pressure Zp,min.
Switch-on time when a switch function is turned on may be determined by a time
point when a measured pressure is greater than a pressing reference pressure, or may be determined by using a pressing threshold pressure Zpr,th that is another constant.
The pressing threshold pressure Zpr,th, which is slightly greater than the touch pre ssure Zt,max, is given by
Zpr.th = Qpr.th (Z°pr - Ztch) + Ztch ... (1 )
where Qpr,th is a proportional constant designated by the user and is in a range of 0.5 < Q < 0.9. Z°pr and Ztch are set during the initialization of the touchpad. Ztch is a maximum t ouch pressure which is measured while a user moves a finger freely over the touchpad, and Z°pr is nominal value which is set slightly lower than a minimum pressing pressure Zp.min measured while the user presses a designed region as usual, preferably, 90 % of Zp,min. But this ratio can be arbitrarily determined by the user so that Z°pr be greater than
A switch-on duration time for which the switch function is turned on may be deter mined by using such a pressing threshold pressure. The switch function may be turne d on at tpr.th- when a pressing pressure reaches a pressing threshold pressure after a pr essing starts, and the switch function may be turned off at tpr,th+ when a pressing pressu re reaches again a pressing threshold pressure after the pressure increases above a pr essing reference pressure Z°pr- The time interval for which the pressure is above the p ressing threshold pressures with its maximum pressure higher than Z°pr may be defined as the actual pressing time Δ tpr.
The reason why both the pressing reference pressure and the pressing threshold pressure are defined is that if only one pressure value is set, lots of force is required to maintain a pressing operation in the case of reference pressure with high value. As a r everse case, if the reference pressure is too low, slight touch may be recognized as a p ressing action and the switching becomes on.
On the contrary, when both the pressing threshold pressure and the pressing ref erence pressure are used as switching criteria, the user needs to apply high pressure fo r a short time in order to maintain a pressing operation, and apply low pressure for the r est of the pressing time, which is a little bit more than the touch pressure(Zt,max) while a switch function should be turned on, thereby preventing the waste of force.
A pressing threshold pressure is also used to correct a text input error which will be explained with reference to FIG. 34 in detail.
In general, a touchpad used in a notebook computer already performs the functio n of a function button by tapping. FIG. 32C illustrates a pressure change when the tou chpad is tapped.
Referring to FIG. 32C, when a maximum pressure generated during a tapping op eration is defined as Ztap, the tapping pressure may be equal to the touch pressure or th e pressing pressure. However, since tapping is recognized not by the magnitude of th e pressure but by touching interval, tapping can be prevented from being recognized as pressing or touching action.
That is, referring to FIG. 32C, when a touch-on duration Δ ttap and a touch-off dur ation Δ toff are repeated within a predetermined time under conditions of Δ t(t)i<Δ t°tap a
nd Δ t(o)i<Δ t°tap for double clicking, where Δ t°tap is a tapping reference time designate d by a user, a tapping function is executed irrespective of a pressing pressure.
When a finger accidentally touches the touchpad, a touch-on duration Δ ttap,2 is Io nger than a tapping reference time Δ t°tap (Δ ttap,2>Δ t°tap) or a touch-off duration Δ tOff,2 i s longer than the tapping reference time (Δ tOff,2>Δ t°tap ), thereby preventing the accide ntal touching from being wrongly recognized as tapping.
Referring to FIG. 32C, when a touch duration Δ ttap,i and a touch duration Δ ttap,2- are consecutive, another switch function may be performed. This is already used in a conventional touchpad that is used as a pointing device and a function button as well by double tapping (clicking).
In this case, although Ztap may be greater or less than Zp,maχ or Zp,maχ, it does not matter. It is important to know whether the touchpad is touched or not by accident or i ntended action on the basis of the duration of touch and touch-off and its change with ti me. That is, if a switch function is defined by setting the ranges of ttap,i, Δ tOff,i, and Δ ttap,2, and checking operation for a tapping is processed before that for pressing, a tappi ng pressure higher than a pressing reference pressure, tapping is not recognized as a p ressing.
When a tapping function is performed by using a change in electrostatic capacity over time in this way, the touchpad can serve as a switch unit, and thus the function b uttons 1201 , 1202, and 1203 of FIG. 12A may not be necessary. If those function butt ons 1201 , 1202, and 1203 are removed, they may be assigned other functions which is
desirable result.
FIG. 33 illustrates touchpads 3301 having a tapping function which replace the fu nction of function buttons of FIG. 32.
Although a tapping function and a pressing function are divided by a touch-off ti me as described above with reference to FIG. 32, when pressing regions 3302 and tap ping regions (S)1 through (S)6 of the touchpads 3301 are mechanically separated, eve n a strong pressure applied during tapping by mistake in longer time than the tapping re ference time, does not cause a pressing state to be on.
Referring to FIG. 33A, since the separate tapping regions (S) 1 , (S)2, (S)3, (S)4, ( S)5, and (S)6 around the pressing regions 3302 are covered with a cellular phone body, the touchpad 3301 is prevented from being pressed during tapping and a tapping oper ation can be freely performed.
As described above, however, pressure duration patterns for tapping and pressin g are theoretically different from each other. Accordingly, without separating the tapping regions (S) 1 , (S)2, (S)3, (S)4, (S)5, a nd (S)6 from the pressing regions 3302, embossed regions as shown in a right touchpa d of FIG. 33B may be expanded to edges of the touchpad, thereby increasing the regio n for each key of the virtual keyboard.
That is, switch regions operated by tapping in a touchpad region may overlap wit h regions for virtual keys.
In this case, each region can be easily perceived and make letter be easily input and tapping regions (S)'2, (S)'4, and (S)'6 may be maintained even though the regions f
or the virtual keys are increased. Furthermore, there is no need to reduce the thicknes s of a part of the phone body corresponding to the tapping regions (S)1 , (S)2, (S)3, (S)4 , (S)5, and (S)6 of FIG. 33-(A).
Even when a switch unit for inputting information corresponding to a selected virt ual key as shown in the above embodiment is disposed separately from the touchpad, if the method of the right touchpad of FIG. 33B is used, some functions can be performe d with only a part of the sensor unit 1301 without using separate hardware.
However, when a separate switch unit for inputting information corresponding to a selected virtual key as shown in the above embodiment is disposed along with the se parate tapping regions (S)1 , (S)2, (S)3, (S)4, (S)5, and (S)6 as shown in FIG. 33A for s ensing contact by using a change in electrostatic capacity, a switching operation can be performed with just a pressing operation at a pressure greater than the pressing refere nee pressure without considering a tapping operation. However, in the case of the righ t touchpad of FIG. 33B, a switching operation must be performed with only an well defin ed pressing operation, which is different from ordinary touch or the like, such as a tappi ng operation in order to distinguish it from the inputting operation of a virtual key.
When a switching is run by measuring a pressing pressure on a touchpad or a to uchscreen which is used as the sensor unit 3301 , the position of finger on the input key may be changed during pressing although the user' s finger contacts a correct position on the touchpad for the key to be input before pressing it.
Besides, even when a pressure switch as shown in FIGS. 2 and 4 is pressed or a separate switch as shown in FIG. 13B is pressed, the contact position of a finger may
be changed due to the movement of the finger around finger' s joints.
A method of correcting an error which may occur like above will now be explaine d with reference to FIG. 34.
FIG. 34 illustrates an error occurring when a touchpad functions as a function but ton on the basis of a pressure change during a pressing operation. A process of placi ng a finger on ' k' of the touchpad and pressing ' k' in order to input ' k' will be e xemplarily explained.
Referring to FIG. 34A, let' s assume a part of the touchpad is divided to X1.5~X
3.5. And the touchpad is pressed when the finger is on the position for key ' k' while t he finger moves from ' j' to ' I' . A pressure change occurring in this process is sh own in FIG. 34B. The most desirable pressure change is shown in FIG. 34B-(A) but ot her pressure changes shown in FIGS. 34B-(B) through (D) may occur.
Referring to FIG. 34B-(D), a pressure is applied while the finger is in the ' k' re gion, but a maximum pressure is reached when the finger is in the ' I' region. Accor dingly, a desired letter to be input by the user may be different from the actually input let ter.
A pressing threshold pressure Zpr,th is introduced to solve this problem. As des cribed already, the pressing threshold pressure Zpr,th may be determined between a pr essing reference pressure Z°pr and a touch pressure Ztch by considering the user' s ha bit.
FIG. 34B illustrates four cases that may occur during a pressing operation. In F IG. 34B, a pressure change is plotted with the X coordinate on the horizontal axis. FIG
. 34B-(A) illustrates the most desirable pressure change. FIG. 34C is a detailed view ill ustrating a pressure change with time(T), Fig.34C-(A) and X coordinate, Fig.34C-(B).
Referring to FIG. 34C-(A), when a pressure is applied with a finger contacting the same position of the touchpad, there is a peak at X2.5 in which case it is not easy to s ee variation of pressure in detail. Referring to FIG. 34C-(B), in which pressure change is plotted with time, pressure begins to be applied at t(X2.5-), reaching its maximum at t(X Pr), and a normal touch pressure Ztch is reached at t(X2.s+).
That is, since there exist two points where the threshold pressure is reached bef ore and after a maximum pressure is reached, the present invention uses this fact to co rrect an error which may occur during an input process. In a desirable pressing proces s, two points Xpr.th-, and Xpr,th+, which are threshold pressure points right before and after XPr, respectively. They are located in the ' k' region (X2<X<X3). However, in the ca se of FIG. 34B-(C), Xpr,th- belongs to the 'k1 region but Xpr,th+ belongs tothe 'I ' region, an d XPr, which determines the region to which the letter to be input is assigned, also is in t he 'e ' region.
Accordingly, in the cases of FIGS. 34B-(C) and 34B-(D), ' I ' is input instead of k' . In order to avoid this error, a letter corresponding to Xpr.th , not a letter corres ponding to Xpr, must be input.
According to the present invention, an error is corrected by determining a pressin g threshold pressure Zpr,th; when a pressing pressure Zpr reaches a pressing reference pressure Z°pr , a letter V(X(Zpr,th-)) corresponding to the pressing threshold pressure Zpr,t h- is compared with a letter V(Z°pr) corresponding to the pressing reference pressure, an
d input V(Zv) if the letters V(X(Zpr,th-)) and V(Z°pr) are the same or otherwise input V(X(
Zpr.th-)).
That is, in any case, since V(X(Zpr,th-)) is input. Accordingly, V(X(Zpr,th-)) is alway s input according to the present invention. Hence, even in the case of pressure variati on shown in FIG. 34B-(D), what is intended to be input by a user can be input.
There seems a problem in that since the averaged pressing pressure is substanti ally reduced, the touch pressure Ztch may exceed pressing threshold pressure Zpr,th. Eve n in this case, if the user has no intention, the touch pressure Ztch may not reach the pre ssing reference pressure Z°pr and an accidental input of letter may not happen. Accordingly, the setting of the pressing threshold pressure reduces the overall te xt input pressure, prevents a text input error during a normal touch operation, and enabl es the intended letter to be accurately input.
When a method of varying the brightness or color of the region of the letter corre sponding to a position indicated by the text input cursor as the text input cursor moves on a virtual keyboard is added to the text input error correction scheme, a user can easi Iy perceive the position of the text input cursor and it can be much easier to input letters . Furthermore, if the region of the letter to be input is changed to another color during th e input action, it will make error correction much easier.
The pressing threshold pressure introduced to accurately input letters can be us ed for another function. That is, the pressing threshold pressure may be used for a se cond additional function of the keyboard.
FIG. 34C-(B) is a detailed view illustrating a pressure change according to a time
and an X coordinate. Referring to FIG. 34C-(B), a letter is input when a pressing pres sure is reduced below a pressing reference pressure and reaches a pressing threshold pressure again (X=Xpr,th+), not when a pressing pressure reaches a pressing reference pressure. This is because when a pressing duration (Δ tpr=t(Xpr,th+)-t(Xpr,th-) in which the pre ssure is kept greater than the pressing reference pressure is longer than a determined pressing reference time Δ t°pr. a space or shift key can be input after a virtual key is inp ut as a second additional function for the virtual keyboard.
For example, referring to FIG. 15B, a shift-key function button needs to be press ed to change a small letter scheme to a capital letter scheme or vice versa. To do the same work, the pressing reference time is defined to a certain value and a pressing pre ssure is maintained more than this time interval, the shift-key function may be performe d. In the same token, Zpr,th- and Zpr,th+ are in charge of a switch-on function and a switch- off function, respectively. Accordingly, when a shift key function is performed according to a pressing durat ion, it is not necessary to press the shift-key function button. However, when second v irtual keys corresponding to capital letters need to be used continuously, it is convenien t to use the function button to operate a caps-lock function.
Also, the function of the caps-lock key may be performed by tapping the tapping regions (S)1 , (S)2, (S)3, (S)4, (S)5, and (S)6 outside the touchpads of FIG. 33A.
Accordingly, when the second virtual keys corresponding to the capital letters ne ed to be used continuously, the shift function may be maintained by using the caps-lock
function button, and when capital letters, such as first letter in a sentence, need to be used occasionally, the shift function may be performed by maintaining a pressing press ure.
How to use the pressing reference time is shown in FIGS. 34C-(B) and 34D-(B). FIG. 34C-(B) illustrates an example where 1K' is input and FIG. 34D-(B) illustrates an e xample that 'k' is input.
That is, in FIGS. 34C-(B) and 34D-(B), a pressing reference time Δ t°pr is gray col ored. Referring to FIG. 34C-(B), a pressing time Δ tpris longer than the pressing refere nee time Δ t°pr (Δ tpr>Δ t°pr) ' K' is to be input. Referring to FIG. 34D-(B), a pressure time Δ tpr is shorter than the pressing reference timeΔ t°pr (Δ tpr<Δ t°pr). ' k' is to be i nput. In either case, what is to be input is the key which represents the key region of the pointer at an initial pressing threshold pressure Zpr,th-
FIG. 35 is a flowchart illustrating the method of correcting letters according to an embodiment of the present invention. Although the function of a text input switch controlled on the basis of the pressur e to a touchpad is explained, the same controlling scheme may be applied to inputting I etters with mechanical switches as shown in FIGS. 2, 4, and 13B.
That is, t(Xpr.th-) and t(Xpr,th+) shown in FIG. 34 correspond to a switch-on time ton and a switch-off Wf , respectively and is utilized in identifying an input letter. That is, if V(Wi) and V(toff) which represent letters when a mechanical switch is turned on and turn ed off, respectively, are the same, V(tOff) is input, and if they are different, V(ton) is input.
Likewise, even when a mechanical pressure switch as shown in FIGS. 2, 4, or 13 B is used, the same text input correction method using a pressing pressure may be app lied. When the mechanical switch is turned on, a pressing pressure should be applied t o the touchpad and pressing threshold pressure time t(Xpr,th ), is earlier than ton which re presents a point of time when the mechanical switch is turned on. Hence V(ton) is replac ed by V(t(Xpr,th-)) in the correction scheme explained above. If V(W) and V(t(Xpr,th-)) are equal to each other, V(tOff) is input and when V(tOff) and V(t(Xpr,th-)) are different from eac h other, V(t(Xpr,th-)) is input. This may be provided as an optional program which is bes t fit to the user' s pressing pattern.
Although the virtual keyboard input system according to the present invention is characterized in that a virtual keyboard based on an absolute coordinate system and a t wo-dimensional pointing device are used to input information of a virtual key assigned t o a division region when a corresponding point is pressed or contacted, the present inv ention is not limited thereto. And it is possible that when a contacting position is moved within a preset time according to a predetermined pattern, a corresponding function or I etter may be programmed to be input.
FIG. 36 is an illustration explaining a method of inputting ' space' and ' backs pace' which are most frequently input in a text input mode.
' space' and ' back space' may be input by selecting a ' space' key on a virtual keyboard by using a switch function, but in the present embodiment, can be input
when a finger is laterally moved over a touchpad in the horizontal direction.
That is, a finger moves laterally during inputting text in general. However, as sh own in FIG. 36A, the movement of a finger which goes fast back and forth or vice versa does not happen except for the cases to deliberately input a special letter or perform a special function as in the present invention.
Accordingly, such a deliberate movement is set in advance and if it is sensed whi Ie a virtual keyboard is used, the corresponding function may be performed or a corresp onding letter may be input. This will help inputting work become easy.
Since a thumb operating a left touchpad is usually positioned to the right side fro m the center of the touchpad, a movement of rig ht->left-> right is convenient, and since a thumb operating a right touchpad is usually positioned to the left side from the center, a movement of left->right->left is convenient. Accordingly, when a space function and a back space function are defined on the basis of this movement scheme, letters can b e easily input. For this, a data processing unit as shown in FIG. 29 stores points of time when t he reference coordinates Xi, X2, X3, X4, and Xsare passed and executes a space or a b ack space function when the trajectory of finger' s movement matches those paths sho wn in FIGS. 36C and 36D.
Paths (D, (D, and ® may be followed for actually inputting letters. However, alt hough a finger follows those paths, the space or back space function is executed only w hen time segment Δ ti, Δ t.2, and Δ t.3 during which a finger follows the paths ©, (D, and (D are less than the preset time tspace in order to distinguish an intended movement of a
finger to input a space or a back space from ordinary movement of a finger on the touch pad. One of Δ ti, Δ t.2, and Δ t3 may be selected according to a user' s input pattern o r convenience.
For a function which is performed when a preset patterned movement is observe d within a preset time, a movement pattern, a time, an assigned function, and the like m ay be set by the user in advance.
FIG. 37 is a flowchart illustrating the method of initializing a touchpad which will p erform the function of a function button. A maximum touch pressure, which is determi ned by a contact area between a finger and a touchpad is first set for the user since the size of a finger is different for a different user and then a pressing reference pressure and a pressing threshold pressure are sequentially set.
Thereafter, a touch-off time for performing the function of a function button by tap ping is set. Then a touchpad coordinate system explained with reference to FIG. 30 is s et in a horizontal mode and a vertical mode to define a new coordinate (X'-Y1) which will be used in calculation of coordinates of a cursor in a text input mode.
The pressing reference pressure and the pressing threshold pressure may be se t according to the position on the touchpad.
FIG. 38 illustrates contact areas between a finger and a touchpad which varies d epending on positions of the finger on the touchpad. When a user is right-handed and presses left upper region of the touchpad as sh own in FIG. 38-(I), the entire area of the thumb is used, but when the user presses a rig ht lower region as shown in FIG. 38-(IV), a contact area is smaller than that for the case
of FIG. 38-(I) since the thumb is raised and pressed.
Since the electrostatic capacity of the touchpad used to calculate a contact occur rence and magnitude of pressure increases in proportion to an area, even when the use r presses the touchpad with the same force as in the case of FIG. 38, the electrostatic c apacity of the left upper end of the touchpad is higher than that of the right lower end of the touchpad.
Accordingly, when a pressing reference pressure and a pressing threshold press ure have a constant value for all the area of the touchpad, a switch function may not be performed although the user presses the touchapd with the same force. On the contrary, even when the user slightly touches the touchpad, the touchpad may sense that the user presses the touchpad.
FIG. 39 is a three-dimensional graph illustrating a contact pressure calculated by a touchpad at each position when an internal region of 4cm*2cm of a touchpad of 6.5c m*4cm is touched by a finger (thumb) as shown in FIG. 38. FIG. 39-(A) is a view seen at an angle of 25 degrees from the xy plane. FIG. 39-(A' ) is a view seen at an angl e of 7 degrees from the xy plane.
FIG. 39-(B) and FIG. 39-(B' ) are views seen after the views of FIGS. 39-(A) an d 39-(A' ) are rotated by 180 degrees about a z axis. In order to display pressures by colors, a colored bar graph is shown on the right side. In each graph, Sp denotes a contour surface of a pressure value Z obtained whe n the touchapd is pressed, and St denotes a contour surface of a pressure value obtain ed when the touchpad is touched. For reference, a Z plane is denoted by Sc correspo
nding to a maximum touch pressure in order to show a relationship between the two co ntour surfaces Spand St.
Referring to FIG. 39, since the electrostatic capacity of the touchpad when a righ t lower surface is pressed is less than the electrostatic capacity of the touchpad when a left upper surface is contacted, inconvenience may be caused when the same pressing reference pressure is set for the whole area of the touchpad.
To solve the problem, a pressing reference pressure may be set for each point o n the touchpad.
In detail, in a configuration for the right-handed, the pressing reference pressure of the left upper region may be set to be higher than that for the right lower surface, and in a configuration for the left-handed, a pressing reference pressure of a left lower regi on may be set to be lower than that for the right upper region of the touchpad.
Such a pressing reference pressure may be set as a default by a manufacture d uring production, or may be set by a user after purchase. FIG. 40 is a flowchart illustrating a method of setting a pressing reference pressu re.
All keys may be pressed and a coordinate system X'-Y' may be automatically set at the same time as the pressing reference pressure for each key is set, or each settin g may be independently performed as shown in FIG. 40. Referring to FIG. 40, after a pressing reference pressure and the input reference coordinate system is set, the tapping reference time may be set.
This step is performed when a new function needs to be added by using tapping.
Since a tapping pattern may be different depending on a user, once the tapping refer ence time is set in the initialization step, many functions can be performed by tapping, a nd thus the number of function buttons of a portable digital device can be reduced and ultimately all function buttons may be not be installed. Accordingly, the space occupie d by the function buttons can be saved for other elements like display screen, thereby making it possible to increase the size of display screen.
Although it has been explained that the division regions of the touchpad for the k eys of the virtual keyboard are fixedly set, they don' t have to be fixed. Rather the area s of the division regions may be changed if necessary. For example, while key regions constituting a virtual keyboard have uniform area s in inactive states, a key region activated by contact with a finger may be expanded to stably input letters, which is shown in FIG. 41.
FIG. 41 illustrates a method of defining each key region of a virtual keyboard. Alt hough all regions have uniform area in inactive states, the region corresponding the acti vated key is expanded when a finger contacts the area for the key.
That is, all regions have the uniform area 4101. When the center of a finger co ntacts a key 4102, the key 4102 is activated, and the region 4101 corresponding to the activated key 4102 is expanded to include part of the area for neighboring keys.
That is, it is not simply showing the enlarged key region of the virtual keyboard o n a screen, but it is expanding the area of the division region on a sensor unit to which a virtual key is assigned.
Accordingly, the active key region on the touchpad or touchscreen can be enlarg
ed and a finger can be more freely moved in a larger space for the key. In particular, e ven when a finger is located at a border with adjacent keys, the adjacent keys are not e asily activated and a selected active key can be stably maintained and a designated lett er can be input. Also, there is an advantage that change of the contact point which may result in i nputting a letter different from what was initially selected to be input by himself/herself c an be prevented when a user touches and presses the touchpad for the selected letter on a virtual keyboard to be input, .
That is, referring to FIG. 411, when a finger is located on a point 'PKL' 4103 that is on the border line LKL 4104 between keys 'K' and 1L', although the key ' K' is present Iy activated, ' L' may be input instead of ' K' with a slight movement of the finger a cross the border line LKL 4104 which changes the activated key to ' L' from ' K' if t here is no expansion of the area for the activated key.
On the contrary, referring to FIG. 41 II, when a finger is located on the point 'PKL 4103 and the key ' K' is activated, since the area on the touchpad for activated key ' K' is actually expanded, a new border line L"KL 4104K is formed. Since an expand ed region 4105 should be passed in order to activate the key 'L', an accidental activatio n of an adjacent key due to a slight movement of a finger as shown in FIG. 411 can be p revented. Likewise, when the key 1L' is activated, a new border line L'KL 4104L is formed an d the key 1K' is deactivated. Such an expanded region enables an activated key to be stably input, but when the expanded region is too large, it may be difficult to select an a
djacent key. Accordingly, it is preferable that the expanded region should not exceed t he center of an adjacent key region. That is, it is preferable that an expansion ratio be less than 2.
The present invention may be embodied as computer-readable codes on a comp uter-readable recording medium. The computer-readable recording medium is any dat a storage device that can store data which can be thereafter read by a computer syste m. Examples of the computer-readable recording medium include read-only memories (ROMs), random-access memories (RAMs), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer-readable recording medium can also be distributed over netw ork coupled computer systems so that the computer readable code is stored and execut ed in a distributed fashion.