WO2001079978A1

WO2001079978A1 - Method and apparatus for entry of multi-stroke characters

Info

Publication number: WO2001079978A1
Application number: PCT/US2000/012234
Authority: WO
Inventors: Jason B. Kenagy
Original assignee: Qualcomm Incorporated
Priority date: 2000-04-13
Filing date: 2000-05-05
Publication date: 2001-10-25
Also published as: EP1272918A1; JP4541629B2; CA2406116C; CA2406116A1; AU2000248211A1; KR100761606B1; KR20020087978A; JP2004501422A; CN1454343A

Abstract

An apparatus for receiving sets of direction codes via an input device (130) and converting said direction codes into a corresponding character. A user operates an input device (130) configured to generate direction codes representative of elemental strokes used in the formation of a character. A processor (110) receives the direction codes and converts them to standard characters such as letters, numbers or punctuation. The conversion may be accomplished via a database (120) such as a lookup table, decision tree or other data structure. The apparatus includes a display (140) for displaying the standard character to the user. A corresponding method is also described.

Description

METHOD AND APPARATUS FOR ENTRY OF MULTI-STROKE

CHARACTERS

BACKGROUND OF THE INVENTION

I. Field of the Invention

This invention relates to symbol entry. Specifically, this invention relates to the entry of multi-stroke symbols or written language characters into an electronic device.

II. Description of Related Art and General Background

Recent advances in technology and design have enabled the production of handheld electronic devices (including cellular telephones and portable digital assistants or 'PDAs') that have unprecedented capabilities for storage, processing, and/or communications. Such devices can perform data storing functions, retaining quantities of organized textual information such as names, street addresses, e-mail addresses, telephone numbers, and facsimile numbers for business and/or personal contacts. Data access functions may then be performed to retrieve and display selected portions of this information for its own sake or, alternatively, such portions may be retrieved in order to serve as parameters to other device functions such as e-mail, telephone, or fax communications .

In using a device such as a laptop or desktop computer, information may easily be stored or retrieved by entering text via the typing keyboard. The portability and miniaturization associated with handheld devices, however, leave no room for a typing keyboard, and other methods are required with such devices to support entering text or entering search parameters for retrieving text.

One option is to adapt an existing user interface such as the standard twelve-button telephone keypad (i.e. the digits 0-9 and the characters '#' and '*') for character entry. In this method, the twenty-six letters of the Roman alphabet are mapped to selected keys (as shown in FIG. 1). This method is an unnatural way to enter textual information, however, in part because the mapping must be plural-to-one. In order to enter a single instance of the letter 'C, for example, the user must press the '2' key three times. Such a method is also slow, as the user must observe pauses between keypresses in order to indicate character boundaries (e.g. to distinguish two instances of the letter 'A' from one instance of the letter 'B'). In some cases, character disambiguation processing may be used to reduce the required number of keypresses to some extent. In United States Patent No. 5,818,437, Grover et al. describe a computer that uses a dictionary to map sequences of keypresses to corresponding words on a one-to-one keypress- to-letter basis. Unfortunately, some sequences may correspond to more than one word or string, requiring the user to perform additional actions in order to resolve the ambiguity. In the described device, for example, the sequence '1226' corresponds at least to the strings 'FOOD', 'GOOD', and '1226'. Also, entry becomes more difficult for words that are not already represented in the computer's dictionary. In such cases, this method requires multiple and unfamiliar actions to enter characters. In one described embodiment, for example, each key is mapped to nine symbols, and at least two keypresses are required to select any desired symbol.

Moreover, such methods are unsuitable for languages that have alphabets or character sets of more than about thirty characters, as the number of keys required (and /or the number of characters mapped to a given key) would become too high for practical use. For languages having thousands of characters such as written Chinese or Japanese kanji, any method that relies on character-to-key mapping may be completely unworkable. Another option is entry of textual characters by the use of single, unbroken strokes called 'unistrokes.' In United States Patent No. 5,596,656, Goldberg describes a method for using a stylus on a suitable writing surface to enter unistrokes, where each unistroke represents a letter of the Roman alphabet, a digit, or a punctuation symbol. As this method is strictly limited to one-stroke entry, however, it requires the user to learn a new writing alphabet, many of whose characters bear little to no resemblance to the characters they represent. The unistroke corresponding to the letter 'E', for example, is a single stroke from right to left, while the unistroke corresponding to the letter 'R' is a single straight stroke from upper left to lower right. The unistroke method may be also unsuitable for languages that include more characters than may conveniently be represented by such an artifice.

Moreover, the unistroke method requires a stylus. On one hand, the stylus may become lost or broken. On the other hand, the stylus may be inconvenient to use in a situation where the user has only one hand free and must use it to hold the device. Additionally, the writing surface required to support such a method consumes a significant portion of the area of the face of the device. Finally, any combination of a stylus and a writing surface that supports such a method will also add considerably to the cost of the device. SUMMARY OF THE INVENTION

Sets of direction codes are received from an input device. Each direction code relates to one among a predetermined number of directions in a drawing plane, and each set of direction codes relates to a stroke. A character comprising the strokes is displayed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a conventional mapping of the letters of the Roman alphabet to keys of a 12-button keypad.

FIG. 2 shows a mapping of elemental strokes and an EOC delimiter to keys. FIG. 3 shows another mapping of elemental strokes and an EOC delimiter to keys.

FIG. 4 shows a further mapping of elemental strokes and an EOC delimiter to keys.

FIG. 5 shows a mapping of elemental strokes and an EOC delimiter to positions of a 4-way-plus-select input device.

FIG. 6 shows a flowchart of a method according to an embodiment of the invention.

FIG. 7 is a block diagram of an apparatus according to an embodiment of the invention. FIG. 8 shows an example of a character having modified strokes.

FIG. 9A shows two possible stroke combinations for the letter 'A'.

FIG. 9B shows three possible stroke combinations for the letter 'V.

FIG. 10 shows a four-way-plus-select rocker switch assembly.

FIG. 11 shows a four-way-plus-select pogo pin. FIG. 12 shows an eight-way-plus-select rocker switch assembly.

FIG. 13 shows an eight-way-plus-select pogo pin.

FIG. 14 shows a flowchart of a method according to another embodiment of the invention.

FIG. 15A shows points of a 3 x 3 bounding box array. FIG. 15B shows points of a 3 x 5 and a 5 x 7 matrix array.

FIG. 16 shows one example of a stroke.

FIG. 17 shows a flowchart of a method according to a further embodiment of the invention. DETAILED DESCRIPTION OF THE INVENTION

In a method according to an embodiment of the invention, each among a set of elemental character strokes is associated with a key of a keypad. FIG. 2 shows one example of a set of elemental strokes (comprising a horizontal stroke, a vertical stroke, an ascending (from left to right) diagonal stroke, a descending diagonal stroke, a curve stroke, and a point or accent stroke) and an end-of-character (EOC) delimiter that are mapped to a keypad (or to a portion of a larger keypad).

Although the example shown in FIG. 2 uses seven keys, a set that requires fewer keys may be obtained, e.g., by combining the two diagonal strokes into one element (e.g. as in the six-key mapping of FIG. 3), deleting the point or accent element, using a pause of predetermined minimum duration between keystrokes rather than a keypress to indicate EOC delimiting, etc. Likewise, a set that requires more keys may be obtained, e.g., by including a shift key to indicate whether an upper case or a lower case character is being entered, by dividing one or more elemental strokes into a long stroke and a short stroke, by distinguishing loop strokes from circular strokes (as in the eight-key mapping of FIG. 4), etc. FIG. 5 shows a mapping of four elements plus an EOC delimiter onto the positions of a four-way-plus-select rocker switch assembly. With this assembly, pressing one of the four tabs indicates entry of the corresponding element, and pressing the middle of the assembly (i.e. choosing the select action) indicates entry of the EOC delimiter. A similar mapping may be used with a four-way-plus-select pogo stick or pogo pin (as shown in top and side views in FIG. 11).

FIG. 6 shows a flowchart of a method according to an embodiment of the invention. In task PI 10, entry of an elemental stroke or EOC delimiter (i.e. via a keypress or similar action as described above) is received by the device. In task P120, the combination of strokes that has been entered for the current character is used to reference an internal database which maps combinations of strokes to characters. The database may be arranged as a lookup table, as a decision tree, or as another data structure known in the art.

If the combination does not appear in the database, then an error is indicated in task P130 (e.g. via an audible beep and/or a visible indication on a display), the stroke is canceled, and task PI 10 is repeated. If the combination is valid (i.e. it appears in the database as at least a part of a mapped combination), then in task P140 the action entered in task P110 is compared to the EOC delimiter. Echo of the entered stroke to a display may occur upon entry in task P110, or echo may be suppressed until the validation of task P130 is completed such that only strokes of valid combinations are displayed.

If a match is not detected in task P140, then entry of the next action continues in task P110. If task P140 detects a match, however (i.e. the user has indicated the end of the character), then the characters to which the entered combination is mapped are displayed for selection by the user in task P150. In one example, these characters are arranged on a display in the same configuration as the keys or positions of the input device, enabling the user to easily select the desired character by choosing the corresponding key or position. A scroll function may be provided in cases where the entered combination is mapped to more characters than may be displayed at one time. Audible feedback may also be provided to indicate that entry of a character has been successfully completed. If the number of remaining possible character matches is reduced to a point where all may be conveniently displayed together, then these remaining characters may be arranged on the display in the same configuration as the keys or positions of the input device, enabling the user to easily select the desired character by choosing the corresponding key or position before the EOC action is performed. In a similar extension, a dictionary of words may be added to a method or apparatus according to an embodiment of the invention such that the number of remaining possible word matches may be displayed for selection.

FIG. 7 is a block diagram of an apparatus according to an embodiment of the invention. Input device 130 may be a keypad, rocker switch assembly, or pogo pin as described above. Display 140 may be a liquid crystal or other type of flat panel display suitable for a portable device. As noted above, database 120 contains mappings of stroke combinations to characters and may be arranged as a lookup table, decision tree, or other data structure as known in the art. Processor 110 executes instructions to perform the tasks described herein. These instructions may be stored or loaded from a storage element (not shown) such as a semiconductor memory, magnetic medium, or other storage device as known in the art. Processor 110 may comprise one or more microprocessors, digital processing units, or other arrays of logic elements programmable to execute instructions. For applications relating to an alphabet that has upper and lower cases, recognition support may be limited to characters of a particular case (e.g. the database may contain only mappings to capital letters). In a implementation that supports recognition of both upper- and lower-case characters, a shift key may be included to facilitate disambiguation between letters of different cases (e.g. between upper and lower case 'O', or between upper case 'D' and lower case 'b' or 'p'). Such disambiguation may reduce the number of keystrokes which the user is required to enter by, for example, reducing the number of characters displayed in task P150. In one such implementation, the shift key may be pressed before character entry begins. In an alternative implementation, the shift key may be pressed and held while the strokes of the character are entered, in which case the shift key may be placed on the side of the device for greater ease of use. While characters of the Roman alphabet contain only a few strokes that may be drawn in any order, the characters of east Asian written languages such as Chinese may contain many strokes that are drawn in a sequence strictly determined by convention. For such applications, character disambiguation may also be facilitated by accounting for the sequential order in which the strokes of a character are entered. For example, such disambiguation may be supported by configuring the decision structure of the database to take sequence into account. For the example of a lookup table, this configuration may entail reducing the number of valid stroke combinations. For the example of a decision tree, this configuration may entail reducing the number of edges between nodes.

Even in applications relating to alphabets whose stroke order is less strictly defined, sequential information may be useful to disambiguation, as it may not be necessary and /or desirable to support stroke orders that are unlikely to appear except in error. In the Roman alphabet, for example, no characters would usually be drawn by beginning with a horizontal stroke followed by a curve or loop stroke.

In some written languages, the manner in which a stroke is terminated may also convey distinguishing information about the character. FIG. 8 shows the example of the Japanese hiragana character 'ka', in which the ends of the first and third strokes are modified as compared to the end of the second stroke. In a method according to a further embodiment of the invention, a user action (e.g. a particular keypress or position selection) is mapped to indicate a modification of the last stroke entered.

An apparatus according to an embodiment of the invention may permit several different combinations of strokes to be mapped to a single character. For example, the letter 'A' may be entered with three or four strokes (as in FIG. 9A); the letter 'V may be entered as any of three different two-stroke combinations (as in FIG. 9B); and the letter ']' may be entered as a vertical and a horizontal stroke, as a vertical stroke and a curve stroke, or simply as a curve stroke. While a device incorporating an embodiment of the invention may be shipped to recognize all such combinations as valid, convenience of use may be increased by allowing the user to personalize the device by programming it to accept only one of the possible compositions for a particular letter. Alternatively, the device may be configured to learn the particular combinations that the user prefers, thereby reducing the number of keystrokes that the user may be required to enter.

Apart from the number of keystrokes involved, note that a method or apparatus according to a described embodiment of the invention provides a natural and familiar interface to the user. For example, such an interface is more similar to the task of writing the strokes of a character than the conventional method of selecting a letter by pressing an assigned key a predetermined number of times. In a method according to an alternative embodiment of the invention, strokes of a character are formed by user manipulation of an input device. The input device may be a 4-way-plus-select device such as a rocker switch (as shown in FIG. 10) or a 'pogo stick' or 'pogo pin' (as shown in side and top views in FIG. 11). With such a device, the four ways of movement indicate two orthogonal directions in a drawing plane and their inverses, and the select action is used to indicate whether the drawing pen is up (i.e. possibly moving but not drawing) or down (i.e. drawing a stroke as it moves). An EOC indication may be supported by a dedicated button or by a predetermined action (e.g. a quick toggle of the select action at the center detent position). Alternatively, the input device may be an 8-way-plus-select device such as the rocker switch shown in FIG. 12 or the pogo stick shown in FIG. 13. As shown in these figures, the eight ways of movement indicate two pairs of orthogonal directions in a drawing plane and their inverses, one pair being oriented at a forty-five-degree angle to the other. Again, the select action is used to indicate whether the drawing pen is up or down. In another alternative implementation, the input device may be a joystick with select action capability or a trackball with an associated button or other select action capability.

FIG. 14 shows a flowchart for a method according to an embodiment of the invention. In task P210, information establishing a starting position for the stroke is received from the input device. This information is created by user manipulation of the input device, and it relates to a position from which to begin drawing the stroke. The starting position may be a point in a bounding box array (a 3 x 3 example of such an array is shown in FIG. 15A, although an array of any other size may be used). Alternatively, the position may be a point in a matrix array (3 x 5 and 5 x 7 examples are shown in FIG. 15B, although arrays of any other size may be used). It may be desirable for the size of the particular array used to correspond to the grid of the display. In task P220, an indication is received that drawing of the stroke is to begin, as if a pen were placed on the paper at the starting position (e.g. the pogo pin or rocker switch assembly is depressed). In task P230, a set of direction codes is received as the user draws the stroke. This set may be configured as a string of codes indicating movements in each direction. For a stroke drawn as shown in FIG. 16, for example, where the 'up' direction is denoted as A and the direction orthogonal to the 'up' direction and to the right is denoted as B, the string of codes may appear as (+A, +A, +B, -A, -A). Two alternative representations are (+2A, +1B, -2A) and (2(+A), 1(+B), 2(-A)).

In addition to or in the alternative to a distance in space, a direction code may represent a relative duration in time of a movement in a particular direction. In such a case, it is not necessary for the direction codes as received from the input device to be related to a bounding box or matrix array, although it may be desirable to normalize them to such an array for display purposes. A reference clock may be used to quantify the duration of such movements. Audible feedback may be provided at each clock tick during stroke drawing, and the speed of the clock may be adjustable by the user. (Note that this clock may also be used to support a EOC timeout function in place of or in addition to a dedicated EOC delimiter action.) A string of codes entered in such an implementation for the stroke of FIG. 16 might appear as (+18A, +7B, -23A), for example, which string might be normalized to (+2A, +1B, -2A) for display and /or further processing.

In task P240, a pen-up indication is received from the input device, signaling that stroke entry is completed. In task P250, if the next signal received from the input device is not an EOC delimiter, then the input is interpreted in task P210 as a starting position for the next stroke in the character (in an alternative implementation, the test of task P250 may be executed as the first step in the loop).

Note that in the method of FIG. 14, the user enters a character in a form as it normally appears. In other words, entry of an instantly recognizable character is achieved, and it is not necessary in such an embodiment to provide recognition support in order to complete the task of character entry into the device. In a method according to another embodiment of the invention as shown in FIG. 17, recognition of the entered stroke combination as a character is performed. Such a method may output the recognized character in 7- or 8-bit ASCII code, in Unicode, or in a similar standard encoding for textual characters. Tasks P310 through P340 of this method are analogous to tasks P210 through P240 as described above.

An apparatus to execute the method of FIG. 17 includes a database that maps combinations of elemental strokes to characters, as described above. In task P350, the received set of direction codes is compared to a set of elemental strokes. Each stroke in this set may be represented as a set of direction codes, or the received set of direction codes may be mapped to an elemental stroke form before the comparison.

If the received set of direction codes is determined to correspond to one among the set of elemental strokes, then the test of task P360 passes. Otherwise, the received set is rejected in task P390 and the stroke is canceled. An audible and/or visual indication of the error may also be produced. Tasks P370, P380, P400, and P410 may be performed analogously to tasks P120, P140, P130, and P150 in the method of FIG. 6 described above.

As noted above, the sequence in which the strokes of a character are entered may be incorporated in the recognition decision. Other information that may be received from the input device and incorporated in that decision includes stroke direction and relative speed of a stroke or of different portions of a stroke.

Additionally, information relating to the relative positions of strokes within a character may be used for disambiguation. For example, the position of the loop in relation to the downstroke may be used to distinguish a capital 'P' from a lower-case 'b'. Disambiguation may also include ignoring unimportant spatial relations between strokes. A capital 'H' may be recognized, for example, regardless of the distance between the downstrokes and /or whether the cross- stroke actually meets both downstrokes.

In a further embodiment, no stroke characterization (as in task P350) need be performed. In this case, the pattern of entered strokes (e.g. as determined by the bounding box or matrix array points which are crossed in drawing the character) may be recognized by a database (e.g. configured as a decision tree) upon receiving the EOC indication, without reference to individual strokes.

Additional features may be provided in the input device for tactile feedback and ease of use. For example, the input device may provide a discernible click at corner and/or edge positions to clearly indicate a current position to the user. Additionally, the handle of a pogo pin or joystick may be extensible to provide greater resolution and control. In such case, it may be desirable to provide a locking mechanism for the extended handle in order to continue the availability of the up-down select action.

The foregoing presentation of the described embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments are possible, and the generic principles presented herein may be applied to other embodiments as well. For example, the invention may be implemented in part or in whole as a hard- wired circuit, as a circuit configuration fabricated into an application-specific integrated circuit, or as a firmware program loaded into non-volatile storage or a software program loaded from or into a data storage medium as machine- readable code, such code being instructions executable by an array of logic elements such as a microprocessor or other digital signal processing unit. Thus, the present invention is not intended to be limited to the embodiments shown above but rather is to be accorded the widest scope consistent with the principles and novel features disclosed in any fashion herein.

What is claimed is:

Claims

1. A method comprising: receiving a first set of direction codes from an input device; receiving a second set of direction codes from the input device; and displaying a character, said character comprising at least a first stroke and a second stroke, wherein each among said first set of direction codes relates to one among first through fourth directions in a drawing plane, and wherein said first direction is orthogonal to said second direction, said third direction is orthogonal to said fourth direction, and said third direction is oriented at an angle of forty-five degrees with respect to said first direction, and wherein each among said second set of direction codes relates to one among said first through fourth directions, and wherein said first set of direction codes relates to said first stroke and said second set of direction codes relates to said second stroke.

2. The method of claim 1, wherein said input device is an eight-way- plus-select device.

3. The method of claim 1, wherein each among said first set of direction codes relates to one among said first and second directions, and wherein each among said second set of direction codes relates to one among said first and second directions.

4. The method of claim 3, wherein said input device is a four-way-plus- select device.

5. The method of claim 1, said method further comprising: obtaining said first stroke from said first set of direction codes; and obtaining said second stroke from said second set of direction codes, wherein a set of elemental strokes comprises said first and second strokes, and wherein said obtaining said first stroke comprises comparing information based at least in part on said first set of direction codes to at least one among the set of elemental strokes, and wherein said obtaining said second stroke comprises comparing information based at least in part on said second set of direction codes to at least one among the set of elemental strokes.

6. The method of claim 5, wherein a character set comprises a plurality of characters, and wherein said character is selected from said character set based at least in part on information relating to said first set of direction codes and said second set of direction codes.

7. A data storage medium having instructions, said instructions being executable by an array of logic elements, said instructions defining a method comprising: receiving a first set of direction codes from an input device; receiving a second set of direction codes from the input device; and displaying a character, said character comprising at least a first stroke and a second stroke, wherein each among said first set of direction codes relates to one among first through fourth directions in a drawing plane, and wherein said first direction is orthogonal to said second direction, said third direction is orthogonal to said fourth direction, and said third direction is oriented at an angle of forty-five degrees with respect to said first direction, and wherein each among said second set of direction codes relates to one among said first through fourth directions, and wherein said first set of direction codes relates to said first stroke and said second set of direction codes relates to said second stroke.

8. The medium of claim 7, wherein said input device is an eight-way- plus-select device.

9. The medium of claim 7, wherein each among said first set of direction codes relates to one among said first and second directions, and wherein each among said second set of direction codes relates to one among said first and second directions.

10. The medium of claim 9, wherein said input device is a four-way-plus- select device.

11. The medium of claim 7, said method further comprising: obtaining said first stroke from said first set of direction codes; and obtaining said second stroke from said second set of direction codes, wherein a set of elemental strokes comprises said first and second strokes, and wherein said obtaining said first stroke comprises comparing information based at least in part on said first set of direction codes to at least one among the set of elemental strokes, and wherein said obtaining said second stroke comprises comparing information based at least in part on said second set of direction codes to at least one among the set of elemental strokes.

12. The medium of claim 11, wherein a character set comprises a plurality of characters, and wherein said character is selected from said character set based at least in part on information relating to said first set of direction codes and said second set of direction codes.

13. An apparatus comprising: a processor; an input device; and a display; wherein said processor receives a first set of direction codes from the input device, and wherein said processor receives a second set of direction codes from the input device, and wherein said processor causes said display to display a character, said character comprising at least a first stroke and a second stroke, wherein each among said first set of direction codes relates to one among first through fourth directions in a drawing plane, and wherein said first direction is orthogonal to said second direction, said third direction is orthogonal to said fourth direction, and said third direction is oriented at an angle of forty-five degrees with respect to said first direction, and wherein each among said second set of direction codes relates to one among said first through fourth directions, and wherein said first set of direction codes relates to said first stroke and said second set of direction codes relates to said second stroke.

14. The apparatus of claim 13, wherein said input device is an eight-way- plus-select device.

15. The apparatus of claim 13, wherein each among said first set of direction codes relates to one among said first and second directions, and wherein each among said second set of direction codes relates to one among said first and second directions.

16. The apparatus of claim 15, wherein said input device is a four-way- plus-select device.

17. The apparatus of claim 1, said apparatus further comprising a database, wherein a set of elemental strokes comprises said first and second strokes, and wherein said database comprises mappings, and wherein each mapping associates a combination of elemental strokes to one among a set of characters.