WO1994010678A1 - Data input system for pen-based computers - Google Patents

Data input system for pen-based computers Download PDF

Info

Publication number
WO1994010678A1
WO1994010678A1 PCT/US1993/010587 US9310587W WO9410678A1 WO 1994010678 A1 WO1994010678 A1 WO 1994010678A1 US 9310587 W US9310587 W US 9310587W WO 9410678 A1 WO9410678 A1 WO 9410678A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
ink
field
ink input
data
Prior art date
Application number
PCT/US1993/010587
Other languages
French (fr)
Inventor
Jeffrey C. Hawkins
Original Assignee
Palm Computing, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Palm Computing, Inc. filed Critical Palm Computing, Inc.
Publication of WO1994010678A1 publication Critical patent/WO1994010678A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • This invention relates to computers, and more particular, to a data input system for pen-based portable computers.
  • FIGURE 1 An example of a prior art pen-based hand-held computer is shown in FIGURE 1.
  • the illustrated hand-held computer 1 is typically about 4 inches by 6.5 inches, with the majority of one surface comprising a touch-sensitive display screen 2.
  • the display screen 2 is typically a liquid crystal display (LCD) having a resolution of 240x320 pixels or greater (although larger or smaller pixel arrays could be used).
  • LCD liquid crystal display
  • Various technologies can be used to sense the location of a pen or stylus 3 touched against the surface of the LCD screen 2 to indicate to the computer's operating system the X-Y coordinates of the touch.
  • Such a computer may be provided with an option slot 4, which may be, for example, a PCMCIA-compliant adapter slot.
  • buttons 5 may be provided to control different functions, and/or to turn power on or off to the unit.
  • buttons or icons 6 may be provided, in known fashion, to indicate such functions as, for example, word processing or a delete ("trash can") function.
  • Computer-generated information is typically shown on the display screen 2 as ASCII characters 7. Data input is typically received and/or displayed in specific fields 8.
  • a common characteristic of such pen-based computers is the use of character recognition software to convert "ink” characters input by a user into computer readable text, such as ASCII characters.
  • "Ink” comprises a series or trail of pixels changed (e.g., darkened or lightened) as a pen 3 is moved across the display screen 2 by a user, thus mimicking the application of real ink to paper.
  • One such character recognition system is described in U.S. Patent No. 5,125,039, entitled “Object Recognition System", by the inventor of the present invention.
  • the computer applies special algorithms to recognize each character as an ASCII character, and replaces the ink representation of the character drawn by the user with a standardized ASCII representation of that character.
  • unrecognized ink is very fast and easy to input, it is less useful than ink that has been recognized as text. Because unrecognized graphical ink input is unstructured and has no meaning or associations to the computer, the computer cannot perform searches on or use ink data types in intelligent ways. Thus, later use of such input is severely restricted. To overcome this significant limitation, some computer designs allow the user to assign key words to a block of ink input. This requires extra steps by the user in anticipation of future needs, and has limited utility.
  • a hand-held comput ⁇ er might have a display measuring only about 2Vz by 3 inches.
  • the present invention provides such a method.
  • the present invention comprises a data input system ideally suited for pen-based portable computers having a limited writing area.
  • a hand-held computer using the invention permits a user to select a pre-defined data display field, whereupon an enlarged ink input field is displayed to the user.
  • the computer accepts ink input from the user into the enlarged ink input field.
  • the enlarged ink input field may be scrollable, automatically or manually, to present additional "blank" writing area to the user.
  • the user has the option of selecting whether the ink input is to be saved as an ink data type, or recognized and converted to text characters. If the user accepts the ink input as an ink data type, then the computer shrinks (reduces) the ink input to fit within the original data display field and displays the reduced ink input in the original data display field.
  • the ink is reduced sufficiently (typically 2:1) to fit within the width of the original data display field, and the height of the data display field is automatically resized to accommodate all of the ink that was entered in the enlarged ink input field.
  • the original data display field may indicate, by means of a scroll icon or similar means, that the field contains additional non-displayed ink input. Activating the indicator allows the user to scroll the reduced ink input in the data display field.
  • the computer recognizes the ink input as text characters, and displays the text characters in the input field.
  • the user closes the enlarged ink input field, and the recognized text is displayed in the data display field.
  • reduced ink input may be processed at a later time to recognize the ink input as text characters.
  • the invention allows a user to enter data quickly into a larger writing field but display the data in a smaller viewing field.
  • the ink data is useful to the user and the computer because the data is entered into defined input fields, and thus a context is automatically associated with the data.
  • the invention permits a user to enter data as rapidly as the user can write, and convert the data to text characters at a later time.
  • FIGURE 1 is a front left-side perspective drawing showing a prior art pen-based hand ⁇ held computer.
  • FIGURE 2 is a front plan view of a display screen of a pen-based hand-held computer showing example labels, data fields, and button icons.
  • FIGURE 3A is a front plan view of the display screen of the computer of FIGURE 2, showing an enlarged ink input field.
  • FIGURE 3B is a front plan view of the display screen of the computer of FIGURE 2, showing an alternative embodiment of an enlarged ink input field.
  • FIGURE 4A is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing multiple rows of reduced ink input obtained from the enlarged ink input field of FIGURE 3.
  • FIGURE 4B is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing a data display field with partially displayed reduced ink input obtained from the enlarged ink input field of FIGURE 3.
  • FIGURE 4C is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing a data display field with partially displayed reduced ink input obtained from the enlarged ink input field of FIGURE 3.
  • FIGURE 5 is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 4, showing the converted form of the reduced ink input of
  • FIGURES 6A and 6B are flow charts describing a first embodiment of the inventive process of the present invention.
  • FIGURE 7 is a flow chart describing a second embodiment of the inventive process of the present invention.
  • FIGURE 2 is a front plan view of a display screen 2 of a pen-based hand-held computer 1 showing example labels 10, pre-defined data display fields or windows
  • buttons or icons 12 For purposes of illustration only, the invention is described in the context of a particular application, comprising a scheduling function. However, the invention can be used with any other application that involves entering data into defined data display fields 11.
  • the scheduling application shows six data display fields 11 opposite six corresponding labels for hours of the day, ranging from 10:00 a.m. to 3:00 p.m.
  • the label field 10 at the top of the screen shows the day of week and date, and a "close application" icon 13.
  • the data display field for the time "12:00” has an ASCII text entry of "LUNCH WITH BOB", previously entered by a user.
  • the image shown in FIGURE 2 is approximately 3" wide by 5" high. It should be clear that it would be difficult for a user to accurately input ink directly into any of the data display fields 11 because of the small size of such fields and the limitations of displays and digitizers, as mentioned previously.
  • a user selects a data display field 11 by touching the field with a pen or stylus 3. For example, if the user wishes to make an entry in the data display field 11 a opposite the 10:00 label 10, the user would touch a pen anywhere within that data display field 11. Sensing the location of a touch on the display screen 2 by the pen 3 and associating the touch with a data field or window are well-known in the art.
  • FIGURE 3A is a front plan view of the display screen of the computer of FIGURE 2, showing a first embodiment of an enlarged ink input field or window 14. Referring to FIGURE 3A, a pen touch on the data display field 11 a corresponding to the 10:00 label 10a causes the enlarged ink input field 14 to be displayed on the display screen 2. Generation of such fields or windows is well known in the art.
  • FIGURE 3A is a front plan view of the display screen of the computer of FIGURE 2, showing an enlarged ink input field 14 that encompass ⁇ es only the lower portion of the display screen 2, with some or all of the data display fields 11 still being shown.
  • a dialog box may be displayed to indicate the which data display field 11 has been selected.
  • a symbol 15 may be dis ⁇ played in the selected data display field 11 a to visually indicate its selection.
  • any input data already existing in the selected data display field 11 a would be shown in the enlarged ink input field 14 at its original input size.
  • the enlarged ink input field 14 would be blank initially.
  • the user may write in the field.
  • the enlarged ink input field 14 may be sized to accommodate only a limited vertical area for ink input, or may be sized to accommodate multiple rows of ink input, as shown in FIGURES 3A and 3B.
  • a scroll bar 16 may be provided, in known fashion.
  • the preferred embodiment also provides soft function keys "INK” 12a, 'TEXT' 12b, "CANCEL” 12c, and “OK” 12d, respectively corresponding to an "INK” mode function, a 'TEXT' mode function, a “CANCEL OPERATION” function, and an "ACCEPT INPUT' function.
  • soft function keys "INK” 12a, 'TEXT' 12b, "CANCEL” 12c, and "OK” 12d, respectively corresponding to an "INK” mode function, a 'TEXT' mode function, a “CANCEL OPERATION” function, and an "ACCEPT INPUT' function.
  • other labels for such soft keys, and other functions could be provided.
  • the "INK' mode 12a icon and 'TEXT' mode 12b icon have been provided to allow a user to select or switch between the type of input mode desired.
  • the "INK' mode all input is accepted as ink.
  • the user may edit the input as desired.
  • the user presses the "OK' icon 12d to accept the ink input for display in the selected data display field 11a.
  • the "INK' mode is the default mode, but the user may set another preference in a set-up file, if desired.
  • ink input is recognized as the user writes. Again, the user may edit the input as desired. The user indicates completion of input by, for example, "clicking" on the "OK' icon 12d to accept the recognized ink input for display in the selected data display field 11 a. Note that the user may save both recognized ink input and unrecognized ink input in a single data display field 11 , and can switch between the "INK' mode and the 'TEXT' mode as desired by selecting the respective icons 12a, 12b.
  • the user has entered the phrase "MEETING WITH JEFF AT OFFICE". If the user had selected the "INK' mode icon 12a, all input would be in shown in the enlarged ink input field 14 as ink. If the user had selected the 'TEXT' mode icon 12b, all input would be recognized as the user writes. In either event, if the user uses the pen 3 to select the "OK' icon 12d, the input would be saved to the selected data display field 11 a.
  • FIGURE 3B the user has entered the phrase "MEETING WITH JEFF AT OFFICE".
  • the user may use the pen 3 to select the "INK' icon 12a' to save the input as an ink data type, or the 'TEXT' icon 12b' to have the input recognized and saved as ASCII characters.
  • the user may re-select the original data display field 11 a with a touch of the pen 3 to automatically save the con ⁇ tents of the enlarged ink input field 14 as an ink data type.
  • re-selecting the selected data display field 11 a can operate to cause the ink input in the enlarged ink input field 14 to be recognized and saved as ASCII characters.
  • FIGURE 4A is a subsequent view of the display shown in FIGURE 3, showing the selected data display field 11 a with multiple "lines" of reduced ink input obtained from the enlarged ink input field 14 of FIGURE 3 ("line” as used here does not refer to ASCII character lines separated by a carriage return/line feed, but to the user's vertical grouping of ink input).
  • the ink input has been reduced in size to fit within the previously selected data display field 11 a. Size reduction of ink input can be accomplished in any number of ways known in the prior art.
  • the ink input is represented as vectors.
  • the length of each vector stroke comprising each character can be mathematically shortened by a desired amount or percentage, and reduced size characters can then be constructed from the shortened vector representation, in known fashion.
  • the amount of size reduction of the ink input is preferably fixed at a set value, such as a 2:1 ratio of original input size to reduced size.
  • the size reduction can be user-settable or automatically scaled.
  • the size reduction for the ink input is limited to an amount that makes the input readable when displayed in the selected data display field 11 a.
  • the longest vertical dimension for user input in the enlarged ink input field 14 can be determined as the number of pixels from the top-most pixel to the bottom-most pixel of the ink input. That vertical length is then used to scale the ink input to fit within the selected data display field 11 a. For example, if the vertical length is found to be 200 pixels, and the vertical dimension of the selected data display field 11 a is 50 pixels, a 4:1 scaling ratio can be used to reduce the size of the original ink input. Alternatively, the horizontal axis, or both the vertical and horizontal axes, can be used to determine the scaling factor.
  • the original data display field 11 a is resized, either automatically or manually, to show most or all of the ink input.
  • the data display field 11 a can be sized to fit all of the ink input, up to the limit of the display screen 2, or sized up to a preset maximum or a maximum set by the user.
  • the data display field 11 a may be increased in vertical size by the lesser of the scaled vertical length of the ink input or a fixed number of pixels.
  • FIGURE 4B is a subsequent view of the display shown in FIGURE 3, showing the selected data display field 11 a with reduced ink input obtained from the enlarged ink input field of FIGURE 3. As shown in FIGURE 4B, the ink input has been reduced in size to at least partially fit within the previously selected data display field 11 a.
  • the data display field 11 a containing the ink data type also includes an icon or symbol 17 to indicate that additional input exists in the field, but is not displayed.
  • touching the icon or symbol 17 enlarges the data display field 11 a and provides a scroll bar (not shown) similar to the scroll bar 16 shown in FIGURE 3. Enlarging windows for scrolling, and the scrolling of windows, is well known in the art.
  • touching the icon or symbol 17 causes the contents of the selected data display field 11 a to be displayed in the enlarged ink input field 14.
  • the original ink input is always saved in its original form (although it may be compressed in a loss-less manner), regardless of the amount or means of reducing the size of the input for display in a data display field 11.
  • the original size ink input from the user is redisplayed in the enlarged ink input field 14, for further editing.
  • FIGURE 4C is a subsequent view of the display shown in FIGURE 3, showing multiple "lines" of reduced ink input obtained from the enlarged ink input field 14 of FIGURE 3.
  • the original data display field 11a is resized, either automati ⁇ cally or manually, to show more than one "line" of the ink input.
  • the data display field 11 a is re-sized to fit all of the ink input, up to the limit of the display screen 2, or sized up to a preset maximum or a maximum set by the user.
  • the user may mark the ink input to indicate a range of ink input to display, and the data display field 11 a is sized to display the reduced size of that range of ink input, up to some maximum.
  • the selected data display field 11a also includes a scroll bar 18 to indicate that additional input data exists in the field, but is not displayed. Alternatively, an icon or symbol may be provided for such indication.
  • ink input when reduced and entered into a defined data display field 11 , has a context automatically associated with the data.
  • a user can search for all appointments at 10:00 for the next 30 days. Any data display field 11 meeting those search criteria and having an ink data type entry will be found and displayed, even though the computer cannot search the contents of ink data types.
  • the user wants to move an appointment to another day or time, the user would simply change the date or time of the existing appointment, and the associated ink would appear at the new date or time.
  • Prior art systems would require selection of the ink (e.g., by drawing a line or box around the ink), and then cutting and pasting the selected ink into a new area.
  • FIGURE 5 is a subsequent view of the display shown in FIGURE 4, showing the converted form of the reduced ink input of FIGURE 4 in the selected data display field 11a. If the user accepts the ink input in the enlarged ink input field 14 for recognition, then the computer recognizes the ink input as ASCII text characters, and displays the text characters in the data display field 11 a. The computer can directly search the contents of data display fields 11 containing ASCII text characters, in known fashion.
  • the selected data display field 11 a may also include an icon or symbol 17 to indicate that additional input data exists in the field, but is not displayed.
  • touching the icon or symbol 17 enlarges the data display field 11 a and provides a scroll bar (not shown) similar to the scroll bar 16 shown in FIGURE 3.
  • the user can also recognize reduced ink input in a selected data display field 11 a at a later time. To do so in the preferred embodiment, the user selects a data display field 11 a, causing the contents to be displayed in the enlarged ink input field 14. The user then selects the 'TEXT' icon 12b (shown in FIGURE 3A) to have the input recog ⁇ nized as ASCII characters. However, any other means may be used to activate the recognition function to operate on the contents of the selected data display field 11 a.
  • the invention permits a user to enter data essentially as rapidly as the user can write. At a later time, the user can convert the data to ASCII text characters if desired.
  • FIGURE 6 is a flow chart describing the preferred embodiment of the inventive process of the present invention. The basic steps are:
  • the computer senses the user's pen touch on a defined data display field 11 a, and accepts that touch as a selection of the field (STEP 100).
  • the enlarged ink input field 14 is opened for user input (STEP 102).
  • the computer tests for the presence of the pen 3 within the enlarged ink inpu field 14 (STEP 104).
  • the ink is recognized (STEP 110) by processing the ink throug a character recognition algorithm (such as the characte recognition system described in U.S. Patent No. 5,125,039, entitled “Object Recognition System", by the inventor of th present invention);
  • a character recognition algorithm such as the characte recognition system described in U.S. Patent No. 5,125,039, entitled “Object Recognition System", by the inventor of th present invention
  • the computer tests if the pen 3 is touching the "OK' icon 12d (STEP 134). 10. If the pen 3 is in the "OK' icon, then: a. the enlarged ink input field 14 is closed (STEP 136); b. the input (text or ink, depending on mode) is displayed in the selected data display field (STEP 138).
  • FIGURE 7 is a flow chart describing a second embodiment of the inventive process of the present invention.
  • the basic steps are: 1.
  • the computer senses the user's pen touch on a defined data display field 11 a, and accepts that touch as a selection of the field (STEP 200).
  • the enlarged ink input field 14 is opened for user input (STEP 202).
  • the computer senses the user's pen touch within the enlarged ink input field 14 as ink input (STEP 204). 4. If the user accepts the ink input for display (e.g., by touching the "INK' soft key 12a) (STEP 206), then: a. The enlarged ink input field 14 is closed (STEP 208) (this step could be performed after the next step); b. The ink input is reduced in size (STEP 210); and c. The reduced ink input is displayed in the selected data display field 11 a (STEP 212). 5. If the user accepts the ink input for recognition (e.g., by touching the 'TEXT' soft key 12b) (STEP 214), then: a.
  • the enlarged ink input field 14 is closed (STEP 216) (this step could be performed after the next step); b.
  • the ink input is processed through a character recognition algorithm (STEP 218); c.
  • the recognized ASCII text is displayed in the selected data display field 11 a (STEP 220).
  • the user does not first select a data display field and then input data into an associated enlarged ink input field. Instead, the user selects or invokes a function that displays an enlarged ink input field, inputs ink data, and then associates the input with a selected data display field.
  • the step described above of selecting a data display field need not be done in the strict order indicated.
  • the invention allows a user to enter data quickly into a larger writing field but display the data in a smaller viewing field.
  • the ink data is useful to the user and the computer because the data is entered into defined input fields, and thus a context is automatically associated with the data.
  • the invention permits a user to enter data as rapidly as the user can write, and convert the data to text characters at a later time.

Abstract

A data input system (3) ideally suited for pen-based portable computers (1) having a limited writing area. A user selects a pre-defined data display field (11), whereupon an enlarged ink input field (14) is displayed. The user may select whether the ink input is to be saved as an ink data type, or recognized and converted to text characters. If the user accepts the ink input as an ink data type, then the ink is reduced sufficiently to fit within the original data display field, and the data display field (11) is automatically resized to accommodate the ink that was entered in the enlarged ink input field (14). If the user accepts the ink input for recognition, then the computer recognizes the ink input as text characters, and displays the text characters in the data display field (11). Reduced ink input may be processed at a later time to recognize the ink input as text characters.

Description

DATA INPUT SYSTEM FOR PEN-BASED COMPUTERS
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to computers, and more particular, to a data input system for pen-based portable computers.
2. Description of Related Art
As computers have become increasingly popular for various applications, portable computers have been developed for a wide variety of uses. While many such portable computers use a traditional keyboard for input, for smaller computers, particularly including hand-held computers, the use of "pens" as an interface has been introduced as a way of making a small computer easier to use. With a pen interface, a user can place a pen or stylus directly on a touch-sensitive screen of the computer to control the software running on the computer and to input information. For many people, writing with a pen is a more natural way of inputing information than using a keyboard.
An example of a prior art pen-based hand-held computer is shown in FIGURE 1. The illustrated hand-held computer 1 is typically about 4 inches by 6.5 inches, with the majority of one surface comprising a touch-sensitive display screen 2. The display screen 2 is typically a liquid crystal display (LCD) having a resolution of 240x320 pixels or greater (although larger or smaller pixel arrays could be used). Various technologies can be used to sense the location of a pen or stylus 3 touched against the surface of the LCD screen 2 to indicate to the computer's operating system the X-Y coordinates of the touch. Such a computer may be provided with an option slot 4, which may be, for example, a PCMCIA-compliant adapter slot. Various hardware buttons 5 may be provided to control different functions, and/or to turn power on or off to the unit. In addition, a variety of software buttons or icons 6 may be provided, in known fashion, to indicate such functions as, for example, word processing or a delete ("trash can") function. Computer-generated information is typically shown on the display screen 2 as ASCII characters 7. Data input is typically received and/or displayed in specific fields 8.
A common characteristic of such pen-based computers is the use of character recognition software to convert "ink" characters input by a user into computer readable text, such as ASCII characters. "Ink" comprises a series or trail of pixels changed (e.g., darkened or lightened) as a pen 3 is moved across the display screen 2 by a user, thus mimicking the application of real ink to paper. One such character recognition system is described in U.S. Patent No. 5,125,039, entitled "Object Recognition System", by the inventor of the present invention. In such systems, as a user inputs each ink character, or after several ink characters have been input, the computer applies special algorithms to recognize each character as an ASCII character, and replaces the ink representation of the character drawn by the user with a standardized ASCII representation of that character.
Despite the functional capability of such hand-held pen-based computers, in actual practice, writing with a pen on the small displays of such computers has proven to have several drawbacks that make pen-based computers difficult to use.
One problem is that state-of-art hand writing recognition software works well for some people, but does not work well for other people, since individual hand printing styles vary significantly. In general, the error rate of such software is high. In particular, such software does not work well at all if the user inputs text in a sloppy fashion or in script, rather than in printed form.
To overcome the limitations of hand writing recognition software, designers of pen- based computers have started saving the user's original input strokes as a graphical "ink" data type, without trying to convert the input strokes into ASCII text. In this scheme, when a user writes on the screen, the computer makes no attempt to recognize what was written. Instead, the information is saved as a graphics image representing the path of the pen 3 across the display screen 2. The graphical ink image may be represented, for example, as a bit-mapped, vector, or algorithmic representation of the input strokes.
While such "unrecognized" ink is very fast and easy to input, it is less useful than ink that has been recognized as text. Because unrecognized graphical ink input is unstructured and has no meaning or associations to the computer, the computer cannot perform searches on or use ink data types in intelligent ways. Thus, later use of such input is severely restricted. To overcome this significant limitation, some computer designs allow the user to assign key words to a block of ink input. This requires extra steps by the user in anticipation of future needs, and has limited utility.
Another problem of both recognized and unrecognized ink input on pen-based computers is the amount of screen space required to accept ink input. The screen digitizers used to determine the location of the pen or stylus 3 on the display screen 3 have limited resolution, and are "noisy" (meaning that they do not always track accurately the position of the pen). Further, the display screens 2 have limited resolution. For good character recognition and to enable the capture of clear ink input from a user, the user has to write fairly large letters to overcome the limitations of the digitizer and display screen. Unfortunately, this need for a large writing area conflicts with the desire for creating small hand-held computers. A hand-held comput¬ er might have a display measuring only about 2Vz by 3 inches. With a normal hand¬ writing style, the user can only write one or two lines of ink on such a small display. To date, this characteristic has been a hinderance in the design and acceptance of such small computers. Accordingly, a need exists for a more effective method of writing information with a pen on small-display pen-based computers. In particular, a need exists for accommodating input from a wide-variety of users on a pen-based, hand-held computer having a limited writing area.
The present invention provides such a method.
SUMMARY OF THE INVENTION
The present invention comprises a data input system ideally suited for pen-based portable computers having a limited writing area. A hand-held computer using the invention permits a user to select a pre-defined data display field, whereupon an enlarged ink input field is displayed to the user. The computer accepts ink input from the user into the enlarged ink input field. The enlarged ink input field may be scrollable, automatically or manually, to present additional "blank" writing area to the user.
The user has the option of selecting whether the ink input is to be saved as an ink data type, or recognized and converted to text characters. If the user accepts the ink input as an ink data type, then the computer shrinks (reduces) the ink input to fit within the original data display field and displays the reduced ink input in the original data display field. In the preferred embodiment, the ink is reduced sufficiently (typically 2:1) to fit within the width of the original data display field, and the height of the data display field is automatically resized to accommodate all of the ink that was entered in the enlarged ink input field. Alternatively, the original data display field may indicate, by means of a scroll icon or similar means, that the field contains additional non-displayed ink input. Activating the indicator allows the user to scroll the reduced ink input in the data display field.
If the user accepts the ink input for recognition, then the computer recognizes the ink input as text characters, and displays the text characters in the input field. When done inputing into the input field, the user closes the enlarged ink input field, and the recognized text is displayed in the data display field. As an option, reduced ink input may be processed at a later time to recognize the ink input as text characters.
Thus, the invention allows a user to enter data quickly into a larger writing field but display the data in a smaller viewing field. The ink data is useful to the user and the computer because the data is entered into defined input fields, and thus a context is automatically associated with the data. Further, the invention permits a user to enter data as rapidly as the user can write, and convert the data to text characters at a later time.
The details of the preferred embodiment of the present invention are set forth in the accompanying drawings and the description below. Once the details of the invention are known, numerous additional innovations and changes will become obvious to one skilled in the art.
BRIEF DESCRIPTION OF THE DRAWINGS
FIGURE 1 is a front left-side perspective drawing showing a prior art pen-based hand¬ held computer.
FIGURE 2 is a front plan view of a display screen of a pen-based hand-held computer showing example labels, data fields, and button icons.
FIGURE 3A is a front plan view of the display screen of the computer of FIGURE 2, showing an enlarged ink input field.
FIGURE 3B is a front plan view of the display screen of the computer of FIGURE 2, showing an alternative embodiment of an enlarged ink input field.
FIGURE 4A is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing multiple rows of reduced ink input obtained from the enlarged ink input field of FIGURE 3.
FIGURE 4B is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing a data display field with partially displayed reduced ink input obtained from the enlarged ink input field of FIGURE 3.
FIGURE 4C is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 3, showing a data display field with partially displayed reduced ink input obtained from the enlarged ink input field of FIGURE 3.
FIGURE 5 is a front plan view of a display screen showing a subsequent view of the screen shown in FIGURE 4, showing the converted form of the reduced ink input of
FIGURE 4. FIGURES 6A and 6B are flow charts describing a first embodiment of the inventive process of the present invention.
FIGURE 7 is a flow chart describing a second embodiment of the inventive process of the present invention.
Like reference numbers and designations in the various drawings refer to like elements.
DETAILED DESCRIPTION OF THE INVENTION
Throughout this description, the preferred embodiment and examples shown should be considered as exemplars, rather than as limitations on the present invention.
FIGURE 2 is a front plan view of a display screen 2 of a pen-based hand-held computer 1 showing example labels 10, pre-defined data display fields or windows
11 , and "soft" buttons or icons 12. For purposes of illustration only, the invention is described in the context of a particular application, comprising a scheduling function. However, the invention can be used with any other application that involves entering data into defined data display fields 11.
Referring to FIGURE 2, the scheduling application shows six data display fields 11 opposite six corresponding labels for hours of the day, ranging from 10:00 a.m. to 3:00 p.m. The label field 10 at the top of the screen shows the day of week and date, and a "close application" icon 13. In the example shown in FIGURE 2, the data display field for the time "12:00" has an ASCII text entry of "LUNCH WITH BOB", previously entered by a user. The image shown in FIGURE 2 is approximately 3" wide by 5" high. It should be clear that it would be difficult for a user to accurately input ink directly into any of the data display fields 11 because of the small size of such fields and the limitations of displays and digitizers, as mentioned previously.
In accordance with the preferred embodiment of the present invention, a user selects a data display field 11 by touching the field with a pen or stylus 3. For example, if the user wishes to make an entry in the data display field 11 a opposite the 10:00 label 10, the user would touch a pen anywhere within that data display field 11. Sensing the location of a touch on the display screen 2 by the pen 3 and associating the touch with a data field or window are well-known in the art. FIGURE 3A is a front plan view of the display screen of the computer of FIGURE 2, showing a first embodiment of an enlarged ink input field or window 14. Referring to FIGURE 3A, a pen touch on the data display field 11 a corresponding to the 10:00 label 10a causes the enlarged ink input field 14 to be displayed on the display screen 2. Generation of such fields or windows is well known in the art.
Although shown in FIGURE 3A, the selected data display field 11 a could be omitted completely, and the ink input field 14 made even larger, so as to comprise all or substantially all of the available display screen space. Further, other configurations could be used. For example, FIGURE 3B is a front plan view of the display screen of the computer of FIGURE 2, showing an enlarged ink input field 14 that encompass¬ es only the lower portion of the display screen 2, with some or all of the data display fields 11 still being shown. If desired, a dialog box may be displayed to indicate the which data display field 11 has been selected. Alternatively, a symbol 15 may be dis¬ played in the selected data display field 11 a to visually indicate its selection.
Any input data already existing in the selected data display field 11 a would be shown in the enlarged ink input field 14 at its original input size. In the example shown, the enlarged ink input field 14 would be blank initially. When the enlarged ink input field 14 is displayed, the user may write in the field. The enlarged ink input field 14 may be sized to accommodate only a limited vertical area for ink input, or may be sized to accommodate multiple rows of ink input, as shown in FIGURES 3A and 3B.
Regardless of the size of the enlarged ink input field 14, such field could accommo¬ date additional input from a user by being scrollable. For such purpose, a scroll bar 16 may be provided, in known fashion.
The preferred embodiment also provides soft function keys "INK" 12a, 'TEXT' 12b, "CANCEL" 12c, and "OK" 12d, respectively corresponding to an "INK" mode function, a 'TEXT' mode function, a "CANCEL OPERATION" function, and an "ACCEPT INPUT' function. Of course, other labels for such soft keys, and other functions, could be provided.
In the example shown in FIGURE 3A, the "INK' mode 12a icon and 'TEXT' mode 12b icon have been provided to allow a user to select or switch between the type of input mode desired. For example, in the "INK' mode, all input is accepted as ink. The user may edit the input as desired. When done, the user presses the "OK' icon 12d to accept the ink input for display in the selected data display field 11a. In the preferred embodiment, the "INK' mode is the default mode, but the user may set another preference in a set-up file, if desired.
In contrast, in the 'TEXT' mode, ink input is recognized as the user writes. Again, the user may edit the input as desired. The user indicates completion of input by, for example, "clicking" on the "OK' icon 12d to accept the recognized ink input for display in the selected data display field 11 a. Note that the user may save both recognized ink input and unrecognized ink input in a single data display field 11 , and can switch between the "INK' mode and the 'TEXT' mode as desired by selecting the respective icons 12a, 12b.
In the example shown in FIGURE 3A, the user has entered the phrase "MEETING WITH JEFF AT OFFICE". If the user had selected the "INK' mode icon 12a, all input would be in shown in the enlarged ink input field 14 as ink. If the user had selected the 'TEXT' mode icon 12b, all input would be recognized as the user writes. In either event, if the user uses the pen 3 to select the "OK' icon 12d, the input would be saved to the selected data display field 11 a.
In the alternative embodiment shown in FIGURE 3B, "INK' and 'TEXT' icons 12a', 12b' do not function as mode selectors. Instead, they operate as post-input "SAVE AS INK" and "SAVE AS ASCII TEXT' functions, respectively. For example, referring to
FIGURE 3B, the user has entered the phrase "MEETING WITH JEFF AT OFFICE". When the user is done entering ink input into the enlarged ink input field 14, the user may use the pen 3 to select the "INK' icon 12a' to save the input as an ink data type, or the 'TEXT' icon 12b' to have the input recognized and saved as ASCII characters. Alternatively or in addition to the "INK' function key 12a', the user may re-select the original data display field 11 a with a touch of the pen 3 to automatically save the con¬ tents of the enlarged ink input field 14 as an ink data type. Alternatively, re-selecting the selected data display field 11 a can operate to cause the ink input in the enlarged ink input field 14 to be recognized and saved as ASCII characters.
FIGURE 4A is a subsequent view of the display shown in FIGURE 3, showing the selected data display field 11 a with multiple "lines" of reduced ink input obtained from the enlarged ink input field 14 of FIGURE 3 ("line" as used here does not refer to ASCII character lines separated by a carriage return/line feed, but to the user's vertical grouping of ink input). The ink input has been reduced in size to fit within the previously selected data display field 11 a. Size reduction of ink input can be accomplished in any number of ways known in the prior art. For example, in the pre¬ ferred embodiment, the ink input is represented as vectors. Hence, the length of each vector stroke comprising each character can be mathematically shortened by a desired amount or percentage, and reduced size characters can then be constructed from the shortened vector representation, in known fashion.
The amount of size reduction of the ink input is preferably fixed at a set value, such as a 2:1 ratio of original input size to reduced size. Alternatively, the size reduction can be user-settable or automatically scaled. In the preferred embodiment, the size reduction for the ink input is limited to an amount that makes the input readable when displayed in the selected data display field 11 a.
For automatic scaling, the longest vertical dimension for user input in the enlarged ink input field 14 can be determined as the number of pixels from the top-most pixel to the bottom-most pixel of the ink input. That vertical length is then used to scale the ink input to fit within the selected data display field 11 a. For example, if the vertical length is found to be 200 pixels, and the vertical dimension of the selected data display field 11 a is 50 pixels, a 4:1 scaling ratio can be used to reduce the size of the original ink input. Alternatively, the horizontal axis, or both the vertical and horizontal axes, can be used to determine the scaling factor.
As shown in FIGURE 4A, in addition to size reduction of the ink input, the original data display field 11 a is resized, either automatically or manually, to show most or all of the ink input. The data display field 11 a can be sized to fit all of the ink input, up to the limit of the display screen 2, or sized up to a preset maximum or a maximum set by the user. For example, the data display field 11 a may be increased in vertical size by the lesser of the scaled vertical length of the ink input or a fixed number of pixels.
If a substantial amount of ink input was entered in the enlarged ink input field 14 by the user, then a reduced size version of the ink input may not fit entirely within the selected data display field 11 a and still be readable, even with resizing of the data display field. FIGURE 4B is a subsequent view of the display shown in FIGURE 3, showing the selected data display field 11 a with reduced ink input obtained from the enlarged ink input field of FIGURE 3. As shown in FIGURE 4B, the ink input has been reduced in size to at least partially fit within the previously selected data display field 11 a. The data display field 11 a containing the ink data type also includes an icon or symbol 17 to indicate that additional input exists in the field, but is not displayed. In this embodiment, touching the icon or symbol 17 enlarges the data display field 11 a and provides a scroll bar (not shown) similar to the scroll bar 16 shown in FIGURE 3. Enlarging windows for scrolling, and the scrolling of windows, is well known in the art. In an alternative embodiment, touching the icon or symbol 17 causes the contents of the selected data display field 11 a to be displayed in the enlarged ink input field 14. ln the preferred embodiment, the original ink input is always saved in its original form (although it may be compressed in a loss-less manner), regardless of the amount or means of reducing the size of the input for display in a data display field 11. By selecting a data display field 11 containing an ink data type, the original size ink input from the user is redisplayed in the enlarged ink input field 14, for further editing.
FIGURE 4C is a subsequent view of the display shown in FIGURE 3, showing multiple "lines" of reduced ink input obtained from the enlarged ink input field 14 of FIGURE 3. In this embodiment, the original data display field 11a is resized, either automati¬ cally or manually, to show more than one "line" of the ink input. In addition, the data display field 11 a is re-sized to fit all of the ink input, up to the limit of the display screen 2, or sized up to a preset maximum or a maximum set by the user. In an alternative embodiment, the user may mark the ink input to indicate a range of ink input to display, and the data display field 11 a is sized to display the reduced size of that range of ink input, up to some maximum. The selected data display field 11a also includes a scroll bar 18 to indicate that additional input data exists in the field, but is not displayed. Alternatively, an icon or symbol may be provided for such indication.
An important aspect of the invention is that ink input, when reduced and entered into a defined data display field 11 , has a context automatically associated with the data. Thus, for example, a user can search for all appointments at 10:00 for the next 30 days. Any data display field 11 meeting those search criteria and having an ink data type entry will be found and displayed, even though the computer cannot search the contents of ink data types. As another example, if the user wants to move an appointment to another day or time, the user would simply change the date or time of the existing appointment, and the associated ink would appear at the new date or time. Prior art systems would require selection of the ink (e.g., by drawing a line or box around the ink), and then cutting and pasting the selected ink into a new area. FIGURE 5 is a subsequent view of the display shown in FIGURE 4, showing the converted form of the reduced ink input of FIGURE 4 in the selected data display field 11a. If the user accepts the ink input in the enlarged ink input field 14 for recognition, then the computer recognizes the ink input as ASCII text characters, and displays the text characters in the data display field 11 a. The computer can directly search the contents of data display fields 11 containing ASCII text characters, in known fashion.
Referring to FIGURE 5, the selected data display field 11 a may also include an icon or symbol 17 to indicate that additional input data exists in the field, but is not displayed. In this embodiment, touching the icon or symbol 17 enlarges the data display field 11 a and provides a scroll bar (not shown) similar to the scroll bar 16 shown in FIGURE 3.
The user can also recognize reduced ink input in a selected data display field 11 a at a later time. To do so in the preferred embodiment, the user selects a data display field 11 a, causing the contents to be displayed in the enlarged ink input field 14. The user then selects the 'TEXT' icon 12b (shown in FIGURE 3A) to have the input recog¬ nized as ASCII characters. However, any other means may be used to activate the recognition function to operate on the contents of the selected data display field 11 a.
Because inputing ink into the enlarged ink input field 14 is very fast compared to recognition, the invention permits a user to enter data essentially as rapidly as the user can write. At a later time, the user can convert the data to ASCII text characters if desired.
FIGURE 6 is a flow chart describing the preferred embodiment of the inventive process of the present invention. The basic steps are:
1. The computer senses the user's pen touch on a defined data display field 11 a, and accepts that touch as a selection of the field (STEP 100).
2. The enlarged ink input field 14 is opened for user input (STEP 102). 3. The computer tests for the presence of the pen 3 within the enlarged ink inpu field 14 (STEP 104).
4. If the pen 3 is in the enlarged ink input field 14, then the computer tests if th system is in the "INK' mode (STEP 106). a. If yes, then the ink is displayed in the enlarged ink input field 14, an processing continues at STEP 104. b. If no, then:
1) the ink is recognized (STEP 110) by processing the ink throug a character recognition algorithm (such as the characte recognition system described in U.S. Patent No. 5,125,039, entitled "Object Recognition System", by the inventor of th present invention);
2) the recognized text is displayed in the enlarged ink input fiel 14 (STEP 112); 3) processing continues at STEP 104.
5. If the pen was not in the enlarged ink input field 14 (STEP 104), then the computer tests if the pen 3 is touching the 'TEXT' icon 12b (STEP 114).
6. If the pen 3 is in the 'TEXT' icon, then the computer tests if the system is in the "INK' mode (STEP 116). a. If no, then processing continues at STEP 104. b. If yes, then:
1 ) the existing ink in the enlarged ink input field 14 is recognized (STEP 118);
2) the enlarged ink input field 14 is cleared of ink (STEP 120); 3) the recognized text is displayed in the enlarged ink input field
14 (STEP 122);
4) the mode is changed to 'TEXT' (STEP 124);
5) processing continues at STEP 104.
7. If the pen 3 is not in the 'TEXT' icon, then the computer tests if the pen 3 is touching the "INK' icon 12a (STEP 126). 8. If the pen 3 is in the "INK' icon, then the computer tests if the system is in the 'TEXT' mode (STEP 128). a. If no, then processing continues at STEP 104. b. If yes, then: 1) the enlarged ink input field 14 is cleared of text (STEP 130);
2) the mode is changed to "INK1 (STEP 132);
3) processing continues at STEP 104.
9. If the pen 3 is not in the "INK' icon, then the computer tests if the pen 3 is touching the "OK' icon 12d (STEP 134). 10. If the pen 3 is in the "OK' icon, then: a. the enlarged ink input field 14 is closed (STEP 136); b. the input (text or ink, depending on mode) is displayed in the selected data display field (STEP 138).
11. If the pen 3 is not in the "OK' icon, then the computer tests if the pen 3 is touching the "CANCEL" icon 12c (STEP 140). a. If no, then processing continues at STEP 104; b. If yes, then the enlarged ink input field 14 is closed (STEP 142).
FIGURE 7 is a flow chart describing a second embodiment of the inventive process of the present invention. The basic steps are: 1. The computer senses the user's pen touch on a defined data display field 11 a, and accepts that touch as a selection of the field (STEP 200).
2. The enlarged ink input field 14 is opened for user input (STEP 202).
3. The computer senses the user's pen touch within the enlarged ink input field 14 as ink input (STEP 204). 4. If the user accepts the ink input for display (e.g., by touching the "INK' soft key 12a) (STEP 206), then: a. The enlarged ink input field 14 is closed (STEP 208) (this step could be performed after the next step); b. The ink input is reduced in size (STEP 210); and c. The reduced ink input is displayed in the selected data display field 11 a (STEP 212). 5. If the user accepts the ink input for recognition (e.g., by touching the 'TEXT' soft key 12b) (STEP 214), then: a. The enlarged ink input field 14 is closed (STEP 216) (this step could be performed after the next step); b. The ink input is processed through a character recognition algorithm (STEP 218); c. The recognized ASCII text is displayed in the selected data display field 11 a (STEP 220).
In an alternative embodiment of the invention, the user does not first select a data display field and then input data into an associated enlarged ink input field. Instead, the user selects or invokes a function that displays an enlarged ink input field, inputs ink data, and then associates the input with a selected data display field. Thus, the step described above of selecting a data display field need not be done in the strict order indicated.
In summary, the invention allows a user to enter data quickly into a larger writing field but display the data in a smaller viewing field. Importantly, the ink data is useful to the user and the computer because the data is entered into defined input fields, and thus a context is automatically associated with the data. Further, the invention permits a user to enter data as rapidly as the user can write, and convert the data to text characters at a later time.
A number of embodiments of the present invention have been described. Neverthe¬ less, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, although the invention has been described in the context of a portable computer, the invention can be applied to pen-based computers embedded within other equipment or structures. According- ly, it is to be understood that the invention is not to be limited by the specific illustrat¬ ed embodiment, but only by the scope of the appended claims.

Claims

1. A data input system for a pen-based computer having a display and writing area, at least one pre-defined data display field, and means for accepting pen input from a user as ink, the data input system including:
(1) means for accepting selection by a user of a pre-defined data display field;
(2) means for displaying an enlarged ink input field;
(3) means for accepting ink input from the user in the enlarged ink input field;
(4) means for reducing the size of the ink input; (5) means for displaying at least part of the reduced-size ink input in the selected data display field.
2. The data input system of claim 1 , further including:
(1 ) means for recognizing the ink input as text;
(2) means for displaying the recognized text in the selected data display field.
3. The data input system of claim 1 , further including means for sizing the enlarged ink input field to accept multiple lines of ink input from the user.
4. The data input system of claim 3, wherein the enlarged ink input field is scrollable.
5. The data input system of claim 1 , wherein the enlarged ink input field includes substantially all of the available writing area of the computer.
6. The data input system of claim 1 , further including means for indicating that the selected data display field contains more reduced-size ink input than is displayed in the selected data display field.
7. The data input system of claim 1 , further including means for sizing the selected data display field to display multiple lines of reduced-size ink input.
8. The data input system of claim 7, wherein the selected data display field is scrollable.
9. The data input system of claim 7, further including means for marking a portion of the ink input to limit display of the reduced-size ink input to the marked portion.
10. The data input system of claim 1 , further including means for sizing th selected data display field to display essentially all of the reduced-size in input.
11. The data input system of claim 10, wherein the selected data display field i scrollable.
12. The data input system of claim 10, further including means for marking portion of the ink input to limit display of the reduced-size ink input to th marked portion.
13. A method for inputing data into a pen-based computer having a display and writing area, at least one pre-defined data display field, and means for accept¬ ing pen input from a user as ink, the method including the steps of:
(1) accepting selection by a user of a pre-defined data display field;
(2) displaying an enlarged ink input field;
(3) accepting ink input from the user in the enlarged ink input field;
(4) reducing the size of the ink input;
(5) displaying at least part of the reduced-size ink input in the selected data display field.
14. The method of inputing data of claim 13, further including the steps of:
(1 ) recognizing the ink input as text;
(2) displaying the recognized text in the selected data display field.
15. The method of inputing data of claim 13, further including the step of sizing the enlarged ink input field to accept multiple lines of ink input from the user.
16. The method of inputing data of claim 15, wherein the enlarged ink input field is scrollable.
17. The method of inputing data of claim 16, wherein the enlarged ink input field includes substantially all of' the available writing area of the computer.
18. The method of inputing data of claim 13, further including the step of indicating that the selected data display field contains more reduced-size ink input than is displayed in the selected data display field.
19. The method of inputing data of claim 13, further including the step of sizing the selected data display field to display multiple lines of reduced-size ink input.
20. The method of inputing data of claim 19, wherein the selected data display field is scrollable.
21. The method of inputing data of claim 13, further including the steps of:
(1 ) providing means to mark a portion of the ink input;
(2) limiting display of the reduced-size ink input to the marked portion.
22. The method of inputing data of claim 13, wherein the step of accepting selection by a user of a pre-defined data display field is performed after the step of accepting ink input from the user in the enlarged ink input field.
23. The method of inputing data of claim 13, further including the step of sizing the selected data display field to display essentially all of the reduced-size ink input.
24. The method of inputing data of claim 23, wherein the selected data display field is scrollable.
AMENDED CLAIMS
[received by the International Bureau on 19 April 1994 (19.04.94); original claims 1 and 13 amended; remaining claims unchanged (2 pages)]
1. A data input system for a pen-based computer having a display and writing area, at least one pre-defined structured data display field, and means for accepting pen input from a user as ink, the data input system including:
(1) means for accepting selection by a user of a pre-defined structured data display field;
(2) means for creating and displaying a temporary enlarged ink input field, the contents of which correspond to the contents of the selected data display field, the enlarged ink input field being larger than the selected data display field; (3) means for accepting ink input from the user in the enlarged ink input field;
(4) means for terminating display of the enlarged ink input field;
(5) means for displaying at least part of the ink input in reduced size in the selected data display field; and (6) means for manipulating the ink input indirectly by directly manipulating the structured data display field.
13. A method for inputing data into a pen-based computer having a display and writing area, at least one pre-defined structured data display field, and means for accepting pen input from a user as ink, the method including the steps of:
(1 ) accepting selection by a user of a pre-defined data display field; (2) creating and displaying a temporary enlarged ink input field, the contents of which correspond to the contents of the selected data display field, the enlarged ink input field being larger than the selected data display field; (3) accepting ink input from the user in the enlarged ink input field; (4) terminating display of the enlarged ink input field;
(5) displaying at least part of the ink input in reduced size in the selected data display field; an
(6) manipulating the ink input indirectly by directly manipulating the structured data display field.
PCT/US1993/010587 1992-11-03 1993-11-02 Data input system for pen-based computers WO1994010678A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US97062192A 1992-11-03 1992-11-03
US970,621 1992-11-03

Publications (1)

Publication Number Publication Date
WO1994010678A1 true WO1994010678A1 (en) 1994-05-11

Family

ID=25517211

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1993/010587 WO1994010678A1 (en) 1992-11-03 1993-11-02 Data input system for pen-based computers

Country Status (1)

Country Link
WO (1) WO1994010678A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6366697B1 (en) 1993-10-06 2002-04-02 Xerox Corporation Rotationally desensitized unistroke handwriting recognition
US6493464B1 (en) 1994-07-01 2002-12-10 Palm, Inc. Multiple pen stroke character set and handwriting recognition system with immediate response
WO2003104887A2 (en) * 2002-06-07 2003-12-18 Smart Technologies Inc. System and method for injecting ink into an application
WO2008117140A1 (en) * 2007-03-23 2008-10-02 Sony Ericsson Mobile Communications Ab Inline editing of web page input fields using a visibly prominent field
US7567239B2 (en) * 2003-06-26 2009-07-28 Motorola, Inc. Method and system for message and note composition on small screen devices
EP2477094A1 (en) * 2011-01-13 2012-07-18 Research In Motion Limited Selective resizing of data input cells
US8234219B2 (en) 2008-09-09 2012-07-31 Applied Systems, Inc. Method, system and apparatus for secure data editing
US8259075B2 (en) 2009-01-06 2012-09-04 Hewlett-Packard Development Company, L.P. Secondary key group layout for keyboard
US8650475B2 (en) 2011-01-13 2014-02-11 Blackberry Limited Selective resizing of data input cells
WO2014097303A1 (en) * 2012-12-23 2014-06-26 N-Trig Ltd. Touchscreen computing device and method
CN104182174A (en) * 2014-09-09 2014-12-03 联想(北京)有限公司 Information processing method and electronic equipment
US8976108B2 (en) 2001-06-11 2015-03-10 Qualcomm Incorporated Interface for processing of an alternate symbol in a computer device
US9549056B2 (en) 2001-06-11 2017-01-17 Qualcomm Incorporated Integrated personal digital assistant device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58114287A (en) * 1981-12-28 1983-07-07 Sharp Corp Electronic pocketbook
US5063600A (en) * 1990-05-14 1991-11-05 Norwood Donald D Hybrid information management system for handwriting and text
US5157737A (en) * 1986-07-25 1992-10-20 Grid Systems Corporation Handwritten keyboardless entry computer system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58114287A (en) * 1981-12-28 1983-07-07 Sharp Corp Electronic pocketbook
US5157737A (en) * 1986-07-25 1992-10-20 Grid Systems Corporation Handwritten keyboardless entry computer system
US5063600A (en) * 1990-05-14 1991-11-05 Norwood Donald D Hybrid information management system for handwriting and text

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6816859B2 (en) 1993-10-06 2004-11-09 Xerox Corporation Rotationally desensitized unistroke handwriting recognition
US6366697B1 (en) 1993-10-06 2002-04-02 Xerox Corporation Rotationally desensitized unistroke handwriting recognition
US6493464B1 (en) 1994-07-01 2002-12-10 Palm, Inc. Multiple pen stroke character set and handwriting recognition system with immediate response
US10326871B2 (en) 2001-06-11 2019-06-18 Qualcomm Incorporated Integrated personal digital assistant device
US9549056B2 (en) 2001-06-11 2017-01-17 Qualcomm Incorporated Integrated personal digital assistant device
US8976108B2 (en) 2001-06-11 2015-03-10 Qualcomm Incorporated Interface for processing of an alternate symbol in a computer device
US9696905B2 (en) 2001-06-11 2017-07-04 Qualcomm Incorporated Interface for processing of an alternate symbol in a computer device
US10097679B2 (en) 2001-06-11 2018-10-09 Qualcomm Incorporated Integrated personal digital assistant device
WO2003104887A3 (en) * 2002-06-07 2004-09-10 Smart Technologies Inc System and method for injecting ink into an application
US7499033B2 (en) 2002-06-07 2009-03-03 Smart Technologies Ulc System and method for injecting ink into an application
US8508489B2 (en) 2002-06-07 2013-08-13 Smart Technologies Ulc System and method for injecting ink into an application
WO2003104887A2 (en) * 2002-06-07 2003-12-18 Smart Technologies Inc. System and method for injecting ink into an application
US7567239B2 (en) * 2003-06-26 2009-07-28 Motorola, Inc. Method and system for message and note composition on small screen devices
WO2008117140A1 (en) * 2007-03-23 2008-10-02 Sony Ericsson Mobile Communications Ab Inline editing of web page input fields using a visibly prominent field
US8234219B2 (en) 2008-09-09 2012-07-31 Applied Systems, Inc. Method, system and apparatus for secure data editing
US8259075B2 (en) 2009-01-06 2012-09-04 Hewlett-Packard Development Company, L.P. Secondary key group layout for keyboard
US8650475B2 (en) 2011-01-13 2014-02-11 Blackberry Limited Selective resizing of data input cells
EP2477094A1 (en) * 2011-01-13 2012-07-18 Research In Motion Limited Selective resizing of data input cells
WO2014097303A1 (en) * 2012-12-23 2014-06-26 N-Trig Ltd. Touchscreen computing device and method
CN104182174A (en) * 2014-09-09 2014-12-03 联想(北京)有限公司 Information processing method and electronic equipment

Similar Documents

Publication Publication Date Title
US7797639B2 (en) Page bar control
US9170731B2 (en) Insertion point bungee space tool
US6243071B1 (en) Tool set for navigating through an electronic book
US6891551B2 (en) Selection handles in editing electronic documents
US5559942A (en) Method and apparatus for providing a note for an application program
US6208340B1 (en) Graphical user interface including a drop-down widget that permits a plurality of choices to be selected in response to a single selection of the drop-down widget
US5539427A (en) Graphic indexing system
EP1363231B1 (en) Overlaying electronic ink
US5276794A (en) Pop-up keyboard system for entering handwritten data into computer generated forms
US5956021A (en) Method and device for inputting information for a portable information processing device that uses a touch screen
US7581194B2 (en) Enhanced on-object context menus
US5677710A (en) Recognition keypad
TW542998B (en) Automatically scaling icons to fit a display area within a data processing system
US20040257346A1 (en) Content selection and handling
EP0243925B1 (en) Instruction input system for electronic processor
US6282315B1 (en) System for entering handwritten data into computer generated forms
US6928609B2 (en) Hypermedia authoring and publishing system
US20010024195A1 (en) Page information display method and device and storage medium storing program for displaying page information
US20030214553A1 (en) Ink regions in an overlay control
JP2000250866A (en) Method for automatically selecting electronic write pen tool and electronic marker tool
WO1994010678A1 (en) Data input system for pen-based computers
US5796383A (en) Method and system for presenting contents of a container object within a graphical user interface in a data processing system
JPH06175775A (en) Information processor
WO1994016408A1 (en) Method and apparatus for editing electronic ink
First Interaction Design Guide

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase