CA2083329A1 - Menu display system and method - Google Patents
Menu display system and methodInfo
- Publication number
- CA2083329A1 CA2083329A1 CA002083329A CA2083329A CA2083329A1 CA 2083329 A1 CA2083329 A1 CA 2083329A1 CA 002083329 A CA002083329 A CA 002083329A CA 2083329 A CA2083329 A CA 2083329A CA 2083329 A1 CA2083329 A1 CA 2083329A1
- Authority
- CA
- Canada
- Prior art keywords
- menu
- selection
- item
- display
- displaying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
Abstract
ABSTRACT
To facilitate use in interaction with a computer by the use of an I/O device in which a liquid crystal display device and a tablet are integrated, a vertically extending menu bar is displayed at the right or left end of a screen, and a pull-down menu is further displayed which downwardly extends in an arc from a selected item of the menu bar to the center. The character string display of each menu bar item is inclined and space is omitted. The locus along which the pull-down menu extends can be calibrated to the user.
To facilitate use in interaction with a computer by the use of an I/O device in which a liquid crystal display device and a tablet are integrated, a vertically extending menu bar is displayed at the right or left end of a screen, and a pull-down menu is further displayed which downwardly extends in an arc from a selected item of the menu bar to the center. The character string display of each menu bar item is inclined and space is omitted. The locus along which the pull-down menu extends can be calibrated to the user.
Description
MENU DISPLAY SYSTEM AND MFTHOD
DETAILRD DESCRIPTION OF TRE INVENTION
Field of the Invention The present invention is re]ated to a ~lser interface of a computer system, and particularly to provide for an efficient menu process in the display screen of an integrated 1/0 (input/outptlt) device or the like which uses a tran~parent tablet and a liquid crystal display.
The conventional computer user interaction technique has been developed mainly on the basis of a bit map display and mouse (or tablet), and it is desiqned for user operation on the assumption that the whole screen is basically visible.
A typical example of user interaction is to use a menu.
This is a method in which choices such as commands are displayed on a bit map display ~nd inptlt is by the use of a pointing device such as a mouse. There i8 a pull-down menu in which the menu is hierarchica] to improve usability. In this menu system, a menu bar is nsually positioned in the upper portions of a display or window and the individual items are laterally arranged, ~d a p~ down menu is vertically displayed. Since a ~lfier generally scans the screen from top to bottom ln a sy~tem using a mouse and a bit map display, such an arrangement between the menu bar and the pull-down menu is very efficient Nowadays, owin~ to the advance of sensor and liquid crystal technologies, an integrated I/O device using a transparent tablet and a liqnid crystal display has been newly propagated, replacing the bit map display an~ mouse. This device is characterized in that an item now on display can be directly operated (the position of the item being displayed is coincident with that of the object to be JA9-91-548 ~ 2083329 operated). However, the direct use of the conventional pull-down menu system has the following problems.
(1) The menu items on the menu bar at the side of the arm having a pen are hidden.
DETAILRD DESCRIPTION OF TRE INVENTION
Field of the Invention The present invention is re]ated to a ~lser interface of a computer system, and particularly to provide for an efficient menu process in the display screen of an integrated 1/0 (input/outptlt) device or the like which uses a tran~parent tablet and a liquid crystal display.
The conventional computer user interaction technique has been developed mainly on the basis of a bit map display and mouse (or tablet), and it is desiqned for user operation on the assumption that the whole screen is basically visible.
A typical example of user interaction is to use a menu.
This is a method in which choices such as commands are displayed on a bit map display ~nd inptlt is by the use of a pointing device such as a mouse. There i8 a pull-down menu in which the menu is hierarchica] to improve usability. In this menu system, a menu bar is nsually positioned in the upper portions of a display or window and the individual items are laterally arranged, ~d a p~ down menu is vertically displayed. Since a ~lfier generally scans the screen from top to bottom ln a sy~tem using a mouse and a bit map display, such an arrangement between the menu bar and the pull-down menu is very efficient Nowadays, owin~ to the advance of sensor and liquid crystal technologies, an integrated I/O device using a transparent tablet and a liqnid crystal display has been newly propagated, replacing the bit map display an~ mouse. This device is characterized in that an item now on display can be directly operated (the position of the item being displayed is coincident with that of the object to be JA9-91-548 ~ 2083329 operated). However, the direct use of the conventional pull-down menu system has the following problems.
(1) The menu items on the menu bar at the side of the arm having a pen are hidden.
(2) The pull-down items are also hidden by the hand while they are being selected in the downward direction, even though the first item is in sight.
Incidentally, the patent reference~ related to the present invention include the Published Unexamined Patent Japan Application Nos. 254233/1987 and 205722/1988 official gazettes. Although these are to improve the conventional menu bar and pull-down menu scheme, the menu bar is laterally arranged at the top of the screen, and thus they are different from the present invention. In addition, a method for diagonally displaying a pull-down menu is disclosed in IBM~ Technical Dificlosure Bulletin Vol.32, No.8, pp.370-372, Jan. 1990, but the menu bar is also laterally arranged at the top of the screen in this method.
Also in a user-friendly user interface, icons representing applicationæ may be vertically lined up, for instance, at the right end of the screen (IBM AIX~ NextStep Environment/6000, sc23-2357, p.2--~9), but this is to display the frequently used applications in order for easy understanding, and thus pen input is not taken into consideration. Further, an application is merely initiated by selection of an icon in SUC]l interface, and a pull-down menu or the like is not further displayed The present invention is provided in view of the above circumstances, and it is the object of the present invention to provide a user interface technique which results in no reduction in operation propertles even for pen input. The invention will be more readily understood from the following detailed description taken in conjunction with the appended drawings, wherein:
Fig's. 1,2 and 3 illustrate conventional pull-down menu systems;
Fig's. 4,5 and 6 illustrate the outline of the present invention;
Fig's. 7 through 10 inclusive il]ustrate an outline of an embodiment of the present invention;
Fig. 11 is a diagram showing the configuration of the embodiment:
Fig's. 12 and 13 are diagrams illustrating main portions of the embodiment;
Fig's. 14 through 17 inclusive are flow charts explaining the operation of the embodiment of the present invention.
As indicated above, Fig's. 1 through 3 are illustrative of conventional pull-down menu systems commented upon in the preamble of the present disclosure In the present invention, a menu bar is vertically lined up at the right or left end of a screen (or window), preferably, at the user's dominant arm side, whereas the conventional menu bar is latera]ly lined up at the top of a screen (or ~indow). More preferably, the pull-down portion is provided with an arc in consideration of the movement of the wrist. (See Figure 4 ? Hereinafter, the description given is for right-handed users, while left and right are to be reversed for left-handed users. The pull-down angle is calibrated before use since it depends on factors such as left- or right-handedness, the size of the hand, the length of the upper arm, and the work space position (particularly, the angle from the center of the chair back). In addition, in order to prevent space from being wasted in continuity of the operation from the menu bar and left~to-right writing of characters, the content of the menu bar items may be displayed at an angle (the contents of the menu bar may be represented by icons).
The present invention is now examined in terms of the visibility of the object. When a user points at the screen with a pen, the arm is placed from the lower right to the upper left of the screen. In the conventional menu bar laterally arranged at the top of the screen or window, when a certain item is selected, the adjacent item is hidden by the hand as shown in Figure 3. In the present invention, however, all the items are displayed without being hidden.
In addition, the present invention is examined from the viewpoint of the operating properties of the hand. In the conventional vertically arranged pull-down menu, the arm is moved to a great extent or the wrist is forced to unnaturally move when a lower item is selected, and thus it cannot be said that the operating properties are good. On the other hand, in the present invention, all the menu items can be selected by a motion which does not impose an unnatural force.
Now, an embodiment of the present invention is described with reference to the drawings.
Incidentally, this embodiment C~ll be constructed by newly adding a calibration function to the conventional menu system and also slightly modlfying the menu bar subsystem and pull-down subsystem.
Calibration Fun_tion Since the locus for tracing the pull-down menu with a pen without causing an unnatural force depends on the individual, calibration for each individual is essential.
First, each individual is caused to indicate one point on the screen a~ shown in Figure 7. Then, the wrist is caused to indicate an end point to which it can move without ~ausing unnatural force~ and the locus traced by the pen point is fitted to an arc, there~y obtaining an arc along which the menu is to ~e displayed.
Menu Bar Subsystem This can easily be created by exchanging the X- and Y-coordinate of the offset calculation in the current menu bar subsystem. However, since it is considered that each item length of the menu bar (usually, one to two words) is short enough in comparison to the radius of gyration of the wrist, the inclination angle is to be constant.
Pull-down Menu S bsystem In the conventional vertically arranged menu system, a vertical offset is merely added to the end when the next item is created after the first item has been created. (See Figure 9.) On the other hand, in the menu system of the present invention, the position of the subsequent item is determined by the method shown in Figure 10 on the basis of the calibration data shown in Figure 8. This method can easily be added to the existing menu system.
The details of the above-mentioned calibration function and the modifications to the menu bar subsystem and pull-down subsystem are described below.
Figure 11 generally shows the system configuration of this embodiment, in which the system comprises personal computer 1, Operating System 2 and user interface management system 3. Personal Computer 1 is, for instance, a PS/55 of IBM
Japan, Ltd. (PS/55 is a -trademark of International Business Machines Corporation, U.S.A.), and consists of processor 4, liquid crystal display device 5, transparent tablet 6a and pen ~b. Operating system 2 is, for instance, AIX PS/2 of IBM Japan, Ltd. (AIX and PS/2 are trademarks of International Business Machines Corporation, U.S.A.). This operating system 2 includes window system 7 which manages the output to liquid crystal display device 5 and the input from transparent tablet 6a User interface management system 3 performs complex processing of the inputs and outputs such as the menu processing, and in this system, data reception and transfer to the display/selection/application programs of the menu are executed.
JA9-91-548 ~ 2083329 Figure 12 illustrates data reception and transfer between user interface management system 3 and window system 7 of Figure 11. In ~ re 12, user interface management system 3 has event handler 10 as well as window manager 8 and menu processing system 9. Event handler 10 receives event information from window system 7 and passes it to window manager 8 and menu processing system 9. Window manager 8 modifies the position or size of the window according to the event information. Menu processing system 9 is adapted to execute the process routines shown in Figures 14 to 17 which are described later, according to the event information, and has menu har information management section 11, pull-down information management section 12 and cali~ration information management section 13. These information management sections ll, 12 and 13 will be described later.
With such a configuration, a user performs a calibration a head of time and the application program logs the menu data.
Thereafter, when the user gives an indication using pen 6b on transparent tablet 6a, window system 7 on operating system 2 generateæ event information in response to the user indication and sends it out to llser interface management system 3. User interface management system 3 provides instructions for performing the display and selection of the menu to menu processing system 9 according to the event information, and menu processing system 9 again displays the menu on liguid crystal display device 5 via window system 7 for item selection from the subseql~ent event. When the menu selection is determined, the previously displayed menu is erased and the selected data is transferred to the application program.
Figure 13 is given to fltrther depict the configuration of menu processing system 9 of Figure 12. In Figure 1~, menu processing system 9 has men~ har information management section 11, pull-down information management section 12 and calibration information management section 13. Menu bar information management section ll incl~ldes the display information (display character string, color, font, display icon data, size (width, heiyht), etc.) of all the items JA9-91-548 7 2 0 8 3 3 2 ~
constituting the menu bar, position information (coordinates of the position of the start point for displaying each item), inclination angle, and index pointing to pull-down information. Pull-down information management section 12 includes the display information (display character string, color, font, size (width, height), etc.) of all the items constituting the pull-down, and application data to be passed to the application program when actually selected.
Calibration information management section 13 includes the information of the are based on the swing of the user's wrist (central coordinates of the relative arc as seen from the position at which the pen point is positioned).
The operation of this embodiment is now described.
To explain the utilization of the menu system, these stages are seguentially described That is, they are (1) calibration process, (2) initialization by the application program, and (3) interactive menu. The switching of these three processes is usually performed by operating system 2 or another independent application ~oftware.
(lL_ C 1_bration Process The calibration process is to extract the information on the elements of the swing of the user s wrist and process it into the form which can be treated by the previously described calibration information management section 13.
The calibration procedllre is performed below according to Figure 14. The user first tells the system that he will perform a calibration (execute the calibration software).
The system newly provides a window for calibraticn to the user and waits for input ~step Sl) When window system 7 informs that the u~er has dropped the point of pen 6b within the window (transparent tablet ~a has sensed the coordinates and simultaneously confirmed tha~ the pen point has been contacted with it), the sampling of data for calibration is initiated (step S2). Jf the user moves the pen point even slightly, window system 7 sends the data of the pen point to menu processing system 9. Although menu processing system 9 provides echo display to the user, it does not recognize the JA9-91-548 ~ 2 0 8 3 3 2 9 inputting of a new point until the pen point of the user moves a fixed distance, and only if the movement is equal to or exceeds that di~tance, it recognizes the pen point as a new point and stores the coordinates of the point in the system (step S3). The sampling is repeated until the pen point is disengaged from transparent tablet 6a (step S4).
As a result, point string data of the movement of the pen point of the user is obtained.
Then, using both end points and the middle point of the obtained data string, the point string is fitted to an arc.
The fitting method is as shown in Figure 8. ~he arc data (Cx, Cy, Cr) obtained from this is discriminately displayed in superposition on the previously echoed back and displayed locus of the pen point of the user (for instance, overwritten with a different color) (step S5). If the user is unsatisfied with the fitting, these steps are repeated (step S6). By transferring the data (Cx-XO, Cy-YO) of the finally obtained arc data to calibration management section 13, the calibration process is terminated (step S7).
However, (XO, YO) represents the coordinate value of the first point of the pen point data. Incidentally, since the difference between right-handedness and left-handedness appears in the sign of Cx (Cx>=~ for right-handedness, Cx<O
for left-handedness), no speci~l branch processing is reguired.
(2) Initialization by Application Pro~ram This initialization is performed in a manner similar to the conventional menu system, or instance, AIX Windows or OS/2 Presentation Manager of IBM Japan, Ltd. First, the application proqram performs the ~etting of the display information (display character string, color, font, di~play icon data, etc.) of all the items constituting the menu bar o menu bar information management section 11, the display information (display char~cter string, color, font, size ~width, height), etc.~ of all the items constituting the pull-down of pull~down information management section 12, and the application data provided to the application program when actually selected.
Then, the ~ize (width, height) is obtained and set using the character string length and font information from the display information of each item of menu bar information management section 11 (for instance, if AIX PS/2 of IBM
Japan, Ltd. is used as operating system 2 and AIX windows of the said company are used as window system 7, the system can be allowed to perform the calculation using that information). Furthermore, from such information, the position information (the coordinates of the position of the start point for displaying each item) and the inclination angle is calculated by the procedure shown in Figure 15.
First, the region availa~le for the menu bar (MBWidth, MBHeight) is calculated from the window size required by the application, the size of the currently available screen, and the window size required by the user (step S11). Next, only for those items having display information in characters, the maximum value of their width (WidthMax) is calculated.
The maximum value of the height (HeightMax) is similarly calculated (step S12). If this value (WidthMax) is smaller than the previously stated MBWidth, the default inclination angle i9 set; otherwise (~) is ca]culated from MBWidth = HeightMax*sin(~) + WidthMax*cos(O) (step S13), and this value is compared with the maximum inclination value previously possessed by the ~ystem and the smaller one is set as the inc]ination angle (step S14). Then, the positions of the items are sequentially determined using this value. First, the position (Y-coordinate) of the first item is calculated from the following e~uation.
y = HeightMax*cos(~) WidthMax*sin(~) (step S15) Then, the subseguent items including the second item are determined by se~entially adding dy = ~eightMax*co~
JA9-91~548 1~ 2083~29 to the preceding Y-coordinate (~teps S16, S17). As the X-coordinate, a fixed value x = HeightMax*sin(~) is set throughout all the items (steps S16, Sl7). Finally, the initialization by the application program is terminated by setting the index of pull--down information management section 12 pointed to from each menu bar item in the index within menu bar information management section 11.
(3~ Interactive Menu_Processlng The menu processing flow is shown in Figure 16. Menu processing system 9 first uses the data of menu bar information management section 11 to display the menu bar in the window specified by the application (step S21). Since all information required to display each item has already been set at the time of the previous initialization, no special calculation or the like is required at this point.
For display o a character string, all that is needed is that the point at the lower left of a string box just surrounding the character string represent the coordinates of position information for each i.tem and display is made with inclination of the angle specified by the inclination angle. For icons on the like, they may be displayed without inclination. When an event is sent from window system 7 for indicating that the user has cli.cked the pen point in some item, from the coordinates of the pen point, which item has been pointed to is retrieved and the flow moves to the pull-down processing (step S22).
The pull-down processing also begins at the pull-down me~u display. First, usin~ the index of pull-down information management ~ection 12 corresponding to the selected item of the menu bar, pull-down mana~ement information is obtained (step S23). Then, using this information, the calibration information and the coordinate values of the selected pull-down i.tem, the pull-down item is displayed (step S24).
The method for determining the display positions of the pull-down items is described later in Figure 17. Also here, similarly to the above menu bar case, it i8 determined from the event of the pen point coordinates which item has been selected (step S25), and the application data corresponding to the particular item is delivered to the application program (~tep S26). Finally, the menu processing is terminated by erasing the pull-down items from the screen (step S27). In addition, if a menu selection event occurs outside the pull-down items display area, it is deemed that the menu processing has been canceled, and the process flows to step 6 (step S28).
The previously described method for determining each pull-down item displaying position is now described using Figure 17. First, the coordinates of a point at the upper right of a string box surrounding the character string of the first item are determined in the following way (step S31).
Xs = X-coordinate value of the left end of menu bar region Ys = Y-coordinate value of selected pull-down item Then the following values are preliminarily calculated for the subsequent calculations (step S32).
Px = Xs + ( Cx - XO ) Py = Ys + (Cy - YO) Where (Cx - XO) and (Cy - YO) are the previously described calibration data. For the second item or an item thereafter (i + l-th item), the coordinates are recurrently calculated using the preceding coordinate values (Xi, Yi) and (Px, Py) in the following manner (step S33).
Xi ~ 1 = Xi - (Px - Xi)/(Py - Yi)*(Height of display of i-th item) Yi + 1 = Yi ~ (Height of display of i.-th item) 208332~
By se~uentially calculating this for all the remaining items, all the display positions can be determined.
The present invention is not intended to be restricted to the above embodiment, and various modifications are available. For instance, if the pen is provided with a button, to use the pen button for the trigger for selection, or for specifying selection or cancellation can also be adopted in the present invention as in the existing menu system. Moreover, a vertical menu bar may be displayed as needed, or the vertical menu bar and the conventional lateral menu bar may selectively be displayed. In addition, it i8 also allowed to display the vertical menu bar in the standard system using a bit map display and a mouse.
Furthermore, the present invention can also apply not only to personal computers but also to interactive systems such as workstations and remote terminals.
As described above, in accordance with the present invention, a menu bar is displayed at the right or left end of the screen, and thus a tablet can be provided on the screen of the display device and the inconvenience that the menu bar is hidden by the hand can be avoided even when inputting is per~ormed by direct]y contacting the tablet surface with a pen.
Incidentally, the patent reference~ related to the present invention include the Published Unexamined Patent Japan Application Nos. 254233/1987 and 205722/1988 official gazettes. Although these are to improve the conventional menu bar and pull-down menu scheme, the menu bar is laterally arranged at the top of the screen, and thus they are different from the present invention. In addition, a method for diagonally displaying a pull-down menu is disclosed in IBM~ Technical Dificlosure Bulletin Vol.32, No.8, pp.370-372, Jan. 1990, but the menu bar is also laterally arranged at the top of the screen in this method.
Also in a user-friendly user interface, icons representing applicationæ may be vertically lined up, for instance, at the right end of the screen (IBM AIX~ NextStep Environment/6000, sc23-2357, p.2--~9), but this is to display the frequently used applications in order for easy understanding, and thus pen input is not taken into consideration. Further, an application is merely initiated by selection of an icon in SUC]l interface, and a pull-down menu or the like is not further displayed The present invention is provided in view of the above circumstances, and it is the object of the present invention to provide a user interface technique which results in no reduction in operation propertles even for pen input. The invention will be more readily understood from the following detailed description taken in conjunction with the appended drawings, wherein:
Fig's. 1,2 and 3 illustrate conventional pull-down menu systems;
Fig's. 4,5 and 6 illustrate the outline of the present invention;
Fig's. 7 through 10 inclusive il]ustrate an outline of an embodiment of the present invention;
Fig. 11 is a diagram showing the configuration of the embodiment:
Fig's. 12 and 13 are diagrams illustrating main portions of the embodiment;
Fig's. 14 through 17 inclusive are flow charts explaining the operation of the embodiment of the present invention.
As indicated above, Fig's. 1 through 3 are illustrative of conventional pull-down menu systems commented upon in the preamble of the present disclosure In the present invention, a menu bar is vertically lined up at the right or left end of a screen (or window), preferably, at the user's dominant arm side, whereas the conventional menu bar is latera]ly lined up at the top of a screen (or ~indow). More preferably, the pull-down portion is provided with an arc in consideration of the movement of the wrist. (See Figure 4 ? Hereinafter, the description given is for right-handed users, while left and right are to be reversed for left-handed users. The pull-down angle is calibrated before use since it depends on factors such as left- or right-handedness, the size of the hand, the length of the upper arm, and the work space position (particularly, the angle from the center of the chair back). In addition, in order to prevent space from being wasted in continuity of the operation from the menu bar and left~to-right writing of characters, the content of the menu bar items may be displayed at an angle (the contents of the menu bar may be represented by icons).
The present invention is now examined in terms of the visibility of the object. When a user points at the screen with a pen, the arm is placed from the lower right to the upper left of the screen. In the conventional menu bar laterally arranged at the top of the screen or window, when a certain item is selected, the adjacent item is hidden by the hand as shown in Figure 3. In the present invention, however, all the items are displayed without being hidden.
In addition, the present invention is examined from the viewpoint of the operating properties of the hand. In the conventional vertically arranged pull-down menu, the arm is moved to a great extent or the wrist is forced to unnaturally move when a lower item is selected, and thus it cannot be said that the operating properties are good. On the other hand, in the present invention, all the menu items can be selected by a motion which does not impose an unnatural force.
Now, an embodiment of the present invention is described with reference to the drawings.
Incidentally, this embodiment C~ll be constructed by newly adding a calibration function to the conventional menu system and also slightly modlfying the menu bar subsystem and pull-down subsystem.
Calibration Fun_tion Since the locus for tracing the pull-down menu with a pen without causing an unnatural force depends on the individual, calibration for each individual is essential.
First, each individual is caused to indicate one point on the screen a~ shown in Figure 7. Then, the wrist is caused to indicate an end point to which it can move without ~ausing unnatural force~ and the locus traced by the pen point is fitted to an arc, there~y obtaining an arc along which the menu is to ~e displayed.
Menu Bar Subsystem This can easily be created by exchanging the X- and Y-coordinate of the offset calculation in the current menu bar subsystem. However, since it is considered that each item length of the menu bar (usually, one to two words) is short enough in comparison to the radius of gyration of the wrist, the inclination angle is to be constant.
Pull-down Menu S bsystem In the conventional vertically arranged menu system, a vertical offset is merely added to the end when the next item is created after the first item has been created. (See Figure 9.) On the other hand, in the menu system of the present invention, the position of the subsequent item is determined by the method shown in Figure 10 on the basis of the calibration data shown in Figure 8. This method can easily be added to the existing menu system.
The details of the above-mentioned calibration function and the modifications to the menu bar subsystem and pull-down subsystem are described below.
Figure 11 generally shows the system configuration of this embodiment, in which the system comprises personal computer 1, Operating System 2 and user interface management system 3. Personal Computer 1 is, for instance, a PS/55 of IBM
Japan, Ltd. (PS/55 is a -trademark of International Business Machines Corporation, U.S.A.), and consists of processor 4, liquid crystal display device 5, transparent tablet 6a and pen ~b. Operating system 2 is, for instance, AIX PS/2 of IBM Japan, Ltd. (AIX and PS/2 are trademarks of International Business Machines Corporation, U.S.A.). This operating system 2 includes window system 7 which manages the output to liquid crystal display device 5 and the input from transparent tablet 6a User interface management system 3 performs complex processing of the inputs and outputs such as the menu processing, and in this system, data reception and transfer to the display/selection/application programs of the menu are executed.
JA9-91-548 ~ 2083329 Figure 12 illustrates data reception and transfer between user interface management system 3 and window system 7 of Figure 11. In ~ re 12, user interface management system 3 has event handler 10 as well as window manager 8 and menu processing system 9. Event handler 10 receives event information from window system 7 and passes it to window manager 8 and menu processing system 9. Window manager 8 modifies the position or size of the window according to the event information. Menu processing system 9 is adapted to execute the process routines shown in Figures 14 to 17 which are described later, according to the event information, and has menu har information management section 11, pull-down information management section 12 and cali~ration information management section 13. These information management sections ll, 12 and 13 will be described later.
With such a configuration, a user performs a calibration a head of time and the application program logs the menu data.
Thereafter, when the user gives an indication using pen 6b on transparent tablet 6a, window system 7 on operating system 2 generateæ event information in response to the user indication and sends it out to llser interface management system 3. User interface management system 3 provides instructions for performing the display and selection of the menu to menu processing system 9 according to the event information, and menu processing system 9 again displays the menu on liguid crystal display device 5 via window system 7 for item selection from the subseql~ent event. When the menu selection is determined, the previously displayed menu is erased and the selected data is transferred to the application program.
Figure 13 is given to fltrther depict the configuration of menu processing system 9 of Figure 12. In Figure 1~, menu processing system 9 has men~ har information management section 11, pull-down information management section 12 and calibration information management section 13. Menu bar information management section ll incl~ldes the display information (display character string, color, font, display icon data, size (width, heiyht), etc.) of all the items JA9-91-548 7 2 0 8 3 3 2 ~
constituting the menu bar, position information (coordinates of the position of the start point for displaying each item), inclination angle, and index pointing to pull-down information. Pull-down information management section 12 includes the display information (display character string, color, font, size (width, height), etc.) of all the items constituting the pull-down, and application data to be passed to the application program when actually selected.
Calibration information management section 13 includes the information of the are based on the swing of the user's wrist (central coordinates of the relative arc as seen from the position at which the pen point is positioned).
The operation of this embodiment is now described.
To explain the utilization of the menu system, these stages are seguentially described That is, they are (1) calibration process, (2) initialization by the application program, and (3) interactive menu. The switching of these three processes is usually performed by operating system 2 or another independent application ~oftware.
(lL_ C 1_bration Process The calibration process is to extract the information on the elements of the swing of the user s wrist and process it into the form which can be treated by the previously described calibration information management section 13.
The calibration procedllre is performed below according to Figure 14. The user first tells the system that he will perform a calibration (execute the calibration software).
The system newly provides a window for calibraticn to the user and waits for input ~step Sl) When window system 7 informs that the u~er has dropped the point of pen 6b within the window (transparent tablet ~a has sensed the coordinates and simultaneously confirmed tha~ the pen point has been contacted with it), the sampling of data for calibration is initiated (step S2). Jf the user moves the pen point even slightly, window system 7 sends the data of the pen point to menu processing system 9. Although menu processing system 9 provides echo display to the user, it does not recognize the JA9-91-548 ~ 2 0 8 3 3 2 9 inputting of a new point until the pen point of the user moves a fixed distance, and only if the movement is equal to or exceeds that di~tance, it recognizes the pen point as a new point and stores the coordinates of the point in the system (step S3). The sampling is repeated until the pen point is disengaged from transparent tablet 6a (step S4).
As a result, point string data of the movement of the pen point of the user is obtained.
Then, using both end points and the middle point of the obtained data string, the point string is fitted to an arc.
The fitting method is as shown in Figure 8. ~he arc data (Cx, Cy, Cr) obtained from this is discriminately displayed in superposition on the previously echoed back and displayed locus of the pen point of the user (for instance, overwritten with a different color) (step S5). If the user is unsatisfied with the fitting, these steps are repeated (step S6). By transferring the data (Cx-XO, Cy-YO) of the finally obtained arc data to calibration management section 13, the calibration process is terminated (step S7).
However, (XO, YO) represents the coordinate value of the first point of the pen point data. Incidentally, since the difference between right-handedness and left-handedness appears in the sign of Cx (Cx>=~ for right-handedness, Cx<O
for left-handedness), no speci~l branch processing is reguired.
(2) Initialization by Application Pro~ram This initialization is performed in a manner similar to the conventional menu system, or instance, AIX Windows or OS/2 Presentation Manager of IBM Japan, Ltd. First, the application proqram performs the ~etting of the display information (display character string, color, font, di~play icon data, etc.) of all the items constituting the menu bar o menu bar information management section 11, the display information (display char~cter string, color, font, size ~width, height), etc.~ of all the items constituting the pull-down of pull~down information management section 12, and the application data provided to the application program when actually selected.
Then, the ~ize (width, height) is obtained and set using the character string length and font information from the display information of each item of menu bar information management section 11 (for instance, if AIX PS/2 of IBM
Japan, Ltd. is used as operating system 2 and AIX windows of the said company are used as window system 7, the system can be allowed to perform the calculation using that information). Furthermore, from such information, the position information (the coordinates of the position of the start point for displaying each item) and the inclination angle is calculated by the procedure shown in Figure 15.
First, the region availa~le for the menu bar (MBWidth, MBHeight) is calculated from the window size required by the application, the size of the currently available screen, and the window size required by the user (step S11). Next, only for those items having display information in characters, the maximum value of their width (WidthMax) is calculated.
The maximum value of the height (HeightMax) is similarly calculated (step S12). If this value (WidthMax) is smaller than the previously stated MBWidth, the default inclination angle i9 set; otherwise (~) is ca]culated from MBWidth = HeightMax*sin(~) + WidthMax*cos(O) (step S13), and this value is compared with the maximum inclination value previously possessed by the ~ystem and the smaller one is set as the inc]ination angle (step S14). Then, the positions of the items are sequentially determined using this value. First, the position (Y-coordinate) of the first item is calculated from the following e~uation.
y = HeightMax*cos(~) WidthMax*sin(~) (step S15) Then, the subseguent items including the second item are determined by se~entially adding dy = ~eightMax*co~
JA9-91~548 1~ 2083~29 to the preceding Y-coordinate (~teps S16, S17). As the X-coordinate, a fixed value x = HeightMax*sin(~) is set throughout all the items (steps S16, Sl7). Finally, the initialization by the application program is terminated by setting the index of pull--down information management section 12 pointed to from each menu bar item in the index within menu bar information management section 11.
(3~ Interactive Menu_Processlng The menu processing flow is shown in Figure 16. Menu processing system 9 first uses the data of menu bar information management section 11 to display the menu bar in the window specified by the application (step S21). Since all information required to display each item has already been set at the time of the previous initialization, no special calculation or the like is required at this point.
For display o a character string, all that is needed is that the point at the lower left of a string box just surrounding the character string represent the coordinates of position information for each i.tem and display is made with inclination of the angle specified by the inclination angle. For icons on the like, they may be displayed without inclination. When an event is sent from window system 7 for indicating that the user has cli.cked the pen point in some item, from the coordinates of the pen point, which item has been pointed to is retrieved and the flow moves to the pull-down processing (step S22).
The pull-down processing also begins at the pull-down me~u display. First, usin~ the index of pull-down information management ~ection 12 corresponding to the selected item of the menu bar, pull-down mana~ement information is obtained (step S23). Then, using this information, the calibration information and the coordinate values of the selected pull-down i.tem, the pull-down item is displayed (step S24).
The method for determining the display positions of the pull-down items is described later in Figure 17. Also here, similarly to the above menu bar case, it i8 determined from the event of the pen point coordinates which item has been selected (step S25), and the application data corresponding to the particular item is delivered to the application program (~tep S26). Finally, the menu processing is terminated by erasing the pull-down items from the screen (step S27). In addition, if a menu selection event occurs outside the pull-down items display area, it is deemed that the menu processing has been canceled, and the process flows to step 6 (step S28).
The previously described method for determining each pull-down item displaying position is now described using Figure 17. First, the coordinates of a point at the upper right of a string box surrounding the character string of the first item are determined in the following way (step S31).
Xs = X-coordinate value of the left end of menu bar region Ys = Y-coordinate value of selected pull-down item Then the following values are preliminarily calculated for the subsequent calculations (step S32).
Px = Xs + ( Cx - XO ) Py = Ys + (Cy - YO) Where (Cx - XO) and (Cy - YO) are the previously described calibration data. For the second item or an item thereafter (i + l-th item), the coordinates are recurrently calculated using the preceding coordinate values (Xi, Yi) and (Px, Py) in the following manner (step S33).
Xi ~ 1 = Xi - (Px - Xi)/(Py - Yi)*(Height of display of i-th item) Yi + 1 = Yi ~ (Height of display of i.-th item) 208332~
By se~uentially calculating this for all the remaining items, all the display positions can be determined.
The present invention is not intended to be restricted to the above embodiment, and various modifications are available. For instance, if the pen is provided with a button, to use the pen button for the trigger for selection, or for specifying selection or cancellation can also be adopted in the present invention as in the existing menu system. Moreover, a vertical menu bar may be displayed as needed, or the vertical menu bar and the conventional lateral menu bar may selectively be displayed. In addition, it i8 also allowed to display the vertical menu bar in the standard system using a bit map display and a mouse.
Furthermore, the present invention can also apply not only to personal computers but also to interactive systems such as workstations and remote terminals.
As described above, in accordance with the present invention, a menu bar is displayed at the right or left end of the screen, and thus a tablet can be provided on the screen of the display device and the inconvenience that the menu bar is hidden by the hand can be avoided even when inputting is per~ormed by direct]y contacting the tablet surface with a pen.
Claims
The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:
(1) A menu display system comprising:
means for displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction, and means responsive to selection of said selection items for displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(2) A menu display system as set forth in Claim 1 comprising means for selecting the display positions of said set of selection items.
(3) A menu display system as set forth in Claim 2 wherein said line extending from the vicinity of the selected selection item extends diagonally down.
(4) A menu display system as set forth in Claim 3 wherein said line extending from the vicinity of the selected selection item forms an arc projecting diagonally up.
(5) A menu display method comprising the steps of:
displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction, and in response to selection of said selection items, displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(6) In a computer program product executable by a computer, a computer program product for menu display which causes said computer to execute the steps of:
displaying a set of selection items at one or both of right and left ends of a display screen along the vertical direction, and in response to selection of said selection items, displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(7) A computer interactive system comprising:
a display device, a transparent tablet superposed on said display device, and means for displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction.
(8) A computer interactive system comprising:
input/output means including a display function and a coordinate inputting function for inputting a coordinate position in response to contact, and means for displaying a set of selection items at one or both of the right and left ends of said input/output means along the vertical direction.
(1) A menu display system comprising:
means for displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction, and means responsive to selection of said selection items for displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(2) A menu display system as set forth in Claim 1 comprising means for selecting the display positions of said set of selection items.
(3) A menu display system as set forth in Claim 2 wherein said line extending from the vicinity of the selected selection item extends diagonally down.
(4) A menu display system as set forth in Claim 3 wherein said line extending from the vicinity of the selected selection item forms an arc projecting diagonally up.
(5) A menu display method comprising the steps of:
displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction, and in response to selection of said selection items, displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(6) In a computer program product executable by a computer, a computer program product for menu display which causes said computer to execute the steps of:
displaying a set of selection items at one or both of right and left ends of a display screen along the vertical direction, and in response to selection of said selection items, displaying a set of selection items associated with the selected selection item along a line extending from the vicinity of the selected selection item.
(7) A computer interactive system comprising:
a display device, a transparent tablet superposed on said display device, and means for displaying a set of selection items at one or both of the right and left ends of a display screen along the vertical direction.
(8) A computer interactive system comprising:
input/output means including a display function and a coordinate inputting function for inputting a coordinate position in response to contact, and means for displaying a set of selection items at one or both of the right and left ends of said input/output means along the vertical direction.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2260292A JPH0785216B2 (en) | 1992-02-07 | 1992-02-07 | Menu display device and method |
| JP92/22602 | 1992-02-07 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2083329A1 true CA2083329A1 (en) | 1993-08-08 |
Family
ID=12087392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002083329A Abandoned CA2083329A1 (en) | 1992-02-07 | 1992-11-19 | Menu display system and method |
Country Status (9)
| Country | Link |
|---|---|
| US (1) | US5559944A (en) |
| EP (1) | EP0555034B1 (en) |
| JP (1) | JPH0785216B2 (en) |
| KR (1) | KR970002382B1 (en) |
| CN (1) | CN1026628C (en) |
| BR (1) | BR9300118A (en) |
| CA (1) | CA2083329A1 (en) |
| DE (1) | DE69321626T2 (en) |
| TW (1) | TW256895B (en) |
Families Citing this family (89)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5588107A (en) * | 1993-03-22 | 1996-12-24 | Island Graphics Corporation | Method and apparatus for selectably expandable menus |
| JPH08161138A (en) * | 1994-12-08 | 1996-06-21 | Nec Corp | Method for displaying menu |
| JP3352562B2 (en) * | 1995-03-31 | 2002-12-03 | 東芝機械株式会社 | Man-machine interface device for process controller |
| US5689667A (en) | 1995-06-06 | 1997-11-18 | Silicon Graphics, Inc. | Methods and system of controlling menus with radial and linear portions |
| US5986657A (en) * | 1996-08-02 | 1999-11-16 | Autodesk, Inc. | Method and apparatus for incorporating expandable and collapsible options in a graphical user interface |
| KR100288976B1 (en) * | 1997-01-08 | 2001-05-02 | 윤종용 | Method for constructing and recognizing menu commands of television receiver |
| US6252597B1 (en) * | 1997-02-14 | 2001-06-26 | Netscape Communications Corporation | Scalable user interface for graphically representing hierarchical data |
| US6002402A (en) * | 1997-04-09 | 1999-12-14 | Symantec Corporation | System and method for producing a drag-and-drop object from a popup menu item |
| JP4119004B2 (en) * | 1998-05-19 | 2008-07-16 | 株式会社東芝 | Data input system |
| US6337698B1 (en) * | 1998-11-20 | 2002-01-08 | Microsoft Corporation | Pen-based interface for a notepad computer |
| US6879665B1 (en) | 1999-04-27 | 2005-04-12 | International Business Machines Corporation | Method and apparatus for sending messages in a data processing system |
| DE1233365T1 (en) * | 1999-06-25 | 2003-03-20 | Genaissance Pharmaceuticals | Method for producing and using haplotype data |
| US7058517B1 (en) | 1999-06-25 | 2006-06-06 | Genaissance Pharmaceuticals, Inc. | Methods for obtaining and using haplotype data |
| US6931326B1 (en) | 2000-06-26 | 2005-08-16 | Genaissance Pharmaceuticals, Inc. | Methods for obtaining and using haplotype data |
| US7454714B2 (en) * | 2001-03-30 | 2008-11-18 | Aol Llc, A Delaware Limited Liability Company | Visually distinguishing menu items |
| US6826729B1 (en) | 2001-06-29 | 2004-11-30 | Microsoft Corporation | Gallery user interface controls |
| US20040267458A1 (en) * | 2001-12-21 | 2004-12-30 | Judson Richard S. | Methods for obtaining and using haplotype data |
| US7898529B2 (en) * | 2003-01-08 | 2011-03-01 | Autodesk, Inc. | User interface having a placement and layout suitable for pen-based computers |
| US20040165012A1 (en) * | 2003-02-20 | 2004-08-26 | International Business Machines Corp. | Cascading menu with selectable offset |
| WO2004097788A1 (en) * | 2003-04-28 | 2004-11-11 | Immersion Corporation | Systems and methods for user interfaces designed for rotary input devices |
| US9715678B2 (en) | 2003-06-26 | 2017-07-25 | Microsoft Technology Licensing, Llc | Side-by-side shared calendars |
| US7707255B2 (en) | 2003-07-01 | 2010-04-27 | Microsoft Corporation | Automatic grouping of electronic mail |
| US7392249B1 (en) | 2003-07-01 | 2008-06-24 | Microsoft Corporation | Methods, systems, and computer-readable mediums for providing persisting and continuously updating search folders |
| US8799808B2 (en) | 2003-07-01 | 2014-08-05 | Microsoft Corporation | Adaptive multi-line view user interface |
| US7716593B2 (en) | 2003-07-01 | 2010-05-11 | Microsoft Corporation | Conversation grouping of electronic mail records |
| US10437964B2 (en) | 2003-10-24 | 2019-10-08 | Microsoft Technology Licensing, Llc | Programming interface for licensing |
| US7555707B1 (en) | 2004-03-12 | 2009-06-30 | Microsoft Corporation | Method and system for data binding in a block structured user interface scripting language |
| US7895531B2 (en) | 2004-08-16 | 2011-02-22 | Microsoft Corporation | Floating command object |
| US7703036B2 (en) * | 2004-08-16 | 2010-04-20 | Microsoft Corporation | User interface for displaying selectable software functionality controls that are relevant to a selected object |
| US8255828B2 (en) | 2004-08-16 | 2012-08-28 | Microsoft Corporation | Command user interface for displaying selectable software functionality controls |
| US8117542B2 (en) | 2004-08-16 | 2012-02-14 | Microsoft Corporation | User interface for displaying selectable software functionality controls that are contextually relevant to a selected object |
| US8146016B2 (en) | 2004-08-16 | 2012-03-27 | Microsoft Corporation | User interface for displaying a gallery of formatting options applicable to a selected object |
| US9015621B2 (en) | 2004-08-16 | 2015-04-21 | Microsoft Technology Licensing, Llc | Command user interface for displaying multiple sections of software functionality controls |
| US7747966B2 (en) | 2004-09-30 | 2010-06-29 | Microsoft Corporation | User interface for providing task management and calendar information |
| US7340686B2 (en) * | 2005-03-22 | 2008-03-04 | Microsoft Corporation | Operating system program launch menu search |
| US7886290B2 (en) | 2005-06-16 | 2011-02-08 | Microsoft Corporation | Cross version and cross product user interface |
| JP2006350812A (en) * | 2005-06-17 | 2006-12-28 | Fujitsu Ltd | Operation menu display position control program, device, and method |
| US8239882B2 (en) | 2005-08-30 | 2012-08-07 | Microsoft Corporation | Markup based extensibility for user interfaces |
| US8689137B2 (en) | 2005-09-07 | 2014-04-01 | Microsoft Corporation | Command user interface for displaying selectable functionality controls in a database application |
| US9542667B2 (en) | 2005-09-09 | 2017-01-10 | Microsoft Technology Licensing, Llc | Navigating messages within a thread |
| US7739259B2 (en) | 2005-09-12 | 2010-06-15 | Microsoft Corporation | Integrated search and find user interface |
| US8627222B2 (en) | 2005-09-12 | 2014-01-07 | Microsoft Corporation | Expanded search and find user interface |
| CN1949161B (en) * | 2005-10-14 | 2010-05-26 | 鸿富锦精密工业（深圳）有限公司 | Multi gradation menu displaying device and display controlling method |
| US7644372B2 (en) * | 2006-01-27 | 2010-01-05 | Microsoft Corporation | Area frequency radial menus |
| KR20070113025A (en) * | 2006-05-24 | 2007-11-28 | 엘지전자 주식회사 | Apparatus and operating method of touch screen |
| US20090213086A1 (en) * | 2006-04-19 | 2009-08-27 | Ji Suk Chae | Touch screen device and operating method thereof |
| KR20070113018A (en) * | 2006-05-24 | 2007-11-28 | 엘지전자 주식회사 | Apparatus and operating method of touch screen |
| KR20070113022A (en) * | 2006-05-24 | 2007-11-28 | 엘지전자 주식회사 | Apparatus and operating method of touch screen responds to user input |
| KR101327581B1 (en) * | 2006-05-24 | 2013-11-12 | 엘지전자 주식회사 | Apparatus and Operating method of touch screen |
| KR101269375B1 (en) * | 2006-05-24 | 2013-05-29 | 엘지전자 주식회사 | Touch screen apparatus and Imige displaying method of touch screen |
| TWI328185B (en) * | 2006-04-19 | 2010-08-01 | Lg Electronics Inc | Touch screen device for potable terminal and method of displaying and selecting menus thereon |
| TW200805131A (en) * | 2006-05-24 | 2008-01-16 | Lg Electronics Inc | Touch screen device and method of selecting files thereon |
| US8605090B2 (en) | 2006-06-01 | 2013-12-10 | Microsoft Corporation | Modifying and formatting a chart using pictorially provided chart elements |
| US9727989B2 (en) | 2006-06-01 | 2017-08-08 | Microsoft Technology Licensing, Llc | Modifying and formatting a chart using pictorially provided chart elements |
| US20080163053A1 (en) | 2006-12-28 | 2008-07-03 | Samsung Electronics Co., Ltd. | Method to provide menu, using menu set and multimedia device using the same |
| KR100818713B1 (en) | 2007-03-23 | 2008-04-02 | 주식회사 하이닉스반도체 | Lithography method for suppressing scum in exposure process |
| US8074178B2 (en) * | 2007-06-12 | 2011-12-06 | Microsoft Corporation | Visual feedback display |
| US8484578B2 (en) | 2007-06-29 | 2013-07-09 | Microsoft Corporation | Communication between a document editor in-space user interface and a document editor out-space user interface |
| US8762880B2 (en) | 2007-06-29 | 2014-06-24 | Microsoft Corporation | Exposing non-authoring features through document status information in an out-space user interface |
| US8201103B2 (en) | 2007-06-29 | 2012-06-12 | Microsoft Corporation | Accessing an out-space user interface for a document editor program |
| JP5034912B2 (en) * | 2007-12-06 | 2012-09-26 | パナソニック株式会社 | Information input device, information input method, and information input program |
| US9513765B2 (en) | 2007-12-07 | 2016-12-06 | Sony Corporation | Three-dimensional sliding object arrangement method and system |
| US9588781B2 (en) | 2008-03-31 | 2017-03-07 | Microsoft Technology Licensing, Llc | Associating command surfaces with multiple active components |
| US10180714B1 (en) * | 2008-04-24 | 2019-01-15 | Pixar | Two-handed multi-stroke marking menus for multi-touch devices |
| US8799821B1 (en) | 2008-04-24 | 2014-08-05 | Pixar | Method and apparatus for user inputs for three-dimensional animation |
| US9665850B2 (en) | 2008-06-20 | 2017-05-30 | Microsoft Technology Licensing, Llc | Synchronized conversation-centric message list and message reading pane |
| US8402096B2 (en) | 2008-06-24 | 2013-03-19 | Microsoft Corporation | Automatic conversation techniques |
| JP4632102B2 (en) * | 2008-07-17 | 2011-02-16 | ソニー株式会社 | Information processing apparatus, information processing method, and information processing program |
| JP5670016B2 (en) * | 2008-07-22 | 2015-02-18 | レノボ・イノベーションズ・リミテッド（香港） | Display device, communication terminal, display device display method, and display control program |
| US8667419B2 (en) * | 2008-09-09 | 2014-03-04 | Applied Systems, Inc. | Method and apparatus for displaying a menu for accessing hierarchical content data including caching multiple menu states |
| GB2468884A (en) * | 2009-03-25 | 2010-09-29 | Nec Corp | User defined paths for control on a touch screen |
| US8839297B2 (en) * | 2009-03-27 | 2014-09-16 | At&T Intellectual Property I, L.P. | Navigation of multimedia content |
| US8799353B2 (en) | 2009-03-30 | 2014-08-05 | Josef Larsson | Scope-based extensibility for control surfaces |
| US9046983B2 (en) | 2009-05-12 | 2015-06-02 | Microsoft Technology Licensing, Llc | Hierarchically-organized control galleries |
| KR101364814B1 (en) | 2009-06-16 | 2014-02-19 | 인텔 코오퍼레이션 | Adaptive virtual keyboard for handheld device |
| BRPI0924538A2 (en) | 2009-06-16 | 2015-08-11 | Intel Corp | Camera applications on a portable device |
| CN101692196B (en) * | 2009-08-25 | 2012-10-10 | 宇龙计算机通信科技(深圳)有限公司 | Window arranging method and system |
| JP5411733B2 (en) * | 2010-02-04 | 2014-02-12 | 株式会社Ｎｔｔドコモ | Display device and program |
| US8302014B2 (en) | 2010-06-11 | 2012-10-30 | Microsoft Corporation | Merging modifications to user interface components while preserving user customizations |
| JP2013101465A (en) * | 2011-11-08 | 2013-05-23 | Sony Corp | Information processing device, information processing method, and computer program |
| KR101340703B1 (en) | 2011-11-25 | 2013-12-12 | 삼성전자주식회사 | Device and method for arranging keypad in wireless terminal |
| JP2012080568A (en) * | 2011-12-02 | 2012-04-19 | Kyocera Corp | Portable terminal device and layout method of operation key group in the portable terminal device |
| CN103135825A (en) * | 2011-12-05 | 2013-06-05 | 冠捷投资有限公司 | Method of using touch module to edit screen display menu |
| US9448692B1 (en) * | 2012-03-12 | 2016-09-20 | Path Mobile Inc Pte. Ltd. | Graphical user interface for displaying menu options |
| KR101979666B1 (en) * | 2012-05-15 | 2019-05-17 | 삼성전자 주식회사 | Operation Method For plural Touch Panel And Portable Device supporting the same |
| US20140325437A1 (en) * | 2013-04-25 | 2014-10-30 | Samsung Electronics Co., Ltd. | Content delivery system with user interface mechanism and method of operation thereof |
| US10691291B2 (en) * | 2013-05-24 | 2020-06-23 | Samsung Electronics Co., Ltd. | Method and apparatus for displaying picture on portable device |
| CN107544737B (en) * | 2017-08-24 | 2020-08-04 | 网易（杭州）网络有限公司 | Information display method, medium, system and computing device |
| US11137891B2 (en) | 2017-10-09 | 2021-10-05 | Huawei Technologies Co., Ltd. | Display processing method and electronic device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5142618A (en) * | 1986-11-21 | 1992-08-25 | Hitachi, Ltd. | Window management apparatus for a document creating apparatus |
| JPS63184879A (en) * | 1987-01-28 | 1988-07-30 | Toshiba Corp | Picture processor |
| US5079695A (en) * | 1988-04-25 | 1992-01-07 | Hewlett-Packard Company | Object management facility which includes a snapshot facility for providing data transfer between two objects |
| US4896291A (en) * | 1988-05-20 | 1990-01-23 | International Business Machines Corporation | Valuator menu for use as a graphical user interface tool |
| US5179368A (en) * | 1989-11-09 | 1993-01-12 | Lippincott Douglas E | Method and apparatus for interfacing computer light pens |
| JPH03268157A (en) * | 1990-03-19 | 1991-11-28 | Toshiba Corp | Interaction device |
| JPH0756628B2 (en) * | 1990-10-22 | 1995-06-14 | 富士ゼロックス株式会社 | Graphical user interface editing device |
| JPH04205137A (en) * | 1990-11-30 | 1992-07-27 | Hitachi Ltd | Menu display system |
| JPH07104766B2 (en) * | 1991-10-28 | 1995-11-13 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Method and apparatus for displaying multiple objects from menu of data processing system |
| US5367624A (en) * | 1993-06-11 | 1994-11-22 | Consilium, Inc. | Interface for controlling transactions in a manufacturing execution system |
-
1992
- 1992-02-07 JP JP2260292A patent/JPH0785216B2/en not_active Expired - Lifetime
- 1992-11-19 CA CA002083329A patent/CA2083329A1/en not_active Abandoned
- 1992-12-17 TW TW081110127A patent/TW256895B/zh not_active IP Right Cessation
-
1993
- 1993-01-07 CN CN93100212A patent/CN1026628C/en not_active Expired - Lifetime
- 1993-01-07 KR KR1019930000135A patent/KR970002382B1/en not_active IP Right Cessation
- 1993-01-11 US US08/006,271 patent/US5559944A/en not_active Expired - Fee Related
- 1993-01-12 BR BR9300118A patent/BR9300118A/en unknown
- 1993-02-01 EP EP93300707A patent/EP0555034B1/en not_active Expired - Lifetime
- 1993-02-01 DE DE69321626T patent/DE69321626T2/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| DE69321626D1 (en) | 1998-11-26 |
| EP0555034A3 (en) | 1994-04-27 |
| KR930018408A (en) | 1993-09-21 |
| CN1075220A (en) | 1993-08-11 |
| CN1026628C (en) | 1994-11-16 |
| DE69321626T2 (en) | 1999-06-17 |
| JPH05282115A (en) | 1993-10-29 |
| TW256895B (en) | 1995-09-11 |
| KR970002382B1 (en) | 1997-03-03 |
| JPH0785216B2 (en) | 1995-09-13 |
| EP0555034A2 (en) | 1993-08-11 |
| EP0555034B1 (en) | 1998-10-21 |
| US5559944A (en) | 1996-09-24 |
| BR9300118A (en) | 1993-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2083329A1 (en) | Menu display system and method | |
| US5864330A (en) | Method and apparatus for providing a two-dimensional position-sensitive scroll icon in a data processing system user interface | |
| EP0797140A1 (en) | Use of a virtual boundary on a tablet for cursor control | |
| US5821930A (en) | Method and system for generating a working window in a computer system | |
| US6069626A (en) | Method and apparatus for improved scrolling functionality in a graphical user interface utilizing a transparent scroll bar icon | |
| US7712046B2 (en) | Virtual magnifying glass with intuitive use enhancements | |
| RU2407992C2 (en) | Improved mobile communication terminal and method | |
| EP0597379B1 (en) | Pen input processing apparatus | |
| JP3234633B2 (en) | Information processing device | |
| US6643824B1 (en) | Touch screen region assist for hypertext links | |
| US5502803A (en) | Information processing apparatus having a gesture editing function | |
| US7451408B2 (en) | Selecting moving objects on a system | |
| USRE36137E (en) | Instruction input system for electronic processor | |
| US8402386B2 (en) | Method and apparatus for two-dimensional scrolling in a graphical display window | |
| US5655093A (en) | Intelligent screen cursor | |
| EP0422577A2 (en) | Method and apparatus for displaying simulated keyboards on touch-sensitive displays | |
| US5568604A (en) | Method and system for generating a working window in a computer system | |
| US20070038955A1 (en) | Pen-based computer system having first and second windows together with second window locator within first window | |
| EP0194442B1 (en) | Method for manipulation of graphic sub-objects in an interactive draw graphic system | |
| EP0159400A1 (en) | Display terminal with a cursor responsive virtual distributed menu | |
| KR930001926B1 (en) | Display control method and apparatus | |
| US20080129712A1 (en) | Pen-based computer system having variable automatic scroll | |
| US5877761A (en) | Method for smooth scrolling of text using window | |
| EP0156116A2 (en) | Method of, and system for, varying adjacent view port sizes on a display screen | |
| KR100603924B1 (en) | Screen display method for computer with pointing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |