CA2077173C - Method and apparatus for direct manipulation of 3-d objects on computer displays - Google Patents

Method and apparatus for direct manipulation of 3-d objects on computer displays Download PDF

Info

Publication number
CA2077173C
CA2077173C CA002077173A CA2077173A CA2077173C CA 2077173 C CA2077173 C CA 2077173C CA 002077173 A CA002077173 A CA 002077173A CA 2077173 A CA2077173 A CA 2077173A CA 2077173 C CA2077173 C CA 2077173C
Authority
CA
Canada
Prior art keywords
transform
displayed object
rotation
translation
bounding box
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CA002077173A
Other languages
French (fr)
Other versions
CA2077173A1 (en
Inventor
Michael Chen
Stephanie L. Houde
Robert H. Seidl
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Computer Inc filed Critical Apple Computer Inc
Publication of CA2077173A1 publication Critical patent/CA2077173A1/en
Application granted granted Critical
Publication of CA2077173C publication Critical patent/CA2077173C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/12—Bounding box
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Abstract

A method and apparatus for direct manipulation of 3-D objects on computer displays is described. This method and apparatus provides for a 3-D bounding region wherein the 3-D bounding region has sensitive areas which the user can select with a reference pointer such that when the user manipulates the reference pointer after selecting a sensitive area the 3-D
bounding region and the objection within it are manipulated with direct kinesthetic correspondence between the user's manipulation of the reference pointer and the bounding region and object manipulation.

Description

1 ,~ i P.~ ~ ~ Yi ~1 s. l.I ~;.3 METHOD AND APPARATUS FOR DIRECT MANIPULATION

FIELD OF THE INVENTION
The present invention relates to the field of manipulation of 3-D
objects on computer displays. More specifically, the present invention relates to the field of manipulation of a 3-D object displayed on a computer display with kinesthetic feedback to the user directing the manipulation.
BACKGROUND OF THE INVENTION
Many prior art computer systems include computer controlled display systems which utilize bit-mapped displays which typically present a graphic image to the user of the computer system. In these computer controlled display systems, a bit-mapped image appears on a display means, such as a cathode ray tube (CRT) or liquid crystal display (LCD); the bit-mapped image is typically generated and stored in a frame buffer which acts as a memory for the display system. In these display systems, the user typically interacts with the computer system by manipulating a cursor control means, such as a mouse. The user uses the mouse to position a cursor on the bit-mapped image to select options which are displayed under the control of the computer system on the display means.

Advances in computer graphics have extended the range of capabilities for the user. Objects can now be displayed in three-dimensional (3=D) representation, for example in wireframe, solid and/or shaded forms.
While 3-D trackball input controller devices (or other 3+ dimensional input controller devices) have been utilized for manipulating objects displayed in 3-D representation, they are generally complex and expensive.
Various techniques utilizing two-dimensional (2-D) input controllers such as a mouse have been developed for manipulating objects displayed in 3-D representation.
A known technique utilizes graphically displayed X, Y, and Z sliders which are adjusted by the user (for example, with an input controller such as a mouse) to indicate the amount of rotation about each axis independently.
Typically, only one slider is adjusted at any given time.
Another known technique involves the menu selection of the axis about which rotation is desired. An input controller such as a mouse is then moved in one dimension to indicate the amount of rotation.
Still another technique involves holding down one of three buttons on a mouse or a keyboard to select the axis of rotation, and then moving a mouse in one dimension to indicate the amount of rotation.
,r~ ry Mf "'j '~ N~~ "~.;,'y 3 ~i : 'd A still further technique involves selecting the object by clicking on it with the mouse pointer and again using the mouse pointer to drag a handle on the selected object in order to move, re-shape, re-size, or rotate the object.
Oftentimes, with 3-D objects, only one or two dimensions can be altered with any given handle and rotation only occurs around a central point in a world 3-D space as opposed to rotation around the centerpoint (or other axis) of the 3-D object itself (sometimes referred to as model space).
An even further technique involves selecting a 3-D object by clicking on it with the mouse pointer, using the mouse pointer to make a menu selection as to a predefined type of movement option desired and again using the mouse pointer to drag a handle on the selected object in order to define a movement of the selected predefined type of movement. Typically, with 3-D
objects, only one predefined type of movement is available at a time in what is commonly known as a modal form of operation.
An important consideration with known techniques for manipulating displayed objects represented in 3-D form is the lack of kinesthetic correspondence (or stimulus-response compatibility) between the movement of the input controller device and the object movement or direction of object rotation. That is, the required movement of the input controller device does not provide the sense of directly manipulating the displayed object. Stated differently, known techniques for manipulating displayed objects represented y r~ ~~ ~. ~~' in 3-D form typically lack direct manipulation kinesthetic correspondence whereby the 3-D displayed object being manipulated continuously moves (is continuously re-displayed) with the mouse controlled pointer directing the manipulation so that the pointer may remain on the same location of the displayed 3-D object throughout the manipulation.
A still further consideration is the inherent limitation of the modal form of 3-D object manipulation which further separates the user's expectations regarding moving a real world 3-D object from the experience of moving an image of the 3-D object on a computer display due to having to either select between alternative manipulation modes and/or operate in different windows each containing different views of the object to be manipulated.
,~ a SUMMARY AND OBTECTS OF THE INVENTION
An objective of the present invention is to provide an improved technique for manipulating objects displayed in 3-D representation with 2-D
input controller devices which provides for kinesthetic correspondence between input controller motion and displayed object movement.
Another objective of the present invention is to provide an improved technique for intuitively manipulating displayed 3-D objects such that the displayed 3-D object manipulation emulates physical 3-D object manipulation.
A still further objective of the present invention is to provide an improved technique for manipulation of displayed 3-D objects which provides for de-coupled object rotation, both homogenous and non-homogenous object scaling and object translation on a plane of the 3-D space.
An even further objective of the present invention is to provide an improved technique for manipulation of displayed 3-D objects which provides for seamless transition from one type of object manipulation to another type of object manipulation whereby explicit manipulation tools need not be selected between the object manipulations.
w~ e~ ~'a '~ ~~, '~~
Another objective of the present invention is to provide an improved technique for manipulation of displayed 3-D objects which provides the user with visual clues as to the manipulations available and to the means to facilitate such manipulations.
The foregoing and other advantages are provided by a method for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, the method comprising the steps of providing a user actuated input controller for selectively positioning a reference indicator on the display, positioning the reference indicator over the displayed object and signaling the computer to activate a control movement mode, providing a three-dimensional representation of a bounding region, positioning the reference indicator over a portion of the bounding region sensitive to the presence of the reference indicator, signaling the computer to activate a predefined control movement type specified by the sensitive portion of the bounding region under the reference indicator and repositioning the reference indicator to define a movement of the predefined control movement type, and re-displaying the displayed object in accordance with the defined movement of the predefined control movement type.
The foregoing and other advantages are provided by an apparatus for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, the apparatus comprising means for positioning a reference indicator over the displayed object anci6signaling the computer to activate a control movement mode, means for generating a three-dimensional representation of a bounding region, means for signaling the computer to activate a predefined control movement type specified by the sensitive portion of the bounding region under the reference indicator and repositioning the reference indicator to define a movement of the predefined control movement type, and means for re-displaying the displayed object in accordance with the defined movement of the predefined control movement type.
Accordingly, in one aspect, the present invention provides a method for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, comprising: providing a user actuated input controller signal for selectively positioning a reference indicator on the display; positioning the reference indicator over the displayed object and signaling the computer to activate a control movement mode; providing on the display a three-dimensional representation of a bounding region including at least two portions which specify respective predefined control movement types, one of said types being rotation around an axis parallel to the portion which specifies rotation around that axis; positioning the reference indicator over one of said portions; signaling the computer to activate a predefined control movement type specified by the portion of the bounding region under the reference indicator, and while the reference indicator is over said portion, repositioning the reference indicator to define a movement of the specified type; and re-displaying the displayed object in accordance with the defined movement of the specified type.
In a further aspect, the present invention provides a method for manipulating an object displayed in three-dimensional representation on a computer controlled video display system having a computer, a video display and a mouse, comprising: selecting the displayed object by using the mouse to position a pointer over the displayed object and pressing a button on the mouse; displaying a three-dimensional representation of a bounding box having at least two active zones which specify respective available movement types, one of said types being rotation around an axis parallel to the zone which specifies rotation around that axis, when the displayed object is selected; defining a movement of a type predefined by one of the active zones by using the mouse to position the pointer over an active zone, pressing the button on the mouse, and, while the pointer is over the active zone, repositioning the pointer with the mouse; and re-displaying the bounding box and the displayed object in accordance with the defined movement.
In a further aspect, the present invention provides an apparatus for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, the apparatus comprising: means for positioning a reference indicator over the displayed object and signaling the computer to activate a control movement mode; means for generating on the display a three-7a dimensional representation of a bounding region including at least two portions which specify respective predefined control movement types, one of said types being rotation around an axis parallel to the portion which specifies rotation around that axis; means for signaling the computer to activate a predefined control movement type specified by a portion of the bounding region under the reference indicator; means for repositioning the reference indicator while the reference indicator is over the portion of the bounding region to define a movement of the predefined control movement type; and means for re-displaying the displayed object in accordance with the defined movement of the predefined control movement type.
In a still further aspect, the present invention provides an apparatus for manipulating an object displayed in three-dimensional representation on a computer controlled video display system having a computer, a video display and a mouse, the apparatus comprising: means for selecting the displayed object by using the mouse to position a pointer over the displayed object and pressing a button on the mouse; means for displaying a three-dimensional representation of a bounding box having at least two active zones which specify respective available movement types, one of said types being rotation around an axis parallel to the zone which specifies rotation around that axis, when the displayed object is selected; means for defining a movement of a type predefined by one of the active zones by using the mouse to position the pointer over an active zone, pressing the button on the mouse, and, while the pointer is over the active zone, repositioning the pointer with the mouse; and 7b means for re-displaying the bounding box and the displayed object in accordance with the defined movement.
Other objects, features, and advantages of the present invention will be apparent from the accompanying drawings and from the detailed description which follows.
7c BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which:
FIG. 1 depicts a generalized block diagram of a computer system as might be used by the present invention;
FIG. 2 depicts the object model coordinate system as used by the present invention;
FIG. 3 depicts a 3-D representation of an object and some alternative embodiments of an object surrounded by a bounding box;
FIG. 4 depicts the active zone layout of the preferred embodiment of the present invention and some of the object and bounding box manipulations supported by the present invention;
FIG. 5 is a flowchart depicting the sequence of steps preparing to handle a user manipulation;
FIG. 6 is a flowchart depicting the translation manipulation sequence of steps;

~. . .., ,.-~ .y ': ~ '.;%
i 2 ~ .I. i :a FIG. 7 is a flowchart depicting the rotation manipulation sequence of steps;
FIG. 8 is a flowchart depicting the scaling manipulation sequence of steps;
FIG. 9 is a flowchart depicting the sequence of steps to re-display a manipulated object and bounding box;
FIG. 10 depicts the transformation relationships of the present invention;
FIG. 11 depicts the further visual clues of a changing pointer as provided by alternative embodiments of the present invention;
FIG. 12 depicts the further visual clues for a rotation manipulation as provided by alternative embodiments of the present invention;
FIG. 13 depicts the further visual clues for a translation manipulation as provided by alternative embodiments of the present invention;
FIG. 14 depicts the active zone layout and determination of which active zone was selected by the user;

,w r~ 1~
FIG. 15 depicts the indexing scheme of the active zone layout and determination of which active zone was selected by the user;
FIG. 16 depicts the polarity of the selected bounding box face of the present invention;
FIG. 17 depicts the translate-pull manipulation alternative embodiment of the present invention;
FIG. 18 depicts the rotation manipulation determination of the preferred embodiment of the present invention;
FIG. 19 depicts the scaling manipulation determination of the preferred embodiment of the present invention.
6~ ,i ~ ' ~ ~ ~ " v~~
tml La :t DETAILED DESCRIPTION
The present invention generally involves the manipulation of a computer displayed object represented in three-dimensional form, and it would be helpful to provide a brief discussion of the pertinent computer environment. Figure 1 is a generalized block diagram of an appropriate computer system 10 which includes a CPU/memory unit 11 that generally comprises a microprocessor, related logic circuitry, and memory circuits. A
keyboard 13 provides inputs to the CPU/memory unit 11, as does two-dimensional input controller 15 which by way of example can be a mouse, a 2-D trackball, a joystick, a stylus, a touch screen, a touch tablet, etc. Disk drives .
17, which can include fixed disk drives, are used for mass storage of programs and data. Display output is provided by a video display 19.
Referring now to Figure 2, the object viewed on the video display 19 can be referenced for convenience relative to an orthogonal coordinate system (having X, Y and Z axes) called the model coordinate system (or model space) that has its origin at the center of rotation of the object.
For ease of understanding, the following discussion will be in the context of using a two-dimensional input controller 15 that is a mouse (used in the preferred embodiment of the present invention), but it should be readily appreciated by those skilled in the art that the disclosed techniques can c b : % > ~~ .?
be implemented with other 2-D or 3-D (or even greater numbers of dimensions) input controller devices.
A mouse controls the position of a mouse pointer (e.g., a reference indicator such as a cursor) that is displayed on the video display. The pointer is moved by moving the mouse over a flat surface, such as the top of a desk, in the desired direction of movement of the pointer. Thus, the two-dimensional movement of the mouse on the flat surface translates into a corresponding two-dimensional movement of the mouse pointer on the video display.
A mouse typically has one or more finger actuated control buttons.
While the control buttons can be utilized for different functions such as selecting a menu option pointed to by the pointer, the disclosed invention advantageously utilizes a single mouse button to select a 3-D object and to trace the movement of the pointer along a desired path. Specifically, the pointer is located at the desired starting location, the mouse button is depressed to signal the computer to activate a control movement mode, and the mouse is moved while maintaining the button depressed. After the desired path has been traced, the mouse button is released. This procedure is sometimes referred to as dragging the mouse pointer. It should be appreciated that a predetermined key on a keyboard could also be utilized to activate dragging the mouse pointer.

(y y~~ w~ ~'Z.
In the present invention, when a 3-D object displayed on a visual display of a computer system is selected by the user, a 3-D "virtual box" or "bounding box" appears on the visual display such that the bounding box completely surrounds the 3-D object. One might view the bounding box as a glass box enclosing the selected object. The bounding box thus signals the user that the 3-D object has been selected. Further, the bounding box allows for direct manipulation of the enclosed 3-D object as will be explained below Note that it is well within the scope of the present invention to provide a bounding region having a shape other than a generally rectangular or box shape. Such a bounding region could be of any of a great number of shapes including oblong, oval, ovoid, conical, cubic, cylindrical, polyhedral, spherical, etc.
Direct manipulation of the 3-D object, which manipulation generally comprises moving, scaling, or rotating the object, can be accomplished in different ways depending upon which embodiment of the present invention the user has chosen and which implementation is supported by a given computer system.
Referring now to Figure 3, a 3-D representation of an object 301, in this case a wing back chair, is shown as displayed on the visual display of a computer system. When the user selects chair 301, by moving the mouse until the pointer 302 is on the chair and clicking on the chair by pressing the mouse button (or using a keyboard equivalent), the chair is surrounded by a .-., y ~ °~ ~e ,y°,_ :;
bounding box 303. Alternative embodiments include a bounding box 305 with hands, a bounding box 307 with handles, and a bounding box 309 with active zones (or hot zones), as is explained more fully below.
In the preferred embodiment of the present invention, the bounding box 303, which appears as a result of the user selecting the 3-D object 301 and as was stated above, is a 3-D transparent box which completely surrounds the selected 3-D object 301. The bounding box 303 is thus, at a minimum, a visual clue to the user that the 3-D object has been selected.
With the bounding box 305 with hands embodiment, the user is given further clues as to what manipulations are possible with the selected object.
Not only is the user informed that the 3-D object 301 has been selected, but the user is also given indications as to what manipulation operations might be possible with the selected object. The top hand 311 of the bounding box 305 appears to be pulling the bounding box up (or pushing down or both) and thus indicates to the user that the 3-D object can be lifted. The hands 313 around the base of the bounding box 305 with hands appear to be pushing or pulling the bounding box around in a circle and thus indicate to the user that this 3-D object can be spun around if so desired.
A similar situation exists with the bounding box 307 with handles.
Again, the user is given clues as to what manipulation operations might be possible with the selected object. The top handle 315 of the bounding box 307 G~ '1:~ a , u° ~k-= ~.~
appears to be available for grabbing and pulling the bounding box up (and/or pushing the bounding box down) and thus tells the user that the 3-D object can be lifted up or down. The handles 317 around the base of the bounding box 307 appear to be available for pushing or pulling the bounding box around in a circle and thus tell the user that this 3-D object can be spun around if so desired.
With the bounding box 309 with active zones, the user is given different clues (and, as will be explained below, some of these clues are user selectable to thus lessen any visual busyness which may exist with the visible active zones). Again, the bounding box tells the user that the 3-D object has been selected. Further, additional lines on the bounding box tell the user that there are different active, or hot, zones available to be used.
Placement of manipulation controls directly on the bounding box in positions which mirror those places one would touch a similarly shaped object in the real, physical world makes interaction with the displayed 3-D
object more intuitive. In the preferred embodiment of the present invention, the location of the rotation controls along the edges of the bounding box (where two faces meet) provides users with particularly intuitive rotation control based on the user's real world experiences. It is common to turn real world objects by grabbing onto a good "hand-hold" such as an exposed corner and pushing or pulling the objects around in a desired direction. The edges of a real box shaped object thus function as hand holds rotation. Similarly, the ~~.~:~~;..,:~ ~o . ~ ill a, .a. n Gd edges of the bounding box function as intuitive "cursor holds" for rotation.
Users intuitively "push" or "pull" on the edges of the displayed bounding box with the reference pointer to achieve object rotation.
Still further embodiments of the present invention would further support spring-loaded object manipulations (as is explained below) by providing additional manipulation clues to the user. Figure 11 shows the pointer changing to a curved arrow indicating rotation manipulations in the case of a rotation active zone selection, to crossed arrows indicating the plane of movement in the case of a translation active zone selection and to an enlarging arrow indicating that dimensions are to be affected in the case of a scaling active zone selection. Figure 12 shows a selected object's bounding box 1201 of the preferred embodiment of the present invention displaying a circle 1203 (or ellipse when the object and bounding box are in a perspective view) when a rotation active zone is selected to thus indicate the rotation possibilities with a given rotation active zone. The displayed circle 1203 could further display a curved arrow 1205 around a portion of the circumference of the displayed circle 1203 to thus signal the user as to the manipulations possible with the selected rotation active zone. Similarly, with translation manipulations, Figure 13 shows a translucent plane 1301 which would be displayed to thus indicate the plane of translation available with a given selected translation active zone. Again, with spring-loaded active zones (further explained below), whenever the user stops pressing the mouse ,., ,, e~ ~') ~Fd'U t~~ ,.A ~' ~ s~
button the manipulation icon or rotation circle would no longer be displayed and the original pointer would again be displayed.
Referring now to Figure 4, a bounding box with active zones 401 is shown. It should be appreaated by one with ordinary skill in the art of the present invention that although the preferred embodiment of the present invention utilizes a bounding box represented as a wireframe with no back lines visible and with the object remaining visible within the bounding box (e.g., bounding box 309 in Figure 3), the back lines of the bounding box could also be displayed or the bounding box could even be displayed as a solid (no back faces or lines visible) with the object inside either visible (a transparent solid bounding box), not visible (an opaque solid bounding box), visible yet faint or greyed out (a translucent solid bounding box), etc., all as alternative embodiments which could be user selectable. Note, however, that no object is shown within the bounding box in the figure so as to avoid any potential visual clutter (which option could be user selectable in a still further alternative embodiment of the present invention).
In the preferred embodiment of the present invention, each faee of the bounding box with active zones 401 is divided into 9 active zones. Clicking the pointer in any one of these active zones and dragging will result in moving, rotating, or scaling the bounding box (along with the 3-D object within the bounding box) depending upon which active zone is selected.

The bounding box 401 with active zones allows various paradigms for 3-D object manipulation. To scale the 3-D object the user grabs a corner of the bounding box and pulls. To rotate the 3-D object the user grabs an edge of the bounding box turns the bounding box. To move (translate) the 3-D object the user grabs a face of the bounding box and slides the bounding box.
And again, with a bounding box, the user need not worry about where to grab a particular 3-D object (regardless of object shape) in order to perform any one of the desired manipulations because the bounding box provides a consistent user interface across all object shapes. For example, if the 3-D
object is a floor lamp, the user need not worry about whether it is "proper" to pick up the lamp by the shade, the base, or the pole. This is because the bounding box consistently defines the available actions and means to perform those actions. In other words, when faced with individual objects of varying shapes and contours, etch user has a different idea of how the object should be "touched" with the reference pointer in order to directly manipulate the object. By allowing the user to control any object by directly manipulating the object's 3-D bounding box upon selection, the user need only learn how to interact with that one simple box shape. This provides for a consistent approach and interface to controlling any object shape. Furthermore, the interface is reinforced by each object manipulation.
Still further, the use of a 3-D bounding box improves user perception of the virtual 3-D screen space in which are objects are displayed. When '-1 re~ , ~ Fx..4, ~~
d viewing 3-D projections of objects on a flat 2-D screen space, it is oftentimes difficult for users to perceive the depth and volume of objects. The wire frame bounding box has a contour that is more easily understood as a 3-D
object by the user than are other more complex or subtly shaped objects.
The bounding box with active zones 401, as shown in Figure 4, shows the manipulations possible by clicking and dragging in the various active zones. The chosen operation (scale, rotate, or move) is determined by the active zone in which the user clicks. The axis or axes along which the bounding box is scaled, rotated, or translated is/are chosen according to the particular active zone and face which is clicked on.
Further, it is important to note that these manipulations are not limited to only one face of the 3-D object but rather are available for each visible face (which can range from one to three faces depending upon the current orientation of the 3-D object). It is also important to note that the particular manipulations for each active zone (as well as the number and type of active zones) could be user selectable such that the corner active zones, for example, perform rotation manipulations instead of scaling manipulations as is shown in the embodiment of Figure 4. Furthermore, in the preferred embodiment of the present invention, the visible lines delineating the active zones on the bounding box are optionally drawn a user settable distance or percentage in from each face edge of the bounding box (the "inset" as is explained more fully below) thus providing users with an explicit view of the active zone layout as well as allowing users to alter the relative sizes of the active zones. It should be appreciated by one with ordinary skill in the art that alternative active zone layouts and locations as well as having greater or fewer active zones (or to not show the active zones on the bounding box) is well within the scope of the present invention.
Bounding box with active zones 403 shows some of the move or translate manipulations available by clicking and dragging on the move active zone of the left front face of bounding box 401. The move manipulation allows moving the bounding box along with the 3-D object inside across the plane of the chosen face of the bounding box. Note that the bounding box 403 with active zones can be moved anywhere within the chosen plane and is not limited to the direction of the arrows in the figure.
Note that in an alternative embodiment object translation would occur relative to the location of another 3-D object. In this way, manipulation of a 3-D object in a room model space would be performed relative to the object's "resting plane" which would be the floor of the room in the case of a chair object but would be a wall in the case of a hanging picture object.
Furthermore, in this alternative embodiment, translations would be limited to sliding in two dimensions parallel to the resting plane and lifting would be limited to a path perpendicular to the floor.

c~ .;, ~ ., i :,~, _.. ~'. ' ;.>t ~:>
Bounding boxes 405 and 407 with active zones show some of the rotate manipulations available by clicking and dragging on the rotate active zones of the left front, top, or right side faces of the bounding box 401 with active zones. The rotate manipulation allows rotating the bounding box along with the 3-D object inside around one of the three axes of the bounding box and the object within it. Bounding box 405 depicts rotation around the object's Y axis using the left or right active zones. Bounding box 407 depicts rotation around the object's X axis using the top or bottom active zones. Note that the rotation active zones are arranged so that clicking on either side near an edge will result in rotations around the same axis which makes the selection less sensitive to minor locational inaccuracies by the user and also provides for greater user interface consistency.
The preferred embodiment of the present invention provides for de-coupled rotations about the three (X, Y and Z) axes. De-coupled rotations require rotations to occur around a single axis at a time. In many 3-D object manipulation tasks (for example, arranging a scene containing a number of objects), rotating objects around a single axis at a time can be more intuitive than dealing with a coupled rotation around an arbitrary axis in 3-D space because rotating objects around a single axis at a time provides a more predictable object orientation manipulation.
Bounding box 409 with active zones shows some of the scaling manipulations available by clicking and dragging on the scaling active zones on the left front face of bounding box 401. The scaling manipulation allows re-sizing the bounding box along with the 3-D object inside across one or two dimensions of the chosen face of the bounding box. Of course, re-sizing the bounding box along with the 3-D object it contains across one or two dimensions of the chosen face alters the relative dimensions of the bounding box and object and is thus a non-homogenous scaling operation. An alternative embodiment of the present invention (user selectable by e.g., depressing a key on the keyboard, making a menu selection, setting a preference option, etc.) provides re-sizing (as opposed to re-shaping) the bounding box along with the object it contains across all three dimensions thus maintaining the relative dimensions of the bounding box and object and is thus a homogenous scaling operation. Please note that homogenous scaling operations would also tolerate greater user active zone selection inaccuracies because the same re-sizing operation would result from selecting any one of the up to three (depending upon bounding box orientation) displayed scaling active zones of a given bounding box corner.
In the preferred embodiment of the present invention, the bounding box with active zones thus provides what might be termed nine degrees of freedom: movement in three directions (up to two concurrently); rotation about any one of the three axes; and scaling along three directions.
Note that displaying the active zones of bounding box 401 (and bounding box 309 of Figure 3) could be user selectable. Displaying the lines ,~ >:.A f: : ~ °~
i :~ ~1 B
delineating the active zones could be used as a beginner mode which the user could turn off after becoming more experienced. In this way, when the user has become more proficient with 3-D object manipulation via bounding boxes with active zones, visually delineating the separate active zones could be turned off and the bounding box with active zones could be displayed as merely a bounding box as in 303 of Figure 3. A more proficient user, who would likely be working with more complex 3-D objects, could thus choose simpler bounding boxes without delineated visible active zones.
An advantage of the bounding box with active zones (whether visible or not) is its lack of fixed modality. With the active zone bounding box implementation (and also with the alternative embodiments depicted in Figure 3), it is not necessary to explicitly enter a "rotation mode," a "scaling mode,' or a "move mode," via special commands, keystrokes, or palette selections. Instead, each transient "mode" is merely a temporary condition which is entered "on-the-fly" by clicking on one of the active zones (or handles in the alternative embodiments) and is exited by releasing the mouse button and might thus be termed "spring-loaded." Thus the particular manipulation "mode" chosen is only active while the mouse button remains pressed down.
This lack of fixed modality can speed up user interaction because a translation (move) can immediately follow a rotation, for example, without requiring extra user actions that might break the flow of interaction or the .,1 6., I~ y,,, ~~.i ~ ~i Y~ ~~
user's train of thought. Obviously, the less the user has to stop and think about how to do that which the user wishes to do, the more intuitive, seamless and simple it is for the user to complete the desired task.
Furthermore, the preferred embodiment of the present invention allows these various sequential manipulations of the selected object to all be performed within a single window on the computer's display. In this way, the user need not worry about whether the current window is the right window for a particular manipulation type.
Still further, the bounding box provides direct manipulation capability which further increases its intuitiveness. Because the manipulation, be it moving, scaling, or rotating, is constrained to only one or two of the three possible axes of the 3-D object, every position on,the screen specifies exactly one particular movement, rotation, or scaling value. If the user keeps the pointer "pinned" to the spot on the bounding box originally clicked, the bounding box will appear to smoothly track the pointer movement. This thus further provides the desired kinesthetic feedback of direct locational coupling between the user motion and the 3-D object display motion which thus increases user intuitiveness.
Still further, it should be appreciated that the manipulations of the present invention are performed in an absolute sense rather than in a relative sense. An absolute manipulation bases the current object position on the difference between the current object position and the original object ~~ .fi~ ri .~ Y"~ ~~
~d ~~ ~i position. Stated differently, the transformation for an absolute manipulation is a gross determination of the current position versus the original position of all of the object movements made by the current manipulation. Conversely, relative manipulations determine the current object position as an incremental difference from the previous object position. Stated differently, the transformation for a relative manipulation is an incremental determination of the current position versus the last position, or each small incremental object movement made by the current manipulation. The importance of using absolute manipulation determinations is the improved user intuitiveness. The improved user intuitiveness is due to the result of absolute determinations wherein when a user returns the pointer to the original location in an object manipulation, the object is returned to its original orientation because the gross difference is zero. Conversely, if relative determinations were used, the user could return the pointer to the original location in an object manipulation yet the object might not return to its original orientation because the incremental differences might not be zero.
The ability of the present invention to always return the object being manipulated to its original orientation if the user returns the pointer to the starting point of the manipulation thus provides greater user intuitiveness.
Therefore, absolute manipulation determinations provide an "on the fly"
undo capability because the user is able to undo an object manipulation by merely returning the pointer to its starting point.

'1 :~d~ :~Y .1.Y .:.3 Generally, in the art of the present invention, the object to be manipulated is either in world space coordinates or in model space coordinates which are passed through transforms in order to reach world space coordinates as is explained more fully below (and either way the object must also pass through a viewing transform as is well known in the art) in order to be displayed. In the preferred embodiment of the present invention, the object is stored in model space coordinates in order to facilitate more efficient manipulation calculations. Therefore, the object must first pass through a transformation, which translates the object to world space, before being displayed on the computer display.
In the preferred embodiment of the present invention, this transformation from model space to world space is represented as three separate transformations; one for scaling, at least one for rotation (alternative embodiments support multiple rotation transforms, as is explained more fully below), and one for translation. The concatenation (in this order, as will be explained below with reference to Figure 10) of these three transforms forms the complete transformation from model space to world space.
The scale and translation transforms, in the preferred embodiment of the present invention, are separately stored as 3-D vectors and the rotation transform is stored as a 3 x 3 matrix. Storing the transforms separately allows changing any component of the three separate transforms without affecting the other transforms. The alternative (storing a single transformation ., r :.
i~ ~ ,~ .~
matrix) is less efficient because it would require additional matrix computations.
As was explained above, in the preferred embodiment of the present , invention, after an object has been selected and the bounding box is displayed the user can manipulate the bounding box and the object it contains by clicking on one of the spring-loaded active zones and dragging the bounding box in the desired direction of manipulation. Referring to Figure 5, the user manipulation steps will now be described. After the object has been selected and the mouse button is again pressed 501, the next determination that needs to be made is whether the user is selecting an active zone in order to manipulate the bounding box and object or, alternatively, the user is de-selecting the bounding box. The x and y coordinates of the pointer location when the user pressed the mouse button down are used to create a ray from the eyepoint into the screen at that x,y pointer location 503.
Please note that creation of such a ray is well known in the art and utilizes a basic formula that many ray tracing image generation schemes use.
In those schemes, the screen plane is scanned and a viewing ray is created for each pixel of the image. In the preferred embodiment of the present invention, such a ray is created after each mouse button click when an object is selected.

ey y.,1 io .' -;.,~
~i.
Then, because the object is maintained in model space and the calculations in the preferred embodiment of the present invention are performed in model space (which is computationally more efficient), the ray is transformed into model space 505. The ray is defined by its origin, which is equal to the camera position or "eyepoint,° and its direction. The direction vector of the ray is constructed by concatenating the vector (x,y,vd) with the x 3 submatrix of M, where vd is the viewing distance (the distance from the projection plane to the eyepoint of the virtual camera) and M is the transpose of the 4 x 4 viewing matrix of the virtual camera. The ray is then transformed into the object's local coordinate system (model space) by multiplying both the ray's origin and direction with the inverse of the current transformation matrix (formed by concatenating the three transforms, one for each of scale, rotate and translate, as is explained more fully below).
Once the ray from the eyepoint into the screen at x,y is transformed into model space it can then be determined whether the user had the pointer placed over the bounding box when the mouse button was pressed (to thus perform a manipulation). This is accomplished by finding the nearest intersection of the bounding box with the ray 507. Given a viewing ray (origin and direction) in 3-D space, a 3-D axis-aligned bounding box (where the planes/faces of the bounding box are perpendicular to the coordinate axes;
note that this is also known as "canonical") with extents given by boxMin and boxMax (the coordinate-wise numerical minima and maxima, respectively, of the bounding box), and a 4 x 4 modeling transformation on the bounding box t~ ~,~ Ya 'h .s~ V~-, ,~
(in the preferred embodiment of the present invention a concatenation of a scaling, a rotation and a translation transformation as was explained above and as will be further explained below), finding the intersection of the ray with the nearest face of the bounding box is a relatively simple matter which is well known in the art (see e.g., "Fast Ray-Box Intersection" by Andrew Woo, in Graphics Gems, Andrew Glassner, ed., Academic Press, 1990, or "Essential Ray-Tracing Algorithms" by Eric Haines, in An Introduction to Ray Tracin Andrew Glassner, ed., Academic Press, 1989).
In the preferred embodiment of the present invention and as was explained above, instead of intersecting the original viewing ray with a plane of the transformed bounding box, the viewing ray is inverse-transformed into the model space of the axis-aligned bounding box. This causes intersections to then occur with axis-parallel planes which thus simplifies the calculations.
In the preferred embodiment of the present invention, a 3-D version of the Woo algorithm described in Graphics Gems (citation above) is used. Furthermore, only those faces of the box visible to the virtual camera need to be tested for intersection. Thus, there is at most one intersection between the visible faces and the viewing ray. The position of this intersection point, as well as a number of other variables as discussed below with respect to particular manipulations, is then recorded. Please note that in an alternative embodiment the dimensions of the face planes are extended slightly outward when the intersection calculations are performed because some users might ' ~~~~J~aj.~~
expect to hit a bounding box edge even when they hit close to the edge yet are still just outside the bounding box.
If no face of the bounding box is hit by the ray (no intersection is found between the viewing ray and any visible face of the bounding box), which merely means the user moved the pointer to another area of the screen before pressing the mouse button, then in the preferred embodiment of the present invention the object is de-selected and the bounding box would disappear ("stop" at step 509).
Conversely, if a face of the bounding box is hit by the ray (there is an intersection between the viewing ray and a visible face of the bounding box), then in the preferred embodiment of the present invention the intersection points in the 2-D coordinate space of the face that was hit are used to determine which and what type of active zone was hit.
In the preferred embodiment of the present invention each face of the bounding box is subdivided into nine active zone rectangular subregions which thus makes it a simple matter to determine in which of the nine regions the hitpoint lies 511. In the preferred embodiment of the present invention, an index scheme is used to indicate which active zone was selected. Referring now to Figure 14, because it is already known that a face of the bounding box was hit, in the preferred embodiment of the present r ,,,.~ ; ,.; c.i ,~~ ;.~ tJ
° j a invention determining which particular active zone is selected uses the following steps for each coordinate axis of the hit face:
ZONE = 0 (0000 in binary);
For the X axis:
is X > Xmin + insetx?
yes: is X > Xmax - insetx?
yes: hitpoint is in right portion of hit face ZONE = ZONE + 1 (0l in binary) no: hitpoint is in middle portion of hit face ZONE = ZONE + 0 (00 in binary) no: hitpoint is in left portion of hit face ZONE = ZONE + 2 (10 in binary) For the Y axis:
is Y > Ymin + insety?
yes: is Y > Ymax - insety?
yes: hitpoint is in top portion of hit face ZONE = ZONE + 4 (0I00 in binary) no: hitpoint is in middle portion of hit face ZONE = ZONE + 0 (0000 in binary) no: hitpoint is in bottom portion of hit face ZONE = ZONE + 8 (1000 in binary) Please note that X and Y in the above determinations should everywhere be replaced by appropriate indices determined by the coordinates of the current hitface, as was stated above.
Referring now to Figure 15, by either logically OR'ing or numerically adding the resulting values, an index value is generated which indicates which particular active zone was selected. For example, if the bottom left corner active zone (scaling, in the preferred embodiment of the present invention) is selected, then the X axis determination would yield a value of 2 s" . > ~ r~~
".~ ~ a .~. , r~
(10 in binary) and the Y axis determination would yield a value of 8 (1000 in binary). In that case, the resulting index value of the selected active zone hitpoint would be 10 (1010 in binary). Similarly, if the right edge active zone (rotation in the preferred embodiment of the present invention) is selected, then the X axis determination would yield a value of 1 (0l in binary) and the Y axis determination would yield a value of 0 (0000 in binary). In that case, the resulting index value of the selected active zone hitpoint would be 1 (or 0001 in binary).
The classification (which manipulation type: scale, rotate or translate) of which of the nine actives zones of the preferred embodiment of the present invention was hit is stored. Also stored, as is well known in the art, is the index of the axis that is perpendicular to the face that was hit. By assigning each axis to an index value (X=0, Y=1 and Z=2), it is a simple matter to determine the other two axes given any one of the three by merely adding 1 and 2 respectively to the index of the given axis and taking the result modulo 3. Finally, a flag speafying which of the two parallel faces of the box along this axis was hit (the "polarity") is stored. Referring now to Figure 16, the polarity refers to the face, of the two parallel faces, of the bounding box having the greater face value along the axis perpendicular to the hit face. Please note that determination of the axis perpendicular to the hit face, determining the polarity of the hit face, and using indices for coordinate axes are techniques well known in the art. Together, these three variables completely determine the active zone that was hit (note that in total there are 9 active zones per box ra i"/:~t 3/ ~ N
face and 6 box faces and therefore a total of 54 active zones in the preferred embodiment of the present invention).
If a translation zone was hit by the viewing ray then a translation manipulation will be caused by any further movement of the mouse while the user continues to hold the mouse button down. This is discussed below with reference to Figure 6. However, if a rotation zone was hit by the viewing ray then a rotation manipulation will be caused by any further movement of the mouse while the user continues to hold the mouse button down. This is discussed below with reference to Figure 7. Lastly, if a scaling zone was hit by the viewing ray then a scaling manipulation will be caused by any further movement of the mouse while the user continues to hold the mouse button down. This is discussed below with reference to Figure 8.
Referring to Figure 6, the translation sequence will now be described.
Again, as was stated above, the calculated active zone classification, the perpendicular axis and the polarity are stored. The original three separate scaling, rotation and translation transforms (at the time the mouse button was first clicked on the active zone) are also remembered. Finally, the indices of the two axes of the face that was hit are also stored. This is because in a translation manipulation the bounding box, and the object it contains, will be moved along the hit plane of these two axes.

After first determining that the user is still pressing the mouse button down 603 (whereas if not then the translation manipulation is exited) then a ray through the current mouse x,y location is transformed into model space 605. In other words, as long as the user is still pressing the mouse button, it must next be determined what effect any movement of the mouse as indicated by a change in pointer location would have on the bounding box and the object it contains. This is accomplished by first creating a ray from the eyepoint through the current mouse pointer x,y location and translating that ray into the model space of the object. This ray translation, as was explained above with reference to the active zone selection, is achieved by an inverse transform which thus simplifies the following calculations because all box-planes are axis-parallel in model coordinate space.
Then it is determined where the translated ray intersects the plane of the selected face and active zone 607. The equations for the planes through the hit face are simple in model coordinates:
axis perp. to hit face plane equation (in normal distance form) x n=[100],d=-Il'x y n = [O 1 0], d = -IPy z n=[001],d=-1Pz where IP is the 3-D intersection point of the original ("mouse-down") viewing ray which selected the bounding box active zone in model coordinates. To intersect a plane (n,d) with a viewing ray in model "'\
'~ t~'~l ~i ~. ~ ~~
coordinates (origin', direction'), one must first calculate the parametric t along the ray where the intersection occurs:
t = - (n ~ origin' + d / n ~ direction') where ~ denotes the dot product. Please note, however, that in the preferred embodiment of the present invention, full dot products are not necessary because the plane normals n are very simple because the zeroes cancel out and hence two-thirds of the calculations need not even be made. To get a 3-D
intersection point, t must merely be back-substituted into the ray equation such that:
Il' = origin' + t ~ direction' Now IP is the new intersection point in model coordinates. Again, in the preferred embodiment of the present invention, only two of the three coordinates of the new IP need to be calculated because the third coordinate stays constant as the bounding box and the object it contains moves in the chosen plane.
This thus provides two intersection points in the plane the bounding box and the object it contains are to be translated in: the original hitpoint that was stored in step b01 and the current hitpoint just now determined in step 607. Next the difference between these two hitpoints is calculated 609. This ~; ~.~ v~ ~a ~. ~~' ~a difference, which represents the amount of movement or translation the user has indicated via movement of the mouse pointer, is then transferred into scaled, rotated coordinates 611. This is done in order to operate in translate space (as is explained more fully below with reference to Figure 10).
The new translation is added to the original translation transformation and the translation transformation is set to this sum 613. In other words, the new translation is added to the original translation transformation in order to create a new combined translation transformation which includes the user's latest manipulations.
Now that the translation transform includes the latest user manipulation, the bounding box and the object it contains can be re-displayed 615. Referring now to Figure 9, re-displaying the bounding box and the object within it is achieved by first creating a cumulative transform M from the current three separate scale, rotate and translate transforms 901. Then the object is re-displayed, in the preferred embodiment of the present invention, by transforming each vertex of the object from model space to world space by multiplying the vertices by M, passing the transformed object vertices through a viewing matrix V (which defines where the camera is located, where the camera is pointed, the focal length of the lens, and the camera screen geometry; please note that these techniques are well known in the art) and drawing lines between the transformed object vertices 903. Finally, to re-display the bounding box, in the preferred embodiment of the present invention, each vertex of the bounding box is transformed by multiplying the vertices by M and the viewing matrix V and drawing lines between the transformed bounding box vertices 905.
Referring again to Figure 6, after re-displaying the object and bounding box 615, the mouse button is again checked 603 to determine whether the user has finished all current translation manipulations. If the user has finished all current translation manipulations, the user will no longer be pressing the mouse button. However, if the user has not yet finished all current manipulations then the user will still be pressing the mouse button and the same sequence of steps 605 through 615 will be followed. In this way, the bounding box and the object within it will appear to the user to continuously move, or translate, across the screen as the user moves the pointer with the mouse while continuing to hold the mouse button down. These continuous movements will only pause while the user stops moving the mouse and will only stop when the user stops pressing the mouse button down.
In an alternative embodiment, a gridding capability is provided whereby movements would be constrained along box coordinate system axes so as to stay on the intersections of a three-dimensional grid. In a further embodiment, the gridding is enabled after the intersection point is transformed into world space, resulting in gridding in world space which would thus not be affected by the orientation of the bounding box in model space. In a still further embodiment, a constrain mechanism is triggered by, "-\

for example, the user holding down a particular (e.g., shift) key (or making a menu selection or setting a preference option) when pressing the mouse button to select an active zone and manipulate the bounding box and object within. The shift-constrain mechanism would constrain the bounding box and object to movements which lie along the one axis which has the larger translation component at the time the shift key is pressed. A still further alternative embodiment would limit translation to a specified volume in 3-D
space. For example, when moving a chair in a room on the visual display the chair would be limited by the room boundaries.
A further embodiment still, referring now to Figure 17, provides a translate manipulation with one degree of freedom where this one degree of freedom is perpendicular to the two degrees of freedom enabled by the translate-slide manipulation. This one degree of freedom is perpendicular to the selected face of the bounding box and is known as a "translate-pull"
manipulation. In the translate-pull manipulation, invoked by holding down the option key while clicking the button when the pointer is positioned over a translate active zone, the bounding box and the object within it are moved in a direction perpendicular to the chosen face in order to provide a direct lifting action. Please note that this embodiment could be an alternative default setting rather than being enabled by holding down the option key.
Referring to Figure 7, the rotation sequence will now be described.
Again, as was stated above, the calculated active zone classification, the axis 6 .~'d.
and the polarity are stored. The original three separate scaling, rotation and translation transforms - at the time the mouse button was first licked on the active zone - are also saved 701. Finally, the index of the axis around which rotation will occur is also stored. This is because in a rotation manipulation the bounding box and the object it contains will be rotated around this axis.
Please note that in the preferred embodiment of the present invention the center line of the bounding box, which passes through the origin of the model space coordinate system, is the axis of rotation. Alternative embodiments support moving the axis of rotation elsewhere within the box, for instance to an edge of the bounding box, and even to an axis outside of the bounding box.
Furthermore, in an alternative embodiment of the present invention, an indicator such as a cross-hair or visible rotation axis line would be displayed when a rotation manipulation was selected to thus inform the user of the current axis of rotation.
After first determining that the user is still pressing the mouse button down 703 (whereas if the user has stopped pressing the mouse button down then the rotation manipulation is exited) then a ray through the current mouse x,y location is transformed into model space 705. Please note that this is accomplished in the same manner as step 605 in the translation manipulation sequence.
Then it is determined where the translated ray intersects the plane of the selected face and active zone 707. Please note that this is accomplished in the same manner as step 605 in the translation manipulation sequence. This thus provides two intersection points in the plane the bounding box and the object it contains are to be rotated in: the original hit point that was stored in step 701 and the current hitpoint just now determined in step 707.
Next, both the original hitpoint A and the current hitpoint B are inverse-transformed through the scale transform 709. Please note that it is important to include the scaling transform (as was stated above) when calculating the intersection points A and B. This is because non-homogenous scaling transforms would change the angles, so in the preferred embodiment of the present invention angle a (explained below) is calculated in scaled space. Please note that because all operations can now be performed in model space with axis-aligned planes, calculating this angle is essentially two-dimensional and is thus computationally more efficient than using a full 3-D
algorithm. Referring now to Figure I8, two lines are formed from the origin 711 of the bounding box, one line through the original intersection point A of the original viewing ray with the bounding box and one line through the intersection point B of the current viewing ray with the rotation plane. The angle between them is then determined by the equation:

r9 J
a = arctangent (- A x B / A ~ B) if (A ~ B < 0), then if(AxB<0) a=a+n else a=a-n where ~ is the dot product and x is the cross product.
Referring again to Figure 7, this angle a is used to construct a rotation matrix which is then preconcatenated into the original rotation matrix (earlier stored, as was discussed above with reference to step 701) and the rotation transform of the bounding box is then set to this compound transform 713. Please note that this is explained more fully below with reference to Figure 10.
Lastly, now that the rotation transform includes the latest user manipulation, the bounding box and the object it contains can be re-displayed 715. Please note that this is accomplished in the same manner as step 615 in the translation manipulation sequence (and thus follows the sequence of steps discussed above with reference to Figure 9).
After re-displaying the object and bounding box 715, the mouse button is again checked 703 to determine whether the user has finished all current rotation manipulations. If the user has finished all current rotation manipulations, the user will no longer be pressing the mouse button.

Fr .~ 1~ ~ ~:i However, if the user has not yet finished all current rotation manipulations then the user will still be pressing the mouse button and the same sequence of steps 705 through 715 will be followed. In this way, the bounding box and the object within it will appear to the user to continuously move, or rotate, on the screen as the user moves the pointer with the mouse while continuing to hold the mouse button down. These continuous movements will only pause while the user stops moving the mouse and will only stop when the user stops pressing the mouse button down.
In an alternative embodiment, the rotation manipulations are constrained to increments of multiples of a predefined angle. For instance, increment angles would be constrained to multiples of 45 degrees when the shift key is held down during rotations. To constrain the angle, the rotation transform of the bounding box would be stored as three successive rotation angles, one of which would be added to a to constrain the result. In a still further embodiment of the present invention, if the rotation transform was stored as three successively applied rotation angles around the X, Y and Z
axes respectively, then the rotation angles could be limited or gridded separately for each of the three axes. This would provide for simulating certain joint styles such as an elbow joint or a shoulder joint which have limited ranges of rotation or even no range of rotation along some axes and would also provide for a "ratchet wheel" simulation where rotation angles are quantized to specified multiples of an angle.

~.~ ~~ ~~ ~ ~~' ~~' Refernng to Figure 8, the scaling sequence will now be described.
Again, as was stated above, the calculated active zone classification, the axis and the polarity are stored. The original three separate scaling, rotation and translation transforms - at the time the mouse button was first clicked on the active zone - are also saved 801. Finally, the index of the plane in which scaling will occur is also stored. This is because in a scaling manipulation the bounding box, and the object it contains, will be scaled in a single plane in the preferred embodiment of the present invention.
After first determining that the user is still pressing the mouse button down 803 (whereas if the, user has stopped pressing the mouse button down then the scaling manipulation is exited) then a ray through the current mouse x,y location is transformed into model space 805. Please note that this is accomplished in the same manner as step 605 in the translation manipulation sequence.
Then it is determined where the translated ray intersects the plane of the selected face and active zone 807. Please note that this is accomplished in the same manner as step 605 in the translation manipulation sequence. This thus provides two intersection points in the plane the bounding box will be scaled in: the original hit point A that was stored in step 801 and the current hitpoint B just now determined in step 807 as can be seen with reference to Figure 19.

y '~'~ ~ 'f ~
Next, the ratio of the original hitpoint A and the current hitpoint B is determined 807. Note that neither of these points needs to be inverse transformed before this calculation can be made because they are both already in the same space and because they are both only one transform away from model space. In other words, because both the original hitpoint A and the current hitpoint B are only the scaling transform away from model space, they are in the same relative space and scaling calculations can be made directly on them.
Referring again to Figure 8, these 2-D points A and B are then used to update the scaling transform 811. The ratio of B/A is then multiplied into the current scaling transform to yield a new scaling transform. Please note that in the preferred embodiment of the present invention scaling along the one axis that is not involved remains unchanged by these computations.
Lastly, now that the scaling transform includes the latest user manipulation, the bounding box and the object it contains can be re-displayed 813. Please note that this is accomplished in the same manner as step 615 in the translation manipulation sequence (and thus follows the sequence of steps discussed above with reference to Figure 9).
After re-displaying the object and bounding box 813, the mouse button is again checked 803 to determine whether the user has finished all current scaling manipulations. If the user has finished all current scaling ~\
a .a. .~
manipulations, the user will no longer be pressing the mouse button.
However, if the user has not yet finished all current scaling manipulations then the user will still be pressing the mouse button and the same sequence of steps 805 through 813 will be followed. In this way, the bounding box and the object within it will appear to the user to continuously scale on the screen as the user moves the pointer with the mouse while continuing to hold the mouse button down. These continuous movements will only pause while the user stops moving the mouse and will only stop when the user stops pressing the mouse button down.
In an alternative embodiment, and similarly to an alternative embodiment of the translation manipulation as discussed above, scaling is gridded or constrained. This would prevent objects from becoming smaller than a predefined (or user settable) minimum size and would prevent a negative scaling manipulation which would otherwise cause an object to flip around within itself.
Referring now to Figure 10, the relationships between each of the three separate transforms - scaling, rotation and translation - will now be explained.
One way an object in model space 1001 can reach world space 1007 is to pass through a single combined transformation M. The other way an object in model space 1001 can reach world space 1007 is to first pass through a scaling transformation to reach scaled space 1003, then pass through a rotation transformation to reach scaled/rotated space 1005 and then pass through a translation transformation to reach scaled/rotated/translated space which is world space 1007. In the preferred embodiment of the present invention, these three separate transforms (scaling, rotation and translation) are separately stored so as to allow individual modification to each without affecting the others. In other words, the present invention stores each of the three transformations depicted in Figure 10 separately rather than store a single transformation M.
It is important to note that this sequence of a scaling transformation, followed by a rotation transformation, followed by a translation transformation is necessary because the transformations do not, generally speaking, commute. In other words, if the order of the transformations were altered, subsequent manipulations could skew or distort the shape of the object. Therefore the order of the transformations is constrained to scaling, then rotation, then translation.
The fact that transformations do not generally commute is why the scaling sequence of steps applies changes to the scaling transform and thus deals with the object in model space 1001 and why the rotation sequence of steps applies changes to the rotation transform and thus deals with the object in scaled space 1003 and why the translation sequence of steps applies changes to the translation transform and thus deals with the object in scaled/rotated space 1005. Furthermore, this is why the sequence of moving into and out of ,;,,~r~_~ . ..
ira v~ ~. ~~ z different spaces is slightly different in each of the three manipulation transformations discussed above with reference to Figures 6-8.
A further consideration arises when, due to the camera position (the user's viewpoint) and the physical display size or area available for object display (e.g., the object could be in a window on the display which window is smaller than the total display area), the object to be manipulated is larger than the area available to the user. In this case, generating a bounding box which encloses the object would thus cause the bounding box to also be larger than the available viewing area and as such the user would not be able to view all of the normally visible faces of the bounding box and thus the user would potentially not have access to some or all of the normally available object manipulations.
To address this issue, an alternative embodiment would, upon noting an object size larger than the available viewing area, provide a reduced size bounding box thus still providing the user with complete access to all of the available object manipulations. The implementation of such an alternative embodiment would be readily apparent to one of ordinary skill in the art based upon the teachings of the present invention (e.g., a scaling factor could be applied to the object dimensions to fool the bounding box generation means into thinking that the object is smaller than it actually is).

Ya ~~.~ V ~ ' ~ a ' ~f t~
Providing a bounding box which is not of equal size with the dimensions of the object to be manipulated provides further capabilities. For instance, if the user wished to manipulate multiple objects as a single group, a reduced size bounding box based on a space size whieh encompasses all of the objects desired to be included in the group could be used. Stated differently, objects (for instance furniture in a room or scene) could be individually selected thus providing a finite sized bounding box. This embodiment would thus provide object manipulation. Alternatively, a scene of objects (for instance a room containing furniture) could be selected thus again providing a finite sized bounding box, albeit reduced in size to provide user access to all of the available manipulations, but one which properly acts as if it encloses all of the objects which are included in that scene. This embodiment would thus provide manipulation of the camera geometry. Still further, a mathematically infinite space such as world space could be manipulated by providing at least one finite small bounding box that completely fits within the viewing area. All objects defined in the infinite space being manipulated would then be manipulated accordingly. This embodiment would thus provide manipulation of an arbitrary mathematical space including world space and camera space.
In the foregoing specification, the invention has been described with reference to a specific exemplary embodiment and alternative embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of .-, ~~~ r~f~
~~~~~~~.:
the invention as set forth in the appended claims. The specifications and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.

Claims (94)

1. A method for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, comprising:
providing a user actuated input controller signal for selectively positioning a reference indicator on the display;
positioning the reference indicator over the displayed object and signaling the computer to activate a control movement mode;
providing on the display a three-dimensional representation of a bounding region including at least two portions which specify respective predefined control movement types, one of said types being rotation around an axis parallel to the portion which specifies rotation around that axis;
positioning the reference indicator over one of said portions;
signaling the computer to activate a predefined control movement type specified by the portion of the bounding region under the reference indicator, and while the reference indicator is over said portion, repositioning the reference indicator to define a movement of the specified type; and re-displaying the displayed object in accordance with the defined movement of the specified type.
2. The method of claim 1 wherein the three-dimensional representation of a bounding region is a generally rectilinear bounding box, and wherein the re-displaying further comprises re-displaying the bounding box in accordance with the defined movement of the predefined control movement type.
3. The method of claim 1 wherein the bounding region is reduced in size relative to the displayed object.
4. The method of claim 1 wherein the user actuated input controller signal is from a mouse.
5. The method of claim 4 wherein the reference indicator is a pointer displayed on the display.
6. The method of claim 5 wherein signaling the computer to activate the control movement mode includes activating a switch.
7. The method of claim 6 wherein the activating a switch comprises pressing a button on the mouse.
8. The method of claim 6 wherein the signaling the computer to activate a predefined control movement type includes the activating a switch.
9. The method of claim 8 wherein the activating a switch comprises pressing a button on the mouse.
10. The method of claim 1, wherein after signaling the computer to activate a predefined control movement type, the method further comprises changing the shape of the reference indicator and thus indicating, to a user of the method, a type and direction of available object manipulations.
11. The method of claim 1 wherein the portion of the bounding region is an active zone.
12. The method of claim 1 wherein the portion of the bounding region defines a handle which graphically distinguishes said portion from the remainder of the bounding region.
13. The method of claim 12 wherein the handle indicates, to a user of the method, a type and direction of available object manipulations.
14. The method of claim 12 wherein the handle extends outwardly from the bounding region such that the outwardly extending handle presents an appearance of being available to be selected by the reference indicator.
15. The method of claim 12 wherein the handle is shaped like a rod.
16. The method of claim 12 wherein the handle is shaped like a cube.
17. The method of claim 12 wherein the handle is shaped like an arrow.
18. The method of claim 1 wherein the portion of the bounding region is an image of a hand.
19. The method of claim 18 wherein the hand indicates to a user of the method a type and direction of available object manipulations.
20. The method of claim 18 wherein the hand looks like a human hand.
21. The method of claim 20 wherein the hand appears to be grabbing the three-dimensional representation of a bounding region.
22. The method of claim 18 wherein the hand looks like a mechanical hand.
23. The method of claim 22 wherein the hand appears to be grabbing the three-dimensional representation of a bounding region.
24. The method of claim 1 wherein the predefined control movement type is a translation of the displayed object.
25. The method of claim 24 wherein the translation of the displayed object is along model space coordinate axes.
26. The method of claim 25 wherein the translation of the displayed object in model space is parallel to a plane of a face of the bounding region.
27. The method of claim 25 wherein the translation of the displayed object in model space is perpendicular to a plane of a face of the bounding region.
28. The method of claim 24 wherein the translation of the displayed object is performed by determining a difference in model space between a position of the reference indicator when the translation operation was activated and a current position of the reference indicator, and transforming the difference into scaled and rotated coordinates using a scale transform and a rotate transform, and adding the transformed difference to a translation transform to create a new translation transform, and wherein re-displaying the displayed object on the video display is in accordance with the scale transform, the rotate transform and the new translation transform.
29. The method of claim 24 wherein translation of the displayed object is parallel to a plane of a face of the bounding region and is limited to a predefined range of translation manipulations.
30. The method of claim 1 wherein the axis of rotation of the displayed object is parallel to model space coordinate axes.
31. The method of claim 30 wherein the rotation of the displayed object in model space is around an axis of the bounding region.
32. The method of claim 31 wherein the axis of rotation is a center line of the bounding region.
33. The method of claim 31 wherein the axis of rotation is an edge of the bounding region.
34. The method of claim 33 wherein the axis of rotation is around a bounding region edge opposite from the portion of the bounding region under the reference indicator.
35. The method of claim 30 wherein the axis of rotation is outside of the bounding region.
36. The method of claim 1 wherein the rotation of the displayed object is performed by transforming a position of the reference indicator when the rotation operation was activated by a scale transform, and transforming a current position of the reference indicator by the scale transform and determining an angle created thereby versus a center point of the displayed object, and concatenating a rotation matrix of the angle into a rotation transform to create a new rotation transform, and wherein re-displaying the displayed object on the video display is in accordance with the scale transform, the new rotation transform and a translation transform.
37. The method of claim 1 wherein a second of the predefined control movement types is a scaling of the displayed object.
38. The method of claim 37 wherein the scaling of the displayed object is along model space coordinate axes.
39. The method of claim 38 wherein the scaling in model space is parallel to a plane of a face of the bounding region.
40. The method of claim 38 wherein the scaling is homogenous.
41. The method of claim 37 wherein the scaling of the displayed object is performed by determining a ratio of a position of the reference indicator versus an origin of the bounding region when the scaling operation was activated and a current-position of the reference indicator versus the origin of the bounding region and multiplying the ratio with a scale transform to create a new scale transform and wherein re-displaying the displayed object on the video display is in accordance with the new scale transform, a rotate transform and a translation transform.
42. The method of claim 41 wherein scaling of the displayed object is parallel to a plane of a face of the bounding region and is limited to a predefined range of scaling manipulations.
43. A method for manipulating an object displayed in three-dimensional representation on a computer controlled video display system having a computer, a video display and a mouse, comprising:
selecting the displayed object by using the mouse to position a pointer over the displayed object and pressing a button on the mouse;
displaying a three-dimensional representation of a bounding box having at least two active zones which specify respective available movement types, one of said types being rotation around an axis parallel to the zone which specifies rotation around that axis, when the displayed object is selected;

defining a movement of a type predefined by one of the active zones by using the mouse to position the pointer over an active zone, pressing the button on the mouse, and, while the pointer is over the active zone, repositioning the pointer with the mouse; and re-displaying the bounding box and the displayed object in accordance with the defined movement.
44. The method of claim 43 wherein the available movement types further comprise translation and scaling.
45. The method of claim 44 wherein if the predefined movement type is translation then the translation of the displayed object and the bounding box is performed by determining a difference in model space between a position of the pointer when the pointer was positioned over the active zone and the mouse button was pressed and a current position of the pointer, and transforming the difference into scaled and rotated coordinates using a scale transform and a rotate transform and adding the transformed difference to a translation transform to create a new translation transform, and wherein re-displaying the bounding box and the displayed object is in accordance with the scale transform, the rotate transform and the new translation transform.
46. The method of claim 44 wherein if the predefined movement type is rotation then the rotation of the displayed object and the bounding box is performed by transforming a position of the pointer when the pointer was positioned over the active zone and the mouse button was pressed by a scale transform and transforming a current position of the pointer by the scale transform and determining an angle created thereby versus a center point of the displayed object and concatenating a rotation matrix of the angle into a rotation transform to create a new rotation transform, and wherein re-displaying the displayed object and the bounding box on the video display is in accordance with the scale transform, the new rotation transform and a translation transform.
47. The method of claim 44 wherein if the predefined movement type is scaling then the scaling of the displayed object and the bounding box is performed by determining a ratio of a position of the pointer versus an origin of the bounding box when the pointer was positioned over the active zone and the mouse button was pressed and a current position of the pointer versus the origin of the bounding box and multiplying the ratio with a scaling transform to create a new scaling transform and wherein re-displaying the displayed object and the bounding box on the video display is in accordance with the new scaling transform, a rotate transform and a translation transform.
48. An apparatus for manipulating an object displayed in three-dimensional representation on a computer controlled display system having a computer and a display coupled to the computer, the apparatus comprising:
means for positioning a reference indicator over the displayed object and signaling the computer to activate a control movement mode;
means for generating on the display a three-dimensional representation of a bounding region including at least two portions which specify respective predefined control movement types, one of said types being rotation around an axis parallel to the portion which specifies rotation around that axis;

means for signaling the computer to activate a predefined control movement type specified by a portion of the bounding region under the reference indicator;

means for repositioning the reference indicator while the reference indicator is over the portion of the bounding region to define a movement of the predefined control movement type; and means for re-displaying the displayed object in accordance with the defined movement of the predefined control movement type.
49. The apparatus of claim 48 wherein the three-dimensional representation of a bounding region is a generally rectilinear bounding box, and further comprising means for re-displaying the bounding box in accordance with the defined movement of the predefined control movement type.
50. The apparatus of claim 48 wherein the bounding region is reduced in size relative to the displayed object.
51. The apparatus of claim 48 wherein the positioning means and the repositioning means is a mouse.
52. The apparatus of claim 51 wherein the reference indicator is a pointer displayed on the display.
53. The apparatus of claim 52 wherein the means for signaling the computer to activate the control movement mode is a switch.
54. The apparatus of claim 53 wherein the switch is a button on the mouse.
55. The apparatus of claim 53 wherein the means for signaling the computer to activate a predefined control movement type includes a switch.
56. The apparatus of claim 55 wherein the switch is a button on the mouse.
57. The apparatus of claim 48 wherein the means for signaling the computer further comprises means for changing the shape of the reference indicator when the computer has been signaled to activate a predefined control movement type thus indicating to a user of the apparatus a type and direction of available object manipulations.
58. The apparatus of claim 48 wherein the portion of the bounding region is an active zone.
59. The apparatus of claim 48 wherein the portion of the bounding region defines a handle which graphically distinguishes said portion from the remainder of the bounding region.
60. The apparatus of claim 59 wherein the handle indicates, to a user of the apparatus, a type and direction of available object manipulations.
61. The apparatus of claim 59 wherein the handle extends outwardly from the bounding region such that the outwardly extending handle presents an appearance of being available to be selected by the reference indicator .
62. The apparatus of claim 59 wherein the handle is shaped like a rod.
63. The apparatus of claim 59 wherein the handle is shaped like a cube.
64. The apparatus of claim 59 wherein the handle is shaped like a arrow.
65. The apparatus of claim 48 wherein the portion of the bounding region is an image of a hand.
66. The apparatus of claim 65 wherein the hand indicates to a user of the apparatus a type and direction of available object manipulations.
67. The apparatus of claim 65 wherein the hand looks like a human hand.
68. The apparatus of claim 67 wherein the hand appears to be grabbing the three-dimensional representation of a bounding region.
69. The apparatus of claim 65 wherein the hand looks like a mechanical hand.
70. The apparatus of claim 69 wherein the hand appears to be grabbing the three-dimensional representation of a bounding region.
71. The apparatus of claim 48 wherein the predefined control movement type is a translation of the displayed object.
72. The apparatus of claim 71 wherein the translation of the displayed object is along model space coordinate axes.
73. The apparatus of claim 72 wherein the translation of the displayed object in model space is parallel to a plane of a face of the bounding region.
74. The apparatus of claim 72 wherein the translation of the displayed object in model space is perpendicular to a plane of a face of the bounding region.
75. The apparatus of claim 71 wherein the translation of the displayed object is performed by determining a difference in model space between a position of the reference indicator when the translation operation was activated and a current position of the reference indicator and transforming the difference into scaled and rotated coordinates using a scale transform and a rotate transform and adding the transformed difference to a translation transform to create a new translation transform and wherein re-displaying the displayed object on the video display is in accordance with the scale transform, the rotate transform and the new translation transform.
76. The apparatus of claim 71 wherein translation of the displayed object is parallel to a plane of a face of the bounding region and is limited to a predefined range of translation manipulations.
77. The apparatus of claim 48 wherein the axis of rotation of the displayed object is parallel to model space coordinate axes.
78. The apparatus of claim 77 wherein the rotation in model space of the displayed object is around an axis of the bounding region.
79. The apparatus of claim 78 wherein the axis of rotation is a center line of the bounding region.
80. The apparatus of claim 78 wherein the axis of rotation is an edge of the bounding region.
81. The apparatus of claim 80 wherein the axis of rotation is around a bounding region edge opposite from the portion of the bounding region under the reference indicator.
82. The apparatus of claim 77 wherein the axis of rotation is outside of the bounding region.
83. The apparatus of claim 48 wherein the rotation of the displayed object is performed by transforming a position of the reference indicator when the rotation operation was activated by a scale transform and transforming a current position of the reference indicator by the scale transform and determining an angle created thereby versus a center point of the displayed object, and concatenating a rotation matrix of the angle into a rotation transform to create a new rotation transform, and wherein re-displaying the displayed object on the video display is in accordance with the scale transform, the new rotation transform and a translation transform.
84. The apparatus of claim 48 wherein a second of the predefined control movement types is a scaling of the displayed object.
85. The apparatus of claim 84 wherein the scaling of the displayed object is along model space coordinate axes.
86. The apparatus of claim 85 wherein the scaling in model space is parallel to a plane of a face of the bounding region,
87. The apparatus of claim 84 wherein the scaling is homogenous.
88. The apparatus of claim 84 wherein the scaling of the displayed object is performed by determining a ratio of a position of the reference indicator versus an origin of the bounding region when the scaling operation was activated and a current position of the reference indicator versus the origin of the bounding region and multiplying the ratio with a scale transform to create a new scale transform and wherein re-displaying the displayed object on the video display is in accordance with the new scale transform, a rotate transform and a translation transform.
89. The apparatus of claim 88 wherein scaling of the displayed object is parallel to a plane of a face of the bounding region and is limited to a predefined range of scaling manipulations.
90. An apparatus for manipulating an object displayed in three-dimensional representation on a computer controlled video display system having a computer, a video display and a mouse, the apparatus comprising:
means for selecting the displayed object by using the mouse to position a pointer over the displayed object and pressing a button on the mouse;
means for displaying a three-dimensional representation of a bounding box having at least two active zones which specify respective available movement types, one of said types being rotation around an axis parallel to the zone which specifies rotation around that axis, when the displayed object is selected;
means for defining a movement of a type predefined by one of the active zones by using the mouse to position the pointer over an active zone, pressing the button on the mouse, and, while the pointer is over the active zone, repositioning the pointer with the mouse; and means for re-displaying the bounding box and the displayed object in accordance with the defined movement.
91. The apparatus of claim 90 wherein the available movement types comprise translation and scaling.
92. The apparatus of claim 91 wherein if the predefined movement type is translation then the translation of the displayed object and the bounding box is performed by a means for determining a difference in model space between a position of the pointer when the pointer was positioned over the active zone and the mouse button was pressed and a current position of the pointer, and transforming the difference into scaled and rotated coordinates using a scale transform and a rotate transform and adding the transformed difference to a translation transform to create a new translation transform, and wherein re-displaying the bounding box and the displayed object is in accordance with the scale transform, the rotate transform and the new translation transform.
93. The apparatus of claim 91 wherein if the predefined movement type is rotation then the rotation of the displayed object and the bounding box is performed by a means for transforming a position of the pointer when the pointer was positioned over the active zone and the mouse button was pressed by a scale transform and transforming a current position of the pointer by the scale transform and determining an angle created thereby versus a center point of the displayed object and concatenating a rotation matrix of the angle into a rotation transform to create a new rotation transform and wherein re-displaying the displayed object and the bounding box on the video display is in accordance with the scale transform, the new rotation transform and a translation transform.
94. The apparatus of claim 91 wherein if the predefined movement type is scaling then the scaling of the displayed object and the bounding box is performed by a means for determining a ratio of a position of the pointer versus an origin of the bounding box when the pointer was positioned over the active zone and the mouse button was pressed and a current position of the pointer versus the origin of the bounding box and multiplying the ratio with a scaling transform to create a new scaling transform, and wherein re-displaying the displayed object and the bounding box on the video display is in accordance with the new scaling transform, a rotate transform and a translation transform
CA002077173A 1991-11-22 1992-08-28 Method and apparatus for direct manipulation of 3-d objects on computer displays Expired - Lifetime CA2077173C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US79619891A 1991-11-22 1991-11-22
US796,198 1991-11-22

Publications (2)

Publication Number Publication Date
CA2077173A1 CA2077173A1 (en) 1993-05-23
CA2077173C true CA2077173C (en) 2003-04-22

Family

ID=25167589

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002077173A Expired - Lifetime CA2077173C (en) 1991-11-22 1992-08-28 Method and apparatus for direct manipulation of 3-d objects on computer displays

Country Status (2)

Country Link
US (1) US5588098A (en)
CA (1) CA2077173C (en)

Families Citing this family (195)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU6083194A (en) * 1993-10-21 1995-05-08 Taligent, Inc. Object-oriented surface manipulation system
AU6121194A (en) * 1993-10-21 1995-05-08 Taligent, Inc. Object-oriented graphic manipulation system
US5583977A (en) * 1993-10-21 1996-12-10 Taligent, Inc. Object-oriented curve manipulation system
US5454371A (en) * 1993-11-29 1995-10-03 London Health Association Method and system for constructing and displaying three-dimensional images
US6397262B1 (en) 1994-10-14 2002-05-28 Qnx Software Systems, Ltd. Window kernel
US5745759A (en) * 1994-10-14 1998-04-28 Qnx Software Systems, Ltd. Window kernel
JP3559335B2 (en) * 1995-02-03 2004-09-02 富士通株式会社 3D image processing device
NL9500280A (en) * 1995-02-15 1995-08-01 Oce Nederland Bv Control element for a copying / printing device.
JP4272711B2 (en) * 1995-05-15 2009-06-03 キヤノン株式会社 Image generation method and apparatus
JP3282957B2 (en) * 1996-01-18 2002-05-20 インターナショナル・ビジネス・マシーンズ・コーポレーション Coordinate input control device and method
US5861889A (en) * 1996-04-19 1999-01-19 3D-Eye, Inc. Three dimensional computer graphics tool facilitating movement of displayed object
US5818420A (en) * 1996-07-31 1998-10-06 Nippon Hoso Kyokai 3D object graphics display device, 3D object graphics display method, and manipulator for 3D object graphics display
DE19632223A1 (en) * 1996-08-09 1998-02-12 Genius Cad Software Gmbh Method for modifying three-dimensional objects
JP3862336B2 (en) * 1996-12-26 2006-12-27 キヤノン株式会社 Image editing method and apparatus
US6035152A (en) * 1997-04-11 2000-03-07 Xerox Corporation Method for measurement of tone reproduction curve
US6426745B1 (en) 1997-04-28 2002-07-30 Computer Associates Think, Inc. Manipulating graphic objects in 3D scenes
WO1999005666A1 (en) 1997-07-25 1999-02-04 Apple Computer, Inc. System and method for generating high-luminance windows on a computer display device
US6313823B1 (en) 1998-01-20 2001-11-06 Apple Computer, Inc. System and method for measuring the color output of a computer monitor
EP1717684A3 (en) 1998-01-26 2008-01-23 Fingerworks, Inc. Method and apparatus for integrating manual input
US6529210B1 (en) 1998-04-08 2003-03-04 Altor Systems, Inc. Indirect object manipulation in a simulation
US7412654B1 (en) 1998-09-24 2008-08-12 Apple, Inc. Apparatus and method for handling special windows in a display
US6362839B1 (en) 1998-09-29 2002-03-26 Rockwell Software Inc. Method and apparatus for displaying mechanical emulation with graphical objects in an object oriented computing environment
US6559860B1 (en) * 1998-09-29 2003-05-06 Rockwell Software Inc. Method and apparatus for joining and manipulating graphical objects in a graphical user interface
US6366293B1 (en) 1998-09-29 2002-04-02 Rockwell Software Inc. Method and apparatus for manipulating and displaying graphical objects in a computer display device
US11026768B2 (en) 1998-10-08 2021-06-08 Align Technology, Inc. Dental appliance reinforcement
US6243097B1 (en) * 1998-12-10 2001-06-05 International Business Machines Corporation Bounding volume for 3D graphic primitives
US6448964B1 (en) 1999-03-15 2002-09-10 Computer Associates Think, Inc. Graphic object manipulating tool
US6597382B1 (en) * 1999-06-10 2003-07-22 Dassault Systemes Knowledge-based polymorph undockable toolbar
US7502027B1 (en) * 1999-09-13 2009-03-10 Solidworks Corporation Electronic drawing viewer
GB0012275D0 (en) * 2000-05-22 2000-07-12 Secr Defence Brit Three dimensional human computer interface
US7000197B1 (en) * 2000-06-01 2006-02-14 Autodesk, Inc. Method and apparatus for inferred selection of objects
US7043695B2 (en) * 2000-09-19 2006-05-09 Technion Research & Development Foundation Ltd. Object positioning and display in virtual environments
CA2328795A1 (en) 2000-12-19 2002-06-19 Advanced Numerical Methods Ltd. Applications and performance enhancements for detail-in-context viewing technology
US8416266B2 (en) 2001-05-03 2013-04-09 Noregin Assetts N.V., L.L.C. Interacting with detail-in-context presentations
CA2345803A1 (en) 2001-05-03 2002-11-03 Idelix Software Inc. User interface elements for pliable display technology implementations
US9760235B2 (en) 2001-06-12 2017-09-12 Callahan Cellular L.L.C. Lens-defined adjustment of displays
US7084886B2 (en) 2002-07-16 2006-08-01 Idelix Software Inc. Using detail-in-context lenses for accurate digital image cropping and measurement
WO2002101534A1 (en) 2001-06-12 2002-12-19 Idelix Software Inc. Graphical user interface with zoom for detail-in-context presentations
CA2361341A1 (en) 2001-11-07 2003-05-07 Idelix Software Inc. Use of detail-in-context presentation on stereoscopically paired images
US7046241B2 (en) * 2001-12-12 2006-05-16 Autodesk, Inc. Oriented three-dimensional editing glyphs
CA2370752A1 (en) 2002-02-05 2003-08-05 Idelix Software Inc. Fast rendering of pyramid lens distorted raster images
US8120624B2 (en) 2002-07-16 2012-02-21 Noregin Assets N.V. L.L.C. Detail-in-context lenses for digital image cropping, measurement and online maps
CA2393887A1 (en) 2002-07-17 2004-01-17 Idelix Software Inc. Enhancements to user interface for detail-in-context data presentation
CA2406047A1 (en) 2002-09-30 2004-03-30 Ali Solehdin A graphical user interface for digital media and network portals using detail-in-context lenses
CA2449888A1 (en) 2003-11-17 2005-05-17 Idelix Software Inc. Navigating large images using detail-in-context fisheye rendering techniques
WO2004041080A2 (en) * 2002-10-31 2004-05-21 Medtronic, Inc. Body region indication
CA2411898A1 (en) 2002-11-15 2004-05-15 Idelix Software Inc. A method and system for controlling access to detail-in-context presentations
US20040246269A1 (en) * 2002-11-29 2004-12-09 Luis Serra System and method for managing a plurality of locations of interest in 3D data displays ("Zoom Context")
JP4100195B2 (en) * 2003-02-26 2008-06-11 ソニー株式会社 Three-dimensional object display processing apparatus, display processing method, and computer program
US7213229B2 (en) * 2003-02-28 2007-05-01 Archvision, Inc. Content-based graphical user interface
US7681112B1 (en) 2003-05-30 2010-03-16 Adobe Systems Incorporated Embedded reuse meta information
US7324121B2 (en) * 2003-07-21 2008-01-29 Autodesk, Inc. Adaptive manipulators
US7814436B2 (en) * 2003-07-28 2010-10-12 Autodesk, Inc. 3D scene orientation indicator system with scene orientation change capability
US6999096B2 (en) * 2003-09-02 2006-02-14 National Institute Of Information And Communications Technology Method and apparatus for rendering using symplectic ray tracing
US8751950B2 (en) * 2004-08-17 2014-06-10 Ice Edge Business Solutions Ltd. Capturing a user's intent in design software
US20050071135A1 (en) 2003-09-30 2005-03-31 Vredenburgh David W. Knowledge management system for computer-aided design modeling
US8194067B2 (en) * 2004-02-04 2012-06-05 3M Innovative Properties Company Planar guides to visually aid orthodontic appliance placement within a three-dimensional (3D) environment
US9492245B2 (en) * 2004-02-27 2016-11-15 Align Technology, Inc. Method and system for providing dynamic orthodontic assessment and treatment profiles
US7904308B2 (en) 2006-04-18 2011-03-08 Align Technology, Inc. Method and system for providing indexing and cataloguing of orthodontic related treatment profiles and options
US7486302B2 (en) 2004-04-14 2009-02-03 Noregin Assets N.V., L.L.C. Fisheye lens graphical user interfaces
US20050231512A1 (en) * 2004-04-16 2005-10-20 Niles Gregory E Animation of an object using behaviors
US7805678B1 (en) 2004-04-16 2010-09-28 Apple Inc. Editing within single timeline
US8448083B1 (en) 2004-04-16 2013-05-21 Apple Inc. Gesture control of multimedia editing applications
US7932909B2 (en) * 2004-04-16 2011-04-26 Apple Inc. User interface for controlling three-dimensional animation of an object
US20050264554A1 (en) * 2004-05-25 2005-12-01 Deming James L Tile based rendering of smooth points using polygons
US8106927B2 (en) 2004-05-28 2012-01-31 Noregin Assets N.V., L.L.C. Graphical user interfaces and occlusion prevention for fisheye lenses with line segment foci
US9317945B2 (en) 2004-06-23 2016-04-19 Callahan Cellular L.L.C. Detail-in-context lenses for navigation
US8453065B2 (en) 2004-06-25 2013-05-28 Apple Inc. Preview and installation of user interface elements in a display environment
US8566732B2 (en) 2004-06-25 2013-10-22 Apple Inc. Synchronization of widgets and dashboards
US7761800B2 (en) 2004-06-25 2010-07-20 Apple Inc. Unified interest layer for user interface
US7490295B2 (en) 2004-06-25 2009-02-10 Apple Inc. Layer for accessing user interface elements
US8302020B2 (en) 2004-06-25 2012-10-30 Apple Inc. Widget authoring and editing environment
US7411590B1 (en) 2004-08-09 2008-08-12 Apple Inc. Multimedia file format
US8510672B2 (en) * 2004-08-17 2013-08-13 Dirtt Environmental Solutions Ltd Automatically creating and modifying furniture layouts in design software
WO2009111885A1 (en) 2008-03-11 2009-09-17 Dirtt Environmental Solutions, Ltd. Automatically creating and modifying furniture layouts in design software
US7714859B2 (en) 2004-09-03 2010-05-11 Shoemaker Garth B D Occlusion reduction and magnification for multidimensional data presentations
US7995078B2 (en) 2004-09-29 2011-08-09 Noregin Assets, N.V., L.L.C. Compound lenses for multi-source data presentation
US9024949B2 (en) * 2004-10-13 2015-05-05 Sony Corporation Object representation using distance functions
US8004539B2 (en) * 2004-10-20 2011-08-23 Siemens Aktiengesellschaft Systems and methods for improved graphical parameter definition
US8140975B2 (en) 2005-01-07 2012-03-20 Apple Inc. Slide show navigation
JP4319156B2 (en) * 2005-03-02 2009-08-26 任天堂株式会社 Information processing program and information processing apparatus
US7580036B2 (en) 2005-04-13 2009-08-25 Catherine Montagnese Detail-in-context terrain displacement algorithm with optimizations
US8543931B2 (en) 2005-06-07 2013-09-24 Apple Inc. Preview including theme based installation of user interface elements in a display environment
US7817150B2 (en) 2005-09-30 2010-10-19 Rockwell Automation Technologies, Inc. Three-dimensional immersive system for representing an automation control environment
US8031206B2 (en) 2005-10-12 2011-10-04 Noregin Assets N.V., L.L.C. Method and system for generating pyramid fisheye lens detail-in-context presentations
US7752556B2 (en) 2005-10-27 2010-07-06 Apple Inc. Workflow widgets
US7743336B2 (en) 2005-10-27 2010-06-22 Apple Inc. Widget security
US9104294B2 (en) 2005-10-27 2015-08-11 Apple Inc. Linked widgets
US7954064B2 (en) 2005-10-27 2011-05-31 Apple Inc. Multiple dashboards
US8543824B2 (en) 2005-10-27 2013-09-24 Apple Inc. Safe distribution and use of content
US7707514B2 (en) 2005-11-18 2010-04-27 Apple Inc. Management of user interface elements in a display environment
US20070159497A1 (en) * 2006-01-09 2007-07-12 Apple Computer, Inc. Rotation control
WO2009100538A1 (en) * 2008-02-13 2009-08-20 Dirtt Environmental Solutions, Ltd. Rendering and modifying cad design entities in object-oriented applications
US7983473B2 (en) 2006-04-11 2011-07-19 Noregin Assets, N.V., L.L.C. Transparency adjustment of a presentation
US8869027B2 (en) 2006-08-04 2014-10-21 Apple Inc. Management and generation of dashboards
US8269727B2 (en) 2007-01-03 2012-09-18 Apple Inc. Irregular input identification
US7855718B2 (en) 2007-01-03 2010-12-21 Apple Inc. Multi-touch input discrimination
US8130203B2 (en) 2007-01-03 2012-03-06 Apple Inc. Multi-touch input discrimination
US7878805B2 (en) 2007-05-25 2011-02-01 Align Technology, Inc. Tabbed dental appliance
US8954871B2 (en) 2007-07-18 2015-02-10 Apple Inc. User-centric widgets and dashboards
US20090027380A1 (en) * 2007-07-23 2009-01-29 Vivek Rajan 3-D visualization
US9026938B2 (en) 2007-07-26 2015-05-05 Noregin Assets N.V., L.L.C. Dynamic detail-in-context user interface for application access and content access on electronic displays
US8667415B2 (en) 2007-08-06 2014-03-04 Apple Inc. Web widgets
US8156467B2 (en) 2007-08-27 2012-04-10 Adobe Systems Incorporated Reusing components in a running application
US8176466B2 (en) 2007-10-01 2012-05-08 Adobe Systems Incorporated System and method for generating an application fragment
US8738394B2 (en) 2007-11-08 2014-05-27 Eric E. Kuo Clinical data file
US20090187862A1 (en) * 2008-01-22 2009-07-23 Sony Corporation Method and apparatus for the intuitive browsing of content
US9619304B2 (en) 2008-02-05 2017-04-11 Adobe Systems Incorporated Automatic connections between application components
US8108189B2 (en) 2008-03-25 2012-01-31 Align Technologies, Inc. Reconstruction of non-visible part of tooth
US8092215B2 (en) 2008-05-23 2012-01-10 Align Technology, Inc. Smile designer
US9492243B2 (en) 2008-05-23 2016-11-15 Align Technology, Inc. Dental implant positioning
US8172569B2 (en) 2008-06-12 2012-05-08 Align Technology, Inc. Dental appliance
US8656293B1 (en) 2008-07-29 2014-02-18 Adobe Systems Incorporated Configuring mobile devices
US7577913B1 (en) 2008-07-30 2009-08-18 International Business Machines Corporation Method of using a fovea type pointer in a video conferencing system including at least two 2-dimensional display screens forming a common virtual surface
US7554564B1 (en) 2008-07-30 2009-06-30 International Business Machines Corporation Method of utilizing a 2-dimensional display screen as a 3-dimensional multi-way rocker for pivoting an image displayed thereon and for revealing a hidden panel in relation to the image displayed thereon
US7567220B1 (en) 2008-07-30 2009-07-28 International Business Machines Corporation Method of using a video conferencing system including at least two 2-dimensional display screens to implement a common virtual surface
WO2010022386A2 (en) 2008-08-22 2010-02-25 Google Inc. Navigation in a three dimensional environment on a mobile device
US8152518B2 (en) 2008-10-08 2012-04-10 Align Technology, Inc. Dental positioning appliance having metallic portion
US8292617B2 (en) 2009-03-19 2012-10-23 Align Technology, Inc. Dental wire attachment
US9256282B2 (en) 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
US8765031B2 (en) 2009-08-13 2014-07-01 Align Technology, Inc. Method of forming a dental appliance
US9245064B2 (en) 2009-11-24 2016-01-26 Ice Edge Business Solutions Securely sharing design renderings over a network
WO2011114154A1 (en) * 2010-03-17 2011-09-22 Andrew Neil Carne Virtual representation of a media product
US9211166B2 (en) 2010-04-30 2015-12-15 Align Technology, Inc. Individualized orthodontic treatment index
US9241774B2 (en) 2010-04-30 2016-01-26 Align Technology, Inc. Patterned dental positioning appliance
US8427483B1 (en) * 2010-08-30 2013-04-23 Disney Enterprises. Inc. Drawing figures in computer-based drawing applications
US8487932B1 (en) 2010-08-30 2013-07-16 Disney Enterprises, Inc. Drawing figures in computer-based drawing applications
US9529424B2 (en) 2010-11-05 2016-12-27 Microsoft Technology Licensing, Llc Augmented reality with direct user interaction
EP2523132A1 (en) * 2011-05-11 2012-11-14 Dassault Systèmes Designing a three-dimensional modeled assembly of objects in a three-dimensional scene
US9189571B2 (en) 2011-06-11 2015-11-17 Ice Edge Business Solutions, Ltd. Automated re-use of structural components
JP5694883B2 (en) * 2011-08-23 2015-04-01 京セラ株式会社 Display device
US9403238B2 (en) 2011-09-21 2016-08-02 Align Technology, Inc. Laser cutting
US20130090895A1 (en) * 2011-10-11 2013-04-11 Dassault Systemes Device and associated methodology for manipulating three-dimensional objects
WO2013082760A1 (en) * 2011-12-06 2013-06-13 Thomson Licensing Method and system for responding to user's selection gesture of object displayed in three dimensions
US9582930B2 (en) * 2011-12-30 2017-02-28 Honeywell International Inc. Target aquisition in a three dimensional building display
US8836658B1 (en) 2012-01-31 2014-09-16 Google Inc. Method and apparatus for displaying a plurality of items
US9375300B2 (en) 2012-02-02 2016-06-28 Align Technology, Inc. Identifying forces on a tooth
US9220580B2 (en) 2012-03-01 2015-12-29 Align Technology, Inc. Determining a dental treatment difficulty
US9414897B2 (en) 2012-05-22 2016-08-16 Align Technology, Inc. Adjustment of tooth position in a virtual dental model
US9075933B2 (en) * 2012-10-11 2015-07-07 Adobe Systems Incorporated 3D transformation of objects using 2D controls projected in 3D space and contextual face selections of a three dimensional bounding box
WO2014069248A1 (en) * 2012-11-02 2014-05-08 ソニー株式会社 Image processing device, image processing method, and program
JP5905421B2 (en) * 2013-09-03 2016-04-20 株式会社ア−キテック Three-dimensional drawing system and program thereof
KR20150039049A (en) * 2013-10-01 2015-04-09 삼성전자주식회사 Method and Apparatus For Providing A User Interface According to Size of Template Edit Frame
EP2889738B1 (en) * 2013-12-30 2020-08-12 Dassault Systèmes Computer-implemented method for designing a three-dimensional modeled object
US9610141B2 (en) 2014-09-19 2017-04-04 Align Technology, Inc. Arch expanding appliance
US10449016B2 (en) 2014-09-19 2019-10-22 Align Technology, Inc. Arch adjustment appliance
US9734634B1 (en) 2014-09-26 2017-08-15 A9.Com, Inc. Augmented reality product preview
US9744001B2 (en) 2014-11-13 2017-08-29 Align Technology, Inc. Dental appliance with cavity for an unerupted or erupting tooth
EP3040946B1 (en) * 2014-12-30 2019-11-13 Dassault Systèmes Viewpoint selection in the rendering of a set of objects
US10504386B2 (en) 2015-01-27 2019-12-10 Align Technology, Inc. Training method and system for oral-cavity-imaging-and-modeling equipment
US11554000B2 (en) 2015-11-12 2023-01-17 Align Technology, Inc. Dental attachment formation structure
US11931222B2 (en) 2015-11-12 2024-03-19 Align Technology, Inc. Dental attachment formation structures
US11103330B2 (en) 2015-12-09 2021-08-31 Align Technology, Inc. Dental attachment placement structure
US11596502B2 (en) 2015-12-09 2023-03-07 Align Technology, Inc. Dental attachment placement structure
US10721451B2 (en) * 2016-03-23 2020-07-21 Symbol Technologies, Llc Arrangement for, and method of, loading freight into a shipping container
WO2017218947A1 (en) 2016-06-17 2017-12-21 Align Technology, Inc. Intraoral appliances with sensing
EP3471653B1 (en) 2016-06-17 2021-12-22 Align Technology, Inc. Orthodontic appliance performance monitor
KR102443088B1 (en) 2016-07-27 2022-09-14 얼라인 테크널러지, 인크. Intraoral scanner with dental diagnostics
CN107818293A (en) * 2016-09-14 2018-03-20 北京百度网讯科技有限公司 Method and apparatus for handling cloud data
EP4295748A3 (en) 2016-11-04 2024-03-27 Align Technology, Inc. Methods and apparatuses for dental images
WO2018102809A1 (en) 2016-12-02 2018-06-07 Align Technology, Inc. Palatal expanders and methods of expanding a palate
US11376101B2 (en) 2016-12-02 2022-07-05 Align Technology, Inc. Force control, stop mechanism, regulating structure of removable arch adjustment appliance
US10993783B2 (en) 2016-12-02 2021-05-04 Align Technology, Inc. Methods and apparatuses for customizing a rapid palatal expander
WO2018102702A1 (en) 2016-12-02 2018-06-07 Align Technology, Inc. Dental appliance features for speech enhancement
US10548700B2 (en) 2016-12-16 2020-02-04 Align Technology, Inc. Dental appliance etch template
US10779718B2 (en) 2017-02-13 2020-09-22 Align Technology, Inc. Cheek retractor and mobile device holder
US10613515B2 (en) 2017-03-31 2020-04-07 Align Technology, Inc. Orthodontic appliances including at least partially un-erupted teeth and method of forming them
US11045283B2 (en) 2017-06-09 2021-06-29 Align Technology, Inc. Palatal expander with skeletal anchorage devices
US10639134B2 (en) 2017-06-26 2020-05-05 Align Technology, Inc. Biosensor performance indicator for intraoral appliances
US10885521B2 (en) 2017-07-17 2021-01-05 Align Technology, Inc. Method and apparatuses for interactive ordering of dental aligners
CN111107806B (en) 2017-07-21 2022-04-19 阿莱恩技术有限公司 Jaw profile anchoring
CN116327391A (en) 2017-07-27 2023-06-27 阿莱恩技术有限公司 System and method for treating orthodontic appliances by optical coherence tomography
US11633268B2 (en) 2017-07-27 2023-04-25 Align Technology, Inc. Tooth shading, transparency and glazing
US11116605B2 (en) 2017-08-15 2021-09-14 Align Technology, Inc. Buccal corridor assessment and computation
WO2019036677A1 (en) 2017-08-17 2019-02-21 Align Technology, Inc. Dental appliance compliance monitoring
US10813720B2 (en) 2017-10-05 2020-10-27 Align Technology, Inc. Interproximal reduction templates
WO2019078292A1 (en) * 2017-10-19 2019-04-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device
CN111565668B (en) 2017-10-27 2022-06-07 阿莱恩技术有限公司 Substitute occlusion adjusting structure
CN116602778A (en) 2017-10-31 2023-08-18 阿莱恩技术有限公司 Dental appliance with selective bite loading and controlled tip staggering
CN115252177A (en) 2017-11-01 2022-11-01 阿莱恩技术有限公司 Automated therapy planning
US11534974B2 (en) 2017-11-17 2022-12-27 Align Technology, Inc. Customized fabrication of orthodontic retainers based on patient anatomy
EP3716885B1 (en) 2017-11-30 2023-08-30 Align Technology, Inc. Orthodontic intraoral appliances comprising sensors
US11432908B2 (en) 2017-12-15 2022-09-06 Align Technology, Inc. Closed loop adaptive orthodontic treatment methods and apparatuses
US10980613B2 (en) 2017-12-29 2021-04-20 Align Technology, Inc. Augmented reality enhancements for dental practitioners
ES2907213T3 (en) 2018-01-26 2022-04-22 Align Technology Inc Diagnostic intraoral scanning and tracking
US11937991B2 (en) 2018-03-27 2024-03-26 Align Technology, Inc. Dental attachment placement structure
KR20200141498A (en) 2018-04-11 2020-12-18 얼라인 테크널러지, 인크. Releasable palate dilator
USD959477S1 (en) 2019-12-20 2022-08-02 Sap Se Display system or portion thereof with a virtual three-dimensional animated graphical user interface
USD959476S1 (en) 2019-12-20 2022-08-02 Sap Se Display system or portion thereof with a virtual three-dimensional animated graphical user interface
US11205296B2 (en) * 2019-12-20 2021-12-21 Sap Se 3D data exploration using interactive cuboids
USD959447S1 (en) 2019-12-20 2022-08-02 Sap Se Display system or portion thereof with a virtual three-dimensional animated graphical user interface
WO2021176861A1 (en) * 2020-03-05 2021-09-10 ソニーグループ株式会社 Information processing device and information processing method, computer program, and augmented reality sensing system
US11182136B1 (en) 2020-08-20 2021-11-23 Ebay Inc. Control bar for element activation
US11694376B2 (en) * 2020-10-19 2023-07-04 Adobe Inc. Intuitive 3D transformations for 2D graphics
US11631206B2 (en) * 2021-06-10 2023-04-18 Adobe Inc. Glyph selection tool for digital text content

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5428721A (en) * 1990-02-07 1995-06-27 Kabushiki Kaisha Toshiba Data processing apparatus for editing image by using image conversion

Also Published As

Publication number Publication date
CA2077173A1 (en) 1993-05-23
US5588098A (en) 1996-12-24

Similar Documents

Publication Publication Date Title
CA2077173C (en) Method and apparatus for direct manipulation of 3-d objects on computer displays
US5583977A (en) Object-oriented curve manipulation system
Hinckley et al. A survey of design issues in spatial input
US5861889A (en) Three dimensional computer graphics tool facilitating movement of displayed object
US5689628A (en) Coupling a display object to a viewpoint in a navigable workspace
US6448964B1 (en) Graphic object manipulating tool
US5524187A (en) Worlds-within-worlds nested display and interaction system and method
EP0421818A2 (en) Interactive computer graphics system for making precise drawings
Mine ISAAC: A virtual environment tool for the interactive construction of virtual worlds
Liang et al. Geometric modeling using six degrees of freedom input devices
Mine Working in a virtual world: Interaction techniques used in the chapel hill immersive modeling program
JPH10283158A (en) Stereoscopic display device for window and method therefor
EP0219671A2 (en) Mirror inverse function in an interactive graphics system
Stork et al. Efficient and precise solid modelling using a 3D input device
Ebert et al. Two-handed interactive stereoscopic visualization
CA2496473A1 (en) Methods and systems for interaction with three-dimensional computer models
Komerska et al. Haptic task constraints for 3D interaction
WO1995011482A1 (en) Object-oriented surface manipulation system
GB2221369A (en) Two-dimensional emulation of three-dimensional trackball
WO1995011480A1 (en) Object-oriented graphic manipulation system
Ebert et al. Minimally immersive flow visualization
Brudy Interactive menus in augmented reality environments
Wu et al. Picking and snapping for 3d input devices
de Haan et al. Hybrid Interfaces in VEs: Intent and Interaction.
JPH08249500A (en) Method for displaying three-dimensional graphic

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry