WO1993023835A1 - Textured sphere and spherical environment map rendering using texture map double indirection - Google Patents
Textured sphere and spherical environment map rendering using texture map double indirection Download PDFInfo
- Publication number
- WO1993023835A1 WO1993023835A1 PCT/US1993/002678 US9302678W WO9323835A1 WO 1993023835 A1 WO1993023835 A1 WO 1993023835A1 US 9302678 W US9302678 W US 9302678W WO 9323835 A1 WO9323835 A1 WO 9323835A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- look
- sphere
- parametric
- screen
- computing
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B29/00—Maps; Plans; Charts; Diagrams, e.g. route diagram
- G09B29/003—Maps
- G09B29/005—Map projections or methods associated specifically therewith
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/08—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
- G09B9/30—Simulation of view from aircraft
- G09B9/301—Simulation of view from aircraft by computer-processed or -generated image
Definitions
- the present invention relates to the field of pixel rendering, in particular to the field of rendering textured spheres and spherical environment maps.
- Pixel rendering refers to the generation of pixel values for displaying an image.
- An environment map is an image or collection of images which characterize the appearance of a scene when viewed from a particular position. Each type of environment map has an associated projection which is used to compute the appearance along a ray traveling in a particular direction towards the camera. Not all types of environment maps capture the scene in every direction.
- spherical projection There are a number of types of spherical projection which may be used to store environment maps. Two are of particular interest, namely spherical reflection maps, and parametric spherical maps.
- Spherical reflection maps store an image of the environment as an orthographic projection of a sphere shaded with a perfect reflection of the surrounding scene.
- these maps are circular images of spheres within a square array of pixels.
- These maps are useful for the computation of reflections and illumination when rendering specular surfaces. They do, in fact, sample the entire orientation space. However, they have the disadvantage that the orientations near the silhouette of the sphere are very sparsely sampled. This renders them unsuitable as a representation for all-round interactive viewers.
- Parametric spherical environment maps store the environment data in a rectangular image where the (x, y) coordinates of a pixel, map linearly to points on a sphere which are defined by the ( ⁇ , ⁇ ) spherical (or angular) coordinates of a corresponding direction vector.
- a parametric spherical environment map is twice as wide as it is high since a sphere is twice the distance around the equator as it is from pole to pole. All regions are sampled at least as much as at the equator. Regions near the poles are oversampled.
- Figure 1 shows a parametric spherical environment of a museum atrium. The parametric spherical environment map contains the pixel values which are used to display the parametric spherical environment.
- Parametric spherical environment maps have a number of useful properties.
- Means for viewing a spherical environment map may be characterized by the algorithm used for display and by the speed with which different degrees of freedom for the view point may be updated.
- texture mapping A related area to such rendering is termed texture mapping.
- texture mapping a texture file (or image) is applied to points on an object being rendered. This is conceptually analogous to putting a decal on a solid object.
- rendering spherical environment maps and textured spheres may be done using a number of different known approaches. The most appropriate approach for doing this will depend on the number of degrees of freedom required during an interactive viewing session.
- rendering a parametric spherical environment map one may consider the environment to be a texture on the surface of a sphere in 3-D space.
- a viewpoint with respect to the sphere will determine what is seen by the viewer. For example, the viewpoint may be outside the sphere looking at it as a whole, or it may be a perspective view from within the sphere.
- An alternative approach is to restrict the degrees of freedom with which the viewer may manipulate the sphere. If the sphere is in a fixed position, with a fixed size, a technique called texture map indirection may be used.
- the sphere is first rendered into a look-up- table, which is the same size as the final image. This is known as the screen look-up-table.
- Each look-up-table pixel contains the surface (u, v) value for the rendered sphere.
- the "u” index is along the equator; while the “v” index is between the poles.
- the contents of the screen look-up-table are used to index into the parametric spherical environment map. If this is done directly, this process would always obtain the same image of the sphere. However, if the sphere u index is offset before being used to look up the texture value, the spherical texture appears to rotate about an axis passing through the poles. This has the effect of allowing a single rotational degree of freedom for the textured sphere or spherical environment. This technique is similar to that described in an article entitled "An Image Synthesizer", Ken Perlin, Computer Graphics, Vol. 19, No. 3, pgs. 287-296, 1985. In the article, the shading is being changed for a fixed geometric scene.
- a method and apparatus for rendering textured spheres and spherical environment maps is disclosed.
- the present invention describes a rapid scheme for viewing textured spheres and spherical environment maps. The intention is to let the user interact with textured spheres and environment maps in real-time, with the view direction and field of view under user control.
- the viewing screen is assumed to be flat, such as a computer monitor.
- the real-time interaction may be done without the use of any special purpose graphics hardware.
- the method of the present invention provides for real time rotation along multiple axes.
- a two-level indexing scheme for accessing pixel data in a parametric spherical environment map (or texture map), is used to identify shading values for pixels in a display window.
- the two-level indexing scheme is comprised of a screen look ⁇ up table and a parametric look-up table.
- the screen look-up table has the dimensions of the display window, whereas the parametric look-up table has the dimensions of the parametric spherical environment map.
- the screen look-up table is similar to the screen look-up table for texture map indirection except that it is rotated by ninety degrees, so that the polar axis is horizontal.
- the parametric look-up table is a transformation of a spheres u,v coordinates having the polar axis along the Z axis, to a sphere with u,v, coordinates having the polar axis along the Y axis.
- the method for the present invention is comprised primarily of the steps of: providing a parametric spherical environment map of the image to be viewed, generating a screen look-up table comprised of look-up addresses, generating a parametric look-up table comprised of index values into the parametric spherical environment map, and for each look-up address in the screen look-up table, mapping to an entry in the parametric look-up table, retrieving the value in the entry, and using the value to retrieve pixel values from the parametric spherical environment map. Rotation or movement of the view being seen is accomplished by adding offsets to the look-up address and /or the index values.
- the method of the present invention may be practiced on a computer system mat does not require specialized rendering hardware. However, certain embodiments of the present invention as described herein may derive benefits of dedicated hardware facilities.
- Figure 1 illustrates a texture map, in this case a parametric spherical environment map, as may be used by the preferred embodiment of the present invention.
- Figure 2 is a block diagram of a computer system as may be utilized by the preferred embodiment of the present invention.
- Figure 3 is a flow chart illustrating the overall method of the preferred embodiment of the present invention.
- Figure 4 illustrates the relationships between the various tables, computer screen display, and the texture map as utilized by the preferred embodiment of the present invention.
- Figure 5 illustrates the geometry of a sphere for the creation of a screen look-up table for orthographic projections, as may be utilized in the preferred embodiment of the present invention.
- the screen look ⁇ up table corresponds to the screen look-up table of Figure 4 rotated by ninety (90) degrees in the plane of the screen.
- Figure 6 illustrates the geometry for the creation of a screen look ⁇ up table where the view position is at the center of the sphere and the viewing direction is in the plane of the sphere, as may be utilized by the preferred embodiment of the present invention.
- the screen look- up table corresponds to the screen look-up table of Figure 4 rotated by ninety (90) degrees in the plane of the screen.
- Figure 7 further illustrates the creation of a screen look-up table of Figure 6, in particular, the vertical scanlines as planes through a sphere as may be utilized by the preferred embodiment of the present invention.
- Figure 8 is an example of a textured sphere, i.e. a globe, as may be rendered using the preferred embodiment of the present invention.
- Figure 9 illustrates the axis of rotation for a textured sphere as may be utilized by the preferred embodiment of the present invention.
- Figure 10 is an example of a spherical environment map projected onto a viewing plane, where the viewing position is at the center of the sphere, i.e. of a museum atrium, as may be rendered using the preferred embodiment of the present invention.
- Figure 11 illustrates the effect of and direction of panning through a parametric spherical environment map, as may be performed by the preferred embodiment of the present invention.
- the computer system of the preferred embodiment is described with reference to Figure 2.
- the present invention may be implemented on a general purpose microcomputer, such as one of the members of the Apple® Macintosh® family, one of the members of the IBM Personal Computer family, or one of several work-station or graphics computer devices which are presently commercially available.
- a computer system as may be utilized by the preferred embodiment generally comprises a bus or other communication means 201 for communicating information, a processor means 202 coupled with said bus 201 for processing information, a random access memory (RAM) or other storage device 203 (commonly referred to as a main memory) coupled with said bus 201 for storing information and instructions for said processor 202, a read only memory (ROM) or other static storage device 204 coupled with said bus 201 for storing static information and instructions for said processor 202, a data storage device 205, such as a magnetic disk and disk drive, coupled with said bus 201 for storing information and instructions, an alphanumeric input device 206 including alphanumeric and other keys coupled to said bus 201 for commurricating information and command selections to said processor 202, a cursor control device 207, such as a mouse, track-ball, cursor control keys, etc, coupled to said bus 201 for communicating information and command selections to said processor 202 and for controlling cursor movement. Additionally, it is useful if
- a frame buffer 209 which is further coupled to a display device 210, preferably a display device capable of displaying color graphics images or high resolution monochrome graphical images.
- the frame buffer 209 contains the pixel data for driving the display device 210.
- the display device 210 may be optionally coupled to a rendering device 211, also known as a graphics accelerator.
- a rendering device 211 is coupled to the bus 201 for communication with the processor 202 and frame buffer 209.
- the preferred embodiment is implemented for use on Macintosh® family of computers available from Apple® Computer, Inc. of Cupertino, California.
- processor 202 performs various parts of the rendering method, such as table creation and table look-ups. Further, such created tables and other data may be stored in RAM 203 (for data that is dynamic in nature), or in data storage device 205 or ROM 204 (for data that is static in nature).
- the rendering method of the currently preferred embodiment is referred to as texture map double indirection.
- the name is derived from the use of two distinct maps for identifying pixel values in a texture map for rendering a particular object.
- the texture map is a parametric spherical environment map, such as described in the prior art. However, it would be apparent to one skilled in the art to use other forms of a texture map, without departing from the spirit and scope of the present invention. In any event, the terms parametric spherical environment map and texture map are used interchangeably in this description.
- Figure 3 is a flow chart illustrating the overall flow of the method of the preferred embodiment.
- a texture map i.e. a parametric spherical environment map
- a rendering means step 301.
- a screen look-up table is generated, step 302.
- the screen look-up table will have (u,v) coordinates as entries. As noted previously, the u index is along the equator, whereas the v index is between the poles. These (u,v) entries correspond to the desired projected view.
- the screen look-up table will be created by rendering the object or perspective of the desired projected view.
- the parametric look-up table is generated, step 303.
- the parametric look-up table will have (u',v') coordinate entries which are orthogonal to the desired projected view of the screen look-up table.
- the parametric look-up table will have dimensions which are identical to the texture map.
- Pixel rendering occurs, by identifying a pixel value for each pixel entry in the screen look-up table. For each pixel in the screen look-up table, a corresponding entry in the parametric look-up table is obtained, step 304. If rotation about a horizontal axis of the displayed sphere is desired, an offset is added to the u index of the entry from the screen look-up table in order to find the entry in the parametric look-up table. Using the index obtained from the parametric look-up table, a pixel value from the texture map is obtained, step 305. If a rotation about the polar axis of the displayed sphere is desired, an offset is added to the u 1 index of the index from the parametric look-up table.
- the pixel value obtained from the texture map is provided to a display buffer at a location corresponding to the pixel address described in the screen look-up table, step 306. As noted above, the foregoing steps 304-306 are repeated for each pixel entry in the screen look-up table.
- Figure 4 illustrates a relationship between the screen look-up table, the parametric look-up table, the texture map (i.e., the parametric spherical environment map), and the rendered object on a display screen.
- a globe is rendered.
- a screen look-up table 404 is used to represent a rendered object 402, here a sphere, on a display screen 401.
- the screen look-up table 404 is for an orthographic projection of a sphere.
- FoF each surface point 403 on rendered object 402 a corresponding pixel address 405 exists in screen look-up table 404.
- a pixel address 405 is used to find an entry in a parametric look-up table 408.
- the parametric look-up table 408 is generated so as to flip the "sphere" ninety degrees about an axis perpendicular to a north south vector of the texture map.
- the parametric look-up table 408 will contain indices into a texture map, here texture map 410 (here a spherical environment map for a globe).
- the pixel address 405 maps to a texture map index 407.
- the texture map index 407 is used to obtain a pixel value in a texture map 410.
- the texture map index 407 indexes the pixel value at (u',v') 411. This pixel value 411 corresponds to the pixel value for the surface point 403.
- a u offset 406 is added to the u index of the pixel address 405, which is used to find the entry in the parametric look-up table 408.
- a u' offset 409 is added to the u' index of the texture map index 407 which is used to find the pixel value 411.
- the screen look-up table 404 has a rotation axis 412 which is horizontal.
- the creation of the screen look-up table is described in more detail below.
- the screen X-axis (screen look-up table horizontal axis) 412 is illustrated.
- a polar axis 414 of texture map 410 is illustrated on display screen 401. This reflects the ninety (90) degree rotation of the orientation of the parametric look-up table 408.
- the horizontal rotation axis 412 is also illustrated on the display screen 401.
- the image e.g., the sphere
- the image can be rendered using ray-tracing or scan-conversion algorithms. If the sphere size and location and the viewing position are unchanged, the table is computed only once. If however, some parameters change frequently, it is beneficial to optimize this calculation. In the preferred embodiment, two cases are worth considering. The first is an orthographic projection of a sphere. The second is when the viewing position is at the center of the sphere looking at the environment map on the sphere's surface using a perspective projection.
- screen look-up table described herein may be utilized in the texture map indirection of the prior art or the texture map double indirection of the present invention.
- the axes are flipped so that offsetting the screen table u index rotates the sphere about the polar axis which is vertical (i.e., screen parallel to the y-axis.).
- Rendering textured spheres in orthographic projection is useful in two applications.
- the first is rendering globes of terrestrial or planetary databases.
- the second is when rendering environment maps as if viewed through a fish-eye lens.
- the zoom factor for the rendering may change when the user wants to examine the center of the spherical projection in more detail, such as when zooming in on a globe. This would cause a re-computation of the screen look-up table.
- Figure 5 shows the geometry of such a configuration.
- a sphere 501 is shown with respect to a circle 503 with a set of scanlines. What will be computed is how the scanlines intersect with the sphere.
- the screen look-up-table will be used to rotate the sphere 501 about a vertical axis 502.
- the symmetry of a sphere in orthographic projection has a number of simplifying characteristics.
- the v parameter (from pole to pole) is constant.
- the u parameter variation is a scaled version of the variation for the central row of pixels. This means that the screen look-up-table u parameter may be computed very rapidly by scaling a 1-D look-up-table for a single scanline.
- the screen look-up-table does not have to be computed exactly because the subsequent table look-up for display, will preferably use a method which works with nearest pixel arithmetic. Because of this, the inverse sine function may be stored as entries in a small inverse sine look-up-table to be used in calculating screen look-up table entries, negating the need for interpolation.
- TABLE A contains pseudo-code which describes the definition of the screen look-up-table for a sphere in an orthographic projection. It assumes that the image displayed on the screen is square. In the pseudo-code, "&” means logical AND “ I " means logical OR, and « means logical left shift.
- zoom zoom factor for the display of the sphere
- v-Index asin(normalizedY) * (vertical width of texture map);
- Line 1 provides for the initialization of an inverse sine look-up table to be used in calculating screen look-up table values.
- Line 2 describes a zoom factor which may be used to compute or recompute the rendering of the sphere. The zoom factor allows for zooming closer to and away from the sphere as it is viewed.
- Line 3 begins the looping for each column in the look-up table. As noted above, the u index remains constant for each column.
- a normalized Y is calculated. The normalized Y provides for the zooming in the display of the sphere.
- the v index is calculated using the inverse sine look-up table.
- a column scaling factor is then determined.
- a loop for pixels within the circular outline of the sphere on the current scanline is calculated. Note that the portions of the screen look-up table outside of the sphere, contain black pixel values.
- a normalized X is calculated. This is calculated for the same reasons and in a similar manner as the normalized Y of line 4.
- a u index is then calculated using the inverse sine look-up table, at line 9.
- the pixel index is defined as the v index shifted over by u bits (i.e., the number of significant bits in u) followed by the u index.
- the v index and u index are packed into a single word with the v value shifted to the left by enough bits to leave room for the range of u values.
- the screen look-up table is stored as contiguous words (or a 1- dimensional array) rather than a 2-dimensional array.
- the pixel index created by performing a logical "OR" functions between the shifted v index and the u index.
- Creating the screen look-up table is slower than indexing the screen look-up-table once it has been created. Thus, it is preferable to break up the computation into a preprocessing step and a subsequent table look up. On the other hand, where memory is very limited, the indices for u and v could be computed dynamically.
- Rendering textured spheres when the viewing position is at the center, is particularly useful when viewing spherical environment maps. Rather than a sphere, what is viewed is a portion of a spherical environment map from a particular perspective. Because this is a perspective projection, the vertical scanlines of the final image no longer correspond to parallel planes in the model space. When the viewing position is at the center of the sphere and the viewing direction is in the plane of the equator, vertical scanlines in the final image correspond to planes which all pass through the poles of the sphere. The geometry for this arrangement is shown in Figure 6.
- a sphere 601 has an equator 602. As noted above, the viewing direction is in a plane of the equator 602. Vertical scanlines 603 for the look-up table correspond to planes 604 which pass through poles 605.
- X tan( ⁇ ).
- the X value 701 lies in a direction which is orthogonal to the polar axis and is parallel to the screen horizontal axis.
- the angle ⁇ 702 represents the position of a scanline with respect to the viewing position.
- the angle ⁇ 702 is the angle between each of the planes 703 and the viewing direction.
- the range of values for y and x are calculated. Note that the actual range that is derived from the calculation is -yRange to +yRange and -xRange to +xRange, respectively.
- line 3 initiates an outer loop for each column of pixels. First, at line 4 a radius for the column is calculated. At lines 5 and 6, a y increment and y-coordinate are respectively calculated. At line 7, a loop for each pixel within in a column is initiated. At line 8, the angular coordinate is calculated using the inverse tangent table. Finally, at line 9, a new Y- coordinate for a pixel in the column is calculated.
- texture map indirection uses rotational symmetry about one axis to give one rotational degree of freedom.
- a sphere however, has rotational symmetry about any axis which passes through its center.
- the first look-up-table is the same as for texture map indirection. It is a sphere rendered into an image the same size as the screen window.
- the second look-up-table is the parametric index table (or map).
- the parametric index table is the same size as the parametric spherical texture map.
- Each pixel in the parametric look-up table contains a mapping of the sphere (u, v) parameters to another sphere rotated by 90 degrees about an axis perpendicular to the poles of the original sphere.
- the method loops for each pixel in the parametric texture table computing the ( ⁇ , ⁇ ) spherical (or angular) coordinates from that pixel (u, v) indices and, from these, finding the direction vector for that surface point on the sphere.
- D x cos( ⁇ )sin( ⁇ )
- the screen look-up-table is used to find a location in the parametric look-up-table.
- Using the contents of this second table to index into the parametric spherical environment map has the effect of rotating the sphere by 90 degrees so that the poles of the sphere texture are now orthogonal to the poles of the screen-space sphere.
- Adding a u-offset to the contents of the second table before indexing into the surface texture has the effect of rotating the sphere about the texture's polar axis.
- a third rotational degree of freedom could be obtained using a two- dimensional rotation in the image plane.
- Table C contains pseudo code for generating the Pixel values for an image to be displayed. It assumes that the texture map is a power of two in the horizontal direction.
- the u and v values have been packed into a single word with the v value shifted to the left by enough bits to leave room for the range of u values. This packing saves memory in the look-up table.
- vMask (uTextureSize * vTextureSize) - (1 + uMask);
- plndex parametric look-up-table value at location parametriclndex
- texturelndex (plndex & vMask) I ((plndex + uYOffset) & uMask);
- Lines 1 and 2 define the X offset and Y offset for the view being rendered. Such offsets will be generated responsive to a rotate or per request.
- lines 3 and 4 masks for the u and v coordinates are generated.
- Line 5 indicates the beginning of a loop for generating each of the screen pixels from the screen look-up table.
- a screen index is provided. The screen index is the value for the current pixel in. the screen look-up table.
- a parametric index is then calculated from the entry in the screen index at line 7.
- FIG 8 illustrates a map of the world rendered on the surface of a globe using the texture map double indirection method of the preferred embodiment.
- the globe may be rotated around an axis defined by the poles 901 or by the screen horizontal axis 902. As described above, such rotation is accomplished by offsetting the u index of the parametric index table entry. Movement around the polar axis 901 is illustrated by the directions 903 and 904. Note that the polar axis 901 here is illustrated as a vertical line. However, the polar axis 901 would change orientation as the textured sphere is manipulated. In any event, as described above, such a rotation is accomplished by offsetting the u index of the screen look-up table value. The directions around the equator 902 are illustrated by the directions 905 and 906. SPHERICAL ENVIRONMENT MAP EXAxMPLE
- Figure 10 is an example of a spherical environment map projected onto an image plane using the texture map double indirection of the preferred embodiment.
- the panning of the image viewed is shown with respect to a parametric environment map 1101.
- the image viewed 1001 can be panned in north, south, east, west directions as indicated by arrows 1102-1105, respectively.
- the panning in the north and south directions is equivalent to rotating a sphere about a horizontal axis (by offsetting the u index of the parametric index table entry).
- the panning of the image view from left to right is analogous to rotating a sphere about a polar axis (by offsetting the u index of the screen look-up table values).
- Manipulation of the textured sphere or parametric environment map occurs in a manner that would be familiar with the user interface of the Apple® Macintosh® family of Computers.
- the technique will be described first with reference to a textured sphere.
- the technique can be characterized as a click-drag-release sequence.
- a user positions a cursor anywhere on the display of the sphere.
- a cursor control device such as a mouse
- a user would position the cursor on a desired location (view position), depress a switch associated with the cursor control device (i.e. click) and reposition the cursor to a desired position.
- the view of the textured sphere will then be rotated along polar and horizontal axes so that the position where the cursor was "clicked” rotates to the new position of the cursor.
- the original view position of the cursor will be “dragged” to the new position of the cursor.
- rotation will occur with the original position seeking to move to the location of the cursor, and will continue until the point is reached or the switch is released. Note that so long as the switch is not released, the original view position will continue to be "dragged” as the cursor is moved.
- the location of the polar axis may be changed during the course of viewing the sphere. This of course would cause a corresponding change to the orientation in which rotation of the sphere would occur.
- the speed of rotation (or velocity) is relative to the zoom factor.
- a velocity that is inversely proportional to the zoom factor i.e. 1/zoom
- the displacement angle is also relative to the distance that the cursor is re-positioned from the original position.
- the cursor manipulation sequence is similar. However, since the viewpoint is from within the sphere, rather than a sphere rotating, what is viewed is different portions of the parametric environment map. Conceptually what occurs is that the view remains the same, but the sphere is rotated causing different portions of the sphere to come into view. Thus, the rotation of the sphere provides for the panning of the parametric environment map.
- the various parameters for viewing a textured sphere or spherical environment map are provided through a pop-up window.
- the pop-up window is associated with the display of the textured sphere or spherical environment map.
- the various parameters would appear as options in the pop-up window.
- a user may control the desired parameters by positioning a cursor on a parameter control means within the pop-up window, such as a button or slider, and clicking on the cursor control device.
- a cursor on a parameter control means within the pop-up window, such as a button or slider, and clicking on the cursor control device.
- pop-up windows are known to those familiar with the user interface of the Apple® Macintosh® computer.
Abstract
A system for rendering textured spheres and spherical environment maps provides for real time rotation of a textured sphere (501) and panning of the view into a spherical environment map (407), along multiple axes (502) without the need for special rendering hardware. The method is comprised of the steps of: providing a parmetric spherical environment map (501) of the image to be viewed, generating a screen look-up table (404) comprised of look-up addresses, generating a parametric look-up table (408) comprised of index values into the parametric spherical environment map, and for each look-up address (405) in the screen look-up table (404), mapping to an entry in the parametric look-up table (408), retrieving the value in the entry, and using the value to retrieve pixel values (411) from the parametric spherical environment map. Rotation or movement of the view being seen is accomplished by adding offsets to the look-up address and/or the index values.
Description
TEXTUREP SPHERE AND SPHERICAL ENVIRONMENT MAP RENDERING USING TEXTURE MAP DOUBLE INDIRECTION
BACKGROUND OF THE INVENTION
Field of the Invention
The present invention relates to the field of pixel rendering, in particular to the field of rendering textured spheres and spherical environment maps.
2. Description of the Related Art
Pixel rendering refers to the generation of pixel values for displaying an image. An environment map is an image or collection of images which characterize the appearance of a scene when viewed from a particular position. Each type of environment map has an associated projection which is used to compute the appearance along a ray traveling in a particular direction towards the camera. Not all types of environment maps capture the scene in every direction.
A variety of different forms of environment maps have been used in the past. An orthographic projection of a reflecting sphere to characterize the illumination of a scene is described by Williams in "Pyramidal Parametrics", Computer Graphics, Vol. 17, No. 3, pgs. 1-11, July, 1983. The intention was to use the environment map as an aid to
the rapid computation of specular reflections. In an article by Greene entitled "Environment Mapping and Order Applications of Worlds Projections", IEEE Computer Graphics and Applications, Vol. 6, No. 11, pgs. 21-29, Nov., 1986, six images on the faces of a cube are used for a "cubic environment map". This mapping was used to resample synthetic images of a scene to be redisplayed in the form of an Omnimax wide angle lens projection system as well as for the computation of reflections.
Spherical Environment Maps
There are a number of types of spherical projection which may be used to store environment maps. Two are of particular interest, namely spherical reflection maps, and parametric spherical maps.
Spherical reflection maps store an image of the environment as an orthographic projection of a sphere shaded with a perfect reflection of the surrounding scene. Typically, these maps are circular images of spheres within a square array of pixels. These maps are useful for the computation of reflections and illumination when rendering specular surfaces. They do, in fact, sample the entire orientation space. However, they have the disadvantage that the orientations near the silhouette of the sphere are very sparsely sampled. This renders them unsuitable as a representation for all-round interactive viewers.
Parametric spherical environment maps store the environment data in a rectangular image where the (x, y) coordinates of a pixel, map linearly to points on a sphere which are defined by the ( θ, Φ) spherical
(or angular) coordinates of a corresponding direction vector.
The relationship between the direction vector and the angular coordinates is given by:
Dx = cos ( θ) sin ( Φ) Dy = cos ( θ) cos ( Φ) Dz = sin ( θ)
Typically, a parametric spherical environment map is twice as wide as it is high since a sphere is twice the distance around the equator as it is from pole to pole. All regions are sampled at least as much as at the equator. Regions near the poles are oversampled. Figure 1 shows a parametric spherical environment of a museum atrium. The parametric spherical environment map contains the pixel values which are used to display the parametric spherical environment.
Parametric spherical environment maps have a number of useful properties.
• The environment is stored in a single contiguous image.
• They sample the environment completely.
• Translation along the equatorial direction in the map corresponds with rotation about the poles of the sphere.
• The environment is always sampled at least as frequently as at the equator.
Means for viewing a spherical environment map may be characterized by the algorithm used for display and by the speed with which different degrees of freedom for the view point may be updated.
KNOWN TECHNIQUES FOR RENDERING SPHERICAL ENVIRONMENT MAPS
A related area to such rendering is termed texture mapping. In texture mapping a texture file (or image) is applied to points on an object being rendered. This is conceptually analogous to putting a decal on a solid object. In any event, rendering spherical environment maps and textured spheres may be done using a number of different known approaches. The most appropriate approach for doing this will depend on the number of degrees of freedom required during an interactive viewing session. In any event, when rendering a parametric spherical environment map, one may consider the environment to be a texture on the surface of a sphere in 3-D space. A viewpoint with respect to the sphere will determine what is seen by the viewer. For example, the viewpoint may be outside the sphere looking at it as a whole, or it may be a perspective view from within the sphere.
Direct Scan-Conversion
For the general perspective case, i.e. unrestricted directions of manipulation, one approach is to compute the analytic form of the intersection between a plane (formed by the viewpoint and a scanline) and the sphere. In an article entitled "Simulation of Natural Scenes Using Textured Quadric Surfaces", Computer Graphics, Geoffrey Y. Gardner, Vol. 18, No. 3, pgs. 11-20, July, 1984, such a scheme was used for textured ellipsoids. Because the surface texture was a procedural texture which only depended on the surface (x, y, z) point, the (u, v)
parameters for the surface were not required. The additional computational requirements for the (u, v) values make this general approach suitable for a non-real time system, but prohibitive for real¬ time use on personal computers without special rendering hardware. Such special hardware may significantly increase the cost of the computer system.
Texture Map Indirection
An alternative approach is to restrict the degrees of freedom with which the viewer may manipulate the sphere. If the sphere is in a fixed position, with a fixed size, a technique called texture map indirection may be used. The sphere is first rendered into a look-up- table, which is the same size as the final image. This is known as the screen look-up-table. Each look-up-table pixel contains the surface (u, v) value for the rendered sphere.
The "u" index is along the equator; while the "v" index is between the poles. When computing the final image, the contents of the screen look-up-table are used to index into the parametric spherical environment map. If this is done directly, this process would always obtain the same image of the sphere. However, if the sphere u index is offset before being used to look up the texture value, the spherical texture appears to rotate about an axis passing through the poles. This has the effect of allowing a single rotational degree of freedom for the textured sphere or spherical environment. This technique is similar to that described in an article entitled "An Image Synthesizer", Ken
Perlin, Computer Graphics, Vol. 19, No. 3, pgs. 287-296, 1985. In the article, the shading is being changed for a fixed geometric scene.
OBJECT OF THE PRESENT INVENTION
It is desirable to provide a rendering means which allows for rotation of textured spheres and spherical environment maps along multiple axes without the requirement of specialized hardware rendering devices. Thus, it is an object for the present invention to provide a means for rendering textured spheres and spherical environment maps that may be rotated and viewed along multiple axes in real-time, and in a cost-effective manner.
-1-
SUMMARY
A method and apparatus for rendering textured spheres and spherical environment maps is disclosed. The present invention describes a rapid scheme for viewing textured spheres and spherical environment maps. The intention is to let the user interact with textured spheres and environment maps in real-time, with the view direction and field of view under user control. The viewing screen is assumed to be flat, such as a computer monitor. The real-time interaction may be done without the use of any special purpose graphics hardware. The method of the present invention provides for real time rotation along multiple axes. A two-level indexing scheme for accessing pixel data in a parametric spherical environment map (or texture map), is used to identify shading values for pixels in a display window. The two-level indexing scheme is comprised of a screen look¬ up table and a parametric look-up table. The screen look-up table has the dimensions of the display window, whereas the parametric look-up table has the dimensions of the parametric spherical environment map. The screen look-up table is similar to the screen look-up table for texture map indirection except that it is rotated by ninety degrees, so that the polar axis is horizontal. The parametric look-up table is a transformation of a spheres u,v coordinates having the polar axis along the Z axis, to a sphere with u,v, coordinates having the polar axis along the Y axis.
The method for the present invention is comprised primarily of the steps of: providing a parametric spherical environment map of the
image to be viewed, generating a screen look-up table comprised of look-up addresses, generating a parametric look-up table comprised of index values into the parametric spherical environment map, and for each look-up address in the screen look-up table, mapping to an entry in the parametric look-up table, retrieving the value in the entry, and using the value to retrieve pixel values from the parametric spherical environment map. Rotation or movement of the view being seen is accomplished by adding offsets to the look-up address and /or the index values.
The method of the present invention may be practiced on a computer system mat does not require specialized rendering hardware. However, certain embodiments of the present invention as described herein may derive benefits of dedicated hardware facilities.
BRIEF DESCRIPπON OF THE FIGURES
Figure 1 illustrates a texture map, in this case a parametric spherical environment map, as may be used by the preferred embodiment of the present invention.
Figure 2 is a block diagram of a computer system as may be utilized by the preferred embodiment of the present invention.
Figure 3 is a flow chart illustrating the overall method of the preferred embodiment of the present invention.
Figure 4 illustrates the relationships between the various tables, computer screen display, and the texture map as utilized by the preferred embodiment of the present invention.
Figure 5 illustrates the geometry of a sphere for the creation of a screen look-up table for orthographic projections, as may be utilized in the preferred embodiment of the present invention. The screen look¬ up table corresponds to the screen look-up table of Figure 4 rotated by ninety (90) degrees in the plane of the screen.
Figure 6 illustrates the geometry for the creation of a screen look¬ up table where the view position is at the center of the sphere and the viewing direction is in the plane of the sphere, as may be utilized by the preferred embodiment of the present invention. The screen look-
up table corresponds to the screen look-up table of Figure 4 rotated by ninety (90) degrees in the plane of the screen.
Figure 7 further illustrates the creation of a screen look-up table of Figure 6, in particular, the vertical scanlines as planes through a sphere as may be utilized by the preferred embodiment of the present invention.
Figure 8 is an example of a textured sphere, i.e. a globe, as may be rendered using the preferred embodiment of the present invention.
Figure 9 illustrates the axis of rotation for a textured sphere as may be utilized by the preferred embodiment of the present invention.
Figure 10 is an example of a spherical environment map projected onto a viewing plane, where the viewing position is at the center of the sphere, i.e. of a museum atrium, as may be rendered using the preferred embodiment of the present invention.
Figure 11 illustrates the effect of and direction of panning through a parametric spherical environment map, as may be performed by the preferred embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
A method and apparatus for rendering textured spheres and spherical environment maps, is described. In the following description, numerous specific details are set forth such as the conversion of angular coordinates to dimensional coordinates, in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, specific implementation details, such as table data structures, have not been shown in detail in order not to unnecessarily obscure the present invention.
OVERVIEW OF A COMPUTER SYSTEM IN THE PREFERRED EMBODIMENT
The computer system of the preferred embodiment is described with reference to Figure 2. The present invention may be implemented on a general purpose microcomputer, such as one of the members of the Apple® Macintosh® family, one of the members of the IBM Personal Computer family, or one of several work-station or graphics computer devices which are presently commercially available. In any event, a computer system as may be utilized by the preferred embodiment generally comprises a bus or other communication means 201 for communicating information, a processor means 202 coupled with said bus 201 for processing information, a random access memory (RAM) or other storage device 203 (commonly referred to as a main memory) coupled with said bus 201 for storing information and instructions for said processor 202, a read only memory (ROM) or other
static storage device 204 coupled with said bus 201 for storing static information and instructions for said processor 202, a data storage device 205, such as a magnetic disk and disk drive, coupled with said bus 201 for storing information and instructions, an alphanumeric input device 206 including alphanumeric and other keys coupled to said bus 201 for commurricating information and command selections to said processor 202, a cursor control device 207, such as a mouse, track-ball, cursor control keys, etc, coupled to said bus 201 for communicating information and command selections to said processor 202 and for controlling cursor movement. Additionally, it is useful if the system includes a hardcopy device 208, such as a printer, for providing permanent copies of information. The hardcopy device 208 is coupled with the processor 202 through bus 201.
Also coupled to the computer system of the preferred embodiment is a frame buffer 209 which is further coupled to a display device 210, preferably a display device capable of displaying color graphics images or high resolution monochrome graphical images. The frame buffer 209 contains the pixel data for driving the display device 210. In some implementations, the display device 210 may be optionally coupled to a rendering device 211, also known as a graphics accelerator. Typically, such a rendering device 211 is coupled to the bus 201 for communication with the processor 202 and frame buffer 209. The preferred embodiment is implemented for use on Macintosh® family of computers available from Apple® Computer, Inc. of Cupertino, California.
It should be noted that the processor 202 performs various parts
of the rendering method, such as table creation and table look-ups. Further, such created tables and other data may be stored in RAM 203 (for data that is dynamic in nature), or in data storage device 205 or ROM 204 (for data that is static in nature).
Finally, it should be noted that an alternative embodiment of the present invention may be practiced on a system of fixed functionality. For example, it would be apparent to one skilled in the art to provide a fixed set of screen look-up tables stored in ROM, wherein views of data are limited to mappings to the fixed set of screen look-up tables. Alternatively, a graphics accelerator, as described above, may be designed which embodies the present invention.
OVERVIEW OF RENDERING METHOD OF THE CURRENTLY PREFERRED EMBODIMENT
The rendering method of the currently preferred embodiment is referred to as texture map double indirection. The name is derived from the use of two distinct maps for identifying pixel values in a texture map for rendering a particular object. In a currently preferred and implemented embodiment, the texture map is a parametric spherical environment map, such as described in the prior art. However, it would be apparent to one skilled in the art to use other forms of a texture map, without departing from the spirit and scope of the present invention. In any event, the terms parametric spherical environment map and texture map are used interchangeably in this description. Figure 3 is a flow chart illustrating the overall flow of the method of the preferred embodiment. It is important to note, that it
would be apparent to one skilled in the art that certain steps, namely steps 301-303, could be performed in a different order. The order in which each of these steps is presented in Figure 3 is merely one sequence in which they can be performed. First, a texture map, i.e. a parametric spherical environment map, is generated and provided to a rendering means, step 301. Next, a screen look-up table is generated, step 302. The screen look-up table will have (u,v) coordinates as entries. As noted previously, the u index is along the equator, whereas the v index is between the poles. These (u,v) entries correspond to the desired projected view. Typically, the screen look-up table will be created by rendering the object or perspective of the desired projected view. Next, the parametric look-up table is generated, step 303. The parametric look-up table will have (u',v') coordinate entries which are orthogonal to the desired projected view of the screen look-up table. The parametric look-up table will have dimensions which are identical to the texture map. Once the foregoing steps have been completed, an image may be rendered.
Pixel rendering occurs, by identifying a pixel value for each pixel entry in the screen look-up table. For each pixel in the screen look-up table, a corresponding entry in the parametric look-up table is obtained, step 304. If rotation about a horizontal axis of the displayed sphere is desired, an offset is added to the u index of the entry from the screen look-up table in order to find the entry in the parametric look-up table. Using the index obtained from the parametric look-up table, a pixel value from the texture map is obtained, step 305. If a rotation about the polar axis of the displayed sphere is desired, an offset is added to the u1
index of the index from the parametric look-up table. Finally, the pixel value obtained from the texture map is provided to a display buffer at a location corresponding to the pixel address described in the screen look-up table, step 306. As noted above, the foregoing steps 304-306 are repeated for each pixel entry in the screen look-up table.
.Relationship Between Tables, Texture Map and Display
Figure 4 illustrates a relationship between the screen look-up table, the parametric look-up table, the texture map (i.e., the parametric spherical environment map), and the rendered object on a display screen. In this illustration a globe is rendered. A screen look-up table 404 is used to represent a rendered object 402, here a sphere, on a display screen 401. In this case the screen look-up table 404 is for an orthographic projection of a sphere. FoF each surface point 403 on rendered object 402 a corresponding pixel address 405 exists in screen look-up table 404. During rendering, a pixel address 405 is used to find an entry in a parametric look-up table 408. The parametric look-up table 408 is generated so as to flip the "sphere" ninety degrees about an axis perpendicular to a north south vector of the texture map. As noted above, the parametric look-up table 408 will contain indices into a texture map, here texture map 410 (here a spherical environment map for a globe). Here, the pixel address 405 maps to a texture map index 407. The texture map index 407 is used to obtain a pixel value in a texture map 410. Here, the texture map index 407, indexes the pixel value at (u',v') 411. This pixel value 411 corresponds to the pixel value for the surface point 403. As noted with reference to Figure 3, if a
rotation about a horizontal axis is desired, a u offset 406 is added to the u index of the pixel address 405, which is used to find the entry in the parametric look-up table 408. Similarly, if rotation about a polar axis is desired, a u' offset 409 is added to the u' index of the texture map index 407 which is used to find the pixel value 411.
Also illustrated in Figure 4 are the axes of rotation. The screen look-up table 404 has a rotation axis 412 which is horizontal. The creation of the screen look-up table is described in more detail below. With respect to the parametric look-up table 408, the screen X-axis (screen look-up table horizontal axis) 412 is illustrated. Finally, a polar axis 414 of texture map 410 is illustrated on display screen 401. This reflects the ninety (90) degree rotation of the orientation of the parametric look-up table 408. The horizontal rotation axis 412 is also illustrated on the display screen 401.
Parametric Spherical Environment Map
Known techniques exist for creating a parametric spherical environment map that is utilized in the preferred embodiment. Thus, no discussion concerning the creation of a parametric spherical environment map is deemed necessary.
GENERAπON OF THE SCREEN LOOK-UP TABLE
When computing the screen look-up-table, a number of approaches may be used. The image (e.g., the sphere) can be rendered
using ray-tracing or scan-conversion algorithms. If the sphere size and location and the viewing position are unchanged, the table is computed only once. If however, some parameters change frequently, it is beneficial to optimize this calculation. In the preferred embodiment, two cases are worth considering. The first is an orthographic projection of a sphere. The second is when the viewing position is at the center of the sphere looking at the environment map on the sphere's surface using a perspective projection.
It should be noted that the screen look-up table described herein may be utilized in the texture map indirection of the prior art or the texture map double indirection of the present invention.
However, in a single texture map indirection case, the axes are flipped so that offsetting the screen table u index rotates the sphere about the polar axis which is vertical (i.e., screen parallel to the y-axis.).
Orthographic Projections
Rendering textured spheres in orthographic projection is useful in two applications. The first is rendering globes of terrestrial or planetary databases. The second is when rendering environment maps as if viewed through a fish-eye lens. The zoom factor for the rendering may change when the user wants to examine the center of the spherical projection in more detail, such as when zooming in on a globe. This would cause a re-computation of the screen look-up table.
Figure 5 shows the geometry of such a configuration. Referring
to Figure 5, a sphere 501 is shown with respect to a circle 503 with a set of scanlines. What will be computed is how the scanlines intersect with the sphere. The screen look-up-table will be used to rotate the sphere 501 about a vertical axis 502.
The symmetry of a sphere in orthographic projection has a number of simplifying characteristics. For a horizontal row of pixels, the v parameter (from pole to pole) is constant. For each row of pixels, the u parameter variation is a scaled version of the variation for the central row of pixels. This means that the screen look-up-table u parameter may be computed very rapidly by scaling a 1-D look-up-table for a single scanline.
The screen look-up-table does not have to be computed exactly because the subsequent table look-up for display, will preferably use a method which works with nearest pixel arithmetic. Because of this, the inverse sine function may be stored as entries in a small inverse sine look-up-table to be used in calculating screen look-up table entries, negating the need for interpolation.
TABLE A contains pseudo-code which describes the definition of the screen look-up-table for a sphere in an orthographic projection. It assumes that the image displayed on the screen is square. In the pseudo-code, "&" means logical AND " I " means logical OR, and « means logical left shift.
TABLE A
1. Generate an inverse sine look-up table;
2. zoom = zoom factor for the display of the sphere;
3. Repeat lines 4 and 5 for each column of the screen look-up-table;
4. normalizedY = (y-coordinate of the scanline - halfScreenYSize)/ (zoom * halfScreenYSize);
5. v-Index = asin(normalizedY) * (vertical width of texture map);
6. columnScalingFactor = 1.0 / (sqrtQ.O - normalizedY * normalizedY) * zoom);
7. Repeat lines 8-10 for each pixel within the circular outline of the sphere on the current scanline;
8. normalizedX = ((x-coordinate of the pixel - halfScreenXSize) / halfScreenYSize);
9. ulndex = asin(normalizedX * ColumnScalingFactor) * uSize;
10. pixellndex = vlndex « uBits I ulndex;
Description of Table A
Line 1 provides for the initialization of an inverse sine look-up table to be used in calculating screen look-up table values. Line 2 describes a zoom factor which may be used to compute or recompute the rendering of the sphere. The zoom factor allows for zooming closer to and away from the sphere as it is viewed. Line 3 begins the looping for each column in the look-up table. As noted above, the u index remains constant for each column. First, at line 4 a normalized Y is calculated. The normalized Y provides for the zooming in the
display of the sphere. At line 5, the v index is calculated using the inverse sine look-up table. At line 6 a column scaling factor is then determined. Recall that the column scaling factor will be used to quickly calculate the horizontal or u index for each of the pixel addresses. At line 7 a loop for pixels within the circular outline of the sphere on the current scanline is calculated. Note that the portions of the screen look-up table outside of the sphere, contain black pixel values. First at line 8 a normalized X is calculated. This is calculated for the same reasons and in a similar manner as the normalized Y of line 4. A u index is then calculated using the inverse sine look-up table, at line 9. Finally at line 10, the pixel index is defined as the v index shifted over by u bits (i.e., the number of significant bits in u) followed by the u index. In order to minimize the amount of space (i.e., memory) required to store the screen look-up table, the v index and u index are packed into a single word with the v value shifted to the left by enough bits to leave room for the range of u values. In this manner, the screen look-up table is stored as contiguous words (or a 1- dimensional array) rather than a 2-dimensional array. However, it would be apparent to one skilled in the art to utilize separate words for each of the respected index values. Further, note that the pixel index created by performing a logical "OR" functions between the shifted v index and the u index.
Creating the screen look-up table is slower than indexing the screen look-up-table once it has been created. Thus, it is preferable to break up the computation into a preprocessing step and a subsequent table look up. On the other hand, where memory is very limited, the
indices for u and v could be computed dynamically.
The Look-Up-Table for a Viewing Position at the Center of a Sphere
Rendering textured spheres, when the viewing position is at the center, is particularly useful when viewing spherical environment maps. Rather than a sphere, what is viewed is a portion of a spherical environment map from a particular perspective. Because this is a perspective projection, the vertical scanlines of the final image no longer correspond to parallel planes in the model space. When the viewing position is at the center of the sphere and the viewing direction is in the plane of the equator, vertical scanlines in the final image correspond to planes which all pass through the poles of the sphere. The geometry for this arrangement is shown in Figure 6.
Referring to Figure 6, a sphere 601 has an equator 602. As noted above, the viewing direction is in a plane of the equator 602. Vertical scanlines 603 for the look-up table correspond to planes 604 which pass through poles 605.
The relationship between the lateral position on the display screen and the angular position on the equator is illustrated in Figure 7. This is given by X = tan( θ). Referring to Figure 7, the X value 701 lies in a direction which is orthogonal to the polar axis and is parallel to the screen horizontal axis. The angle θ 702 represents the position of a scanline with respect to the viewing position. The angle θ 702 is the angle between each of the planes 703 and the viewing direction.
The relationship between the screen coordinate x, y and the
elevation angle Φ is given by radius r = (l+x2) 1 2 ø = tan_1(y/r)
Since the expression for Φ depends on scaling y and then finding the inverse tangent value, a table of inverse tangent values may be used to speed the computation. The following pseudo-code fragment exemplifies the calculation of ø.
TABLE B
1. yRange = tan(FieldOfView / 2);
2. xRange = yRange * aspectRatio;
3. Loop for each column of pixels with horizontal screen coordinate "x" where x goes from -xRange to xRange;
4. radius = sqrt(1.0 + x*x);
5. ylncrement = 1.0 / (radius * yScreenPixels);
6. yCoordinate = -yRange / radius;
7. Loop for each pixel in the column;
8. Φ = inverseTanTable(yCoordinate);
9. yCoordinate = yCoordinate + ylncrement;
Description of Table B
At lines 1 and 2, the range of values for y and x are calculated. Note that the actual range that is derived from the calculation is -yRange to +yRange and -xRange to +xRange, respectively. Next, line 3 initiates an outer loop for each column of pixels. First, at line 4 a
radius for the column is calculated. At lines 5 and 6, a y increment and y-coordinate are respectively calculated. At line 7, a loop for each pixel within in a column is initiated. At line 8, the angular coordinate is calculated using the inverse tangent table. Finally, at line 9, a new Y- coordinate for a pixel in the column is calculated.
Generation of the Parametric Look-Up Table
As described with respect to the prior art, texture map indirection uses rotational symmetry about one axis to give one rotational degree of freedom. A sphere, however, has rotational symmetry about any axis which passes through its center. By using two levels of indirection, it is possible to render a sphere with two rotational degrees of freedom. The first look-up-table is the same as for texture map indirection. It is a sphere rendered into an image the same size as the screen window.
The second look-up-table is the parametric index table (or map). The parametric index table is the same size as the parametric spherical texture map. Each pixel in the parametric look-up table contains a mapping of the sphere (u, v) parameters to another sphere rotated by 90 degrees about an axis perpendicular to the poles of the original sphere.
The method loops for each pixel in the parametric texture table computing the ( θ, Φ) spherical (or angular) coordinates from that pixel (u, v) indices and, from these, finding the direction vector for that surface point on the sphere.
Dx=cos( θ)sin( Φ)
Dy = cos( θ)cos( Φ)
Dz = sin( θ)
The direction vector D is then rotated about the Z-axis and the result is used to find a new pair of ( Θ, Φ) values which are then encoded in the parametric look-up-table for that surface point using the equations: dx = Dy
Φ' = tan-l (dx/dz) θ' = sin-1 (dy)
When computing a view of the final image of the sphere or spherical environment map, the screen look-up-table is used to find a location in the parametric look-up-table. Using the contents of this second table to index into the parametric spherical environment map has the effect of rotating the sphere by 90 degrees so that the poles of the sphere texture are now orthogonal to the poles of the screen-space sphere.
Adding a u-offset to the contents of the second table before indexing into the surface texture has the effect of rotating the sphere about the texture's polar axis. This leads to a sphere renderer which has two rotational degrees of freedom. The first rotates the sphere about the X-axis and the second rotates the sphere about its pole. A third rotational degree of freedom could be obtained using a two- dimensional rotation in the image plane.
Table C contains pseudo code for generating the Pixel values for an image to be displayed. It assumes that the texture map is a power of two in the horizontal direction. As before, the u and v values have been packed into a single word with the v value shifted to the left by enough bits to leave room for the range of u values. This packing saves memory in the look-up table.
TABLE C
1. uXOffset = xRotationAngle * uTextureSize/ (2.0 * π);
2. uYOffset = yRotationAngle * uTextureSize/ (2.0 * π);
3. uMask =uTextureSize - I;
4. vMask = (uTextureSize * vTextureSize) - (1 + uMask);
5. loop for each screen pixel in the screen look-up table;
6. slndex = Screen look-up-table value for current pixel;
7. parametriclndex = (slndex & vMask) I ((slndex + uXOffset) & uMask);
8. plndex = parametric look-up-table value at location parametriclndex;
9. texturelndex = (plndex & vMask) I ((plndex + uYOffset) & uMask);
10. pixel color = texture entry value at location texturelndex;
Description of Table C
Lines 1 and 2 define the X offset and Y offset for the view being rendered. Such offsets will be generated responsive to a rotate or per request. At lines 3 and 4 masks for the u and v coordinates are generated. Line 5 indicates the beginning of a loop for generating each of the screen pixels from the screen look-up table. At line 6, a screen index is provided. The screen index is the value for the current pixel in. the screen look-up table. A parametric index is then calculated from the entry in the screen index at line 7. This is accomplished by a series of logical functions; that screen index and the v mask are "AND"ed,
the horizontal axis u offset is added to screen index then "AND"ed with the u-mask, and the "OR" value is derived from the two remaining values. At line 8 the parametric look-up table at the location within the metric look-up table is calculated. At line 10, the index into the texture map is calculated. This is accomplished by performing an "AND" function between the parametric index and v mask which is "OR"ed with the parametric index added to the polar axis u offset which is "AND"ed with u-mask. And finally, at line 10 the pixel color for the pixel being rendered from the texture map.
TEXTURED SPHERE EXAMPLE
Figure 8 illustrates a map of the world rendered on the surface of a globe using the texture map double indirection method of the preferred embodiment. Referring now to Figure 9, the directions of rotation are illustrated. The globe may be rotated around an axis defined by the poles 901 or by the screen horizontal axis 902. As described above, such rotation is accomplished by offsetting the u index of the parametric index table entry. Movement around the polar axis 901 is illustrated by the directions 903 and 904. Note that the polar axis 901 here is illustrated as a vertical line. However, the polar axis 901 would change orientation as the textured sphere is manipulated. In any event, as described above, such a rotation is accomplished by offsetting the u index of the screen look-up table value. The directions around the equator 902 are illustrated by the directions 905 and 906.
SPHERICAL ENVIRONMENT MAP EXAxMPLE
Figure 10 is an example of a spherical environment map projected onto an image plane using the texture map double indirection of the preferred embodiment.
Referring now to Figure 11, the panning of the image viewed is shown with respect to a parametric environment map 1101. As illustrated by Figure 11, the image viewed 1001 can be panned in north, south, east, west directions as indicated by arrows 1102-1105, respectively. The panning in the north and south directions is equivalent to rotating a sphere about a horizontal axis (by offsetting the u index of the parametric index table entry). Similarly, the panning of the image view from left to right is analogous to rotating a sphere about a polar axis (by offsetting the u index of the screen look-up table values).
Manipulation and Viewing of a Textured Sphere and Spherical Environment Map
Manipulation of the textured sphere or parametric environment map occurs in a manner that would be familiar with the user interface of the Apple® Macintosh® family of Computers. The technique will be described first with reference to a textured sphere. The technique can be characterized as a click-drag-release sequence. In such a sequence, a user positions a cursor anywhere on the display of the sphere. Using a cursor control device, such as a mouse, a user would
position the cursor on a desired location (view position), depress a switch associated with the cursor control device (i.e. click) and reposition the cursor to a desired position. The view of the textured sphere will then be rotated along polar and horizontal axes so that the position where the cursor was "clicked" rotates to the new position of the cursor. Thus, the original view position of the cursor will be "dragged" to the new position of the cursor. In any event, rotation will occur with the original position seeking to move to the location of the cursor, and will continue until the point is reached or the switch is released. Note that so long as the switch is not released, the original view position will continue to be "dragged" as the cursor is moved.
It should be further noted that the location of the polar axis may be changed during the course of viewing the sphere. This of course would cause a corresponding change to the orientation in which rotation of the sphere would occur.
Further, the speed of rotation (or velocity) is relative to the zoom factor. Thus, if a user was zoomed in close to the sphere, rotation of the sphere would be slower than it would be if the user is zoomed farther away. A velocity that is inversely proportional to the zoom factor (i.e. 1/zoom) is utilized in the preferred embodiment. The displacement angle is also relative to the distance that the cursor is re-positioned from the original position.
With respect to a spherical environment map, the cursor manipulation sequence is similar. However, since the viewpoint is
from within the sphere, rather than a sphere rotating, what is viewed is different portions of the parametric environment map. Conceptually what occurs is that the view remains the same, but the sphere is rotated causing different portions of the sphere to come into view. Thus, the rotation of the sphere provides for the panning of the parametric environment map.
The various parameters for viewing a textured sphere or spherical environment map, e.g. zooming and velocity control, are provided through a pop-up window. The pop-up window is associated with the display of the textured sphere or spherical environment map. The various parameters would appear as options in the pop-up window. A user may control the desired parameters by positioning a cursor on a parameter control means within the pop-up window, such as a button or slider, and clicking on the cursor control device. Again, such pop-up windows are known to those familiar with the user interface of the Apple® Macintosh® computer.
Thus, a method and apparatus for rendering textured spheres and spherical environmental maps, and allowing rotation along multiple axes, in real-time and without requiring specialized rendering hardware, is disclosed.
Claims
1. A method for rendering views of a spheres, said views being capable of manipulation along multiple axes, said method comprising the steps of: a) providing a texture map comprised of a plurality of pixel shading values; b) generating a screen look-up table comprised of look-up addresses, said screen look-up table corresponding to a display window having a predetermined projection orientation with respect to a viewer; c) generating a parametric look-up table, said parametric index map being of the same size as said parametric spherical environment map; d) for each look-up address in said look-up table:
• mapping to a corresponding entry in said parametric look-up table based on said look-up address;
• retrieving an index value from said corresponding entry in said parametric look-up table;
• retrieving an entry in said texture map based on said index value, said entry being a pixel shading value for said look-up address in said screen look-up table.
2. The method as recited in Claim 1 wherein said step of mapping to a corresponding entry in said parametric look-up table is further comprised of the step of providing a first offset to said look-up address, thereby rotating the view of said sphere along a first axis.
3. The method as recited in Claim 2 wherein said step of retrieving an entry in said texture map based on said index value is further comprised of the step of providing a second offset to said index value, thereby rotating the view of said sphere along a second axis.
4. The method as recited in Claim 3 wherein said first axis is a horizontal axis and said second axis is a polar axis.
5. The method as recited in Claim 3 wherein said texture map is a spherical environment map.
6. The method as recited in Claim 1 wherein said step of generating a look-up table comprised of look-up addresses, said screen look-up table corresponding to a display window having a predetermined projection orientation with respect to a viewer, said predetermined projection orientation being an orthographic projection, said step is further comprised of the steps of: a) generating a set of look-up address for a central scanline of said display window; b) storing said set of look-up addresses for said central scanline; c) for each of the remaining scanlines in said display window:
• scaling said look-up address for said central scanline by a factor corresponding to the position of the scanline being processed; and
• storing said scaled look-up address in corresponding location of said screen look-up table.
7. The method as recited in Claim 1 wherein said step of generating a screen look-up table comprised of look-up addresses, said screen look¬ up table corresponding to a display window having a predetermined projection orientation with respect to a viewer, said predetermined projection orientation being at the center of a sphere, said step is further comprised of the steps of: a) computing an X-range and a Y-range for the projection orientation of a viewer; for each column of pixels with with said X-range: b) computing a radius for said column; c) computing a Y-increment value; d) computing a Y-coordinate from said Y-range and said radius; for each pixel in said column: e) computing an inverse tangent, from said Y-coordinate and storing as an elevation angle; and f) assigning a Y-coordinate to equal a prior Y-coordinate value added to said Y-increment value.
8. The method as recited in Claim 1 wherein said step of generating a parametric look-up table is further comprised of the steps of: for each pixel address of said parametric spherical environment map: a) computing first angular coordinates corresponding to said pixel addresses; b) computing a direction vector corresponding to first linear coordinates of said pixel address, said direction vector having X, Y and Z axis components; c) rotating said direction vector around said Z-axis by ninety degrees; d) computing second angular coordinates based on said rotation; e) computing second linear coordinates from said second angular coordinates; and f) storing said second linear coordinates.
9. A method for for viewing textured spheres and spherical environment maps as rendered by the method of Claim 1, wherein said method is comprised of the steps of: a) positioning a cursor at a position on said textured sphere or said spherical environment map by moving a cursor control device at a first position; b) depressing a switch associated with said cursor control device into a first position; c) re-positioning said cursor by moving said cursor control device to a second position; and d) rotating said textured sphere or said spherical environment map from said first position to said second position.
10. The method as recited in Claim 9 wherein said step of rotating said textured sphere or said spherical environment map from said first position to said second position will terminate if said switch associated with said cursor control device is released into a second position.
11. In a rendering system for generating pixel values for rendering textured spheres and spherical environment maps, said rendering system utilizing a screen look-up table to identify pixel values in a texture map corresponding to pixel addresses in said screen look-up table, a method for generating said screen look-up table comprising the steps of: a) identifying a projection orientation as a textual sphere; b) generating a set of look-up addresses for a central scanline of said display window; c) storing said set of look-up addresses for said central scanline; d) for each of the remaining scanlines in said display window: • scaling said look-up addresses for said central scanline by a factor corresponding to the position of the scanline being processed; and
• storing said scaled look-up address in corresponding location of said screen look-up table.
12. The method as recited in Claim 11 is further comprised of the steps of: a) computing an X-range and a Y-range for the projection orientation of a viewer; for each column of pixels with with said X-range: b) computing a radius for said column; c) computing a Y-increment value; d) computing a Y-coordinate from said Y-range and said radius; for each pixel in said column: e) computing an inverse tangent, from said Y-coordinate and storing as an elevation angle; and f) assigning Y-coordinate to equal a prior Y-coordinate value added to said Y-increment value.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US88024092A | 1992-05-08 | 1992-05-08 | |
US07/880,240 | 1992-05-08 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1993023835A1 true WO1993023835A1 (en) | 1993-11-25 |
Family
ID=25375817
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US1993/002678 WO1993023835A1 (en) | 1992-05-08 | 1993-03-23 | Textured sphere and spherical environment map rendering using texture map double indirection |
Country Status (4)
Country | Link |
---|---|
US (2) | US5446833A (en) |
AU (1) | AU3930793A (en) |
CA (1) | CA2135180A1 (en) |
WO (1) | WO1993023835A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0804022A1 (en) * | 1995-11-14 | 1997-10-29 | Sony Corporation | Device and method for processing image |
EP1028389A2 (en) * | 1999-02-12 | 2000-08-16 | Advanet, Inc. | Arithmetic unit for image transformation |
WO2001063559A2 (en) * | 2000-02-23 | 2001-08-30 | Uts United 3 D Software Inc. | Method for automatically linking image areas of a 3-dimensional representation of an object with functions |
EP1453009A3 (en) * | 2003-03-01 | 2017-03-01 | The Boeing Company | Systems and methods for providing enhanced vision imaging |
Families Citing this family (109)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7382399B1 (en) | 1991-05-13 | 2008-06-03 | Sony Coporation | Omniview motionless camera orientation system |
US5990941A (en) * | 1991-05-13 | 1999-11-23 | Interactive Pictures Corporation | Method and apparatus for the interactive display of any portion of a spherical image |
US5945985A (en) * | 1992-10-27 | 1999-08-31 | Technology International, Inc. | Information system for interactive access to geographic information |
US5623588A (en) * | 1992-12-14 | 1997-04-22 | New York University | Computer user interface with non-salience deemphasis |
US8381126B2 (en) | 1992-12-14 | 2013-02-19 | Monkeymedia, Inc. | Computer user interface with non-salience deemphasis |
US8370746B2 (en) * | 1992-12-14 | 2013-02-05 | Monkeymedia, Inc. | Video player with seamless contraction |
TW284870B (en) * | 1994-01-26 | 1996-09-01 | Hitachi Ltd | |
US5734805A (en) * | 1994-06-17 | 1998-03-31 | International Business Machines Corporation | Apparatus and method for controlling navigation in 3-D space |
JPH0877356A (en) * | 1994-09-09 | 1996-03-22 | Fujitsu Ltd | Method and device for processing three-dimensional multi-view image |
EP0702494B1 (en) * | 1994-09-19 | 2001-12-05 | Matsushita Electric Industrial Co., Ltd. | Three-dimensional image display apparatus |
US5835692A (en) * | 1994-11-21 | 1998-11-10 | International Business Machines Corporation | System and method for providing mapping notation in interactive video displays |
US5577176A (en) * | 1994-11-23 | 1996-11-19 | Computervision Corporation | Method and apparatus for displaying a cursor along a two dimensional representation of a computer generated three dimensional surface |
US5751931A (en) * | 1995-04-18 | 1998-05-12 | Lucent Technologies Inc. | Three dimensional graphical display of information |
US5632205A (en) * | 1995-06-07 | 1997-05-27 | Acushnet Company | Apparatus for the spatial orientation and manipulation of a game ball |
US5694531A (en) * | 1995-11-02 | 1997-12-02 | Infinite Pictures | Method and apparatus for simulating movement in multidimensional space with polygonal projections |
US6031540A (en) | 1995-11-02 | 2000-02-29 | Imove Inc. | Method and apparatus for simulating movement in multidimensional space with polygonal projections from subhemispherical imagery |
US7542035B2 (en) * | 1995-11-15 | 2009-06-02 | Ford Oxaal | Method for interactively viewing full-surround image data and apparatus therefor |
US5748194A (en) * | 1996-05-08 | 1998-05-05 | Live Picture, Inc. | Rendering perspective views of a scene using a scanline-coherent look-up table |
JPH09319891A (en) * | 1996-06-03 | 1997-12-12 | Sega Enterp Ltd | Image processor and its processing method |
US6459451B2 (en) | 1996-06-24 | 2002-10-01 | Be Here Corporation | Method and apparatus for a panoramic camera to capture a 360 degree image |
US6373642B1 (en) | 1996-06-24 | 2002-04-16 | Be Here Corporation | Panoramic imaging arrangement |
US6341044B1 (en) | 1996-06-24 | 2002-01-22 | Be Here Corporation | Panoramic imaging arrangement |
US6331869B1 (en) | 1998-08-07 | 2001-12-18 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
US6493032B1 (en) | 1996-06-24 | 2002-12-10 | Be Here Corporation | Imaging arrangement which allows for capturing an image of a view at different resolutions |
US5923334A (en) * | 1996-08-05 | 1999-07-13 | International Business Machines Corporation | Polyhedral environment map utilizing a triangular data structure |
US6031541A (en) * | 1996-08-05 | 2000-02-29 | International Business Machines Corporation | Method and apparatus for viewing panoramic three dimensional scenes |
US5912670A (en) * | 1996-08-05 | 1999-06-15 | International Business Machines Corporation | Method and apparatus for overlaying a bit map image on an environment map |
US6230167B1 (en) | 1996-08-05 | 2001-05-08 | International Business Machines Corporation | Method and apparatus for generating and displaying hotlinks in a panoramic three dimensional scene |
US5929861A (en) * | 1996-08-23 | 1999-07-27 | Apple Computer, Inc. | Walk-through rendering system |
US6654414B1 (en) * | 1996-11-12 | 2003-11-25 | Ibm Corporation | Video conferencing using camera environment panoramas |
EP0877991B1 (en) * | 1996-11-21 | 2003-01-08 | Koninklijke Philips Electronics N.V. | Method and apparatus for generating a computer graphics image |
US5963213A (en) * | 1997-05-07 | 1999-10-05 | Olivr Corporation Ltd. | Method and system for accelerating warping |
US6356296B1 (en) | 1997-05-08 | 2002-03-12 | Behere Corporation | Method and apparatus for implementing a panoptic camera system |
US6466254B1 (en) | 1997-05-08 | 2002-10-15 | Be Here Corporation | Method and apparatus for electronically distributing motion panoramic images |
JP3904671B2 (en) * | 1997-05-28 | 2007-04-11 | 富士通株式会社 | Virtual clay system and simulation method thereof |
US6151029A (en) * | 1997-08-22 | 2000-11-21 | Seiko Epson Corporation | Texture mapping with improved technique for selecting an appropriate level in filtered representations of the texture |
US5956043A (en) * | 1997-09-18 | 1999-09-21 | Novell, Inc. | Textured tile rotation system and method |
US6011558A (en) * | 1997-09-23 | 2000-01-04 | Industrial Technology Research Institute | Intelligent stitcher for panoramic image-based virtual worlds |
US6067090A (en) * | 1998-02-04 | 2000-05-23 | Intel Corporation | Data skew management of multiple 3-D graphic operand requests |
US6064399A (en) * | 1998-04-03 | 2000-05-16 | Mgi Software Corporation | Method and system for panel alignment in panoramas |
US6192393B1 (en) | 1998-04-07 | 2001-02-20 | Mgi Software Corporation | Method and system for panorama viewing |
US6486908B1 (en) * | 1998-05-27 | 2002-11-26 | Industrial Technology Research Institute | Image-based method and system for building spherical panoramas |
US6369837B1 (en) * | 1998-07-17 | 2002-04-09 | International Business Machines Corporation | GUI selector control |
US6160924A (en) * | 1998-08-12 | 2000-12-12 | Northrop Grumman Corporation | Method for forming a map of a three-dimensional object |
US6191795B1 (en) * | 1998-09-30 | 2001-02-20 | Silicon Graphics, Inc. | Ellipsoidal projection mapping |
JP2000194726A (en) * | 1998-10-19 | 2000-07-14 | Sony Corp | Device, method and system for processing information and providing medium |
US6369818B1 (en) | 1998-11-25 | 2002-04-09 | Be Here Corporation | Method, apparatus and computer program product for generating perspective corrected data from warped information |
US7271803B2 (en) * | 1999-01-08 | 2007-09-18 | Ricoh Company, Ltd. | Method and system for simulating stereographic vision |
US6175454B1 (en) | 1999-01-13 | 2001-01-16 | Behere Corporation | Panoramic imaging arrangement |
US6362824B1 (en) | 1999-01-29 | 2002-03-26 | Hewlett-Packard Company | System-wide texture offset addressing with page residence indicators for improved performance |
US10051298B2 (en) | 1999-04-23 | 2018-08-14 | Monkeymedia, Inc. | Wireless seamless expansion and video advertising player |
US6393158B1 (en) | 1999-04-23 | 2002-05-21 | Monkeymedia, Inc. | Method and storage device for expanding and contracting continuous play media seamlessly |
US6606089B1 (en) * | 1999-06-08 | 2003-08-12 | Sulzer Market And Technology Ag | Method for visualizing a spatially resolved data set |
WO2001006462A1 (en) * | 1999-07-20 | 2001-01-25 | Koninklijke Philips Electronics N.V. | Method and apparatus for computing a computer graphics image of a textured surface |
US7292261B1 (en) | 1999-08-20 | 2007-11-06 | Patrick Teo | Virtual reality camera |
JP3306397B2 (en) | 1999-11-25 | 2002-07-24 | 株式会社ソニー・コンピュータエンタテインメント | Entertainment device, image generation method, and storage medium |
US6687387B1 (en) | 1999-12-27 | 2004-02-03 | Internet Pictures Corporation | Velocity-dependent dewarping of images |
US6897858B1 (en) | 2000-02-16 | 2005-05-24 | Enroute, Inc. | Partial image decompression of a tiled image |
US6559853B1 (en) | 2000-02-16 | 2003-05-06 | Enroute, Inc. | Environment map creation using texture projections with polygonal curved surfaces |
US6515673B1 (en) | 2000-02-16 | 2003-02-04 | Enroute, Inc. | Displaying immersive videos using tiled decompression |
US7259760B1 (en) | 2000-02-16 | 2007-08-21 | Be Here Corporation | Polygonal curvature mapping to increase texture efficiency |
DE10016753A1 (en) * | 2000-04-04 | 2001-10-11 | Definiens Ag | Procedure for navigating between sections in a display room |
US6690371B1 (en) * | 2000-05-03 | 2004-02-10 | Ge Medical Systems Global Technology, Llc | Relevant image data extraction from a medical image data volume |
US7877437B1 (en) * | 2000-05-08 | 2011-01-25 | H.E.B., Llc | Method and apparatus for a distributable globe graphical object |
US20020169789A1 (en) * | 2000-06-05 | 2002-11-14 | Ali Kutay | System and method for accessing, organizing, and presenting data |
US6822656B1 (en) * | 2000-07-13 | 2004-11-23 | International Business Machines Corporation | Sphere mode texture coordinate generator |
US6825851B1 (en) * | 2000-08-23 | 2004-11-30 | Nintendo Co., Ltd. | Method and apparatus for environment-mapped bump-mapping in a graphics system |
WO2002021404A1 (en) * | 2000-09-06 | 2002-03-14 | Envoii | Method and apparatus for a portable information account access agent |
WO2002047028A2 (en) * | 2000-12-07 | 2002-06-13 | Just Iced Cubed Inventions Inc. | Systems and methods for registration of hemispheric images for panomaric viewing |
US7154504B2 (en) * | 2001-01-26 | 2006-12-26 | Microsoft Corporation | System and method for fast, smooth rendering of lit, textured spheres |
WO2002069130A1 (en) * | 2001-02-23 | 2002-09-06 | Altoweb Systems, Inc. | System and method to create an application and to manipulate application components within the application |
US6756990B2 (en) * | 2001-04-03 | 2004-06-29 | Be Here Corporation | Image filtering on 3D objects using 2D manifolds |
US6999971B2 (en) * | 2001-05-08 | 2006-02-14 | Verity, Inc. | Apparatus and method for parametric group processing |
EP1403761B1 (en) | 2001-06-27 | 2008-06-04 | Sony Corporation | Integrated circuit device, information processing device, information recording device memory management method, mobile terminal device, semiconductor integrated circuit device, and communication method using mobile terminal device |
US7136072B2 (en) * | 2001-08-03 | 2006-11-14 | Hewlett-Packard Development Company, L.P. | System and method for performing texture synthesis |
US6700585B2 (en) * | 2001-08-03 | 2004-03-02 | Hewlett-Packard Development Company, L.P. | System and method for synthesis of parametric texture map textures |
US6941516B2 (en) * | 2001-08-06 | 2005-09-06 | Apple Computer, Inc. | Object movie exporter |
WO2003015034A1 (en) * | 2001-08-10 | 2003-02-20 | Stephen John Regelous | A method of rendering an image and a method of animating a graphics character |
US7631277B1 (en) | 2001-12-14 | 2009-12-08 | Apple Inc. | System and method for integrating media objects |
WO2003093954A2 (en) * | 2002-05-03 | 2003-11-13 | Pixearth, Corporation | A system to navigate within images spatially referenced to a computed space |
US7310165B2 (en) * | 2002-09-05 | 2007-12-18 | Xerox Corporation | Dynamic color rendering dictionaries |
US7202867B1 (en) | 2003-01-31 | 2007-04-10 | Microsoft Corporation | Generation of glow effect |
US7274365B1 (en) * | 2003-01-31 | 2007-09-25 | Microsoft Corporation | Graphical processing of object perimeter information |
US7030884B2 (en) * | 2003-02-13 | 2006-04-18 | Hewlett-Packard Development Company, L.P. | System and method for resampling texture maps |
US7623730B2 (en) * | 2003-07-30 | 2009-11-24 | Hewlett-Packard Development Company, L.P. | System and method that compensate for rotations of textures defined by parametric texture maps |
US7006103B2 (en) * | 2003-07-30 | 2006-02-28 | Hewlett-Packard Development Company, L.P. | System and method for editing parametric texture maps |
US7002592B2 (en) * | 2003-07-30 | 2006-02-21 | Hewlett-Packard Development Company, L.P. | Graphical display system and method for applying parametric and non-parametric texture maps to graphical objects |
US7009620B2 (en) * | 2003-07-30 | 2006-03-07 | Hewlett-Packard Development Company, L.P. | System and method for combining parametric texture maps |
US7837740B2 (en) * | 2007-01-24 | 2010-11-23 | Musculoskeletal Transplant Foundation | Two piece cancellous construct for cartilage repair |
US7925391B2 (en) * | 2005-06-02 | 2011-04-12 | The Boeing Company | Systems and methods for remote display of an enhanced image |
US20080008371A1 (en) * | 2006-06-13 | 2008-01-10 | Kevin Woods | Considerations when colon segmentation differs between CAD processing and visualization |
US20080089602A1 (en) | 2006-10-17 | 2008-04-17 | Eastman Kodak Company | Advanced automatic digital radiographic hot light method and apparatus |
JP2011022726A (en) * | 2009-07-14 | 2011-02-03 | Sony Corp | Image processing apparatus and method |
US20110185138A2 (en) * | 2009-08-12 | 2011-07-28 | Research In Motion Limited | Method and apparatus for controlling access to a computing device |
KR20110059009A (en) * | 2009-11-27 | 2011-06-02 | 삼성전자주식회사 | Apparatus and method for user interface configuration in portable terminal |
US20110199286A1 (en) * | 2010-02-13 | 2011-08-18 | Robin Dziama | Spherical Electronic LCD Display |
US8910076B2 (en) * | 2010-12-17 | 2014-12-09 | Juan Fernandez | Social media platform |
US8810598B2 (en) | 2011-04-08 | 2014-08-19 | Nant Holdings Ip, Llc | Interference based augmented reality hosting platforms |
JP5896424B2 (en) * | 2011-04-25 | 2016-03-30 | 光雄 林 | Omnidirectional image editing program and omnidirectional image editing apparatus |
JP5790345B2 (en) | 2011-09-07 | 2015-10-07 | 株式会社リコー | Image processing apparatus, image processing method, program, and image processing system |
WO2014043814A1 (en) * | 2012-09-21 | 2014-03-27 | Tamaggo Inc. | Methods and apparatus for displaying and manipulating a panoramic image by tiles |
US9315192B1 (en) * | 2013-09-30 | 2016-04-19 | Google Inc. | Methods and systems for pedestrian avoidance using LIDAR |
US9582516B2 (en) | 2013-10-17 | 2017-02-28 | Nant Holdings Ip, Llc | Wide area augmented reality location-based services |
US9894350B2 (en) | 2015-02-24 | 2018-02-13 | Nextvr Inc. | Methods and apparatus related to capturing and/or rendering images |
US9865055B2 (en) | 2015-02-24 | 2018-01-09 | Nextvr Inc. | Calibration for immersive content systems |
US10486068B2 (en) | 2015-05-14 | 2019-11-26 | Activision Publishing, Inc. | System and method for providing dynamically variable maps in a video game |
US10709981B2 (en) | 2016-11-17 | 2020-07-14 | Activision Publishing, Inc. | Systems and methods for the real-time generation of in-game, locally accessible barrier-aware heatmaps |
US10463964B2 (en) | 2016-11-17 | 2019-11-05 | Activision Publishing, Inc. | Systems and methods for the real-time generation of in-game, locally accessible heatmaps |
EP3610647B1 (en) * | 2017-04-26 | 2021-12-08 | Huawei Technologies Co., Ltd. | Apparatuses and methods for encoding and decoding a panoramic video signal |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4736436A (en) * | 1984-04-13 | 1988-04-05 | Fujitsu Limited | Information extraction by mapping |
US4935879A (en) * | 1987-08-05 | 1990-06-19 | Daikin Industries, Ltd. | Texture mapping apparatus and method |
US4972319A (en) * | 1987-09-25 | 1990-11-20 | Delorme David M | Electronic global map generating system |
US5051734A (en) * | 1990-01-11 | 1991-09-24 | The Grass Valley Group, Inc. | Special effects using polar image coordinates |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4821212A (en) * | 1984-08-08 | 1989-04-11 | General Electric Company | Three dimensional texture generator for computed terrain images |
US4752836A (en) * | 1984-09-07 | 1988-06-21 | Ivex Corporation | Method and apparatus for reproducing video images to simulate movement within a multi-dimensional space |
US4841292A (en) * | 1986-08-11 | 1989-06-20 | Allied-Signal Inc. | Third dimension pop up generation from a two-dimensional transformed image display |
US4807158A (en) * | 1986-09-30 | 1989-02-21 | Daleco/Ivex Partners, Ltd. | Method and apparatus for sampling images to simulate movement within a multidimensional space |
US4899293A (en) * | 1988-10-24 | 1990-02-06 | Honeywell Inc. | Method of storage and retrieval of digital map data based upon a tessellated geoid system |
US5204944A (en) * | 1989-07-28 | 1993-04-20 | The Trustees Of Columbia University In The City Of New York | Separable image warping methods and systems using spatial lookup tables |
US5175808A (en) * | 1989-09-12 | 1992-12-29 | Pixar | Method and apparatus for non-affine image warping |
US5224208A (en) * | 1990-03-16 | 1993-06-29 | Hewlett-Packard Company | Gradient calculation for texture mapping |
US5179638A (en) * | 1990-04-26 | 1993-01-12 | Honeywell Inc. | Method and apparatus for generating a texture mapped perspective view |
US5161013A (en) * | 1991-04-08 | 1992-11-03 | Honeywell Inc. | Data projection system with compensation for nonplanar screen |
-
1993
- 1993-03-23 AU AU39307/93A patent/AU3930793A/en not_active Abandoned
- 1993-03-23 WO PCT/US1993/002678 patent/WO1993023835A1/en active Application Filing
- 1993-03-23 CA CA002135180A patent/CA2135180A1/en not_active Abandoned
-
1994
- 1994-02-28 US US08/205,137 patent/US5446833A/en not_active Expired - Lifetime
-
1995
- 1995-06-07 US US08/486,822 patent/US5561756A/en not_active Expired - Lifetime
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4736436A (en) * | 1984-04-13 | 1988-04-05 | Fujitsu Limited | Information extraction by mapping |
US4935879A (en) * | 1987-08-05 | 1990-06-19 | Daikin Industries, Ltd. | Texture mapping apparatus and method |
US4972319A (en) * | 1987-09-25 | 1990-11-20 | Delorme David M | Electronic global map generating system |
US5051734A (en) * | 1990-01-11 | 1991-09-24 | The Grass Valley Group, Inc. | Special effects using polar image coordinates |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0804022A1 (en) * | 1995-11-14 | 1997-10-29 | Sony Corporation | Device and method for processing image |
EP0804022A4 (en) * | 1995-11-14 | 1998-03-25 | Sony Corp | Device and method for processing image |
US6021229A (en) * | 1995-11-14 | 2000-02-01 | Sony Corporation | Imaging processing method for mapping video source information onto a displayed object |
EP1028389A2 (en) * | 1999-02-12 | 2000-08-16 | Advanet, Inc. | Arithmetic unit for image transformation |
EP1028389A3 (en) * | 1999-02-12 | 2003-07-02 | Advanet, Inc. | Arithmetic unit for image transformation |
WO2001063559A2 (en) * | 2000-02-23 | 2001-08-30 | Uts United 3 D Software Inc. | Method for automatically linking image areas of a 3-dimensional representation of an object with functions |
WO2001063559A3 (en) * | 2000-02-23 | 2002-03-14 | Dimension 3D Systems Gmbh | Method for automatically linking image areas of a 3-dimensional representation of an object with functions |
EP1453009A3 (en) * | 2003-03-01 | 2017-03-01 | The Boeing Company | Systems and methods for providing enhanced vision imaging |
Also Published As
Publication number | Publication date |
---|---|
CA2135180A1 (en) | 1993-11-25 |
AU3930793A (en) | 1993-12-13 |
US5561756A (en) | 1996-10-01 |
US5446833A (en) | 1995-08-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5446833A (en) | Textured sphere and spherical environment map rendering using texture map double indirection | |
US5396583A (en) | Cylindrical to planar image mapping using scanline coherence | |
Onoe et al. | Telepresence by real-time view-dependent image generation from omnidirectional video streams | |
US4734690A (en) | Method and apparatus for spherical panning | |
US6232977B1 (en) | Rendering perspective views of a scene using a scanline-coherent look-up table | |
US5936630A (en) | Method of and apparatus for performing perspective transformation of visible stimuli | |
US5561745A (en) | Computer graphics for animation by time-sequenced textures | |
US6031540A (en) | Method and apparatus for simulating movement in multidimensional space with polygonal projections from subhemispherical imagery | |
US6028584A (en) | Real-time player for panoramic imaged-based virtual worlds | |
US5742749A (en) | Method and apparatus for shadow generation through depth mapping | |
US7212207B2 (en) | Method and apparatus for real-time global illumination incorporating stream processor based hybrid ray tracing | |
US6243099B1 (en) | Method for interactive viewing full-surround image data and apparatus therefor | |
US7382374B2 (en) | Computerized method and computer system for positioning a pointer | |
US8077176B2 (en) | Method for interactively viewing full-surround image data and apparatus therefor | |
Tolba et al. | A projective drawing system | |
US9704282B1 (en) | Texture blending between view-dependent texture and base texture in a geographic information system | |
WO1996036011A1 (en) | Graphics system utilizing homogeneity values for depth for occlusion mapping and texture mapping | |
Litwinowicz et al. | Efficient techniques for interactive texture placement | |
Weiskopf | Visualization of four-dimensional spacetimes | |
Cunzi et al. | Dynamic canvas for immersive non-photorealistic walkthroughs | |
Fan et al. | Pixels and Panoramas: An Enhanced Cubic Mapping Scheme for Video\/Image-Based Virtual-Reality Scenes | |
US20070040832A1 (en) | Trapezoidal shadow maps | |
Wan et al. | Virtual flythrough over a voxel-based terrain | |
US6710775B1 (en) | Animation technique | |
JP2973413B2 (en) | Illuminance calculation method and display device for computer graphics |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AT AU BB BG BR CA CH CZ DE DK ES FI GB HU JP KP KR KZ LK LU MG MN MW NL NO NZ PL PT RO RU SD SE SK UA VN |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2135180 Country of ref document: CA |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
122 | Ep: pct application non-entry in european phase |