WO1995021395A1 - Personal visual display system - Google Patents

Abstract

A visual display device is provided for delivering a generated image, preferably combinable with environment light, to the eye of a user. The device is lightweight and compact but yields a high quality image. In one embodiment, a color shutter (88) provides a high-density color image. In one embodiment, a shroud (112) protects from stray light and holds optical elements in desired alignment. In one embodiment an image generator (72) is masked by at least two masks (222 and 224) to provide for a high quality image without waste. In one embodiment, a removably mounted shield (302) or activatable device converts the apparatus from a see-through device to an immersion device and back again. In one embodiment, the device can be comfortably mounted to the user's head while still allowing for use of conventional eyeglasses. In one embodiment various controls, such as a mute button (42), volume control and the like can be provided, such as by mounting on the head-mounted display device.

Description

PERSONAL VISUAL DISPLAY SYSTEM This invention relates to visual displays which preferably can combine generated images with a view of the environment surrounding a user and transmit such combined visual information to the eye position of the user.

BACKGROUND OF THE INVENTION

It is often desirable to provide visual information to a living being. Frequently, one wishes to superimpose such visual information upon the being's view of the real world. In other applications, it is desired to shield the user from a view of the environment, providing an exclusive view of the visual information.

Such displays include a number of components including, in a form known as a folded catadioptric display, an image generator, a beam splitter which receives the image light from the image generator, often via a series of lenses and other optic elements and sends a fraction, designated the reflected fraction, of such image light to a reflective combiner that is either non-transmissive or both allows light from the real world to pass through such combiner and reflects the image light such that both the real-world light and the image light are transmitted to the eye of the user through the beam splitter, often via another series of lenses or other optical elements. The beam splitter will transmit a fraction, designated the transmitted fraction, of the image light reflected from the collimator-combiner. In embodiments in which the combiner is at least partially transmissive, a fraction of the real-world light is also transmitted by the beam splitter.

Previous devices included a number of additional components. Some devices have included corrective optical elements. Other devices have included a depixelator, e.g., as described in PCT/US94/01390 filed February 7, 1994 for "Depixelated Visual Display" (incorporated herein by reference) . Still other devices have included apparatus for intensifying the visual display such as those described in PCT/US94/01391, filed February 7, 1994 for "Intensified Visual Display" (incorporated herein by reference) . In designing a system for providing a generated image to the eye or eyes of a user, various factors are often in opposition. Although it is desirable to provide an image which has high quality so as to not only provide a pleasing and attractive display for the user but also to reduce eyestrain, very often the techniques used to produce such a pleasing image have been contrary to goals of an apparatus which is lightweight, low-cost, and relatively easy to design, fabricate and/or repair. Many previous devices have required expensive and heavy series of optical elements such as lenses to achieve a desired picture quality. Other devices have simply accepted a lower-quality image in order to achieve goals of low-cost or light weight. For example, some previous devices have failed to provide a flat focal field to the user. Others have resulted in a poor image contrast, particularly at high viewing angles of the image. Many devices have deprived the user of the full image in order to mask-off unwanted light near the edge of an image generator.

Accordingly, it would be useful to provide a personal, visual display apparatus which provides a high quality of image, which is low cost, lightweight, comfortable and has increased ease of design, fabrication, repair and the like.

SUMMARY OF THE INVENTION One embodiment of the invention is a head-mounted display (HMD) that can project an image from an image generator such as a cathode ray tube (CRT) or a liquid crystal display (LCD) to one or each of the eyes of the observer or both transmit such an image and combine it with a direct view of the surrounding environment. The combiner images a CRT or LCD display surface mounted above the eye with a simple metallic, dielectric or holographic fold mirror reflecting the image towards the combiner. According to one aspect of the present invention, the device simplifies the imaging optics by reducing the total number of elements. One embodiment of the invention consists of an image generator such as a CRT or LCD, a combiner such as a spherical metallic, dielectric or holographic combiner or collimator-combiner and a fold mirror such as a metallic, dielectric or holographic fold mirror.

In one embodiment, few optical elements are needed to achieve the desired high quality image. Preferably, the visual display is simplified and made lightweight and less expensive by eliminating the need for certain optic elements such as relay lenses or additional corrective refractive optics. In one embodiment, a visual display provides for monochromatic and/or three-color display without refractive optics, such as by using reflective imaging optics only.

In one embodiment of the invention, the apparatus provides a high-quality image while using a lightweight and visually attractive configuration. In one embodiment, the apparatus is a glasses-like structure with optics configured to deliver an image to the user's eye position, preferably to deliver generated images to the left and right eyes of a user, and with temple pieces projecting backward on each side of the user's head in the fashion of eyeglasses. A strap may be used to assist in holding the device in a desired location. Headphone-like loud speakers are positionable near the user's ears to provide simultaneous video and audio to the user. In one embodiment, a brace is used to contact the user's forehead to further assist in proper positioning and weight-bearing. This configuration is particularly useful when it is desired to leave enough space between the apparatus and the user's eyes to accommodate ordinary eyeglasses. Preferably, various controls are available such as being mounted on the head- mountable apparatus. These can include, for example, a mute button such as an audio and video mute, volume control, image selector and the like. Preferably, the temple pieces can be folded, similarly to folding of typical eyeglasses to achieve a compact storage or carrying configuration. In one embodiment, the display device is modifiable by addition, preferably snap-on addition, of further components. For example, a light shield may be snapped on to convert a see-through display into an immersion display. Head position tracker components can be snapped on to provide an indication, e.g., to a computer and/or video game device, of the orientation, movement, and/or location of the user's head.

In one embodiment, an optical element is configured to reduce or eliminate loss of image contrast such as that which may occur from an image generated by a backlit LCD display, particularly near the edges of the image. In one embodiment, a color display with high density is provided by the combination of a white or monochrome display coupled with a color shutter. In one embodiment, the shutter is located spaced from the screen or output plane of the image generator, and may be positioned substantially immediately in front of the eyes of the user. In another embodiment the shutter is located adjacent to the image generator output plane or to an optical element, such as a field curvature correction lens, which is adjacent to the image generator output plane.

According to one embodiment, shrouds provide proper shielding, holding and alignment of various components of the device. A shroud can be configured to not only block stray light but also to hold, for example, a fold mirror and/or combiner. In one embodiment, two or more masks are provided for the image generator to achieve elimination of unwanted light source angles without masking desired portions of the image. Preferably, such masks are provided as a unitary piece which can also function to hold other elements such as the LCD or other image generator, a light source, a lens, etc. By providing for an adjustment in the position of such a holder, it is possible to correct positional disparity, particularly vertical positional disparity between the left and right image generators when the apparatus is used in a binocular fashion.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a perspective view of a head-mounted display according to one embodiment of the present invention; Fig. 2 is a front view of the apparatus of Fig. 1;

Fig. 3 is a rear view of the apparatus of Fig. 1;

Fig. 4 is a right side elevational view of the apparatus of Fig. 1; Fig. 5 is a left side elevational view of the apparatus of Fig. 1;

Fig. 6 is a top plan view of the apparatus of Fig. 1;

Fig. 7 is a top view generally corresponding to that of Fig. 6 but showing the temple pieces in a folded configuration;

Fig. 8 is a plan view similar to that of Fig. 4 but having portions cut away to show interior components thereof;

Fig. 9 is a schematic side view showing optical components according to one embodiment of the present invention;

Fig. 10 is a perspective view of an optical shroud according to one embodiment of the present invention;

Fig. 11 is a front view of an the optical shroud of Fig. 10;

Fig. 12 is a side view of the optical shroud of Fig. 10;

Fig. 13A is a bottom plan view of the optical shroud of Fig. 10; Fig 13B is a partially exploded perspective view of the optical shroud of Fig. 10, fold mirror, combiner and field curvature correction lens;

Fig. 14A is a schematic, cross-sectional view of a mask and holder apparatus according to one embodiment of the present invention;

Fig. 14B is an exploded perspective view of a mask and holder apparatus according to one embodiment of the present invention; and

Fig. 15 is a perspective view of the apparatus of Fig. 1 showing attachment of additional components.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS As depicted in Fig. 1, one embodiment of the present invention provides a main component 12, preferably containing some or all of the electronics or optics used for the visual display and left and right temple pieces 14a, 14b. The temple pieces may be used for assisting and holding the main portion 12 in the desired position to deliver video output to the user's eyes. A strap 16 can be provided to further assist in holding the apparatus in the desired position with respect to the head 18 of the user. A forehead brace 22 can be provided to further assist in proper positioning of the main portion 12. The forehead brace 22 is useful to transfer some of the weight of the apparatus to the user's forehead. This may provide, a more comfortable configuration than having substantially all of the weight transferred via other components such as the temples 14a, 14b, headstrap 16 and/or a nose bridge piece such as may be used in some devices. As can be seen in Figs. 4 and 5, the forehead brace 22 extends back a distance 24 from the main portion 12 of the apparatus. As a result, there is an amount of space 26 between the eye position of the user 28 and the portion of the apparatus 32 which resides in front of the user's eyes sufficient to accommodate the user's eyeglasses, e.g., about one inch or more (in one embodiment, about 28 mm) . A connection is provided for establishing communication or data transfer to the display apparatus which, in the depicted embodiment, involves a cable 34 mounted along the underside of the left temple piece 14b and terminating in a connector 36. Typically, the connector 36 will be connected to a cable which provides for data transfer or other communication with a video/audio source 38 (Fig. 17) such as a computer, a video cassette recorder (VCR) , video disk player, broadcast television receiver, television cable or optical fiber source, gaming device, or video telephone service. Preferably, the cable 34 is also used to deliver power to the apparatus. In other embodiments, data communication can be made without using a wire cable, such as by using a fiber optic cable, or by using wireless communication such as infrared, or radio communication. In some embodiments, it is useful to provide the user with controls. Although it is possible to provide controls which are not mounted on the head-mounted unit (such as a remote control unit or a console) in the depicted embodiment, at least some controls are on the head-mounted unit. In the depicted embodiment, a first button 42 can be used to provide, for example, a mute function. Preferably, activation of this button provides for both discontinuing the video image which is currently being output and discontinuing the audio to provide both a video mute and an audio mute.

However, it is also possible to provide for controls that mute video only or that mute audio only. Preferably, the mute control is configured so that the user can easily turn off at least the image, without requiring turning off of power to the HMD or interrupting the stack of data (although, in one embodiment, the mute button can be configured to simultaneously pause the data stream) . In one embodiment, the mute control turns off power for the LCD backlight, LCD and/or audio functions. Preferably, the current control setting, e.g., monoscopic/3-D, volume, contrast) are still maintained, allowing the user to quickly return to viewing e.g., without having to reset the controls.

In the depicted embodiment, a rocker switch 44 can be used to provide control of a parameter which varies through a range, such as volume of the audio. Other items that could be controlled in the fashion include tint, hue or contrast of the video image, selection of a video and/or audio source such as channel selection, image brightness, audio tone (i.e., treble/bass control) and the like. A slider switch 46 can be used, e.g., to select among discrete choices to select left, right or no relative frame phasing, to select between stereo and non-stereoscopic views, and the like. One or more visible displays can be provided. In the depicted embodiment, an LED "power on" indicator is provided. Other controls and/or indicators can also be used and can be mounted on various surfaces of the head-mounted apparatus of Fig. 1.

Left and right loudspeakers 52a, 52b are preferably movably attached to the ends of the temple pieces 14a, 14b, e.g., by pivotable arms 54a, 54b which can be laterally adjusted in a mounting slot 56a, 56b in each temple 14a, 14b. The speakers 52a, 52b can be held in position by friction or detent tightners 58a, 58b can be used to secure the speakers 52a, 52b in the desired position. Cables 62a, 62b are used to provide the desired signal to the loud speaker 52a, 52b. The head strap 16 is preferably coupled to the temples 14a, 14b via left and right strap pivots, loops or D-rings 17a, 17b. A length and/or tightness adjustment mechanism such as a buckle, can be provided on the strap 16.

Preferably, the temples 14a, 14b are connected to the main portion 12 using left and right hinges 64a, 64b. The hinges 64a, 64b permit the temple pieces 14a, 14b to be folded in directions inwardly 66a, 66b to provide the compact configuration depicted in Fig. 7. The compact configuration is achieved partially by locating much or all of the electronics associated with the production of the video device in the main portion 12 (as described more fully below) . In one configuration, there are little or no optical or video elements or electronics in the temple pieces 14a, 14b

(although in some embodiments these may contain, for example, cables and connectors) . As a result, the temples 14a, 14b can be folded nearly flat against the main portion 12, as depicted in Fig. 7, residing underneath the forehead brace 22. Such compact configuration provides for ease of shipment, storage, transport and the like. In one embodiment, the electronics used in generating the image 72 are substantially all contained in the upper portion of the main section 12 of the apparatus as depicted in Fig. 8. The electronics used for this purpose can be those generally well-known in the art for producing video images, such as the electronics used in producing video images in the eyepiece of a video recorder and can include, for example, power supply, timing circuitry (e.g. to assure that the data which arrives is routed to the proper position of the image generators) , buffer memory or other memory devices, and/or image processor cirucitry. The electronic signals constituting the video signal are converted into an image, or a series of images, e.g., simulating motion, by an image generator 74. The image generator 2 can be any of a plurality of color or monochrome imaging devices including a cathode-ray tube (CRT) , light emitting diode (LED) array, liquid crystal display (LCD) , field emissive device (FED) , as well as laser devices such as laser diode arrays.

One example of an LCD that can be used for this purpose is a 0.7" diagonal LCD of the type commonly used for the view finder of a camcorder, for example, Model FO7KM200 available from Seiko Epson Corporation. Other sizes and types of LCDs can also be used such as a 1 inch diagonal LCD available from Hitachi, Inc. Preferably, an LCD device includes the capability for being backlit using any of a number of backlighting devices such as incandescent lighting, fluorescent lighting, electro-luminescent and ambient lighting.

Once the image generator 74 generates the optical image, the light from the image generator is configured by various optical elements to deliver the desired image to the eye position 28 of the user. A number of different optical configurations can be used for this purpose including those described in USSN 08/150,996 filed November 12, 1993 for "Optically Corrected Helmet Mounted Display," a divisional of U.S. Patent No. 5,303,085, filed February 7, 1992, both of which are incorporated herein by reference or PCT application No. PCT/US94/ (attorney docket 16486-5PC) for

"Personal Visual Display" filed on an even date herewith and incorporated herein by reference. In the embodiment depicted in Fig. 8, the optical devices include the image generator 74, a field correction device such as a plano-convex or meniscus lens 76 for providing a substantially flat field of focus to the user, a fold mirror 78 for reflecting at least a part of the image from the image generator towards a combiner 82 which reflects at least a portion of the image received from the fold mirror 78 through the fold mirror 78 and towards the eye position of the user 28, preferably magnifying the image (e.g., by virtue of a reflection from its substantially spherical surface) and, in embodiments where the combiner is at least partially transparent, combines the image light with light from the environment to provide the user with a simultaneous view of the environment and of the generated image. Preferably, the combiner serves as the primary magnification element for the image light. An optical element is referred to as being a "powered" element if it provides image magnification. Although, for convenience, this item is referred to as a "combiner", in some embodiments the combiner may be used without providing for a combination of image light with environmental light, as described more fully below. In the depicted embodiment, the image generator 2 is mounted substantially above the fold mirror 1 (meaning vertically above, when the device is oriented so that the axis between the eye position 5 and combiner 4 is substantially horizontal) . With reference to this configuration, the image light travels downward from the image generator 2 towards the fold mirror 1. The image light is at least partially reflected by the fold mirror 1 in a substantially horizontal direction away from the eye of the user 5 and towards the combiner 4. At the combiner 4, the image light is at least partially reflected back towards the fold mirror 1. In an embodiment in which the user will simultaneously view the image or the environmental light, light from the environment passes through the substantially transparent combiner 4 and travels along with the image light reflected from the combiner 4 to produce combined light. In an embodiment in which the user will view only the generated image, without being able to view the environment (referred to as an "immersive" device) , the combiner can be substantially fully reflective and substantially non-transmissive. The image light and/or the combined light is at least partially transmitted through the fold mirror 1 towards the eye of the user 5. The amount of light, if any, which passes from the surrounding environment to the eyes of the observer can be at least partially controlled by the coatings placed on the surfaces of the combiner, and the fold mirror.

In many applications, it is desired to provide the user with the impression of a color image. Full color images can be acheived by displaying discrete color components, such as red, green and blue components. Most current technologies for providing a color video image are arranged so that the various component colors are displaced from one another either in space or in time. For example, in a typical television screen, the red, green and blue positions for a given image pixel form a pixel triad displaced in space, i.e., which lie adjacent one another rather than at the same location. This necessarily increases the average size of the pixel triad with the result that pixel density is less intense than it would otherwise be.

Another approach is the approach of displacing the component colors in time such that the red, green and blue colors for a given pixel all are provided in the same location but at different times. Thus, in a configuration in which it is desired to provide the colored image at a rate of 60 frames per second, each frame would be divided into three subframes, one for each color so that subframes would be presented at a rate of about 180 times per second in a repeating pattern of e.g., a red frame, a green frame, a blue frame, a red frame, etc.

One method of achieving the displaced-in-time color image is by using a color shutter. A color shutter is an electronically-driven device which provides a color filter over the entire image area and which can be switched rapidly, e.g., 180 times per second among the three image colors (red, blue, green) . One type of color shutter is that provided in Tektronix EX100HD 1 inch Color Display System. Such a color shutter can be mounted directly on the surface of the screen of a monochrome (or black and white) video image generator. The monochrome image generator is then configured to produce a black and white image of the respective color components of the desired final image at, e.g., 180 frames per second. In this way, to produce the first (red) subframe, the black and white image generator will produce a black and white image of the red component of the first frame of the image and the color shutter will be configured to transmit only red light. During the next subframe, 1/180 of a second later, the monochrome generator will generate a black-and-white image of the blue component of the image and the color shutter will be configured to transmit only blue light. During the third subframe, the monochrome image generator will output a black- and white image of the green component of the frame and the color shutter will be configured to transmit only green light. The resulting image will appear to be fully colored to the user but the three colors for a given pixel will be in exactly the same location, i.e., there will be no physical separation of the location of the color components of the pixel. Although a color shutter approach is useful to provide a high-intensity color image, it has not been previously provided in the context of a light-weight, high- quality, head-mounted display. Typically, optical configurations in the past have used, e.g., a monochrome CRT in conjunction with relay lens systems to transfer the image from a remotely-mounted CRT to the user's eye. This typically resulted in heavy systems, often of a type that were helmet- mounted and suitable cheifly for military use.

It has been found that it is difficult to satisfactorily position and align a color shutter over a substantially curved surface such as that of lens 86. In most cases it has been found that such positioning creates a very small viewing aperture, making the use of the device difficult and uncomfortable. Accordingly, one embodiment of the present invention departs from the approach of positioning a color shutter directly on an output screen and, instead, positions a color shutter 88 at a position which is farther along on the optical path, such as the position depicted in Fig. 9. As depicted in Fig. 9, the color shutter 88 can be placed between the fold mirror 78 and the eye position 28 of the user. This avoids the difficulty of locating the shutter over a curved surface 86 and avoids placing the color shutter in a region, such as the region between the fold mirror 78 and the combiner 82, which has optical paths going in more than one direction (so that the filter would conceivably filter the light twice) . As depicted in Fig. 9, if the color shutter 88 is positioned below the lens 86, it would be necessary to increase the height 92 of the device in order to avoid interfering with the double-filtering the light between the fold mirror 78 and the combiner 82. Increasing the height of the device will result in a reduction of magnification or reduction of the viewing aperture. It has been found that a number of items can detract from the delivery of a high-quality image to the user. The image can deteriorate because the image generator or various optical elements are not located in the correct position with respect to one another and/or with respect to the user's eye position. The image can deteriorate because stray light, i.e., light other than that desired to be delivered to the user may be combined with the image and/or desired environmental light. In order to achieve the goals of low cost and low weight while maintaining high quality, an embodiment of the invention provides for an optical shroud which can be used for the dual functions of shielding from stray light and providing for correct positioning of optical elements. In the embodiment depicted in Fig. 10, the shroud 112 has a top surface 114 having an opening 116 for entry of the image light. Beneath the top portion 114 is a chamber 118 defined by left and right sidewalls 122a, 122b and floor member 124. As seen in Figs. 11 and 13, the side members 122a, 122b preferably flare outward (i.e., in a direction away from the eye position, e.g., at an angle 124 (with respect to the straight-ahead axis of view of the user 128) of between about 10° and about 30°, preferably between about 10° and about 25° and more preferably being about 15°. The top of the shroud 114 in the depicted embodiment, defines a plane 131 which is substantially parallel to the plane of the image generator output. In the depicted embodiment, the floor 124 is flared downward at an angle 132 , with respect to the top plane 131, of between about 10° and about 25°, preferably between about 10° and about 20° and more preferably at about 12°. A groove near the front edge of the floor 134c is curved with a curvature corresponding to that of the combiner. This groove is used , in conjunction with recesses 134a and 134 b, for mounting the combiner so as to assure that the combiner 82 is located in the correct position, as depicted in Fig 13B. After positioning, the combiner can be held in place ^by e.g. adhesives, ultrsonic welding, interlocking tabs and slots, latches, gaskets and the like. Ledges 136, 137, 137, defining an imaginary plane which intersects the sidewalls 122a, 122b along lines running diagonally inside of the sidewalls, are used for mounting the fold mirror 78 in the correct position with respect to the other optical components, as depicted in Fig 13B. After positioning, the fold mirror can be held in place by, e.g. adhesives, ultrsonic welding, interlocking tabs and slots, heat staking, latches, gaskets and the like. The top 114, floor 124 and sidewalls 122a, 122b, and particularly, the floor 124 and outside sidewall are particularly useful in shielding the optics from stray light of types that commonly produce image degradation. An example of such stray light would be light that may bounce upward off a light-colored shirt of a user. The shroud also protects the optical components from dust, abrasion, scratches and the like, at least on the surfaces of the optics enclosed within the chamber 118. To assist in protecting the optics, a transparent dust cover 141 can be positioned e.g. between the fold mirror 78 and the eye of the user.

In the depicted embodiment, pins 152 a, 152b, 152c projecting from the upper surface 114 assist in proper alignment of the field curvature correction device such as plano-convex lens 76, e.g. by mating with corresponding holes 154a, 154b, 154c in the lens 76. The lens 76 can be attached to the shroud 12 by heat staking or heat-doming the ends of the pins 152a, 152b,152c or by other means such as adhesives, ultrasonic welding, clamps, latches and the like. Tabs 156a, 156b, 156c are provided for aligning and/or attaching the shroud 112 to the main portion 12 of the head-mounted display device.

In one embodiment, separate shrouds 112 are provided for the left and right optics, as depicted, e.g., in Fig. 1, although a unified shroud can also be used. Although the depicted embodiment shows recesses 134a, 134b, groove 134c, ledges 136, 137, 139 and pins 152a, 152b, 152c for aligning and/or holding various optical components, other devices for holding can be used such as tabs, ridges, tracks, rails, spring-mounts, gaskets, latches and the like. The shroud 112 can be made from a number of components, including plastic, metal, ceramic, fiber-reinforced resins, and the like. The shroud 112 may contains holes, slots or other shapes to facilitate connecting the shroud to other optics (such as contrast-enhancement optics) in the correct position with respect to other items in the device.

Another alignment issue is presented by the image generator. The image generator, must, of course, be correctly positioned with respect to the other elements such as a field correction lens 86, fold mirror 78, etc. Certain image generating devices, notably an LCD array, suffer from image degradation as a result of transmission of light peripheral to the image area of the LCD. Typically, an LCD is backlit and many LCDs have used a rectangularly-shaped mask around the edge of the LCD to prevent the viewer from seeing a bright outline surrounding the active area of the LED. Because of the fact that an LCD has a thickness (typically about 2.5 mm) undesired light, e.g., from the backlight, which is typically not collimated, can travel through the LCD at an angle other than normal to the output plane to the LCD and thus a mask on the output plane which went only up to the active area of the LCD would not fully mask the undesired light. Fig. 14A depicts a cross-section through a backlight 202, active LCD area 204, peripiheral LCD circuitry 206, and mask 208. As seen in this configuration, if the only light travelling through the LCD 204 were travelling in a normal direction, such as that shown by arrow 210, the mask 208 would be fully effective. However, because light travels from the backlight 202 in directions other than normal to the plane of the LCD 204, some light 212 will travel obliquely through the LCD 204, missing the mask 208. For this reason, in previous devices, in order to avoid the undesired oblique light around the edges of the LCD, the mask 208 would typically be provided with an opening 214 which was smaller than a full active area of the LCD. This represented a certain amount of waste of the image generated by the LCDs since the edge of the LCD image would be masked.

Accordingly, one embodiment of the invention involves providing at least two masks, one mask 222 (Fig. 14B) adjacent the output surface of the LED 72 and another mask 224 between the LCD location 226 and the location of the backlight 228. Preferably, both the first mask 222 and the second mask 224 have opening or windows 232, 234, respectively, which are substantially equal and congruent to the active area of the LCD.

Preferably, the first mask 222 is formed integrally with a holder 236 which includes sidewalls 237a, 237b, 237c for properly aligning the second masks 222, 224 and/or the LCD device 72 to provide an accurate and inexpensive way to perform both masking and proper positioning and alignment of the masks with respect to the LCD array. Alternatively it is possible to provide both the masks 222,224 as part of a unitary mask/LCD-holder. In one embodiment, the mask/holder also contains holes 238a, 238b 238c for mounting the holder to the main portion 12 of the head mounted display device. It is also possible for the holder 236 to include devices (such as screw holes, bosses, grooves, rails and the like, not shown) for mounting items such as the image source, backlight, lenses, etc. In one embodiment, the mask/holder 236 is provided with a means for adjustably mounting the mask/holder within the main portion 12 of the apparatus. Adjustability is useful in order to avoid image disparity between the two eye positions. Part of the image disparity results from the fact that the active area of an LCD due to manufacturing tolerances, may not be precisely located in the same position, with respect to the device edges, on every LCD device. The variability is typically within about ± 0.25 mm in both horizontal and vertical directions. Although it is possible to provide for adjustment of both horizontal and vertical disparity, it has been shown that human vision is not as sensitive to horizontal disparity (i.e. disparity wherein corresponding portions of the left and right images appear to the viewer to be displaced from one another along a left-right axis) as it is to vertical disparity (i.e. disparity wherein corresponding portions of left and right images appear to the viewer to be displaced from one another along an up-down axis) . Accordingly, in the depicted embodiment, in order to e.g., eliminate eyestrain which can result from vertical disparity of the left and right images, an optional adjustment mechanism such a travelling screw arrangement 244a can be provided for vertical alignment of the two images. By rotating the screw 224a, the traveller 246a, attached to the holder 236 will move vertically up and down (i.e. along axis 247) and the desired vertical adjustment can be achieved in this fashion. Other ways of achieving vertical disparity adjustment include use of rack and pinion adjustment, shims, and tilting the combiner (at the cost of introducing other distortions) . A similar adjustment mechanism 244b, 246b can be provided for adjusting the focus of the image for one eye with respect to the other.

Some uses for a head mounted display make it advisable to provide the user with a simultaneous view of the environment and a generated image. Other uses make it preferable to provide a view of the image alone, exclusive of the environment. As noted above, in one embodiment the environmental view can be provided by using the combiner to combine image light with light from the environment. It is possible to provide a fully reflective, substantially spherical mirror so as to provide an image-only or "immersive" device. Preferably, however, the apparatus can be used to provide either type of image as desired by the user. It is believed to be particularly useful to leave the user with the option of achieving a view of the environment since users may need such a view in order to properly and safely move while wearing the apparatus. In the embodiment depicted in Fig. 15, a shield 302 is configured so that it can snap over the external area of the combiner 82, thus converting an environmental-view device (also called "see-through", "transmissive" or "heads-up") into an immersive view device. The shield can be held in place by a number of mechanisms such as snaps 304, or by tab and slot devices, hook and loop devices such as that sold under the tradename VELCRO^®, or various latches or pivots (such as a flip-up shield) . The shield 302 can be made from a number of materials including plastics, metals and the like.

In addition to providing for a shield which can be added or removed mechanically, the transmissivity of light through the combiner 82 can also be controlled by other devices such as an electro-mechanically controlled iris, a photochromically activated coating or an electrically activated coating.

In many uses of a head mounted display, it is desired to collect information regarding the position, posture, location and/or movement of the user's head. This information can be used to control the image generated to the eyes of the user for a number of purposes, such as to provide a "virtual reality" or simulated environment to the user, to allow the user to navigate through various displayed images to observe a simulated object from various angles and the like. A number of tracking devices can be used for this purpose such as inertial tracking, electromagnetic tracking, Hall effect tracking, magneto resistance tracking, electrolytic tilt sensing and flux gate tracking. According to one embodiment of the invention, tracking devices are configured so as to permit the user to attach and detach the tracking devices as desired. In the embodiment depicted in Fig. 15, a tracking devices 312, can be attached to either of the temples 14a, 14b of the apparatus, e.g., using flexible hook attachments 314, configured to engage the edges of the temples 14a, 14b. Other attachment devices that can be used include latches, clamps, and/or hook and loop material (such as that sold under the tradename VELCRO*. One tracking device which can be used for this purpose is a product sold under the trade name The Bird™, by Ascension Technology Corp. In the depicted embodiment, the tracker 312 has its own cable for transmitting information, e.g., to a computer. It is also possible to provide for couplers and wiring to route the tracking information over the HMD cable, to reduce the number of separate cables involved. Although a snap-on or otherwise removably mountable tracker leaves the user with the option of doing without the bulk and weight of trackers when trackers are not desired, in another embodiment, one or more trackers can be integrally built into the head-mounted display device. In view of the above description, a number of advantages of the present invention can be seen. The present invention provides for a high quality image in a head-mounted display at low cost and low weight. The device can be easily stored and transported, provides for comfort for the user, because of its low weight and mounting facility, can provide controls for video and audio is easily adjustable to accommodate the user's head size and ear and eye location, provides a high intensity, preferably color image, provides for ease of alignment, manufacture, design and repair, provides for ease of control by the user such as controlling video, audio or immersive characteristics and permits the user to select whether tracking is attached.

A number of variations and modifications of the invention can also be used. Although the device depicted is binocular, a monocular device can also be used. More or fewer controls than those depicted can be used. A number of aspects of the invention can be used without providing other aspects, for example, it is possible to provide for the eyeglass-like fold-up style without providing for a color shutter.

Although the invention has been described by way of a preferred embodiment and certain variations and modification, other variations and modifications can also be used, the invention being defined by the following claims.

Claims

WHAT IS CLAIMED IS;

1. Visual display apparatus for a user, comprising: a monochrome image generator having a first output surface, which outputs image light; a color shutter, spaced from said output surface for controlling the color of light transmitted through said color shutter; a fold mirror positioned to receive the image light from the image generator and to reflect at least a first portion of said image light; a reflective combiner situated to receive said first portion of said image light from said fold mirror, reflect at least a second portion of said image light, wherein at least some of said image light is transmitted through said fold mirror to the eye position of the user, providing an optical path from said image generator to said fold mirror, to said combiner, back through said fold mirror, to said eye position of the user.

2. Visual display apparatus, as claimed in claim 1, further comprising means for providing said image light to said user with a substantially flat focal field.

3. Visual display apparatus, as claimed in claim 1, further comprising: means for maintaining high contrast across the extent of said image light.

4. Visual display apparatus, as claimed in claim 1, wherein said color shutter is positioned between said fold mirror and said eye position of the user.

5. Visual display apparatus for a user comprising: an image generator having a first output surface which outputs image light; color shutter means spaced from said output surface for providing color in the light transmitted through said color shutter means; a fold mirror positioned to receive the image light from the image generator and to reflect at least a first portion of said image light in a third direction; a reflective combiner situated to receive said first portion of said image light from said fold mirror, reflect at least a second portion of said image light wherein some of said image light is transmitted back through said fold mirror to the eye position of the user.

6. Visual display apparatus for a user, comprising: an image generator, which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a shroud having at least a lower surface and a side surface, said shroud having integrated optics holders for holding at least some of said optics elements in a predetermined spatial relationship, substantially sealed from the environment; and a holder configured to mount the image generator, optical elements and shroud to the user's head.

7. Apparatus, as claimed in claim 6, further comprising means for aligning said image generator with said optical elements.

8. Apparatus, as claimed in claim 7, further comprising means for aligning said image generator with said holder and means for aligning said shroud with said holder.

9. Visual display apparatus for a user, comprising: image generation means for outputing image light in response to image information from an image source; optical means for receiving said image light from said image generator and providing said image to the eye position of the user; means for holding said image generator and for holding at least some of said optics elements in a predetermined spatial relationship to said image generator, while blocking transmission of stray light to the eye position of the user; and means for mounting the image generation means, and said optical means to said means for holding.

10. A head-mounted visual display apparatus for a user, comprising: an image generator, which outputs image light; a backlight for said image generator; a first mask between said backlight and said image generator; a second mask between said image generator and said optics; and optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user.

11. Apparatus, as claimed in claim 10, wherein said image generator outputs an image having an image height and an image width and wherein said second mask defines an aperture having a height which is about equal to or greater than said image height and a width which is about equal to or greater than said image width.

12. Apparatus, as claimed in claim 10, wherein said first and second masks are separately formed.

13. Apparatus, as claimed in claim 10, wherein at least one of said first and second masks is coupled to a means for aligining said first and second masks.

14. Apparatus, as claimed in claim 10 wherein as least one of said first and second masks is coupled to means for aligning with said image generator.

15. Apparatus, as claimed in claim 10, wherein at least one of said first and second masks includes means for aligning at least one of said optical elements.

16. Apparatus, as claimed in claim 10, wherein said first and second masks are formed in a single unitary piece.

17. A head-mounted visual display apparatus for a user, comprising: left and right image generators, which output first and second image light; optical elements configured to receive said first and second image light from said left and right image generators and provide at least portions of said first and second image light to the left and right eye positions of the user, defining left and right optical paths; means for adjusting the effective position of at least one of the left and right image generators in order to correct image disparity or focus; and a holder configured to mount the image generator, optical elements and shroud to the user's head.

18. A head-mounted visual display apparatus for a user, comprising: an image generator, which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a removably mounted shield wherein said shield, when mounted, substantially prevents mixing of environmental light with said image light and, when removed, allows combination of said image light with environmental light to provide the user with at least a partial view of the environment; and a holder configured to mount the image generator, optical elements and shroud to the user's head.

19. A head-mounted visual display apparatus for a user, comprising: image generator means for outputing image light; optical means for receiving said image light from said image generator and providing said image to the eye position of the user; shield means selectable between a first configuration wherein said shield substantially prevents mixing of environmental light with said image light and a second configuration which allows combination of said image light with environmental light to provide the user with at least a partial view of the environment; and a holder configured to mount the image generator, optical elements and shroud to the user's head.

20. Apparatus as claimed in claim 19, wherein said shield means comprises one of a detachable opaque shield, an acutatable iris, an electro-optically activated coating and a photochromically activated coating.

21. A head-mounted visual display apparatus for a user, comprising: an image generator, which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator, optical elements and shroud to the user's head including a brace configured to contact the user's forehead, wherein said optical elements are spaced at least about one inch from the user's eye position.

22. Apparatus as claimed in claim 21, further comprising a strap for holding said brace against the user's forehead.

23. Apparatus, as claimed in claim 21, wherein said brace includes at least a portion being pivotable with respect to said holder.

24. Apparatus, as claimed in claim 22, further comprising means for adjusting the effective length of said strap.

25. Apparatus, as claimed in claim 22, wherein said strap is coupled to said holder using a loop.

26. A head-mounted visual display apparatus for a user, comprising: an image generator which outputs image light; optical elements configured to receive image light from said image generator and provide such image to the eye position of the user; a holder configured to mount the image generator, optical elements and shroud to the user's head; and brace means configured to contact the user's forehead wherein said optical elements are spaced at least about one inch from the user's eye position.

27. A head-mounted visual display apparatus for a user, comprising: an image generator, which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator, and optical elements to the user's head; at least one speaker for providing sound; and a button, functionally coupled to said speaker, for muting said sound.

28. A head-mounted visual display apparatus for a user comprising: an image generator which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator and optical elements to the user's head; and a button, functionally coupled to said image generator for interrupting generation of said image light.

29. A head-mounted visual display apparatus for a user comprising: an image generator which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator and optical elements to the user's head; and user-activatable means for interrupting said output of said image light.

30. Apparatus, as claimed in claim 29, wherein said user-activatable means is mounted on said holder.

31. A head-mounted visual display apparatus for a user, comprising: an image generator, which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator, optical elements to the user's head; a removably mounted tracking module for outputting an indication of the motion or position of the user's head.

32. A head-mounted visual display apparatus for a user comprising: an optical generator which outputs image light; optical elements configured to receive said image light from said image generator and provide said image to the eye position of the user; a holder configured to mount the image generator and optical elements to the user's head; a tracking module for outputting an indication of the motion or position of the user's head; and means for removably^' mounting said tracking module on said head-mounted display.

33. A method for providing visual display of an image to a user comprising: providing an image generator which outputs image light in at least a first direction; receiving said image light by a fold mirror and reflecting at least a first portion of said image light in a second direction; receiving said image light from said fold mirror and magnifying said image light by reflecting said image light in a direction towards the eye position of the user; positioning a color shutter for providing color image light; mounting at least said fold mirror and reflective combiner on a shroud having at least a lower surface and a side surface; positioning a backlight adjacent said image generator; positioning a first mask between said backlight and said image generator; poistioning a second mask between said image generator and said fold mirror; positioning said holder on the head of a user wherein said shroud is spaced at least one inch from said user's eye position to accommodate eyeglasses; mounting at least one speaker with respect to said holder, for providing sound; activating a button mounted on said holder for muting at least one of said sound and said image light; and removably mounting a tracking module for outputting ion of the motion or position of the user's head.