US20050270367A1 - Multi-person stereo display system - Google Patents

Multi-person stereo display system Download PDF

Info

Publication number
US20050270367A1
US20050270367A1 US11/196,010 US19601005A US2005270367A1 US 20050270367 A1 US20050270367 A1 US 20050270367A1 US 19601005 A US19601005 A US 19601005A US 2005270367 A1 US2005270367 A1 US 2005270367A1
Authority
US
United States
Prior art keywords
projector
glasses
person
shutters
shutter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/196,010
Inventor
Ian McDowall
Mark Bolas
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fakespace Labs Inc
Original Assignee
Fakespace Labs Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fakespace Labs Inc filed Critical Fakespace Labs Inc
Priority to US11/196,010 priority Critical patent/US20050270367A1/en
Publication of US20050270367A1 publication Critical patent/US20050270367A1/en
Priority to US12/411,238 priority patent/US8223197B2/en
Priority to US13/551,410 priority patent/US20130021457A1/en
Priority to US14/152,936 priority patent/US9100643B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/334Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/24Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/15Processing image signals for colour aspects of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/158Switching image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189Recording image signals; Reproducing recorded image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/363Image reproducers using image projection screens
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/368Image reproducers using viewer tracking for two or more viewers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/286Image signal generators having separate monoscopic and stereoscopic modes

Definitions

  • This invention relates to the field of multi-person stereo display systems incorporating head-tracking for immersive environments in virtual reality systems.
  • These systems vary in their configuration and may have between 1 and 6 projection screens in a single system.
  • the viewer may stand either in a corner at the junction between 2 screens or in a room composed of several projection screens with images projected onto the walls, floor and possibly even the ceiling.
  • Each screen has an image projected on it by a projector which is oriented behind the screen—possibly with an intervening mirror—which relays the image and shortens the image path or folds in a convenient way.
  • the screen is either oriented at an angle relative to the viewer, much like a drafting table, or it may be oriented in a horizontal orientation so that it more closely resembles a table surface.
  • the Virtual Portal system incorporated three walls which were projection screens, each of which was approximately 10′.times.10′ and surrounded the user who wore stereo glasses and a head-tracker.
  • the head-tracker is used so that the computer can update the images appropriately as the user moves around. For example, if there is a cube in front of the user on the projection screen, as the user moves around the images are updated in such way that the user may look at different sides of the cube by moving their head or walking around it.
  • Michael Deering has also developed systems which are based on a flat, small monitor display as would typically accompany a workstation. Again, head-tracking is used so that the stereo images presented on the display give an illusion of an object floating in front of the user. The user can generally interact with these objects by use of a hand-tracker of some kind of a tracked wand.
  • the tracking technology for these systems is generally either electromagnetic in nature or acoustic.
  • Michael Deering in particular, has generally used acoustic tracking for various reasons.
  • stereo glasses which are standard flicker glasses for stereo at 120 hertz (approx. per eye) and the computer updates the perspective views for left and right eyes according to the location of this individual person.
  • the stereo glasses will see a stereo image but it is offset because the images are being calculated from the head-tracked point of view rather than from their own point of view.
  • the responsive workbench originally developed at GMD in Germany, is a flat table-top display and again head-tracking with stereo glasses is used so that one may see a stereo image on the table. If multiple people are looking at the table together, only those people who are very close to the person with the head-tracker see a reasonable view and as this person moves around, the passive viewer's perspectives are very distorted.
  • the invention is a system which includes software, video muxing, control, and special flicker glasses.
  • the system is currently controlled by a personal computer (PC) which may be easily replaced by a micro controller, or other electronics.
  • PC personal computer
  • the invention is described in terms of two independent viewpoints into the computer generated scene. In general the same basic scheme may be extended to N viewers.
  • the invention is framed in the context of CRT based projectors which have 3 lenses (Red, Green, and Blue).
  • CRT based projectors which have 3 lenses (Red, Green, and Blue).
  • the technology of projection displays is a rapidly evolving field and the use of LCD or DMD projectors may offer some alternate configurations which are advantageous. In particular, we expect that a DMD projector would work well and allow one to support a large number of viewers.
  • FIG. 1 shows a typical, basic one correct view system incorporating a computer and projector on a tabletop display.
  • FIG. 2 shows a multi-screen, rear projection system as is typical with a single, active viewer.
  • FIG. 3 illustrates the basic system diagram for two people with a single projector and a single computer with a frame buffer and a multi-channel option.
  • FIG. 4 shows the configuration for high frame rate multi-person stereo using two people as an example configuration.
  • FIG. 5 illustrates the sequence for the shutters in FIG. 4 with the shutters for each projector as a single row in the table and assuming the shutters for the projectors have a fast on time, but a slow transition from on to off.
  • FIG. 6 shows a technique for increasing the efficiency of the system under the condition that the on and off times for the shutters is asymmetric.
  • FIG. 7 shows the technique of FIG. 6 and the timing of the glasses relative to the projector shutters.
  • FIG. 8 shows the timing for a system with four viewers rather than two.
  • FIG. 1 illustrates the basic system for the single correct viewer case.
  • a computer ( 100 ) generates an image based on the position and orientation of the viewer ( 160 ) who's head motions are detected by the head tracker which is composed of source ( 130 ), and sensor ( 140 ). The data from the tracker is relayed to the computer ( 100 ) and this position and orientation data is used to compute the correct left and right eye perspective views from the person's point of view. These images are generated by the computer and relayed to the projector ( 105 ). The images from the projector go through mirror ( 110 ) and appear on the display surface ( 120 ). The viewer 160 sees different images in the left and right eyes through the glasses ( 150 ).
  • the right/left opening of the glasses is controlled by controller ( 190 ) which is often infrared but might need a wire to the glasses. As previously described, these glasses flicker in time to an infrared beacon ( 190 ) which is also controlled by the computer ( 100 ).
  • the person ( 160 ) sees the images ( 170 ) and ( 180 ) in their left and right eyes, respectively, thus giving the illusion of a model (in this case a cube) being on/in/above the table. As the person ( 160 ) moves their head, these images are updated by the computer and the illusion is maintained. Viewers 161 , 162 , and 163 also see the same stereo pair on the table as person 160 . The view from their perspective is incorrect however.
  • person 163 should see a different face of the cube than will person 160 .
  • the current state of the art does not permit this. Instead the same view as person 160 is seen.
  • viewers 161 and 162 there is an error but if they stand very close to person 160 they will see an OK image pair.
  • FIG. 2 illustrates a multi-screen system in which the viewer stands surrounded by three large screens. Again, the images on the three screens are presented in stereo.
  • the image on the left screen ( 210 ) is projected onto the screen by projector ( 250 ).
  • the image on the center screen ( 220 ) is projected by projector ( 260 ), and the image on the right screen ( 230 ) is projected by projector ( 270 ).
  • the viewer ( 240 ) is head tracked and can look around in this space and see a stereo image on all three screens simultaneously. Thus, there is an illusion of being “in” a space. Of course, this is true only for this single viewer ( 240 ). If another viewer were to step into the room and was to be in an opposite corner, for instance, the view would not be correct.
  • FIG. 3 illustrates the system diagram for two people, both seeing stereo images, in a system which incorporates a single projector.
  • the images that the two people see are generated by a Silicon Graphics machine.
  • the images generated by the computer are stored in a frame buffer.
  • the frame buffer is organized as shown by ( 300 ).
  • the frame buffer is essentially 2,048 pixels tall and 1,280 pixels wide. This buffer is divided into four areas for the left and right eyes of each of the two participants.
  • area ( 301 ) is used by the left eye of Person A
  • area ( 302 ) is used by the right eye of Person A.
  • Area ( 303 ) is used by the left eye of Person B and area ( 304 ) is used by the right eye of Person B.
  • the video data from these areas comes out over 6 cables (RGB per eye). Three of the cables come out of the frame buffer for Person A and three of them for Person B. This is an SGI with a multi-channel option in the 2@1280.times.1024.sub. - - - 60 mode. In addition to the configuration shown, alternate configurations as shown in ( 305 ) are also possible with simple software changes on the SGI and the PC which controls the glasses.
  • the images from the frame buffer are taken into a 2:1 mux ( 310 ). This video mux can switch between input “A” and input “B” and produces a single video signal over the three cables which go to the projector ( 320 ).
  • a GDC3 controller is used to generate the vertical sync information. This unit takes in composite sync from one of the two video channels and produces a sync signal with an added vertical sync signal in the middle of the image for the projector. In addition, it produces a signal which switches at 60 hertz. This signal is fed to the parallel port interface ( 350 ) of personal computer ( 360 ).
  • the state of the signal from the GDC3 is used by the PC to determine which eye should be unveiled. In addition, this signal is used as a reference for keeping the personal computer synchronized to the vertical sync of the images coming into the system from the Silicon Graphics computer.
  • the sync from the GDC3, which is running at 120 hertz, goes to the projector ( 320 ).
  • the parallel port interface ( 350 ) interfaces between the personal computer ( 360 ) and the rest of the system.
  • the drive signal from the GEC3 comes into the parallel port and causes an interrupt on the PC which indicates that a frame is starting. This interrupt is triggered by the edge of the drive signal rather than the logic level.
  • the software on the PC controls the state of the mux ( 310 ), and also the state of the shutters in the glasses ( 381 , 382 , 391 , 392 ). Between the parallel port interface ( 350 ) and the glasses there are some drive electronic units ( 370 , 371 , 372 , 373 ). The parallel port output to the glasses goes through a buffer and this buffer provides enough energy to drive the shutters to the desired state. Because the drive wave form for the shutters will be asymmetric, a filter is used to AC couple the shutters from the drive electronics.
  • the drive electronics ( 373 ) interfaces between the parallel port interface ( 350 ) and the glasses ( 380 ) in particular, one of the two lenses ( 382 or 381 ) and between the driver and the glasses one will see the filter ( 375 ) which is composed of a capacitor and a resister which AC couple the signal between the driver and the shutter so that the shutter is not damaged.
  • the other lenses are driven by a similar filter network and drive electronics ( 372 , 371 , 370 ).
  • the PC 360 is used as a central controller for the various timing requirements.
  • the PC uses its parallel port to interface to the system and to control the timing.
  • Various bits on the parallel port control which of the four eyes is “open” and the state of the 2:1 mux.
  • the GDC-3 DRIVE output is connected to pin 10 of the parallel port which is an input to the PC. In this way, the PC determines which eye should be shown.
  • the PC determines the state of the 2:1 mux thus determining which video image will be routed to the projector during this frame time.
  • the PC 360 controls which eye and which person is being displayed; it can turn on the respective shutters for making that view visible to the correct eye. It does this by outputting the correct bit on the parallel port interface for turning the correct shutter on.
  • the shutters are actually driven by the shutter drivers ( 373 ) and the intervening filter ( 375 ) and so the PC just outputs a high-level to indicate that the glasses for that person should be used and the high is routed either to the left eye or the right eye interface.
  • person A has a stereo pair. Each eye saw an image for 1/125th of a second and the entire process took 1/60th of a second.
  • the PC now switches the mux over to position B and the mux is left there for 1/60th of a second which is long enough for a full video image (1280.times.1024) to get routed to the projector.
  • the GDC3 again inserts an additional vertical sync pulse and switches the drive signal again and this occurs at the half-way point so two images of 1280 horizontal by 492 vertical will be displayed by the projector on the immersive work bench.
  • the PC gets the same information as before, but as the mux is in position B, routes the control signals for the glasses over to the glasses belonging to person B by controlling the drivers ( 371 and 370 ). That essentially concludes the rendering of a single frame for both people.
  • FIG. 4 shows a projector and glasses configuration which enables high-resolution multi-person stereo with high frame rates.
  • This system is composed of two frame buffers or other video sources which generally would come from a computer such as a Silicon Graphics Reality Engine or some other type of graphics workstation or personal computer. These are represented by the areas shown as 401 and 402 .
  • These frame buffers are connected to two independent projectors.
  • Frame buffer ( 401 ) is connected to projector ( 403 ).
  • This projector will display the image from frame buffer ( 401 ) on the display surface ( 420 ).
  • the projector is mounted so that the image appears on the projection surface after passing through the shutters ( 405 A, 405 B, and 405 C).
  • These shutters could be configured as a single panel; current off the shelf shutters are available up to approximately 4′′ in diameter.
  • Frame buffer ( 402 ) is interfaced to projector ( 404 ) whose image passes through shutters ( 410 A, B, and C) on its way to display ( 420 ).
  • the images from the frame buffers ( 401 and 402 ) displayed by the projectors on the display surface may be driven in stereo from each of the frame buffers so that the projectors are running at a vertical frequency higher than normal and displaying alternate frames of left and right eye imagery.
  • the images from the two projectors are aligned onto the display surface ( 420 ) and when the system is in operation, the person A looking through glasses ( 430 ) will only be able to see the image from projector A and the person using glasses ( 440 ) will only be able to see the image from projector ( 404 ).
  • the sync signal from each of the frame buffers is fed to a personal computer which monitors the position of each projector relative to the top of the picture by counting A sync and B sync as required.
  • the PC may easily be replaced by a custom controller, or a microcomputer, or processor of some kind.
  • the personal computer controls the state of the various shutters through parallel port interface ( 460 ).
  • This interface allows the personal computer to control the shutters for projector A ( 405 A, B, and C) which are driven by driver ( 480 ).
  • the images from projector B also pass through shutters ( 410 A, B, and C).
  • These shutters are controlled by the PC through the parallel port interface and driver ( 470 ).
  • the PC also controls the state of each of the lenses in the glasses ( 430 and 440 ). This is done by the drive circuitry ( 490 and 495 ).
  • the shutters for projector A and projector B are driven at a fast rate so that the images coming from the projectors are simultaneously displayed on the immersive workbench from an external point of view.
  • FIG. 5 shows the various states of the shutters in the system shown in FIG. 4 over time.
  • the first cycle of the sequence is for person A to see the left and right eye images which are appropriate.
  • the second person, Person B sees the left and right eye images from their respective points of view.
  • Time in the figures runs from left to right.
  • time “starts” at the transition from opaque to clear of the shutters in front of projector A.
  • This start of the sequence is shown by the marker ( 500 ).
  • Time in the figure runs to the right and the state of the various shutters is indicated by the line to the right of the name of the shutter and the following shutters are shown: 591 indicates the shutters that are located in front of the projection lenses for the projector corresponding to person A.
  • 592 is representative of the shutters which are positioned in front of the lenses of projector B.
  • 593 represents the state of the shutters in front of the person A over their left eye.
  • 594 is for the shutter over Person A's right eye.
  • 595 is over Person B's left eye, and 596 is over Person B's right eye.
  • the exact ordering of the states for shutters 593 through 596 is actually dependent upon which eye image is drawn in the frame buffer is what position; thus, if one were to draw the images differently in the frame buffers, one would need to adjust the timing of the shutters accordingly. This particular configuration was chosen somewhat arbitrarily. As time progresses, the states of the shutters are changed by the controller and the state of each shutter is indicated by the line and a high state indicates that the shutter is clear.
  • a low state indicates that that shutter is opaque.
  • the transitions from clear to opaque, or opaque to clear are not instantaneous, in general, and take some time.
  • shutters may be designed which have unbalanced transitions as shown in this diagram where for the shutters in front of the projectors, the transition from opaque to clear is very quick, and the transition from clear to opaque is somewhat slower.
  • the system which we have constructed uses a different shutter material for the glasses than it does for the projectors.
  • the shutter material for the glasses can be manufactured only in small shutters which are too small for use directly in front of the lenses for a projector.
  • the shutter for projector A is still on so 591 , as you can see, is still high, 593 is turned off, and the person's left eye can now no longer see the display and the shutter for the person's right eye ( 594 ) has been turned on and can now see the display.
  • the image from the frame buffer which person's right eye should be seeing is being fed to the display to the projector.
  • the shutters for the projector A are being turned off and this transition occurs over a small time period and somewhere during this time period the glasses for person A should be completely turned off, as shown in the figure.
  • the projector A shutters are completely off, as are both left and right eye shutters for person A.
  • projector shutters ( 592 ) are turned on, thus allowing light from projector B to flow to the display.
  • the shutters for the glasses A are left off and the shutters for the B person are adjusted.
  • shutter ( 595 ) is turned on and person B's left eye sees the left eye image.
  • the shutter for the person B's left eye ( 595 ) is turned off and in the next instant ( 540 ), the glasses for person B will switch over to the right eye so that shutter ( 596 ) is on and ( 595 ) is off.
  • the shutter for the projector B ( 592 ) is left on.
  • the shutters for projector B are turned off and at some point during this interval the shutter for person B's right eye ( 596 ) is also turned off.
  • the sequence which started originally at 500 would be repeated ad infinitum. This sequence can be repeated as quickly as it is possible to switch the shutters with reasonable losses.
  • the transition time of the projector shutters shown here in time period 520 , and 550 , will become the dominant period as the frequency of repetition is increased. These transition times limit the maximum possible efficiency of the system.
  • FIG. 6 illustrates a significant efficiency improvement over FIG. 5 .
  • the switching time of the shutters for the projectors heavily influences the achievable efficiency of the system as shown.
  • the shutters in front of the projectors are asymmetric and that this asymmetry in turn on/turn off time may be set up so that it either happens on the on to off transition or on the off to on transition.
  • setting up the projectors with projector A having a fast on time and a slow off time and projector B having a fast off time and a slow on time we can improve the overall efficiency of the system, as shown in FIG. 6 .
  • Projector A and B use the same type of shutter which has a fast on time and a slow off time.
  • projector A is turned on as B has turned completely off.
  • projector B is turned fully on now that projector A is fully off.
  • projector B is turned fully on now that projector A is fully off.
  • projector B is turned off and at ( 614 ), we again turn projector A back on again.
  • this sequence takes longer than the sequence where the asymmetric shutter turn on, turn off curves have been used to our advantage.
  • FIG. 7 illustrates the combination of the increased efficiency as described in FIG. 6 with the states of the glasses for the two viewers.
  • 791 is the state of the shutters in front of Projector A.
  • 792 is the state of the shutters in front of Projector B.
  • 793 and 794 are the states of the left and right shutters in the glasses for person A.
  • 795 and 796 are the states of the shutters for the left and right eyes of person B.
  • Time starts at mark 700 and proceeds right to left to 750 at which point the sequence is repeated.
  • time 705 The left view from projector A is seen.
  • duration 710 the right view for person A is seen.
  • duration 720 the transition from projector A to projector B is made and all glasses are off.
  • duration 730 the left eye view of B is seen.
  • duration 740 the right eye view of B is seen.
  • FIG. 8 illustrates the system timing with four independent viewers using four projectors.
  • the projectors are continuously projecting sequential stereo images and shutters between the projectors and the display surface determine which of the four projectors is illuminating the screen at any instant in time.
  • Time in the figure starts at 800 and runs to the right.
  • projector A 801 is enabled and the left eye 811 of the A glasses is on.
  • time 820 projector A 801 is enabled and the right eye 812 of the A glasses is on.
  • time 830 the transition is made from projector A 801 to projector B 802 .
  • time 840 projector B 802 is enabled and the left eye 821 of the B glasses is on.
  • projector B 802 is enabled and the right eye 822 of the B glasses is on.
  • projector C 803 is enabled and the left eye 831 of the C glasses is on.
  • time 870 projector C 803 is enabled and the right eye 832 of the C glasses is on.
  • time 880 the transition is made from projector C 803 to projector D 804 .
  • projector D 804 is enabled and the left eye 841 of the D glasses is on.
  • time 895 projector D 804 is enabled and the right eye 842 of the D glasses is on.

Abstract

The multi-person stereo display system permits several independent viewers to see different stereo images on a single projection surface. This is accomplished through the innovative use of video multiplexing, software, control electronics, and special viewing glasses. The system is particularly useful in situations where the viewers see computer generated images from their own independent perspectives.

Description

  • This application is a continuation of U.S. application Ser. No. 10/392,481 filed Mar. 18, 2003, now U.S. Pat. No. 6,924,833 which is a continuation of U.S. application Ser. No. 08/748,595 filed Nov. 13, 1996, now U.S. Pat. No. 6,535,241.
  • FIELD OF THE INVENTIONS
  • This invention relates to the field of multi-person stereo display systems incorporating head-tracking for immersive environments in virtual reality systems.
  • BACKGROUND OF THE INVENTIONS
  • Many people have developed large immersive displays based on rear projection techniques. These systems generally incorporate a projection screen or multiple projection screens in large CRT-based projectors which project images from a computer onto the screen. The user or users generally wear flicker stereo glasses and see images on the projection screens. The images on the projection screens are refreshed at 120 hertz (or some other higher than normal vertical rate) and the flicker glasses provide the user with different images to each eye by changing the opacity of the lens in front of each eye in sync with the accelerated vertical refresh of the monitor.
  • These systems vary in their configuration and may have between 1 and 6 projection screens in a single system. In multi-screen configurations the viewer may stand either in a corner at the junction between 2 screens or in a room composed of several projection screens with images projected onto the walls, floor and possibly even the ceiling. Each screen has an image projected on it by a projector which is oriented behind the screen—possibly with an intervening mirror—which relays the image and shortens the image path or folds in a convenient way. In single screen systems, the screen is either oriented at an angle relative to the viewer, much like a drafting table, or it may be oriented in a horizontal orientation so that it more closely resembles a table surface.
  • Some researchers, such as NRL have been doing similar work with non head-tracked interfaces. In these settings, the viewer or viewers all see a stereo pair and for the best view should stand in a small cluster near the place where the perspective is calculated from in the software.
  • These systems have been demonstrated on a number of occasions. One of the early public demonstrations was presented by Michael Deering of Sun Microsystems at Siggraph 1992. The Virtual Portal system incorporated three walls which were projection screens, each of which was approximately 10′.times.10′ and surrounded the user who wore stereo glasses and a head-tracker. The head-tracker is used so that the computer can update the images appropriately as the user moves around. For example, if there is a cube in front of the user on the projection screen, as the user moves around the images are updated in such way that the user may look at different sides of the cube by moving their head or walking around it.
  • In addition to large systems such as this, Michael Deering has also developed systems which are based on a flat, small monitor display as would typically accompany a workstation. Again, head-tracking is used so that the stereo images presented on the display give an illusion of an object floating in front of the user. The user can generally interact with these objects by use of a hand-tracker of some kind of a tracked wand. The tracking technology for these systems is generally either electromagnetic in nature or acoustic. Michael Deering, in particular, has generally used acoustic tracking for various reasons.
  • Other researchers have used magnetic tracking. An example of this would be the systems that have been developed by the University of Illinois at Chicago (Electronic Visualization Lab) which were demonstrated at Siggraph 1993. These systems use an electromagnetic tracker to track the location of a person in a room composed of a number of large screens. The advantage of electromagnetic tracking is that there are no “line-of-sight” requirements for the tracking technology to function correctly.
  • These systems generally have one person who wears both the stereo glasses which are standard flicker glasses for stereo at 120 hertz (approx. per eye) and the computer updates the perspective views for left and right eyes according to the location of this individual person. Thus, other people who are also wearing the stereo glasses will see a stereo image but it is offset because the images are being calculated from the head-tracked point of view rather than from their own point of view.
  • Consider the cube example: if there is a virtual cube and person A is standing on one side of the cube with the head-tracker and another person B is actually standing on the other side of the cube, both people in fact see the same image because only one view is presented and it is from the point of view of person A who has the head-tracker. The person B without the head-tracker sees an incorrect view. For person B to get a correct view, the tracker would have to be passed over to person B and the image calculated from B's point of view. Of course, then A is getting the wrong view which is not ideal. In general, when using these systems there has been the restriction that users who are passively viewing the system must stand close to the person with the head-tracker in order to get an incorrect but sort of acceptable perspective.
  • In a multi-screen projection environment, this limits the number of people who get a reasonable view to just a couple of people and also restricts the mobility of those who all must stay as a small group inside the room. This means that things like collaborative computing and collaborative design are difficult because one person is essentially in control of what everybody sees. In other systems, this is also an issue. For example, the responsive workbench, originally developed at GMD in Germany, is a flat table-top display and again head-tracking with stereo glasses is used so that one may see a stereo image on the table. If multiple people are looking at the table together, only those people who are very close to the person with the head-tracker see a reasonable view and as this person moves around, the passive viewer's perspectives are very distorted. This is particularly objectionable in situations such as training and situation awareness or planning. In a training exercise, a surgeon may be attempting to illustrate a procedure to a student and the student would like to be able to see the procedure from the correct perspective from their point of view. The surgeon also needs to be able to see the operation proceeding correctly from her own point of view and it is unacceptable for the view of either person to be incorrect.
  • Thus, in all present systems, a single viewer has both the head-tracker and the stereo glasses and this person essentially controls the view that all other participants will see. We have developed a system which eliminates this restriction and simultaneously provides the correct perspective to more than one person. This is a tremendous step forward for presenting a virtual environment in a large projection-type display to more than one person at a time which is very important for collaborative computing and collaborative design.
  • SUMMARY
  • The invention is a system which includes software, video muxing, control, and special flicker glasses. The system is currently controlled by a personal computer (PC) which may be easily replaced by a micro controller, or other electronics.
  • The invention is described in terms of two independent viewpoints into the computer generated scene. In general the same basic scheme may be extended to N viewers. The invention is framed in the context of CRT based projectors which have 3 lenses (Red, Green, and Blue). The technology of projection displays is a rapidly evolving field and the use of LCD or DMD projectors may offer some alternate configurations which are advantageous. In particular, we expect that a DMD projector would work well and allow one to support a large number of viewers.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a typical, basic one correct view system incorporating a computer and projector on a tabletop display.
  • FIG. 2 shows a multi-screen, rear projection system as is typical with a single, active viewer.
  • FIG. 3 illustrates the basic system diagram for two people with a single projector and a single computer with a frame buffer and a multi-channel option.
  • FIG. 4 shows the configuration for high frame rate multi-person stereo using two people as an example configuration.
  • FIG. 5 illustrates the sequence for the shutters in FIG. 4 with the shutters for each projector as a single row in the table and assuming the shutters for the projectors have a fast on time, but a slow transition from on to off.
  • FIG. 6 shows a technique for increasing the efficiency of the system under the condition that the on and off times for the shutters is asymmetric.
  • FIG. 7 shows the technique of FIG. 6 and the timing of the glasses relative to the projector shutters.
  • FIG. 8 shows the timing for a system with four viewers rather than two.
  • DESCRIPTION OF THE REFERENCE NUMERALS IN THE FIGURES
  • Number Description
      • 100 Computer
      • 105 Projector
      • 110 Mirror
      • 120 Rear projection screen
      • 130 Tracker source
      • 140 Tracker receiver
      • 150 Stereo glasses
      • 160 User with head tracker 140 and Stereo glasses
      • 161 User with stereo glasses
      • 162 User with stereo glasses
      • 163 User with stereo glasses
      • 170 User's left eye view (all viewers see the same left image)
      • 180 User's right eye view (all viewers see the same right image)
      • 190 Glasses controller
      • 210 Left screen
      • 220 Center screen
      • 230 Right screen
      • 240 User
      • 250 Left projector
      • 260 Center projector
      • 270 Right projector
      • 300 Silicon Graphics frame buffer
      • 301 Area where Person A left eye view is drawn
      • 302 Area where Person A right eye view is drawn
      • 303 Area where Person B left eye view is drawn
      • 304 Area where Person B right eye view is drawn
      • 305 Alternate frame buffer configuration
      • 310 Video 2:1 mud
      • 320 Projector
      • 330 Projection surface, possibly incorporating mirrors
      • 340 StereoGraphics GDC3
      • 350 Personal computer parallel port interface
      • 360 Personal computer
      • 370 Shutter driver electronics
      • 371 Shutter driver electronics
      • 372 Shutter driver electronics
      • 373 Shutter driver electronics
      • 375 Filter (typical)
      • 380 Person A glasses
      • 381 Left eye shutter
      • 382 Right eye shutter
      • 390 Person B glasses
      • 391 Left eye shutter
      • 392 Right eye shutter
      • 401 Frame buffer Person A
      • 402 Frame buffer Person B
      • 403 Projector A
      • 404 Projector B
      • 405 A, B, C Electronically controlled optical shutter(s) for projector A
      • 410 A, B, C Electronically controlled optical shutter(s) for projector B
      • 420 Immersive workbench screen system
      • 430 Glasses Person A
      • 440 Glasses Person B
      • 450 Personal computer and control software
      • 460 Parallel port interface
      • 470 Shutter drive electronics
      • 480 Shutter drive electronics
      • 490 Dual-channel shutter drive electronics for glasses of person A
      • 495 Dual-channel shutter drive electronics for glasses of person B
      • 500 Time starting for a single sequence
      • 505 Shutter for Projector A on and Person A left glasses on
      • 510 Projector A still on, glasses A right on
      • 520 Shutters for Projector A turning off, glasses A right turn off
      • 530 Projector B on, and glasses Person B left on
      • 540 Projector B still on, glasses Person B right on
      • 550 Projector B shutters turning off, Person B right shutter turning off
      • 560 End of cycle
      • 591 State for shutter(s) in front of lens(s) of Projector A, high=on
      • 592 State for shutter(s) in front of lens(s) of Projector B, high=on
      • 593 Glasses, shutter Person A left eye
      • 594 Glasses, shutter Person A right eye
      • 595 Glasses, shutters Person B left eye
      • 596 Glasses, shutters Person B right eye
      • 600 Start of sequence
      • 601 Transition from A to B
      • 602 B active
      • 603 Transition from B to A
      • 610 Transition from B to A ends
      • 611 Projector A turning off
      • 612 Projector B on
      • 613 Projector B turning off
      • 614 A on
      • 700 Start of sequence
      • 705 Projector A shutters turned on, glasses A left on
      • 710 Projector A shutters still on, glasses A switch to right on, left off
      • 720 Projector A shutters transitions on to off, Projector B transitions off to on both glasses off
      • 730 Projector B shutters on, glasses B left on
      • 740 Projector B still on, glasses B switch to right on
      • 750 end of sequence
      • 791 State for shutter(s) in front of lens(s) of Projector A, high=on
      • 792 State for shutter(s) in front of lens(s) of Projector B, high=on
      • 793 Glasses, shutter Person A left eye
      • 794 Glasses, shutter Person A right eye
      • 795 Glasses, shutters Person B left eye
      • 796 Glasses, shutters Person B right eye
      • 800 Start of sequence
      • 801 State for shutter(s) in front of lens(s) of Projector A, high=on
      • 802 State for shutter(s) in front of lens(s) of Projector B, high=on
      • 803 State for shutter(s) in front of lens(s) of Projector C, high=on
      • 804 State for shutter(s) in front of lens(s) of Projector D, high=on
      • 810 Projector A on and Glasses A Left on
      • 811 Glasses, shutter Person A left eye
      • 812 Glasses, shutter Person A right eye
      • 820 Projector A on and Glasses A Right on
      • 821 Glasses, shutters Person B left eye
      • 822 Glasses, shutters Person B right eye
      • 830 Transition Projector to Projector B all glasses off
      • 831 Glasses, shutter Person C left eye
      • 832 Glasses, shutter Person C right eye
      • 840 Projector B on and Glasses B Left on
      • 841 Glasses, shutters Person D left eye
      • 842 Glasses, shutters Person D right eye
      • 850 Projector B on and Glasses B Right on
      • 860 Projector C on and Glasses C Left on
      • 870 Projector C on and Glasses C Right on
      • 880 Transition Projector to Projector B all glasses off
      • 890 Projector D on and Glasses D Left on
      • 895 Projector D on and Glasses D Right on
    DETAILED DESCRIPTION OF THE INVENTIONS
  • FIG. 1 illustrates the basic system for the single correct viewer case. In this system, a computer (100) generates an image based on the position and orientation of the viewer (160) who's head motions are detected by the head tracker which is composed of source (130), and sensor (140). The data from the tracker is relayed to the computer (100) and this position and orientation data is used to compute the correct left and right eye perspective views from the person's point of view. These images are generated by the computer and relayed to the projector (105). The images from the projector go through mirror (110) and appear on the display surface (120). The viewer 160 sees different images in the left and right eyes through the glasses (150). The right/left opening of the glasses is controlled by controller (190) which is often infrared but might need a wire to the glasses. As previously described, these glasses flicker in time to an infrared beacon (190) which is also controlled by the computer (100). The person (160) sees the images (170) and (180) in their left and right eyes, respectively, thus giving the illusion of a model (in this case a cube) being on/in/above the table. As the person (160) moves their head, these images are updated by the computer and the illusion is maintained. Viewers 161, 162, and 163 also see the same stereo pair on the table as person 160. The view from their perspective is incorrect however. For example, person 163 should see a different face of the cube than will person 160. However, the current state of the art does not permit this. Instead the same view as person 160 is seen. For viewers 161 and 162 there is an error but if they stand very close to person 160 they will see an OK image pair.
  • FIG. 2 illustrates a multi-screen system in which the viewer stands surrounded by three large screens. Again, the images on the three screens are presented in stereo. The image on the left screen (210) is projected onto the screen by projector (250). The image on the center screen (220) is projected by projector (260), and the image on the right screen (230) is projected by projector (270). The viewer (240) is head tracked and can look around in this space and see a stereo image on all three screens simultaneously. Thus, there is an illusion of being “in” a space. Of course, this is true only for this single viewer (240). If another viewer were to step into the room and was to be in an opposite corner, for instance, the view would not be correct.
  • FIG. 3 illustrates the system diagram for two people, both seeing stereo images, in a system which incorporates a single projector. The images that the two people see are generated by a Silicon Graphics machine. The images generated by the computer are stored in a frame buffer. In this case, the frame buffer is organized as shown by (300). The frame buffer is essentially 2,048 pixels tall and 1,280 pixels wide. This buffer is divided into four areas for the left and right eyes of each of the two participants. In frame buffer (300), area (301) is used by the left eye of Person A, and area (302) is used by the right eye of Person A. Area (303) is used by the left eye of Person B and area (304) is used by the right eye of Person B. The video data from these areas comes out over 6 cables (RGB per eye). Three of the cables come out of the frame buffer for Person A and three of them for Person B. This is an SGI with a multi-channel option in the 2@1280.times.1024.sub. - - - 60 mode. In addition to the configuration shown, alternate configurations as shown in (305) are also possible with simple software changes on the SGI and the PC which controls the glasses. The images from the frame buffer are taken into a 2:1 mux (310). This video mux can switch between input “A” and input “B” and produces a single video signal over the three cables which go to the projector (320). Thus, by controlling the state of mux (310), one may switch between Person “A” and Person “B.” The image from projector (320) passes to a display surface (330). In getting onto the projection surface the image may be bounced through a mirror in order to fold the optical path for convenience. In addition to the projector receiving the video imagery from the mux (310), a GDC3 controller is used to generate the vertical sync information. This unit takes in composite sync from one of the two video channels and produces a sync signal with an added vertical sync signal in the middle of the image for the projector. In addition, it produces a signal which switches at 60 hertz. This signal is fed to the parallel port interface (350) of personal computer (360). The state of the signal from the GDC3 is used by the PC to determine which eye should be unveiled. In addition, this signal is used as a reference for keeping the personal computer synchronized to the vertical sync of the images coming into the system from the Silicon Graphics computer. The sync from the GDC3, which is running at 120 hertz, goes to the projector (320). The parallel port interface (350) interfaces between the personal computer (360) and the rest of the system. The drive signal from the GEC3 comes into the parallel port and causes an interrupt on the PC which indicates that a frame is starting. This interrupt is triggered by the edge of the drive signal rather than the logic level. The software on the PC controls the state of the mux (310), and also the state of the shutters in the glasses (381, 382, 391, 392). Between the parallel port interface (350) and the glasses there are some drive electronic units (370,371,372,373). The parallel port output to the glasses goes through a buffer and this buffer provides enough energy to drive the shutters to the desired state. Because the drive wave form for the shutters will be asymmetric, a filter is used to AC couple the shutters from the drive electronics. For example, the drive electronics (373) interfaces between the parallel port interface (350) and the glasses (380) in particular, one of the two lenses (382 or 381) and between the driver and the glasses one will see the filter (375) which is composed of a capacitor and a resister which AC couple the signal between the driver and the shutter so that the shutter is not damaged. Similarly, the other lenses are driven by a similar filter network and drive electronics (372, 371, 370).
  • The PC 360 is used as a central controller for the various timing requirements. The PC uses its parallel port to interface to the system and to control the timing. Various bits on the parallel port control which of the four eyes is “open” and the state of the 2:1 mux. The GDC-3 DRIVE output is connected to pin 10 of the parallel port which is an input to the PC. In this way, the PC determines which eye should be shown. In addition, the PC determines the state of the 2:1 mux thus determining which video image will be routed to the projector during this frame time.
  • The PC 360 controls which eye and which person is being displayed; it can turn on the respective shutters for making that view visible to the correct eye. It does this by outputting the correct bit on the parallel port interface for turning the correct shutter on. The shutters are actually driven by the shutter drivers (373) and the intervening filter (375) and so the PC just outputs a high-level to indicate that the glasses for that person should be used and the high is routed either to the left eye or the right eye interface. Thus, person A has a stereo pair. Each eye saw an image for 1/125th of a second and the entire process took 1/60th of a second. The PC now switches the mux over to position B and the mux is left there for 1/60th of a second which is long enough for a full video image (1280.times.1024) to get routed to the projector. In the midst of this frame, of course, the GDC3 again inserts an additional vertical sync pulse and switches the drive signal again and this occurs at the half-way point so two images of 1280 horizontal by 492 vertical will be displayed by the projector on the immersive work bench. The PC gets the same information as before, but as the mux is in position B, routes the control signals for the glasses over to the glasses belonging to person B by controlling the drivers (371 and 370). That essentially concludes the rendering of a single frame for both people. Each person saw an image in each of their eyes for 1/120th of second, i.e., 1/60th of a second each, so, overall, the update rate is 30 hertz because each person gets 1/60th and two 60th's is 1/30th.
  • We move now to an alternate configuration which permits one to reach display rates which are higher than 30 hertz stereo which is a little flickery.
  • FIG. 4 shows a projector and glasses configuration which enables high-resolution multi-person stereo with high frame rates. This system is composed of two frame buffers or other video sources which generally would come from a computer such as a Silicon Graphics Reality Engine or some other type of graphics workstation or personal computer. These are represented by the areas shown as 401 and 402. These frame buffers are connected to two independent projectors. Frame buffer (401) is connected to projector (403). This projector will display the image from frame buffer (401) on the display surface (420). The projector is mounted so that the image appears on the projection surface after passing through the shutters (405A, 405B, and 405C). These shutters could be configured as a single panel; current off the shelf shutters are available up to approximately 4″ in diameter.
  • Frame buffer (402) is interfaced to projector (404) whose image passes through shutters (410A, B, and C) on its way to display (420). The images from the frame buffers (401 and 402) displayed by the projectors on the display surface may be driven in stereo from each of the frame buffers so that the projectors are running at a vertical frequency higher than normal and displaying alternate frames of left and right eye imagery. The images from the two projectors are aligned onto the display surface (420) and when the system is in operation, the person A looking through glasses (430) will only be able to see the image from projector A and the person using glasses (440) will only be able to see the image from projector (404). In practice, there will be some bleed-through of both the glasses and the shutters so that the images seen by each person will also include some slight visual “shadows” where the other image is being displayed. This may be improved by improving the contrast ratio of the various optical shutters and by improving the off-axis performance of the various shutters and the performance of the projectors. The sync signal from each of the frame buffers is fed to a personal computer which monitors the position of each projector relative to the top of the picture by counting A sync and B sync as required. In fact, the PC may easily be replaced by a custom controller, or a microcomputer, or processor of some kind. In this system, the personal computer (450) controls the state of the various shutters through parallel port interface (460). This interface allows the personal computer to control the shutters for projector A (405 A, B, and C) which are driven by driver (480). The images from projector B also pass through shutters (410 A, B, and C). These shutters are controlled by the PC through the parallel port interface and driver (470). The PC also controls the state of each of the lenses in the glasses (430 and 440). This is done by the drive circuitry (490 and 495). In operation, the shutters for projector A and projector B are driven at a fast rate so that the images coming from the projectors are simultaneously displayed on the immersive workbench from an external point of view. So, if you were to look at the table without the glasses on you would see both the left and right eye images from both frame buffer A and frame buffer B on the table. The shutters in front of each projector are turning on and off very quickly (>100 Hz) in order to modulate the light coming from the projector and hitting the table. They are modulating the light in a Ping-Pong fashion so that any instant in time, only one of the two images will actually be on the table. The shutters are thus being driven much quicker than the vertical frequency of the two projectors. This frequency is somewhat adjustable. It is obviously impractical for this to be less than 30 hertz because otherwise one might as well use the configuration shown in FIG. 3 which uses only one projector instead of two. Of course, if one had a special projector which could show images at a very high rate, then one could eliminate the shutters 405ABC and 410ABC. The rest of the design would stay essentially the same.
  • FIG. 5 shows the various states of the shutters in the system shown in FIG. 4 over time. The first cycle of the sequence is for person A to see the left and right eye images which are appropriate. Following this, the second person, Person B, sees the left and right eye images from their respective points of view. This is accomplished in the following manner. Time in the figures runs from left to right. In this figure, time “starts” at the transition from opaque to clear of the shutters in front of projector A. This start of the sequence is shown by the marker (500). Time in the figure runs to the right and the state of the various shutters is indicated by the line to the right of the name of the shutter and the following shutters are shown: 591 indicates the shutters that are located in front of the projection lenses for the projector corresponding to person A. 592 is representative of the shutters which are positioned in front of the lenses of projector B. 593 represents the state of the shutters in front of the person A over their left eye. 594 is for the shutter over Person A's right eye. 595 is over Person B's left eye, and 596 is over Person B's right eye. The exact ordering of the states for shutters 593 through 596 is actually dependent upon which eye image is drawn in the frame buffer is what position; thus, if one were to draw the images differently in the frame buffers, one would need to adjust the timing of the shutters accordingly. This particular configuration was chosen somewhat arbitrarily. As time progresses, the states of the shutters are changed by the controller and the state of each shutter is indicated by the line and a high state indicates that the shutter is clear. A low state indicates that that shutter is opaque. The transitions from clear to opaque, or opaque to clear, are not instantaneous, in general, and take some time. In fact, shutters may be designed which have unbalanced transitions as shown in this diagram where for the shutters in front of the projectors, the transition from opaque to clear is very quick, and the transition from clear to opaque is somewhat slower. The system which we have constructed uses a different shutter material for the glasses than it does for the projectors. The shutter material for the glasses can be manufactured only in small shutters which are too small for use directly in front of the lenses for a projector. However, it is possible in the future that this size limitation will be lifted, in which case the transition time for both shutters over the projector and those over the glasses would be more instantaneous and this would simplify the system's design and increase the overall efficiency. As time progresses from the start of the cycle at 500 to 505, the shutter in front of the projector for person A (591) is clear and the image from the projector will reach the display screen. Also during this time, the shutter in front of person A's left eye shutter (593) is also turned on and the person's left eye will see the image from projector A. In the next instant (510), the shutter for projector A is still on so 591, as you can see, is still high, 593 is turned off, and the person's left eye can now no longer see the display and the shutter for the person's right eye (594) has been turned on and can now see the display. At this point in time, of course, it is expected that the image from the frame buffer which person's right eye should be seeing, is being fed to the display to the projector. In the next instant (520), the shutters for the projector A are being turned off and this transition occurs over a small time period and somewhere during this time period the glasses for person A should be completely turned off, as shown in the figure. Thus, at the end of time period (520), the projector A shutters are completely off, as are both left and right eye shutters for person A. In the next instant (530), projector shutters (592) are turned on, thus allowing light from projector B to flow to the display. The shutters for the glasses A are left off and the shutters for the B person are adjusted. In the first instant, shutter (595) is turned on and person B's left eye sees the left eye image. At the end of this instant the shutter for the person B's left eye (595) is turned off and in the next instant (540), the glasses for person B will switch over to the right eye so that shutter (596) is on and (595) is off. The shutter for the projector B (592) is left on. During instant (550), the shutters for projector B are turned off and at some point during this interval the shutter for person B's right eye (596) is also turned off. Thus, at the end of time period 50, we are now back at the same point as we were at the beginning of the figure and starting at 560, the sequence which started originally at 500 would be repeated ad infinitum. This sequence can be repeated as quickly as it is possible to switch the shutters with reasonable losses. As you can well imagine, the transition time of the projector shutters, shown here in time period 520, and 550, will become the dominant period as the frequency of repetition is increased. These transition times limit the maximum possible efficiency of the system.
  • FIG. 6 illustrates a significant efficiency improvement over FIG. 5. As mentioned in reference to FIG. 5, the switching time of the shutters for the projectors heavily influences the achievable efficiency of the system as shown. In order to increase the efficiency of the system, we can take advantage of the fact that the shutters in front of the projectors are asymmetric and that this asymmetry in turn on/turn off time may be set up so that it either happens on the on to off transition or on the off to on transition. But setting up the projectors with projector A having a fast on time and a slow off time and projector B having a fast off time and a slow on time, we can improve the overall efficiency of the system, as shown in FIG. 6.
  • At time (600), projector A turns on and projector B turns off. This occurs fairly quickly and projector A is left on and projector B is left off until time (601). At time (601), the transition for project A is begun as is the transition for projector B. By the end of this time period at (602), projector B is now on and projector A is now off. This time is duly used for the transition of both projectors resulting in an efficiency. At the end of time period (603), we again switch which projector is on, and, as both shutters are in the state from which they can switch quickly, this transition is fairly fast. The configuration shown in FIG. 5 results in the following sequence, which, as you can see, takes longer. Projector A and B use the same type of shutter which has a fast on time and a slow off time. At instant (610) projector A is turned on as B has turned completely off. At (611), we start the transition for projector A from on to off, and at (612), projector B is turned fully on now that projector A is fully off. At (613), we begin the transition for projector B turning off and at (614), we again turn projector A back on again. As you can see, this sequence takes longer than the sequence where the asymmetric shutter turn on, turn off curves have been used to our advantage.
  • FIG. 7 illustrates the combination of the increased efficiency as described in FIG. 6 with the states of the glasses for the two viewers. 791 is the state of the shutters in front of Projector A. 792 is the state of the shutters in front of Projector B. 793 and 794 are the states of the left and right shutters in the glasses for person A. 795 and 796 are the states of the shutters for the left and right eyes of person B. Time starts at mark 700 and proceeds right to left to 750 at which point the sequence is repeated. In time 705, The left view from projector A is seen. In duration 710 the right view for person A is seen. In duration 720 the transition from projector A to projector B is made and all glasses are off. In duration 730 the left eye view of B is seen. In duration 740 the right eye view of B is seen. As you can see, there is a lot less “dead” time in this figure than in FIG. 5 by overlapping the transitions of the projector shutters, a more efficient system is achieved.
  • FIG. 8 illustrates the system timing with four independent viewers using four projectors. The projectors are continuously projecting sequential stereo images and shutters between the projectors and the display surface determine which of the four projectors is illuminating the screen at any instant in time. Time in the figure starts at 800 and runs to the right. During time 810 projector A 801 is enabled and the left eye 811 of the A glasses is on. During time 820 projector A 801 is enabled and the right eye 812 of the A glasses is on. During time 830 the transition is made from projector A 801 to projector B 802. During time 840 projector B 802 is enabled and the left eye 821 of the B glasses is on. During time 850 projector B 802 is enabled and the right eye 822 of the B glasses is on. During time 860 projector C 803 is enabled and the left eye 831 of the C glasses is on. During time 870 projector C 803 is enabled and the right eye 832 of the C glasses is on. During time 880 the transition is made from projector C 803 to projector D 804. During time 890 projector D 804 is enabled and the left eye 841 of the D glasses is on. During time 895 projector D 804 is enabled and the right eye 842 of the D glasses is on. Thus at time 899 we are back at the start of the sequence. Four independent stereo views have been presented to four independent viewers.

Claims (1)

1. A multi-person stereoscopic display system comprising:
at least one projector, each of the at least one projectors having a shutter;
a first pair of stereoscopic shutter glasses for use by a first viewer;
a second pair of stereoscopic shutter glasses for use by a second viewer;
a computer programmed to generate a first set of images and a second set of images, the first set of images being generated for the first viewer, the second set of images being generated for the second viewer, the first and second set of images to be projected by the projector, and
a controlling unit which controls the optical transparency of shutters for the at least one projector, the first pair of glasses and the second pair of glasses; said controlling unit operating in conjunction with the computer to control each projector shutter, the first pair of glasses and the second pair of glasses so that the first pair of glasses is stereoscopically transparent when the first set of images is projected, and the the second pair of glasses is stereoscopically transparent when the second set of images is projected.
US11/196,010 1996-11-13 2005-08-02 Multi-person stereo display system Abandoned US20050270367A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US11/196,010 US20050270367A1 (en) 1996-11-13 2005-08-02 Multi-person stereo display system
US12/411,238 US8223197B2 (en) 1996-11-13 2009-03-25 Multi-person stereo display system
US13/551,410 US20130021457A1 (en) 1996-11-13 2012-07-17 Multi-Person Stereo Display System
US14/152,936 US9100643B2 (en) 1996-11-13 2014-01-10 Multi-person stereo display system

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/748,595 US6535241B1 (en) 1996-11-13 1996-11-13 Multi-person stereo display system
US10/392,481 US6924833B1 (en) 1996-11-13 2003-03-18 Multi-person stereo display system
US11/196,010 US20050270367A1 (en) 1996-11-13 2005-08-02 Multi-person stereo display system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/392,481 Continuation US6924833B1 (en) 1996-11-13 2003-03-18 Multi-person stereo display system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/411,238 Continuation US8223197B2 (en) 1996-11-13 2009-03-25 Multi-person stereo display system

Publications (1)

Publication Number Publication Date
US20050270367A1 true US20050270367A1 (en) 2005-12-08

Family

ID=25010116

Family Applications (6)

Application Number Title Priority Date Filing Date
US08/748,595 Expired - Lifetime US6535241B1 (en) 1996-11-13 1996-11-13 Multi-person stereo display system
US10/392,481 Expired - Fee Related US6924833B1 (en) 1996-11-13 2003-03-18 Multi-person stereo display system
US11/196,010 Abandoned US20050270367A1 (en) 1996-11-13 2005-08-02 Multi-person stereo display system
US12/411,238 Expired - Fee Related US8223197B2 (en) 1996-11-13 2009-03-25 Multi-person stereo display system
US13/551,410 Abandoned US20130021457A1 (en) 1996-11-13 2012-07-17 Multi-Person Stereo Display System
US14/152,936 Expired - Fee Related US9100643B2 (en) 1996-11-13 2014-01-10 Multi-person stereo display system

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US08/748,595 Expired - Lifetime US6535241B1 (en) 1996-11-13 1996-11-13 Multi-person stereo display system
US10/392,481 Expired - Fee Related US6924833B1 (en) 1996-11-13 2003-03-18 Multi-person stereo display system

Family Applications After (3)

Application Number Title Priority Date Filing Date
US12/411,238 Expired - Fee Related US8223197B2 (en) 1996-11-13 2009-03-25 Multi-person stereo display system
US13/551,410 Abandoned US20130021457A1 (en) 1996-11-13 2012-07-17 Multi-Person Stereo Display System
US14/152,936 Expired - Fee Related US9100643B2 (en) 1996-11-13 2014-01-10 Multi-person stereo display system

Country Status (1)

Country Link
US (6) US6535241B1 (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100066816A1 (en) * 2008-09-18 2010-03-18 Kane Paul J Stereoscopic display system with flexible rendering for multiple simultaneous observers
GB2472438A (en) * 2009-08-06 2011-02-09 Sony Corp Multi-person 3D display system with several viewers watching different images on a single screen
EP2349002A1 (en) * 2008-09-30 2011-08-03 Universite De Montreal Method and device for assessing, training and improving perceptual-cognitive abilities of individuals
US8402502B2 (en) * 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
WO2013111145A1 (en) * 2011-12-14 2013-08-01 Virtual Logic Systems Private Ltd System and method of generating perspective corrected imagery for use in virtual combat training
WO2013111146A2 (en) * 2011-12-14 2013-08-01 Virtual Logic Systems Private Ltd System and method of providing virtual human on human combat training operations
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8918831B2 (en) * 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
US20150024357A1 (en) * 2012-02-22 2015-01-22 Jocelyn Faubert Perceptual-cognitive-motor learning system and method
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US9049426B2 (en) 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US9787974B2 (en) 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US10354359B2 (en) 2013-08-21 2019-07-16 Interdigital Ce Patent Holdings Video display with pan function controlled by viewing direction
JP2020528162A (en) * 2017-07-19 2020-09-17 ユークリデオン ホログラフィクス プロプリエタリー リミテッドEuclideon Holographics Pty Ltd Improvements for multiple observers in a virtual environment
US11451764B2 (en) * 2020-05-06 2022-09-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and device for the simultaneous projection of individual images for a plurality of viewers

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3956179B2 (en) * 1999-09-17 2007-08-08 富士フイルム株式会社 Video image production method and apparatus
WO2002059691A2 (en) * 2000-12-18 2002-08-01 Alan Sullivan 3d display devices with transient light scattering shutters
US7225115B2 (en) * 2001-10-04 2007-05-29 Novint Technologies, Inc. Coordinating haptics with visual images in a human-computer interface
US7468778B2 (en) * 2002-03-15 2008-12-23 British Broadcasting Corp Virtual studio system
US7180529B2 (en) * 2002-12-19 2007-02-20 Eastman Kodak Company Immersive image viewing system and method
KR100667823B1 (en) * 2005-10-13 2007-01-11 삼성전자주식회사 Multi-channel imaging system
US8189038B2 (en) 2005-12-21 2012-05-29 International Business Machines Corporation Stereographic projection apparatus with passive eyewear utilizing a continuously variable polarizing element
US8172399B2 (en) 2005-12-21 2012-05-08 International Business Machines Corporation Lumen optimized stereo projector using a plurality of polarizing filters
US8167431B2 (en) * 2005-12-21 2012-05-01 International Business Machines Corporation Universal stereographic trigger peripheral for electronic equipment
US8182099B2 (en) * 2005-12-21 2012-05-22 International Business Machines Corporation Noise immune optical encoder for high ambient light projection imaging systems
US8157381B2 (en) * 2005-12-21 2012-04-17 International Business Machines Corporation Method to synchronize stereographic hardware to sequential color rendering apparatus
US8152303B2 (en) 2005-12-21 2012-04-10 International Business Machines Corporation Signal synthesizer for periodic acceleration and deceleration of rotating optical devices
EP1884819A1 (en) * 2006-08-02 2008-02-06 Swiss Medical Technology GmbH Eyewear with segmented look-through elements
US8162482B2 (en) * 2006-08-30 2012-04-24 International Business Machines Corporation Dynamic projector refresh rate adjustment via PWM control
US8264525B2 (en) * 2006-08-30 2012-09-11 International Business Machines Corporation Closed loop feedback control to maximize stereo separation in 3D imaging systems
US8152304B2 (en) * 2006-08-30 2012-04-10 International Business Machines Corporation Stereographic imaging system using open loop magnetomechanically resonant polarizing filter actuator
US7884823B2 (en) * 2007-06-12 2011-02-08 Microsoft Corporation Three dimensional rendering of display information using viewer eye coordinates
US8934000B2 (en) * 2008-01-29 2015-01-13 Eastman Kodak Company Switchable 2-D/3-D display system
US8937766B2 (en) * 2008-03-13 2015-01-20 Eastman Kodak Company Stereoscopic display using multi-linear electromechanical modulator
US7430018B1 (en) * 2008-03-24 2008-09-30 International Business Machines Corporation Timesharing of a display screen
US8134591B2 (en) * 2008-05-07 2012-03-13 Eastman Kodak Company Display using bidirectionally scanned linear modulator
JP4623222B2 (en) * 2008-06-09 2011-02-02 ソニー株式会社 Video signal processing apparatus, video signal processing method, video signal processing system, program, and recording medium
US8233035B2 (en) 2009-01-09 2012-07-31 Eastman Kodak Company Dual-view stereoscopic display using linear modulator arrays
JP5465523B2 (en) * 2009-01-29 2014-04-09 三洋電機株式会社 Stereoscopic image display system
US8194101B1 (en) 2009-04-01 2012-06-05 Microsoft Corporation Dynamic perspective video window
CN102484730A (en) * 2009-06-04 2012-05-30 寇平公司 3d video processor integrated with head mounted display
US20110025821A1 (en) * 2009-07-30 2011-02-03 Dell Products L.P. Multicast stereoscopic video synchronization
US9438896B2 (en) * 2009-11-13 2016-09-06 Kopin Corporation Method for driving 3D binocular eyewear from standard video stream
KR101598396B1 (en) * 2009-11-27 2016-03-15 삼성디스플레이 주식회사 Method for displaying stereo-scopic image and display apparatus for performing the same
US8421851B2 (en) * 2010-01-04 2013-04-16 Sony Corporation Vision correction for high frame rate TVs with shutter glasses
WO2011084895A1 (en) 2010-01-08 2011-07-14 Kopin Corporation Video eyewear for smart phone games
JP2011205241A (en) * 2010-03-24 2011-10-13 Sony Corp Shutter glasses and method of obtaining shutter control signal of shutter glasses
JP2011215227A (en) * 2010-03-31 2011-10-27 Sony Corp Video display device, video display system, video presenting method and computer program
US8890941B2 (en) * 2010-04-29 2014-11-18 Virginia Venture Industries, Llc Methods and apparatuses for viewing three dimensional images
TW201201566A (en) * 2010-06-24 2012-01-01 Mstar Semiconductor Inc Playback system, associated apparatus and method
CN102340680B (en) * 2010-07-16 2014-12-03 晨星软件研发(深圳)有限公司 Image playing system, correlated apparatus thereof and methods thereof
DE102010037256A1 (en) * 2010-08-31 2012-03-01 Armin Zink Method for displaying a plurality of image sequences
US20120062551A1 (en) * 2010-09-13 2012-03-15 Lg Electronics Inc. Image display apparatus and method for operating image display apparatus
US20120092469A1 (en) * 2010-10-15 2012-04-19 Albert Kovalick Switchable 3d stereoscopic and 2d multiprogram viewing system and method
US8698880B2 (en) 2010-12-01 2014-04-15 Industrial Technology Research Institute System and method for time multiplexed stereo display and display apparatus
JPWO2012131862A1 (en) * 2011-03-28 2014-07-24 株式会社東芝 Image processing apparatus, stereoscopic image display apparatus, method, and program
KR20120109158A (en) * 2011-03-28 2012-10-08 삼성디스플레이 주식회사 Display system
US8643703B1 (en) * 2011-03-30 2014-02-04 Amazon Technologies, Inc. Viewer tracking image display
US8566694B2 (en) * 2011-04-04 2013-10-22 Xerox Corporation Multi-dimensional documents for parallel content display on a single screen for multiple viewers
KR101905090B1 (en) 2011-08-11 2018-10-08 삼성디스플레이 주식회사 Multi view display device
CN102682730A (en) * 2012-05-14 2012-09-19 深圳市华星光电技术有限公司 Liquid crystal display system and image display method thereof
US9030723B2 (en) 2013-01-18 2015-05-12 Pixtronix, Inc. Asymmetric travel for MEMS light modulator
CN107003532A (en) 2014-07-22 2017-08-01 巴科公司 Using the display system and method for the wavelength multiplexing of color
EP3172620A4 (en) 2014-07-22 2018-03-28 Barco Inc. Display systems and methods employing time mutiplexing of projection screens and projectors
WO2016014560A2 (en) 2014-07-22 2016-01-28 Barco,Inc. Display systems and methods employing polarizing reflective screens
WO2016069631A1 (en) 2014-10-27 2016-05-06 Barco, Inc. Display systems and methods employing screens with an array of micro-lenses or micro-mirrors
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5239373A (en) * 1990-12-26 1993-08-24 Xerox Corporation Video computational shared drawing space
US5245319A (en) * 1991-03-14 1993-09-14 Cray Research, Inc. Synchronized stereoscopic display system
US5311220A (en) * 1992-06-10 1994-05-10 Dimension Technologies, Inc. Autostereoscopic display
US5495576A (en) * 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5502481A (en) * 1992-11-16 1996-03-26 Reveo, Inc. Desktop-based projection display system for stereoscopic viewing of displayed imagery over a wide field of view
US5574836A (en) * 1996-01-22 1996-11-12 Broemmelsiek; Raymond M. Interactive display apparatus and method with viewer position compensation
US5606363A (en) * 1994-03-28 1997-02-25 Magma, Inc. Two-dimensional three-dimensional imaging and broadcast system
US5608363A (en) * 1994-04-01 1997-03-04 Com Dev Ltd. Folded single mode dielectric resonator filter with cross couplings between non-sequential adjacent resonators and cross diagonal couplings between non-sequential contiguous resonators
US5781229A (en) * 1997-02-18 1998-07-14 Mcdonnell Douglas Corporation Multi-viewer three dimensional (3-D) virtual display system and operating method therefor
US5822117A (en) * 1996-01-22 1998-10-13 Kleinberger; Paul Systems for three-dimensional viewing including first and second light polarizing layers
US5821989A (en) * 1990-06-11 1998-10-13 Vrex, Inc. Stereoscopic 3-D viewing system and glasses having electrooptical shutters controlled by control signals produced using horizontal pulse detection within the vertical synchronization pulse period of computer generated video signals
US5894364A (en) * 1996-07-15 1999-04-13 Fujitsu Limited Stereoscopic image display apparatus
US6002518A (en) * 1990-06-11 1999-12-14 Reveo, Inc. Phase-retardation based system for stereoscopic viewing micropolarized spatially-multiplexed images substantially free of visual-channel cross-talk and asymmetric image distortion
US6163336A (en) * 1994-12-13 2000-12-19 Richards; Angus Duncan Tracking system for stereoscopic display systems
US6188442B1 (en) * 1997-08-01 2001-02-13 International Business Machines Corporation Multiviewer display system for television monitors
US6211927B1 (en) * 1995-12-14 2001-04-03 Semiconductor Energy Laboratory Co., Ltd. Display system for viewing images on the front and back surfaces of a screen

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0410551D0 (en) * 2004-05-12 2004-06-16 Ller Christian M 3d autostereoscopic display
JP2009135686A (en) * 2007-11-29 2009-06-18 Mitsubishi Electric Corp Stereoscopic video recording method, stereoscopic video recording medium, stereoscopic video reproducing method, stereoscopic video recording apparatus, and stereoscopic video reproducing apparatus

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5821989A (en) * 1990-06-11 1998-10-13 Vrex, Inc. Stereoscopic 3-D viewing system and glasses having electrooptical shutters controlled by control signals produced using horizontal pulse detection within the vertical synchronization pulse period of computer generated video signals
US6002518A (en) * 1990-06-11 1999-12-14 Reveo, Inc. Phase-retardation based system for stereoscopic viewing micropolarized spatially-multiplexed images substantially free of visual-channel cross-talk and asymmetric image distortion
US5239373A (en) * 1990-12-26 1993-08-24 Xerox Corporation Video computational shared drawing space
US5245319A (en) * 1991-03-14 1993-09-14 Cray Research, Inc. Synchronized stereoscopic display system
US5311220A (en) * 1992-06-10 1994-05-10 Dimension Technologies, Inc. Autostereoscopic display
US5502481A (en) * 1992-11-16 1996-03-26 Reveo, Inc. Desktop-based projection display system for stereoscopic viewing of displayed imagery over a wide field of view
US5495576A (en) * 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5606363A (en) * 1994-03-28 1997-02-25 Magma, Inc. Two-dimensional three-dimensional imaging and broadcast system
US5608363A (en) * 1994-04-01 1997-03-04 Com Dev Ltd. Folded single mode dielectric resonator filter with cross couplings between non-sequential adjacent resonators and cross diagonal couplings between non-sequential contiguous resonators
US6163336A (en) * 1994-12-13 2000-12-19 Richards; Angus Duncan Tracking system for stereoscopic display systems
US6211927B1 (en) * 1995-12-14 2001-04-03 Semiconductor Energy Laboratory Co., Ltd. Display system for viewing images on the front and back surfaces of a screen
US5822117A (en) * 1996-01-22 1998-10-13 Kleinberger; Paul Systems for three-dimensional viewing including first and second light polarizing layers
US5574836A (en) * 1996-01-22 1996-11-12 Broemmelsiek; Raymond M. Interactive display apparatus and method with viewer position compensation
US5894364A (en) * 1996-07-15 1999-04-13 Fujitsu Limited Stereoscopic image display apparatus
US5781229A (en) * 1997-02-18 1998-07-14 Mcdonnell Douglas Corporation Multi-viewer three dimensional (3-D) virtual display system and operating method therefor
US6188442B1 (en) * 1997-08-01 2001-02-13 International Business Machines Corporation Multiviewer display system for television monitors

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100066816A1 (en) * 2008-09-18 2010-03-18 Kane Paul J Stereoscopic display system with flexible rendering for multiple simultaneous observers
US8217996B2 (en) * 2008-09-18 2012-07-10 Eastman Kodak Company Stereoscopic display system with flexible rendering for multiple simultaneous observers
EP2349002A4 (en) * 2008-09-30 2014-07-09 Univ Montreal Method and device for assessing, training and improving perceptual-cognitive abilities of individuals
EP2349002A1 (en) * 2008-09-30 2011-08-03 Universite De Montreal Method and device for assessing, training and improving perceptual-cognitive abilities of individuals
US9566029B2 (en) 2008-09-30 2017-02-14 Cognisens Inc. Method and device for assessing, training and improving perceptual-cognitive abilities of individuals
GB2472438A (en) * 2009-08-06 2011-02-09 Sony Corp Multi-person 3D display system with several viewers watching different images on a single screen
US9380294B2 (en) 2010-06-04 2016-06-28 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
US10567742B2 (en) 2010-06-04 2020-02-18 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content
US9030536B2 (en) 2010-06-04 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for presenting media content
US9774845B2 (en) 2010-06-04 2017-09-26 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content
US8402502B2 (en) * 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
US9479764B2 (en) 2010-06-16 2016-10-25 At&T Intellectual Property I, Lp Method and apparatus for presenting media content
US8640182B2 (en) 2010-06-30 2014-01-28 At&T Intellectual Property I, L.P. Method for detecting a viewing apparatus
US8593574B2 (en) 2010-06-30 2013-11-26 At&T Intellectual Property I, L.P. Apparatus and method for providing dimensional media content based on detected display capability
US9787974B2 (en) 2010-06-30 2017-10-10 At&T Intellectual Property I, L.P. Method and apparatus for delivering media content
US9781469B2 (en) 2010-07-06 2017-10-03 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
US8918831B2 (en) * 2010-07-06 2014-12-23 At&T Intellectual Property I, Lp Method and apparatus for managing a presentation of media content
US9049426B2 (en) 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
US11290701B2 (en) 2010-07-07 2022-03-29 At&T Intellectual Property I, L.P. Apparatus and method for distributing three dimensional media content
US10237533B2 (en) 2010-07-07 2019-03-19 At&T Intellectual Property I, L.P. Apparatus and method for distributing three dimensional media content
US9032470B2 (en) 2010-07-20 2015-05-12 At&T Intellectual Property I, Lp Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US10489883B2 (en) 2010-07-20 2019-11-26 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US9560406B2 (en) 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9830680B2 (en) 2010-07-20 2017-11-28 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content according to a position of a viewing apparatus
US10070196B2 (en) 2010-07-20 2018-09-04 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9232274B2 (en) 2010-07-20 2016-01-05 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US9668004B2 (en) 2010-07-20 2017-05-30 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US10602233B2 (en) 2010-07-20 2020-03-24 At&T Intellectual Property I, L.P. Apparatus for adapting a presentation of media content to a requesting device
US8994716B2 (en) 2010-08-02 2015-03-31 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9247228B2 (en) 2010-08-02 2016-01-26 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9352231B2 (en) 2010-08-25 2016-05-31 At&T Intellectual Property I, Lp Apparatus for controlling three-dimensional images
US9700794B2 (en) 2010-08-25 2017-07-11 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
US8438502B2 (en) 2010-08-25 2013-05-07 At&T Intellectual Property I, L.P. Apparatus for controlling three-dimensional images
US9086778B2 (en) 2010-08-25 2015-07-21 At&T Intellectual Property I, Lp Apparatus for controlling three-dimensional images
US8947511B2 (en) 2010-10-01 2015-02-03 At&T Intellectual Property I, L.P. Apparatus and method for presenting three-dimensional media content
US9407872B2 (en) 2011-06-24 2016-08-02 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US10200669B2 (en) 2011-06-24 2019-02-05 At&T Intellectual Property I, L.P. Apparatus and method for providing media content
US9445046B2 (en) 2011-06-24 2016-09-13 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9681098B2 (en) 2011-06-24 2017-06-13 At&T Intellectual Property I, L.P. Apparatus and method for managing telepresence sessions
US10484646B2 (en) 2011-06-24 2019-11-19 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US9736457B2 (en) 2011-06-24 2017-08-15 At&T Intellectual Property I, L.P. Apparatus and method for providing media content
US9270973B2 (en) 2011-06-24 2016-02-23 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US9602766B2 (en) 2011-06-24 2017-03-21 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US9160968B2 (en) 2011-06-24 2015-10-13 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US10200651B2 (en) 2011-06-24 2019-02-05 At&T Intellectual Property I, L.P. Apparatus and method for presenting media content with telepresence
US9030522B2 (en) 2011-06-24 2015-05-12 At&T Intellectual Property I, Lp Apparatus and method for providing media content
US10033964B2 (en) 2011-06-24 2018-07-24 At&T Intellectual Property I, L.P. Apparatus and method for presenting three dimensional objects with telepresence
US8947497B2 (en) 2011-06-24 2015-02-03 At&T Intellectual Property I, Lp Apparatus and method for managing telepresence sessions
US9167205B2 (en) 2011-07-15 2015-10-20 At&T Intellectual Property I, Lp Apparatus and method for providing media services with telepresence
US9807344B2 (en) 2011-07-15 2017-10-31 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
US9414017B2 (en) 2011-07-15 2016-08-09 At&T Intellectual Property I, Lp Apparatus and method for providing media services with telepresence
US8587635B2 (en) 2011-07-15 2013-11-19 At&T Intellectual Property I, L.P. Apparatus and method for providing media services with telepresence
WO2013111146A3 (en) * 2011-12-14 2013-09-19 Virtual Logic Systems Private Ltd System and method of providing virtual human on human combat training operations
WO2013111146A2 (en) * 2011-12-14 2013-08-01 Virtual Logic Systems Private Ltd System and method of providing virtual human on human combat training operations
WO2013111145A1 (en) * 2011-12-14 2013-08-01 Virtual Logic Systems Private Ltd System and method of generating perspective corrected imagery for use in virtual combat training
US20150024357A1 (en) * 2012-02-22 2015-01-22 Jocelyn Faubert Perceptual-cognitive-motor learning system and method
US10706730B2 (en) * 2012-02-22 2020-07-07 Cognisens Inc. Perceptual-cognitive-motor learning system and method
US10354359B2 (en) 2013-08-21 2019-07-16 Interdigital Ce Patent Holdings Video display with pan function controlled by viewing direction
JP2020528162A (en) * 2017-07-19 2020-09-17 ユークリデオン ホログラフィクス プロプリエタリー リミテッドEuclideon Holographics Pty Ltd Improvements for multiple observers in a virtual environment
US11451764B2 (en) * 2020-05-06 2022-09-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and device for the simultaneous projection of individual images for a plurality of viewers

Also Published As

Publication number Publication date
US20090185030A1 (en) 2009-07-23
US8223197B2 (en) 2012-07-17
US6924833B1 (en) 2005-08-02
US9100643B2 (en) 2015-08-04
US20140192175A1 (en) 2014-07-10
US6535241B1 (en) 2003-03-18
US20130021457A1 (en) 2013-01-24

Similar Documents

Publication Publication Date Title
US9100643B2 (en) Multi-person stereo display system
EP0970589B1 (en) Autostereoscopic projection system
US8040307B2 (en) 2D/3D liquid crystal display device and method for driving the same
JP2005164916A (en) Stereoscopic display device
US6239830B1 (en) Displayer and method for displaying
EP0598665B1 (en) Liquid crystal display system
JP2006033363A (en) Stereoscopic video image display device
JP3753763B2 (en) Apparatus and method for recognizing 3D image
WO1995014252A1 (en) 3-d video microscope
JP3472068B2 (en) 3D image display device
JP2004258594A (en) Three-dimensional image display device realizing appreciation from wide angle
JPH06169475A (en) Three-dimensional picture showing device
WO1998011737A1 (en) Method and apparatus for presenting a visual display to an audience
JP3464789B2 (en) 3D image display device
Lipton The evolution of electronic stereoscopy
CN115776559A (en) System for full-color LED display screen realizes 3D demonstration
JPH01252093A (en) Stereoscopic television receiver
JPH11275605A (en) Method for stereoscopically viewing head-mounted display and head-mounted display device
JPH0588650A (en) Multi-screen display system
CA2206292A1 (en) A stereoscopic 3d real-time video window display method using hardware-based techniques and standard personal computer (or similar platform)
JPH04180493A (en) Stereoscopic television receiver
KR20020050897A (en) Stereoscopic Image Display Device
JPH1124872A (en) Display device available simultaneously to plural operators
JPH07159724A (en) Stereoscopic picture display device
JPH05207520A (en) Stereoscopic video device

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION