WO1992021117A1 - Modular display simulator - Google Patents

Modular display simulator Download PDF

Info

Publication number
WO1992021117A1
WO1992021117A1 PCT/US1992/004313 US9204313W WO9221117A1 WO 1992021117 A1 WO1992021117 A1 WO 1992021117A1 US 9204313 W US9204313 W US 9204313W WO 9221117 A1 WO9221117 A1 WO 9221117A1
Authority
WO
WIPO (PCT)
Prior art keywords
monitor
controller
space
housing
simulated
Prior art date
Application number
PCT/US1992/004313
Other languages
French (fr)
Inventor
Rick L. Moncrief
Original Assignee
Atari Games Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Atari Games Corporation filed Critical Atari Games Corporation
Priority to JP5500310A priority Critical patent/JPH06508222A/en
Publication of WO1992021117A1 publication Critical patent/WO1992021117A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • G09B9/30Simulation of view from aircraft
    • G09B9/301Simulation of view from aircraft by computer-processed or -generated image
    • G09B9/302Simulation of view from aircraft by computer-processed or -generated image the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/26Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/803Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/04Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
    • G09B9/05Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles the view from a vehicle being simulated
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • G09B9/30Simulation of view from aircraft
    • G09B9/34Simulation of view from aircraft by cathode-ray screen display
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/301Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device using an additional display connected to the game console, e.g. on the controller
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8017Driving on land or water; Flying

Definitions

  • the present invention relates generally to video-based simulators. More particularly, the present invention relates to simulators which use a plurality of video monitors to present a panoramic view of simulated space through which a simulated vehicle moves.
  • the present invention is particularly, though not exclusively, useful for modelling the motion of an aircraft or automobile through space, for training or entertainment purposes.
  • a “simulator” may be a conventional simulator, which presents a visual model of a simulated space, or a simulator which presents an image of a so-called “virtual reality” or “artificial reality". Such a simulator can stimulate one or more of the five human senses to present a more complete model of a "true” reality.
  • a vehicle simulator has a computer which displays on a monitor a constantly changing video picture of a simulated three dimensional space. The "window" presented on the monitor is ordinarily the view of the simulated space as would be seen from the driver's seat of the simulated vehicle.
  • the video display is constantly updated by the computer to model the motion of the vehicle.
  • the vehicle simulator is to be used for training or entertainment, it is desirable to provide the operator of the simulated vehicle with a panoramic display of the simulated space through which the simulated vehicle is to travel. This is to provide a more effective simulation of the view that an operator of a vehicle to be modelled would see from the driver's seat of the actual modelled vehicle.
  • each of the three monitors is spatially congruent with the sector of simulated space displayed on the monitor. More specifically, the images presented on each monitor have the same perspective to the viewer as would the corresponding real-world objects that would occupy the same sector of space as that presented by the particular monitor.
  • the monitors of the Osofsky et al. flight simulator require relatively powerful video drivers to relay the video commands from the controller to each of the three monitors.
  • relatively powerful elect-rical drivers are required to drive the relatively larger electrical harnesses to conduct the video commands from the controller to each of the three monitors.
  • such electrical harnesses can, when energized, induce electromagnetic signals that can interfere with the operation of nearby electrical equipment. Besides being technically undesirable, such interference may not comport with governmental regulations regarding acceptable levels of electromagnetic interference. Accordingly, relatively lengthy electrical harnesses typically must be electrically shielded. Unfortunately, shielding of harnesses increases driver power requirements, which in combination with the shielded longer harnesses increases the expense of the apparatus, as compared to apparatus that use short harnesses with energy contents that do not require shielding. Further, depending on a variety of factors, such shielding may not be completely effective in preventing electromagnetic interference.
  • the present invention recognizes that it is possible to provide a multi-monitor simulator in which one or more of the monitors can relatively easily be relocated on the simulator, and still maintain congruence between the monitor and the sector of simulated space displayed on the monitor. Accordingly, it is an object of the present invention to provide a multi-monitor vehicle simulator in which one or more of the monitors can relatively easily be relocated on the simulator, while maintaining congruence between the relocated monitor and the sector of simulated space displayed on the monitor.
  • a further object of the present invention is to provide a multi-monitor vehicle simulator which does not require the use of relatively lengthy electrical harnesses and concomitant peripheral equipment which would otherwise be required to reduce electromagnetic interference from the harness.
  • Yet another object of the present invention is to provide a multi-monitor vehicle simulator which is relatively easy and effective to use, and comparatively cost-effective to manufacture.
  • the present invention is accordingly a compact multichannel simulator which, because of its compact nature, can be used in many existing training and entertainment facilities.
  • a modular display vehicle simulator for modelling the motion of a simulated vehicle through a simulated space has a base and a plurality of housings, preferably three or more, mounted on the base.
  • the housings are mounted on the base in close proximity to each other.
  • each housing is juxtaposed with at least one other housing.
  • a video monitor and an associated video controller, t.& which the monitor is electrically connected, are mounted in each housing.
  • simulated control devices such as a steering wheel and throttle controls, are mounted on the base for generating control signals which are processed in accordance with the present invention.
  • the control signals are representative of the motion of the simulated vehicle through the simulated space that is desired by the operator of the simulator.
  • One of the controllers is a master controller which calculates a reference position based upon the control signal from the control devices. Periodically, (e.g., about ten to thirty times per second) , the master controller updates the reference position.
  • the reference position is the simulated position of the vehicle in the simulated space.
  • the master controller is electrically connected to at least one slave controller. In the presently preferred embodiment, the master controller is electrically connected to two slave controllers for transmitting a signal representative of the reference position to the slave controllers.
  • each slave controller calculates a perspective of the sector of space (i.e., a "window") and the objects within the space that are to be presented on the associated monitor, and causes the associated monitor to display the calculated sector.
  • Each of the displayed sectors has a predetermined orientation, relative to the reference position.
  • the displayed sectors are spatially congruent with their associated monitors. More particularly, the monitors occupy the sectors of space that would be occupied in "real life" by the space and objects which are presented, in simulated form, on the respective monitor.
  • each sector is oriented, relative to the reference position, such that the axis of each window, from foreground to background, is coincident with the axis of the monitor which presents the window, from the front of the monitor which is observed by the operator to the back of the monitor.
  • the particular orientation of each window can be changed as necessary to maintain congruence between the window and associated monitor by appropriately manipulating a switch which is electrically connected to the controller of the particular monitor.
  • the present invention is accordingly a compact multichannel simulator which, because of its compact nature, can be used in many existing training and entertainment facilities. Further, the volume behind the CRT face plates in each monitor can be used to hold display channel electronics and thus save space and avoid the need for additional housing racks for the electronics.
  • Figure 1 is a perspective view of one presently preferred embodiment of the modular display simulator of the present invention
  • Figure 2 is a block diagram of a presently preferred embodiment of the electrical components of the modular display simulator of the present invention
  • Figure 3 is a schematic view of the modular display simulator of the present invention, as seen from a top-down perspective, showing the simulated vehicle within the simulated space;
  • Figure 4 is a flow diagram illustrating the operational steps of the modular display simulator of the present invention. Description of a Preferred Embodiment
  • a modular display simulator is shown, generally designated 10.
  • the simulator 10 has a base 12 and three housings 14, 16, and 18 which are mounted on the base 12.
  • Figure 1 shows that the housing 14 is juxtaposed with the housings 16 and 18.
  • Each housing 14, 16, 18 has a respective video monitor-*eo, 22, 24 mounted therein.
  • the monitors 20, 22, and 24 are suitable for displaying, in color, computer-generated videographics.
  • Figure 1 shows that the simulator 10 has three monitors 20, 22, 24, it is to be understood that the simulator 10 can include two monitors, or any number of monitors greater than three, within space constraints.
  • the simulator 10 as disclosed herein is an automobile simulator, it is to be understood that the simulator of the present invention can be used as a flight simulator or for simulating motion of any other vehicle.
  • a seat 32 is shown in Figure 1, and the seat 32 is rotationally attached to a support beam 34.
  • the support beam 34 is in turn pivotally attached to the base 12. It will be appreciated by the skilled artisan that an operator (not shown in Figure 1) can sit in the seat 32 and position the seat 32 so that the operator faces the monitors 20, 22, 24, with the monitors 20, 22, 24 approximately at eye level to the operator.
  • the monitors 20, 22, and 24 together display a panoramic view of a simulated space, and the simulated space displayed on the monitors moves as the operator of the simulator 10 sits in the seat 32 and "drives" a simulated automobile through the simulated space.
  • the monitor 20 displays an image of a sector 38 of the simulated space.
  • the orientation of the sector 38, along with the positions and orientations of the objects within the sector 38 change with simulated motion of the simulated vehicle.
  • the monitor 20 presents a display of the sector 38 of the simulated space as would be seen through a window of the vehicle being simulated.
  • the monitor 20 presents a "window” which shows the sector 38 in perspective as seen from the position of the operator in the simulated space.
  • the monitors 22, 24 present "window" displays of respective sectors 40, 42 of the simulated space.
  • Figure 1 also shows a means attached to the b"ase 12 for generating signals for controlling the simulated motion of the simulated vehicle. More particularly, a steering wheel 60 is rotationally mounted on the base 12, and an accelerator pedal 62 is pivotably attached to the base 12. Also, a gear shift lever 64 is pivotably connected to the base 12. Other control means, e.g., a brake pedal and clutch pedal (not shown) can also be provided on the simulator 10, if desired. It will be appreciated that the operator of the simulator 10 can manipulate the steering wheel 60, accelerator pedal 62, and gear shift lever 64 as appropriate to generate a control signal for controlling the simulated motion of the simulated vehicle.
  • each of the monitors 20, 22, 24 are preferably spatially congruent with their respective displays. More particularly, each of the monitors 20, 22, and 24 preferably displays its respective sector 38, 40, 42 such that each sector 38, 40, 42 has a predetermined orientation relative to a reference position 44 within the simulated space, generally designated 45, shown in Figure 2.
  • the reference position 44 is the simulated position of the operator 46 of the simulator 10 within the simulated space 45.
  • the simulated space 45 has an elevation extending from directly above the position 44 of operator 46 to the simulated horizon as would be seen from the position 44.
  • the simulated space 45 has -an azimuth of three hundred sixty degrees (360) relative to the position 44.
  • the monitor 20 presents a view of the simulated space 45 that would be seen through the front windshield of the vehicle 48, as viewed by the user 46.
  • the sector 38 is that sector of the simulated space which is oriented directly in front of the position 44 of the operator 46, i.e., along the axis 50 of the simulated vehicle 48.
  • the monitors 22, 24 are offset, by respective predetermined angles 52, 54, from the monitor 20.
  • the respective orientations of the displayed sectors 40, 42 are offset from the axis 50 of the simulated vehicle 48 by the angles 52, 54.
  • each sector 38, 40, 42 from the foreground of the particular sector to the background is preferably coincident with the axis of the respective monitor 20, 22, 24, from the front of the particular monitor which is viewed by the operator to the back of the monitor.
  • the angle 52 is approximately equal to fifty three (53) degrees
  • the angle 54 is about equal to minus fifty three (-53) degrees. It is to be understood, however, that the angles 52, 54 can have other values. It is to be further understood that while Figure 2 shows that the angles 52, 54 represent an offset between the monitors 20, 22, and 24 which is in two dimensions, any two or three of the monitors 20, 22, and 24 can be positioned on the base 12 such that the offset between monitors has a component in a third dimension. For example, the monitor 22 can be moved to the position on the base 12 indicated by the monitor 22', as shown in Figure 1.
  • the controller 28 of the monitor 22 can be reset in accordance with disclosure be pw so that the sector 40' displayed by the monitor in position 22" is spatially congruent with the monitor in position 22' .
  • the sector 40' displays the top 56 of the simulated transmission pole 58.
  • each housing 14, 16, 18 holds a respective video controller 26, 28, 30, and each video controller is electrically connected to its respective monitor.
  • the video controller 26 is a master controller, and is electrically connected to the monitor 20.
  • the controllers 28, 30 are slave controllers, and are electrically connected to their respective monitors 22, 24 and to the master controller 26.
  • each controller 26, 28, and 30 includes a respective game processor 66, 68, and 70.
  • Each game processor 66, 68, and 70 is any suitable microprocessor which can rapidly calculate the sector to be displayed, and which also maintains in electronic memory a map of the space
  • each game processor is a type 68010 microprocessor manufactured by Motorola
  • the game processors 68, 70 of the respective slave controllers 28, 30 receive inputs generated by respective hardware or software switches 75, 77 for establishing a predetermined orientation offset for the sectors 40, 42 relative to the sector 38.
  • the game processor 66 of the master controller 26 is electrically connected to the steering wheel 60, the accelerator pedal 62, and the gear shift lever 64. Accordingly, electrical control signals which are generated by the steering wheel 60, accelerator pedal 62, and gear shift lever 64 are sent to the game processor 66.
  • FIG. 3 also shows that each controller 26, 28, and 30 includes a respective image calculation engine, referred to herein as an ADSP 72, 74, 76 which is electrically connected to its associated game processor.
  • Each ADSP includes an ADSP
  • Each of the ADSPs 72, 74, 76 maintains in its electronic memory a listing of the objects within the simulated space 45
  • This listing contains a data base of objects within the space 45, such as trees and buildings, and movable objects within the space 45, e.g., birds, aircraft, and other ground vehicles.
  • the particular data organization within the blackboard can be any well-known means for organizing data which permits efficient data retrieval and storage.
  • the orientation offsets established by the switches 75, 77 can have components in two or three dimensions, as desired. Stated differently, the switches 75, 77 can establish orientation offsets for the sectors 40, 42 vis-a-vis the sector 38 in the azimuthal and elevational dimensions.
  • each switch 75, 77 is a software switch that has a value stored in nonvolitional zero-power RAM.
  • the values for the switches 75, 77 can be set by the operator of the simulator 10 to any one of several predetermined azimuth and pitch offsets. The values of these offsets are established based upon the particular application of the simulator 10. It is to be understood that the offsets established by the switches 75, 77 can have any azimuthal value from 0 to + 180 degrees and any elevational value from 0 to + 180 degrees. It is to be further understood that the switches 75, 77 can be hardware switches, e.g., the switches 75, 77 can be rotary potentiometers.
  • each controller 26, 28, 30 has a respective graphics signal processor (GSP) 78, 80, 82 which is electrically connected to its associated game processor.
  • GSP graphics signal processor
  • Each GSP 78, 80, 82 is any suitable electronic device which fills image buffers to be displayed on its respective monitor 20, 22, 24 in response to graphics signals from the associated game processor 66, 68, 70.
  • each GSP is a Texas Instrument component 34010. As shown in Figure 3, each GSP is electrically connected to a respective video frame buffer 84, 86, 88, and the frame buffers 84, 86, and 88 are respectively electrically connected to the monitors 20, 22, 24.
  • each controller 26, 28, and 30 includes a respective dual universal asynchronous receiver transmitter (DUART) 90, 92, and 94.
  • Each DUART 90, 92, 94 is a device, such as a type MC68681 manufactured by Motorola Corporation, which is suitable for converting parallel data from its respective game processor 66, 68, 70 into serial data for transmission to another DUART, and for converting serial data received from another DUART into parallel data for processing by the associated game processor 66, 68, 70.
  • the DUART 90 of the master controller 26 is electrically connected to the DUARTs 92, 94 of the slave controllers 28, 30, for transmitting data from the master controller 26 to the slave controllers 28, 30.
  • the DUARTs 90, 92, 94 could be replaced with suitable parallel cables.
  • blocks which are labelled with a numeral followed by the letter "a” represent steps that are performed by the master controller 26.
  • the operator 46 (shown in Figure 2) of the simulator 10 can manipulate the steering wheel 60, accelerator pedal 62, and gear shift lever 64.
  • the positions of these physical devices at any point in time are reflected by sensors (not shown) such as photodetectors affixed within the vehicle simulator 10 to detect the positions of the steering wheel 60, accelerator pedal 62, and shift lever 64.
  • sensors such as photodetectors affixed within the vehicle simulator 10 to detect the positions of the steering wheel 60, accelerator pedal 62, and shift lever 64.
  • the system Upon the initiation of an operational cycle, as indicated at block 96, the system receives position indicating signals from the various sensors and, in response thereto, generates corresponding control signals for controlling the desired simulated motion of the simulated vehicle 48 through the simulated space 45.
  • a signal processor such as the game processor 66
  • the control signals representing positions of the wheel 60, pedal 62, and lever 64 are sent via respective electrical lines 98, 102, and 104 to the game processor 66 of the master controller 26, as shown in Figure 3.
  • the system next moves to block 106 of Figure 4, wherein the game processor 66, in conjunction with a math coprocessor, if necessary, calculates the reference position and orientation of the simulated vehicle 48 in the simulated space 45, shown in Figure 2, based upon the previous position of the vehicle 48 in the space 45 and the control signals from the wheel 60, pedal 62, and lever 64.
  • Any suitable method may be used to calculate the orientation and position of the vehicle 48 based upon the previous position, velocity, and acceleration of the vehicle 48 and the signals from the wheel 60, pedal 62, lever 64, and other controls (e.g., a clutch pedal and a brake pedal) .
  • the orientation and position of the vehicle 48 can be calculated by any method suitable for the particular application of the simulator 10.
  • a simple point and thrust orientation and position control algorithm can be used for applications of the simulator 10 wherein it is desirable for the simulated vehicle to "fly" around a predetermined point in the simulated space.
  • the orientation and position of the vehicle 48 can be calculated using any one of the algorithms used to control aircraft positions and orientations in popular video home games.
  • the orientation and position of the vehicle 48 can be calculated using any one of the algorithms used to control aircraft positions and orientations in high fidelity aircraft simulators which are used for training commercial or military aviators or astronauts.
  • a free body model can be used. More specifically, the game processor 66, in conjunction with a math coprocessor that can contain a data base of the drivable road surfaces, continuously calculates a new orientation and position of the vehicle 48 based upon the previous position, velocity, and acceleration of the vehicle 48 and the signals from the controls of the simulator 10.
  • a free body algorithm similar to the equations of flight in a high fidelity flight simulator is preferably used.
  • a reference position signal which represents both the reference position and orientation of the simulated vehicle 48 as calculated by the game processor 66, is then sent to the DUART 90, where the reference position signal is converted to serial format.
  • the signal is sent to the DUARTs 92, 94 of the slave controllers 28, 30.
  • the DUARTs 92, 94 convert the signal back to parallel data and send the signal to their respective game processors 68, 70.
  • the slave controllers 28, 30 establish the orientation of the sectors
  • the game processor 68 determines the angle 52
  • the game processor 68 records the reference position 44, sent from the game processor 66, the orientation of the axis 50, also sent from the game processor 66, and the rotation around the axis 50.
  • the game processor 68 establishes the axis 51 and rotation around the axis 51 of the sector 40 to originate from the reference position 44 and to be offset from the axis 50 of the sector 38 by an angle 52, which corresponds to the setting on the switch 75.
  • the switch 75 is set to establish an angle 52 which will result in spatial-congruence between the monitor 22 and the sector 40.
  • the game processor 68 has, in its electronic memory, data which represents the predetermined angular width 43 of the sector 40.
  • the game processor 68 essentially determines the orientation of the axis 51 of the sector 40, as well as the area of the space 45 that encompasses the sector 40.
  • the game processor 70 determines the angle 54
  • the switch 77 can have settings which correspond to a plurality of potentially desired values for the angle 54.
  • the switch 77 is set to establish an angle 54 which will result in spatial congruence between the monitor 24 and the sector 42.
  • the game processor 70 has, in its electronic memory, data which represents the angular width 45 of the sector 42.
  • the game processor 70 essentially determines what area of the space 45 comprises the sector 42.
  • the system moves to blocks 110a, 110b, 110c.
  • the game processing by each controller 20, 22, 24 described below is done asynchronously with respect to the other controllers.
  • the master controller 20 periodically sends the reference signal to the slave controllers 22, 24, which process the signal independently from the other controllers. More specifically, in the event that one of the slave controllers 22, 24 completes one processing cycle as described below before the master controller 20 sends an updated reference signal to the particular slave controller 22, 24, the particular slave controller 22, 24 continues to display the image that was based upon the last received reference position signal.
  • the particular slave controller 22 or 24 then awaits the arrival of a new reference position signal to commence processing a new image based upon the new reference position signal.
  • the slave controller 22, 24 can commence another computational cycle based upon a linear extrapolation of the reference position. To accomplish this extrapolation, the particular slave controller 22, 24 assumes that the speed and direction of the simulated vehicle 48 have the same values as calculated between the two immediately previous reference position signals from the master controller 20.
  • the reference position signal is processed by each of the game processors 66, 68, 70.
  • the game processor 66 calculates the orientation and position of each of the objects that are stored in the data listing of the electronic memory of the game processor 66 and which are .within the sector 38. More specifically, the game processor 66 determines the distance between the position of the simulated vehicle 48 and each of the objects within the sector 38 by computational processes well-known in the art.
  • the game processor 66 calculates the relative size, as would appear from the position of the vehicle 48, of each object within the sector 38, again by computational processes well-known in the art.
  • the game processor 66 also calculates the perspective of each object within the sector 38 as would be seen from the position of the simulated vehicle 48. The relative size and orientation of each object within the sector 38 is then sent to ADSP 72. In other words, the game processor 66 calculates the content and perspective of the "window" which is to be displayed on the monitor 20.
  • the game processors 68, 70 of the slave controllers 28, 30 calculate the positions and orientations of the objects within the respective sectors 40, 42, based upon the reference position signal from the master controller 26. Specifically, the game processor 68 calculates the orientation and position of each of the objects that are stored in the electronic memory of the game processor 68 and which are within the sector 40. More specifically, the game processor 68 determines the distance between the position of the simulated vehicle 48 and the orientation of each of the objects within the sector 40.
  • the game processor 68 calculates the relative size and perspective, as would appear from the position of the vehicle 48, of each object within the sector 40, by computational processes well-known in the art. Accordingly, it is to be understood that the game processors 68, 70 calculate the size and perspective of each object within the respective sectors 40, 42 as would be seen from the position of the simulated vehicle 48 in substantially the same way as the game processor 66 calculation of the sector 38 described above.
  • each of the ADSPs 72, 74, 76 generates signals that are representative of the particular sector to be displayed.
  • Each signal generated by the ADSPs 72, 74, 76 at blocks 112a-c contains data defining the boundaries of polygons that are combined to form the visual images of objects in the sectors 38, 40, 42.
  • the signals from the ADSPs 72, 74, 76 are sent to the respective GSPs 78, 80, 82.
  • the system then moves to blocks 114a-c, wherein each of the GSPs 78, 80, 82 "fills" buffers with a plurality of polygons with color data received from the respective ADSPs 72, 74, 76. This color data is representative of the predetermined color of the various objects to be presented on the monitors 14, 16, 18.
  • each GSP 78, 80, 82 deletes, i.e., clears, "old" polygons stored in a first half of its respective video buffer 84, 86, 88 and fills this first half of its buffer 84, 86, 88 with the polygons generated by the GSP.
  • the polygons which were previously stored in the remaining (i.e., second) half of the buffers 84, 86, 88 are respectively displayed by the monitors 20, 22, 24.
  • the displayed polygons in -the second half of the buffers 84, 86, 88 will be deleted and replaced with "new" polygons from the GSPs 78, 80, and 82, and the polygons in the first half of the buffers 84, 86, 88 will be displayed on the respective monitors 20, 22, 24.
  • the process repeats for successive cycles of the operation of the simulator 10.
  • the simulator 10 updates the displays presented on the monitors 20, 22, 24 between ten times and thirty times per second. It is to be appreciated in reference to the above disclosure that the monitors 22, 24 can be relocated on the base 12 to display other perspectives of the simulated space 45, while still maintaining spatial congruence with the sector displayed on the particular monitor.
  • the monitor 22 can be moved to the location indicated by the monitor 22 x , and the switch 75 manipulated to establish the orientation offset of the sector 40 x which is appropriate for maintaining spatial congruence between the monitor 22 v and the sector 40 .
  • the housing of one of the slave monitors e.g., the housing 16 of the monitor 22
  • the housing 16 can be pivotably attached to the base 12 by any suitable means well-known in the art.
  • the housing 16 can be attached to a pivot arm, and the pivot arm pivotably connected to the base 12.
  • the monitor 22 is pivotably attached to the base 12, and can be moved relative to the base 12 by the operator of the simulator 10.
  • the pivot arm can be engaged with the switch 75 such that as the housing 16 is moved, the portion of the space 45 which is congruent with the monitor 22 is displayed on the monitor 22.
  • This embodiment is useful in, e.g., vehicle backing exercises that require a view of the simulated space 45 that is wider than the monitors 20, 22, 24. It is to be appreciated in reference to the disclosure above that the present invention overcomes the longstanding problem of how to easily relocate one or more monitors in a multi-monitor simulator, while still maintaining spatial congruence between the relocated monitor and its associated displayed sector. Further, by physically housing eac monitor with its associated video controller, the present invention provides a relatively compact system.
  • the present invention dispenses with the requirement for comparatively powerful video drivers, lengthy transmission cables, and the concomitant electromagnetic shielding requirements which attend lengthy cable runs. While the particular modular display simulator as herein shown and described in detail is fully capable of achieving the stated objectives, it is to be understood that the scope of the present invention is to be limited by nothing other than the limitations set forth in the appended claims.

Abstract

A vehicle simulator (10) has three video monitors (20, 22, 24), which display three respective windows, i.e., sectors (38, 40, 42), of a simulated space. Each of the monitors is held in a respective housing (14, 16, 18), and each housing is mounted on the simulator (10). Also, a respective video controller (26, 28, 30) is associated with each monitor, and each controller is mounted on the housing of the associated monitor. One of the controllers is a master controller (26) which calculates a reference position representative of the position of the simulated vehicle in a simulated space, based upon user-generated control signals. A signal representing the reference position is transmitted from the master controller (26) to the two slave controllers (28, 30). Based upon the reference position, each of the controllers generates a video display of a predetermined sector (38, 40, 42) of the simulated space and causes its associated monitor (20, 22, 24) to present the predetermined sector. The sectors (40, 42) that are displayed on the monitors (20, 24) which are associated with the slave controllers (28, 30) are offset by a predetermined angular amount (52, 54) from the sector (38) displayed by the monitor (20) of the master controller (26), so that the sector displayed by each monitor is congruent with the physical position of its respective monitor. The predetermined sector (40, 42) calculated by each slave controller (28, 30) can be relatively easily changed by appropriately changing the value of the angular offset (52, 54) which is established for the controller.

Description

MODULAR DISPLAY SIMULATOR
Field of the Invention The present invention relates generally to video-based simulators. More particularly, the present invention relates to simulators which use a plurality of video monitors to present a panoramic view of simulated space through which a simulated vehicle moves. The present invention is particularly, though not exclusively, useful for modelling the motion of an aircraft or automobile through space, for training or entertainment purposes.
Background of the Pertinent Technology The use of vehicle simulators which simulate the operation of vehicles, such as race cars and aircraft, for entertainment is becoming widespread. Also, apparatus which simulate the operation of vehicles are increasingly being used as training devices for government and industry vehicle operators. Such apparatus can be programmed to realistically simulate the motion of a vehicle through two or three- dimensional space, and can also provide relatively realistic simulation of the control of the vehicle. Importantly, it is safer and more cost effective for a person to be entertained or trained on a video simulator, as compared with a real vehicle. It is to be understood that for purposes of the present invention, a "simulator" may be a conventional simulator, which presents a visual model of a simulated space, or a simulator which presents an image of a so-called "virtual reality" or "artificial reality". Such a simulator can stimulate one or more of the five human senses to present a more complete model of a "true" reality. Typically, a vehicle simulator has a computer which displays on a monitor a constantly changing video picture of a simulated three dimensional space. The "window" presented on the monitor is ordinarily the view of the simulated space as would be seen from the driver's seat of the simulated vehicle. Thus, as the simulated vehicle "moves" through the simulated space, the video display is constantly updated by the computer to model the motion of the vehicle. Whether the vehicle simulator is to be used for training or entertainment, it is desirable to provide the operator of the simulated vehicle with a panoramic display of the simulated space through which the simulated vehicle is to travel. This is to provide a more effective simulation of the view that an operator of a vehicle to be modelled would see from the driver's seat of the actual modelled vehicle.
Not surprisingly, devices have been proposed which use more than a single video monitor to provide a panoramic "window" of the simulated space. Representative of these devices is the invention disclosed in U.S. Patent No. 3,996,672 to Osofsky et al. , which describes an aircraft simulator that uses three video monitors to display a panoramic window of a simulated space. As the simulated aircraft described in the Osofsky et al. patent moves through the simulated space, the images presented on the video monitors are updated as appropriate to model the motion of the aircraft.
As envisioned by the Osofsky et al. simulator, each of the three monitors is spatially congruent with the sector of simulated space displayed on the monitor. More specifically, the images presented on each monitor have the same perspective to the viewer as would the corresponding real-world objects that would occupy the same sector of space as that presented by the particular monitor.
While effective for its intended purpose, it is unfortunately the case that to coordinate the windows presented by each monitor to display a panoramic view of the simulated space, the monitors of the Osofsky et al. flight simulator require relatively powerful video drivers to relay the video commands from the controller to each of the three monitors. As a further consequence, relatively powerful elect-rical drivers are required to drive the relatively larger electrical harnesses to conduct the video commands from the controller to each of the three monitors.
As is well-known in the art, such electrical harnesses can, when energized, induce electromagnetic signals that can interfere with the operation of nearby electrical equipment. Besides being technically undesirable, such interference may not comport with governmental regulations regarding acceptable levels of electromagnetic interference. Accordingly, relatively lengthy electrical harnesses typically must be electrically shielded. Unfortunately, shielding of harnesses increases driver power requirements, which in combination with the shielded longer harnesses increases the expense of the apparatus, as compared to apparatus that use short harnesses with energy contents that do not require shielding. Further, depending on a variety of factors, such shielding may not be completely effective in preventing electromagnetic interference.
In addition to the above-mentioned drawbacks, it is the case that the video monitors in many, if not most, multi- monitor simulators cannot be easily relocated from one position on the simulator to another, and still maintain spatial congruence between the relocated monitor and the "window" presented on the monitor. This is unfortunate, because it may be desirable, depending on the application of the particular simulator, to move the location of a monitor on the simulator as utilization requirements dictate, while maintaining congruence between the monitor and the sector of simulated space displayed on the monitor. For example, in an automobile simulator, it may be desirable to present a view of the simulated space behind the position of the -driver, to support practicing driving the simulated automobile in reverse.
The present invention recognizes that it is possible to provide a multi-monitor simulator in which one or more of the monitors can relatively easily be relocated on the simulator, and still maintain congruence between the monitor and the sector of simulated space displayed on the monitor. Accordingly, it is an object of the present invention to provide a multi-monitor vehicle simulator in which one or more of the monitors can relatively easily be relocated on the simulator, while maintaining congruence between the relocated monitor and the sector of simulated space displayed on the monitor.
It is a further object of the present invention to provide a multi-monitor vehicle simulator which does not require comparatively powerful video drivers.
A further object of the present invention is to provide a multi-monitor vehicle simulator which does not require the use of relatively lengthy electrical harnesses and concomitant peripheral equipment which would otherwise be required to reduce electromagnetic interference from the harness.
Yet another object of the present invention is to provide a multi-monitor vehicle simulator which is relatively easy and effective to use, and comparatively cost-effective to manufacture. The present invention is accordingly a compact multichannel simulator which, because of its compact nature, can be used in many existing training and entertainment facilities.
Summary of the Invention A modular display vehicle simulator for modelling the motion of a simulated vehicle through a simulated space has a base and a plurality of housings, preferably three or more, mounted on the base. The housings are mounted on the base in close proximity to each other. In one embodiment, each housing is juxtaposed with at least one other housing. A video monitor and an associated video controller, t.& which the monitor is electrically connected, are mounted in each housing. Also, simulated control devices, such as a steering wheel and throttle controls, are mounted on the base for generating control signals which are processed in accordance with the present invention. The control signals are representative of the motion of the simulated vehicle through the simulated space that is desired by the operator of the simulator. One of the controllers is a master controller which calculates a reference position based upon the control signal from the control devices. Periodically, (e.g., about ten to thirty times per second) , the master controller updates the reference position. In accordance with the present invention, the reference position is the simulated position of the vehicle in the simulated space. The master controller is electrically connected to at least one slave controller. In the presently preferred embodiment, the master controller is electrically connected to two slave controllers for transmitting a signal representative of the reference position to the slave controllers. In response to the reference position signal, each slave controller calculates a perspective of the sector of space (i.e., a "window") and the objects within the space that are to be presented on the associated monitor, and causes the associated monitor to display the calculated sector. Each of the displayed sectors has a predetermined orientation, relative to the reference position.
Importantly, the displayed sectors are spatially congruent with their associated monitors. More particularly, the monitors occupy the sectors of space that would be occupied in "real life" by the space and objects which are presented, in simulated form, on the respective monitor. Thus, each sector is oriented, relative to the reference position, such that the axis of each window, from foreground to background, is coincident with the axis of the monitor which presents the window, from the front of the monitor which is observed by the operator to the back of the monitor. When a monitor is relocated on the base, the particular orientation of each window can be changed as necessary to maintain congruence between the window and associated monitor by appropriately manipulating a switch which is electrically connected to the controller of the particular monitor.
The present invention is accordingly a compact multichannel simulator which, because of its compact nature, can be used in many existing training and entertainment facilities. Further, the volume behind the CRT face plates in each monitor can be used to hold display channel electronics and thus save space and avoid the need for additional housing racks for the electronics.
The details of the present invention, as well as the operation of the invention, can best be understood by reference to the drawings, in which like numerals refer to like parts.
Brief Description of the Drawings Figure 1 is a perspective view of one presently preferred embodiment of the modular display simulator of the present invention; Figure 2 is a block diagram of a presently preferred embodiment of the electrical components of the modular display simulator of the present invention;
Figure 3 is a schematic view of the modular display simulator of the present invention, as seen from a top-down perspective, showing the simulated vehicle within the simulated space; and
Figure 4 is a flow diagram illustrating the operational steps of the modular display simulator of the present invention. Description of a Preferred Embodiment
Referring initially to Figure 1, a modular display simulator is shown, generally designated 10. As shown, the simulator 10 has a base 12 and three housings 14, 16, and 18 which are mounted on the base 12. Figure 1 shows that the housing 14 is juxtaposed with the housings 16 and 18. Each housing 14, 16, 18 has a respective video monitor-*eo, 22, 24 mounted therein. Preferably, the monitors 20, 22, and 24 are suitable for displaying, in color, computer-generated videographics. While Figure 1 shows that the simulator 10 has three monitors 20, 22, 24, it is to be understood that the simulator 10 can include two monitors, or any number of monitors greater than three, within space constraints. Furthermore, while the simulator 10 as disclosed herein is an automobile simulator, it is to be understood that the simulator of the present invention can be used as a flight simulator or for simulating motion of any other vehicle.
A seat 32 is shown in Figure 1, and the seat 32 is rotationally attached to a support beam 34. The support beam 34 is in turn pivotally attached to the base 12. It will be appreciated by the skilled artisan that an operator (not shown in Figure 1) can sit in the seat 32 and position the seat 32 so that the operator faces the monitors 20, 22, 24, with the monitors 20, 22, 24 approximately at eye level to the operator.
Accordingly, it can be further appreciated in reference to Figure 1 that the monitors 20, 22, and 24 together display a panoramic view of a simulated space, and the simulated space displayed on the monitors moves as the operator of the simulator 10 sits in the seat 32 and "drives" a simulated automobile through the simulated space. Specifically, the monitor 20 displays an image of a sector 38 of the simulated space. As contemplated by the present invention, the orientation of the sector 38, along with the positions and orientations of the objects within the sector 38, change with simulated motion of the simulated vehicle. More specifically, the monitor 20 presents a display of the sector 38 of the simulated space as would be seen through a window of the vehicle being simulated. In other words, the monitor 20 presents a "window" which shows the sector 38 in perspective as seen from the position of the operator in the simulated space. Similarly, the monitors 22, 24 present "window" displays of respective sectors 40, 42 of the simulated space.
Figure 1 also shows a means attached to the b"ase 12 for generating signals for controlling the simulated motion of the simulated vehicle. More particularly, a steering wheel 60 is rotationally mounted on the base 12, and an accelerator pedal 62 is pivotably attached to the base 12. Also, a gear shift lever 64 is pivotably connected to the base 12. Other control means, e.g., a brake pedal and clutch pedal (not shown) can also be provided on the simulator 10, if desired. It will be appreciated that the operator of the simulator 10 can manipulate the steering wheel 60, accelerator pedal 62, and gear shift lever 64 as appropriate to generate a control signal for controlling the simulated motion of the simulated vehicle. U.S. Patent No. 4,949,119 to Moncrief et al., assigned to the same assignee as the present invention, fully discloses the structure and operation of one presently preferred embodiment of the gear shift lever 64 that may be used with the invention disclosed herein. Also, U.S. Patent application serial no. 296,472 for an invention entitled "Control Device as a Steering Wheel for Video Vehicle Simulator with Realistic Feedback Forces", assigned to the same assignee as the present invention, describes the operation of one preferred embodiment of the steering wheel 60. The above-referenced patent and patent application are incorporated herein by reference.
It is to be appreciated in cross-reference to Figures 1 and 2 that the monitors 20, 22, 24 are preferably spatially congruent with their respective displays. More particularly, each of the monitors 20, 22, and 24 preferably displays its respective sector 38, 40, 42 such that each sector 38, 40, 42 has a predetermined orientation relative to a reference position 44 within the simulated space, generally designated 45, shown in Figure 2. In the preferred embodiment, the reference position 44 is the simulated position of the operator 46 of the simulator 10 within the simulated space 45. As envisioned by the present invention, the simulated space 45 has an elevation extending from directly above the position 44 of operator 46 to the simulated horizon as would be seen from the position 44. Also, the simulated space 45 has -an azimuth of three hundred sixty degrees (360) relative to the position 44.
In accordance with the preferred embodiment of the present invention, the monitor 20 presents a view of the simulated space 45 that would be seen through the front windshield of the vehicle 48, as viewed by the user 46. Accordingly, to establish spatial congruence between the monitor 20 and its displayed sector 38, the sector 38 is that sector of the simulated space which is oriented directly in front of the position 44 of the operator 46, i.e., along the axis 50 of the simulated vehicle 48. On the other hand, the monitors 22, 24 are offset, by respective predetermined angles 52, 54, from the monitor 20. Thus, to establish spatial congruence between the monitors 22, 24 and their respective displayed sectors 40, 42, in the preferred embodiment the respective orientations of the displayed sectors 40, 42 are offset from the axis 50 of the simulated vehicle 48 by the angles 52, 54.
Stated differently, the respective axes 50, 51, and 53 of each sector 38, 40, 42 from the foreground of the particular sector to the background is preferably coincident with the axis of the respective monitor 20, 22, 24, from the front of the particular monitor which is viewed by the operator to the back of the monitor.
In the embodiment shown, the angle 52 is approximately equal to fifty three (53) degrees, and the angle 54 is about equal to minus fifty three (-53) degrees. It is to be understood, however, that the angles 52, 54 can have other values. It is to be further understood that while Figure 2 shows that the angles 52, 54 represent an offset between the monitors 20, 22, and 24 which is in two dimensions, any two or three of the monitors 20, 22, and 24 can be positioned on the base 12 such that the offset between monitors has a component in a third dimension. For example, the monitor 22 can be moved to the position on the base 12 indicated by the monitor 22', as shown in Figure 1. The controller 28 of the monitor 22 can be reset in accordance with disclosure be pw so that the sector 40' displayed by the monitor in position 22" is spatially congruent with the monitor in position 22' . As an example, in the embodiment shown, the sector 40' displays the top 56 of the simulated transmission pole 58.
Now referring to Figure 3, the details of the electrical components of the simulator 10 can be seen. As shown in Figure 3, each housing 14, 16, 18 holds a respective video controller 26, 28, 30, and each video controller is electrically connected to its respective monitor. More particularly, for purposes of disclosure the video controller 26 is a master controller, and is electrically connected to the monitor 20. Also, the controllers 28, 30 are slave controllers, and are electrically connected to their respective monitors 22, 24 and to the master controller 26.
As further shown in Figure 3, each controller 26, 28, and 30 includes a respective game processor 66, 68, and 70. Each game processor 66, 68, and 70 is any suitable microprocessor which can rapidly calculate the sector to be displayed, and which also maintains in electronic memory a map of the space
45. In one preferred embodiment, each game processor is a type 68010 microprocessor manufactured by Motorola
Corporation. As will be more fully disclosed below, the game processors 68, 70 of the respective slave controllers 28, 30 receive inputs generated by respective hardware or software switches 75, 77 for establishing a predetermined orientation offset for the sectors 40, 42 relative to the sector 38.
Still referring to Figure 3, the game processor 66 of the master controller 26 is electrically connected to the steering wheel 60, the accelerator pedal 62, and the gear shift lever 64. Accordingly, electrical control signals which are generated by the steering wheel 60, accelerator pedal 62, and gear shift lever 64 are sent to the game processor 66.
Figure 3 also shows that each controller 26, 28, and 30 includes a respective image calculation engine, referred to herein as an ADSP 72, 74, 76 which is electrically connected to its associated game processor. Each ADSP includes an ADSP
2100 series microprocessor manufactured by Analog Devices.
Each of the ADSPs 72, 74, 76 maintains in its electronic memory a listing of the objects within the simulated space 45
(shown in Figure 2) for access of the data stored in the listing by associated signal processing equipment, as more fully disclosed below. This listing contains a data base of objects within the space 45, such as trees and buildings, and movable objects within the space 45, e.g., birds, aircraft, and other ground vehicles. The particular data organization within the blackboard can be any well-known means for organizing data which permits efficient data retrieval and storage. The orientation offsets established by the switches 75, 77 can have components in two or three dimensions, as desired. Stated differently, the switches 75, 77 can establish orientation offsets for the sectors 40, 42 vis-a-vis the sector 38 in the azimuthal and elevational dimensions. Specifically, in the presently preferred embodiment each switch 75, 77 is a software switch that has a value stored in nonvolitional zero-power RAM. The values for the switches 75, 77 can be set by the operator of the simulator 10 to any one of several predetermined azimuth and pitch offsets. The values of these offsets are established based upon the particular application of the simulator 10. It is to be understood that the offsets established by the switches 75, 77 can have any azimuthal value from 0 to + 180 degrees and any elevational value from 0 to + 180 degrees. It is to be further understood that the switches 75, 77 can be hardware switches, e.g., the switches 75, 77 can be rotary potentiometers.
Additionally, each controller 26, 28, 30 has a respective graphics signal processor (GSP) 78, 80, 82 which is electrically connected to its associated game processor. Each GSP 78, 80, 82 is any suitable electronic device which fills image buffers to be displayed on its respective monitor 20, 22, 24 in response to graphics signals from the associated game processor 66, 68, 70. In one presently preferred embodiment, each GSP is a Texas Instrument component 34010. As shown in Figure 3, each GSP is electrically connected to a respective video frame buffer 84, 86, 88, and the frame buffers 84, 86, and 88 are respectively electrically connected to the monitors 20, 22, 24.
Still referring to Figure 3, each controller 26, 28, and 30 includes a respective dual universal asynchronous receiver transmitter (DUART) 90, 92, and 94. Each DUART 90, 92, 94 is a device, such as a type MC68681 manufactured by Motorola Corporation, which is suitable for converting parallel data from its respective game processor 66, 68, 70 into serial data for transmission to another DUART, and for converting serial data received from another DUART into parallel data for processing by the associated game processor 66, 68, 70. Thus, the DUART 90 of the master controller 26 is electrically connected to the DUARTs 92, 94 of the slave controllers 28, 30, for transmitting data from the master controller 26 to the slave controllers 28, 30. In an alternative embodiment, the DUARTs 90, 92, 94 could be replaced with suitable parallel cables.
In describing the steps of a single cycle of operation of the simulator 10, reference is made to Figures 2 , 3, and 4. For ease of disclosure, blocks which are labelled with a numeral followed by the letter "a" represent steps that are performed by the master controller 26. On the other hand, blocks which are labelled with a numeral followed by the letter "b" represent steps which are performed by the slave controller 28, and blocks which are labelled with a numeral followed by the letter "c" represent steps which are performed by the slave controller 30.
The operator 46 (shown in Figure 2) of the simulator 10 can manipulate the steering wheel 60, accelerator pedal 62, and gear shift lever 64. The positions of these physical devices at any point in time are reflected by sensors (not shown) such as photodetectors affixed within the vehicle simulator 10 to detect the positions of the steering wheel 60, accelerator pedal 62, and shift lever 64. Upon the initiation of an operational cycle, as indicated at block 96,-the system receives position indicating signals from the various sensors and, in response thereto, generates corresponding control signals for controlling the desired simulated motion of the simulated vehicle 48 through the simulated space 45. An example of how such a control signal is generated and subsequently used by a signal processor, such as the game processor 66, is disclosed in the above-referenced U.S. Patent
No. 4,949,119. The control signals representing positions of the wheel 60, pedal 62, and lever 64 are sent via respective electrical lines 98, 102, and 104 to the game processor 66 of the master controller 26, as shown in Figure 3. The system next moves to block 106 of Figure 4, wherein the game processor 66, in conjunction with a math coprocessor, if necessary, calculates the reference position and orientation of the simulated vehicle 48 in the simulated space 45, shown in Figure 2, based upon the previous position of the vehicle 48 in the space 45 and the control signals from the wheel 60, pedal 62, and lever 64. Any suitable method may be used to calculate the orientation and position of the vehicle 48 based upon the previous position, velocity, and acceleration of the vehicle 48 and the signals from the wheel 60, pedal 62, lever 64, and other controls (e.g., a clutch pedal and a brake pedal) .
For example, the orientation and position of the vehicle 48 can be calculated by any method suitable for the particular application of the simulator 10. For example, a simple point and thrust orientation and position control algorithm can be used for applications of the simulator 10 wherein it is desirable for the simulated vehicle to "fly" around a predetermined point in the simulated space. As another alternative, wherein limited vehicle motion fidelity is acceptable, the orientation and position of the vehicle 48 can be calculated using any one of the algorithms used to control aircraft positions and orientations in popular video home games. As yet another alternative, the orientation and position of the vehicle 48 can be calculated using any one of the algorithms used to control aircraft positions and orientations in high fidelity aircraft simulators which are used for training commercial or military aviators or astronauts. As a further and preferred means for calculating the orientation and position of the vehicle 48, a free body model can be used. More specifically, the game processor 66, in conjunction with a math coprocessor that can contain a data base of the drivable road surfaces, continuously calculates a new orientation and position of the vehicle 48 based upon the previous position, velocity, and acceleration of the vehicle 48 and the signals from the controls of the simulator 10. A free body algorithm similar to the equations of flight in a high fidelity flight simulator is preferably used.
The system next moves to block 108, wherein a reference position signal, which represents both the reference position and orientation of the simulated vehicle 48 as calculated by the game processor 66, is then sent to the DUART 90, where the reference position signal is converted to serial format. From the DUART 90, the signal is sent to the DUARTs 92, 94 of the slave controllers 28, 30. The DUARTs 92, 94 convert the signal back to parallel data and send the signal to their respective game processors 68, 70.
As indicated at blocks 109, 111, respectively, the slave controllers 28, 30 establish the orientation of the sectors
40, 42 in accordance with a predetermined angular offset. Specifically, the game processor 68 determines the angle 52
(shown in Figure 2) based upon the setting of the switch 75, shown in Figure 3. More specifically, the game processor 68 records the reference position 44, sent from the game processor 66, the orientation of the axis 50, also sent from the game processor 66, and the rotation around the axis 50.
Then, the game processor 68 establishes the axis 51 and rotation around the axis 51 of the sector 40 to originate from the reference position 44 and to be offset from the axis 50 of the sector 38 by an angle 52, which corresponds to the setting on the switch 75. Preferably, the switch 75 is set to establish an angle 52 which will result in spatial-congruence between the monitor 22 and the sector 40. Also, the game processor 68 has, in its electronic memory, data which represents the predetermined angular width 43 of the sector 40. Thus, the game processor 68 essentially determines the orientation of the axis 51 of the sector 40, as well as the area of the space 45 that encompasses the sector 40.
-Likewise, the game processor 70 determines the angle 54
(shown in Figure 2) based upon the setting of the switch 77, shown in Figure 3. It can now be further understood that the switch 77 can have settings which correspond to a plurality of potentially desired values for the angle 54. Preferably, the switch 77 is set to establish an angle 54 which will result in spatial congruence between the monitor 24 and the sector 42. Moreover, the game processor 70 has, in its electronic memory, data which represents the angular width 45 of the sector 42. Thus, the game processor 70 essentially determines what area of the space 45 comprises the sector 42.
Having modified the respective sector orientations, the system moves to blocks 110a, 110b, 110c. In accordance with the present invention, the game processing by each controller 20, 22, 24 described below is done asynchronously with respect to the other controllers. Specifically, the master controller 20 periodically sends the reference signal to the slave controllers 22, 24, which process the signal independently from the other controllers. More specifically, in the event that one of the slave controllers 22, 24 completes one processing cycle as described below before the master controller 20 sends an updated reference signal to the particular slave controller 22, 24, the particular slave controller 22, 24 continues to display the image that was based upon the last received reference position signal. The particular slave controller 22 or 24 then awaits the arrival of a new reference position signal to commence processing a new image based upon the new reference position signal.
Alternatively, however, the slave controller 22, 24 can commence another computational cycle based upon a linear extrapolation of the reference position. To accomplish this extrapolation, the particular slave controller 22, 24 assumes that the speed and direction of the simulated vehicle 48 have the same values as calculated between the two immediately previous reference position signals from the master controller 20.
In blocks 110a, 110b, 110c, the reference position signal is processed by each of the game processors 66, 68, 70. Specifically, as indicated at block 110a, the game processor 66 calculates the orientation and position of each of the objects that are stored in the data listing of the electronic memory of the game processor 66 and which are .within the sector 38. More specifically, the game processor 66 determines the distance between the position of the simulated vehicle 48 and each of the objects within the sector 38 by computational processes well-known in the art. Then, based upon the distance between the simulated vehicle 48 and each object within the sector 38, and the orientation of each object relative to the vehicle 48 as next described, the game processor 66 calculates the relative size, as would appear from the position of the vehicle 48, of each object within the sector 38, again by computational processes well-known in the art.
The game processor 66 also calculates the perspective of each object within the sector 38 as would be seen from the position of the simulated vehicle 48. The relative size and orientation of each object within the sector 38 is then sent to ADSP 72. In other words, the game processor 66 calculates the content and perspective of the "window" which is to be displayed on the monitor 20.
As indicated at blocks 110b, 110c, the game processors 68, 70 of the slave controllers 28, 30 calculate the positions and orientations of the objects within the respective sectors 40, 42, based upon the reference position signal from the master controller 26. Specifically, the game processor 68 calculates the orientation and position of each of the objects that are stored in the electronic memory of the game processor 68 and which are within the sector 40. More specifically, the game processor 68 determines the distance between the position of the simulated vehicle 48 and the orientation of each of the objects within the sector 40. Then, based upon the distance and orientation between the simulated vehicle 48 and each object within the sector 40, the game processor 68 calculates the relative size and perspective, as would appear from the position of the vehicle 48, of each object within the sector 40, by computational processes well-known in the art. Accordingly, it is to be understood that the game processors 68, 70 calculate the size and perspective of each object within the respective sectors 40, 42 as would be seen from the position of the simulated vehicle 48 in substantially the same way as the game processor 66 calculation of the sector 38 described above.
Next, the system moves to blocks 112a-c, wherein each of the ADSPs 72, 74, 76 generates signals that are representative of the particular sector to be displayed. Each signal generated by the ADSPs 72, 74, 76 at blocks 112a-c contains data defining the boundaries of polygons that are combined to form the visual images of objects in the sectors 38, 40, 42. In accordance with the present invention, the signals from the ADSPs 72, 74, 76 are sent to the respective GSPs 78, 80, 82. The system then moves to blocks 114a-c, wherein each of the GSPs 78, 80, 82 "fills" buffers with a plurality of polygons with color data received from the respective ADSPs 72, 74, 76. This color data is representative of the predetermined color of the various objects to be presented on the monitors 14, 16, 18.
The system next moves to blocks 116a-c, wherein each GSP 78, 80, 82 deletes, i.e., clears, "old" polygons stored in a first half of its respective video buffer 84, 86, 88 and fills this first half of its buffer 84, 86, 88 with the polygons generated by the GSP. Simultaneously, as indicated at blocks 118a-c, the polygons which were previously stored in the remaining (i.e., second) half of the buffers 84, 86, 88 are respectively displayed by the monitors 20, 22, 24. In the next succeeding cycle, the displayed polygons in -the second half of the buffers 84, 86, 88 will be deleted and replaced with "new" polygons from the GSPs 78, 80, and 82, and the polygons in the first half of the buffers 84, 86, 88 will be displayed on the respective monitors 20, 22, 24. The process repeats for successive cycles of the operation of the simulator 10. In one preferred embodiment, the simulator 10 updates the displays presented on the monitors 20, 22, 24 between ten times and thirty times per second. It is to be appreciated in reference to the above disclosure that the monitors 22, 24 can be relocated on the base 12 to display other perspectives of the simulated space 45, while still maintaining spatial congruence with the sector displayed on the particular monitor. For example, the monitor 22 can be moved to the location indicated by the monitor 22x, and the switch 75 manipulated to establish the orientation offset of the sector 40x which is appropriate for maintaining spatial congruence between the monitor 22v and the sector 40 . Furthermore, the housing of one of the slave monitors, e.g., the housing 16 of the monitor 22, can be pivotably attached to the base 12 by any suitable means well-known in the art. For example, the housing 16 can be attached to a pivot arm, and the pivot arm pivotably connected to the base 12. Accordingly, in such an embodiment the monitor 22 is pivotably attached to the base 12, and can be moved relative to the base 12 by the operator of the simulator 10. In accordance with this embodiment, the pivot arm can be engaged with the switch 75 such that as the housing 16 is moved, the portion of the space 45 which is congruent with the monitor 22 is displayed on the monitor 22. This embodiment is useful in, e.g., vehicle backing exercises that require a view of the simulated space 45 that is wider than the monitors 20, 22, 24. It is to be appreciated in reference to the disclosure above that the present invention overcomes the longstanding problem of how to easily relocate one or more monitors in a multi-monitor simulator, while still maintaining spatial congruence between the relocated monitor and its associated displayed sector. Further, by physically housing eac monitor with its associated video controller, the present invention provides a relatively compact system. Moreover, by distributing the processing function, the present invention dispenses with the requirement for comparatively powerful video drivers, lengthy transmission cables, and the concomitant electromagnetic shielding requirements which attend lengthy cable runs. While the particular modular display simulator as herein shown and described in detail is fully capable of achieving the stated objectives, it is to be understood that the scope of the present invention is to be limited by nothing other than the limitations set forth in the appended claims.

Claims

I CLAIM:
1. A device for displaying a changing video image of a simulated space having a reference position, which comprises: a base; a first housing mounted on said base; a first video monitor mounted on said first housing; a first controller electrically connected to said first monitor for calculating said reference position and generating a position signal representative of said reference position, said first controller establishing a display of a first predetermined sector of said space on said first monitor in response to said position signal; a second housing mounted on said base; a second video monitor mounted on said second housing; a second controller electrically connected to said second monitor and said first controller for establishing a display of a second predetermined sector of said space in response to said position signal.
2. The device as recited in Claim 1, further comprising manual means connected to said base for generating a control signal, wherein said first controller periodically calculates said reference position in response to said control signal.
3. The device as recited in Claim 2, wherein said controllers establish respective said displays on respective said monitors substantially when said ' first .controller calculates said reference position.
4. The device as recited in Claim 1, wherein the spatial relationship between said first and second sectors is congruent with the spatial relationship between said first and second monitors.
5. The device recited in Claim 4, further comprising a switch mounted on said second housing and electrically connected to said second controller for selectively changing the spatial relationship of said second sector relative to said first sector.
6. The device as recited in Claim 2, wherein said first and second controllers are respectively mounted on said first and second housings, and said device further comprises: a third housing mounted on said base; a third video monitor mounted on said third housing; a third controller mounted on said third housing and electrically connected to said third monitor and said first controller for establishing a display of a third predetermined sector of said space in response to said position signal.
7. A simulator for presenting a display of a simulated space, which comprises: a first video monitor; a master controller electrically connected to said first monitor for establishing on said first monitor a display of said space which is spatially congruent with said first monitor; a second video monitor juxtaposed with said first monitor; and a slave controller electrically connected to said master controller and said second monitor for establishing on said second monitor a display of said space which is spatially congruent with said second monitor.
8. The simulator as recited in Claim 7, wherein said master controller generates a reference signal that is representative of said display on said first monitor, and wherein said slave controller establishes said display on said second monitor in response to said reference signal.
9. The simulator as recited in Claim 8, further comprising: a first housing for holding said first monitor and said master controller; a second housing for holding said second monitor and said slave controller; a base for holding said housings; and manual means connected to said base for generating •a control signal and transmitting said control signal to said master controller, wherein said master controller periodically calculates said reference position in response to said control signal, said reference position being representative of a predetermined position in said space .
10. The simulator as recited in Claim 9, wherein said controllers establish respective said displays on respective said monitors substantially when said master controller calculates said reference position.
11. The simulator as recited in Claim 9, wherein the spatial relationship between said first and second displays is congruent with the spatial relationship between said first and second monitors.
12. The device recited in Claim 11, further comprising a switch mounted on said second housing and electrically connected to said slave controller for selectively changing the spatial relationship of said display of said slave monitor relative to said display of said master monitor.
13. The simulator as recited in Claim 9, further comprising: a third housing mounted on said base; a third video monitor mounted on said third housing; a third controller mounted on said third housing and electrically connected to said third monitor and said master controller for establishing, in response to said position signal, a display of said space which is spatially congruent with said third monitor.
14. A device for generating a changing image of a simulated space, which comprises: a base having means attached thereto for generating a control signal representative of a desired motion through the simulated space; a first monitor mounted on said base and having a master controller electrically attached thereto for calculating a reference position in response to said control signal and for causing said first monitor to present a first window displaying a first sector of said space having a redetermined orientation relative to said reference position; and a second monitor mounted on said base and having a slave controller electrically attached thereto for causing said second monitor to present a second window displaying a second sector of said space, said slave controller being electrically connected to said master controller for establishing a predetermined orientation of said second sector relative to said reference position, the spatial relationship between said first and second windows being congruent with the spatial relationship between said first and second monitors.
15. The device as recited in Claim 14, wherein said master controller periodically calculates said reference position in response to said control signal.
16. The device as recited in Claim 14, wherein said controllers establish respective said windows on respective said monitors substantially when said master controller calculates said reference position.
17. The device as recited in Claim 16, wherein said master controller calculates said reference position about ten (10) times per second.
18. The device as recited in Claim 14, further comprising: a third housing mounted on said base; a third video monitor mounted on said third housing; a third controller mounted on said third housing and electrically connected to said third monitor and said master controller for generating an image of said space having a predetermined orientation relative to said reference position in response to said position signal.
19. A method for presenting images of a simulated space on first and second monitors as seen from a simulated vehicle having a selectable position and orientation in the simulated space, which comprises: generating a control signal representative of the desired movement of the simulated vehicle through the simulated space; processing the control signal in a master controller to generate a reference signal representative of the position and orientation of the simulated vehicle in the simulated space; generating a first display signal in a master controller in response to the reference signal; displaying a first image of the simulated space on the first monitor in response to the display signal, the first image being spatially congruent with the first monitor; generating a second display signal in a first slave controller in response to the reference signal; and displaying a second image of the simulated space on the second monitor in response to the display signal, the second image being spatially congruent with the second monitor.
20. The method of Claim 19, further comprising the steps of: generating a third display signal in a second slave controller in response to the reference signal; and displaying a third image of the simulated space on a third monitor in response to the display signal, the third image being spatially congruent with the third monitor.
21. The method of Claim 19, wherein the second monitor can be moved relative to the first monitor, and the relationship of the second image of the simulated space relative to the first image is selectably established by a switch to maintain spatial congruence between the second image and the second monitor.
PCT/US1992/004313 1991-05-23 1992-05-22 Modular display simulator WO1992021117A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP5500310A JPH06508222A (en) 1991-05-23 1992-05-22 modular display simulator

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US70437391A 1991-05-23 1991-05-23
US704,373 1991-05-23

Publications (1)

Publication Number Publication Date
WO1992021117A1 true WO1992021117A1 (en) 1992-11-26

Family

ID=24829202

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1992/004313 WO1992021117A1 (en) 1991-05-23 1992-05-22 Modular display simulator

Country Status (3)

Country Link
US (1) US5275565A (en)
JP (1) JPH06508222A (en)
WO (1) WO1992021117A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1993016776A1 (en) * 1992-02-24 1993-09-02 Hughes Aircraft Company Virtual image entertainment
FR2730842A1 (en) * 1995-02-17 1996-08-23 Renault Process for visualising images of adjustable size in field of view for motor vehicle driving simulator
EP1808205A2 (en) * 2006-01-06 2007-07-18 Kabushiki Kaisha Sega doing business as Sega Corporation Game apparatus and control method
GB2442259A (en) * 2006-05-05 2008-04-02 Sony Comp Entertainment Europe Secondary display showing alternative viewpoint
DE202011000695U1 (en) * 2010-10-07 2011-09-02 XRMotion-Rüdiger Reuter GBR (vertretungsberechtigter Gesellschafter Herr Reuter 28329 Bremen) Transportable cockpit simulator
RU2695480C1 (en) * 2018-11-09 2019-07-23 Федеральное государственное унитарное предприятие "Государственный научно-исследовательский институт авиационных систем" (ФГУП "ГосНИИАС") Method of excluding the effect of separating an image by frames of monitors for visualizing the extra-cockpit environment of flight simulators

Families Citing this family (134)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889670A (en) 1991-10-24 1999-03-30 Immersion Corporation Method and apparatus for tactilely responsive user interface
EP0568386A3 (en) * 1992-05-01 1995-08-16 R Brent Johnson Console simulator, multi-console management system, and console management distribution system
US5515078A (en) * 1992-06-12 1996-05-07 The Computer Museum, Inc. Virtual-reality positional input and display system
JP2760253B2 (en) * 1992-07-14 1998-05-28 住友電気工業株式会社 Road moving image creation method and in-vehicle navigation device to which the method is applied
US5790108A (en) 1992-10-23 1998-08-04 University Of British Columbia Controller
US5629594A (en) 1992-12-02 1997-05-13 Cybernet Systems Corporation Force feedback system
US7345672B2 (en) * 1992-12-02 2008-03-18 Immersion Corporation Force feedback system and actuator power management
US6801008B1 (en) 1992-12-02 2004-10-05 Immersion Corporation Force feedback system and actuator power management
GB9308658D0 (en) * 1993-04-27 1993-06-09 Philips Electronics Uk Ltd An image sensor
US5739811A (en) * 1993-07-16 1998-04-14 Immersion Human Interface Corporation Method and apparatus for controlling human-computer interface systems providing force feedback
US5734373A (en) 1993-07-16 1998-03-31 Immersion Human Interface Corporation Method and apparatus for controlling force feedback interface systems utilizing a host computer
US6437771B1 (en) * 1995-01-18 2002-08-20 Immersion Corporation Force feedback device including flexure member between actuator and user object
US5731804A (en) * 1995-01-18 1998-03-24 Immersion Human Interface Corp. Method and apparatus for providing high bandwidth, low noise mechanical I/O for computer systems
US5724264A (en) * 1993-07-16 1998-03-03 Immersion Human Interface Corp. Method and apparatus for tracking the position and orientation of a stylus and for digitizing a 3-D object
US5767839A (en) * 1995-01-18 1998-06-16 Immersion Human Interface Corporation Method and apparatus for providing passive force feedback to human-computer interface systems
US5805140A (en) * 1993-07-16 1998-09-08 Immersion Corporation High bandwidth force feedback interface using voice coils and flexures
US5701140A (en) * 1993-07-16 1997-12-23 Immersion Human Interface Corp. Method and apparatus for providing a cursor control interface with force feedback
US5721566A (en) * 1995-01-18 1998-02-24 Immersion Human Interface Corp. Method and apparatus for providing damping force feedback
US5431569A (en) * 1993-08-27 1995-07-11 Simpkins; Terry J. Computer interactive motion simulator
US6351261B1 (en) * 1993-08-31 2002-02-26 Sun Microsystems, Inc. System and method for a virtual reality system having a frame buffer that stores a plurality of view points that can be selected and viewed by the user
US5659691A (en) * 1993-09-23 1997-08-19 Virtual Universe Corporation Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements
US5625576A (en) * 1993-10-01 1997-04-29 Massachusetts Institute Of Technology Force reflecting haptic interface
JPH07289736A (en) * 1994-04-25 1995-11-07 Namco Ltd Game system and entry method to game system
US5623582A (en) 1994-07-14 1997-04-22 Immersion Human Interface Corporation Computer interface or control input device for laparoscopic surgical instrument and other elongated mechanical objects
US5821920A (en) 1994-07-14 1998-10-13 Immersion Human Interface Corporation Control input device for interfacing an elongated flexible object with a computer system
JP2769790B2 (en) * 1994-09-05 1998-06-25 パイオニア株式会社 Video game system
US20030040361A1 (en) * 1994-09-21 2003-02-27 Craig Thorner Method and apparatus for generating tactile feedback via relatively low-burden and/or zero burden telemetry
US5674127A (en) * 1995-03-07 1997-10-07 Habilas, Inc. Multisite multiplayer interactive electronic entertainment system having a partially player defined universe
US5829745A (en) * 1995-03-28 1998-11-03 Home Arcade Systems, Inc. Video game control unit with self-centering steering wheel
US5691898A (en) 1995-09-27 1997-11-25 Immersion Human Interface Corp. Safe and low cost computer peripherals with force feedback for consumer applications
US6166723A (en) * 1995-11-17 2000-12-26 Immersion Corporation Mouse interface device providing force feedback
US6704001B1 (en) 1995-11-17 2004-03-09 Immersion Corporation Force feedback device including actuator with moving magnet
JP2000501033A (en) 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド Human / machine interface with tactile feedback
US7027032B2 (en) * 1995-12-01 2006-04-11 Immersion Corporation Designing force sensations for force feedback computer applications
US8508469B1 (en) 1995-12-01 2013-08-13 Immersion Corporation Networked applications including haptic feedback
US6219032B1 (en) 1995-12-01 2001-04-17 Immersion Corporation Method for providing force feedback to a user of an interface device based on interactions of a controlled cursor with graphical elements in a graphical user interface
US6028593A (en) 1995-12-01 2000-02-22 Immersion Corporation Method and apparatus for providing simulated physical interactions within computer generated environments
US5956484A (en) * 1995-12-13 1999-09-21 Immersion Corporation Method and apparatus for providing force feedback over a computer network
US6300936B1 (en) 1997-11-14 2001-10-09 Immersion Corporation Force feedback system including multi-tasking graphical host environment and interface device
US6161126A (en) 1995-12-13 2000-12-12 Immersion Corporation Implementing force feedback over the World Wide Web and other computer networks
US6078308A (en) * 1995-12-13 2000-06-20 Immersion Corporation Graphical click surfaces for force feedback applications to provide user selection using cursor interaction with a trigger position within a boundary of a graphical object
US6374255B1 (en) * 1996-05-21 2002-04-16 Immersion Corporation Haptic authoring
US6125385A (en) * 1996-08-01 2000-09-26 Immersion Corporation Force feedback implementation in web pages
US6117007A (en) * 1996-08-09 2000-09-12 Konami Corporation Driving game machine and a storage medium for storing a driving game program
US6024576A (en) 1996-09-06 2000-02-15 Immersion Corporation Hemispherical, high bandwidth mechanical interface for computer systems
US6106297A (en) * 1996-11-12 2000-08-22 Lockheed Martin Corporation Distributed interactive simulation exercise manager system and method
US6044696A (en) * 1997-04-10 2000-04-04 Northern California Diagnostic Laboratories Apparatus for testing and evaluating the performance of an automobile
US6146143A (en) * 1997-04-10 2000-11-14 Faac Incorporated Dynamically controlled vehicle simulation system, and methods of constructing and utilizing same
AU7833098A (en) * 1997-06-10 1998-12-30 Beaird, Chyle E. Multiple access computer monitoring system
US6126548A (en) * 1997-10-08 2000-10-03 Illusion, Inc. Multi-player entertainment system
JPH11119754A (en) * 1997-10-20 1999-04-30 Clarion Co Ltd Display device
US6104382A (en) * 1997-10-31 2000-08-15 Immersion Corporation Force feedback transmission mechanisms
US6020875A (en) * 1997-10-31 2000-02-01 Immersion Corporation High fidelity mechanical transmission system and interface device
US6243078B1 (en) 1998-06-23 2001-06-05 Immersion Corporation Pointing device with forced feedback button
US6088019A (en) * 1998-06-23 2000-07-11 Immersion Corporation Low cost force feedback device with actuator for non-primary axis
US6211861B1 (en) * 1998-06-23 2001-04-03 Immersion Corporation Tactile mouse device
US6252583B1 (en) 1997-11-14 2001-06-26 Immersion Corporation Memory and force output management for a force feedback system
US6256011B1 (en) * 1997-12-03 2001-07-03 Immersion Corporation Multi-function control device with force feedback
US5956046A (en) * 1997-12-17 1999-09-21 Sun Microsystems, Inc. Scene synchronization of multiple computer displays
US5888069A (en) * 1997-12-23 1999-03-30 Sikorsky Aircraft Corporation Mobile modular simulator system
US6717573B1 (en) 1998-06-23 2004-04-06 Immersion Corporation Low-cost haptic mouse implementations
US6697043B1 (en) 1999-12-21 2004-02-24 Immersion Corporation Haptic interface device and actuator assembly providing linear haptic sensations
US6707443B2 (en) 1998-06-23 2004-03-16 Immersion Corporation Haptic trackball device
US6184868B1 (en) 1998-09-17 2001-02-06 Immersion Corp. Haptic feedback control devices
US6429846B2 (en) * 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6232932B1 (en) * 1998-07-16 2001-05-15 Craig A. Thorner Apparatus and method for providing modular reconfigurable multi-function displays for computer simulations
US6490011B1 (en) * 1998-12-18 2002-12-03 Caterpillar Inc Display device convertible between a cave configuration and a wall configuration
US6227862B1 (en) 1999-02-12 2001-05-08 Advanced Drivers Education Products And Training, Inc. Driver training system
US7158140B1 (en) * 1999-03-15 2007-01-02 Ati International Srl Method and apparatus for rendering an image in a video graphics adapter
EP1210820A2 (en) * 1999-05-12 2002-06-05 Redifun Stimulation, Inc. Method and apparatus for an improved wide-angle display system
US6690337B1 (en) 1999-06-09 2004-02-10 Panoram Technologies, Inc. Multi-panel video display
DE20080209U1 (en) * 1999-09-28 2001-08-09 Immersion Corp Control of haptic sensations for interface devices with vibrotactile feedback
US6693626B1 (en) * 1999-12-07 2004-02-17 Immersion Corporation Haptic feedback using a keyboard device
US6822635B2 (en) * 2000-01-19 2004-11-23 Immersion Corporation Haptic interface for laptop computers and other portable devices
US6468086B1 (en) 2000-07-03 2002-10-22 Shelly Brady-Koontz Method of display of video images of exercises
US20020158877A1 (en) * 2000-11-22 2002-10-31 Guckenberger Ronald James Shadow buffer control module method and software construct for adjusting per pixel raster images attributes to screen space and projector features for digital wrap, intensity transforms, color matching, soft-edge blending and filtering for multiple projectors and laser projectors
US20020180727A1 (en) * 2000-11-22 2002-12-05 Guckenberger Ronald James Shadow buffer control module method and software construct for adjusting per pixel raster images attributes to screen space and projector features for digital warp, intensity transforms, color matching, soft-edge blending, and filtering for multiple projectors and laser projectors
US6592375B2 (en) 2001-02-09 2003-07-15 Midway Games West Inc. Method and system for producing engine sounds of a simulated vehicle
US7170468B2 (en) 2001-02-21 2007-01-30 International Business Machines Corporation Collaborative tablet computer
IL143255A (en) 2001-05-20 2015-09-24 Simbionix Ltd Endoscopic ultrasonography simulation
US7091926B2 (en) * 2002-02-08 2006-08-15 Kulas Charles J Computer display system using multiple screens
US6904823B2 (en) 2002-04-03 2005-06-14 Immersion Corporation Haptic shifting devices
US6748604B2 (en) * 2002-05-30 2004-06-15 Finger Fitting Products, Inc. Glove massager
US8917234B2 (en) 2002-10-15 2014-12-23 Immersion Corporation Products and processes for providing force sensations in a user interface
AU2003293449A1 (en) * 2002-12-08 2004-06-30 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
US8830161B2 (en) 2002-12-08 2014-09-09 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
US8059088B2 (en) * 2002-12-08 2011-11-15 Immersion Corporation Methods and systems for providing haptic messaging to handheld communication devices
GB2418475B (en) * 2003-06-09 2007-10-24 Immersion Corp Interactive gaming systems with haptic feedback
US7850456B2 (en) 2003-07-15 2010-12-14 Simbionix Ltd. Surgical simulation device, system and method
US7411576B2 (en) * 2003-10-30 2008-08-12 Sensable Technologies, Inc. Force reflecting haptic interface
US20060114171A1 (en) * 2004-11-12 2006-06-01 National Research Council Of Canada Windowed immersive environment for virtual reality simulators
JP2007066291A (en) * 2005-08-02 2007-03-15 Seiko Epson Corp Method, apparatus and system for image display, server, program, and recording medium
US20070097016A1 (en) * 2005-10-27 2007-05-03 Scott McGowan Triple Screen Video Arcade Circuit
US7667891B2 (en) * 2005-11-08 2010-02-23 Eastman Kodak Company Desktop display with continuous curved surface
US8607281B2 (en) * 2006-09-07 2013-12-10 Porto Vinci Ltd. Limited Liability Company Control of data presentation in multiple zones using a wireless home entertainment hub
US9319741B2 (en) 2006-09-07 2016-04-19 Rateze Remote Mgmt Llc Finding devices in an entertainment system
KR20150044979A (en) 2006-09-13 2015-04-27 임머숀 코퍼레이션 Systems and methods for casino gaming haptics
US8147247B1 (en) * 2006-10-27 2012-04-03 Carl Reese Personalized traffic safety instruction
US8543338B2 (en) 2007-01-16 2013-09-24 Simbionix Ltd. System and method for performing computerized simulations for image-guided procedures using a patient specific model
WO2008087629A2 (en) * 2007-01-16 2008-07-24 Simbionix Ltd. Preoperative surgical simulation
US9666091B2 (en) 2008-01-10 2017-05-30 Lifelong Driver Llc Driver training system
US9486292B2 (en) 2008-02-14 2016-11-08 Immersion Corporation Systems and methods for real-time winding analysis for knot detection
US8139072B2 (en) 2008-04-14 2012-03-20 Mcgowan Scott James Network hardware graphics adapter compression
US20100053151A1 (en) * 2008-09-02 2010-03-04 Samsung Electronics Co., Ltd In-line mediation for manipulating three-dimensional content on a display device
EP3666347B1 (en) * 2008-11-25 2021-10-20 Fox Factory, Inc. Computer usable storage medium for virtual competition
US9104791B2 (en) * 2009-05-28 2015-08-11 Immersion Corporation Systems and methods for editing a model of a physical system for a simulation
US20100328354A1 (en) * 2009-06-26 2010-12-30 Sony Computer Entertainment, Inc. Networked Computer Graphics Rendering System with Multiple Displays
US20100328447A1 (en) * 2009-06-26 2010-12-30 Sony Computer Entertainment, Inc. Configuration of display and audio parameters for computer graphics rendering system having multiple displays
EP2446431A1 (en) * 2009-06-26 2012-05-02 Sony Computer Entertainment Inc. Networked computer graphics rendering system with multiple displays
US8269691B2 (en) * 2009-06-26 2012-09-18 Sony Computer Entertainment Inc. Networked computer graphics rendering system with multiple displays for displaying multiple viewing frustums
US8894415B2 (en) * 2009-09-29 2014-11-25 Advanced Training System Llc System, method and apparatus for driver training
DE102009045452B4 (en) * 2009-10-07 2011-07-07 Winter, York, 10629 Arrangement and method for carrying out an interactive simulation and a corresponding computer program and a corresponding computer-readable storage medium
US20110207091A1 (en) * 2010-02-23 2011-08-25 Arinc Incorporated Compact multi-aircraft configurable flight simulator
US9132352B1 (en) 2010-06-24 2015-09-15 Gregory S. Rabin Interactive system and method for rendering an object
US10013893B2 (en) 2011-10-31 2018-07-03 Lifelong Driver Llc Driver training
US9349300B2 (en) 2011-10-31 2016-05-24 Lifelong Driver Llc Senior driver training
US9582178B2 (en) 2011-11-07 2017-02-28 Immersion Corporation Systems and methods for multi-pressure interaction on touch-sensitive surfaces
US9866924B2 (en) 2013-03-14 2018-01-09 Immersion Corporation Systems and methods for enhanced television interaction
WO2015003056A1 (en) * 2013-07-02 2015-01-08 ROFFE, Brian Real time car driving simulator
US9138651B2 (en) * 2014-01-03 2015-09-22 Jonathan B Gaug Universal game pedal controller and method therefor
US8868808B1 (en) * 2014-03-26 2014-10-21 Cae Inc. Configurable simulator with a plurality of configurable modular cards
KR20150130845A (en) * 2014-05-14 2015-11-24 삼성전자주식회사 Apparatus and Device for Position Measuring of Electronic Apparatuses
US11195233B1 (en) 2014-06-12 2021-12-07 Allstate Insurance Company Virtual simulation for insurance
US11216887B1 (en) 2014-06-12 2022-01-04 Allstate Insurance Company Virtual simulation for insurance
US10614726B2 (en) 2014-12-08 2020-04-07 Life Long Driver, Llc Behaviorally-based crash avoidance system
US20160292919A1 (en) 2015-03-31 2016-10-06 Cae Inc. Modular Infrastructure For An Interactive Computer Program
US9754506B2 (en) * 2015-03-31 2017-09-05 Cae Inc. Interactive computer program with virtualized participant
EP3278321B1 (en) 2015-03-31 2021-09-08 CAE Inc. Multifactor eye position identification in a display system
US9933262B2 (en) * 2015-07-27 2018-04-03 Caterpillar Inc. Positioning system having a master-slave configuration
JP6572145B2 (en) * 2016-01-27 2019-09-04 ミネベアミツミ株式会社 Switch unit and vending machine
TWD205586S (en) * 2019-08-23 2020-07-01 宏碁股份有限公司 Esports cabin
WO2022211667A1 (en) * 2021-03-30 2022-10-06 Хальдун Саид Аль-Зубейди Multi-screen panoramic television
RU206248U1 (en) * 2021-03-30 2021-09-02 Хальдун Саид Аль-Зубейди Multi-screen panoramic TV
US11651703B1 (en) * 2021-11-16 2023-05-16 Beta Air, Llc Systems and methods for a mobile flight simulator of an electric aircraft

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2164301A (en) * 1984-09-15 1986-03-19 Timewell Properties Limited Simulating driving a motor vehicle
US4807202A (en) * 1986-04-17 1989-02-21 Allan Cherri Visual environment simulator for mobile viewer
US5005148A (en) * 1989-01-12 1991-04-02 Atari Games Corporation Driving simulator with moving painted dashboard
EP0443928A1 (en) * 1990-02-20 1991-08-28 Faros Training method and device for vehicle driving

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3514871A (en) * 1967-05-09 1970-06-02 Dalto Electronics Corp Wide angle visual display
US3659920A (en) * 1970-08-27 1972-05-02 Singer Co Wide angle infinity image visual display
US3996672A (en) * 1975-03-12 1976-12-14 The Singer Company Real-time simulation of a point system as viewed by a moving observer
GB2003103B (en) * 1977-08-27 1982-01-06 British Aircraft Corp Ltd Simulators
US4373169A (en) * 1979-10-30 1983-02-08 The Boeing Company Multi-window visual display system for flight simulators
GB2068138B (en) * 1980-01-29 1983-10-19 Singer Co Uk Ltd Wide angle crt display device
JPS58116377A (en) * 1981-12-28 1983-07-11 任天堂株式会社 Handheld type game apparatus
GB2123656B (en) * 1982-06-09 1987-02-18 Tatsumi Denshi Kogyo Kk A method and an apparatus for displaying a unified picture on crt screens of multiple displaying devices
US4477069A (en) * 1982-09-27 1984-10-16 Crudgington Jr Cleveland B Electronic amusement center
US4572509A (en) * 1982-09-30 1986-02-25 Sitrick David H Video game network
US4521014A (en) * 1982-09-30 1985-06-04 Sitrick David H Video game including user visual image
US4761641A (en) * 1983-01-21 1988-08-02 Vidcom Rentservice B.V. Information display system
US4817948A (en) * 1983-09-06 1989-04-04 Louise Simonelli Reduced-scale racing system
JPH0630687B2 (en) * 1984-01-17 1994-04-27 任天堂株式会社 Video game equipment
US4672541A (en) * 1984-05-31 1987-06-09 Coleco Industries, Inc. Video game with interactive enlarged play action inserts
US4891633A (en) * 1984-07-23 1990-01-02 General Research Of Electronics, Inc. Digital image exchange system
DE3632601A1 (en) * 1985-09-27 1987-04-23 Olympus Optical Co DEVICE FOR DISPLAYING A POSITION BRAND ON SEVERAL SCREENS
US4740779A (en) * 1986-04-16 1988-04-26 The Boeing Company Aircraft panoramic display
JPH0827604B2 (en) * 1986-06-18 1996-03-21 株式会社日立製作所 Image display system
JPH068993B2 (en) * 1987-02-05 1994-02-02 株式会社ナムコ Video display
US4949119A (en) * 1989-01-12 1990-08-14 Atari Games Corporation Gearshift for a vehicle simulator using computer controlled realistic real world forces
US5044956A (en) * 1989-01-12 1991-09-03 Atari Games Corporation Control device such as a steering wheel for video vehicle simulator with realistic feedback forces
US4960117A (en) * 1989-01-13 1990-10-02 Atari Games Corporation Rear entry booth and seat for a sit-down video game
US4969647A (en) * 1989-06-02 1990-11-13 Atari Corporation Invertible hand-held electronic game apparatus
US5015189A (en) * 1989-10-20 1991-05-14 Doron Precision Systems, Inc. Training apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2164301A (en) * 1984-09-15 1986-03-19 Timewell Properties Limited Simulating driving a motor vehicle
US4807202A (en) * 1986-04-17 1989-02-21 Allan Cherri Visual environment simulator for mobile viewer
US5005148A (en) * 1989-01-12 1991-04-02 Atari Games Corporation Driving simulator with moving painted dashboard
EP0443928A1 (en) * 1990-02-20 1991-08-28 Faros Training method and device for vehicle driving

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1993016776A1 (en) * 1992-02-24 1993-09-02 Hughes Aircraft Company Virtual image entertainment
FR2730842A1 (en) * 1995-02-17 1996-08-23 Renault Process for visualising images of adjustable size in field of view for motor vehicle driving simulator
EP1808205A2 (en) * 2006-01-06 2007-07-18 Kabushiki Kaisha Sega doing business as Sega Corporation Game apparatus and control method
EP1808205A3 (en) * 2006-01-06 2009-09-23 Kabushiki Kaisha Sega doing business as Sega Corporation Game apparatus and control method
US7815509B2 (en) 2006-01-06 2010-10-19 Kabushiki Kaisha Sega Game apparatus and control method
GB2442259A (en) * 2006-05-05 2008-04-02 Sony Comp Entertainment Europe Secondary display showing alternative viewpoint
GB2442259B (en) * 2006-05-05 2008-07-16 Sony Comp Entertainment Europe Display apparatus and method
DE202011000695U1 (en) * 2010-10-07 2011-09-02 XRMotion-Rüdiger Reuter GBR (vertretungsberechtigter Gesellschafter Herr Reuter 28329 Bremen) Transportable cockpit simulator
RU2695480C1 (en) * 2018-11-09 2019-07-23 Федеральное государственное унитарное предприятие "Государственный научно-исследовательский институт авиационных систем" (ФГУП "ГосНИИАС") Method of excluding the effect of separating an image by frames of monitors for visualizing the extra-cockpit environment of flight simulators

Also Published As

Publication number Publication date
JPH06508222A (en) 1994-09-14
US5275565A (en) 1994-01-04

Similar Documents

Publication Publication Date Title
US5275565A (en) Modular display simulator and method
KR100455689B1 (en) Method and apparatus for creating a virtual image
US5388990A (en) Virtual reality flight control display with six-degree-of-freedom controller and spherical orientation overlay
US5616079A (en) Three-dimensional games machine
EP0580729B1 (en) Vehicle simulator including cross-network feedback
KR100393504B1 (en) Object orientation control method and apparatus
EP0761267B1 (en) Driving game machine
EP0404381A2 (en) Real-time vehicle simulation
KR100280853B1 (en) Image processing method, image processing device and pseudo experience device
Liu et al. Some of what one needs to know about using head-mounted displays to improve teleoperator performance
US6483511B1 (en) Event simulator, and methods of constructing and utilizing same
US20030011619A1 (en) Synchronization and blending of plural images into a seamless combined image
JPH07253773A (en) Three dimentional display device
JPH09138637A (en) Pseudo visibility device
EP0368458A1 (en) Simulator apparatus
EP0845130B1 (en) Atmospheric effects simulation
JP3658421B2 (en) Vehicle simulation device
JPH08117440A (en) Three-dimensional simulator device and image synthesis method
CN113112888A (en) AR real scene interactive simulation driving method
DE102018000968B4 (en) Device for simulating moving real or fictitious objects
EP0237660A1 (en) Simulation device
WO2009075599A1 (en) Simulator
Laurell et al. The use of simulators for studies of driver performance
JP3638669B2 (en) Image composition method and game device
JP3217309B2 (en) A search method for virtual space using helicopter control metapore

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IT LU MC NL SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase