CN101163236B - A system and method for dynamically correcting parallax in head borne video systems - Google Patents

A system and method for dynamically correcting parallax in head borne video systems Download PDF

Info

Publication number
CN101163236B
CN101163236B CN2007101809367A CN200710180936A CN101163236B CN 101163236 B CN101163236 B CN 101163236B CN 2007101809367 A CN2007101809367 A CN 2007101809367A CN 200710180936 A CN200710180936 A CN 200710180936A CN 101163236 B CN101163236 B CN 101163236B
Authority
CN
China
Prior art keywords
video data
skew
video source
columns
wearing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2007101809367A
Other languages
Chinese (zh)
Other versions
CN101163236A (en
Inventor
T·K·特鲁多
B·R·多比
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Exelis Inc
Original Assignee
Exelis Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Exelis Inc filed Critical Exelis Inc
Publication of CN101163236A publication Critical patent/CN101163236A/en
Application granted granted Critical
Publication of CN101163236B publication Critical patent/CN101163236B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/24—Connectivity information management, e.g. connectivity discovery or connectivity update
    • H04W40/248—Connectivity information update
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0129—Head-up displays characterised by optical features comprising devices for correcting parallax
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/005—Discovery of network devices, e.g. terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks

Abstract

A dynamically corrected parallax system includes a head borne video source for imaging an object and providing video data. A controller electronically offsets the video data provided from the head borne video source to form offset video data. A display device receives the offset video data and displays the offset video data to a user's eye. The display device is configured for placement directly in front of the user's eye as a vision aid, and the head borne video source is configured for displacement to a side of the user's eye. The offset video data corrects parallax due to horizontal and/or vertical displacement between the display device and the head borne video source. The display device includes an X,Y array of respective columns and rows of pixels, and the offset video data includes an offset of a number of columns of pixels in the X direction of the X,Y array, and/or another offset of a number of rows of pixels in the Y direction of the X,Y array.

Description

Be used for dynamically proofreading and correct the system and method for the parallax of wearing video system
Technical field
Present invention relates in general to the system for parallax correction.More particularly, the present invention relates to for dynamically proofreading and correct the system and method for the parallax that directly is placed on user's head mounted display (HMD) at the moment.
Background technology
The visual aid that is worn on the head usually is located immediately at and receives auxiliary eyes front.To have moved to digital camera from the direct viewing optical path auxiliary due to these systems, thereby its system configuration requires head mounted display (HMD) is placed directly in the front that the user receives auxiliary eyes, and its eye relief is one inch.This placement to HMD has hindered the while directly to place camera aperture (aperture) in the front that receives auxiliary eyes.Camera aperture must be moved on to the front of HMD or move on to the side of HMD.
For example, if digital camera is placed on the 100mm place, optical axis side that accepts auxiliary eyes, set up displacement between showing at the image of the aperture of digital camera and digital camera so, display is placed centered by the optical axis of the eyes accepting to assist usually.This displacement has caused inconsistent between the physical location of the apparent position of the object of watching by video camera and the object seen in object space (or real space).With awareness to space and this deviation in object space be called parallax (parallax).
Fig. 1 provides the example of parallax.As shown in the figure, the user is by wearing video-unit environment of observation 10.The user has seen the in-plant instrument 12 that is in, and attempts picking up this instrument.Due to the effect of parallax, the awareness position of instrument 12 (perceived position) is incorrect.Instrument 14 represents the actual position of instruments 12 in object spaces by a dotted line.
In the situation that the user watches object by wearing video-unit, parallax has reduced the serviceability of video system.Psychology-vision system of people is got used to unintentionally by its natural entrance aperture, and namely the pupil of human eye comes the perception world.Hand-eye coordinate intrinsic in manual task is take this inherent characteristic as the basis.Common human motion task for example, is walked and running depends on this process of consciousness.The fixed system of eliminating the parallax at some fixed ranges place by aligning all will lose alignment in other all distances.Eliminating the parallax of the object of distant location by aiming at video system, but the user attempts another object to closely locating, for example, when the instrument shown in Figure 1 12 in user's arm scope in one's power of being in positioned, this problem was especially obvious.
As explanation hereinafter, the present invention will solve described problem of parallax experienced by a kind of system is provided, and described system is used for video image is dynamically harmonized (realigning) again, thereby image is all matched with real world in all distances.
Summary of the invention
In order to satisfy these needs and other needs and to consider its purpose, the invention provides a kind of system of dynamically proofreading and correct parallax, comprising:
Be used for the object imaging and the video source of wearing of video data be provided,
Be used for making the described described video data generation electronic form skew (electronically offsetting) that video source provides of wearing, with the controller of formation skew video data, and
The head-wearing display device that is used for receiving described skew video data and shows described skew video data to eyes of user,
Wherein, described head-wearing display device is configured to directly to be placed on the auxiliary as vision of described user at the moment, and the described video source of wearing is configured to exist displacement to the side of described eyes of user,
Described skew video data is proofreaied and correct the parallax that causes due to described head-wearing display device and described displacement of wearing between video source,
The optical axis direction of described eyes of user is by the described object extended distance D that wears the video source imaging,
The described optical axis of wearing the aperture of video source extends along the direction parallel with the optical axis of described eyes of user,
Described displacement to the side be horizontal displacement between the optical axis of the optical axis of described eyes of user in the Frankfort plane and the described aperture of wearing video source apart from d, and
Described skew video data is take described horizontal displacement apart from d with to the described distance B of described object as the basis.
Display unit comprises X, the Y array that is made of corresponding pixel column and pixel column, and the skew video data comprises that some pixel columns are along the skew of the directions X of X, Y array.Perhaps, the skew video data can comprise that some pixel columns are along the skew of the Y-direction of X, Y array.Described skew video data can also comprise another skew along the skew of the directions X of X, Y array and some pixel columns along the Y-direction of X, Y array of some pixel columns.
In addition, form following horizontal-shift angle θ D:
θ D=t an -1d/D，
Wherein, d is the horizontal displacement distance between the optical axis of aperture of the optical axis of eyes of user and video source.
Described display unit comprises X, the Y array that is made of corresponding pixel column and pixel column, and described skew is aobvious to be looked data and comprise following horizontal-shift:
offset columns=#Columns/FOV horz*θ D
Wherein, offset ColumnsThe horizontal offset of the unit of classifying as, FOV HorzBe the horizontal field of view of video source, #Columns is total columns of display unit.
In addition, also form vertical deviation angle D, wherein
φ D=t an -1d′/D，
Wherein, d ' is the vertical displacement distance between the optical axis of aperture of the optical axis of eyes of user and video source.The skew video data comprises following vertical shift:
offset rows＝#Rows/FOV vert*φ D
Wherein, offset RowsThe vertical offset with behavior unit, FOV VertBe the vertical field of view of video source, #Rows is the total line number in display unit.
Described system of dynamically proofreading and correct parallax comprise be arranged between described video source and display unit, be used for being converted into from the video data of described video source the demonstration electronic module of digital of digital video data.Described demonstration electronic module is configured to receive bias order and described digital of digital video data is revised as the skew video data from described controller.Described demonstration electronic module and described controller can be integrated in individual unit.The focal position encoder is connected to described controller, to determine to arrive the distance B by the object of described video source imaging, wherein, adopts distance B to proofread and correct parallax.
Described display unit can be helmet installing type display (helmet mounted display, HMD), or the part of wear-type night vision goggles.
Another embodiment of the present invention comprises a kind ofly dynamically proofreaies and correct the method for parallax for head mounted image-sensing machine (head borne camera) system, described head mounted image-sensing machine system has the video source of wearing and head-wearing display device, in described head mounted image-sensing machine system, described display device configurations is auxiliary as vision at the moment for being located immediately at the user, described video source is set to exist the displacement towards the eyes of user side, and described method comprises the steps:
(a) by described video source to the object imaging so that video data to be provided;
(b) determine to arrive the focusing distance of object;
(c) make described video data skew occur to form the skew video data based on the shift length between the aperture of the described focusing distance of determining in step (b) and described eyes of user and described video source; And
(d) show described skew video data by described display unit;
Wherein, make described video data skew by the described parallax of following offset correction,
offset columns=#Columns?/FOV horz*θ D
Wherein, offset ColumnsThe horizontal offset of the unit of classifying as,
FOV HorzThe described horizontal field of view of wearing video source, and
#Columns is the total columns in described display unit, and
θ D＝t an -1d/D。
Should be appreciated that above-mentioned generality explanation and detailed description hereinafter are exemplary, rather than the present invention is construed as limiting.
Description of drawings
Detailed description the present invention below reading in conjunction with the drawings will obtain best understanding.Accompanying drawing comprises:
Fig. 1 shows the geometric graph of the parallactic shift between the same object of seeing by the object of video camera imaging and observer in object space;
Fig. 2 is the block diagram of system that dynamic calibration is worn the parallax of video system that is used for according to the embodiment of the present invention;
Fig. 3 A is the top view by the object of video camera imaging that the user sees, wherein, the demonstration of image has produced from the aperture of video camera the displacement that equals the horizontal displacement distance;
Fig. 3 B is the end view by the object of video camera imaging that the user sees, wherein, the demonstration of image has produced from the aperture of video camera the displacement that equals the vertical displacement distance;
Fig. 4 be according to an embodiment of the invention, as the chart of the columns that need to be offset on display of the function of the viewing distance of interested object; And
Fig. 5 be according to an embodiment of the invention, as the chart of the columns that need to be offset on display of the function of the viewing distance of interested object, wherein, introduced offset angle (bias angle) in the angle of image of video camera.
Embodiment
As mentioned below, the present invention will dynamically aim at video image again, thereby image is all coincide with real world in all distances.In order to realize this purpose, the present invention determines the distance to attention object, thereby completes dynamic alignment based on determined distance.In one embodiment, the present invention adopts the absolute position (the perhaps angular orientation of Manual focusing knob) of camera focus mechanism to determine distance to the interested object of user, and the image that shows on the user display afterwards applies suitable parallax correction amount.In this way, the apparent position of interested object correctly is perceived as the physical location place in object space.
In one embodiment of the invention, provide video to the user on the numeric display unit such as LCD or light-emitting diode display.These displays are made of the array of pixel column and pixel column.By controlling to the timing of the video data of display transmission, the present invention introduces skew (offset) in described image when described image is shown to the user.By at display space bias internal image, the present invention has eliminated the apparent position of object and the difference between its physical location in object space.
The result of migrated image is to have lost pixel column and/or row along the image shift direction on display.Pixel column on the opposite edges of display and/or row show any intensity level, because (supposing to have man-to-man pixel resolution relation between video camera and display) these pixels no longer are in the visual field of video camera, therefore do not provide view data.Thereby migrated image has caused user's the dwindling of available field of view (field-of-view), because useful picture size has been dwindled.But, can realize assembling than the much closer distance in far field by video camera sighting angle (pointing angle) is set to, and this negative effect is being minimized.
Next with reference to figure 2, show the system that the parallax in video system is worn in dynamic calibration, generally by Reference numeral 20 expressions.System 20 comprises to showing that electronic module 24 provides the video source 23 of video data, shows that electronic module 24 is formed for the digital pixel data of watching on display unit 25.Also comprise focal position (focus position) encoder by Reference numeral 21 expressions in system 20, it is used for providing the focal position data to microcontroller 22.As shown in the figure, 21 pairs of focal position encoders are arranged on the orientation coding of the focus knob 26 on video source 23.Microcontroller 22 will be converted into X, Y offset control signal from the focal position data that position coder 21 receives, and will be explained it hereinafter.To showing that electronic module 24 provides X, Y offset control signal, show that 24 of electronic modules are provided for the skew video data of watching on display unit 25.
Will be appreciated that, video source 23 can be any camera head, and it is configured to be placed on the side of the optical axis of eyes of user.In the embodiment shown in Figure 2, video source 23 comprises Manual focusing knob 26, and it allows the user to adjust the lens of video camera, makes it to focus on interested object.Display unit 25 can be any display, and it is configured to place around the optical axis of eyes of user.Described display unit provides the offset pixels image of the image that is represented by the video data that receives from video source 23.X, the Y array of the pixel that shows on display unit 25 and can have man-to-man corresponding relation by the video data that video source 23 provides, perhaps can have any other relation, for example, by the corresponding relation that consists of between the display of decrease resolution and high-resolution camera.
As another embodiment, can control focus knob 26 by the motor (not shown), thereby realize the zoom lens operation of video source 23.In this embodiment, focal position encoder 21 can comprise Zoom lens barrel, to determine the focal length to interested object.Can comprise the focal length detection circuit, to survey and to export the focal length of Zoom lens barrel.As another embodiment, video source 23 can comprise rangefinder, infrared range-measurement system for example, and it can focus on infrared beam on target, and receives from the infrared beam of target reflection.The position sensitive apparatus that comprises in focal position encoder 21 can be surveyed the displacement of folded light beam, and the distance of described target or the code signal of position are provided.
Described microcontroller can be that the controller of any type of the processor executive capability that is provided by the software program that is stored in medium or hard wire (hardwired) program that is provided by integrated circuit are provided.Next the mode that microcontroller 22 calculates X, Y offset control signal will be described.
With reference to figure 3A and Fig. 3 B, it shows the video camera 23 that has been offset shift length (displacement distance) from eyes of user 32.Fig. 3 A and Fig. 3 B are mutually similar, just in Fig. 3 A, video camera 23 towards the horizontal right side horizontal displacement of eyes of user 32 apart from d, in Fig. 3 B, video camera 23 towards vertical side (or high or low) vertical displacement of eyes of user apart from d '.Described horizontal displacement distance and/or vertical displacement distance are in 100 millimeter usually.Video camera 23 has the optical axis by Reference numeral 37 expressions, and eyes of user has the optical axis by Reference numeral 35 expressions.As shown in the figure, two optical axises are parallel to each other.
The user is assisted by display unit 25 when watching object 31.As shown in Figure 3A, video camera 23 is with horizontal-shift angle θ DTo object 31 imagings.But in Fig. 3 B, video camera 23 is with vertical deviation angle φ DTo object 31 imagings.In two width figure, object 31 is shown as pixel image on display unit 25, watch for the user.Adjustable focusing distance is the distance B between eyes of user and interested object 31.
To adopt hereinafter Fig. 3 A that the method for calculating the X offset control signal by microcontroller 22 is illustrated.In this example, the unit of X skew is horizontal pixel, and it can be equivalent to the pixel column on video display 25.For the purpose of this example, suppose that horizontal displacement is 103mm apart from d; The field of view (FOV) of video camera 23 is along trunnion axis 40 degree (HFOV); The horizontal resolution of display unit 25 is 1280 pixels; The optical axis of video camera 23 is parallel to the optical axis of the eyes 32 of being assisted; The aperture of video camera is on observer's Frankfort plane, its be in a straight line without auxiliary eyes; Interested object 31 is in focusing distance D place.
Provided horizontal-shift angle θ by following equation (1) D:
θ D=t an -1D/D (equation 1)
Provided correction coefficient " C by following equation (2) Horz" (for 40 the degree FOV and the horizontal display resolution of 1280 pixels), its unit for row every degree
C horz＝#Columns/FOV horz
=1280/40 (equation 2)
=32 row/degree
Here, #Columns is sum or 1280 row (in this example) of row in digital display.By following equation 3 provided on the display unit image shift or with the side-play amount of the unit of classifying as, wherein, θ DThe sight line 36 of video camera and the horizontal-shift angle between camera optical axis 37.
Offset Columns=C Horz* θ D(equation 3)
Hereinafter, by similar mode, adopt Fig. 3 B that the method for calculating the Y offset control signal by microcontroller 22 is illustrated.In this example, the unit of Y skew is vertical pixel, and it can be equivalent to the pixel column on video display 25.For the purpose of this example, suppose that vertical displacement is 103mm apart from d '; The field of view (FOV) of video camera 23 is along vertical axis 30 degree (VFOV); The vertical resolution of display unit 25 is 1024 pixels; The optical axis of video camera 23 is parallel to the optical axis of the eyes 32 of being assisted; The aperture of video camera be on a vertical line without auxiliary eyes; Interested object 31 is in focusing distance D place.
Provide vertical deviation angle φ by following equation (4) D
φ D=t an -1D '/D (equation 4)
Provide correction coefficient C by following equation 5 Vert(for 30 the degree vertical FOV and the vertical display resolution of 1024 pixels), its unit for the row every degree,
C vert＝#Rows/FOV vert
=1024/30 (equation 5)
=34 row/degree
Here, #Rows is total line number or 1024 row (in this example) in digital display.By following equation 6 provided on the display unit image shift or with the side-play amount of behavior unit, wherein, φ DThe sight line 36 of video camera and the vertical deviation angle between camera optical axis 37.
Offset Rows=C Vert* φ D(equation 6)
Next with reference to figure 4, the skew that shows #columns is with respect to the chart of the relation of the distance between observer's (eyes of user) and observed object (interested object).More particularly, Fig. 4 has drawn out the required horizontal image skew that represents with columns of parallax that compensation causes by the horizontal displacement of 103mm between observer and video camera.For the video camera that is positioned at the right side of accepting auxiliary eyes, the parallax correction image shift in display is towards the right side.
Chart shown in Figure 4 is for the video camera/HMD system of coupling (matched) HFOV with 40 degree.Can find out, to more and more nearer Range Focusing, eliminate the required non-linear increase of image shift amount of parallax along with the observer.At the focusing distance place of 2 feet, 25% of the effective area of SXGA high resolution display will be moved out of the visual field, make thus effective demonstration HFOV reduce about 25%.Loss for fear of the HFOV of proximity focused distance can make the optical axis of video camera put towards left avertence, reduces thus horizontal-shift angle θ D
Can draw and the similar chart of chart shown in Figure 4 for the relation between the distance between the skew of #rows and observer's (eyes of user) and observed object (interested object).
At last, Fig. 5 shows the horizontal image skew that relies on the #columns that obtains with the identical hypothesis of doing for Fig. 4, but has introduced the offset angle of 4.8 degree here.Under this video camera visual angle, will eliminate the required display offset of parallax at 4 feet places and be reduced to zero.At 2 feet places, required skew is 152 row or 12% HFOV, it can be compared with 24% HFOV in Fig. 4.In the distance that surpasses 4 feet, display offset becomes negative value, and it shows must make video image towards opposite edge or the end offset of display.Thereby the parallax with contrary sign has been introduced at this video camera visual angle.For the focusing distance of 10 feet, the required horizontal display offset of compensation for parallax disparity is the HFOV of-93 row or 7.2%.The distance of 40 feet, horizontal display offset is the HFOV of 139 row or 11%.
Comprise that any camera chain of wearing of wearing night vision goggles and wearing the device that is situated between between reality (reality mediator device) all can adopt above-described embodiment.
Although with reference to specific embodiment, the present invention has been carried out diagram and text description, its intention is not to be to limit the invention to given details.On the contrary, in the scope that is equal to important document of claim, and can make in detail various changes in the case of without departing from the present invention.

Claims (19)

1. system of dynamically proofreading and correct parallax comprises:
Be used for the object imaging and the video source of wearing of video data be provided,
Be used for making the described described video data generation electronic form skew that video source provides of wearing, with the controller of formation skew video data, and
The head-wearing display device that is used for receiving described skew video data and shows described skew video data to eyes of user,
Wherein, described head-wearing display device is configured to directly to be placed on the auxiliary as vision of described user at the moment, and the described video source of wearing is configured to exist displacement to the side of described eyes of user,
Described skew video data is proofreaied and correct the parallax that causes due to described head-wearing display device and described displacement of wearing between video source,
The optical axis direction of described eyes of user is by the described object extended distance D that wears the video source imaging,
The described optical axis of wearing the aperture of video source extends along the direction parallel with the optical axis of described eyes of user,
Described displacement to the side be horizontal displacement between the optical axis of the optical axis of described eyes of user in the Frankfort plane and the described aperture of wearing video source apart from d, and
Described skew video data is take described horizontal displacement apart from d with to the described distance B of described object as the basis.
2. system of dynamically proofreading and correct parallax according to claim 1, wherein
Described display unit comprises X, the Y array of corresponding pixel column and pixel column, and
Described skew video data comprises along the skew of some pixel columns of the directions X of described X, Y array.
3. system of dynamically proofreading and correct parallax according to claim 1, wherein
Described display unit comprises X, the Y array of corresponding pixel column and pixel column, and
Described skew video data comprises along the skew of some pixel columns of the Y-direction of described X, Y array.
4. system of dynamically proofreading and correct parallax according to claim 1, wherein
Described display unit comprises X, the Y array of corresponding pixel column and pixel column, and
Described skew video data comprises along the skew of some pixel columns of the directions X of described X, Y-direction with along another skews of some pixel columns of the Y-direction of described X, Y array.
5. system of dynamically proofreading and correct parallax according to claim 1, wherein, following formation horizontal-shift angle θ D:
θ D=t an -1d/D，
Wherein, d is the horizontal displacement distance between the optical axis of the optical axis of described eyes of user and the described aperture of wearing video source, and
Described display unit comprises X, the Y array of corresponding pixel column and pixel column, and
Described skew video data comprises following horizontal-shift:
offset columns=#Columns/FOV horz*θ D
Wherein, offset ColumnsThe horizontal offset of the unit of classifying as,
FOV HorzThe described horizontal field of view of wearing video source, and
#Columns is the total columns in described display unit.
6. system of dynamically proofreading and correct parallax according to claim 1, wherein
Following formation vertical deviation angle θ D:
φ D=t an -1d′/D
Wherein, d ' is the vertical displacement distance between the optical axis of the optical axis of described eyes of user and the described aperture of wearing video source; And
Described display unit comprises X, the Y array of corresponding pixel column and pixel column, and
Described skew video data comprises following vertical shift:
offset rows＝#Rows?/FOV vert*φ D
Wherein, offset RowsThe vertical offset with behavior unit,
FOV VertThe described vertical field of view of wearing video source, and
#Rows is the total line number in described display unit.
7. system of dynamically proofreading and correct parallax according to claim 1, comprise
Be arranged between described video source and described display unit, be used for being converted into from the described video data of described video source the demonstration electronic module of digital of digital video data,
Wherein, described demonstration electronic module is configured to receive bias order and described digital of digital video data is revised as described skew video data from described controller.
8. system of dynamically proofreading and correct parallax according to claim 7, wherein
Described demonstration electronic module and described controller are integrated in individual unit.
9. system of dynamically proofreading and correct parallax according to claim 1, comprise
Be connected to described controller, be used for to determine to the focal position encoder by the distance B of the described object of wearing the video source imaging,
Wherein, adopt described distance B to proofread and correct described parallax.
10. system of dynamically proofreading and correct parallax according to claim 1, wherein
Described display unit is helmet installing type display (HMD).
11. system of dynamically proofreading and correct parallax according to claim 1, wherein
Described display unit and describedly wear the part that video source is the wear-type night vision goggles.
12. method of dynamically proofreading and correct parallax in having the head mounted image-sensing machine system of the video source worn and head-wearing display device, in described head mounted image-sensing machine system, described display device configurations is auxiliary as vision at the moment for being located immediately at the user, described video source is set to exist the displacement towards the eyes of user side, and described method comprises the steps:
(a) by described video source to the object imaging so that video data to be provided;
(b) determine to arrive the focusing distance D of object;
(c) make described video data skew occur to form the skew video data based on the horizontal displacement between the aperture of the described focusing distance of determining in step (b) and described eyes of user and described video source apart from d; And
(d) show described skew video data by described display unit;
Wherein, make described video data skew by the described parallax of following offset correction,
offset columns=#Columns/FOV horz*θ D
Wherein, offset ColumnsThe horizontal offset of the unit of classifying as,
FOV HorzThe described horizontal field of view of wearing video source, and
#Columns is the total columns in described display unit, and
θ D＝t an -1d/D。
13. method according to claim 12 wherein, adopts X, the Y array of described video data formation respective pixel row and pixel column, and
Step (c) comprises makes described video data move some pixel columns along the directions X of described X, Y array, to form described skew video data.
14. method according to claim 12 wherein, adopts X, the Y array of described video data formation respective pixel row and pixel column, and
Step (c) comprises makes described video data move some pixel columns along the Y-direction of described X, Y array, to form described skew video data.
15. method according to claim 12 wherein, adopts X, the Y array of described video data formation respective pixel row and pixel column, and
Step (c) comprises makes described video data move some pixel columns along the directions X of described X, Y array, and makes described video data move some pixel columns along the Y-direction of described X, Y array, to form described skew video data.
16. method according to claim 12, wherein
Step (a) comprises provides analog video data, and
Step (c) is converted to digital of digital video data with described analog video data before being included in and making described video data skew.
17. method according to claim 12, wherein
Described video source is configured to exist displacement towards the right side of described eyes of user, and
Described step (c) comprises that the image that makes described object is towards the skew of the right side of described display unit.
18. method according to claim 17, it comprises the following steps:
Make the aperture of described video source towards the optical axis biasing of described eyes of user, thereby make the side-play amount that produces in step (c) be down to minimum.
19. method according to claim 12, wherein
Step (b) comprises encodes to the angular orientation that is arranged on the focus knob on described video source, to determine the described focusing distance to described object.
CN2007101809367A 2006-10-10 2007-10-09 A system and method for dynamically correcting parallax in head borne video systems Expired - Fee Related CN101163236B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/545,644 2006-10-10
US11/545,644 US8130261B2 (en) 2006-10-10 2006-10-10 System and method for dynamically correcting parallax in head borne video systems

Publications (2)

Publication Number Publication Date
CN101163236A CN101163236A (en) 2008-04-16
CN101163236B true CN101163236B (en) 2013-05-08

Family

ID=39032336

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101809367A Expired - Fee Related CN101163236B (en) 2006-10-10 2007-10-09 A system and method for dynamically correcting parallax in head borne video systems

Country Status (7)

Country Link
US (1) US8130261B2 (en)
EP (1) EP1912392A2 (en)
JP (1) JP5160852B2 (en)
CN (1) CN101163236B (en)
AU (1) AU2007219287B2 (en)
CA (1) CA2604513A1 (en)
IL (1) IL186235A (en)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8648897B2 (en) * 2006-10-10 2014-02-11 Exelis, Inc. System and method for dynamically enhancing depth perception in head borne video systems
US9618748B2 (en) * 2008-04-02 2017-04-11 Esight Corp. Apparatus and method for a dynamic “region of interest” in a display system
ES2423989T3 (en) 2009-03-30 2013-09-26 The Boeing Company AD HOC mobile network
JP4875127B2 (en) * 2009-09-28 2012-02-15 パナソニック株式会社 3D image processing device
HU0900696D0 (en) * 2009-11-05 2009-12-28 Holakovszky Laszlo Binocular display device
CN102098442B (en) * 2010-12-24 2012-09-19 中国科学院长春光学精密机械与物理研究所 Method and system for calibrating non-overlap ratio of optical axis and visual axis of zoom camera
WO2013125138A1 (en) 2012-02-22 2013-08-29 ソニー株式会社 Display apparatus, image processing apparatus, image processing method, and computer program
CN103369212B (en) * 2012-03-28 2018-06-05 联想(北京)有限公司 A kind of image-pickup method and equipment
US9091849B2 (en) 2012-08-31 2015-07-28 Industrial Technology Research Institute Wearable display and adjusting method thereof
US9998687B2 (en) * 2012-09-12 2018-06-12 Bae Systems Information And Electronic Systems Integration Inc. Face mounted extreme environment thermal sensor system
CN102905076B (en) * 2012-11-12 2016-08-24 深圳市维尚境界显示技术有限公司 The device of a kind of 3D stereoscopic shooting Based Intelligent Control, system and method
US9619021B2 (en) 2013-01-09 2017-04-11 Lg Electronics Inc. Head mounted display providing eye gaze calibration and control method thereof
KR20140090552A (en) 2013-01-09 2014-07-17 엘지전자 주식회사 Head Mounted Display and controlling method for eye-gaze calibration
JP6314339B2 (en) * 2014-01-16 2018-04-25 コニカミノルタ株式会社 Eyeglass type display device
JP6347067B2 (en) * 2014-01-16 2018-06-27 コニカミノルタ株式会社 Eyeglass type display device
CN103901622B (en) * 2014-04-23 2016-05-25 成都理想境界科技有限公司 3D wears viewing equipment and corresponding video player
WO2016088227A1 (en) * 2014-12-03 2016-06-09 日立マクセル株式会社 Video display device and method
US10162412B2 (en) 2015-03-27 2018-12-25 Seiko Epson Corporation Display, control method of display, and program
WO2018010040A1 (en) * 2016-07-11 2018-01-18 王民良 Image reality augmentation method and surgical guide of applying same to wearable glasses
JP2018148257A (en) * 2017-03-01 2018-09-20 セイコーエプソン株式会社 Head mounted display device and control method for the same
WO2018190826A1 (en) 2017-04-12 2018-10-18 Hewlett-Packard Development Company, L.P. Transfer to head mounted display
CN107346175B (en) * 2017-06-30 2020-08-25 联想(北京)有限公司 Gesture position correction method and augmented reality display device
US11290942B2 (en) 2020-08-07 2022-03-29 Rockwell Collins, Inc. System and method for independent dominating set (IDS) based routing in mobile AD hoc networks (MANET)
US11726162B2 (en) 2021-04-16 2023-08-15 Rockwell Collins, Inc. System and method for neighbor direction and relative velocity determination via doppler nulling techniques
US11737121B2 (en) 2021-08-20 2023-08-22 Rockwell Collins, Inc. System and method to compile and distribute spatial awareness information for network
US11665658B1 (en) 2021-04-16 2023-05-30 Rockwell Collins, Inc. System and method for application of doppler corrections for time synchronized transmitter and receiver
US11296966B2 (en) 2019-11-27 2022-04-05 Rockwell Collins, Inc. System and method for efficient information collection and distribution (EICD) via independent dominating sets
TWI741536B (en) * 2020-03-20 2021-10-01 台灣骨王生技股份有限公司 Surgical navigation image imaging method based on mixed reality
CN111866493B (en) * 2020-06-09 2022-01-28 青岛小鸟看看科技有限公司 Image correction method, device and equipment based on head-mounted display equipment
US11037359B1 (en) * 2020-06-24 2021-06-15 Microsoft Technology Licensing, Llc Real-time rendering stylized passthrough images
US11646962B1 (en) 2020-10-23 2023-05-09 Rockwell Collins, Inc. Zero overhead efficient flooding (ZOEF) oriented hybrid any-cast routing for mobile ad hoc networks (MANET)
US11481960B2 (en) * 2020-12-30 2022-10-25 Meta Platforms Technologies, Llc Systems and methods for generating stabilized images of a real environment in artificial reality

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5500671A (en) * 1994-10-25 1996-03-19 At&T Corp. Video conference system and method of providing parallax correction and a sense of presence
CN2665738Y (en) * 2003-11-28 2004-12-22 王小光 Multipurpose image forming apparatus
CN1716081A (en) * 2005-07-22 2006-01-04 中国科学院上海光学精密机械研究所 Head carried type self lighting video photographic system
CN1721915A (en) * 2004-07-14 2006-01-18 文化传信科技（澳门）有限公司 Image display system and method thereof

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4398799A (en) * 1980-03-04 1983-08-16 Pilkington P.E. Limited Head-up displays
US6590573B1 (en) * 1983-05-09 2003-07-08 David Michael Geshwind Interactive computer system for creating three-dimensional image information and for converting two-dimensional image information for three-dimensional display systems
GB2189365A (en) * 1986-03-20 1987-10-21 Rank Xerox Ltd Imaging apparatus
US4924247A (en) * 1988-03-11 1990-05-08 Asahi Kogaku Kogyo Kabushiki Kaisha Apparatus and method for correcting and adjusting parallax in electronic camera
US5173726A (en) * 1991-06-04 1992-12-22 Eastman Kodak Company Automatic parallax correction in deploying lens camera
JPH09269528A (en) * 1996-01-31 1997-10-14 Canon Inc Camera with parallax correction function
US5787313A (en) * 1997-02-20 1998-07-28 Eastman Kodak Company Hybrid camera including viewfinder with masks for parallax correction and image format indication
CA2233047C (en) * 1998-02-02 2000-09-26 Steve Mann Wearable camera system with viewfinder means
JP3261115B2 (en) * 1999-09-22 2002-02-25 富士重工業株式会社 Stereo image processing device
US6560029B1 (en) * 2001-12-21 2003-05-06 Itt Manufacturing Enterprises, Inc. Video enhanced night vision goggle
JP2004289548A (en) * 2003-03-24 2004-10-14 Olympus Corp Image adjuster and head-mounted display device
JP4388790B2 (en) * 2003-11-06 2009-12-24 富士フイルム株式会社 Endoscope light source device socket
US7225548B2 (en) * 2004-05-17 2007-06-05 Sr2 Group, Llc System and method for aligning multiple sighting devices
CN101111748B (en) * 2004-12-03 2014-12-17 弗卢克公司 Visible light and ir combined image camera with a laser pointer
JP2006208451A (en) * 2005-01-25 2006-08-10 Konica Minolta Photo Imaging Inc Video display device
US20060250322A1 (en) * 2005-05-09 2006-11-09 Optics 1, Inc. Dynamic vergence and focus control for head-mounted displays

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5500671A (en) * 1994-10-25 1996-03-19 At&T Corp. Video conference system and method of providing parallax correction and a sense of presence
CN2665738Y (en) * 2003-11-28 2004-12-22 王小光 Multipurpose image forming apparatus
CN1721915A (en) * 2004-07-14 2006-01-18 文化传信科技（澳门）有限公司 Image display system and method thereof
CN1716081A (en) * 2005-07-22 2006-01-04 中国科学院上海光学精密机械研究所 Head carried type self lighting video photographic system

Also Published As

Publication number Publication date
AU2007219287A1 (en) 2008-04-24
CN101163236A (en) 2008-04-16
AU2007219287B2 (en) 2013-08-01
JP2008134616A (en) 2008-06-12
US20080084472A1 (en) 2008-04-10
US8130261B2 (en) 2012-03-06
CA2604513A1 (en) 2008-04-10
EP1912392A2 (en) 2008-04-16
IL186235A (en) 2013-01-31
IL186235A0 (en) 2008-01-20
JP5160852B2 (en) 2013-03-13

Similar Documents

Publication Publication Date Title
CN101163236B (en) A system and method for dynamically correcting parallax in head borne video systems
US8648897B2 (en) System and method for dynamically enhancing depth perception in head borne video systems
US11223820B2 (en) Augmented reality displays with active alignment and corresponding methods
US20200120329A1 (en) Augmented reality displays with active alignment and corresponding methods
US10466484B1 (en) Compact head-mounted display for artificial reality
JP6243398B2 (en) Projection display and whole image projection method
US20150198808A1 (en) Image display apparatus and method for displaying image
KR100711199B1 (en) Lenticular misalignment detection and corresponding image distortion compensation in 3D lenticular displays
US20190227322A1 (en) Light projection system including an optical assembly for correction of differential distortion
JP2017003981A (en) Display device and method for operating display device
WO2007069099A3 (en) Optical system for 3-dimensional display
CN103533340A (en) Naked eye 3D (three-dimensional) playing method of mobile terminal and mobile terminal
US7511684B2 (en) Image alignment method for binocular eyewear displays
CN109855845A (en) A kind of binocular measures vehicle-mounted HUD virtual image distance and modification method
US20210241667A1 (en) Display unit
KR100837259B1 (en) A 3D image multiplexing scheme compensating for lens alignment errors and viewing location change in 3D monitor
US11069140B2 (en) Display panel, display device, and virtual reality/augmented reality device
US20160217613A1 (en) Extendable eyecups for a virtual reality headset
US10303211B2 (en) Two part cone display using flexible substrates
US20210051315A1 (en) Optical display, image capturing device and methods with variable depth of field
US20110317262A1 (en) Optical Film and Stereoscopic Display Using the Same
JP2002162194A (en) Day and night sighting instrument for small arms
US20230093023A1 (en) Stereoscopic display device and display method thereof
US20220400247A1 (en) Augmented reality display device and method
CN113777783B (en) Binocular augmented reality system with alignment correction and alignment correction method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: ANLISHI COMPANY

Free format text: FORMER OWNER: ITT MANUFACTURING ENTERPRISES, INC.

Effective date: 20120821

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20120821

Address after: American Virginia

Applicant after: EXELIS, INC.

Address before: American Delaware

Applicant before: ITT Mfg. Enterprises, Inc.

C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130508

Termination date: 20151009

EXPY Termination of patent right or utility model