CN105425526A - Three-dimensional scene obtaining device based multiple plane mirrors - Google Patents
Three-dimensional scene obtaining device based multiple plane mirrors Download PDFInfo
- Publication number
- CN105425526A CN105425526A CN201510751327.7A CN201510751327A CN105425526A CN 105425526 A CN105425526 A CN 105425526A CN 201510751327 A CN201510751327 A CN 201510751327A CN 105425526 A CN105425526 A CN 105425526A
- Authority
- CN
- China
- Prior art keywords
- plane mirror
- camera
- dimensional scene
- plane
- acquisition device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
- G03B35/08—Stereoscopic photography by simultaneous recording
- G03B35/10—Stereoscopic photography by simultaneous recording having single camera with stereoscopic-base-defining system
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Image Input (AREA)
- Studio Devices (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a three-dimensional scene obtaining device based multiple plane mirrors, and the device employs a camera and a plurality of plane mirrors for obtaining a three-dimensional scene. Compared with an active three-dimensional scene obtaining device, the device is high in scene obtaining speed, and is not affected by the illumination nonuniformity of an environment. Compared with a light field obtaining system, the device employs the plurality of plane mirrors in a spatial coding process, and the plane mirrors do not introduce new optical aberration and do not reduce the light transmission, thereby causing no impact on an imaging effect. Meanwhile, the device provided by the invention is convenient to carry and machine, and a light field obtaining region is not limited by the size of an entrance pupil of a camera, thereby facilitating the adjustment of the light field obtaining region according to the specific needs. According to the device, the device can be used for man-machine interaction, the reconstruction of the three-dimensional scene, and the target recognition and tracking.
Description
Technical field
The present invention relates to three-dimensional reconstruction field, particularly relate to a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror.
Background technology
In recent years become hot product for the three-dimensional scenic acquisition device of man-machine interaction, 3 D scene rebuilding, target recognition and tracking owing to providing the depth information of three-dimensional scenic.Three-dimensional scenic display device can be applied to as entertainment applications such as somatic sensation television game, film special effect makings, also can be applied to as high-end applications such as scientific research, medical treatment/professional training, flight training, immersion amusements.
Three-dimensional scene information acquisition methods can use initiatively three-dimensional measurement to realize, the method utilizes to three-dimensional body projective structure encoded light and the image that its surface modulation deforms is passed through in shooting, utilizes the method for the appearance information calculating three-dimensional body in the image of carrying object surface three dimension information.Based on this method, comprise SteinbiehleGmbH company, three-dimensional Science and Technology Ltd. far away of GOMGmbH company and sky, Beijing etc. and invented multiple spatial digitizer in order to obtain the profile information of three-dimensional scenic, the method is always for industrial detection, historical relic reconstruction, anthropological measuring field.Microsoft answers the demand of XBOX360 somatic sensation television game to be proposed kinect body sense camera, utilizes initiatively Emission Lasers encoded light, and carries out fast decoding, obtain the spatial scene degree of depth, and the time causes the extensive concern of industry and consumer.But, the three-dimensional scenic acquisition device of this structure based encoded light can only provide the depth information of three-dimensional scenic, and there is very large requirement owing to carrying out again after its active illuminating obtaining for ambient lighting conditions, in outdoor environment or remote scene effect bad.
The acquisition of three-dimensional scenic and the method for reconstruction are the important research contents of computer realm, and develop this important subject direction of computer vision, cause the extensive concern of China and foreign countries' research work all the time, initial scientific worker copys the method for the different anaglyph of acquisition of mankind's binocular, there is the image of parallax in the shooting of different viewpoint same object by video camera, be similar to the interpupillary distance of human eye, the distance of different points of view is called as baseline, by the three-dimensional information having the image of parallax to calculate scene, the method is also referred to as stereoscopic vision.The flow process of the implementation method of stereoscopic vision comprises camera calibration, anaglyph acquisition, feature point extraction, Stereo matching, the degree of depth are asked for and six processes such as interpolation fitting.Three-dimensional scenic surface to all the winds emission of light, these light forms light field, along with the development of computing technique, photoelectric technology and processing and manufacturing technology, people have been not content with the acquisition of simple depth image for the demand of the acquisition of three-dimensional information, the comprehensive information of three-dimensional scenic is needed in actual application, therefore, light field three dimensional acquisition method is arisen at the historic moment.
Levoy and Hanrahan in 1996 proposes to be realized by the video camera array being evenly distributed on a plane, and the research institutions such as Massachusetts Polytechnics, Tsing-Hua University, University of Southern California design according to this thought and achieve light filed acquisition platform.These light filed acquisition platforms are made up of multiple cameras, volume and cost all limit the development of this type systematic, Liang devises dynamic coding aperture in order to replace mechanical movement, dynamic change coded aperture achieves light field space scanning, but owing to adopting time-multiplexed method, system cannot obtain dynamic optical field information.The field information of the four-dimension is recorded on the video camera of two dimension by the mode that Ives and Lippmann you can well imagine out use grating and integrated photography 1903 and 1908 fraction of the year, and this is that follow-up research workers provide the record being realized light field by the mode of space encoding.Microlens array is placed between camera lens and optical sensor by Stanford University doctor Ng, analyzes the three-dimensional rebuilding method of spatial domain and frequency domain, realizes portable Lytro light-field camera and introduces to the market; Raytrix company also applies microlens array and releases Raytrix light-field camera.Except microlens array, microwell array equally can implementation space coding function, the people such as Veeraraghavan 2007 according to optical heterodyne technical design sinusoidal and coded aperture, the spectrum information of four-dimensional light field to be recorded on two-dimension optical sensor and to use four-dimensional Fourier transform that the image after coding is carried out light field recovery by this space encoder.Brown Univ USA doctor Lanman is optimized on the basis in spectrum coding aperture, the even redundant array of utilization amendment (
edUniformlyRedundantArrays, MURA) replace traditional coding structure, labor microwell array, sine and array and MURA array structure, add optical transmittance.The mode of existing usage space coding realizes the record of light field, and microlens array can introduce new optical aberration, and the use of encoding array can reduce optical transmittance, in fact adds the F number of main lens, all can reduce the quality of image.
Summary of the invention
In view of this, the invention provides a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror, three-dimensional scenic can be obtained easily, reduce and realize difficulty.
In order to solve the problems of the technologies described above, the present invention is achieved in that
A kind of Portable three-dimensional scene acquisition device based on multiple plane mirror of the present invention, comprises camera (1) and N number of plane mirror (2); N at least gets 4;
Described N number of plane mirror (2) respectively to three-dimensional body imaging to be captured, become the virtual image to be positioned at described camera (1) visual field;
Described camera (1) is taken the described virtual image, and the N number of image obtained is in order to obtain three-dimensional scenic.
Further, the supporting construction (3) for fixing described N number of plane mirror (2) is also comprised.
Preferably, described N number of plane mirror (2) is spliced compactly in described supporting construction (3).
Preferably, do not block between plane mirror (2) between two in N number of plane mirror (2).
Preferably, plane mirror (2) meets with the relative position of described camera (1): camera (1) does not enter in the visual field of self in the virtual image of each plane mirror (2).
Preferably, described N gets 4, and 4 plane mirrors (2) are stitched together with the form of 2 × 2 arrays in described supporting construction (3).
Preferably, described N gets 20, and 20 plane mirrors (2) are stitched together with the form of 4 × 5 arrays in described supporting construction (3).
The present invention has following beneficial effect:
(1) the invention provides a kind of three-dimensional scenic acquisition device based on multiple plane mirror, adopt a camera and multiple plane mirror, can three-dimensional scenic be obtained.Compared to active three-dimensional scenic acquisition device, scene acquisition speed is fast, does not affect by aspects such as the uneven illumination of environment are even; Relative to light filed acquisition system, owing to using multiple plane mirror in spatial encoding process, and new optical aberration do not introduced by plane mirror and do not reduce logical light rate, thus do not affect imaging effect; Device provided by the invention is convenient to carry and process simultaneously, and the region of light filed acquisition, not by the restriction of camera entrance pupil size, conveniently adjusts the region of light filed acquisition according to concrete demand.Man-machine interaction, 3 D scene rebuilding, target recognition and tracking is can be applicable to according to the acquisition device of three-dimensional scenic of the present invention.
Accompanying drawing explanation
Fig. 1 is a kind of Portable three-dimensional scene acquisition device structural representation based on multiple plane mirror of the present invention.
Fig. 2 is the location diagram of camera in the present invention, many plane mirrors and three-dimensional body to be captured.
Fig. 3 is the space three-dimensional light field image that in the first case study on implementation of the present invention, camera obtains.
Fig. 4 is the device that the present invention is based on embodiment 1, uses digital refocusing technology to realize focusing on the effect of three-dimensional scenic different depth.
Fig. 5 is the structural representation based on the Portable three-dimensional scene acquisition device of multiple plane mirror in the second case study on implementation of the present invention.
Wherein, 1-camera, 2-plane mirror, 3-supporting construction, 4-three-dimensional body to be captured.
Embodiment
To develop simultaneously embodiment below in conjunction with accompanying drawing, describe the present invention.
The object of this invention is to provide a kind of three-dimensional scenic acquisition device based on multiple plane mirror 2, comprise camera 1 and N number of plane mirror 2; N at least gets 4.N number of plane mirror 2 respectively to three-dimensional body 4 imaging to be captured, become the virtual image to be positioned at described camera 1 visual field; Described camera 1 is taken the described virtual image, and the N number of image obtained is in order to obtain three-dimensional scenic.For convenience of installing, device of the present invention also comprises the supporting construction 3 for fixing described N number of plane mirror 2, and plane mirror 2 splices compactly in supporting construction 3.
This device is compared to active three-dimensional scenic acquisition device, and scene acquisition speed is fast, does not affect by aspects such as the uneven illumination of environment are even; Relative to light filed acquisition system, owing to using multiple plane mirror 2 in spatial encoding process, and new optical aberration do not introduced by plane mirror 2 and do not reduce logical light rate, thus do not affect imaging effect; Method provided by the invention is portable is simultaneously easy to processing, and the region of light filed acquisition, not by the restriction of camera 1 entrance pupil size, conveniently adjusts the region of light filed acquisition according to concrete demand.The present invention propose device may be used for man-machine interaction, 3 D scene rebuilding, target recognition and tracking three-dimensional scenic acquisition device be in recent years become hot product owing to providing the depth information of three-dimensional scenic.Three-dimensional scenic display device can be applied to as entertainment applications such as somatic sensation television game, film special effect makings, also can be applied to as high-end applications such as scientific research, medical treatment/professional training, flight training, immersion amusements.
In order to make those skilled in the art understand technical scheme of the present invention better, below in conjunction with accompanying drawing and concrete case study on implementation, the present invention is described in further detail.
The coordinate system of Portable three-dimensional scene acquisition device provided by the invention is defined as: make the position of camera 1 photocentre be true origin O, optical axis direction is Z axis, crossing the rectangular image plane definition that O point is parallel to camera 1 is OXY plane, and wherein X-axis and Y-axis are parallel to two adjacent edges of described rectangular image plane respectively.
Fig. 1 shows the Portable three-dimensional scene acquisition device based on multiple plane mirror 2 according to a first embodiment of the present invention, camera 1 is positioned at true origin, 20 plane mirrors 2 define the plane reflection lens array of 4 × 5 in space, this plane reflection lens array is fixed in supporting construction 3, and and ensure rational relativeness between camera 1, using camera 1 as viewpoint, multiple plane mirror 2 does not block mutually, make the minute surface of catoptron 2 all be used for reflecting three-dimensional body, avoid waste minute surface resource; In like manner, camera 1 does not see self by any one plane mirror 2, makes the visual field of camera 1 be used for receiving reflection ray as far as possible.Camera 1 forms 20 virtual images by 20 plane mirrors 2, and be equivalent to employing 20 virtual cameras and take simultaneously, camera 1 obtains 20 width images simultaneously.Distribution in space, can obtain for the light field of space three-dimensional scene.Fig. 2 shows camera 1 in the first case study on implementation, space three-dimensional object 4 and plane mirror 2 location diagram.In a kind of embodiment, the field angle of camera 1 is 67.5 ° × 40 °, the photocentre position of each virtual camera is in same plane, and the field angle of virtual camera is 12.5 ° × 10 °, and the optical axis direction of each virtual camera is vertical and parallel with the optical axis direction of camera 1.Each level crossing is quadrilateral, and four summits of quadrangular plan catoptron 2 represent with M1, M2, M3 and M4 respectively, and its X, Y, Z coordinate figure is as shown in the table, and wherein, the unit of coordinate figure is millimeter:
The Portable three-dimensional scene acquisition device based on multiple plane mirror 2 of the first case study on implementation is utilized to obtain three-dimensional scene information, Fig. 3 shows the space three-dimensional light field image that the first case study on implementation camera 1 obtains, Fig. 4 gives and uses digital refocusing technology, realizes the design sketch focusing on three-dimensional scenic different depth.
Fig. 2 shows the Portable three-dimensional scene acquisition device based on multiple plane mirror 2 according to a second embodiment of the present invention, camera 1 is positioned at true origin, four plane mirrors 2 define the plane reflection lens array of 2 × 2 in space, this plane reflection lens array is fixed on mechanical support structure 3, and and ensure rational relativeness between camera 1, using camera 1 as viewpoint, multiple plane mirror 2 does not block mutually, and camera 1 does not see self by any one catoptron simultaneously.Camera 1 forms 4 virtual images by four plane mirrors 2, and distribution in space, can obtain for the light field of space three-dimensional scene.In second all embodiments, the field angle of camera 1 is 67.5 ° × 40 °, and the photocentre position of each virtual camera is in same plane, and field angle is equal, and the optical axis direction of each virtual camera is vertical and parallel with the optical axis direction of camera 1.Each level crossing is quadrilateral, and four summits of quadrilateral are M1, M2, M3, M4, and its X, Y, Z coordinate figure is as shown in the table, and the unit of coordinate figure is millimeter:
In sum, these are only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (9)
1. based on a Portable three-dimensional scene acquisition device for multiple plane mirror, it is characterized in that, comprise camera (1) and N number of plane mirror (2); N at least gets 4;
Described N number of plane mirror (2) respectively to three-dimensional body imaging to be captured, become the virtual image to be positioned at described camera (1) visual field;
Described camera (1) is taken the described virtual image, and the N number of image obtained is in order to obtain three-dimensional scenic.
2. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, is characterized in that, also comprises the supporting construction (3) for fixing described N number of plane mirror (2).
3. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 2, it is characterized in that, described N number of plane mirror (2) is spliced compactly in described supporting construction (3).
4. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, is characterized in that, do not block between two in N number of plane mirror (2) between plane mirror (2).
5. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, it is characterized in that, plane mirror (2) meets with the relative position of described camera (1): camera (1) does not enter in the visual field of self in the virtual image of each plane mirror (2).
6. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, it is characterized in that, described N gets 4, and 4 plane mirrors (2) are stitched together with the form of 2 × 2 arrays in described supporting construction (3).
7. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 6, it is characterized in that, the position of camera (1) photocentre is made to be true origin O, optical axis direction is Z axis, crossing the rectangular image plane definition that O point is parallel to camera (1) is OXY plane, and wherein X-axis and Y-axis are parallel to two adjacent sides of described rectangular image plane respectively; Four summits of the plane mirror (2) of quadrilateral represent with M1, M2, M3 and M4 respectively, then X, Y and Z coordinate figure on 4 summits of 4 plane mirrors (2) is as shown in the table, and wherein, the unit of coordinate figure is millimeter:
8. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, it is characterized in that, described N gets 20, and 20 plane mirrors (2) are stitched together with the form of 4 × 5 arrays in described supporting construction (3).
9. a kind of Portable three-dimensional scene acquisition device based on multiple plane mirror as claimed in claim 1, it is characterized in that, the position of camera (1) photocentre is made to be true origin O, optical axis direction is Z axis, crossing the rectangular image plane definition that O point is parallel to camera (1) is OXY plane, and wherein X-axis and Y-axis are parallel to two adjacent sides of described rectangular image plane respectively; Four summits of the plane mirror (2) of quadrilateral represent with M1, M2, M3 and M4 respectively, then X, Y and Z coordinate figure on 4 summits of 20 plane mirrors (2) is as shown in the table, and wherein, the unit of coordinate figure is millimeter:
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510751327.7A CN105425526B (en) | 2015-11-06 | 2015-11-06 | A kind of three-dimensional scenic acquisition device based on multiple plane mirrors |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510751327.7A CN105425526B (en) | 2015-11-06 | 2015-11-06 | A kind of three-dimensional scenic acquisition device based on multiple plane mirrors |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105425526A true CN105425526A (en) | 2016-03-23 |
| CN105425526B CN105425526B (en) | 2018-09-28 |
Family
ID=55503822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510751327.7A Active CN105425526B (en) | 2015-11-06 | 2015-11-06 | A kind of three-dimensional scenic acquisition device based on multiple plane mirrors |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105425526B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| NL9401389A (en) * | 1994-08-29 | 1996-04-01 | Nedap Nv | Recording system and image-processing system for object recognition or distance measurement |
| JP2005221686A (en) * | 2004-02-05 | 2005-08-18 | View Magic:Kk | Stereoscopic screen constitution, adjustment method and apparatus therefor |
| US20100226114A1 (en) * | 2009-03-03 | 2010-09-09 | David Fishbaine | Illumination and imaging system |
| CN201641974U (en) * | 2009-02-19 | 2010-11-24 | 广州中科恺盛医疗科技有限公司 | Multi-angle imaging device |
| CN201641972U (en) * | 2009-02-19 | 2010-11-24 | 广州中科恺盛医疗科技有限公司 | Three-dimensional imaging data acquisition unit |
-
2015
- 2015-11-06 CN CN201510751327.7A patent/CN105425526B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| NL9401389A (en) * | 1994-08-29 | 1996-04-01 | Nedap Nv | Recording system and image-processing system for object recognition or distance measurement |
| JP2005221686A (en) * | 2004-02-05 | 2005-08-18 | View Magic:Kk | Stereoscopic screen constitution, adjustment method and apparatus therefor |
| CN201641974U (en) * | 2009-02-19 | 2010-11-24 | 广州中科恺盛医疗科技有限公司 | Multi-angle imaging device |
| CN201641972U (en) * | 2009-02-19 | 2010-11-24 | 广州中科恺盛医疗科技有限公司 | Three-dimensional imaging data acquisition unit |
| US20100226114A1 (en) * | 2009-03-03 | 2010-09-09 | David Fishbaine | Illumination and imaging system |
Non-Patent Citations (1)
| Title |
|---|
| 冯晓锋，潘迪夫: "基于平面镜成像的单摄像机立体视觉传感器研究", 《光学学报》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105425526B (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Song et al. | Light f ield head-mounted display with correct focus cue using micro structure array | |
| Balram et al. | Light‐field imaging and display systems | |
| Papadhimitri et al. | Uncalibrated near-light photometric stereo | |
| US7796152B2 (en) | Multi-dimensional imaging | |
| Jones et al. | Interpolating vertical parallax for an autostereoscopic three-dimensional projector array | |
| US20180048883A1 (en) | Image display apparatus and image display method | |
| CN105184800A (en) | Automatic three-dimensional mapping projection system and method | |
| Luo et al. | Pepper's Cone: An Inexpensive Do-It-Yourself 3D Display | |
| Wilm et al. | Accurate and simple calibration of DLP projector systems | |
| CN104113747A (en) | Image acquisition and pseudo 3D display system based on binocular vision | |
| Iseringhausen et al. | 4D imaging through spray-on optics | |
| Yue et al. | Accurate three dimensional body scanning system based on structured light | |
| Osato et al. | Compact optical system displaying mid-air images movable in depth by rotating light source and mirror | |
| Hong et al. | Towards 3D television through fusion of kinect and integral-imaging concepts | |
| CN111308698B (en) | Directional display screen, induction type three-dimensional display device and display method thereof | |
| Ayaz et al. | Multiview registration-based handheld 3D profiling system using visual navigation and structured light | |
| Song et al. | Light field acquisition using a planar catadioptric system | |
| CN105425526A (en) | Three-dimensional scene obtaining device based multiple plane mirrors | |
| Tompkin et al. | Joint 5d pen input for light field displays | |
| Farber et al. | Spectral light fields for improved three-dimensional profilometry | |
| Soomro et al. | Integrated 3D display and imaging using dual purpose passive screen and head-mounted projectors and camera | |
| Bazeille et al. | Light-field image acquisition from a conventional camera: design of a four minilens ring device | |
| Hsu et al. | HoloTube: a low-cost portable 360-degree interactive autostereoscopic display | |
| Zhou et al. | 3D reconstruction from structured light field by Fourier transformation profilometry | |
| CN112087616A (en) | Method, apparatus and computer readable medium for generating two-dimensional light field image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |