US20040041996A1 - Range finder and method - Google Patents
Range finder and method Download PDFInfo
- Publication number
- US20040041996A1 US20040041996A1 US10/373,761 US37376103A US2004041996A1 US 20040041996 A1 US20040041996 A1 US 20040041996A1 US 37376103 A US37376103 A US 37376103A US 2004041996 A1 US2004041996 A1 US 2004041996A1
- Authority
- US
- United States
- Prior art keywords
- camera
- stripe pattern
- projector
- pattern
- projected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/593—Depth or shape recovery from multiple images from stereo images
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/04—Interpretation of pictures
- G01C11/06—Interpretation of pictures by comparison of two or more pictures of the same area
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
- G01C3/08—Use of electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
Abstract
Pattern projection apparatuses are placed on each other in a stack manner in a stripe pattern direction for projecting the same patterns. An image pickup apparatus (camera 1) is placed between the pattern projection apparatuses. The optical axes of the pattern projection apparatuses and the image pickup apparatus are aligned on the same plane parallel with the stripe pattern direction. On the plane, the principal points also become the same. An image of a stripe pattern is picked up directly by the image pickup apparatus without the intervention of a half mirror, etc., and is recoded. An image of the recoded stripe pattern is picked up by an image pickup apparatus (camera 2) and is decoded and the range of an object is measured by triangulation based on image correspondence points.
Description
- The present disclosure relates to the subject matter contained in Japanese Patent Application No. 2002-248034 filed on Aug. 28, 2002, which is incorporated herein by reference in its entirety.
- 1. Field of the Invention
- The invention relates to a three-dimensional image pickup art based on a triangulation technique for picking up a pattern projection image provided by applying pattern light to a measurement object from different directions by one or a plurality of image pickup device and obtaining a range data based on pattern change.
- 2. Description of the Related Art
- As a technique of acquiring a three-dimensional shape, active vision and passive vision are available. The active vision includes (1) a technique of emitting laser light or a ultrasonic wave, measuring reflected light amount from an object or arrival time at the object, and extracting depth information, (2) a pattern projection method of using a special pattern light source such as stripe light to estimate an object shape from image information such as geometric change of an object surface pattern, (3) a method of forming contour lines based on moire fringes by optical processing and obtaining three-dimensional information. On the other hand, the passive vision includes monocular stereoscopic viewing for estimating three-dimensional information from one image using knowledge concerning object viewing, light source, lighting, shadow information and the like, and twin-lens stereoscopic viewing for estimating depth information of each pixel based on the triangulation principle.
- Generally, the active vision has higher measurement accuracy than the passive vision, but often has a small measurement range because of limit of a light projection device and the like. On the other hand, the passive vision is a general-purpose technique and has less restriction on an object. The invention relates to the pattern projection method of a range finder of the active vision.
- In the pattern projection method, reference pattern light is projected onto an object and an image is picked up from a different direction from a projection direction of the reference pattern light. The picked-up pattern image is deformed by the shape of the object. The observed deformation pattern and the projection pattern are related to each other, whereby range finding on the object can be conducted. The pattern projection method involves a problem of how to lessen erroneous correspondence in relating the deformation pattern and the projection pattern to each other and easily relate the deformation pattern and the projection pattern to each other. Then, various pattern projection techniques (space coding method, moire, color coding) have been proposed.
- As a typical example of the space coding, a proposition disclosed in JP-A-5-3327375 will be discussed. An apparatus in the example has a laser light source, a lens system, a scanner, a camera, and a controller. The lens system shapes laser light into a slit form. The scanner applies and scans the shaped laser light to and over an object. The camera detects reflected light from the object. The controller controls the components.
- Laser light application portions and laser light non-application portions form stripes on the object by the laser light scanned from the scanner. As the laser light is applied according to different patterns, the object is divided into N identifiable portions. It is determined which division portion each pixel of the image of the object picked up by the camera from different positions is contained in, whereby the shape of the object can be calculated.
- In the example, to raise the resolution, it becomes necessary to perform laser scanning two or more times and pick up an image by the camera two or more times. For example, when a full screen is divided into 256 regions (256 resolution levels), it becomes necessary to pick up an image eight times. Thus, it becomes difficult to pick up an image of an object moving fast and further the image pickup system needs to be reliably fixed during scanning. Therefore, even if the apparatus itself becomes simple, it is difficult to easily pick up an image.
- As a technique for decreasing number of pattern light projection times, a color coding method disclosed in JP-A-3-192474 is available. In the color coding, letting q and k be predetermined natural numbers of two or more, a coded pattern is controlled so that using q or more colors, two adjacent stripe light beams do not become the same color and color alignment produced by k adjacent stripe light beams appears only once. Stripe colors are detected from the observed image. Stripe numbers are acquired from the color alignment of the corresponding stripes. The stripe application directions can be calculated from the stripe numbers and the range data can be calculated as with the example of the space coding.
- However, in the color coding, codes are restored from the coding pattern list and thus there is a problem of large calculation amount of restoring the codes. Further, in a case of dividing an area into 256 regions using three colors of R, G, and B, it is necessary to know alignment of eight stripe light beams surrounding the stripe whose code is to be known. Therefore, the color coding suits only for measurement of a shape in which stripes can be continuously long observed.
- As a technique for easily restoring stripes and further projecting a coded pattern once, a space coding method disclosed in Japanese Patent No.2565885 is available. In Japanese Patent No.2565885, there are provided three or more kinds of gradation areas using light and shade of a ternary value or more, or three or more colors, or a combination of light and shade with color. Also provided is a multi-valued lattice plate pattern disposed so that at least three kinds of gradation areas contact one another at an intersection point of boundary lines of the gradation areas. Main codes, which conform to the kind and order of gradations, are generated at an intersection point of projected images resulting from projection of pattern to an object to be measured, to touch the intersection point. A combined code obtained by combining the main codes with each other is used as a feature code for identification of the previous intersection point.
- However, in the above described system, coding is broken depending on the object to be measured and it may be made impossible to correctly relate codes to each other. Projected pattern row may be recognized with missing pattern row photographed by a camera or an inverted pattern row may be obtained depending on the structure of the photographed object. It becomes difficult to relate because of change in the projected pattern and photographed pattern row depending on the shape of the object, the reflection factor of the object, etc.
- In the color coding, this problem is circumvented by using a technique in which decoding is not performed for a pattern having a possibility of loss or inversion of stripe when stripes are grouped at the decoding time. In the space coding method, a two-dimensional pattern is used to decrease the possibility of the error described above, but the same error will occur depending on the object on principle. Therefore, the above-described system can provide excellent accuracy in photographing (image pickup) in special circumstances in a laboratory or in circumstances where the objects are limited, but the accuracy is degraded in general photographing (image pickup) circumstances where the objects are not limited.
- The applicant proposed a range finder, which does not depend on the object by feeding back a projected pattern and generating new code (JP-A-2000-9442, JP-A-2000-65542, and U.S. Pat. No. 6,356,298 corresponding to JP-A-2000-65542). The proposition will be discussed below:
- FIG. 15 shows the general configuration of a range finder disclosed in JP-A-2000-65542. FIG. 16 shows a positional relationship between a light source and image pickup devices of the range finder.
- In the configuration shown in FIG. 16, a range finder includes three
cameras 101 to 103 and aprojector 104.Distances first camera 101 and theprojector 104 are placed so that optical axes match using ahalf mirror 105 as a beam splitter. Thesecond camera 102 and thethird camera 103 are placed on both sides of thefirst camera 101 and theprojector 104 so that thesecond camera 102 and thethird camera 103 differ from thefirst camera 101 and theprojector 104 in optical axis. A distance between the optical axis at the center and that on either side is base line length L. - The
projector 104 has alight source 106, amask pattern 107, astrength pattern 108, and aprism 109. An invisible-region light source using infrared or ultraviolet light can be used as thelight source 106. In this case, each camera is configured as shown in FIG. 17. That is,incident light 310 is split in two directions through aprism 301. One is incident on an image pickup apparatus (for example, a CCD camera) 303 through an invisible-region (infrared or ultraviolet)transmission filter 302. The other is incident on animage pickup apparatus 305 through an invisible-region (infrared and ultraviolet) cut-off filter 304. - A light source having a wavelength range capable of picking up an image regardless of a visible region or an invisible region may be used as the
light source 106 shown in FIG. 16. In this case, a CCD camera of progressive scan type is used as thefirst camera 301 and thesecond camera 102 and thethird camera 103 may be of any configuration. However, considering compatibility with thefirst camera 101, CCD cameras of the same configuration as thefirst camera 101 are desirable. A pattern is projected from thelight source 106 and the three cameras (101 to 103) pick up an image at the same time. Each camera acquires an image in batch by obtaining the light passing through thefilter 302, 304 (see FIG. 17) in theimage pickup apparatus - The configuration of the range finder will be discussed with reference to FIG. 15. As shown in the figure, the
second camera 102 stores brightness information provided by picking up an image inbrightness value memory 121 and stores an image pickup pattern inpattern image memory 122. Likewise, thethird camera 103 stores brightness information inbrightness value memory 123 and stores an image pickup pattern inpattern image memory 124. Thefirst camera 101 stores brightness information inbrightness value memory 125 and stores an image pickup pattern inpattern image memory 126. To reference a coded pattern, which is prepared in advance, later, theprojector 104 divides each slit into cells on a square lattice for storage inframe memory 127. - Using the stored image pickup patterns and brightness information, a three-dimensional image is obtained as follows: The following operation is common to both a combination of the
second camera 102 and thefirst camera 101 and a combination of thethird camera 103 and thefirst camera 101 and therefore will be discussed by taking the combination of thesecond camera 102 and thefirst camera 101 as an example. - In FIG. 15, an
area division section 128 performs area division of an image pickup pattern picked up by thefirst camera 101. Thearea division section 128 extracts an area with the strength difference between adjacent slit patterns being a threshold value or less as anarea 1 where light from the projector does not reach, and extracts an area with the strength difference between adjacent slit patterns being the threshold value or more as anarea 2. Arecoding section 129 recodes the extractedarea 2 using the image pickup pattern stored in thepattern image memory 126 and the projection pattern stored in theframe memory 127. - FIG. 18 is a flowchart for recoding. First, each slit pattern is divided in a longitudinal direction for each slit width (step S11) to generate square cells. The strengths of the generated cells are averaged and the average value is adopted as the strength of each cell (step S12). A comparison is made between each of cells of the projection pattern and each of corresponding cells of the image pickup pattern with respect to the strength in order starting at the center of the image. Then whether or not the strength difference between the cells is more than a threshold value because of change in pattern caused by the reflection factor of the object, the range data to the object, and the like is determined (step S13). If the strength difference between cells is not more than the threshold value, the recoding is terminated for all picked-up image cells (step S17).
- If the strength difference between the cells is more than the threshold value, whether or not the cell of the image pickup pattern is a cell having new strength is determined (step S14) If the cell of the image pickup pattern is a cell having new strength, new code is generated and assigned (step S15). If the cell of the image pickup pattern is not a cell having new strength, coding is performed using a slit pattern alignment of other part (step S16). The recoding is now complete (step S17).
- FIGS. 19A to19C show a coding example of a slit pattern; FIG. 19A shows a projection pattern coded based on a slit alignment, and 3 (strong), 2 (medium), and 1 (weak) are assigned as the strength. In FIG. 19B, the strength is changed in the third cell from the left and a new code appears. Thus, new code of 0 is assigned. In FIG. 19C, an existing code appears in the third cell from the left, the second cell from the top. Thus, recoding is performed in such a manner that the vertical alignment is [232] and the horizontal alignment is [131] as new code from the cell alignment. This recoding is equal to light projection of a complicated pattern such as a two-dimensional pattern to a part of the object shape rich in change and light projection of a simple pattern to apart less in change. This process is repeated for assigning unique codes to all cells, thereby performing recoding.
- FIG. 20 shows an example of projecting a coded pattern onto a
plate 606 placed in front of awall 605 usingcameras 601 to 603 and aprojector 604. The coded pattern is a slit pattern shown in FIG. 21. At this time,areas plate 606 occur in images provided by thecameras plate 606, a slit pattern as shown in FIG. 24 is provided as a new coded pattern. - Referring again to FIG. 15, a
decoding section 130 of thesecond camera 102 extracts the image on which the projection pattern is pick up from thepattern image memory 122 and divides the image pickup pattern into cells in a similar manner to that described above. Using the codes provided by therecoding section 129, adecoding section 130 detects the code of each cell and calculates slit angle θ from the light source based on the detected codes. FIG. 25 is a drawing to show a range calculation method in the space coding. Range Z is calculated according to the following expression (1) from the slit angle θ of the cell to which each pixel belongs, the x coordinate on the image picked up by thesecond camera 102, focal distance F of a camera parameter, and base line length L: - Z=(F×L)/(x+F×tan θ) (1)
- The range Z is also calculated in a similar manner in a
decoding section 131 of thethird camera 103. - For the
area 1 described above, the rage is calculated as follows: In thearea 1, pattern detection based on the projected pattern cannot be executed and thus a correspondencepoint search section 132 detects a parallax using the brightness information read from thebrightness value memories cameras 101 to 103, and calculates the range based on the detected parallax. For areas except thearea 1, the range is calculated by performing the above-described operation and thus the minimum value of the range of thearea 1 is obtained and the pixels, which can be related, are also limited. Using the limitation, the pixels are related to each other and parallax d is detected and using pixel size λ of a camera parameter, the range Z is calculated according to the following expression (2): - Z=(L×F)/(λ×d) (2)
- With the range information provided by using the
first camera 101 and thethird camera 103 in combination according to the technique described above, range information of thearea 801 as the shadow of the plate shown in FIG. 22 cannot be detected. On the other hand, with the range information provided by using thefirst camera 101 and thesecond camera 102 in combination, range information of thearea 901 as the shadow of the plate shown in FIG. 23 cannot be detected. That is, the shadow areas are areas blocked by the plate that light does not reach, and cannot be measured according to the system. Therefore, range information is found for areas other than the shadow areas. That is, a rangeinformation integration section 133 in FIG. 15 acquires range information for all pixels of the image of the first camera 101 (FIG. 26), namely, pixels other than the shadows from the range information calculated in the pair of thefirst camera 101 and thesecond camera 102 and the range information calculated in the pair of thefirst camera 101 and thethird camera 103. The range information provided by performing the described operation is related to brightness image of thefirst camera 101, for example, for storage in three-dimensional memory, whereby three-dimensional image pickup is performed. - The description of the contents of the related art (JP-A-2000-65542) is now complete.
- The range finder described in JP-A-2000-9442, JP-A-2000-65542 projects a projection pattern coded according to a plurality of strengths and a plurality of wavelengths. At this time, the projection pattern is changed by the effects of brightness information, material, and the like of the subject and when a three-dimensional shape is calculated, an error occurs and an appropriate three-dimensional shape cannot be measured. Thus, the range finder includes the monitor image pickup device placed at the same principal point as the projection element, monitors change in a projection pattern based on measured object information, performs recoding, and measures a three-dimensional shape.
- In the configuration, however, making the same the principal points of the projection element and the image pickup device is indispensable for recoding; to do this, a beam splitter such as a half mirror is used to match the principal points of the projection element and the image pickup device.
- If a half mirror or the like is used to match the principal points, the light projected from the projection element is attenuated through the half mirror. The pattern projected onto the measured object is attenuated in brightness through the half mirror and is input to the image pickup device. It is assumed that ideally the half mirror can distribute at 50:50 at an angle of 45 degrees. The measured object is observed with an attenuation of 25% as compared with a case where light from the projection element is projected directly on the measured object and the measured object is observed on the image pickup device. In the range finder in the related art, as shown in FIG. 16, the half mirror intervenes between the image pickup device intended for recoding and the image pickup device for shape measurement. Because of the effect of the half mirror, double brightness difference occurs on principle between the measured object observed on the image pickup device for shape measurement and the measured object observed on the image pickup device intended for recoding.
- Further, in the pattern projected from the projection element, pattern unevenness is also caused due to optical passage difference before and after being split, film thickness unevenness of the application material of the half mirror and the like. A light scattering produced by dirt, dust, or the like on the half mirror also occurs in coaxial image.
- Thus, if information with the projection pattern changed by subject information is recoded in the monitor image pickup device, the image is not provided strictly under the same condition as the image observed on the image pickup device for shape calculation and therefore precision degradation of shape measurement is caused.
- Further, as for the dynamic range of image pickup device, if image pickup devices of the same characteristics are used, it is difficult to drive the monitor and measurement image pickup devices under the same condition, and degradation of precision of measurement caused by recoding occurs.
- According to the invention, to solve the problems, a combination of a projector for projecting a coded pattern and an image pickup device for monitoring is formed without using a beam splitter or a half mirror.
- The combination of the projector and the image pickup device is called projection system. As the coded pattern, a stripe pattern ideally orthogonal to an epipola line of the projection system and an image pickup device for shape measurement is projected. The range finder in JP-A-2000-9442, JP-A-2000-65542 performs recoding by matching the principal points of the projector and the image pickup device of the projection system with each other. To perform recoding, optical match in the direction orthogonal to stripes is required. That is, the principal points of the projector and the image pickup device of the projection system need to match in the direction orthogonal to the stripes.
- In the invention, attention is focused on this point and preferably two or more projectors are placed on each other in the same direction as the stripes of the stripe pattern projected by the projection element so as to project the same pattern. At this time, the projectors are placed so that the stripe images shift depending on the subject. The principal point positions in the direction orthogonal to the stripe direction are matched between the projectors and the image pickup device for recoding is placed therebetween. According to the configuration of the projection system described above, it is made possible to match the principal points of the image pickup device for recoding and the projector without the need for the intervention of an optical device such as a half mirror or a beam splitter, so that a range finder free of the effect of image degradation, etc., affected by placing a half mirror or a beam splitter can be provided.
- Since the principal points of the projector and the image pickup device of the projection system need only to match in the direction orthogonal to the stripe direction, the number of projectors may be reduced to only one.
- To the end, according to one aspect of the invention, there is provided a range finder including a projector for projecting a coded stripe pattern, a first camera for picking up an image of the stripe pattern projected by the projector, the first camera placed so that a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and a second camera for picking up an image of the stripe pattern projected by the projector, the second camera placed so that a principal point of the second camera and the principal point of the first camera are placed away from each other in a direction not parallel to the length direction of the stripe pattern. An area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more is determined. A new code is assigned to the area. The second camera picks up a recoded stripe pattern projected by the projector after the new code is assigned. Range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the second camera.
- Preferably, the principal point of the second camera and the principal point of the first camera are placed on the same line along the direction perpendicular to the length direction of the stripe pattern. However, the principal points of the first and second camera may be placed on the same line forming a predetermined angle other than the right angles with the length direction of the stripe pattern.
- In the configuration, it is not necessary to place a half mirror or a beam splitter between the projector and the image pickup device (first camera) of the projection system as described above, so that image degradation can be circumvented.
- In the accompanying drawings:
- FIG. 1 is a plan view to show a range finder of an embodiment of the invention;
- FIG. 2 is a perspective view to show the range finder of the embodiment of the invention;
- FIG. 3 is a drawing to describe the relationship between the principal point of pattern projection apparatus and the principal point of an image pickup apparatus for monitoring in the range finder of the embodiment of the invention;
- FIG. 4 is a side view of the range finder of the embodiment of the invention to describe projection and picking up of a pattern image;
- FIG. 5 is a drawing to describe an observation image of an image pickup apparatus (camera 1) when a screen is at
position 0 in FIG. 4; - FIG. 6 is a drawing to describe an observation image of the image pickup apparatus (camera 1) when the screen is at position + in FIG. 4;
- FIG. 7 is a drawing to describe an observation image of the image pickup apparatus (camera 1) when the screen is at position − in FIG. 4;
- FIG. 8 is a drawing to describe the relationship between the range finder of the embodiment of the invention and subject (two flat plates);
- FIG. 9 is a side view of the apparatus and subject in FIG. 8;
- FIG. 10 is a drawing to describe an observation image of the image pickup apparatus (camera 1) in the example in FIG. 9;
- FIG. 11 is a side view when only pattern projection apparatus (projector 2) is installed in FIG. 8;
- FIG. 12 is a drawing to describe an observation image of the image pickup apparatus (camera1) in the example in FIG. 11;
- FIG. 13 is a side view when only pattern projection apparatus (projector1) is installed in FIG. 8;
- FIG. 14 is a drawing to describe an observation image of the image pickup apparatus (camera1) in the example in FIG. 13;
- FIG. 15 is a block diagram to show a configuration example of a range finder in a related art;
- FIG. 16 is a drawing to show a camera configuration example of the range finder in the related art in FIG. 15;
- FIG. 17 is a drawing to describe the image pickup configuration of the range finder in the related art in FIG. 15;
- FIG. 18 is a flowchart to show a processing flow of the range finder in the related art in FIG. 15;
- FIGS. 19A to19C are drawings to show a coding example of a projection pattern of the range finder in the related art in FIG. 15;
- FIG. 20 is a drawing to describe the image pickup configuration of the range finder in the related art in FIG. 15;
- FIG. 21 is a drawing to show a projection pattern example of the range finder in the related art in FIG. 15;
- FIG. 22 is a drawing to show an example of a slit pattern photographed by a
third camera 103 of the range finder in the related art in FIG. 15; - FIG. 23 is a drawing to show an example of a slit pattern photographed by a
second camera 102 of the range finder in the related art in FIG. 15; - FIG. 24 is a drawing to show an example of a new coded slit pattern in the range finder in the related art in FIG. 15;
- FIG. 25 is a drawing to show a range calculation method according to a space coding method of the range finder in the related art in FIG. 15; and
- FIG. 26 is a drawing to show an example of a slit pattern photographed by a
first camera 101 of the range finder in the related art in FIG. 15. - Referring now to the accompanying drawings, there is shown a preferred embodiment of the invention.
- FIG. 1 is a top view of a range finder according to an embodiment of the invention. FIG. 2 is a drawing of viewing the range finder from the slanting top thereof. In the embodiment, two pattern projection apparatus (also called projectors) are used. As the pattern projection apparatus, for example, commercially available projectors for projecting an image onto a screen can be used.
- In the embodiment, generation of a coded stripe pattern, monitor of a coded stripe pattern, re-coding based on the monitor, and triangulation are similar to those in the related arts previously described with reference to FIGS.15 to 26 and therefore will not be discussed again.
- In FIGS. 1 and 2, the range finder includes two pattern projection apparatus (projectors)10 and 11, an image pickup apparatus (camera 1) 12, and an image pickup apparatus (camera 2) 13 for triangulation. The
image pickup apparatus 12 monitors a pattern on the same optical axis as theprojectors pattern projection apparatus image pickup apparatus 12 for monitoring are arranged in the same plane along pattern stripes. - Basically, as with the related art example, the stripe patterns projected by the
pattern projection apparatus - In the embodiment, as shown clearly in FIG. 2, two
pattern projection apparatus pattern projection apparatus - A specific description is given. FIG. 4 is a side view of the range finder. Placed up and down are the
pattern projection apparatus pattern projection apparatus - A description is given based on a specific measured object. FIG. 8 is a schematic drawing to conduct measurement with two flat plates arranged in front of the range finder of the invention. FIG. 9 is a side view thereof. An image of the image pickup apparatus (camera 1)12 observed according to the configuration is as shown in FIG. 10. That is, a projection pattern of only either of the projection apparatus is projected onto the shadow portion of the front flat plate. Assuming that only either of the
projection apparatus - According to the described configuration, the image recoded in the image pickup apparatus (camera 1)12 and checked on the image pickup apparatus (camera 2) 13 can be used to calculate a range image based the principle of triangulation.
- In the example, two pattern projection apparatus are installed, but three or more pattern projection apparatus may be installed. Only one pattern projection apparatus may be placed. In this case, a portion where no pattern is formed occurs and it is made impossible to relate based on code as for the portion and it is made impossible to perform range calculation of the portion. In this case, processing of interpolating using the nearby range or the like may be performed. Alternatively, the object and the range finder may be moved relatively for making it possible to conduct measurement on an unmeasurable portion.
- Shape measurement using the
pattern projection apparatus 10 and shape measurement using thepattern projection apparatus 11 may be conducted separately and the measurement results may be made complementary to each other. That is, making adjustment so that the stripe patterns of the two up and downpattern projection apparatus pattern projection apparatus pattern projection apparatus pattern projection apparatus 10 differs from that produced in thepattern projection apparatus 11 and thus if both the shape measurement results are combined, the complete shape measurement result can be provided. Thus, if the user (operator) does not stick to one image pickup and shape measurement sequence, easy and complete shape measurement can be conducted. - This measurement will be described in more detail.
- At first, principal points of the image pickup apparatus (camera 1)12 and the
pattern projection apparatuses pattern projection apparatuses cameras 1, 2) 12, 13 are disposed so that the principal point of the image pickup apparatus (camera 1) 12 and a principal point of the image pickup apparatus (camera 2) 13 away from each other in a direction not parallel to the length direction of the stripe pattern. Under this state, shape measurement using thepattern projection apparatus 10 and shape measurement using thepattern projection apparatus 11 are conducted separately. That is, thepattern projection apparatus 10 and thepattern projection apparatus 11 are driven to project stripe patterns in different time periods. Then, an area is determined, with change amount of the stripe pattern, which is picked up by the image pickup apparatus (camera 1) 12, with respect to the stripe pattern projected by thepattern projection apparatus 10 being a predetermined value or more. A new code is assigned to the area. The image pickup apparatus (camera 2) 13 picks up a recoded stripe pattern projected by thepattern projection apparatus 10 after the new code is assigned. First range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the image pickup apparatus (camera 2) 13. Then, thepattern projection apparatus 11 projects the stripe pattern to obtain second range information in a similar manner. That is, an area is determined, with change amount of the stripe pattern, which is picked up by the image pickup apparatus (camera 1) 12, with respect to the stripe pattern projected by thepattern projection apparatus 11 being a predetermined value or more. A new code is assigned to the area. The image pickup apparatus (camera 2) 13 picks up an image of a recoded stripe pattern projected by thepattern projection apparatus 11 after the new code is assigned. Then, the second range information of the three-dimensional object onto which the stripe pattern is projected is generated based on the image of the recoded stripe pattern picked up by the image pickup apparatus (camera 2) 13. Finally, the first range information and the second range information are combined to form total range information. - As described above, according to the invention, the need for a half mirror or a beam splitter used with the measurement apparatus in the related art is eliminated and problems of brightness difference, a light scattering caused by dirt, dust, etc., and the like caused by a substance placed between a pattern projection apparatus and an image pickup apparatus do not occur on principle, so that more accurate measurement is made possible.
Claims (6)
1. A range finder comprising:
a projector for projecting a coded stripe pattern;
a first camera for picking up an image of the stripe pattern projected by the projector, the first camera placed so that a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and
a second camera for picking up an image of the stripe pattern projected by the projector, the second camera placed so that a principal point of the second camera and the principal point of the first camera are placed away from each other in a direction being not parallel to the length direction of the stripe pattern,
wherein an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more is determined;
wherein a new code is assigned to the area;
wherein the second camera picks up a recoded stripe pattern projected by the projector after the new code is assigned; and
wherein range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the second camera.
2. The range finder according to claim 1 ,
wherein the projector is at least one projector;
wherein the principal point of all the projector and the principal point of the first camera are placed along the length direction of the stripe pattern; and
wherein the coded stripe pattern projected from all the projector is matched with each other.
3. The range finder according to claim 2 ,
wherein total number of the projectors is two; and
wherein the two projectors are placed so as to sandwich the first camera therebetween.
4. The range finder according to claim 1 , wherein texture information of a surface of the three-dimensional object onto which the stripe pattern is projected is generated from the image of the stripe pattern picked up by the first camera.
5. A three-dimensional image pickup method comprising:
providing a projector for projecting a coded stripe pattern, a first camera and a second camera each for picking up the stripe pattern projected by the projector,
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more;
assigning a new code to the area;
picking up a recoded stripe pattern projected by the projector after the new code is assigned by the second camera; and
generating range information of a three-dimensional object onto which the stripe pattern is projected based on the image of the recoded stripe pattern picked up by the second camera,
wherein a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and
wherein the principal point of the first camera and a principal point of the second camera are placed away from each other in a direction not parallel to the length direction of the stripe pattern.
6. A three-dimensional image pickup method comprising:
providing a first projector and a second projector each for projecting a coded stripe pattern, and a first camera and a second camera for picking up images of the stripe patterns projected by the first projector and the second projector;
placing a principal point of the first camera and principal points of the first projector and the second projector along a length direction of the stripe pattern;
placing the two projectors to sandwich the first camera therebetween;
placing the principal point of the first camera and a principal point of the second camera away from each other in a direction not parallel to the length direction of the stripe pattern;
driving the first projector and the second projector to project stripe patterns in different time periods;
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the first projector being a predetermined value or more;
assigning a new code to the area;
picking up a recoded stripe pattern projected by the first projector after the new code is assigned by the second camera;
generating first range information of a three-dimensional object onto which the stripe pattern is projected based on the recoded stripe pattern picked up by the second camera;
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the second projector being a predetermined value or more;
assigning a new code to the area;
picking up an image of are coded stripe pattern projected by the second projector after the new code is assigned by the second camera;
generating second range information of the three-dimensional object onto which the stripe pattern is projected based on the image of the recoded stripe pattern picked up by the second camera; and
combining the first range information and the second range information to form total range information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/702,597 US7075625B2 (en) | 2002-08-28 | 2003-11-07 | Range finder and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2002-248034 | 2002-08-28 | ||
JP2002248034 | 2002-08-28 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/702,597 Continuation-In-Part US7075625B2 (en) | 2002-08-28 | 2003-11-07 | Range finder and method |
US10/702,597 Continuation US7075625B2 (en) | 2002-08-28 | 2003-11-07 | Range finder and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040041996A1 true US20040041996A1 (en) | 2004-03-04 |
Family
ID=31972497
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/373,761 Abandoned US20040041996A1 (en) | 2002-08-28 | 2003-02-27 | Range finder and method |
US10/702,597 Expired - Fee Related US7075625B2 (en) | 2002-08-28 | 2003-11-07 | Range finder and method |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/702,597 Expired - Fee Related US7075625B2 (en) | 2002-08-28 | 2003-11-07 | Range finder and method |
Country Status (1)
Country | Link |
---|---|
US (2) | US20040041996A1 (en) |
Cited By (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102012100955A1 (en) * | 2012-02-06 | 2013-08-08 | A.Tron3D Gmbh | Device for detecting three-dimensional geometry of object e.g. teeth, has light source of projector that is provided to emit within predetermined range, and optical device that is provided with light source and camera |
US20130335559A1 (en) * | 2010-12-13 | 2013-12-19 | Surveylab Group Limited | Mobile measurement devices, instruments and methods |
WO2014010251A1 (en) * | 2012-07-13 | 2014-01-16 | Panasonic Corporation | Hand and object tracking in three-dimensional space |
US20140268093A1 (en) * | 2013-03-15 | 2014-09-18 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US9007601B2 (en) | 2010-04-21 | 2015-04-14 | Faro Technologies, Inc. | Automatic measurement of dimensional data with a laser tracker |
US9151830B2 (en) | 2011-04-15 | 2015-10-06 | Faro Technologies, Inc. | Six degree-of-freedom laser tracker that cooperates with a remote structured-light scanner |
US9164173B2 (en) | 2011-04-15 | 2015-10-20 | Faro Technologies, Inc. | Laser tracker that uses a fiber-optic coupler and an achromatic launch to align and collimate two wavelengths of light |
US9377885B2 (en) | 2010-04-21 | 2016-06-28 | Faro Technologies, Inc. | Method and apparatus for locking onto a retroreflector with a laser tracker |
US9395174B2 (en) | 2014-06-27 | 2016-07-19 | Faro Technologies, Inc. | Determining retroreflector orientation by optimizing spatial fit |
US9400170B2 (en) | 2010-04-21 | 2016-07-26 | Faro Technologies, Inc. | Automatic measurement of dimensional data within an acceptance region by a laser tracker |
US9453913B2 (en) | 2008-11-17 | 2016-09-27 | Faro Technologies, Inc. | Target apparatus for three-dimensional measurement system |
US9482755B2 (en) | 2008-11-17 | 2016-11-01 | Faro Technologies, Inc. | Measurement system having air temperature compensation between a target and a laser tracker |
US9482529B2 (en) | 2011-04-15 | 2016-11-01 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US9686532B2 (en) | 2011-04-15 | 2017-06-20 | Faro Technologies, Inc. | System and method of acquiring three-dimensional coordinates using multiple coordinate measurement devices |
US9772394B2 (en) | 2010-04-21 | 2017-09-26 | Faro Technologies, Inc. | Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker |
DE102016105426A1 (en) * | 2016-03-23 | 2017-09-28 | Gottfried Wilhelm Leibniz Universität Hannover | Optical measuring system and optical measuring method |
US9781397B2 (en) | 2015-10-05 | 2017-10-03 | Panasonic Intellectual Property Management Co., Ltd. | Projector and projector system |
US20190235079A1 (en) * | 2016-12-27 | 2019-08-01 | Gerard Dirk Smits | Systems and methods for machine perception |
US10451737B2 (en) | 2016-10-31 | 2019-10-22 | Gerard Dirk Smits | Fast scanning with dynamic voxel probing |
US10502815B2 (en) | 2015-12-18 | 2019-12-10 | Gerard Dirk Smits | Real time position sensing of objects |
US20190377088A1 (en) * | 2018-06-06 | 2019-12-12 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10725177B2 (en) | 2018-01-29 | 2020-07-28 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US10962867B2 (en) | 2007-10-10 | 2021-03-30 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US11067794B2 (en) | 2017-05-10 | 2021-07-20 | Gerard Dirk Smits | Scan mirror systems and methods |
US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US11272147B2 (en) | 2017-03-17 | 2022-03-08 | Panasonic Intellectual Property Management Co., Ltd. | Projector and projector system |
US11483503B2 (en) | 2019-01-20 | 2022-10-25 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US11680790B2 (en) * | 2008-07-08 | 2023-06-20 | Cognex Corporation | Multiple channel locating |
US11690701B2 (en) * | 2017-07-26 | 2023-07-04 | Dentlytec G.P.L. Ltd. | Intraoral scanner |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6634552B2 (en) * | 2001-09-26 | 2003-10-21 | Nec Laboratories America, Inc. | Three dimensional vision device and method, and structured light bar-code patterns for use in the same |
US8224064B1 (en) * | 2003-05-21 | 2012-07-17 | University Of Kentucky Research Foundation, Inc. | System and method for 3D imaging using structured light illumination |
AU2005229207B2 (en) * | 2004-04-02 | 2009-11-19 | Leica Geosystems Ag | Electronic distance meter featuring spectral and spatial selectivity |
WO2007059780A1 (en) * | 2005-11-28 | 2007-05-31 | 3Shape A/S | Coded structured light |
CA2536411C (en) * | 2006-02-14 | 2014-01-14 | Lmi Technologies Inc. | Multiple axis multipoint non-contact measurement system |
US7525114B2 (en) | 2006-02-14 | 2009-04-28 | Lmi Technologies Ltd. | Multiple axis multipoint non-contact measurement system |
US7957007B2 (en) * | 2006-05-17 | 2011-06-07 | Mitsubishi Electric Research Laboratories, Inc. | Apparatus and method for illuminating a scene with multiplexed illumination for motion capture |
JP4380663B2 (en) * | 2006-06-08 | 2009-12-09 | コニカミノルタセンシング株式会社 | Three-dimensional shape measurement method, apparatus, and focus adjustment method |
GB0612786D0 (en) * | 2006-06-28 | 2006-08-09 | Spiral Scratch Ltd | Imaging with depth information |
US20080007700A1 (en) * | 2006-07-10 | 2008-01-10 | Vanbaar Jeroen | Method and system for aligning an array of rear-projectors |
JP4270264B2 (en) * | 2006-11-01 | 2009-05-27 | セイコーエプソン株式会社 | Image correction apparatus, projection system, image correction method, image correction program, and recording medium |
US8090194B2 (en) | 2006-11-21 | 2012-01-03 | Mantis Vision Ltd. | 3D geometric modeling and motion capture using both single and dual imaging |
CA2670214A1 (en) | 2006-11-21 | 2008-05-29 | Mantisvision Ltd. | 3d geometric modeling and 3d video content creation |
US20080156619A1 (en) * | 2006-12-01 | 2008-07-03 | Mehul Patel | Range finder |
US20080316432A1 (en) * | 2007-06-25 | 2008-12-25 | Spotless, Llc | Digital Image Projection System |
US20110001935A1 (en) * | 2007-06-25 | 2011-01-06 | Spotless, Llc | Digital image projection system |
US8031346B2 (en) * | 2008-10-31 | 2011-10-04 | Siemens Energy, Inc. | Coating evaluation process |
CN101930071A (en) * | 2009-06-19 | 2010-12-29 | 鸿富锦精密工业(深圳)有限公司 | Device and method for detecting movement of object |
US8681217B2 (en) * | 2010-07-21 | 2014-03-25 | Olympus Corporation | Inspection apparatus and measurement method |
US9536312B2 (en) * | 2011-05-16 | 2017-01-03 | Microsoft Corporation | Depth reconstruction using plural depth capture units |
TWI461656B (en) | 2011-12-01 | 2014-11-21 | Ind Tech Res Inst | Apparatus and method for sencing distance |
DE102012013079B4 (en) | 2012-06-25 | 2023-06-22 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method and device for non-contact detection of a three-dimensional contour |
US20140160162A1 (en) * | 2012-12-12 | 2014-06-12 | Dhanushan Balachandreswaran | Surface projection device for augmented reality |
US9102055B1 (en) * | 2013-03-15 | 2015-08-11 | Industrial Perception, Inc. | Detection and reconstruction of an environment to facilitate robotic interaction with the environment |
JP6410079B2 (en) * | 2014-06-26 | 2018-10-24 | パナソニックIpマネジメント株式会社 | Optical projection device and illumination device using the same |
KR102595391B1 (en) * | 2016-12-07 | 2023-10-31 | 매직 아이 인코포레이티드 | Distance sensor with adjustable focus imaging sensor |
EP3637045B1 (en) * | 2017-06-07 | 2023-05-24 | Sony Semiconductor Solutions Corporation | Information processing device and method |
CN108362205B (en) * | 2017-11-14 | 2020-04-28 | 沈阳工业大学 | Space distance measuring method based on fringe projection |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4842411A (en) * | 1986-02-06 | 1989-06-27 | Vectron, Inc. | Method of automatically measuring the shape of a continuous surface |
US6356298B1 (en) * | 1998-08-18 | 2002-03-12 | Fuji Xerox Co., Ltd. | Three-dimensional image photographing system |
US6417880B1 (en) * | 1995-06-29 | 2002-07-09 | Matsushita Electric Industrial Co., Ltd. | Stereoscopic CG image generating apparatus and stereoscopic TV apparatus |
US6549288B1 (en) * | 1998-05-14 | 2003-04-15 | Viewpoint Corp. | Structured-light, triangulation-based three-dimensional digitizer |
US6549289B1 (en) * | 2000-03-07 | 2003-04-15 | Pheno Imaging, Inc. | Three-dimensional measuring system for animals using light pattern triangulation |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03192474A (en) | 1989-12-22 | 1991-08-22 | Fujitsu Ltd | Three-dimensional shape measuring system |
JPH0816608B2 (en) | 1991-03-15 | 1996-02-21 | 幸男 佐藤 | Shape measuring device |
US5548392A (en) * | 1995-01-31 | 1996-08-20 | Kabushikikaisha Wacom | Optical position detector having scale pattern spot-illuminated to increase resolution |
JP3384329B2 (en) | 1998-06-22 | 2003-03-10 | 富士ゼロックス株式会社 | 3D image capturing device |
-
2003
- 2003-02-27 US US10/373,761 patent/US20040041996A1/en not_active Abandoned
- 2003-11-07 US US10/702,597 patent/US7075625B2/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4842411A (en) * | 1986-02-06 | 1989-06-27 | Vectron, Inc. | Method of automatically measuring the shape of a continuous surface |
US6417880B1 (en) * | 1995-06-29 | 2002-07-09 | Matsushita Electric Industrial Co., Ltd. | Stereoscopic CG image generating apparatus and stereoscopic TV apparatus |
US6549288B1 (en) * | 1998-05-14 | 2003-04-15 | Viewpoint Corp. | Structured-light, triangulation-based three-dimensional digitizer |
US6356298B1 (en) * | 1998-08-18 | 2002-03-12 | Fuji Xerox Co., Ltd. | Three-dimensional image photographing system |
US6549289B1 (en) * | 2000-03-07 | 2003-04-15 | Pheno Imaging, Inc. | Three-dimensional measuring system for animals using light pattern triangulation |
Cited By (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10962867B2 (en) | 2007-10-10 | 2021-03-30 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US11680790B2 (en) * | 2008-07-08 | 2023-06-20 | Cognex Corporation | Multiple channel locating |
US9482755B2 (en) | 2008-11-17 | 2016-11-01 | Faro Technologies, Inc. | Measurement system having air temperature compensation between a target and a laser tracker |
US9453913B2 (en) | 2008-11-17 | 2016-09-27 | Faro Technologies, Inc. | Target apparatus for three-dimensional measurement system |
US9772394B2 (en) | 2010-04-21 | 2017-09-26 | Faro Technologies, Inc. | Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker |
US9007601B2 (en) | 2010-04-21 | 2015-04-14 | Faro Technologies, Inc. | Automatic measurement of dimensional data with a laser tracker |
US10480929B2 (en) | 2010-04-21 | 2019-11-19 | Faro Technologies, Inc. | Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker |
US9146094B2 (en) | 2010-04-21 | 2015-09-29 | Faro Technologies, Inc. | Automatic measurement of dimensional data with a laser tracker |
US10209059B2 (en) | 2010-04-21 | 2019-02-19 | Faro Technologies, Inc. | Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker |
US9400170B2 (en) | 2010-04-21 | 2016-07-26 | Faro Technologies, Inc. | Automatic measurement of dimensional data within an acceptance region by a laser tracker |
US9377885B2 (en) | 2010-04-21 | 2016-06-28 | Faro Technologies, Inc. | Method and apparatus for locking onto a retroreflector with a laser tracker |
US20130335559A1 (en) * | 2010-12-13 | 2013-12-19 | Surveylab Group Limited | Mobile measurement devices, instruments and methods |
US9448059B2 (en) | 2011-04-15 | 2016-09-20 | Faro Technologies, Inc. | Three-dimensional scanner with external tactical probe and illuminated guidance |
US9494412B2 (en) | 2011-04-15 | 2016-11-15 | Faro Technologies, Inc. | Diagnosing multipath interference and eliminating multipath interference in 3D scanners using automated repositioning |
US9164173B2 (en) | 2011-04-15 | 2015-10-20 | Faro Technologies, Inc. | Laser tracker that uses a fiber-optic coupler and an achromatic launch to align and collimate two wavelengths of light |
US9453717B2 (en) | 2011-04-15 | 2016-09-27 | Faro Technologies, Inc. | Diagnosing multipath interference and eliminating multipath interference in 3D scanners using projection patterns |
US9157987B2 (en) | 2011-04-15 | 2015-10-13 | Faro Technologies, Inc. | Absolute distance meter based on an undersampling method |
US9482746B2 (en) | 2011-04-15 | 2016-11-01 | Faro Technologies, Inc. | Six degree-of-freedom laser tracker that cooperates with a remote sensor |
US10578423B2 (en) | 2011-04-15 | 2020-03-03 | Faro Technologies, Inc. | Diagnosing multipath interference and eliminating multipath interference in 3D scanners using projection patterns |
US9151830B2 (en) | 2011-04-15 | 2015-10-06 | Faro Technologies, Inc. | Six degree-of-freedom laser tracker that cooperates with a remote structured-light scanner |
US9482529B2 (en) | 2011-04-15 | 2016-11-01 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US9207309B2 (en) | 2011-04-15 | 2015-12-08 | Faro Technologies, Inc. | Six degree-of-freedom laser tracker that cooperates with a remote line scanner |
US9686532B2 (en) | 2011-04-15 | 2017-06-20 | Faro Technologies, Inc. | System and method of acquiring three-dimensional coordinates using multiple coordinate measurement devices |
US10119805B2 (en) | 2011-04-15 | 2018-11-06 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US10267619B2 (en) | 2011-04-15 | 2019-04-23 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US10302413B2 (en) | 2011-04-15 | 2019-05-28 | Faro Technologies, Inc. | Six degree-of-freedom laser tracker that cooperates with a remote sensor |
DE102012100955A1 (en) * | 2012-02-06 | 2013-08-08 | A.Tron3D Gmbh | Device for detecting three-dimensional geometry of object e.g. teeth, has light source of projector that is provided to emit within predetermined range, and optical device that is provided with light source and camera |
WO2014010251A1 (en) * | 2012-07-13 | 2014-01-16 | Panasonic Corporation | Hand and object tracking in three-dimensional space |
US9720511B2 (en) | 2012-07-13 | 2017-08-01 | Panasonic Intellectual Property Management Co., Ltd. | Hand and object tracking in three-dimensional space |
US9482514B2 (en) | 2013-03-15 | 2016-11-01 | Faro Technologies, Inc. | Diagnosing multipath interference and eliminating multipath interference in 3D scanners by directed probing |
DE112014001459B4 (en) | 2013-03-15 | 2019-10-17 | Faro Technologies, Inc. | Method for determining three-dimensional coordinates on a surface of an object |
US9041914B2 (en) * | 2013-03-15 | 2015-05-26 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US20140268093A1 (en) * | 2013-03-15 | 2014-09-18 | Faro Technologies, Inc. | Three-dimensional coordinate scanner and method of operation |
US9395174B2 (en) | 2014-06-27 | 2016-07-19 | Faro Technologies, Inc. | Determining retroreflector orientation by optimizing spatial fit |
US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US9781397B2 (en) | 2015-10-05 | 2017-10-03 | Panasonic Intellectual Property Management Co., Ltd. | Projector and projector system |
US11714170B2 (en) | 2015-12-18 | 2023-08-01 | Samsung Semiconuctor, Inc. | Real time position sensing of objects |
US10502815B2 (en) | 2015-12-18 | 2019-12-10 | Gerard Dirk Smits | Real time position sensing of objects |
DE102016105426A1 (en) * | 2016-03-23 | 2017-09-28 | Gottfried Wilhelm Leibniz Universität Hannover | Optical measuring system and optical measuring method |
DE102016105426B4 (en) * | 2016-03-23 | 2018-01-11 | Gottfried Wilhelm Leibniz Universität Hannover | Optical measuring system and optical measuring method |
US10935659B2 (en) | 2016-10-31 | 2021-03-02 | Gerard Dirk Smits | Fast scanning lidar with dynamic voxel probing |
US10451737B2 (en) | 2016-10-31 | 2019-10-22 | Gerard Dirk Smits | Fast scanning with dynamic voxel probing |
US11709236B2 (en) | 2016-12-27 | 2023-07-25 | Samsung Semiconductor, Inc. | Systems and methods for machine perception |
US10564284B2 (en) * | 2016-12-27 | 2020-02-18 | Gerard Dirk Smits | Systems and methods for machine perception |
US20190235079A1 (en) * | 2016-12-27 | 2019-08-01 | Gerard Dirk Smits | Systems and methods for machine perception |
US11272147B2 (en) | 2017-03-17 | 2022-03-08 | Panasonic Intellectual Property Management Co., Ltd. | Projector and projector system |
US11067794B2 (en) | 2017-05-10 | 2021-07-20 | Gerard Dirk Smits | Scan mirror systems and methods |
US11690701B2 (en) * | 2017-07-26 | 2023-07-04 | Dentlytec G.P.L. Ltd. | Intraoral scanner |
US10935989B2 (en) | 2017-10-19 | 2021-03-02 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10725177B2 (en) | 2018-01-29 | 2020-07-28 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US11474245B2 (en) * | 2018-06-06 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US20190377088A1 (en) * | 2018-06-06 | 2019-12-12 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11483503B2 (en) | 2019-01-20 | 2022-10-25 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
Also Published As
Publication number | Publication date |
---|---|
US7075625B2 (en) | 2006-07-11 |
US20040246495A1 (en) | 2004-12-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7075625B2 (en) | Range finder and method | |
US8718326B2 (en) | System and method for extracting three-dimensional coordinates | |
US9501833B2 (en) | Method and system for providing three-dimensional and range inter-planar estimation | |
JP3714063B2 (en) | 3D shape measuring device | |
US8025408B2 (en) | Method, apparatus and program for image processing and method and apparatus for image synthesizing | |
EP1595224B1 (en) | Acquisition of three-dimensional images by an active stereo technique using locally unique patterns | |
US4965442A (en) | System for ascertaining direction of blur in a range-from-defocus camera | |
US6028672A (en) | High speed three dimensional imaging method | |
EP2751521B1 (en) | Method and system for alignment of a pattern on a spatial coded slide image | |
EP2568253B1 (en) | Structured-light measuring method and system | |
US20160223724A1 (en) | Structured light pattern generation | |
US6356298B1 (en) | Three-dimensional image photographing system | |
JP2009300268A (en) | Three-dimensional information detection device | |
US6411327B1 (en) | Stereo camera system for obtaining a stereo image of an object, and system and method for measuring distance between the stereo camera system and the object using the stereo image | |
JP3818028B2 (en) | 3D image capturing apparatus and 3D image capturing method | |
KR102160340B1 (en) | Method and apparatus for generating 3-dimensional data of moving object | |
US11350077B2 (en) | Handheld three dimensional scanner with an autoaperture | |
JP2004110804A (en) | Three-dimensional image photographing equipment and method | |
JP3384329B2 (en) | 3D image capturing device | |
JP3852285B2 (en) | 3D shape measuring apparatus and 3D shape measuring method | |
JP3932776B2 (en) | 3D image generation apparatus and 3D image generation method | |
JP3525712B2 (en) | Three-dimensional image capturing method and three-dimensional image capturing device | |
JP2006058092A (en) | Three-dimensional shape measuring device and method | |
JP2002013918A (en) | Three-dimensional image forming device and three- dimensional image forming method | |
US20190149795A1 (en) | Three dimensional imaging using line scan camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FUJI XEROX CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ABE, TSUTOMU;REEL/FRAME:013818/0369 Effective date: 20030225 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |