US9420149B2 - Integrated depth camera - Google Patents
Integrated depth camera Download PDFInfo
- Publication number
- US9420149B2 US9420149B2 US14/458,298 US201414458298A US9420149B2 US 9420149 B2 US9420149 B2 US 9420149B2 US 201414458298 A US201414458298 A US 201414458298A US 9420149 B2 US9420149 B2 US 9420149B2
- Authority
- US
- United States
- Prior art keywords
- lighting
- depth camera
- board
- control
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000004075 alteration Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011900 installation process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
Images
Classifications
-
- H04N5/2252—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
- G01S7/4813—Housing arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G06K9/00335—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- H04N13/0253—
-
- H04N13/0271—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
Definitions
- the invention relates to cameras, particularly to depth cameras.
- a depth camera can be used to control a computer through a gesture. Moreover, a depth camera can be further used to control a TV game through a body motion. This makes human-machine interaction more intuitive.
- Such human-machine interaction needs a depth camera which can store a three-dimensional image into a two-dimensional format.
- a depth camera can measure a Z-axis distance between every shot point and the camera so that it can record three-dimensional image data.
- a common method for measuring the Z-axis distance is to use the principle of time of flight (TOF). Simply speaking, a time period from a light beam emitted by a light source to be reflected by a shot point to come back to the origin can be used to calculate the Z-axis distance.
- TOF time of flight
- the light source is an essential element of the TOF principle.
- a conventional TOF depth camera is provided with multiple light sources. To ensure the light beams from the light sources are absolutely parallel, each light source is further provided with a reflector. However, the reflectors are separate parts which must be individually installed over the light sources. Such installation always makes the light beams deflective, and finally, the distance measurement will be inaccurate.
- An object of the invention is to provide an integrated depth camera, which has a modularized light source set. This can simplify the installation process of the light source set and ensure the accuracy of installation.
- the depth camera of the invention includes a control module and a lighting module.
- the control module includes a control board, a control unit mounted on the control board, a seat mounted on the control board and over the control unit and a lens rooted in the seat.
- the lighting module is superposed on the control module and includes a lighting board with a through hole for receiving the lens, lighting units mounted on the lighting board and a reflector set composed of a base plate and reflectors formed thereon. Each reflector has an opening surrounding one of the lighting units.
- FIG. 1 is an exploded view of the invention
- FIG. 2 is an assembled view of the invention
- FIG. 3 is a sectional view of the invention.
- FIG. 4 is a schematic view of the invention.
- the depth camera of the invention includes a control module 1 and a lighting module 2 .
- the control module 1 and the lighting module 2 are installed in a case 3 .
- the control module 1 further includes a control board 11 .
- a control unit 12 is mounted on the control board 11 .
- the control unit 12 is a control chip for controlling the operation of the depth camera.
- a seat 13 is mounted on the control board 11 .
- the seat 13 is formed with a connecting hole 131 surrounding the control unit 12 .
- An edge of the connecting hole 131 is formed with a thread 132 .
- a lens 14 is rooted in the connecting hole 131 and electrically connected to the control unit 12 .
- the lens 14 has a connecting end 141 with a thread for screwing with the connecting hole 131 .
- the lighting module 2 includes a lighting board 21 electrically connected to the control board 11 .
- the lighting board 21 is formed with a through hole 211 for receiving the lens 14 .
- the lens 14 passes through the lighting board 21 as shown in FIG. 3 .
- the lighting board 21 is mounted by multiple lighting units 22 under control of the control unit 21 .
- the lighting units 22 are arranged in a line and beside the through hole 211 .
- the lighting units 22 may be an infrared or laser light source.
- the lighting board 21 is provided with at least one reflector set 23 . In the shown embodiment, the reflector set 23 is two in number.
- Each reflector set 23 includes a base plate 231 and multiple reflectors 232 mounted thereon.
- each reflector 232 is formed with an opening 233 surrounding one of the lighting units 232 .
- the base plate 231 is provided with fixing rods 234 for being inserted into fixing holes 212 of the lighting board 21 .
- the lighting units 22 are separately surrounded by the reflectors 232 in a one-to-one manner as shown in FIG. 3 .
- the lighting units 22 of the lighting module 2 are installed with the reflectors 232 in a module manner.
- the lighting units 22 emit light beams while the depth camera is working, and the reflectors 232 can keep the light beams concentrative to reach the shot object (as the arrows shown in the figure).
- the modularized reflectors 23 ensure the installing accuracy and simplify the installing process.
Abstract
Description
Claims (6)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/458,298 US9420149B2 (en) | 2014-06-13 | 2014-08-13 | Integrated depth camera |
US14/564,021 US9609184B2 (en) | 2014-06-13 | 2014-12-08 | Depth camera |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW103210475U | 2014-06-13 | ||
TW103210475 | 2014-06-13 | ||
US14/458,298 US9420149B2 (en) | 2014-06-13 | 2014-08-13 | Integrated depth camera |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/564,021 Continuation-In-Part US9609184B2 (en) | 2014-06-13 | 2014-12-08 | Depth camera |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160050346A1 US20160050346A1 (en) | 2016-02-18 |
US9420149B2 true US9420149B2 (en) | 2016-08-16 |
Family
ID=52515044
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/458,298 Active 2035-03-10 US9420149B2 (en) | 2014-06-13 | 2014-08-13 | Integrated depth camera |
US14/564,021 Active 2034-11-12 US9609184B2 (en) | 2014-06-13 | 2014-12-08 | Depth camera |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/564,021 Active 2034-11-12 US9609184B2 (en) | 2014-06-13 | 2014-12-08 | Depth camera |
Country Status (3)
Country | Link |
---|---|
US (2) | US9420149B2 (en) |
CN (1) | CN204156959U (en) |
TW (1) | TWM495545U (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10694089B2 (en) * | 2018-08-24 | 2020-06-23 | Yuan-Tai Wang | LED projection device for a camera and method for controlling a light pattern projected by the LED projection device |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016161312A1 (en) | 2015-04-03 | 2016-10-06 | Red.Com, Inc. | Modular motion camera |
US10194071B2 (en) | 2015-04-03 | 2019-01-29 | Red.Com, Llc | Modular motion camera |
DE102015113219A1 (en) * | 2015-08-11 | 2017-03-02 | Connaught Electronics Ltd. | Camera for a motor vehicle with arranged on the lens housing electronics unit, motor vehicle and method |
CN108780820B (en) * | 2016-02-19 | 2023-05-12 | 赫普塔冈微光有限公司 | Optoelectronic module with double encapsulation having an opening for receiving an optical component |
CN105516574A (en) * | 2016-02-23 | 2016-04-20 | 珠海格力电器股份有限公司 | Electronic apparatus and connecting component of camera thereof |
TWI580929B (en) * | 2016-10-07 | 2017-05-01 | H P B Optoelectronic Co Ltd | Height detection system and its method |
US10502548B2 (en) * | 2017-05-09 | 2019-12-10 | Google Llc | Sensor combination |
CN107121886A (en) * | 2017-06-20 | 2017-09-01 | 深圳奥比中光科技有限公司 | 3D imaging electronicses |
CN208572292U (en) * | 2018-03-18 | 2019-03-01 | 宁波舜宇光电信息有限公司 | Depth information camera module and its base assembly and electronic equipment |
CN109031329B (en) * | 2018-07-02 | 2024-01-16 | 昆山丘钛微电子科技有限公司 | Flight time ranging module and electronic equipment |
CN112492139B (en) * | 2018-12-24 | 2021-10-15 | 华为技术有限公司 | Camera shooting assembly and electronic equipment |
US11115576B2 (en) * | 2019-03-29 | 2021-09-07 | Qualcomm Incorporated | Sensor module with a collar configured to be attached to a camera module for a user device |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030062413A1 (en) * | 1999-10-04 | 2003-04-03 | Hand Held Products, Inc. | Optical reader comprising multiple color illumination |
US20090020687A1 (en) * | 2007-07-18 | 2009-01-22 | Mesa Imaging Ag | Reference Pixel Array with Varying Sensitivities for TOF Sensor |
US20090122394A1 (en) * | 2007-11-12 | 2009-05-14 | Sung Ho Son | Camera Module |
US20100039500A1 (en) * | 2008-02-15 | 2010-02-18 | Matthew Bell | Self-Contained 3D Vision System Utilizing Stereo Camera and Patterned Illuminator |
US20100060722A1 (en) * | 2008-03-07 | 2010-03-11 | Matthew Bell | Display with built in 3d sensing |
US20110139876A1 (en) * | 2009-12-16 | 2011-06-16 | Fujian Newland Auto-Id Technology Co., Ltd. | Imaging module for optical reader |
US20130335560A1 (en) * | 2011-03-15 | 2013-12-19 | Fujitsu Frontech Limited | Imagaging apparatus, imaging method, and imaging program |
US20140110485A1 (en) * | 2012-10-24 | 2014-04-24 | Honeywell International Inc. | Chip on board based highly integrated imager |
US20140160459A1 (en) * | 2012-12-12 | 2014-06-12 | Espros Photonics Ag | Tof distance sensor and method for operation thereof |
US20140160300A1 (en) * | 2012-12-07 | 2014-06-12 | Sercomm Corporation | Network camera |
US20150054001A1 (en) * | 2013-08-26 | 2015-02-26 | Optiz, Inc. | Integrated Camera Module And Method Of Making Same |
US20150229912A1 (en) * | 2014-02-10 | 2015-08-13 | Microsoft Corporation | Vcsel array for a depth camera |
US9294754B2 (en) * | 2012-02-03 | 2016-03-22 | Lumentum Operations Llc | High dynamic range and depth of field depth camera |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9746557B2 (en) * | 2014-07-25 | 2017-08-29 | Heptagon Micro Optics Pte. Ltd. | Proximity sensor module including time-of-flight sensor wherein a second group of light sensitive elements is in a second one of the chambers of the module |
-
2014
- 2014-08-13 US US14/458,298 patent/US9420149B2/en active Active
- 2014-11-11 TW TW103219971U patent/TWM495545U/en not_active IP Right Cessation
- 2014-11-11 CN CN201420675432.8U patent/CN204156959U/en not_active Expired - Fee Related
- 2014-12-08 US US14/564,021 patent/US9609184B2/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030062413A1 (en) * | 1999-10-04 | 2003-04-03 | Hand Held Products, Inc. | Optical reader comprising multiple color illumination |
US20090020687A1 (en) * | 2007-07-18 | 2009-01-22 | Mesa Imaging Ag | Reference Pixel Array with Varying Sensitivities for TOF Sensor |
US20090122394A1 (en) * | 2007-11-12 | 2009-05-14 | Sung Ho Son | Camera Module |
US20100039500A1 (en) * | 2008-02-15 | 2010-02-18 | Matthew Bell | Self-Contained 3D Vision System Utilizing Stereo Camera and Patterned Illuminator |
US20100060722A1 (en) * | 2008-03-07 | 2010-03-11 | Matthew Bell | Display with built in 3d sensing |
US20110139876A1 (en) * | 2009-12-16 | 2011-06-16 | Fujian Newland Auto-Id Technology Co., Ltd. | Imaging module for optical reader |
US20130335560A1 (en) * | 2011-03-15 | 2013-12-19 | Fujitsu Frontech Limited | Imagaging apparatus, imaging method, and imaging program |
US9294754B2 (en) * | 2012-02-03 | 2016-03-22 | Lumentum Operations Llc | High dynamic range and depth of field depth camera |
US20140110485A1 (en) * | 2012-10-24 | 2014-04-24 | Honeywell International Inc. | Chip on board based highly integrated imager |
US20140160300A1 (en) * | 2012-12-07 | 2014-06-12 | Sercomm Corporation | Network camera |
US20140160459A1 (en) * | 2012-12-12 | 2014-06-12 | Espros Photonics Ag | Tof distance sensor and method for operation thereof |
US20150054001A1 (en) * | 2013-08-26 | 2015-02-26 | Optiz, Inc. | Integrated Camera Module And Method Of Making Same |
US20150229912A1 (en) * | 2014-02-10 | 2015-08-13 | Microsoft Corporation | Vcsel array for a depth camera |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10694089B2 (en) * | 2018-08-24 | 2020-06-23 | Yuan-Tai Wang | LED projection device for a camera and method for controlling a light pattern projected by the LED projection device |
Also Published As
Publication number | Publication date |
---|---|
US20160050347A1 (en) | 2016-02-18 |
CN204156959U (en) | 2015-02-11 |
TWM495545U (en) | 2015-02-11 |
US9609184B2 (en) | 2017-03-28 |
US20160050346A1 (en) | 2016-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9420149B2 (en) | Integrated depth camera | |
US10884553B2 (en) | Light guide and touch screen assembly | |
WO2015119979A3 (en) | Vcsel array for a depth camera | |
MX2015015629A (en) | Light bar. | |
US10859235B2 (en) | Warning devices with oscillating light patterns | |
US20160335492A1 (en) | Optical apparatus and lighting device thereof | |
US9425895B2 (en) | Signal receiving module and display apparatus | |
US10976560B2 (en) | Navigation device, illumination system and light beam shaping optics thereof | |
CN106289092B (en) | Optical device and light-emitting device thereof | |
EP3074805B1 (en) | Lighting device | |
US20140320851A1 (en) | Lens module testing device | |
US20150345735A1 (en) | Secondary optical element and light source module | |
TWM509339U (en) | Optical device and light emitting device thereof | |
US9772718B2 (en) | Optical touch device and touch detecting method using the same | |
US9229582B2 (en) | Motion trajectory capturing device and motion trajectory capturing module thereof | |
US20130106786A1 (en) | Handwriting System and Sensing Method Thereof | |
EP3552193B1 (en) | Flash light emitter with remote communication function | |
US20150365652A1 (en) | Depth camera system | |
KR20160060843A (en) | light distribution feature variable type lighting | |
US20130314532A1 (en) | Vision detection device and vision detection method thereof | |
US9860519B2 (en) | Method for correcting image phase | |
US20130027974A1 (en) | Electronic device with light-guide structure | |
WO2018104130A1 (en) | Flash light emitter with remote communication function | |
US9223078B2 (en) | Positioning signal transmitter module and electronic product with cursor-controllable function | |
TWI749280B (en) | Structured light emitting module, structured light sensing module, and electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LIPS CORPORATION, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIU, LING-WEI;TSAI, HUNG-CHANG;REEL/FRAME:033521/0481 Effective date: 20140801 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 8 |