CN101836852A - Medical endoscope containing structured light three-dimensional imaging system - Google Patents

Medical endoscope containing structured light three-dimensional imaging system Download PDF

Info

Publication number
CN101836852A
CN101836852A CN201010179256.5A CN201010179256A CN101836852A CN 101836852 A CN101836852 A CN 101836852A CN 201010179256 A CN201010179256 A CN 201010179256A CN 101836852 A CN101836852 A CN 101836852A
Authority
CN
China
Prior art keywords
structured light
light
image
medical endoscope
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201010179256.5A
Other languages
Chinese (zh)
Other versions
CN101836852B (en
Inventor
王宽全
左旺孟
纪筱鹏
陈彦军
吴秋峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN2010101792565A priority Critical patent/CN101836852B/en
Publication of CN101836852A publication Critical patent/CN101836852A/en
Application granted granted Critical
Publication of CN101836852B publication Critical patent/CN101836852B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0605Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for spatially modulated illumination

Abstract

The invention provides a medical endoscope containing a structured light three-dimensional imaging system, which relates to a medical endoscope, solves the problem that the conventional three-dimensional observing technology can not be directly applied to the medical endoscope due to space limit in the brain surgery of nasal cavity expansion. The medical endoscope comprises a working scope tube, a computing and processing module and a structured light channel, wherein the working scope tube comprises an imaging channel and an illuminating channel; illuminating optical fibers are arranged in the illuminating channel; the signal input end of the computing and processing module is connected with the electric signal output end of the imaging channel; the structured light channel is arranged in the illuminating channel; the light beam outputted from the tail end of the illuminating optical fiber is received by the structured light channel; the light beam generates structured light after passing through the structured light channel; and the structured light is outputted out of the illuminating channel through the structured light channel. The invention overcomes the defects of the prior art and can be applied to the brain surgery of nasal cavity expansion.

Description

The medical endoscope that comprises structured light three-dimensional imaging system
Technical field
The present invention relates to a kind of medical endoscope.
Background technology
The endoscopic imaging technology is a kind of typical medical imaging technology, is all bringing into play important effect at aspects such as medical diagnosis and surgical navigationals.Along with the pay attention to day by day of people to diagnosis and surgical navigational precision, the application of three-dimensional imaging technology in medical endoscope is also increasing.With the cerebroma operation is example, in traditional cerebroma Therapeutic Method, adopts incision patient's the skull or the modus operandi of facial skeleton as craniotomy, tends to badly damaged patient's appearance, and needs the long post-operative recovery phase.Recently, (EEN ExpandedEndonasalNeurosurgery) has obtained very big concern to the nasal cavity expansion cerebral surgery operation in the cerebroma clinical treatment.This operation plan imports nasal cavity with miniature endoscope and surgical device, and the exact position that finds out cerebroma is also excised.The smooth implementation of EEN operation needs effective guide of scope image navigation system, and the performance of navigation system can directly have influence on the accurate positioning and the operating susceptiveness of cerebroma.General main two subsystems that comprise of image navigation system of endoscope: (1) is used for obtaining in real time the endoscopic imaging system of operative site image; (2) be used for position with surgical apparatus and be mapped to navigation system on preoperative CT or the MRI data.Fig. 1 is the structural representation of a typical rigid body endoscope, as shown in Figure 1, there are two passages in endoscope at internal work mirror tube portion: imaging passage 0-4 and illumination channel 0-6, and wherein imaging passage 0-4 is used for the organ surface imaging, and illumination channel 0-6 then is used for output beam.The optical element (counting from end) of imaging passage 0-4 comprises the object lens 0-3 that disperses camera lens 0-5, is used to focus that is used to observe big field-of-view angle, bar-shaped conducting parts 0-2 and the magnification eyepiece 0-7 that is used for converted image; Illumination channel only comprises lighting fiber 0-1, is used to be connected to the light source place.0-4 compares with the imaging passage, and it is much simple that the structure of illumination channel 0-6 is wanted.
The image navigation system of endoscope that is applied to EEN operation at present still has very big unsound property, owing to can not restore the three-dimensional scenic certain deviation (maximum deviation can reach about 2cm) of appearance that causes navigating from the image that obtains or video.If lack the necessary three-dimensional scene information of operative site, the doctor often needs to attempt the contact tissue surface experiencing depth distance, or relies on the personal experience to make subjective judgment.Thereby accurate three-dimensional visualization scene will significantly improve the susceptiveness and the localized accuracy of cerebroma of surgeon's operation technique, has great technology and medical application and is worth.
Recent years, the dimensional Modeling Technology of endoscopic images has obtained development to a certain degree and has obtained preliminary achievement in research.Yet because the endoscope that uses in the EEN operation must arrive the skull bottom section so that can pass nasal cavity very for a short time, stereopsis technology that some are conventional such as multi-eye stereo vision often can not directly be used owing to spatial constraints.Up to now, the report that does not occur feasible EEN three dimensional structure modeling technique aspect both at home and abroad as yet.
Summary of the invention
The objective of the invention is to solve in the nasal cavity expansion cerebral surgery operation, can not directly apply to the problem of medical endoscope because conventional stereopsis technology is subjected to spatial constraints, a kind of medical endoscope that comprises structured light three-dimensional imaging system is provided.
The medical endoscope that comprises structured light three-dimensional imaging system, it comprises work mirror pipe, described work mirror pipe comprises imaging passage and illumination channel, described illumination channel internal illumination optical fiber, it also comprises the computing module, and the signal input part of described computing module connects into the electrical signal of picture passage;
It also comprises the structured light passage, described structured light passage places in the illumination channel, the light beam of the end output of lighting fiber is received by the structured light passage, produce structured light behind this light beam process structured light passage to, and described structured light is exported outside the illumination channel by the structured light passage.
The medical endoscope that comprises structured light three-dimensional imaging system of the present invention, by in the illumination channel of medical endoscope, setting up structured light passage, and comprehensive the use, and can be applied in the nasal cavity expansion cerebral surgery operation based on the structural light three-dimensional method for reconstructing of grid deformation and based on the three-dimensional shape information that three-dimensional rebuilding method obtains medical tissue and organ surface that defocuses of method of geometry; 3-D view of the present invention realizes there is not the occupying volume external space by the structural light three-dimensional method for reconstructing.
Description of drawings
Fig. 1 is the structural representation of typical rigid body endoscope; Fig. 2 is the structural representation of medical endoscope of the present invention; Fig. 3 is the structural representation of the structured light passage in the medical endoscope of the present invention; Fig. 4 is the generalized section of medical endoscope of the present invention.
The specific embodiment
The specific embodiment one: in conjunction with Fig. 2 and Fig. 3 present embodiment is described, the medical endoscope that comprises structured light three-dimensional imaging system of present embodiment, it comprises work mirror pipe, described work mirror pipe comprises imaging passage 1 and illumination channel 2, described illumination channel 2 internal illumination optical fiber 3, it also comprises computing module 4, and the signal input part of described computing module 4 connects into the electrical signal of picture passage 1;
It also comprises structured light passage 5, described structured light passage 5 places in the illumination channel 2, the light beam of the end output of lighting fiber 3 is received by structured light passage 5, and this light beam produces structured light through structured light passage 5 backs, and described structured light is exported to outside the illumination channel 2 by structured light passage 5.Above structure can be referring to Fig. 2.
The diameter of lighting fiber 2 is about 10 microns (mm), uses the reason of thin optic fibre bundle to be that it can be approximated to be a point source.
Endoscope as shown in Figure 2 comprises imaging passage 1 and illumination channel 2.Imaging passage 1 comprises and is used to observe dispersing camera lens, the object lens that are used to focus, being used for the bar-shaped conducting parts and the magnification eyepiece of converted image of big field-of-view angle; Illumination channel 2 internal illumination optical fiber 3, lighting fiber 3 is connected to the light source place.Structured light passage 5 is set in the illumination channel 2, is used for generating structure light.Wherein Target is a target.
With expansion intranasal cerebral surgery operation is example, owing to endoscope need be inserted from nasal cavity, so endoscope's size must be small and exquisite as far as possible.As shown in Figure 4, about 4 millimeters of the diameter of rigid body endoscope, about 2.8 millimeters of imaging passage 1 diameter, about 1 millimeter of structured light passage 5 diameters.
Referring to Fig. 3, described structured light passage 5 can be made up of amasthenic lens group 51, miniature grid screen 52 and projection lens group 53, through amasthenic lens group 51, miniature grid screen 52 and projection lens group 53 after, export successively by generating structure light for the light beam of the end output of lighting fiber 3.
Miniature grid screen 52 is key elements of design, and it need possess following characteristics: solid, fairly regular and resolution very high (being of a size of standard with grid unit); In the present embodiment, the material of described miniature grid screen 52 can adopt the carbon polymeric material, specifically can select carbon nano tube/epoxy resin composite or carbon nano-tube/poly ammonia ester composite for use.
Make b1 represent the distance of miniature grid screen 52, make b2 represent the distance of miniature grid screen 52, then can make 1 to projection lens group 53 equivalent photocentres to the equivalent photocentre of amasthenic lens group 51 :3〉b1 :B2〉1 :5.
The light beam of described structured light passage 5 outputs is structured light, because endoscope's size and structural limitations can't produce complicated structure light coding pattern, and can only produce single raster mode.
When projection lens group 53 can be similar to thin camera lens module, distance b 2 is determined by two factors, described two factors are respectively the equivalent photocentre of projection lens group 53 to the amplification R apart from Z2 and projection lens group 53 between the target, b2=Z/R is promptly arranged, its middle distance Z2 can be according to the statistical study of EEN Clinical symptoms is estimated, Z2 is 10 ~ 20mm as to the conchoscope imaging time, and amplification R is by the light source decision of being adopted.
Described amasthenic lens group 51 can be made up of first planoconvex lens 511 and second planoconvex lens 512, and the convex surfaces of the convex surfaces of first planoconvex lens 511 and second planoconvex lens 512 is staggered relatively, the plane surface of first planoconvex lens 511 is as the light input end of amasthenic lens group 51, and the plane surface of second planoconvex lens 512 is as the light output end of amasthenic lens group 51.
Described first planoconvex lens 511 and second planoconvex lens 512 all can adopt the two and lens of achromatism.
In the present embodiment, the inner cold light of xenon or metal halide generation that uses of endoscope is as light source, consider the wide spectrum of light source, can adopt achromatic doublet, the not normal minimum of aberration that the camera lens variations in refractive index about optical wavelength is caused as amasthenic lens.
Make d1 represent the focal length of first planoconvex lens 511, make d2 represent the focal length of second planoconvex lens 512, then the distance between the photocentre of the photocentre of first planoconvex lens 511 and second planoconvex lens 512 can be d1+d2.
Described projection lens group 53 can be made up of the 3rd planoconvex lens 531 and Siping City's convex lens 532, and the convex surfaces of the 3rd planoconvex lens 531 and the convex surfaces of Siping City's convex lens 532 are staggered relatively, the plane surface of the 3rd planoconvex lens 531 is as the light input end of amasthenic lens group 51, and the plane surface of Siping City's convex lens 532 is as the light output end of amasthenic lens group 51.
Make d3 represent the focal length of the 3rd planoconvex lens 531, make d4 represent the focal length of Siping City's convex lens 532, then the distance between the photocentre of the photocentre of the 3rd planoconvex lens 531 and Siping City's convex lens 532 can be d3+d4.
Distance D between the terminal and miniature grid screen 52 of lighting fiber 3 can determine that described distance D need satisfy following constraints according to the raster resolution standard:
Figure DEST_PATH_IMAGE002
Wherein H represents the radius of structured light passage 5, and L represents the radius in optical fibre illumination zone, and Z represents the distance between miniature grid screen 52 and the target.
Satisfying under the situation of above-mentioned constraints, selecting bigger D value, can guarantee to obtain higher raster resolution.
Described computing module 4 is used for the image that imaging passage 1 obtains is carried out three-dimensional reconstruction, obtains the 3-D view of described image.
The detailed process that the image that 4 pairs of imaging passages of computing module 1 obtain carries out three-dimensional reconstruction is:
For clear area in the target,, and utilize the surface three dimension shape of rebuilding described clear area based on the structural light three-dimensional method for reconstructing of grid deformation by the method for extraction grid angle point;
For fuzzy region in the target, adopt the surface three dimension shape that three-dimensional rebuilding method is rebuild described fuzzy region that defocuses based on method of geometry.
The detailed process of described three-dimensional rebuilding method based on grid deformation can be with reference to following process:
For any 1 P on the object, its coordinate in world coordinate system is
Figure 2010101792565100002DEST_PATH_IMAGE004
, at the coordinate of photographing unit reference frame be , at the coordinate of projection lens reference frame be
Figure 2010101792565100002DEST_PATH_IMAGE008
The initial point of photographing unit reference frame is defined in the photocentre of the CCD lens of the interior photographing unit of imaging passage (1), and the initial point of projection lens reference frame is defined in the photocentre of structured light passage (5) inner projection lens group (53), camera images coordinate system
Figure 2010101792565100002DEST_PATH_IMAGE010
Initial point be defined in the center of CCD
Figure 2010101792565100002DEST_PATH_IMAGE012
, the projection lens image coordinate system
Figure 2010101792565100002DEST_PATH_IMAGE014
Initial point be defined in the center of projection lens group (53)
Figure 2010101792565100002DEST_PATH_IMAGE016
Figure 2010101792565100002DEST_PATH_IMAGE018
Be the focal length of CCD lens,
Figure 2010101792565100002DEST_PATH_IMAGE020
It is the focal length of projection lens group (53);
The world coordinates of spatial point P With the photographing unit reference coordinate
Figure 164570DEST_PATH_IMAGE006
There is following transformational relation:
Figure 2010101792565100002DEST_PATH_IMAGE022
Consider the inclination deformation situation of image.When so-called inclination deformation just was meant imaging, the X-axis and the Y-axis of image were non-orthogonal, though in most cases X-axis and Y-axis are orthogonal, may cause X-axis and Y-axis non-orthogonal when optical axis and the incomplete quadrature of imaging plane.
The inclination deformation angle of supposing X-axis and Y-axis is
Figure 2010101792565100002DEST_PATH_IMAGE024
, obtain:
Figure 2010101792565100002DEST_PATH_IMAGE026
Wherein
Figure 2010101792565100002DEST_PATH_IMAGE028
Be the focal length of CCD lens U direction,
Figure 2010101792565100002DEST_PATH_IMAGE030
Focal length for CCD lens V direction;
So:
With the inner parameter matrix and the external parameter matrix abbreviation of photographing unit, and order
Figure 2010101792565100002DEST_PATH_IMAGE034
, obtain:
In like manner because projector can be regarded as the inversion of photographing unit, so can obtain:
Figure DEST_PATH_IMAGE038
Cancellation
Figure DEST_PATH_IMAGE040
With
Figure DEST_PATH_IMAGE042
, obtain:
Figure DEST_PATH_IMAGE044
After the image that is obtained by photographing unit was handled through decoding, each code value can be mapped to the relevant position of the coding pattern that projection lens group (53) throwed, and promptly has a kind of corresponding relation between them:
The concrete form of following formula is by the coded system decision of being adopted, and different coded system correspondences different concrete forms;
For a structured light system of demarcating, the inside and outside parameter of photographing unit and projector is all known.If can implementation space point in the coupling (Correspondence) of picture point on the photographing unit and the subpoint on the projector, promptly determine corresponding relation, then can obtain the coordinate of spatial point P, thereby realize three-dimensional reconstruction.Because endoscope's size and structural limitations, can't produce complicated structure light coding pattern, can only produce single raster mode, by extracting the grid angle point and utilizing the 3D shape that the trigonometric ratio method can reconstructed surface.
The described process that defocuses three-dimensional rebuilding method based on method of geometry is as follows:
Step 1, generation at random TImage focal planes such as the width of cloth r j , obtain image focal planes such as every width of cloth and equal in object distance zThe light distribution of the out-of-focus image at 0 place I 1, j , obtain object distance simultaneously and equal zThe light distribution of the out-of-focus image of 1 image focal planes such as every width of cloth I 2, j Wherein,
Figure DEST_PATH_IMAGE048
,
Figure DEST_PATH_IMAGE050
,
Figure DEST_PATH_IMAGE052
Step 2, based on ( I 1, j , I 2, j ) |
Figure 147919DEST_PATH_IMAGE048
Make up training sample set, it is right to introduce image I j =( I 1, j , I 2, j );
Step 3, according to the minimum principle of inequality, have
Figure DEST_PATH_IMAGE054
Wherein,
Figure DEST_PATH_IMAGE056
Represent the restorative image focal plane of Denging,
Figure DEST_PATH_IMAGE058
The depth information estimation of presentation video,
Figure DEST_PATH_IMAGE060
The expression degree of depth is SThe time correspondence linearity defocus transformation operator;
Step 4, to each degree of depth rank SFind the solution the linear operator of a correspondence
Figure DEST_PATH_IMAGE062
, make
Figure DEST_PATH_IMAGE064
Minimum, thus each degree of depth rank obtained SCorresponding linear operator
Figure 422037DEST_PATH_IMAGE062
Wherein Represent that a degree of depth is SOut-of-focus image right;
Step 5, when endoscopic imaging, adjust camera and obtain two width of cloth images I=( I 1, I 2), utilize step 4 to obtain
Figure 727248DEST_PATH_IMAGE062
, according to formula
Figure DEST_PATH_IMAGE068
, obtain the depth information of image, and then realize three-dimensional reconstruction image.
The detailed process of the described content of step 4 is:
To each degree of depth rank SFind the solution the linear operator of a correspondence
Figure 906556DEST_PATH_IMAGE062
, make
Figure 119363DEST_PATH_IMAGE064
Minimum, wherein
Figure 700517DEST_PATH_IMAGE066
Represent that a degree of depth is SOut-of-focus image right;
Make up a large-spacing learning planning problem and learn linear operator
Figure 35683DEST_PATH_IMAGE062
:
Figure DEST_PATH_IMAGE070
Order
Figure DEST_PATH_IMAGE072
,
If I j Corresponding depth information is S, then
Figure DEST_PATH_IMAGE074
, otherwise
Figure DEST_PATH_IMAGE076
Wherein, , be the compromise parameter;
Utilize the gradient descent method on the Stiefel stream shape, find the solution the acquisition linear operator
Figure 515337DEST_PATH_IMAGE062
Operation principle of the present invention is:
Structured light passage in the endoscope is launched the light of AD HOC, after projecting organ surface, catch the organ surface image by the camera in the imaging passage, by the deformation data of computing module, utilize the structural light three-dimensional method for reconstructing to extract the 3D shape of organ then by light in the analysis image.
The medical endoscope that comprises structured light three-dimensional imaging system of the present invention, by in the illumination channel of rigidity medical endoscope, setting up a pipeline, focus lens group, miniature grid screen and projection lens group are set in pipeline, and realize a structured light generation system in conjunction with the fibre bundle that utilizes endoscope, the comprehensive use based on the structural light three-dimensional method for reconstructing of grid deformation and based on the three-dimensional shape information that three-dimensional rebuilding method obtains medical tissue and organ surface that defocuses of method of geometry.

Claims (9)

1. the medical endoscope that comprises structured light three-dimensional imaging system, it comprises work mirror pipe, described work mirror pipe comprises imaging passage (1) and illumination channel (2), described illumination channel (2) internal illumination optical fiber (3), it also comprises computing module (4), and the signal input part of described computing module (4) connects into the electrical signal of picture passage (1);
It is characterized in that, it also comprises structured light passage (5), described structured light passage (5) places in the illumination channel (2), the light beam of the end output of lighting fiber (3) is received by structured light passage (5), this light beam produces structured light through structured light passage (5) back, and described structured light is exported to outside the illumination channel (2) by structured light passage (5).
2. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 1, it is characterized in that described structured light passage (5) shields (52) by amasthenic lens group (51), miniature grid and projection lens group (53) is formed, after the light beam of the end output of lighting fiber (3) passes through amasthenic lens group (51), miniature grid screen (52) and projection lens group (53) successively, the output of generating structure light.
3. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 2, it is characterized in that described amasthenic lens group (51) is made up of first planoconvex lens (511) and second planoconvex lens (512), and the convex surfaces of the convex surfaces of first planoconvex lens (511) and second planoconvex lens (512) is staggered relatively, the plane surface of first planoconvex lens (511) is as the light input end of amasthenic lens group (51), and the plane surface of second planoconvex lens (512) is as the light output end of amasthenic lens group (51).
4. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 2, it is characterized in that described projection lens group (53) is made up of the 3rd planoconvex lens (531) and Siping City's convex lens (532), and the convex surfaces of the 3rd planoconvex lens (531) and the convex surfaces of Siping City's convex lens (532) are staggered relatively, the plane surface of the 3rd planoconvex lens (531) is as the light input end of amasthenic lens group (51), and the plane surface of Siping City's convex lens (532) is as the light output end of amasthenic lens group (51).
5. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 2, it is characterized in that the distance D between the end of described lighting fiber (3) and the miniature grid screen (52) determines that according to the raster resolution standard described distance D need satisfy following constraints:
Wherein H represents the radius of structured light passage (5), and L represents the radius in optical fibre illumination zone, and Z represents the distance between miniature grid screen (52) and the target.
6. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 2 is characterized in that described computing module (4) is used for the image that imaging passage (1) obtains is carried out three-dimensional reconstruction, obtains the 3-D view of described image.
7. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 6 is characterized in that the detailed process that image that computing module (4) obtains imaging passage (1) carries out three-dimensional reconstruction is:
For clear area in the target,, and utilize the surface three dimension shape of rebuilding described clear area based on the structural light three-dimensional method for reconstructing of grid deformation by the method for extraction grid angle point;
For fuzzy region in the target, adopt the surface three dimension shape that three-dimensional rebuilding method is rebuild described fuzzy region that defocuses based on method of geometry.
8. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 7 is characterized in that the described process that defocuses three-dimensional rebuilding method based on method of geometry is as follows:
Step 1, generation at random TImage focal planes such as the width of cloth r j , obtain image focal planes such as every width of cloth and equal in object distance zThe light distribution of the out-of-focus image at 0 place I 1, j , obtain object distance simultaneously and equal zThe light distribution of the out-of-focus image of 1 image focal planes such as every width of cloth I 2, j Wherein,
Figure DEST_PATH_IMAGE004
,
Figure DEST_PATH_IMAGE006
,
Figure DEST_PATH_IMAGE008
Step 2, based on ( I 1, j , I 2, j ) |
Figure 89775DEST_PATH_IMAGE004
Make up training sample set, it is right to introduce image I j =( I 1, j , I 2, j );
Step 3, according to the minimum principle of inequality, have
Figure DEST_PATH_IMAGE010
Wherein,
Figure DEST_PATH_IMAGE012
Represent the restorative image focal plane of Denging,
Figure DEST_PATH_IMAGE014
The depth information estimation of presentation video,
Figure DEST_PATH_IMAGE016
The expression degree of depth is SThe time correspondence linearity defocus transformation operator;
Step 4, to each degree of depth rank SFind the solution the linear operator of a correspondence
Figure DEST_PATH_IMAGE018
, make
Figure DEST_PATH_IMAGE020
Minimum, thus each degree of depth rank obtained SCorresponding linear operator
Figure 450872DEST_PATH_IMAGE018
Wherein Represent that a degree of depth is SOut-of-focus image right;
Step 5, when endoscopic imaging, adjust camera and obtain two width of cloth images I=( I 1, I 2), utilize step 4 to obtain
Figure 721447DEST_PATH_IMAGE018
, according to formula
Figure DEST_PATH_IMAGE024
, obtain the depth information of image, and then realize three-dimensional reconstruction image.
9. the medical endoscope that comprises structured light three-dimensional imaging system according to claim 8 is characterized in that the detailed process of the described content of step 4 is:
To each degree of depth rank SFind the solution the linear operator of a correspondence
Figure 598136DEST_PATH_IMAGE018
, make Minimum, wherein
Figure 562998DEST_PATH_IMAGE022
Represent that a degree of depth is SOut-of-focus image right;
Make up a large-spacing learning planning problem and learn linear operator
Figure 761899DEST_PATH_IMAGE018
:
Figure DEST_PATH_IMAGE026
Order ,
If I j Corresponding depth information is S, then
Figure DEST_PATH_IMAGE030
, otherwise
Figure DEST_PATH_IMAGE032
Wherein,
Figure DEST_PATH_IMAGE034
, be the compromise parameter;
Utilize the gradient descent method on the Stiefel stream shape, find the solution the acquisition linear operator
Figure 181510DEST_PATH_IMAGE018
CN2010101792565A 2010-05-21 2010-05-21 Medical endoscope containing structured light three-dimensional imaging system Expired - Fee Related CN101836852B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010101792565A CN101836852B (en) 2010-05-21 2010-05-21 Medical endoscope containing structured light three-dimensional imaging system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010101792565A CN101836852B (en) 2010-05-21 2010-05-21 Medical endoscope containing structured light three-dimensional imaging system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201110261463.XA Division CN102283626B (en) 2010-05-21 2010-05-21 Medical endoscope containing structured light three-dimensional imaging system

Publications (2)

Publication Number Publication Date
CN101836852A true CN101836852A (en) 2010-09-22
CN101836852B CN101836852B (en) 2012-07-18

Family

ID=42740715

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010101792565A Expired - Fee Related CN101836852B (en) 2010-05-21 2010-05-21 Medical endoscope containing structured light three-dimensional imaging system

Country Status (1)

Country Link
CN (1) CN101836852B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103513330A (en) * 2012-06-28 2014-01-15 耿征 Structured light generating device, minitype three-dimensional imaging device and method for collecting three-dimensional data
CN103765159A (en) * 2011-09-02 2014-04-30 皇家飞利浦有限公司 Rapid dense point cloud imaging using probabilistic voxel maps
CN105996961A (en) * 2016-04-27 2016-10-12 安翰光电技术(武汉)有限公司 3D stereo-imaging capsule endoscope system based on structured light and method for same
CN108388070A (en) * 2017-02-03 2018-08-10 深圳奥比中光科技有限公司 Fibre-optical projector and apply its depth camera
CN110426837A (en) * 2019-07-19 2019-11-08 青岛智能产业技术研究院 More mesh three-dimensional endoscopic imaging systems based on simple lens
US10512508B2 (en) 2015-06-15 2019-12-24 The University Of British Columbia Imagery system
CN110613510A (en) * 2018-06-19 2019-12-27 清华大学 Self-projection endoscope device
CN112577458A (en) * 2019-09-27 2021-03-30 沈阳华慧高新技术有限公司 Three-dimensional scanning endoscope device, calibration method and use method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6503195B1 (en) * 1999-05-24 2003-01-07 University Of North Carolina At Chapel Hill Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
WO2003105289A2 (en) * 2002-06-07 2003-12-18 University Of North Carolina At Chapel Hill Methods and systems for laser based real-time structured light depth extraction
CN101264002A (en) * 2008-05-06 2008-09-17 中国科学院上海光学精密机械研究所 Three-dimensional endoscope measuring device and method based on optical grating projection
CN101305899A (en) * 2008-07-09 2008-11-19 中国科学院上海光学精密机械研究所 Three dimensional measuring device and method based amplitude transmission grating projection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6503195B1 (en) * 1999-05-24 2003-01-07 University Of North Carolina At Chapel Hill Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
WO2003105289A2 (en) * 2002-06-07 2003-12-18 University Of North Carolina At Chapel Hill Methods and systems for laser based real-time structured light depth extraction
CN101264002A (en) * 2008-05-06 2008-09-17 中国科学院上海光学精密机械研究所 Three-dimensional endoscope measuring device and method based on optical grating projection
CN101305899A (en) * 2008-07-09 2008-11-19 中国科学院上海光学精密机械研究所 Three dimensional measuring device and method based amplitude transmission grating projection

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103765159A (en) * 2011-09-02 2014-04-30 皇家飞利浦有限公司 Rapid dense point cloud imaging using probabilistic voxel maps
CN103513330A (en) * 2012-06-28 2014-01-15 耿征 Structured light generating device, minitype three-dimensional imaging device and method for collecting three-dimensional data
US10512508B2 (en) 2015-06-15 2019-12-24 The University Of British Columbia Imagery system
CN105996961A (en) * 2016-04-27 2016-10-12 安翰光电技术(武汉)有限公司 3D stereo-imaging capsule endoscope system based on structured light and method for same
CN105996961B (en) * 2016-04-27 2018-05-11 安翰光电技术(武汉)有限公司 3D three-dimensional imagings capsule endoscope system and method based on structure light
CN108388070A (en) * 2017-02-03 2018-08-10 深圳奥比中光科技有限公司 Fibre-optical projector and apply its depth camera
CN110613510A (en) * 2018-06-19 2019-12-27 清华大学 Self-projection endoscope device
CN110613510B (en) * 2018-06-19 2020-07-21 清华大学 Self-projection endoscope device
CN110426837A (en) * 2019-07-19 2019-11-08 青岛智能产业技术研究院 More mesh three-dimensional endoscopic imaging systems based on simple lens
CN112577458A (en) * 2019-09-27 2021-03-30 沈阳华慧高新技术有限公司 Three-dimensional scanning endoscope device, calibration method and use method thereof
CN112577458B (en) * 2019-09-27 2024-02-02 沈阳华慧高新技术有限公司 Three-dimensional scanning endoscope device, calibration method and use method thereof

Also Published As

Publication number Publication date
CN101836852B (en) 2012-07-18

Similar Documents

Publication Publication Date Title
CN101836852B (en) Medical endoscope containing structured light three-dimensional imaging system
CN106236006B (en) 3D optical molecular image laparoscope imaging systems
Geng et al. Review of 3-D endoscopic surface imaging techniques
US9549662B2 (en) Endoscope connector method and apparatus
CN101797182A (en) Nasal endoscope minimally invasive operation navigating system based on augmented reality technique
CN105242393B (en) A kind of stereo endoscope electronic imaging optical system
CN104280886A (en) Microscopic system and microscopic method based on in-situ three-dimensional enhanced display
CN110811498A (en) Visible light and near-infrared fluorescence 3D fusion image endoscope system
CN110169821B (en) Image processing method, device and system
CN102283626B (en) Medical endoscope containing structured light three-dimensional imaging system
CN101889853B (en) Three-dimensional endoscope system capable of rotating freely for angles
CN103654699A (en) Fluorescence excitation binocular endoscopic system
JP2015220643A (en) Stereoscopic observation device
CN103142202B (en) Prism-based medical endoscope system with measurement function and method
CN109068035A (en) A kind of micro- camera array endoscopic imaging system of intelligence
CN110680264A (en) 3D optical endoscope system based on dual-optical-path design
CN110840385A (en) Binocular 3D endoscope three-dimensional image processing method and imaging system based on single detector
CN106725245A (en) A kind of objective lens arrangement for stereo endoscope
Clancy et al. An endoscopic structured lighting probe using spectral encoding
US20140055562A1 (en) Endoscopic synthetic stereo imaging method and apparatus
CN110623626A (en) Two-dimensional-three-dimensional imaging converter for two-dimensional laparoscope
CN114019671A (en) Hard endoscope with large field angle
CN110613510B (en) Self-projection endoscope device
CN110623625A (en) Three-dimensional imaging converter for two-dimensional laparoscope
CN204203546U (en) Comprise the stereoscopic objective lens optical system of binocular solid endoscope of wedge

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120718

Termination date: 20130521