WO2005020151A3 - Method and apparatus for registration of virtual endoscopic images - Google Patents

Method and apparatus for registration of virtual endoscopic images Download PDF

Info

Publication number
WO2005020151A3
WO2005020151A3 PCT/US2004/026026 US2004026026W WO2005020151A3 WO 2005020151 A3 WO2005020151 A3 WO 2005020151A3 US 2004026026 W US2004026026 W US 2004026026W WO 2005020151 A3 WO2005020151 A3 WO 2005020151A3
Authority
WO
WIPO (PCT)
Prior art keywords
images
reference frame
centerline
registration
virtual
Prior art date
Application number
PCT/US2004/026026
Other languages
French (fr)
Other versions
WO2005020151A2 (en
Inventor
Hotel Christophe Chefd
Bernhard Geiger
Original Assignee
Siemens Corp Res Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Corp Res Inc filed Critical Siemens Corp Res Inc
Priority to JP2006523337A priority Critical patent/JP2007501675A/en
Priority to EP04780803A priority patent/EP1656643A2/en
Publication of WO2005020151A2 publication Critical patent/WO2005020151A2/en
Publication of WO2005020151A3 publication Critical patent/WO2005020151A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10081—Computed x-ray tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10088—Magnetic resonance imaging [MRI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30028—Colon; Small intestine

Abstract

A method for registration of virtual endoscopy images in first and second patient positions comprises performing colon segmentation and feature extraction, including centerline and colon surface data for each of the images; resampling the centerline and colon surface data; computing respective local descriptors; pairing point correspondences on the centerlines between the first and second images by minimal cost matching; extrapolating the centerline point correspondences to a 3 dimensional/3 dimensional (3D/3D) transformation between the first and second images. The method also includes selecting a position for a virtual endoscope in one of the images; associating an orthogonal reference frame with the virtual endoscope; and applying the 3D/3D transformation to the orthogonal reference frame so as to derive a corresponding transformed reference frame for the virtual endoscope in the other of the images.
PCT/US2004/026026 2003-08-14 2004-08-11 Method and apparatus for registration of virtual endoscopic images WO2005020151A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2006523337A JP2007501675A (en) 2003-08-14 2004-08-11 Virtual endoscopic image registration method and virtual endoscopic image registration apparatus
EP04780803A EP1656643A2 (en) 2003-08-14 2004-08-11 Method and apparatus for registration of virtual endoscopic images

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US49530403P 2003-08-14 2003-08-14
US60/495,304 2003-08-14
US10/915,501 2004-08-09
US10/915,501 US7300398B2 (en) 2003-08-14 2004-08-09 Method and apparatus for registration of virtual endoscopic images

Publications (2)

Publication Number Publication Date
WO2005020151A2 WO2005020151A2 (en) 2005-03-03
WO2005020151A3 true WO2005020151A3 (en) 2005-09-01

Family

ID=34221382

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/026026 WO2005020151A2 (en) 2003-08-14 2004-08-11 Method and apparatus for registration of virtual endoscopic images

Country Status (4)

Country Link
US (1) US7300398B2 (en)
EP (1) EP1656643A2 (en)
JP (1) JP2007501675A (en)
WO (1) WO2005020151A2 (en)

Families Citing this family (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7457444B2 (en) * 2003-05-14 2008-11-25 Siemens Medical Solutions Usa, Inc. Method and apparatus for fast automatic centerline extraction for virtual endoscopy
US7574032B2 (en) * 2003-10-31 2009-08-11 General Electric Company Method and apparatus for virtual subtraction of stool from registration and shape based analysis of prone and supine scans of the colon
US20060079746A1 (en) * 2004-10-11 2006-04-13 Perret Florence M Apparatus and method for analysis of tissue classes along tubular structures
RU2007137054A (en) * 2005-03-07 2009-04-20 Конинклейке Филипс Электроникс Н.В. (Nl) DEVICE AND METHOD FOR COMPARING THE FIRST AND SECOND 3D-IMAGES OF A TUBULAR OBJECT
CN101263527B (en) * 2005-08-01 2012-05-30 皇家飞利浦电子股份有限公司 Method and apparatus for matching first and second image data of an object
US20070092144A1 (en) * 2005-08-17 2007-04-26 Chuanyong Bai Random data resampling for medical imaging
EP1942800B1 (en) * 2005-09-09 2011-09-07 Given Imaging Ltd. Concurrent transfer and processing and real time viewing of in-vivo images
US7590272B2 (en) * 2005-11-23 2009-09-15 Vital Images, Inc. Colon characteristic path registration
WO2007070008A1 (en) * 2005-12-14 2007-06-21 Agency For Science, Technology And Research Warping and transformation of images
US9224303B2 (en) 2006-01-13 2015-12-29 Silvertree Media, Llc Computer based system for training workers
DE102006012943B4 (en) * 2006-03-21 2009-11-19 Siemens Ag Method for automatically evaluating an imaging data set of an object and medical imaging system
DE102006012945B4 (en) * 2006-03-21 2014-10-02 Siemens Aktiengesellschaft A method of virtual layer positioning in a 3D volume data set and medical imaging system
US7570986B2 (en) * 2006-05-17 2009-08-04 The United States Of America As Represented By The Secretary Of Health And Human Services Teniae coli guided navigation and registration for virtual colonoscopy
US7761134B2 (en) * 2006-10-20 2010-07-20 Given Imaging Ltd. System and method for modeling a tracking curve of an in vivo device
WO2008073855A2 (en) 2006-12-09 2008-06-19 Masimo Corporation Plethysmograph variability processor
GB0625455D0 (en) * 2006-12-20 2007-01-31 Mitsubishi Electric Inf Tech Graph-based multiple panorama extraction from unordered image sets
WO2008075061A2 (en) * 2006-12-20 2008-06-26 Mitsubishi Electric Information Technology Centre Europe B.V. Multiple image registration apparatus and method
US7970226B2 (en) * 2007-04-23 2011-06-28 Microsoft Corporation Local image descriptors
US8126275B2 (en) * 2007-04-24 2012-02-28 Microsoft Corporation Interest point detection
CN101889284B (en) * 2007-12-07 2014-03-12 皇家飞利浦电子股份有限公司 Navigation guide
WO2009094672A2 (en) * 2008-01-25 2009-07-30 Trustees Of Columbia University In The City Of New York Belief propagation for generalized matching
DE102008049467B4 (en) * 2008-09-29 2016-12-29 Siemens Healthcare Gmbh Method and device for registration of tomographic volume data sets of the intestine
WO2010068840A1 (en) * 2008-12-12 2010-06-17 The Trustees Of Columbia University In The City Of New York Machine optimization devices, methods, and systems
US8337397B2 (en) 2009-03-26 2012-12-25 Intuitive Surgical Operations, Inc. Method and system for providing visual guidance to an operator for steering a tip of an endoscopic device toward one or more landmarks in a patient
US10004387B2 (en) 2009-03-26 2018-06-26 Intuitive Surgical Operations, Inc. Method and system for assisting an operator in endoscopic navigation
JP5836267B2 (en) * 2009-05-18 2015-12-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Method and system for markerless tracking registration and calibration for an electromagnetic tracking endoscope system
CA2761944A1 (en) 2009-05-20 2010-11-25 The Trustees Of Columbia University In The City Of New York Systems devices and methods for estimating
JP5561578B2 (en) * 2009-08-03 2014-07-30 国立大学法人名古屋大学 Medical image observation support device
US7931588B2 (en) * 2009-09-14 2011-04-26 Artann Laboratories System for assessment of colonoscope manipulation
US8430817B1 (en) 2009-10-15 2013-04-30 Masimo Corporation System for determining confidence in respiratory rate measurements
US9848800B1 (en) 2009-10-16 2017-12-26 Masimo Corporation Respiratory pause detector
US8817014B2 (en) * 2009-11-23 2014-08-26 Siemens Medical Solutions Usa, Inc. Image display of a tubular structure
US8615127B2 (en) * 2010-01-15 2013-12-24 Vanderbilt University System and method for point-based rigid registration with anisotropic weighting
WO2011094518A2 (en) * 2010-01-28 2011-08-04 The Penn State Research Foundation Image-based global registration system and method applicable to bronchoscopy guidance
US9307928B1 (en) * 2010-03-30 2016-04-12 Masimo Corporation Plethysmographic respiration processor
US9659365B2 (en) * 2010-04-13 2017-05-23 Koninklijke Philips N.V. Image analysing
US9082082B2 (en) 2011-12-06 2015-07-14 The Trustees Of Columbia University In The City Of New York Network information methods devices and systems
US9129417B2 (en) * 2012-02-21 2015-09-08 Siemens Aktiengesellschaft Method and system for coronary artery centerline extraction
JP5930539B2 (en) * 2012-09-12 2016-06-08 富士フイルム株式会社 MEDICAL IMAGE DISPLAY DEVICE, METHOD, AND PROGRAM
US10441181B1 (en) 2013-03-13 2019-10-15 Masimo Corporation Acoustic pulse and respiration monitoring system
JP5725579B1 (en) * 2013-11-27 2015-05-27 株式会社Ａｚｅ Medical diagnosis support apparatus, method and program
US10331850B2 (en) * 2014-01-28 2019-06-25 Siemens Healthcare Gmbh Estimating body surface models of patients
WO2015164724A1 (en) * 2014-04-24 2015-10-29 Arizona Board Of Regents On Behalf Of Arizona State University System and method for quality assessment of optical colonoscopy images
US9892506B2 (en) * 2015-05-28 2018-02-13 The Florida International University Board Of Trustees Systems and methods for shape analysis using landmark-driven quasiconformal mapping
EP3324819A1 (en) * 2015-07-23 2018-05-30 Koninklijke Philips N.V. Endoscope guidance from interactive planar slices of a volume image
JP6242543B2 (en) * 2015-09-28 2017-12-06 オリンパス株式会社 Image processing apparatus and image processing method
US10426424B2 (en) 2017-11-21 2019-10-01 General Electric Company System and method for generating and performing imaging protocol simulations
US10675458B2 (en) 2018-07-24 2020-06-09 Synerfuse, Inc. Methods and systems for implanting a neuromodulation system and a spinal fixation system at a surgically open spinal treatment site
US10818080B2 (en) * 2018-07-25 2020-10-27 Disney Enterprises, Inc. Piecewise-polynomial coupling layers for warp-predicting neural networks

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5891030A (en) * 1997-01-24 1999-04-06 Mayo Foundation For Medical Education And Research System for two dimensional and three dimensional imaging of tubular structures in the human body

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5920319A (en) * 1994-10-27 1999-07-06 Wake Forest University Automatic analysis in virtual endoscopy
US6343936B1 (en) * 1996-09-16 2002-02-05 The Research Foundation Of State University Of New York System and method for performing a three-dimensional virtual examination, navigation and visualization
US6928314B1 (en) * 1998-01-23 2005-08-09 Mayo Foundation For Medical Education And Research System for two-dimensional and three-dimensional imaging of tubular structures in the human body
EP1058913B1 (en) * 1999-01-04 2005-08-31 Koninklijke Philips Electronics N.V. Method, system and apparatus for processing an image representing a tubular structure and for constructing a path through said structure
EP1337970A4 (en) * 2000-10-02 2006-09-20 Univ New York State Res Found Centerline and tree branch skeleton determination for virtual objects
WO2003046811A1 (en) * 2001-11-21 2003-06-05 Viatronix Incorporated Registration of scanning data acquired from different patient positions

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5891030A (en) * 1997-01-24 1999-04-06 Mayo Foundation For Medical Education And Research System for two dimensional and three dimensional imaging of tubular structures in the human body

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
NAIN D, HAKER S, GRIMSON W E L, COSMAN E, WELLS W W, JI H, KIKINIS R, WESTIN C F: "Intra-patient Prone to Supine Colon Registration for Synchronized Virtual Colonoscopy", LECTURE NOTES IN COMPUTER SCIENCE - LNCS, MICCAI 2002, TOKYO, CONFERENCE SERIES ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, vol. 2489, 25 September 2002 (2002-09-25) - 28 September 2002 (2002-09-28), SPRINGER VERLAG, BERLIN HEIDELBERG, pages 573 - 580, XP002332884 *
SUNDAR H ET AL: "Skeleton based shape matching and retrieval", SHAPE MODELING INTERNATIONAL, 2003 12-15 MAY 2003, PISCATAWAY, NJ, USA,IEEE, 12 May 2003 (2003-05-12), pages 130 - 290, XP010639691, ISBN: 0-7695-1909-1 *

Also Published As

Publication number Publication date
JP2007501675A (en) 2007-02-01
US7300398B2 (en) 2007-11-27
EP1656643A2 (en) 2006-05-17
US20050048456A1 (en) 2005-03-03
WO2005020151A2 (en) 2005-03-03

Similar Documents

Publication Publication Date Title
WO2005020151A3 (en) Method and apparatus for registration of virtual endoscopic images
US9066086B2 (en) Methods for generating stereoscopic views from monoscopic endoscope images and systems using the same
CN105283905B (en) Use the robust tracking of Points And lines feature
US20030039405A1 (en) Image position matching apparatus and image processing apparatus
WO2007060584A3 (en) Rendering views for a multi-view display device
WO2004095370A3 (en) Image data set with embedded pre-subpixel rendered image
Joshi et al. Shape from varying illumination and viewpoint
GB0712084D0 (en) Fingerprint matching method and apparatus
WO2008152924A1 (en) Image processing apparatus, image processing program and image processing method
WO2007056768A3 (en) Determining camera motion
CN101520902A (en) System and method for low cost motion capture and demonstration
Guo et al. A virtual reality‐based method of decreasing transmission time of visual feedback for a tele‐operative robotic catheter operating system
CN103295209A (en) Splicing method and system for DR images
CN107993197A (en) The joining method and system of a kind of panorama camera
CN101488224A (en) Characteristic point matching method based on relativity measurement
CN104216533B (en) A kind of wear-type virtual reality display based on DirectX9
CN108010082A (en) A kind of method of geometric match
CN102802007A (en) Method for interactively displaying stereoscopic object effect
WO2001057805A3 (en) Image data processing method and apparatus
WO2001075793A3 (en) Fast hierarchical reprojection algorithm for tomography
WO2009125132A3 (en) Method for determining a three-dimensional representation of an object using a sequence of cross-section images, computer program product, and corresponding method for analyzing an object and imaging system
Kim et al. Designing a new endoscope for panoramic-view with focus-area 3D-vision in minimally invasive surgery
CN106296741A (en) Cell high-speed motion feature mask method in nanoscopic image
CN103006332A (en) Scalpel tracking method and device and digital stereoscopic microscope system
CN106780432B (en) A kind of objective evaluation method for quality of stereo images based on sparse features similarity

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200480023335.X

Country of ref document: CN

AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004780803

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006523337

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2004780803

Country of ref document: EP

DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)