WO2004102458A2 - Method and apparatus for automatic setting of rendering parameter for virtual endoscopy - Google Patents

Method and apparatus for automatic setting of rendering parameter for virtual endoscopy Download PDF

Info

Publication number
WO2004102458A2
WO2004102458A2 PCT/US2004/013833 US2004013833W WO2004102458A2 WO 2004102458 A2 WO2004102458 A2 WO 2004102458A2 US 2004013833 W US2004013833 W US 2004013833W WO 2004102458 A2 WO2004102458 A2 WO 2004102458A2
Authority
WO
WIPO (PCT)
Prior art keywords
rendering
images
image
histogram
transfer function
Prior art date
Application number
PCT/US2004/013833
Other languages
French (fr)
Other versions
WO2004102458A3 (en
Inventor
Bernhard Geiger
Original Assignee
Siemens Corporate Research, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Corporate Research, Inc. filed Critical Siemens Corporate Research, Inc.
Publication of WO2004102458A2 publication Critical patent/WO2004102458A2/en
Publication of WO2004102458A3 publication Critical patent/WO2004102458A3/en

Links

Classifications

    • G06T5/92
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/08Volume rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration by the use of histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30028Colon; Small intestine
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical

Definitions

  • the present application relates generally to computer vision and imaging systems and, more particularly, to computerized imaging as applied to virtual endoscopy and related fields.
  • Virtual colonoscopy refers to a method of diagnosis based on computer simulation of standard, minimally invasive endoscopic procedures using patient specific three-dimensional (3D) anatomic data sets. Examples of current endoscopic procedures include bronchoscopy, sinusoscopy, upper gastro-intestinal endoscopy, colonoscopy, cystoscopy, cardioscopy, and urethroscopy.
  • VC visualization of non-invasively obtained patient specific anatomic structures avoids risks, such as perforation, infection, hemorrhage, and so forth, associated with real endoscopy, and provides the endoscopist with important information prior to performing an actual endoscopic examination. Such understanding can minimize procedural difficulties, decrease patient morbidity, enhance training and foster a better understanding of therapeutic results.
  • 3D images are created from two-dimensional (2D) computerized tomography (CT) or magnetic resonance (MR) data, for example, by volume rendering.
  • Volume rendering is a known technique for interpreting volume data.
  • CT and MRI scanners typically produce a set of cross-sectional images which, in combination, produce a set of volume data.
  • These 3D images are created to simulate images coming from an actual endoscope, such as a fiber optic endoscope.
  • the Volume Rendering Technique requires rendering settings that include a classification function that defines the visibility of materials present in the data set.
  • the classification function is also referred to herein as a transfer function or rendering setting. It is generally assumed that different materials map to different intensity levels and therefore the classification function maps intensity levels to respective opacity values.
  • the classification function essentially determines which voxel will be rendered, and which voxel will be invisible or "transparent"; a low opacity value results in a translucent or even invisible object while a high opacity value results in a clearly visible object. See, for example, the textbook “Virtual Endoscopy and Related 3D Techniques," edited by A. L. Baert; Springer, New York; 2001, 2002.
  • this can be carried out interactively.
  • a user can manipulate a simple transfer function such as, for example, trapezoid, and can see immediately the result. He can then adjust it until he gets the images desired. In some cases, this function can be extremely complicated, so that adjusting takes considerable time.
  • voxel value to tissue such as for example in CT, where air, water, etc have known values
  • preset functions can be used. But in cases where the voxel values are not known, such as, for example, in MR, or CT with an unknown amount of contrast agent in the blood, the user has to adjust the transfer function to each individual case.
  • MR data is usually not homogeneous; the contrast varies at different locations.
  • Virtual Endoscopy only shows very local parts of the body, such as, for example, the inside of a part of the colon, or the inside of an airway. Because the region that is rendered is local, the rendering parameters have to be adjusted to the local data in order to produce optimal quality.
  • Taosong He et al. in the article entitled Generation of Transfer Functions with Stochastic Search Techniques, IEEE 1996, propose a solution with 3 different quality criteria: maximizing first order image entropy, maximizing variance of pixels in final image, or maximizing edge energy in the final image. None of these criterions takes into account 3D features such as 3D surface normals or local properties of the input data (histogram).
  • a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; calculating a histogram from the data set; correlating features of the histogram with known physical regions wherein the endoscope is situated; and selecting a transfer function positioned relative to the features of the histogram for providing image differentiation between respective rendered images of the physical regions in the images.
  • the step of selecting a transfer function comprises selecting and positioning the transfer function relative to the features of the histogram for providing optimal image differentiation between respective rendered images of first and second ones of the physical regions. In accordance with another aspect of the invention, the step of selecting a transfer function comprises selecting and positioning the transfer function relative to the features of the histogram for providing optimal image differentiation between respective rendered images of air and soft tissue respectively.
  • the step of a selecting a transfer function includes a step of positioning the transfer function, such that a first selected one of the physical regions is rendered as a transparent image.
  • the step of positioning the transfer function includes a step of selecting a closest physical region to the endoscope.
  • the step of positioning the transfer function comprises positioning the transfer function for maximum contrast between the transparent image and a respective image of a second selected one of the physical regions.
  • the step of positioning the transfer function comprises positioning the transfer function for maximum contrast between the transparent image and a respective image of a second selected one of the physical regions.
  • a method for automatically setting a rendering parameter for a virtual endoscope for comprises the steps of: calculating a histogram HI in area relatively close to the virtual endoscope; calculating a histogram H2 in area at a relatively greater distance to the endoscope; calculating a histogram H3 in area comprising HI and H2; identifying a given peak PI in histogram HI as material that will be set to be transparent; identifying a given peak P2 ⁇ PI in histogram H2 as material that will be set to be oblique; analyzing histogram H3 and setting the rendering parameter at minimum between the peaks PI and P2; and rendering the image using the transfer function.
  • a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; rendering a plurality of images from the data set utilizing for each such image a respective rendering setting; utilizing a predetermined criterion to determine a respective quality factor for each such image; selecting as a preferred image one of the images exhibiting a quality factor having a maximum value of the respective quality factors; storing a preferred rendering setting associated with the preferred image; and utilizing the preferred rendering setting for rendering an image from the data set.
  • the step of utilizing a predetermined criterion comprises utilizing a smoothness criterion.
  • the step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of the plurality of images;
  • the step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of the pixels, and comparing a surface normal for a given pixel with a surface normal for a neighboring pixel in the same row to derive a first angle between their normals; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as the first angle exceeding predetermined value.
  • the step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of the plurality of images, and arranging the pixels in rows and columns;
  • the step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of the pixels, and comparing a surface normal for a given pixel with a surface normal for a pixel in the same row to derive a first angle between their normals and with a surface normal of a pixel in the same column to derive a second angle between their normals; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of the first and second angles exceeding a predetermined value.
  • the step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of the plurality of images;
  • the step of utilizing a predetermined criterion comprises: comparing color data for a given pixel with color data for a neighboring pixel, and deriving a color difference therebetween; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as the color difference exceeding predetermined value.
  • the step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of the plurality of images; arranging the pixels in rows and columns; the step of utilizing a predetermined criterion comprises comparing color data for a given pixel with color data for a pixel in the same row to derive a first color difference therebetween and with color data for a pixel in the same column to derive a second color difference therebetween; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of the first and second color differences exceeding a predetermined value.
  • a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; rendering an image from the data set n times with parameter settings Pi (0 ⁇ i ⁇ n); calculating a quality Qi for each such rendering; selecting a parameter Pmax which has highest quality Q max ⁇ Qi; 0 ⁇ i ⁇ n and 0 ⁇ max ⁇ n; and render a final image with parameter setting P max .
  • apparatus for autofnatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy comprises: apparatus for calculating a histogram HI in area relatively close to the virtual endoscope; apparatus for calculating a histogram H2 in area at a relatively greater distance to the endoscope; apparatus for calculating a histogram H3 in area comprising HI and H2; apparatus for identifying a given peak PI in histogram HI as material that will be set to be transparent; apparatus for identifying a given peak P2 ⁇ PI in histogram H2 as material that will be set to be oblique; apparatus for analyzing histogram H3 and setting the rendering parameter at minimum between the peaks PI and P2; and apparatus for rendering the image using the transfer function.
  • apparatus for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy comprises: apparatus for deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; apparatus for rendering an image from the data set n times with parameter settings Pi (0 ⁇ i ⁇ n); apparatus for calculating a quality Qj for each such rendering; apparatus for selecting a parameter P ma ⁇ which has highest quality Q ma ⁇ ⁇ Qi; 0 ⁇ i ⁇ n and 0 ⁇ max ⁇ n; and apparatus for render a final image with parameter setting P max .
  • apparatus for deriving a data set corresponding to an inside view of a viewing frustum of the endoscope comprises: apparatus for deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; apparatus for rendering an image from the data set n times with parameter settings Pi (0 ⁇ i ⁇ n); apparatus for calculating a quality Qj for each such rendering; apparatus for selecting
  • Figure 1 shows a histogram based transfer function selection in accordance with an embodiment of the present invention
  • Figure 2 shows a flow chart showing steps of a method in accordance with the present invention, utilizing a histogram based transfer function selection for automatically adjusting rendering settings to data characteristics;
  • Figure 3 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics;
  • Figure 4 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for further automatically adjusting rendering settings to data characteristics;
  • Figure 5 shows a flow chart showing steps of a method in accordance with the present invention, wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics.
  • a histogram is used as a basis for automatically adjusting rendering settings to data characteristics.
  • the histogram is calculated of the data inside a viewing frustum.
  • the viewing frustum is taken to mean the viewing pyramid that one gets when one has a view point and a perspective projection, together with a square, or rectangular, image plane.
  • the frustum is the part of this pyramid between the front clipping plane and the back clipping plane.
  • Additional information can be used to determine the best setting for rendering.
  • the virtual endoscope is situated inside a particular structure, such as the colon, for example.
  • the material immediately surrounding the endoscope thus has to be set to "transparent", otherwise the view of the endoscope will be obscured.
  • the tissue surrounding the endoscope is low contrast, that is, air. Accordingly a transfer function should be set up to separate air from soft tissue in the histogram of the local viewing frustum.
  • Figure 1 shows a histogram based transfer function selection in accordance with an embodiment of the present invention.
  • CT data is sampled around the endoscope in 3 regions, and the histograms are calculated (upper left).
  • the red line shows a histogram adjacent to the endoscope.
  • the blue line is the histogram of a larger region around the endoscope, and the black line is the largest region.
  • the histogram shows two distinct peaks, one for air and one for contrast and soft tissue.
  • the endoscope is situated inside contrast; therefore contrast agent has to be selected as transparent.
  • Below is the actual transfer function, and on the right is the corresponding 3D rendering.
  • rendering is used as a basis for automatically adjusting rendering settings to data characteristics. Images are rendered with different rendering settings. A quality factor is calculated after each rendering. The rendering setting that produces the best quality is stored and used. The quality setting can be smoothness.
  • Ray casting is a commonly used method for volume rendering. See, for example, the above- cited text edited by A. L. Baert. If ray casting is used for the rendering, at each pixel the surface normal is calculated for lighting calculations. The surface normals of the previous pixel (row) and of the pixel above (column) are now compared. If the angle between the normals is larger than a given value, for example 18 degrees (determined experimentally), there is a discontinuity in the surface. Bad rendering settings increase surface discontinuities. If the threshold is too low, noise is rendered as random blocks flying in the air. If the threshold is too high, the walls will show holes, which again increase the number of surface discontinuities. The program renders images using different rendering settings, and measures the number of surface discontinuities at each step. The setting with the lowest number is considered to produce the best image quality. Other quality measures can be used, such as color change between neighboring pixels.
  • Figure 2 shows a flow chart showing steps of a method in accordance with the present invention, utilizing a histogram based transfer function selection for automatically adjusting rendering settings to data characteristics;
  • Figure 3 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics.
  • the left-hand side of Figure 3 shows rendering with a threshold of 13, indicating a level of noise.
  • the right-hand side of Figure 3 shows the result after the system has automatically adjusted the threshold to 20, showing significant reduction in the noise level.
  • Figure 4 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting settings to data characteristics.
  • the left-hand side of Figure 3 shows rendering with a threshold of 30, resulting in holes in the wall.
  • the right-hand side of Figure 3 shows the result after the system has automatically adjusted the threshold to 20, showing an essentially perfect image.
  • Figure 5 shows a flow chart showing steps of a method in accordance with the present invention, wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics.

Abstract

A method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; calculating a histogram from the data set; correlating features of the histogram with known physical regions wherein the endoscope is situated; and selecting a transfer function positioned relative to the features of the histogram for providing image differentiation between respective rendered images of the physical regions in the images.

Description

METHOD AND APPARATUS FOR AUTOMATIC SETTING OF RENDERING PARAMETER FOR VIRTUAL ENDOSCOPY
CROSS-REFERENCE TO RELATED APPLICATIONS
PRIORITY
Specific reference is hereby made to Provisional Application No. 60/468,907 (Attorney Docket No. 2003P06576US), entitled AUTOMATIC SETTING OF RENDERING PARAMETER FOR VIRTUAL ENDOSCOPY, filed May 8, 2003 in the name of Bernhard Geiger, the inventor in the present application and of which the benefit of priority is claimed and whereof the disclosure is hereby incorporated herein by reference.
The present application relates generally to computer vision and imaging systems and, more particularly, to computerized imaging as applied to virtual endoscopy and related fields.
BACKGROUND OF THE INVENTION
Virtual colonoscopy (VC) refers to a method of diagnosis based on computer simulation of standard, minimally invasive endoscopic procedures using patient specific three-dimensional (3D) anatomic data sets. Examples of current endoscopic procedures include bronchoscopy, sinusoscopy, upper gastro-intestinal endoscopy, colonoscopy, cystoscopy, cardioscopy, and urethroscopy. VC visualization of non-invasively obtained patient specific anatomic structures avoids risks, such as perforation, infection, hemorrhage, and so forth, associated with real endoscopy, and provides the endoscopist with important information prior to performing an actual endoscopic examination. Such understanding can minimize procedural difficulties, decrease patient morbidity, enhance training and foster a better understanding of therapeutic results.
In virtual colonoscopy, 3D images are created from two-dimensional (2D) computerized tomography (CT) or magnetic resonance (MR) data, for example, by volume rendering. Volume rendering, as such, is a known technique for interpreting volume data. . Present- day CT and MRI scanners typically produce a set of cross-sectional images which, in combination, produce a set of volume data. These 3D images are created to simulate images coming from an actual endoscope, such as a fiber optic endoscope.
The computerized post-processing of imaging data from cross-sectional imaging modalities is presently of importance in the field of medicine
Typically, the Volume Rendering Technique (VRT) requires rendering settings that include a classification function that defines the visibility of materials present in the data set. The classification function is also referred to herein as a transfer function or rendering setting. It is generally assumed that different materials map to different intensity levels and therefore the classification function maps intensity levels to respective opacity values. Thus, the classification function essentially determines which voxel will be rendered, and which voxel will be invisible or "transparent"; a low opacity value results in a translucent or even invisible object while a high opacity value results in a clearly visible object. See, for example, the textbook "Virtual Endoscopy and Related 3D Techniques," edited by A. L. Baert; Springer, New York; 2001, 2002.
In many systems, this can be carried out interactively. A user can manipulate a simple transfer function such as, for example, trapezoid, and can see immediately the result. He can then adjust it until he gets the images desired. In some cases, this function can be extremely complicated, so that adjusting takes considerable time. If the relation of voxel value to tissue is known, such as for example in CT, where air, water, etc have known values, preset functions can be used. But in cases where the voxel values are not known, such as, for example, in MR, or CT with an unknown amount of contrast agent in the blood, the user has to adjust the transfer function to each individual case.
In the worst case, the user needs to adjust the transfer functions not only per case, but also depending on the location in the dataset where being looked at. An example would be virtual endoscopy of MR data. MR data is usually not homogeneous; the contrast varies at different locations. Unlike conventional 3D rendering that shows a body from the outside and therefore requires that the rendering parameters be adjusted globally, Virtual Endoscopy only shows very local parts of the body, such as, for example, the inside of a part of the colon, or the inside of an airway. Because the region that is rendered is local, the rendering parameters have to be adjusted to the local data in order to produce optimal quality. Taosong He et al., in the article entitled Generation of Transfer Functions with Stochastic Search Techniques, IEEE 1996, propose a solution with 3 different quality criteria: maximizing first order image entropy, maximizing variance of pixels in final image, or maximizing edge energy in the final image. None of these criterions takes into account 3D features such as 3D surface normals or local properties of the input data (histogram).
Kindlriiann G. L. in the article entitled Semi- Automatic Generation of Transfer Functions for Direct Volume Rendering Dissertation, Cornell University, 1999 proposes a technique to render material boundaries in volume dataset. In a first step, the data is analyzed by calculating first and second order derivatives. In a second step, the user has to select regions and decide what to render. Although this technique facilitates the creation of rendering parameters, it is not automatic in the sense that the user still has to adjust parameters and evaluate the quality Visually.
BRIEF SUMMARY OF THE INVENTION
It is herein recognized that a virtual flythrough of such data would require a corresponding re-adjustment of the transfer function every few frames in order to show a high quality image throughout the flythrough range.
In accordance with aspects of the present invention, a number of methods are herein disclosed for automatically adjusting rendering settings to data characteristics.
In accordance with an aspect of the invention, a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; calculating a histogram from the data set; correlating features of the histogram with known physical regions wherein the endoscope is situated; and selecting a transfer function positioned relative to the features of the histogram for providing image differentiation between respective rendered images of the physical regions in the images.
In accordance with another aspect of the invention, the step of selecting a transfer function comprises selecting and positioning the transfer function relative to the features of the histogram for providing optimal image differentiation between respective rendered images of first and second ones of the physical regions. In accordance with another aspect of the invention, the step of selecting a transfer function comprises selecting and positioning the transfer function relative to the features of the histogram for providing optimal image differentiation between respective rendered images of air and soft tissue respectively.
In accordance with another aspect of the invention, the step of a selecting a transfer function includes a step of positioning the transfer function, such that a first selected one of the physical regions is rendered as a transparent image.
In accordance with another aspect of the invention, the step of positioning the transfer function includes a step of selecting a closest physical region to the endoscope.
In accordance with another aspect of the invention, the step of positioning the transfer function comprises positioning the transfer function for maximum contrast between the transparent image and a respective image of a second selected one of the physical regions.
In accordance with another aspect of the invention, the step of positioning the transfer function comprises positioning the transfer function for maximum contrast between the transparent image and a respective image of a second selected one of the physical regions.
In accordance with another aspect of the invention, a method for automatically setting a rendering parameter for a virtual endoscope for In accordance with another aspect of the invention,rendering images for virtual endoscopy, comprises the steps of: calculating a histogram HI in area relatively close to the virtual endoscope; calculating a histogram H2 in area at a relatively greater distance to the endoscope; calculating a histogram H3 in area comprising HI and H2; identifying a given peak PI in histogram HI as material that will be set to be transparent; identifying a given peak P2 ≠ PI in histogram H2 as material that will be set to be oblique; analyzing histogram H3 and setting the rendering parameter at minimum between the peaks PI and P2; and rendering the image using the transfer function.
In accordance with another aspect of the invention, a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; rendering a plurality of images from the data set utilizing for each such image a respective rendering setting; utilizing a predetermined criterion to determine a respective quality factor for each such image; selecting as a preferred image one of the images exhibiting a quality factor having a maximum value of the respective quality factors; storing a preferred rendering setting associated with the preferred image; and utilizing the preferred rendering setting for rendering an image from the data set.
In accordance with another aspect of the invention, the step of utilizing a predetermined criterion comprises utilizing a smoothness criterion.
In accordance with another aspect of the invention, the step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of the plurality of images; the step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of the pixels, and comparing a surface normal for a given pixel with a surface normal for a neighboring pixel in the same row to derive a first angle between their normals; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as the first angle exceeding predetermined value.
In accordance with another aspect of the invention, the step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of the plurality of images, and arranging the pixels in rows and columns; the step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of the pixels, and comparing a surface normal for a given pixel with a surface normal for a pixel in the same row to derive a first angle between their normals and with a surface normal of a pixel in the same column to derive a second angle between their normals; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of the first and second angles exceeding a predetermined value.
In accordance with another aspect of the invention, the step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of the plurality of images; the step of utilizing a predetermined criterion comprises: comparing color data for a given pixel with color data for a neighboring pixel, and deriving a color difference therebetween; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as the color difference exceeding predetermined value.
In accordance with another aspect of the invention, the step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of the plurality of images; arranging the pixels in rows and columns; the step of utilizing a predetermined criterion comprises comparing color data for a given pixel with color data for a pixel in the same row to derive a first color difference therebetween and with color data for a pixel in the same column to derive a second color difference therebetween; and the step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of the first and second color differences exceeding a predetermined value.
In accordance with another aspect of the invention, a method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises the steps of: deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; rendering an image from the data set n times with parameter settings Pi (0 < i < n); calculating a quality Qi for each such rendering; selecting a parameter Pmax which has highest quality Qmax ≥ Qi; 0< i <n and 0<max<n; and render a final image with parameter setting Pmax.
In accordance with another aspect of the invention, apparatus for autofnatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises: apparatus for calculating a histogram HI in area relatively close to the virtual endoscope; apparatus for calculating a histogram H2 in area at a relatively greater distance to the endoscope; apparatus for calculating a histogram H3 in area comprising HI and H2; apparatus for identifying a given peak PI in histogram HI as material that will be set to be transparent; apparatus for identifying a given peak P2 ≠ PI in histogram H2 as material that will be set to be oblique; apparatus for analyzing histogram H3 and setting the rendering parameter at minimum between the peaks PI and P2; and apparatus for rendering the image using the transfer function.
In accordance with another aspect of the invention, apparatus for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprises: apparatus for deriving a data set corresponding to an inside view of a viewing frustum of the endoscope; apparatus for rendering an image from the data set n times with parameter settings Pi (0 < i < n); apparatus for calculating a quality Qj for each such rendering; apparatus for selecting a parameter Pmaχ which has highest quality Qmaχ ≥ Qi; 0< i <n and 0<max<n; and apparatus for render a final image with parameter setting Pmax. BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
The invention will be more fully understood from the detailed description which follows in conjunction with the drawings in which
Figure 1 shows a histogram based transfer function selection in accordance with an embodiment of the present invention;
Figure 2 shows a flow chart showing steps of a method in accordance with the present invention, utilizing a histogram based transfer function selection for automatically adjusting rendering settings to data characteristics;
Figure 3 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics;
Figure 4 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for further automatically adjusting rendering settings to data characteristics; and
Figure 5 shows a flow chart showing steps of a method in accordance with the present invention, wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics.
DETAILED DESCRIPTION OF THE INVENTION
It will be understood that the method and system of the present invention are best implemented utilizing a programmable digital computer and that the operations herein described are in reference to such an implementation. In the context of imaging, terms such as "air", "lumen", etc. are typically intended to refer to the corresponding imaging of these features.
In accordance with a first principle of the invention, a histogram is used as a basis for automatically adjusting rendering settings to data characteristics. In one embodiment of the invention, the histogram is calculated of the data inside a viewing frustum. In the present context, the viewing frustum is taken to mean the viewing pyramid that one gets when one has a view point and a perspective projection, together with a square, or rectangular, image plane. The frustum is the part of this pyramid between the front clipping plane and the back clipping plane.
Additional information can be used to determine the best setting for rendering. For example, it might be known that the virtual endoscope is situated inside a particular structure, such as the colon, for example. The material immediately surrounding the endoscope thus has to be set to "transparent", otherwise the view of the endoscope will be obscured. In the example of the colon, the tissue surrounding the endoscope is low contrast, that is, air. Accordingly a transfer function should be set up to separate air from soft tissue in the histogram of the local viewing frustum.
Figure 1 shows a histogram based transfer function selection in accordance with an embodiment of the present invention. CT data is sampled around the endoscope in 3 regions, and the histograms are calculated (upper left). The red line shows a histogram adjacent to the endoscope. The blue line is the histogram of a larger region around the endoscope, and the black line is the largest region. The histogram shows two distinct peaks, one for air and one for contrast and soft tissue. The endoscope is situated inside contrast; therefore contrast agent has to be selected as transparent. Below is the actual transfer function, and on the right is the corresponding 3D rendering.
In accordance with another embodiment of the present invention, rendering is used as a basis for automatically adjusting rendering settings to data characteristics. Images are rendered with different rendering settings. A quality factor is calculated after each rendering. The rendering setting that produces the best quality is stored and used. The quality setting can be smoothness.
Ray casting is a commonly used method for volume rendering. See, for example, the above- cited text edited by A. L. Baert. If ray casting is used for the rendering, at each pixel the surface normal is calculated for lighting calculations. The surface normals of the previous pixel (row) and of the pixel above (column) are now compared. If the angle between the normals is larger than a given value, for example 18 degrees (determined experimentally), there is a discontinuity in the surface. Bad rendering settings increase surface discontinuities. If the threshold is too low, noise is rendered as random blocks flying in the air. If the threshold is too high, the walls will show holes, which again increase the number of surface discontinuities. The program renders images using different rendering settings, and measures the number of surface discontinuities at each step. The setting with the lowest number is considered to produce the best image quality. Other quality measures can be used, such as color change between neighboring pixels.
Figure 2 shows a flow chart showing steps of a method in accordance with the present invention, utilizing a histogram based transfer function selection for automatically adjusting rendering settings to data characteristics;
Figure 3 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics. The left-hand side of Figure 3 shows rendering with a threshold of 13, indicating a level of noise. The right-hand side of Figure 3 shows the result after the system has automatically adjusted the threshold to 20, showing significant reduction in the noise level.
Figure 4 shows image based adjustment in accordance with an embodiment of the present invention wherein rendering is used as a basis for automatically adjusting settings to data characteristics. The left-hand side of Figure 3 shows rendering with a threshold of 30, resulting in holes in the wall. The right-hand side of Figure 3 shows the result after the system has automatically adjusted the threshold to 20, showing an essentially perfect image.
Figure 5 shows a flow chart showing steps of a method in accordance with the present invention, wherein rendering is used as a basis for automatically adjusting rendering settings to data characteristics.
It will be understood that the invention is applicable to virtual colonoscopy as well as to various other virtual endoscopic type examinations. While the invention has been described by way of exemplary embodiments, it will also be understood by one of skill in the art to which it pertains that various changes and modifications can be made which do not depart from the spirit of the invention which is defined by the claims following.

Claims

CLAIMSWhat is claimed is:
1. A method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising the steps of: deriving a data set corresponding to an inside view of a viewing frustum of said endoscope; calculating a histogram from said data set; correlating features of said histogram with known physical regions wherein said endoscope is situated; and selecting a transfer function positioned relative to said features of said histogram for providing image differentiation between respective rendered images of said physical regions in said images.
2. A method as recited in claim 1, wherein said step of selecting a transfer function comprises selecting and positioning said transfer function relative to said features of said histogram for providing optimal image differentiation between respective rendered images of first and second ones of said physical regions.
3. A method as recited in claim 1, wherein said step of selecting a transfer function comprises selecting and positioning said transfer function relative to said features of said histogram for providing optimal image differentiation between respective rendered images of air and soft tissue respectively.
4. A method as recited in claim 1, wherein said step of selecting a transfer function comprises selecting and positioning said transfer function relative to said features of said histogram for providing optimal image differentiation between respective rendered images of said physical regions in said images.
5. A method as recited in claim 4, wherein said step of positioning said transfer function comprises positioning said transfer function for a given contrast between respective images first and second selected one of said physical regions.
6. A method as recited in claim 2, wherein said step of a selecting a transfer function includes a step of positioning said transfer function such that a first selected one of said physical regions is rendered as a transparent image.
7. A method as recited in claim 6, wherein said step of positioning said transfer function includes a step of selecting a closest physical region to said endoscope.
8. A method as recited in claim 6, wherein said step of positioning said transfer function comprises positioning said transfer function for maximum contrast between said transparent image and a respective image of a second selected one of said physical regions.
9. A method as recited in claim 6, wherein said step of positioning said transfer function comprises positioning said transfer function for maximum contrast between said transparent image and a respective image of a second selected one of said physical regions.
10. A method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising the steps of: calculating a histogram HI in area relatively close to said virtual endoscope; calculating a histogram H2 in area at a relatively greater distance to said endoscope; calculating a histogram H3 in area comprising HI and H2; identifying a given peak PI in histogram HI as material that will be set to be transparent; identifying a given peak P2 ≠ PI in histogram H2 as material that will be set to be oblique; analyzing histogram H3 and setting said rendering parameter at minimum between said peaks PI and P2; and rendering said image using said transfer function.
11. A method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising the steps of: deriving a data set corresponding to an inside view of a viewing frustum of said endoscope; rendering a plurality of images from said data set utilizing for each such image a respective rendering setting; utilizing a predetermined criterion to determine a respective quality factor for each such image; selecting as a preferred image one of said images exhibiting a quality factor having a maximum value of said respective quality factors; storing a preferred rendering setting associated with said preferred image; and utilizing said preferred rendering setting for rendering an image from said data set.
12. A method as recited in claim 11, wherein said step of utilizing a predetermined criterion comprises utilizing a smoothness criterion.
13. A method as recited in claim 11, wherein: said step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of said plurality of images; said step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of said pixels, and comparing a surface normal for a given pixel with a surface normal for a neighboring pixel in the same row to derive a first angle between their normals; and said step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as said first angle exceeding predetermined value.
14. A method as recited in claim 11, wherein: said step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of said plurality of images, and arranging said pixels in rows and columns; said step of utilizing a predetermined criterion comprises: calculating a respective surface normal based on lighting criteria for each of said pixels, and comparing a surface normal for a given pixel with a surface normal for a pixel in the same row to derive a first angle between their normals and with a surface normal of a pixel in the same column to derive a second angle between their normals; and said step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of said first and second angles exceeding a predetermined value.
15. A method as recited in claim Bl, wherein: ' said step of rendering a plurality of images comprises utilizing ray casting for deriving a plurality of pixels for each of said plurality of images; said step of utilizing a predetermined criterion comprises: comparing color data for a given pixel with color data for a neighboring pixel, and deriving a color difference therebetween; and said step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as said color difference exceeding predetermined value.
16. A method as recited in claim 11 , wherein: said step of rendering a plurality of images comprises: utilizing ray casting for deriving a plurality of pixels for each of said plurality of images; arranging said pixels in rows and columns; said step of utilizing a predetermined criterion comprises comparing color data for a given pixel with color data for a pixel in the same row to derive a first color difference therebetween and with color data for a pixel in the same column to derive a second color difference therebetween; and said step of utilizing a predetermined criterion comprises assigning a quality factor having the highest value for an image exhibiting the least number of faults where a fault is defined as at least one of said first and second color differences exceeding a predetermined value.
17. A method for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising the steps of: deriving a data set corresponding to an inside view of a viewing frustum of said endoscope; rendering an image from said data set n times with parameter settings Pj (0 < i < n); calculating a quality Qi for each such rendering; selecting a parameter Pmax which has highest quality Qmax ≥ Qi; 0< i <n and 0<max<n; and render a final image with parameter setting Pmax.
18. Apparatus for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising: means for calculating a histogram HI in an area relatively close to said virtual endoscope; means for calculating a histogram H2 in an area at a relatively greater distance to said endoscope; means for calculating a histogram H3 in an area comprising HI and H2; means for identifying a given peak PI in histogram HI as material that will be set to be transparent; means for identifying a given peak P2 ≠ PI in histogram H2 as material that will be set to be oblique; means for analyzing histogram H3 and setting said rendering parameter at minimum between said peaks PI and P2; and means for rendering said image using said transfer function.
19. Apparatus for automatically setting a rendering parameter for a virtual endoscope for rendering images for virtual endoscopy, comprising: means for deriving a data set corresponding to an inside view of a viewing frustum of said endoscope; means for rendering an image from said data set n times with parameter settings Pi (0 < i < n); means for calculating a quality Qj for each such rendering; means for selecting a parameter Pmax which has highest quality Qmax > Qi; 0< i <n and 0<max<n; and means for render a final image with parameter setting Pmaχ-
PCT/US2004/013833 2003-05-08 2004-05-04 Method and apparatus for automatic setting of rendering parameter for virtual endoscopy WO2004102458A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US46890703P 2003-05-08 2003-05-08
US60/468,907 2003-05-08
US10/838,064 US7417636B2 (en) 2003-05-08 2004-05-03 Method and apparatus for automatic setting of rendering parameter for virtual endoscopy
US10/838,064 2004-05-03

Publications (2)

Publication Number Publication Date
WO2004102458A2 true WO2004102458A2 (en) 2004-11-25
WO2004102458A3 WO2004102458A3 (en) 2005-07-07

Family

ID=33457110

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/013833 WO2004102458A2 (en) 2003-05-08 2004-05-04 Method and apparatus for automatic setting of rendering parameter for virtual endoscopy

Country Status (2)

Country Link
US (1) US7417636B2 (en)
WO (1) WO2004102458A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862120A1 (en) * 2006-05-29 2007-12-05 Kabushiki Kaisha Toshiba Computer-aided imaging diagnostic processing apparatus and computer-aided imaging diagnostic processing method
CN100434044C (en) * 2006-08-03 2008-11-19 上海交通大学 Method of realizing virtual inflated expansion of tubular organ through non-rigid characteristic point registration
US10062200B2 (en) 2015-04-03 2018-08-28 Dental Imaging Technologies Corporation System and method for displaying volumetric images

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7532214B2 (en) * 2005-05-25 2009-05-12 Spectra Ab Automated medical image visualization using volume rendering with local histograms
US8041129B2 (en) 2006-05-16 2011-10-18 Sectra Ab Image data set compression based on viewing parameters for storing medical image data from multidimensional data sets, related systems, methods and computer products
US20080012856A1 (en) * 2006-07-14 2008-01-17 Daphne Yu Perception-based quality metrics for volume rendering
US8711144B2 (en) * 2006-08-01 2014-04-29 Siemens Medical Solutions Usa, Inc. Perception-based artifact quantification for volume rendering
US7830381B2 (en) * 2006-12-21 2010-11-09 Sectra Ab Systems for visualizing images using explicit quality prioritization of a feature(s) in multidimensional image data sets, related methods and computer products
US7920669B2 (en) * 2007-07-25 2011-04-05 Siemens Aktiengesellschaft Methods, apparatuses and computer readable mediums for generating images based on multi-energy computed tomography data
US8584025B2 (en) * 2008-05-02 2013-11-12 International Business Machines Corporation Virtual world teleportation
WO2011077315A1 (en) * 2009-12-21 2011-06-30 Koninklijke Philips Electronics N.V. Processing an image dataset based on clinically categorized populations
JP5551955B2 (en) * 2010-03-31 2014-07-16 富士フイルム株式会社 Projection image generation apparatus, method, and program
JP5755122B2 (en) * 2011-11-30 2015-07-29 富士フイルム株式会社 Image processing apparatus, method, and program
JP6423172B2 (en) * 2014-05-22 2018-11-14 オリンパス株式会社 Wireless endoscope system, display device, and program
CN107016228B (en) * 2016-11-25 2023-08-18 斯图尔特平李 Medical imaging system based on HMDS
US10593099B2 (en) * 2017-11-14 2020-03-17 Siemens Healthcare Gmbh Transfer function determination in medical imaging

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020183606A1 (en) * 2000-10-23 2002-12-05 Bert Boehler Diagnostic device having means for setting transfer functions
WO2002103065A2 (en) * 2001-06-20 2002-12-27 Koninklijke Philips Electronics N.V. Method for segmentation of digital images

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6331116B1 (en) * 1996-09-16 2001-12-18 The Research Foundation Of State University Of New York System and method for performing a three-dimensional virtual segmentation and examination
JP4149126B2 (en) 2000-12-05 2008-09-10 ジーイー・メディカル・システムズ・グローバル・テクノロジー・カンパニー・エルエルシー Image processing method, image processing apparatus, and image photographing apparatus
US7031523B2 (en) 2001-05-16 2006-04-18 Siemens Corporate Research, Inc. Systems and methods for automatic scale selection in real-time imaging

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020183606A1 (en) * 2000-10-23 2002-12-05 Bert Boehler Diagnostic device having means for setting transfer functions
WO2002103065A2 (en) * 2001-06-20 2002-12-27 Koninklijke Philips Electronics N.V. Method for segmentation of digital images

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
HE T ET AL INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS ASSOCIATION FOR COMPUTING MACHINERY: "GENERATION OF TRANSFER FUNCTIONS WITH STOCHASTIC SEARCH TECHNIQUES" VISUALIZATION '96. PROCEEDINGS OF THE VISUALIZATION CONFERENCE. SAN FRANCISCO, OCT. 27 - NOV. 1, 1996, PROCEEDINGS OF THE VISUALIZATION CONFERENCE, NEW YORK, IEEE/ACM, US, 27 October 1996 (1996-10-27), pages 227-234, XP000704193 ISBN: 0-7803-3673-9 cited in the application *
KINDLMANN G ET AL: "Semi-automatic generation of transfer functions for direct volume rendering" VOLUME VISUALIZATION, 1998. IEEE SYMPOSIUM ON RESEARCH TRIANGLE PARK, NC, USA 19-20 OCT. 1998, NEW YORK, NY, USA,IEEE, US, 19 October 1998 (1998-10-19), pages 79-86,170, XP010313221 ISBN: 0-8186-9180-8 cited in the application *
KINDLMANN G: "Transfer Functions in Direct Volume Rendering: Design, Interface, Interaction" SIGGRAPH COURSE NOTES, 2002, pages 1-6, XP002318414 *
MARKS J ET AL: "DESIGN GALLERIES: A GENERAL APPROACH TO SETTING PARAMETERS FOR COMPUTER GRAPHICS AND ANIMATION" COMPUTER GRAPHICS PROCEEDINGS. SIGGRAPH 97. LOS ANGELES, AUG. 3 - 8, 1997, READING, ADDISON WESLEY, US, 3 August 1997 (1997-08-03), pages 389-400, XP000765839 ISBN: 0-201-32220-7 *
PEKAR V ET AL INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS: "Fast detection of meaningful isosurfaces for volume data visualization" PROCEEDINGS VISUALIZATION 2001. VIS 2001. SAN DIEGO, CA, OCT. 21 - 26, 2001, ANNUAL IEEE CONFERENCE ON VISUALIZATION, NEW YORK, NY : IEEE, US, 21 October 2001 (2001-10-21), pages 223-227, XP002246128 ISBN: 0-7803-7200-X *
WEINERT K, MEHNEN J, ALBERSMANN F, DRERUP P: "New solutions for surface reconstruction from discrete point data by means of computational intelligence" INTERNATIONAL SEMINAR ON INTELLIGENT COMPUTATION IN MANUFACTURING ENGINEERING (ICME9), 1998, pages 431-438, XP002326656 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1862120A1 (en) * 2006-05-29 2007-12-05 Kabushiki Kaisha Toshiba Computer-aided imaging diagnostic processing apparatus and computer-aided imaging diagnostic processing method
US8442282B2 (en) 2006-05-29 2013-05-14 Kabushiki Kaisha Toshiba Computer-aided imaging diagnostic processing apparatus and computer-aided imaging diagnostic processing method
CN100434044C (en) * 2006-08-03 2008-11-19 上海交通大学 Method of realizing virtual inflated expansion of tubular organ through non-rigid characteristic point registration
US10062200B2 (en) 2015-04-03 2018-08-28 Dental Imaging Technologies Corporation System and method for displaying volumetric images

Also Published As

Publication number Publication date
US20040259065A1 (en) 2004-12-23
US7417636B2 (en) 2008-08-26
WO2004102458A3 (en) 2005-07-07

Similar Documents

Publication Publication Date Title
US7417636B2 (en) Method and apparatus for automatic setting of rendering parameter for virtual endoscopy
JP4359647B2 (en) Automatic analysis in endoscopy that cannot be detected directly
CN105719324B (en) Image processing apparatus and image processing method
US7167180B1 (en) Automatic path planning system and method
US20050119550A1 (en) System and methods for screening a luminal organ (&#34;lumen viewer&#34;)
Wolfsberger et al. Advanced virtual endoscopy for endoscopic transsphenoidal pituitary surgery
JP2020506452A (en) HMDS-based medical image forming apparatus
EP3561768B1 (en) Visualization of lung fissures in medical imaging
JP2005349199A (en) Medical three-dimensional image display, three-dimensional image processing method, computer tomographic apparatus, work station and computer program product
CN106231986A (en) Image processing apparatus
JP2015217120A (en) Image diagnosis support apparatus, and processing method and program thereof
US20230316639A1 (en) Systems and methods for enhancing medical images
US9445082B2 (en) System, apparatus, and method for image processing
US20080118182A1 (en) Method of Fusing Digital Images
Díaz Iriberri et al. Depth-enhanced maximum intensity projection
JP2010075549A (en) Image processor
Hassouna et al. Virtual fly-over: A new visualization technique for virtual colonoscopy
Wan et al. Interactive electronic biopsy for 3D virtual colonscopy
Hong et al. Colonoscopy simulation
JP5260933B2 (en) Cartoon-style exaggeration of medical images to emphasize anomalies
EP3929934A1 (en) Vrds 4d medical image-based tumor and blood vessel ai processing method and product
Neubauer Virtual Endoscopy for preoperative planning and training of endonasal transsphenoidal pituitary surgery
US6965686B2 (en) Device for four-dimensional representation of a structural variation, in particular of the course of a disease
EP3929935A1 (en) Vrds 4d medical image-based ai processing method and product for tumors
Nurizzaty Khairi Three-dimensional visualization of brain tumor computed tomography images/Nurizzaty Khairi Mohamed

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
122 Ep: pct application non-entry in european phase