US20020127735A1 - Methods of monitoring effects of chemical agents on a sample - Google Patents

Methods of monitoring effects of chemical agents on a sample Download PDF

Info

Publication number
US20020127735A1
US20020127735A1 US10/068,133 US6813302A US2002127735A1 US 20020127735 A1 US20020127735 A1 US 20020127735A1 US 6813302 A US6813302 A US 6813302A US 2002127735 A1 US2002127735 A1 US 2002127735A1
Authority
US
United States
Prior art keywords
tissue
sample
optical signal
image
dispensing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/068,133
Inventor
Howard Kaufman
Alex Zelenchuk
Ross Flewelling
Philippe Schmid
Ze?apos;ev Hed
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Medispectra Inc
Original Assignee
Medispectra Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Medispectra Inc filed Critical Medispectra Inc
Priority to US10/068,133 priority Critical patent/US20020127735A1/en
Priority to US10/099,881 priority patent/US7260248B2/en
Publication of US20020127735A1 publication Critical patent/US20020127735A1/en
Priority to US10/273,511 priority patent/US7187810B2/en
Assigned to MEDISPECTRA, INC. reassignment MEDISPECTRA, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HED, ZE'EV, FLEWELLING, ROSS, KAUFMAN, HOWARD, ZELENCHUK, ALEX, SCHMID, PHILIPPE
Priority to US11/633,677 priority patent/US7406215B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0071Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00071Insertion part of the endoscope body
    • A61B1/0008Insertion part of the endoscope body characterised by distal tip features
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00142Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with means for preventing contamination, e.g. by using a sanitary sheath
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M11/00Sprayers or atomisers specially adapted for therapeutic purposes

Definitions

  • This invention relates generally to spectral analysis. More particularly, in one embodiment, the invention relates to determining chemically-induced changes of optical spectra.
  • Colposcopists may amplify the difference between normal and cancerous tissue with the application of various “activation” agents, the most common being acetic acid, at approximately 3% to 5% concentration, or an iodine solution, such as Lugol's iodine or Shiller's iodine. Even when the cervical tissues are viewed through a colposcope by an experienced practitioner with the application of acetic acid, correct diagnosis can be affected by subjective analysis. A variety of methods using optical techniques have been directed towards the diagnosis of cancer and other pathologies, particularly involving the cervix. Certain of these systems and methods have limitations that render them unsuitable for use as screening procedures.
  • a screening method should be sufficiently sensitive and specific to identify abnormalities accurately. Furthermore, a screening method ideally is easy to perform so that it can be carried out rapidly on an otherwise healthy patient. In addition, to be cost effective the screening method should not require the use of expensive resources, including a significant time commitment from costly, highly trained medical personnel. Generally, screening settings advantageously employ less skilled operators and more operator-independent technology.
  • the invention provides systems and methods for quickly and efficiently screening samples, especially biological samples.
  • changes in the spectral properties of tissues upon exposure to chemical agents are characteristic of the physiological state of the tissue.
  • the invention relates to changes in spectral properties of a sample in response to chemical treatment.
  • the sample can be a sample of tissue, and the response can be indicative of a state of health of the tissue or the patient from whom the sample is obtained.
  • the light emission properties of a sample change.
  • the temporal evolution of these changes is characteristic of the state of health of the tissue generally.
  • tissues emit light having spectral properties that are characteristic of the physiological and biochemical make-up of the tissue.
  • the spectral properties of the tissue are changed by the interaction of the agent with endogenous molecules in the tissue.
  • a chemical agent such as a contrast agent
  • the emission spectrum of the tissue returns to pre-exposure levels.
  • changes in tissue produced by endogenous chemical agents provide insight into the sample, such as the clinical health of the tissue as described in detail below.
  • the invention also involves systems and methods of performing the application of one or more chemical agents, including the amount of material dispensed, dispensing patterns, and triggering a measurement relative to the time of dispensing.
  • the invention provides methods and systems for monitoring effects of chemical agents on a sample by exposing a sample to one or more chemical agents, and measuring a change in an optical signal from the sample.
  • a preferred method of the invention comprises dispensing a plurality of chemical agents on a sample, wherein the agents interact to alter an optical signal from the sample and measuring the chemical agents are selected from the group consisting of acetic acid, formic acid, propionic acid, butyric acid, Lugol's iodine, Shiller's iodine, methylene blue, toluidine blue, osmotic agents, ionic agents, and indigo carmine.
  • the chemical agents may be applied substantially simultaneously, or by dispensing at least two of the plurality of chemical agents sequentially.
  • the invention is applicable to any sample type.
  • Preferred methods of the invention comprise using a biological sample.
  • the sample is selected from epithelial tissue, cervical tissue, colorectal tissue, skin, and uterine tissue.
  • a preferred embodiment of the invention relates to a method of monitoring effects of a chemical agent on a sample comprising dispensing a chemical agent on a sample, providing an automated triggering signal to initiate a measurement period relative to the dispensing, and measuring an optical signal from the sample.
  • the automated triggering signal can be provided prior to, substantially simultaneously with, or after dispensing the chemical agent.
  • the measurement is initiated at a predetermined time relative to the automatic triggering signal.
  • methods of the invention comprise of diagnosing the state of health of a applying the chemical agent or agents as a mist onto the sample.
  • the predefined pattern is substantially circular. In another preferred embodiment, the predefined pattern is substantially annular.
  • the chemical agent is dispensed at a controlled rate, or a controlled volume of the chemical agent is dispensed, or both.
  • the invention comprises dispensing a chemical agent on a sample, capturing a plurality of sequential images of the sample during a measurement period, automatically aligning a subset of the plurality of images to spatially correlate the subset of images, measuring an optical signal from the subset of the spatially correlated images, and providing a diagnosis of a state of health of the sample based at least in part on the optical signal.
  • aligning further comprises aligning the subset to compensate for relative motion between the sample and a spectral observation device. In another preferred embodiment, aligning further comprises aligning the subset to compensate for relative motion between a first portion of the sample and a second portion of the sample.
  • the invention provides methods for determining a tissue response in which a chemical agent is applied to a tissue and an optical property of an endogenous molecule in the tissue is measured.
  • the endogenous molecule is a chromophore, for example a fluorophore.
  • Method of the invention comprise applying the chemical agent and monitoring an optical signal from the endogenous molecule. The presence, absence, or change in the signal may be indicative of disease when compared to known standards. Such standards may be empirically derived or may be obtained from the art.
  • the endogenous chromophore is preferably hemoglobin, a porphoryin, NADH, a flavin, elastin, or collagen.
  • the optical signal is a light signal, such as a fluorescent or white light spectrum.
  • the optical signal may also be a spectrum produced, at least in part by light-scattering properties of the tissue.
  • the optical signal may be a decay function.
  • the optical signal is compared to a standard response associated with healthy or diseased tissue, including tissue at various stages of disease. Such standards may be determined empirically or known in the art. Alteration of an optical signa alone may be indicative of the health of the patient from whom a sample was obtained.
  • FIG. 1 shows an exemplary spectroscopic system that employs a plurality of spectral types according to an illustrative embodiment of the invention
  • FIG. 2 shows an exemplary operational block diagram of the spectroscopic system of FIG. 1;
  • FIG. 3 is a detailed schematic flow diagram showing exemplary steps of combining a fluorescence spectrum analysis with a reflectance spectrum analysis according to an illustrative embodiment of the invention
  • FIG. 4 is a schematic diagram of another illustrative system useful for monitoring the effects of a chemical agent on a specimen, and which embodies principles of the invention
  • FIG. 5 is a graph that shows trend lines of data observed according to principles of the invention.
  • FIGS. 6 A- 6 C are diagrams that show raw data observed from various specimens, according to principles of the invention.
  • FIG. 7 is a graph showing curves representing averages of data processed according to principles of the invention.
  • FIG. 8 is a graph plotting computed ratios that show a basis for differentiating CIN II/III lesionf from CIN I and normal tissue for individual specimens, according to principles of the invention
  • FIG. 9 is a graph showing responses, normalized at 480 nm, from tissues as function of wavelength, according to principles of the invention.
  • FIG. 10 is a functional block diagram of an embodiment of a another illustrative system useful for monitoring the effects of a chemical agent on a specimen according to the invention.
  • FIG. 11 is a functional block diagram of an embodiment of an illustrative hand-held system useful for monitoring the effects of a chemical agent on a specimen according to the invention
  • FIGS. 12 A- 12 C depict schematic arrangements for illustrative filter wheels useful in the system of FIG. 11;
  • FIG. 13 is a functional block diagram of an embodiment of a system useful for monitoring the effects of a chemical agent on a specimen according to the invention
  • FIG. 14 is a schematic diagram of a filter wheel useful in the system of FIG. 13;
  • FIG. 15 is a functional block diagram of an embodiment of a system useful for monitoring the effects of a chemical agent on a specimen according to the invention.
  • FIG. 16 shows a schematic diagram of a CCD device for use in the system of FIG. 15;
  • FIG. 17 is a graph showing the time dependence of backscattered responses at 600 nm for various tissue classes (NED, CIN II and CIN III), recorded using systems and methods of the invention;
  • FIGS. 18 A- 18 C are diagrams depicting various aspects of a mucosal atomizer device used to spray a chemical agent uniformly onto the surface of a specimen, and to provide a trigger mechanism useful for initiating an optical observation, according to principles of the invention;
  • FIG. 19 is a graph of absorption spectra recorded for NADH using a chemical agent according to the invention.
  • FIG. 20 is a graph of fluorescence spectra as a function of time for specimens treated with a chemical agent according to principles of the invention.
  • FIG. 21 is a graph of flourescence spectra recorded before and after treatment of a specimen with a chemical agent, according to principles of the invention.
  • FIG. 22 is a one-dimensional diagram of watershed segmentation
  • FIG. 23 is a graph of a signal and its first derivative
  • FIG. 24 shows a sigmoidal scaling function used to enhance the contrast between light and dark regions of an image.
  • Acetowhitening of cervical tissue has long been known to be a qualitative aid to locating lesions during colposcopic examination.
  • accurate quantitative measurements of acetowhitening of cervical epithelial tissue, as a function of time and wavelength, have not been reported.
  • Quantitative analysis of the acetowhitening process can significantly increase the sensitivity and specificity of traditional colposcopy.
  • the invention will be described in terms of multiple embodiments that relate to the observation of chemically-induced changes in optical spectra, particularly in the area of medical diagnostics, and especially as it relates to the analysis of spectra obtained from human cervical tissue in the detection of cervical cancer.
  • the invention has applicability generally in the area of chemically-induced changes in optical spectra.
  • FIG. 1 depicts an exemplary spectroscopic system 100 employing a plurality of spectral data types in methods and systems according to an illustrative embodiment of the invention.
  • the spectroscopic system includes a console 102 connected to a probe 104 by a cable 106 .
  • the cable 106 carries electrical and optical signals between the console 102 and the probe 104 .
  • the probe 104 accommodates a disposable component 108 which is used only once, and discarded after use.
  • the console 102 and the probe 104 are mechanically connected by an articulating arm 110 , which can also support the cable 106 .
  • the console 102 contains much of the hardware and the software of the system, and the probe 104 contains the necessary hardware for making suitable spectroscopic observations. The details of the system are further explained in conjunction with FIG. 2.
  • FIG. 2 shows an exemplary operational block diagram 200 of a spectroscopic system of the type depicted in FIG. 1.
  • the spectroscopic system of FIGS. 1 and 2 is subtantially the same as single-beam spectrometer devices, but is adapted to include the features of the invention.
  • the console 102 includes a computer 202 which executes software that controls the operation of the spectroscopic system 100 .
  • the software includes one or more modules recorded on machine-readable media, which can be any medium such as magnetic disks, magnetic tape, CD-ROM, semiconductor memory, or the like.
  • the machine-readable medium is resident within the computer 202 .
  • the machine-readable medium can be connected to the computer 202 by a communication link.
  • firmware i.e., computer instructions recorded on devices such as PROMs, EPROMS oe EEPROMs, or the like.
  • machine-readable instructions as used herein is intended to encompass software, hardwired logic, firmware and the like.
  • the computer 202 is a general purpose computer.
  • the computer 202 can be an embedded computer, or a personal computer such as a laptop or desktop computer, that is capable of running the software, issuing suitable control commands, and recording information in real time.
  • the computer 202 has a display 204 for reporting information to an operator of the spectroscopic system 100 , a keyboard 206 for enabling the operator to enter information and commands, and a printer 208 for providing a print-out, or permanent record, of measurements made by the spectroscopic system 100 and for printing diagnostic results, for example, for inclusion in the chart of a patient.
  • some commands entered at the keyboard enable a user to select a particular spectrum for analysis or to reject a spectrum, and to select particular segments of a spectrum for normalization.
  • Other commands enable a user to select the wavelength range for each particular segment and to specify both wavelength contiguous and non-contiguous segments.
  • the console 102 also includes an ultraviolet (UV) source 210 such as a nitrogen laser or a frequency-tripled Nd:YAG laser, a white light source 212 such as one or more Xenon flash lamps, and control electronics 214 for controlling the light sources both as to intensity and as to the time of onset of operation and the duration of operation.
  • UV ultraviolet
  • One or more power supplies 216 are included in the console 102 , to provide regulated power for the operation of all of the components.
  • the console 102 also includes at least one spectrometer and at least one detector (spectrometer and detector 218 ) suitable for use with each of the light sources.
  • a single spectrometer can operate with both the UV light source and the white light source.
  • the same detector can record UV and white light signals, and in some embodiments different detectors are used for each light source.
  • the console 102 also includes coupling optics 220 to couple the UV illumination from the UV light source 210 to one or more optical fibers in the cable 106 for transmission to the probe 104 , and for coupling the white light illumination from the white light source 212 to one or more optical fibers in the cable 106 for transmission to the probe 104 .
  • the console 102 also includes coupling optics 222 to couple the spectral response of a specimen to UV illumination from the UV light source 210 observed by the probe 104 and carried by one or more optical fibers in the cable 106 for transmission to the spectrometer and detector 218 , and for coupling the spectral response of a specimen to the white light illumination from the white light source 212 observed by the probe 104 and carried by one or more optical fibers in the cable 106 for transmission to the spectrometer and detector 218 .
  • the console 102 includes a footswitch 224 to enable an operator of the spectroscopic system I 00 to signal when it is appropriate to commence a spectral observation by stepping on the switch. In this manner, the operator has his or her hands free to perform other tasks, for example, aligning the probe 104 .
  • the console 102 includes a calibration port 226 for calibrating the optical components of the spectrometer system.
  • the operator places the probe 104 in registry with the calibration port 226 and issues a command that starts the calibration operation.
  • a calibrated light source provides illumination of known intensity as a function of wavelength as a calibration signal.
  • the probe 104 detects the calibration signal.
  • the probe 104 transmits the detected signal through the optical fiber in the cable 106 , through the coupling optics 222 to the spectrometer and detector 218 .
  • a test spectral result is obtained.
  • a calibration of the spectral system is computed as the ratio of the amplitude of the known illumination at a particular wavelength divided by the test spectral result at the same wavelength.
  • the probe 104 includes probe optics 230 for illuminating a specimen to be analyzed with UV and white light from the UV source 210 and the white light source 212 , and for collecting the fluorescent and backscatter (or reflectance) illumination from the specimen that is being analyzed.
  • the probe includes a scanner assembly 232 that provides illumination from the UV source 210 in a raster pattern over a target area of the specimen of cervical tissue to be analyzed.
  • the probe includes a video camera 234 for observing and recording visual images of the specimen under analysis.
  • the probe 104 includes a targeting souce 236 , which can be used to determine where on the surface of the specimen to be analyzed the probe 104 is pointing.
  • the probe 104 also includes a white light illuminator 238 to assist the operator in visualizing the specimen to be analyzed.
  • the computer 202 controls the actions of the light sources 210 , 212 , the coupling optics 220 , the transmission of light signals and electrical signals through the cable 106 , the operation of the probe optics 230 and the scanner assembly 232 , the retreival of observed spectra via the cable 106 , the coupling of the observed spectra via the coupling optics 222 into the spectrometer and detector 218 , the operation of the spectrometer and detector 218 , and the subsequent signal procesing and analysis of the recorded spectra.
  • FIG. 3 is a detailed schematic flow diagram 300 showing exemplary steps of combining fluorescence spectrum analysis with reflectance spectrum analysis to perform tissue characterization according to an illustrative embodiment of the invention.
  • Step 310 indicates that fluorescence spectra from a test specimen of unknown condition or unknown state of health are available.
  • the computer 202 determines whether the test specimen can be classified as “normal,” or “metaplasia,” or can not be classified by fluorescence spectroscopy alone. As indicated in step 325 , a decision is taken as to whether the test specimen has a definitive state of health, for example that the specimen is “normal.” If the test specimen can be classified, for example as normal, the method ends at step 330 .
  • the computer 202 further analyses information available from a reflectance spectrum or from a plurality of reflectance spectra taken from the test specimen. At step 335 , the computer 202 provides processed reflectance spectra.
  • a mean normalization step is performed by computer 202 , as indicated at step 340 .
  • the mean normalization is carried out using a plurality of reflectance spectra taken from specimens that are known to represent normal squamous tissue. In one embodiment, a single test specimen is examined at multiple locations, each location measuring approximately one millimeter in diameter. If one or more locations of the test specimen provide fluorescence spectra that indicate that those locations can be classified as representing normal squamous tissue, the reflectance spectra recorded from those locations are used to mean normalize the reflectance spectra obtained from locations that are not capable of being classified as “normal” or “metaplasia” solely on the basis of fluorescence spectra.
  • the computer 202 can carry out an analysis using a metric, for example using the Mahalanobis distance as a metric in N-dimensional space.
  • the test reflectance spectra are truncated to the wavelength regions 391 nm to 484 nm, and 532 nm to 625 nm.
  • the classifications CIN I and CIN II/II are the classifications that are possible for a test spectrum that is neither classified as “normal” nor “metaplasia” by fluorescence spectral analysis.
  • the computer 202 classifies the test specimen as having a condition or state of health selected from CIN I and CIN II/III based on the value of the metric computed by the computer 202 , provided that the value of the metric does not exceed a pre-determined maximum value.
  • the computer 202 presents the results of the classification of the test specimen, as a condition or state of health corresponding to one of normal, metaplasia, CIN I and CIN II/III.
  • FIG. 4 shows a schematic diagram of an illustrative system 600 embodying principles of the invention.
  • a standard colposcope 610 (Zeiss, Model 1-FC ZMS-506-II) is modified by adding video image capture capability with permanent and electronic storage of data to allow capturing of time-sequenced images during a routine colposcopic examination.
  • the colposcope 610 has magnification capabilities of 4 ⁇ , 6 ⁇ , 10 ⁇ , 16 ⁇ , and 25 ⁇ , and is illuminated by a fiber optic-coupled 12 volt/100 watt halogen lamp 620 with 20 ⁇ eye binoculars.
  • a three-channel charge-coupled device color video camera (DAGE-MTI, Model DC-330) 630 is mounted to the colposcope 610 .
  • DAGE-MTI Model DC-330
  • the computer 650 includes an integrated video frame-grab board and video display card at 24-bit resolution for capturing images. Images can be captured at a rate of at least about one image per second.
  • the computer 650 also includes image control software (TeleComputing Solutions, ColpoShotTM) that interfaces with the video frame grab board for archiving images, for example into patients' medical records.
  • the ColpoShotTM software is modified to allow for intensity measurements at specific sites as a function of time and wavelength (as resolved by four discrete filters in a filter wheel 640 , described in more detail below).
  • the computer 650 also includes control software for controlling the change of filters in the high-speed filter wheel 640 . This software is synchronized with the data collection (image capture) software so each image is associated with a spectral region corresponding to a particular filter. Time-stamping of each image is performed so each image can be placed in proper time sequence.
  • the filter wheel 640 is from a Ludl Electronics Ltd., with an RS 232 and GPIB 488 computer interface for resolving optical signals with respect to wavelength. Images are measured and recorded at three separate wavelength bands in the visible spectral region. The first wavelength band is near 400 nm, with a bandwidth of about 20 nm to about 30 nm. The second wavelength band is near 525 nm with a bandwidth of about 30 nm. The third wavelength band is near 680 nm with a nominal bandwidth of about 30 nm. In addition to the images taken through the filter wheel 640 , a fourth image using unfiltered illumination is taken as part of the data set.
  • the unfiltered images allow data analysis of red (R), green (G), and blue (B) components for comparison with filtered image data.
  • crossed polarizers mounted in the optical path one associated with the light coming from the illumination source 620 , and one associated with the light from the image to be observed and recorded, are used to reduce unwanted glare from the surface of the cervix.
  • the illustrative system 600 is controlled by the computer 650 , having capabilities similar to the computer 140 described earlier.
  • the computer 650 has associated with it software to operate the computer 650 , to provide input and output interactions with an instrument user, to control and synchronize the various components of the illustrative system 600 , and to record, analyze, and report data obtained from the illustrative system 600 .
  • the illustrative system 600 is configured to capture time-separated images of the specimen during routine colposcopic examinations. Digital images are recorded at a 4 x magnification giving a panoramic view of the entire cervical field at maximal acetic whitening. In the illustrative embodiment, images are taken about every second for about 5 minutes after the application of acetic acid.
  • the computer 650 rotates the filter wheel 640 to allow for imaging at different wavelengths.
  • an illustrative embodiment of the process of obtaining images is as follows.
  • the first image following the application of the acetic acid is an unfiltered image.
  • the filter wheel 640 is rotated to bring the short-wavelength ( ⁇ 400 nm) filter into place and the next image is recorded.
  • the ⁇ 525 nm filter is positioned, and the next image is recorded.
  • the long-wavelength ( ⁇ 680 nm) filter is positioned and the last image of the sequence is recorded. This process takes four seconds to complete.
  • the process repeats with another unfiltered image, followed by the sequence of filtered images.
  • the process of observing and recording images continues without stopping for a duration of 300 seconds.
  • the resulting data are seventy-five unfiltered images of the evolution of an optical signal from a specimen treated with a chemical agent, such as cervical acetowhitening, and a total of seventy-five images in each of the three filtered spectral regions.
  • a chemical agent such as cervical acetowhitening
  • the precise sequence of observing and recording images in the various wavelength bands depends on the sequence of placement of filters within the filter wheel 640 and the sense of rotation of the wheel 640 . Alternative sequences of observation can be employed with substantially equivalent results.
  • the duration of operation can be shortened or extended from the illustrative 300 seconds just described depending on the situation, which can be influenced by the kind of specimen and how it is to be examined (e.g., specimen characteristics, such as cervix, larynx, skin, and the like, specimen in vivo or in vitro, use of different chemical agents, the disease conditions to be investigated, and the like).
  • specimen characteristics such as cervix, larynx, skin, and the like
  • specimen in vivo or in vitro use of different chemical agents, the disease conditions to be investigated, and the like.
  • time-stamped images are saved to disk at 20 second intervals.
  • treatment of a specimen with a chemical agent is accomplished as follows. A solution of 5% acetic acid is applied with solution-soaked cotton balls placed in contact with the surface of the cervix for about 15 seconds. An alternative method of application of a chemical agent is discussed below.
  • the time sequence image capturing software is run immediately before the application of acetic acid, to obtain baseline measurements.
  • the parameters that are extracted from the observations include the rate of acetowbitening, the maximum intensity of the whitening, and the final rate of decay of the whitening.
  • the images are analyzed by the computer 650 with software that calculates four parameters (mean Luminance, and mean red (R ), green (G), and blue (B) intensities) within user-defined Regions of Interest (ROI's).
  • the software enables the user to mark, with a mouse controlled cross-hair cursor, 5 pixel by 5 pixel ROI's on a location in an image.
  • a biopsy can subsequently be taken by the colposcopist, to permit a comparison of the results obtained from the methods of the invention with the results of the biopsy.
  • mean Luminance and mean R, G, B intensities within the 5 pixel by 5 pixel ROI's are calculated and output in tabular form. Also included in the output recorded in the table are the following data elements; image number, ROI location, elapsed time in seconds, and the standard deviation and median of the Luminance and R, G, B values. In one embodiment, the ratio of the mean green intensity to the mean red intensity is found to yield accurate results.
  • FIG. 5 is a diagram 700 that shows the trend lines of ROIs correlated to CIN II/III lesions (curve 706 ), CIN I lesions (curve 708 ), and normal mature squamous tissue (curve 710 ).
  • the trend lines are plotted using the ratio of mean green intensity to mean red intensity, normalized to maximum intensity, as the vertical axis 702 (expressed in arbitrary units), and using the time after application of acetic acid to the tissue, expressed in seconds, as the horizontal axis 704 .
  • FIGS. 6 A- 6 C are diagrams, generally 800 , that show graphs of raw data plotted using the ratio of mean green intensity to mean red intensity, normalized to maximum intensity, as the vertical axis 802 (expressed in arbitrary units), and using the time after appllication of acetic acid to the tissue, expressed in seconds, as the horizontal axis 804 .
  • FIG. 6A is a diagram that shows the raw data of ROIs correlated to CIN II/III lesions, as curves 810 , 812 , 814 , 816 , 818 representing observations taken from five individuals.
  • FIG. 6B is a diagram that shows the raw data of ROIs correlated to CIN I lesions, as curves 820 , 822 , 824 , 826 , 828 representing observations taken from five individuals.
  • FIG. 6C is a diagram that shows the raw data of ROIs correlated to normal mature squamous tissue, as curves 830 , 832 , 834 , 836 , 838 representing observations taken from five individuals.
  • An operator of the illustrative system and method defines a region of interest on an image.
  • the intensity readings of the pixels in this region are averaged to provide a quantitative value of brightness as recorded through the particular filter (or unfiltered).
  • a picture of the evolution of the acetowhitening at the selected location in the image is created.
  • a clinically useful tool based on the acetowhitening kinetic characteristics analyzes the data to differentiate CIN II/III lesions from CIN I lesions and normal mature squamous tissue.
  • the technique uses mean values from 100 second segments of individual patient kinetic curves. The curves are processed by calculating the mean of segments along the curve, i.e. the mean value of the data in the temporal range from about 100 -200 seconds after application of the chemical agent, the mean value of the data in the temporal range from about 200-300 seconds after application of the chemical agent, and so forth.
  • FIG. 7 is a graph 900 showing curves of the averages of data processed in this manner, in which the average values are plotted along the vertical axis 902 (expressed in normalized units), and using the time after application of acetic acid to the tissue, expressed in seconds, as the horizontal axis 904 .
  • the curve 906 represents data relating to CIN II/III lesions.
  • the curve 908 represents data relating to CIN I lesions.
  • the curve 910 represents data relating to mormal mature squamous tissue.
  • FIG. 8 is a scatter plot 1000 generated by taking the ratio of mean values from two time intervals (100-200 seconds) and (200-300 seconds) for data from individual specimens.
  • the average values for the time interval 200 seconds to 300 seconds are plotted along the vertical axis 1002
  • the time interval 100 seconds to 200 seconds is plotted as the horizontal axis 1004 .
  • the points 1006 represent data relating to CIN II/III lesions.
  • the points 1008 represent data relating to CIN I lesions.
  • the points 1010 represent data relating to mormal mature squamous tissue.
  • FIG. 8 shows a basis for differentiating CIN II/III for individual specimens.
  • An illustrative line 1020 is a line of demarcation between the CIN II/III data and the remaining data.
  • a second technique using the first derivative of the curves shown in FIG. 7 is also operative . This technique yields similar results to those shown in FIG. 8.
  • an indication of the presence or lack of cancerous or precancerous tissue is obtained by recording the optical response in two parts of the visible spectrum.
  • the inventors have observed that at short wavelengths, such as 380 nm, absorption by hemoglobin can reduce signal intensities.
  • Optical responses are recorded in that part of the spectrum where optical response variation can be detected due to morphological changes in tissue which are associated with cancerous and precancerous tissue, such morphological variations having a strong impact on light scattering.
  • scattering of light from cancerous tissue was substantially greater than from normal tissue, and thus the reflected responses from cancerous tissue in that spectral range were greater than from normal tissue.
  • the system of the invention standardizes responses at 480 nm for this purpose.
  • the response e.g., the observed reflectance
  • the response obtained at the short wavelength (between 360 and 440 nm) and at the long wavelength (between 590 and 750 nm) are divided by the response at 480 nm.
  • normalized reflections at longer wavelengths indicate cancerous and precancerous tissue, while lower intensity normalized refelections indicate healthy tissue.
  • reflections in the short wavelength part of the spectrum indicate cancerous and precancerous tissue, while higher intensity reflections indicate healthy tissue.
  • An algorithm using the rate of change of white light reflection at some specific wavelength, for instance, at 600 nm, can provide accurate differentiation between pathologic and healthy tissue within the first 60 seconds after the application of a pathology differentiating agent like acetic acid.
  • Other algorithms, using both the aforementioned rate of change, or the time lapsed to reach maximum back scattering after application of a differentiating agent, or the time required to attain specific back scattered (normalized) threshold values, permit the diagnosis of the presence or absence of cancer in the screened cervix.
  • methods are provided that employ specific algorithms to analyze the back-scattered responses obtained at the preselected wavelength or wavelengths either with or without a chemical agent. Algorithms further provide for classifying examined tissues as normal or pathological. In certain embodiments, these systems are characterized by ease of operation, simplicity and ruggedness.
  • FIG. 9 presents a graph 1100 showing two data curves 1102 , 1104 obtained from healthy (no evidence of disease, or NED) and cancerous (CIN) tissue respectively. Normalized intensity is plotted along the vertical axis 1106 and wavelength (in units of nm) is plotted along the horizontal axis 1108 . All received responses (I ⁇ ) are normalized by dividing the intensities received by the intensity obtained at an arbitrary wavelength. Reflections measured at 480 nm are used for this purpose, since it is in a part of the spectrum where the responses' intensities are relatively independent of the tissue state (healthy or pathological).
  • FIG. 1100 showing two data curves 1102 , 1104 obtained from healthy (no evidence of disease, or NED) and cancerous (CIN) tissue respectively. Normalized intensity is plotted along the vertical axis 1106 and wavelength (in units of nm) is plotted along the horizontal axis 1108 . All received responses (I ⁇ ) are normalized by dividing the intensities received by the
  • an algorithm utilizes the reflected reading from the tissue at the three selected wavelengths to produce an indicator of the presence or absence of a pathology in the target tissue, or to create an artificial pathology image of the tissue observed.
  • the responses are collected at three wavelengths for each point observed. In one embodiment, the following three wavelengths can be used:
  • R 380 I( ⁇ 1 )/I( ⁇ 2 )
  • R 650 I( ⁇ 3 )/I( ⁇ 2 )
  • I( ⁇ 1 ), I( ⁇ 2 ) and I( ⁇ 3 ) are the measured reflected intensities at ⁇ 1 , ⁇ 2 and ⁇ 3 respectively.
  • These normalized intensities R 380 and R 650 (which are dimensionless), can vary from about 0.2 to about 6.
  • the intensity of the reflected light at 380 and 650 nm are normalized, where the normalization parameter is the reflected intensity at 480 nm.
  • R(low ⁇ ) and R(high ⁇ ) around neighboring wavelengths in the respective ranges are defined well, using data such as presented in FIG. 9 from a number of subjects and tissue with varying pathologies in those subjects as a “training set” to calibrate the apparatus being employed.
  • the selection of the “bandwidth” around the center wavelength is related to the kind of instrumentation selected for the actual device, as described below in more detail.
  • a grading algorithm is incorporated in a data processing unit employed by these systems and methods.
  • the grading algorithm utilizes the pair (R 650 , R 380 ) and classifies the reflections from each site observed into three groups.
  • the algorithm classifies reflections for which the pair obeys R 650 ⁇ 2.9, R 380 >0.1.1 as “healthy tissue” or NED.
  • a second group of sites, for which the pair obeys R 650 >3.5, R 380 ⁇ 0.9 is classified as cancerous or precancerous tissue or CIN.
  • a third group of tissue including those tissues for which the reflections pairs obey the relationships 2.9 ⁇ R 650 ⁇ 3.5, 0.9 ⁇ R 380 ⁇ 0.1.1, is classified as tissue for which a determination cannot be made.
  • An algorithm according to these systems and methods classifies each point in the observed tissue as healthy or unhealthy. If this classification can not be performed for a particular tissue area, that area is segregated into a third, “unclassifiable” class.
  • an algorithm maps tissue for the presence or absence of a pathology.
  • an algorithm utilizes an independently determined set of threshold values for R 380 and R 650 . These threshold values are determined in clinical studies from a large number of patients from which both readings of R 380 and R 650 are compared with biopsies taken from the tissues from which these values are determined.
  • the threshold values as well as the actual wavelengths where the reflections are taken (and the normalizing wavelength utilized to determine from I( ⁇ ) the normalized reflection R ⁇ ) can vary from the values presented herein, as long as the short wavelengths reflections correlate well with absorption by hemoglobin and the long wavelengths reflections with variations of scattering between healthy and pathological tissues.
  • the wavelengths presented in the example above and shown in FIG. 9 are useful in the diagnosis of cervical tissue abnormalities. It is understood, however, that other wavelengths may be useful, particularly when other tissue areas are studied. Furthermore, the critical threshold values of the short and long wavelengths standardized reflections, R, are subject to determination for each type of tissue targeted.
  • a tissue integral algorithm is used, where the cervix as a whole is examined to determine if a pathology exists without actually obtaining an image of the location of such pathology within the tissue.
  • This algorithm is used as follows.
  • the computer 650 collects the normalized reflection R 650 for all measured sites on the tissue and determine the minimum R 650 (min) of the set ⁇ R 650 ⁇ .
  • the computer 650 determines the maximum value R 650 (max) of the set ⁇ R 650 ⁇ .
  • the tissue is free of pathology. If this condition is not met, pathology of some type is indicated, and the subject should be referred for additional diagnostic tests to identify the type and location of the suspected cervical pathology.
  • R 380 determines the minimum R 380 (min) of the set ⁇ R 380 ⁇ , for the normalized reflection R 380 observed for all tissue locations.
  • the computer 650 determines the maximum value R 380 (max) of the set ⁇ R 380 ). In one embodiment, if the condition R 380 (max) ⁇ 1.20R 380 (min) of the set ⁇ R 380 ⁇ is true, (e.g., if all observed values of R 380 are smaller than 120% of the smallest value of R 380 , R 380 (min)), then the tissue is free of pathology. If this condition is not met, pathology of some type is indicated, and the subject should be referred for additional diagnostic tests to identify the type and location of the suspected cervical pathology.
  • FIG. 10 shows an illustrative embodiment of a device for determining the presence or absence of pathology in a tissue of the cervix according to the invention.
  • a screening device shown generally at 1200
  • a colposcope 1202 is provided with a high intensity light source and optics to view cervical tissue, all included within the colposcope 1202 .
  • the image viewed by an observer 1203 is recorded with a video camera 1210 and recorded for future reference on magnetic media through a video tape recorder 1211 .
  • the instrument depicted in FIG. 10 is used for determining the presence or absence of pathology point by point.
  • a beam splitter 1212 is used to select a site in the target tissue 1213 which is illuminated with white light 1214 from the light source provided in the colposcope 1202 .
  • the position control of the beam splitter (and thus selection of the point examined in the target tissue) is accomplished with a “joystick” 1215 .
  • the optical head 1216 includes a small laser diode (wavelength at about 635 nm) 1217 , having a beam coaxial with the optical head's detection optics. In operation, the red beam is pointed toward the tissue 1213 .
  • the optical head 1216 measures the light reflected from the point illuminated by the red laser diode beam.
  • a white reflector 1219 is provided within the illumination path of the colposcope, to which the operator directs the seeking beam from the laser diode 1217 .
  • the reflectance from the white reflector 1219 is used as a standard for calibrating the sensor 1218 .
  • Such a white reflector can be made from SpectrolonTM, from Labsphere Corporation.
  • high purity BaSO 4 reflecting paint from the Kodak Corporation can be applied to a flat surface and used.
  • a polarizer is interposed in the back scattered beams which considerably reduces the specular reflection from the target tissues.
  • the specular reflection is understood to comprise the light reflected from the thin film of moisture overlaying the target tissue that has not interacted with the underlying tissue.
  • the physician directs the beam 1214 to a specific site on the suspected tissue 1213 .
  • the reflected light from this site is collected by the optical head 1216 .
  • a spectrometer 1220 (which can be either a refractive or dispersive spectrometer) disperses the light so that the intensity of the reflected light at preselected wave lengths can be measured in the detector 1218 .
  • three preselected wavelengths are chosen.
  • the sensor 1218 comprises a plurality of sensors corresponding in number to the number of preselected wavelengths, so that one sensor is dedicated to each wavelength.
  • the sensor 1218 can be an ICCD, a standard CCD, or any other detector system known in the art or envisioned by those of ordinary skill in these arts.
  • Data from the sensor 1218 is analyzed in a computer processor 1221 by applying an algorithm system as described above, and a score is obtained from the data processing that relates to the presence or absence of pathology at the tissue area being illuminated by the laser diode 1217 .
  • This score is graphically represented on a display 1222 .
  • the digital information corresponding to the score is made available electronically for further processing or representation.
  • points for which pathological scores are obtained can be represented on a display 1222 as superimposed upon an image provided by a video camera 1210 .
  • abnormal points are identified graphically with an artificial color not commonly found in cervical tissue, such as shades of green. It will be seen below that other embodiments provide for creation of artificial images or representations of pathologies.
  • the embodiment illustrated in FIG. 10 is suitable for operation by a gynecologist in conjunction with colposcopy. In this setting, the device is well adapted for use as an assisting device for determining which areas of the cervix may require biopsies.
  • the systems and methods of the invention provide a hand held device adapted for illuminating a target tissue with white light and further adapted for detecting reflections or backscattered responses at three specific wavelengths.
  • FIG. 11 shows an illustrative embodiment suitable for screening applications. This embodiment provides features of a visualization colposcope and features of a screening device according to the present invention. In this embodiment, a superimposition of pathological findings on a cervical image may be produced.
  • FIG. 11 shows a colposcreener 1330 consisting of two orthogonal optical paths 1331 and 1332 .
  • the first optical path 1331 includes a plurality of lenses (for example lenses 1333 , 1334 and 1335 ) to image the tissue 1336 so that it can be viewed by an observer 1303 .
  • the second optical path 1332 includes a distal portion 1331 a of the first optical path 1331 (for example lenses 1334 and 1335 ), a beam splitter, 1338 and additional lenses (for example, lenses 1337 and 1339 ).
  • the beam splitter 1338 couples the two optical paths 1331 and 1332 to the distal portion 1331 a of the first optical path 1331 , directing half of the light reflected back from the tissue 1336 to be viewed by the observer 1303 through the ocular 1333 and directing half to a sensor 1340 .
  • the sensor 1340 is coupled to the optics via a mirror 1341 , as shown in FIG. 11, or the sensor 1340 is positioned in the image plane of the second optical path 1332 .
  • the sensor 1340 comprises a plurality of sensors corresponding in number to the number of preselected wavelengths, so that one sensor is dedicated to each wavelength.
  • the sensor 1340 can be, for example an ICCD, a standard CCD, or any other detector system known in the art or envisioned by those of ordinary skill in these arts.
  • a filter wheel 1342 is placed in the optical path of the detected beam 1332 , to allow at any given time only one wavelength to reach the detector 1340 .
  • the filter wheel 1342 is mounted on an appropriate driving mechanism, for instance, a stepper motor 1343 , which sequentially indexes the wheel to the appropriate filter.
  • the filter wheel 1442 has three filters, 1444 , 1445 and 1446 , each capable of blocking most of the spectrum of the reflected beam except around the three selected wavelengths, 380 nm, 480 nm and 650 nm respectively (for the filters 1444 , 1445 and 1446 ).
  • a number of duplications of these filters can be employed for drive simplicity, in particular when the cross section of the reflected beam is narrowed (at the common focal point of the lens on both sides of the filter wheel 1442 ), so as to allow more than three wavelengths to be determined per rotation of the filter wheel 1442 .
  • the number of filter slots would be a multiple of three.
  • a different filter wheel, 1447 is used in place of the previously illustrated filter wheel 1442 .
  • the filter wheel 1447 has four positions (or multiples of four).
  • the first three, positions 1448 , 1449 and 1450 are filters transmitting at 380 nm, 480 nm and 650 nm respectively, as cited above, and a fourth slot, 1451 , being spectrally neutral, namely it is either a simple open slot in the filter wheel 1447 , or a neutral filter that reduces the transmission of all wavelengths by a constant factor.
  • the latter case simplifies the task of maintaining the signals received by the sensor 1440 , (for instance a CCD) under a given threshold and thus preventing sensor's saturation.
  • the shape of the colposcreener 1330 is similar to the device depicted in FIG. 11.
  • FIG. 11 shows a colposcreener 1330 shaped like a gun, with a trigger 1352 used to initiate the processes of obtaining optical reflection data and viewing the tissue 1336 .
  • pressing the trigger 1352 switches on a light source in the control console 1353 .
  • This light source is concentrated into an optical fiber bundle (not shown) included in the control cable 1354 which connects the control console 1353 and the colposcreener 1330 .
  • the optical fiber bundle 1354 delivers light to the distal end 1355 of the colposcreener 1330 .
  • a cone of white light 1357 illuminates the target tissue 1336 homogeneously.
  • colposcreener 1330 may be envisioned by those of ordinary skill in these arts without departing from the scope of the systems and methods disclosed herein. Furthermore, while the colposcreener 1330 is adapted for examination of the cervix, other shapes and embodiments consistent with these systems and methods may be devised that are structurally adapted for other anatomic areas.
  • FIG. 11 further shows that light reflected from the tissue is split by the beam splitter 1338 into a viewing beam carried along the optical path 1331 and a detection beam carried along the optical path 1332 .
  • the tissue screened is viewed directly through the ocular 1333 while the detection beam is being sequentially scanned for the three wave length discussed above.
  • the tissue is imaged onto the sensor 1340 .
  • the sensor 1340 comprises a CCD array, whereby the light intensity reflected for each point in the tissue is measured.
  • the data from the sensor 1340 is transmitted through a data cable 1356 to a data processing unit 1358 for further analysis.
  • Synchronization signals generated in the control console 1353 provide correct indexing of the streams of data for each one of the three filters in the filter wheel 1342 . This may be achieved by using the signal sent to the stepper motor 1343 to coordinate with the data stream from the sensor 1340 .
  • the synchronization task is simplified by using the geometry of the filters in the filter wheel 1342 .
  • the motor 1343 is used in a continuous rather then a stepping manner, thus the filter wheel 1342 rotates continuously.
  • An embodiment using a filter wheel in this way is shown in FIG. 12C, where the filter wheel 1459 is depicted as having three unequal filters 1460 , 1461 and 1462 , separated by unequal spaces 1463 , 1464 and 1465 .
  • a CCD or a CCD array is advantageously employed as the sensor 1340 , as previously described.
  • the 650 nm red filter 1460 in FIG. 12C is much shorter, with shorter collection time.
  • the short collection time is used to indicate to the data analysis unit 1358 that the red filter 1460 (transmitting selectively at 650 nm) is being used.
  • the green filter 1461 transmitting selectively at 480 nm
  • the blue filter 1462 transmitting selectively at 380 nm where the CCD is least sensitive
  • the signals received at various wavelengths are more homogeneous and easier to analyze. Integration times can be adjusted accordingly. The adjustment of the integration time can be keyed on the “No signal” periods between the filters, represented by the unequal spacings 1463 , 1464 and 1465 between the filters.
  • the data received for each one of the three filters is analyzed for each pixel and is displayed on the display monitor 1322 in a dual fashion.
  • the first display generates a Red/Green/Blue image of the tissue by taking the raw data (normalized for spectral differences in the CCD sensitivity as well as variations of integration times when using the filter wheel 1559 shown in FIG. 12C) from each CCD's pixel and presenting it as a normal full color picture. This is achieved with well known “frame grabbing” electronics readily available commercially.
  • Each pixel, P ij has associated with it three values (residing in the grabbed frame), I ij,380 , I ij,480 and I ij,650 , from which are derived normalized intensities R ij,380 and R ij,650 .
  • a strongly discriminating algorithm selects all pixels P ij for which both of the conditions R ij,650 >3.3 and R ij,380 ⁇ 0.9, namely those pixels for which a pathology is identified. These pixels form a group Qij of pathological tissue.
  • a “weaker” discrimination defines as “pathological” only those P ij for which R ij,650 >3.3 and the so defined Q ij are then painted on the total image as a pathology.
  • the display superimposes an image of all the pixels Q ij having a “pathological” signature on the natural picture of the tissue. This is achieved by selecting a color uncommon to the tissue (such as green, or blue) and painting said all Q ij (pathological) pixels all in the same color, thus obtaining an artificial-looking image of the extent of the pathology in the tissue.
  • the filter depicted in FIG. 12B wherein one of the positions is a neutral filter uses the image generated by the neutral filter (which will appear on the display having shades of gray) as the background image of the tissue on which the pathology is superimposed in any desired color.
  • a standard white reflector is used, as described above for FIG. 10.
  • FIG. 13 depicts an embodiment in which the apparatus is configured as a screening device 1570 without providing for direct visualization of the tissue being screened by an observer.
  • the screening optical head 1571 contains an optical train 1572 , an illuminator 1573 , a CCD array 1574 and a filter wheel 1575 .
  • the filter wheel 1575 is rotated as previously described, either continuously or in a stepping fashion with a stepper motor, 1576 .
  • the light source is within the data processing/control console 1577 , and the data is displayed on a display 1578 . Light from the light source is collected into a bundle of optical fibers 1573 which is an integral part of the cable 1579 , between the console 1577 and the screening device 1571 .
  • FIG. 13 shows the optical fibers 1573 as nested within the screening device 1571 at one location, it is understood that the fibers within the bundle can be arranged circumferentially or in any other geometric arrangement in order to provide homogeneous illumination of the target tissue 1580 .
  • FIG. 14 shows a filter wheel 1600 suitable for use with the device depicted in FIG. 13.
  • the illustrated filter wheel 1600 is configured to select light at wavelengths of 380 nm, 480 nm and 650 nm, with an open area to facilitate synchronization. It should also be evident to practitioners of ordinary skill that any arrangement of filter wheels understood in the art, including those illustrated in FIGS. 12 A- 12 C above, could be used in the depicted system, with the operation of the apparatus being adjusted accordingly.
  • the screening device 1571 may be pointed to the target tissue 1580 .
  • the tissue may be illuminated through the optical fiber bundle 1573 and reflections from the tissue may be recorded by the CCD array 1574 at about 380 nm, about 480 nm and about 650 nm.
  • the data processing unit 1577 analyzes the recorded data using any one of the algorithms described above. Tissues with color enhanced pathologies are represented on the display 1578 .
  • visual display is not provided and only a reading or printout of the status of the subject (having or nor having a pathology in the target tissue) is presented.
  • the instrument advantageously uses the above-mentioned tissue integral algorithm.
  • the data processing unit 1577 After obtaining the values R ij,650 and R ij,380 for each pixel P ij , determines the maximum and minimum values obtained for R 650 and R 380 . If the conditions R 650 (max) ⁇ 1.2R 650 (min) and R 380 (max) ⁇ 1.2 380 (min) are met, the subject is classified free of pathologies. Otherwise, the subject is referred for additional diagnostic evaluation to determine the nature and the extent of the suspected pathology.
  • a screening device 1700 includes three modules 1701 , 1704 and 1703 .
  • the first module, the screening probe 1701 is operably connected to the second module 1704 through a cable 1703 .
  • the first module 1701 contains a circumferentially arranged optical fiber bundle 1706 for transmitting light to a target 1710 , and an optical path 1702 comprising optical elements for receiving light emitted from the target 1710 .
  • the second module 1704 contains a light source coupled to an optical fiber bundle 1706 .
  • the fibers in the optical fiber bundle 1706 are distributed circumferentially at the distal end of the probe. Furthermore, the second module 1704 contains a data processing unit, including an electronic frame grabbing submodule to process data received from the color CCD array 1900 in the probe module. Results are displayed on the display module 1705 , which is connected to the second module 1704 by way of cable 1707 .
  • the color CCD array 1900 may be typically divided into pixels each having four elements.
  • FIG. 16 shows a segment of the surface of such an array 1800 .
  • an array of 10 ⁇ 10 elements organized as an array of 5 ⁇ 5 pixels is shown. However, it is understood that such an array can comprise in excess of 500 ⁇ 500 elements and thus more that 250 ⁇ 250 pixels.
  • Each one of the pixels 1801 has two green filters 1802 and 1803 , overlaying two of the elements of the four elements in pixel 1801 .
  • the other two elements, 1804 and 1805 have respectively a red and a blue filter overlaid thereupon. While the specific filters employed in standard color CCD devices can vary from the three wavelengths selected above, and can vary from manufacturer to manufacturer, standard color CCDs can be used in the invention.
  • the operation of the device 1700 depicted in FIG. 15 is similar to the operation of the system depicted in FIG. 13, except that no filter wheel is employed.
  • the whole image in three chroma is taken at once, and the frame grabbing module transfers the intensities received for each one of the three colors to a data processing device which undertakes the normalization of the long and short wavelength reflection with the middle of the spectrum responses and proceeds to apply to the two artificial intensities so derived any of the previously described algorithms.
  • the system optics 1702 images the target tissue 1710 onto the color CCD 1800 , and the signal from each pixel is captured in a frame grabbing device in module 1704 .
  • the intensities registered for the two green filtered elements are averaged and used as the normalization value for the intensities registered for the red filtered element and for the blue filtered element.
  • normalized values R ij (B) and R ij (R) are obtained for each pixel having a row i and a column j. These normalized values respectively represent the normalized reflected intensities in the blue and red part of the spectrum.
  • FIG. 17 shows a graph 1900 of measured reflectance I, as normalized by the initial reflectance immediately after the application of the acetic acid, as function of time, beginning with the application of an acetic solution to the cervix, at a wavelength of about 600 nm.
  • the graph 1900 has normalized intensity plotted along the vertical axis 1902 and time expressed in seconds plotted along the horizontal axis 1904 .
  • the data collection is achieved by using a single narrow bandpass filter, transmitting around 600 nm, overlaying a CCD.
  • FIG. 17 represents measurements from a number of tissue samples (in vivo, followed by determination of the pathology from biopsies).
  • the time dependence of the reflected responses from tissues fall into three well differentiated zones.
  • Healthy (NED) tissues have a response 1910 which is independent of time.
  • CIN II tissue shows an increasing response 1920 for about 30 to 60 seconds, and then the reflectance slowly fades out and returns to normal within about three minutes or a little longer.
  • CIN III tissue shows a response 1930 that includes a strong change with time for the first 20 to 30 seconds, and then, the response 1930 stays strong for longer than about three minutes.
  • FIG. 17 shows that the optical behavior of the various tissue classes following the application of the amplifying agent differentiates between healthy and pathologic tissue from measurements taken during the first 10 to 20 seconds after the application of the amplifying agent (or chemical agent), in this case acetic acid.
  • a useful algorithm employs the rate of change of the normalized intensity I with time, dI/dt at between 10 to 20 seconds after the application of the amplifying agent. According to this algorithm, if dI/dt ⁇ 0.055 sec ⁇ 1 , the tissue is classified as healthy (NED). If 0.075 sec ⁇ 1 ⁇ dI/dt ⁇ 0.11 sec ⁇ 1 , the tissue is classified as CIN II. If di/dt>0.11 sec ⁇ 1 , the tissue is classified as CIN III. In one embodiment, the higher dI/dt during the first 10 to 20 seconds after the application of the acetic acid solution, the more severe the pathology is.
  • an algorithm involves the measurement of the normalized reflectance after either 10 or 20 seconds from the application of the acetic acid solution. If I is greater than 1.25 after 10 seconds (or about 1.5 after 20 seconds), the tissue is classified as pathologic, and the patient is directed to have a more detailed analysis of the condition, sometimes, including a biopsy. This embodiment is applied, as an example, when the probe is used in true screening situations rather than in more traditional colposcopic examinations.
  • an algorithm is based on the time required to reach a maximum in the back reflected response of the tissue. According to this embodiment, the longer it takes to reach this maximum the more severe the condition, providing, however, that the maximum is more than about 3.0 times the minimum back scattered response for the same tissue. The disadvantage of this approach is that longer exposure may be required, particularly in the case of CIN III, where back scattered responses continue to increase even after more than 200 seconds.
  • Another algorithm compares the maximum normalized response at 600 nm during any interval of time greater than 10 seconds from the application of the acetic acid solution, to the initial response, and if that response is more than 30% larger than the initial response, the tissue is classified as CIN in general. This algorithm is used when fast classification of cervixes in a screening environment is desired.
  • a screening algorithm takes an ititial reading of responses for each point probed prior to the application of the acetic acid, stores the values as a standard set, and then takes a number of images sequentially.
  • the screening algorithm performs a point by point subtraction of the value of the stored initial responses from the responses obtained after the application of the acetic acid.
  • the time dependence for various classes of tissue results in distributions similar to those shown in FIG. 17, except that the scale of the back scattered intensities is now changed.
  • the algorithm utilizes the differential responses of various classes in a manner as described above.
  • Apparatus and methods for controlled delivery amount and delivery pattern of a chemical agent are disclosed below.
  • Apparatus and method for accurately and synchronously triggering the optical measurements with regard to the time of delivery of the chemical agent are disclosed below.
  • Image capture software to record time-stamped images and user-defined regions of interest to be defined on a master image is disclosed below.
  • This analysis software automates the calculation and display of acetowhitening characteristics from a motion corrected time-sequence of patient images. This improves the ability to correlate instrument measurements to the pathological evaluation of biopsied tissue.
  • an automated system when using an amplifying agent such as acetic acid, delivers the amplifying agent to the target tissue.
  • a triggering mechanism applies the chemical reproducibly and eliminates variability of time delays between the application and the start of obtaining optical responses from the target tissue.
  • FIG. 18A shows an illustrative embodiment of a system with a screening probe 2000 similar in construction to the probe shown in FIG. 11.
  • This apparatus and the associated techniques are used to improve the demarcation of a start time and to guarantee the application of a constant volume of acetic acid.
  • Another embodiment is a mucosal atomizer device comprising a 3 cc syringe and 6′′ stylet tubing extension nozzle is used to spray 2 cc of 5% acetic acid uniformly onto the surface of the cervix.
  • the distal part 2013 of the probe 2000 is covered with a composite disposable sheath 2011 having attached at its own distal periphery a hollow toroidal structure 2014 .
  • the hollow toroidal structure 2014 contains the chemical agent or amplifying agent, for example, acetic acid at a 3% to 5% concentration.
  • a retractor 2012 compresses the toroidal structure 2014 when the operator is ready to apply the amplifying agent to the target tissue.
  • the retractor 2012 is retracted using a trigger like mechanism 2015 the toroidal structure 2014 is compressed and its content is sprayed onto the tissue.
  • the probe is signaled to start taking measurements, by the actuation of a switch 2016 in the handle of the probe.
  • the chemical or amplifying agent is sprayed through a plurality of perforations 2017 as shown in FIG. 18B, a top view of the distal end of the assembled sheath/retractor assembly.
  • a covering such as an adhesive tape may be attached to the distal end 2013 , covering the toroidal structure 2014 .
  • the covering may be removed after mounting the sheath on the probe and just prior to the insertion of the probe into a target area such as the vagina.
  • FIG. 18A depicts a cylindrical structure, it should be apparent to those of ordinary skill in the art that a conical structure can be utilized to improve packaging and nesting of multiple disposable sheaths, and furthermore, that any other structure may be constructed which is adapted for the functions depicted in FIG. 18A and which is further adapted for the anatomic region in which it will be used.
  • the retractor 2012 is designed to leave an optical window 2018 for the reception of responses from the illuminated tissue. Illumination is achieved through circumferentially distributed optical fibers, as previously described in FIG. 11, and the light is transmitted through a transparent part of the peripheral distal end of the retractor 2012 .
  • the toroidal container 2014 for the amplifying agent is affixed to the sheath 2011 , as shown in FIG. 18C, which shows a cross sectional view of the distal end of the sheath/retractor assembly.
  • the toroidal container 2014 is directly attached to the sheath (as shown at 2019 ) or it is affixed in any other suitable way.
  • the amplifying agent container is constructed as a side mounted syringe having a plunger that causes discharge of the amplifying agent in a spray form, while providing simultaneously a signal to the probe that amplifying agent is applied, and thus providing a starting point for the temporal measurements of reflections from the target tissue.
  • the trigger actuates a timer within the probe controller that sets up a predetermined time interval for the first measurement (typically within 1 second of amplifying agent application).
  • a timer within the probe controller that sets up a predetermined time interval for the first measurement (typically within 1 second of amplifying agent application).
  • an image of the cervix is taken prior to the application and recorded with the frame grabber in the data processing unit 1704 .
  • the trigger 2016 signals the probe to start taking responses, the responses are taken and normalized (pixel by pixel) and one of the algorithms described above analyzes the data.
  • the data are presented as either a “positive” or “negative” finding for the whole cervix, or alternatively, an artificial image of the pathology is presented for those pixels where the algorithms returned positive findings. This image is superimposed on a visual image of the cervix and recorded to allow post screening accurate location of tissue requiring subsequent biopsy.
  • spatial data are averaged over groups of neighboring pixels (between 2 ⁇ 2 to 6 ⁇ 6), and these averages (both for the standardizing measurement, or normalizing measurement) are used as normalized intensities.
  • Other methods for averaging or normalizing spatial data can be used. Different methods of normalizing can be related to the resolution of the CCD used in that specific interest.
  • a plurality of chemical agents are applied to a specimen, either simultaneously or sequentially.
  • the use of multiple chemical agents causes any of a number of different effects.
  • One chemical agent is used to control or change pH (e.g., hydrogen ion concentration), change the concentration of one or more other ionic species, or change an osmotic pressure, while another chemical agent is used to induce another sort of change, for example, staining a material, activating or passivating a material, or otherwise changing a physical property of a material.
  • an exogenous contrast agent when combined with the activation of an endogenous contrast agent gives rise to a combined contrast that provides more valuable information than either agent alone.
  • application of acetic acid to epithelial tissue results in time-dependent effects in the fluorescence emission spectrum resulting from activation of endogenous native fluorophores in tissue, such as NADH, collagen, elastin, favins (e.g., FAD) or porphyrins.
  • This effect arises from at least two different sources.
  • One source is the penetration of the acetic acid into the tissue followed by the resulting pH change on the spectral properties of the endogenous fluorophore.
  • the effect of pH is shown for NADH in FIG. 19.
  • FIG. 19 shows four absorption spectra recorded over the wavelength range of about 320 nm to aboout 600 nm. The absorbance is plotted along the vertical axis 2102 and the wavelength in nm is plotted along the horizontal axis 2104 .
  • a baseline spectrum 2110 is taken for a 5% acetic acid solution containing no NADH, and shows little absorption.
  • the spectrum 2120 is taken at pH 4.0 and shows two strong absorption peaks at approximately 350 nm and at approximately 430 nm.
  • the spectrum 2130 is taken at pH 5.0 and shows a strong absorption peak at approximately 350 nm and a much weaker absorption peak at approximately 430 nm as compared to the pH 4.0 spectrum.
  • the spectrum 2140 is taken at pH 7.0 and shows a strong absorption peak at approximately 350 nm and virtually no absorption peak at approximately 430 nm as compared to the pH 4.0 spectrum.
  • the spectral properties of NADH absorption are significantly affected by pH. Since absorption is the first step in fluorescence, it is reasonable to expect that pH will affect the emitted fluorescence as well.
  • Acetic acid penetrates into different types of tissues and cells at different rates depending on the type of tissue present.
  • the amount of NADH in cells typically differs according to the type of cell and its metabolic state. Consequently the kinetics of this pH response can be indicative of the tissue or cell type and its metabolic condition.
  • Acetic acid causes acetowhitening when applied to certain tissues, such as epithelial surfaces.
  • the acetowhitening effect is produced by light scattering changes. These changes have further secondary effects on spectral measurements, such as induced fluorescence. Changes in the induced fluorescence result from either of two sources. One source is the direct effect of acetowhitening on the penetration of the UV excitation light. A second effect results from the light scattering on the observed spectral shape of the emitted fluorescence. Since the acetowhitening is time dependent, these secondary effects are time dependent as well.
  • FIG. 20 shows a graph 2200 of spectra measured as a function of time after application of acetic acid. The spectral intensity is plotted along the vertical axis 2202 and the wavelength in nm is plotted along the horizontal axis 2204 .
  • Curve 2210 is recorded at the time of application of the acetic acid solution.
  • Curve 2220 is measured 0.5 minutes after acetic acid application.
  • Curves 2230 , 2240 , 2250 and 2260 are recorded 1, 2, 3, and 7 minutes after acetic acid application, respectively.
  • the fluorescence spectrum originally observed at the time of acetic acid application quickly decreases in intensity, and recovers slowly thereafter.
  • FIG. 21 is a graph 2300 that shows the changes in fluorescence spectra before (curve 2310 ) and after (curve 2320 ) application of acetic acid to cervical tissue.
  • the spectral intensity is plotted along the vertical axis 2302 and the wavelength in nm is plotted along the horizontal axis 2304 . Note that the fluorescent intensity at some wavelengths below about 450 nm changes more substantially than the intensity at wavelengths above about 450 nm. Since the time-course of those changes is related to the type of tissue being probed (as described above) these spectral differences can differentiate the type of tissue under study.
  • Relative motion between the patient and the colposcope can cause problems with registration of the different images for that patient during analysis.
  • a robust motion detection and correction technique is disclosed below. This technique uses the cross-correlation of two successive images to determine global motion. The cross-correlation is computed in the Fourier domain using a fast Fourier transform.
  • the image registration technique is used after the specimen data is collected.
  • systems according to the invention incorporate the technique on-line, as it does not require excessive processing overhead.
  • Image processing is used to extract relevant features from the data observed and recorded using the systems and methods of the invention.
  • Image processing techniques that can be applied include, but are not limited to, color space transformations, filtering, artifact detection and removal, image enhancement, extraction of three-dimensional shape information, manipulations using mathematical morphology, and segmentation.
  • a color space transfromation is intended to transform the three primary colors, red (R), blue (B), and green (G), into a new set of colors or values using a kinear or non-linear transformation.
  • a number of well-known transformations interconvert R,G,B and luminance/chrominance components, for example, as used in converting light recorded in a camera into broadcast signals, and rendering broadcast signals on a television display.
  • Filtering is useful in image processing, and is used to suppress noise and unwanted interfereing signals.
  • Many filters and filtering processes are known. Filters can include both hardware filters such as optical filters and electronic filters, as well as filters applied in software, such as digital filters.
  • the median filter replaces every pixel of an image with the median value computed in a given neighborhood of the pixel.
  • Artifact detection and removal is used to eliminate spurious information from a set of data to be analyzed.
  • Some artifacts such as portions of an optical field of view that are extraneous, may be eliminated by changing the height and or width of the field of view, or by masking portions of the field of view, for example when a physician observes that the field of view includes material that is not of interest.
  • Image enhancement can include processing to improve the visual contrast between adjacent portions of an image.
  • a number of known techniques are available, including applying a weighting function to a range of intensities or gray scale values.
  • Extraction of three-dimensional shape information is useful in representing a surface that is non-planar in two-dimensions.
  • An example is computing the three-dimensional features of the cervix to account for the nonuniformities of illuminating a three-dimensional surface.
  • Morphological operators are based on the mathematics of set theory.
  • a set in mathematical morphology represents the shape of an object in an image.
  • the sets are members of Z 2 and each element represents the (x,y) coordinates of a black (or white, depending on the convention) pixel in the image.
  • Gray-scale, color, time-varying components, or any vector-valued information can be included by extending the Euclidean space size.
  • Gray-scale dilation is defined as:
  • b Z 2 ⁇ R is a function called a structuring element
  • D f is the domain of f
  • D 6 is the domain of b.
  • the structuring element has a key role in this operator: it is added morphologically to the image at each pixel location.
  • the opposite of dilation is erosion.
  • the erosion operator is defined as:
  • the structuring element is subtracted morphologically from the image at each pixel location.
  • the effect of opening is to preserve holes and remove peaks, while closing preserves peaks and closes holes according to the structuring element's shape.
  • the structuring element b is fitted from inside (below an image) in the opening case and fitted from outside (above an image) in the closing case.
  • a morphological filter can be defined as any combination of morphological operators. For example (f ⁇ b)•b, opening followed by closing, or (f•b) ⁇ b, closing followed by opening. These operators are neither commutative, nor associative or distributive and the filtering operators cited above are not equal.
  • f_b 1 2 ⁇ [ ( f ⁇ b ) + ( f ⁇ b ) ]
  • f_b 1 2 ⁇ [ ( f ⁇ b ) + ( f ⁇ b ) ]
  • f_b 1 2 ⁇ [ ( f ⁇ b ) ⁇ b + ( f ⁇ b ) ⁇ b ]
  • a more elegant way to achieve a morphological filtering with better geometrical characteristics is to use geodesic reconstruction after a morphological opening.
  • the reconstruction process uses geodesic dilation which for gray-scale images is defined by:
  • Geodesic reconstruction is obtained by repeating the geodesic dilation n times ((f ⁇ b) (n) ) until idempotency is reached. The geodesic reconstruction is then written:
  • An equivalent operator can be defined for reconstruction after morphological closing which uses geodesic erosion.
  • gray-scale images it is defined as:
  • Heat transfer involves a thermal flux q.
  • the whole system must obey the law of energy conservation.
  • the parameter p is the density of the medium
  • k is the thermal conductivity
  • c is the specific heat capacity
  • f the capacity of internal heat sources.
  • D is a tensor whose elements are functions g ij ( ⁇ ) then the diffusion is anisotropic.
  • Histogram equalization re-assigns pixel values in order to obtain a uniform distribution.
  • v(x) be the pixel value at location x
  • P(v) be the probability density function associated to v. The following transformation is used:
  • n is the total number of pixels and n j the number of pixels with value equal to j.
  • the fitting technique used is called linear least squares.
  • N 2 in the case of images
  • ⁇ i is the measurement variance at location x i .
  • set ⁇ i ⁇ 1, ⁇ i 1, . . . , n ⁇ 1.
  • Segmentation is a morphological technique that splits an image into different regions according to a pre-defined criterion. In the analysis of the state of health of a biological specimen, it is meaningful to compare the proprties of different areas of the specimen. Segmentation is a method that directly provides information on how many regions are present in the image of a specimen, and the location of each region.
  • colposcopic images are segmented to track regions in a time series of images. Relevant features are extracted from the labeled regions and their evolution is analyzed as a function of time, to measure and localize acetowhitening effects. Colposcopic images are segmented using a watershed based algorithm. An efficient pre-processing scheme is used, as are two region merging techniques. The use of markers to track the segmentation in time-series of images is used, and the problem of global motion and local deformations related to the precise tracking of these markers is discussed.
  • a segmentation scheme for colposcopic images separates the image of the cervix into a number of regions according to an intensity criterion. Segmentation techniques are well known in the mathematical morphology arts.
  • the object e.g., the cervix
  • multiple regions with different intensity content within the cervix are to be identified.
  • a technique based on the structural and spatial information rather than on the spectral information is suited to analyze colposcopic images.
  • One approach uses the watershed technique.
  • the watershed technique uses structural information.
  • the watershed technique provides a fine to coarse segmentation of an image in combination with region merging techniques.
  • the flooding technique views a gray-level image as a 3-dimensional surface and progressively floods this surface from below. Each local minimum in the surface is thought of as a hole.
  • a rising water level floods a region as soon as a hypothetical water level reaches the associated minimum.
  • FIG. 22 illustrates this concept on a 1-D signal.
  • the arrows 2402 a - 2402 d show the flooding origins and directions and the solid lines 2406 a - 2406 d are the watersheds.
  • the flooded minima are called catchment basins and the borders between neighboring basins are called watersheds. Only the catchment basins are of interest. They constitute the segmented image.
  • Fast implementations use first-in-first-out (FIFO) queues and sorted data.
  • FIG. 23 is a graph 2500 of a signal 2510 and its first derivative 2520 , both plotted with amplitude as a vertical axis 2502 and position as a horizontal axis 2504 .
  • FIG. 23 shows a signal 2510 used to represent watersheds with three distinct regions (hole 2512 , plateau 2514 , and peak 2516 ) and its derivative function 2520 , or gradient. Image segmentation with the watershed transform is performed on the image gradient 2520 .
  • the signal shows three distinct regions, and the direct watershed transform would produce a one lowest region.
  • the gradient 2520 separates the signal into its three regions.
  • An analogous principle holds for two-dimensional signals, i.e. images.
  • FIG. 24 shows a graph 2600 of a sigmoidal scaling function 2610 used to enhance the contrast between light and dark regions of an image.
  • the sigmoidal scaling function 2610 is plotted as output along a vertical axis 2602 as a function of an input that is indiated along a horizontal axis 2604 .
  • the use of the watershed transform often leads to a severe over- segmentation.
  • Pre-processing is performed to reduce the number of regions in a segmented image. In one embodiment, a pre-processing scheme reduces the number of regions from several thousand to several hundreds:
  • An algorithm that treats images to provide a segmented image includes the following steps:
  • the uniform luminance component L* is well adapted to the segmentation process, and is computed for an image of interest.
  • 3-D shape compensation removes an artifact (e.g., a stair-case effect) in the segmented image.
  • the illumination is non-uniform when falling on a curved surface (e.g., the cervix), which in turn influences the gradient values used for the segmentation.
  • FIG. 24 is a graph of a scaled sigmoid, used in this study.
  • the sigmoid increases contrast in the median intensity range by providing a larger number of quantification levels.
  • Applying a sigmoidal scaling function causes dark and very light areas to exhibit diminished contract, while the limit between light and dark regions is enhanced.
  • Closing and opening morphological operators are used to suppress small regions corresponding to holes or peaks in the images.
  • the geodesic reconstruction keeps the geometrical aspect of the image as close as possible to that of the original image.
  • a morphological closing with geodesic reconstruction is performed on the gradient of the filtered image to remove plateaus, which are visualized as separate regions in the watershed transform.
  • the diameter of the cylinder used as structuring element defines the minimum size of the regions in the segmented image.
  • Finite-element approximations are used to compute derivatives.
  • Alternative approaches involve using a Sobel operator, which is a 3 ⁇ 3filter.
  • Another alternative is the use of a local cubic polynomial approximation, which is a 5 ⁇ 5 filter.
  • application of a threshold removes small values.
  • the gradient is computed using cubic mean-square approximation.
  • a morphological closing/opening filter with geodesic reconstruction is first applied and then the gradient is computed. Spurious regions are smoothed out and contrast enhanced in large regions by both methods.
  • the watershed algorithm is modified as follows.
  • the data is represented in floating point, and the interval steps between successive flooded levels is not uniform.
  • each watershed pixel is merged into a neighboring region according to a nearest neighbor criterion.
  • the region merging step following the watershed transform step reduces over-segmentation.
  • neighboring regions are merged if an intensity change along their border is greater than a given threshold.
  • neighboring regions are merged if a difference in mean intensity value is greater than a given threshold.
  • a map of all border pixels is used. For each segment, a computer computes the difference between the mean value of pixels of each of the two regions under consideration. If the absolute value is below a given value, the segment is removed from the mask, and the regions are merged. The final mask is used to map out the gradient image. The watersheds are recomputed.
  • An alternative merging algorithm uses the same routines.
  • the alternative algorithm uses the mean value image as input in place of the original image. Since all pixels in a region have the same (mean) value, the algorithm works differently, in that border segments are suppressed if the difference in mean value between neighboring regions is smaller than a given threshold.
  • a morphological distance is an approximation of the distance, in pixels, from a pixel to the nearest segment border.
  • a method to use markers to track the segmentation in time series of images is now presented. The extraction of markers is necessary in order to initialize the flooding process in the watershed transform computed in successive images (e.g., in time-series).
  • the approach used comprises the steps of finding pixels having minimum value for each region, and selecting the minimum with the largest morphological distance for each region.
  • the first step selects the minimum value as an initial marker, since the flooding used in the watersheds start at local minima.
  • the pixel with minimum value and largest morphological distance is used to avoid a small deformation of a region pushing a marker outside of the region.
  • a homotopy modification of the gradient image obtained with the markers is used to suppress catchment basins corresponding to minima that have not been marked, in order to speed up the computation.
  • the homotopy modification of ⁇ is the geodesic reconstruction of ⁇ (mask) from ⁇ acute over ( ⁇ ) ⁇ (marker).
  • ⁇ ⁇ ⁇ ( ⁇ , i ) ( ⁇ ⁇ ( ⁇ , i ) if ⁇ ⁇ ( ⁇ , i ) ⁇ M max ⁇ ⁇ y ⁇ ⁇ ⁇ ⁇ ( ⁇ , i ) o ⁇ ⁇ t ⁇ ⁇ h ⁇ ⁇ e ⁇ ⁇ r ⁇ ⁇ w ⁇ ⁇ i ⁇ ⁇ s ⁇ ⁇ e .
  • more than one marker per region is considered. Pixels having a morphological distance greater than a given value (typically 2-3) or being at least equal to the largest morphological distance within a given region are considered. These markers are used to zero out gradient values in the following image, in order to reduce influence of local maxima on the homotopy modification. It is assumed that the borders between neighboring regions are located somewhere between the marked regions.
  • markers are used to initialize the watershed algorithm with the gradient image of the next image. Tracking schemes are employed to take into account global and local motion.
  • One illustrative tracking scheme for the detection of patient motion during an acquisition cycle uses the cross-correlation of two sub-images of two successive images to determine the global motion.
  • An alternative algorithm is used to track motion for segmentation tasks.
  • the embodiment further comprises three modifications.
  • the true cross-correlation of successive images is computed in a 512 ⁇ 512 pixels window.
  • the two windows used for each image are different and are of sizes 302 ⁇ 302 and 210 ⁇ 210, respectively.
  • a Hamming window is used to extract these two signals.
  • the two windows have different sizes to make sure that the second signal is completely contained in the first one, and the use of a Hamming window avoids small oscillations, especially at the transition of the selected signals and the zero-padded areas.
  • the equations used for the motion detection are given below.
  • Optical flow algorithms are used to measure local motions. In order to save computation time, the optical flow is computed only for the markers. Optical flow is defined as the distribution of apparent velocities of movement of brightness patterns in an image, and is used to reconstruct three-dimensional surfaces in medical imaging applications.
  • Additional embodiments of motion detection algorithms include the following steps: implementation of a local deformation tracking system for improving the precision of marker tracking; extraction of feature signals from the series of segmentation results; analysis of feature signals and classification into groups of interest; and use of group information to correlate the evolution with the histology.
  • Motion can be detected using a cross-correlation operator applied to two successive images in a sequence.
  • ⁇ , X, and Y are the Fourier transform of the cross-correlation function, the first, and the second signal, respectively.
  • the * symbol represents the complex conjugate. Note that the cross-correlation of two signals of length N 1 and N 2 provides N 1 +N 2 ⁇ 1 values and therefore, in order to avoid aliasing problems due to under-sampling, the two signals must be padded with zeros up to N 1 +N 2 ⁇ 1 samples.
  • This transform expands the signal onto an orthonormal basis of exponential functions. Once the inverse discrete transform is computed, the location of the maximum value corresponds to the translation necessary to align both images.
  • N is the number of samples
  • k is the sample index
  • the Fourier transform of the signal is convolved with the Fourier transform of the Hamming window.
  • the cross-correlation of the sum-of-derivatives images is the basis of a motion detection algorithm.
  • the second filter in Equation 2 is a low-pass filter in the direction perpendicular to the derivative operator, which renders the filter less sensitive to noise.
  • the derivative along the y-axis is obtained by using the transposed version of the Sobel operator.
  • (k,l) are the coordinates in the local 5 ⁇ 5 domain centered on the current pixel.
  • the b i coefficients are the optimal weights in the MSE sense and the ⁇ i are orthogonal polynomials (1, k, l, k 2 ⁇ 2/3, l 2 ⁇ 2/3, kl, (k 2 ⁇ 2/3)l, (l 2 ⁇ 2/3)k, (k 2 ⁇ 2/3)(l 2 ⁇ 2/3)).
  • each image is divided into an 8 ⁇ 8 array of blocks of size 32 ⁇ 32.
  • the array is chosen to avoid the image borders.
  • the borders can contain extraneous material, that is, not part of the cervix. In normal use, the physician attempts to keep the cervix in the middle of the image.
  • B ij ⁇ N 2 is the domain of definition of block (i,j), and I 1,2 are the two processed images.
  • the absolute value of P i,j is used as a quality measure.
  • the method is used for series of 28 images and the motion is estimated for each of them, except for the first one. Once the motion parameters are determined, the frame is shifted to its computed “correct” location and the above block-based correlation is computed with the previous shifted image. The result obtained when using the intensity values for each image is plotted with the x-axis corresponding to the different blocks while the y-axis corresponds to the different images. For the example presented above, the shifted images match perfectly and the output is zero intensity everywhere.

Abstract

The invention provides methods and systems for monitoring effects of chemical agents on optical signals produced by samples in response to the chemical agents. Preferred methods comprise application of multiple chemical agents that interact to alter an optical signal from the sample. Methods and systems of the invention also comprise monitoring an optical signal from an endogenous chromophore upon application of a chemical agent to a sample. Methods and systems of the invention also comprise the use of triggers, atomizers and image alignment to enhance the results of methods described herein.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application claims priority to and the benefit of U.S. provisional patent application Serial No. 60/170,972, filed Dec. 15, 1999, the disclosure of which application is hereby incorporated by reference.[0001]
  • FIELD OF THE INVENTION
  • This invention relates generally to spectral analysis. More particularly, in one embodiment, the invention relates to determining chemically-induced changes of optical spectra. [0002]
  • BACKGROUND OF THE INVENTION
  • Direct visual observation alone is often inadequate for identification of abnormalities in a specimen being examined, whether the specimen is a biological specimen or otherwise. Observation of many medical conditions in biological specimens of all kinds is well known. It is common in medical examination to perform visual examinations in disease diagnosis. For example, visual examination of the cervix can discern areas where there is a “suspicion” of pathology. In some instances, filters can be used to improve visual differentiation of normal and abnormal tissues. In other situations, when tissues of the cervix are examined in vivo, chemical agents such as acetic acid can be applied to enhance the differences in appearance between normal and pathological areas. These techniques form an integral part of a colposcopic examination of the cervix. Colposcopists may amplify the difference between normal and cancerous tissue with the application of various “activation” agents, the most common being acetic acid, at approximately 3% to 5% concentration, or an iodine solution, such as Lugol's iodine or Shiller's iodine. Even when the cervical tissues are viewed through a colposcope by an experienced practitioner with the application of acetic acid, correct diagnosis can be affected by subjective analysis. A variety of methods using optical techniques have been directed towards the diagnosis of cancer and other pathologies, particularly involving the cervix. Certain of these systems and methods have limitations that render them unsuitable for use as screening procedures. [0003]
  • While there have been extensive developments in the field of cancer diagnosis, none of these are well adapted for screening large populations. Currently, disease diagnoses are made predominately from pathological examinations of biopsied tissue. Techniques such as biopsies, while being the definitive determination of the presence of disease, are labor-intensive and operator-dependent, thus unsuitable for screening large populations. As another example, medical imaging techniques, depending on their cost, resource requirements and patient accessibility, may be unsuitable for population screening. [0004]
  • To be well accepted in the medical community, a screening method should be sufficiently sensitive and specific to identify abnormalities accurately. Furthermore, a screening method ideally is easy to perform so that it can be carried out rapidly on an otherwise healthy patient. In addition, to be cost effective the screening method should not require the use of expensive resources, including a significant time commitment from costly, highly trained medical personnel. Generally, screening settings advantageously employ less skilled operators and more operator-independent technology. [0005]
  • SUMMARY OF THE INVENTION
  • The invention provides systems and methods for quickly and efficiently screening samples, especially biological samples. According to the invention, changes in the spectral properties of tissues upon exposure to chemical agents are characteristic of the physiological state of the tissue. In particular, the invention relates to changes in spectral properties of a sample in response to chemical treatment. The sample can be a sample of tissue, and the response can be indicative of a state of health of the tissue or the patient from whom the sample is obtained. Upon exposure to chemical agents, the light emission properties of a sample change. In the case of a sample of tissue, the temporal evolution of these changes is characteristic of the state of health of the tissue generally. When exposed to light, tissues emit light having spectral properties that are characteristic of the physiological and biochemical make-up of the tissue. When exposed to a chemical agent, such as a contrast agent, the spectral properties of the tissue are changed by the interaction of the agent with endogenous molecules in the tissue. As the chemical agent diffuses out of the area of application, or otherwise becomes less abundant in the tissue, the emission spectrum of the tissue returns to pre-exposure levels. According to the invention, changes in tissue produced by endogenous chemical agents provide insight into the sample, such as the clinical health of the tissue as described in detail below. The invention also involves systems and methods of performing the application of one or more chemical agents, including the amount of material dispensed, dispensing patterns, and triggering a measurement relative to the time of dispensing. [0006]
  • Accordingly, the invention provides methods and systems for monitoring effects of chemical agents on a sample by exposing a sample to one or more chemical agents, and measuring a change in an optical signal from the sample. A preferred method of the invention comprises dispensing a plurality of chemical agents on a sample, wherein the agents interact to alter an optical signal from the sample and measuring the chemical agents are selected from the group consisting of acetic acid, formic acid, propionic acid, butyric acid, Lugol's iodine, Shiller's iodine, methylene blue, toluidine blue, osmotic agents, ionic agents, and indigo carmine. The chemical agents may be applied substantially simultaneously, or by dispensing at least two of the plurality of chemical agents sequentially. [0007]
  • The invention is applicable to any sample type. Preferred methods of the invention comprise using a biological sample. In a preferred embodiment, the sample is selected from epithelial tissue, cervical tissue, colorectal tissue, skin, and uterine tissue. [0008]
  • In another aspect, a preferred embodiment of the invention relates to a method of monitoring effects of a chemical agent on a sample comprising dispensing a chemical agent on a sample, providing an automated triggering signal to initiate a measurement period relative to the dispensing, and measuring an optical signal from the sample. The automated triggering signal can be provided prior to, substantially simultaneously with, or after dispensing the chemical agent. In preferred embodiments, the measurement is initiated at a predetermined time relative to the automatic triggering signal. In yet another aspect, methods of the invention comprise of diagnosing the state of health of a applying the chemical agent or agents as a mist onto the sample. [0009]
  • In a preferred embodiment, the predefined pattern is substantially circular. In another preferred embodiment, the predefined pattern is substantially annular. [0010]
  • In preferred embodiments, the chemical agent is dispensed at a controlled rate, or a controlled volume of the chemical agent is dispensed, or both. [0011]
  • In a still further aspect, the invention comprises dispensing a chemical agent on a sample, capturing a plurality of sequential images of the sample during a measurement period, automatically aligning a subset of the plurality of images to spatially correlate the subset of images, measuring an optical signal from the subset of the spatially correlated images, and providing a diagnosis of a state of health of the sample based at least in part on the optical signal. [0012]
  • In a preferred embodiment, aligning further comprises aligning the subset to compensate for relative motion between the sample and a spectral observation device. In another preferred embodiment, aligning further comprises aligning the subset to compensate for relative motion between a first portion of the sample and a second portion of the sample. [0013]
  • In a still further aspect, the invention provides methods for determining a tissue response in which a chemical agent is applied to a tissue and an optical property of an endogenous molecule in the tissue is measured. In a preferred embodiment, the endogenous molecule is a chromophore, for example a fluorophore. Method of the invention comprise applying the chemical agent and monitoring an optical signal from the endogenous molecule. The presence, absence, or change in the signal may be indicative of disease when compared to known standards. Such standards may be empirically derived or may be obtained from the art. The endogenous chromophore is preferably hemoglobin, a porphoryin, NADH, a flavin, elastin, or collagen. [0014]
  • In preferred methods, the optical signal is a light signal, such as a fluorescent or white light spectrum. The optical signal may also be a spectrum produced, at least in part by light-scattering properties of the tissue. [0015]
  • Also in preferred methods, the optical signal may be a decay function. The optical signal is compared to a standard response associated with healthy or diseased tissue, including tissue at various stages of disease. Such standards may be determined empirically or known in the art. Alteration of an optical signa alone may be indicative of the health of the patient from whom a sample was obtained. [0016]
  • The foregoing and other objects, aspects, features, and advantages of the invention will become more apparent from the following description and from the claims.[0017]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The objects and features of the invention can be better understood with reference to the drawings described below, and the claims. The drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention. In the drawings, like numerals are used to indicate like parts throughout the various views. [0018]
  • FIG. 1 shows an exemplary spectroscopic system that employs a plurality of spectral types according to an illustrative embodiment of the invention; [0019]
  • FIG. 2 shows an exemplary operational block diagram of the spectroscopic system of FIG. 1; [0020]
  • FIG. 3 is a detailed schematic flow diagram showing exemplary steps of combining a fluorescence spectrum analysis with a reflectance spectrum analysis according to an illustrative embodiment of the invention; [0021]
  • FIG. 4 is a schematic diagram of another illustrative system useful for monitoring the effects of a chemical agent on a specimen, and which embodies principles of the invention; [0022]
  • FIG. 5 is a graph that shows trend lines of data observed according to principles of the invention; [0023]
  • FIGS. [0024] 6A-6C are diagrams that show raw data observed from various specimens, according to principles of the invention;.
  • FIG. 7 is a graph showing curves representing averages of data processed according to principles of the invention; [0025]
  • FIG. 8 is a graph plotting computed ratios that show a basis for differentiating CIN II/III lesionf from CIN I and normal tissue for individual specimens, according to principles of the invention; [0026]
  • FIG. 9 is a graph showing responses, normalized at 480 nm, from tissues as function of wavelength, according to principles of the invention; [0027]
  • FIG. 10 is a functional block diagram of an embodiment of a another illustrative system useful for monitoring the effects of a chemical agent on a specimen according to the invention; [0028]
  • FIG. 11 is a functional block diagram of an embodiment of an illustrative hand-held system useful for monitoring the effects of a chemical agent on a specimen according to the invention; [0029]
  • FIGS. [0030] 12A-12C depict schematic arrangements for illustrative filter wheels useful in the system of FIG. 11;
  • FIG. 13 is a functional block diagram of an embodiment of a system useful for monitoring the effects of a chemical agent on a specimen according to the invention; [0031]
  • FIG. 14 is a schematic diagram of a filter wheel useful in the system of FIG. 13; [0032]
  • FIG. 15 is a functional block diagram of an embodiment of a system useful for monitoring the effects of a chemical agent on a specimen according to the invention; [0033]
  • FIG. 16 shows a schematic diagram of a CCD device for use in the system of FIG. 15; [0034]
  • FIG. 17 is a graph showing the time dependence of backscattered responses at 600 nm for various tissue classes (NED, CIN II and CIN III), recorded using systems and methods of the invention; [0035]
  • FIGS. [0036] 18A-18C are diagrams depicting various aspects of a mucosal atomizer device used to spray a chemical agent uniformly onto the surface of a specimen, and to provide a trigger mechanism useful for initiating an optical observation, according to principles of the invention;
  • FIG. 19 is a graph of absorption spectra recorded for NADH using a chemical agent according to the invention; [0037]
  • FIG. 20 is a graph of fluorescence spectra as a function of time for specimens treated with a chemical agent according to principles of the invention; [0038]
  • FIG. 21 is a graph of flourescence spectra recorded before and after treatment of a specimen with a chemical agent, according to principles of the invention; [0039]
  • FIG. 22 is a one-dimensional diagram of watershed segmentation; [0040]
  • FIG. 23 is a graph of a signal and its first derivative; and [0041]
  • FIG. 24 shows a sigmoidal scaling function used to enhance the contrast between light and dark regions of an image.[0042]
  • DETAILED DESCRIPTION
  • Acetowhitening of cervical tissue has long been known to be a qualitative aid to locating lesions during colposcopic examination. However, accurate quantitative measurements of acetowhitening of cervical epithelial tissue, as a function of time and wavelength, have not been reported. Quantitative analysis of the acetowhitening process can significantly increase the sensitivity and specificity of traditional colposcopy. [0043]
  • The invention will be described in terms of multiple embodiments that relate to the observation of chemically-induced changes in optical spectra, particularly in the area of medical diagnostics, and especially as it relates to the analysis of spectra obtained from human cervical tissue in the detection of cervical cancer. However, the invention has applicability generally in the area of chemically-induced changes in optical spectra. [0044]
  • FIG. 1 depicts an [0045] exemplary spectroscopic system 100 employing a plurality of spectral data types in methods and systems according to an illustrative embodiment of the invention. The spectroscopic system includes a console 102 connected to a probe 104 by a cable 106. The cable 106 carries electrical and optical signals between the console 102 and the probe 104. The probe 104 accommodates a disposable component 108 which is used only once, and discarded after use. The console 102 and the probe 104 are mechanically connected by an articulating arm 110, which can also support the cable 106. The console 102 contains much of the hardware and the software of the system, and the probe 104 contains the necessary hardware for making suitable spectroscopic observations. The details of the system are further explained in conjunction with FIG. 2.
  • FIG. 2 shows an exemplary operational block diagram [0046] 200 of a spectroscopic system of the type depicted in FIG. 1. According to an illustrative embodiment, the spectroscopic system of FIGS. 1 and 2 is subtantially the same as single-beam spectrometer devices, but is adapted to include the features of the invention. The console 102 includes a computer 202 which executes software that controls the operation of the spectroscopic system 100. The software includes one or more modules recorded on machine-readable media, which can be any medium such as magnetic disks, magnetic tape, CD-ROM, semiconductor memory, or the like. Preferably, the machine-readable medium is resident within the computer 202. In alternative embodiments, the machine-readable medium can be connected to the computer 202 by a communication link. In alternative embodiments, one can substitute computer insructions in the form of hardwired logic for software, or one can substitute firmware (i.e., computer instructions recorded on devices such as PROMs, EPROMS oe EEPROMs, or the like) for software. The term machine-readable instructions as used herein is intended to encompass software, hardwired logic, firmware and the like.
  • The [0047] computer 202 is a general purpose computer. The computer 202 can be an embedded computer, or a personal computer such as a laptop or desktop computer, that is capable of running the software, issuing suitable control commands, and recording information in real time. The computer 202 has a display 204 for reporting information to an operator of the spectroscopic system 100, a keyboard 206 for enabling the operator to enter information and commands, and a printer 208 for providing a print-out, or permanent record, of measurements made by the spectroscopic system 100 and for printing diagnostic results, for example, for inclusion in the chart of a patient. As described below in more detail, in an illustrative embodiment of the invention, some commands entered at the keyboard, enable a user to select a particular spectrum for analysis or to reject a spectrum, and to select particular segments of a spectrum for normalization. Other commands enable a user to select the wavelength range for each particular segment and to specify both wavelength contiguous and non-contiguous segments.
  • The [0048] console 102 also includes an ultraviolet (UV) source 210 such as a nitrogen laser or a frequency-tripled Nd:YAG laser, a white light source 212 such as one or more Xenon flash lamps, and control electronics 214 for controlling the light sources both as to intensity and as to the time of onset of operation and the duration of operation. One or more power supplies 216 are included in the console 102, to provide regulated power for the operation of all of the components. The console 102 also includes at least one spectrometer and at least one detector (spectrometer and detector 218) suitable for use with each of the light sources. In some embodiments, a single spectrometer can operate with both the UV light source and the white light source. In some embodiments, the same detector can record UV and white light signals, and in some embodiments different detectors are used for each light source.
  • The [0049] console 102 also includes coupling optics 220 to couple the UV illumination from the UV light source 210 to one or more optical fibers in the cable 106 for transmission to the probe 104, and for coupling the white light illumination from the white light source 212 to one or more optical fibers in the cable 106 for transmission to the probe 104. The console 102 also includes coupling optics 222 to couple the spectral response of a specimen to UV illumination from the UV light source 210 observed by the probe 104 and carried by one or more optical fibers in the cable 106 for transmission to the spectrometer and detector 218, and for coupling the spectral response of a specimen to the white light illumination from the white light source 212 observed by the probe 104 and carried by one or more optical fibers in the cable 106 for transmission to the spectrometer and detector 218. The console 102 includes a footswitch 224 to enable an operator of the spectroscopic system I 00 to signal when it is appropriate to commence a spectral observation by stepping on the switch. In this manner, the operator has his or her hands free to perform other tasks, for example, aligning the probe 104.
  • The [0050] console 102 includes a calibration port 226 for calibrating the optical components of the spectrometer system. The operator places the probe 104 in registry with the calibration port 226 and issues a command that starts the calibration operation. In the calibration operation, a calibrated light source provides illumination of known intensity as a function of wavelength as a calibration signal. The probe 104 detects the calibration signal. The probe 104 transmits the detected signal through the optical fiber in the cable 106, through the coupling optics 222 to the spectrometer and detector 218. A test spectral result is obtained. A calibration of the spectral system is computed as the ratio of the amplitude of the known illumination at a particular wavelength divided by the test spectral result at the same wavelength.
  • The [0051] probe 104 includes probe optics 230 for illuminating a specimen to be analyzed with UV and white light from the UV source 210 and the white light source 212, and for collecting the fluorescent and backscatter (or reflectance) illumination from the specimen that is being analyzed. The probe includes a scanner assembly 232 that provides illumination from the UV source 210 in a raster pattern over a target area of the specimen of cervical tissue to be analyzed. The probe includes a video camera 234 for observing and recording visual images of the specimen under analysis. The probe 104 includes a targeting souce 236, which can be used to determine where on the surface of the specimen to be analyzed the probe 104 is pointing. The probe 104 also includes a white light illuminator 238 to assist the operator in visualizing the specimen to be analyzed. Once the operator aligns the spectroscopic system and depresses the footswitch 224, the computer 202 controls the actions of the light sources 210, 212, the coupling optics 220, the transmission of light signals and electrical signals through the cable 106, the operation of the probe optics 230 and the scanner assembly 232, the retreival of observed spectra via the cable 106, the coupling of the observed spectra via the coupling optics 222 into the spectrometer and detector 218, the operation of the spectrometer and detector 218, and the subsequent signal procesing and analysis of the recorded spectra.
  • FIG. 3 is a detailed schematic flow diagram [0052] 300 showing exemplary steps of combining fluorescence spectrum analysis with reflectance spectrum analysis to perform tissue characterization according to an illustrative embodiment of the invention. Step 310 indicates that fluorescence spectra from a test specimen of unknown condition or unknown state of health are available. At step 320, the computer 202 determines whether the test specimen can be classified as “normal,” or “metaplasia,” or can not be classified by fluorescence spectroscopy alone. As indicated in step 325, a decision is taken as to whether the test specimen has a definitive state of health, for example that the specimen is “normal.” If the test specimen can be classified, for example as normal, the method ends at step 330.
  • In the event that a definitive condition or state of health cannot be ascribed to a test specimen, the [0053] computer 202 further analyses information available from a reflectance spectrum or from a plurality of reflectance spectra taken from the test specimen. At step 335, the computer 202 provides processed reflectance spectra.
  • If the specimen cannot be classified, a mean normalization step is performed by [0054] computer 202, as indicated at step 340. The mean normalization is carried out using a plurality of reflectance spectra taken from specimens that are known to represent normal squamous tissue. In one embodiment, a single test specimen is examined at multiple locations, each location measuring approximately one millimeter in diameter. If one or more locations of the test specimen provide fluorescence spectra that indicate that those locations can be classified as representing normal squamous tissue, the reflectance spectra recorded from those locations are used to mean normalize the reflectance spectra obtained from locations that are not capable of being classified as “normal” or “metaplasia” solely on the basis of fluorescence spectra.
  • As indicated in [0055] step 350, the computer 202 can carry out an analysis using a metric, for example using the Mahalanobis distance as a metric in N-dimensional space. In one embodiment, the test reflectance spectra are truncated to the wavelength regions 391 nm to 484 nm, and 532 nm to 625 nm. In one embodiment, the classifications CIN I and CIN II/II are the classifications that are possible for a test spectrum that is neither classified as “normal” nor “metaplasia” by fluorescence spectral analysis. As indicated at step 350, the computer 202 classifies the test specimen as having a condition or state of health selected from CIN I and CIN II/III based on the value of the metric computed by the computer 202, provided that the value of the metric does not exceed a pre-determined maximum value.
  • At [0056] step 360, the computer 202 presents the results of the classification of the test specimen, as a condition or state of health corresponding to one of normal, metaplasia, CIN I and CIN II/III.
  • FIG. 4 shows a schematic diagram of an [0057] illustrative system 600 embodying principles of the invention. A standard colposcope 610 (Zeiss, Model 1-FC ZMS-506-II) is modified by adding video image capture capability with permanent and electronic storage of data to allow capturing of time-sequenced images during a routine colposcopic examination. The colposcope 610 has magnification capabilities of 4×, 6×, 10×, 16×, and 25×, and is illuminated by a fiber optic-coupled 12 volt/100 watt halogen lamp 620 with 20× eye binoculars. A three-channel charge-coupled device color video camera (DAGE-MTI, Model DC-330) 630 is mounted to the colposcope 610. The computer 650 includes an integrated video frame-grab board and video display card at 24-bit resolution for capturing images. Images can be captured at a rate of at least about one image per second. The computer 650 also includes image control software (TeleComputing Solutions, ColpoShot™) that interfaces with the video frame grab board for archiving images, for example into patients' medical records. The ColpoShot™ software is modified to allow for intensity measurements at specific sites as a function of time and wavelength (as resolved by four discrete filters in a filter wheel 640, described in more detail below). The computer 650 also includes control software for controlling the change of filters in the high-speed filter wheel 640. This software is synchronized with the data collection (image capture) software so each image is associated with a spectral region corresponding to a particular filter. Time-stamping of each image is performed so each image can be placed in proper time sequence.
  • In the [0058] illustrative system 600, the filter wheel 640 is from a Ludl Electronics Ltd., with an RS 232 and GPIB 488 computer interface for resolving optical signals with respect to wavelength. Images are measured and recorded at three separate wavelength bands in the visible spectral region. The first wavelength band is near 400 nm, with a bandwidth of about 20 nm to about 30 nm. The second wavelength band is near 525 nm with a bandwidth of about 30 nm. The third wavelength band is near 680 nm with a nominal bandwidth of about 30 nm. In addition to the images taken through the filter wheel 640, a fourth image using unfiltered illumination is taken as part of the data set. The unfiltered images allow data analysis of red (R), green (G), and blue (B) components for comparison with filtered image data. As described before, crossed polarizers mounted in the optical path, one associated with the light coming from the illumination source 620, and one associated with the light from the image to be observed and recorded, are used to reduce unwanted glare from the surface of the cervix.
  • The [0059] illustrative system 600 is controlled by the computer 650, having capabilities similar to the computer 140 described earlier. The computer 650 has associated with it software to operate the computer 650, to provide input and output interactions with an instrument user, to control and synchronize the various components of the illustrative system 600, and to record, analyze, and report data obtained from the illustrative system 600.
  • The [0060] illustrative system 600 is configured to capture time-separated images of the specimen during routine colposcopic examinations. Digital images are recorded at a 4 x magnification giving a panoramic view of the entire cervical field at maximal acetic whitening. In the illustrative embodiment, images are taken about every second for about 5 minutes after the application of acetic acid. The computer 650 rotates the filter wheel 640 to allow for imaging at different wavelengths.
  • In operation, an illustrative embodiment of the process of obtaining images is as follows. The first image following the application of the acetic acid is an unfiltered image. Next, the [0061] filter wheel 640 is rotated to bring the short-wavelength (˜400 nm) filter into place and the next image is recorded. Then, the ˜525 nm filter is positioned, and the next image is recorded. Next, the long-wavelength (˜680 nm) filter is positioned and the last image of the sequence is recorded. This process takes four seconds to complete. After this first cycle through the filter wheel 640, the process repeats with another unfiltered image, followed by the sequence of filtered images. The process of observing and recording images continues without stopping for a duration of 300 seconds. The resulting data are seventy-five unfiltered images of the evolution of an optical signal from a specimen treated with a chemical agent, such as cervical acetowhitening, and a total of seventy-five images in each of the three filtered spectral regions. As will be appreciated by those of skill in the spectroscopic arts, the precise sequence of observing and recording images in the various wavelength bands depends on the sequence of placement of filters within the filter wheel 640 and the sense of rotation of the wheel 640. Alternative sequences of observation can be employed with substantially equivalent results. The duration of operation can be shortened or extended from the illustrative 300 seconds just described depending on the situation, which can be influenced by the kind of specimen and how it is to be examined (e.g., specimen characteristics, such as cervix, larynx, skin, and the like, specimen in vivo or in vitro, use of different chemical agents, the disease conditions to be investigated, and the like).
  • Illustratively, time-stamped images are saved to disk at 20 second intervals. In one embodiment, treatment of a specimen with a chemical agent is accomplished as follows. A solution of 5% acetic acid is applied with solution-soaked cotton balls placed in contact with the surface of the cervix for about 15 seconds. An alternative method of application of a chemical agent is discussed below. In one embodiment, the time sequence image capturing software is run immediately before the application of acetic acid, to obtain baseline measurements. [0062]
  • In one embodiment, the parameters that are extracted from the observations include the rate of acetowbitening, the maximum intensity of the whitening, and the final rate of decay of the whitening. Once the data is collected, the images are analyzed by the [0063] computer 650 with software that calculates four parameters (mean Luminance, and mean red (R ), green (G), and blue (B) intensities) within user-defined Regions of Interest (ROI's). The software enables the user to mark, with a mouse controlled cross-hair cursor, 5 pixel by 5 pixel ROI's on a location in an image. A biopsy can subsequently be taken by the colposcopist, to permit a comparison of the results obtained from the methods of the invention with the results of the biopsy. Once ROI's have been manually marked on all images in the timed-sequence, mean Luminance and mean R, G, B intensities within the 5 pixel by 5 pixel ROI's are calculated and output in tabular form. Also included in the output recorded in the table are the following data elements; image number, ROI location, elapsed time in seconds, and the standard deviation and median of the Luminance and R, G, B values. In one embodiment, the ratio of the mean green intensity to the mean red intensity is found to yield accurate results.
  • In this embodiment, to calibrate the utility of the system and method, five (5) biopsy-confirmed CIN II/III lesions are measured, five (5) biopsy-confirmed CIN I lesions are measured, five (5) colposcopy-confirmed normal mature squamous tissue regions are measured and one (1) biopsy-confirmed normal mature squamous tissue region is measured. Data are analyzed by graphing the Green intensity divided by the Red intensity and normalizing by the maximum intensity within each patient. [0064]
  • FIG. 5 is a diagram [0065] 700 that shows the trend lines of ROIs correlated to CIN II/III lesions (curve 706), CIN I lesions (curve 708), and normal mature squamous tissue (curve 710). The trend lines are plotted using the ratio of mean green intensity to mean red intensity, normalized to maximum intensity, as the vertical axis 702 (expressed in arbitrary units), and using the time after application of acetic acid to the tissue, expressed in seconds, as the horizontal axis 704.
  • FIGS. [0066] 6A-6C are diagrams, generally 800, that show graphs of raw data plotted using the ratio of mean green intensity to mean red intensity, normalized to maximum intensity, as the vertical axis 802 (expressed in arbitrary units), and using the time after appllication of acetic acid to the tissue, expressed in seconds, as the horizontal axis 804. FIG. 6A is a diagram that shows the raw data of ROIs correlated to CIN II/III lesions, as curves 810, 812, 814, 816, 818 representing observations taken from five individuals. FIG. 6B is a diagram that shows the raw data of ROIs correlated to CIN I lesions, as curves 820, 822, 824, 826, 828 representing observations taken from five individuals. FIG. 6C is a diagram that shows the raw data of ROIs correlated to normal mature squamous tissue, as curves 830, 832, 834, 836, 838 representing observations taken from five individuals.
  • An operator of the illustrative system and method defines a region of interest on an image. The intensity readings of the pixels in this region are averaged to provide a quantitative value of brightness as recorded through the particular filter (or unfiltered). By plotting these values as functions of time, a picture of the evolution of the acetowhitening at the selected location in the image is created. [0067]
  • A clinically useful tool based on the acetowhitening kinetic characteristics analyzes the data to differentiate CIN II/III lesions from CIN I lesions and normal mature squamous tissue. According to one illustrative embodiment, the technique uses mean values from 100 second segments of individual patient kinetic curves. The curves are processed by calculating the mean of segments along the curve, i.e. the mean value of the data in the temporal range from about 100 -200 seconds after application of the chemical agent, the mean value of the data in the temporal range from about 200-300 seconds after application of the chemical agent, and so forth. FIG. 7 is a graph [0068] 900 showing curves of the averages of data processed in this manner, in which the average values are plotted along the vertical axis 902 (expressed in normalized units), and using the time after application of acetic acid to the tissue, expressed in seconds, as the horizontal axis 904. The curve 906 represents data relating to CIN II/III lesions. The curve 908 represents data relating to CIN I lesions. The curve 910 represents data relating to mormal mature squamous tissue.
  • FIG. 8 is a [0069] scatter plot 1000 generated by taking the ratio of mean values from two time intervals (100-200 seconds) and (200-300 seconds) for data from individual specimens. In FIG. 8, the average values for the time interval 200 seconds to 300 seconds (expressed in normalized units) are plotted along the vertical axis 1002, and the time interval 100 seconds to 200 seconds (expressed in normalized units), is plotted as the horizontal axis 1004. The points 1006 represent data relating to CIN II/III lesions. The points 1008 represent data relating to CIN I lesions. The points 1010 represent data relating to mormal mature squamous tissue. FIG. 8 shows a basis for differentiating CIN II/III for individual specimens. An illustrative line 1020 is a line of demarcation between the CIN II/III data and the remaining data. A second technique using the first derivative of the curves shown in FIG. 7 is also operative . This technique yields similar results to those shown in FIG. 8.
  • According to another illustrative embodiment of the invention, an indication of the presence or lack of cancerous or precancerous tissue is obtained by recording the optical response in two parts of the visible spectrum. In this embodiment, the inventors have observed that at short wavelengths, such as 380 nm, absorption by hemoglobin can reduce signal intensities. Optical responses are recorded in that part of the spectrum where optical response variation can be detected due to morphological changes in tissue which are associated with cancerous and precancerous tissue, such morphological variations having a strong impact on light scattering. At longer wavelengths, beyond 590 nm and to about 750 nm, scattering of light from cancerous tissue was substantially greater than from normal tissue, and thus the reflected responses from cancerous tissue in that spectral range were greater than from normal tissue. [0070]
  • It is desirable to standardize the responses from the tissue using a signal at a wavelength where both of these influences are relatively weak. In one embodiment, the system of the invention standardizes responses at 480 nm for this purpose. In one embodiment, the response, e.g., the observed reflectance, is recorded at three wavelengths, and the responses obtained at the short wavelength (between 360 and 440 nm) and at the long wavelength (between 590 and 750 nm) are divided by the response at 480 nm. According to one illustrative methodology of the invention, normalized reflections at longer wavelengths indicate cancerous and precancerous tissue, while lower intensity normalized refelections indicate healthy tissue. According to a further illustrative methodology of the invention, reflections in the short wavelength part of the spectrum indicate cancerous and precancerous tissue, while higher intensity reflections indicate healthy tissue. [0071]
  • An algorithm using the rate of change of white light reflection at some specific wavelength, for instance, at 600 nm, can provide accurate differentiation between pathologic and healthy tissue within the first 60 seconds after the application of a pathology differentiating agent like acetic acid. Other algorithms, using both the aforementioned rate of change, or the time lapsed to reach maximum back scattering after application of a differentiating agent, or the time required to attain specific back scattered (normalized) threshold values, permit the diagnosis of the presence or absence of cancer in the screened cervix. [0072]
  • As an aspect of the invention, methods are provided that employ specific algorithms to analyze the back-scattered responses obtained at the preselected wavelength or wavelengths either with or without a chemical agent. Algorithms further provide for classifying examined tissues as normal or pathological. In certain embodiments, these systems are characterized by ease of operation, simplicity and ruggedness. [0073]
  • FIG. 9 presents a [0074] graph 1100 showing two data curves 1102, 1104 obtained from healthy (no evidence of disease, or NED) and cancerous (CIN) tissue respectively. Normalized intensity is plotted along the vertical axis 1106 and wavelength (in units of nm) is plotted along the horizontal axis 1108. All received responses (Iλ) are normalized by dividing the intensities received by the intensity obtained at an arbitrary wavelength. Reflections measured at 480 nm are used for this purpose, since it is in a part of the spectrum where the responses' intensities are relatively independent of the tissue state (healthy or pathological). FIG. 9 shows that the received intensities at longer wavelength (between 550 to 750 nm) are consistently higher for cancerous tissue (curve 1104) than for healthy tissue (curve 1102). The data indicate that the use of three wavelengths from the reflected spectrum of tissue provides correlation between the presence or absence of cancer in the target tissue.
  • In one embodiment, an algorithm utilizes the reflected reading from the tissue at the three selected wavelengths to produce an indicator of the presence or absence of a pathology in the target tissue, or to create an artificial pathology image of the tissue observed. In the first step of the algorithm, the responses are collected at three wavelengths for each point observed. In one embodiment, the following three wavelengths can be used: [0075]
  • λ[0076] 1=380 nm
  • λ[0077] 2=480 nm
  • λ[0078] 3=650 nm
  • It is understood that one can select wavelength ranges rather than specific narrow bands as illustrated here. Normalized reflected intensities may then be defined: [0079]
  • R[0080] 380=I(λ1)/I(λ2)
  • R[0081] 650=I(λ3)/I(λ2)
  • where I(λ[0082] 1), I(λ2) and I(λ3) are the measured reflected intensities at λ1, λ2 and λ3 respectively. These normalized intensities R380 and R650 (which are dimensionless), can vary from about 0.2 to about 6. In one embodiment, the intensity of the reflected light at 380 and 650 nm are normalized, where the normalization parameter is the reflected intensity at 480 nm. It should be evident to those of ordinary skill in the art that while in one embodiment R380 is defined at λ=380 nm and R650 at λ=650 nm, one can define R(low λ) and R(high λ) around neighboring wavelengths in the respective ranges as well, using data such as presented in FIG. 9 from a number of subjects and tissue with varying pathologies in those subjects as a “training set” to calibrate the apparatus being employed. The selection of the “bandwidth” around the center wavelength is related to the kind of instrumentation selected for the actual device, as described below in more detail.
  • As long as the bandwidths selected during the calibration or training of the device and its subsequent use in the field for screening purposes are the same, good correlation is found between high values of R[0083] 650 coupled with low values of R380 and the presence of cancerous and precancerous, or CIN, tissue. Similarly, good correlation is found between low values of R650 and high values of R380 and the presence of healthy, or NED, tissue. Specifically, for cervical tissue that when R650<3.1 and R380>1.1, the tissue is healthy (NED) and when R650>3 and R380<0.9 the tissue is cancerous or precancerous (CIN of all grades).
  • In one embodiment, a grading algorithm is incorporated in a data processing unit employed by these systems and methods. The grading algorithm utilizes the pair (R[0084] 650, R380) and classifies the reflections from each site observed into three groups. In the case of cervical tissue, the algorithm classifies reflections for which the pair obeys R650<2.9, R380>0.1.1 as “healthy tissue” or NED. Similarly, a second group of sites, for which the pair obeys R650>3.5, R380<0.9 is classified as cancerous or precancerous tissue or CIN. Finally, a third group of tissue, including those tissues for which the reflections pairs obey the relationships 2.9<R650<3.5, 0.9<R380<0.1.1, is classified as tissue for which a determination cannot be made. An algorithm according to these systems and methods classifies each point in the observed tissue as healthy or unhealthy. If this classification can not be performed for a particular tissue area, that area is segregated into a third, “unclassifiable” class.
  • An algorithm according to these systems and methods maps tissue for the presence or absence of a pathology. In one embodiment, an algorithm utilizes an independently determined set of threshold values for R[0085] 380 and R650. These threshold values are determined in clinical studies from a large number of patients from which both readings of R380 and R650 are compared with biopsies taken from the tissues from which these values are determined. The threshold values as well as the actual wavelengths where the reflections are taken (and the normalizing wavelength utilized to determine from I(λ) the normalized reflection Rλ) can vary from the values presented herein, as long as the short wavelengths reflections correlate well with absorption by hemoglobin and the long wavelengths reflections with variations of scattering between healthy and pathological tissues.
  • The wavelengths presented in the example above and shown in FIG. 9 are useful in the diagnosis of cervical tissue abnormalities. It is understood, however, that other wavelengths may be useful, particularly when other tissue areas are studied. Furthermore, the critical threshold values of the short and long wavelengths standardized reflections, R, are subject to determination for each type of tissue targeted. [0086]
  • In another embodiment of the invention, a tissue integral algorithm is used, where the cervix as a whole is examined to determine if a pathology exists without actually obtaining an image of the location of such pathology within the tissue. This algorithm is used as follows. The [0087] computer 650 collects the normalized reflection R650 for all measured sites on the tissue and determine the minimum R650(min) of the set {R650}. The computer 650 determines the maximum value R650(max) of the set {R650}. In one embodiment, if the condition R650(max)<1.2R650(min) of the set {R650} is true (e.g., if all observed values of R650 are smaller than 120% of the smallest value of R650 R650(min)), then the tissue is free of pathology. If this condition is not met, pathology of some type is indicated, and the subject should be referred for additional diagnostic tests to identify the type and location of the suspected cervical pathology.
  • A similar algorithm involving R[0088] 380 can be used, whereby the computer 650 determines the minimum R380(min) of the set {R380}, for the normalized reflection R380 observed for all tissue locations. The computer 650 determines the maximum value R380(max) of the set {R380). In one embodiment, if the condition R380(max)<1.20R380(min) of the set {R380} is true, (e.g., if all observed values of R380 are smaller than 120% of the smallest value of R380, R380(min)), then the tissue is free of pathology. If this condition is not met, pathology of some type is indicated, and the subject should be referred for additional diagnostic tests to identify the type and location of the suspected cervical pathology.
  • It is understood that an algorithm in which both of the above conditions are met also results in a valid classification of the subject population into healthy and possibly pathological tissue. It should further be clear that an algorithm based on simultaneously satisfying both conditions can be a useful grading system of tissue for the presence or lack of pathology. Such an algorithm can be expected to result in a greater number of “undetermined” cases. However, the confidence level of correctly grading healthy and pathologic tissue is higher that when using either one of the tissue integral algorithms described above individually. [0089]
  • It should furthermore be evident to those of ordinary skill in these arts that other algorithms can be constructed without departing from the scope of the systems and methods described above but that nonetheless rely upon the fact that scattering from non-pathological tissue at wavelengths between about 600 mn and about 750 nm is consistently greater for pathological tissue than for healthy tissue, or that rely upon the fact that absorption of light in the range of about 370 nm to about 430 nm is greater for pathological tissue than for healthy tissue. Such algorithms, consistent with these systems and methods, are useful in classifying a subject's cervix for the presence or lack thereof of pathological tissue (e.g., a state of health of a subject's cervix). In other embodiments, algorithms can employ data collected at other wavelengths in order to diagnose pathologies of the cervix or pathologies of other body tissues. [0090]
  • FIG. 10 shows an illustrative embodiment of a device for determining the presence or absence of pathology in a tissue of the cervix according to the invention. In this figure, a screening device (shown generally at [0091] 1200) is an integral part of a colposcope 1202, and is used to make determinations of tissue pathology point by point. A colposcope 1202 is provided with a high intensity light source and optics to view cervical tissue, all included within the colposcope 1202. The image viewed by an observer 1203 is recorded with a video camera 1210 and recorded for future reference on magnetic media through a video tape recorder 1211. The instrument depicted in FIG. 10 is used for determining the presence or absence of pathology point by point. Since it is paired with a colposcope 1202, this embodiment is suitable for use by highly trained professionals, such as gynecologists. A beam splitter 1212 is used to select a site in the target tissue 1213 which is illuminated with white light 1214 from the light source provided in the colposcope 1202. The position control of the beam splitter (and thus selection of the point examined in the target tissue) is accomplished with a “joystick” 1215. The optical head 1216 includes a small laser diode (wavelength at about 635 nm) 1217, having a beam coaxial with the optical head's detection optics. In operation, the red beam is pointed toward the tissue 1213. Since the optical axis of the laser diode 1217 and the collection optics in the optical head 1216 are the same, the optical head 1216 measures the light reflected from the point illuminated by the red laser diode beam. In order to maintain the calibration of the optical head's sensor 1218, a white reflector 1219 is provided within the illumination path of the colposcope, to which the operator directs the seeking beam from the laser diode 1217. The reflectance from the white reflector 1219 is used as a standard for calibrating the sensor 1218. Such a white reflector can be made from Spectrolon™, from Labsphere Corporation. Alternatively, high purity BaSO4 reflecting paint from the Kodak Corporation can be applied to a flat surface and used.
  • In some embodiments of the invention, a polarizer is interposed in the back scattered beams which considerably reduces the specular reflection from the target tissues. The specular reflection is understood to comprise the light reflected from the thin film of moisture overlaying the target tissue that has not interacted with the underlying tissue. [0092]
  • In operation, the physician directs the [0093] beam 1214 to a specific site on the suspected tissue 1213. The reflected light from this site is collected by the optical head 1216. A spectrometer 1220 (which can be either a refractive or dispersive spectrometer) disperses the light so that the intensity of the reflected light at preselected wave lengths can be measured in the detector 1218. In one illustrative embodiment, three preselected wavelengths are chosen. In certain embodiments, the sensor 1218 comprises a plurality of sensors corresponding in number to the number of preselected wavelengths, so that one sensor is dedicated to each wavelength. The sensor 1218 can be an ICCD, a standard CCD, or any other detector system known in the art or envisioned by those of ordinary skill in these arts.
  • Data from the [0094] sensor 1218 is analyzed in a computer processor 1221 by applying an algorithm system as described above, and a score is obtained from the data processing that relates to the presence or absence of pathology at the tissue area being illuminated by the laser diode 1217. This score is graphically represented on a display 1222. The digital information corresponding to the score is made available electronically for further processing or representation. In certain embodiments, points for which pathological scores are obtained can be represented on a display 1222 as superimposed upon an image provided by a video camera 1210. In one embodiment, abnormal points are identified graphically with an artificial color not commonly found in cervical tissue, such as shades of green. It will be seen below that other embodiments provide for creation of artificial images or representations of pathologies. The embodiment illustrated in FIG. 10 is suitable for operation by a gynecologist in conjunction with colposcopy. In this setting, the device is well adapted for use as an assisting device for determining which areas of the cervix may require biopsies.
  • In one embodiment, the systems and methods of the invention provide a hand held device adapted for illuminating a target tissue with white light and further adapted for detecting reflections or backscattered responses at three specific wavelengths. FIG. 11 shows an illustrative embodiment suitable for screening applications. This embodiment provides features of a visualization colposcope and features of a screening device according to the present invention. In this embodiment, a superimposition of pathological findings on a cervical image may be produced. [0095]
  • FIG. 11 shows a [0096] colposcreener 1330 consisting of two orthogonal optical paths 1331 and 1332. The first optical path 1331 includes a plurality of lenses (for example lenses 1333, 1334 and 1335) to image the tissue 1336 so that it can be viewed by an observer 1303. The second optical path 1332 includes a distal portion 1331 a of the first optical path 1331 (for example lenses 1334 and 1335), a beam splitter, 1338 and additional lenses (for example, lenses 1337 and 1339). The beam splitter 1338 couples the two optical paths 1331 and 1332 to the distal portion 1331 a of the first optical path 1331, directing half of the light reflected back from the tissue 1336 to be viewed by the observer 1303 through the ocular 1333 and directing half to a sensor 1340. The sensor 1340 is coupled to the optics via a mirror 1341, as shown in FIG. 11, or the sensor 1340 is positioned in the image plane of the second optical path 1332. In some embodiments, the sensor 1340 comprises a plurality of sensors corresponding in number to the number of preselected wavelengths, so that one sensor is dedicated to each wavelength. The sensor 1340 can be, for example an ICCD, a standard CCD, or any other detector system known in the art or envisioned by those of ordinary skill in these arts. A filter wheel 1342 is placed in the optical path of the detected beam 1332, to allow at any given time only one wavelength to reach the detector 1340. The filter wheel 1342 is mounted on an appropriate driving mechanism, for instance, a stepper motor 1343, which sequentially indexes the wheel to the appropriate filter.
  • Arrangements of filter wheels are shown in more detail in FIGS. 12A, 12B and [0097] 12C. In one embodiment, as shown in FIG. 12A, the filter wheel 1442 has three filters, 1444, 1445 and 1446, each capable of blocking most of the spectrum of the reflected beam except around the three selected wavelengths, 380 nm, 480 nm and 650 nm respectively (for the filters 1444, 1445 and 1446). It will be understood by those of ordinary skill in the art that a number of duplications of these filters can be employed for drive simplicity, in particular when the cross section of the reflected beam is narrowed (at the common focal point of the lens on both sides of the filter wheel 1442), so as to allow more than three wavelengths to be determined per rotation of the filter wheel 1442. In such an arrangement in the illustrated embodiment, the number of filter slots would be a multiple of three. In another embodiment, as shown in FIG. 12B, a different filter wheel, 1447, is used in place of the previously illustrated filter wheel 1442. The filter wheel 1447 has four positions (or multiples of four). The first three, positions 1448, 1449 and 1450, are filters transmitting at 380 nm, 480 nm and 650 nm respectively, as cited above, and a fourth slot, 1451, being spectrally neutral, namely it is either a simple open slot in the filter wheel 1447, or a neutral filter that reduces the transmission of all wavelengths by a constant factor. The latter case simplifies the task of maintaining the signals received by the sensor 1440, (for instance a CCD) under a given threshold and thus preventing sensor's saturation.
  • In one embodiment, the shape of the [0098] colposcreener 1330 is similar to the device depicted in FIG. 11. FIG. 11 shows a colposcreener 1330 shaped like a gun, with a trigger 1352 used to initiate the processes of obtaining optical reflection data and viewing the tissue 1336. In operation of this embodiment, pressing the trigger 1352 switches on a light source in the control console 1353. This light source is concentrated into an optical fiber bundle (not shown) included in the control cable 1354 which connects the control console 1353 and the colposcreener 1330. The optical fiber bundle 1354 delivers light to the distal end 1355 of the colposcreener 1330. In one embodiment, a cone of white light 1357 illuminates the target tissue 1336 homogeneously. It is understood that other shapes and configurations of the colposcreener 1330 may be envisioned by those of ordinary skill in these arts without departing from the scope of the systems and methods disclosed herein. Furthermore, while the colposcreener 1330 is adapted for examination of the cervix, other shapes and embodiments consistent with these systems and methods may be devised that are structurally adapted for other anatomic areas.
  • FIG. 11 further shows that light reflected from the tissue is split by the [0099] beam splitter 1338 into a viewing beam carried along the optical path 1331 and a detection beam carried along the optical path 1332. In that manner, the tissue screened is viewed directly through the ocular 1333 while the detection beam is being sequentially scanned for the three wave length discussed above. The tissue is imaged onto the sensor 1340. In one embodiment the sensor 1340 comprises a CCD array, whereby the light intensity reflected for each point in the tissue is measured. The data from the sensor 1340 is transmitted through a data cable 1356 to a data processing unit 1358 for further analysis. Synchronization signals generated in the control console 1353 provide correct indexing of the streams of data for each one of the three filters in the filter wheel 1342. This may be achieved by using the signal sent to the stepper motor 1343 to coordinate with the data stream from the sensor 1340.
  • In one illustrative embodiment, the synchronization task is simplified by using the geometry of the filters in the [0100] filter wheel 1342. In this embodiment, the motor 1343 is used in a continuous rather then a stepping manner, thus the filter wheel 1342 rotates continuously. An embodiment using a filter wheel in this way is shown in FIG. 12C, where the filter wheel 1459 is depicted as having three unequal filters 1460, 1461 and 1462, separated by unequal spaces 1463, 1464 and 1465. In this embodiment, a CCD or a CCD array is advantageously employed as the sensor 1340, as previously described. Since the CCD has its highest sensitivity in the red part of the spectrum, and the light source is typically richer in the red part of the spectrum as well, the 650 nm red filter 1460 in FIG. 12C is much shorter, with shorter collection time. The short collection time is used to indicate to the data analysis unit 1358 that the red filter 1460 (transmitting selectively at 650 nm) is being used. To better equilibrate the intensities received, the green filter 1461 (transmitting selectively at 480 nm) is larger than the red filter 1460. The blue filter 1462 (transmitting selectively at 380 nm where the CCD is least sensitive) occupies the longest segment of the circumference. The signals received at various wavelengths are more homogeneous and easier to analyze. Integration times can be adjusted accordingly. The adjustment of the integration time can be keyed on the “No signal” periods between the filters, represented by the unequal spacings 1463, 1464 and 1465 between the filters.
  • In this illustrative approach, the actual normalized intensities, R[0101] 380, R480 and R650 as discussed above are modified to account for the time variability of data acquisition between the three different filters. Since these factors depend on the specific integration time selected, the normalized reflections Rλ provided above are used, understanding that algorithms based on these findings are devised once a calibration for a specific design is available.
  • The data received for each one of the three filters is analyzed for each pixel and is displayed on the [0102] display monitor 1322 in a dual fashion. The first display generates a Red/Green/Blue image of the tissue by taking the raw data (normalized for spectral differences in the CCD sensitivity as well as variations of integration times when using the filter wheel 1559 shown in FIG. 12C) from each CCD's pixel and presenting it as a normal full color picture. This is achieved with well known “frame grabbing” electronics readily available commercially.
  • Each pixel, P[0103] ij, has associated with it three values (residing in the grabbed frame), Iij,380, Iij,480 and Iij,650, from which are derived normalized intensities Rij,380 and Rij,650. A strongly discriminating algorithm selects all pixels Pij for which both of the conditions Rij,650>3.3 and Rij,380<0.9, namely those pixels for which a pathology is identified. These pixels form a group Qij of pathological tissue. A “weaker” discrimination defines as “pathological” only those Pij for which Rij,650>3.3 and the so defined Qij are then painted on the total image as a pathology.
  • The display superimposes an image of all the pixels Q[0104] ij having a “pathological” signature on the natural picture of the tissue. This is achieved by selecting a color uncommon to the tissue (such as green, or blue) and painting said all Qij (pathological) pixels all in the same color, thus obtaining an artificial-looking image of the extent of the pathology in the tissue. The filter depicted in FIG. 12B wherein one of the positions is a neutral filter uses the image generated by the neutral filter (which will appear on the display having shades of gray) as the background image of the tissue on which the pathology is superimposed in any desired color. To maintain the system of FIG. 11 in calibration, a standard white reflector is used, as described above for FIG. 10.
  • FIG. 13 depicts an embodiment in which the apparatus is configured as a [0105] screening device 1570 without providing for direct visualization of the tissue being screened by an observer. In the illustrative embodiment, the screening optical head 1571 contains an optical train 1572, an illuminator 1573, a CCD array 1574 and a filter wheel 1575. The filter wheel 1575 is rotated as previously described, either continuously or in a stepping fashion with a stepper motor, 1576. The light source is within the data processing/control console 1577, and the data is displayed on a display 1578. Light from the light source is collected into a bundle of optical fibers 1573 which is an integral part of the cable 1579, between the console 1577 and the screening device 1571. While FIG. 13 shows the optical fibers 1573 as nested within the screening device 1571 at one location, it is understood that the fibers within the bundle can be arranged circumferentially or in any other geometric arrangement in order to provide homogeneous illumination of the target tissue 1580.
  • FIG. 14 shows a [0106] filter wheel 1600 suitable for use with the device depicted in FIG. 13. The illustrated filter wheel 1600 is configured to select light at wavelengths of 380 nm, 480 nm and 650 nm, with an open area to facilitate synchronization. It should also be evident to practitioners of ordinary skill that any arrangement of filter wheels understood in the art, including those illustrated in FIGS. 12A-12C above, could be used in the depicted system, with the operation of the apparatus being adjusted accordingly.
  • In operation the [0107] screening device 1571 may be pointed to the target tissue 1580. The tissue may be illuminated through the optical fiber bundle 1573 and reflections from the tissue may be recorded by the CCD array 1574 at about 380 nm, about 480 nm and about 650 nm. The data processing unit 1577 analyzes the recorded data using any one of the algorithms described above. Tissues with color enhanced pathologies are represented on the display 1578. In one embodiment of the invention, visual display is not provided and only a reading or printout of the status of the subject (having or nor having a pathology in the target tissue) is presented. In this embodiment, the instrument advantageously uses the above-mentioned tissue integral algorithm. To use this algorithm, the data processing unit 1577, after obtaining the values Rij,650 and Rij,380 for each pixel Pij, determines the maximum and minimum values obtained for R650 and R380. If the conditions R650(max)<1.2R650(min) and R380(max)<1.2380(min) are met, the subject is classified free of pathologies. Otherwise, the subject is referred for additional diagnostic evaluation to determine the nature and the extent of the suspected pathology.
  • In another illustrative embodiment, depicted in FIG. 15, the filter wheel is eliminated. Further, in lieu of a standard CCD array a color CCD array may be used. In the illustrated embodiment, a [0108] screening device 1700 includes three modules 1701, 1704 and 1703. The first module, the screening probe 1701, is operably connected to the second module 1704 through a cable 1703. The first module 1701 contains a circumferentially arranged optical fiber bundle 1706 for transmitting light to a target 1710, and an optical path 1702 comprising optical elements for receiving light emitted from the target 1710. The second module 1704 contains a light source coupled to an optical fiber bundle 1706. The fibers in the optical fiber bundle 1706 are distributed circumferentially at the distal end of the probe. Furthermore, the second module 1704 contains a data processing unit, including an electronic frame grabbing submodule to process data received from the color CCD array 1900 in the probe module. Results are displayed on the display module 1705, which is connected to the second module 1704 by way of cable 1707.
  • The [0109] color CCD array 1900, as used in the illustrated embodiment, may be typically divided into pixels each having four elements. FIG. 16 shows a segment of the surface of such an array 1800. For illustrative purposes, an array of 10×10 elements organized as an array of 5×5 pixels is shown. However, it is understood that such an array can comprise in excess of 500×500 elements and thus more that 250×250 pixels. Each one of the pixels 1801 has two green filters 1802 and 1803, overlaying two of the elements of the four elements in pixel 1801. The other two elements, 1804 and 1805, have respectively a red and a blue filter overlaid thereupon. While the specific filters employed in standard color CCD devices can vary from the three wavelengths selected above, and can vary from manufacturer to manufacturer, standard color CCDs can be used in the invention.
  • The operation of the [0110] device 1700 depicted in FIG. 15 is similar to the operation of the system depicted in FIG. 13, except that no filter wheel is employed. In contrast to the embodiment depicted in FIG. 13, in the embodiment of FIG. 16 the whole image in three chroma is taken at once, and the frame grabbing module transfers the intensities received for each one of the three colors to a data processing device which undertakes the normalization of the long and short wavelength reflection with the middle of the spectrum responses and proceeds to apply to the two artificial intensities so derived any of the previously described algorithms.
  • In the illustrative embodiment, the [0111] system optics 1702 images the target tissue 1710 onto the color CCD 1800, and the signal from each pixel is captured in a frame grabbing device in module 1704. The intensities registered for the two green filtered elements are averaged and used as the normalization value for the intensities registered for the red filtered element and for the blue filtered element. In this fashion, normalized values Rij(B) and Rij(R) are obtained for each pixel having a row i and a column j. These normalized values respectively represent the normalized reflected intensities in the blue and red part of the spectrum.
  • While the filters used in commercial color CCD do not correspond exactly to the [0112] wavelength 380 nm and 650 nm mentioned above, and furthermore the bandwidth of those filters are relatively wide, satisfactory calibration and discrimination between pathological and healthy tissue can be achieved. The threshold values can be changed for R(B) and R(R) relative to those shown above for R380 and R650. These values vary somewhat depending on the source of the color CCD. To alleviate the problem of variability, an array of filters with the appropriate fixed wavelengths of about 380 nm, about 480 nm and about 650 nm can be overlaid over a standard CCD array to obtain a screening device that has no moving parts (such as the filter wheel) in some of the embodiments mentioned above. The general algorithm Rλ(Max)<αRλ(min) where α>1 and is a function of the specific λ selected is advantageously employed without undue experimentation by ordinary skilled practitioners in these arts to discriminate between healthy and pathological tissue.
  • In another illustrative embodiment, these systems and methods are used in conjunction with an acetic acid delivery system, as shown in FIG. 17. FIG. 17 shows a [0113] graph 1900 of measured reflectance I, as normalized by the initial reflectance immediately after the application of the acetic acid, as function of time, beginning with the application of an acetic solution to the cervix, at a wavelength of about 600 nm. The graph 1900 has normalized intensity plotted along the vertical axis 1902 and time expressed in seconds plotted along the horizontal axis 1904. The data collection is achieved by using a single narrow bandpass filter, transmitting around 600 nm, overlaying a CCD. FIG. 17 represents measurements from a number of tissue samples (in vivo, followed by determination of the pathology from biopsies). The time dependence of the reflected responses from tissues fall into three well differentiated zones. Healthy (NED) tissues have a response 1910 which is independent of time. CIN II tissue shows an increasing response 1920 for about 30 to 60 seconds, and then the reflectance slowly fades out and returns to normal within about three minutes or a little longer. CIN III tissue shows a response 1930 that includes a strong change with time for the first 20 to 30 seconds, and then, the response 1930 stays strong for longer than about three minutes. FIG. 17 shows that the optical behavior of the various tissue classes following the application of the amplifying agent differentiates between healthy and pathologic tissue from measurements taken during the first 10 to 20 seconds after the application of the amplifying agent (or chemical agent), in this case acetic acid.
  • A useful algorithm employs the rate of change of the normalized intensity I with time, dI/dt at between 10 to 20 seconds after the application of the amplifying agent. According to this algorithm, if dI/dt<0.055 sec[0114] −1, the tissue is classified as healthy (NED). If 0.075 sec−1<dI/dt<0.11 sec−1, the tissue is classified as CIN II. If di/dt>0.11 sec−1, the tissue is classified as CIN III. In one embodiment, the higher dI/dt during the first 10 to 20 seconds after the application of the acetic acid solution, the more severe the pathology is.
  • In another embodiment, an algorithm involves the measurement of the normalized reflectance after either 10 or 20 seconds from the application of the acetic acid solution. If I is greater than 1.25 after 10 seconds (or about 1.5 after 20 seconds), the tissue is classified as pathologic, and the patient is directed to have a more detailed analysis of the condition, sometimes, including a biopsy. This embodiment is applied, as an example, when the probe is used in true screening situations rather than in more traditional colposcopic examinations. [0115]
  • In another embodiment, an algorithm is based on the time required to reach a maximum in the back reflected response of the tissue. According to this embodiment, the longer it takes to reach this maximum the more severe the condition, providing, however, that the maximum is more than about 3.0 times the minimum back scattered response for the same tissue. The disadvantage of this approach is that longer exposure may be required, particularly in the case of CIN III, where back scattered responses continue to increase even after more than 200 seconds. [0116]
  • To shorten that time interval, another algorithm compares the maximum normalized response at 600 nm during any interval of time greater than 10 seconds from the application of the acetic acid solution, to the initial response, and if that response is more than 30% larger than the initial response, the tissue is classified as CIN in general. This algorithm is used when fast classification of cervixes in a screening environment is desired. [0117]
  • In yet another embodiment of the invention, a screening algorithm takes an ititial reading of responses for each point probed prior to the application of the acetic acid, stores the values as a standard set, and then takes a number of images sequentially. The screening algorithm performs a point by point subtraction of the value of the stored initial responses from the responses obtained after the application of the acetic acid. The time dependence for various classes of tissue results in distributions similar to those shown in FIG. 17, except that the scale of the back scattered intensities is now changed. The algorithm utilizes the differential responses of various classes in a manner as described above. [0118]
  • Apparatus and methods for controlled delivery amount and delivery pattern of a chemical agent are disclosed below. Apparatus and method for accurately and synchronously triggering the optical measurements with regard to the time of delivery of the chemical agent are disclosed below. Image capture software to record time-stamped images and user-defined regions of interest to be defined on a master image is disclosed below. This analysis software automates the calculation and display of acetowhitening characteristics from a motion corrected time-sequence of patient images. This improves the ability to correlate instrument measurements to the pathological evaluation of biopsied tissue. [0119]
  • In another embodiment of the invention, when using an amplifying agent such as acetic acid, an automated system delivers the amplifying agent to the target tissue. A triggering mechanism applies the chemical reproducibly and eliminates variability of time delays between the application and the start of obtaining optical responses from the target tissue. [0120]
  • FIG. 18A shows an illustrative embodiment of a system with a [0121] screening probe 2000 similar in construction to the probe shown in FIG. 11. This apparatus and the associated techniques are used to improve the demarcation of a start time and to guarantee the application of a constant volume of acetic acid. Another embodiment is a mucosal atomizer device comprising a 3 cc syringe and 6″ stylet tubing extension nozzle is used to spray 2 cc of 5% acetic acid uniformly onto the surface of the cervix. The distal part 2013 of the probe 2000 is covered with a composite disposable sheath 2011 having attached at its own distal periphery a hollow toroidal structure 2014. The hollow toroidal structure 2014 contains the chemical agent or amplifying agent, for example, acetic acid at a 3% to 5% concentration. A retractor 2012 compresses the toroidal structure 2014 when the operator is ready to apply the amplifying agent to the target tissue. When the retractor 2012 is retracted using a trigger like mechanism 2015 the toroidal structure 2014 is compressed and its content is sprayed onto the tissue. Simultaneously with the retraction action, the probe is signaled to start taking measurements, by the actuation of a switch 2016 in the handle of the probe. The chemical or amplifying agent is sprayed through a plurality of perforations 2017 as shown in FIG. 18B, a top view of the distal end of the assembled sheath/retractor assembly. To prevent accidental expulsion of the solution, a covering such as an adhesive tape may be attached to the distal end 2013, covering the toroidal structure 2014. In one embodiment, the covering may be removed after mounting the sheath on the probe and just prior to the insertion of the probe into a target area such as the vagina. While FIG. 18A depicts a cylindrical structure, it should be apparent to those of ordinary skill in the art that a conical structure can be utilized to improve packaging and nesting of multiple disposable sheaths, and furthermore, that any other structure may be constructed which is adapted for the functions depicted in FIG. 18A and which is further adapted for the anatomic region in which it will be used.
  • In the embodiment shown in FIGS. 18B and 18C, the [0122] retractor 2012 is designed to leave an optical window 2018 for the reception of responses from the illuminated tissue. Illumination is achieved through circumferentially distributed optical fibers, as previously described in FIG. 11, and the light is transmitted through a transparent part of the peripheral distal end of the retractor 2012. The toroidal container 2014 for the amplifying agent is affixed to the sheath 2011, as shown in FIG. 18C, which shows a cross sectional view of the distal end of the sheath/retractor assembly. The toroidal container 2014 is directly attached to the sheath (as shown at 2019) or it is affixed in any other suitable way.
  • While in FIG. 18A we show a [0123] toroidal container 2014 which discharges its content upon compression, it should be clear that other shapes may be useful in the practice of the invention. For instance, the cross section of the toroidal container 2014 can be oval or rectangular. In certain embodiments, the amplifying agent container is constructed as a side mounted syringe having a plunger that causes discharge of the amplifying agent in a spray form, while providing simultaneously a signal to the probe that amplifying agent is applied, and thus providing a starting point for the temporal measurements of reflections from the target tissue. While this figure shows one embodiment of a system for automating the application of the amplifying agent and for standardizing the time lapse between the application of the amplifying agent and the measurement of back scattered responses from the target tissue, it should be evident to a person trained in the art that other mechanisms achieving the same goal can be devised without deviating from the spirit of the invention. Such other applicators could include, but are not limited to, surgical applicators like sponges, cloths or swabs that are made to be retracted after the application of the amplifying solution so leave open the optical path between the tissue and the probe's distal end 2013.
  • When the algorithms use normalized responses, as normalized against time zero, the trigger actuates a timer within the probe controller that sets up a predetermined time interval for the first measurement (typically within 1 second of amplifying agent application). When the algorithm used normalizes responses relative to the response obtained prior to the application of the amplifying agent, an image of the cervix is taken prior to the application and recorded with the frame grabber in the [0124] data processing unit 1704. After the trigger 2016 signals the probe to start taking responses, the responses are taken and normalized (pixel by pixel) and one of the algorithms described above analyzes the data. The data are presented as either a “positive” or “negative” finding for the whole cervix, or alternatively, an artificial image of the pathology is presented for those pixels where the algorithms returned positive findings. This image is superimposed on a visual image of the cervix and recorded to allow post screening accurate location of tissue requiring subsequent biopsy.
  • In some embodiments of the invention, spatial data are averaged over groups of neighboring pixels (between 2×2 to 6×6), and these averages (both for the standardizing measurement, or normalizing measurement) are used as normalized intensities. Other methods for averaging or normalizing spatial data can be used. Different methods of normalizing can be related to the resolution of the CCD used in that specific interest. [0125]
  • In another embodiment, a plurality of chemical agents are applied to a specimen, either simultaneously or sequentially. The use of multiple chemical agents causes any of a number of different effects. One chemical agent is used to control or change pH (e.g., hydrogen ion concentration), change the concentration of one or more other ionic species, or change an osmotic pressure, while another chemical agent is used to induce another sort of change, for example, staining a material, activating or passivating a material, or otherwise changing a physical property of a material. [0126]
  • Application of an exogenous contrast agent when combined with the activation of an endogenous contrast agent gives rise to a combined contrast that provides more valuable information than either agent alone. For example, application of acetic acid to epithelial tissue results in time-dependent effects in the fluorescence emission spectrum resulting from activation of endogenous native fluorophores in tissue, such as NADH, collagen, elastin, favins (e.g., FAD) or porphyrins. [0127]
  • This effect arises from at least two different sources. One source is the penetration of the acetic acid into the tissue followed by the resulting pH change on the spectral properties of the endogenous fluorophore. The effect of pH is shown for NADH in FIG. 19. FIG. 19 shows four absorption spectra recorded over the wavelength range of about 320 nm to aboout 600 nm. The absorbance is plotted along the [0128] vertical axis 2102 and the wavelength in nm is plotted along the horizontal axis 2104. A baseline spectrum 2110 is taken for a 5% acetic acid solution containing no NADH, and shows little absorption. The spectrum 2120 is taken at pH 4.0 and shows two strong absorption peaks at approximately 350 nm and at approximately 430 nm. The spectrum 2130 is taken at pH 5.0 and shows a strong absorption peak at approximately 350 nm and a much weaker absorption peak at approximately 430 nm as compared to the pH 4.0 spectrum. The spectrum 2140 is taken at pH 7.0 and shows a strong absorption peak at approximately 350 nm and virtually no absorption peak at approximately 430 nm as compared to the pH 4.0 spectrum. The spectral properties of NADH absorption are significantly affected by pH. Since absorption is the first step in fluorescence, it is reasonable to expect that pH will affect the emitted fluorescence as well.
  • Acetic acid penetrates into different types of tissues and cells at different rates depending on the type of tissue present. In addition, the amount of NADH in cells typically differs according to the type of cell and its metabolic state. Consequently the kinetics of this pH response can be indicative of the tissue or cell type and its metabolic condition. [0129]
  • Acetic acid causes acetowhitening when applied to certain tissues, such as epithelial surfaces. The acetowhitening effect is produced by light scattering changes. These changes have further secondary effects on spectral measurements, such as induced fluorescence. Changes in the induced fluorescence result from either of two sources. One source is the direct effect of acetowhitening on the penetration of the UV excitation light. A second effect results from the light scattering on the observed spectral shape of the emitted fluorescence. Since the acetowhitening is time dependent, these secondary effects are time dependent as well. [0130]
  • Temporal changes observed in fluorescence emission following the application of acetic acid to a cell suspension is shown in FIG. 20. FIG. 20 shows a [0131] graph 2200 of spectra measured as a function of time after application of acetic acid. The spectral intensity is plotted along the vertical axis 2202 and the wavelength in nm is plotted along the horizontal axis 2204. Curve 2210 is recorded at the time of application of the acetic acid solution. Curve 2220 is measured 0.5 minutes after acetic acid application. Curves 2230, 2240, 2250 and 2260 are recorded 1, 2, 3, and 7 minutes after acetic acid application, respectively. The fluorescence spectrum originally observed at the time of acetic acid application quickly decreases in intensity, and recovers slowly thereafter.
  • Fluorescence spectra in cervical tissue have similar changes over time following application of acetic acid. FIG. 21 is a [0132] graph 2300 that shows the changes in fluorescence spectra before (curve 2310) and after (curve 2320) application of acetic acid to cervical tissue. The spectral intensity is plotted along the vertical axis 2302 and the wavelength in nm is plotted along the horizontal axis 2304. Note that the fluorescent intensity at some wavelengths below about 450 nm changes more substantially than the intensity at wavelengths above about 450 nm. Since the time-course of those changes is related to the type of tissue being probed (as described above) these spectral differences can differentiate the type of tissue under study.
  • Relative motion between the patient and the colposcope can cause problems with registration of the different images for that patient during analysis. A robust motion detection and correction technique is disclosed below. This technique uses the cross-correlation of two successive images to determine global motion. The cross-correlation is computed in the Fourier domain using a fast Fourier transform. In one embodiment, the image registration technique is used after the specimen data is collected. In an alternative embodiment, systems according to the invention incorporate the technique on-line, as it does not require excessive processing overhead. [0133]
  • Image processing is used to extract relevant features from the data observed and recorded using the systems and methods of the invention. Image processing techniques that can be applied include, but are not limited to, color space transformations, filtering, artifact detection and removal, image enhancement, extraction of three-dimensional shape information, manipulations using mathematical morphology, and segmentation. [0134]
  • A color space transfromation is intended to transform the three primary colors, red (R), blue (B), and green (G), into a new set of colors or values using a kinear or non-linear transformation. A number of well-known transformations interconvert R,G,B and luminance/chrominance components, for example, as used in converting light recorded in a camera into broadcast signals, and rendering broadcast signals on a television display. [0135]
  • Filtering is useful in image processing, and is used to suppress noise and unwanted interfereing signals. Many filters and filtering processes are known. Filters can include both hardware filters such as optical filters and electronic filters, as well as filters applied in software, such as digital filters. For example, the median filter replaces every pixel of an image with the median value computed in a given neighborhood of the pixel. [0136]
  • Artifact detection and removal is used to eliminate spurious information from a set of data to be analyzed. Some artifacts, such as portions of an optical field of view that are extraneous, may be eliminated by changing the height and or width of the field of view, or by masking portions of the field of view, for example when a physician observes that the field of view includes material that is not of interest. [0137]
  • Image enhancement can include processing to improve the visual contrast between adjacent portions of an image. A number of known techniques are available, including applying a weighting function to a range of intensities or gray scale values. [0138]
  • Extraction of three-dimensional shape information is useful in representing a surface that is non-planar in two-dimensions. An example is computing the three-dimensional features of the cervix to account for the nonuniformities of illuminating a three-dimensional surface. [0139]
  • Manipulations using mathematical morphology are well-known. Image processing using the principles of mathematical morphology provides a representation of an image in a form that simplifies the computational burden in image processing. [0140]
  • Morphological operators are based on the mathematics of set theory. A set in mathematical morphology represents the shape of an object in an image. In the case of two- dimensional (binary) images, the sets are members of Z[0141] 2 and each element represents the (x,y) coordinates of a black (or white, depending on the convention) pixel in the image. Gray-scale, color, time-varying components, or any vector-valued information can be included by extending the Euclidean space size.
  • The basic morphological operators are described in terms of gray-scale images below. Let the input image be described by a function f: Z[0142] 2→R. Gray-scale dilation is defined as:
  • (f⊕b)(v,w)=max{f(v−x,w−y)+b(x,y)|(v−x,w−yD f;(x,yD b}
  • where b: Z[0143] 2→R is a function called a structuring element, Df is the domain of f and D6 is the domain of b. The structuring element has a key role in this operator: it is added morphologically to the image at each pixel location.
  • The opposite of dilation is erosion. The erosion operator is defined as: [0144]
  • (f⊕b)(v,w)=min{f(v+x,w+y)−b(x,y)|(v+x,w+yD f;(x,yD b}
  • In this case the structuring element is subtracted morphologically from the image at each pixel location. [0145]
  • Two important morphological operators are defined using erosion and dilation: opening and closing. They are respectively defined as: [0146]
  • f∘b=(fΘb)⊕b
  • f•b=(f⊕bb.
  • The effect of opening is to preserve holes and remove peaks, while closing preserves peaks and closes holes according to the structuring element's shape. The structuring element b is fitted from inside (below an image) in the opening case and fitted from outside (above an image) in the closing case. [0147]
  • A morphological filter can be defined as any combination of morphological operators. For example (f∘b)•b, opening followed by closing, or (f•b)∘b, closing followed by opening. These operators are neither commutative, nor associative or distributive and the filtering operators cited above are not equal. One of the following two filters is used: [0148] f_b = 1 2 [ ( f · b ) + ( f b ) ] , and f_b = 1 2 [ ( f b ) · b + ( f · b ) b ]
    Figure US20020127735A1-20020912-M00001
  • where the _ symbol means f filtered by b. [0149]
  • A more elegant way to achieve a morphological filtering with better geometrical characteristics is to use geodesic reconstruction after a morphological opening. The reconstruction process uses geodesic dilation which for gray-scale images is defined by: [0150]
  • (f⊕b)(1)(v,w)=min{(f⊕b)(v,w),f 0(v,w)},(v,wD f,
  • where f[0151] 0 is the reference image, usually the original image, and g is a small structuring element, usually a four pixel (cross) or eight pixel (square) connected element. Geodesic reconstruction is obtained by repeating the geodesic dilation n times ((f⊕b)(n)) until idempotency is reached. The geodesic reconstruction is then written:
  • Rg=(f⊕b)(i), with (f⊕b)(i+1)=(f⊕b)(i)
  • An equivalent operator can be defined for reconstruction after morphological closing which uses geodesic erosion. For gray-scale images it is defined as: [0152]
  • (f b)(1)(v,w)=max{(f b)(v,w),f 0(v,w)},(v,wD f
  • An example of geodesic reconstruction after morphological opening suppresses the square shape deformation introduced by the opening process. These geodesic reconstruction operators significantly improve any filtering process for a modest additional computation time. [0153]
  • The most natural example of diffusion process is heat transfer inside matter. This physical phenomenon is mathematically expressed by the following partial differential equations: [0154]
  • q=−k∇T, c p T t = - · q + f ,
    Figure US20020127735A1-20020912-M00002
  • leading to the following second order elliptic equation: [0155] c p T t = - · ( k T ) + f ,
    Figure US20020127735A1-20020912-M00003
  • Heat transfer involves a thermal flux q. The whole system must obey the law of energy conservation. The symbol ∇ is the differential operator, which is defined as ∇=(∂/∂x[0156] 1, . . . , ∂/∂xd). The parameter p is the density of the medium, k is the thermal conductivity, c is the specific heat capacity, and f the capacity of internal heat sources. An analogy exists between temperature variation and value variation in images. The basic formulation is obtained when the medium is assumed to be homogeneous, without sources and with constant conductivity.
  • In image processing applications the ideal objective is to obtain an image where only strong edges are preserved while noise and small structures are smoothed out. Diffusion is used as an edge preserving filtering method. The thermal conductivity is replaced by a conductivity function which adapts the diffusion to the local gradient: decreasing diffusion for increasing gradient. The above diffusion equation becomes: [0157] v t = · ( D u ) ,
    Figure US20020127735A1-20020912-M00004
  • where v(x, t) is the signal value at time t and position x, and D is a conductivity matrix. The latter defines the type of diffusion: [0158]
  • if D reduces to a constant value k then the diffusion is isotropic, [0159]
  • if D reduces to a nonlinear function g(·) then the diffusion is nonlinear isotropic, [0160]
  • if D is a tensor whose elements are functions g[0161] ij(·) then the diffusion is anisotropic.
  • The analysis uses the case where D=g(·), and the following conductivity function: [0162] g ( | υ | ) = { 1 if | υ | k o , k o / | υ | if | υ | > k o . , Φ f ( | υ | ) = { 1 if | υ | k o , 0 if | υ | > k o . ,
    Figure US20020127735A1-20020912-M00005
  • Histogram equalization re-assigns pixel values in order to obtain a uniform distribution. Let v(x) be the pixel value at location x and P(v) be the probability density function associated to v. The following transformation is used: [0163]
  • νeq(ν)=∫0 ν P(s)ds
  • where 0≦v≦1. In the discrete case, the uniform distribution is only approximated and the following equation is used: [0164] u k , e q = j = 0 k n j n ,
    Figure US20020127735A1-20020912-M00006
  • where n is the total number of pixels and n[0165] j the number of pixels with value equal to j.
  • The fitting technique used is called linear least squares. The idea is to fit a linear combination of arbitrary functions (linear or nonlinear) given by: [0166] l ( x ) = k = 0 M - 1 α k f k ( x ) ,
    Figure US20020127735A1-20020912-M00007
  • where x is an N-dimensional coordinate vector (N=2 in the case of images), to a set of data l[0167] i(xi), with i=0, . . . , n−1. In one embodiment, the following series of functions are used:
  • 1, x, x[0168] 2, x3, . . . ,
  • in the 1-D case and: [0169]
  • 1, x, y, x[0170] 2, xy, y2, x3, x2y, xy2, y3, . . . ,
  • in the 2-D case. [0171]
  • The fitting criteria is the minimization of the following least-square error: [0172] x 2 = i - 0 n - 1 [ l i - K = 0 M - 1 α k f k ( x i ) σ i ] 2
    Figure US20020127735A1-20020912-M00008
  • where σ[0173] i is the measurement variance at location xi. In one embodiment, set σi−1, ∀i=1, . . . , n−1.
  • By defining the n×M matrix A whose elements A[0174] ij are given by:
  • A ij =f j(x i),
  • and the vector b of length n whose elements b[0175] i are given by bi=li, then the following system must be solved:
  • a=(A T A)−1 A T ·b,
  • where a=[σ[0176] 0 . . . σm−1]. Since the ATA product is positive definite, Cholesky decomposition can be used to compute the inverse.
  • Segmentation is a morphological technique that splits an image into different regions according to a pre-defined criterion. In the analysis of the state of health of a biological specimen, it is meaningful to compare the proprties of different areas of the specimen. Segmentation is a method that directly provides information on how many regions are present in the image of a specimen, and the location of each region. [0177]
  • In one embodiment, colposcopic images are segmented to track regions in a time series of images. Relevant features are extracted from the labeled regions and their evolution is analyzed as a function of time, to measure and localize acetowhitening effects. Colposcopic images are segmented using a watershed based algorithm. An efficient pre-processing scheme is used, as are two region merging techniques. The use of markers to track the segmentation in time-series of images is used, and the problem of global motion and local deformations related to the precise tracking of these markers is discussed. [0178]
  • A segmentation scheme for colposcopic images separates the image of the cervix into a number of regions according to an intensity criterion. Segmentation techniques are well known in the mathematical morphology arts. In one embodiment, the object (e.g., the cervix) is known and multiple regions with different intensity content within the cervix are to be identified. [0179]
  • A technique based on the structural and spatial information rather than on the spectral information is suited to analyze colposcopic images. One approach uses the watershed technique. The watershed technique uses structural information. The watershed technique provides a fine to coarse segmentation of an image in combination with region merging techniques. The flooding technique views a gray-level image as a 3-dimensional surface and progressively floods this surface from below. Each local minimum in the surface is thought of as a hole. A rising water level floods a region as soon as a hypothetical water level reaches the associated minimum. FIG. 22 illustrates this concept on a 1-D signal. The arrows [0180] 2402 a-2402 d show the flooding origins and directions and the solid lines 2406 a-2406 d are the watersheds. The flooded minima are called catchment basins and the borders between neighboring basins are called watersheds. Only the catchment basins are of interest. They constitute the segmented image. Fast implementations use first-in-first-out (FIFO) queues and sorted data.
  • FIG. 23 is a [0181] graph 2500 of a signal 2510 and its first derivative 2520, both plotted with amplitude as a vertical axis 2502 and position as a horizontal axis 2504. FIG. 23 shows a signal 2510 used to represent watersheds with three distinct regions (hole 2512, plateau 2514, and peak 2516) and its derivative function 2520, or gradient. Image segmentation with the watershed transform is performed on the image gradient 2520. The signal shows three distinct regions, and the direct watershed transform would produce a one lowest region. The gradient 2520 separates the signal into its three regions. An analogous principle holds for two-dimensional signals, i.e. images.
  • FIG. 24 shows a [0182] graph 2600 of a sigmoidal scaling function 2610 used to enhance the contrast between light and dark regions of an image. The sigmoidal scaling function 2610 is plotted as output along a vertical axis 2602 as a function of an input that is indiated along a horizontal axis 2604. The use of the watershed transform often leads to a severe over- segmentation. Pre-processing is performed to reduce the number of regions in a segmented image. In one embodiment, a pre-processing scheme reduces the number of regions from several thousand to several hundreds:
  • An algorithm that treats images to provide a segmented image includes the following steps: [0183]
  • computing luminance component L*; [0184]
  • performing 3-D shape compensation; [0185]
  • performing sigmoidal scaling; [0186]
  • morphological closing/opening with a cylindrical structural element; [0187]
  • performing geodesic reconstruction; [0188]
  • computing image gradient; [0189]
  • computing threshold gradient; [0190]
  • performing closing; and [0191]
  • performing geodesic reconstruction of the gradient image. [0192]
  • The uniform luminance component L* is well adapted to the segmentation process, and is computed for an image of interest. [0193]
  • 3-D shape compensation removes an artifact (e.g., a stair-case effect) in the segmented image. The illumination is non-uniform when falling on a curved surface (e.g., the cervix), which in turn influences the gradient values used for the segmentation. [0194]
  • A sigmoidal scaling function is used to improve the contrast between light and dark regions. FIG. 24 is a graph of a scaled sigmoid, used in this study. The sigmoid increases contrast in the median intensity range by providing a larger number of quantification levels. Applying a sigmoidal scaling function causes dark and very light areas to exhibit diminished contract, while the limit between light and dark regions is enhanced. [0195]
  • Closing and opening morphological operators, respectively, are used to suppress small regions corresponding to holes or peaks in the images. The geodesic reconstruction keeps the geometrical aspect of the image as close as possible to that of the original image. A morphological closing with geodesic reconstruction is performed on the gradient of the filtered image to remove plateaus, which are visualized as separate regions in the watershed transform. The diameter of the cylinder used as structuring element defines the minimum size of the regions in the segmented image. [0196]
  • Finite-element approximations are used to compute derivatives. Alternative approaches involve using a Sobel operator, which is a 3×3filter. Another alternative is the use of a local cubic polynomial approximation, which is a 5×5 filter. Before processing the gradient for the watershed extraction, application of a threshold removes small values. [0197]
  • In one embodiment, the gradient is computed using cubic mean-square approximation. In another embodiment, a morphological closing/opening filter with geodesic reconstruction is first applied and then the gradient is computed. Spurious regions are smoothed out and contrast enhanced in large regions by both methods. [0198]
  • In one embodiment, the watershed algorithm is modified as follows. The data is represented in floating point, and the interval steps between successive flooded levels is not uniform. Also, each watershed pixel is merged into a neighboring region according to a nearest neighbor criterion. [0199]
  • The region merging step following the watershed transform step reduces over-segmentation. In one embodiment, neighboring regions are merged if an intensity change along their border is greater than a given threshold. Alternatively, neighboring regions are merged if a difference in mean intensity value is greater than a given threshold. [0200]
  • In both embodiments, a map of all border pixels is used. For each segment, a computer computes the difference between the mean value of pixels of each of the two regions under consideration. If the absolute value is below a given value, the segment is removed from the mask, and the regions are merged. The final mask is used to map out the gradient image. The watersheds are recomputed. [0201]
  • An alternative merging algorithm uses the same routines. The alternative algorithm uses the mean value image as input in place of the original image. Since all pixels in a region have the same (mean) value, the algorithm works differently, in that border segments are suppressed if the difference in mean value between neighboring regions is smaller than a given threshold. A morphological distance is an approximation of the distance, in pixels, from a pixel to the nearest segment border. A method to use markers to track the segmentation in time series of images is now presented. The extraction of markers is necessary in order to initialize the flooding process in the watershed transform computed in successive images (e.g., in time-series). [0202]
  • The approach used comprises the steps of finding pixels having minimum value for each region, and selecting the minimum with the largest morphological distance for each region. [0203]
  • The first step selects the minimum value as an initial marker, since the flooding used in the watersheds start at local minima. The pixel with minimum value and largest morphological distance is used to avoid a small deformation of a region pushing a marker outside of the region. [0204]
  • A homotopy modification of the gradient image obtained with the markers is used to suppress catchment basins corresponding to minima that have not been marked, in order to speed up the computation. The homotopy modification of ν is the geodesic reconstruction of ν (mask) from {acute over (ν)} (marker). [0205] υ ~ ( κ , i ) = ( υ ( κ , i ) if ( κ , i ) M max y υ ( κ , i ) o t h e r w i s e .
    Figure US20020127735A1-20020912-M00009
  • In one embodiment, more than one marker per region is considered. Pixels having a morphological distance greater than a given value (typically 2-3) or being at least equal to the largest morphological distance within a given region are considered. These markers are used to zero out gradient values in the following image, in order to reduce influence of local maxima on the homotopy modification. It is assumed that the borders between neighboring regions are located somewhere between the marked regions. [0206]
  • Further, the markers are used to initialize the watershed algorithm with the gradient image of the next image. Tracking schemes are employed to take into account global and local motion. [0207]
  • One illustrative tracking scheme for the detection of patient motion during an acquisition cycle uses the cross-correlation of two sub-images of two successive images to determine the global motion. An alternative algorithm is used to track motion for segmentation tasks. [0208]
  • Typically, images of specimens exhibit large homogeneous regions which are difficult to track. Structural information is used to improve motion tracking. Derivatives are used instead of the original image. Using the gradient improves the system's sensitivity to glare, while the use of the sum of the gradients in both the x and y directions highlights low-contrast structures. Using the Laplacian operator (the sum of second derivatives) provides similar results. Applying a low-pass filter before computing the derivatives yields results similar to the Laplacian of Gaussian used for edge detection. The low pass filter suppresses noise and smoothes out glare. [0209]
  • The embodiment further comprises three modifications. The true cross-correlation of successive images is computed in a 512×512 pixels window. The two windows used for each image are different and are of sizes 302×302 and 210×210, respectively. A Hamming window is used to extract these two signals. The two windows have different sizes to make sure that the second signal is completely contained in the first one, and the use of a Hamming window avoids small oscillations, especially at the transition of the selected signals and the zero-padded areas. The equations used for the motion detection are given below. [0210]
  • Optical flow algorithms are used to measure local motions. In order to save computation time, the optical flow is computed only for the markers. Optical flow is defined as the distribution of apparent velocities of movement of brightness patterns in an image, and is used to reconstruct three-dimensional surfaces in medical imaging applications. [0211]
  • Additional embodiments of motion detection algorithms include the following steps: implementation of a local deformation tracking system for improving the precision of marker tracking; extraction of feature signals from the series of segmentation results; analysis of feature signals and classification into groups of interest; and use of group information to correlate the evolution with the histology. [0212]
  • For motion detection, only a single frame is used. The three RGB color components are transformed into a single intensity component using the following relationship: [0213]
  • I=0.299·R+0.587·G+0.114·B
  • In order to suppress high-frequencies due to noise and to the interlaced video signals, we apply a Gaussian low-pass filter to the intensity component: [0214] g ( x ) = 1 2 πσ 2 exp ( ( x - μ ) T · ( x - μ ) 2 σ 2 )
    Figure US20020127735A1-20020912-M00010
  • where {overscore (μ)} is the center (mean value) of the Gaussian and σ is its standard deviation. Finally, we use only derivative information to compute the translation parameters, either the sum of derivatives [0215] x + y
    Figure US20020127735A1-20020912-M00011
  • or the Laplacian [0216] 2 x 2 + 2 y 2 .
    Figure US20020127735A1-20020912-M00012
  • Motion can be detected using a cross-correlation operator applied to two successive images in a sequence. [0217]
  • The cross-correlation is computed in the Fourier domain using a fast Fourier transform. The following relationship is used: [0218]
  • Φ=X·Y*
  • where Φ, X, and Y are the Fourier transform of the cross-correlation function, the first, and the second signal, respectively. The * symbol represents the complex conjugate. Note that the cross-correlation of two signals of length N[0219] 1 and N2 provides N1+N2−1 values and therefore, in order to avoid aliasing problems due to under-sampling, the two signals must be padded with zeros up to N1+N2−1 samples.
  • For discrete signals (i.e. sampled and quantized signals), the discrete Fourier transform (DFT) and the inverse discrete Fourier transform (IDFT) are given respectively by: [0220] v ( k , l ) = m = 0 N - 1 n = 0 M - 1 u ( m , n ) exp ( - j2πmk N ) exp ( - j2πnl M ) u ( m , n ) = 1 NM k = 0 N - 1 l = 0 M - 1 v ( m , n ) exp ( j2πmk N ) exp ( j2πnl M )
    Figure US20020127735A1-20020912-M00013
  • This transform expands the signal onto an orthonormal basis of exponential functions. Once the inverse discrete transform is computed, the location of the maximum value corresponds to the translation necessary to align both images. [0221]
  • Different types of windows are used for spectral analysis, when only part of a signal is analyzed. The goal is to avoid oscillation around discontinuities (Gibbs phenomenon). A Hamming window can be used, which is given by the following relationship: [0222]
  • ωh(k)=½[1+cos(2πk/N)]
  • where N is the number of samples, k is the sample index, and −N/2<=k<=−N/2. In the frequency domain, the Fourier transform of the signal is convolved with the Fourier transform of the Hamming window. For the two-dimensional case the Hamming window is constructed as a separable function, i.e. ω[0223] h(k,l)=ωh(k)·ωh(k), where (k,l) are the pixel coordinates.
  • As mentioned above, in some embodiments, the cross-correlation of the sum-of-derivatives images is the basis of a motion detection algorithm. [0224]
  • The cross-correlation of two images in a sequence provides information about the translation necessary to obtain the best match in the inner-product sense. However, this does not necessarily mean that the two images are perfectly aligned. A validation method is necessary to measure the “quality” of the matching. [0225]
  • The Sobel operator is given by: [0226] fs = 1 / 8 ( - 1 0 1 - 2 0 2 - 1 0 1 )
    Figure US20020127735A1-20020912-M00014
  • This filter is obtained by convolving the finite element approximation to derivatives with a weight matrix: [0227] fs = 1 / 2 ( 0 0 0 - 1 0 1 0 0 0 ) ** 1 / 4 ( 0 1 0 0 2 0 0 1 0 )
    Figure US20020127735A1-20020912-M00015
  • where ** is the two-dimensional convolution. The second filter in [0228] Equation 2 is a low-pass filter in the direction perpendicular to the derivative operator, which renders the filter less sensitive to noise. The derivative along the y-axis is obtained by using the transposed version of the Sobel operator.
  • Another way to compute derivatives is to use a local polynomial approximation by minimizing the mean-square error (MSE) with the underlying image pixels. The approximation is given by: [0229] υ ( κ , i ) i = 0 8 b i φ i ( κ , i )
    Figure US20020127735A1-20020912-M00016
  • where (k,l) are the coordinates in the local 5×5 domain centered on the current pixel. The b[0230] i coefficients are the optimal weights in the MSE sense and the Φi are orthogonal polynomials (1, k, l, k2−2/3, l2−2/3, kl, (k2−2/3)l, (l2−2/3)k, (k2−2/3)(l2−2/3)). The minimization of the MSE leads to the following filter for the first derivatives: f ρ = 1 50 ( - 2 - 1 0 1 2 - 2 - 1 0 1 2 - 2 - 1 0 1 2 - 2 - 1 0 1 2 - 2 - 1 0 1 2 ) - 17 300 ( - 1 2 0 - 2 1 - 1 2 0 - 2 1 - 1 2 0 - 2 1 - 1 2 0 - 2 1 - 1 2 0 - 2 1 ) + 1 144 ( 4 2 0 - 2 - 4 - 2 - 1 0 1 2 - 4 - 2 0 2 4 - 2 - 1 0 1 2 4 2 0 - 2 - 4 )
    Figure US20020127735A1-20020912-M00017
  • The center of each image is divided into an 8×8 array of blocks of size 32×32. The array is chosen to avoid the image borders. The borders can contain extraneous material, that is, not part of the cervix. In normal use, the physician attempts to keep the cervix in the middle of the image. [0231]
  • For each of the blocks the normalized inner product with the corresponding block in the adjacent motion compensated image is computed: [0232] P i , j = x ε B i , j I 2 ( x ) · I 2 ( x ) x ε B i , j I 1 2 ( x ) · x ε B i , j I 2 2 ( x )
    Figure US20020127735A1-20020912-M00018
  • where B[0233] ij⊂N2 is the domain of definition of block (i,j), and I1,2 are the two processed images. The absolute value of Pi,j is used as a quality measure.
  • The method is used for series of 28 images and the motion is estimated for each of them, except for the first one. Once the motion parameters are determined, the frame is shifted to its computed “correct” location and the above block-based correlation is computed with the previous shifted image. The result obtained when using the intensity values for each image is plotted with the x-axis corresponding to the different blocks while the y-axis corresponds to the different images. For the example presented above, the shifted images match perfectly and the output is zero intensity everywhere. [0234]
  • In an alternative embodiment, in which edge information is the only information used in the matching correlation, the intensity images are replaced with sum-of-derivatives images. To date, this embodiment has provided less favorable motion compensation than the other embodiment. However, the sum-of derivatives approach appears to provide better identification of sudden or gross motion. [0235]
  • While the invention has been particularly shown and described with reference to specific preferred embodiments, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.[0236]

Claims (32)

What is claimed is:
1. A method for monitoring effects of chemical agents on a sample, the method comprising the steps of:
dispensing a plurality of chemical agents on a sample, wherein said chemical agents interact to alter an optical signal produced by said sample, and measuring said altered optical signal.
2. The method of claim 1, wherein said chemical agents interact to produce an additive effect on said optical signal.
3. The method of claim 1, wherein said chemical agents interact to reduce an intensity of said optical signal.
4. The method of claim 1, wherein said optical signal is a light spectrum.
5. The method of claim 4, wherein said light spectrum is a fluorescent spectrum.
6. The method of claim 1, wherein said optical signal is produced by an endogenous chromophore.
7. The method of claim 6, wherein said endogenous chromophore is a flourophore.
8. The method of claim 1, wherein said chemical agents are selected from the group consisting of acetic acid, formic acid, propionic acid, butyric acid, Lugol's iodine, Shiller's iodine, methylene blue, toluidine blue, and indigo carmine.
9. The method of claim 1, wherein said plurality of chemical agents are dispensed substantially simultaneously.
10. The method of claim 1, wherein said chemical agents are dispensed sequentially.
11. The method of claim 1, wherein said optical signal is measured over a predetermined time.
12. The method of claim 1, wherein at least one member of said plurality of chemical agents alters pH of said sample.
13. The method of claim 1, wherein at least one member of said plurality is selected from the group consisting of osmotic agents and ionic agents.
14. A method for monitoring effects of chemical agents on a sample, the method comprising the steps of:
dispensing a chemical agent on a sample, and
measuring a change in response to said chemical agent in an optical signal from an endogenous chromophore in said sample.
15. The method of claim 14, wherein said endogenous chromophore is a flourophore.
16. A method for monitoring effects of a chemical agent on a sample, the method comprising the steps of:
dispensing a chemical agent on a sample,
providing an automated triggering signal to initiate a measurement period relative to said dispensing step, and
measuring a temporal evolution of an optical signal observed from said sample during said measurement period.
17. The method of claim 16, wherein said triggering signal is provided substantially simultaneously with said dispensing step.
18. The method of claim 16, wherein said triggering signal is provided after said dispensing step.
19. The method of claim 16, wherein said measuring step comprises measuring said temporal evolution at at least one predetermined time relative to said triggering signal.
20. The method of claim 1 or 16, wherein said dispensing step comprises dispensing said chemical agent or agents as a mist in a predefined pattern on said tissue.
21. The method of claim 20, wherein said pattern is substantially circular.
22. The method of claim 20, wherein said pattern is substantially annular.
23. The method of claim 20, wherein said mist is a controlled volume.
24. The method of claim 20, wherein said dispensing occurs at a controlled rate.
25. A method for monitoring the effects of a chemical agent on a sample, the method comprising the steps of:
dispensing a chemical agent on a sample,
capturing a plurality of sequential images of said sample during a measurement period,
automatically aligning a subset of said plurality of images to spatially correlate said subset, and
measuring a temporal evolution of an optical signal from said subset of spatially correlated images.
26. The method of claim 25, wherein said aligning step comprises aligning said subset to compensate for relative motion between said sample and an optical device.
27. The method of claim 25, wherein said aligning step comprises aligning said subset to compensate for relative motion between a first portion of said sample and a second portion of said sample.
28. The method of claim 25, wherein said measuring step is performed at predetermined times relative to said dispensing step.
29. The method of claim 25, wherein said sample is selected from the group consisting of cervical tissue, skin, colorectal tissue, and gastric tissue.
30. The method of claim 1, wherein said optical signal is approximated by a decay function.
31. The method of claim 6 or 14, wherein said endogenous molecule is selected from the group consisting of NADH, collagen, elastin, flavins, hemoglobin, and porphyrins.
32. The method of claim 4, wherein said spectrum is produced at least in part by light scattering properties of said tissue.
US10/068,133 1999-12-15 2002-02-05 Methods of monitoring effects of chemical agents on a sample Abandoned US20020127735A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US10/068,133 US20020127735A1 (en) 1999-12-15 2002-02-05 Methods of monitoring effects of chemical agents on a sample
US10/099,881 US7260248B2 (en) 1999-12-15 2002-03-15 Image processing using measures of similarity
US10/273,511 US7187810B2 (en) 1999-12-15 2002-10-18 Methods and systems for correcting image misalignment
US11/633,677 US7406215B2 (en) 1999-12-15 2006-12-04 Methods and systems for correcting image misalignment

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17097299P 1999-12-15 1999-12-15
US09/738,614 US6902935B2 (en) 1999-12-15 2000-12-15 Methods of monitoring effects of chemical agents on a sample
US10/068,133 US20020127735A1 (en) 1999-12-15 2002-02-05 Methods of monitoring effects of chemical agents on a sample

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/738,614 Continuation US6902935B2 (en) 1999-12-15 2000-12-15 Methods of monitoring effects of chemical agents on a sample

Related Child Applications (3)

Application Number Title Priority Date Filing Date
US10/099,881 Continuation-In-Part US7260248B2 (en) 1999-12-15 2002-03-15 Image processing using measures of similarity
US10/273,511 Continuation-In-Part US7187810B2 (en) 1999-12-15 2002-10-18 Methods and systems for correcting image misalignment
US11/633,677 Continuation-In-Part US7406215B2 (en) 1999-12-15 2006-12-04 Methods and systems for correcting image misalignment

Publications (1)

Publication Number Publication Date
US20020127735A1 true US20020127735A1 (en) 2002-09-12

Family

ID=26866607

Family Applications (5)

Application Number Title Priority Date Filing Date
US09/738,614 Expired - Fee Related US6902935B2 (en) 1999-12-15 2000-12-15 Methods of monitoring effects of chemical agents on a sample
US09/738,147 Abandoned US20020007122A1 (en) 1999-12-15 2000-12-15 Methods of diagnosing disease
US10/068,133 Abandoned US20020127735A1 (en) 1999-12-15 2002-02-05 Methods of monitoring effects of chemical agents on a sample
US10/411,777 Abandoned US20030207250A1 (en) 1999-12-15 2003-04-11 Methods of diagnosing disease
US10/911,996 Abandoned US20050064602A1 (en) 1999-12-15 2004-08-05 Methods of monitoring effects of chemical agents on a sample

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US09/738,614 Expired - Fee Related US6902935B2 (en) 1999-12-15 2000-12-15 Methods of monitoring effects of chemical agents on a sample
US09/738,147 Abandoned US20020007122A1 (en) 1999-12-15 2000-12-15 Methods of diagnosing disease

Family Applications After (2)

Application Number Title Priority Date Filing Date
US10/411,777 Abandoned US20030207250A1 (en) 1999-12-15 2003-04-11 Methods of diagnosing disease
US10/911,996 Abandoned US20050064602A1 (en) 1999-12-15 2004-08-05 Methods of monitoring effects of chemical agents on a sample

Country Status (1)

Country Link
US (5) US6902935B2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020107668A1 (en) * 2000-12-15 2002-08-08 Costa Peter J. System for normalizing spectra
WO2004032058A2 (en) * 2002-09-30 2004-04-15 Medispectra, Inc. Methods and systems for correcting image misalignment
US6818903B2 (en) 2002-07-09 2004-11-16 Medispectra, Inc. Method and apparatus for identifying spectral artifacts
US20050090751A1 (en) * 2000-03-28 2005-04-28 Foundation For Research And Technology Method and system for characterization and mapping of tissue lesions
US20050131284A1 (en) * 2002-04-02 2005-06-16 Yeda Research And Development Co. Ltd. Characterization of moving objects in a stationary background
US20060270912A1 (en) * 2003-03-27 2006-11-30 Koninklijke Philips Electronics N.V. Medical imaging system and a method for segmenting an object of interest
US20090163827A1 (en) * 2007-12-20 2009-06-25 Yeda Research And Development Co. Ltd Time-based imaging
US20090221912A1 (en) * 2005-05-06 2009-09-03 Darin Nelson Imaging and analysis of movement of erythrocytes in blood vessels in relation to the cardiac cycle
US20110184272A1 (en) * 2008-06-13 2011-07-28 Kun Zeng Portable Diagnostic Device for Precancerous Lesion of Cervical Cancer
US8005527B2 (en) 2002-07-10 2011-08-23 Luma Imaging Corporation Method of determining a condition of a tissue

Families Citing this family (118)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010041843A1 (en) * 1999-02-02 2001-11-15 Mark Modell Spectral volume microprobe arrays
US6251691B1 (en) 1996-04-25 2001-06-26 Bioarray Solutions, Llc Light-controlled electrokinetic assembly of particles near surfaces
AU759282B2 (en) * 1998-12-23 2003-04-10 Medispectra, Inc. Systems and methods for optical examination of samples
US7260248B2 (en) * 1999-12-15 2007-08-21 Medispectra, Inc. Image processing using measures of similarity
US6902935B2 (en) * 1999-12-15 2005-06-07 Medispectra, Inc. Methods of monitoring effects of chemical agents on a sample
GB2361994B (en) * 2000-05-06 2004-12-08 Astron Clinica Ltd Apparatus and methods for analysing skin histology
ATE319087T1 (en) 2000-06-21 2006-03-15 Bioarray Solutions Ltd MULTI-ANALYTICAL MOLECULAR ANALYSIS BY USING APPLICATION-SPECIFIC RANDOM PARTICLE ARRAYS
US9709559B2 (en) 2000-06-21 2017-07-18 Bioarray Solutions, Ltd. Multianalyte molecular analysis using application-specific random particle arrays
US20060177416A1 (en) 2003-10-14 2006-08-10 Medivas, Llc Polymer particle delivery compositions and methods of use
US7262063B2 (en) 2001-06-21 2007-08-28 Bio Array Solutions, Ltd. Directed assembly of functional heterostructures
US6985612B2 (en) * 2001-10-05 2006-01-10 Mevis - Centrum Fur Medizinische Diagnosesysteme Und Visualisierung Gmbh Computer system and a method for segmentation of a digital image
WO2003034029A2 (en) 2001-10-15 2003-04-24 Bioarray Solutions, Ltd. Multiplexed analysis of polymorphic loci by concurrent interrogation and enzyme-mediated detection
FR2832832A1 (en) * 2001-11-23 2003-05-30 Ge Med Sys Global Tech Co Llc X-ray tomo-densitometry system, especially for identification of lung nodules, wherein ellipsoids are defined relating to nodules or regions of interest and then image processing is applied to determine nodule extent
US20030209518A1 (en) * 2002-05-08 2003-11-13 Taiwan Semiconductor Manufacturing Co., Ltd. Method of detecting abnormal chamber conditions in etcher
US7309867B2 (en) * 2003-04-18 2007-12-18 Medispectra, Inc. Methods and apparatus for characterization of tissue samples
US7469160B2 (en) * 2003-04-18 2008-12-23 Banks Perry S Methods and apparatus for evaluating image focus
WO2004005895A1 (en) * 2002-07-09 2004-01-15 Medispectra, Inc. Methods and apparatus for characterization of tissue samples
US7459696B2 (en) * 2003-04-18 2008-12-02 Schomacker Kevin T Methods and apparatus for calibrating spectral data
US20040208385A1 (en) * 2003-04-18 2004-10-21 Medispectra, Inc. Methods and apparatus for visually enhancing images
US20040208390A1 (en) * 2003-04-18 2004-10-21 Medispectra, Inc. Methods and apparatus for processing image data for use in tissue characterization
US20040064053A1 (en) * 2002-09-30 2004-04-01 Chang Sung K. Diagnostic fluorescence and reflectance
US7526114B2 (en) 2002-11-15 2009-04-28 Bioarray Solutions Ltd. Analysis, secure access to, and transmission of array images
AU2003295774A1 (en) * 2002-11-21 2004-06-18 Cdex, Inc. Methods and appartus for molecular species detection, inspection and classification using ultraviolet fluorescence
JP2006519032A (en) * 2002-12-02 2006-08-24 エダ リサーチ アンド ディベロップメント カンパニー リミティド Characterization of arteriosclerosis by optical imaging
US20060013454A1 (en) * 2003-04-18 2006-01-19 Medispectra, Inc. Systems for identifying, displaying, marking, and treating suspect regions of tissue
US20040215487A1 (en) * 2003-04-25 2004-10-28 Murphey James P. Method for displaying variations in cells and tissues
US20050008253A1 (en) * 2003-07-10 2005-01-13 Joseph Rozgonyi Method and apparatus for eliminating irrelevant luminescent signals
US7927796B2 (en) 2003-09-18 2011-04-19 Bioarray Solutions, Ltd. Number coding for identification of subtypes of coded types of solid phase carriers
TW200521436A (en) 2003-09-22 2005-07-01 Bioarray Solutions Ltd Surface immobilized polyelectrolyte with multiple functional groups capable of covalently bonding to biomolecules
WO2005042763A2 (en) 2003-10-28 2005-05-12 Bioarray Solutions Ltd. Optimization of gene expression analysis using immobilized capture probes
JP2007509629A (en) 2003-10-29 2007-04-19 バイオアレイ ソリューションズ リミテッド Complex nucleic acid analysis by cleavage of double-stranded DNA
DE102004006960B4 (en) * 2004-02-10 2021-03-18 Heidelberg Engineering Gmbh Method and arrangement for obtaining and evaluating high-contrast images of the time-resolved fluorescence of moving objects, for example the fundus of the eye
US7315637B2 (en) * 2004-07-16 2008-01-01 Bioarray Solutions Ltd. Image processing and analysis of array data
US7848889B2 (en) 2004-08-02 2010-12-07 Bioarray Solutions, Ltd. Automated analysis of multiplexed probe-target interaction patterns: pattern matching and allele identification
US20060241501A1 (en) * 2004-09-28 2006-10-26 Zila Pharmaceuticals, Inc. Method and apparatus for detecting abnormal epithelial tissue
US20090118624A1 (en) * 2004-09-28 2009-05-07 Zila Pharmaceuticals, Inc. Device for oral cavity examination
US20080255462A1 (en) * 2004-09-28 2008-10-16 Zila Pharmaceuticals, Inc. Light stick
US20060241494A1 (en) * 2004-09-28 2006-10-26 Zila Pharmaceuticals, Inc. Methods for detecting abnormal epithelial tissue
US20060173358A1 (en) * 2005-01-11 2006-08-03 Olympus Corporation Fluorescence observation endoscope apparatus and fluorescence observation method
US8486629B2 (en) 2005-06-01 2013-07-16 Bioarray Solutions, Ltd. Creation of functionalized microparticle libraries by oligonucleotide ligation or elongation
EP1738682B1 (en) * 2005-07-01 2008-02-13 Ecole Polytechnique Electronic polarimetric imaging system for colposcopy device
JP5191090B2 (en) * 2005-07-15 2013-04-24 オリンパスメディカルシステムズ株式会社 Endoscope device
US7756309B2 (en) * 2005-07-27 2010-07-13 Bioimagene, Inc. Method and system for storing, indexing and searching medical images using anatomical structures of interest
CA2623198C (en) 2005-09-22 2014-08-05 Medivas, Llc Bis-(a-amino)-diol-diester-containing poly(ester amide) and poly(ester urethane) compositions and methods of use
WO2007038246A2 (en) * 2005-09-22 2007-04-05 Medivas, Llc Solid polymer delivery compositions and methods for use thereof
ES2322481T3 (en) * 2005-09-29 2009-06-22 Forth-Photonics Ltd VAGINAL SPECULUM DEVICE.
US7749162B2 (en) 2005-09-29 2010-07-06 Forth Photonics Ltd. Vaginal speculum arrangement
US7787678B2 (en) * 2005-10-07 2010-08-31 Siemens Corporation Devices, systems, and methods for processing images
WO2007084210A2 (en) * 2005-11-10 2007-07-26 Chemimage Corporation System and method for a raman and/or fluorescence colposcope
US20070127793A1 (en) * 2005-11-23 2007-06-07 Beckett Bob L Real-time interactive data analysis management tool
EP1962894A4 (en) * 2005-12-07 2012-11-14 Medivas Llc Method for assembling a polymer-biologic delivery composition
JP5445130B2 (en) * 2006-05-02 2014-03-19 メディバス エルエルシー Delivery of ophthalmic drugs to the exterior or interior of the eye
EP2021141A4 (en) * 2006-05-09 2013-07-03 Medivas Llc Biodegradable water soluble polymers
US20080021301A1 (en) * 2006-06-01 2008-01-24 Marcela Alejandra Gonzalez Methods and Apparatus for Volume Computer Assisted Reading Management and Review
CA2652010C (en) * 2006-06-05 2016-01-05 Forth Photonics Limited Methods for characterizing tissues
US7381972B1 (en) 2006-07-24 2008-06-03 Science Applications International Corporation System and method for light fluorescence detection
US20080144013A1 (en) * 2006-12-01 2008-06-19 Institute For Technology Development System and method for co-registered hyperspectral imaging
AU2008237675A1 (en) * 2007-04-11 2008-10-23 Forth Photonics Limited A supporting structure and a workstation incorporating the supporting structure for improving, objectifying and documenting in vivo examinations of the uterus
CA2687084A1 (en) * 2007-05-11 2008-11-20 Translational Genomics Research Institute Method for determining the effects of external stimuli on biological pathways in living cells
CA2709412A1 (en) * 2007-07-24 2009-01-29 Medivas, Llc Biodegradable cationic polymer gene transfer compositions and methods of use
EP2237190A2 (en) 2007-08-03 2010-10-06 STI Medical Systems, LLC Computerized image analysis for a acetic acid induced cervical intraepithelial neoplasia
US20090062662A1 (en) * 2007-08-27 2009-03-05 Remicalm, Llc Optical spectroscopic device for the identification of cervical cancer
US20090099460A1 (en) * 2007-10-16 2009-04-16 Remicalm Llc Method and device for the optical spectroscopic identification of cervical cancer
JP5235473B2 (en) * 2008-04-04 2013-07-10 Hoya株式会社 Spectral characteristic estimation device
RU2440591C2 (en) 2008-04-10 2012-01-20 Шлюмбергер Текнолоджи Б.В. Method of obtaining characteristics of geological formation intersected by well
US8725477B2 (en) 2008-04-10 2014-05-13 Schlumberger Technology Corporation Method to generate numerical pseudocores using borehole images, digital rock samples, and multi-point statistics
US9042967B2 (en) 2008-05-20 2015-05-26 University Health Network Device and method for wound imaging and monitoring
US8437570B2 (en) * 2008-05-23 2013-05-07 Microsoft Corporation Geodesic image and video processing
US8334900B2 (en) * 2008-07-21 2012-12-18 The Hong Kong University Of Science And Technology Apparatus and method of optical imaging for medical diagnosis
CN102186484A (en) * 2008-08-13 2011-09-14 梅迪沃什有限公司 Aabb-poly(depsipeptide) biodegradable polymers and methods of use
US8731840B2 (en) 2008-10-31 2014-05-20 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US9072799B2 (en) 2008-10-31 2015-07-07 The Invention Science Fund I, Llc Compositions and methods for surface abrasion with frozen particles
US20100111857A1 (en) 2008-10-31 2010-05-06 Boyden Edward S Compositions and methods for surface abrasion with frozen particles
US8721583B2 (en) 2008-10-31 2014-05-13 The Invention Science Fund I, Llc Compositions and methods for surface abrasion with frozen particles
US8788211B2 (en) 2008-10-31 2014-07-22 The Invention Science Fund I, Llc Method and system for comparing tissue ablation or abrasion data to data related to administration of a frozen particle composition
US8762067B2 (en) 2008-10-31 2014-06-24 The Invention Science Fund I, Llc Methods and systems for ablation or abrasion with frozen particles and comparing tissue surface ablation or abrasion data to clinical outcome data
US8518031B2 (en) 2008-10-31 2013-08-27 The Invention Science Fund I, Llc Systems, devices and methods for making or administering frozen particles
US8731841B2 (en) 2008-10-31 2014-05-20 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US8784385B2 (en) 2008-10-31 2014-07-22 The Invention Science Fund I, Llc Frozen piercing implements and methods for piercing a substrate
US9060934B2 (en) 2008-10-31 2015-06-23 The Invention Science Fund I, Llc Compositions and methods for surface abrasion with frozen particles
US8725420B2 (en) 2008-10-31 2014-05-13 The Invention Science Fund I, Llc Compositions and methods for surface abrasion with frozen particles
US9050070B2 (en) 2008-10-31 2015-06-09 The Invention Science Fund I, Llc Compositions and methods for surface abrasion with frozen particles
US9060931B2 (en) 2008-10-31 2015-06-23 The Invention Science Fund I, Llc Compositions and methods for delivery of frozen particle adhesives
US9060926B2 (en) 2008-10-31 2015-06-23 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US9056047B2 (en) 2008-10-31 2015-06-16 The Invention Science Fund I, Llc Compositions and methods for delivery of frozen particle adhesives
US9072688B2 (en) 2008-10-31 2015-07-07 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US8793075B2 (en) 2008-10-31 2014-07-29 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US9050317B2 (en) 2008-10-31 2015-06-09 The Invention Science Fund I, Llc Compositions and methods for therapeutic delivery with frozen particles
US8613937B2 (en) 2008-10-31 2013-12-24 The Invention Science Fund I, Llc Compositions and methods for biological remodeling with frozen particle compositions
US20110004447A1 (en) * 2009-07-01 2011-01-06 Schlumberger Technology Corporation Method to build 3D digital models of porous media using transmitted laser scanning confocal mircoscopy and multi-point statistics
US8311788B2 (en) * 2009-07-01 2012-11-13 Schlumberger Technology Corporation Method to quantify discrete pore shapes, volumes, and surface areas using confocal profilometry
US8351654B2 (en) * 2009-04-28 2013-01-08 Microsoft Corporation Image processing using geodesic forests
JP5506443B2 (en) * 2010-02-10 2014-05-28 オリンパス株式会社 Fluorescence observation equipment
US8559721B1 (en) * 2010-04-28 2013-10-15 Exelis, Inc. Filter mosaic for detection of fugitive emissions
CN102455291B (en) * 2010-10-20 2017-04-12 纳尔科公司 Pollution detection method using fluorescent technique
US9873765B2 (en) 2011-06-23 2018-01-23 Dsm Ip Assets, B.V. Biodegradable polyesteramide copolymers for drug delivery
US9963549B2 (en) 2011-06-23 2018-05-08 Dsm Ip Assets, B.V. Biodegradable polyesteramide copolymers for drug delivery
WO2013075247A1 (en) * 2011-11-23 2013-05-30 Circle Cardiovascular Imaging Inc. Knowledge-based multi-scale histogram analysis
TWI467184B (en) * 2011-12-20 2015-01-01 Univ Nat Cheng Kung Spectrum analysis method and disease examination method
US8781173B2 (en) * 2012-02-28 2014-07-15 Microsoft Corporation Computing high dynamic range photographs
US8994681B2 (en) * 2012-10-19 2015-03-31 Google Inc. Decoding imprecise gestures for gesture-keyboards
JP6053459B2 (en) * 2012-11-01 2016-12-27 住友重機械工業株式会社 Substrate manufacturing method and substrate manufacturing apparatus
EP4235152A3 (en) * 2013-01-28 2023-09-27 Oslo Universitetssykehus HF Assessing circulatory failure
US9500526B2 (en) * 2013-02-01 2016-11-22 Dicon Fiberoptics Inc. High-throughput and high resolution method for measuring the color uniformity of a light spot
GB201312214D0 (en) * 2013-07-08 2013-08-21 Waterford Inst Technology A Measurement Probe
US10448861B2 (en) * 2013-09-06 2019-10-22 Covidien Lp System and method for light based lung visualization
US9270919B2 (en) * 2013-09-24 2016-02-23 Karl Storz Imaging, Inc. Simultaneous display of two or more different sequentially processed images
MX2014011990A (en) 2013-10-04 2015-05-28 Tidi Products Llc Sheath for a medical or dental instrument.
DE202014102353U1 (en) 2014-05-20 2014-05-27 Borcad Cz S.R.O. colposcope
FI128285B (en) 2014-06-27 2020-02-28 Metso Automation Oy Optical multi-channel measurement unit, optical multi-channel detector unit and a measurement method related thereto
CN115989999A (en) 2014-07-24 2023-04-21 大学健康网络 Collection and analysis of data for diagnostic purposes
GB201414631D0 (en) * 2014-08-18 2014-10-01 Univ Singapore Apparatus and methods for simultaneous multimodal nonlinear optical microscopy for label-free bio-imaging
JP6720447B2 (en) 2014-12-18 2020-07-08 ディーエスエム アイピー アセッツ ビー.ブイ.Dsm Ip Assets B.V. Drug delivery system for delivery of acid sensitive drugs
US11129577B2 (en) 2015-02-17 2021-09-28 Telebyte, Inc. Optical cancer detector using deep optical scanning and multi layer neural network
US20160235372A1 (en) * 2015-02-17 2016-08-18 Telebyte, Inc. Portable cancer diagnostic device and system
US10952799B2 (en) * 2017-05-31 2021-03-23 Covidien Lp Systems and methods for navigational bronchoscopy and selective drug delivery
CN108742490A (en) * 2018-05-30 2018-11-06 广州众健医疗科技有限公司 A kind of spectral detection system of diagnosing gastric cancer gastroscope
CN112672677A (en) * 2018-07-31 2021-04-16 维纳·莫塔利 Digital device for facilitating body cavity examination and diagnosis

Citations (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3809072A (en) * 1971-10-07 1974-05-07 Med General Inc Sterile sheath apparatus for fiber optic illuminator with compatible lens
US3945371A (en) * 1972-05-26 1976-03-23 Stuart Lee Adelman Apparatus for inspection and sampling in restricted aperture cavities employing fibre optics
US4017192A (en) * 1975-02-06 1977-04-12 Neotec Corporation Optical analysis of biomedical specimens
US4071020A (en) * 1976-06-03 1978-01-31 Xienta, Inc. Apparatus and methods for performing in-vivo measurements of enzyme activity
US4198571A (en) * 1977-04-28 1980-04-15 National Research Development Corporation Scanning microscopes
US4254421A (en) * 1979-12-05 1981-03-03 Communications Satellite Corporation Integrated confocal electromagnetic wave lens and feed antenna system
US4646722A (en) * 1984-12-10 1987-03-03 Opielab, Inc. Protective endoscope sheath and method of installing same
US4662360A (en) * 1984-10-23 1987-05-05 Intelligent Medical Systems, Inc. Disposable speculum
US4733063A (en) * 1985-12-13 1988-03-22 Hitachi, Ltd. Scanning laser microscope with aperture alignment
US4741326A (en) * 1986-10-01 1988-05-03 Fujinon, Inc. Endoscope disposable sheath
US4800571A (en) * 1988-01-11 1989-01-24 Tektronix, Inc. Timing jitter measurement display
US4803049A (en) * 1984-12-12 1989-02-07 The Regents Of The University Of California pH-sensitive optrode
US4891829A (en) * 1986-11-19 1990-01-02 Exxon Research And Engineering Company Method and apparatus for utilizing an electro-optic detector in a microtomography system
US4997242A (en) * 1988-03-07 1991-03-05 Medical Research Council Achromatic scanning system
US5003979A (en) * 1989-02-21 1991-04-02 University Of Virginia System and method for the noninvasive identification and display of breast lesions and the like
US5011243A (en) * 1986-09-16 1991-04-30 Laser Precision Corporation Reflectance infrared microscope having high radiation throughput
US5083220A (en) * 1990-03-22 1992-01-21 Tandem Scanning Corporation Scanning disks for use in tandem scanning reflected light microscopes and other optical systems
US5091652A (en) * 1990-01-12 1992-02-25 The Regents Of The University Of California Laser excited confocal microscope fluorescence scanner and method
US5101825A (en) * 1988-10-28 1992-04-07 Blackbox, Inc. Method for noninvasive intermittent and/or continuous hemoglobin, arterial oxygen content, and hematocrit determination
US5192980A (en) * 1990-06-27 1993-03-09 A. E. Dixon Apparatus and method for method for spatially- and spectrally-resolved measurements
US5193525A (en) * 1990-11-30 1993-03-16 Vision Sciences Antiglare tip in a sheath for an endoscope
US5199431A (en) * 1985-03-22 1993-04-06 Massachusetts Institute Of Technology Optical needle for spectroscopic diagnosis
USRE34214E (en) * 1984-03-15 1993-04-06 Molecular Dynamics, Inc. Method and apparatus for microphotometering microscope specimens
US5201908A (en) * 1991-06-10 1993-04-13 Endomedical Technologies, Inc. Sheath for protecting endoscope from contamination
US5201318A (en) * 1989-04-24 1993-04-13 Rava Richard P Contour mapping of spectral diagnostics
US5205291A (en) * 1988-11-08 1993-04-27 Health Research, Inc. In vivo fluorescence photometer
US5284149A (en) * 1992-01-23 1994-02-08 Dhadwal Harbans S Method and apparatus for determining the physical characteristics of ocular tissue
US5285490A (en) * 1992-10-22 1994-02-08 Eastman Kodak Company Imaging combination for detecting soft tissue anomalies
US5286964A (en) * 1991-02-19 1994-02-15 Phoenix Laser Systems, Inc. System for detecting, correcting and measuring depth movement of a target
US5289274A (en) * 1991-02-06 1994-02-22 Sony Corporation Electronic image stabilization apparatus
US5294799A (en) * 1993-02-01 1994-03-15 Aslund Nils R D Apparatus for quantitative imaging of multiple fluorophores
US5296700A (en) * 1991-09-12 1994-03-22 Nikon Corporation Fluorescent confocal microscope with chromatic aberration compensation
US5303026A (en) * 1991-02-26 1994-04-12 The Regents Of The University Of California Los Alamos National Laboratory Apparatus and method for spectroscopic analysis of scattering media
US5306902A (en) * 1992-09-01 1994-04-26 International Business Machines Corporation Confocal method and apparatus for focusing in projection lithography
US5313567A (en) * 1991-06-13 1994-05-17 At&T Bell Laboratories Arrangement for determining and displaying volumetric data in an imaging system
US5383874A (en) * 1991-11-08 1995-01-24 Ep Technologies, Inc. Systems for identifying catheters and monitoring their use
US5398685A (en) * 1992-01-10 1995-03-21 Wilk; Peter J. Endoscopic diagnostic system and associated method
US5402768A (en) * 1992-09-01 1995-04-04 Adair; Edwin L. Endoscope with reusable core and disposable sheath with passageways
US5406939A (en) * 1994-02-14 1995-04-18 Bala; Harry Endoscope sheath
US5412563A (en) * 1993-09-16 1995-05-02 General Electric Company Gradient image segmentation method
US5413092A (en) * 1991-06-24 1995-05-09 Xomed-Treace, Inc. Sheath for endoscope
US5413108A (en) * 1993-04-21 1995-05-09 The Research Foundation Of City College Of New York Method and apparatus for mapping a tissue sample for and distinguishing different regions thereof based on luminescence measurements of cancer-indicative native fluorophor
US5415157A (en) * 1993-02-05 1995-05-16 Welcome; Steven Damage preventing endoscope head cover
US5418797A (en) * 1993-01-15 1995-05-23 The United States Of America As Represented By The Secretary Of The Navy Time gated imaging through scattering material using polarization and stimulated raman amplification
US5419311A (en) * 1993-02-18 1995-05-30 Olympus Optical Co., Ltd. Endoscope apparatus of a type having cover for covering the endoscope
US5480775A (en) * 1990-01-26 1996-01-02 Canon Kabushiki Kaisha Method for measuring a specimen by the use of fluorescent light
US5493444A (en) * 1994-04-28 1996-02-20 The United States Of America As Represented By The Secretary Of The Air Force Photorefractive two-beam coupling nonlinear joint transform correlator
US5496259A (en) * 1993-09-13 1996-03-05 Welch Allyn, Inc. Sterile protective sheath and drape for video laparoscope and method of use
US5507295A (en) * 1992-07-01 1996-04-16 British Technology Group Limited Medical devices
US5516010A (en) * 1984-10-23 1996-05-14 Sherwood Medical Company Sanitary speculum for tympanic thermometer probe
US5519545A (en) * 1993-11-30 1996-05-21 Sony Corporation Digital signal recording circuit using a rotary transformer with a reduced-jitter low-frequency compensation circuit
US5596992A (en) * 1993-06-30 1997-01-28 Sandia Corporation Multivariate classification of infrared spectra of cell and tissue samples
US5609560A (en) * 1992-08-19 1997-03-11 Olympus Optical Co., Ltd. Medical operation device control system for controlling a operation devices accessed respectively by ID codes
US5623932A (en) * 1993-05-12 1997-04-29 Board Of Regents, The University Of Texas System Diagnosis of dysplasia using laser induced fluorescence
US5704892A (en) * 1992-09-01 1998-01-06 Adair; Edwin L. Endoscope with reusable core and disposable sheath with passageways
US5713364A (en) * 1995-08-01 1998-02-03 Medispectra, Inc. Spectral volume microprobe analysis of materials
US5720293A (en) * 1991-01-29 1998-02-24 Baxter International Inc. Diagnostic catheter with memory
US5730701A (en) * 1995-09-12 1998-03-24 Olympus Optical Co., Ltd. Endoscope
US5733244A (en) * 1995-03-13 1998-03-31 Asahi Kogaku Kogyo Kabushiki Kaisha Distal end part of endoscope
US5735276A (en) * 1995-03-21 1998-04-07 Lemelson; Jerome Method and apparatus for scanning and evaluating matter
US5746695A (en) * 1993-11-18 1998-05-05 Asahi Kogaku Kogyo Kabushiki Kaisha Front end structure of endoscope
US5855551A (en) * 1997-03-17 1999-01-05 Polartechnics Limited Integral sheathing apparatus for tissue recognition probes
US5860913A (en) * 1996-05-16 1999-01-19 Olympus Optical Co., Ltd. Endoscope whose distal cover can be freely detachably attached to main distal part thereof with high positioning precision
US5863287A (en) * 1995-10-04 1999-01-26 Fuji Photo Optical Co., Ltd. Removable protector sheath for use with endoscopic insertion instrument
US5865726A (en) * 1996-03-27 1999-02-02 Asahi Kogaku Kogyo Kabushiki Kaisha Front end structure of side-view type endoscope
US5871439A (en) * 1995-01-18 1999-02-16 Asahi Kogaku Kogyo Kabushiki Kaisha Endoscope system transmitting a magnification ratio to an external processing device
US5876329A (en) * 1996-08-08 1999-03-02 Vision-Sciences, Inc. Endoscope with sheath retaining device
US5880826A (en) * 1997-07-01 1999-03-09 L J Laboratories, L.L.C. Apparatus and method for measuring optical characteristics of teeth
US5894340A (en) * 1995-02-17 1999-04-13 The Regents Of The University Of California Method for quantifying optical properties of the human lens
US5902246A (en) * 1996-03-26 1999-05-11 Lifespex, Incorporated Method and apparatus for calibrating an optical probe
US6011596A (en) * 1991-05-24 2000-01-04 British Broadcasting Video image motion compensation using an algorithm involving at least two fields
US6021344A (en) * 1996-12-04 2000-02-01 Derma Technologies, Inc. Fluorescence scope system for dermatologic diagnosis
US6026319A (en) * 1997-02-13 2000-02-15 Fuji Photo Film Co., Ltd. Fluorescence detecting system
US6040139A (en) * 1995-09-19 2000-03-21 Bova; G. Steven Laser cell purification system
US6067371A (en) * 1995-11-28 2000-05-23 Dornier Medical Systems, Inc. Method and system for non-invasive temperature mapping of tissue
US6069689A (en) * 1997-04-16 2000-05-30 Derma Technologies, Inc. Apparatus and methods relating to optical systems for diagnosis of skin diseases
US6169817B1 (en) * 1998-11-04 2001-01-02 University Of Rochester System and method for 4D reconstruction and visualization
US6193660B1 (en) * 1999-03-31 2001-02-27 Acuson Corporation Medical diagnostic ultrasound system and method for region of interest determination
US6205235B1 (en) * 1998-07-23 2001-03-20 David Roberts Method and apparatus for the non-invasive imaging of anatomic tissue structures
US6210331B1 (en) * 1996-06-26 2001-04-03 Morphometrix Technologies Inc. Confocal ultrasonic imaging system
US6224256B1 (en) * 1998-06-18 2001-05-01 Harry Bala Cover for medical probe
US6370422B1 (en) * 1998-03-19 2002-04-09 Board Of Regents, The University Of Texas System Fiber-optic confocal imaging apparatus and methods of use
US6373998B2 (en) * 1997-05-21 2002-04-16 Inria Institut National Dn Recherche En Informatique Et En Automatique Image processing electronic device for detecting dimensional variations
US6377842B1 (en) * 1998-09-22 2002-04-23 Aurora Optics, Inc. Method for quantitative measurement of fluorescent and phosphorescent drugs within tissue utilizing a fiber optic probe
US6385484B2 (en) * 1998-12-23 2002-05-07 Medispectra, Inc. Spectroscopic system employing a plurality of data types
US20030207250A1 (en) * 1999-12-15 2003-11-06 Medispectra, Inc. Methods of diagnosing disease
US20040010375A1 (en) * 2002-07-09 2004-01-15 Medispectra, Inc. Methods and apparatus for processing spectral data for use in tissue characterization
US20040010195A1 (en) * 2002-07-10 2004-01-15 Zelenchuk Alex R. Fluorescent fiberoptic probe for tissue health discrimination and method of use thereof
US6697666B1 (en) * 1999-06-22 2004-02-24 Board Of Regents, The University Of Texas System Apparatus for the characterization of tissue of epithelial lined viscus
US6711283B1 (en) * 2000-05-03 2004-03-23 Aperio Technologies, Inc. Fully automatic rapid microscope slide scanner
US6718055B1 (en) * 2000-12-05 2004-04-06 Koninklijke Philips Electronics, N.V. Temporal and spatial correction for perfusion quantification system
US6717668B2 (en) * 2000-03-07 2004-04-06 Chemimage Corporation Simultaneous imaging and spectroscopy apparatus
US20040204648A1 (en) * 2002-07-09 2004-10-14 Medispectra, Inc. Optimal windows for obtaining optical data for characterization of tissue samples
US6839661B2 (en) * 2000-12-15 2005-01-04 Medispectra, Inc. System for normalizing spectra
US6847490B1 (en) * 1997-01-13 2005-01-25 Medispectra, Inc. Optical probe accessory device for use in vivo diagnostic procedures
US20050054936A1 (en) * 2000-03-28 2005-03-10 Constantinos Balas Method and system for characterization and mapping of tissue lesions
US6885763B2 (en) * 2000-08-18 2005-04-26 Ge Medical Systems Global Technology Company, Llc Image processing method and apparatus, recording medium, and imaging apparatus

Family Cites Families (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US242393A (en) * 1881-05-31 Governor
US242398A (en) * 1881-05-31 Lye-trough for soap-makers
US598315A (en) * 1898-02-01 Toilet-paper
US242396A (en) * 1881-05-31 Bridge-truss
US453964A (en) * 1891-06-09 John cone
US453962A (en) * 1891-06-09 Linotype-machine
US453832A (en) * 1891-06-09 Snow-plow
US460821A (en) * 1891-10-06 Apparatus for cutting or marking artificial stone pavements
US242397A (en) * 1881-05-31 Process of desulphurizing ores
US453963A (en) * 1891-06-09 Edward a
US3013467A (en) 1957-11-07 1961-12-19 Minsky Marvin Microscopy apparatus
US3632865A (en) * 1969-12-23 1972-01-04 Bell Telephone Labor Inc Predictive video encoding using measured subject velocity
FR2430754A1 (en) * 1978-07-13 1980-02-08 Groux Jean ULTRAVIOLET ENDOSCOPE
US4357075A (en) 1979-07-02 1982-11-02 Hunter Thomas M Confocal reflector system
US4349510A (en) * 1979-07-24 1982-09-14 Seppo Kolehmainen Method and apparatus for measurement of samples by luminescence
DE2951459C2 (en) 1979-12-20 1984-03-29 Heimann Gmbh, 6200 Wiesbaden Optical arrangement for a smoke detector based on the light scattering principle
US4515165A (en) * 1980-02-04 1985-05-07 Energy Conversion Devices, Inc. Apparatus and method for detecting tumors
ATE23752T1 (en) * 1980-08-21 1986-12-15 Oriel Scient Ltd OPTICAL ANALYZER.
US4396579A (en) * 1981-08-06 1983-08-02 Miles Laboratories, Inc. Luminescence detection device
AU556742B2 (en) 1982-02-01 1986-11-20 Sony Corporation Digital tape jitter compensation
JPS5952359A (en) 1982-09-02 1984-03-26 Hitachi Medical Corp Automatic corrector for picture distortion during inter-picture operation
US5139025A (en) 1983-10-14 1992-08-18 Somanetics Corporation Method and apparatus for in vivo optical spectroscopic examination
US4641352A (en) * 1984-07-12 1987-02-03 Paul Fenster Misregistration correction
US4930516B1 (en) * 1985-11-13 1998-08-04 Laser Diagnostic Instr Inc Method for detecting cancerous tissue using visible native luminescence
US5042494A (en) 1985-11-13 1991-08-27 Alfano Robert R Method and apparatus for detecting cancerous tissue using luminescence excitation spectra
GB8529889D0 (en) * 1985-12-04 1986-01-15 Cardiff Energy & Resources Luminometer construction
NL8600422A (en) * 1986-02-20 1987-09-16 Philips Nv TRANSCONDUCTION AMPLIFIER.
JPS62247232A (en) 1986-04-21 1987-10-28 Agency Of Ind Science & Technol Fluorescence measuring apparatus
US4852955A (en) 1986-09-16 1989-08-01 Laser Precision Corporation Microscope for use in modular FTIR spectrometer system
NL8603108A (en) * 1986-12-08 1988-07-01 Philips Nv MICROSALE.
NZ223988A (en) 1987-03-24 1990-11-27 Commw Scient Ind Res Org Optical distance measuring
US5235457A (en) 1987-09-24 1993-08-10 Washington University Kit for converting a standard microscope into a single aperture confocal scanning epi-illumination microscope
US4945478A (en) * 1987-11-06 1990-07-31 Center For Innovative Technology Noninvasive medical imaging system and method for the identification and 3-D display of atherosclerosis and the like
US4844617A (en) * 1988-01-20 1989-07-04 Tencor Instruments Confocal measuring microscope with automatic focusing
FR2626383B1 (en) 1988-01-27 1991-10-25 Commissariat Energie Atomique EXTENDED FIELD SCAN AND DEPTH CONFOCAL OPTICAL MICROSCOPY AND DEVICES FOR CARRYING OUT THE METHOD
US5032720A (en) * 1988-04-21 1991-07-16 White John G Confocal imaging system
US4877033A (en) 1988-05-04 1989-10-31 Seitz Jr H Michael Disposable needle guide and examination sheath for transvaginal ultrasound procedures
DE8808299U1 (en) 1988-06-25 1989-07-20 Effner Gmbh, 1000 Berlin, De
EP0393165B2 (en) * 1988-07-13 2007-07-25 Optiscan Pty Ltd Scanning confocal endoscope
CA1325537C (en) 1988-08-01 1993-12-28 Timothy Peter Dabbs Confocal microscope
US5036853A (en) 1988-08-26 1991-08-06 Polartechnics Ltd. Physiological probe
US4972258A (en) 1989-07-31 1990-11-20 E. I. Du Pont De Nemours And Company Scanning laser microscope system and methods of use
US5419323A (en) * 1988-12-21 1995-05-30 Massachusetts Institute Of Technology Method for laser induced fluorescence of tissue
US5022757A (en) * 1989-01-23 1991-06-11 Modell Mark D Heterodyne system and method for sensing a target substance
US4878485A (en) 1989-02-03 1989-11-07 Adair Edwin Lloyd Rigid video endoscope with heat sterilizable sheath
US5421337A (en) * 1989-04-14 1995-06-06 Massachusetts Institute Of Technology Spectral diagnosis of diseased tissue
JPH0378720A (en) * 1989-08-22 1991-04-03 Nikon Corp Confocal laser scanning microscope
US5065008A (en) 1989-10-18 1991-11-12 Fuji Photo Film Co., Ltd. Scanning microscope and scanning mechanism for the same
DE8912757U1 (en) 1989-10-27 1989-12-07 Fa. Carl Zeiss, 7920 Heidenheim, De
US4979498A (en) 1989-10-30 1990-12-25 Machida Incorporated Video cervicoscope system
US5034613A (en) * 1989-11-14 1991-07-23 Cornell Research Foundation, Inc. Two-photon laser microscopy
US5257617A (en) 1989-12-25 1993-11-02 Asahi Kogaku Kogyo Kabushiki Kaisha Sheathed endoscope and sheath therefor
US5028802A (en) * 1990-01-11 1991-07-02 Eye Research Institute Of Retina Foundation Imaging apparatus and methods utilizing scannable microlaser source
US5274240A (en) 1990-01-12 1993-12-28 The Regents Of The University Of California Capillary array confocal fluorescence scanner and method
JPH0742401Y2 (en) 1990-02-01 1995-10-04 株式会社町田製作所 Endoscope cover
JPH03101903U (en) 1990-02-01 1991-10-23
US5074306A (en) 1990-02-22 1991-12-24 The General Hospital Corporation Measurement of burn depth in skin
JP2613118B2 (en) * 1990-04-10 1997-05-21 富士写真フイルム株式会社 Confocal scanning microscope
EP0458601B1 (en) 1990-05-22 1996-08-28 Research Development Corporation Of Japan Method of and apparatus for measuring spectral absorption in opaque specimens and method of and apparatus for measuring microscopic absorption distribution
GB9016587D0 (en) 1990-07-27 1990-09-12 Isis Innovation Infra-red scanning microscopy
US5324979A (en) * 1990-09-26 1994-06-28 Futrex, Inc. Method and means for generating synthetic spectra allowing quantitative measurement in near infrared measuring instruments
US5239178A (en) 1990-11-10 1993-08-24 Carl Zeiss Optical device with an illuminating grid and detector grid arranged confocally to an object
US5168157A (en) 1990-11-20 1992-12-01 Fuji Photo Film Co., Ltd. Scanning microscope with means for detecting a first and second polarized light beams along first and second optical receiving paths
US5261410A (en) 1991-02-07 1993-11-16 Alfano Robert R Method for determining if a tissue is a malignant tumor tissue, a benign tumor tissue, or a normal or benign tissue using Raman spectroscopy
US5260578A (en) 1991-04-10 1993-11-09 Mayo Foundation For Medical Education And Research Confocal imaging system for visible and ultraviolet light
DE4111903A1 (en) * 1991-04-12 1992-10-15 Bayer Ag SPECTROSCOPY-CORRECTED LIGHT-SCREEN MICROSCOPY
US5321501A (en) * 1991-04-29 1994-06-14 Massachusetts Institute Of Technology Method and apparatus for optical imaging with means for controlling the longitudinal range of the sample
JP2975719B2 (en) * 1991-05-29 1999-11-10 オリンパス光学工業株式会社 Confocal optics
US5319200A (en) * 1991-06-05 1994-06-07 Zeltex, Inc. Rapid near-infrared measurement of nonhomogeneous samples
US5769792A (en) * 1991-07-03 1998-06-23 Xillix Technologies Corp. Endoscopic imaging system for diseased tissue
US5203328A (en) * 1991-07-17 1993-04-20 Georgia Tech Research Corporation Apparatus and methods for quantitatively measuring molecular changes in the ocular lens
US5162941A (en) 1991-07-23 1992-11-10 The Board Of Governors Of Wayne State University Confocal microscope
JPH0527177A (en) 1991-07-25 1993-02-05 Fuji Photo Film Co Ltd Scanning type microscope
JP3018687B2 (en) 1991-12-12 2000-03-13 松下電器産業株式会社 Scanning laser microscope
US5253071A (en) 1991-12-20 1993-10-12 Sony Corporation Of America Method and apparatus for stabilizing an image produced in a video camera
US5248876A (en) 1992-04-21 1993-09-28 International Business Machines Corporation Tandem linear scanning confocal imaging system with focal volumes at different heights
US5325846A (en) * 1992-07-27 1994-07-05 Linvatec Corporation Endoscopic draping apparatus and method
US5643175A (en) * 1992-09-01 1997-07-01 Adair; Edwin L. Sterilizable endoscope with separable disposable tube assembly
US5337734A (en) 1992-10-29 1994-08-16 Advanced Polymers, Incorporated Disposable sheath with optically transparent window formed continuously integral therewith
US5469853A (en) * 1992-12-11 1995-11-28 Tetrad Corporation Bendable ultrasonic probe and sheath for use therewith
US5536236A (en) * 1993-02-12 1996-07-16 Olympus Optical Co., Ltd. Covered endoscope system
US5424543A (en) * 1993-04-19 1995-06-13 Surface Optics Corporation Imaging spectroradiometer
US5529235A (en) * 1994-04-28 1996-06-25 Ethicon Endo-Surgery, Inc. Identification device for surgical instrument
US5599717A (en) * 1994-09-02 1997-02-04 Martin Marietta Energy Systems, Inc. Advanced synchronous luminescence system
US5612540A (en) * 1995-03-31 1997-03-18 Board Of Regents, The University Of Texas Systems Optical method for the detection of cervical neoplasias using fluorescence spectroscopy
JP3543027B2 (en) * 1995-04-10 2004-07-14 オリンパス株式会社 Curved sheath for probe
US5647368A (en) * 1996-02-28 1997-07-15 Xillix Technologies Corp. Imaging system for detecting diseased tissue using native fluorsecence in the gastrointestinal and respiratory tract
US5717209A (en) * 1996-04-29 1998-02-10 Petrometrix Ltd. System for remote transmission of spectral information through communication optical fibers for real-time on-line hydrocarbons process analysis by near infra red spectroscopy
US5768333A (en) * 1996-12-02 1998-06-16 Philips Electronics N.A. Corporation Mass detection in digital radiologic images using a two stage classifier
US5941834A (en) * 1997-03-17 1999-08-24 Polartechnics Limited Sheath for a side view probe
US5830146A (en) * 1997-03-17 1998-11-03 Polartechnics Limited Sheathed probes for tissue type recognition
US5920399A (en) * 1997-03-18 1999-07-06 Sandia Corporation Multispectral imaging method and apparatus
US6124597A (en) * 1997-07-07 2000-09-26 Cedars-Sinai Medical Center Method and devices for laser induced fluorescence attenuation spectroscopy
US6096065A (en) * 1997-09-29 2000-08-01 Boston Scientific Corporation Sheath for tissue spectroscopy
US6058322A (en) * 1997-07-25 2000-05-02 Arch Development Corporation Methods for improving the accuracy in differential diagnosis on radiologic examinations
WO1999020313A1 (en) * 1997-10-20 1999-04-29 The Board Of Regents, The University Of Texas System Acetic acid as a contrast agent in reflectance confocal imaging of tissue
WO1999057529A1 (en) * 1998-05-04 1999-11-11 The Board Of Regents Combined fluorescence and reflectance spectroscopy
US6243601B1 (en) * 1998-09-18 2001-06-05 Abund Ottokar Wist Transillumination imaging instrumentation with scattered light discrimination
US6208887B1 (en) * 1999-06-24 2001-03-27 Richard H. Clarke Catheter-delivered low resolution Raman scattering analyzing system for detecting lesions
JP2001157658A (en) * 1999-12-02 2001-06-12 Fuji Photo Film Co Ltd Fluorescent image display device
USD453964S1 (en) * 2001-02-09 2002-02-26 Medispectra, Inc. Sheath for cervical optical probe
USD453832S1 (en) * 2001-02-09 2002-02-19 Medispectra, Inc. Sheath for cervical optical probe
USD453963S1 (en) * 2001-02-09 2002-02-26 Medispectra, Inc. Sheath for cervical optical probe
US7103401B2 (en) * 2002-07-10 2006-09-05 Medispectra, Inc. Colonic polyp discrimination by tissue fluorescence and fiberoptic probe

Patent Citations (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3809072A (en) * 1971-10-07 1974-05-07 Med General Inc Sterile sheath apparatus for fiber optic illuminator with compatible lens
US3945371A (en) * 1972-05-26 1976-03-23 Stuart Lee Adelman Apparatus for inspection and sampling in restricted aperture cavities employing fibre optics
US4017192A (en) * 1975-02-06 1977-04-12 Neotec Corporation Optical analysis of biomedical specimens
US4071020A (en) * 1976-06-03 1978-01-31 Xienta, Inc. Apparatus and methods for performing in-vivo measurements of enzyme activity
US4198571A (en) * 1977-04-28 1980-04-15 National Research Development Corporation Scanning microscopes
US4254421A (en) * 1979-12-05 1981-03-03 Communications Satellite Corporation Integrated confocal electromagnetic wave lens and feed antenna system
USRE34214E (en) * 1984-03-15 1993-04-06 Molecular Dynamics, Inc. Method and apparatus for microphotometering microscope specimens
US5707343A (en) * 1984-10-23 1998-01-13 O'hara; Gary J. Disposable sanitary speculum for timpanic thermometer probe
US5516010A (en) * 1984-10-23 1996-05-14 Sherwood Medical Company Sanitary speculum for tympanic thermometer probe
US4662360A (en) * 1984-10-23 1987-05-05 Intelligent Medical Systems, Inc. Disposable speculum
US4646722A (en) * 1984-12-10 1987-03-03 Opielab, Inc. Protective endoscope sheath and method of installing same
US4803049A (en) * 1984-12-12 1989-02-07 The Regents Of The University Of California pH-sensitive optrode
US5199431A (en) * 1985-03-22 1993-04-06 Massachusetts Institute Of Technology Optical needle for spectroscopic diagnosis
US4733063A (en) * 1985-12-13 1988-03-22 Hitachi, Ltd. Scanning laser microscope with aperture alignment
US5011243A (en) * 1986-09-16 1991-04-30 Laser Precision Corporation Reflectance infrared microscope having high radiation throughput
US4741326A (en) * 1986-10-01 1988-05-03 Fujinon, Inc. Endoscope disposable sheath
US4891829A (en) * 1986-11-19 1990-01-02 Exxon Research And Engineering Company Method and apparatus for utilizing an electro-optic detector in a microtomography system
US4800571A (en) * 1988-01-11 1989-01-24 Tektronix, Inc. Timing jitter measurement display
US4997242A (en) * 1988-03-07 1991-03-05 Medical Research Council Achromatic scanning system
US5101825A (en) * 1988-10-28 1992-04-07 Blackbox, Inc. Method for noninvasive intermittent and/or continuous hemoglobin, arterial oxygen content, and hematocrit determination
US5205291A (en) * 1988-11-08 1993-04-27 Health Research, Inc. In vivo fluorescence photometer
US5003979A (en) * 1989-02-21 1991-04-02 University Of Virginia System and method for the noninvasive identification and display of breast lesions and the like
US5201318A (en) * 1989-04-24 1993-04-13 Rava Richard P Contour mapping of spectral diagnostics
US5091652A (en) * 1990-01-12 1992-02-25 The Regents Of The University Of California Laser excited confocal microscope fluorescence scanner and method
US5480775A (en) * 1990-01-26 1996-01-02 Canon Kabushiki Kaisha Method for measuring a specimen by the use of fluorescent light
US5083220A (en) * 1990-03-22 1992-01-21 Tandem Scanning Corporation Scanning disks for use in tandem scanning reflected light microscopes and other optical systems
US5192980A (en) * 1990-06-27 1993-03-09 A. E. Dixon Apparatus and method for method for spatially- and spectrally-resolved measurements
US5193525A (en) * 1990-11-30 1993-03-16 Vision Sciences Antiglare tip in a sheath for an endoscope
US5720293A (en) * 1991-01-29 1998-02-24 Baxter International Inc. Diagnostic catheter with memory
US5289274A (en) * 1991-02-06 1994-02-22 Sony Corporation Electronic image stabilization apparatus
US5286964A (en) * 1991-02-19 1994-02-15 Phoenix Laser Systems, Inc. System for detecting, correcting and measuring depth movement of a target
US5303026A (en) * 1991-02-26 1994-04-12 The Regents Of The University Of California Los Alamos National Laboratory Apparatus and method for spectroscopic analysis of scattering media
US6011596A (en) * 1991-05-24 2000-01-04 British Broadcasting Video image motion compensation using an algorithm involving at least two fields
US5201908A (en) * 1991-06-10 1993-04-13 Endomedical Technologies, Inc. Sheath for protecting endoscope from contamination
US5313567A (en) * 1991-06-13 1994-05-17 At&T Bell Laboratories Arrangement for determining and displaying volumetric data in an imaging system
US5413092A (en) * 1991-06-24 1995-05-09 Xomed-Treace, Inc. Sheath for endoscope
US5296700A (en) * 1991-09-12 1994-03-22 Nikon Corporation Fluorescent confocal microscope with chromatic aberration compensation
US5383874A (en) * 1991-11-08 1995-01-24 Ep Technologies, Inc. Systems for identifying catheters and monitoring their use
US5398685A (en) * 1992-01-10 1995-03-21 Wilk; Peter J. Endoscopic diagnostic system and associated method
US5284149A (en) * 1992-01-23 1994-02-08 Dhadwal Harbans S Method and apparatus for determining the physical characteristics of ocular tissue
US5507295A (en) * 1992-07-01 1996-04-16 British Technology Group Limited Medical devices
US5609560A (en) * 1992-08-19 1997-03-11 Olympus Optical Co., Ltd. Medical operation device control system for controlling a operation devices accessed respectively by ID codes
US5306902A (en) * 1992-09-01 1994-04-26 International Business Machines Corporation Confocal method and apparatus for focusing in projection lithography
US5402768A (en) * 1992-09-01 1995-04-04 Adair; Edwin L. Endoscope with reusable core and disposable sheath with passageways
US5704892A (en) * 1992-09-01 1998-01-06 Adair; Edwin L. Endoscope with reusable core and disposable sheath with passageways
US5285490A (en) * 1992-10-22 1994-02-08 Eastman Kodak Company Imaging combination for detecting soft tissue anomalies
US5418797A (en) * 1993-01-15 1995-05-23 The United States Of America As Represented By The Secretary Of The Navy Time gated imaging through scattering material using polarization and stimulated raman amplification
US5294799A (en) * 1993-02-01 1994-03-15 Aslund Nils R D Apparatus for quantitative imaging of multiple fluorophores
US5415157A (en) * 1993-02-05 1995-05-16 Welcome; Steven Damage preventing endoscope head cover
US5419311A (en) * 1993-02-18 1995-05-30 Olympus Optical Co., Ltd. Endoscope apparatus of a type having cover for covering the endoscope
US5413108A (en) * 1993-04-21 1995-05-09 The Research Foundation Of City College Of New York Method and apparatus for mapping a tissue sample for and distinguishing different regions thereof based on luminescence measurements of cancer-indicative native fluorophor
US5623932A (en) * 1993-05-12 1997-04-29 Board Of Regents, The University Of Texas System Diagnosis of dysplasia using laser induced fluorescence
US5596992A (en) * 1993-06-30 1997-01-28 Sandia Corporation Multivariate classification of infrared spectra of cell and tissue samples
US5496259A (en) * 1993-09-13 1996-03-05 Welch Allyn, Inc. Sterile protective sheath and drape for video laparoscope and method of use
US5412563A (en) * 1993-09-16 1995-05-02 General Electric Company Gradient image segmentation method
US5746695A (en) * 1993-11-18 1998-05-05 Asahi Kogaku Kogyo Kabushiki Kaisha Front end structure of endoscope
US5519545A (en) * 1993-11-30 1996-05-21 Sony Corporation Digital signal recording circuit using a rotary transformer with a reduced-jitter low-frequency compensation circuit
US5406939A (en) * 1994-02-14 1995-04-18 Bala; Harry Endoscope sheath
US5493444A (en) * 1994-04-28 1996-02-20 The United States Of America As Represented By The Secretary Of The Air Force Photorefractive two-beam coupling nonlinear joint transform correlator
US5871439A (en) * 1995-01-18 1999-02-16 Asahi Kogaku Kogyo Kabushiki Kaisha Endoscope system transmitting a magnification ratio to an external processing device
US5894340A (en) * 1995-02-17 1999-04-13 The Regents Of The University Of California Method for quantifying optical properties of the human lens
US5733244A (en) * 1995-03-13 1998-03-31 Asahi Kogaku Kogyo Kabushiki Kaisha Distal end part of endoscope
US5735276A (en) * 1995-03-21 1998-04-07 Lemelson; Jerome Method and apparatus for scanning and evaluating matter
US5713364A (en) * 1995-08-01 1998-02-03 Medispectra, Inc. Spectral volume microprobe analysis of materials
US5730701A (en) * 1995-09-12 1998-03-24 Olympus Optical Co., Ltd. Endoscope
US6040139A (en) * 1995-09-19 2000-03-21 Bova; G. Steven Laser cell purification system
US5863287A (en) * 1995-10-04 1999-01-26 Fuji Photo Optical Co., Ltd. Removable protector sheath for use with endoscopic insertion instrument
US6067371A (en) * 1995-11-28 2000-05-23 Dornier Medical Systems, Inc. Method and system for non-invasive temperature mapping of tissue
US5902246A (en) * 1996-03-26 1999-05-11 Lifespex, Incorporated Method and apparatus for calibrating an optical probe
US5865726A (en) * 1996-03-27 1999-02-02 Asahi Kogaku Kogyo Kabushiki Kaisha Front end structure of side-view type endoscope
US5860913A (en) * 1996-05-16 1999-01-19 Olympus Optical Co., Ltd. Endoscope whose distal cover can be freely detachably attached to main distal part thereof with high positioning precision
US6210331B1 (en) * 1996-06-26 2001-04-03 Morphometrix Technologies Inc. Confocal ultrasonic imaging system
US5876329A (en) * 1996-08-08 1999-03-02 Vision-Sciences, Inc. Endoscope with sheath retaining device
US6021344A (en) * 1996-12-04 2000-02-01 Derma Technologies, Inc. Fluorescence scope system for dermatologic diagnosis
US6847490B1 (en) * 1997-01-13 2005-01-25 Medispectra, Inc. Optical probe accessory device for use in vivo diagnostic procedures
US6026319A (en) * 1997-02-13 2000-02-15 Fuji Photo Film Co., Ltd. Fluorescence detecting system
US5855551A (en) * 1997-03-17 1999-01-05 Polartechnics Limited Integral sheathing apparatus for tissue recognition probes
US6069689A (en) * 1997-04-16 2000-05-30 Derma Technologies, Inc. Apparatus and methods relating to optical systems for diagnosis of skin diseases
US6373998B2 (en) * 1997-05-21 2002-04-16 Inria Institut National Dn Recherche En Informatique Et En Automatique Image processing electronic device for detecting dimensional variations
US5880826A (en) * 1997-07-01 1999-03-09 L J Laboratories, L.L.C. Apparatus and method for measuring optical characteristics of teeth
US6370422B1 (en) * 1998-03-19 2002-04-09 Board Of Regents, The University Of Texas System Fiber-optic confocal imaging apparatus and methods of use
US6224256B1 (en) * 1998-06-18 2001-05-01 Harry Bala Cover for medical probe
US6205235B1 (en) * 1998-07-23 2001-03-20 David Roberts Method and apparatus for the non-invasive imaging of anatomic tissue structures
US6377842B1 (en) * 1998-09-22 2002-04-23 Aurora Optics, Inc. Method for quantitative measurement of fluorescent and phosphorescent drugs within tissue utilizing a fiber optic probe
US6169817B1 (en) * 1998-11-04 2001-01-02 University Of Rochester System and method for 4D reconstruction and visualization
US6385484B2 (en) * 1998-12-23 2002-05-07 Medispectra, Inc. Spectroscopic system employing a plurality of data types
US6193660B1 (en) * 1999-03-31 2001-02-27 Acuson Corporation Medical diagnostic ultrasound system and method for region of interest determination
US6697666B1 (en) * 1999-06-22 2004-02-24 Board Of Regents, The University Of Texas System Apparatus for the characterization of tissue of epithelial lined viscus
US20030207250A1 (en) * 1999-12-15 2003-11-06 Medispectra, Inc. Methods of diagnosing disease
US6717668B2 (en) * 2000-03-07 2004-04-06 Chemimage Corporation Simultaneous imaging and spectroscopy apparatus
US20050054936A1 (en) * 2000-03-28 2005-03-10 Constantinos Balas Method and system for characterization and mapping of tissue lesions
US20050090751A1 (en) * 2000-03-28 2005-04-28 Foundation For Research And Technology Method and system for characterization and mapping of tissue lesions
US6711283B1 (en) * 2000-05-03 2004-03-23 Aperio Technologies, Inc. Fully automatic rapid microscope slide scanner
US6885763B2 (en) * 2000-08-18 2005-04-26 Ge Medical Systems Global Technology Company, Llc Image processing method and apparatus, recording medium, and imaging apparatus
US6718055B1 (en) * 2000-12-05 2004-04-06 Koninklijke Philips Electronics, N.V. Temporal and spatial correction for perfusion quantification system
US6839661B2 (en) * 2000-12-15 2005-01-04 Medispectra, Inc. System for normalizing spectra
US20040010375A1 (en) * 2002-07-09 2004-01-15 Medispectra, Inc. Methods and apparatus for processing spectral data for use in tissue characterization
US20040204648A1 (en) * 2002-07-09 2004-10-14 Medispectra, Inc. Optimal windows for obtaining optical data for characterization of tissue samples
US20040010195A1 (en) * 2002-07-10 2004-01-15 Zelenchuk Alex R. Fluorescent fiberoptic probe for tissue health discrimination and method of use thereof

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7974683B2 (en) 2000-03-28 2011-07-05 Forth Photonics Ltd. Method and system for characterization and mapping of tissue lesions via light and special chemical agents
US20090253991A1 (en) * 2000-03-28 2009-10-08 Forth Photonics Limited Method and system for characterization and mapping of tissue lesions
US8173432B2 (en) 2000-03-28 2012-05-08 Forth Photonics Ltd. Method and system for characterization and mapping of tissue lesions
US20050090751A1 (en) * 2000-03-28 2005-04-28 Foundation For Research And Technology Method and system for characterization and mapping of tissue lesions
US20060141633A1 (en) * 2000-03-28 2006-06-29 The Foundation Of Research And Technology Hellas Method and system for characterization and mapping of tissue lesions
US7598088B2 (en) 2000-03-28 2009-10-06 Forth Photonics Ltd. Optical imaging method and system for characterization and mapping of tissue lesions
US7515952B2 (en) 2000-03-28 2009-04-07 Forth Photonics Limited System for characterization and mapping of tissue lesions
US6839661B2 (en) * 2000-12-15 2005-01-04 Medispectra, Inc. System for normalizing spectra
US20020107668A1 (en) * 2000-12-15 2002-08-08 Costa Peter J. System for normalizing spectra
US20050131284A1 (en) * 2002-04-02 2005-06-16 Yeda Research And Development Co. Ltd. Characterization of moving objects in a stationary background
US7912534B2 (en) * 2002-04-02 2011-03-22 Yeda Research And Development Co. Ltd. Characterization of moving objects in a stationary background
US6818903B2 (en) 2002-07-09 2004-11-16 Medispectra, Inc. Method and apparatus for identifying spectral artifacts
US8005527B2 (en) 2002-07-10 2011-08-23 Luma Imaging Corporation Method of determining a condition of a tissue
WO2004032058A3 (en) * 2002-09-30 2004-06-17 Medispectra Inc Methods and systems for correcting image misalignment
WO2004032058A2 (en) * 2002-09-30 2004-04-15 Medispectra, Inc. Methods and systems for correcting image misalignment
US20060270912A1 (en) * 2003-03-27 2006-11-30 Koninklijke Philips Electronics N.V. Medical imaging system and a method for segmenting an object of interest
US9251593B2 (en) * 2003-03-27 2016-02-02 Koninklijke Philips N.V. Medical imaging system and a method for segmenting an object of interest
US20090221912A1 (en) * 2005-05-06 2009-09-03 Darin Nelson Imaging and analysis of movement of erythrocytes in blood vessels in relation to the cardiac cycle
US8172763B2 (en) 2005-05-06 2012-05-08 Yeda Research And Development Co., Ltd. Imaging and analysis of movement of erythrocytes in blood vessels in relation to the cardiac cycle
US8403862B2 (en) 2007-12-20 2013-03-26 Yeda Research And Development Co. Ltd. Time-based imaging
US20090163827A1 (en) * 2007-12-20 2009-06-25 Yeda Research And Development Co. Ltd Time-based imaging
US20110184272A1 (en) * 2008-06-13 2011-07-28 Kun Zeng Portable Diagnostic Device for Precancerous Lesion of Cervical Cancer

Also Published As

Publication number Publication date
US20020007122A1 (en) 2002-01-17
US20030207250A1 (en) 2003-11-06
US20020197728A1 (en) 2002-12-26
US20050064602A1 (en) 2005-03-24
US6902935B2 (en) 2005-06-07

Similar Documents

Publication Publication Date Title
US6902935B2 (en) Methods of monitoring effects of chemical agents on a sample
US7469160B2 (en) Methods and apparatus for evaluating image focus
US6208749B1 (en) Systems and methods for the multispectral imaging and characterization of skin tissue
US7136518B2 (en) Methods and apparatus for displaying diagnostic data
US7282723B2 (en) Methods and apparatus for processing spectral data for use in tissue characterization
AU755385B2 (en) Systems and methods for the multispectral imaging and characterization of skin tissue
US7309867B2 (en) Methods and apparatus for characterization of tissue samples
US7459696B2 (en) Methods and apparatus for calibrating spectral data
Pogue et al. Analysis of acetic acid-induced whitening of high-grade squamous intraepithelial lesions
US20040208385A1 (en) Methods and apparatus for visually enhancing images
US20060013454A1 (en) Systems for identifying, displaying, marking, and treating suspect regions of tissue
US20030026762A1 (en) Bio-spectral imaging system and methods for diagnosing cell disease state
US20060184040A1 (en) Apparatus, system and method for optically analyzing a substrate
US9436992B2 (en) Method of reconstituting cellular spectra useful for detecting cellular disorders
US20040209237A1 (en) Methods and apparatus for characterization of tissue samples
AU2014293317A1 (en) Optical detection of skin disease
US20040208390A1 (en) Methods and apparatus for processing image data for use in tissue characterization
JP2009300131A (en) Bio-tissue discriminating apparatus and method
CN111465344A (en) Optical probe for cervical examination
AU2003259095A2 (en) Methods and apparatus for characterization of tissue samples
EP1931262B1 (en) Disposable calibration-fiducial mark for hyperspectral imaging
Ortega et al. Hyperspectral database of pathological in-vitro human brain samples to detect carcinogenic tissues
US20200390383A1 (en) Complex analysis system of spectrophotometry and ultrasound images and data for automatic early-stage diagnosing of malignant skin tumors
KR20190079187A (en) Multi-modal fusion endoscope system
CN112116027A (en) Skin cancer classification method based on optical intensity and gradient of OCT imaging image

Legal Events

Date Code Title Description
AS Assignment

Owner name: MEDISPECTRA, INC., MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KAUFMAN, HOWARD;ZELENCHUK, ALEX;FLEWELLING, ROSS;AND OTHERS;REEL/FRAME:016768/0754;SIGNING DATES FROM 20010315 TO 20010322

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION