WO2003009209A1 - Computer-aided method and system for detecting spiculated lesions in a mammogram - Google Patents

Computer-aided method and system for detecting spiculated lesions in a mammogram Download PDF

Info

Publication number
WO2003009209A1
WO2003009209A1 PCT/US2002/022652 US0222652W WO03009209A1 WO 2003009209 A1 WO2003009209 A1 WO 2003009209A1 US 0222652 W US0222652 W US 0222652W WO 03009209 A1 WO03009209 A1 WO 03009209A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixels
pixel
spiculation
group
combination
Prior art date
Application number
PCT/US2002/022652
Other languages
French (fr)
Inventor
Kevin Scott Woods
Original Assignee
Icad, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Icad, Inc. filed Critical Icad, Inc.
Publication of WO2003009209A1 publication Critical patent/WO2003009209A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection

Definitions

  • the present invention relates to a method and system for digital mammography, and more particularly, to a computer-aided method and system for detecting spiculated lesions in a mammogram.
  • Digital mammography the computer analysis of mammo graphic images, is becoming an increasingly important tool for detecting breast cancer.
  • the early detection and treatment of breast cancer can prolong or save the life of a patient.
  • the detection of mammographic abnormalities was the solely the domain of a trained radiologist who manually screened mammographic images.
  • digital mammography has become a valuable clinical tool for identifying suspicious lesions in mammograms.
  • the margin of a mass which is often characterized as circumscribed, lobulated, obscured, or spiculated, is considered as one of the most important indicators of a malignant lesion.
  • Karssemeijer described a mathematical algorithm for estimating the number of pixels along a line contained in a pre-defined pie-shaped bin that are oriented towards a central area.
  • the Karssemeijer feature extraction technique employs neighborhoods or bins to detect marginal spiculation.
  • the area surrounding a selected pixel of a digital mammogram is divided into pie-shaped bins. Based on spiculation measurements calculated for each bin, the pixel is then classified as either benign or malignant.
  • this approach and other feature extraction schemes have several disadvantages or shortcomings.
  • present techniques fail to adequately adjust the size of a neighborhood or bin to accurately capture the spicules radiating from the margins of a mass. Because the choice of the neighborhood affects the detection and measurement of spiculation, it is important that the bin size be adjusted accordingly. Finally, the computational intensity of current detection schemes for measuring and analyzing spiculation information requires significant financial and computer resources.
  • the present invention is directed to a computer-aided method and system for detecting spiculated lesions in a mammogram that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.
  • One object of the present invention is to provide a computer-aided method and system for detecting and measuring spiculation information for lesions having different sizes.
  • Another object of the present invention is to provide a computer-aided method and system for identifying spiculated lesions by computing spiculation information for a combination or subset of neighborhoods.
  • a further object of the present invention is to provide an efficient computational method and system for detecting spiculated lesions.
  • Yet another object of the present invention is to provide a method and system for extracting spiculation features from a digital mammogram.
  • Yet another object of the present invention is to provide a method and system for distinguishing spiculated and non-spiculated lesions.
  • Yet another object of the present invention is to provide a method and system for adjusting the neighborhood or bin dimensions to better approximate the size of a lesion.
  • Yet another object of the present invention is to provide a method and system for decreasing the number false-positive responses by increasing the specificity in which bin depth is defined to capture the marginal spiculation of a mass.
  • Yet another object of the present invention is to provide a method and system for detecting and measuring the spiculation responses across a range of bin depths.
  • Yet another object of the present invention is to provide a method and system for detecting and measuring spiculation information that can inputted or integrated with other image processing techniques.
  • FIG. 1 A illustrates a smooth, oval lesion
  • FIG. IB illustrates a small lesion with marginal spiculation near the central mass
  • FIG. 1C illustrates a large lesion with marginal spiculation further from the central mass
  • FIG. 2A is a block diagram showing a system for detecting spiculated lesions in a mammogram according to one exemplary embodiment of the present invention
  • FIG. 2B is a block diagram showing another exemplary embodiment of a system for detecting spiculated lesions in a mammogram
  • FIG. 3A is a flowchart showing a method for detecting spiculation in a digital mammogram according to one exemplary embodiment of the present invention
  • FIG. 3B is a flowchart showing a method for detecting spiculation in a digital mammogram according to an alternative exemplary embodiment of the present invention
  • FIG. 4 is a photograph of an X-ray mammogram showing the outline of a breast mask according to one exemplary embodiment of the present invention
  • FIG. 5 graphically illustrates a number of depth bins according to one exemplary embodiment of the present invention
  • FIG. 6 is a flow diagram showing a method for detecting spiculation using depth bins according to one exemplary embodiment of the present invention
  • FIGS. 7A-7C are flowcharts showing a detailed method for detecting spiculation using depth bins according to one exemplary embodiment of the present invention.
  • FIG. 8 is a flow diagram showing a method for detecting spiculated lesions in a mammogram according to an alternative exemplary embodiment of the present invention.
  • FIG. 9 is a flow diagram showing a method for detecting spiculation in a mammogram using a breast mask image according to an alternative exemplary embodiment f the present invention.
  • FIG. 10 is a photograph of an X-ray mammogram showing regions of interests highlighted.
  • FIG. 2A shows a block diagram of a computer-aided system 30 for detecting and measuring spiculation in a mammogram according to one embodiment of the present invention.
  • the system 30 comprises a processor 38, such as a central processing unit (CPU) or parallel processor, memory (such as RAM, a hard drive, an optical media, and/or ROM) 32, a database 34, and various input/output devices 36, such as a keyboard, mouse or pointer, microphone, speaker, monitor, printer, and scanner.
  • a processor 38 such as a central processing unit (CPU) or parallel processor
  • memory such as RAM, a hard drive, an optical media, and/or ROM
  • database 34 such as a database 34
  • input/output devices 36 such as a keyboard, mouse or pointer, microphone, speaker, monitor, printer, and scanner.
  • implementation of the present invention is not limited to the specific hardware configuration shown in FIG. 2A.
  • system 30 may be connected directly or indirectly to an imaging device 10, a digitizer 20, and one or more external storage devices 40.
  • the imaging device 10 is used to produce X-ray mammograms that are converted into digital images by a digitizer 20.
  • the digital mammogram is then processed by system 30 and stored in database 34 or in an external storage device 40, such as a hard disk or optical disk.
  • the imaging device 10 and digitizer 20 may be controlled by computer system 30 or by another computer system.
  • the software for implementing system 30 of the present invention is not limited to any one computer programming language. Because of the computational requirements associated with image processing, the software for implementing the present invention on system 30 was written in C++.
  • FIG. 3 A is a flowchart showing a general overview of a method for detecting and measuring spiculation in a digitized mammogram according to one embodiment of the present invention.
  • the X-ray mammogram has been previously produced and digitized according to methods and procedures well known in the art.
  • the digitized mammogram 100 is input and processed to determine line orientation values for each pixel of the digital mammogram at step 200.
  • spiculation information is computed at step 300 by examining the orientation of the pixels along one or more lines.
  • the spiculation information is computed and recorded for a number of depth bins, which are located at varying distances from a central region or central pixel.
  • the line detection step 200 and the spiculation detection step 300 will be discussed in more detail below.
  • the present invention contemplates using a breast mask template 110 to identify which pixels represent the breast tissue and which pixels represent the film background.
  • FIG. 4 shows a photographic image of a mammogram with the outline of a breast mask template overlaid.
  • a breast mask 110 reduces the computational requirements of the present embodiment.
  • the breast mask 110 may be defined manually by a radiologist or by computer-aided techniques well known in the art.
  • the method and system of the present invention may be implemented independently or may be integrated with other existing or future techniques.
  • the lesion extraction method and system of the present invention may alternatively be integrated with an imaging device 10 that produces an X-ray mammogram that is then converted into a suitable digital format.
  • the digital mammogram may then be stored in system 30 or any type of compatible external storage device 40.
  • corrective post processing of the digital mammogram may be performed prior to feature extraction. For example, contrast or other properties of the digital mammogram may be enhanced and background noise may be identified and filtered.
  • the digital mammogram 100 can then be processed in accordance with the line detection algorithm 200 and spiculation detection algorithm 300 contemplated by the present invention.
  • the present technique of detecting stellate patterns in a digital mammogram for purposes of identifying spiculated lesions involves two basic steps - line detection 200 and spiculation detection using depth bins 300. Each step will now be discussed in more detail.
  • any number of the line detection algorithms known in the art may be utilized to estimate the orientation of pixels along lines detected in the mammogram.
  • line detection is performed on a digital mammogram at a spatial resolution of 200 microns per pixel to create three images: A line image, a line orientation image, and a line strength image.
  • the line image may be a template that contains line information for identifying bright lines against the dark background of the mammogram.
  • the line detection technique may assign each pixel a positive value, e.g., "1,” if it is located along a bright line and a negative value if the pixel is located along a dark line.
  • Estimated values representing the orientation of each pixel in the line image may then mapped in a line orientation image.
  • output from the preferred line detection technique may also include a line strength image that contains strength (i.e., magnitude or contrast) values for each pixel of the line image, and the distribution of the strength values of any bright lines that have been detected in the mammogram.
  • a spiculation detection technique may be performed at step 300 of FIG. 3 A.
  • the current embodiment involves detecting stellate patterns (i.e., areas of locally radiating spicules) in the mammogram.
  • the degree of marginal spiculation is quantified for a neighborhood of pixels according to both the orientation and distance of the pixels surrounding a central pixel. Therefore, more accurate spiculation information can be computed for a range of mass sizes that may have spiculation features located at varying distances from a central mass.
  • FIG. 5 shows a graphical representation of a number of neighborhoods or depth bins 440 defined according to one embodiment of the present invention. Namely, a circular neighborhood 400 centered on a candidate location 410 is divided into a number of sectors 420 or pie-shaped bins.
  • the candidate location 410 may comprise a candidate pixel 410 or a group of pixels 410, however, the following description will only make reference to a candidate pixel 410 for simplicity and to avoid redundancy.
  • the sectors 420 may measure between, for example, approximately 1° and 15°.
  • Each sector 420 is further divided into a number of depth bins 440. As shown in FIG. 5, a depth bin 440 is located by the intersection of a sector 420 and the area between two concentric circles centered on pixel 410.
  • the size of a concentric circle is defined by a radius R x 454, which may range in value between a maximum allowable radius, R ma ⁇ 450, and a minimum allowable radius, R m ⁇ n 452.
  • R x 454 shown in FIG. 5 is bound by an outer radius, R max 450 and inner radius, R x 454.
  • the depth bins 440 are located by concentric circles having radii R x 454 set at fixed increments.
  • the shape and position of the depth bins 440 may be defined using a number of techniques. For example, while concentric circles are shown in FIG. 5, other shapes or combinations of shapes may be used to bound a depth bin.
  • FIG. 6 shows a flow diagram of the general steps for accomplishing the spiculation detection step 300 of FIG. 3A.
  • the present embodiment calculates one or more metrics for each candidate pixel 410. For example, the following two metrics may be calculated: (1) The percentage of pixels surrounding a candidate pixel 410 with line orientations directed toward a central region; and (2) the percentage of depth bins 440 which have more pixels oriented toward a central region than would be expected for a uniformly distributed random noise pattern.
  • a candidate pixel 410 may be chosen according to a predetermined sample spacing or sample rate. For example, a sample spacing may be defined such that every pixel, or every other or every third pixel is selected as the candidate pixel 410.
  • the method for selecting the candidate pixel 410 or group of pixels 410 may rely on any number of techniques well known in the art.
  • a neighborhood of pixels 400 surrounding the central pixel 420 is defined by an outer radius R max 450 and an inner radius R m ⁇ n 452.
  • the neighborhood 400 is divided into sectors 420 and each sector is further subdivided into depth bins 440.
  • the present technique To determine whether any lines identified by the line detection algorithm 200 are radiating toward a candidate pixel 410, at step 310 of FIG. 6 the present technique first computes the number of pixels 460 (see FIG. 5) of neighborhood 400 that have line orientations directed towards a presumed or estimated central mass represented by region 430 (see FIG. 5) divided by the total number of pixels in the neighborhood.
  • the central region 430 centered at the candidate pixel 410 and defined by radius R, is often referred to as the mass radius disk.
  • the present technique determines the percentage of pixels 460 or subset of pixels 460 within neighborhood 400 that are contained along lines that point to a central mass region 430.
  • the resultant metric for a pixel 460 is recorded according to both the orientation and depth of the pixel 460 with respect to the candidate pixel 410. Therefore, the number of pixels 460 of a particular depth bin 440 with the desired line orientation can be computed. Then at step 320 of FIG. 6, the present technique computes a second metric
  • spiculation information that quantifies the probability of finding a certain number of pixels 460 of a particular depth bin 40 directed toward the mass radius disk 430. Since a random number of lines not associated with a spiculated lesion may point to mass radius disk 430, the spiculation information represents the degree in which the region of a depth bin 440 may be considered spiculated. Therefore, a depth bin 440 that has a large number of pixels 460 directed toward mass radius disk 430 above what is considered as random orientations or background noise would have an associated spiculation metric that quantifies the increase. The second metric is computed as the percentage of depth bins that have a spiculation metric greater than what is considered random. However, since different lesion sizes exhibit different marginal spiculation characteristics, the spiculation measurements computed for each depth bin 440 are subsequently analyzed.
  • the spicules of small lesions are typically closer to the central mass than the spicules of a larger lesion.
  • spiculation information is combined from various subsets of depth bins 440 and compared at step 330 of FIG. 6.
  • the spiculation detection algorithm 300 computes and analyzes spiculation information for a number of bin configurations in one computational pass to produce a more accurate spiculation measurement for the candidate pixel 410. This technique indirectly approximates the size of a lesion.
  • FIGS. 7A through 7C show in more detail the steps associated with the spiculation detection technique of step 300 of FIG. 3 A.
  • FIG. 7 A shows the initial steps of defining operating parameters according to one embodiment of the present invention.
  • Step 500 comprises the step of defining the spacing between candidate pixels 410 that are examined using the present technique.
  • the precision of the present embodiment can be increased or decreased by adjusting the sample spacing rate.
  • the mass radius disk 430 may be computed according to the estimated size of the lesion.
  • the depth bins 440 surrounding a candidate pixel 410 are defined.
  • FIG. 7B shows in more detail the step of computing the number of pixels 460 of a depth bin 440 that have a desired orientation.
  • the spiculation detection algorithm identifies the depth bin 440 that corresponds to the location 460 selected in step 530.
  • the orientation of the pixel 460 towards the mass radius disk 430 is examined at step 550.
  • a metric is recorded indicating whether the pixel 460 is located along a line that intersects mass radius disk 430.
  • the algorithm queries whether there are any remaining pixel locations 460 to examine.
  • the technique computes the spiculation information for each depth bin 440, as shown in step 570 of FIG. 7C.
  • the spiculation information for a range of radial bins is computed and analyzed.
  • spiculation information is computed for a number of bin configurations that may include one depth bin 440 or multiple adjacent depth bins 440.
  • the measurements are compared to determine better approximate the size of the mass, thereby resulting in a more accurate spiculation measurement.
  • the outer and inner radii of the corresponding neighborhood 400 are retained at step 590. This process is repeated for each candidate pixel 410.
  • the system computes line information at step 200 and spiculation information at step 300 for a digital mammogram 100. Then, the final spiculation measurement, which represents the best response across a range of bin sizes, is used in step 340 to classify the degree of spiculation. For example, a location may be classified as spiculated, moderately spiculated, or non-spiculated. As one skilled in the art will recognize, the classification will vary depending on the classification scheme. Furthermore, the operating parameters of many of the classification schemes can be adjusted to provide increased or decreased sensitivity. In an alternative embodiment shown in FIG.
  • ROI regions of interest
  • target areas are extracted from the digital mammogram 100 or from the breast region of a mammogram 100 using a breast mask 110. Therefore, only potentially interesting areas of the digital mammogram 100 are subsequently analyzed in the line detection step 200 and spiculation detection step 300.
  • ROI may be extracted after computing line information in step 200 of FIG. 9.
  • FIG. 10 shows a mammogram with exemplary ROIs highlighted. Restricting subsequent image processing to only a portion of the original mammogram increases the speed in which the present embodiment identifies spiculated lesions.
  • the ROIs may be selected according to any number of reliable techniques known in the art - including manual and computer-aided detection techniques.
  • a multi-scale mass detection algorithm identifies ROIs that may contain a range of mass sizes, but not fatty tissue.
  • contrast is computed by comparing the intensity of a pixel with a group of surrounding pixels. Then, by comparing the contrast measured at each pixel with a variable threshold value, the technique identifies roughly circular regions of relatively dense tissue. Depending on the sensitivity desired, the threshold value may be adjusted to create larger or smaller ROI.

Abstract

A computer-aided method and system for detecting spiculated lesions in a digital mammogram. Multiple bins are defined around pixel or group of pixels of the digital mammogram. Each of the bins is divided into multiple depth regions with differing distance characteristics relative to the pixel or group of pixels. Spiculation information is computed and correlated to at least one of the depth regions. Then, the spiculation information for a combination of depth regions is analyzed to detect spiculated lesions.

Description

COMPUTER-AIDED METHOD AND SYSTEM FOR DETECTING SPICULATED LESIONS IN A MAMMOGRAM
Field of the Invention
The present invention relates to a method and system for digital mammography, and more particularly, to a computer-aided method and system for detecting spiculated lesions in a mammogram. Digital mammography, the computer analysis of mammo graphic images, is becoming an increasingly important tool for detecting breast cancer. The early detection and treatment of breast cancer can prolong or save the life of a patient. Until recently, the detection of mammographic abnormalities was the solely the domain of a trained radiologist who manually screened mammographic images. With advances in image acquisition and digital image processing, digital mammography has become a valuable clinical tool for identifying suspicious lesions in mammograms.
Many computer-aided diagnostic techniques have been developed to detect and classify potentially abnormal structures. Using density estimates, pattern recognition, or other techniques, abnormal structures can be extracted from a mammogram. However, the difficulty in the field of digital mammography is not only in identifying lesions or masses, but also in identifying lesions that a trained radiologist would classify as malignant. For example, a smooth, round or oval mass as shown in FIG. 1 A is usually classified as benign. Therefore, computer-aided techniques have been developed to distinguish between likely benign and likely malignant lesions according to calcification, spiculation, and the roughness and shape of a mass.
In particular, the margin of a mass, which is often characterized as circumscribed, lobulated, obscured, or spiculated, is considered as one of the most important indicators of a malignant lesion. A stellate structure having locally radiating spicules, as shown in FIG. IB, is considered a strong indication of malignancy. Thus, many techniques have been developed to detect and classify spiculated lesions. For example, in an article entitled "Recognition of Stellate Lesions in Digital Mammograms (Digital Mammography: Proceedings of the 2nd International Workshop on Digital Mammography, York, England, 10-12 July, 1994, Elsevier Science 1994), which is hereby incorporated by reference, Karssemeijer described a mathematical algorithm for estimating the number of pixels along a line contained in a pre-defined pie-shaped bin that are oriented towards a central area.
The Karssemeijer feature extraction technique employs neighborhoods or bins to detect marginal spiculation. The area surrounding a selected pixel of a digital mammogram is divided into pie-shaped bins. Based on spiculation measurements calculated for each bin, the pixel is then classified as either benign or malignant. However, this approach and other feature extraction schemes have several disadvantages or shortcomings.
First, current feature extraction techniques yield a significant number of false- positive responses because the size and marginal spiculation characteristics of differently sized masses are not properly accommodated for. As shown in FIG. IB, a small lesion typically has a spiculated region closer to the central mass than a larger lesion. The typical spiculation characteristics of a large lesion are depicted in FIG. lC. Therefore, present techniques that simply measure the degree of spiculation according to the orientation of pixels along a line in a pre-defined, pie-shaped bin fail to accurately consider the depth or distance at which spicules are located from the central mass.
Second, present techniques fail to adequately adjust the size of a neighborhood or bin to accurately capture the spicules radiating from the margins of a mass. Because the choice of the neighborhood affects the detection and measurement of spiculation, it is important that the bin size be adjusted accordingly. Finally, the computational intensity of current detection schemes for measuring and analyzing spiculation information requires significant financial and computer resources.
In light of the foregoing, there is a need for a computer-aided method and system for detecting spiculated lesions having different sizes and different spiculation characteristics. Moreover, there is a need for a computer-aided method and system for computing and analyzing spiculation information for lesions of various sizes during one computational pass. SUMMARY OF THE INVENTION
Accordingly, the present invention is directed to a computer-aided method and system for detecting spiculated lesions in a mammogram that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.
One object of the present invention is to provide a computer-aided method and system for detecting and measuring spiculation information for lesions having different sizes.
Another object of the present invention is to provide a computer-aided method and system for identifying spiculated lesions by computing spiculation information for a combination or subset of neighborhoods.
A further object of the present invention is to provide an efficient computational method and system for detecting spiculated lesions.
Yet another object of the present invention is to provide a method and system for extracting spiculation features from a digital mammogram.
Yet another object of the present invention is to provide a method and system for distinguishing spiculated and non-spiculated lesions.
Yet another object of the present invention is to provide a method and system for adjusting the neighborhood or bin dimensions to better approximate the size of a lesion.
Yet another object of the present invention is to provide a method and system for decreasing the number false-positive responses by increasing the specificity in which bin depth is defined to capture the marginal spiculation of a mass.
Yet another object of the present invention is to provide a method and system for detecting and measuring the spiculation responses across a range of bin depths.
Yet another object of the present invention is to provide a method and system for detecting and measuring spiculation information that can inputted or integrated with other image processing techniques.
Additional objects and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory.
BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. In the drawings:
FIG. 1 A illustrates a smooth, oval lesion;
FIG. IB illustrates a small lesion with marginal spiculation near the central mass; FIG. 1C illustrates a large lesion with marginal spiculation further from the central mass;
FIG. 2A is a block diagram showing a system for detecting spiculated lesions in a mammogram according to one exemplary embodiment of the present invention; FIG. 2B is a block diagram showing another exemplary embodiment of a system for detecting spiculated lesions in a mammogram;
FIG. 3A is a flowchart showing a method for detecting spiculation in a digital mammogram according to one exemplary embodiment of the present invention;
FIG. 3B is a flowchart showing a method for detecting spiculation in a digital mammogram according to an alternative exemplary embodiment of the present invention;
FIG. 4 is a photograph of an X-ray mammogram showing the outline of a breast mask according to one exemplary embodiment of the present invention; FIG. 5 graphically illustrates a number of depth bins according to one exemplary embodiment of the present invention; FIG. 6 is a flow diagram showing a method for detecting spiculation using depth bins according to one exemplary embodiment of the present invention; FIGS. 7A-7C are flowcharts showing a detailed method for detecting spiculation using depth bins according to one exemplary embodiment of the present invention;
FIG. 8 is a flow diagram showing a method for detecting spiculated lesions in a mammogram according to an alternative exemplary embodiment of the present invention;
FIG. 9 is a flow diagram showing a method for detecting spiculation in a mammogram using a breast mask image according to an alternative exemplary embodiment f the present invention; and FIG. 10 is a photograph of an X-ray mammogram showing regions of interests highlighted.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like elements.
FIG. 2A shows a block diagram of a computer-aided system 30 for detecting and measuring spiculation in a mammogram according to one embodiment of the present invention. The system 30 comprises a processor 38, such as a central processing unit (CPU) or parallel processor, memory (such as RAM, a hard drive, an optical media, and/or ROM) 32, a database 34, and various input/output devices 36, such as a keyboard, mouse or pointer, microphone, speaker, monitor, printer, and scanner. As one skilled in the art will appreciate, implementation of the present invention is not limited to the specific hardware configuration shown in FIG. 2A.
For instance, in another embodiment of the present invention shown in FIG. 2B, system 30 may be connected directly or indirectly to an imaging device 10, a digitizer 20, and one or more external storage devices 40. As one skilled in the art will appreciate, the imaging device 10 is used to produce X-ray mammograms that are converted into digital images by a digitizer 20. The digital mammogram is then processed by system 30 and stored in database 34 or in an external storage device 40, such as a hard disk or optical disk. The imaging device 10 and digitizer 20 may be controlled by computer system 30 or by another computer system.
The software for implementing system 30 of the present invention is not limited to any one computer programming language. Because of the computational requirements associated with image processing, the software for implementing the present invention on system 30 was written in C++.
GENERAL OVERVIEW
FIG. 3 A is a flowchart showing a general overview of a method for detecting and measuring spiculation in a digitized mammogram according to one embodiment of the present invention. In the present embodiment, the X-ray mammogram has been previously produced and digitized according to methods and procedures well known in the art. The digitized mammogram 100 is input and processed to determine line orientation values for each pixel of the digital mammogram at step 200. Using the images output from step 200, spiculation information is computed at step 300 by examining the orientation of the pixels along one or more lines. The spiculation information is computed and recorded for a number of depth bins, which are located at varying distances from a central region or central pixel. The line detection step 200 and the spiculation detection step 300 will be discussed in more detail below.
INPUT
In an alternative embodiment shown in FIG. 3B, the present invention contemplates using a breast mask template 110 to identify which pixels represent the breast tissue and which pixels represent the film background. For instance, FIG. 4 shows a photographic image of a mammogram with the outline of a breast mask template overlaid. By restricting subsequent image processing to the breast tissue areas of the mammogram, a breast mask 110 reduces the computational requirements of the present embodiment. The breast mask 110 may be defined manually by a radiologist or by computer-aided techniques well known in the art. As will be recognized by one skilled in the art, the method and system of the present invention may be implemented independently or may be integrated with other existing or future techniques. For example, the lesion extraction method and system of the present invention may alternatively be integrated with an imaging device 10 that produces an X-ray mammogram that is then converted into a suitable digital format. The digital mammogram may then be stored in system 30 or any type of compatible external storage device 40.
Moreover, one skilled in the art will appreciate that corrective post processing of the digital mammogram may be performed prior to feature extraction. For example, contrast or other properties of the digital mammogram may be enhanced and background noise may be identified and filtered. The digital mammogram 100 can then be processed in accordance with the line detection algorithm 200 and spiculation detection algorithm 300 contemplated by the present invention.
As discussed earlier in reference to FIG. 3 A, the present technique of detecting stellate patterns in a digital mammogram for purposes of identifying spiculated lesions involves two basic steps - line detection 200 and spiculation detection using depth bins 300. Each step will now be discussed in more detail.
LINE DETECTION
With respect to step 200 of FIG. 3 A, any number of the line detection algorithms known in the art may be utilized to estimate the orientation of pixels along lines detected in the mammogram. For example, in one embodiment line detection is performed on a digital mammogram at a spatial resolution of 200 microns per pixel to create three images: A line image, a line orientation image, and a line strength image.
The line image may be a template that contains line information for identifying bright lines against the dark background of the mammogram. The line detection technique may assign each pixel a positive value, e.g., "1," if it is located along a bright line and a negative value if the pixel is located along a dark line. Estimated values representing the orientation of each pixel in the line image may then mapped in a line orientation image. Finally, output from the preferred line detection technique may also include a line strength image that contains strength (i.e., magnitude or contrast) values for each pixel of the line image, and the distribution of the strength values of any bright lines that have been detected in the mammogram. SPICULATION DETECTION
After the line-based orientation values have been estimated using a line detection algorithm 200, a spiculation detection technique may be performed at step 300 of FIG. 3 A. To identify spiculated lesions, which are a strong indication of malignancy, the current embodiment involves detecting stellate patterns (i.e., areas of locally radiating spicules) in the mammogram. The degree of marginal spiculation is quantified for a neighborhood of pixels according to both the orientation and distance of the pixels surrounding a central pixel. Therefore, more accurate spiculation information can be computed for a range of mass sizes that may have spiculation features located at varying distances from a central mass.
FIG. 5 shows a graphical representation of a number of neighborhoods or depth bins 440 defined according to one embodiment of the present invention. Namely, a circular neighborhood 400 centered on a candidate location 410 is divided into a number of sectors 420 or pie-shaped bins. The candidate location 410 may comprise a candidate pixel 410 or a group of pixels 410, however, the following description will only make reference to a candidate pixel 410 for simplicity and to avoid redundancy. The sectors 420 may measure between, for example, approximately 1° and 15°. Each sector 420 is further divided into a number of depth bins 440. As shown in FIG. 5, a depth bin 440 is located by the intersection of a sector 420 and the area between two concentric circles centered on pixel 410. The size of a concentric circle is defined by a radius Rx 454, which may range in value between a maximum allowable radius, Rmaχ 450, and a minimum allowable radius, Rmιn 452. For example, depth bin 442 shown in FIG. 5 is bound by an outer radius, Rmax 450 and inner radius, Rx 454. In the present embodiment, the depth bins 440 are located by concentric circles having radii Rx 454 set at fixed increments. One in the art will appreciate that the shape and position of the depth bins 440 may be defined using a number of techniques. For example, while concentric circles are shown in FIG. 5, other shapes or combinations of shapes may be used to bound a depth bin.
FIG. 6 shows a flow diagram of the general steps for accomplishing the spiculation detection step 300 of FIG. 3A. For a window of pixels that may correspond to a region of interest, the present embodiment calculates one or more metrics for each candidate pixel 410. For example, the following two metrics may be calculated: (1) The percentage of pixels surrounding a candidate pixel 410 with line orientations directed toward a central region; and (2) the percentage of depth bins 440 which have more pixels oriented toward a central region than would be expected for a uniformly distributed random noise pattern.
Moving incrementally across an image or a region of an image, that may have been selected based on the results of a mass detection algorithm, the one or more metrics are calculated for each candidate pixel 410. A candidate pixel 410 may be chosen according to a predetermined sample spacing or sample rate. For example, a sample spacing may be defined such that every pixel, or every other or every third pixel is selected as the candidate pixel 410. As one skilled in the art will appreciate, the method for selecting the candidate pixel 410 or group of pixels 410 may rely on any number of techniques well known in the art.
After a candidate pixel 410 has been selected for analysis, a neighborhood of pixels 400 surrounding the central pixel 420 is defined by an outer radius Rmax 450 and an inner radius Rmιn 452. The neighborhood 400 is divided into sectors 420 and each sector is further subdivided into depth bins 440.
To determine whether any lines identified by the line detection algorithm 200 are radiating toward a candidate pixel 410, at step 310 of FIG. 6 the present technique first computes the number of pixels 460 (see FIG. 5) of neighborhood 400 that have line orientations directed towards a presumed or estimated central mass represented by region 430 (see FIG. 5) divided by the total number of pixels in the neighborhood. The central region 430, centered at the candidate pixel 410 and defined by radius R, is often referred to as the mass radius disk. In other words, the present technique determines the percentage of pixels 460 or subset of pixels 460 within neighborhood 400 that are contained along lines that point to a central mass region 430. The resultant metric for a pixel 460 is recorded according to both the orientation and depth of the pixel 460 with respect to the candidate pixel 410. Therefore, the number of pixels 460 of a particular depth bin 440 with the desired line orientation can be computed. Then at step 320 of FIG. 6, the present technique computes a second metric
(i.e., spiculation information) that quantifies the probability of finding a certain number of pixels 460 of a particular depth bin 40 directed toward the mass radius disk 430. Since a random number of lines not associated with a spiculated lesion may point to mass radius disk 430, the spiculation information represents the degree in which the region of a depth bin 440 may be considered spiculated. Therefore, a depth bin 440 that has a large number of pixels 460 directed toward mass radius disk 430 above what is considered as random orientations or background noise would have an associated spiculation metric that quantifies the increase. The second metric is computed as the percentage of depth bins that have a spiculation metric greater than what is considered random. However, since different lesion sizes exhibit different marginal spiculation characteristics, the spiculation measurements computed for each depth bin 440 are subsequently analyzed.
As previously discussed, the spicules of small lesions are typically closer to the central mass than the spicules of a larger lesion. To better approximate the size of a lesion, spiculation information is combined from various subsets of depth bins 440 and compared at step 330 of FIG. 6. In one embodiment, the spiculation detection algorithm 300 computes and analyzes spiculation information for a number of bin configurations in one computational pass to produce a more accurate spiculation measurement for the candidate pixel 410. This technique indirectly approximates the size of a lesion. Therefore, the outer radius Rmax 450 and inner radius Rm,n 452 of a neighborhood 400 more likely to display characteristics of marginal spiculation for a particular mass is determined by analyzing the spiculation measurements from various combinations of depth bins 440. For example, a combination of three depth bins 440 close to the candidate pixel 410 may constitute the strongest spiculation measurement for a small mass. FIGS. 7A through 7C show in more detail the steps associated with the spiculation detection technique of step 300 of FIG. 3 A. FIG. 7 A shows the initial steps of defining operating parameters according to one embodiment of the present invention. Step 500 comprises the step of defining the spacing between candidate pixels 410 that are examined using the present technique. As one skilled in the art will appreciate, the precision of the present embodiment can be increased or decreased by adjusting the sample spacing rate. At step 510, the mass radius disk 430 may be computed according to the estimated size of the lesion. Then at step 520 of FIG. 7 A, the depth bins 440 surrounding a candidate pixel 410 are defined.
FIG. 7B shows in more detail the step of computing the number of pixels 460 of a depth bin 440 that have a desired orientation. At step 540 the spiculation detection algorithm identifies the depth bin 440 that corresponds to the location 460 selected in step 530. The orientation of the pixel 460 towards the mass radius disk 430 is examined at step 550. A metric is recorded indicating whether the pixel 460 is located along a line that intersects mass radius disk 430. Then at step 560, the algorithm queries whether there are any remaining pixel locations 460 to examine. After examining the line orientations of the selected candidate locations 460, the technique computes the spiculation information for each depth bin 440, as shown in step 570 of FIG. 7C. To accommodate lesions of varying size, the spiculation information for a range of radial bins is computed and analyzed. In particular, at step 580 spiculation information is computed for a number of bin configurations that may include one depth bin 440 or multiple adjacent depth bins 440. The measurements are compared to determine better approximate the size of the mass, thereby resulting in a more accurate spiculation measurement. The outer and inner radii of the corresponding neighborhood 400 are retained at step 590. This process is repeated for each candidate pixel 410.
EXAMPLES OF ALTERNATIVE EMBODIMENTS
In an alternative embodiment shown in FIG. 8, the system computes line information at step 200 and spiculation information at step 300 for a digital mammogram 100. Then, the final spiculation measurement, which represents the best response across a range of bin sizes, is used in step 340 to classify the degree of spiculation. For example, a location may be classified as spiculated, moderately spiculated, or non-spiculated. As one skilled in the art will recognize, the classification will vary depending on the classification scheme. Furthermore, the operating parameters of many of the classification schemes can be adjusted to provide increased or decreased sensitivity. In an alternative embodiment shown in FIG. 9, at step 150 regions of interest (ROI) or target areas are extracted from the digital mammogram 100 or from the breast region of a mammogram 100 using a breast mask 110. Therefore, only potentially interesting areas of the digital mammogram 100 are subsequently analyzed in the line detection step 200 and spiculation detection step 300. Alternatively, ROI may be extracted after computing line information in step 200 of FIG. 9. FIG. 10 shows a mammogram with exemplary ROIs highlighted. Restricting subsequent image processing to only a portion of the original mammogram increases the speed in which the present embodiment identifies spiculated lesions. The ROIs may be selected according to any number of reliable techniques known in the art - including manual and computer-aided detection techniques. In one embodiment, a multi-scale mass detection algorithm identifies ROIs that may contain a range of mass sizes, but not fatty tissue. First, contrast is computed by comparing the intensity of a pixel with a group of surrounding pixels. Then, by comparing the contrast measured at each pixel with a variable threshold value, the technique identifies roughly circular regions of relatively dense tissue. Depending on the sensitivity desired, the threshold value may be adjusted to create larger or smaller ROI.
It will be apparent to those skilled in the art that various modifications and variations can be made in the method and system for detecting spiculated lesions in a mammogram of the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims

What Is Claimed Is:
1. A computer-aided method for detecting spiculated lesions in a digital mammogram, comprising the steps of: (a) for each of multiple pixels or groups of pixels of said digital mammogram, computing spiculation information using pixels surrounding the pixel or group of pixels, wherein the step of computing spiculation information includes defining multiple bins around the pixel or group of pixels, each of the bins being divided into multiple depth regions with differing distance characteristics relative to the pixel or group of pixels, and correlating the spiculation information to at least one of the depth regions; and
(b) analyzing said spiculation information for a combination of depth regions to detect spiculated lesions.
2. The method of claim 1 , further comprising the step of segmenting a breast region from a background region of said digital mammogram and wherein said step of computing spiculation information is computed from said breast region.
3. The method of claim 1, further comprising the step of identifying at least one region of interest (ROI) in said digital mammogram, and wherein said step of computing spiculation information is computed from said ROI.
4. The method of claim 3, wherein the step of identifying at least one region of interest (ROI) includes identifying said ROI using a mass detection algorithm.
5. The method of claim 1, wherein the step of computing spiculation information includes the step of computing line information.
6. The method of claim 5, wherein the step of computing line information includes the steps of: creating a line image for identifying one or more bright lines against a dark background; creating a line orientation image containing orientation valves for each pixel of said line image; and creating a line strength image containing magnitude or contrast valves for each pixel of said line image.
7. The method of claim 1, wherein said multiple pixels or groups of pixels are selected according to a predetermined sample rate.
8. The method of claim 1, wherein the step of defining multiple bins around the pixel or group of pixels includes the steps of: defining a neighborhood around the pixel or group of pixels; and defining radii that divide said neighborhood into multiple bins.
9. The method of claim 8, wherein said neighborhood is approximately circular.
10. The method of claim 1, wherein said depth region comprises an intersection of said bin and an area between two, approximately concentric circles centered on said pixels or group of pixels.
11. The method of claim 1 , wherein said combination of depth regions may include one or more contiguous regions.
12. The method of claim 1, wherein the step of analyzing said spiculation information for the combination of depth regions includes the steps of: comparing the spiculation information for the combination of depth regions; and determining which combination of depth regions may identify a spiculated lesion.
13. A system for detecting spiculated lesions in a digital mammogram, comprising: means for computing spiculation information using pixels surrounding a pixel or group of pixels, wherein the means for computing spiculation information includes means for defining multiple bins around the pixel or group of pixels, each of the bins being divided into multiple depth regions with differing distance characteristics relative to the pixel or group of pixels, and means for correlating the spiculation information to at least one of the depth regions; and means for analyzing said spiculation information for a combination of depth regions to detect spiculated lesions.
14. The system of claim 13, further comprising means for identifying at least one region of interest (ROI) in said digital mammogram and wherein said computing of spiculation information is restricted to said ROI.
15. The system of claim 14, wherein the means for identifying at least one ROI includes means for identifying said ROI using a mass detection algorithm.
16. The system of claim 13, wherein said multiple pixels or groups of pixels are selected according to a predetermined sample rate.
17. The system of claim 13, wherein means for defining multiple bins around the pixel or group of pixels includes: defining a neighborhood around the pixel or group of pixels; and defining radii that divide said neighborhood into multiple bins.
18. The system of claim 17, wherein said neighborhood is approximately circular.
19. The system of claim 13, wherein said depth region comprises an intersection of said bin and an area between two, approximately concentric circles centered on said pixels or group of pixels.
20. The system of claim 13, wherein said combination of depth regions may include one or more contiguous regions.
21. The system of claim 13, wherein the means for analyzing said spiculation information for the combination of depth regions includes means for comparing the spiculation information for the combination of depth regions and determining which combination of depth regions may identify a spiculated lesion.
22. A computer program product for detecting spiculated lesions in a digital mammogram, comprising: computer code for computing spiculation information using pixels surrounding a pixel or group of pixels, wherein the code for computing spiculation information includes defining multiple bins around the pixel or group of pixels, each of the bins being divided into multiple depth regions with differing distance characteristics relative to the pixel or group of pixels, and correlating the spiculation information to at least one of the depth regions; and computer code for analyzing said spiculation information for a combination of depth regions to detect spiculated lesions.
23. The computer program product of claim 22, further comprising computer code for identifying at least one region of interest (ROI) in said mammogram.
24. The computer program product of claim 22, wherein the computer code for defining multiple bins around the pixel or group of pixels includes code for defining a neighborhood around the pixel or group of pixels and defining radii that divide said neighborhood into multiple bins.
25. The computer program product of claim 22, wherein said depth region comprises an intersection of said bin and an area between two, approximately concentric circles centered on said pixels or group of pixels.
26. The computer program product of claim 22, wherein the computer code for analyzing said spiculation information for the combination of depth regions includes code for: comparing the spiculation information for the combination of depth regions; and determining which combination of depth regions may identify a spiculated lesion.
27. The computer program product of claim 22, wherein the combination of depth regions may include one or more contiguous regions.
PCT/US2002/022652 2001-07-18 2002-07-17 Computer-aided method and system for detecting spiculated lesions in a mammogram WO2003009209A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US90665501A 2001-07-18 2001-07-18
US09/906,655 2001-07-18

Publications (1)

Publication Number Publication Date
WO2003009209A1 true WO2003009209A1 (en) 2003-01-30

Family

ID=25422767

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/022652 WO2003009209A1 (en) 2001-07-18 2002-07-17 Computer-aided method and system for detecting spiculated lesions in a mammogram

Country Status (1)

Country Link
WO (1) WO2003009209A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10013638B2 (en) 2008-08-14 2018-07-03 Ping Zhang Cancer diagnostic method and system
CN110974286A (en) * 2019-12-11 2020-04-10 北京华健蓝海医疗科技有限责任公司 Method and device for detecting breast X-ray image lump

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263092B1 (en) * 1996-07-10 2001-07-17 R2 Technology, Inc. Method and apparatus for fast detection of spiculated lesions in digital mammograms
US6301378B1 (en) * 1997-06-03 2001-10-09 R2 Technology, Inc. Method and apparatus for automated detection of masses in digital mammograms

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263092B1 (en) * 1996-07-10 2001-07-17 R2 Technology, Inc. Method and apparatus for fast detection of spiculated lesions in digital mammograms
US6301378B1 (en) * 1997-06-03 2001-10-09 R2 Technology, Inc. Method and apparatus for automated detection of masses in digital mammograms

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
HIRAKO K ET AL: "DEVELOPMENT OF DETECTION FILTER FOR MICROCALCIFICATIONS ON MAMMOGRAMS: A METHOD BASED ON DENSITY GRADIENT AND TRIPLE-RING FILTER ANALYSIS", SYSTEMS & COMPUTERS IN JAPAN, SCRIPTA TECHNICA JOURNALS. NEW YORK, US, vol. 27, no. 13, 30 November 1996 (1996-11-30), pages 36 - 48, XP000685976, ISSN: 0882-1666 *
JIANG H ET AL: "Detection of spicules in mammograms", IMAGE PROCESSING, 1997. PROCEEDINGS., INTERNATIONAL CONFERENCE ON SANTA BARBARA, CA, USA 26-29 OCT. 1997, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 26 October 1997 (1997-10-26), pages 520 - 523, XP010253800, ISBN: 0-8186-8183-7 *
KARSSEMEIJER N: "RECOGNITION OF STELLATE LESIONS IN DIGITAL MAMMOGRAMS", DIGITAL MAMMOGRAPHY, ELSEVIER SCIENCE, AMSTERDAM,, NL, 1994, pages 211 - 219, XP002919692 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10013638B2 (en) 2008-08-14 2018-07-03 Ping Zhang Cancer diagnostic method and system
US10671885B2 (en) 2008-08-14 2020-06-02 Ping Zhang Cancer diagnostic method and system
CN110974286A (en) * 2019-12-11 2020-04-10 北京华健蓝海医疗科技有限责任公司 Method and device for detecting breast X-ray image lump
CN110974286B (en) * 2019-12-11 2023-11-17 北京华健蓝海医疗科技有限责任公司 Method and device for detecting breast X-ray image tumor

Similar Documents

Publication Publication Date Title
US6185320B1 (en) Method and system for detection of lesions in medical images
US6580818B2 (en) Method and apparatus for automated detection of masses in digital images
EP0757544B1 (en) Computerized detection of masses and parenchymal distortions
Karssemeijer et al. Detection of stellate distortions in mammograms
US5838815A (en) Method and system to enhance robust identification of abnormal regions in radiographs
US7903861B2 (en) Method for classifying breast tissue density using computed image features
US4907156A (en) Method and system for enhancement and detection of abnormal anatomic regions in a digital image
Netsch et al. Scale-space signatures for the detection of clustered microcalcifications in digital mammograms
US6014452A (en) Method and system for using local attention in the detection of abnormalities in digitized medical images
US6198838B1 (en) Method and system for detection of suspicious lesions in digital mammograms using a combination of spiculation and density signals
US5872859A (en) Training/optimization of computer aided detection schemes based on measures of overall image quality
JP4184842B2 (en) Image discrimination device, method and program
US8687867B1 (en) Computer-aided detection and classification of suspicious masses in breast imagery
JP2006517663A (en) Image analysis
EP1131778A1 (en) Method and system for computer-aided lesion detection using information from multiple images
WO1998043201A9 (en) Method and apparatus for automatic muscle segmentation in digital mammograms
Karssemeijer et al. Computer-assisted reading of mammograms
US11730436B2 (en) Mammography apparatus
Ball et al. Digital mammogram spiculated mass detection and spicule segmentation using level sets
JP5000474B2 (en) Method and apparatus for candidate detection using Hesse peak characteristics
JP2004195080A (en) Abnormal shadow detection apparatus
US20080107321A1 (en) Spiculation detection method and apparatus for CAD
WO2003009209A1 (en) Computer-aided method and system for detecting spiculated lesions in a mammogram
CN109671091B (en) Non-calcified plaque detection method and non-calcified plaque detection equipment
Alolfe et al. Development of a computer-aided classification system for cancer detection from digital mammograms

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP