US20110134271A1 - Detecting Red Eye Filter and Apparatus Using Meta-Data - Google Patents

Detecting Red Eye Filter and Apparatus Using Meta-Data Download PDF

Info

Publication number
US20110134271A1
US20110134271A1 US12/958,130 US95813010A US2011134271A1 US 20110134271 A1 US20110134271 A1 US 20110134271A1 US 95813010 A US95813010 A US 95813010A US 2011134271 A1 US2011134271 A1 US 2011134271A1
Authority
US
United States
Prior art keywords
red
image
eye
indicative
meta
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/958,130
Inventor
Michael J. DeLuca
Yury Prilutsky
Eran Steinberg
Peter Corcoran
Petronel Bigioi
Alexei Pososin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fotonation Ltd
Original Assignee
Tessera Technologies Ireland Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/947,603 external-priority patent/US6407777B1/en
Priority claimed from US10/170,511 external-priority patent/US7042505B1/en
Application filed by Tessera Technologies Ireland Ltd filed Critical Tessera Technologies Ireland Ltd
Priority to US12/958,130 priority Critical patent/US20110134271A1/en
Assigned to FOTONATION IRELAND LIMITED reassignment FOTONATION IRELAND LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BIGIOI, PETRONEL, CORCORAN, PETER, POSOSIN, ALEXEI, DELUCA, MICHAEL J., STEINBERG, ERAN, PRILUTSKY, YURY
Assigned to FOTONATION VISION LIMITED reassignment FOTONATION VISION LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FOTONATION IRELAND LIMITED
Assigned to TESSERA TECHNOLOGIES IRELAND LIMITED reassignment TESSERA TECHNOLOGIES IRELAND LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FOTONATION VISION LIMITED
Publication of US20110134271A1 publication Critical patent/US20110134271A1/en
Assigned to DigitalOptics Corporation Europe Limited reassignment DigitalOptics Corporation Europe Limited CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: TESSERA TECHNOLOGIES IRELAND LIMITED
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06T5/94
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration by the use of histogram techniques
    • G06T5/77
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/6083Colour correction or control controlled by factors external to the apparatus
    • H04N1/6086Colour correction or control controlled by factors external to the apparatus by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/62Retouching, i.e. modification of isolated colours only or in isolated picture areas only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/62Retouching, i.e. modification of isolated colours only or in isolated picture areas only
    • H04N1/624Red-eye correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30216Redeye defect

Definitions

  • the present invention relates generally to digital photography using flash, and specifically to filtering “Red Eye” artifacts from digital images shot by digital cameras or scanned by a digital scanner as part of an image acquisition process or an image printing process.
  • Red-eye is a phenomenon in flash photography where a flash is reflected within a subject's eye and appears in a photograph as a red dot where the black pupil of the subject's eye would normally appear.
  • the unnatural glowing red of an eye is due to internal reflections from the vascular membrane behind the retina, which is rich in blood vessels.
  • This objectionable phenomenon is well understood to be caused in part by a small angle between the flash of the camera and the lens of the camera. This angle has decreased with the miniaturization of cameras with integral flash capabilities. Additional contributors include the relative closeness of the subject to the camera, iris color where light eyes are more susceptible to this artifact and low ambient light levels which means the pupils are dilated.
  • the red-eye phenomenon can be somewhat minimized by causing the iris to reduce the opening of the pupil. This is typically done with a “pre-flash”, a flash or illumination of light shortly before a flash photograph is taken or a strong additional light source. This causes the iris to close.
  • pre-flash a flash or illumination of light shortly before a flash photograph is taken or a strong additional light source. This causes the iris to close.
  • these techniques typically delay the photographic exposure process by 0.5 second or more to allow for the pupil to contract. Such delay may cause the user to move, the subject to turn away, etc. Therefore, these techniques, although somewhat useful in removing the red-eye artifact, can cause new unwanted results.
  • Digital cameras are becoming more popular and smaller in size. Digital cameras have several advantages over film cameras, e.g. eliminating the need for film as the image is digitally captured and stored in a memory array for display on a display screen on the camera itself This allows photographs to be viewed and enjoyed virtually instantaneously as opposed to waiting for film processing. Furthermore, the digitally captured image may be downloaded to another display device such as a personal computer or color printer for further enhanced viewing. Digital cameras include microprocessors for image processing and compression and camera systems control. Nevertheless, without a pre-flash, both digital and film cameras can capture the red-eye phenomenon as the flash reflects within a subject's eye. Thus, what is desired is a method of eliminating red-eye phenomenon within a miniature digital camera having a flash without the distraction of a pre-flash.
  • An advantage of digital capture devices is that the image contains more data than the traditional film based image has.
  • Such data is also referred to as meta-data and is usually saved in the header of the digital file.
  • the meta-data may include information about the camera, the user, and the acquisition parameters.
  • images that originate from analog devices like film are being scanned to create a digital image.
  • the scanning can be either for the purpose of digitization of film based images into digital form, or as an intermediate step as part of the printing of film based images on a digital system.
  • Red Eye phenomenon is a well known problem even for film cameras, and in particular point and shoot cameras where the proximity of the flash and the lens is accentuated.
  • the scanner may have the option to adjust its scanning parameters in order to accommodate for exposure and color balance.
  • the scanner software will reverse the colors as well as remove the orange, film base mask of the negative.
  • meta data for film images is generally more limited than for digital cameras.
  • most films include information about the manufacturer, the film type and even the batch number of the emulsion. Such information can be useful in evaluating the raw, uncorrected color of eyes suffering from red eye artifacts.
  • Red-eye detection algorithms typically include detecting the pupil and detecting the eye. Both of these operations may be performed in order to determine if red-eye data is red-eye or if an eye has red-eye artifact in it.
  • the success of a red eye detection algorithm is generally dependent on the success of a correct positive detection and a minimal false detection of the two.
  • the detection is primarily done on image data information, also referred to as pixel-data. However, there is quite a lot of a-priori information when the image is captured and the nature of the artifact that can be utilized. Such information relies on both anthropometric information as well as photographic data.
  • Anthropometry is defined as the study of human body measurement for use in anthropological classification and comparison. Such data, albeit extremely statistical in nature, can provide good indication as to whether an object is an eye, based on analysis of other detected human objects in the image.
  • Bayesian probability takes account of the system's propensity to misidentify the eyes, which is referred to as ‘false positives’.
  • the Bayesian approach permits the use of objective data or subjective opinion in specifying an a priori distribution. With the Bayesian approach, different individuals or applications might specify different prior distributions, and also the system can improve or have a self-learning mode to change the subjective distribution.
  • Bayes' theorem provides a mechanism for combining an a priori probability distribution for the states of nature with new sample information, the combined data giving a revised probability distribution about the states of nature, which can then be used as an a priori probability with a future new sample, and so on.
  • the intent is that the earlier probabilities are then used to make ever better decisions.
  • this is an iterative or learning process, and is a common basis for establishing computer programs that learn from experience.
  • conditional probability is defined as:
  • FIG. 8 - b A Venn diagram is depicted in FIG. 8 - b.
  • a method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image includes analyzing meta-data information including information describing conditions under which the image was acquired and/or acquisition device-specific information; determining one or more regions within said digital image suspected as including red eye artifact; and determining, based at least in part on said meta-data analysis, whether said regions are actual red eye artifact.
  • the method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on said meta-data analysis, whether the regions are actual red eye artifact, being based further on the anthropometrical information.
  • the filtering may be executed within a portable image acquisition device, having no photographic film.
  • the filtering may be executed as a post-processing step on an external computation device.
  • the meta-data information describing the conditions under which the image was acquired may include an indication of whether a flash was used when the image was acquired and/or an aperture at the time of the acquisition.
  • the acquisition device information may include sensor size and/or a spectral response of a sensor of the acquisition device.
  • the acquisition device information may further or alternatively include a color transformation from raw sensor pixel values to saved image pixel values. A color of the pixels indicative of red eye color may be calculated based on a spectral response and a color transformation.
  • a lens may be used to capture the image.
  • the meta-data information may include a focal length of the lens and/or a focusing distance of the lens at time of acquisition.
  • the actual red eye artifact may be determined based on calculated expected size of the red eye artifact based on the meta-data information including the acquisition device information.
  • the calculated expected size of the red eye artifact may be defined as a range with a density probability function.
  • the range may be determined by depth of field which is a function of said aperture setting.
  • the method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact, may be based further on the anthropometrical information.
  • the range may be determined by a statistical distribution of the anthropometrical information.
  • the determining whether the regions are actual red eye artifact may be performed as a probability determination process based upon multiple criteria.
  • the method may further include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image to a printer.
  • the pixel color correcting may also be performed within the printer.
  • the method may further include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image.
  • a digital apparatus having no photographic film includes a source of light for providing illumination during image capturing; a digital image capturing apparatus; at least one of an image display and an image output; and a red-eye filter for modifying pixels indicative of a red-eye phenomenon within the at least one of the image display and the image output.
  • the apparatus may further include memory for recording the image after applying the filter module for modifying pixels as a modified image.
  • the modified pixels may be stored directly in the image by replacing the pixels within the image indicative of red-eye phenomenon to create the modified image.
  • the modified pixels may be stored as an overlay of the image thus preserving the original image.
  • the modified pixels may be processed by an external device.
  • the external device may be a personal computer and/or a printer.
  • the apparatus may further include an image output for downloading an integral image display for printing the image modified by the red-eye filter.
  • the red-eye correction module may generate an overlay for the pixels indicative of the red-eye phenomenon of the captured image for the at least one of image display and image output.
  • the pixels indicative of the red-eye phenomenon may have a color and shape indicative of the red-eye phenomenon and the image may be modified to change the color to a black color.
  • the source of light may selectively provide illumination during image capturing, and the red-eye filter may be enabled to modify the image in response to the source of light providing illumination during image capturing.
  • the apparatus may include an exposure control means for determining if the image was captured in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto.
  • the red-eye filter may be further enabled in response to the red-eye signal.
  • the red-eye filter may further include a false-detection avoidance apparatus which enables modification of the pixels indicative of the red-eye phenomenon in response to an absence of color indicative of the red-eye phenomenon with in a vicinity of and exclusive to the pixels.
  • the red-eye filter may further include a false-detection avoidance apparatus which enables modification of the pixels in response to one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the pixels.
  • the red-eye filter may detect the pixels within the image indicative of a red-eye phenomenon based on one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.
  • the red-eye filter may include a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon; a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator include a shape indicative of the red-eye phenomenon; and a pixel modifier for modifying the color of the pixels within the grouping.
  • the false-detection analyzer may further process the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto.
  • the apparatus may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
  • the red-eye filter may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
  • the exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether the light source was used during image recording.
  • the exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether low ambient lighting conditions existed during image recording.
  • the exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon.
  • the exposure analyzer may further include a distance analyzer for determining if the subject was at a relatively close distance to the apparatus during image recording.
  • a portable digital image acquisition apparatus having no photographic film includes an integral flash for providing illumination during image recording; a digital image capturing apparatus for recording an image; and a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon.
  • the apparatus may further include an integral image display for displaying the modified image.
  • the area may have a color and shape indicative of the red-eye phenomenon and the image may be modified to change the color to a black color.
  • the integral flash may selectively provide illumination during image recording, and the red-eye filter may be enabled to modify the image in response to the integral flash providing illumination during image recording.
  • the apparatus may include an exposure control means for determining if the image was recorded in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto.
  • the red-eye filter may be further enabled in response to the red-eye signal.
  • the red-eye filter may further include a falsing avoidance apparatus which enables modification of the area in response to an absence of color indicative of the red-eye phenomenon within a vicinity of and exclusive to the area.
  • the red-eye filter may further include a falsing avoidance apparatus which enables modification of the area in response to a substantially white colored region within a vicinity of the area.
  • the red-eye filter may include a pixel locator for locating pixels having a color indicative of the red-eye phenomenon; a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator comprise a shape indicative of the red-eye phenomenon; and a pixel modifier for modifying the color of the pixels within the grouping.
  • the red-eye filter may further include a falsing analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto.
  • the red-eye filter may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
  • a method of filtering a red-eye phenomenon from an acquired digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image is further provided.
  • the method includes analyzing meta-data information including information describing conditions under which the image was acquired, digitized and/or captured; determining one or more regions within the digital image suspected as including red eye artifact; and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact.
  • the method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on said meta-data analysis, whether the regions are actual red eye artifact, may be based further on the anthropometrical information.
  • the filtering method may be executed within a portable image acquisition device, having no photographic film.
  • the filtering method may be executed as a post-processing step on an external computation device.
  • the meta-data information describing the conditions under which the image was acquired may include an indication of whether a flash was used when the image was acquired.
  • the determining whether the regions are actual red eye artifact may be performed as a probability determination process based upon multiple criteria.
  • the method may include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image to a printer. The pixel color correction may also be performed within the printer.
  • FIG. 1 shows a block diagram of an acquisition device operating in accordance with a preferred embodiment.
  • FIG. 2 illustrates a high level workflow of detecting red eye artifacts in digital images in accordance with a preferred embodiment.
  • FIGS. 3 a - 3 d schematically depicts a light sensor, and the formation of a digital pixelated image on it, in accordance with a preferred embodiment.
  • FIG. 4 describes a process of collecting, forwarding and analyzing meta-data as part of red-eye detection in accordance with a preferred embodiment.
  • FIG. 5 illustrates by means of geometric optics, a relationship between an object and an image based on a distance to the object and the focal length, where the focal length is the distance from the image principal plane of the optical system to the image focal plane, which is the plane where the image of the object situated at infinity is formed.
  • FIG. 6 illustrates a relationship between focal length of a lens and depth of field, and an object size as it appears on an image.
  • FIGS. 7 a - 7 c illustrate some anthropometric measurements of a human face for an adult male and female.
  • FIGS. 8 a - 8 b show a workflow diagram describing a statistical analysis of an image using anthropometric data in accordance with a preferred embodiment.
  • FIG. 9 depicts a spectral response of an acquisition system based on spectral sensitivity curves of a hypothetical three color sensor, the spectral distribution of a generic light source and the spectral characteristics of a object being photographed, in accordance with a preferred embodiment.
  • EP 0 884 694 A1 EP 0 911 759 A2,3, EP 1 293 933 A1, EP 1 199 672 A2, EP 1 288 858 A1, EP 1 288 859 A1, and EP 1 288 860 A1;
  • Preferred embodiments described below include methods for detecting red eye artifacts in digital images. Methods are also described for utilizing meta-data gathered as part of the image acquisition to remove such red-eye artifacts. In addition, methods for enhancing the accuracy of detection of red eye artifacts based on a-priori knowledge of the camera sensor, the acquisition mechanism and the color transformation are described. Methods are described for enhancing the speed of detection of red eye artifacts in digital images, and for reducing the amount of false detection of regions suspected to be red-eye artifacts. A method for user-selected tradeoff between the reduction of false detection and the improvement of positive detection is also described.
  • a way to estimate the size of faces is provided, and in particular the eyes in an image and in particular the size of eyes in faces based on the acquisition data.
  • a way to improve the detection of the eyes based on anthropometric analysis of the image is also provided.
  • An improvement is described for the detection of the eyes based on a Bayesian statistical approach.
  • An improvement is also described for the detection of the red eye artifacts based a priori knowledge of the film manufacturer, the film type and/or the emulsion batch of the film.
  • An improvement is also described for the detection of the eye artifact based on a priori knowledge of the scanner its light source and the color sensors of the scanner.
  • a digital camera has a built in flash, an image acquisition mechanism and a way to save the acquired data.
  • the methods of the preferred embodiments are generally applicable to digital image acquisition devices, such as digital cameras and scanners, and to and output devices such as printers and electronic storage devices.
  • digital image acquisition devices such as digital cameras and scanners
  • printers and electronic storage devices such as printers and electronic storage devices.
  • digital camera and output device or printer it is generally meant to more broadly, respectively include digital image acquisition devices and digital data output devices.
  • a printer that receives image data from an original image acquisition device such as a digital camera or scanner may include a display that shows the image, or may be configurable to be cable, rf, or otherwise connected to a display. In this way, the image may be previewed before printing, and if desired, corrected and previewed again until the image is as desired for printing.
  • Another alternative is to permit the image to be printed as a thumbnail with a preview of the red eye corrected regions to save on printing time and money. These regions of interest as to red eye correction may be circled or otherwise indicated in the printer viewer and or in the printed thumbnail.
  • the camera itself includes the red eye correction software, firmware, and/or memory or other electronic component circuitry, then such preview and/or thumbnail capability may be included within the camera that may itself be cable, rf, network and/or otherwise connected to the printer.
  • the digital camera or other acquisition device preferably has the capability of analyzing and processing images.
  • the processing of the images can be done outside of the camera on a general purpose or specialized computer after downloading the images or on a device that is acting as a hosting platform for the digital camera.
  • a device may be, but is not limited to, a hand held PC, a print server, a printer with built in processing capability, or cell phone equipped with a digital camera.
  • the acquisition process can be of an analog image, such as scanning of a film based negative or reversal film, or scanning of a photographic print.
  • the accuracy of a detection process may be measured by two parameters.
  • the former is the correct detection, which relates to the percentage of objects correctly detected.
  • the second parameter for evaluating successful detection is the amount of mis-classifications, which is also defined as false detections or beta-error. False detections relate to the objects falsely determined to have the specific characteristics, which they do not possess.
  • the goal of a successful detection process is to improve the accuracy of correct detections while minimizing the percentage of false detections. In many cases there is a tradeoff between the two. When the search criterion is relaxed, more images are detected but at the same time, more false detections are typically introduced, and vice versa.
  • a preferred embodiment utilizes a priori information about the camera or camera-specific information, anthropometric information about the subject, and information gathered as part of the acquisition process. That is, although information gathered as part of the acquisition process may relate to the camera or other digital acquisition device used, information relating to those parameters that are adjustable or that may change from exposure to exposure, based on user input or otherwise, are generally included herein as information relating to the acquisition process.
  • a priori or camera-specific information is camera-dependent rather than exposure-dependent.
  • a-priori information about the camera may include any of the color sensitivity, spectral response or size of the camera sensor, whether the sensor is CCD or CMOS, and color transformations from the RAW data gathered by the sensor, e.g., CCD, to a known color space such as RGB, the f-stop, or other camera-specific parameters understood by those skilled in the art, or combinations thereof.
  • CCD color sensitivity
  • a-priori information may include the color sensitivity curve of the film, the color sensitivity of the scanner sensor, whether CCD or CMOS, whether linear or area sensors, the color transformations from the RAW data gathered by the scanner to a known color space such as RGB.
  • Acquisition data may include any of the focal distance as determined by the auto focus mechanism of the digital camera, the power of the flash including whether a flash was used at all, the focal length of the lens at acquisition time, the size of the CCD, the depth of field or the lens aperture, exposure duration, or other acquisition parameters understood by those skilled in the art, or combinations thereof.
  • Anthropometric data may include first and higher order statistics, which is an average and a variability of an expected size and ratio between different parts of the human body, and particularly the facial region.
  • the processor can perform a correction step.
  • FIG. 1 is a components diagram in accordance with a preferred embodiment.
  • Block 100 describes the image acquisition device which can be a digital camera in different packaging such as a digital still camera, a lens connected to a hand held computer, a cell phone with image capturing capability, a video camera with still image capturing capability, etc.
  • the first is the light sensor 102 that can be a CCD, CMOS or any other object that transforms light information into electronic encoding.
  • Most cameras are equipped with a built in flash 104 , also referred to as a strobe. In many cases, the camera strobe is physically close to the lens, which tends to accentuate the occurrence and strength of the red eye artifact.
  • the camera is equipped with a lens 106 .
  • the relevant parameters of the lens during acquisition include the aperture 114 , or a f-stop, which primarily determines the depth of field, the focal length 112 which determines the enlargement of the image, and the focusing distance 116 which determines the distance to the objects that the lens 106 was focused at.
  • Block 130 of FIG. 1 describes the red eye filter that performs a process of detection and correction of the red eye artifacts in accordance with a preferred embodiment.
  • the process can be done in the camera as part of the acquisition stage, in the camera at a post processing stage, during the transferring of the images from the camera to an external device such as a personal computer, or on the external device as a post processing stage, such as in the image transfer software or image editing software.
  • the red eye filter includes two main stages.
  • Block 132 describes a meta-data analysis module 132 , where the image and the probability for red eye artifacts are evaluated based on the acquisition data and/or other meta-data.
  • Block 138 describes the pixel-based analysis where the image data is used. The pixel-based analysis 138 preferably receives information from the meta-data stage 132 . Therefore, the decision on the pixel level may vary based on the conditions under which the image was captured and/or other meta-data.
  • Block 160 describes the image storage component 160 that saves the image after the red eye correction operation.
  • FIG. 2 is a workflow representation corresponding to the preferred camera embodiment illustrated at FIG. 1 .
  • the image capture stage is described in block 200 .
  • This operation includes the pre-acquisition setup 210 , where the user and/or the camera determine preferred settings such as f-stop 212 , flash on/off 214 and/or focal length 216 .
  • the image capture stage 200 also includes acquisition or picture taking 226 , and temporary storage in block 228 in its final form or in a raw form that corresponds to the image as captured by the light sensor 102 of FIG. 1 .
  • the camera determines the best acquisition parameters in the pre-acquisition stage 210 .
  • Such parameters may include the right exposure, including gain, white balance and color transformation, and in particular aperture settings 212 and whether to use flash 214 .
  • the user may decide on the focal length 216 of the lens 106 , which is also be referred to as the zoom position.
  • the image after being stored in block 228 is then processed for red eye 230 in accordance with a preferred embodiment, among other stages of processing that may include color corrections, compression, sharpening, etc.
  • the red eye filter preferably includes two main operations. The red eye detection 240 and red eye correction 250 .
  • the red eye detection 240 includes a first stage of analyzing the peripheral or external data, or meta-data 242 , a stage of transferring the revised data 244 , and the specific red eye detection 246 , based on pixel analysis.
  • the red eye correction is illustrated at FIG. 2 as the operation 250 where any image modifications based on the results of the detection stage 240 , are applied to the image.
  • correction may be burned into the data 252 , thus replacing the damaged pixels, saved as a list of the pixels that need to be changed with their new value in the header of the image or externally 254 , and/or presented to the user 256 , requesting the user to take an action in order to apply the corrections, or a combination of these operations.
  • the image, with the corrections applied as described in 240 is then preferably saved in block 260 .
  • FIGS. 3 a - 3 d illustrates in detail the image as created on the receptor 102 of FIG. 1 , which is located at the image plane of the optical system.
  • Such receptor can be any electro-photosensitive object such as CCD or CMOS.
  • FIG. 3 a illustrates a grid type CCD.
  • Each one of the smaller squares (as illustrated by block 302 ) is a cell, which is sensitive to light.
  • the CCD size 304 is calculated as the diagonal of the rectangle made of Width 306 and Height 308 .
  • FIG. 3 b illustrates how a face may be projected onto the CCD.
  • FIG. 3 c illustrates how the image is pixelized, where the continuous image is transformed into a grid based image.
  • FIG. 3 d is more specific to the image as created by a human eye.
  • the image of the eye will include the iris 342 as well as the pupil 344 , which is usually the locations where red-eye artifacts occur.
  • the white part 346 of the eye is also a component of the human eye illustrated at FIG. 3 d and which can be used in red-eye detection, particularly false-detection avoidance.
  • FIG. 4 illustrates various meta-data information that can be utilized as part of a preferred embodiment as a priori input, and the potential outcome of such data analysis.
  • blocks 412 , 422 , and 432 illustrate an operation of red-eye detection relating to the use or non-use of flash.
  • the information whether the flash is used or not, Block 412 is forwarded at operation 422 to red-eye pre-processing 432 to determine whether there is reason to launch the red-eye filter. If a Flash, as determined in 412 is not used, there is preferably no reason to apply the redeye filter. This is a reasonable estimation for consumer lever cameras where most of the red eye is created, as described in the introduction, by the small disparity between the strobe unit and the lens.
  • Blocks 414 , 424 , 434 describe a collection of acquisition meta-data, wherein non-exhaustive examples are provided including the distance to the object, the aperture, CCD size, focal length of the lens and the depth of field. This data is usually recorded on or with the image at acquisition. Based on this information, as transferred to the filter at operation 424 , the filter can determine at operation 434 , e.g., a range of potential sizes of red eye regions.
  • Blocks 416 , 426 , 436 relate to specific information that is unique to the camera.
  • the color composition, e.g., of the image is determined by a few parameters which include the CCD response curves as illustrated in FIG. 9 (see below), and the potential color transformations from the recorded, raw image data such as color correction, gain adjustment and white balance to a known color space such as RGB or YCC.
  • Such transformations can be presented in the form of lookup tables, transformation matrices, color profiles, etc.
  • the software can better determine a more precise range of colors at operation 436 that are good candidates for the red eye artifacts.
  • This information can advantageously narrow down the potential red eye regions based on the variability of sensors and color correction algorithms. It may also help to eliminate colors that, without this knowledge, could be falsely identified as potential red eye region candidates, but are not such in case of a specific combination of sensor and color transformation.
  • FIG. 5 depicts illustrative information that can be gathered to determine the relative size of the object.
  • the ratio of the image size divided by image distance, and the object size divided by the object distance, are approximately equal, wherein the image size divided by the object size is defined as the magnification of the lens 106 . If one knows three out of the four values, namely focal length 112 , distance to object 116 , and object size 516 , one can estimate the size of the object:
  • Object ⁇ ⁇ size ⁇ ⁇ ( 516 ) distance ⁇ ⁇ to ⁇ ⁇ object ⁇ ⁇ ( 116 ) ⁇ image ⁇ ⁇ size ⁇ ⁇ ( 512 ) focal ⁇ ⁇ length ⁇ ⁇ ( 112 )
  • FIG. 6 illustrates the variability generated by the depth of field.
  • Depth of field is defined as the range of distances from the camera to the objects where the images of the objects are captured sufficiently sharp.
  • the depth of field is a function of the aperture. The more open the aperture is, the shallower the depth of field is.
  • FIG. 6 The reason why this information is important and has to be taken into consideration is depicted in FIG. 6 .
  • two objects a tree 614 and a house 624 are located in close distance 616 , and further away 626 respectively. Even though the tree, 614 and the house 634 are the same size, the sizes of the objects or the projections of the objects on the image plane are different and the tree image, 636 being closer to the camera appears much larger than the house 646 .
  • FIG. 7 includes some relevant anthropometrical values for male and female averages.
  • FIG. 7 - a is an average male and
  • FIG. 7 - b is an average adult female.
  • the distance between the eyes, 714 is on average 2.36′′
  • the distance between the eyes and the nostrils, 724 is 1.5′′ the width of the head, 712 is 6.1′′ etc.
  • the object size in order to be considered as a candidate for being a face, and eye or any known object will be:
  • the average size of an eyeball, 770 is roughly 1′′, or 24 mm
  • the average size of the iris, 772 is half in diameter to the full eye, or 0.5′′ or 12 mm in diameter.
  • the pupil, 774 can be as small as a few millimeters, and dilated to as large as the size of the iris. Fortunately, in the case of red-eye artifacts, which happen primarily in low lighting conditions that required a flash, the pupil will be on the dilated side.
  • the variability in this case is not only for different individuals, but also variability based on age. Fortunately, in the case of eyes, the size of the eye is relatively constant as the person grows from a baby into an adult, this is the reason of the striking effect of “big eyes” that is seen in babies and young children.
  • the average infant's eyeball measures approximately 191 ⁇ 2 millimeters from front to back, and as described above, grows to 24 millimeters on average during the person's lifetime. Based on this data, in case of eye detection, the size of the object which is the pupil which is part of the iris, is limited, when allowing some variability to be:
  • the object size as calculated above is going to be in actual physical size such as millimeters or inches. For this invention to become useful, this information needs to be presented measured in pixel sizes.
  • the size of the sensor is depicted by 304 , which is the diagonal of the sensor. Based on that, and the ratio between the width, 306 and the height, 308 , the width and height can be calculated as a Pythagorean triangle.
  • the size of object can now be translated into pixel size.
  • a 1 mm object size is equal to roughly 300 pixels.
  • Image_Size in — pixels Image_Size in — millimeters
  • FIG. 3 d An example is depicted in FIG. 3 d where a hypothetical eye is displayed in pixels, and in this case, the iris 342 , is roughly 11 pixels, and the pupil, 344 , 6 pixels in diameter.
  • this invention presents a decision process capable of rejecting the objects, 346 that are not eyes and selecting most likely candidates to be an eye based on the sizes of the captured images of the objects.
  • FIG. 8 describes a preferred workflow to perform, the analysis based on the sizes of objects, and in the case of human beings, the anthropometrical analysis.
  • the input is the acquisition data 434 , as described in FIG. 4 , and human anthropometric data, 800 as depicted in FIGS. 7 a and 7 b.
  • Step 810 describes the calculation of potential size and distribution of the objects, as corresponds to the camera resolution. This process was fully defined above. Note that this calculation can be done on the fly or alternatively pre-calculated values can be stored in a database to speed up the processing.
  • a preferred embodiment proposes to check, 830 whether the regions fall within the size and distribution as calculated above in 820 . If the size is too large or too small, the system can determine, 890 that the probability for this object to be an eye is low. However, this is a probabilistic result and not necessarily a conclusive one. In other words, the specific region 820 has now low probability assigned to it as a potential eye. If the region is falling inside the allowed size, the probability, 880 are raised.
  • This preferred embodiment describes additional steps to refine the decision, or increase the probability, by analyzing additional clues such as the existence of a second eye, 832 , the surrounding facial features, 834 such as the overall shape of the face, the hair, neck etc., the existence of lips in proximity to the eyes, 836 , the nostrils 838 etc.
  • the question asked is whether the new feature is part of the region, 840 . If the reply is positive, then the probability for identifying the area as an eye is raised, 850 , and if negative, the probability is reduced, 860 .
  • this probabilistic approach can be useful to create a better set of criteria in deciding whether the detected object is what the system is looking for.
  • the detection process involves two types of allowed errors also known as Type-I and Type-II errors, or also referred to as ⁇ -error, which is the acceptable probability of making a wrong decision, or a false positive and ⁇ -error, which is the acceptable probability of not detecting at all. Based on this approach, the probability as decreased or increased in steps 850 and 860 are always compared against the two criteria ⁇ and ⁇ .
  • Bayesian probability can be calculated based on:
  • FIG. 9 illustrates a different kind of information that can be very useful in determining the existence of red eye artifacts, using the color sensitivity of the capturing system such as a digital camera.
  • the capturing system may be analog capture such as film followed by a digitization process such as scanning
  • the graph in FIG. 9 describes the relative response, 950 as a function of the visual wavelength 910 , of the three sensors for blue, 932 , Green 934 , and Red 936 , of a typical CCD type sensor. Similar graph, although with different response curve describes the response of the different layers for photographic film.
  • the x-axis which is the wavelength range of the human visual system, is expanded to include infrared and ultraviolet, which may not be visible to the human eye but may record on a sensor.
  • the y-axis is depicted in relative value as opposed to an absolute one.
  • the three Red, Green, and Blue spectral response functions as functions of the wavelength are defined respectively as:
  • the light source 940 when reaching the three different color sensors, or color pigments on film will generate a response for each of the colors as defined mathematically as the integral of the scalar multiplication of the curves.
  • the range of integration is from the low wavelength region UV to the highest IR.
  • Metamerizm can be a property of the sensor's/film's metamerizm, the human visual system metamerizm, or the light source's metamerizm.
  • Red Eye artifacts are results of the reflection of the strobe light, which has very well defined characteristics, from the vascular membrane behind the retina, which is rich in blood vessels. In most cases, the effect of the external ambient light is relatively low, and the red-eye effect can be considered as a self-illuminating object, with more precise spectral characteristics than other objects.
  • the red eye tristimulus values for this specific sensor are:
  • ⁇ R , G , B ⁇ red - eye ⁇ ⁇ - UV ⁇ - IR ⁇ ⁇ R , G , B ⁇ ⁇ ⁇ L ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇
  • red lookup table As transformed via three lookup tables. For example for red lookup table:
  • Red lookup table R-Lut can be a gamma function from 10 bit raw data to 8 bits as follows:
  • R LUT ( x ) ( R RAW-CCD /1024) 22 *256
  • R ⁇ 1 LUT ( x ) ( R LUT — RAW /256) 1/2.2 *1024
  • the preferred embodiments described above may be modified by adding or changing operations, steps and/or components in many ways to produce advantageous alternative embodiments.
  • the traditional one includes an attempt to reduce one or more reasons that cause red eye prior to taking the picture.
  • the second approach is the post processing of the images to detect and then eliminate the red-eye artifact in a post processing stage, as described in accordance with a preferred embodiment.
  • Meta-data contained in a digital image may be analyzed, as may be referred to as EXIF tags, or simply tags, and utilizing such information, global post-processing may be performed on the image to adjust the image tone, sharpness and/or color balance.
  • EXIF tags EXIF tags
  • Another way to use meta-data is in the photo-finishing industry, where a digital image may be post-processed to optimize the output from a printing system. Examples of this use of meta-data are provided at U.S. Pat. Nos.
  • image meta-data may be used to determine a size range of objects and related features within an image, in addition to the correction of global parameters such as image tone, sharpness and color balance.
  • a red-eye correction procedure may begin with detecting a human face in a digital image and, based on this detection, finding the eyes in the face (see, e.g., U.S. Pat. No. 6,252,976 to Schildkraut and Gray, U.S. Publ. Pat. App. No. 2003/0044070 to Fuersich et al., and U.S. Pat. No. 6,278,491 to Wang and Zhang, which are incorporated by reference).
  • This procedure may preferably begin with detecting one or more face regions of a person or persons in a digital image, followed by detecting an eye region or eye regions in each face, and finally determining if red-eye defects exist in the subject's eyes.
  • a simplified and thus generally less resource intensive, image processing technique is used relative to those described at the '976 and '491 patents which detect face and eye regions in an image and subsequently verify the presence of red-eye defects.
  • An advantageous technique will preferably not weight too heavily upon detecting balanced eye pairs, as this approach can get complex and resource intensive when two or more facial regions overlap or are in close proximity to one another in a digital image.
  • metadata is used to simplify the detection of red-eye defects in a digital image. For example, one or more exclusion criteria may be employed to determine that no flash was used (see also U.S. Publ. Pat. App. No. 2003/0044063 to Meckes et al.).
  • a range of alternative techniques may be employed to detect and verify the existence of red-eye defects in an image (see, e.g., U.S. Publ. Pat. Apps. No. 2003/0044177 and 2003/0044178 to Oberhardt et al., hereby incorporated by reference).
  • a camera may include software or firmware for automatically detecting a red-eye image using a variety of image characteristics such as image brightness, contrast, the presence of human skin and related colors. The analysis of these image characteristics may be utilized, based on certain pre-determined statistical thresholds, to decide if red-eye defects exist and if a flash was used to take the original image.
  • This technique may be applied to images captured on conventional film, which is then digitally scanned, or to initially digitally-acquired images.
  • Metadata is used that can be generated by a digital camera or otherwise recorded in or associated with the body of a digital image initially captured or scanned.
  • meta-data an/or anthropometric data may be used to validate the existence of a red-eye defect in an image.
  • Two copies of a digital image may be captured, one taken with flash illumination and a second taken without flash illumination, and intensity histograms of the two images may be compared in order to locate regions of the image where flash artifacts occur and correct these by reducing intensities in these regions (see, e.g., US Publ. Pat. App. No. 2002/0150306 to Baron). Specular reflections may be removed due to the flash and red-eye can be reduced in this way. However, even Baron recognizes that the technique may involve the setting of separate thresholds for each of the RGB image colors. A technique such as this will generally further involve use of some additional knowledge of the captured image if it is to be relied upon for correctly locating and identifying red-eye defects.
  • Another technique may involve the identification of small specular reflections that occur in the eye region when flash illumination is used (see, e.g., WO 03/026278 to Jarman, which is hereby incorporated by reference).
  • This procedure may be used to detect red-eye defects without first detecting a human face or eye region. It is preferred, however, to use camera-specific information, or other image metadata such as acquisition data, or anthropometric data, or a combination thereof, to assist in the confirmation of a red-eye defect.
  • Digital cameras can also be customized using demographic groups (see, e.g., U.S. Publ. Pat. App. No. 2003/0025811 to Keelan et al., hereby incorporated by reference).
  • the rationale for this technique is that certain aspects of image processing and the image acquisition process such as color and tone balance may be affected by both age-related and racial factors. It is also noted that both racial and age factors can affect the level of red-eye defects, which occur, and thus the pre-flash algorithms and flash-to-lens spacing for a digital camera may be adjusted according to the target market group based on age and nationality. Human faces may be detected and classified according to the age of the subjects (see, e.g., U.S. Pat. No.
  • a number of image processing techniques may be combined with anthropometric data on facial features to determine an estimate of the age category of a particular facial image.
  • the facial features and/or eye regions are validated using anthropometric data within a digital image.
  • the reverse approach may also be employed and may involve a probability inference, also known as Bayesian Statistics.
  • the preferred embodiments described herein may involve expanded digital acquisition technology that inherently involves digital cameras, but that may be integrated with other devices such as cell-phones equipped with an acquisition component, toy cameras etc.
  • the digital camera or other image acquisition device of the preferred embodiment has the capability to record not only image data, but also additional data referred to as meta-data.
  • the file header of an image file such as JPEG, TIFF, JPEG-2000, etc., may include capture information such as whether a flash was used, the distance as recorded by the auto-focus mechanism, the focal length of the lens, the sensor resolution, the shutter and the aperture.
  • the preferred embodiments described herein serve to improve the detection of red eyes in images, while eliminating or reducing the occurrence of false positives, and to improve the correction of the detected artifacts.

Abstract

A method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, includes analyzing meta-data information, determining one or more regions within the digital image suspected as including red eye artifact, and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact. The meta-data information may include information describing conditions under which the image was acquired, captured and/or digitized, acquisition device-specific information, and film information.

Description

    PRIORITY
  • This application is a Continuation of U.S. patent application Ser. No. 11/690,834, filed Aug. Mar. 25, 2007; which is a Divisional of U.S. patent application Ser. No. 10/635,862, filed Aug. 5, 2003, now U.S. Pat. No. 7,630,006; which is a Continuation-in-Part application which claims the benefit of priority to U.S. patent application Ser. No. 10/170,511, filed Jun. 12, 2002, now U.S. Pat. No. 7,042,505; which is a Continuation of U.S. patent application Ser. No. 08/947,603, filed Oct. 9, 1997, now U.S. Pat. No. 6,407,777; which is hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates generally to digital photography using flash, and specifically to filtering “Red Eye” artifacts from digital images shot by digital cameras or scanned by a digital scanner as part of an image acquisition process or an image printing process.
  • 2. Description of the Related Art
  • i. Red Eye Phenomenon
  • “Red-eye” is a phenomenon in flash photography where a flash is reflected within a subject's eye and appears in a photograph as a red dot where the black pupil of the subject's eye would normally appear. The unnatural glowing red of an eye is due to internal reflections from the vascular membrane behind the retina, which is rich in blood vessels. This objectionable phenomenon is well understood to be caused in part by a small angle between the flash of the camera and the lens of the camera. This angle has decreased with the miniaturization of cameras with integral flash capabilities. Additional contributors include the relative closeness of the subject to the camera, iris color where light eyes are more susceptible to this artifact and low ambient light levels which means the pupils are dilated.
  • The red-eye phenomenon can be somewhat minimized by causing the iris to reduce the opening of the pupil. This is typically done with a “pre-flash”, a flash or illumination of light shortly before a flash photograph is taken or a strong additional light source. This causes the iris to close. Unfortunately, these techniques typically delay the photographic exposure process by 0.5 second or more to allow for the pupil to contract. Such delay may cause the user to move, the subject to turn away, etc. Therefore, these techniques, although somewhat useful in removing the red-eye artifact, can cause new unwanted results.
  • ii. Digital Cameras and Red Eye Artifacts
  • Digital cameras are becoming more popular and smaller in size. Digital cameras have several advantages over film cameras, e.g. eliminating the need for film as the image is digitally captured and stored in a memory array for display on a display screen on the camera itself This allows photographs to be viewed and enjoyed virtually instantaneously as opposed to waiting for film processing. Furthermore, the digitally captured image may be downloaded to another display device such as a personal computer or color printer for further enhanced viewing. Digital cameras include microprocessors for image processing and compression and camera systems control. Nevertheless, without a pre-flash, both digital and film cameras can capture the red-eye phenomenon as the flash reflects within a subject's eye. Thus, what is desired is a method of eliminating red-eye phenomenon within a miniature digital camera having a flash without the distraction of a pre-flash.
  • An advantage of digital capture devices is that the image contains more data than the traditional film based image has. Such data is also referred to as meta-data and is usually saved in the header of the digital file. The meta-data may include information about the camera, the user, and the acquisition parameters.
  • iii. Digital Scanning and Red Eye Artifacts
  • In many cases images that originate from analog devices like film are being scanned to create a digital image. The scanning can be either for the purpose of digitization of film based images into digital form, or as an intermediate step as part of the printing of film based images on a digital system. Red Eye phenomenon is a well known problem even for film cameras, and in particular point and shoot cameras where the proximity of the flash and the lens is accentuated. When an image is scanned from film, the scanner may have the option to adjust its scanning parameters in order to accommodate for exposure and color balance. In addition, for negative film, the scanner software will reverse the colors as well as remove the orange, film base mask of the negative.
  • The so-called meta data for film images is generally more limited than for digital cameras. However, most films include information about the manufacturer, the film type and even the batch number of the emulsion. Such information can be useful in evaluating the raw, uncorrected color of eyes suffering from red eye artifacts.
  • iv. Red-Eye Detection and Correction Algorithms
  • Red-eye detection algorithms typically include detecting the pupil and detecting the eye. Both of these operations may be performed in order to determine if red-eye data is red-eye or if an eye has red-eye artifact in it. The success of a red eye detection algorithm is generally dependent on the success of a correct positive detection and a minimal false detection of the two. The detection is primarily done on image data information, also referred to as pixel-data. However, there is quite a lot of a-priori information when the image is captured and the nature of the artifact that can be utilized. Such information relies on both anthropometric information as well as photographic data.
  • v. Anthropometry
  • Anthropometry is defined as the study of human body measurement for use in anthropological classification and comparison. Such data, albeit extremely statistical in nature, can provide good indication as to whether an object is an eye, based on analysis of other detected human objects in the image.
  • vi. Bayesian Statistics
  • A key feature of Bayesian methods is the notion of using an empirically derived probability distribution for a population parameter such as anthropometry. In other words, Bayesian probability takes account of the system's propensity to misidentify the eyes, which is referred to as ‘false positives’. The Bayesian approach permits the use of objective data or subjective opinion in specifying an a priori distribution. With the Bayesian approach, different individuals or applications might specify different prior distributions, and also the system can improve or have a self-learning mode to change the subjective distribution. In this context, Bayes' theorem provides a mechanism for combining an a priori probability distribution for the states of nature with new sample information, the combined data giving a revised probability distribution about the states of nature, which can then be used as an a priori probability with a future new sample, and so on. The intent is that the earlier probabilities are then used to make ever better decisions. Thus, this is an iterative or learning process, and is a common basis for establishing computer programs that learn from experience.
  • Mathematically,
  • While conditional probability is defined as:
  • P ( A B ) = P ( A B ) P ( B )
  • In Bayesian statistics:
  • P ( A B ) = P ( B A ) P ( B ) P ( A )
  • Alternatively a verbal way of representing it is:
  • Posterior = Likelihood × Prioir Normalizing_Factor
  • Or with a Likelihood function L( ), over a selection of events, which is also referred to as the Law of Total Probability:
  • P ( B i A ) = L ( A B i ) P ( B ) all - j L ( A B i ) P ( B j )
  • A Venn diagram is depicted in FIG. 8-b.
  • SUMMARY OF THE INVENTION
  • A method of filtering a red-eye phenomenon from an acquired digital image including a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, is provided. The method includes analyzing meta-data information including information describing conditions under which the image was acquired and/or acquisition device-specific information; determining one or more regions within said digital image suspected as including red eye artifact; and determining, based at least in part on said meta-data analysis, whether said regions are actual red eye artifact.
  • The method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on said meta-data analysis, whether the regions are actual red eye artifact, being based further on the anthropometrical information.
  • The filtering may be executed within a portable image acquisition device, having no photographic film. The filtering may be executed as a post-processing step on an external computation device.
  • The meta-data information describing the conditions under which the image was acquired may include an indication of whether a flash was used when the image was acquired and/or an aperture at the time of the acquisition. The acquisition device information may include sensor size and/or a spectral response of a sensor of the acquisition device. The acquisition device information may further or alternatively include a color transformation from raw sensor pixel values to saved image pixel values. A color of the pixels indicative of red eye color may be calculated based on a spectral response and a color transformation.
  • A lens may be used to capture the image. The meta-data information may include a focal length of the lens and/or a focusing distance of the lens at time of acquisition.
  • The actual red eye artifact may be determined based on calculated expected size of the red eye artifact based on the meta-data information including the acquisition device information. The calculated expected size of the red eye artifact may be defined as a range with a density probability function. The range may be determined by depth of field which is a function of said aperture setting. The method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact, may be based further on the anthropometrical information. The range may be determined by a statistical distribution of the anthropometrical information.
  • The determining whether the regions are actual red eye artifact may be performed as a probability determination process based upon multiple criteria. The method may further include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image to a printer. The pixel color correcting may also be performed within the printer. The method may further include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image.
  • A digital apparatus having no photographic film is also provided. The apparatus includes a source of light for providing illumination during image capturing; a digital image capturing apparatus; at least one of an image display and an image output; and a red-eye filter for modifying pixels indicative of a red-eye phenomenon within the at least one of the image display and the image output.
  • The apparatus may further include memory for recording the image after applying the filter module for modifying pixels as a modified image. The modified pixels may be stored directly in the image by replacing the pixels within the image indicative of red-eye phenomenon to create the modified image. The modified pixels may be stored as an overlay of the image thus preserving the original image. The modified pixels may be processed by an external device. The external device may be a personal computer and/or a printer.
  • The apparatus may further include an image output for downloading an integral image display for printing the image modified by the red-eye filter. The red-eye correction module may generate an overlay for the pixels indicative of the red-eye phenomenon of the captured image for the at least one of image display and image output.
  • The pixels indicative of the red-eye phenomenon may have a color and shape indicative of the red-eye phenomenon and the image may be modified to change the color to a black color. Also, the source of light may selectively provide illumination during image capturing, and the red-eye filter may be enabled to modify the image in response to the source of light providing illumination during image capturing. The apparatus may include an exposure control means for determining if the image was captured in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto. The red-eye filter may be further enabled in response to the red-eye signal.
  • The red-eye filter may further include a false-detection avoidance apparatus which enables modification of the pixels indicative of the red-eye phenomenon in response to an absence of color indicative of the red-eye phenomenon with in a vicinity of and exclusive to the pixels. The red-eye filter may further include a false-detection avoidance apparatus which enables modification of the pixels in response to one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the pixels. The red-eye filter may detect the pixels within the image indicative of a red-eye phenomenon based on one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.
  • The red-eye filter may include a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon; a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator include a shape indicative of the red-eye phenomenon; and a pixel modifier for modifying the color of the pixels within the grouping. The false-detection analyzer may further process the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto. The apparatus may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon. The red-eye filter may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
  • The exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether the light source was used during image recording. The exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether low ambient lighting conditions existed during image recording. The exposure analyzer may determine if the image was recorded in a condition indicative of the red-eye phenomenon. The exposure analyzer may further include a distance analyzer for determining if the subject was at a relatively close distance to the apparatus during image recording.
  • A portable digital image acquisition apparatus having no photographic film is also provided. The apparatus includes an integral flash for providing illumination during image recording; a digital image capturing apparatus for recording an image; and a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon.
  • The apparatus may further include an integral image display for displaying the modified image. The area may have a color and shape indicative of the red-eye phenomenon and the image may be modified to change the color to a black color. The integral flash may selectively provide illumination during image recording, and the red-eye filter may be enabled to modify the image in response to the integral flash providing illumination during image recording.
  • The apparatus may include an exposure control means for determining if the image was recorded in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto. The red-eye filter may be further enabled in response to the red-eye signal.
  • The red-eye filter may further include a falsing avoidance apparatus which enables modification of the area in response to an absence of color indicative of the red-eye phenomenon within a vicinity of and exclusive to the area. The red-eye filter may further include a falsing avoidance apparatus which enables modification of the area in response to a substantially white colored region within a vicinity of the area.
  • The red-eye filter may include a pixel locator for locating pixels having a color indicative of the red-eye phenomenon; a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator comprise a shape indicative of the red-eye phenomenon; and a pixel modifier for modifying the color of the pixels within the grouping. The red-eye filter may further include a falsing analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto. The red-eye filter may further include an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
  • A method of filtering a red-eye phenomenon from an acquired digital image comprising a multiplicity of pixels indicative of color, the pixels forming various shapes of the image, is further provided. The method includes analyzing meta-data information including information describing conditions under which the image was acquired, digitized and/or captured; determining one or more regions within the digital image suspected as including red eye artifact; and determining, based at least in part on the meta-data analysis, whether the regions are actual red eye artifact.
  • The method may further include obtaining anthropometrical information of human faces and the determining, based at least in part on said meta-data analysis, whether the regions are actual red eye artifact, may be based further on the anthropometrical information. The filtering method may be executed within a portable image acquisition device, having no photographic film. The filtering method may be executed as a post-processing step on an external computation device. The meta-data information describing the conditions under which the image was acquired may include an indication of whether a flash was used when the image was acquired. The determining whether the regions are actual red eye artifact may be performed as a probability determination process based upon multiple criteria. The method may include adjusting a pixel color within any of the regions wherein red eye artifact is determined and outputting an adjusted image to a printer. The pixel color correction may also be performed within the printer.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a block diagram of an acquisition device operating in accordance with a preferred embodiment.
  • FIG. 2 illustrates a high level workflow of detecting red eye artifacts in digital images in accordance with a preferred embodiment.
  • FIGS. 3 a-3 d schematically depicts a light sensor, and the formation of a digital pixelated image on it, in accordance with a preferred embodiment.
  • FIG. 4 describes a process of collecting, forwarding and analyzing meta-data as part of red-eye detection in accordance with a preferred embodiment.
  • FIG. 5 illustrates by means of geometric optics, a relationship between an object and an image based on a distance to the object and the focal length, where the focal length is the distance from the image principal plane of the optical system to the image focal plane, which is the plane where the image of the object situated at infinity is formed.
  • FIG. 6 illustrates a relationship between focal length of a lens and depth of field, and an object size as it appears on an image.
  • FIGS. 7 a-7 c illustrate some anthropometric measurements of a human face for an adult male and female.
  • FIGS. 8 a-8 b show a workflow diagram describing a statistical analysis of an image using anthropometric data in accordance with a preferred embodiment.
  • FIG. 9 depicts a spectral response of an acquisition system based on spectral sensitivity curves of a hypothetical three color sensor, the spectral distribution of a generic light source and the spectral characteristics of a object being photographed, in accordance with a preferred embodiment.
  • INCORPORATION BY REFERENCE
  • What follows is a cite list of references which are, in addition to those references cited above and below herein, and including that which is described as background, the invention summary, brief description of the drawings, the drawings and the abstract, hereby incorporated by reference into the detailed description of the preferred embodiments below, as disclosing alternative embodiments of elements or features of the preferred embodiments not otherwise set forth in detail below. A single one or a combination of two or more of these references may be consulted to obtain a variation of the preferred embodiments described in the detailed description below. Further patent, patent application and non-patent references are cited in the written description and are also incorporated by reference into the preferred embodiment with the same effect as just described with respect to the following references:
  • U.S. Pat. Nos. 4,285,588, 5,016,107, 5,070,355, 5,202,720, 5,537,516, 5,452,048, 5,748,764, 5,761,550, 5,781,650, 5,862,217, 5,862,218, 5,991,549, 6,006,039, 6,433,818, 6,510,520, 6,516,154, 6,505,003, 6,501,911, 6,496,655, 6,429,924, 6,252,976, 6,278,491;
  • United States published applications no. 2003/0058349, 2003/0044177, 2003/0044178, 2003/0044070, 2003/0044063, 2003/0025811, 2002/0150306, 2002/0041329, 2002/0141661, and 2002/0159630;
  • PCT published applications no. WO 03/026278, WO 99/17254; and WO 01/71421; and
  • Japanese patents no. JP 04-192681, JP 2000/134486, and JP 2002/271808; and
  • European patents no. EP 0 884 694 A1, EP 0 911 759 A2,3, EP 1 293 933 A1, EP 1 199 672 A2, EP 1 288 858 A1, EP 1 288 859 A1, and EP 1 288 860 A1; and
  • Matthew Gaubatz, et al., “Automatic Red-eye Detection and correction”, IEEE ICIP, 2002, pp. I-804-I-807.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Preferred embodiments described below include methods for detecting red eye artifacts in digital images. Methods are also described for utilizing meta-data gathered as part of the image acquisition to remove such red-eye artifacts. In addition, methods for enhancing the accuracy of detection of red eye artifacts based on a-priori knowledge of the camera sensor, the acquisition mechanism and the color transformation are described. Methods are described for enhancing the speed of detection of red eye artifacts in digital images, and for reducing the amount of false detection of regions suspected to be red-eye artifacts. A method for user-selected tradeoff between the reduction of false detection and the improvement of positive detection is also described. In addition, a way to estimate the size of faces is provided, and in particular the eyes in an image and in particular the size of eyes in faces based on the acquisition data. A way to improve the detection of the eyes based on anthropometric analysis of the image is also provided. An improvement is described for the detection of the eyes based on a Bayesian statistical approach. An improvement is also described for the detection of the red eye artifacts based a priori knowledge of the film manufacturer, the film type and/or the emulsion batch of the film. An improvement is also described for the detection of the eye artifact based on a priori knowledge of the scanner its light source and the color sensors of the scanner.
  • In one embodiment, a digital camera has a built in flash, an image acquisition mechanism and a way to save the acquired data. The methods of the preferred embodiments are generally applicable to digital image acquisition devices, such as digital cameras and scanners, and to and output devices such as printers and electronic storage devices. When the terms digital camera and output device or printer are used, it is generally meant to more broadly, respectively include digital image acquisition devices and digital data output devices.
  • A printer that receives image data from an original image acquisition device such as a digital camera or scanner may include a display that shows the image, or may be configurable to be cable, rf, or otherwise connected to a display. In this way, the image may be previewed before printing, and if desired, corrected and previewed again until the image is as desired for printing. Another alternative is to permit the image to be printed as a thumbnail with a preview of the red eye corrected regions to save on printing time and money. These regions of interest as to red eye correction may be circled or otherwise indicated in the printer viewer and or in the printed thumbnail. In a case where the camera itself includes the red eye correction software, firmware, and/or memory or other electronic component circuitry, then such preview and/or thumbnail capability may be included within the camera that may itself be cable, rf, network and/or otherwise connected to the printer.
  • The digital camera or other acquisition device preferably has the capability of analyzing and processing images. Alternatively, the processing of the images can be done outside of the camera on a general purpose or specialized computer after downloading the images or on a device that is acting as a hosting platform for the digital camera. Such a device may be, but is not limited to, a hand held PC, a print server, a printer with built in processing capability, or cell phone equipped with a digital camera. Alternatively the acquisition process can be of an analog image, such as scanning of a film based negative or reversal film, or scanning of a photographic print.
  • The accuracy of a detection process may be measured by two parameters. The former is the correct detection, which relates to the percentage of objects correctly detected. The second parameter for evaluating successful detection is the amount of mis-classifications, which is also defined as false detections or beta-error. False detections relate to the objects falsely determined to have the specific characteristics, which they do not possess.
  • Overall, the goal of a successful detection process is to improve the accuracy of correct detections while minimizing the percentage of false detections. In many cases there is a tradeoff between the two. When the search criterion is relaxed, more images are detected but at the same time, more false detections are typically introduced, and vice versa.
  • In order to improve the accuracy of the red eye detection and correction, a preferred embodiment utilizes a priori information about the camera or camera-specific information, anthropometric information about the subject, and information gathered as part of the acquisition process. That is, although information gathered as part of the acquisition process may relate to the camera or other digital acquisition device used, information relating to those parameters that are adjustable or that may change from exposure to exposure, based on user input or otherwise, are generally included herein as information relating to the acquisition process. A priori or camera-specific information is camera-dependent rather than exposure-dependent. For example, a-priori information about the camera may include any of the color sensitivity, spectral response or size of the camera sensor, whether the sensor is CCD or CMOS, and color transformations from the RAW data gathered by the sensor, e.g., CCD, to a known color space such as RGB, the f-stop, or other camera-specific parameters understood by those skilled in the art, or combinations thereof. In the case of scanning such a-priori information may include the color sensitivity curve of the film, the color sensitivity of the scanner sensor, whether CCD or CMOS, whether linear or area sensors, the color transformations from the RAW data gathered by the scanner to a known color space such as RGB. Acquisition data may include any of the focal distance as determined by the auto focus mechanism of the digital camera, the power of the flash including whether a flash was used at all, the focal length of the lens at acquisition time, the size of the CCD, the depth of field or the lens aperture, exposure duration, or other acquisition parameters understood by those skilled in the art, or combinations thereof. Anthropometric data may include first and higher order statistics, which is an average and a variability of an expected size and ratio between different parts of the human body, and particularly the facial region.
  • Based on utilizing the aforementioned information, preferred embodiments described herein achieve a more accurate detection of the regions containing red eye artifacts. Based on this detection, the processor, whether in the camera or on a different device, can perform a correction step.
  • FIG. 1 is a components diagram in accordance with a preferred embodiment. Block 100 describes the image acquisition device which can be a digital camera in different packaging such as a digital still camera, a lens connected to a hand held computer, a cell phone with image capturing capability, a video camera with still image capturing capability, etc.
  • In the image capture apparatus 100, there are a few components shown in block form in FIG. 1. The first is the light sensor 102 that can be a CCD, CMOS or any other object that transforms light information into electronic encoding. Most cameras are equipped with a built in flash 104, also referred to as a strobe. In many cases, the camera strobe is physically close to the lens, which tends to accentuate the occurrence and strength of the red eye artifact. In addition, the camera is equipped with a lens 106. The relevant parameters of the lens during acquisition include the aperture 114, or a f-stop, which primarily determines the depth of field, the focal length 112 which determines the enlargement of the image, and the focusing distance 116 which determines the distance to the objects that the lens 106 was focused at.
  • Block 130 of FIG. 1 describes the red eye filter that performs a process of detection and correction of the red eye artifacts in accordance with a preferred embodiment. The process can be done in the camera as part of the acquisition stage, in the camera at a post processing stage, during the transferring of the images from the camera to an external device such as a personal computer, or on the external device as a post processing stage, such as in the image transfer software or image editing software.
  • The red eye filter includes two main stages. Block 132 describes a meta-data analysis module 132, where the image and the probability for red eye artifacts are evaluated based on the acquisition data and/or other meta-data. Block 138 describes the pixel-based analysis where the image data is used. The pixel-based analysis 138 preferably receives information from the meta-data stage 132. Therefore, the decision on the pixel level may vary based on the conditions under which the image was captured and/or other meta-data. Block 160 describes the image storage component 160 that saves the image after the red eye correction operation.
  • FIG. 2 is a workflow representation corresponding to the preferred camera embodiment illustrated at FIG. 1. The image capture stage is described in block 200. This operation includes the pre-acquisition setup 210, where the user and/or the camera determine preferred settings such as f-stop 212, flash on/off 214 and/or focal length 216. The image capture stage 200 also includes acquisition or picture taking 226, and temporary storage in block 228 in its final form or in a raw form that corresponds to the image as captured by the light sensor 102 of FIG. 1. As part of the capture process, the camera determines the best acquisition parameters in the pre-acquisition stage 210. Such parameters may include the right exposure, including gain, white balance and color transformation, and in particular aperture settings 212 and whether to use flash 214. In addition, the user may decide on the focal length 216 of the lens 106, which is also be referred to as the zoom position.
  • The image after being stored in block 228, is then processed for red eye 230 in accordance with a preferred embodiment, among other stages of processing that may include color corrections, compression, sharpening, etc. The red eye filter preferably includes two main operations. The red eye detection 240 and red eye correction 250.
  • The red eye detection 240 includes a first stage of analyzing the peripheral or external data, or meta-data 242, a stage of transferring the revised data 244, and the specific red eye detection 246, based on pixel analysis.
  • The red eye correction is illustrated at FIG. 2 as the operation 250 where any image modifications based on the results of the detection stage 240, are applied to the image. At this stage 250, correction may be burned into the data 252, thus replacing the damaged pixels, saved as a list of the pixels that need to be changed with their new value in the header of the image or externally 254, and/or presented to the user 256, requesting the user to take an action in order to apply the corrections, or a combination of these operations. The image, with the corrections applied as described in 240, is then preferably saved in block 260.
  • FIGS. 3 a-3 d illustrates in detail the image as created on the receptor 102 of FIG. 1, which is located at the image plane of the optical system. Such receptor can be any electro-photosensitive object such as CCD or CMOS.
  • FIG. 3 a illustrates a grid type CCD. Each one of the smaller squares (as illustrated by block 302) is a cell, which is sensitive to light. The CCD size 304 is calculated as the diagonal of the rectangle made of Width 306 and Height 308.
  • FIG. 3 b illustrates how a face may be projected onto the CCD. FIG. 3 c illustrates how the image is pixelized, where the continuous image is transformed into a grid based image.
  • FIG. 3 d is more specific to the image as created by a human eye. The image of the eye will include the iris 342 as well as the pupil 344, which is usually the locations where red-eye artifacts occur. The white part 346 of the eye is also a component of the human eye illustrated at FIG. 3 d and which can be used in red-eye detection, particularly false-detection avoidance.
  • FIG. 4 illustrates various meta-data information that can be utilized as part of a preferred embodiment as a priori input, and the potential outcome of such data analysis. For example, blocks 412, 422, and 432 illustrate an operation of red-eye detection relating to the use or non-use of flash. The information whether the flash is used or not, Block 412, is forwarded at operation 422 to red-eye pre-processing 432 to determine whether there is reason to launch the red-eye filter. If a Flash, as determined in 412 is not used, there is preferably no reason to apply the redeye filter. This is a reasonable estimation for consumer lever cameras where most of the red eye is created, as described in the introduction, by the small disparity between the strobe unit and the lens.
  • Blocks 414, 424, 434 describe a collection of acquisition meta-data, wherein non-exhaustive examples are provided including the distance to the object, the aperture, CCD size, focal length of the lens and the depth of field. This data is usually recorded on or with the image at acquisition. Based on this information, as transferred to the filter at operation 424, the filter can determine at operation 434, e.g., a range of potential sizes of red eye regions.
  • Blocks 416, 426, 436 relate to specific information that is unique to the camera. The color composition, e.g., of the image is determined by a few parameters which include the CCD response curves as illustrated in FIG. 9 (see below), and the potential color transformations from the recorded, raw image data such as color correction, gain adjustment and white balance to a known color space such as RGB or YCC. Such transformations can be presented in the form of lookup tables, transformation matrices, color profiles, etc.
  • Based on the knowledge of the transfer from operation 426, the software can better determine a more precise range of colors at operation 436 that are good candidates for the red eye artifacts. This information can advantageously narrow down the potential red eye regions based on the variability of sensors and color correction algorithms. It may also help to eliminate colors that, without this knowledge, could be falsely identified as potential red eye region candidates, but are not such in case of a specific combination of sensor and color transformation.
  • FIG. 5 depicts illustrative information that can be gathered to determine the relative size of the object. The ratio of the image size divided by image distance, and the object size divided by the object distance, are approximately equal, wherein the image size divided by the object size is defined as the magnification of the lens 106. If one knows three out of the four values, namely focal length 112, distance to object 116, and object size 516, one can estimate the size of the object:
  • Object size ( 516 ) distance to object ( 116 ) = image size ( 512 ) focal length ( 112 )
  • If one knows three out of the four values, namely focal length 112,distance to object 116, and object size 516 one can estimate the image size 512:
  • Object size ( 516 ) = distance to object ( 116 ) · image size ( 512 ) focal length ( 112 )
  • However, the parameter values described above are usually not known precisely. Instead, distributions of values can be estimated based on different reasons as depicted in FIGS. 6, 7 and 8.
  • FIG. 6, illustrates the variability generated by the depth of field. Depth of field is defined as the range of distances from the camera to the objects where the images of the objects are captured sufficiently sharp. For a fixed length lens, the depth of field is a function of the aperture. The more open the aperture is, the shallower the depth of field is.
  • As can be seen in FIG. 6, due to the fact that the depth of field can be rather large, the distance to the objects still in focus can vary. Therefore the parameter

  • Distance_to_Subject
  • is rather a range:

  • Distance_to_SubjectClose range≦Subject≦Distance_to_SubjectFar range
  • The reason why this information is important and has to be taken into consideration is depicted in FIG. 6. In this case, two objects, a tree 614 and a house 624 are located in close distance 616, and further away 626 respectively. Even though the tree, 614 and the house 634 are the same size, the sizes of the objects or the projections of the objects on the image plane are different and the tree image, 636 being closer to the camera appears much larger than the house 646.
  • FIG. 7 includes some relevant anthropometrical values for male and female averages. FIG. 7-a is an average male and FIG. 7-b is an average adult female. For example, for adult male, 700, the distance between the eyes, 714, is on average 2.36″, the distance between the eyes and the nostrils, 724, is 1.5″ the width of the head, 712 is 6.1″ etc.
  • However, this is only the first order approximation. There is a second order approximation, which is the overall variability of the values. Such variability once again needs to be calculated into the formula.
  • Or:

  • Subject_SizeSmall≦Subject_Size≦Subject_SizeLarge
  • The object size, in order to be considered as a candidate for being a face, and eye or any known object will be:
  • Subject_SizeSmall * Focal_Length Distance_To _Object Far _ Range Object_Size Subject_Size large * Focal_Length Distance_To _Object Close _ Range
  • Specifically, as seen in FIG. 7-c, the average size of an eyeball, 770, is roughly 1″, or 24 mm, and the average size of the iris, 772, is half in diameter to the full eye, or 0.5″ or 12 mm in diameter. The pupil, 774 can be as small as a few millimeters, and dilated to as large as the size of the iris. Fortunately, in the case of red-eye artifacts, which happen primarily in low lighting conditions that required a flash, the pupil will be on the dilated side.
  • The variability in this case is not only for different individuals, but also variability based on age. Luckily, in the case of eyes, the size of the eye is relatively constant as the person grows from a baby into an adult, this is the reason of the striking effect of “big eyes” that is seen in babies and young children. The average infant's eyeball measures approximately 19½ millimeters from front to back, and as described above, grows to 24 millimeters on average during the person's lifetime. Based on this data, in case of eye detection, the size of the object which is the pupil which is part of the iris, is limited, when allowing some variability to be:

  • 9 mm≦Size_Of_Iris≦13 mm
  • The object size as calculated above is going to be in actual physical size such as millimeters or inches. For this invention to become useful, this information needs to be presented measured in pixel sizes.
  • Returning to FIG. 3 a, the size of the sensor is depicted by 304, which is the diagonal of the sensor. Based on that, and the ratio between the width, 306 and the height, 308, the width and height can be calculated as a Pythagorean triangle.

  • Sensor_Diagonal_Size=√{square root over (width2+Height2)}
  • Knowing the sensor resolution, the size of object can now be translated into pixel size.
  • For Example:
    • Given a ½ inch (12 mm) CCD, with an aspect ratio of 2:3, and a 2,000×3,000 CCD resolution:
    • The width of the CCD is:
  • 12 mm = ( 2 α ) 2 + ( 3 α ) 2 = 13 α 3 α = 3 × 12 / 13 3 × 3.3 10 mm
  • and therefore, for a 3000 pixel width, a 1 mm object size is equal to roughly 300 pixels.
  • Or

  • Image_Sizein pixels=Image_Sizein millimeters
  • Based on this formula, when an image is now detected, its size in pixels is compared to the range allowed, and decided whether the object is a candidate or not.
  • An example is depicted in FIG. 3 d where a hypothetical eye is displayed in pixels, and in this case, the iris 342, is roughly 11 pixels, and the pupil, 344, 6 pixels in diameter. With the added knowledge of the distance to the object and the focal length of the lens, this invention presents a decision process capable of rejecting the objects, 346 that are not eyes and selecting most likely candidates to be an eye based on the sizes of the captured images of the objects.
  • FIG. 8 describes a preferred workflow to perform, the analysis based on the sizes of objects, and in the case of human beings, the anthropometrical analysis. The input is the acquisition data 434, as described in FIG. 4, and human anthropometric data, 800 as depicted in FIGS. 7 a and 7 b.
  • Step 810 describes the calculation of potential size and distribution of the objects, as corresponds to the camera resolution. This process was fully defined above. Note that this calculation can be done on the fly or alternatively pre-calculated values can be stored in a database to speed up the processing.
  • When looking for eyes in an image, but not limited specifically to eyes, given regions suspected as eyes, 820, a preferred embodiment proposes to check, 830 whether the regions fall within the size and distribution as calculated above in 820. If the size is too large or too small, the system can determine, 890 that the probability for this object to be an eye is low. However, this is a probabilistic result and not necessarily a conclusive one. In other words, the specific region 820 has now low probability assigned to it as a potential eye. If the region is falling inside the allowed size, the probability, 880 are raised.
  • This preferred embodiment describes additional steps to refine the decision, or increase the probability, by analyzing additional clues such as the existence of a second eye, 832, the surrounding facial features, 834 such as the overall shape of the face, the hair, neck etc., the existence of lips in proximity to the eyes, 836, the nostrils 838 etc.
  • In each step, the question asked is whether the new feature is part of the region, 840. If the reply is positive, then the probability for identifying the area as an eye is raised, 850, and if negative, the probability is reduced, 860. Of course, this probabilistic approach can be useful to create a better set of criteria in deciding whether the detected object is what the system is looking for. In more detail, the detection process involves two types of allowed errors also known as Type-I and Type-II errors, or also referred to as α-error, which is the acceptable probability of making a wrong decision, or a false positive and β-error, which is the acceptable probability of not detecting at all. Based on this approach, the probability as decreased or increased in steps 850 and 860 are always compared against the two criteria α and β.
  • Alternatively to the classical statistical approach, this analysis can be done using Bayesian approach. As defined above, Bayesian probability can be calculated based on:
  • P ( B i A ) = L ( A B i ) P ( B ) all - j L ( A B j ) P ( B j )
  • This is further depicted in FIG. 8 b. Specifically to this embodiment, the events are:
    • A=Region detected is red eye, as depicted in Block 870
    • Bj=the various detected features as defined in blocks 872,874,876 and 878, 834,836 and 838.
    • A∩Bj=Probability that the area is red eye AND that another attribute is found. For example If Bi is the probability of detecting lips,
    • A∩Bj is the probability that the region is an eye and that the lips are detected.
    • P(Bi|A) is the probability that lips exist when eye is detected.
    • And
    • P(A|Bi) is the probability of eye detection given the probability of lips detection.
  • FIG. 9 illustrates a different kind of information that can be very useful in determining the existence of red eye artifacts, using the color sensitivity of the capturing system such as a digital camera. Alternatively the capturing system may be analog capture such as film followed by a digitization process such as scanning
  • The graph in FIG. 9 describes the relative response, 950 as a function of the visual wavelength 910, of the three sensors for blue, 932, Green 934, and Red 936, of a typical CCD type sensor. Similar graph, although with different response curve describes the response of the different layers for photographic film.
  • The x-axis, which is the wavelength range of the human visual system, is expanded to include infrared and ultraviolet, which may not be visible to the human eye but may record on a sensor. The y-axis is depicted in relative value as opposed to an absolute one. The three Red, Green, and Blue spectral response functions as functions of the wavelength are defined respectively as:

  • R(λ), G(λ), B(λ)
  • Given a light source 940 defined as a spectral response curve L(λ), the light source 940 when reaching the three different color sensors, or color pigments on film will generate a response for each of the colors as defined mathematically as the integral of the scalar multiplication of the curves. The range of integration is from the low wavelength region UV to the highest IR.
  • R = λ - UV λ - IR R λ × L λ λ , G = λ - UV λ - IR G λ × L λ λ B = λ - UV λ - IR B λ × L λ λ
  • to create a tristimulus value of {R, G, B}
  • Those skilled in the art are familiar with the fact that different spectral responses may create the same tristimulus values due to the scalar reduction from a 2 dimensional representation to a single value. This effect is also known as Metamerizm which can be a property of the sensor's/film's metamerizm, the human visual system metamerizm, or the light source's metamerizm.
  • Due to the many variable parameters, it is relatively hard to find a specific color that can be a fixed-reference-point in an image. The reason is that the reflected colors are usually dependent on many factors and especially on the ambient light. However, Red Eye artifacts, as previously explained, are results of the reflection of the strobe light, which has very well defined characteristics, from the vascular membrane behind the retina, which is rich in blood vessels. In most cases, the effect of the external ambient light is relatively low, and the red-eye effect can be considered as a self-illuminating object, with more precise spectral characteristics than other objects. An example of such spectral response, which is a combination, of the flash spectral response, which is relatively broad and the blood vessels inside the eye, is depicted in block 940.
  • Given the spectral sensitivity of the sensor:

  • R(λ), G(λ), B(λ)
  • and the reflection of the flash light in the eye, as defined by 950, E(λ), the red eye tristimulus values for this specific sensor are:
  • { R , G , B } red - eye = λ - UV λ - IR { R , G , B } λ × L λ λ
  • This value of {R, G B}red-eye is relatively constant for a given camera. However, due to the difference in the response between different sensors, these values are not constant across different cameras. However, with the knowledge of the response curves above, one can determine a much closer approximation of the range or red colors based on this information. Note that it is not only the value of the Red that may help in such determination, but also the residual response of the red eye on the Green and even less the blue sensor. One skilled in the art knows that most cameras perform additional transformations for exposure and tone reproduction for images before saving them into persistent storage. An example of such transformation will be a concatenation of color correction and tone reproduction as a function of the pixel value:
  • Given a Raw pixel value of:

  • {R, G, B}RAW-CCD
  • as transformed via three lookup tables. For example for red lookup table:

  • R−LUT (Raw−Pix): {input_values}→{output_values}
  • For example the Red lookup table R-Lut can be a gamma function from 10 bit raw data to 8 bits as follows:

  • RLUT(Raw−Pix): {0..1024}→{0..256}

  • R LUT(x)=(R RAW-CCD/1024)22*256
  • and the inverse function

  • R −1 LUT(x)=(R LUT RAW/256)1/2.2*1024
  • the {R,G,B} values after transformed through the lookup table will be:
  • { R , G , B } LUT - RAW = { R LUT ( R RAW - CCD ) , G LUT ( G RAW - CCD ) , B LUT ( B RAW - CCD ) } { R , G , B } new = { R , G , B } LUT - RAW × [ RR RG RB GR GG GB BR BG BB ]
  • With the internal knowledge of these transformations, one can reverse the process, to reach the RAW values as defined above.
  • { R , G , B } LUT - RAW = [ RR RG RB GR GG GB BR BG BB ] - 1 × { R , G , B } NEW T and { R , G , B } RAW = { R LUT - 1 ( R LUT - RAW ) , G LUT - 1 ( G lut - raw ) , B LUT - 1 ( B LUT - RAW ) }
  • and the value of the raw tristimulus values can be then determined and used for the exact matching. Similar transformations are performed by digital scanners in order to correct for sub optimal images such as underexposure, or wrong ambient light. Reversing the process may be difficult in its pure mathematical sense e.g. the conversion function may through the transformation not be fully reversible. Such issues occur for example when the pixel values are clipped or condensed. In such cases, there is a need to define a numerical approximation to the inverse function.
  • The preferred embodiments described above may be modified by adding or changing operations, steps and/or components in many ways to produce advantageous alternative embodiments. For example, there are generally two approaches to removing red-eye from images. The traditional one includes an attempt to reduce one or more reasons that cause red eye prior to taking the picture. The second approach is the post processing of the images to detect and then eliminate the red-eye artifact in a post processing stage, as described in accordance with a preferred embodiment.
  • There are many ways that analysis processes operating within a camera prior to invoking a pre-flash may be configured. Various conditions may be monitored prior to the photograph and even before the pre-flash is generated. These conditions may include the ambient light level and the distance of the subject from the camera (see, e.g., U.S. Pat. No. 5,070,355 to Inoue et al., hereby incorporated by reference). According to one embodiment, steps may be taken that generally reduce the occurrences of a pre-flash that may otherwise be used when warranted. In another embodiment, the use of pre-flash is eliminated altogether. In this embodiment, the red-eye phenomenon in a miniature camera with an integral strobe or flash is eliminated and/or prevented without using a pre-flash, preferably through post-processing, red-eye elimination procedures as described above.
  • The use of meta-data for the post-processing of digital images has been described above in accordance with a preferred embodiment (see also US Publ. Pat. App. No. 2003/0058349 to Takemoto). Meta-data contained in a digital image may be analyzed, as may be referred to as EXIF tags, or simply tags, and utilizing such information, global post-processing may be performed on the image to adjust the image tone, sharpness and/or color balance. Another way to use meta-data is in the photo-finishing industry, where a digital image may be post-processed to optimize the output from a printing system. Examples of this use of meta-data are provided at U.S. Pat. Nos. 6,505,003 6,501,911 and 6,496,655 to Mallory Desormeaux, hereby incorporated by reference. A hybrid camera may be used which saves a copy of the original image containing meta-data and implements a scheme which allows control over saving the image containing metadata outside the camera. Image meta-data may also be recorded onto a standard camera film and the meta-data may be subsequently recovered to assist in the post-processing of the film (see U.S. Pat. No. 6,429,924 to Milch, hereby incorporated by reference). Advantageously in accordance with a preferred embodiment, image meta-data may be used to determine a size range of objects and related features within an image, in addition to the correction of global parameters such as image tone, sharpness and color balance.
  • A red-eye correction procedure may begin with detecting a human face in a digital image and, based on this detection, finding the eyes in the face (see, e.g., U.S. Pat. No. 6,252,976 to Schildkraut and Gray, U.S. Publ. Pat. App. No. 2003/0044070 to Fuersich et al., and U.S. Pat. No. 6,278,491 to Wang and Zhang, which are incorporated by reference). This procedure may preferably begin with detecting one or more face regions of a person or persons in a digital image, followed by detecting an eye region or eye regions in each face, and finally determining if red-eye defects exist in the subject's eyes. In the '976 patent, a complex procedure is described for detecting faces and balanced eye-pairs from a skin-map of the image. This task involves several partitioning and re-scaling operations. Significant additional processing of a potential face region of the image then follows in order to determine if a matching pair of eyes is present. Finally, the image pixels in the detected eye regions go through a complex scoring process to determine if a red-eye defect is present.
  • In a preferred process, a simplified and thus generally less resource intensive, image processing technique is used relative to those described at the '976 and '491 patents which detect face and eye regions in an image and subsequently verify the presence of red-eye defects. An advantageous technique will preferably not weight too heavily upon detecting balanced eye pairs, as this approach can get complex and resource intensive when two or more facial regions overlap or are in close proximity to one another in a digital image. According to a preferred embodiment herein, metadata is used to simplify the detection of red-eye defects in a digital image. For example, one or more exclusion criteria may be employed to determine that no flash was used (see also U.S. Publ. Pat. App. No. 2003/0044063 to Meckes et al.).
  • A range of alternative techniques may be employed to detect and verify the existence of red-eye defects in an image (see, e.g., U.S. Publ. Pat. Apps. No. 2003/0044177 and 2003/0044178 to Oberhardt et al., hereby incorporated by reference). A camera may include software or firmware for automatically detecting a red-eye image using a variety of image characteristics such as image brightness, contrast, the presence of human skin and related colors. The analysis of these image characteristics may be utilized, based on certain pre-determined statistical thresholds, to decide if red-eye defects exist and if a flash was used to take the original image. This technique may be applied to images captured on conventional film, which is then digitally scanned, or to initially digitally-acquired images. Preferably, metadata is used that can be generated by a digital camera or otherwise recorded in or associated with the body of a digital image initially captured or scanned. In accordance with a preferred embodiment, meta-data an/or anthropometric data may be used to validate the existence of a red-eye defect in an image.
  • Further techniques may be used alternatively to the preferred embodiments described above for removing flash artifacts from digital images. Two copies of a digital image may be captured, one taken with flash illumination and a second taken without flash illumination, and intensity histograms of the two images may be compared in order to locate regions of the image where flash artifacts occur and correct these by reducing intensities in these regions (see, e.g., US Publ. Pat. App. No. 2002/0150306 to Baron). Specular reflections may be removed due to the flash and red-eye can be reduced in this way. However, even Baron recognizes that the technique may involve the setting of separate thresholds for each of the RGB image colors. A technique such as this will generally further involve use of some additional knowledge of the captured image if it is to be relied upon for correctly locating and identifying red-eye defects.
  • Another technique may involve the identification of small specular reflections that occur in the eye region when flash illumination is used (see, e.g., WO 03/026278 to Jarman, which is hereby incorporated by reference). This procedure may be used to detect red-eye defects without first detecting a human face or eye region. It is preferred, however, to use camera-specific information, or other image metadata such as acquisition data, or anthropometric data, or a combination thereof, to assist in the confirmation of a red-eye defect.
  • Digital cameras can also be customized using demographic groups (see, e.g., U.S. Publ. Pat. App. No. 2003/0025811 to Keelan et al., hereby incorporated by reference). The rationale for this technique is that certain aspects of image processing and the image acquisition process such as color and tone balance may be affected by both age-related and racial factors. It is also noted that both racial and age factors can affect the level of red-eye defects, which occur, and thus the pre-flash algorithms and flash-to-lens spacing for a digital camera may be adjusted according to the target market group based on age and nationality. Human faces may be detected and classified according to the age of the subjects (see, e.g., U.S. Pat. No. 5,781,650 to Lobo et al.). A number of image processing techniques may be combined with anthropometric data on facial features to determine an estimate of the age category of a particular facial image. In a preferred embodiment, the facial features and/or eye regions are validated using anthropometric data within a digital image. The reverse approach may also be employed and may involve a probability inference, also known as Bayesian Statistics.
  • The preferred embodiments described herein may involve expanded digital acquisition technology that inherently involves digital cameras, but that may be integrated with other devices such as cell-phones equipped with an acquisition component, toy cameras etc. The digital camera or other image acquisition device of the preferred embodiment has the capability to record not only image data, but also additional data referred to as meta-data. The file header of an image file, such as JPEG, TIFF, JPEG-2000, etc., may include capture information such as whether a flash was used, the distance as recorded by the auto-focus mechanism, the focal length of the lens, the sensor resolution, the shutter and the aperture. The preferred embodiments described herein serve to improve the detection of red eyes in images, while eliminating or reducing the occurrence of false positives, and to improve the correction of the detected artifacts.
  • While an exemplary drawing and specific embodiments of the present invention have been described and illustrated, it is to be understood that that the scope of the present invention is not to be limited to the particular embodiments discussed. Thus, the embodiments shall be regarded as illustrative rather than restrictive, and it should be understood that variations may be made in those embodiments by workers skilled in the arts without departing from the scope of the present invention, as set forth in the claims below and structural and functional equivalents thereof.
  • In addition, in methods that may be performed according to preferred embodiments herein and that may have been described above, the operations have been described in selected typographical sequences. However, the sequences have been selected and so ordered for typographical convenience and are not intended to imply any particular order for performing the operations, unless expressly set forth or understood by those skilled in the art being necessary.

Claims (30)

1. A portable digital apparatus having no photographic film, comprising:
(a) a housing;
(b) a source of light coupled to the housing for providing illumination during image capturing;
(c) a digital image capturing apparatus within the housing;
(d) at least one of an image display and an image output coupled to the housing; and
(e) an auto-focus mechanism
(f) a red-eye filter within the housing for modifying pixels indicative of a red-eye phenomenon within said at least one of said image display and said image output, wherein the red eye filter is configured to modify an area within the image indicative of red-eye phenomenon based on a metadata analysis, including:
(i) a comparison of a calculated range of expected sizes of said area based on distance information as recorded by the auto-focus mechanism and on one or more stored human facial anthropometrical values: and
(ii) a search for a second eye, a surrounding face, lips, nostrils or another associated peripheral region, or combinations thereof, at an estimated distance based on said distance information as recorded by the auto-focus mechanism.
2. The apparatus of claim 1, wherein said red-eye filter comprises:
a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon;
a pixel analyzer for determining if a grouping of at least a portion of the pixels located by said pixel locator comprise one or more parameters indicative of the red-eye phenomenon; and
a pixel modifier for modifying the color of the pixels within the grouping.
3. The apparatus of claim 2, further comprising a meta-data analyzer for determining whether to preclude a red-eye phenomenon determination based upon analysis of meta-data.
4. The apparatus of claim 3, said meta-data analysis being performed before said pixel analysis.
5. The apparatus of claim 3, said meta-data analyzer comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
6. The apparatus of claim 3, said meta-data comprising digital apparatus-specific information.
7. A portable digital apparatus having no photographic film, comprising:
(a) a housing;
(b) an integral flash embedded within said housing for providing illumination during image recording;
(c) a digital image capturing apparatus within said housing for recording an image; and
(d) a red-eye filter within said housing for modifying an area within the image indicative of a red-eye phenomenon, and
(e) wherein whether said area within said image is indicative of said red-eye phenomenon is determined based at least in part on a metadata analysis, including:
(i) a comparison of a calculated range of expected sizes of said area based on distance information as recorded by the auto-focus mechanism and on one or more stored human facial anthropometrical values: and
(ii) a search for a second eye, a surrounding face, lips, nostrils or another associated peripheral region, or combinations thereof, at an estimated distance based on said distance information as recorded by the auto-focus mechanism.
8. The apparatus of claim 7, further comprising memory for recording said image after applying said red-eye filter, thereby recording a modified image.
9. The apparatus of claim 8, wherein said area is stored directly in said image by replacing pixels within the image indicative of red-eye phenomenon to create said modified image.
10. The apparatus of claim 8, wherein said area is stored as an overlay of said image thus preserving the original said image.
11. The apparatus of claim 10, wherein said area is processed by an external device.
12. The apparatus of claim 11, wherein said external device comprises a personal computer.
13. The apparatus of claim 11, wherein said external device comprises a printer.
14. The apparatus of claim 7, further comprising an image output for downloading an integral image display for printing said image modified by said red-eye filter.
15. The apparatus of claim 7, further comprising the red eye filter for generating an overlay for said area indicative of the red-eye phenomenon of the captured image for at least one of image display and image output.
16. The apparatus of claim 7, wherein the area that is indicative of the red-eye phenomenon comprises a color and shape indicative of the red-eye phenomenon and the image is modified to change the color to a black color and further wherein:
the integral flash selectively provides illumination during image capturing; and
said red-eye filter is enabled to modify the image in response to said source of light providing illumination during image capturing.
17. The apparatus of claim 16, further comprising an exposure control means for determining if the image was captured in a condition conducive to the red-eye phenomenon and for generating a red-eye signal in response thereto, wherein said red-eye filter is further enabled in response to the red-eye signal.
18. The apparatus of claim 7, wherein said red-eye filter further includes a false-detection avoidance apparatus which enables modification of the area that is indicative of the red-eye phenomenon in response to an absence of color indicative of the red-eye phenomenon within a vicinity of and exclusive to the area.
19. The apparatus of claim 7, wherein said red-eye filter further includes a false-detection avoidance apparatus which enables modification of the area in response to one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.
20. The apparatus of claim 7, wherein said red-eye filter detects said area within the image indicative of a red-eye phenomenon based on one or more of a substantially white colored region, an iris ring and an eyebrow line within a vicinity of the area.
21. The apparatus of claim 7, wherein said red-eye filter comprises:
a pixel locator for locating the pixels having a color indicative of the red-eye phenomenon;
a shape analyzer for determining if a grouping of at least a portion of the pixels located by said pixel locator comprise a shape indicative of the red-eye phenomenon; and
a pixel modifier for modifying the color of the pixels within the grouping.
22. The apparatus of claim 21, further comprising a false-detection analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling said pixel modifier in response thereto.
23. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
24. The apparatus of claim 21, wherein the red-eye filter further comprises an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
25. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether said flash was used during image recording.
26. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon including determining whether low ambient lighting conditions existed during image recording.
27. The apparatus of claim 21, further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon, and a distance analyzer for determining if the subject was at a relatively close distance to the apparatus during image recording.
28. The apparatus of claim 7, said meta-data information being analyzed in said red-eye phenomenon determination prior to a pixel analysis.
29. The apparatus of claim 7, said meta-data information comprising digital apparatus-specific information.
30. The apparatus of claim 29, said meta-data information comprising information regarding conditions under which the image was acquired.
US12/958,130 1997-10-09 2010-12-01 Detecting Red Eye Filter and Apparatus Using Meta-Data Abandoned US20110134271A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/958,130 US20110134271A1 (en) 1997-10-09 2010-12-01 Detecting Red Eye Filter and Apparatus Using Meta-Data

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US08/947,603 US6407777B1 (en) 1997-10-09 1997-10-09 Red-eye filter method and apparatus
US10/170,511 US7042505B1 (en) 1997-10-09 2002-06-12 Red-eye filter method and apparatus
US10/635,862 US7630006B2 (en) 1997-10-09 2003-08-05 Detecting red eye filter and apparatus using meta-data
US11/690,834 US7852384B2 (en) 1997-10-09 2007-03-25 Detecting red eye filter and apparatus using meta-data
US12/958,130 US20110134271A1 (en) 1997-10-09 2010-12-01 Detecting Red Eye Filter and Apparatus Using Meta-Data

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/690,834 Continuation US7852384B2 (en) 1997-10-09 2007-03-25 Detecting red eye filter and apparatus using meta-data

Publications (1)

Publication Number Publication Date
US20110134271A1 true US20110134271A1 (en) 2011-06-09

Family

ID=34135579

Family Applications (14)

Application Number Title Priority Date Filing Date
US10/635,862 Expired - Fee Related US7630006B2 (en) 1997-10-09 2003-08-05 Detecting red eye filter and apparatus using meta-data
US11/690,834 Expired - Fee Related US7852384B2 (en) 1997-10-09 2007-03-25 Detecting red eye filter and apparatus using meta-data
US12/187,763 Expired - Fee Related US7847839B2 (en) 1997-10-09 2008-08-07 Detecting red eye filter and apparatus using meta-data
US12/192,897 Expired - Fee Related US7804531B2 (en) 1997-10-09 2008-08-15 Detecting red eye filter and apparatus using meta-data
US12/192,335 Expired - Fee Related US7847840B2 (en) 1997-10-09 2008-08-15 Detecting red eye filter and apparatus using meta-data
US12/613,457 Expired - Fee Related US8537251B2 (en) 1997-10-09 2009-11-05 Detecting red eye filter and apparatus using meta-data
US12/889,215 Abandoned US20110058071A1 (en) 1997-10-09 2010-09-23 Detecting Red Eye Filter and Apparatus Using Meta-Data
US12/957,594 Expired - Fee Related US8493478B2 (en) 1997-10-09 2010-12-01 Detecting red eye filter and apparatus using meta-data
US12/957,633 Expired - Fee Related US8379117B2 (en) 1997-10-09 2010-12-01 Detecting red eye filter and apparatus using meta-data
US12/958,130 Abandoned US20110134271A1 (en) 1997-10-09 2010-12-01 Detecting Red Eye Filter and Apparatus Using Meta-Data
US13/235,757 Abandoned US20120038788A1 (en) 1997-10-09 2011-09-19 Detecting Red Eye Filter and Apparatus Using Meta-Data
US13/769,812 Expired - Fee Related US8648938B2 (en) 1997-10-09 2013-02-18 Detecting red eye filter and apparatus using meta-data
US13/771,001 Expired - Fee Related US9025054B2 (en) 2003-08-05 2013-02-19 Detecting red eye filter and apparatus using meta-data
US13/787,783 Expired - Fee Related US8957993B2 (en) 2003-08-05 2013-03-06 Detecting red eye filter and apparatus using meta-data

Family Applications Before (9)

Application Number Title Priority Date Filing Date
US10/635,862 Expired - Fee Related US7630006B2 (en) 1997-10-09 2003-08-05 Detecting red eye filter and apparatus using meta-data
US11/690,834 Expired - Fee Related US7852384B2 (en) 1997-10-09 2007-03-25 Detecting red eye filter and apparatus using meta-data
US12/187,763 Expired - Fee Related US7847839B2 (en) 1997-10-09 2008-08-07 Detecting red eye filter and apparatus using meta-data
US12/192,897 Expired - Fee Related US7804531B2 (en) 1997-10-09 2008-08-15 Detecting red eye filter and apparatus using meta-data
US12/192,335 Expired - Fee Related US7847840B2 (en) 1997-10-09 2008-08-15 Detecting red eye filter and apparatus using meta-data
US12/613,457 Expired - Fee Related US8537251B2 (en) 1997-10-09 2009-11-05 Detecting red eye filter and apparatus using meta-data
US12/889,215 Abandoned US20110058071A1 (en) 1997-10-09 2010-09-23 Detecting Red Eye Filter and Apparatus Using Meta-Data
US12/957,594 Expired - Fee Related US8493478B2 (en) 1997-10-09 2010-12-01 Detecting red eye filter and apparatus using meta-data
US12/957,633 Expired - Fee Related US8379117B2 (en) 1997-10-09 2010-12-01 Detecting red eye filter and apparatus using meta-data

Family Applications After (4)

Application Number Title Priority Date Filing Date
US13/235,757 Abandoned US20120038788A1 (en) 1997-10-09 2011-09-19 Detecting Red Eye Filter and Apparatus Using Meta-Data
US13/769,812 Expired - Fee Related US8648938B2 (en) 1997-10-09 2013-02-18 Detecting red eye filter and apparatus using meta-data
US13/771,001 Expired - Fee Related US9025054B2 (en) 2003-08-05 2013-02-19 Detecting red eye filter and apparatus using meta-data
US13/787,783 Expired - Fee Related US8957993B2 (en) 2003-08-05 2013-03-06 Detecting red eye filter and apparatus using meta-data

Country Status (5)

Country Link
US (14) US7630006B2 (en)
EP (2) EP2264997A3 (en)
JP (1) JP4709147B2 (en)
AT (1) ATE535098T1 (en)
WO (1) WO2005015896A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060170791A1 (en) * 2002-11-29 2006-08-03 Porter Robert Mark S Video camera
US20090232402A1 (en) * 2008-03-14 2009-09-17 Seiko Epson Corporation Image Processing Apparatus, Image Processing Method, and Computer Program for Image Processing
US20110157410A1 (en) * 2009-12-31 2011-06-30 Jose Antonio Mendez Alcazar Auto white balance algorithm using rgb product measure

Families Citing this family (134)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7738015B2 (en) 1997-10-09 2010-06-15 Fotonation Vision Limited Red-eye filter method and apparatus
US7630006B2 (en) 1997-10-09 2009-12-08 Fotonation Ireland Limited Detecting red eye filter and apparatus using meta-data
US7042505B1 (en) 1997-10-09 2006-05-09 Fotonation Ireland Ltd. Red-eye filter method and apparatus
US7352394B1 (en) 1997-10-09 2008-04-01 Fotonation Vision Limited Image modification based on red-eye filter analysis
JP3856221B2 (en) * 2002-05-15 2006-12-13 シャープ株式会社 Mobile phone
US8155397B2 (en) 2007-09-26 2012-04-10 DigitalOptics Corporation Europe Limited Face tracking in a camera processor
US9692964B2 (en) 2003-06-26 2017-06-27 Fotonation Limited Modification of post-viewing parameters for digital images using image region or feature information
US7792970B2 (en) 2005-06-17 2010-09-07 Fotonation Vision Limited Method for establishing a paired connection between media devices
US7620218B2 (en) 2006-08-11 2009-11-17 Fotonation Ireland Limited Real-time face tracking with reference images
US8036458B2 (en) 2007-11-08 2011-10-11 DigitalOptics Corporation Europe Limited Detecting redeye defects in digital images
US7574016B2 (en) 2003-06-26 2009-08-11 Fotonation Vision Limited Digital image processing using face detection information
US8553949B2 (en) 2004-01-22 2013-10-08 DigitalOptics Corporation Europe Limited Classification and organization of consumer digital images using workflow, and face detection and recognition
US8948468B2 (en) 2003-06-26 2015-02-03 Fotonation Limited Modification of viewing parameters for digital images using face detection information
US8330831B2 (en) 2003-08-05 2012-12-11 DigitalOptics Corporation Europe Limited Method of gathering visual meta data using a reference image
US7970182B2 (en) 2005-11-18 2011-06-28 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
US9129381B2 (en) 2003-06-26 2015-09-08 Fotonation Limited Modification of post-viewing parameters for digital images using image region or feature information
US8989453B2 (en) 2003-06-26 2015-03-24 Fotonation Limited Digital image processing using face detection information
US7685341B2 (en) * 2005-05-06 2010-03-23 Fotonation Vision Limited Remote control apparatus for consumer electronic appliances
US7440593B1 (en) 2003-06-26 2008-10-21 Fotonation Vision Limited Method of improving orientation and color balance of digital images using face detection information
US8363951B2 (en) 2007-03-05 2013-01-29 DigitalOptics Corporation Europe Limited Face recognition training method and apparatus
US7269292B2 (en) 2003-06-26 2007-09-11 Fotonation Vision Limited Digital image adjustable compression and resolution using face detection information
US7536036B2 (en) * 2004-10-28 2009-05-19 Fotonation Vision Limited Method and apparatus for red-eye detection in an acquired digital image
US7680342B2 (en) * 2004-08-16 2010-03-16 Fotonation Vision Limited Indoor/outdoor classification in digital images
US7565030B2 (en) 2003-06-26 2009-07-21 Fotonation Vision Limited Detecting orientation of digital images using face detection information
US8682097B2 (en) * 2006-02-14 2014-03-25 DigitalOptics Corporation Europe Limited Digital image enhancement with reference images
US7606417B2 (en) 2004-08-16 2009-10-20 Fotonation Vision Limited Foreground/background segmentation in digital images with differential exposure calculations
US7844076B2 (en) 2003-06-26 2010-11-30 Fotonation Vision Limited Digital image processing using face detection and skin tone information
US8896725B2 (en) * 2007-06-21 2014-11-25 Fotonation Limited Image capture device with contemporaneous reference image capture mechanism
US7471846B2 (en) 2003-06-26 2008-12-30 Fotonation Vision Limited Perfecting the effect of flash within an image acquisition devices using face detection
US8170294B2 (en) 2006-11-10 2012-05-01 DigitalOptics Corporation Europe Limited Method of detecting redeye in a digital image
US7689009B2 (en) 2005-11-18 2010-03-30 Fotonation Vision Ltd. Two stage detection for photographic eye artifacts
US8498452B2 (en) 2003-06-26 2013-07-30 DigitalOptics Corporation Europe Limited Digital image processing using face detection information
US8254674B2 (en) 2004-10-28 2012-08-28 DigitalOptics Corporation Europe Limited Analyzing partial face regions for red-eye detection in acquired digital images
US8593542B2 (en) 2005-12-27 2013-11-26 DigitalOptics Corporation Europe Limited Foreground/background separation using reference images
US7920723B2 (en) 2005-11-18 2011-04-05 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
US7587068B1 (en) * 2004-01-22 2009-09-08 Fotonation Vision Limited Classification database for consumer digital images
US20050031224A1 (en) * 2003-08-05 2005-02-10 Yury Prilutsky Detecting red eye filter and apparatus using meta-data
US9412007B2 (en) 2003-08-05 2016-08-09 Fotonation Limited Partial face detector red-eye filter method and apparatus
US8520093B2 (en) 2003-08-05 2013-08-27 DigitalOptics Corporation Europe Limited Face tracker and partial face tracker for red-eye filter method and apparatus
US8369650B2 (en) 2003-09-30 2013-02-05 DigitalOptics Corporation Europe Limited Image defect map creation using batches of digital images
JP4262082B2 (en) * 2003-12-24 2009-05-13 キヤノン株式会社 Image processing apparatus, control method therefor, program, and storage medium
US7564994B1 (en) 2004-01-22 2009-07-21 Fotonation Vision Limited Classification system for consumer digital images using automatic workflow and face detection and recognition
JP2005309409A (en) * 2004-03-25 2005-11-04 Fuji Photo Film Co Ltd Red-eye preventing device, program and recording medium with recorded program
JP2005310124A (en) * 2004-03-25 2005-11-04 Fuji Photo Film Co Ltd Red eye detecting device, program, and recording medium with program recorded therein
JP2005346806A (en) * 2004-06-02 2005-12-15 Funai Electric Co Ltd Dvd recorder and recording and reproducing apparatus
US8320641B2 (en) 2004-10-28 2012-11-27 DigitalOptics Corporation Europe Limited Method and apparatus for red-eye detection using preview or other reference images
EP1813119B1 (en) 2004-11-16 2019-01-09 Thomson Licensing Film grain sei message insertion for bit-accurate simulation in a video system
US7715597B2 (en) 2004-12-29 2010-05-11 Fotonation Ireland Limited Method and component for image recognition
US8503800B2 (en) 2007-03-05 2013-08-06 DigitalOptics Corporation Europe Limited Illumination detection using classifier chains
US7315631B1 (en) 2006-08-11 2008-01-01 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device
US7548647B2 (en) * 2005-04-29 2009-06-16 Hewlett-Packard Development Company, L.P. Method and apparatus for digital-image red-eye correction that facilitates undo operation
US7694048B2 (en) * 2005-05-06 2010-04-06 Fotonation Vision Limited Remote control apparatus for printer appliances
JP4405942B2 (en) * 2005-06-14 2010-01-27 キヤノン株式会社 Image processing apparatus and method
US7599577B2 (en) 2005-11-18 2009-10-06 Fotonation Vision Limited Method and apparatus of correcting hybrid flash artifacts in digital images
US7567704B2 (en) * 2005-11-30 2009-07-28 Honeywell International Inc. Method and apparatus for identifying physical features in video
US7692696B2 (en) * 2005-12-27 2010-04-06 Fotonation Vision Limited Digital image acquisition system with portrait mode
US7675652B2 (en) * 2006-02-06 2010-03-09 Microsoft Corporation Correcting eye color in a digital image
US7469071B2 (en) * 2006-02-14 2008-12-23 Fotonation Vision Limited Image blurring
IES20060559A2 (en) * 2006-02-14 2006-11-01 Fotonation Vision Ltd Automatic detection and correction of non-red flash eye defects
WO2007095553A2 (en) 2006-02-14 2007-08-23 Fotonation Vision Limited Automatic detection and correction of non-red eye flash defects
IES20060564A2 (en) 2006-05-03 2006-11-01 Fotonation Vision Ltd Improved foreground / background separation
WO2008023280A2 (en) 2006-06-12 2008-02-28 Fotonation Vision Limited Advances in extending the aam techniques from grayscale to color images
JP4201025B2 (en) 2006-06-30 2008-12-24 ソニー株式会社 Monitoring device, monitoring system, filter setting method, and monitoring program
US7515740B2 (en) 2006-08-02 2009-04-07 Fotonation Vision Limited Face recognition with combined PCA-based datasets
US7916897B2 (en) 2006-08-11 2011-03-29 Tessera Technologies Ireland Limited Face tracking for controlling imaging parameters
US7403643B2 (en) 2006-08-11 2008-07-22 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device
JP2008113085A (en) 2006-10-27 2008-05-15 Seiko Epson Corp Printer with image scanner
US8055067B2 (en) 2007-01-18 2011-11-08 DigitalOptics Corporation Europe Limited Color segmentation
EP2123008A4 (en) 2007-03-05 2011-03-16 Tessera Tech Ireland Ltd Face categorization and annotation of a mobile phone contact list
US7995804B2 (en) 2007-03-05 2011-08-09 Tessera Technologies Ireland Limited Red eye false positive filtering using face location and orientation
EP2006804A1 (en) * 2007-06-22 2008-12-24 Siemens Aktiengesellschaft Method for optical inspection of a matt surface and apparatus for applying this method
US8503818B2 (en) 2007-09-25 2013-08-06 DigitalOptics Corporation Europe Limited Eye defect detection in international standards organization images
US7747160B2 (en) * 2008-01-04 2010-06-29 Sony Ericsson Mobile Communications Ab Intelligent red eye removal
US8212864B2 (en) 2008-01-30 2012-07-03 DigitalOptics Corporation Europe Limited Methods and apparatuses for using image acquisition data to detect and correct image defects
JP5381060B2 (en) * 2008-02-05 2014-01-08 株式会社リコー Imaging apparatus and image processing method thereof
JP2009223524A (en) * 2008-03-14 2009-10-01 Seiko Epson Corp Image processor, image processing method, and computer program for image processing
JP2009223527A (en) * 2008-03-14 2009-10-01 Seiko Epson Corp Image processor, image processing method, and computer program for image processing
US8433144B2 (en) * 2008-03-27 2013-04-30 Hewlett-Packard Development Company, L.P. Systems and methods for detecting red-eye artifacts
WO2010012448A2 (en) 2008-07-30 2010-02-04 Fotonation Ireland Limited Automatic face and skin beautification using face detection
US8081254B2 (en) 2008-08-14 2011-12-20 DigitalOptics Corporation Europe Limited In-camera based method of detecting defect eye with high accuracy
US8194993B1 (en) * 2008-08-29 2012-06-05 Adobe Systems Incorporated Method and apparatus for matching image metadata to a profile database to determine image processing parameters
US8340453B1 (en) 2008-08-29 2012-12-25 Adobe Systems Incorporated Metadata-driven method and apparatus for constraining solution space in image processing techniques
US8391640B1 (en) 2008-08-29 2013-03-05 Adobe Systems Incorporated Method and apparatus for aligning and unwarping distorted images
US8724007B2 (en) 2008-08-29 2014-05-13 Adobe Systems Incorporated Metadata-driven method and apparatus for multi-image processing
US8368773B1 (en) 2008-08-29 2013-02-05 Adobe Systems Incorporated Metadata-driven method and apparatus for automatically aligning distorted images
US8842190B2 (en) 2008-08-29 2014-09-23 Adobe Systems Incorporated Method and apparatus for determining sensor format factors from image metadata
KR101539043B1 (en) * 2008-10-31 2015-07-24 삼성전자주식회사 Image photography apparatus and method for proposing composition based person
WO2010063463A2 (en) 2008-12-05 2010-06-10 Fotonation Ireland Limited Face recognition using face tracker classifier data
CN101769723B (en) * 2008-12-30 2013-07-03 鸿富锦精密工业(深圳)有限公司 Electronic device and object shape parameter measurement method thereof
JP5456159B2 (en) * 2009-05-29 2014-03-26 デジタルオプティックス・コーポレイション・ヨーロッパ・リミテッド Method and apparatus for separating the top of the foreground from the background
JP5279636B2 (en) * 2009-06-30 2013-09-04 キヤノン株式会社 Imaging device
US8379917B2 (en) 2009-10-02 2013-02-19 DigitalOptics Corporation Europe Limited Face recognition performance using additional image features
JP5451300B2 (en) * 2009-10-15 2014-03-26 キヤノン株式会社 Calculation method and calculation apparatus
JP5591063B2 (en) * 2009-11-12 2014-09-17 キヤノン株式会社 Measuring method and measuring device
US8872887B2 (en) 2010-03-05 2014-10-28 Fotonation Limited Object detection and rendering for wide field of view (WFOV) image acquisition systems
US8971628B2 (en) 2010-07-26 2015-03-03 Fotonation Limited Face detection using division-generated haar-like features for illumination invariance
US8429570B2 (en) 2010-10-28 2013-04-23 International Business Machines Corporation Pattern recognition with edge correction for design based metrology
US8495527B2 (en) 2010-10-28 2013-07-23 International Business Machines Corporation Pattern recognition with edge correction for design based metrology
US8308379B2 (en) 2010-12-01 2012-11-13 Digitaloptics Corporation Three-pole tilt control system for camera module
EP2577955B1 (en) 2011-02-18 2014-07-30 DigitalOptics Corporation Europe Limited Dynamic range extension by combining differently exposed hand-held device-acquired images
TWI455043B (en) * 2011-03-01 2014-10-01 Hon Hai Prec Ind Co Ltd System and method for avoiding to capture red eye images using camera
US8516308B1 (en) 2011-03-09 2013-08-20 Amazon Technologies, Inc. Crash based incompatibility prediction for classes of mobile devices crash data
US8788944B1 (en) 2011-03-09 2014-07-22 Amazon Technologies, Inc. Personalized mobile device application presentation using photograph-based capability detection
US8896703B2 (en) 2011-03-31 2014-11-25 Fotonation Limited Superresolution enhancment of peripheral regions in nonlinear lens geometries
US8723959B2 (en) 2011-03-31 2014-05-13 DigitalOptics Corporation Europe Limited Face and other object tracking in off-center peripheral regions for nonlinear lens geometries
US8947501B2 (en) 2011-03-31 2015-02-03 Fotonation Limited Scene enhancements in off-center peripheral regions for nonlinear lens geometries
US8982180B2 (en) 2011-03-31 2015-03-17 Fotonation Limited Face and other object detection and tracking in off-center peripheral regions for nonlinear lens geometries
EP2515526A3 (en) 2011-04-08 2014-12-24 FotoNation Limited Display device with image capture and analysis module
WO2013020142A2 (en) * 2011-08-04 2013-02-07 University Of Southern California Image-based crack detection
WO2013090830A1 (en) 2011-12-16 2013-06-20 University Of Southern California Autonomous pavement condition assessment
CN103226690B (en) * 2012-01-30 2016-03-02 展讯通信(上海)有限公司 Detect blood-shot eye illness method and device, removal blood-shot eye illness method and device
WO2013126568A1 (en) * 2012-02-21 2013-08-29 Massachusetts Eye & Ear Infirmary Calculating conjunctival redness
US9294667B2 (en) 2012-03-10 2016-03-22 Digitaloptics Corporation MEMS auto focus miniature camera module with fixed and movable lens groups
WO2013136053A1 (en) 2012-03-10 2013-09-19 Digitaloptics Corporation Miniature camera module with mems-actuated autofocus
EP2845164B1 (en) * 2012-04-30 2018-06-06 Dolby Laboratories Licensing Corporation Reference card for scene referred metadata capture
US9354486B2 (en) 2012-06-07 2016-05-31 DigitalOptics Corporation MEMS MEMS fast focus camera module
US9508119B2 (en) * 2012-07-13 2016-11-29 Blackberry Limited Application of filters requiring face detection in picture editor
US20140015854A1 (en) * 2012-07-13 2014-01-16 Research In Motion Limited Application of Filters Requiring Face Detection in Picture Editor
US9007520B2 (en) 2012-08-10 2015-04-14 Nanchang O-Film Optoelectronics Technology Ltd Camera module with EMI shield
US9001268B2 (en) 2012-08-10 2015-04-07 Nan Chang O-Film Optoelectronics Technology Ltd Auto-focus camera module with flexible printed circuit extension
US9242602B2 (en) 2012-08-27 2016-01-26 Fotonation Limited Rearview imaging systems for vehicle
JP2014053855A (en) * 2012-09-10 2014-03-20 Sony Corp Image processing device and method, and program
US9055207B2 (en) 2012-12-31 2015-06-09 Digitaloptics Corporation Auto-focus camera module with MEMS distance measurement
US9980629B2 (en) * 2013-03-11 2018-05-29 Karl Storz Imaging, Inc. Video capture and streaming diagnostics metadata
ES2893541T3 (en) 2014-05-02 2022-02-09 Massachusetts Eye & Ear Infirmary Qualification of corneal fluorescein staining
US9390690B2 (en) * 2014-06-30 2016-07-12 Apple Inc. Refresh rate dependent dithering
KR20170092662A (en) 2014-12-09 2017-08-11 포토내이션 리미티드 Image processing method
US9465988B1 (en) * 2014-12-17 2016-10-11 Amazon Technologies, Inc. Camera and illuminator for iris imaging in cell phones and tablets
WO2016189764A1 (en) * 2015-05-26 2016-12-01 三菱電機株式会社 Detection device and detection method
US9659355B1 (en) * 2015-12-03 2017-05-23 Motorola Mobility Llc Applying corrections to regions of interest in image data
CN106570462A (en) * 2016-10-21 2017-04-19 哈尔滨工业大学深圳研究生院 Lip movement feature extraction method and system capable of illumination robustness improvement
JP7130839B2 (en) * 2018-07-16 2022-09-05 オーナー・デヴァイス・カンパニー・リミテッド Dye detection method and electronics
EP3882810B1 (en) * 2020-03-16 2023-06-07 Carl Zeiss Vision International GmbH Computer implemented methods and devices for determining dimensions and distances of head features
CN115937085B (en) * 2022-06-28 2023-08-01 哈尔滨学院 Nuclear cataract image processing method based on neural network learning

Citations (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4549801A (en) * 1983-03-21 1985-10-29 W. Haking Enterprises Limited Automatic focussing camera with automatic aperture setting
US4577219A (en) * 1982-12-11 1986-03-18 Dr. Ing. Rudolf Hell Gmbh Method and an apparatus for copying retouch in electronic color picture reproduction
US4646134A (en) * 1984-03-21 1987-02-24 Sony Corporation Apparatus for encoding image signal
US4829331A (en) * 1987-01-12 1989-05-09 Canon Kabushiki Kaisha Camera having auto-focussing device
US5202720A (en) * 1989-02-02 1993-04-13 Minolta Camera Kabushiki Kaisha Photographic camera with flash unit
US5301026A (en) * 1991-01-30 1994-04-05 Samsung Electronics Co., Ltd. Picture editing apparatus in a digital still video camera system
US5303049A (en) * 1990-01-18 1994-04-12 Nikon Corporation Electronic still camera with enhanced tonal rendition
US5384601A (en) * 1992-08-25 1995-01-24 Matsushita Electric Industrial Co., Ltd. Color adjustment apparatus for automatically changing colors
US5400113A (en) * 1988-03-16 1995-03-21 Nikon Corporation Control device for preventing red-eye effect on camera
US5708866A (en) * 1996-05-02 1998-01-13 Eastman Kodak Company Camera selects unused flash bulb farthest from taking lens to reduce red-eye effect when camera-to-subject distance within near range
US5719951A (en) * 1990-07-17 1998-02-17 British Telecommunications Public Limited Company Normalized image feature processing
US5719639A (en) * 1995-03-29 1998-02-17 Dainippon Screen Mfg., Ltd. Method and apparatus for changing specified color in a color image
US5721983A (en) * 1993-07-30 1998-02-24 Canon Kabushiki Kaisha Camera having red-eye reducing function
US5724456A (en) * 1995-03-31 1998-03-03 Polaroid Corporation Brightness adjustment of images using digital scene analysis
US5734425A (en) * 1994-02-15 1998-03-31 Eastman Kodak Company Electronic still camera with replaceable digital processing program
US5862218A (en) * 1996-04-04 1999-01-19 Fotonation, Inc. Method and apparatus for in-camera image marking and authentication
US5862217A (en) * 1996-03-28 1999-01-19 Fotonation, Inc. Method and apparatus for in-camera encryption
US5892837A (en) * 1997-08-29 1999-04-06 Eastman Kodak Company Computer program product for locating objects in an image
US6011547A (en) * 1996-10-22 2000-01-04 Fuji Photo Film Co., Ltd. Method and apparatus for reproducing image from data obtained by digital camera and digital camera used therefor
US6011585A (en) * 1996-01-19 2000-01-04 Apple Computer, Inc. Apparatus and method for rotating the display orientation of a captured image
US6016354A (en) * 1997-10-23 2000-01-18 Hewlett-Packard Company Apparatus and a method for reducing red-eye in a digital image
US6028611A (en) * 1996-08-29 2000-02-22 Apple Computer, Inc. Modular digital image processing via an image processing chain
US6035074A (en) * 1997-05-27 2000-03-07 Sharp Kabushiki Kaisha Image processing apparatus and storage medium therefor
US6035072A (en) * 1997-12-08 2000-03-07 Read; Robert Lee Mapping defects or dirt dynamically affecting an image acquisition device
US6036072A (en) * 1998-10-27 2000-03-14 De Poan Pneumatic Corporation Nailer magazine
US6172706B1 (en) * 1995-04-19 2001-01-09 Canon Kabushiki Kaisha Video camera with automatic zoom adjustment based on distance between user's eyes
US6192149B1 (en) * 1998-04-08 2001-02-20 Xerox Corporation Method and apparatus for automatic detection of image target gamma
US6195127B1 (en) * 1996-07-18 2001-02-27 Sanyo Electric Co., Ltd. Digital camera, having a flash unit, which determines proper flash duration through an assessment of image luminance and, where needed, a preliminary flash emission
US6201571B1 (en) * 1996-06-13 2001-03-13 Nec Corporation Digital camera recording a reduced image synthesized with a character image of the image picking-up information
US6204868B1 (en) * 1997-07-22 2001-03-20 Konica Corporation Image forming apparatus providing polygonal mirror having braking means
US6204858B1 (en) * 1997-05-30 2001-03-20 Adobe Systems Incorporated System and method for adjusting color data of pixels in a digital image
US20020019859A1 (en) * 2000-08-01 2002-02-14 Fuji Photo Film Co., Ltd. Method and system for contents data processing service
US20020041329A1 (en) * 1998-06-26 2002-04-11 Eran Steinberg In camera messaging and advertisement system
US6381345B1 (en) * 1997-06-03 2002-04-30 At&T Corp. Method and apparatus for detecting eye location in an image
US6505003B1 (en) * 2001-10-12 2003-01-07 Eastman Kodak Company Hybrid cameras that revise stored electronic image metadata at film unit removal and methods
US20030007687A1 (en) * 2001-07-05 2003-01-09 Jasc Software, Inc. Correction of "red-eye" effects in images
US6510520B1 (en) * 1998-06-26 2003-01-21 Fotonation, Inc. Secure storage device for transfer of digital camera data
US20030021478A1 (en) * 2001-07-25 2003-01-30 Minolta Co., Ltd. Image processing technology for identification of red eyes in image
US6516154B1 (en) * 2001-07-17 2003-02-04 Eastman Kodak Company Image revising camera and method
US20030025808A1 (en) * 1997-02-20 2003-02-06 Kenneth A. Parulski Electronic camera with "utilization" selection capability
US20030025811A1 (en) * 2000-12-13 2003-02-06 Eastman Kodak Company Customizing a digital camera based on demographic factors
US20030044070A1 (en) * 2001-09-03 2003-03-06 Manfred Fuersich Method for the automatic detection of red-eye defects in photographic image data
US20030044178A1 (en) * 2001-09-03 2003-03-06 Knut Oberhardt Method for the automatic detection of red-eye defects in photographic image data
US20030044176A1 (en) * 2001-08-28 2003-03-06 Asahi Kogaku Kogyo Kabushiki Kaisha Optical axis adjusting device
US20030044177A1 (en) * 2001-09-03 2003-03-06 Knut Oberhardt Method for the automatic detection of red-eye defects in photographic image data
US20030052991A1 (en) * 2001-09-17 2003-03-20 Stavely Donald J. System and method for simulating fill flash in photography
US20030058349A1 (en) * 2001-09-26 2003-03-27 Fuji Photo Film Co., Ltd. Method, apparatus, and program for image processing
US20030058343A1 (en) * 2001-09-26 2003-03-27 Fuji Photo Film Co., Ltd. Image data transfer method, digital camera, and program
US20040017481A1 (en) * 2002-04-11 2004-01-29 Olympus Optical Co., Ltd. Digital camera, image pickup method, and image format conversion method
US20040027593A1 (en) * 2001-10-12 2004-02-12 David Wilkins Techniques for resolution independent rendering of images
US20040033071A1 (en) * 2002-08-02 2004-02-19 Naoki Kubo Electronic flash device and camera having the same
US20040032512A1 (en) * 1997-05-15 2004-02-19 Kia Silverbrook Correction of distortions in digital images
US20040037460A1 (en) * 2002-08-22 2004-02-26 Eastman Kodak Company Method for detecting objects in digital images
US6700614B1 (en) * 1998-10-08 2004-03-02 Ricoh Company, Ltd. Autofocus apparatus
US20040041924A1 (en) * 2002-08-29 2004-03-04 White Timothy J. Apparatus and method for processing digital images having eye color defects
US20040047491A1 (en) * 2000-12-21 2004-03-11 Bo Rydbeck Image capturing device with reflex reduction
US20040046878A1 (en) * 2001-09-14 2004-03-11 Nick Jarman Image processing to remove red-eyed features
US6707950B1 (en) * 1999-06-22 2004-03-16 Eastman Kodak Company Method for modification of non-image data in an image processing chain
US20040057705A1 (en) * 2002-09-11 2004-03-25 Nidec Copal Corporation Motor driving apparatus
US20040057623A1 (en) * 2002-09-24 2004-03-25 Thomas Schuhrke Method for automated processing of digital image data
US20040057715A1 (en) * 2002-06-06 2004-03-25 Olympus Optical Co., Ltd. Strobe light emitting apparatus and camera
US6714665B1 (en) * 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
US6718051B1 (en) * 2000-10-16 2004-04-06 Xerox Corporation Red-eye detection method
US6724941B1 (en) * 1998-09-30 2004-04-20 Fuji Photo Film Co., Ltd. Image processing method, image processing device, and recording medium
US6728401B1 (en) * 2000-08-17 2004-04-27 Viewahead Technology Red-eye removal using color image processing
US20050001024A1 (en) * 2001-12-03 2005-01-06 Yosuke Kusaka Electronic apparatus, electronic camera, electronic device, image display apparatus, and image transmission system
US20050013602A1 (en) * 2003-07-18 2005-01-20 Pentax Corporation Digital camera having red-eye reduction bracket photographing mode
US20050013603A1 (en) * 2003-07-15 2005-01-20 Shoji Ichimasa Image sensing apparatus, image processing apparatus, and control method therefor
US20050024498A1 (en) * 2003-07-28 2005-02-03 Fuji Photo Film Co., Ltd. Image processor and image processing system
US20050031224A1 (en) * 2003-08-05 2005-02-10 Yury Prilutsky Detecting red eye filter and apparatus using meta-data
US6859565B2 (en) * 2001-04-11 2005-02-22 Hewlett-Packard Development Company, L.P. Method and apparatus for the removal of flash artifacts
US20050041121A1 (en) * 1997-10-09 2005-02-24 Eran Steinberg Red-eye filter method and apparatus
US20050047656A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Systems and methods of detecting and correcting redeye in an image suitable for embedded applications
US20050047655A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Detecting and correcting redeye in an image
US20050046730A1 (en) * 2003-08-25 2005-03-03 Fuji Photo Film Co., Ltd. Digital camera
US20050053279A1 (en) * 2001-02-13 2005-03-10 Microsoft Corporation Red-eye detection based on red region detection with eye confirmation
US20050063083A1 (en) * 2003-08-21 2005-03-24 Dart Scott E. Systems and methods for the implementation of a digital images schema for organizing units of information manageable by a hardware/software interface system
US20050062856A1 (en) * 2003-09-19 2005-03-24 Fuji Photo Film Co., Ltd. Camera equipped with red-eye correction feature
US6873743B2 (en) * 2001-03-29 2005-03-29 Fotonation Holdings, Llc Method and apparatus for the automatic real-time detection and correction of red-eye defects in batches of digital images or in handheld appliances
US20050068452A1 (en) * 2003-09-30 2005-03-31 Eran Steinberg Digital camera with built-in lens calibration table
US6984039B2 (en) * 2003-12-01 2006-01-10 Eastman Kodak Company Laser projector having silhouette blanking for objects in the output light path
US20060008171A1 (en) * 2004-07-06 2006-01-12 Microsoft Corporation Digital photography with flash/no flash extension
US20060017825A1 (en) * 2004-06-30 2006-01-26 Khageshwar Thakur Method and apparatus for effecting automatic red eye reduction
US20060038916A1 (en) * 2004-08-17 2006-02-23 Dialog Semiconductor Gmbh Intelligent light source with synchronization with a digital camera
US20060039690A1 (en) * 2004-08-16 2006-02-23 Eran Steinberg Foreground/background segmentation in digital images with differential exposure calculations
US20060045352A1 (en) * 2004-09-01 2006-03-02 Eastman Kodak Company Determining the age of a human subject in a digital image
US20060050300A1 (en) * 2004-09-03 2006-03-09 Canon Kabushiki Kaisha Information processing apparatus and method for managing order data of on-line orders, program for the same
US20060066628A1 (en) * 2004-09-30 2006-03-30 Microsoft Corporation System and method for controlling dynamically interactive parameters for image processing
US7315631B1 (en) * 2006-08-11 2008-01-01 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device
US20080002060A1 (en) * 1997-10-09 2008-01-03 Fotonation Vision Limited Optimized Performance and Performance for Red-Eye Filter Method and Apparatus
US20080013798A1 (en) * 2006-06-12 2008-01-17 Fotonation Vision Limited Advances in extending the aam techniques from grayscale to color images
US20080043121A1 (en) * 2003-08-05 2008-02-21 Fotonation Vision Limited Optimized Performance and Performance for Red-Eye Filter Method and Apparatus
US7336821B2 (en) * 2006-02-14 2008-02-26 Fotonation Vision Limited Automatic detection and correction of non-red eye flash defects
US20100053368A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Face tracker and partial face tracker for red-eye filter method and apparatus
US20100053362A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Partial face detector red-eye filter method and apparatus
US20100053367A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Partial face tracker for red-eye filter method and apparatus

Family Cites Families (299)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB841609A (en) 1958-08-01 1960-07-20 Ralph Austin Rusca Carding apparatus
US4285588A (en) 1980-07-24 1981-08-25 Eastman Kodak Company Apparatus and method for minimizing red-eye in flash photography
JPS61131990A (en) 1984-11-30 1986-06-19 Sony Corp Videotex image producing system
US4777620A (en) 1985-02-20 1988-10-11 Elscint Ltd. Data compression system
US5568187A (en) 1987-09-10 1996-10-22 Canon Kabushiki Kaisha Image pickup apparatus including distance measurement
GB8725465D0 (en) 1987-10-30 1987-12-02 Linx Printing Tech Ink jet printers
JPH0264532A (en) * 1988-08-30 1990-03-05 Nikon Corp Photographing information recordable camera, and information outputting device for visualizing object information
JP3205989B2 (en) 1988-09-22 2001-09-04 日本電気株式会社 Information processing system
JP2572826B2 (en) 1988-11-25 1997-01-16 オリンパス光学工業株式会社 Camera with red-eye forecasting device
US5016107A (en) 1989-05-09 1991-05-14 Eastman Kodak Company Electronic still camera utilizing image compression and digital storage
JPH02306228A (en) 1989-05-22 1990-12-19 Minolta Camera Co Ltd Camera recording information in external memory device
US5231674A (en) 1989-06-09 1993-07-27 Lc Technologies, Inc. Eye tracking method and apparatus
US5164833A (en) 1989-11-15 1992-11-17 Konica Corporation Electronic viewfinder
US5130789A (en) 1989-12-13 1992-07-14 Eastman Kodak Company Localized image recoloring using ellipsoid boundary function
JPH03237413A (en) * 1990-02-15 1991-10-23 Asahi Optical Co Ltd Electric focal distance changing device
US5164831A (en) 1990-03-15 1992-11-17 Eastman Kodak Company Electronic still camera providing multi-format storage of full and reduced resolution images
US5335072A (en) 1990-05-30 1994-08-02 Minolta Camera Kabushiki Kaisha Photographic system capable of storing information on photographed image data
KR920005598A (en) 1990-08-29 1992-03-28 오가 노리오 Digital Electronic Still Camera
JP2748678B2 (en) 1990-10-09 1998-05-13 松下電器産業株式会社 Gradation correction method and gradation correction device
US5249053A (en) 1991-02-05 1993-09-28 Dycam Inc. Filmless digital camera with selective image compression
JP2634511B2 (en) * 1991-07-15 1997-07-30 富士写真フイルム株式会社 Red-eye correction method for photo prints and pictorial hard copy device
JP3528184B2 (en) 1991-10-31 2004-05-17 ソニー株式会社 Image signal luminance correction apparatus and luminance correction method
JP2962012B2 (en) 1991-11-08 1999-10-12 日本ビクター株式会社 Video encoding device and decoding device therefor
JPH05224271A (en) * 1992-02-13 1993-09-03 Ricoh Co Ltd Image processor
JP2500726B2 (en) 1992-06-12 1996-05-29 日本電気株式会社 Method and apparatus for detecting upper eyelid region, inner corner of eye, outer corner of eye, upper eyelid region and eye structure
JP2673146B2 (en) 1992-08-04 1997-11-05 インターナショナル・ビジネス・マシーンズ・コーポレイション Method and camera system for determining light emission timing of electronic flash
US5649238A (en) 1992-09-14 1997-07-15 Nikon Corporation Camera having built-in flash light emitting device for improving picture quality and method thereof
KR100247287B1 (en) * 1993-02-19 2000-04-01 유무성 Method and device for replacing of flash automatically by using camera power
JP3009561B2 (en) 1993-04-26 2000-02-14 富士写真フイルム株式会社 Still video camera and strobe light emission control data adjusting device
US5974189A (en) 1993-05-24 1999-10-26 Eastman Kodak Company Method and apparatus for modifying electronic image data
US5432863A (en) 1993-07-19 1995-07-11 Eastman Kodak Company Automated detection and correction of eye color defects due to flash illumination
US5781650A (en) 1994-02-18 1998-07-14 University Of Central Florida Automatic feature detection and age classification of human faces in digital images
US5537516A (en) 1994-03-15 1996-07-16 Electronics For Imaging, Inc. Method for calibrating a color printer using a scanner for color measurements
JP2931755B2 (en) 1994-04-14 1999-08-09 株式会社東芝 Data reproduction device, data encoding device, data encoding method, and data reproduction system
DE69518578T2 (en) 1994-05-18 2001-04-26 Sharp Kk Card-type camera with image processing function
JP3444552B2 (en) 1994-05-24 2003-09-08 オリンパス光学工業株式会社 Camera system
US5568194A (en) 1994-05-31 1996-10-22 Asahi Kogaku Kogyo Kabushiki Kaisha Adjusting a white balance in a camera using a flash
US5572596A (en) 1994-09-02 1996-11-05 David Sarnoff Research Center, Inc. Automated, non-invasive iris recognition system and method
EP1205203B1 (en) 1994-10-14 2004-09-29 Bird Products Corporation Exhalation valve with flow transducer
JP2630923B2 (en) 1994-12-05 1997-07-16 日本アイ・ビー・エム株式会社 Image recognition method and apparatus
JP3267082B2 (en) * 1994-12-28 2002-03-18 トヨタ自動車株式会社 Vehicle pedal system
JPH11502336A (en) 1995-03-22 1999-02-23 イーデーテー インテルナツィオナール ディギタール テクノロギース ドイッチュラント ゲーエムベーハー Method and apparatus for motion discrimination over multiple frames
US5805745A (en) 1995-06-26 1998-09-08 Lucent Technologies Inc. Method for locating a subject's lips in a facial image
US5874994A (en) * 1995-06-30 1999-02-23 Eastman Kodak Company Filter employing arithmetic operations for an electronic sychronized digital camera
JP3426060B2 (en) 1995-07-28 2003-07-14 三菱電機株式会社 Face image processing device
US5850470A (en) 1995-08-30 1998-12-15 Siemens Corporate Research, Inc. Neural network for locating and recognizing a deformable object
JP3420405B2 (en) 1995-09-20 2003-06-23 キヤノン株式会社 Imaging device
US6104839A (en) 1995-10-16 2000-08-15 Eastman Kodak Company Method and apparatus for correcting pixel values in a digital image
WO1997030375A1 (en) 1996-02-13 1997-08-21 Obsidian Imaging, Inc. Method and apparatus for configuring a camera through external means
US6433818B1 (en) 1998-11-06 2002-08-13 Fotonation, Inc. Digital camera with biometric security
US6295378B1 (en) 1996-02-29 2001-09-25 Sanyo Electric Co., Ltd. Handwriting stroke information encoder which encodes handwriting stroke information by sampling
US5991456A (en) 1996-05-29 1999-11-23 Science And Technology Corporation Method of improving a digital image
US5678073A (en) 1996-05-29 1997-10-14 Eastman Kodak Company Multiple taking lenses, equal number flash bulbs, camera with flash-lens sequencing to reduce red-eye
JP2907120B2 (en) 1996-05-29 1999-06-21 日本電気株式会社 Red-eye detection correction device
US5928323A (en) 1996-05-30 1999-07-27 Sun Microsystems, Inc. Apparatus and method for dynamically generating information with server-side software objects
US5847714A (en) 1996-05-31 1998-12-08 Hewlett Packard Company Interpolation method and apparatus for fast image magnification
US20030118216A1 (en) 1996-09-04 2003-06-26 Goldberg David A. Obtaining person-specific images in a public venue
US5818975A (en) 1996-10-28 1998-10-06 Eastman Kodak Company Method and apparatus for area selective exposure adjustment
US6125213A (en) 1997-02-17 2000-09-26 Canon Kabushiki Kaisha Image processing method, an image processing apparatus, and a storage medium readable by a computer
US6441854B2 (en) 1997-02-20 2002-08-27 Eastman Kodak Company Electronic camera with quick review of last captured image
US5761550A (en) 1997-02-20 1998-06-02 Kancigor; Barry Telescoping flash unit for a camera
US6249315B1 (en) 1997-03-24 2001-06-19 Jack M. Holm Strategy for pictorial digital image processing
US6009209A (en) 1997-06-27 1999-12-28 Microsoft Corporation Automated removal of red eye effect from a digital image
US6335990B1 (en) 1997-07-03 2002-01-01 Cisco Technology, Inc. System and method for spatial temporal-filtering for improving compressed digital video
US5991594A (en) 1997-07-21 1999-11-23 Froeber; Helmut Electronic book
US6151403A (en) 1997-08-29 2000-11-21 Eastman Kodak Company Method for automatic detection of human eyes in digital images
US6292574B1 (en) 1997-08-29 2001-09-18 Eastman Kodak Company Computer program product for redeye detection
US6252976B1 (en) 1997-08-29 2001-06-26 Eastman Kodak Company Computer program product for redeye detection
US7630006B2 (en) 1997-10-09 2009-12-08 Fotonation Ireland Limited Detecting red eye filter and apparatus using meta-data
US6407777B1 (en) 1997-10-09 2002-06-18 Deluca Michael Joseph Red-eye filter method and apparatus
US7042505B1 (en) * 1997-10-09 2006-05-09 Fotonation Ireland Ltd. Red-eye filter method and apparatus
US6266054B1 (en) 1997-11-05 2001-07-24 Microsoft Corporation Automated removal of narrow, elongated distortions from a digital image
US5949904A (en) 1997-11-06 1999-09-07 International Business Machines Corporation Method, apparatus and computer program product for querying by image colors using JPEG image format
JPH11215358A (en) 1997-11-14 1999-08-06 Canon Inc Image processing unit, its conrol method and image processing system
US6484050B1 (en) 1997-11-18 2002-11-19 Care Wise Medical Products Corporation Minimally invasive surgical instrument for tissue identification, dislodgment and retrieval and methods of use
JPH11175699A (en) * 1997-12-12 1999-07-02 Fuji Photo Film Co Ltd Picture processor
KR20010033768A (en) 1997-12-31 2001-04-25 프레데릭 티. 바우어 Vehicle vision system
US6268939B1 (en) 1998-01-08 2001-07-31 Xerox Corporation Method and apparatus for correcting luminance and chrominance data in digital color images
US6278491B1 (en) 1998-01-29 2001-08-21 Hewlett-Packard Company Apparatus and a method for automatically detecting and reducing red-eye in a digital image
JP3657769B2 (en) 1998-03-19 2005-06-08 富士写真フイルム株式会社 Image processing method and image processing apparatus
US6298166B1 (en) 1998-03-30 2001-10-02 Seiko Epson Corporation Image transformations in the compressed domain
US6631208B1 (en) 1998-05-29 2003-10-07 Fuji Photo Film Co., Ltd. Image processing method
US6275614B1 (en) 1998-06-26 2001-08-14 Sarnoff Corporation Method and apparatus for block classification and adaptive bit allocation
GB9814006D0 (en) * 1998-06-29 1998-08-26 Biotica Tech Ltd Polyketides and their synthesis
JP2000050062A (en) 1998-07-31 2000-02-18 Minolta Co Ltd Image input device
US6269175B1 (en) 1998-08-28 2001-07-31 Sarnoff Corporation Method and apparatus for enhancing regions of aligned images using flow estimation
EP0984396A3 (en) * 1998-09-03 2003-08-20 Canon Kabushiki Kaisha Optimising image compositing
US6285410B1 (en) 1998-09-11 2001-09-04 Mgi Software Corporation Method and system for removal of flash artifacts from digital images
US6134339A (en) 1998-09-17 2000-10-17 Eastman Kodak Company Method and apparatus for determining the position of eyes and for correcting eye-defects in a captured frame
US6233364B1 (en) 1998-09-18 2001-05-15 Dainippon Screen Engineering Of America Incorporated Method and system for detecting and tagging dust and scratches in a digital image
JP2000134486A (en) 1998-10-22 2000-05-12 Canon Inc Image processing unit, image processing method and storage medium
JP2000209425A (en) 1998-11-09 2000-07-28 Canon Inc Device and method for processing image and storage medium
JP3291259B2 (en) 1998-11-11 2002-06-10 キヤノン株式会社 Image processing method and recording medium
US6621867B1 (en) 1998-11-16 2003-09-16 Hitachi America, Ltd Methods and apparatus for detecting edges within encoded images
US6473199B1 (en) 1998-12-18 2002-10-29 Eastman Kodak Company Correcting exposure and tone scale of digital images captured by an image capture device
US6396599B1 (en) 1998-12-21 2002-05-28 Eastman Kodak Company Method and apparatus for modifying a portion of an image in accordance with colorimetric parameters
US6396963B2 (en) 1998-12-29 2002-05-28 Eastman Kodak Company Photocollage generation and modification
US6438264B1 (en) 1998-12-31 2002-08-20 Eastman Kodak Company Method for compensating image color when adjusting the contrast of a digital color image
US6421468B1 (en) 1999-01-06 2002-07-16 Seiko Epson Corporation Method and apparatus for sharpening an image by scaling elements of a frequency-domain representation
AUPP898499A0 (en) 1999-03-02 1999-03-25 University Of Queensland, The Method for image texture analysis
US6300935B1 (en) 1999-04-20 2001-10-09 Agilent Technologies, Inc. Image interpolation circuit architecture and method for fast bi-cubic interpolation of image information
US6614471B1 (en) 1999-05-10 2003-09-02 Banctec, Inc. Luminance correction for color scanning using a measured and derived luminance value
US6393148B1 (en) 1999-05-13 2002-05-21 Hewlett-Packard Company Contrast enhancement of an image using luminance and RGB statistical metrics
US6967680B1 (en) 1999-05-28 2005-11-22 Microsoft Corporation Method and apparatus for capturing images
US7019778B1 (en) * 1999-06-02 2006-03-28 Eastman Kodak Company Customizing a digital camera
EP1181809B1 (en) 1999-06-02 2004-03-24 Eastman Kodak Company Customizing digital image transfer
US6937997B1 (en) 1999-06-02 2005-08-30 Eastman Kodak Company Configuring and purchasing imaging devices
JP2001016447A (en) 1999-06-30 2001-01-19 Minolta Co Ltd Picture processor, picture processing method and recording medium with picture processing program stored therein
US6785469B1 (en) * 1999-11-16 2004-08-31 Olympus Corporation Distance measuring device installed in camera
US6516147B2 (en) 1999-12-20 2003-02-04 Polaroid Corporation Scene recognition method and system using brightness and ranging mapping
US6786655B2 (en) 2000-02-03 2004-09-07 Eastman Kodak Company Method and system for self-service film processing
WO2001071421A1 (en) 2000-03-23 2001-09-27 Kent Ridge Digital Labs Red-eye correction by image processing
JP3729017B2 (en) 2000-03-27 2005-12-21 コニカミノルタビジネステクノロジーズ株式会社 Image processing device
US7053933B2 (en) 2000-04-04 2006-05-30 Canon Kabushiki Kaisha Image pickup apparatus having an automatic mode control
EP1986436A3 (en) 2000-04-05 2010-10-27 Sony United Kingdom Limited Audio and/or video generation apparatus and method of generating audio and /or video signals
JP4251756B2 (en) * 2000-04-10 2009-04-08 富士通マイクロエレクトロニクス株式会社 Photomask and method and apparatus for processing optical proximity effect correction data
CA2309002A1 (en) 2000-05-23 2001-11-23 Jonathan Martin Shekter Digital film grain reduction
JP2001339675A (en) 2000-05-25 2001-12-07 Sony Corp Information processing equipment and method
EP1290252B1 (en) 2000-06-01 2005-09-21 Commonwealth Scientific And Industrial Research Organisation Modified worker operation in textile carding
JP3927353B2 (en) 2000-06-15 2007-06-06 株式会社日立製作所 Image alignment method, comparison inspection method, and comparison inspection apparatus in comparison inspection
US6809840B1 (en) * 2000-06-23 2004-10-26 Eastman Kodak Company Image processing method for adaptively sub-sampling an image
JP4469476B2 (en) 2000-08-09 2010-05-26 パナソニック株式会社 Eye position detection method and eye position detection apparatus
KR100378351B1 (en) 2000-11-13 2003-03-29 삼성전자주식회사 Method and apparatus for measuring color-texture distance, and method and apparatus for sectioning image into a plurality of regions using the measured color-texture distance
US7099510B2 (en) 2000-11-29 2006-08-29 Hewlett-Packard Development Company, L.P. Method and system for object detection in digital images
US6429924B1 (en) 2000-11-30 2002-08-06 Eastman Kodak Company Photofinishing method
US7260274B2 (en) 2000-12-01 2007-08-21 Imax Corporation Techniques and systems for developing high-resolution imagery
EP1211881A1 (en) 2000-12-04 2002-06-05 Fuji Photo Film Co., Ltd. Image processing method and device
US6847377B2 (en) 2001-01-05 2005-01-25 Seiko Epson Corporation System, method and computer program converting pixels to luminance levels and assigning colors associated with luminance levels in printer or display output devices
JP4167401B2 (en) 2001-01-12 2008-10-15 富士フイルム株式会社 Digital camera and operation control method thereof
EP1227659A1 (en) * 2001-01-19 2002-07-31 GRETAG IMAGING Trading AG Colour modelling for a photograph
EP1229486A1 (en) 2001-01-31 2002-08-07 GRETAG IMAGING Trading AG Automatic image pattern detection
EP1229734A1 (en) * 2001-01-31 2002-08-07 GRETAG IMAGING Trading AG Automatic colour defect correction
JP4666274B2 (en) 2001-02-20 2011-04-06 日本電気株式会社 Color image processing apparatus and method
JP4158343B2 (en) 2001-02-21 2008-10-01 コニカミノルタビジネステクノロジーズ株式会社 Program for identifying red-eye area in image, image processing apparatus, and recording medium
JP4232345B2 (en) 2001-03-13 2009-03-04 コニカミノルタビジネステクノロジーズ株式会社 Program for correcting red eye in image, recording medium, and red eye correction method
US7216289B2 (en) 2001-03-16 2007-05-08 Microsoft Corporation Method and apparatus for synchronizing multiple versions of digital data
JP2002287017A (en) 2001-03-28 2002-10-03 Fuji Photo Optical Co Ltd Focusing state detecting device for photographic lens
US7155070B2 (en) 2001-03-29 2006-12-26 Fotomedia Technologies, Llc Visual cell phone notification of processed film images
US6751348B2 (en) 2001-03-29 2004-06-15 Fotonation Holdings, Llc Automated detection of pornographic images
JP2002296493A (en) 2001-03-30 2002-10-09 Fuji Photo Optical Co Ltd Focus state detector
US7174034B2 (en) 2001-04-13 2007-02-06 Seiko Epson Corporation Redeye reduction of digital images
US20020172419A1 (en) 2001-05-15 2002-11-21 Qian Lin Image enhancement using face detection
US7031523B2 (en) 2001-05-16 2006-04-18 Siemens Corporate Research, Inc. Systems and methods for automatic scale selection in real-time imaging
JP4800511B2 (en) 2001-07-10 2011-10-26 本田技研工業株式会社 Computer-aided product design equipment
JP2003030647A (en) 2001-07-11 2003-01-31 Minolta Co Ltd Image processor, image processing method and program
US20030039402A1 (en) 2001-08-24 2003-02-27 Robins David R. Method and apparatus for detection and removal of scanned image scratches and dust
EP1288860A1 (en) * 2001-09-03 2003-03-05 Agfa-Gevaert AG Method for processing digital photographic image data including a method for the automatic detection of red-eye defects
US7027619B2 (en) * 2001-09-13 2006-04-11 Honeywell International Inc. Near-infrared method and system for use in face detection
US7298412B2 (en) * 2001-09-18 2007-11-20 Ricoh Company, Limited Image pickup device, automatic focusing method, automatic exposure method, electronic flash control method and computer program
US7133070B2 (en) * 2001-09-20 2006-11-07 Eastman Kodak Company System and method for deciding when to correct image-specific defects based on camera, scene, display and demographic data
JP2003209683A (en) * 2001-09-27 2003-07-25 Fuji Photo Film Co Ltd Image processing equipment and image processing method
US7324246B2 (en) 2001-09-27 2008-01-29 Fujifilm Corporation Apparatus and method for image processing
US7433089B2 (en) 2001-09-27 2008-10-07 Fujifilm Corporation Image processor
JP2003107365A (en) 2001-09-28 2003-04-09 Pentax Corp Observation device with photographing function
US20050110868A1 (en) 2001-10-04 2005-05-26 Myers Kenneth J. System and method for inputting contours of a three-dimensional subject to a computer
US6501911B1 (en) 2001-10-12 2002-12-31 Eastman Kodak Company Hybrid cameras that download electronic images with reduced metadata and methods
US6496655B1 (en) 2001-10-12 2002-12-17 Eastman Kodak Company Hybrid cameras having optional irreversible clearance of electronic images with film unit removal and methods
US6614995B2 (en) 2001-11-28 2003-09-02 Sunplus Technology Co., Ltd. Apparatus and method for compensating auto-focus of image capture device by utilizing red-eye eliminating function
US7130446B2 (en) 2001-12-03 2006-10-31 Microsoft Corporation Automatic detection and tracking of multiple individuals using multiple cues
US7688349B2 (en) 2001-12-07 2010-03-30 International Business Machines Corporation Method of detecting and tracking groups of people
US7162102B2 (en) 2001-12-19 2007-01-09 Eastman Kodak Company Method and system for compositing images to produce a cropped image
US8048065B2 (en) 2001-12-21 2011-11-01 Sensomotoric Instruments Gmbh Method and apparatus for eye position registering and tracking
US7715595B2 (en) * 2002-01-16 2010-05-11 Iritech, Inc. System and method for iris identification using stereoscopic face recognition
US7289664B2 (en) * 2002-01-17 2007-10-30 Fujifilm Corporation Method of detecting and correcting the red eye
JP3964796B2 (en) * 2002-01-17 2007-08-22 富士フイルム株式会社 Red-eye detection and correction method
JP4275344B2 (en) 2002-01-22 2009-06-10 富士フイルム株式会社 Imaging apparatus, imaging method, and program
GB2384639B (en) 2002-01-24 2005-04-13 Pixology Ltd Image processing to remove red-eye features
AU2003207336A1 (en) 2002-02-22 2003-09-09 Pixology Software Limited Detection and correction of red-eye features in digital images
GB2385736B (en) 2002-02-22 2005-08-24 Pixology Ltd Detection and correction of red-eye features in digital images
US20030161506A1 (en) * 2002-02-25 2003-08-28 Eastman Kodak Company Face detection computer program product for redeye correction
JP2003289474A (en) 2002-03-27 2003-10-10 Canon Inc Image processor, imaging apparatus, image processing method, program, and computer-readable storage medium
US7155058B2 (en) 2002-04-24 2006-12-26 Hewlett-Packard Development Company, L.P. System and method for automatically detecting and correcting red eye
US7397969B2 (en) 2002-08-30 2008-07-08 Fujifilm Corporation Red eye compensation method, image processing apparatus and method for implementing the red eye compensation method, as well as printing method and printer
US6993185B2 (en) 2002-08-30 2006-01-31 Matsushita Electric Industrial Co., Ltd. Method of texture-based color document segmentation
US7277589B2 (en) 2002-09-24 2007-10-02 Fujifilm Corporation Image retouching method, apparatus, and program storage medium, image correcting method, apparatus, and program storage medium, and eye detecting and correcting method apparatus, and program storage medium
US20040126086A1 (en) 2002-09-30 2004-07-01 Fuji Photo Film Co., Ltd. Image recording apparatus
WO2004034696A1 (en) 2002-10-09 2004-04-22 Expodisc, Inc. System and method for effectively performing a white balance procedure for electronic cameras
US20040114829A1 (en) 2002-10-10 2004-06-17 Intelligent System Solutions Corp. Method and system for detecting and correcting defects in a digital image
GB0225425D0 (en) 2002-10-31 2002-12-11 Hewlett Packard Co Production of interface devices for controlling a remote device
US20040093432A1 (en) 2002-11-07 2004-05-13 Eastman Kodak Company Method and system for conducting image processing from a mobile client device
US7394969B2 (en) 2002-12-11 2008-07-01 Eastman Kodak Company System and method to compose a slide show
DE60322328D1 (en) 2002-12-11 2008-09-04 Fujifilm Corp Image correcting device and image pickup device
JP2004206688A (en) 2002-12-12 2004-07-22 Fuji Photo Film Co Ltd Face recognition method, face image cutting out method, and imaging apparatus
EP1431810A1 (en) 2002-12-16 2004-06-23 Agfa-Gevaert AG Method for automatic determination of colour correction data for the reproduction or digital images
US7181082B2 (en) 2002-12-18 2007-02-20 Sharp Laboratories Of America, Inc. Blur detection system
US20040174434A1 (en) * 2002-12-18 2004-09-09 Walker Jay S. Systems and methods for suggesting meta-information to a camera user
JP4178949B2 (en) 2002-12-27 2008-11-12 富士ゼロックス株式会社 Image processing apparatus, image processing method, and program thereof
FR2850181B1 (en) 2003-01-16 2005-07-08 Canon Europa Nv IMAGE MANAGEMENT METHOD AND DEVICE
US7180545B2 (en) 2003-01-31 2007-02-20 Hewlett-Packard Development Company, L.P. System and method for redeye strobe mode control
JP4072071B2 (en) 2003-02-13 2008-04-02 富士フイルム株式会社 Face image correction method and apparatus, and face image correction program
JP2004274720A (en) 2003-02-18 2004-09-30 Fuji Photo Film Co Ltd Data conversion apparatus and data conversion program
JP2004253970A (en) 2003-02-19 2004-09-09 Fuji Photo Film Co Ltd Image processor, method therefor, and program thereof
EP1453290A1 (en) 2003-02-28 2004-09-01 Agfa-Gevaert AG Method and device for automatic production of prints of photographic, digital image data
US20040196503A1 (en) 2003-04-07 2004-10-07 Eastman Kodak Company Index print having a correction indicator thereon and a method of making the index print
US7116820B2 (en) 2003-04-28 2006-10-03 Hewlett-Packard Development Company, Lp. Detecting and correcting red-eye in a digital image
US7184602B2 (en) 2003-05-02 2007-02-27 Microsoft Corp. System and method for low bandwidth video streaming for face-to-face teleconferencing
US7224850B2 (en) 2003-05-13 2007-05-29 Microsoft Corporation Modification of red-eye-effect in digital image
JP4186699B2 (en) 2003-05-16 2008-11-26 株式会社ニコン Imaging apparatus and image processing apparatus
US7343028B2 (en) 2003-05-19 2008-03-11 Fujifilm Corporation Method and apparatus for red-eye detection
JP2004350130A (en) 2003-05-23 2004-12-09 Fuji Photo Film Co Ltd Digital camera
JP4192681B2 (en) 2003-05-29 2008-12-10 ソニー株式会社 Display device and manufacturing method thereof
JP4136793B2 (en) 2003-05-29 2008-08-20 キヤノン株式会社 IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
US20040252217A1 (en) 2003-06-12 2004-12-16 Battles Amy E. System and method for analyzing a digital image
US7532234B2 (en) 2003-06-19 2009-05-12 Microsoft Corporation Automatic analysis and adjustment of digital images upon acquisition
US7362368B2 (en) 2003-06-26 2008-04-22 Fotonation Vision Limited Perfecting the optics within a digital image acquisition device using face detection
US20060093238A1 (en) 2004-10-28 2006-05-04 Eran Steinberg Method and apparatus for red-eye detection in an acquired digital image using face recognition
US7920723B2 (en) 2005-11-18 2011-04-05 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
US7269292B2 (en) 2003-06-26 2007-09-11 Fotonation Vision Limited Digital image adjustable compression and resolution using face detection information
US7680342B2 (en) 2004-08-16 2010-03-16 Fotonation Vision Limited Indoor/outdoor classification in digital images
US7970182B2 (en) 2005-11-18 2011-06-28 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
US7844076B2 (en) 2003-06-26 2010-11-30 Fotonation Vision Limited Digital image processing using face detection and skin tone information
US7587085B2 (en) 2004-10-28 2009-09-08 Fotonation Vision Limited Method and apparatus for red-eye detection in an acquired digital image
US7689009B2 (en) * 2005-11-18 2010-03-30 Fotonation Vision Ltd. Two stage detection for photographic eye artifacts
US8170294B2 (en) 2006-11-10 2012-05-01 DigitalOptics Corporation Europe Limited Method of detecting redeye in a digital image
US7565030B2 (en) 2003-06-26 2009-07-21 Fotonation Vision Limited Detecting orientation of digital images using face detection information
US7440593B1 (en) * 2003-06-26 2008-10-21 Fotonation Vision Limited Method of improving orientation and color balance of digital images using face detection information
WO2007142621A1 (en) 2006-06-02 2007-12-13 Fotonation Vision Limited Modification of post-viewing parameters for digital images using image region or feature information
US8254674B2 (en) 2004-10-28 2012-08-28 DigitalOptics Corporation Europe Limited Analyzing partial face regions for red-eye detection in acquired digital images
US8330831B2 (en) 2003-08-05 2012-12-11 DigitalOptics Corporation Europe Limited Method of gathering visual meta data using a reference image
US7536036B2 (en) 2004-10-28 2009-05-19 Fotonation Vision Limited Method and apparatus for red-eye detection in an acquired digital image
US7792335B2 (en) 2006-02-24 2010-09-07 Fotonation Vision Limited Method and apparatus for selective disqualification of digital images
US7904815B2 (en) 2003-06-30 2011-03-08 Microsoft Corporation Content-based dynamic photo-to-video methods and apparatuses
US6912298B1 (en) 2003-08-11 2005-06-28 Adobe Systems Incorporation Object detection using dynamic probability scans
JP3752691B2 (en) * 2003-09-11 2006-03-08 ソニー株式会社 Reflective liquid crystal display element, manufacturing method thereof, and liquid crystal display device
US7310443B1 (en) 2003-09-17 2007-12-18 Sonic Solutions, Inc. Automatic red eye detection and correction in digital images
JP2005092759A (en) * 2003-09-19 2005-04-07 Fuji Photo Film Co Ltd Image processing device and method, red-eye detection method, and program
US7295233B2 (en) 2003-09-30 2007-11-13 Fotonation Vision Limited Detection and removal of blemishes in digital images utilizing original images of defocused scenes
US7835572B2 (en) 2003-09-30 2010-11-16 Sharp Laboratories Of America, Inc. Red eye reduction technique
IES20040604A2 (en) 2003-09-30 2005-06-15 Fotonation Vision Ltd Statistical self-calibrating detection and removal of blemishes in digital images based on multiple occurrences of dust in images
US7369712B2 (en) 2003-09-30 2008-05-06 Fotonation Vision Limited Automated statistical self-calibrating detection and removal of blemishes in digital images based on multiple occurrences of dust in images
US7412105B2 (en) * 2003-10-03 2008-08-12 Adobe Systems Incorporated Tone selective adjustment of images
US20050078191A1 (en) * 2003-10-14 2005-04-14 Hewlett-Packard Development Company Lp System and method to allow undoing of certain digital image modifications
JP4431949B2 (en) 2003-10-27 2010-03-17 ノーリツ鋼機株式会社 Red-eye correction method and apparatus for carrying out this method
JP4345622B2 (en) 2003-11-05 2009-10-14 オムロン株式会社 Eye color estimation device
US20050134719A1 (en) 2003-12-23 2005-06-23 Eastman Kodak Company Display device with automatic area of importance display
JP4145246B2 (en) 2004-01-15 2008-09-03 オリンパス株式会社 Image processing method, image processing apparatus, and program
JP4121026B2 (en) 2004-01-21 2008-07-16 富士フイルム株式会社 Imaging apparatus and method, and program
US20050163498A1 (en) 2004-01-28 2005-07-28 Battles Amy E. User interface for automatic red-eye removal in a digital image
JP2005215634A (en) 2004-02-02 2005-08-11 Fujinon Corp Light emitting apparatus and photographing apparatus
US20110102643A1 (en) * 2004-02-04 2011-05-05 Tessera Technologies Ireland Limited Partial Face Detector Red-Eye Filter Method and Apparatus
US7684642B2 (en) 2004-03-03 2010-03-23 Eastman Kodak Company Correction of redeye defects in images of humans
DE502005004191D1 (en) 2004-03-18 2008-07-03 Rieter Ag Maschf CLEANING THE BAY.
JP4373828B2 (en) 2004-03-22 2009-11-25 富士フイルム株式会社 Specific area detection method, specific area detection apparatus, and program
US7693308B2 (en) * 2004-03-24 2010-04-06 Fujifilm Corporation Authentication system, authentication method, machine readable medium storing thereon authentication program, certificate photograph taking apparatus, and certificate photograph taking method
JP2005310124A (en) 2004-03-25 2005-11-04 Fuji Photo Film Co Ltd Red eye detecting device, program, and recording medium with program recorded therein
JP2005309409A (en) 2004-03-25 2005-11-04 Fuji Photo Film Co Ltd Red-eye preventing device, program and recording medium with recorded program
US7995239B2 (en) 2004-03-29 2011-08-09 Fujifilm Corporation Image output apparatus, method and program
US20050220346A1 (en) 2004-03-30 2005-10-06 Fuji Photo Film Co., Ltd. Red eye detection device, red eye detection method, and recording medium with red eye detection program
JP4505362B2 (en) 2004-03-30 2010-07-21 富士フイルム株式会社 Red-eye detection apparatus and method, and program
US7657060B2 (en) 2004-03-31 2010-02-02 Microsoft Corporation Stylization of video
JP4320272B2 (en) 2004-03-31 2009-08-26 富士フイルム株式会社 Specific area detection method, specific area detection apparatus, and program
US7620242B2 (en) 2004-04-06 2009-11-17 Fujifilm Corporation Particular-region detection method and apparatus, and program therefor
JP2005310068A (en) 2004-04-26 2005-11-04 Noritsu Koki Co Ltd Method for correcting white of eye, and device for executing the method
US20050276481A1 (en) 2004-06-02 2005-12-15 Fujiphoto Film Co., Ltd. Particular-region detection method and apparatus, and program therefor
JP4078334B2 (en) 2004-06-14 2008-04-23 キヤノン株式会社 Image processing apparatus and image processing method
KR100702397B1 (en) 2004-06-14 2007-04-02 후지필름 가부시키가이샤 Image processing system, image processing method and recording medium storing image processing program
US7894666B2 (en) 2004-07-30 2011-02-22 Canon Kabushiki Kaisha Image processing method and apparatus, image sensing apparatus, and program
CN100377163C (en) 2004-08-09 2008-03-26 佳能株式会社 Image processing method, apparatus and storage media
JP4757559B2 (en) 2004-08-11 2011-08-24 富士フイルム株式会社 Apparatus and method for detecting components of a subject
US7403654B2 (en) * 2004-10-04 2008-07-22 Arcsoft, Inc. Enhanced automatic red eye removal
JP4378258B2 (en) * 2004-10-14 2009-12-02 富士フイルム株式会社 Image correction apparatus and control method thereof
JP4383399B2 (en) 2004-11-05 2009-12-16 富士フイルム株式会社 Detection target image search apparatus and control method thereof
US7444017B2 (en) 2004-11-10 2008-10-28 Eastman Kodak Company Detecting irises and pupils in images of humans
US7593603B1 (en) 2004-11-30 2009-09-22 Adobe Systems Incorporated Multi-behavior image correction tool
KR100682906B1 (en) 2004-12-09 2007-02-15 삼성전자주식회사 Apparatus and method for detecting face in image using boost algorithm
US7715597B2 (en) 2004-12-29 2010-05-11 Fotonation Ireland Limited Method and component for image recognition
US7337399B2 (en) 2005-01-03 2008-02-26 Infoprint Solutions Company Apparatus, system, and method for editing a region of a document intersecting multiple content component types in a single operation
US20060204052A1 (en) 2005-03-11 2006-09-14 Fuji Photo Film Co., Ltd. Method, apparatus, and program for detecting red eye
US20070189609A1 (en) 2005-03-31 2007-08-16 Fuji Photo Film Co., Ltd. Method, apparatus, and program for discriminating faces
JP2006281663A (en) 2005-04-01 2006-10-19 Canon Inc Image processing parameter value setting method
JP2006338377A (en) 2005-06-02 2006-12-14 Fujifilm Holdings Corp Image correction method, apparatus, and program
US20060280375A1 (en) 2005-06-08 2006-12-14 Dalton Dan L Red-eye correction method and apparatus with user-adjustable threshold
JP4498224B2 (en) 2005-06-14 2010-07-07 キヤノン株式会社 Image processing apparatus and method
US7756325B2 (en) 2005-06-20 2010-07-13 University Of Basel Estimating 3D shape and texture of a 3D object based on a 2D image of the 3D object
US7574069B2 (en) 2005-08-01 2009-08-11 Mitsubishi Electric Research Laboratories, Inc. Retargeting images for small displays
US7747071B2 (en) 2005-10-27 2010-06-29 Hewlett-Packard Development Company, L.P. Detecting and correcting peteye
JP4645411B2 (en) * 2005-10-28 2011-03-09 コニカミノルタホールディングス株式会社 Authentication system, registration system and program
US7599577B2 (en) 2005-11-18 2009-10-06 Fotonation Vision Limited Method and apparatus of correcting hybrid flash artifacts in digital images
JP4751192B2 (en) * 2005-12-12 2011-08-17 本田技研工業株式会社 Mobile robot
JP3962803B2 (en) 2005-12-16 2007-08-22 インターナショナル・ビジネス・マシーンズ・コーポレーション Head detection device, head detection method, and head detection program
US7567707B2 (en) * 2005-12-20 2009-07-28 Xerox Corporation Red eye detection and correction
IES20060559A2 (en) 2006-02-14 2006-11-01 Fotonation Vision Ltd Automatic detection and correction of non-red flash eye defects
JP4640825B2 (en) 2006-02-23 2011-03-02 富士フイルム株式会社 Specific orientation face determination method, apparatus, and program
US7903870B1 (en) * 2006-02-24 2011-03-08 Texas Instruments Incorporated Digital camera and method
JP2007305030A (en) 2006-05-15 2007-11-22 Fujifilm Corp Red-eye processing method, device and program
US7515740B2 (en) 2006-08-02 2009-04-07 Fotonation Vision Limited Face recognition with combined PCA-based datasets
US7403643B2 (en) 2006-08-11 2008-07-22 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device
JP4172512B2 (en) * 2006-08-30 2008-10-29 船井電機株式会社 Panorama imaging device
JP4895797B2 (en) 2006-12-26 2012-03-14 アイシン精機株式会社 Wrinkle detection device, wrinkle detection method and program
JP5049356B2 (en) 2007-02-28 2012-10-17 デジタルオプティックス・コーポレイション・ヨーロッパ・リミテッド Separation of directional lighting variability in statistical face modeling based on texture space decomposition
US7995804B2 (en) 2007-03-05 2011-08-09 Tessera Technologies Ireland Limited Red eye false positive filtering using face location and orientation
KR101049188B1 (en) 2007-03-05 2011-07-14 테쎄라 테크놀로지스 아일랜드 리미티드 2-step detection of pupil defects in photographs
JP4479756B2 (en) 2007-07-05 2010-06-09 ソニー株式会社 Image processing apparatus, image processing method, and computer program
US7961983B2 (en) * 2007-07-18 2011-06-14 Microsoft Corporation Generating gigapixel images
JP4518131B2 (en) 2007-10-05 2010-08-04 富士フイルム株式会社 Imaging method and apparatus
US8212864B2 (en) 2008-01-30 2012-07-03 DigitalOptics Corporation Europe Limited Methods and apparatuses for using image acquisition data to detect and correct image defects
US8081254B2 (en) * 2008-08-14 2011-12-20 DigitalOptics Corporation Europe Limited In-camera based method of detecting defect eye with high accuracy
JP2010183564A (en) * 2009-01-09 2010-08-19 Canon Inc Image recording apparatus and method of controlling the same, and program
JP4846811B2 (en) * 2009-02-03 2011-12-28 シャープ株式会社 Optical spot position detection apparatus, optical device including the same, and electronic apparatus including the optical device

Patent Citations (101)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4577219A (en) * 1982-12-11 1986-03-18 Dr. Ing. Rudolf Hell Gmbh Method and an apparatus for copying retouch in electronic color picture reproduction
US4549801A (en) * 1983-03-21 1985-10-29 W. Haking Enterprises Limited Automatic focussing camera with automatic aperture setting
US4646134A (en) * 1984-03-21 1987-02-24 Sony Corporation Apparatus for encoding image signal
US4829331A (en) * 1987-01-12 1989-05-09 Canon Kabushiki Kaisha Camera having auto-focussing device
US5400113A (en) * 1988-03-16 1995-03-21 Nikon Corporation Control device for preventing red-eye effect on camera
US5202720A (en) * 1989-02-02 1993-04-13 Minolta Camera Kabushiki Kaisha Photographic camera with flash unit
US5303049A (en) * 1990-01-18 1994-04-12 Nikon Corporation Electronic still camera with enhanced tonal rendition
US5719951A (en) * 1990-07-17 1998-02-17 British Telecommunications Public Limited Company Normalized image feature processing
US5301026A (en) * 1991-01-30 1994-04-05 Samsung Electronics Co., Ltd. Picture editing apparatus in a digital still video camera system
US5384601A (en) * 1992-08-25 1995-01-24 Matsushita Electric Industrial Co., Ltd. Color adjustment apparatus for automatically changing colors
US5721983A (en) * 1993-07-30 1998-02-24 Canon Kabushiki Kaisha Camera having red-eye reducing function
US5734425A (en) * 1994-02-15 1998-03-31 Eastman Kodak Company Electronic still camera with replaceable digital processing program
US6714665B1 (en) * 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
US5719639A (en) * 1995-03-29 1998-02-17 Dainippon Screen Mfg., Ltd. Method and apparatus for changing specified color in a color image
US5724456A (en) * 1995-03-31 1998-03-03 Polaroid Corporation Brightness adjustment of images using digital scene analysis
US6172706B1 (en) * 1995-04-19 2001-01-09 Canon Kabushiki Kaisha Video camera with automatic zoom adjustment based on distance between user's eyes
US6011585A (en) * 1996-01-19 2000-01-04 Apple Computer, Inc. Apparatus and method for rotating the display orientation of a captured image
US5862217A (en) * 1996-03-28 1999-01-19 Fotonation, Inc. Method and apparatus for in-camera encryption
US5862218A (en) * 1996-04-04 1999-01-19 Fotonation, Inc. Method and apparatus for in-camera image marking and authentication
US5708866A (en) * 1996-05-02 1998-01-13 Eastman Kodak Company Camera selects unused flash bulb farthest from taking lens to reduce red-eye effect when camera-to-subject distance within near range
US6201571B1 (en) * 1996-06-13 2001-03-13 Nec Corporation Digital camera recording a reduced image synthesized with a character image of the image picking-up information
US6195127B1 (en) * 1996-07-18 2001-02-27 Sanyo Electric Co., Ltd. Digital camera, having a flash unit, which determines proper flash duration through an assessment of image luminance and, where needed, a preliminary flash emission
US6028611A (en) * 1996-08-29 2000-02-22 Apple Computer, Inc. Modular digital image processing via an image processing chain
US6011547A (en) * 1996-10-22 2000-01-04 Fuji Photo Film Co., Ltd. Method and apparatus for reproducing image from data obtained by digital camera and digital camera used therefor
US20030025808A1 (en) * 1997-02-20 2003-02-06 Kenneth A. Parulski Electronic camera with "utilization" selection capability
US20040032512A1 (en) * 1997-05-15 2004-02-19 Kia Silverbrook Correction of distortions in digital images
US6035074A (en) * 1997-05-27 2000-03-07 Sharp Kabushiki Kaisha Image processing apparatus and storage medium therefor
US6204858B1 (en) * 1997-05-30 2001-03-20 Adobe Systems Incorporated System and method for adjusting color data of pixels in a digital image
US6381345B1 (en) * 1997-06-03 2002-04-30 At&T Corp. Method and apparatus for detecting eye location in an image
US20040032526A1 (en) * 1997-07-15 2004-02-19 Silverbrook Research Pty Ltd Method of processing digital image to correct for flash effects
US6204868B1 (en) * 1997-07-22 2001-03-20 Konica Corporation Image forming apparatus providing polygonal mirror having braking means
US5892837A (en) * 1997-08-29 1999-04-06 Eastman Kodak Company Computer program product for locating objects in an image
US20050041121A1 (en) * 1997-10-09 2005-02-24 Eran Steinberg Red-eye filter method and apparatus
US20080002060A1 (en) * 1997-10-09 2008-01-03 Fotonation Vision Limited Optimized Performance and Performance for Red-Eye Filter Method and Apparatus
US6016354A (en) * 1997-10-23 2000-01-18 Hewlett-Packard Company Apparatus and a method for reducing red-eye in a digital image
US6035072A (en) * 1997-12-08 2000-03-07 Read; Robert Lee Mapping defects or dirt dynamically affecting an image acquisition device
US6192149B1 (en) * 1998-04-08 2001-02-20 Xerox Corporation Method and apparatus for automatic detection of image target gamma
US20020041329A1 (en) * 1998-06-26 2002-04-11 Eran Steinberg In camera messaging and advertisement system
US6510520B1 (en) * 1998-06-26 2003-01-21 Fotonation, Inc. Secure storage device for transfer of digital camera data
US6724941B1 (en) * 1998-09-30 2004-04-20 Fuji Photo Film Co., Ltd. Image processing method, image processing device, and recording medium
US20040056975A1 (en) * 1998-10-08 2004-03-25 Daisuke Hata Autofocus apparatus
US6700614B1 (en) * 1998-10-08 2004-03-02 Ricoh Company, Ltd. Autofocus apparatus
US6036072A (en) * 1998-10-27 2000-03-14 De Poan Pneumatic Corporation Nailer magazine
US6707950B1 (en) * 1999-06-22 2004-03-16 Eastman Kodak Company Method for modification of non-image data in an image processing chain
US20020019859A1 (en) * 2000-08-01 2002-02-14 Fuji Photo Film Co., Ltd. Method and system for contents data processing service
US6728401B1 (en) * 2000-08-17 2004-04-27 Viewahead Technology Red-eye removal using color image processing
US6718051B1 (en) * 2000-10-16 2004-04-06 Xerox Corporation Red-eye detection method
US20030025811A1 (en) * 2000-12-13 2003-02-06 Eastman Kodak Company Customizing a digital camera based on demographic factors
US20040047491A1 (en) * 2000-12-21 2004-03-11 Bo Rydbeck Image capturing device with reflex reduction
US20050053279A1 (en) * 2001-02-13 2005-03-10 Microsoft Corporation Red-eye detection based on red region detection with eye confirmation
US7171044B2 (en) * 2001-02-13 2007-01-30 Microsoft Corporation Red-eye detection based on red region detection with eye confirmation
US20050058340A1 (en) * 2001-02-13 2005-03-17 Microsoft Corporation Red-eye detection based on red region detection with eye confirmation
US20050058342A1 (en) * 2001-02-13 2005-03-17 Microsoft Corporation Red-eye detection based on red region detection with eye confirmation
US6873743B2 (en) * 2001-03-29 2005-03-29 Fotonation Holdings, Llc Method and apparatus for the automatic real-time detection and correction of red-eye defects in batches of digital images or in handheld appliances
US6859565B2 (en) * 2001-04-11 2005-02-22 Hewlett-Packard Development Company, L.P. Method and apparatus for the removal of flash artifacts
US20030007687A1 (en) * 2001-07-05 2003-01-09 Jasc Software, Inc. Correction of "red-eye" effects in images
US6516154B1 (en) * 2001-07-17 2003-02-04 Eastman Kodak Company Image revising camera and method
US20030021478A1 (en) * 2001-07-25 2003-01-30 Minolta Co., Ltd. Image processing technology for identification of red eyes in image
US20030044176A1 (en) * 2001-08-28 2003-03-06 Asahi Kogaku Kogyo Kabushiki Kaisha Optical axis adjusting device
US20030044070A1 (en) * 2001-09-03 2003-03-06 Manfred Fuersich Method for the automatic detection of red-eye defects in photographic image data
US20030044178A1 (en) * 2001-09-03 2003-03-06 Knut Oberhardt Method for the automatic detection of red-eye defects in photographic image data
US20030044177A1 (en) * 2001-09-03 2003-03-06 Knut Oberhardt Method for the automatic detection of red-eye defects in photographic image data
US20040046878A1 (en) * 2001-09-14 2004-03-11 Nick Jarman Image processing to remove red-eyed features
US20030052991A1 (en) * 2001-09-17 2003-03-20 Stavely Donald J. System and method for simulating fill flash in photography
US20030058349A1 (en) * 2001-09-26 2003-03-27 Fuji Photo Film Co., Ltd. Method, apparatus, and program for image processing
US20030058343A1 (en) * 2001-09-26 2003-03-27 Fuji Photo Film Co., Ltd. Image data transfer method, digital camera, and program
US20040027593A1 (en) * 2001-10-12 2004-02-12 David Wilkins Techniques for resolution independent rendering of images
US6505003B1 (en) * 2001-10-12 2003-01-07 Eastman Kodak Company Hybrid cameras that revise stored electronic image metadata at film unit removal and methods
US20050001024A1 (en) * 2001-12-03 2005-01-06 Yosuke Kusaka Electronic apparatus, electronic camera, electronic device, image display apparatus, and image transmission system
US20040017481A1 (en) * 2002-04-11 2004-01-29 Olympus Optical Co., Ltd. Digital camera, image pickup method, and image format conversion method
US20040057715A1 (en) * 2002-06-06 2004-03-25 Olympus Optical Co., Ltd. Strobe light emitting apparatus and camera
US20040033071A1 (en) * 2002-08-02 2004-02-19 Naoki Kubo Electronic flash device and camera having the same
US20040037460A1 (en) * 2002-08-22 2004-02-26 Eastman Kodak Company Method for detecting objects in digital images
US20040041924A1 (en) * 2002-08-29 2004-03-04 White Timothy J. Apparatus and method for processing digital images having eye color defects
US20040057705A1 (en) * 2002-09-11 2004-03-25 Nidec Copal Corporation Motor driving apparatus
US20040057623A1 (en) * 2002-09-24 2004-03-25 Thomas Schuhrke Method for automated processing of digital image data
US20050013603A1 (en) * 2003-07-15 2005-01-20 Shoji Ichimasa Image sensing apparatus, image processing apparatus, and control method therefor
US20050013602A1 (en) * 2003-07-18 2005-01-20 Pentax Corporation Digital camera having red-eye reduction bracket photographing mode
US20050024498A1 (en) * 2003-07-28 2005-02-03 Fuji Photo Film Co., Ltd. Image processor and image processing system
US20100053367A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Partial face tracker for red-eye filter method and apparatus
US20080043121A1 (en) * 2003-08-05 2008-02-21 Fotonation Vision Limited Optimized Performance and Performance for Red-Eye Filter Method and Apparatus
US20100053368A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Face tracker and partial face tracker for red-eye filter method and apparatus
US20050031224A1 (en) * 2003-08-05 2005-02-10 Yury Prilutsky Detecting red eye filter and apparatus using meta-data
US20100053362A1 (en) * 2003-08-05 2010-03-04 Fotonation Ireland Limited Partial face detector red-eye filter method and apparatus
US20050063083A1 (en) * 2003-08-21 2005-03-24 Dart Scott E. Systems and methods for the implementation of a digital images schema for organizing units of information manageable by a hardware/software interface system
US20050046730A1 (en) * 2003-08-25 2005-03-03 Fuji Photo Film Co., Ltd. Digital camera
US20050047655A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Detecting and correcting redeye in an image
US20050047656A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Systems and methods of detecting and correcting redeye in an image suitable for embedded applications
US20050062856A1 (en) * 2003-09-19 2005-03-24 Fuji Photo Film Co., Ltd. Camera equipped with red-eye correction feature
US20050068452A1 (en) * 2003-09-30 2005-03-31 Eran Steinberg Digital camera with built-in lens calibration table
US6984039B2 (en) * 2003-12-01 2006-01-10 Eastman Kodak Company Laser projector having silhouette blanking for objects in the output light path
US20060017825A1 (en) * 2004-06-30 2006-01-26 Khageshwar Thakur Method and apparatus for effecting automatic red eye reduction
US20060008171A1 (en) * 2004-07-06 2006-01-12 Microsoft Corporation Digital photography with flash/no flash extension
US20060039690A1 (en) * 2004-08-16 2006-02-23 Eran Steinberg Foreground/background segmentation in digital images with differential exposure calculations
US20060038916A1 (en) * 2004-08-17 2006-02-23 Dialog Semiconductor Gmbh Intelligent light source with synchronization with a digital camera
US20060045352A1 (en) * 2004-09-01 2006-03-02 Eastman Kodak Company Determining the age of a human subject in a digital image
US20060050300A1 (en) * 2004-09-03 2006-03-09 Canon Kabushiki Kaisha Information processing apparatus and method for managing order data of on-line orders, program for the same
US20060066628A1 (en) * 2004-09-30 2006-03-30 Microsoft Corporation System and method for controlling dynamically interactive parameters for image processing
US7336821B2 (en) * 2006-02-14 2008-02-26 Fotonation Vision Limited Automatic detection and correction of non-red eye flash defects
US20080013798A1 (en) * 2006-06-12 2008-01-17 Fotonation Vision Limited Advances in extending the aam techniques from grayscale to color images
US7315631B1 (en) * 2006-08-11 2008-01-01 Fotonation Vision Limited Real-time face tracking in a digital image acquisition device

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060170791A1 (en) * 2002-11-29 2006-08-03 Porter Robert Mark S Video camera
US8384791B2 (en) * 2002-11-29 2013-02-26 Sony United Kingdom Limited Video camera for face detection
US20090232402A1 (en) * 2008-03-14 2009-09-17 Seiko Epson Corporation Image Processing Apparatus, Image Processing Method, and Computer Program for Image Processing
US20110157410A1 (en) * 2009-12-31 2011-06-30 Jose Antonio Mendez Alcazar Auto white balance algorithm using rgb product measure
US8339471B2 (en) 2009-12-31 2012-12-25 DigitalOptics Corporation Europe Limited Auto white balance algorithm using RGB product measure
US8624996B2 (en) 2009-12-31 2014-01-07 DigitalOptics Corporation Europe Limited Auto white balance algorithm using RGB product measure

Also Published As

Publication number Publication date
EP2264997A2 (en) 2010-12-22
US20080298679A1 (en) 2008-12-04
US7804531B2 (en) 2010-09-28
US8648938B2 (en) 2014-02-11
US20080292183A1 (en) 2008-11-27
US7847840B2 (en) 2010-12-07
US20130188077A1 (en) 2013-07-25
US20110058069A1 (en) 2011-03-10
US20110058071A1 (en) 2011-03-10
US20130155298A1 (en) 2013-06-20
US8493478B2 (en) 2013-07-23
US20120038788A1 (en) 2012-02-16
US7847839B2 (en) 2010-12-07
US20080316341A1 (en) 2008-12-25
ATE535098T1 (en) 2011-12-15
US20040223063A1 (en) 2004-11-11
US8537251B2 (en) 2013-09-17
EP1654865A1 (en) 2006-05-10
WO2005015896A1 (en) 2005-02-17
JP2007503030A (en) 2007-02-15
US9025054B2 (en) 2015-05-05
EP1654865B1 (en) 2011-11-23
EP2264997A3 (en) 2011-12-07
US20110074975A1 (en) 2011-03-31
US20070263104A1 (en) 2007-11-15
US7630006B2 (en) 2009-12-08
US20130162869A1 (en) 2013-06-27
US8957993B2 (en) 2015-02-17
JP4709147B2 (en) 2011-06-22
US8379117B2 (en) 2013-02-19
US7852384B2 (en) 2010-12-14
US20110069186A1 (en) 2011-03-24

Similar Documents

Publication Publication Date Title
US7852384B2 (en) Detecting red eye filter and apparatus using meta-data
US20050031224A1 (en) Detecting red eye filter and apparatus using meta-data
US7953251B1 (en) Method and apparatus for detection and correction of flash-induced eye defects within digital images using preview or other reference images
US8265388B2 (en) Analyzing partial face regions for red-eye detection in acquired digital images
US6845181B2 (en) Method for processing a digital image to adjust brightness
JP4078334B2 (en) Image processing apparatus and image processing method
US8446494B2 (en) Automatic redeye detection based on redeye and facial metric values
US20050140801A1 (en) Optimized performance and performance for red-eye filter method and apparatus

Legal Events

Date Code Title Description
AS Assignment

Owner name: FOTONATION IRELAND LIMITED, IRELAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DELUCA, MICHAEL J.;PRILUTSKY, YURY;STEINBERG, ERAN;AND OTHERS;SIGNING DATES FROM 20040615 TO 20040625;REEL/FRAME:025434/0694

Owner name: FOTONATION VISION LIMITED, IRELAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FOTONATION IRELAND LIMITED;REEL/FRAME:025435/0038

Effective date: 20041227

AS Assignment

Owner name: TESSERA TECHNOLOGIES IRELAND LIMITED, IRELAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FOTONATION VISION LIMITED;REEL/FRAME:025567/0216

Effective date: 20101001

AS Assignment

Owner name: DIGITALOPTICS CORPORATION EUROPE LIMITED, IRELAND

Free format text: CHANGE OF NAME;ASSIGNOR:TESSERA TECHNOLOGIES IRELAND LIMITED;REEL/FRAME:027144/0293

Effective date: 20110713

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION