CA2236082A1 - Method and apparatus for detecting eye location in an image - Google Patents

Method and apparatus for detecting eye location in an image

Info

Publication number
CA2236082A1
CA2236082A1 CA002236082A CA2236082A CA2236082A1 CA 2236082 A1 CA2236082 A1 CA 2236082A1 CA 002236082 A CA002236082 A CA 002236082A CA 2236082 A CA2236082 A CA 2236082A CA 2236082 A1 CA2236082 A1 CA 2236082A1
Authority
CA
Canada
Prior art keywords
image
eye
eyes
gamma
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002236082A
Other languages
French (fr)
Other versions
CA2236082C (en
Inventor
Cassandra Turner Swain
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AT&T Corp
Original Assignee
AT&T Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AT&T Corp filed Critical AT&T Corp
Publication of CA2236082A1 publication Critical patent/CA2236082A1/en
Application granted granted Critical
Publication of CA2236082C publication Critical patent/CA2236082C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding

Abstract

Method And Apparatus For Detecting Eye Location In An Image A simple method for segmenting eyes and extracting parameters enables further processing of the image to enable a person to appear to be making eye contact with another via a video conferencing system. This method is a first step for eye synthesis and gaze detection because it can automatically extract select eye parameters useful to these processes. Its advantage is that no a priori information is necessary to segment eyes, unlike modeling and neural network methods. The method of the present invention first blurs the image to make it easier to determine the location of the two eye regions in the image. The eyebrows are then eliminated based on the located eye regions. The eyes are thensegmented and the eye parameters are extracted from the resulting image. According to the present invention, the process applies a Gaussian filter, h(~,.gamma.),where g(~,.gamma.) is the resulting image and(~,.gamma.) is the original image.
CA002236082A 1997-06-03 1998-04-27 Method and apparatus for detecting eye location in an image Expired - Lifetime CA2236082C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/867,728 1997-06-03
US08/867,728 US6381345B1 (en) 1997-06-03 1997-06-03 Method and apparatus for detecting eye location in an image

Publications (2)

Publication Number Publication Date
CA2236082A1 true CA2236082A1 (en) 1998-12-03
CA2236082C CA2236082C (en) 2001-10-30

Family

ID=25350364

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002236082A Expired - Lifetime CA2236082C (en) 1997-06-03 1998-04-27 Method and apparatus for detecting eye location in an image

Country Status (4)

Country Link
US (1) US6381345B1 (en)
EP (2) EP1669909A1 (en)
CA (1) CA2236082C (en)
DE (1) DE69837233T2 (en)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7738015B2 (en) * 1997-10-09 2010-06-15 Fotonation Vision Limited Red-eye filter method and apparatus
US7630006B2 (en) * 1997-10-09 2009-12-08 Fotonation Ireland Limited Detecting red eye filter and apparatus using meta-data
US7042505B1 (en) 1997-10-09 2006-05-09 Fotonation Ireland Ltd. Red-eye filter method and apparatus
US6792134B2 (en) * 2000-12-19 2004-09-14 Eastman Kodak Company Multi-mode digital image processing method for detecting eyes
US6920237B2 (en) * 2000-12-19 2005-07-19 Eastman Kodak Company Digital image processing method and computer program product for detecting human irises in an image
EP1229486A1 (en) * 2001-01-31 2002-08-07 GRETAG IMAGING Trading AG Automatic image pattern detection
AUPS140502A0 (en) * 2002-03-27 2002-05-09 Seeing Machines Pty Ltd Method for automatic detection of facial features
US7227976B1 (en) * 2002-07-08 2007-06-05 Videomining Corporation Method and system for real-time facial image enhancement
US8036458B2 (en) * 2007-11-08 2011-10-11 DigitalOptics Corporation Europe Limited Detecting redeye defects in digital images
US7792970B2 (en) 2005-06-17 2010-09-07 Fotonation Vision Limited Method for establishing a paired connection between media devices
US8170294B2 (en) * 2006-11-10 2012-05-01 DigitalOptics Corporation Europe Limited Method of detecting redeye in a digital image
US7574016B2 (en) 2003-06-26 2009-08-11 Fotonation Vision Limited Digital image processing using face detection information
US8254674B2 (en) 2004-10-28 2012-08-28 DigitalOptics Corporation Europe Limited Analyzing partial face regions for red-eye detection in acquired digital images
US7920723B2 (en) * 2005-11-18 2011-04-05 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
US7336821B2 (en) 2006-02-14 2008-02-26 Fotonation Vision Limited Automatic detection and correction of non-red eye flash defects
US7689009B2 (en) 2005-11-18 2010-03-30 Fotonation Vision Ltd. Two stage detection for photographic eye artifacts
US7970182B2 (en) 2005-11-18 2011-06-28 Tessera Technologies Ireland Limited Two stage detection for photographic eye artifacts
KR20030066512A (en) * 2003-07-04 2003-08-09 김재민 Iris Recognition System Robust to noises
US20050140801A1 (en) * 2003-08-05 2005-06-30 Yury Prilutsky Optimized performance and performance for red-eye filter method and apparatus
US8520093B2 (en) * 2003-08-05 2013-08-27 DigitalOptics Corporation Europe Limited Face tracker and partial face tracker for red-eye filter method and apparatus
US9412007B2 (en) * 2003-08-05 2016-08-09 Fotonation Limited Partial face detector red-eye filter method and apparatus
US20110102643A1 (en) * 2004-02-04 2011-05-05 Tessera Technologies Ireland Limited Partial Face Detector Red-Eye Filter Method and Apparatus
US7599577B2 (en) * 2005-11-18 2009-10-06 Fotonation Vision Limited Method and apparatus of correcting hybrid flash artifacts in digital images
US7650034B2 (en) * 2005-12-14 2010-01-19 Delphi Technologies, Inc. Method of locating a human eye in a video image
EP2033142B1 (en) 2006-06-12 2011-01-26 Tessera Technologies Ireland Limited Advances in extending the aam techniques from grayscale to color images
US7620216B2 (en) * 2006-06-14 2009-11-17 Delphi Technologies, Inc. Method of tracking a human eye in a video image
US8055067B2 (en) 2007-01-18 2011-11-08 DigitalOptics Corporation Europe Limited Color segmentation
JP2010520567A (en) * 2007-03-05 2010-06-10 フォトネーション ビジョン リミテッド Red-eye false detection filtering using face position and orientation
JP4309928B2 (en) * 2007-03-15 2009-08-05 アイシン精機株式会社 Wrinkle detection device, wrinkle detection method, and program
DE102007016403A1 (en) * 2007-04-03 2008-10-09 Micronas Gmbh Method and device for recording, transmitting and / or reproducing image data, in particular videoconferencing image data
US8503818B2 (en) 2007-09-25 2013-08-06 DigitalOptics Corporation Europe Limited Eye defect detection in international standards organization images
US8212864B2 (en) * 2008-01-30 2012-07-03 DigitalOptics Corporation Europe Limited Methods and apparatuses for using image acquisition data to detect and correct image defects
US8081254B2 (en) * 2008-08-14 2011-12-20 DigitalOptics Corporation Europe Limited In-camera based method of detecting defect eye with high accuracy
US8396004B2 (en) 2008-11-10 2013-03-12 At&T Intellectual Property Ii, L.P. Video share model-based video fixing
JP5602708B2 (en) * 2011-11-09 2014-10-08 楽天株式会社 Gaze position estimation system, gaze position estimation system control method, gaze position estimation apparatus, gaze position estimation apparatus control method, program, and information storage medium
US8542879B1 (en) 2012-06-26 2013-09-24 Google Inc. Facial recognition
US8457367B1 (en) 2012-06-26 2013-06-04 Google Inc. Facial recognition
US8856541B1 (en) 2013-01-10 2014-10-07 Google Inc. Liveness detection
US9113036B2 (en) 2013-07-17 2015-08-18 Ebay Inc. Methods, systems, and apparatus for providing video communications
US10089525B1 (en) 2014-12-31 2018-10-02 Morphotrust Usa, Llc Differentiating left and right eye images
US9846807B1 (en) 2014-12-31 2017-12-19 Morphotrust Usa, Llc Detecting eye corners
KR20180053108A (en) * 2016-11-11 2018-05-21 삼성전자주식회사 Method and apparatus for extracting iris region
CN108229276B (en) * 2017-03-31 2020-08-11 北京市商汤科技开发有限公司 Neural network training and image processing method and device and electronic equipment
US10713813B2 (en) 2018-02-22 2020-07-14 Innodem Neurosciences Eye tracking method and system
CN108509894A (en) * 2018-03-28 2018-09-07 北京市商汤科技开发有限公司 Method for detecting human face and device

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS62247410A (en) * 1985-12-04 1987-10-28 Aisin Seiki Co Ltd Energization controller for electric apparatus
US4822162A (en) * 1987-08-27 1989-04-18 Richardson Robert W Method and device for measuring retinal response as a function of position of the retina
US5016282A (en) * 1988-07-14 1991-05-14 Atr Communication Systems Research Laboratories Eye tracking image pickup apparatus for separating noise from feature portions
WO1992002000A1 (en) * 1990-07-17 1992-02-06 British Telecommunications Public Limited Company A method of processing an image
JP2522859B2 (en) * 1990-12-14 1996-08-07 日産自動車株式会社 Eye position detection device
US5450504A (en) * 1992-05-19 1995-09-12 Calia; James Method for finding a most likely matching of a target facial image in a data base of facial images
US5537662A (en) * 1992-05-29 1996-07-16 Casio Computer Co., Ltd. Electronic montage composing apparatus
ATE178439T1 (en) * 1993-01-16 1999-04-15 James Andrew Bangham SIGNAL PROCESSING SYSTEM
US5407391A (en) 1993-05-14 1995-04-18 The Walt Disney Company Negative bust illusion and related method
US5432863A (en) * 1993-07-19 1995-07-11 Eastman Kodak Company Automated detection and correction of eye color defects due to flash illumination
US5689575A (en) * 1993-11-22 1997-11-18 Hitachi, Ltd. Method and apparatus for processing images of facial expressions
US5781650A (en) * 1994-02-18 1998-07-14 University Of Central Florida Automatic feature detection and age classification of human faces in digital images
US5572596A (en) * 1994-09-02 1996-11-05 David Sarnoff Research Center, Inc. Automated, non-invasive iris recognition system and method
US5802220A (en) * 1995-12-15 1998-09-01 Xerox Corporation Apparatus and method for tracking facial motion through a sequence of images

Also Published As

Publication number Publication date
DE69837233T2 (en) 2007-12-20
EP0883080B1 (en) 2007-03-07
EP0883080A3 (en) 2000-04-12
CA2236082C (en) 2001-10-30
EP0883080A2 (en) 1998-12-09
EP1669909A1 (en) 2006-06-14
US6381345B1 (en) 2002-04-30
DE69837233D1 (en) 2007-04-19

Similar Documents

Publication Publication Date Title
CA2236082A1 (en) Method and apparatus for detecting eye location in an image
EP0751473B1 (en) Locating features in an image
JP4755202B2 (en) Face feature detection method
EP1229493A3 (en) Multi-mode digital image processing method for detecting eyes
WO2001033497A1 (en) A system and method for face detection through geometric distribution of a non-intensity image property
CN107172354B (en) Video processing method and device, electronic equipment and storage medium
CN111191573A (en) Driver fatigue detection method based on blink rule recognition
CA2326816A1 (en) Face recognition from video images
AU2015377788B2 (en) Process and system for video spoof detection based on liveness evaluation
JP2000105819A (en) Face image area detecting device
Monwar et al. Pain recognition using artificial neural network
Park et al. Detection of human faces using skin color and eyes
CN111179156A (en) Video beautifying method based on face detection
CN109522865A (en) A kind of characteristic weighing fusion face identification method based on deep neural network
Lin et al. Face detection based on skin color segmentation and SVM classification
JP2003317084A (en) System, method and program for detecting gaze from face image
JP3578321B2 (en) Image normalizer
CN112487904A (en) Video image processing method and system based on big data analysis
KR20040026905A (en) Evaluation apparatus and method of image quality for realtime iris recognition, and storage media having program thereof
JPH11185026A (en) Face area extraction device
KR20050096484A (en) Decision of occlusion of facial features and confirmation of face therefore using a camera
Mak et al. A lip-tracking system based on morphological processing and block matching techniques
KR950029985A (en) Personal recognition method using image processing of human face
CN1131699C (en) Method for detecting driver's eyes in dozing driving alarm system
Akimoto et al. Feature Extraction from Front and Side Views of Faces for 3D Facial Model Creation.

Legal Events

Date Code Title Description
EEER Examination request