 |
|
|
|
|
|
 Title: |
US6539100:
Method and apparatus for associating pupils with subjects
[ Derwent Title ]
|
| Country: |
US United States of America
|
| |
| Inventor: |
Amir, Arnon; Cupertino, CA
Flickner, Myron Dale; San Jose, CA
Koons, David Bruce; San Jose, CA
Morimoto, Carlos Hitoshi; San Jose, CA
|
| Assignee: |
International Business Machines Corporation, Armonk, NY
other patents from INTERNATIONAL BUSINESS MACHINES CORPORATION (280070) (approx. 44,393)
News, Profiles, Stocks and More about this company
|
| Published / Filed: |
2003-03-25
/ 1999-01-27
|
| Application Number: |
US1999000238979
|
| IPC Code: |
Advanced:
G06F 3/00;
G06F 3/01;
G06K 9/00;
G06T 7/00;
Core:
more...
IPC-7:
G06K 9/00;
|
| ECLA Code: |
G06F3/01B; G06K9/00F2; G06K9/00S; G06K9/00V4; G06T7/00P;
|
| U.S. Class: |
382/117;
382/173;
|
| Field of Search: |
382/117,199,128,173,286
351/206,221,208,210
434/040,42
|
| Priority Number: |
| 1999-01-27 |
US1999000238979 |
|
| Abstract: |
A method and apparatus analyzes a scene to determine which pupils correspond to which subjects. First, a machine-readable representation of the scene, such as a camera image, is generated. Although more detail may be provided, this representation minimally depicts certain visually perceivable characteristics of multiple pupil candidates corresponding to multiple subjects in the scene. A machine such as a computer then examines various features of the pupil candidates. The features under analysis include (1) visually perceivable characteristics of the pupil candidates at one given time ("spatial cues"), and (2) changes in visually perceivable characteristics of the pupil candidates over a sampling period ("temporal cues"). The spatial and temporal cues may be used to identify associated pupil pairs. Some exemplary spatial cues include interocular distance, shape, height, and color of potentially paired pupils. In addition to features of the pupils themselves, spatial cues may also include nearby facial features such as presence of a nose/mouth/eyebrows in predetermined relationship to potentially paired pupils, a similarly colored iris surrounding each of two pupils, skin of similar color nearby, etc. Some exemplary temporal cues include motion or blinking of paired pupils together, etc. With the foregoing examination, each pupil candidate can be associated with a subject in the scene.
|
| Attorney, Agent or Firm: |
Hubert, Dan ;
|
| Primary / Asst. Examiners: |
Johns, Andrew W.; Azarian, Seyed
|
| INPADOC Legal Status: |
Show legal status actions
|
| Family: |
None
|
First Claim:
Show all 65 claims |
What is claimed is:
1. A machine-implemented method of associating pupils present in a scene to corresponding subjects, comprising the operations of:
- receiving a machine-readable representation of visually perceivable characteristics of multiple pupil candidates corresponding to multiple subjects in a scene;
- associating each pupil candidate with one of the multiple subjects in the scene by examining at least one of the following: (1) one or more of the visually perceivable characteristics of the pupil candidates at one sample time, and (2) any changes in one or more of the visually perceivable characteristics of the pupil candidates during a sampling period; and
- providing a machine-readable output representing the association of pupil candidates with subjects in the scene.
|
| Background / Summary: |
Show background / summary
|
| Drawing Descriptions: |
Show drawing descriptions
|
| Description: |
Show description
|
| Forward References: |
Show 7 U.S. patent(s) that reference this one
|
|
|
|
|
|
|
| Foreign References: |
None
|
| Other References: |
Aizawa et al., "Detection and Tracking of Facial Features," Proc. of the SPIE Com. and Image Proc. (1995), v. 2501, Taipei Taiwan, pp. 1161-1172.
Baluja et al., "Neutral Network-Based Face Detection," Proc. IEEE Conf. on Computer Vision and Pattern Recognition (1996), San Francisco, CA, pp. 203-208.
Baluja et al., "Rotation Invariant Neutral Network-Based Face Detection," Proc. IEEE Conf. on Computer Vision and Pattern Recognition (Jun. 1998), Santa Barbara, CA, pp. 38-44.
Berard et al., "LAFTER: Lips and Face Real Time Tracker," Proc. IEEE Conf. on Computer Vision and Pattern Recognition (Jun. 1997), Puerto Rico, pp. 123-129.
Birchfeld, "Elliptical Head Tracking Using Intensity Gradients and Color Histograms," Proc. IEEE Conf. on Computer Vision and Pattern Recognition (1998), pp. 232-237.
Cohen et al., "Feature Extraction From Faces Using Deformable Template," International Journal of Computer Vision (1992), vol. 8, No. 2, pp. 99-111.
(13 pages)
Cited by 13 patents
[ISI abstract]
Darrell et al., "Active Face Tracking and Pose Estimation in an Interactive Room," MIT Media Lab, TR-356 (1996), pp. 1-16.
Darrell et al., "A Virtual Mirror Interface Using Real-Time Robust Face Tracking," Proc. Int'l conf. on Automatic Face and Gesture Recognition (Apr. 1998), Japan, pp. 616-621.
Darrell et al., "Integrated Person Tracking Using Stereo, Color, and Pattern Detection," Proc. IEEE on Conf. on Computer Vision and Pattern Recognition (Jun. 1998), Santa Barbara, CA, pp. 601-608.
Ebisawa et al., "Effectiveness of Pupil Area Detection Technique Using Two Light Sources and Image Difference Method", Proc. of the 15th Ann. Int'l Conf. of IEEE Engineering in Medicine and Biology Society, vol. 15, (Jan. 1993), pp. 1268-1269.
Ebisawa, "Unconstained Pupil Detection Technique Using Two Light Sources and the Image Difference Method", Visualization and Intelligent Design in Engineering and Architecture (1995), pp. 79-89.
Fieguth et al., "Color-Based Tracking of Heads and Other Mobile Objects at Video Frame Rates", Proc. IEEE Conference on Computer Vision and Pattern Recognition (1997), pp. 21-27.
Govindaraju et al., "A Computational Model For Face Location," Proc. of the Int'l Conf. on computer Vision (Dec. 1990), pp. 718-721, Osaka, Japan.
Harville et al., "Tracking People With Integrated Stereo, Color, and Face Detection,", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, Jun. 1998, pp. 601-608.
Kothari et al., "Detection of Eye Locations in Unconstrained Visual Images", Proc. Int'l Conf. on Image Processing (1996), Switzerland, pp. 519-522.
Poggio et al., "Example-Based Learning for View-Based Human Face Detection," MIT AI Lab TR-AI-1521 (1994), pp. 1-20.
Scassellati, "Eye Finding via Face Detection for a Foveated, Active Vision System," Proceedings of the 15th Conf. on Artificial Intelligence (AAAI-98), ISBM 0-262-51098-7, Jul. 26-30, 1998.
Scassellati, "Real-Time Face and Eye Detection," world-wide-web, 1998.
Stiefelhagen et al., "A Model-Based Gaze Tracking System," Proc. Joint Symposium on Intelligence and Systems (1996), pp. 304-310.
Sirohey, "Human Face Segmentation and Identification", CAR-TR-695, CS-TR-3176, (1993 ), pp. 1-33.
Waibel et al., "A Real-Time Face Tracker", Proc. of the 3rd IEEE Workshop on Applications of Computer Vision (1996), Sarasota, FL, pp. 142-147.
|
|
 Nominate this for the Gallery...
|
|
