Reflections in the eye contain identifiable faces

Jan 15, 2014 by Lisa Zyga feature
(a) High-resolution face photograph, with the red frame indicating the region of interest. (b) Zoomed view of the region of interest showing the cornea and reflections of five faces. The green frame highlights the face shown in (c) as a close-up. Credit: Jenkins and Kerr, DOI: 10.1371/journal.pone.0083325

(Phys.org) —Eyes are said to be a mirror to the soul, but they may also be a mirror to the surrounding world. Researchers have found that our eyes reflect the people we're looking at with high enough resolution so that the people can be identified. The results could be applied to analyzing photographs of crime victims whose eyes may be reflecting their perpetrators.

The researchers, Rob Jenkins at the University of York, UK, and Christie Kerr at the University of Glasgow, UK, have published a paper in PLOS ONE on extracting identifiable images of bystanders from corneal reflections. The researchers explained that at first they weren't sure how well the images would turn out.

"Humans can recognize from very poor images, so we knew that was on our side," Jenkins told Phys.org. "At the time, we were not sure how much we would be able to recover from the eye reflections. As soon as we saw the first image, we realized we were on to something."

In their study, the researchers used a high-resolution digital camera (Hasselblad H2D 39-megapixel camera) and illuminated the room with four carefully positioned Bowens DX1000 flash lamps. Then the photographer and four volunteer bystanders stood in a semi-circle around the subject to be photographed.

The resulting photographs have a high resolution of 5,400 x 7,200 pixels, with the subject's iris containing about 54,000 pixels overall. By zooming in on the iris, the researchers could extract several rectangular sections containing the head and shoulders of the reflected bystanders.

The whole face area for each bystander is only about 322 pixels on average. Although these images are fuzzy, previous research has shown that humans can identify faces with extremely poor image quality—as low as 7 x 10 pixels—when they are familiar with the faces.

Corneal reflection images of several individuals used in the face recognition task. Credit: Jenkins and Kerr, DOI: 10.1371/journal.pone.0083325

The researchers here found similar results. When showing volunteers who were not involved in the photo shoots the low-resolution eye reflection images, and asking them whether the person in the image was the same or different as a person in a good-quality photo, the volunteers did quite well. The volunteers were accurate 71% of the time when unfamiliar with the ' faces, and 84% of the time when familiar with the faces. In both cases, the accuracy in the face-matching tasks was well above chance (50%).

A second experiment involved a group of specially selected volunteers who were familiar with only one out of six individuals in a mock line-up of eye reflection images. The volunteers, who were naïve to the purpose of the experiment, were asked if they could identify anyone in the images. Overall, nine out of the 10 volunteers correctly identified the familiar face with high confidence, while altogether they made five incorrect identifications with low confidence.

The researchers pointed out that there are limitations to this method, since it requires high-resolution images that are in focus, and also that the subject's face be viewed from a roughly frontal angle under good lighting. However, as camera technology is rapidly improving, it may not be long before mobile phones routinely carry cameras with more than 39 megapixels.

In the future, the researchers hope that the technique could be extended to combine pairs of images recovered from both of the subject's eyes. The information contained in the two images could be used to reconstruct a 3D representation of the environment from the subject's viewpoint. Interestingly, since the corneal reflections extend beyond the aperture of the pupil, these reconstructions could capture an even wider angle of the scene than was visible to the subject at the time.

"The future prospects are interesting," Jenkins said. "The world is awash with digital images. Over 40 million photos per day are shared via Instagram alone. Meanwhile, the pixel count for digital cameras is doubling roughly every 12 months. So the future holds a lot of detailed , which is potentially interesting for image analysts."

Explore further: Researchers point to digital gains in human recognition

More information: Rob Jenkins and Christie Kerr. "Identifiable Images of Bystanders Extracted from Corneal Reflections." PLOS ONE. DOI: 10.1371/journal.pone.0083325

Related Stories

Dogs recognize familiar faces from images

Dec 18, 2013

So far the specialized skill for recognizing facial features holistically has been assumed to be a quality that only humans and possibly primates possess. Although it's well known, that faces and eye contact ...

Taking nothing at face value

Jul 09, 2012

Photographs of faces may not be adequate proof of a person's identity and this could have serious implications for the accuracy of passport photographs in determining identity. Research funded by the Economic and Social Research ...

Recommended for you

Taxi app Uber defies ban in Spain

15 hours ago

Smartphone car-ride service Uber vowed Friday to keep operating in Spain despite a ban following a lawsuit by taxi drivers and said it would fight the case in court.

Sony film mess reflects gadgets-entertainment gap

23 hours ago

Sony's iconic gadgetry and the star appeal of Hollywood may have appeared to be a perfect match when the electronics giant bought Columbia Pictures in 1989. A quarter century later, it's apparent that Sony ...

Streaming release of 'Interview' test for industry

Dec 25, 2014

Sony's "The Interview" has been a hacking target, a punchline and a political lightning rod. Now, with its release online at the same time it debuts in theaters, it has a new role: a test for a new kind of ...

User comments : 5

Adjust slider to filter visible comments by rank

Display comments: newest first

baudrunner
5 / 5 (2) Jan 15, 2014
CSI: Miami is going to be all over this.
24volts
4.8 / 5 (4) Jan 15, 2014
security cameras are going to have to get a lot better to do this. Most of the pictures I see taken from one of them are so poor you can barely see the faces in them.
goracle
not rated yet Jan 15, 2014
The eyes have it!
MP3Car
not rated yet Jan 16, 2014
Why is this news? Even 18MP cameras with high quality lenses can do this, especially if the camera is closer to the subject. The Sony Alpha 7R (or A7R; 36.1MP, $2000-$2500) comes to mind. Also, the example explained in the article used four "carefully positioned" flash lamps...

The neater area of study is related to processing multiple frames from real-world scenes (i.e. no "carefully positioned flash lamps") where all frames include the subject. You can process the multiple frames together to get an image that is higher resolution than any of the frames individually... The "magic" enhancement you see on TV can actually be done to some extent, but not very much from a single frame. If you have multiple frames of a subject as they're moving through the field of view, or the camera moves, it is possible to combine them to get a specific region of interest that is a higher resolution than any single frame.

Again, why is this "news" ???
antialias_physorg
5 / 5 (2) Jan 16, 2014
Suddenly that scene in "Bladerunner" doesn't seem so futuristic anymore.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.