Expert passport officers better at detecting fraud using face recognition technology

October 14, 2015
An illustrative example of a face-matching task in the lab. A UNSW Australia-led study has shown that face-matching experts at the Australian Passport Office are 20 percent more accurate than average people at detecting fraud using automatic face recognition software. Credit: CC BY David White

Face-matching experts at the Australian Passport Office are 20 per cent more accurate than average people at detecting fraud using automatic face recognition software, new research shows.

The UNSW-led study is the first to test how well people perform on this difficult but common operational task carried out by passport officers.

"Our research shows that accuracy can be significantly improved by recruiting staff who are naturally good at - the so-called "super-recognisers" - and then giving them in-depth training in the use of the software," says study lead author and UNSW psychologist Dr David White.

The study is published in the journal PLOS ONE.

Automatic face recognition software is increasingly being used for police work or when people apply for identity documents such as passports, immigration visas or driver licences.

These commercial systems search large databases of known offenders or existing passport or licence-holders and generate a list of the top eight or so "candidate faces" that closely match the suspect or person applying for a document.

A match could help reveal, for example, if someone is fraudulently applying for a second passport under a different name.

"The accuracy of automatic has improved markedly in recent years. But, despite its name, the system is not fully automatic," says Dr White.

"Human skills are also very important. Once a list of candidates has been generated by the software, a police officer or passport officer must decide whether any of these images are of the target person. Our study is the first to test how well people can match the identity of faces selected by facial ."

The researchers tested 42 untrained students and 24 non-expert passport officers who make face-matching decisions in their daily work using the software, but who have only had a small amount of training.

They also tested seven specialist facial examiners - highly trained and experienced staff who regularly work on cases of suspected passport fraud.

Real Australian passport application images were used in the experiment as well as a face recognition system used to screen passport applications for identity fraud.

The students and non-experts passport officers made errors 50 per cent of the time when determining whether a face was on the list of candidates or not.

"Their performance was very poor, and our results show that mere practice does not improve this. It shows the software sets them a very difficult face-matching task," says Dr White.

"But it is encouraging that specialist facial examiners performed far better than the untrained students and the non-specialist officers. They outperformed other groups by 20 percentage points."

As a result of Dr White's research, the Australian Passport Office has recently begun to recruit staff who are naturally good at face recognition.

Explore further: Taking nothing at face value

More information: PLOS ONE, dx.plos.org/10.1371/journal.pone.0139827

Related Stories

Taking nothing at face value

July 9, 2012

Photographs of faces may not be adequate proof of a person's identity and this could have serious implications for the accuracy of passport photographs in determining identity. Research funded by the Economic and Social Research ...

Forensic examiners pass the face matching test

September 1, 2015

The first study to test the skills of FBI agents and other law enforcers who have been trained in facial recognition has provided a reassuring result - they perform better than the average person or even computers on this ...

Recommended for you

Paleontologists discover major T. rex fossil (Update)

August 18, 2016

Paleontologists with the Burke Museum of Natural History and Culture and the University of Washington have discovered a Tyrannosaurus rex, including a very complete skull. The find, which paleontologists estimate to be about ...

An inflexible diet led to the disappearance of the cave bear

August 23, 2016

Senckenberg scientists have studied the feeding habits of the extinct cave bear. Based on the isotope composition in the collagen of the bears' bones, they were able to show that the large mammals subsisted on a purely vegan ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.