Expert passport officers better at detecting fraud using face recognition technology

October 14, 2015
An illustrative example of a face-matching task in the lab. A UNSW Australia-led study has shown that face-matching experts at the Australian Passport Office are 20 percent more accurate than average people at detecting fraud using automatic face recognition software. Credit: CC BY David White

Face-matching experts at the Australian Passport Office are 20 per cent more accurate than average people at detecting fraud using automatic face recognition software, new research shows.

The UNSW-led study is the first to test how well people perform on this difficult but common operational task carried out by passport officers.

"Our research shows that accuracy can be significantly improved by recruiting staff who are naturally good at - the so-called "super-recognisers" - and then giving them in-depth training in the use of the software," says study lead author and UNSW psychologist Dr David White.

The study is published in the journal PLOS ONE.

Automatic face recognition software is increasingly being used for police work or when people apply for identity documents such as passports, immigration visas or driver licences.

These commercial systems search large databases of known offenders or existing passport or licence-holders and generate a list of the top eight or so "candidate faces" that closely match the suspect or person applying for a document.

A match could help reveal, for example, if someone is fraudulently applying for a second passport under a different name.

"The accuracy of automatic has improved markedly in recent years. But, despite its name, the system is not fully automatic," says Dr White.

"Human skills are also very important. Once a list of candidates has been generated by the software, a police officer or passport officer must decide whether any of these images are of the target person. Our study is the first to test how well people can match the identity of faces selected by facial ."

The researchers tested 42 untrained students and 24 non-expert passport officers who make face-matching decisions in their daily work using the software, but who have only had a small amount of training.

They also tested seven specialist facial examiners - highly trained and experienced staff who regularly work on cases of suspected passport fraud.

Real Australian passport application images were used in the experiment as well as a face recognition system used to screen passport applications for identity fraud.

The students and non-experts passport officers made errors 50 per cent of the time when determining whether a face was on the list of candidates or not.

"Their performance was very poor, and our results show that mere practice does not improve this. It shows the software sets them a very difficult face-matching task," says Dr White.

"But it is encouraging that specialist facial examiners performed far better than the untrained students and the non-specialist officers. They outperformed other groups by 20 percentage points."

As a result of Dr White's research, the Australian Passport Office has recently begun to recruit staff who are naturally good at face recognition.

Explore further: Forensic examiners pass the face matching test

More information: PLOS ONE, dx.plos.org/10.1371/journal.pone.0139827

Related Stories

Forensic examiners pass the face matching test

September 1, 2015

The first study to test the skills of FBI agents and other law enforcers who have been trained in facial recognition has provided a reassuring result - they perform better than the average person or even computers on this ...

Taking nothing at face value

July 9, 2012

Photographs of faces may not be adequate proof of a person's identity and this could have serious implications for the accuracy of passport photographs in determining identity. Research funded by the Economic and Social Research ...

Recommended for you

Evaluation of scientific rigor in animal research

December 2, 2016

The "reproducibility crisis" in biomedical research has led to questions about the scientific rigor in animal research, and thus the ethical justification of animal experiments. In research publishing in the Open Access journals ...

Researchers find evidence of original 1620 Plymouth settlement

November 30, 2016

Three hundred and ninety-five years after Pilgrims celebrated the first Thanksgiving in Plymouth, Massachusetts, researchers from UMass Boston's Andrew Fiske Memorial Center for Archaeological Research can say they have definitively ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.