Two sociable weavers with the bounding boxes illustrating the individual identification performed by the computer. Credit: Annie Basson and André Ferreira

New research demonstrates for the first time that artificial intelligence (AI) can be used to train computers to recognize individual birds, a task humans are unable to do. The research is published in the British Ecological Society journal Methods in Ecology and Evolution.

"We show that computers can consistently recognize dozens of , even though we cannot ourselves tell these individuals apart. In doing so, our study provides the means of overcoming one of the greatest limitations in the study of wild —reliably recognizing individuals." Said Dr. André Ferreira at the Center for Functional and Evolutionary Ecology (CEFE), France, and lead author of the study.

In the study, researchers from institutes in France, Germany Portugal and South Africa describe the process for using AI to individually identify birds. This involves collecting thousands of labeled images of birds and then using this data to train and test AI models. This study represents the first successful attempt to do this in birds.

The researchers trained the AI models to recognize images of individual birds in wild populations of great tits and sociable weavers and a captive population of zebra finches, some of the most commonly studied birds in behavioral ecology. After training, the AI models were tested with images of the individuals they had not seen before and had an accuracy of over 90% for the and 87% for the captive zebra finches.

In animal behavior studies, individually identifying animals is one of the most expensive and time-consuming factors, limiting the scope of behaviors and the size of the populations that researchers can study. Current identification methods like attaching color bands to birds' legs can also be stressful to the animals.

These issues could be solved with AI models. Dr. André Ferreira said: "The development of methods for automatic, non-invasive identification of animals completely unmarked and unmanipulated by researchers represents a major breakthrough in this research field. Ultimately, there is plenty of room to find new applications for this system and answer questions that seemed unreachable in the past."

A great tit with the bounding box illustrating the individual identification performed by the computer. Credit: André Ferreira

For AI models to be able to accurately identify individuals they need to be trained with thousands of labeled images. Companies like Facebook are able to do this for human recognition because they have access to millions of pictures of different people that are voluntarily tagged by users. But, acquiring such labeled photographs of animals is difficult and has created a bottleneck in research.

The researchers were able to overcome this challenge by building feeders with camera traps and sensors. Most birds in the study populations carried a passive integrated transponder (PIT) tag, similar to the microchips implanted in pet cats and dogs. Antennae on the bird feeders were able to read the identity of the bird from these tags and trigger the cameras.

Being able to distinguish individual animals from each other is important for the long-term monitoring of populations and protecting species from pressures such as climate change. While some species such as leopards have distinct patterns that allow humans to recognize them by eye, most species require additional visual identifiers, such as color bands attached to birds' legs, for us to tell them apart. Even then, methods like this are extremely time consuming and error prone.

AI methods like the one shown in this study use a type of deep learning known as convolutional neural networks, these are optimal for solving image classification problems. In ecology, these methods have previously been used to identify animals at a species levels and individual primates, pigs and elephants. However, until now it hasn't been explored in smaller like birds.

The authors caution that the AI is only able to re-identify individuals it has been shown before. "The model is able to identify birds from new pictures as long as the birds in those pictures are previously known to the models. This means that if new birds join the study population the computer will not be able to identify them." said Dr. André Ferreira.

The appearance of individual birds can change over time, for instance molting, and it's not known how the performance of the AI model will be affected. Images of the same bird taken months apart could be mistakenly identified as different individuals.

The authors add that both these limitations can be overcome with large enough datasets containing thousands of images of thousands of individuals over long periods of time, which they are currently trying to collect.

More information: André C. Ferreira et al, Deep learning‐based methods for individual recognition in small birds, Methods in Ecology and Evolution (2020). DOI: 10.1111/2041-210X.13436

Journal information: Methods in Ecology and Evolution