Desktop tool traces animal movement using consumer video equipment

Mar 11, 2014 by Rob Knies

People love to watch animals. That's why zoos exist. That's why photographic safaris command princely sums. That's why cat videos have become an unstoppable force.

Lucas Joppa loves to watch animals, too, but his motivation includes an additional dimension. A scientist in the Computational Ecology and Environmental Sciences (CEES) group at Microsoft Research Cambridge, Joppa heads the Conservation Science Research Unit, which focuses on his key interests: science, policy, and tools and technology.

On Feb. 24, Joppa and his CEES colleagues took yet another step toward melding a couple of those interests by offering for download ZooTracer, a desktop tool that can be used to trace animal movement by using consumer video equipment. The product of collaboration between CEES and the Computer Vision group, also from Microsoft Research Cambridge, the ZooTracer download offers three distinct benefits:

  • It is easy to use.
  • It can take video from anywhere.
  • The user can quickly modify the results—helping the software learn how to track any object.

"We hope people use it to track animals in ," Joppa states. "Doing so is an important step in addressing fundamental ecological and environmental problems.

This video is not supported by your browser at this time.
Credit: ©2014 Microsoft Corporation. All rights reserved.

"For example, bee populations are in drastic decline. What plants do they pollinate—and why? That is a question pretty relevant to the production of food for human consumption, but actually watching bees fly around and trying to track their plant preferences and the flight paths they take is a pretty difficult task. ZooTracer allows scientists to collect these very easily."

The ZooTracer software can provide accurate tracking of multiple, unmarked, interacting animals in arbitrary video footage. It also can cope with variations in lighting, camera movement, and object appearance—and it does so regardless of the type of recording device or habitat.

"Most other video-tracking software packages require the user to have thought quite hard about what they were going to do before they did it," Joppa observes. "For example, using extreme background subtraction algorithms allows for a heavily automated object detection and tracking process. But the actual collection of video footage appropriate for such algorithms can become a trying affair—and it certainly doesn't work for most field biologists!

"We have thrown that thinking by the wayside and said that if we allow the user to input a small amount of information about the system, then perhaps we can make a tool significantly more generic than currently exists. So, have some footage taken with your smartphone with shaky hands and a strangely lit background? No problem! ZooTracer should be able to handle it, and if it doesn't, you are able to modify the algorithm's parameters through the user interface to attempt to make it work for you."

In short, ZooTracer represents a leap forward in enabling the collection and analysis of behavior, not just for laboratory experiments, but also for biologists in the field. It will prove helpful for any scientist interested in tracking objects in video.

"I'm really intrigued by the many other, non-ecological, uses I'm sure people will find for the software," Joppa says. "Putting people back in the loop and allowing them to decide what they want to track should lead to some pretty interesting scientific applications."

That, often enough, is the hallmark of successful research: Not only has it been abstracted to a level where it works for the problem at hand, but its design also is sufficiently flexible to inspire a class of entirely new challenges.

"Just because we happen to be interested in animal movement doesn't mean you have to be," Joppa enthuses. "We used as our motivation for completing the tool—and it turned out to be a fantastic collaboration between one of the world's leading computer-vision teams here at Microsoft Research, led by Andrew Fitzgibbon, and our own computational-ecology group."

Explore further: New system allows for high-accuracy, through-wall, 3-D motion tracking (w/ Video)

add to favorites email to friend print save as pdf

Related Stories

JAABA: New software speeds analysis of animal behavior

Dec 10, 2012

(Phys.org)—Using new software developed at HHMI's Janelia Farm Research Campus, a computer can be trained to recognize characteristic animal behaviors like an experienced biologist. Rather than scrutinizing hours of video ...

Recommended for you

Forging a photo is easy, but how do you spot a fake?

Nov 21, 2014

Faking photographs is not a new phenomenon. The Cottingley Fairies seemed convincing to some in 1917, just as the images recently broadcast on Russian television, purporting to be satellite images showin ...

Algorithm, not live committee, performs author ranking

Nov 21, 2014

Thousands of authors' works enter the public domain each year, but only a small number of them end up being widely available. So how to choose the ones taking center-stage? And how well can a machine-learning ...

Professor proposes alternative to 'Turing Test'

Nov 19, 2014

(Phys.org) —A Georgia Tech professor is offering an alternative to the celebrated "Turing Test" to determine whether a machine or computer program exhibits human-level intelligence. The Turing Test - originally ...

Image descriptions from computers show gains

Nov 18, 2014

"Man in black shirt is playing guitar." "Man in blue wetsuit is surfing on wave." "Black and white dog jumps over bar." The picture captions were not written by humans but through software capable of accurately ...

Converting data into knowledge

Nov 17, 2014

When a movie-streaming service recommends a new film you might like, sometimes that recommendation becomes a new favorite; other times, the computer's suggestion really misses the mark. Yisong Yue, assistant ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.