Software that recognizes behavior patterns developed to improve computer tracking of human activity

Oct 11, 2012
Bourne pursuit: Improving computer tracking of human activity

(—Contrary to what you might see in police dramas, you don't have to be Jason Bourne to shake off a computer tracking you through a video feed. Cross paths with someone who vaguely resembles you, and the computer is likely to swap your labels.

But researchers at the University of Michigan have found a way to improve a computer's human-tracking accuracy by more than 30 percent by looking not only at where the targets are going, but also at what they're doing.

"By creating that understands which activity a person or a group of people is performing, we can obtain much more robust and stable tracking results," says Silvio Savarese, professor of electrical engineering and computer sciences. "This is a new way of solving the tracking problem and can potentially revolutionize the way researchers look at the tracking problem in general."

Savarese and doctoral student Wongun Choi conducted the research.

In order to say anything useful about what its video feeds sees, a computer needs to be able to track people and things moving through the scene. Already, computers can identify and track people who are standing or walking, but camera movements and obstacles that temporarily hide targets can throw them off. In order to make computer tracking more reliable, Savarese's team taught the software to recognize interactions such as people walking together, standing in a line or crossing a street.

The of an individual give information about his or her interactions, and the interactions can predict future behavior of an individual. For instance, when two people appear to be walking and talking together, the computer can connect their tracks. If the pair then pass behind an obstacle with a third person, the computer now has the to predict that when the individuals reappear, the two in conversation will probably still be together.

If such advanced software tries to follow the behaviors of targets with "brute force"—that is, by considering every possible interaction that could occur and deciding which is most likely—Savarese says that it could take years to give its tracking solution. Ideally, for applications like vehicle collision prevention, such software should run in real time.

To speed things up, the team taught their software to think more like a human. They fed it example videos with targets and behaviors labeled. That way, the computer could capitalize on the analytical strength of our brains: recognizing patterns based on previous experience.

"Our method reduces the computational complexity and makes it possible to solve the problem of inferring what a person will do based on their activities as an individual, their interactions with other individuals and their behavior in larger groups," Savarese says.

His research team will continue to speed up the process, and he reports that a simplified version of the tracking software is approaching real-time operation.

The problem of tracking targets is significant in many fields, from robot vision to observing animal herds in the wild and picking out suspicious activity in a crowd. The application Savarese has in mind would aid drivers, keeping an eye on the pedestrians and sounding an alarm or braking if one of them is about to take an unexpected step into the street.

Explore further: Earthquake simulation tops one quadrillion flops

More information: Silvio Savarese:

Related Stories

Training eye movement may reduce driver distraction

Jun 08, 2010

More than 16 people are killed and more than 1,300 people are injured each day in crashes involving a distracted driver, a phenomenon that could be reduced with the right application of motion information and appropriate ...

App helps San Fran police track stolen iPhone fast

Jul 22, 2010

(AP) -- A man accused of swiping an Apple iPhone out of a woman's hand in San Francisco may have been shocked when police found him only nine minutes later. It turns out the phone had been tracking his every move.

Watching me, watching you

Oct 21, 2009

( -- Software that tracks shoppers' eye movements as they browse supermarket shelves may seem a bit Big Brother, but the latest technology in 'eye-tracking', which monitors what grabs a person's ...

Scientists crack code on tracking zebras

May 25, 2011

Field biologists following thousands of wild zebras in Africa used to joke about how nice it would be to have a bar code reader to help them identify and catalogue individual animals.

Recommended for you

Ten ways 3D printing could change space exploration

37 minutes ago

This close-up shows a titanium ball manufactured by 3D printing. ESA is investigating the potential of this promising new technology to transform the way space missions are put together.

Students turn $250 wheelchair into geo-positioning robot

49 minutes ago

Talk about your Craigslist finds! A team of student employees at The University of Alabama in Huntsville's Systems Management and Production Center (SMAP) combined inspiration with innovation to make a $250 ...

How does false information spread online?

1 hour ago

Last summer the World Economic Forum (WEF) invited its 1,500 council members to identify top trends facing the world, including what should be done about them. The WEF consists of 80 councils covering a wide range of issues including social media. Members come ...

Technip, Heerema win third giant Angolan oil contract

1 hour ago

The ultra-deep Angolan offshore oil project called Kaombo generated the third huge contract in three days on Wednesday when French group Total picked two firms to carry out underwater engineering worth $3.5 billion.

User comments : 0

More news stories

How does false information spread online?

Last summer the World Economic Forum (WEF) invited its 1,500 council members to identify top trends facing the world, including what should be done about them. The WEF consists of 80 councils covering a wide range of issues including social media. Members come ...

Patent talk: Google sharpens contact lens vision

( —A report from Patent Bolt brings us one step closer to what Google may have in mind in developing smart contact lenses. According to the discussion Google is interested in the concept of contact ...

Melting during cooling period

( —A University of Maine research team says stratification of the North Atlantic Ocean contributed to summer warming and glacial melting in Scotland during the period recognized for abrupt cooling ...

Australia's dirty secret: who's breathing toxic air?

Australians living in poorer communities, with lower employment and education levels, as well as communities with a high proportion of Indigenous people, are significantly more likely to be exposed to high ...