Robot Cameras in the Wild

Jan 02, 2006
A prototype CONE in Goldberg's laboratory.
Image: A prototype CONE in Goldberg's laboratory.

Almost every night, cars are broken into in Yosemite National Park. It's classic smash-and-dash. Windows are shattered and goods stolen. It's not a human crime ring though. The thieves are black bears and they're mostly after food that visitors leave in their vehicles. Soon though, a new telerobotic surveillance system that enables visitors to "tour" the park via the Internet may also help capture footage of the bear burglars. The installation would be a proof-of-concept test for the Collaborative Observatories for Natural Environments (CONE) technology that UC Berkeley robotics professor Ken Goldberg is developing to aid scientists studying natural animal behavior in remote places.

"Biologists spend a great deal of time observing and recording nature using traditional video equipment," says Goldberg, who holds a joint appointment in the Department of Industrial Engineering and Operations Research and also Electrical Engineering and Computer Sciences. "So we're trying to help them bring the latest technology into the field."

Right now, the study of animals in the wild over long periods can be difficult, expensive, and sometimes dangerous. For example, scientists would like to watch families of Alaskan polar bears emerging from their dens in the spring. While it's fine weather for bears, humans aren't accustomed to the whipping winds and freezing cold.

Working with his former graduate student Dezhen Song, now a professor at Texas A&M University, Goldberg is designing robotic "observatories" that scientists could leave behind at their research sites. Once they return to the laboratory, they could log on to the Internet to see what the camera see and steer it to keep an eye on their animal subjects from afar. The system draws from advances in high-resolution robotic cameras, long-range wireless networking, distributed sensor networks, and software algorithms for collaborative control that Goldberg and Song developed in the last few years.

The idea, Goldberg explains, is that the CONE would be contained in a small, wheeled trunk. After opening the lid, the system automatically kicks into operation, seeking out a satellite connection for Internet access and charging its batteries via solar panels. Meanwhile, the scientist distributes a handful of small, wireless sensors (pioneered at UC Berkeley) that monitor motion, temperature, and other variables. T he sensors self-organize into an ad hoc wireless network and pass their data from one to another, bucket-brigade style until the information reaches the CONE.

Depending on what the sensors detect, the telerobotic camera can then point itself at the source of the activity – for example, unusual movement off to one side of the panorama. The system might then create a time-lapse clip of that specific region for later review by the scientist.

What happens if more than one sensor calls for the camera's attention, or more than one scientist commands it to move simultaneously? That's when Goldberg and Song's advanced control algorithms kick in. The software uses mathematical principles to infer a consensus from a group of requests. That way, the observatory can point the camera in the direction that will satisfy the most users all of the time. They're also working on a time-based technique for the camera to respond in turn to each request as efficiently as possible.

"It's a hybrid system though, so it's collaborative not just among people but also among sensors," Goldberg says. "A change in the image can be requested by people or sensors and that request can be weighted depending on who or what is making it. If the chief biologist wants to see something, her request can override everything else."

Currently, Goldberg and Song are working with the National Geographic Society on a plan to test their prototype CONE in Yosemite in the near future. They've also begun to discuss more scientific collaborations with UC Berkeley biologists. In the short term though, the technology may soon save visitors from facing the reality that animals can be criminals too.

"The rangers want to show people what can happen if they leave food in their cars," Goldberg says. "Of course, viewers safe at home may enjoy watching the brutes at work: Go Bears!"

Source: UC Berkeley College of Engineering, Lab Notes, by David Pescovitz

Explore further: New 'Surveyman' software promises to revolutionize survey design and accuracy

add to favorites email to friend print save as pdf

Related Stories

Microsoft beefs up security protection in Windows 10

9 minutes ago

What Microsoft users in business care deeply about—-a system architecture that supports efforts to get their work done efficiently; a work-centric menu to quickly access projects rather than weather readings ...

US official: Auto safety agency under review

12 hours ago

Transportation officials are reviewing the "safety culture" of the U.S. agency that oversees auto recalls, a senior Obama administration official said Friday. The National Highway Traffic Safety Administration has been criticized ...

Out-of-patience investors sell off Amazon

13 hours ago

Amazon has long acted like an ideal customer on its own website: a freewheeling big spender with no worries about balancing a checkbook. Investors confident in founder and CEO Jeff Bezos' invest-and-expand ...

Ebola.com domain sold for big payout

13 hours ago

The owners of the website Ebola.com have scored a big payday with the outbreak of the epidemic, selling the domain for more than $200,000 in cash and stock.

Recommended for you

Remains of French ship being reassembled in Texas

18 hours ago

A frigate carrying French colonists to the New World that sank in a storm off the Texas coast more than 300 years ago is being reassembled into a display that archeologists hope will let people walk over ...

Cloning whistle-blower: little change in S. Korea

Oct 24, 2014

The whistle-blower who exposed breakthrough cloning research as a devastating fake says South Korea is still dominated by the values that allowed science fraudster Hwang Woo-suk to become an almost untouchable ...

User comments : 0