Robotic camera mimics human operators to anticipate basketball game action

January 7, 2015, Disney Research

Automated cameras make it possible to broadcast even minor events, but the result often looks...well, robotic. Now scientists at Disney Research have made it possible for robotic cameras to learn from human operators how to better frame shots of a basketball game.

Many automated systems determine where to point the camera by tracking a key object, such as a lecturer. But human camera operators are able to anticipate action and can adjust the camera's pan, tilt and zoom controls to allow more space, or "lead room," in the direction that the action is moving. The result is video imagery that is smooth and aesthetically pleasing.

Peter Carr, a Disney Research engineer, and Jianhui Chen, an intern and a Ph.D. student in computer science at the University of British Columbia, devised a data-driven approach that allows a camera system to monitor an expert during a basketball game. The automated system uses machine learning algorithms to recognize the relationship between player locations and corresponding camera configurations.

They will report their findings at WACV 2015, the IEEE Winter Conference on Applications of Computer Vision, Jan. 6-9, in Waikoloa Beach, Hawaii.

"We don't use any direct information about the ball's location because tracking the ball with a single camera is difficult," Carr said. "But players are coached to be in the right place at the right time, so their formations usually give strong clues about the ball's location."

Carr and Chen demonstrated their system on a high school . They used two cameras - a broadcast camera that was operated by a human expert and another that was a stationary camera that the computer used to detect and track the players automatically.

"Because the main broadcast camera in basketball maintains a wide shot of the court, we focused on predicting the appropriate pan angle of the camera," Carr said. Following supervised learning based on the operator's actions, the system was able to predict how to pan the camera in a way that was superior to the best previous algorithm and that did indeed mimic a human operator.

Carr said he expects the method can be adapted to other sports, possibly with additional features. Future work also will include mimicking the auxiliary cameras used for cutaway shots in multi- productions.

Explore further: Researchers scan video to monitor nighttime behavior of giraffes

More information: "Mimicking Human Camera Operators-Paper" www.disneyresearch.com/wp-cont … -Operators-Paper.pdf

Related Stories

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

NASA instruments image fireball over Bering Sea

March 22, 2019

On Dec. 18, 2018, a large "fireball—the term used for exceptionally bright meteors that are visible over a wide area—exploded about 16 miles (26 kilometers) above the Bering Sea. The explosion unleashed an estimated 173 ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.