Disney Research transforms movie-quality animations for interactive viewing

May 16, 2017, Disney Research

Cinema-quality animations and virtual reality graphics that need to be rendered in real-time are often mutually exclusive categories, but Disney Research has developed a new process that transforms high-resolution animated content into a novel video format to enable immersive viewing.

The end-to-end solution the researchers devised will make it easier to repurpose animated film assets for use in games and location-based VR venues. Viewers wearing head-mounted displays can interact with movie animations in a new way, based on the position and orientation of their heads.

"This new solution promises huge savings on the most costly aspects of interactive media production," said Professor Kenny Mitchell, senior research scientist.

The researchers will present their real-time rendering method May 16 at the Graphics Interface 2017 conference in Edmonton, Alberta.

"We've seen a resurgence in interest in in recent years as companies have released a number of head-mounted displays for consumers," said Professor Markus Gross, vice president at Disney Research. "The subsequent demand for VR and other immersive content is driving innovations such as this ground-breaking set of methods for reusing rendered animated ."

Virtual reality scenes must be rendered in real-time and that performance requirement means using animations that are less complex than the highly detailed animations typical of feature films. That means when artists produce an interactive experience tied-in to the film or a related video game, they have to convert the film animations into a lower-quality form compatible with real-time rendering or game engines. That process is both laborious and expensive.

Mitchell and his colleagues opt instead for an approach that relies on automated pre-processing: The 3D scenes are rendered from the perspective of a number of camera positions calculated to provide the best viewpoints for all of the surfaces in the scene with as few cameras as possible and encode it all in a modular video format. This content can then be rendered in real-time from an arbitrary point of view, allowing for motion parallax, head tilting and rotations.

"This process enables consumption of immersive pre-rendered video in six degrees of freedom using a head-mounted display," said Babis Koniaris, a post-doctoral associate on the team. "It can also be used for rendering film-quality visuals for video games."

In addition to Mitchell and Koniaris, the research team included Maggie Kosek and David Sinclair. The research was partly supported by the Innovate UK project #102684, titled OSCIR.

Combining creativity and innovation, this research continues Disney's rich legacy of leveraging technology to enhance the tools and systems of tomorrow.

Explore further: Using virtual reality to catch a real ball

Related Stories

Using virtual reality to catch a real ball

March 20, 2017

Disney Research scientists have found innovative ways to enhance virtual experiences involving interactions with physical objects by showing how a person using a virtual reality system can use it to reliably catch a real ...

New method enables more realistic hair simulation

April 24, 2017

When a person has a bad hair day, that's unfortunate. When a virtual character has bad hair, an entire animation video or film can look unrealistic. A new innovative method developed by Disney Research makes it possible to ...

Sony patent filing talks about glove interface object

February 29, 2016

Some patent filings make viewers scratch their heads and wonder if the inventions could possibly be viable, functional and commercially successful now or in a million years. A patent filing recently made public by the US ...

Recommended for you

Team breaks world record for fast, accurate AI training

November 7, 2018

Researchers at Hong Kong Baptist University (HKBU) have partnered with a team from Tencent Machine Learning to create a new technique for training artificial intelligence (AI) machines faster than ever before while maintaining ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.