Researchers invent system for 3-D reconstruction of sparse facial hair and skin

Aug 10, 2012
Coupled 3D reconstruction of sparse facial hair and skin applied to various different facial hairstyles. Image: Disney Research

Researchers at Disney Research, Zürich, ETH Zürich, and Cornell University have invented a system to digitize facial hair and skin. Capturing facial skin and geometry is a fundamental technology for a variety of computer-based special effects for movies. Conventional face capturing is well established and widely utilized in the entertainment industry to capture a three-dimensional model of an actor's face. However, up to now, no method was capable of reconstructing facial hair or even handling it appropriately. This omission is surprising as facial hair is an important component of our popular culture.

The system developed by the Disney Research Laboratory in Zürich constitutes a significant technical breakthrough in the field of digitizing human faces and was presented at ACM SIGGRAPH, the International Conference on Computer Graphics and Interactive Techniques. "Our method captures individual strands of facial hair and stores them separately from the actual human face. This approach allows us to 'shave' people with facial hair virtually with the computer." said Thabo Beeler, a computer scientist at Disney Research, Zürich, who is the main inventor of the technology.

The system employs several consumer-grade photo cameras to capture a face in a fraction of a second. The method then automatically detects hairs in the captured images. These hairs are being tracked and followed in the input images, much like we follow a path on a map with our fingers. A mathematical method called multi-view stereo (MVS) reconstructs them in three dimensions. The trick the researchers applied is to remove the hair strands from the input images similar to an artist painting over parts of a picture. This process makes the 3D skin surface to look as if it were digitally shaved. The system was applied to a large variety of different facial hair styles, ranging from designer stubbles all the way to wild mustaches, to demonstrate its robustness. The produced results look very compelling.

Prof. Markus Gross, director of Disney Research, Zürich, stated, "The long-term goal of our research is to make facial animation and special effects more realistic and ultimately indistinguishable from reality. This method is going to be a very important step toward this long term goal".

Explore further: Computer software accurately predicts student test performance

More information: For more information, please visit the web site at www.disneyresearch.com/research/projects/cv_reconFacialHair_drz.htm

add to favorites email to friend print save as pdf

Related Stories

A new window to the face

Aug 09, 2011

The human face is a complicated thing—powered by 52 muscles; contoured by the nose, eyebrows, and other features; and capable of an almost infinite range of expressions, from joy to anger to sorrow to ...

Improving security with face recognition technology

Nov 10, 2009

A number of U.S. states now use facial recognition technology when issuing drivers licenses. Similar methods are also used to grant access to buildings and to verify the identities of international travelers. ...

Recommended for you

'Chief Yahoo' David Filo returns to board

27 minutes ago

Yahoo announced the nomination of three new board members, including company co-founder David Filo, who earned the nickname and formal job title of "Chief Yahoo."

Fired Yahoo exec gets $58M for 15 months of work

37 minutes ago

Yahoo's recently fired chief operating officer, Henrique de Castro, left the Internet company with a severance package of $58 million even though he lasted just 15 months on the job.

Simplicity is key to co-operative robots

8 hours ago

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Freight train industry to miss safety deadline

9 hours ago

The U.S. freight railroad industry says only one-fifth of its track will be equipped with mandatory safety technology to prevent most collisions and derailments by the deadline set by Congress.

User comments : 0

More news stories

Simplicity is key to co-operative robots

A way of making hundreds—or even thousands—of tiny robots cluster to carry out tasks without using any memory or processing power has been developed by engineers at the University of Sheffield, UK.

Microsoft CEO is driving data-culture mindset

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

Floating nuclear plants could ride out tsunamis

When an earthquake and tsunami struck the Fukushima Daiichi nuclear plant complex in 2011, neither the quake nor the inundation caused the ensuing contamination. Rather, it was the aftereffects—specifically, ...

New clinical trial launched for advance lung cancer

Cancer Research UK is partnering with pharmaceutical companies AstraZeneca and Pfizer to create a pioneering clinical trial for patients with advanced lung cancer – marking a new era of research into personalised medicines ...

More vets turn to prosthetics to help legless pets

A 9-month-old boxer pup named Duncan barreled down a beach in Oregon, running full tilt on soft sand into YouTube history and showing more than 4 million viewers that he can revel in a good romp despite lacking ...