Disney researchers create computer models that capture style and process of portrait artists

Jul 19, 2013

By monitoring artists as they sketch human faces, stroke by stroke, scientists at Disney Research, Pittsburgh, have built computer models that learn each artist's drawing style, how they use strokes and how they select features to highlight as they interpret a face into a portrait.

A better understanding of this abstraction process, the researchers stated, not only is interesting from an artistic point of view, but also can help in developing artificial drawing tools.

"There's something about an artist's interpretation of a subject that people find compelling," said Moshe Mahler, a digital artist at Disney Research, Pittsburgh. "We're trying to capture that – to create a of it – in a way that no one has done before."

Mahler, along with Itamar Berger and Ariel Shamir of the Interdisciplinary Center Herzliya, Israel, will present the findings at ACM SIGGRAPH 2013, the International Conference on Computer Graphics and Interactive Techniques, July 21-25 in Anaheim, Calif. Jessica Hodgins, Vice President of Disney Research, and Elizabeth Carter, a Disney Research, Pittsburgh associate, also were part of the research team.

Other computer programs can create line drawings from photos and some can mimic certain stroke styles. The Disney Research, Pittsburgh approach, by contrast, is built on a database representing abstractions of a set of artists.

To create the database, the researchers recruited seven artists. Each sketched portraits based on 24 photographs of male and female faces using a stylus pen that enabled the researchers to record each stroke. The artists created four sketches of each photo, with decreasing time intervals allowed for each – 270, 90, 30 and 15 seconds. The result was a dataset of 672 sketches at four abstraction levels.

The dataset contains about 8,000 strokes for each artist, with each stroke categorized as shading strokes or contour strokes, with contour strokes subdivided into complex and simple strokes.

"Watching these strokes accumulate was an interesting part of this project," Berger said. Some artists started with the eyes, others with the outlines of the face. One of the artists had no discernible pattern, starting "wherever."

The analysis did not only focus on strokes style but also on the geometric interpretation of the face by the artist and how it is conveyed in the drawing. For instance, one artist consistently spaced eyes closer together in the sketches than they appear in reality, while another tended to draw wide jaws. Identifying these tendencies may help artists correct bad habits, Shamir said, though in other cases these variations may simply be recognized as artistic tendencies or style.

The researchers also used their system to synthesize sketches based on new face photos. In a perceptual study, test subjects were then asked to match sketches based on style, to match synthesized sketches with those of the actual artist and to try to identify which sketches were real and which were synthesized. The results demonstrated that the sketch generation method produced multiple, distinct styles that are similar to hand-drawn sketches.

What the program can't do, Mahler emphasized, is replicate the spontaneity of an artist and their ability to balance the drawing as they work. "Our approach only understands the trends of how an artist might work," he added. And, because all of the based their work on photos, even the hand-drawn sketches were more constrained and reflected less personality than would have been the case if based on living, breathing subjects.

Future work could extend these techniques to subjects beyond faces or people, to other drawing techniques and might also include time-based animation, Shamir said.

Explore further: Calculating art: Meet e-David, the painting machine (w/ Video)

add to favorites email to friend print save as pdf

Related Stories

Method developed to match police sketch, mug shot

Mar 03, 2011

(PhysOrg.com) -- The long-time practice of using police facial sketches to nab criminals has been, at best, an inexact art. But the process may soon be a little more exact thanks to the work of some Michigan ...

Computer program can identify sketches

Sep 13, 2012

(Phys.org)—Computers are good at speed, numbers, and massive amounts of data, but understanding the content of a simple drawing is more difficult. Researchers at Brown and the Technical University of Berlin ...

Why police sketches sometimes don't work

May 11, 2011

When they were investigating the series of attacks on women in Philadelphia's Kensington neighborhood, police stopped dozens of black or Latino men who were thought to resemble a face in a forensic sketch. The image of a ...

Recommended for you

User comments : 0

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...