Scientists invent robotic 'artist' that spray paints giant murals

April 7, 2016, Dartmouth College
Wojciech Jarosz, an assistant professor of computer science at Dartmouth College, and his collaborators invented a 'smart' paint spray can that robotically reproduces photographs as large-scale murals. Credit: Wojciech Jarosz

Robots do many things formerly done only by humans - from bartending and farming to driving cars - but a Dartmouth researcher and his colleagues have invented a "smart" paint spray can that robotically reproduces photographs as large-scale murals.

The computerized technique, which basically paints a photo, isn't likely to spawn a wave of giant graffiti, but it can be used in , digital and , artistic stylization and other applications.

The findings appear in the journal Computer & Graphics. The project was a collaboration between ETH Zurich, Disney Research Zurich, Dartmouth College and Columbia University.

The "smart" spray can system is a novel twist on computer-aided , which originated in the early 1960s and is a well-studied subject among scientists and artists. Spray paint is affordable and easy to use, making large-scale spray painted murals common in modern urban culture. But covering walls of buildings and other large surfaces can be logistically and technically difficult even for skilled artists.

The researchers wanted to create a way to help non-artists create accurate reproductions of photographs as large-scale murals using spray painting. So, they developed a computer-aided system that uses an ordinary paint spray can, tracks the can's position relative to the wall or canvas and recognizes what image it "wants" to paint. As the person waves the pre-programmed spray can around the canvas, the system automatically operates the spray on/off button to reproduce the specific image as a spray painting.

Credit: Dartmouth College

The prototype is fast and light-weight: it includes two webcams and QR-coded cubes for tracking, and a small actuation device for the spray can, attached via a 3D-printed mount. Paint commands are transmitted via radio directly connected to a servo-motor operating the spray nozzle. Running on a nearby computer, the real-time algorithm determines the optimal amount of paint of the current color to spray at the spray can's tracked location. The end result is that the painting reveals itself as the user waves the can around, without the user necessarily needing to know the image beforehand.

Due to difficulty getting permission to spray paint university buildings, the researchers tested the automated painting system on large sheets of paper assembled into mural-size paintings. Though the method currently only supports painting on flat surfaces, one potential benefit of the new technique over standard printing is that it may be usable on more complicated, curved painting surfaces.

"Typically, computationally-assisted painting methods are restricted to the computer," says co-author Wojciech Jarosz, an assistant professor of computer science at Dartmouth who previously was a senior research scientist at Disney Research Zurich. "In this research, we show that by combining computer graphics and computer vision techniques, we can bring such assistance technology to the physical world even for this very traditional painting medium, creating a somewhat unconventional form of digital fabrication. Our assistive approach is like a modern take on 'paint by numbers' for spray painting. Most importantly, we wanted to maintain the aesthetic aspects of physical spray painting and the tactile experience of holding and waving a physical spray can while enabling unskilled users to create a physical piece of art."

Explore further: Scientists develop pioneering new spray-on solar cells

More information: — Romain Prévost et al. Large-scale painting of photographs by interactive optimization, Computers & Graphics (2016). DOI: 10.1016/j.cag.2015.11.001 … /prevost16large.html

Related Stories

Scientists develop pioneering new spray-on solar cells

August 1, 2014

( —A team of scientists at the University of Sheffield are the first to fabricate perovskite solar cells using a spray-painting process – a discovery that could help cut the cost of solar electricity.

Painting in virtual reality, no trial-and-error

February 19, 2014

Almost any product made of plastic, metal or wood is painted or coated. But colour doesn't come cheap. The biggest polluter in a factory is the painting and surface treatment processes. By painting in virtual reality you ...

Recommended for you

Understanding dynamic stall at high speeds

December 18, 2018

When a bird in flight lands, it performs a rapid pitch-up maneuver during the perching process to keep from overshooting the branch or telephone wire. In aerodynamics, that action produces a complex phenomenon known as dynamic ...

Pushing lithium ion batteries to the next performance level

December 13, 2018

Conventional lithium ion batteries, such as those widely used in smartphones and notebooks, have reached performance limits. Materials chemist Freddy Kleitz from the Faculty of Chemistry of the University of Vienna and international ...

Uber filed paperwork for IPO: report

December 8, 2018

Ride-share company Uber quietly filed paperwork this week for its initial public offering, the Wall Street Journal reported late Friday.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Apr 11, 2016
This robotic artist is a step backwards. The image quality is sad, changing colors is tedious and you still have to have a person direct the mechanism. There is a patented mural painting machine that can reproduce any image, hundreds of square feet in size, with well over a million colors, 1 pass, run by computer and nobody has to be on the side of the building. A perfect duplicate of the 'firemen at ground zero' was painted as a mural on a building in Seattle, just after 9/11. I know, I did it with this machine. For more info contact

Monday, April 11, 2016
11:25 AM

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.