Rebuilding the world one pixel at a time

January 10, 2011 By Miles O' Brien and Jon Baime
A rendering of a 3-D model of the Duomo in Pisa, reconstructed from 56 photographs downloaded from the Internet photo-sharing site Flickr. Images found on these public photo-sharing sites can now be used to help build accurate 3-D models of the real world. Credit: Michael Goesele, TU Darmstadt and collaborators at the University of Washington

Who says Rome wasn't built in a day? With the muscle of about 500 computers and 150,000 still images, Steve Seitz, a professor in the Department of Computer Science and Engineering at the University of Washington's Seattle campus, and his colleagues have reconstructed many of Rome's famous landmarks in just 21 hours.

"The idea behind "Rome in a Day"' is that we wanted to see how big of a city or model we could build from photos on the internet," says Steve Seitz from the university's and imaging laboratory. With support from the National Science Foundation (NSF), they're rebuilding Rome by pixel rather than brick by brick.

Calculations that once took months now take hours. "This is the largest 3-D reconstruction that anyone has ever tried," explains Seitz. "It's completely organic; it works just from any image set."

The project starts with a trip to the photo-sharing site Flickr to search for images of the real thing. Once pictures are identified, the computer starts the process of making 3-D objects from 2-D stills. Sameer Agarwal, a former postdoctoral scholar, at the university is mostly responsible for creating the that makes 3-D objects in from thousands of 2-D images.

"If I am a sculpture and there were three photographs of me, we would try to find three points in each that point to my nose. From that we know that there are three points in these images that correspond to a single point in the 3-D world," explains Agarwal. "We would be able to say where in a particular image corresponding to that camera, the image of my nose should show up. This statement can be written as an equation involving the position and orientation of the camera, the position of my nose and where in the image my nose shows up. And you can connect all of these equations together and solve them to, in one shot, obtain both the positions of the cameras as well as the position of my nose in the 3-D world relative to those cameras."

Computers map huge clusters of points in 3-D space creating ghost-like images called "Point Clouds."

Seitz says the imaging is very accurate. "For the buildings, I think we can get accuracy to within a few centimeters. We've measured this. For individual objects that are photographed closer, we can potentially do a lot better, like millimeter accuracy."

Finally, color and texture are added. What Seitz and his colleagues have gotten are virtual 3-D tours of cities like Dubrovnik, Croatia or Venice, Italy.

"What excites me is the ability to capture the real world; to be able to reconstruct the experience of being somewhere without actually being there," says Seitz.

In the future this "next generation" technology may show up in places online like mapping sites, video games or real estate sites--it's a virtual guarantee.

Explore further: Rome was built in a day, with hundreds of thousands of digital photos

Related Stories

A 360 degree camera that sees in 3D (w/ Video)

December 1, 2010

Surround sight has come to the camera. Inspired by the eye of a fly, EPFL scientists have invented a camera that can take pictures and film in 360° and reconstruct the images in 3D.

New technology could make TV more exciting

February 2, 2005

Live TV outside broadcasts that combine real action and computer-generated images could become possible for the first time, thanks to camera navigation technology now under development. The work is opening up the prospect ...

Recommended for you

Volvo to supply Uber with self-driving cars (Update)

November 20, 2017

Swedish carmaker Volvo Cars said Monday it has signed an agreement to supply "tens of thousands" of self-driving cars to Uber, as the ride-sharing company battles a number of different controversies.


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Jan 10, 2011
Sim city...
not rated yet Jan 10, 2011
It won't be long until Google Earth 3D is launched
not rated yet Jan 11, 2011
i'm sure this is just the up front, public release of a system that the military uses to look thru Kim Jong il's bathroom window.
not rated yet Jan 11, 2011
Next Grand Theft Auto in a true to life recreated city? That would be something to learn a real city through a game.

I vote for Chechnya Russia or Ciudad Jaurez, Mexico. Either one would make New York, Miami or Los Angeles look like an organized crime holiday.
not rated yet Jan 13, 2011
Combine this with Microsoft Image Composite Editor and Multi-Image Fusion and you could have something unbelieveable ...

goto to youtube and type in the keywords Multi-Image Fusion and watch the video

now combine that concept with lets say Google Earth + every picture on the internet that has a shot of landscape -- I'm talking google's image archive + a full web crawl of facebook and flikr and think of what you could create.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.