2-D photos spring to 3-D life

June 16, 2011 By Rob Knies

You’re interested in purchasing a car you’ve seen on the web. It’s the right make, model and vintage. It seems to be in great shape, and it’s just the right color. The price seems reasonable. So what’s the problem?

The problem, of course, is what’s on the side away from the camera. Is it just as pristine, or is it a mess of door dings with an unmatched fender?

The solution is simple. Spin the image around on your PC screen and take a look.

Sound impossible? That’s because you haven’t seen the D.C. TechFair 2011 demo 3-D Scanning with a Regular Camera. Demonstrated today by Sudipta Sinha, a researcher who helped devise the project with his Interactive Visual Media colleagues Johannes Kopf, Rick Szeliski, Eric Stollnitz, and Matt Uyttendaele at Microsoft Research Redmond, the research project enables the creation of a 3-D image from a modest collection of ordinary photographs, the kind commonly acquired these days by anybody with a point-and-shoot camera or a mobile phone.

The video will load shortly

“Suppose you see something interesting and you want to capture different views of an object from different angles,” Sinha says. “You take these pictures from different viewpoints, send them to our system, and it automatically figures out a 3-D model by measuring the 3-D depth behind the pixels in the images. Once you have that, you can interactively, seamlessly change the view from one camera location to another, and this allows the object to be viewed interactively in 3-D.”

Once you have that, your prospective car seller can mark this one sold.

Sinha shows just such a demo, constructed from a mere 48 photos. Some people click off that many in minutes. The get transferred to a PC and uploaded to the cloud. A processing pipeline then matches similar images and learns how the moved in 3-D, enabling the creation of a depth map, not dissimilar from the depth data provided by the Kinect for Xbox 360 sensor.

The depth data gets stored, in a compact format, and is then viewable on virtually any screen you prefer: phone, laptop, desktop—you name it. Standard computer-graphics technology enables the viewing. It could even run inside a browser as a Silverlight app.

The potential for such technology seems endless. Yes, e-commerce and retail scenarios seem immediately obvious, but uses in tourism or education aren’t far behind.

As Sinha says, “This is an enabling technology that makes lots of applications possible.”

Admit it: You want this already, don’t you?

Explore further: A 360 degree camera that sees in 3D (w/ Video)

Related Stories

A 360 degree camera that sees in 3D (w/ Video)

December 1, 2010

Surround sight has come to the camera. Inspired by the eye of a fly, EPFL scientists have invented a camera that can take pictures and film in 360° and reconstruct the images in 3D.

Scientist creates 3-D scanner iPhone app (w/ video)

April 14, 2011

(PhysOrg.com) -- Leave it to an iPhone app developer to turn a tool that cost hundreds of dollars a year ago into something that can be done with a 99-cent app. Grant Schindler, research scientist in Georgia Tech’s College ...

One year of the moon in 2.5 minutes

June 15, 2011

We don’t always have the time or ability to see the Moon every night of the year, but this video, from the Goddard Space Flight Center Scientific Visualization Studio, uses data from the Lunar Reconnaissance Orbiter ...

Recommended for you

Search engines will know what you want ... sooner

February 8, 2016

If you enter "Oklahoma" in a search engine, you might get a travelogue, news about the oil industry, Oklahoma State football scores or an article on Rodgers and Hammerstein musicals. What appears at the top of the list might ...

Researchers find vulnerability in two-factor authentication

February 3, 2016

Two-factor authentication is a computer security measure used by major online service providers to protect the identify of users in the event of a password loss. The process is familiar: When a password is forgotten, the ...

Battery technology could charge up water desalination

February 4, 2016

The technology that charges batteries for electronic devices could provide fresh water from salty seas, says a new study by University of Illinois engineers. Electricity running through a salt water-filled battery draws the ...

EU and US reach new data-sharing agreement

February 2, 2016

The European Union and the United States struck a deal Tuesday over data-sharing that will allow the likes of Facebook and Apple to continue sending people's information across the Atlantic—but a legal challenge to the ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.