Scientist creates 3-D scanner iPhone app (w/ video)

Apr 14, 2011
Grant Schindler, research scientist at Georgia Tech's College of Computing created Trimensional, an app that uses the iPhone 4, iPad 2 or most recent iPod Touch to take 3-D scans of faces or other objects. Photo: Rob Felt/Georgia Tech

(PhysOrg.com) -- Leave it to an iPhone app developer to turn a tool that cost hundreds of dollars a year ago into something that can be done with a 99-cent app. Grant Schindler, research scientist in Georgia Tech’s College of Computing, created Trimensional, the first app that allows users with an iPhone 4, iPad 2 or recent iPod Touch to take 3-D scans of faces or other objects and share them by e-mail. Now in the latest update, users can also e-mail animated videos of their 3-D models. For a few dollars more, artists and designers can even export their creation to CAD programs or 3-D applications, such as Maya.

Trimensional works by using the iPhone’s screen to shine four different lighting patterns on the subject while also using the device’s front-facing camera to snap photos. It produces a full 3-D model that you can zoom into, pan around and view from any angle.

“You can just have fun with it, or if you work with 3-D models, you can use it professionally,” said Schindler, a research scientist in Tech’s School of Interactive Computing in the College of Computing.

This video is not supported by your browser at this time.

The program uses a technique that was originally designed in the 1980s, but required an expensive set up of lights, a still model and a lot of time. But now, Trimensional has automated this process. The program works by taking every pixel and asking the same question using four different lighting conditions.

“If I take a scan of my face, the app asks ‘what does the image look like if I shine the light from the left side, what does it look like from the right side,’ and so on. There’s one three-dimensional answer per pixel, and combining all those answers results in the full 3-D model,” said Schindler.

In the first version of the app, which was released in January, users could send still images of their scans via e-mail. This update allows the app to stitch different views of a model together into a movie or an animated gif and e-mail.

How It Works

The new pro upgrade for Trimensional (available as an in-app purchase) will also send a file that you can use any 3-D program to open, so artists and other 3-D professionals or hobbyists can now use this $5 app to perform a task that used to require hundreds of dollars worth of equipment.

“There are professional, $40,000 3-D scanners out there; this won’t perform like those do, but for anything under $100, this is your best bet,” added Schindler.

Trimensional began as a program for a desktop computer in 2008, using the screen to light the subject.

“I thought surely someone had done this before, so I looked and no one had done it that way. It was amazing to really see it working,” he said.

3-D Scan

Later, Schindler entered it into the Georgia Tech Research & Innovation Conference. He didn’t win, but being in the conference put him in touch with Tech’s business incubator, the Advanced Technology Development Center. “ATDC provided invaluable advice that helped turn Trimensional from an idea into a real product,” said Schindler. When the 4 came out with the front-facing camera, he thought, it’s finally time to build an app.

In the future, he imagines people being able to do more with 3-D models.

“Once we get scanners in everyone’s hands, you should be able to use these images for any use you can think of, replicating physical objects by sending your scans to a 3-D printer, or creating a perfect digital substitute to take your video calls when you’re not looking your best,” said Schindler. “Or you could put it on your World of Warcraft character, or use it in other games.”

Schindler is now working on a version for the Android operating system. In addition, he’s developing a chess game he created into an app. Do we really need another chess game ? Yes, we do, because this one, called Evolutionary War, has evolving pieces.

Explore further: Researcher uses high-performance computing to design new materials

Related Stories

Blocked arteries? There's an App for that.

Jan 25, 2011

(PhysOrg.com) -- Researchers at The University of Western Ontario's Schulich School of Medicine & Dentistry have developed an iPhone web application (app) that shows patients at high risk of stroke, what their own arteries ...

iPhone quit-smoking apps not up to par

Feb 08, 2011

A new study finds that iPhone software applications designed to help people quit smoking fall short of the mark because they do not meet accepted standards.

Anatomy app for medical students on the move

Mar 17, 2011

Gone are the days when medical students had to share dusty, well-thumbed anatomy text books to swot up on diagrams and photographs of odd-looking pieces of lung or muscle tissue. Now, would-be doctors can ...

Recommended for you

Five ways the superintelligence revolution might happen

Sep 26, 2014

Biological brains are unlikely to be the final stage of intelligence. Machines already have superhuman strength, speed and stamina – and one day they will have superhuman intelligence. This is of course ...

Artificial intelligence that imitates children's learning

Sep 23, 2014

The computer programmes used in the field of artificial intelligence (AI) are highly specialised. They can for example fly airplanes, play chess or assemble cars in controlled industrial environments. However, a research ...

User comments : 9

Adjust slider to filter visible comments by rank

Display comments: newest first

Quantum_Conundrum
3 / 5 (4) Apr 14, 2011
It's actually pointless, because it won't be long before these devices will have 4 cameras instead of two:

2 binocular cameras looking at the user for 3-d video chat.
2 binocular cameras looking away for 3-d photography and filming.

The Cameras on these things cost a few cents each to make, so it won't be long...
wealthychef
5 / 5 (2) Apr 14, 2011
It's actually pointless, because it won't be long before these devices will have 4 cameras instead of two:.

It's not pointless -- right NOW you can use this guy's app. No phone that I know of has the camera system you mention. Right now. So "pointless" is a bit of hyperbole.
jselin
1 / 5 (1) Apr 14, 2011
QC- all you need is two cameras for zero degrees of freedom... somehow this guy has done it with one (which explains the poor quality)

You'd also need 4+ gigs of RAM and multiple cores at 2+Ghz on the phone to handle a scan of any useful size and resolution. I have a 32 gig 8 core machine that I run with my high end scanner and I've got my fingers crossed that future phones won't destroy my investment :(
_ilbud
5 / 5 (1) Apr 14, 2011
LG Optima 3D 2x5MP cameras recording 3d HD, put your rig on ebay while you still can.
CHollman82
1 / 5 (1) Apr 14, 2011
LG Optima 3D 2x5MP cameras recording 3d HD, put your rig on ebay while you still can.


3D video recording is not even close to 3D scanning...
maxcypher
not rated yet Apr 14, 2011
This guy will be "FU rich"!
CHollman82
1 / 5 (1) Apr 15, 2011
Wow that sounds stupid... Who even uses the snooze button? Why not just set your alarm for the time you absolutely have to get up?
DickWilhelm
1 / 5 (1) Apr 20, 2011
If anything he might just make the technology mainstream so enough demand will warrant better solutions to 3d capture/scan. I say good work, as it will be a while before you see 3d scanning on a handheld device.
sbugiardo
not rated yet Apr 21, 2011
Han Solo will be relieved.