Building an indoor 3-D map on the spot, via smartphone

March 21, 2014

The view from the basement laboratory is breathtaking. Not the one out the tiny windows of the half-underground office. It's on a smartphone that computer science Prof. Stergios Roumeliotis is using while walking around the depths of the University of Minnesota's Walter Library.

On the screen, a three-dimensional map of a nearby hallway has taken shape. The map was made by holding the smartphone's camera while moving. The camera and the phone's motion sensor worked together to create a grid of data points that became a 3-D image.

It's a radical new ability for smartphones and promises to enable consumers to create 3-D maps on the fly. The development is being handled by UM grad students who are funded by $1.35 million grant from Google Inc. The work is part of the company's recently announced Project Tango, a cellphone optimized for 3-D mapping.

"We will soon be able to get smartphone directions for how to go from one place to another in a building, such as how to go from the entrance to my classroom," Roumeliotis said. "We'll also be able to ask the phone questions, such as, 'Where is the closest place within the airport where I can get coffee?' "

In addition, homeowners could use the software to create a virtual tour of their houses before putting them up for sale, Roumeliotis said. The software could also help the blind walk through a building or aid a drone aircraft in navigating.

While the software is being designed to work on a prototype of the new Google smartphone, it will also work on existing smartphones. Notably, it doesn't use much processing power, about as much as the game "Angry Birds," Roumeliotis said.

"I think this is as big a revolution as when Google Maps first came out or even bigger," said the professor, who is 43 and has been working on map technology since 1995. "It has the potential to become the Google Maps of the indoor world, and this is where we spend most of our time."

Scott Strawn, senior Google analyst for Massachusetts research firm IDC, said Roumeliotis may be right about the significance of 3-D mapping.

Besides its use on smartphones, the University of Minnesota software is likely to play a major role in 3-D imaging for Google Glass, the company's wearable computer that has a tiny display above the right eye, Strawn said.

For Glass, the software could create much better 3-D "augmented reality," a name used today for overlaying a camera image with explanatory information.

One of the key features of the University of Minnesota software is that it creates a map almost instantly without slowing down the phone's other operations or drawing much battery power, Roumeliotis said.

To do that, the University of Minnesota team had to try some novel design ideas.

For example, unlike most smartphone maps, the new software doesn't rely on global positioning system data because satellite signals aren't typically available inside buildings. It also does more with less by combining data from the phone's built-in motion sensor with just a fraction of the images produced by the phone's camera.

"We pick which information to process," Roumeliotis said. "That way we don't choke the phone's processor chip or drain the battery."

The technology is built on some of the university's earlier work with NASA to create navigational software for Mars landing vehicles, Roumeliotis said.

His group got involved in Google's Project Tango after one of his former students went to work at the company and recommended the U researchers. The university signed a contract with Google last spring.

Roumeliotis said the software that his group is developing for Google "will be ready within less than a year."

But Strawn thinks Google won't offer the University of Minnesota software as mainstream product for several years. That would give app developers time to come up with 3-D applications that can take advantage of the technique.

"It will be introduced in the same way that Google released Glass, years before it anticipated the product would be broadly distributed," Strawn said.

It's not unusual for Google to reach out to universities for help in creating new technology, Strawn said.

"There's a lot of valuable brainpower in the university system, and that's what Google needs to move these projects forward," he said.

"We're on the frontier of this kind of mapping," Roumeliotis said. "You could map the inside of the Mall of America today using a computing center with a lot of processing power and a lot of time. Our plan is to do that on a cellphone in almost real time, with the time lag getting smaller and smaller."

Explore further: Google unveils 'Project Tango' 3D smartphone platform

Related Stories

Review: Windows OS hobbles Nokia's impressive Lumia Icon

March 12, 2014

Nokia's new Lumia Icon smartphone offers a lot of compelling features. But they don't make up for the fact that the device runs Windows Phone software, which has proved unpopular with both consumers and developers.

HTC phone users to power up scientific research

February 25, 2014

HTC announced at Mobile World Congress on Monday its new Power To Give project, which aims to donate processor power to scientific research. Planning on bringing together the power of millions of smartphones, the Android ...

Recommended for you

Cryptocurrency rivals snap at Bitcoin's heels

January 14, 2018

Bitcoin may be the most famous cryptocurrency but, despite a dizzying rise, it's not the most lucrative one and far from alone in a universe that counts 1,400 rivals, and counting.

Top takeaways from Consumers Electronics Show

January 13, 2018

The 2018 Consumer Electronics Show, which concluded Friday in Las Vegas, drew some 4,000 exhibitors from dozens of countries and more than 170,000 attendees, showcased some of the latest from the technology world.

Finnish firm detects new Intel security flaw

January 12, 2018

A new security flaw has been found in Intel hardware which could enable hackers to access corporate laptops remotely, Finnish cybersecurity specialist F-Secure said on Friday.


Adjust slider to filter visible comments by rank

Display comments: newest first

2 / 5 (1) Mar 21, 2014
Dogs can sniff out an object even when hidden; If a Cell phone can do that, WoW!
Mobile should give tag nos to each and every object brought into its view....Then it should be able to locate it even if moved around.
A few years back there was constant news about fragrance creation using laptop. If the same technology can be used in some weird way to locate things in the house....Beep Beep Beep!
not rated yet Mar 24, 2014
Mapping without GPS or other dependencies.
Fantastic for a lot of scenario's.
Including making maps from environments to put in video games and simulations.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.