Team develops faster, higher quality 3-D camera

April 24, 2015 by Amanda Morris, Northwestern University

When Microsoft released the Kinect for Xbox in November 2010, it transformed the video game industry. The most inexpensive 3-D camera to date, the Kinect bypassed the need for joysticks and controllers by sensing the user's gestures, leading to a feeling of total immersion into the game. Microsoft sold 8 million Kinect units within 60 days, making it the fastest-selling electronic device ever.

"But then something interesting happened," said Oliver Cossairt, assistant professor of electrical engineering and computer science at Northwestern University's McCormick School of Engineering. "Microsoft made the software available for the 3-D capture part of the device. People were able to integrate this inexpensive consumer device into a variety of platforms, including robotics and navigation."

But users quickly discovered the Kinect's limitations. It does not work outdoors, and it produces relatively low-quality images. Now, Cossairt's team has picked up where the Kinect left off and developed a 3-D capture camera that is inexpensive, produces high-quality images, and works in all environments—including outdoors.

Supported by the Office of Naval Research and the US Department of Energy, the research is described in the paper "MC3D: Motion Contrast 3D Scanning," presented on April 24 at the IEEE International Conference on Computational Photography. Nathan Matsuda, a graduate student in Cossairt's lab, is first author, and Mohit Gupta from Columbia University is co-author and collaborator.

Both first and second generation Kinect devices work by projecting light patterns that are then sensed and processed to estimate scene depth at each pixel on the sensor. Although these techniques work quickly, they are less precise than expensive single-point scanners, which use a laser to scan points across an entire scene or object. Cossairt's camera uses single-point scanning in a different way. Modeled after the human eye, it only scans parts of the scenes that have changed, making it much faster and higher quality.

"If you send the same signal to your eye over and over, the neurons will actually stop firing," Cossairt said. "The neurons only fire if there is a change in your visual stimulus. We realized this principle could be really useful for a 3-D scanning system."

Another problem that plagues the Kinect: it does not work well outside because the sunlight overpowers its projected light patterns. The laser on Cossairt's camera, however, can be sensed in the presence of the sun because it is much brighter than ambient light.

"In order for a 3-D camera to be useful, it has to be something you can use in everyday, normal environments," Cossairt said. "Outdoors is a part of that, and that's something the Kinect cannot do, but our Motion Contrast 3-D scanner can."

Cossairt believes his camera has many applications for devices in science and industry that rely on capturing the 3-D shapes of scenes "in the wild," such as in robotics, bioinformatics, augmented reality, and manufacturing automation. It could potentially also be used for navigation purposes, install on anything from a car to a motorized wheelchair. Cossairt's group received a Google Faculty Research Award to integrate their 3-D scanning technology onto an autonomous vehicle platform. Their scanner will provide high-quality 3-D scans in real time without only a fraction of the power of competing technologies.

Explore further: Microsoft to add Kinect Fusion to Kinect for Windows SDK

Related Stories

Microsoft to add Kinect Fusion to Kinect for Windows SDK

November 6, 2012

(—Senior Program Manager for Microsoft's Kinect for Windows, Chris White recently announced via a blog post that Kinect Fusion will soon be incorporated into the Kinect for Windows Software Development Kit (SDK). ...

Microsoft Kinect makes moves on computers

June 17, 2011

Microsoft on Thursday began letting software developers imbue computers with voice and motion-sensing technology from its Kinect controller for the Xbox 360 videogame console.

Consumer Reports: Kinect not 'racist'

November 5, 2010

(AP) -- Looking to debunk a report that Microsoft's new motion-sensing video game controller might be racist, Consumer Reports says it found no evidence that Kinect has problems recognizing users with darker skin.

Sales of Microsoft's Kinect top 10 million

March 9, 2011

Microsoft said Wednesday that sales of the gesture-sensing Kinect for the Xbox 360 videogame console had topped 10 million units, making it the fastest-selling consumer electronics device ever.

Recommended for you

What rising seas mean for local economies

February 15, 2019

Impacts from climate change are not always easy to see. But for many local businesses in coastal communities across the United States, the evidence is right outside their doors—or in their parking lots.

Where is the universe hiding its missing mass?

February 15, 2019

Astronomers have spent decades looking for something that sounds like it would be hard to miss: about a third of the "normal" matter in the Universe. New results from NASA's Chandra X-ray Observatory may have helped them ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.