Low-power chip processes 3-D camera data, could enable wearable device to guide the visually impaired

February 3, 2016 by Larry Hardesty
A new device lets visually impaired users carry a mechanical Braille interface developed at MIT’s Computer Science and Artificial Intelligence Laboratory, which conveys information about the distance to the nearest obstacle in the direction the user is moving.

MIT researchers have developed a low-power chip for processing 3-D camera data that could help visually impaired people navigate their environments. The chip consumes only one-thousandth as much power as a conventional computer processor executing the same algorithms.

Using their chip, the researchers also built a prototype of a complete for the visually impaired. About the size of a binoculars case and similarly worn around the neck, the system uses an experimental 3-D camera from Texas Instruments. The user carries a mechanical Braille interface developed at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), which conveys information about the distance to the nearest obstacle in the direction the user is moving.

The researchers reported the new chip and the prototype navigation system in a paper presented earlier this week at the International Solid-State Circuits Conference in San Francisco.

"There was some prior work on this type of system, but the problem was that the systems were too bulky, because they require tons of different processing," says Dongsuk Jeon, a postdoc at MIT's Microsystems Research Laboratories (MTL) when the work was done who joined the faculty of Seoul National University in South Korea this year. "We wanted to miniaturize this system and realized that it is critical to make a very that saves power but still provides enough computational power."

Jeon is the first author on the new paper, and he's joined by Anantha Chandrakasan, the Vannevar Bush Professor of and computer science; Daniela Rus, the Andrew and Erna Viterbi professor of electrical engineering and computer science; Priyanka Raina, a graduate student in electrical engineering and ; Nathan Ickes, a former research scientist at MTL who's now at Apple Computer; and Hsueh-Cheng Wang, a postdoc at CSAIL when the work was done who will join the National Chiao Tung University in Taiwan as an assistant professor this month.

In work sponsored by the Andrea Bocelli Foundation, which was founded by the blind singer Andrea Bocelli, Rus' group had developed an for converting 3-D camera data into useful navigation aids. The output of any 3-D camera can be converted into a 3-D representation called a "point cloud," which depicts the spatial locations of individual points on the surfaces of objects. The Rus group's algorithm clustered points together to identify flat surfaces in the scene, then measured the unobstructed walking distance in multiple directions.

For the new paper, the researchers modified this algorithm, with power conservation in mind. The standard way to identify planes in point clouds, for instance, is to pick a point at random, then look at its immediate neighbors, and determine whether any of them lie in the same plane. If one of them does, the algorithm looks at its neighbors, determining whether any of them lie in the same plane, and so on, gradually expanding the surface.

This is computationally efficient, but it requires frequent requests to a chip's main memory bank. Because the algorithm doesn't know in advance which direction it will move through the point cloud, it can't reliably preload the data it will need into its small working-memory bank.

Fetching data from main memory, however, is the biggest energy drain in today's chips, so the MIT researchers modified the standard algorithm. Their algorithm always begins in the upper left-hand corner of the point cloud and scans along the top row, comparing each point only to the neighbor on its left. Then it starts at the leftmost point in the next row down, comparing each point only to the neighbor on its left and to the one directly above it, and repeats this process until it has examined all the points. This enables the chip to load as many rows as will fit into its working memory, without having to go back to .

This and similar tricks drastically reduced the chip's power consumption. But the data-processing chip isn't the component of the navigation system that consumes the most energy; the 3-D camera is. So the chip also includes a circuit that quickly and coarsely compares each new frame of data captured by the camera with the one that immediately preceded it. If little changes over successive frames, that's a good indication that the user is still; the chip sends a signal to the camera, which can lower its frame rate, saving power.

Although the prototype navigation system is less obtrusive than its predecessors, it should be possible to miniaturize it even further. Currently, one of its biggest components is a heat dissipation device atop a second chip that converts the camera's output into a point cloud. Adding the conversion algorithm to the data-processing should have a negligible effect on its power consumption but would significantly reduce the size of the system's electronics.

Explore further: Optoelectronic microprocessors built using existing chip manufacturing

Related Stories

Algorithm helps turn smartphones into 3-D scanners

December 22, 2015

While 3-D printers have become relatively cheap and available, 3-D scanners have lagged well behind. But now, an algorithm developed by Brown University researchers my help bring high-quality 3-D scanning capability to off-the-shelf ...

Recommended for you

Dutch unveil giant vacuum to clean outside air

October 25, 2016

Dutch inventors Tuesday unveiled what they called the world's first giant outside air vacuum cleaner—a large purifying system intended to filter out toxic tiny particles from the atmosphere surrounding the machine.

3-D-printed organ-on-a-chip with integrated sensors

October 24, 2016

Harvard University researchers have made the first entirely 3D-printed organ-on-a-chip with integrated sensing. Built by a fully automated, digital manufacturing procedure, the 3D-printed heart-on-a-chip can be quickly fabricated ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.