Team uses smart light, shadows to track human posture

August 11, 2015

A Dartmouth College team has created the first light-sensing system that reconstructs human postures continuously and unobtrusively, furthering efforts to create smart spaces in which people control their environment with simple gestures.

The findings and a demonstration video will be presented Sept. 9 at MobiCom, the 21st annual International Conference on Mobile Computing and Networking.

Light plays many roles in our lives, from illumination to energy source, but advances in visible communication (VLC) add a new dimension to the list: . VLC encodes data into light intensity changes at a high frequency imperceptible to human eyes. Unlike conventional radio frequency systems that require complex signal processing, VLC uses energy efficient to transmit data inexpensively, securely, cleanly and with virtually unlimited bandwidth. Any devices equipped with can recover data by monitoring light changes.

"Here we are pushing the envelope further and ask: Can light turn into a ubiquitous sensing medium that tracks what we do and senses how we behave?" says senior author Xia Zhou, an assistant professor of computer science and co-director of the DartNets (Dartmouth Networking and Ubiquitous Systems) Lab.

Envision a smart space such as the home, office or gym that takes the advantage of the ubiquity of light as a medium that integrates data communication and human sensing. Smart devices such as smart glasses, smart watches and smartphones equipped with photodiodes communicate using VLC. More importantly, light also serves as a passive sensing medium. Users can continuously gesture and interact with appliances and objects in a room - for example, a wall-mounted display, computers, doors, windows, coffee machine—similar to using the Kinect or Wii in front of a TV. But there are no cameras (high-fidelity sensors with privacy concerns) monitoring users or any on-body devices or sensors that users have to constantly wear or carry, just LED lights on the ceiling and photodiodes on the floor. Compared to existing methods that use wireless radio signals such as Wi-Fi to track user gestures, light-based sensing does not introduce electromagnetic interferences and is not limited to classifying a pre-defined set of gestures and activities.

The video will load shortly

In their new study, the researchers developed a system called LiSense that uses VLC to reconstruct a human skeleton's movements in real time (60 Hz). They built the-first-of-its-kind light sensing testbed in the DartNets lab using off-the-shelf LED lights, photodiodes, and micro-controllers. LiSense uses shadows created by the human body from blocked light and reconstructs 3-D human skeleton postures in real time. The researchers overcame two key challenges to realize shadow-based human sensing. First, multiple lights on the ceiling lead to diminished and complex shadow patterns on the floor, so they designed light beacons enabled by VLC to separate light rays from different light sources and recover the shadow pattern cast by each individual light. Second, they designed an algorithm to reconstruct human postures using 2-D shadow information with a limited resolution collected by photodiodes embedded in the floor.

"Light is everywhere and we are making light very smart," Zhou says. "Imagine a future where light knows and responds to what we do. We can naturally interact with surrounding smart objects such as drones and smart appliances and play games, using purely the light around us. It can also enable a new, passive health and behavioral monitoring paradigm to foster healthy lifestyles or identify early symptoms of certain diseases. The possibilities are unlimited."

Explore further: Researchers test first 'smart spaces' using light to send data

Related Stories

Li-Fi: Edinburgh prof seeds LEDs for communication

October 6, 2012

(—"We believe wireless communications should be as reliable as lighting." That is a company motto of startup PureVLC (Visible Light Communication), which aims to connect the two—communications and light. They ...

Managing the “Internet of Things

May 29, 2015

Researchers in Hong Kong have developed a software platform designed to manage and control devices for "Internet of Things" (IoT) systems. The platform can be tailored for everything from city management sensors and devices ...

Recommended for you

Google, EU dig in for long war

July 20, 2017

Google and the EU are gearing up for a battle that could last years, with the Silicon Valley behemoth facing a relentless challenge to its ambition to expand beyond search results.

Strengthening 3-D printed parts for real-world use

July 20, 2017

From aerospace and defense to digital dentistry and medical devices, 3-D printed parts are used in a variety of industries. Currently, 3-D printed parts are very fragile and only used in the prototyping phase of materials ...

Swimming robot probes Fukushima reactor to find melted fuel

July 19, 2017

An underwater robot entered a badly damaged reactor at Japan's crippled Fukushima nuclear plant Wednesday, capturing images of the harsh impact of its meltdown, including key structures that were torn and knocked out of place.

Microsoft cloud to help Baidu self-driving car effort

July 19, 2017

Microsoft's cloud computing platform will be used outside China for collaboration by members of a self-driving car alliance formed by Chinese internet search giant Baidu, the companies announced on Tuesday.

Making lab equipment on the cheap

July 18, 2017

Laboratory equipment is one of the largest cost factors in neuroscience. However, many experiments can be performed with good results using self-assembled setups involving 3-D printed components and self-programmed electronics. ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.