Yoga accessible for the blind with new Microsoft Kinect-based program (w/ Video)

Oct 17, 2013 by Michelle Ma
An incorrect Warrior II yoga pose is outlined showing angles and measurements. Using geometry, the Kinect reads the angles and responds with a verbal command to raise the arms to the proper height. Credit: Kyle Rector, UW

In a typical yoga class, students watch an instructor to learn how to properly hold a position. But for people who are blind or can't see well, it can be frustrating to participate in these types of exercises.

Now, a team of University of Washington computer scientists has created a software program that watches a user's movements and gives spoken feedback on what to change to accurately complete a pose.

"My hope for this technology is for people who are blind or low-vision to be able to try it out, and help give a basic understanding of yoga in a more comfortable setting," said project lead Kyle Rector, a UW doctoral student in and engineering.

The program, called Eyes-Free Yoga, uses Microsoft Kinect software to track body movements and offer auditory feedback in real time for six yoga poses, including Warrior I and II, Tree and Chair poses. Rector and her collaborators published their methodology in the conference proceedings of the Association for Computing Machinery's SIGACCESS International Conference on Computers and Accessibility in Bellevue, Wash., Oct. 21-23.

Rector wrote programming code that instructs the Kinect to read a user's body angles, then gives verbal feedback on how to adjust his or her arms, legs, neck or back to complete the pose. For example, the program might say: "Rotate your shoulders left," or "Lean sideways toward your left."

This color-coded image shows the order of priority for correcting a person's alignment. Credit: Kyle Rector, UW

The result is an accessible yoga "exergame" – a video game used for exercise – that allows people without sight to interact verbally with a simulated yoga instructor. Rector and collaborators Julie Kientz, a UW assistant professor in Computer Science & Engineering and in Human Centered Design & Engineering, and Cynthia Bennett, a research assistant in computer science and engineering, believe this can transform a typically visual activity into something that blind people can also enjoy.

"I see this as a good way of helping people who may not know much about yoga to try something on their own and feel comfortable and confident doing it," Kientz said. "We hope this acts as a gateway to encouraging people with visual impairments to try exercise on a broader scale."

Each of the six poses has about 30 different commands for improvement based on a dozen rules deemed essential for each yoga position. Rector worked with a number of yoga instructors to put together the criteria for reaching the correct alignment in each pose. The Kinect first checks a person's core and suggests alignment changes, then moves to the head and neck area, and finally the arms and legs. It also gives positive feedback when a person is holding a pose correctly.

This video is not supported by your browser at this time.

Rector practiced a lot of yoga as she developed this technology. She tested and tweaked each aspect by deliberately making mistakes while performing the exercises. The result is a program that she believes is robust and useful for people who are blind.

"I tested it all on myself so I felt comfortable having someone else try it," she said.

Rector worked with 16 blind and low-vision people around Washington to test the program and get feedback. Several of the participants had never done yoga before, while others had tried it a few times or took yoga classes regularly. Thirteen of the 16 people said they would recommend the program and nearly everyone would use it again.

The technology uses simple geometry and the law of cosines to calculate angles created during yoga. For example, in some poses a bent leg must be at a 90-degree angle, while the arm spread must form a 160-degree angle. The Kinect reads the angle of the pose using cameras and skeletal-tracking technology, then tells the user how to move to reach the desired angle.

Rector opted to use Kinect software because it's open source and easily accessible on the market, but she said it does have some limitations in the level of detail with which it tracks movement.

Rector and collaborators plan to make this technology available online so users could download the program, plug in their Kinect and start doing yoga. The team also is pursuing other projects that help with fitness.

Explore further: Cadillac CT6 will get streaming video mirror

More information: dub.washington.edu/projects/eyes-free-yoga

Related Stories

Yoga in menopause may help insomnia, but not hot flashes

Sep 27, 2013

Taking a 12-week yoga class and practicing at home was linked to less insomnia—but not to fewer or less bothersome hot flashes or night sweats. The link between yoga and better sleep was the only statistically significant ...

NIH video reveals the science behind yoga

Aug 02, 2012

A video featuring research on how yoga works, the safety of yoga and whether yoga can help treat certain health problems is being released by the National Center for Complementary and Alternative Medicine (NCCAM), ...

Recommended for you

Cyclist's helmet, Volvo car to communicate for safety

9 hours ago

Volvo calls it "a wearable life-saving wearable cycling tech concept." The car maker is referring to a connected car and helmet prototype that enables two-way communication between Volvo drivers and cyclists ...

California puzzles over safety of driverless cars

9 hours ago

California's Department of Motor Vehicles will miss a year-end deadline to adopt new rules for cars of the future because regulators first have to figure out how they'll know whether "driverless" vehicles ...

Cadillac CT6 will get streaming video mirror

Dec 20, 2014

Cadillac said Thursday it will add high resolution streaming video to the function of a rearview mirror, so that the driver's vision and safety can be enhanced. The technology will debut on the 2016 Cadillac ...

Poll: Americans skeptical of commercial drones (Update)

Dec 19, 2014

Americans broadly back tight regulations on commercial drone operators, according to a new Associated Press-GfK poll, as concerns about privacy and safety override the potential benefits of the heralded drone ...

Cheaper, more powerful VR system for engineers

Dec 17, 2014

It's like a scene from a gamer's wildest dreams: 12 high-definition, 55-inch 3D televisions all connected to a computer capable of supporting high-end, graphics-intensive gaming.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.