Yoga accessible for the blind with new Microsoft Kinect-based program (w/ Video)

Oct 17, 2013 by Michelle Ma
An incorrect Warrior II yoga pose is outlined showing angles and measurements. Using geometry, the Kinect reads the angles and responds with a verbal command to raise the arms to the proper height. Credit: Kyle Rector, UW

In a typical yoga class, students watch an instructor to learn how to properly hold a position. But for people who are blind or can't see well, it can be frustrating to participate in these types of exercises.

Now, a team of University of Washington computer scientists has created a software program that watches a user's movements and gives spoken feedback on what to change to accurately complete a pose.

"My hope for this technology is for people who are blind or low-vision to be able to try it out, and help give a basic understanding of yoga in a more comfortable setting," said project lead Kyle Rector, a UW doctoral student in and engineering.

The program, called Eyes-Free Yoga, uses Microsoft Kinect software to track body movements and offer auditory feedback in real time for six yoga poses, including Warrior I and II, Tree and Chair poses. Rector and her collaborators published their methodology in the conference proceedings of the Association for Computing Machinery's SIGACCESS International Conference on Computers and Accessibility in Bellevue, Wash., Oct. 21-23.

Rector wrote programming code that instructs the Kinect to read a user's body angles, then gives verbal feedback on how to adjust his or her arms, legs, neck or back to complete the pose. For example, the program might say: "Rotate your shoulders left," or "Lean sideways toward your left."

This color-coded image shows the order of priority for correcting a person's alignment. Credit: Kyle Rector, UW

The result is an accessible yoga "exergame" – a video game used for exercise – that allows people without sight to interact verbally with a simulated yoga instructor. Rector and collaborators Julie Kientz, a UW assistant professor in Computer Science & Engineering and in Human Centered Design & Engineering, and Cynthia Bennett, a research assistant in computer science and engineering, believe this can transform a typically visual activity into something that blind people can also enjoy.

"I see this as a good way of helping people who may not know much about yoga to try something on their own and feel comfortable and confident doing it," Kientz said. "We hope this acts as a gateway to encouraging people with visual impairments to try exercise on a broader scale."

Each of the six poses has about 30 different commands for improvement based on a dozen rules deemed essential for each yoga position. Rector worked with a number of yoga instructors to put together the criteria for reaching the correct alignment in each pose. The Kinect first checks a person's core and suggests alignment changes, then moves to the head and neck area, and finally the arms and legs. It also gives positive feedback when a person is holding a pose correctly.

This video is not supported by your browser at this time.

Rector practiced a lot of yoga as she developed this technology. She tested and tweaked each aspect by deliberately making mistakes while performing the exercises. The result is a program that she believes is robust and useful for people who are blind.

"I tested it all on myself so I felt comfortable having someone else try it," she said.

Rector worked with 16 blind and low-vision people around Washington to test the program and get feedback. Several of the participants had never done yoga before, while others had tried it a few times or took yoga classes regularly. Thirteen of the 16 people said they would recommend the program and nearly everyone would use it again.

The technology uses simple geometry and the law of cosines to calculate angles created during yoga. For example, in some poses a bent leg must be at a 90-degree angle, while the arm spread must form a 160-degree angle. The Kinect reads the angle of the pose using cameras and skeletal-tracking technology, then tells the user how to move to reach the desired angle.

Rector opted to use Kinect software because it's open source and easily accessible on the market, but she said it does have some limitations in the level of detail with which it tracks movement.

Rector and collaborators plan to make this technology available online so users could download the program, plug in their Kinect and start doing yoga. The team also is pursuing other projects that help with fitness.

Explore further: Yoga in menopause may help insomnia, but not hot flashes

More information: dub.washington.edu/projects/eyes-free-yoga

Related Stories

Yoga in menopause may help insomnia, but not hot flashes

Sep 27, 2013

Taking a 12-week yoga class and practicing at home was linked to less insomnia—but not to fewer or less bothersome hot flashes or night sweats. The link between yoga and better sleep was the only statistically significant ...

NIH video reveals the science behind yoga

Aug 02, 2012

A video featuring research on how yoga works, the safety of yoga and whether yoga can help treat certain health problems is being released by the National Center for Complementary and Alternative Medicine (NCCAM), ...

Recommended for you

Jacket works like a mobile phone

Apr 23, 2014

A fire is raging in a large building and the fire leader is sending a message to all firefighters at the scene. But they don't need a mobile phone – they simply check their jacket sleeves and read the message ...

User comments : 0

More news stories

One in 13 US schoolkids takes psych meds

(HealthDay)—More than 7 percent of American schoolchildren are taking at least one medication for emotional or behavioral difficulties, a new government report shows.

FDA reconsiders behavior-modifying 'shock devices'

(HealthDay)—They're likened to a dog's "shock collar" by some and called a "life-saving treatment" by others. But the days of electro-shock devices as a tool for managing hard-to-control behavior in people ...

Computer program could help solve arson cases

Sifting through the chemical clues left behind by arson is delicate, time-consuming work, but University of Alberta researchers teaming with RCMP scientists in Canada, have found a way to speed the process.