Research uses muscle activity to move virtual objects (w/ video)

March 27, 2013 by Marianne English, University of Wisconsin-Madison

( —Today's smartphones and computers offer gestural interfaces where information arrives at users' fingertips with a swipe of a hand. Still, researchers have found that most technology falls short in making people feel as if they're interacting with virtual objects the same way they would with real objects.

But a team at UW-Madison says it has developed, for the first time, a way to move in an immersive virtual reality environment through the use of . In addition to making virtual reality more interactive and realistic, the research could have rehabilitation applications for people recovering from injuries or people living with specific disabilities.

"We're trying to add the dimension of movement and touch to allow people to exert forces against things that are created in front of them with a projector and virtual reality goggles," says Robert Radwin, a UW–Madison professor of industrial and , and discovery fellow at the Wisconsin Institute for Discovery (WID)'s Living Environments Laboratory (LEL). "What if we could use these virtual exertions as a way of rehabilitating people from an illness or an injury such as a stroke? What if we could alter people's abilities for different tasks, making them weaker or stronger during certain exercises?"

In previous research, manipulating virtual objects has relied on wands, controllers and other devices external to the body. Though valuable, these devices are not driven by a person's muscles the same way as when real objects are picked up or moved.

Radwin worked closely with the LEL to develop the software and process for a pilot study in which participants move virtual objects in the CAVE, a fully immersive six-sided room that projects 3-D environments on its walls. Kevin Ponto, an assistant professor of design studies in the School of , Karen Chen, a graduate student in the LEL, and Ross Tredinnick, systems programmer in the LEL, collaborated in the design of the project.

In the study, participants' arms were hooked up to an electromyography (EMG) device that collects the electrical signals produced by muscles during physical activity. Situated outside of the CAVE, people lifted dumbbells of different weights while the EMG device recorded muscle activity to a nearby computer.

Then, participants did the same exercise inside the CAVE, wearing 3-D , head and hand sensors, and the EMG device. Instead of lifting a real dumbbell, people "grabbed" and lifted a virtual dumbbell instead, stiffening their arms to lift the object.

Karen Chen says the preliminary results show that people can adapt their lifting behavior to a using the same muscle groups used to lift real objects. The benefit, she adds, is being able to perform lifting in a controlled environment with a reduced risk of strain or dropping real objects.

With more experiments and refinement of the technology, the group may examine downsizing the technology to include a headset rather than an entire virtual reality room.

Ponto says that in addition to rehabilitation applications, the project can open doors to make virtual reality more intuitive, including creating the illusion of lifting objects that don't actually exist.

Future research could examine how to better tie virtual reality and human muscle groups together so simulations are more personally tailored based on a person's normal activity while sitting or standing.

Explore further: Virtual reality you can reach out and touch

Related Stories

Virtual reality you can reach out and touch

July 1, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

New robot takes augmented reality to a new level

February 11, 2013

(—Researchers and engineers at a Japanese company called Different Dimensions have taken the concept of augmented reality to new heights by adding the touch of an avatar to the experience. That touch comes courtesy ...

Talk to the virtual hands

October 12, 2011

Body language of both speaker and listener affects success in virtual reality communication game.

Holodesk prototype puts life in computers (w/ video)

October 20, 2011

( -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" the virtual display. ...

A virtual reality scent system that fools human taste

April 19, 2011

( -- Can you fool the human sense of taste in the world of virtual reality? Up until recently that question was impossible to answer, most because it had not been tested. Most of virtual reality relied on sight ...

Virtual reality you can touch (w/ Video)

August 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. By incorporating ...

Recommended for you

What do you get when you cross an airplane with a submarine?

February 15, 2018

Researchers from North Carolina State University have developed the first unmanned, fixed-wing aircraft that is capable of traveling both through the air and under the water – transitioning repeatedly between sky and sea. ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.