Research uses muscle activity to move virtual objects (w/ video)

Mar 27, 2013 by Marianne English

( —Today's smartphones and computers offer gestural interfaces where information arrives at users' fingertips with a swipe of a hand. Still, researchers have found that most technology falls short in making people feel as if they're interacting with virtual objects the same way they would with real objects.

But a team at UW-Madison says it has developed, for the first time, a way to move in an immersive virtual reality environment through the use of . In addition to making virtual reality more interactive and realistic, the research could have rehabilitation applications for people recovering from injuries or people living with specific disabilities.

"We're trying to add the dimension of movement and touch to allow people to exert forces against things that are created in front of them with a projector and virtual reality goggles," says Robert Radwin, a UW–Madison professor of industrial and , and discovery fellow at the Wisconsin Institute for Discovery (WID)'s Living Environments Laboratory (LEL). "What if we could use these virtual exertions as a way of rehabilitating people from an illness or an injury such as a stroke? What if we could alter people's abilities for different tasks, making them weaker or stronger during certain exercises?"

In previous research, manipulating virtual objects has relied on wands, controllers and other devices external to the body. Though valuable, these devices are not driven by a person's muscles the same way as when real objects are picked up or moved.

Radwin worked closely with the LEL to develop the software and process for a pilot study in which participants move virtual objects in the CAVE, a fully immersive six-sided room that projects 3-D environments on its walls. Kevin Ponto, an assistant professor of design studies in the School of , Karen Chen, a graduate student in the LEL, and Ross Tredinnick, systems programmer in the LEL, collaborated in the design of the project.

In the study, participants' arms were hooked up to an electromyography (EMG) device that collects the electrical signals produced by muscles during physical activity. Situated outside of the CAVE, people lifted dumbbells of different weights while the EMG device recorded muscle activity to a nearby computer.

Then, participants did the same exercise inside the CAVE, wearing 3-D , head and hand sensors, and the EMG device. Instead of lifting a real dumbbell, people "grabbed" and lifted a virtual dumbbell instead, stiffening their arms to lift the object.

Karen Chen says the preliminary results show that people can adapt their lifting behavior to a using the same muscle groups used to lift real objects. The benefit, she adds, is being able to perform lifting in a controlled environment with a reduced risk of strain or dropping real objects.

With more experiments and refinement of the technology, the group may examine downsizing the technology to include a headset rather than an entire virtual reality room.

Ponto says that in addition to rehabilitation applications, the project can open doors to make virtual reality more intuitive, including creating the illusion of lifting objects that don't actually exist.

Future research could examine how to better tie virtual reality and human muscle groups together so simulations are more personally tailored based on a person's normal activity while sitting or standing.

Explore further: EU open source software project receives green light

Related Stories

Virtual reality you can reach out and touch

Jul 01, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

New robot takes augmented reality to a new level

Feb 11, 2013

(—Researchers and engineers at a Japanese company called Different Dimensions have taken the concept of augmented reality to new heights by adding the touch of an avatar to the experience. That ...

Talk to the virtual hands

Oct 12, 2011

Body language of both speaker and listener affects success in virtual reality communication game.

Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011

( -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" ...

A virtual reality scent system that fools human taste

Apr 19, 2011

( -- Can you fool the human sense of taste in the world of virtual reality? Up until recently that question was impossible to answer, most because it had not been tested. Most of virtual reality ...

Virtual reality you can touch (w/ Video)

Aug 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. ...

Recommended for you

EU open source software project receives green light

Jul 01, 2015

An open source software project involving the University of Southampton to extend the capacity of computational mathematics and interactive computing environments has received over seven million euros in EU funding.

Can computers be creative?

Jul 01, 2015

The EU-funded 'What-if Machine' (WHIM) project not only generates fictional storylines but also judges their potential usefulness and appeal. It represents a major advance in the field of computational creativity.

Algorithm detects nudity in images, offers demo page

Jul 01, 2015

An algorithm has been designed to tell if somebody in a color photo is naked. launched earlier this month; its demo page invites you to try it out to test its power in nudity detection. You ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.