Research uses muscle activity to move virtual objects (w/ video)

Mar 27, 2013 by Marianne English

(Phys.org) —Today's smartphones and computers offer gestural interfaces where information arrives at users' fingertips with a swipe of a hand. Still, researchers have found that most technology falls short in making people feel as if they're interacting with virtual objects the same way they would with real objects.

But a team at UW-Madison says it has developed, for the first time, a way to move in an immersive virtual reality environment through the use of . In addition to making virtual reality more interactive and realistic, the research could have rehabilitation applications for people recovering from injuries or people living with specific disabilities.

"We're trying to add the dimension of movement and touch to allow people to exert forces against things that are created in front of them with a projector and virtual reality goggles," says Robert Radwin, a UW–Madison professor of industrial and , and discovery fellow at the Wisconsin Institute for Discovery (WID)'s Living Environments Laboratory (LEL). "What if we could use these virtual exertions as a way of rehabilitating people from an illness or an injury such as a stroke? What if we could alter people's abilities for different tasks, making them weaker or stronger during certain exercises?"

In previous research, manipulating virtual objects has relied on wands, controllers and other devices external to the body. Though valuable, these devices are not driven by a person's muscles the same way as when real objects are picked up or moved.

Radwin worked closely with the LEL to develop the software and process for a pilot study in which participants move virtual objects in the CAVE, a fully immersive six-sided room that projects 3-D environments on its walls. Kevin Ponto, an assistant professor of design studies in the School of , Karen Chen, a graduate student in the LEL, and Ross Tredinnick, systems programmer in the LEL, collaborated in the design of the project.

In the study, participants' arms were hooked up to an electromyography (EMG) device that collects the electrical signals produced by muscles during physical activity. Situated outside of the CAVE, people lifted dumbbells of different weights while the EMG device recorded muscle activity to a nearby computer.

Then, participants did the same exercise inside the CAVE, wearing 3-D , head and hand sensors, and the EMG device. Instead of lifting a real dumbbell, people "grabbed" and lifted a virtual dumbbell instead, stiffening their arms to lift the object.

Karen Chen says the preliminary results show that people can adapt their lifting behavior to a using the same muscle groups used to lift real objects. The benefit, she adds, is being able to perform lifting in a controlled environment with a reduced risk of strain or dropping real objects.

With more experiments and refinement of the technology, the group may examine downsizing the technology to include a headset rather than an entire virtual reality room.

Ponto says that in addition to rehabilitation applications, the project can open doors to make virtual reality more intuitive, including creating the illusion of lifting objects that don't actually exist.

Future research could examine how to better tie virtual reality and human muscle groups together so simulations are more personally tailored based on a person's normal activity while sitting or standing.

Explore further: Scientists track Internet usage as it pulses across the globe daily (w/ Video)

Related Stories

Virtual reality you can reach out and touch

Jul 01, 2010

A team of European researchers has "virtually" teleported real objects through cyberspace, touched things in virtual reality and even felt the movements of a virtual dance partner.

New robot takes augmented reality to a new level

Feb 11, 2013

(Phys.org)—Researchers and engineers at a Japanese company called Different Dimensions have taken the concept of augmented reality to new heights by adding the touch of an avatar to the experience. That ...

Talk to the virtual hands

Oct 12, 2011

Body language of both speaker and listener affects success in virtual reality communication game.

Holodesk prototype puts life in computers (w/ video)

Oct 20, 2011

(PhysOrg.com) -- A research project at Microsoft Research Cambridge has brought forth a prototype called Holodesk, which lets you manipulate virtual objects with your hand. You literally "get your hands on" ...

A virtual reality scent system that fools human taste

Apr 19, 2011

(PhysOrg.com) -- Can you fool the human sense of taste in the world of virtual reality? Up until recently that question was impossible to answer, most because it had not been tested. Most of virtual reality ...

Virtual reality you can touch (w/ Video)

Aug 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. ...

Recommended for you

Facebook sues law firms, claims fraud

6 hours ago

Facebook is suing several law firms that represented a man who claimed he owned half of the social network and was entitled to billions of dollars from the company and its CEO Mark Zuckerberg.

IBM 3Q disappoints as it sheds 'empty calories'

6 hours ago

IBM disappointed investors Monday, reporting weak revenue growth again and a big charge to shed its costly chipmaking division as the tech giant tries to steer its business toward cloud computing and social-mobile ...

User comments : 0