Study researches 'gorilla arm' fatigue in mid-air computer usage

May 9, 2017, Purdue University
Arm fatigue accumulates during a prolonged use of mid-air interfaces such as Oculus Rift. Credit: Purdue University Photo/Brian Huchel

Researchers at Purdue University's C Design Lab are studying arm and muscle fatigue connected to advancements in the use of hand gestures for mid-air computer interaction.

Computer interaction improvements have included the expanding use of natural motions and gestures to control floating graphical user interfaces. As a result, from prolonged use of the motions and gestures has become an issue.

Karthik Ramani, the Donald W. Feddersen Professor in the School of Mechanical Engineering, is part of a study to evaluate and quantify arm fatigue in a simplified framework compared to current methods.

"In previous years, all the computer interaction technologies we had included something to support our limbs," Ramani said. "But with newer forms of interaction, there is no support. The question now is what the guidelines are to design new interfaces and interaction for such settings."

Technology has created mid-air interaction advancements in gaming, augmented and virtual reality applications and the use of mobile technologies using hands.

"Physical ergonomics is an important design factor for mid-air interaction," Ramani said. "In particular, arm fatigue – the so-called 'gorilla arm syndrome' – is known to negatively impact user experience and hamper prolonged use of mid-air interfaces."

Results of the study will be presented Tuesday (May 9) at the Association for Computing Machinery Conference on Human Factors in Computing Systems in Denver. The event is one in a series of prestigious academic conferences in the field of human–computer interaction and one of the top conferences in computer science. It is hosted by ACM SIGCHI, the special interest group on computer–human interaction.

Ramani, who also has a courtesy appointment in the School of Electrical and Computer Engineering, is joined in the research by Sujin Jang, a doctoral student in the School of Mechanical Engineering, and Satyajit Ambike, an assistant professor in the Department of Health and Kinesiology, as well as Wolfgang Stuerzlinger, a professor in the School of Interactive Arts and Technology at Simon Fraser University, Vancouver, Canada.

The study looked at the issue of human-computer interaction in two ways: Determining an individual's arm strength and estimating cumulative subjective fatigue levels.

Ramani said current methods to examine strength are expensive and invasive and can leave out considerations for rest. To simplify the issue, the study opted for inexpensive depth cameras, which are used in popular home video game systems to sense body motion and hand motion.

According to Jang, 24 participants were asked to grasp a dumbbell (5-pound for 20 males and 3-pound for four females) and hold their arm out horizontally for as long as they could. The camera sensors measured what their hands and arms are doing.

Using shoulder torque and endurance time, researchers were able to determine arm strength with an average error of 8.4 percent, slightly higher than the 6.2 percent recorded by current, higher-priced methods. That difference is negligible given the latter's accessibility and price tags of tens of thousands of dollars.

"With a simple depth camera and a dumbbell, we are able to do as good measurements as the other methods," Ramani said.

In determining cumulative subjective fatigue, the study once again looked to improve current methods, which usually register an error rate of 35 percent.

Jang said 24 subjects were shown targets on screen and asked to touch the targets as many times as possible with good accuracy for four one-minute segments, with random rest durations of 5-20 seconds between each segment. The screens were placed at shoulder- and waist-level heights for the experiment, and depth cameras were used to examine the body's skeleton.

He pointed out the researchers utilized a biomechanical model that includes the idea of a rest period into their estimate of the subject's fatigue. The status of the muscle as it transitioned from rest to activation to fatigue also was considered in estimating the subject's fatigue.

In the end, Ramani said the study was able to estimate the cumulating subjective fatigue at an improved 15 percent error rate over traditional methods.

According to Stuerzlinger, an expert on 3-D user interfaces, the "gorilla arm syndrome" is already an issue with vertical touchscreens, making it a problem even beyond augmented and virtual reality systems.

"The results of our work enable designers to predict how fatiguing a specific user interface is, even before a new design is built/realized, which enables the designers to make better decisions around new, proposed 3-D user interfaces," he said. "This, in turn, will accelerate and lead to the development of better user interface solutions for virtual and augmented reality systems."

For Ambike, the study's method of measuring strength and fatigue could have far-reaching implications for the aging population.

"Our inexpensive methods will potentially translate to establishing the relation between fatigue/strength and health, as well as into continuous monitoring of fatigue levels in at-risk populations," he said. "In this way, this technology promises to have a significant clinical impact."

Explore further: New tool for virtual and augmented reality uses 'deep learning'

More information: Modeling Cumulative Arm Fatigue in Mid-Air Interaction based on Perceived Exertion and Kinetics of Arm Motion. engineering.purdue.edu/cdesign … ulative-arm-fatigue/

Related Stories

People find changes in user interfaces annoying

April 12, 2017

Researchers modelled learning and visual search and predicted how users learn new or partially changed user interfaces. The model shows that even small changes can disturb visual search and impede use.

Shape-changing fog screen invented

May 5, 2017

There is something spooky about being able to see and talk to the pirate Blackbeard while one walks down a dark alley and then stepping right through him as he disappears into thin air. Such entertainment experiences are ...

Recommended for you

A novel approach of improving battery performance

September 18, 2018

New technological developments by UNIST researchers promise to significantly boost the performance of lithium metal batteries in promising research for the next-generation of rechargeable batteries. The study also validates ...

4 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

katesisco
not rated yet May 09, 2017
IF ONLY they had consulted the workers and volunteers at the thrift shops like SALVATION ARMY. We could have told them that hours of repetitive lifting the arm with a light weight like a dress or shirt cause this same 'fatigue.
rderkis
1 / 5 (1) May 09, 2017
Most people don't realize that the reason police hold their handgun pointing up as they walk around is to prevent fatigue.
ayesdi_fdesay
not rated yet May 09, 2017
Thankfully eye tracking will help solve a number of VR input issues.
antialias_physorg
not rated yet May 09, 2017
Eye tracking is tricky stuff (not the actual tracking, but figuring out what it *means*). The eye wanders all over the place during tasks. Figuring out whether looking some direction is
a) random
b) intentional
c) intentional to the point of triggering an action
is very hard.

By that I don't mean it's impossible but there are a lot of false positives associated with any application I'm aware of (which means you're spending a lot of time hitting the 'undo' button - which in turn quickly nullifies any advantage and can be somewhat vexing).

I've tried to use some off-the-shelf software once for using eye tracking to control the mouse cursor. Constantly making the cursor go where you want is extremly strenuous. (Un)expectedly it kills the auto-focus feature many programs use, too.
(Also drives home that you do a lot of the last few percent of ordinary mouse pointing/clicking without actually looking at what you're doing)

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.