How games can lead to a radical redesign of everyday computer use

Nov 01, 2011 By Kathleen Hamilton

For many people, daily computer use might lead to complaints about a sore back, carpal tunnel or lost data. For Polytechnic Institute of New York University (NYU-Poly) Associate Professor Katherine Isbister, glazed eyes and fatigue at the end of the day led her to rethink “our physical relationship to everyday computing.”

In an article in the current issue of Interactions Magazine, published by the Association for Computing Machinery, Isbister discusses a new effort: people who work in HCI (human-computer interaction) are using games to inspire fresh ways to engage with computers physically and emotionally – ways that can lead to positive practical outcomes such as better learning. Conducting research at NYU-Poly’s new Innovation Lab, which she directs, Isbister and her students have begun looking at whether — and how — movement can change the way people learn. They focus on the experience people have physically when they interact with computers: “how we feel as we move to interact with the technology.” 

The success of movement-based gaming such as Wii and Kinect, along with the rapid growth in multi-touch device use (smart phones, tablets) leads her to declare that “the era of movement-based interaction has arrived. People have “sophisticated sensor-based ways to interact with the console machines in their living rooms.” 

What next?

“Designers must turn their attention to the qualities of coupling with the system — of the moment-to-moment interaction—to create more supple experiences,” she writes. “I’ve come to realize that this is an excellent organizing principle for approaching movement-based interaction design. What if we place considerable design emphasis on how a movement makes a person feel in her body — as she performs it, and at the end of an extended interaction with the system?” 

This question led to her lab’s efforts to pin down the essential qualities of useful and pleasing movement-based interactions that integrate natural movement. “You might think because it’s movement, and movement is something we do every day, that this is intuitive and easy to do,” she says, “but it’s hard to design good movement and gestural-based interfaces.” 

One project was a simple game called Wriggle. The research team created two versions of the game — identical except that one was controlled with a keyboard, the other with a Wii Remote mounted in a silly hat. This allowed them to isolate the effects of movement on players, with an eye toward building devices and applications beyond gaming.  

In another example, Isbister cites recent research that striking powerful poses for just a couple of minutes enhances testosterone and risk tolerance. What if we could use this to combat math anxiety? she wondered — then designed a math-learning game called Scoop that employed high- and low-power arm sweeps to move fractions along a number line. Scoop recently finished a pilot with middle school girls. If they vary in self-reported math confidence after playing the two versions of the game, Isbister plans to further develop Scoop for an innovative math-curriculum program in New York City. 

Isbister’s research approach:

• Uses research from social science about how movement affects emotions, sense of social connection and well-being; 

• Creates games as research instruments in order to confirm these effects and construct designs that will shape the future of movement-based interactions;

• Applies these methods to design movement-based interactions to accomplish practical aims. 

The way we move contributes to how we feel, Isbister explains, raising the questions: Could email sorting feel more like gardening? Could an online meeting feel more like cooking or playing a sport than chatting through a small window at a prison’s visiting center? “I want to bring my body and its pleasures and capacities back into the mix of doing my daily work,” she says. “Maybe this could even reverse some of the alarming health trends that inactivity has wrought.”

Isbister holds joint appointments in NYU-Poly’s Department of Computer Science and Engineering, and NYU’s Tisch Game Center. She is also an investigator in the Games for Learning Institute housed at NYU and the research director of the Game Innovation Lab at NYU-Poly. Her research focuses on understanding and enhancing the social and emotional expressive range of games and other interactive systems. 

Explore further: Hackathon team's GoogolPlex gives Siri extra powers

Provided by Polytechnic Institute of New York University

2 /5 (1 vote)
add to favorites email to friend print save as pdf

Related Stories

Robotic dragon, an unlikely teacher

Oct 21, 2011

David DeSteno, an associate professor of psychology at Northeastern, and researchers from the Massachusetts Institute of Technology (MIT) and Harvard University, are examining how social robots can aid preschoolers ...

Helping people with dementia catch some zzz's

Aug 29, 2011

Sometimes counting sheep just doesn’t work. Sleep deprivation is a common problem for everyone, no matter what their age, but for those suffering dementia, healthy sleep is critical and untreated sleep problems are one ...

The family that plays together stays together?

Apr 21, 2011

(PhysOrg.com) -- “Get off the computer and go play outside.” So go the words heard in homes around the country as parents and children clash over the social benefits of video games.

The dark side of Oxytocin

Aug 01, 2011

For a hormone, oxytocin is pretty famous. It’s the “cuddle chemical”—the hormone that helps mothers bond with their babies. Salespeople can buy oxytocin spray on the internet, to make their clients trust ...

Wheelchair follows orders, but can act on its own, too

May 25, 2011

Five Northeastern University engineering seniors have developed an innovative, voice-operated wheelchair that can navigate through a cluttered room, move alongside walls and detect stairwells and other obstacles ...

Recommended for you

Hackathon team's GoogolPlex gives Siri extra powers

3 hours ago

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...