How games can lead to a radical redesign of everyday computer use

November 1, 2011 By Kathleen Hamilton

For many people, daily computer use might lead to complaints about a sore back, carpal tunnel or lost data. For Polytechnic Institute of New York University (NYU-Poly) Associate Professor Katherine Isbister, glazed eyes and fatigue at the end of the day led her to rethink “our physical relationship to everyday computing.”

In an article in the current issue of Interactions Magazine, published by the Association for Computing Machinery, Isbister discusses a new effort: people who work in HCI (human-computer interaction) are using games to inspire fresh ways to engage with computers physically and emotionally – ways that can lead to positive practical outcomes such as better learning. Conducting research at NYU-Poly’s new Innovation Lab, which she directs, Isbister and her students have begun looking at whether — and how — movement can change the way people learn. They focus on the experience people have physically when they interact with computers: “how we feel as we move to interact with the technology.” 

The success of movement-based gaming such as Wii and Kinect, along with the rapid growth in multi-touch device use (smart phones, tablets) leads her to declare that “the era of movement-based interaction has arrived. People have “sophisticated sensor-based ways to interact with the console machines in their living rooms.” 

What next?

“Designers must turn their attention to the qualities of coupling with the system — of the moment-to-moment interaction—to create more supple experiences,” she writes. “I’ve come to realize that this is an excellent organizing principle for approaching movement-based interaction design. What if we place considerable design emphasis on how a movement makes a person feel in her body — as she performs it, and at the end of an extended interaction with the system?” 

This question led to her lab’s efforts to pin down the essential qualities of useful and pleasing movement-based interactions that integrate natural movement. “You might think because it’s movement, and movement is something we do every day, that this is intuitive and easy to do,” she says, “but it’s hard to design good movement and gestural-based interfaces.” 

One project was a simple game called Wriggle. The research team created two versions of the game — identical except that one was controlled with a keyboard, the other with a Wii Remote mounted in a silly hat. This allowed them to isolate the effects of movement on players, with an eye toward building devices and applications beyond gaming.  

In another example, Isbister cites recent research that striking powerful poses for just a couple of minutes enhances testosterone and risk tolerance. What if we could use this to combat math anxiety? she wondered — then designed a math-learning game called Scoop that employed high- and low-power arm sweeps to move fractions along a number line. Scoop recently finished a pilot with middle school girls. If they vary in self-reported math confidence after playing the two versions of the game, Isbister plans to further develop Scoop for an innovative math-curriculum program in New York City. 

Isbister’s research approach:

• Uses research from social science about how movement affects emotions, sense of social connection and well-being; 

• Creates games as research instruments in order to confirm these effects and construct designs that will shape the future of movement-based interactions;

• Applies these methods to design movement-based interactions to accomplish practical aims. 

The way we move contributes to how we feel, Isbister explains, raising the questions: Could email sorting feel more like gardening? Could an online meeting feel more like cooking or playing a sport than chatting through a small window at a prison’s visiting center? “I want to bring my body and its pleasures and capacities back into the mix of doing my daily work,” she says. “Maybe this could even reverse some of the alarming health trends that inactivity has wrought.”

Isbister holds joint appointments in NYU-Poly’s Department of Computer Science and Engineering, and NYU’s Tisch Game Center. She is also an investigator in the Games for Learning Institute housed at NYU and the research director of the Game Innovation Lab at NYU-Poly. Her research focuses on understanding and enhancing the social and emotional expressive range of games and other interactive systems. 

Explore further: The family that plays together stays together?

Related Stories

The family that plays together stays together?

April 21, 2011

( -- “Get off the computer and go play outside.” So go the words heard in homes around the country as parents and children clash over the social benefits of video games.

Wheelchair follows orders, but can act on its own, too

May 25, 2011

Five Northeastern University engineering seniors have developed an innovative, voice-operated wheelchair that can navigate through a cluttered room, move alongside walls and detect stairwells and other obstacles in its path ...

Robotic dragon, an unlikely teacher

October 21, 2011

David DeSteno, an associate professor of psychology at Northeastern, and researchers from the Massachusetts Institute of Technology (MIT) and Harvard University, are examining how social robots can aid preschoolers in language ...

Recommended for you

Nevada researchers trying to turn roadside weed into biofuel

November 26, 2015

Three decades ago, a University of Nevada researcher who obtained one of the first U.S. Energy Department grants to study the potential to turn plants into biofuels became convinced that a roadside weed—curly top gumweed—was ...

Glider pilots aim for the stratosphere

November 20, 2015

Talk about serendipity. Einar Enevoldson was strolling past a scientist's office in 1991 when he noticed a freshly printed image tacked to the wall. He was thunderstruck; it showed faint particles in the sky that proved something ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.