Researchers advance artificial intelligence for player goal prediction in gaming

September 9, 2014 by Matt Shipman, North Carolina State University
Image from the Crystal Island game. Image credit: the IntelliMedia Group, NC State University.

Researchers from North Carolina State University have developed artificial intelligence (AI) software that is significantly better than any previous technology at predicting what goal a player is trying to achieve in a video game. The advance holds promise for helping game developers design new ways of improving the gameplay experience for players.

"We developed this software for use in educational gaming, but it has applications for all developers," says Dr. James Lester, a professor of computer science at NC State and senior author of a paper on the work. "This is a key step in developing player-adaptive games that can respond to player actions to improve the gaming experience, either for entertainment or – in our case – for education."

The researchers used "" to develop the AI software. Deep learning describes a family of machine learning techniques that can extrapolate patterns from large collections of data and make predictions. Deep learning has been actively investigated in various research domains such as computer vision and in both academia and industry.

In this case, the large collection of data is the sum total of actions that players have made in a game. The predictive AI software can then draw on all of that data to determine what an individual player is trying to accomplish, based on his or her actions at any given point in the game. And the software is capable of improving its accuracy over time, because the more data the AI program has, the more accurate it becomes.

"At some point that improvement will level off, but we haven't reached that point yet," Lester says.

To test the AI program, the researchers turned to an educational game called "Crystal Island," which they developed years earlier. While testing Crystal Island, the researchers amassed logs of player behavior (tracking every action a player took in the ) for 137 different players. The researchers were able to test the predictive AI against the Crystal Island player logs to determine its accuracy in goal recognition. In other words, they could tell the AI everything a player had done in Crystal Island up to a certain point and see what goal the AI thought the player was trying to accomplish. By checking the AI's response against the player log, the researchers could tell whether the AI was correct.

"For games, the current state-of-the-art AI program for goal recognition has an accuracy rate of 48.4 percent," says Wookhee Min, a Ph.D. student at NC State and lead author of the paper. "The accuracy rate for our new program is 62.3 percent. That's a big jump."

The paper, "Deep Learning-Based Goal Recognition in Open-Ended Digital Games," will be presented at the Tenth Annual Conference on Artificial Intelligence and Interactive Digital Entertainment, being held Oct. 5-7 in Raleigh, North Carolina.

Explore further: PhD student creates AI machine that can write video games

More information: "Deep Learning-Based Goal Recognition in Open-Ended Digital Games" … s/min-aiide-2014.pdf

Related Stories

PhD student creates AI machine that can write video games

December 17, 2012

(—Micheal Cook, a PhD researcher in the Computational Creativity Group at Imperial College in Britain, along with colleagues, has released a video game that was written in part by an Artificial Intelligence (AI) ...

ANGELINA AI game enters Ludum Dare jam

January 6, 2014

( —Can we automatically design video games? Put more boldly, what if a machine carrying AI, not humans, could step up to the role of creating a game? And can AI even create a better game than a human can? These ...

Study finds gaming augments players' social lives

March 27, 2014

New research finds that online social behavior isn't replacing offline social behavior in the gaming community. Instead, online gaming is expanding players' social lives. The study was done by researchers at North Carolina ...

Recommended for you

Light-based production of drug-discovery molecules

February 18, 2019

Photoelectrochemical (PEC) cells are widely studied for the conversion of solar energy into chemical fuels. They use photocathodes and photoanodes to "split" water into hydrogen and oxygen respectively. PEC cells can work ...

Sound waves let quantum systems 'talk' to one another

February 18, 2019

Researchers at the University of Chicago and Argonne National Laboratory have invented an innovative way for different types of quantum technology to "talk" to each other using sound. The study, published Feb. 11 in Nature ...

Engineered metasurfaces reflect waves in unusual directions

February 18, 2019

In our daily lives, we can find many examples of manipulation of reflected waves, such as mirrors, or reflective surfaces for sound that improve auditorium acoustics. When a wave impinges on a reflective surface with a certain ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.