Researchers track facial expressions to improve teaching software

Jun 27, 2013

(Phys.org) —Research from North Carolina State University shows that software which tracks facial expressions can accurately assess the emotions of students engaged in interactive online learning and predict the effectiveness of online tutoring sessions.

"This work is part of a larger effort to develop to teach students computer science," says Dr. Kristy Boyer, an assistant professor of computer science at NC State and co-author of a paper on the work. "The program, JavaTutor, will not only respond to what a student knows, but to each student's feelings of frustration or engagement. This is important because research shows that student emotion plays an important role in the learning process."

The researchers used the automated Computer Expression Recognition Toolbox (CERT) program to evaluate of 65 college students engaged in one-on-one online tutoring sessions. The researchers found that CERT was able to identify associated with learning-centered emotions, such as frustration or concentration – and that the automated program's findings were consistent with expert human assessments more than 85 percent of the time.

The researchers also had the students report how effective they felt the tutorial was, and tested the students before and after each tutoring session to measure how much they learned.

The researchers used observational data from CERT along with student self-assessments and test results to develop models that could predict how effective a tutorial session was, based on what the facial expressions of the students indicated about each student's feelings of or engagement.

"This work feeds directly into the next stage of JavaTutor system development, which will enable the program to provide cognitive and emotion-based feedback to students," says Joseph Grafsgaard, a Ph.D. student at NC State and lead author of the paper.

Explore further: Why plants in the office make us more productive

add to favorites email to friend print save as pdf

Related Stories

New computers respond to students' emotions, boredom

Mar 02, 2012

Emotion-sensing computer software that models and responds to students’ cognitive and emotional states – including frustration and boredom – has been developed by University of Notre Dame Assistant ...

Student engagement more complex, changeable than thought

Jun 20, 2013

A student who shows up on time for school and listens respectfully in class might appear fully engaged to outside observers, including teachers. But other measures of student engagement, including the student's emotional ...

Scanning the brain for impending error

Apr 20, 2012

(Phys.org) -- UA computer science doctoral student Federico Cirett is using new technology to predict, in advance, when people will make a mistake. He's been testing subjects taking the SAT exam in math.

Recommended for you

Precarious work schedules common among younger workers

Aug 29, 2014

One wish many workers may have this Labor Day is for more control and predictability of their work schedules. A new report finds that unpredictability is widespread in many workers' schedules—one reason ...

Girls got game

Aug 29, 2014

Debi Taylor has worked in everything from construction development to IT, and is well and truly socialised into male-dominated workplaces. So when she found herself the only female in her game development ...

Computer games give a boost to English

Aug 28, 2014

If you want to make a mark in the world of computer games you had better have a good English vocabulary. It has now also been scientifically proven that someone who is good at computer games has a larger ...

Saddam Hussein—a sincere dictator?

Aug 28, 2014

Are political speeches manipulative and strategic? They could be – when politicians say one thing in public, and privately believe something else, political scientists say. Saddam Hussein's legacy of recording private discussions ...

User comments : 0