I'm listening -- conversations with computers

Apr 16, 2008

A computer system that can carry on a discussion with a human being by reacting to signals such as tone of voice and facial expression, is being developed by an international team including Queen’s University Belfast.

Known as SEMAINE, the project will build a Sensitive Artificial Listener (SAL) system, which will perceive a human user’s facial expression, gaze, and voice and then engage with the user. When engaging with a human, the SAL will be able to adapt its own performance and pursue different actions, depending on the non-verbal behaviour of the user.

SEMAINE is led by DFKI, the German centre for research on Artificial Intelligence: the other partners are Imperial College, London, the University of Paris 8, the University of Twente in Holland, and the Technical University of Munich. The European Commission awarded it a grant of €2.75 million after it was ranked first out of 143 bids for medium-sized projects in the area of cognitive systems and robotics.

Professor Roddy Cowie, from the School of Psychology, leads the team at Queen’s. He said: “A basic feature of human communication is that it is coloured by emotion. When we talk to another person, the words are carried on an undercurrent of signs that show them what attracts us, what bores us and so on. The fact that computers do not currently do this is one of the main reasons why communicating with them is so unlike interacting with a human. It is also one of the reasons we can find them so frustrating,” said Professor Cowie.

“SEMAINE and projects like it will change the way people interact with technology. They mean that you will be talking to your computer in 20 years time. When you do, pause for a minute, and remember that the human sciences at Queen’s helped to lay the groundwork.

“These new developments depend on connecting technology to the relevant understanding of people, and it is recognised worldwide that we have a distinctive strength in bringing psychology, linguistics and ethics to bear on the process of developing the new systems.”

SEMAINE follows on from another project, entitled HUMAINE, which was led by Professor Cowie. The HUMAINE Project (Human-Machine Interaction Network on Emotion) received €4.95 million to develop interfaces that let humans use computers in a more natural way. In 2006 it won the “Grand Prize” for the best Information Society Technology Project website. HUMAINE continues in the form of a world-wide organisation for emotion-oriented computing, the HUMAINE Association (emotion-research.net/> ), of which Professor Cowie is president.

Professor Cowie added: “Today when we use technology we adopt a style of communication that suits the machine. Through projects like HUMAINE, SEMAINE, and others linked to them, we will develop technology that will eventually communicate in ways that suit human beings.”

Source: Queen's University Belfast

Explore further: Earthquake simulation tops one quadrillion flops

add to favorites email to friend print save as pdf

Related Stories

Emotional machines

Apr 03, 2008

Emotions are an intrinsic part of communications. But machines don’t have, perceive or react to them, which makes us – their handlers – hot under the collar. But thanks to building blocks developed by ...

Recommended for you

Dish Network denies wrongdoing in $2M settlement

8 hours ago

The state attorney general's office says Dish Network Corp. will reimburse Washington state customers about $2 million for what it calls a deceptive surcharge, but the satellite TV provider denies any wrongdoing.

Yahoo sees signs of growth in 'core' (Update)

8 hours ago

Yahoo reported a stronger-than-expected first-quarter profit Tuesday, results hailed by chief executive Marissa Mayer as showing growth in the Web giant's "core" business.

Intel reports lower 1Q net income, higher revenue

8 hours ago

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Earthquake simulation tops one quadrillion flops

10 hours ago

A team of computer scientists, mathematicians and geophysicists at Technische Universitaet Muenchen (TUM) and Ludwig-Maximillians Universitaet Muenchen (LMU) have – with the support of the Leibniz Supercomputing ...

Twitter buys data analytics partner Gnip

11 hours ago

Twitter says it has bought its data partner Gnip, which provides analysis of the more than 500 million tweets its users share each day—to advertisers, academic institutions, politicians and other customers.

User comments : 0

More news stories

Intel reports lower 1Q net income, higher revenue

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Low Vitamin D may not be a culprit in menopause symptoms

A new study from the Women's Health Initiative (WHI) shows no significant connection between vitamin D levels and menopause symptoms. The study was published online today in Menopause, the journal of The North American Menopa ...

Astronomers: 'Tilt-a-worlds' could harbor life

A fluctuating tilt in a planet's orbit does not preclude the possibility of life, according to new research by astronomers at the University of Washington, Utah's Weber State University and NASA. In fact, ...