Lip-read me now, hear me better later

April 12, 2007

Experience hearing a person's voice allows us to more easily hear what they are saying. Now research by UC Riverside psychology Professor Lawrence D. Rosenblum and graduate students Rachel M. Miller and Kauyumari Sanchez has shown that experience seeing a person's face also makes it easier to hear them.

Rosenblum’s paper, “Lip-Read Me Now, Hear Me Better Later: Crossmodal Transfer of Talker Familiarity Effects,” will appear in the May issue of the journal Psychological Science, published by the Association for Psychological Science.

Sixty college undergraduates were asked to lip-read sentences from a silent videotape of a talker's face. These subjects all had normal hearing and vision and had no formal lip reading experience.

After an hour of lip reading, the students were asked to listen to sentences heard against a background of noise and to identify as many words as they could. Half of the students heard sentences from the same talker they had just lip-read, while the other half heard sentences by a new talker. The undergraduates who lip-read and heard speech from the same talker were better at identifying the noisy sentences than those who lip-read from one talker and heard speech from another.

These findings suggest that when we watch a person speak, we become familiar with characteristics of their speaking style which also are present in the sound of their speech. This allows talker familiarity to be transferred from lip reading to listening, thereby making a talker easier to hear. These results have implications for individuals with hearing impairments as well as for brain lesion patients, Rosenblum said.

Source: Association for Psychological Science

Related Stories

Recommended for you

How the finch changes its tune

August 3, 2015

Like top musicians, songbirds train from a young age to weed out errors and trim variability from their songs, ultimately becoming consistent and reliable performers. But as with human musicians, even the best are not machines. ...

Machine Translates Thoughts into Speech in Real Time

December 21, 2009

( -- By implanting an electrode into the brain of a person with locked-in syndrome, scientists have demonstrated how to wirelessly transmit neural signals to a speech synthesizer. The "thought-to-speech" process ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.