Can You Read My Mind?

Mar 23, 2005

The W.M. Keck Foundation has awarded Carnegie Mellon University a $750,000 grant to support research into how the human brain deciphers language, which could one day yield advances in the treatment of neurological disorders such as autism and dyslexia.
This multidisciplinary research is being conducted by Marcel Just, the D.O. Hebb Professor of Psychology, and Tom Mitchell, the Edward Fredkin Professor of Artificial Intelligence and Learning in the School of Computer Science. Using computer models to interpret the results of functional Magnetic Resonance Imaging (fMRI) brain scans, the researchers plan to develop a computational theory that describes the changes in brain activity over time during language comprehension and makes predictions about the subprocesses involved in word and sentence comprehension.

They also will demonstrate how reading different words and sentences will produce variations in brain activity and how dysfunctions in specific brain regions influence the function of the entire brain system.

In addition to this Keck Foundation grant, Mitchell and Just have received funding from the National Science Foundation for related studies, for a total of $1 million.

"If successful, our research will result in a significant advance in the scientific understanding of brain function during language processing. Such an understanding will have a major impact on the study of brain disorders involving language comprehension," Just said.

An fMRI study measures brain activity in each part of the brain over a specific duration of time. The process generates a massive amount of data—a single scan measures the activity level in about 20,000 voxels (3-D pixels) once every second. Each voxel is about the size of a peppercorn. So Just and Mitchell use data mining and statistical machine software to detect subtle patterns. They already have developed computer algorithms for analyzing fMRI scans that can distinguish which category of words a person is reading about (for example, a list of buildings versus a list of tools) by detecting subtle variations in brain activity. They also have created a computational model that can predict what brain activity will occur when a person reads a sentence.

"We can train our machine learning programs by showing them activity from one person's brain. It looks at other activity from the same brain and it can tell with 90 percent accuracy whether it's looking at a picture or reading a sentence. It can discriminate between words about different semantic and grammatical content, such as buildings versus tools, nouns versus verbs," Mitchell said.

While they trained their software, the researchers had focused on nouns. They now will turn their attention to nouns and verbs in combination to determine how different parts of the brain are activated to comprehend verb phrases and sentences.

Explore further: Financial decisions: Older adults' lifetime of acquired expertise offsets declining ability to process information

add to favorites email to friend print save as pdf

Related Stories

How your smartphone got so smart

Sep 16, 2013

In 1947, the Cold War, David Letterman, and the CIA were born; the future Queen Elizabeth got married; and a U.S. postage stamp cost 3 cents. That was also the year the seed that would eventually grow into ...

What causes traffic gridlock?

Sep 07, 2011

Everyday life enters a different phase on the Tuesday after Labor Day, the unofficial start of autumn in the United States. As students and employees return from vacation, and vehicles fully flood roadways ...

Shuttle's end hits Houston in ego more than wallet

Jul 07, 2011

(AP) -- The end of the space shuttle program is hitting its Florida launch home in the pocketbook with some areas practically becoming economic ghost towns. But Houston, home of Mission Control, is getting ...

The digital side of biology

Mar 07, 2011

Revolutions in science come in waves. One of the epoch-making events in modern biology came in 1995 when J. Craig Venter, an American biologist, decoded the whole genome of the Haemohilus influenzae bacterium ...

Recommended for you

Study sheds new light on the diet of extinct animals

7 hours ago

A study of tooth enamel in mammals living today in the equatorial forest of Gabon could ultimately shed light on the diet of long extinct animals, according to new research from the University of Bristol.

Decision cascades in social networks

9 hours ago

How do people in a social network behave? How are opinions, decisions and behaviors of individuals influenced by their online networks? Can the application of math help answer these questions?

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.