Scientists Have Identified Basic Principles of Communication

May 9, 2006

How do we succeed in putting our ideas into words, so that another person can understand them? This complex undertaking involves translating an idea into a one-dimensional sequence, a string of words to be read or spoken one after the other. Of course the person on the receiving end might not get the intended point: The effective expression of one’s ideas is considered an art, or at least a desirable and important skill.

A team of scientists that included physicists and language researchers at the Weizmann Institute of Science recently investigated this process by applying scientific methods to some of our culture’s most successful models for effective transfer of ideas – classic writings that, by common agreement, get their messages across well. They created mathematical tools that allowed them to trace the development of ideas throughout a book. The international team included Prof. Elisha Moses of the Weizmann Institute’s Physics of Complex Systems Department and Prof. Jean-Pierre Eckmann, a frequent visitor from the University of Geneva, as well as postdoctoral fellow Enrique Alvarez Lacalle and research student Beate Dorow from the University of Stuttgart. The paper describing their research was recently published in the Proceedings of the National Academy of Sciences (PNAS).

Because strings of words are one-dimensional, they literally lack depth. Our minds and memories aid us in recreating complex ideas from this string. The narration “encodes” a hierarchical structure. (An obvious hierarchical structure in a text is chapter-paragraph-sentence.) The implication is that our minds decipher the encoded structure, allowing us to comprehend the abstract concept.

To test for an underlying structure in strings of words that are known for their ability to convey ideas, the scientists applied their mathematical tools to a number of books, including writings of Albert Einstein, Mark Twain’s Tom Sawyer, Metamorphosis by Franz Kafka and other classics of different styles and periods. They defined “windows of attention” of around 200 words (about a paragraph) and within these windows, they identified pairs of words that frequently occurred near each other (after eliminating “meaningless” words such as pronouns). From the resulting word lists and the frequencies with which the single words appeared in the text, the scientists’ mathematical analysis was used to construct a sort of network of “concept vectors” – linked words that convey the principal ideas of the text.

Mathematically, these concept vectors can go in many directions, and reading the text can be thought of as a tour along paths in the resulting network. The multidimensional concept vectors seem to span a “web of ideas.” The scientists’ work suggests this network is based on a tree-like hierarchy that may be a basic underpinning of language. The reader or listener can reconstruct the hierarchical structure of a text, and thus the multidimensional space of ideas, in his or her mind to grasp “the author’s meaning.”

Moses: “Philosophers from Wittgenstein to Chomsky have taught us that language plays a central evolutionary role in shaping the human brain, and that revealing the structure of language is an essential step to comprehending brain structure. Our contribution to research in this basic field is in the creation of mathematical tools that can be used to make the connection between concepts or ideas and the words used to express them, making it possible to trace in a speech or text the path of an idea in an abstract mathematical space. We can understand theoretically how the structure of the wording serves to transmit concepts and reconstruct them in the mind of the reader. A deep question that remains open is if and how the correlations we uncovered serve the aesthetics of the text.”

Prof. Elisha Moses' research is supported by the Clore Center for Biological Physics; the Center for Experimental Physics; and the Rosa and Emilio Segre Research Award.

Source: Weizmann Institute of Science

Explore further: Gender segregation in jobs is not rooted in early family planning

Related Stories

Science and the rise of the co-authors

November 30, 2015

Physicists set a new record this year for number of co-authors: a 9-page report needed an extra 24 pages to list its 5,154 authors. That's a mighty long way from science's lone wolf origins!

The art and beauty of general relativity

November 26, 2015

One hundred years ago this month, an obscure German physicist named Albert Einstein presented to the Prussian Academy of Science his General Theory of Relativity. Nothing prior had prepared scientists for such a radical re-envisioning ...

Professor brings science to the art of persuasion

November 4, 2015

As the presidential race continues to heat up—the latest being that Republican presidential candidates were left fuming over what they called an unfair debate last week—the public will no doubt be more and more inundated ...

Time travel with the molecular clock

November 23, 2015

Migration isn't a new phenomenon, but new insights suggest that modern-day Europeans actually have at least three ancestral populations. This finding was published by Johannes Krause and prominently featured on the cover ...

Recommended for you


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.