New algorithm found for learning languages

September 6, 2005

Cornell University and Tel Aviv University researchers say they've developed a method for enabling a computer program to learn languages.

The researchers said the algorithm they've formulated allows a computer to scan text in many languages, including English and Chinese, and autonomously and without previous information infer the underlying rules of grammar.

The rules can then be used to generate new and meaningful sentences, they said. The method also works for such data as sheet music or protein sequences.

"The algorithm -- the computational method -- for language learning and processing that we have developed can take a body of text, abstract from it a collection of recurring patterns or rules and then generate new material," explained Shimon Edelman, a computer scientist and professor of psychology at Cornell.

"This is the first time an unsupervised algorithm is shown capable of learning complex syntax, generating grammatical new sentences and proving useful in other fields that call for structure discovery from raw data, such as bioinformatics," he said.

The study appears in the Proceedings of the National Academy of Sciences.

Copyright 2005 by United Press International

Explore further: The uncertain unicycle that taught itself and how it's helping AI make good decisions

Related Stories

Database for steganalysis of forensic evidence

February 13, 2018

There is nothing striking or remarkable about the tens of thousands of pictures an Iowa State University research team has spent the past 18 months collecting for a new database.

Microscopic chariots deliver molecules within our cells

February 9, 2018

On the cellular highway, motor proteins called dyneins rule the road. Dyneins "walk" along structures called microtubules to deliver cellular cargo, such as signaling molecules and organelles, to different parts of a cell. ...

Recommended for you

Unprecedented study of Picasso's bronzes uncovers new details

February 17, 2018

Musee national Picasso-Paris and the Northwestern University/Art Institute of Chicago Center for Scientific Studies in the Arts (NU-ACCESS) have completed the first major material survey and study of the Musee national Picasso-Paris' ...

Researchers create first superatomic 2-D semiconductor

February 16, 2018

Atoms are the basic building blocks of all matter—at least, that is the conventional picture. In a new study, researchers have fabricated the first superatomic 2-D semiconductor, a material whose basic units aren't atoms ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.