Machine speak: Left to their own devices, computers can figure it out

April 24, 2018 by Sara Shoemaker, Oak Ridge National Laboratory
Using novel machine learning techniques, a research team from Oak Ridge National Laboratory is teaching electronic devices how to speak for themselves. Credit: Jason Richards/Oak Ridge National Laboratory, U.S. Dept. of Energy

Using novel machine learning techniques, a research team from the Department of Energy's Oak Ridge National Laboratory is teaching electronic devices how to speak for themselves.

Email, texting, image sharing and take place over networks that are reliable—most of the time. When certain connections are lost or disrupted by a physical or cyberattack, immediately lose touch, and they are not equipped to find another method of communication.

Electronics are only as smart as their design. With proper training and intelligence, devices could be programmed to seek out available media, such as acoustics, optics or radio frequencies, and figure out how to transmit and receive messages on their own without being told beforehand.

For example, multiple response teams using two-way radio devices, or walkie-talkies, during an emergency are limited to a finite number of available frequencies. The same devices could be programmed and trained through and intelligence to seek alternate means to keep people connected, which is critical in life-and-death scenarios.     

"The devices, pre-equipped with language and the ability to communicate, could begin sharing data of any kind over just about any physical medium," said ORNL's Adam Anderson who leads a team specializing in computing, networking and cybersecurity. "They will initially go through a trial-and-error volley of information, developing their own patterns as they go, until they reach the most efficient and accurate mode of message transmission."

The resulting language, or machine , is unrecognizable to humans, a phenomenon that can evoke controversy—and even fear—over whether machines may begin communicating independently. But, according to ORNL researchers, allowing computers to talk to each other, rather than telling computers how to communicate, is what gives them the intelligence to optimize their ability to maintain contact.

"In other words, we're training and programming devices to figure out the best way to communicate for themselves rather than being overly prescriptive," Anderson said.

One of the key issues ORNL researchers had to overcome was having the devices converge on an agreed speech without any back-channel assistance. "We felt it was 'cheating' if the devices learned anything from an outside, or unrealistic, source; they needed to converge all on their own," Anderson said.

To demonstrate machine speech, Anderson and his team connected two laptop computers to separate speakers and microphones facing each other. The researchers programmed the devices with language comprising sounds known as phonemes, the smallest units of human speech including consonants, vowels and syllables. The phonemes replaced the digital bits computers typically use to communicate.

Anderson input the numbers 1 through 5 on the transmitting computer and told it to "speak" them to the receiving computer. The receiving computer output the words "won, too, three, forr, five" on its screen. As they bantered, the two adjusted and corrected their speech until the receiving computer produced the numbers correctly.

"To us, the language emitting from the speakers is distorted, like pulsing static, yet the computers understand their speech as it becomes more refined through training," Anderson said. "Ultimately, the technology demonstrated here can be used in high-speed digital communications between devices."

Other physical media can be used to demonstrate speech transmission, such as light through fiber optics or radio waves.

As the project progresses, the ORNL team plans to use these software radio, machine learning and techniques to replace classic digital modems in computers. This approach to communications aims to improve the robustness of networks associated with smart grid technologies against malicious attacks.

Explore further: Researchers develop more comprehensive acoustic scene analysis method

Related Stories

Why deaf people can have accents, too

March 22, 2017

Most people have probably encountered someone who appears to use lip-reading to overcome a hearing difficulty. But it is not as simple as that. Speech is "bimodal", in that we use both sounds and facial movements and gestures ...

Speech therapy after a stroke

August 24, 2017

Dear Mayo Clinic: My mother had a stroke six months ago. Her mobility has returned to near normal. She can read and understands others when they speak. But she has a lot of difficulty talking, often struggling to find the ...

Recommended for you

Archaeologists discover Incan tomb in Peru

February 16, 2019

Peruvian archaeologists discovered an Incan tomb in the north of the country where an elite member of the pre-Columbian empire was buried, one of the investigators announced Friday.

Where is the universe hiding its missing mass?

February 15, 2019

Astronomers have spent decades looking for something that sounds like it would be hard to miss: about a third of the "normal" matter in the Universe. New results from NASA's Chandra X-ray Observatory may have helped them ...

What rising seas mean for local economies

February 15, 2019

Impacts from climate change are not always easy to see. But for many local businesses in coastal communities across the United States, the evidence is right outside their doors—or in their parking lots.

The friendly extortioner takes it all

February 15, 2019

Cooperating with other people makes many things easier. However, competition is also a characteristic aspect of our society. In their struggle for contracts and positions, people have to be more successful than their competitors ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.