Space scientists find that solar wind becomes music in the right hands

Apr 21, 2006
Space scientists find that solar wind becomes music in the right hands
Roberto Morales-Manzanares performing his 2004 composition "Cenzontle," written for solo flute and interactive video. Morales uses his instrumental gestures, captured in real time with sensors, to control a projected video in abstract and vibrant ways.

The music of composer and musician Roberto Morales-Manzanares has been inspired by the sea, by wind and wave, by mathematical equations, and now - thanks to his collaboration with space scientists at the University of California, Berkeley - the breeze of electrons from the sun.

Morales, a doctoral student at UC Berkeley's Center for New Music and Audio Technologies (CNMAT), has made a name for himself in the computer music field, generating music using rules or algorithms seldom associated with music.

"We are surrounded by computers and technology, we're being hit by media all the time, so you have to use it to create art," he said. "I see technology as a traditional tool for composition like Bach used the pipe organ in his time."

He was an obvious choice to work with physicists at UC Berkeley's Space Sciences Laboratory on a piece of software to convert data from a pair of NASA satellites comprising the Solar TErrestrial RElations Observatory, or STEREO, into sound, a concept that has acquired the name "sonification."

STEREO, scheduled for launch later this year, will provide a stereoscopic view of the sun and solar explosions called coronal mass ejections, which generate space storms that affect Earth. The IMPACT (In-situ Measurements of Particles and CME Transients) suite of instruments aboard STEREO, however, focuses, not on pretty pictures, but on the wind of electrons and ions from the sun, and the magnetic field of the sun.

Physicist Janet Luhmann, the principal investigator for IMPACT, realized that the data these instruments capture could be used to generate an audio counterpart to the STEREO images, not only drawing attention to the IMPACT data - typically not as sexy as the colorful pictures of the sun - but perhaps providing scientific value, too.

"You can look at wiggly lines, and you can look at spectrograms, which are kind of rainbow plots, and your eyes can give you certain feedback, but sometimes you hear patterns you don't see readily," she said. "I see the sonification as possibly adding to the ability to recognize certain kinds of characteristic behaviors."

With one of the STEREO satellites, dubbed A, leading Earth in its orbit around the sun and the other, B, following, the cameras and instruments will tell scientists how large the solar bursts are and how they vary from place to place and over time. Such data could easily be converted into sound, even music.

"If you have the record from STEREO A played in one ear and from STEREO B played in the other ear, you could hear particles arriving first in the right ear and later in the left ear, or hear a change in intensity as a crescendo," said Luhmann. "If you made the particular scale or note translation related to particle energy, you could see whether it was more energetic in one ear than another. It's really got acute potential for not only being a gee whiz kind of thing, but also conveying a sense of the physical thing happening, which is invisible."

Luhmann's colleague, Space Sciences Laboratory physicist Laura Peticolas, hired Morales to create a computer program, like a video game, that converts data from the instruments aboard IMPACT into sound. Together, they created three programs, one for kids that explains how numbers can be translated into music, one called "STEREO Spectro" that lets the general public play with the "sounds of space," and one called "Incandescence 1.1" for musicians who want to experiment with the sounds or weave them into a composition.

"Most people make this data sound like a solar wind, with the sound increasing and decreasing as the data intensity increases or decreases, which is a very literal translation of what's happening," Morales said. "But we wanted to ask, 'How can we look at the data in a new way? How can we map the data to increase the listenability, to make the music more appealing?' This way we can explore a new type of aesthetic."

One interpretation involves resonators, a tool developed at CNMAT by Adrian Freed. Morales uses these resonators to create new instruments based on resonance patterns inherent in the piano, "like building new pianos with a different sound-color perspective."

Morales tested his software with solar wind data from a satellite already orbiting Earth, NASA's Advanced Composition Explorer (ACE), and liked the results so much he incorporated them into a composition, "Turning Point," that was performed in 2004 by the University of Guanajuato's Philharmonic Orchestra. For that piece, Morales used two channels of data to determine the pitch, two others to set the rhythm, and two others to fix the dynamics, either forte or piano.

"You can make it as musical as you want," he said. "You can design your mapping strategies to make the generated sound tonal, D mayor for instance, or make intervals representing any rhythmic model you would like to explore. You are also able to configure the orchestration of the resultant sound to get the effect of a string quartet, a piano trio brass quintet, etc."

Peticolas noted that most sonification is akin to taking radio waves, which are inaudible, and shifting their frequency into the audio range.

However, "a direct translation of the data to sound may not be the best way for us to listen to it," she said. "The advantage of bringing Roberto on the project is that he is not stuck in the data. He has helped us think of different ways to make the sonification both musical and useful."

The software is already available for download from the laboratory's "Sounds of Space" Web site, http://cse.ssl.berkeley.edu/impact/sounds.html, but the proof of the pudding will be after STEREO's launch this summer, when data will be posted on the Web for anyone to download and turn into music. While Morales will have returned to Guanajuato with a newly minted Ph.D. from UC Berkeley, he hopes that the sonification software will bring people closer to what's happening in space.

"I see this idea of generating music from different sources - animals, the sea, light, space, the sound of the environment - as ways of getting close to nature," he said. "The musical technology expands your language as an artist and gives you a more complete vision of what you experience."

Sounds of Space: Download software to create your own music from data.

Source: UC Berkeley

Explore further: Dawn spacecraft captures best-ever view of dwarf planet

add to favorites email to friend print save as pdf

Related Stories

Researcher discusses electronic cochlear architecture

Jan 20, 2015

Researchers have developed an architecture and digital implementation of an electronic cochlea with an acoustic fovea and address event representation using field programmable gate arrays. Prof. Andreas Andreou of Johns Hopkins ...

Want to turn heads at CES? Hire a celebrity (Update)

Jan 07, 2015

Driverless cars of the future. Every imaginable (and unimaginable) kind of smartphone case. The latest laundry technology, even. Acres of Las Vegas convention center floor packed with gadget demos and exhibitor ...

Rosetta's comet sings strange, seductive song

Nov 12, 2014

Scientists can't figure exactly why yet, but Comet 67P/Churyumov-Gerasimenko has been singing since at least August. Listen to the video – what do you think? I hear a patter that sounds like frogs, purring ...

Recommended for you

Dawn spacecraft captures best-ever view of dwarf planet

46 minutes ago

NASA's Dawn spacecraft has returned the sharpest images ever seen of the dwarf planet Ceres. The images were taken 147,000 miles (237,000 kilometers) from Ceres on Jan. 25, and represent a new milestone for ...

Image: Striking lightning from space

4 hours ago

Lightning illuminates the area it strikes on Earth but the flash can be seen from space, too. This image was taken from 400 km above Earth in 2012 by an astronaut on the International Space Station travelling ...

Are asteroids the future of planetary science?

4 hours ago

I don't think I ever learned one of those little rhymes – My Very Educated Mother Just Served Us Nine Pizzas – to memorize the order of the planets, but if I had, it would've painted for me a minimalist ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.