Students invent 'Aura' musical instrument using gloves (w/ Video)

February 19, 2014

Imagine holding music in your hands. That's what you can do with the Aura, a new electronic musical instrument conceived by Cornell University engineering students.

"The goal was to create the most intuitive instrument," said senior Ray Li, who came up with the idea of an instrument played by gesturing in the air and brought it to life in collaboration with programmer Michael Ndubuisi, also a senior.

To play the Aura, Li dons gloves fitted with sensors that report the position and orientation of his hands in a . Raising and lowering the hands controls pitch; spreading them apart increases volume. Closing the fingers activates flex sensors and muffles the sound, and twisting the hands adds distortion. Through an interface created by Ndubuisi, hand positions are converted to signals in the universal MIDI language for electronic instruments and fed to a synthesizer.

The result looks something like a person listening to music and pretending to conduct, but this "conductor" is more like a wizard conjuring music out of thin air. "We're trying to capture those intuitive gestures and make music," Li explained.

The were lent by Ascension Technology Corp. of Vermont, which developed them for medical applications, motion tracking and manipulation of 3-D graphics.

This video is not supported by your browser at this time.
Ray Li, BS '14 and Michael Ndubuisi, BS '14, talk about their new musical instrument, Aura, which allows the musician to control sound simply by moving their hands in the air. Video courtesy of the Cornell Daily Sun. Videographer: Ryan Larkin, film major.

Li's first electronic instrument, a class project for a circuits course in his sophomore year, was Sabre, an electronic cello in which conductive strips replaced strings, and a joystick in the right hand could modify the sound. Aura grew out of a desire to improve expressiveness. He wanted more than a joystick, he said, so he could directly control the sound with his hands.

The Cornell Council for the Arts is funding a public presentation at the end of this semester, for which the team is developing the next phase, called SoundSpace. This will let the musician control recorded sounds of various instruments, add percussion through body movement, and provide some visual representations. The concert is slated for March 26 in Cornell's Barnes Hall Auditorium.

"The musician will create a whole song on stage with nothing," as Li describes it, adding that he will have to recruit a whole team of programmers to bring his vision to life.

Outside of class, Li plays "a bit of piano and guitar," but focuses on vocals, singing with the a cappella groups Tarana and Exploosh!

Explore further: UK virtual orchestra puts you in conductor's stand

Related Stories

Disabled kids inspire musical instrument anyone can play

February 6, 2013

(Phys.org)—Not everyone can play music. You need timing and rhythm, an ear for pitch and notes and an ability to interpret sheet music and symbols. You need physical coordination to apply those talents plus control of lungs, ...

The sound of driving: VW plays a car's music (w/ Video)

November 28, 2013

(Phys.org) —Volkswagen calls its new concept "driving music reinvented" in the form of an app called Play the Road. We can think about the driver as a composer; we can think about the car as an instrument; we can think ...

DIY music kit turns to crowdfunding for takeoff

February 3, 2014

(Phys.org) —A synthesizer has been modeled to transform any object into a musical instrument: A London-based creative design and invention company Dentaku, formed just last year, is turning to crowdfunding to get its device, ...

Digital music gets a cubist makeover

February 7, 2014

An 8-inch wooden cube may be an unlikely spark for a musical revolution – but that's the hope of a collaboration of electronic engineers and musicians working towards hackable electronic instruments that performers can ...

Recommended for you

How to curb emissions? Put a price on carbon

September 3, 2015

Literally putting a price on carbon pollution and other greenhouse gasses is the best approach for nurturing the rapid growth of renewable energy and reducing emissions.

Magnetic fields provide a new way to communicate wirelessly

September 1, 2015

Electrical engineers at the University of California, San Diego demonstrated a new wireless communication technique that works by sending magnetic signals through the human body. The new technology could offer a lower power ...

For these 'cyborgs', keys are so yesterday

September 4, 2015

Punching in security codes to deactivate the alarm at his store became a thing of the past for Jowan Oesterlund when he implanted a chip into his hand about 18 months ago.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

manifespo
not rated yet Feb 22, 2014
Futuristic! Sounds similar to the theremin.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.