Wearable robot transforms musicians into three-armed drummers (w/ Video)

February 17, 2016
The robotic arm attaches to a drummer's right shoulder and plays the cymbal and tom. Credit: Georgia Tech

Georgia Institute of Technology researchers have built a wearable robotic limb that allows drummers to play with three arms. The two-foot long "smart arm" can be attached to a musician's shoulder. It responds to human gestures and the music it hears. When the drummer moves to play the high hat cymbal, for example, the robotic arm maneuvers to play the ride cymbal. When the drummer switches to the snare, the mechanical arm shifts to the tom.

Georgia Tech Professor Gil Weinberg oversees the project, which is funded by the National Science Foundation. He says the goal is to push the limits of what humans can do.

"If you augment humans with smart, wearable robotics, they could interact with their environment in a much more sophisticated manner," said Weinberg, director of the Center for Music Technology. "The third arm provides a much richer and more creative experience, allowing the human to play many drums simultaneously with virtuosity and sophistication that are not otherwise possible."

The robotic arm is smart for a few reasons. First, it knows what to play by listening to the music in the room. It improvises based on the beat and rhythm. For instance, if the musician plays slowly, the arm slows the tempo. If the drummer speeds up, it plays faster.

Another aspect of its intelligence is knowing where it's located at all times, where the drums are, and the direction and proximity of the human arms. When the robot approaches an instrument, it uses built-in accelerometers to sense the distance and proximity. On-board motors make sure the stick is always parallel to the playing surface, allowing it to rise, lower or twist to ensure solid contact with the drum or cymbal. The arm moves naturally with intuitive gestures because it was programmed using human motion capture technology.

Student Tyler White on drums. Georgia Tech Professor Gil Weinberg (right) oversees the project. Credit: Georgia Tech

Weinberg and a team of student researchers with backgrounds in music, engineering, computer science and physics built the arm after creating a robotic prosthesis for an Atlanta drummer. That device had two sticks, one with a mind of its own. The allowed the man to continue his musical passion after losing an arm in an accident, while also making him the fastest drummer in the world. Its success led Weinberg to create the "third arm" robot, something that anyone can wear and become a cyborg drummer.

"If you have a robotic device that is part of your body, it's a completely different feeling from working alongside a regular robot," said Weinberg. "The machine learns how your body moves and can augment and complement your activity. It becomes a part of you."

The next step is linking the arm's movements to brain activity. The team is already experimenting with an electroencephalogram (EEG) headband that detects a drummer's brain patterns. They're hoping to identify patterns that would allow the arm to react when the musician simply thinks about changing tempo or instruments.

The video will load shortly

Weinberg sees other applications for the technology.

"Imagine if doctors could use a third arm to bring them tools, supplies or even participate in surgeries. Technicians could use an extra hand to help with repairs and experiments," he said. "Music is based on very timely, precise movements. It's the perfect medium to try this concept of human augmentation and a third ."

Explore further: Darpa's robotics simulator/test platform reaches 2nd milestone

Related Stories

Can a bonobo keep the beat?

November 24, 2015

Humans have a remarkable ability to synchronize to complex, temporally structured acoustic signals, an ability which is believed to underlie social coordination and may be a precursor to speech. This ability takes years to ...

Mind-controlled prosthetic arm moves individual 'fingers'

February 16, 2016

Physicians and biomedical engineers from Johns Hopkins report what they believe is the first successful effort to wiggle fingers individually and independently of each other using a mind-controlled artificial "arm" to control ...

Recommended for you

Inferring urban travel patterns from cellphone data

August 29, 2016

In making decisions about infrastructure development and resource allocation, city planners rely on models of how people move through their cities, on foot, in cars, and on public transportation. Those models are largely ...

How machine learning can help with voice disorders

August 29, 2016

There's no human instinct more basic than speech, and yet, for many people, talking can be taxing. 1 in 14 working-age Americans suffer from voice disorders that are often associated with abnormal vocal behaviors - some of ...

Apple issues update after cyber weapon captured

August 26, 2016

Apple iPhone owners on Friday were urged to install a quickly released security update after a sophisticated attack on an Emirati dissident exposed vulnerabilities targeted by cyber arms dealers.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

SCVGoodToGo
1 / 5 (1) Feb 18, 2016
Only 3 arms away from Dr. Octavius.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.