Robotic prosthesis turns drummer into a three-armed cyborg (w/ Video)

Mar 06, 2014 by Jason Maderer
This robotic drumming prosthesis has motors that power two drumsticks. One is controlled by muscle sensors. The other is autonomous.

Professor Gil Weinberg has already built a band of robotic musicians in his Georgia Tech lab. Now he's created a robot that can be attached to amputees, allowing its technology to be embedded into humans. The robotic drumming prosthesis has motors that power two drumsticks. The first stick is controlled both physically by the musicians' arms and electronically using electromyography (EMG) muscle sensors. The other stick "listens" to the music being played and improvises.  

"The second drumstick has a mind of its own," said Weinberg, founding director of the Georgia Tech Center for Music Technology. "The drummer essentially becomes a cyborg. It's interesting to see him playing and improvising with part of his arm that he doesn't totally control."

The prosthesis was created for Jason Barnes, a drummer who was electrocuted two years ago and lost his right arm below the elbow. The Atlanta Institute of Music and Media student built his own prosthetic device shortly after the accident. It wasn't very flexible. He could bang the drums by moving his elbow up and down, but couldn't control the speed or bounce of the stick without a wrist or fingers. That's when Weinberg stepped in to create a single-stick device with sensors that responds to Barnes' bicep muscles.

"Now I can flex and send signals to a computer that tightens or loosens the stick and controls the rebound," said Barnes.

Weinberg, who has already built a robotic percussionist and marimba player that use computer algorithms to improvise with human musicians, took the prosthesis a step further. He added the second stick and gave it a "musical brain."

This video is not supported by your browser at this time.

"Jason can pull the robotic stick away from the drum when he wants to be fully in control," says Weinberg. "Or he can allow it to play on its own and be surprised and inspired by his own arm responding to his drumming."  

Regardless of how he uses the extra stick, the new prosthetic has already given Barnes capabilities he hasn't had since before the amputation. It's only the beginning for Weinberg. He's using a National Science Foundation grant (IIS- 1345006) to expand the technology.

Jason Barnes can now flex his muscles to send signals to a computer, which tightens or loosens his drumstick.

"Music is very time sensitive. You can hear the difference between two strokes, even if they are a few milliseconds apart," said Weinberg. "If we are able to use machine learning from Jason's muscles (and in future steps, from his brain activity) to determine when he intends to drum and have the stick hit at that moment, both arms can be synchronized."

Weinberg says such robotic synchronization technology could potentially be used in the future by fully abled humans to control an embedded, mechanical third arm during time-sensitive operations. For example, Weinberg's anticipation algorithms could be used to help astronauts or surgeons perform complex, physical tasks in synchronization with robotic devices.

Professor Gil Weinberg (left) created a robotic prosthesis for Jason Barnes, who lost his right arm two years ago.

For Barnes, it's all about the music. Because an embedded chip can control the speed of the drumsticks, the prosthesis can be programmed to play two sticks at a different rhythm. It can also move the sticks faster than humanly possible.

"I'll bet a lot of metal drummers might be jealous of what I can do now," he said. "Speed is good. Faster is always better."

Explore further: New robotic leg gets closer to the real thing, study says

add to favorites email to friend print save as pdf

Related Stories

Creating Music With Your Cell Phone

Nov 07, 2008

(PhysOrg.com) -- If you own a cell phone, then new software created by Georgia Tech Center for Music Technology director Gil Weinberg and his students will allow you to be the next composer and performer of ...

Bionic leg undergoing clinical trials

Apr 22, 2011

(Medical Xpress) -- A "bionic" leg designed for people who have lost a lower leg is undergoing clinical trials sponsored by the US Army. The researchers hope the leg will be able to learn the patient's nerve signal patterns ...

Recommended for you

Flying robots will go where humans can't

17 hours ago

There are many situations where it's impossible, complicated or too time-consuming for humans to enter and carry out operations. Think of contaminated areas following a nuclear accident, or the need to erect ...

Will tomorrow's robots move like snakes?

Sep 16, 2014

Over the last few years, researchers at MIT's Computer Science and Artificial Intelligence Lab (CSAIL) have developed biologically inspired robots designed to fly like falcons, perch like pigeons, and swim ...

Robot Boris learning to load a dishwasher (w/ Video)

Sep 12, 2014

Researchers at the University of Birmingham in the U.K. have set themselves an ambitious goal: programming a robot in such a way as to allow it to collect dishes, cutlery, etc. from a dinner table, and put ...

Deep-sea diver hand offers freedom and feedback

Sep 12, 2014

Bodyskins and goggles are hardly the solution for divers who need to reach extreme depths. The Atmospheric Dive Suit (ADS) gives them the protection they need. Recently, The Economist detailed a technology ...

User comments : 0