Music Technology Researchers Create New Robotic Percussionist

Nov 07, 2008
Music Technology Researchers Create New Robotic Percussionist
Shimon is able to interact with his human counterparts on a much more social level. The robot’s head is made to be more interactive and give fellow musicians social cues that relate to the music it’s playing.

(PhysOrg.com) -- Georgia Tech has created an improved version of the robotic percussionist. The second edition, named Shimon, is designed to play a melodic instrument – the marimba. It, therefore, utilizes more sophisticated algorithms for music perception and improvisation in comparison to Haile, Georgia Tech’s first robotic drummer. The robot can also create richer sound and more communicative visual cues.

Shimon is able to interact with his human counterparts on a much more social level. The robot’s head is made to be more interactive and give fellow musicians social cues that relate to the music it’s playing.

Video is available here

“I really wanted to make this robot more socially dynamic to enrich the interaction experience for the human musicians,” said Gil Weinberg, director of Music Technology. “We start with simple social cues such as recognizing a beat and moving the robot’s head. Sort of getting itself into the groove.”

Shimon is able to interact with his human counterparts on a much more social level. The robot’s head is made to be more interactive and give fellow musicians social cues that relate to the music it’s playing.

“I really wanted to make this robot more socially dynamic to enrich the interaction experience for the human musicians,” said Gil Weinberg, director of Music Technology. “We start with simple social cues such as recognizing a beat and moving the robot’s head. Sort of getting itself into the groove.”

“There is really a back channel of social cues that go on between musicians,” said Andrea Thomaz, assistant professor in the School of Interactive Computing, who is collaborating with Weinberg on building the robot’s head. “Shimon’s head is really meant to take Gil’s robotic musicians into that realm of being a true social collaborative music partner.”

“When a guitar player and a drummer want to finish a piece together, there are synchronization and anticipation social cues given,” said Weinberg. “With Shimon, there are four arms that stretch over a large instrument that give other musicians anticipatory cues of what is going to happen next.”

Shimon is able to interact with the environment around it, analyze rhythm, melodies and harmony and use his musical understanding to improvise with humans.

Weinberg says that it can help study the way we think and play music because it expands the knowledge we have about music making and the musical mind.

Haile, Weinberg’s first robotic percussionist, played in venues all around the world and has led to additional research in human-robotic interaction. The Robotic Musicianship project, which led to the development of Shimon, was supported by NSF and by the GVU Research Innovation grant.

Provided by Georgia Institute of Technology

Explore further: Classroom acoustics for architects

Related Stories

Advertisers look with empathy into your front room

Feb 03, 2014

Technology is under development to enable advertisers to target products not just at a broad group of people that might be watching a certain type of programme but at specific households and even individuals.

Apple TV adds HBO Go, WatchESPN to line up

Jun 19, 2013

Apple on Wednesday added HBO GO and WatchESPN to the line-up of programming available on its Apple TV devices that stream shows from the Internet to living room screens.

Google+ 'Hangouts' grow in popularity

Feb 23, 2012

David Resnick used it to break through the anxiety and isolation of people who stutter. Joe Saad launched a business. M. Monica Malone, an extrovert whose damaged immune system left her a shut-in, found a ...

Robots to the rescue (w/ Video)

Mar 14, 2011

Researchers are exploring ways to make rescue robots less "creepy" and more user-friendly, incorporating lessons learned from studies of how humans interact with technology

Recommended for you

Team develops faster, higher quality 3-D camera

1 hour ago

When Microsoft released the Kinect for Xbox in November 2010, it transformed the video game industry. The most inexpensive 3-D camera to date, the Kinect bypassed the need for joysticks and controllers by ...

Researchers finding applications for tough spinel ceramic

11 hours ago

Imagine a glass window that's tough like armor, a camera lens that doesn't get scratched in a sand storm, or a smart phone that doesn't break when dropped. Except it's not glass, it's a special ceramic called ...

Classroom acoustics for architects

Apr 23, 2015

The Acoustical Society of America (ASA) has published a free online booklet for architects to aid in the application of ANSI/ASA S12.60-2010/Part 1-American National Standard Acoustical Performance Criteria, Design Requirements, ...

JRC wins competition on indoor localization

Apr 23, 2015

A team of JRC researchers outperformed 27 teams from academia and industry across the globe and achieved best overall result at a competition on indoor localisation in Seattle, USA. Providing accurate position ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.