Music-playing robot developed by Drexel students

Mar 17, 2011

Only a decade ago, musically-aware humanoids, or robots, equipped to play popular songs on the piano and dance to audio beats could have come to life only in a science fiction film, but for Drexel University graduate student Alyssa Batula developing a music-playing robot is very much a reality.

Batula and her collaborators led by Dr. Youngmoo Kim, assistant professor of electrical and computer engineering at Drexel and director of Drexel’s and Entertainment Technology Laboratory, are pursuing a long-term goal of enabling a to be an interactive participant in a live music ensemble with other performers.

“Through projects like these, we learn about human creativity and human expression,” said Kim. “These are extremely difficult to study and quantify but by teaching a robot to mimic creative performance, we also reveal insights about human capabilities and are better able to understand them.”

RoboNova, one of several humanoids used for research by two Drexel engineering labs—the Music and Entertainment Technology Laboratory (MET-lab) and the Drexel Autonomous Systems Laboratory (DASL)—is a miniature humanoid for rapid prototyping and testing. The RoboNova kit can be configured as a humanoid, so it can mimic some human gestures.

Kim and a team of researchers that included Batula enabled the RoboNova to perform a variety of tasks, such as to dance to live music and to play the piano. The team created videos of RoboNova playing “Chopsticks” and “Twinkle Twinkle Little Star,” as well as a dance number to a real-time audio beat track. RoboNova is also being studied for more than its entertainment value.

“From a research and psychological perspective if we can get a humanoid robot to play like a human performer, researchers could use it to study musicians’ gestures and see how these gestures affect the quality of the performance,” said Batula, an electrical engineering major.

RoboNova has provided researchers with the ability to review physical actions when it comes to a musical performance.

“It’s impossible for humans to repeat a performance exactly, and equally impossible for humans to make precisely pre-defined changes, but a robot can be programmed to do that,” said Kim. “In teaching the or exploring different variations, we learn more about how humans perform.

MET lab is devoted to research in digital media technologies that will shape the future of entertainment, especially in the areas of sound and music. MET-lab's research spans the following music and entertainment applications: music production and playback technology, machine listening and music information retrieval, and new music interfaces and robotics.

DASL, under the direction of Dr. Paul Oh of the mechanical engineering and mechanics department at Drexel, consists of students from the freshman level to doctoral candidates. The lab is a multidisciplinary environment with projects and students coming from electrical and computer engineering, mechanical engineering, computer science, and even psychology. Current projects range from unmanned aerial/ground vehicle applications to humanoid robotics.

Explore further: Germ-zapping robot could support war against Ebola (w/ Video)

add to favorites email to friend print save as pdf

Related Stories

Introducing Japan’s new singing robot (w/ Video)

Oct 15, 2010

(PhysOrg.com) -- A new humanoid robot, the HRP-4, has been unveiled at the CEATEC Japan 2010 trade show. The robot, nicknammed "diva-bot," has learned to sing by mimicking a human singer, enabling it to sound ...

Music and spirituality may be legacies of motherese: expert

Jan 31, 2011

(PhysOrg.com) -- Ancient humans may have developed a capacity for music and a sense of spirituality linked to music because of the foetal/infant-maternal bond, according to international authority on the origins of music, ...

Recommended for you

New iPad cellular models have Apple SIM flexibility

Oct 19, 2014

Cellular-enabled iPad models are under a new paradigm, said AppleInsider, regarding the Apple SIM. Apple's newest iPad models with cellular connectivity use a SIM card which tech sites said could eventually ...

MasterCard, Zwipe announce fingerprint-sensor card

Oct 18, 2014

On Friday, MasterCard and Oslo, Norway-based Zwipe announced the launch of a contactless payment card featuring an integrated fingerprint sensor. Say goodbye to PINs. This card, they said, is the world's ...

User comments : 0