Mogees project delivers haptic symphony (w/ video)

Jan 05, 2012 by Nancy Owano weblog

(PhysOrg.com) -- Creative sound-making is as fluid and changing as it implies, incorporating everything from troupes that bang on every hard surface imaginable to creators of electronic music, to musicians who craft their notes to reflect real conversation, to the new phenomenon, the Mogees.

The Mogees is a project that stems from the department of computing at Goldsmiths, University of London, where researcher Bruno Zamborlin collaborates with a team at IRCAM in Paris to experiment with new methods for “gestural interaction” in coming up with novel ways of making sounds. The project has released a video that, besides delighting every four year old on the planet, opens the minds of researchers. The video shows the use of a contact microphone and audio processing software to construct a gesture-recognizing touch interface from assorted surfaces—a tree trunk, a balloon, a glass panel at a bus stage, and an inflated balloon. Also, different gestures control different sounds.

This video is not supported by your browser at this time.

Wooden panels sound like a bicycle bell; playing on a balloon makes sounds like a crystal hanging ornament in the wind. Other surfaces reveal sounds, by slapping or brushing, hitting, or finger tapping, that include tribal string pianos in the heat of a musical narrative.

The Mogees project turns any surface into a gestural musical interface, using the button-like silver microphone and audio processing software. But just how does it work? ExtremeTech carries the more lucid of attempted explanations: The contact microphone has multiple microphones, creating a stereo image of a sound that’s made. A PC cable connection picks up the finger vibrations for analysis and converts them into gestures. A visual programming language (MaxMSP) turns the gestures into sounds.

“Mogees is an interactive gestural-based surface for realtime audio mosaicing,” is the somewhat intimidating definition appearing on the Department of Computing site at Goldsmiths. A helpful explanation, however, also contributes toward understanding what is going on.

“When the performer touches the surface, Mogees analyses the incoming audio signal and continuously looks for its closest segment within the sound database. These segments are played one after the other over time: this technique is called concatenative synthesis.”

A surface, for example, can be played with any tool such as hands and Mogees will always try to find a correspondent sound to it. It can also be applied to other sound sources such as voice or acoustic/electric instruments.

Zamborlin began the project because he liked the idea of being able to touch a real surface when creating electronic music. “Touching real surfaces allows users to experience haptic feedback on what they do and enhancing their relationship with the device."

Researcher and developer Norbert Schnell is named as part of the Mogees effort, and the project also makes reference to its use of the “MuBu environment for MaxMSP.”

Max is a visual programming language for music and multimedia; electronic use it for unique sound-making tools. The program is highly modular with most routines in the form of shared libraries. MuBu is a sound description buffer for real-time interactive audio processing.

Explore further: Revealing faded frescos

More information: www.brunozamborlin.com/mogees/

Related Stories

Sound With Space and Motion; Real Life Reflection

Jun 29, 2004

A conversation snaps around you. A string trio plays in front of you as you turn your attention from cello to violin. A soprano walks across the stage, and you turn your head to follow her voice. Conventional ...

Apple seeks patents for display and noise-out systems

Dec 11, 2011

(PhysOrg.com) -- Apple made patent news this week in two directions, toward a Kinect like system and toward a quest for excellence in sound quality on phones. It’s been reported that Apple has filed patent ...

Recommended for you

Revealing faded frescos

11 hours ago

Many details of the wall and ceiling frescos in the cloister of Brandenburg Cathedral have faded: Plaster on which horses once "galloped" appears more or less bare. A hyperspectral camera sees images that remain hidden to ...

Device could detect driver drowsiness, make roads safer

13 hours ago

Drowsy driving injures and kills thousands of people in the United States each year. A device being developed by Vigo Technologies Inc., in collaboration with Wichita State University professor Jibo He and ...

New capability takes sensor fabrication to a new level

Jun 30, 2015

Operators must continually monitor conditions in power plants to assure they are operating safely and efficiently. Researchers on the Sensors and Controls Team at DOE's National Energy Technology Laboratory ...

Smart phones spot tired drivers

Jun 30, 2015

An electronic accelerometer of the kind found in most smart phones that let the device determine its orientation and respond to movement, could also be used to save lives on our roads, according to research ...

User comments : 4

Adjust slider to filter visible comments by rank

Display comments: newest first

Isaacsname
5 / 5 (1) Jan 05, 2012
Woah.....I have to have this.......I was one of those kids that was constantly drumming on everything, I drove people crazy. That things looks like it could lead to poly-rhythmic orgasms :P

" STOP.. FIDGETING.. " Rofl

Just as a kid's toy this would be insanely fun to have, but there's other applications ...I'd love to hear spider mating rhythms through this, for ex..

.....they should get in touch with the Moog foundation here in Asheville NC, if they aren't already.

http://www.moogfoundation.org/
Isaacsname
not rated yet Jan 05, 2012
I wonder if it is sensitive enough to pick up light bouncing off a mirror ?
Xbw
1.7 / 5 (6) Jan 05, 2012
I wonder if it is sensitive enough to pick up light bouncing off a mirror ?


I doubt it.

I agree though on the applications. I wouldn't mind hooking this thing up to a tree in the park and making sweet sweet music.
Isaacsname
5 / 5 (1) Jan 05, 2012
I wonder if it is sensitive enough to pick up light bouncing off a mirror ?


I doubt it.

I agree though on the applications. I wouldn't mind hooking this thing up to a tree in the park and making sweet sweet music.

No kidding, me too. Even just hearing the rain on the tree would be great... I'm just really blown away with this...

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.