Build music with blocks: Audio d-touch

August 24, 2011
This is the audio d-touch system in use. Credit: University of Southampton

Researchers at the University of Southampton have developed a new way to generate music and control computers.

"Grab a block and add a base beat, turn a block to speed up the high hat and we have a new way to generate music through controlling the ," said Dr Enrico Costanza at the University's ECS - Electronics and Computer Science, who is launching d-touch (Thursday 25 August).

Audio d-touch, which is based on Dr Costanza's research into tangible user interfaces, or TUIs, gives physical control in the immaterial world of computers. It uses a standard computer and a web cam. Through using simple computer vision techniques, physical blocks are tracked on a printed board. The position of the blocks then determines how the computer samples and reproduces sound.

"As more of our world moves into the electronic; records to mp3s, books to eBooks, we loose the satisfying richness of touching physical objects like paper and drumsticks," said Dr Costanza.

"Our Audio d-touch system allows people to set up and use tangible interfaces in their own home, office or recording studio, or wherever else they like," said Dr Costanza. This is the first time that anyone has developed a free application like this."

This video is not supported by your browser at this time.

Audio d-touch is more than just for play: TUIs are an alternative to virtual worlds. Human-Computer Interaction researchers are investigating ways to move away from the online, purely digital world and rediscover the richness of our .

Dr Costanza has developed Audio d-touch over several years, "Our aim is to advance the field by gaining insight into how tangible interfaces can be used in the real world. We are keen to have more people download audio d-touch and give us feedback so that we can improve it."

All that is needed is a regular computer equipped with a web-cam and a printer. The user creates physical interactive objects and attaches printed visual markers recognized by Audio d-touch. The is open and can be extended for applications beyond music synthesis.

Explore further: Color touch-screen remote to control, share and distribute content

More information: d-touch.org/

Related Stories

Scuppering pirates improves internet audio

August 9, 2007

A new digital watermarking system not only protects music and media files from online pirates but also ensures that the quality for legitimate users is as good as it gets.

Virtual maps for the blind

September 10, 2009

The blind and visually impaired often rely on others to provide cues and information on navigating through their environments. The problem with this method is that it doesn't give them the tools to venture out on their own, ...

Virtual reality you can touch (w/ Video)

August 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. By incorporating ...

Recommended for you

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

CHollman82
1 / 5 (1) Aug 24, 2011
It's neat but a waste of time and energy... "Rediscover the richness of our sense of touch", really? Give me a break, you touch your mouse and keyboard. Most common HID's are based on touch, this one is just different, not better. In fact this is much less intuitive and efficient than a traditional GUI would be for doing the same thing.

TUI's that provide tactile feedback for specific purposes, such as controls to manipulate a robotic arm to perform micro-surgery, are a different story of course.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.