Build music with blocks: Audio d-touch

Aug 24, 2011
This is the audio d-touch system in use. Credit: University of Southampton

Researchers at the University of Southampton have developed a new way to generate music and control computers.

"Grab a block and add a base beat, turn a block to speed up the high hat and we have a new way to generate music through controlling the ," said Dr Enrico Costanza at the University's ECS - Electronics and Computer Science, who is launching d-touch (Thursday 25 August).

Audio d-touch, which is based on Dr Costanza's research into tangible user interfaces, or TUIs, gives physical control in the immaterial world of computers. It uses a standard computer and a web cam. Through using simple computer vision techniques, physical blocks are tracked on a printed board. The position of the blocks then determines how the computer samples and reproduces sound.

"As more of our world moves into the electronic; records to mp3s, books to eBooks, we loose the satisfying richness of touching physical objects like paper and drumsticks," said Dr Costanza.

"Our Audio d-touch system allows people to set up and use tangible interfaces in their own home, office or recording studio, or wherever else they like," said Dr Costanza. This is the first time that anyone has developed a free application like this."

This video is not supported by your browser at this time.

Audio d-touch is more than just for play: TUIs are an alternative to virtual worlds. Human-Computer Interaction researchers are investigating ways to move away from the online, purely digital world and rediscover the richness of our .

Dr Costanza has developed Audio d-touch over several years, "Our aim is to advance the field by gaining insight into how tangible interfaces can be used in the real world. We are keen to have more people download audio d-touch and give us feedback so that we can improve it."

All that is needed is a regular computer equipped with a web-cam and a printer. The user creates physical interactive objects and attaches printed visual markers recognized by Audio d-touch. The is open and can be extended for applications beyond music synthesis.

Explore further: The ethics of driverless cars

More information: d-touch.org/

Related Stories

Scuppering pirates improves internet audio

Aug 09, 2007

A new digital watermarking system not only protects music and media files from online pirates but also ensures that the quality for legitimate users is as good as it gets.

Virtual reality you can touch (w/ Video)

Aug 19, 2010

Researchers at the Computer Vision Lab at ETH Zurich, Switzerland, have developed a method with which they can produce virtual copies of real objects. The copies can be touched and even sent via the Internet. ...

Dolby brings theater sound to new-age gadgets

Jan 07, 2010

Dolby Laboratories is out to make sure people's ears are as delighted as their eyes in a world enthralled by high-definition televisions and entertainment on the go.

Virtual maps for the blind

Sep 10, 2009

The blind and visually impaired often rely on others to provide cues and information on navigating through their environments. The problem with this method is that it doesn't give them the tools to venture out on their own, ...

Recommended for you

Ahead of Emmys, Netflix already winning online

10 hours ago

Even if it doesn't take home any of the major trophies at Monday's Emmy Awards, Netflix will have already proven itself the top winner in one regard: Internet programming.

US warns shops to watch for customer data hacking

10 hours ago

The US Department of Homeland Security on Friday warned businesses to watch for hackers targeting customer data with malicious computer code like that used against retail giant Target.

Official says hackers hit up to 25,000 US workers

10 hours ago

The internal records of as many as 25,000 Homeland Security Department employees were exposed during a recent computer break-in at a federal contractor that handles security clearances, an agency official said Friday.

Oregon sues Oracle over failed health care website

20 hours ago

Oregon Attorney General Ellen Rosenblum says she's filed a lawsuit against Oracle Corp. and several of its executives over the technology company's role in the state's troubled health insurance exchange.

Google buys product design firm Gecko

20 hours ago

Google on Friday confirmed that it bought Gecko Design to bolster its lab devoted to technology-advancing projects such as self-driving cars and Internet-linked Glass eyewear.

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

CHollman82
1 / 5 (1) Aug 24, 2011
It's neat but a waste of time and energy... "Rediscover the richness of our sense of touch", really? Give me a break, you touch your mouse and keyboard. Most common HID's are based on touch, this one is just different, not better. In fact this is much less intuitive and efficient than a traditional GUI would be for doing the same thing.

TUI's that provide tactile feedback for specific purposes, such as controls to manipulate a robotic arm to perform micro-surgery, are a different story of course.