Method developed to identify musical notes at any venue

Apr 23, 2010
A new method has been developed to automatically detect and identify the musical notes in an audio file and generate sheet music. Credit: Carabias et al./ Rachel Johnson

A team of telecommunications engineers from the University of Jaen (UJA) has created a new method to automatically detect and identify the musical notes in an audio file and generate sheet music. The system identifies the notes even when the type of instrument, musician, type of music or recording studio conditions vary.

"We propose an automatic system to detect and transcribe musical notes for one-instrument musical signals which, unlike other methods, is capable of adapting to the scene", Julio José Carabias, co-author of the paper and a researcher from the Department of Telecommunications Engineering at the University of Jaen explained to SINC.

The details of the method were published recently in IEEE Transactions on Audio, Speech, and Language Processing. The fact that the new system can "adapt" means it will work even if elements such as the type of instrument, music, style, studio or microphone position vary.

"Automatic music transcription has many practical applications for musicological analysis and is of enormous assistance, for example, in recovering musical content, separating audio sources and codifying or converting audio files", Carabias says.

The researchers start with a 'wav' file, a common format for audio recordings, and after applying the method they obtain a 'midi' file, a musical instrument communication protocol that makes it possible to visualise the sheet music and listen to the result.

Harmonic Dictionary

"Another advantage of this method is that it does not require prior training with a musical database," the engineer highlights. What the technique does determine is the note or 'spectral pattern' of the musical notes of an instrument, which are used to compile a harmonic dictionary.

In music, people talk about 'harmonicity' when the energy produced by a note is distributed across the multiple positions of a fundamental frequency. The distribution of the harmonic energy of a musical note is what defines its spectral pattern. The harmonic diction is a matrix in which the typical spectral patterns of all musical notes are represented.

With the help of this dictionary and a computer algorithm called 'Matching Pursuit', the musical notes with patterns that most resemble the harmonic dictionary are identified. While the method can only be applied to files with one sole instrument at present, the scientists are already investigating how it can be applied to several.

Explore further: Lifting the brakes on fuel efficiency

More information: J. J. Carabias-Orti, P. Vera-Candeas, F. J. Cañadas-Quesada y N. Ruiz-Reyes. "Music Scene-Adaptive Harmonic Dictionary for Unsupervised Note-Event Detection". IEEE Transactions on Audio, Speech, and Language Processing 18 (3): 473 - 486, marzo de 2010.

Provided by FECYT - Spanish Foundation for Science and Technology

4.6 /5 (10 votes)

Related Stories

Ray Charles really did have that swing

Dec 04, 2006

Ray Charles was really good at snapping, said musical acoustician Kenneth Lindsay of Southern Oregon University in Ashland. Charles's snaps that open "It Don't Mean a Thing (If It Ain't Got That Swing)" are timed so well ...

Scientists study music hallucinations

Jul 12, 2005

Psychiatrists at St. Cadoc's Hospital in Wales have issued the largest case-series study ever published concerning musical hallucinations.

Intelligent DJ Emerges from Fundamental Research

Jun 22, 2009

(PhysOrg.com) -- An Austrian project has made the leap from research bench to shop shelf and is breathing musical intelligence into a digital audio system. This achievement has been made possible by a computer ...

Recommended for you

Finnish inventor rethinks design of the axe

1 hour ago

(Phys.org) —Finnish inventor Heikki Kärnä is the man behind the Vipukirves Leveraxe, which is a precision tool for splitting firewood. He designed the tool to make the job easier and more efficient, with ...

Lifting the brakes on fuel efficiency

Apr 18, 2014

The work of a research leader at Michigan Technological University is attracting attention from Michigan's Governor as well as automotive companies around the world. Xiaodi "Scott" Huang of Michigan Tech's ...

Large streams of data warn cars, banks and oil drillers

Apr 16, 2014

Better warning systems that alert motorists to a collision, make banks aware of the risk of losses on bad customers, and tell oil companies about potential problems with new drilling. This is the aim of AMIDST, the EU project ...

User comments : 0

More news stories

Finnish inventor rethinks design of the axe

(Phys.org) —Finnish inventor Heikki Kärnä is the man behind the Vipukirves Leveraxe, which is a precision tool for splitting firewood. He designed the tool to make the job easier and more efficient, with ...

Making graphene in your kitchen

Graphene has been touted as a wonder material—the world's thinnest substance, but super-strong. Now scientists say it is so easy to make you could produce some in your kitchen.

Poll: Big Bang a big question for most Americans

Few Americans question that smoking causes cancer. But they have more skepticism than confidence in global warming, the age of the Earth and evolution and have the most trouble believing a Big Bang created the universe 13.8 ...