Artificial intelligence create more than 100,000 new tunes based on Irish and English folk tunes

September 24, 2018, KTH Royal Institute of Technology
Researcher Bob Sturm performs one of the AI generated folk tunes. Credit: David Callahan

At turns lively and yearning, the traditional folk musics of Ireland and Britain have made their mark around the world. Now these perennially popular forms of music are helping computers learn to become a new kind of partner in music creation.

A machine learning system overseen by a researcher in Sweden has produced 100,000 new folk tunes to date, generating a diverse range of reactions from folk musicians and the public. Some of the music can even be heard on a newly-released album by an Irish folk group.

Bob Sturm, associate professor of science at KTH Royal Institute of Technology, says that the main idea of the project was to train computer models on folk music, so that they appear to have some musical intelligence, and then to "devise methods to unravel what they are actually doing," he says.

The research subsequently led to creative opportunities.

"Our work with many collaborators, such as composer Oded Ben-Tal at Kingston University in the UK, and professional musicians, has also shown how the models can serve a wider purpose: as useful partners in creating new music," Sturm says.

The project uses an off-the-shelf method called a recurrent neural network (RNN), which essentially predicts what comes next based on what it has previously seen. For training data, the team drew upon the website thesession.org, which contains tens-of-thousands of tunes transcribed by people using a short-hand language designed for folk music.

Visitors to folkrnn.org can create their own AI-generated tunes in the style of Irish and British traditional music. Credit: KTH The Royal Institute of Technology
"The resulting computer models show some ability to repeat and vary patterns in ways that are characteristic of this kind of music," Sturm says. "It was not programmed to do this using rules – it learned to do so because these patterns exist in the data we fed it."

To test the plausibility of the generated tunes, Sturm and Ben-Tal challenged a group of professional Irish traditional musicians to create an album of folk music drawing upon existing tunes and the 100,000 generated by their computer models. The result is a full-length album on which over half of the music is computer-generated. Sturm and Ben-Tal then released the album online in order to solicit reviews and comments from professionals and the public. "We had to make up a story about the album's origins in order to avoid the bias that can result when someone believes a creative product was created by a computer," Sturm says. "And now that we have reviews, we are revealing the true origins of the album."

The album can be heard and downloaded for free at: soundcloud.com/oconaillfamilyandfriends

These computer models aren't about to elbow human composers aside any time soon, Sturm says. "Music is and always will be a human activity. Our models are merely generating sequences of symbols that require trained musicians to transform into music, or even to decide not to waste the time.

"But strange, unexpected, and sometimes wonderful things occur when models venture outside their limited knowledge," he says. "If we push a model just a bit away from patterns it has seen, it can fail catastrophically. Unlike a human, the system isn't able to generalize beyond a very specific context." Much of what the researchers originally thought the system learned about key features of folk music, such as variation and repetition, it hadn't learned after all.

The models' idiosyncratic knowledge of music notwithstanding, Sturm and his colleagues are the pursuing the question of whether they can augment music creation. They created an online implementation at folkrnn.org, where anyone can explore the models for themselves. They also created an online project called The Machine Folk Session themachinefolksession.org: a growing collection of machine-generated folk music, which much like thesession.org serves as a collection of real .

"It will be interesting to see if this collection is used to train future generations of computer models," Sturm says.

Explore further: From Mozart to Botzart: when machines write our music

More information: Let's Have Another Gan Ainm: An experimental album of Irish traditional music and computer-generated tunes. kth.diva-portal.org/smash/reco … 3A1248565&dswid=5373

Related Stories

Deep-learning system generates specific genre-based music

March 5, 2018

Izaro Goienetxea, a UPV/EHU researcher, has developed a method for automatically generating new tunes on the basis of a collection or corpus comprising tunes used in bertso—a form of extempore, sung, Basque verse-making. ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.