Science says Kandinsky was right – paintings can be heard

Sep 04, 2006

We all link music and art, but only a tiny minority of us is aware of the crossover of senses in our brains, according to a UCL (University College London) neuroscientist, speaking today at the BA Festival of Science. New research has found that vision and hearing are inextricably interlinked in everyone’s brain, but only synaesthetes, who have a rare condition in which the senses mingle, are conscious of it.

The results show that most of us prefer image and sound combined, rather than either in isolation. We also tend to agree on which images match particular sounds. This could have implications for how we understand art and develop art forms that combine visual images with sound – such as ballet, opera, visual jockeying and animation.

In his talk at the ‘Beautiful Brains’ symposium, Dr Jamie Ward, of the UCL Department of Psychology, said: “Kandinsky wanted to make visual art more like music – more abstract. He also hoped that his paintings would be ‘heard’ by his audiences. This seems more achievable now that we have found such a strong link between vision and hearing.

“Although information from the world enters our heads via different sensory organs – the eyes and ears in this instance – once they are in the brain they are intimately connected with each other. Impressively, they are connected in non-random ways, so that some combinations of sound and vision go together better than others.”

During a series of experiments, Dr Ward asked six synaesthetes to draw and describe their visual experiences of music played by the New London Orchestra. A control group of six people without the condition were asked to do the same. Animated films, combining the music and drawn images were created by an animator, Sam Moore of the University of Wolverhampton, and shown to the public visiting London’s Science Museum. A hundred images were shown to over 200 people and these visitors were asked to choose the image that provided the best fit to the music. Respondents consistently chose the images drawn by synaesthetes over control images. This shows that while people without synaesthesia are not able to hear a painting or see a piece of music in a literal sense, they are able to sense the crossover and tend to choose the ‘correct’ image.

Dr Ward said: “While some synaesthetes can actually hear a Kandinsky in a very real way, the rest of us don’t have such a pronounced crossover of senses. But, this research shows that all of us have links between our hearing and vision – even if we don’t really realise it. We hope that understanding synaesthesia will enable us to understand more about how our senses are linked in our brains, and how this may help us create and appreciate works of art that combine music and sound.”

Describing ‘Composition VIII, 1923’ by Kandinsky, one synaesthete said: “The jumbled mass of lines gave various tones, which changed as my eyes travelled round the picture. When looking at the large multicoloured powerful circle at upper left, I get a pure tone which can be too much, so to relieve my mind of this I travel back to the cacophony of jumbled lines and shapes. This painting therefore is a good balance of contrasting noise – pure tones and cacophony – which was a delight to see. The more I looked at it, the more I came to appreciate the image and to like the ‘music’.”

Another synaesthete, describes her experience of this painting: “There is a huge splurge of sound left-hand top – booming and vulgar! Below it is a mousy little meee sound which then translates into ‘oh’s and ‘ah’s and pops at the various circles. The lines are sharp and are moving to the right with the sound of steel – like blades scraping against one another. The triangle and boomerang shape are surprised and pop up laughing with a ‘whooo’.”

The next stage of the research will use brain scans to look at what happens in the brain of synaesthetes when Kandinsky triggers sound or when sound triggers a Kandinsky-like vision.

Source: University College London

Explore further: Art of Science 2014: Princeton launches online galleries of prize-winning images and video

add to favorites email to friend print save as pdf

Related Stories

Review: Amazon phone watches you watch it

Jun 19, 2014

Amazon set out to do something different with the unveiling of its first smartphone Wednesday. How about a completely new way of interacting with your phone, for starters?

Adobe releases Voice – free app for video storytelling

May 08, 2014

Adobe, makers of PhotoShop and other high-end presentation products, has clearly decided to try to break in to the low-end presentation market currently evolving in the tablet computer or smartphone market—this ...

Review: Updated HTC One phone worth considering

Mar 25, 2014

The HTC One might be the best smartphone you never heard of. The phone won critical acclaim last year, yet it barely made a dent in the marketplace. It's overshadowed by Apple's iPhones and Samsung's Galaxy ...

Detecting gravitational waves at your desk

Mar 24, 2014

Physics is on the front pages of newspapers around the world. This time it is because of the announcement made by a team of scientists who seem to have found indirect evidence for the existence of "primord ...

Recommended for you

How to win a Tour de France sprint

23 hours ago

The final dash to the line in a Tour de France sprint finish may appear to the bystander to be a mess of bodies trying to cram into the width of a road, but there is a high degree of strategy involved. It ...

Bible museum planned for US capital

Jul 18, 2014

The devout Christian family that upended a part of President Barack Obama's health care law aims to open a Bible museum in Washington in 2017, a spokesperson for the project said Friday.

User comments : 0