Finding the unknowns in the universe

December 13, 2016 by Ray Norris, The Conversation
Part of CSIRO’s ASKAP antennas at the Murchison Radio-astronomy Observatory (MRO) in Western Australia. Credit: Australian SKA Office/WA Department of Commerce, CC BY-ND

What have pulsars, quasars, dark matter and dark energy got in common? Answer: each of them took the discoverer by surprise. While much of science advances carefully and methodically, the majority of truly spectacular discoveries in astronomy are unexpected.

Many of our telescopes are built to discover the known unknowns: the things we know we don't know, such as identifying the stuff that makes up dark matter.

But the real breakthroughs are the unknown unknowns. These are the things we don't even suspect are out there until we accidentally find them.

For example, of the ten greatest discoveries by the Hubble space telescope, only one featured in the proposal used to justify its construction and launch. That one, measuring the rate of expansion of the universe, is a known unknown.

In other words, we had a question about something that we knew about, and we thought Hubble could answer the question. Most of the other discoveries are unknown unknowns: we didn't know what they were until we stumbled across them.

They include the discovery of dark energy, the only Hubble discovery (so far) to win a Nobel prize, in 2011.

A chance discovery

Consider pulsars. They were discovered in the 1960s when a bright young PhD student in the UK, Jocelyn Bell Burnell, was studying the twinkling of radio waves by electrons in space (a known unknown).

She noticed odd bits of what she called "bits of scruff" on her chart recorder, and realised they were something much more startling than mere tractor interference, and thereby discovered pulsars – an unknown unknown – for which her supervisor Antony Hewish won the 1974 Nobel prize for physics.

So how did she make that discovery?

Apart from being a bright, persistent, open-minded student, Bell Burnell was also observing the universe in a way in which it had never been observed before. By looking at rapid changes in the , she was observing the universe using a parameter – in this case short timescale observations – that hadn't been used before.

Other discoveries happen when people observe with a different parameter, such as faintness, or area of sky, that hasn't been observed before. Together, these parameters make up our parameter space.

Most major astronomical discoveries seem to happen when somebody observes a new part of parameter space; observing the universe in a way it hasn't been observed before.

This new way might consist of looking more deeply, or with better resolution, or on a larger scale, or maybe just seeing much more of the universe. Extending any of these parameters into their unexplored regions is likely to lead to an unexpected discovery.

Right now several next-generation telescopes are being built, boldly going where no telescope has gone before. They will significantly expand the volume of observational parameter space, and should in principle discover unexpected new phenomena and new types of object.

For example, CSIRO's A$165-million ASKAP telescope, now nearing completion, is exploring several areas of uncharted parameter space, with an excellent chance of stumbling across a major unexpected discovery that could shake the scientific world.

But will we recognise it when we see it? Probably not.

Bell Burnell discovered pulsars by laboriously sifting through all her data, and noticed a tiny anomaly that didn't fit her understanding of the telescope.

How much data?

If Bell Burnell were observing with ASKAP, she would have to sift through about 80 petabytes of data a year, from a machine that is so complex that nobody truly understands every bit of it. Sorry, not even Bell Burnell's brain is up to the task of sifting through that amount of data.

We cannot possibly examine all that data by eye. So the way we do our science is that we decide on the scientific question we are asking, and turn it into a data query.

We then mine the database looking for those bits of data that will answer our question.

This is a very efficient way of answering the known unknowns. Sadly, it is useless at finding the unknown unknowns. We only receive answers to the questions that we ask, and not to the questions that we didn't know we ought to ask.

Now remember the Hitchhiker's Guide to the Galaxy science fiction/fantasy series by author Douglas Adams? When a giant computer, Deep Thought, found the answer to "life, the universe, and everything" to be 42, another, even bigger, computer had to be built to find out what the actual question was.

So can we design a machine, or a piece of software, to replicate Bell Burnell's brain in detecting unknown unknowns but working comfortably with petabytes of data and unbelievably complex telescopes?

WTF into the unknowns

I think we can, and we've already started the project WTF, which stands for Widefield ouTlier Finder, with the progress so far published just last month. The WTF machine will sift through the petabytes of data, searching for something unexpected, without knowing exactly what it's looking for.

The trick is to use machine learning techniques, where we teach the software about all the things we know about, and then ask it to find things we don't know about.

For example, it might plot a graph of radio brightness against optical colour. On that graph, it would find a cluster of quasars grouped together, another cluster of galaxies like the Milky Way, and so on.

Maybe it will find another cluster of objects that we didn't expect and didn't know about. Our puny brains couldn't make more than a small dent into all the possible graphs that need to be plotted, but WTF will take these in its stride.

This process won't be easy. At first, WTF will probably turn up things we forgot to tell it, and it will also find radio interference and instrumental artefacts.

As we gradually teach it what these are, it will start to recognise truly new objects and phenomena. More significantly, it will start to learn new things from the data that are made invisible to our brains by their sheer multidimensional complexity, but will be grist to the mill for WTF.

We expect WTF to become smarter than us, able to find those rare discoveries buried in the . Perhaps WTF may even win the first non-human Nobel prize.

Explore further: How citizen scientists discovered a giant cluster of galaxies

Related Stories

How fast is the universe expanding?

February 10, 2015

The Universe is expanding, but how quickly is it expanding? How far away is everything getting from everything else? And how do we know any of this anyway?

Space... the final frontier

July 21, 2016

Fifty years ago Captain Kirk and the crew of the starship Enterprise began their journey into space—the final frontier. Now, as the newest Star Trek film hits cinemas, the NASA/ESA Hubble space telescope is also exploring ...

Recommended for you

Neutron-star merger yields new puzzle for astrophysicists

January 18, 2018

The afterglow from the distant neutron-star merger detected last August has continued to brighten - much to the surprise of astrophysicists studying the aftermath of the massive collision that took place about 138 million ...

New technique for finding life on Mars

January 18, 2018

Researchers demonstrate for the first time the potential of existing technology to directly detect and characterize life on Mars and other planets. The study, published in Frontiers in Microbiology, used miniaturized scientific ...

North, east, south, west: The many faces of Abell 1758

January 18, 2018

Resembling a swarm of flickering fireflies, this beautiful galaxy cluster glows intensely in the dark cosmos, accompanied by the myriad bright lights of foreground stars and swirling spiral galaxies. A1758N is a sub-cluster ...


Adjust slider to filter visible comments by rank

Display comments: newest first

Dec 14, 2016
This comment has been removed by a moderator.
Dec 14, 2016
This comment has been removed by a moderator.
Dec 14, 2016
This comment has been removed by a moderator.
Dr_ Rock
not rated yet Dec 14, 2016
THIS TREAT new insights into structure of the Universe, and it is not desirable that I was not involved when this was used in its evidence of some phenomena in the universe.

That is a pity. And now? You work at the local Burger King?
5 / 5 (2) Dec 14, 2016
While much of science advances carefully and methodically, the majority of truly spectacular discoveries in astronomy are unexpected.

Which is why doing science is so much more fun than doing...well...anything else.
This does not suggest that we should forego methodical work. Methodical work is what gets you to places where surprises lurk. Without it you would never know one way or another.

I think we can, and we've already started the project WTF,

Gotta love that name.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.