New software application uses artificial intelligence to calculate images of reality based on incomplete data

February 28, 2019, Max Planck Society
Gazing at the universe: The spatial structure of interstellar dust clouds reconstructed from data from the Gaia space observatory. Credit: MPA

Advances in the field of metrology have resulted in totally novel instruments the raw data of which needs to be presented in images comprehensible to human beings, which is why Torsten Enßlin's group at the Max Planck Institute for Astrophysics in Garching has been researching information field theory for the past decade. Building upon this theory, the team develops imaging software known as NIFTy, which is able to process data from different instruments to deduce the structural properties of a given observation. NIFTy5, for example, used data from the Gaia space observatory to determine the spatial distribution of dust clouds in the Milky Way.

Astronomers are now making observations of the universe in nearly all wavelengths, but, in contrast with telescopes for example, the information recorded by radio telescopes is delivered in the form of X-rays and gamma rays. The majority of images obtained from these instruments are the result of complex calculations developed specifically for each individual telescope.

However, a complete picture of a given celestial object can only be created by comparing the data from different fields, which is why it is desirable to combine the images from all these instruments.

This is possible using a concept known as information field theory, which works in the following manner: assuming one wishes to depict the temperature distribution over Germany, this would correspond, in theory, to an infinitely large range of temperature values. Yet, in practical terms, only a finite number of values can be measured.

A computer calculates the entire temperature field based on this incomplete coverage. To ensure a successful result, the computer is primed with certain known laws – for example that temperature differences rarely leap between adjacent areas.

The Information Field Theory Group at the Max Planck Institute for Astrophysics has released a new version of the NIFTy software for scientific imaging. NIFTy5 generates an optimal imaging algorithm from the complex probability model of a measured signal. Credit: Max Planck Society

NIFTy (Numerical Information Field Theory), with which Torsten Enßlin and his colleagues succeeded in determining the spatial distribution of dust clouds in the Milky Way, operates on the same principle, using data from the European space observatory, Gaia, which measures the distances between stars and records them through several colour filters.

The differential brightness of these filter fields makes it possible to estimate the dust volumes through which the starlight has passed en route to earth. "From the positions of the stars and dust volumes between us and them," says Enßlin "we were able to calculate the spatial structure of the dust clouds."

The challenging thing about this task was that the available data was actually too scant for an accurate reconstruction, which is why, as Enßlin says "we assumed that rather than varying arbitrarily from pixel to pixel, the dust density would obey statistical laws." Physicists talk of a correlation, yet this correlation function is often unknown and must be determined as part of the overall calculation. "That's why," the Max-Planck researcher explains, "we continuously check which correlation function fits best with the data throughout the entire calculation and use it for imaging. This method of non-parametric self-adjustment of the process makes us the global leaders in this field."

Based on the correlation data, NIFTy5 not only generates a map of the but also provides a chart that shows the degree of uncertainty of the accuracy of the model for every single pixel.

The human brain works in a similar way. If we look at something like a particular landscape, it develops various hypotheses about the structure of what it is seeing whilst simultaneously applying them as operating instructions – for example for deciding on the best route through a given locality.

Reconstruction of an artificial wave field: the simulated wave field is shown at the top whereby time flows from left to right and the positional location is on the vertical axis. The waves are generated by random events on the peaks of the triangular structures. The central section of the image shows the measured values for the upper field at a few locations. The reconstruction of the field based only on this measured data, with no prior knowledge of the relevant dynamics, is shown below. The dynamics were also reconstructed from the data. Thus, all fundamental structures are actually discovered. Credit: © MPA

Enßlin's team used an artificially generated scene to prove that NIFTy5 really works. To do this, the researchers created a wave field on the computer based on random events then dotted it with fragmentary measuring points that only covered part of the entire wave system. The programme then reconstructed the entire wave from the data with no prior knowledge of the wave dynamics, an understanding of which it learned.

In addition, NIFTy5 has become faster due to further mathematical innovations, including the implementation of a process known as "variational inference by means of metric Gauß", which requires far less memory space for the calculation than was formerly the case.

"Not only does this make NIFTy5 faster than its precursors, it also gets by with poorer-quality data," Enßlin explains. This, he goes on to say, may make it possible to reduce exposure to X-rays during computed tomography imaging, whilst retaining the same image quality.

NIFTy5 has already been used to solve a series of astronomical imaging problems. A planned collaboration with the Technical University of Munich could result in the use of the all-round software in daily life.

Explore further: Visual assistance for cosmic blind spots

Related Stories

Visual assistance for cosmic blind spots

November 23, 2009

A bit of imagination on the part of a measuring instrument wouldn't be a bad thing. It could help to add data from areas where the instrument is unable to measure. However, it must do so constructively. In order to infer ...

Image: Newborn stars blow bubbles in the Cat's Paw Nebula

October 24, 2018

This image from NASA's Spitzer Space Telescope shows the Cat's Paw Nebula, so named for the large, round features that create the impression of a feline footprint. The nebula is a star-forming region in the Milky Way galaxy, ...

Image: The magnetic field along the galactic plane

December 16, 2014

While the pastel tones and fine texture of this image may bring to mind brush strokes on an artist's canvas, they are in fact a visualisation of data from ESA's Planck satellite. The image portrays the interaction between ...

Herschel reveals a ribbon of future stars

March 30, 2016

Star formation is taking place all around us. The Milky Way is laced with clouds of dust and gas that could become the nursery of the next generation of stars. Thanks to ESA's Herschel space observatory, we can now look inside ...

Recommended for you

Catalyst advance removes pollutants at low temperatures

March 25, 2019

Researchers at Washington State University, University of New Mexico, Eindhoven University of Technology, and Pacific Northwest National Laboratory have developed a catalyst that can both withstand high temperatures and convert ...

EPA adviser is promoting harmful ideas, scientists say

March 22, 2019

The Trump administration's reliance on industry-funded environmental specialists is again coming under fire, this time by researchers who say that Louis Anthony "Tony" Cox Jr., who leads a key Environmental Protection Agency ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.