Particle physicists team up with AI to solve toughest science problems

August 2, 2018 by Manuel Gnida, SLAC National Accelerator Laboratory
Credit: CC0 Public Domain

Experiments at the Large Hadron Collider (LHC), the world's largest particle accelerator at the European particle physics lab CERN, produce about a million gigabytes of data every second. Even after reduction and compression, the data amassed in just one hour is similar to the data volume Facebook collects in an entire year – too much to store and analyze.

Luckily, particle physicists don't have to deal with all of that all by themselves. They partner with a form of artificial intelligence called that learns how to do complex analyses on its own.

A group of researchers, including scientists at the Department of Energy's SLAC National Accelerator Laboratory and Fermi National Accelerator Laboratory, summarize current applications and future prospects of machine learning in particle physics in a paper published today in Nature.

"Compared to a traditional computer algorithm that we design to do a specific analysis, we design a machine learning algorithm to figure out for itself how to do various analyses, potentially saving us countless hours of design and analysis work," says co-author Alexander Radovic from the College of William & Mary, who works on the NOvA .

Sifting through big data

To handle the gigantic data volumes produced in modern experiments like the ones at the LHC, researchers apply what they call "triggers" – dedicated hardware and software that decide in real time which data to keep for analysis and which data to toss out.

In LHCb, an experiment that could shed light on why there is so much more matter than antimatter in the universe, machine learning algorithms make at least 70 percent of these decisions, says LHCb scientist Mike Williams from the Massachusetts Institute of Technology, one of the authors of the Nature summary. "Machine learning plays a role in almost all data aspects of the experiment, from triggers to the analysis of the remaining data," he says.

Machine learning has proven extremely successful in the area of analysis. The gigantic ATLAS and CMS detectors at the LHC, which enabled the discovery of the Higgs boson, each have millions of sensing elements whose signals need to be put together to obtain meaningful results.

"These signals make up a complex data space," says Michael Kagan from SLAC, who works on ATLAS and was also an author on the Nature review. "We need to understand the relationship between them to come up with conclusions, for example that a certain particle track in the detector was produced by an electron, a photon or something else."

Neutrino experiments also benefit from machine learning. NOvA, which is managed by Fermilab, studies how neutrinos change from one type to another as they travel through the Earth. These neutrino oscillations could potentially reveal the existence of a new neutrino type that some theories predict to be a particle of dark matter. NOvA's detectors are watching out for charged produced when neutrinos hit the detector material, and machine learning algorithms identify them.

From machine learning to deep learning

Recent developments in machine learning, often called "deep learning," promise to take applications in particle physics even further. Deep learning typically refers to the use of : computer algorithms with an architecture inspired by the dense network of neurons in the human brain.

These neural nets learn on their own how to perform certain analysis tasks during a training period in which they are shown sample data, such as simulations, and told how well they performed.

Until recently, the success of neural nets was limited because training them used to be very hard, says co-author Kazuhiro Terao, a SLAC researcher working on the MicroBooNE neutrino experiment, which studies neutrino oscillations as part of Fermilab's short-baseline neutrino program and will become a component of the future Deep Underground Neutrino Experiment (DUNE) at the Long-Baseline Neutrino Facility (LBNF). "These difficulties limited us to neural networks that were only a couple of layers deep," he says. "Thanks to advances in algorithms and computing hardware, we now know much better how to build and train more capable networks hundreds or thousands of layers deep."

Many of the advances in deep learning are driven by tech giants' commercial applications and the data explosion they have generated over the past two decades. "NOvA, for example, uses a neural network inspired by the architecture of the GoogleNet," Radovic says. "It improved the experiment in ways that otherwise could have only been achieved by collecting 30 percent more data."

A fertile ground for innovation

Machine learning algorithms become more sophisticated and fine-tuned day by day, opening up unprecedented opportunities to solve particle physics problems.

Many of the new tasks they could be used for are related to computer vision, Kagan says. "It's similar to facial recognition, except that in particle physics, image features are more abstract than ears and noses."

Some experiments like NOvA and MicroBooNE produce data that is easily translated into actual images, and AI can be readily used to identify features in them. In LHC experiments, on the other hand, images first need to be reconstructed from a murky pool of data generated by millions of sensor elements.

"But even if the data don't look like images, we can still use computer vision methods if we're able to process the data in the right way," Radovic says.

One area where this approach could be very useful is the analysis of particle jets produced in large numbers at the LHC. Jets are narrow sprays of particles whose individual tracks are extremely challenging to separate. Computer vision technology could help identify features in jets.

Another emerging application of is the simulation of particle physics data that predict, for example, what happens in particle collisions at the LHC and can be compared to the actual data. Simulations like these are typically slow and require immense computing power. AI, on the other hand, could do simulations much faster, potentially complementing the traditional approach.

"Just a few years ago, nobody would have thought that deep neural networks can be trained to 'hallucinate' data from random noise," Kagan says. "Although this is very early work, it shows a lot of promise and may help with the data challenges of the future."

Benefitting from healthy skepticism

Despite all obvious advances, machine learning enthusiasts frequently face skepticism from their collaboration partners, in part because machine learning algorithms mostly work like "black boxes" that provide very little information about how they reached a certain conclusion.

"Skepticism is very healthy," Williams says. "If you use machine learning for triggers that discard data, like we do in LHCb, then you want to be extremely cautious and set the bar very high."

Therefore, establishing machine learning in requires constant efforts to better understand the inner workings of the algorithms and to do cross-checks with real data whenever possible.

"We should always try to understand what a computer algorithm does and always evaluate its outcome," Terao says. "This is true for every algorithm, not only machine learning. So, being skeptical shouldn't stop progress."

Rapid progress has some researchers dreaming of what could become possible in the near future. "Today we're using machine learning mostly to find features in our data that can help us answer some of our questions," Terao says. "Ten years from now, machine learning algorithms may be able to ask their own questions independently and recognize when they find new physics."

Explore further: Training artificial intelligence with artificial X-rays

More information: Alexander Radovic et al. Machine learning at the energy and intensity frontiers of particle physics, Nature (2018). DOI: 10.1038/s41586-018-0361-2

Related Stories

Training artificial intelligence with artificial X-rays

July 6, 2018

Artificial intelligence (AI) holds real potential for improving both the speed and accuracy of medical diagnostics. But before clinicians can harness the power of AI to identify conditions in images such as X-rays, they have ...

New algorithm limits bias in machine learning

July 16, 2018

Machine learning—a form of artificial intelligence based on the idea that computers can learn from data and make determinations with little help from humans—has the potential to improve our lives in countless ways. From ...

Higgs boson machine-learning challenge

May 20, 2014

Last week, CERN was among several organizations to announce the Higgs boson machine-learning challengeExternal Links icon – your chance to develop machine-learning techniques to improve analysis of Higgs data.

Recommended for you

Bursting bubbles launch bacteria from water to air

November 15, 2018

Wherever there's water, there's bound to be bubbles floating at the surface. From standing puddles, lakes, and streams, to swimming pools, hot tubs, public fountains, and toilets, bubbles are ubiquitous, indoors and out.

Terahertz laser pulses amplify optical phonons in solids

November 15, 2018

A study led by scientists of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg/Germany presents evidence of the amplification of optical phonons ...

Designer emulsions

November 15, 2018

ETH material researchers are developing a method with which they can coat droplets with controlled interfacial composition and coverage on demand in an emulsion in order to stabilise them. In doing so they are fulfilling ...

Quantum science turns social

November 15, 2018

Researchers in a lab at Aarhus University have developed a versatile remote gaming interface that allowed external experts as well as hundreds of citizen scientists all over the world to optimize a quantum gas experiment ...

9 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

TheGhostofOtto1923
3.7 / 5 (3) Aug 02, 2018
Human to AI: help us to answer these questions
AI to human: you're asking the wrong questions
Itar_Pejo
5 / 5 (2) Aug 02, 2018
AI: The answer is 42. Now stop bothering me until you figure out what the question is!!
keboeu
not rated yet Aug 02, 2018
Best guess is accepted as fact ???. Hell, I can do that for a lot less money (a few million $ or so).
joel in oakland
5 / 5 (2) Aug 03, 2018
Sabine Hossenfelder (Lost in Math) quotes a number of theoretical physicists who refer to a "nightmare scenario", generally involving the continued lack of new particles showing up at the LHC, other than the Higgs, which was already predicted half a century ago, despite occasional teasers that with further investigation turn out to be noise.

She says *her* Nightmare Scenario is that important data is being discarded, because (unlike the Higgs) physicists don't actually know what they're looking for, as they are "lost in math" and intuitive concepts like "naturalness" & " beauty" (of the math). Those algorithms are looking for what the theoretical physicists *expect* to see, an approach that has often been fruitful in the more distant past but has failed miserably for the last 40 years. What if, as seems more and more likely, we're at a region or level where our intuitions about "beauty" & "naturalness" don't match the universe's notions of such things, as it were?
joel in oakland
5 / 5 (1) Aug 03, 2018
As evidence, she notes her colleagues' disdain for the math as "ugly", both for the Standard Model and Quantum Theory. While each has been remarkably successful, theoreticians keep trying - and failing - to come up with alternative formulations better matching their aesthetic values, meanwhile spending billions of (*our*) dollars then urging billions more to be spent on bigger, better colliders likely to find those supersymetric particles or evidence of energy leaking off into those extra dimensions their math needs in order to work.
Hyperfuzzy
3 / 5 (2) Aug 03, 2018
Sounds like nonsense: Tools built with known science and a computer that does not compare data to 'The Theory of the century' that has won Nobels and existed for a hundred years and is False. An experiment better done in your head. i.e. Think with Logic!
Whart1984
Aug 03, 2018
This comment has been removed by a moderator.
Surveillance_Egg_Unit
3.7 / 5 (3) Aug 06, 2018
Sounds like nonsense: Tools built with known science and a computer that does not compare data to 'The Theory of the century' that has won Nobels and existed for a hundred years and is False. An experiment better done in your head. i.e. Think with Logic!
says Hyper Fuzzball

The educated human brain will always be far superior to an AI built-in algorithm. The AI lacks the imaginative skills and ability to solve problems that cannot be solved by a set of circumstantial numerical deductions that may not be relative to reality. A Macgyver is more suitable.
Hyperfuzzy
not rated yet Aug 07, 2018
Sounds like nonsense: Tools built with known science and a computer that does not compare data to 'The Theory of the century' that has won Nobels and existed for a hundred years and is False. An experiment better done in your head. i.e. Think with Logic!
says Hyper Fuzzball

The educated human brain will always be far superior to an AI built-in algorithm. The AI lacks the imaginative skills and ability to solve problems that cannot be solved by a set of circumstantial numerical deductions that may not be relative to reality. A Macgyver is more suitable.

I didn't say that. If you realize it's just addition as the equal potential spheres update, the center of the field moves and the spherical fields update at the speed of light relative to the center. This is obvious. Coulomb! So AI should kick your behind if built with LOGIC!

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.