The importance of statistics in high-energy physics

January 20, 2012 by Achintya Rao, CERN, CERN
The search for the Higgs boson receives regular input from the Statistics Committee, especially when it comes to defining the significances of excesses.

“If you remember, Mark Twain once said, ‘There are three kinds of lies: lies, damned lies, and statistics.’ If you use statistics in an improper way, you could get pretty much any result,” says Greg Landsberg, CMS’s new physics coordinator. “The role of the CMS Statistics Committee is to interpret what we see in a statistically correct way.”

“All of our results depend on statistical procedures that we perform on the data we obtain,” adds Tommaso Dorigo, the new chairperson of the CMS Committee. Terms like “statistical significance” play a key role in categorising observed signals as hints, evidence or discovery. “Upon performing a search for a new particle or process,” Dorigo continues, “you rarely observe such a huge new signal that you do not need to quantify its size or whether it may be due to a fluctuation. You have to have a procedure with which you can give a mathematical interpretation of your data in terms of how significant your result is.”

One of the tasks of the Statistics Committee is to produce guidelines on the to be used by the many analyses within the collaboration. The team makes recommendation to the analysis teams to ensure that CMS papers do not contain statistical claims that are unsupported by the data. “It is an attempt to make our papers coherent in the way they present the results,” says Dorigo.

“By now in particle physics, we have very well-defined statistical methods. And it’s very important to use them uniformly across the collaboration and also to communicate with ATLAS, ALICE and LHCb with the view of combining results,” adds Landsberg.

In the last year, CMS has moved into the combination regime, having combined the Bs→μμ result with LHCb and the Higgs limits with half of 2011’s statistics with ATLAS. Since all of the LHC experiments are designed differently and the individual results are obtained by different methods, how to go about combining the results is not always obvious. The CMS Statistics Committee has to join forces with the other experiments in order to recommend statistical methods that are acceptable to all.

Statistics are involved not only in the mathematical framework for comparing experiment with theory but also in building the right computer tools to select interesting data from collisions. This parallel branch of statistics activities is now represented at the committee: Gennadiy Kukartsev, who is co-leading the Physics Analysis Tools group at CMS, is an ex-officio member. “In this new incarnation,” says Landsberg, “we hope that the Statistics Committee will not only make recommendations on a theoretical basis but also provide more practical tools, pieces of code and examples.”

Under a new chairperson, the committee has been enlarged from nine members to eleven. The reason: CMS has published over 100 physics papers so far, and the rate of papers will only increase with time. “The current size of the committee is just not sufficient to follow all the papers,” points out Landsberg.

The committee also provides a helpline to answer statistics questions almost in real-time, and is looking to expand this function. As more people get involved in the analyses, the greater is the demand for help in tackling statistics problems.

The interaction between the committee and the physics groups has also changed. Plans are to establish a sustainable two-way communication between the Statistics Committee and the physics conveners through regular talks and surveys. The committee’s weekly meetings are also now open to every collaborator, an important step in ensuring that the collaboration is well prepared for the statistical challenges of the coming years.

This article was originally published on the CMS website. More such articles can be found at

Explore further: LHC experiments eliminate more Higgs hiding spots (Update)

Related Stories

LHC experiments eliminate more Higgs hiding spots (Update)

August 22, 2011

( -- Two experimental collaborations at the Large Hadron Collider, located at CERN laboratory near Geneva, Switzerland, announced today that they have significantly narrowed the mass region in which the Higgs ...

Endgame for the Higgs Boson

September 14, 2011

The last missing piece of scientists’ fundamental model of particle physics is running out of places to hide.

African stats 'a numbers game' -- study

January 17, 2012

( -- International development and aid groups are making decisions and distributing funds to African nations based on national statistics that are incomplete and untrustworthy, says Simon Fraser University economic ...

Large Hadron Collider achieves 2011 data milestone

June 19, 2011

Today at around 10:50 CEST, the amount of data accumulated by Large Hadron Collider experiments ATLAS and CMS clicked over from 0.999 to 1 inverse femtobarn, signalling an important milestone in the experiments' quest for ...

Recommended for you

Information engine operates with nearly perfect efficiency

January 19, 2018

Physicists have experimentally demonstrated an information engine—a device that converts information into work—with an efficiency that exceeds the conventional second law of thermodynamics. Instead, the engine's efficiency ...

Team takes a deep look at memristors

January 19, 2018

In the race to build a computer that mimics the massive computational power of the human brain, researchers are increasingly turning to memristors, which can vary their electrical resistance based on the memory of past activity. ...

Artificial agent designs quantum experiments

January 19, 2018

On the way to an intelligent laboratory, physicists from Innsbruck and Vienna present an artificial agent that autonomously designs quantum experiments. In initial experiments, the system has independently (re)discovered ...


Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (6) Jan 21, 2012
Higgs particle doesn't exist.
The mass is the electric dipole moment.
4 / 5 (2) Jan 21, 2012
Please write the full name of terms such as Compact Muon Solenoid (CMS) before you use their acronyms throughout an article.

Even most physicists will not recognize this term before they click on the html links at the end of the article.

I realize that this was copied and pasted from the CMS website, but a few minor edits to increase clarity should have been made before it was posted at a more public forum with a readership that generally does not actually work at CERN.
1.3 / 5 (3) Jan 21, 2012
In AWT the geometry of dispersion of energy at the quantum scale replicates the dispersion of light at the cosmic scale, so that the analogy of dodecahedron geometry of dark matter could be observed there. http://th.physik....trum.png
1 / 5 (2) Jan 21, 2012
The characteristic for statistics of boundary phenomena is, they're usually vanish with higher amount of data. For example Tevatron collected over 10 inverse picobarns of integral data and it detected nothing. Many false signals of collider results in the recent past were averaged later with increasing amount of data. My estimation is, the LHC results (which collected roughly half amount of data) will face the similar destiny.
1 / 5 (1) Jan 21, 2012
CMS stands for Content Management System.
not rated yet Jan 21, 2012
CMS stands for Content Management System.
Well maybe that's what we need.
1 / 5 (1) Jan 21, 2012
Higgs particle doesn't exist.
The mass is the electric dipole moment.
Interesting remark from http://www.aps.or...012.pdf:
Black holes give off pairs of Higgs bosons, among many other thingsThey produce these Higgs particles at their horizons, and if you put a detector there, you would see them. But the detector would be gobbled up pretty quick by the black hole.
John Gunion, University of California, Davis,, December 14, 2011.

not rated yet Jan 21, 2012
If that doesn't work try google on APS NewsFebruary 2012 (Volume 21, No. 1) Entire issue

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.