# Researchers apply Benford's law to physics exams to see if they can do better than chance

##### Nov 29, 2013 by Bob Yirka

(Phys.org) —A team of scientists who specialize in multiple-choice test assessment at Brock and Trent University's in Canada has conducted a study to find out if students could use Benford's law to help them pass multiple-choice physics tests. They have posted a paper describing their results on the preprint server arXiv.

Benford's law, named after Frank Benford, a physicist working with probability, says that the numbers 1, 2, and 3 are much more likely to appear at the beginning of multiple digit numbers that are based on real-world measurements of such things as physical constants, the addresses of random people, etc. More specifically, the number 1, the law says, will appear first in a series of digits 30 percent of the time. The number 2 will appear first 18 percent of the time and the number 3 will appear first 13 percent of the time, and so on, with higher numbers appearing less and less often.

This got the team in Canada wondering if students taking a multiple-choice test might be able to do better than random guessing if they followed Benford's law instead—theory suggests that if they used Benford's law to answer all of the questions, they should be able to score at least 51 percent correct—a passing mark. To find out, they created their own 500 question multiple-choice (each with three choices) exam along with a dataset of real answers from a real test. Incorrect answers were represented randomly.

To run the test, the researchers chose the lowest possible number for each answer. In analyzing the results, they found that they could indeed score 51 percent on the test, without any knowledge of underlying physics concepts.

But, there was a catch, when the researchers applied the same science to a real physics , they found they were able to do no better than chance. That was because, they discovered, the wrong answers followed Benford's law as well.

The research team still can't explain why the incorrect answers followed Benford's law, but can report that clever students seeking to apply the law to their multiple choice tests, likely won't fare any better than chance, which would mean they would fail miserably.

Explore further: Limited patient choice next health overhaul issue

More information: Benford's Law: Textbook Exercises and Multiple-choice Testbanks, arXiv:1311.4787 [physics.data-an] arxiv.org/abs/1311.4787

Abstract
Benford's Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. The history and development of Benford's Law is inexorably linked to physics, yet there has been a dearth of physics-related Benford datasets reported in the literature. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.

Journal reference: arXiv

## Related Stories

#### Number one rules in nature: study

Feb 17, 2011

(PhysOrg.com) -- Researchers from The Australian National University have used a long-forgotten mathematical rule to reveal that in nature the number one dominates, as well as detect natural events like earthquakes ...

#### New Pattern Found in Prime Numbers

May 08, 2009

(PhysOrg.com) -- Prime numbers have intrigued curious thinkers for centuries. On one hand, prime numbers seem to be randomly distributed among the natural numbers with no other law than that of chance. But ...

#### Limited patient choice next health overhaul issue

Nov 20, 2013

After they get the health care website fixed, then what?

#### Cheating students more likely to want government jobs, study finds

Nov 20, 2013

College students who cheated on a simple task were more likely to want government jobs, researchers from Harvard University and the University of Pennsylvania found in a study of hundreds of students in Bangalore, India.

#### Physicists use blind quantum computing to verify results of quantum computer

Sep 30, 2013

(Phys.org) —A team of researchers working at the University of Vienna, has developed a technique for verifying results produced by a quantum computer. In their paper published in the journal Nature Physics, the re ...

#### Researchers use Moore's Law to calculate that life began before Earth existed

Apr 18, 2013

(Phys.org) —Geneticists Richard Gordon of the Gulf Specimen Marine Laboratory in Florida and Alexei Sharov of the National Institute on Aging in Baltimore have proposed, in a paper uploaded to the preprint ...

## Recommended for you

#### Information storage for the next generation of plastic computers

2 hours ago

Inexpensive computers, cell phones and other systems that substitute flexible plastic for silicon chips may be one step closer to reality, thanks to research published on April 16 in the journal Nature Communications.

#### With neutrons, scientists can now look for dark energy in the lab

5 hours ago

It does not always take a huge accelerator to do particle physics: First results from a low energy, table top alterative takes validity of Newtonian gravity down by five orders of magnitude and narrows the ...

#### At the origin of cell division: The features of living matter emerge from inanimate matter

7 hours ago

Droplets of filamentous material enclosed in a lipid membrane: these are the models of a "simplified" cell used by the SISSA physicists Luca Giomi and Antonio DeSimone, who simulated the spontaneous emergence ...

#### Physicists develop new method for manipulating minuscule drops

8 hours ago

Researchers from the University of Twente MESA+ research institute, the Foundation for Fundamental Research on Matter (FOM) and the Eindhoven University of Technology have, in cooperation with industrial partners ASML and ...

#### How to test the twin paradox without using a spaceship

10 hours ago

Forget about anti-ageing creams and hair treatments. If you want to stay young, get a fast spaceship. That is what Einstein's Theory of Relativity predicted a century ago, and it is commonly known as "twin ...

#### Sensitive detection method may help impede illicit nuclear trafficking

Apr 15, 2014

According to the International Atomic Energy Agency (IAEA) the greatest danger to nuclear security comes from terrorists acquiring sufficient quantities of plutonium or highly enriched uranium (HEU) to construct ...

##### antialias_physorg
3.7 / 5 (3) Nov 29, 2013
Nothing as useless as a multiple choice test. Especially in the natural science - no matter how you structure it - it fails to test the most important part: whether you have understood the subject AND the implications.

Regurgitating based on a "that looks about right", "I can exclude the other three choices as dumb" or "That seems familiar" is the worst way of deluding yourself into thinking that you have some aptitude in these subjects.
##### gopher65
not rated yet Nov 29, 2013
Yup, I have repeatedly scored well on multiple choice tests while having only cursory knowledge of the subject matter. They fail miserably at testing students, but are very easy for the teachers compared to, you know, *real* tests.
##### gopher65
not rated yet Nov 29, 2013
antialias_physorg: I accidentally rated your comment one rather than 5. Sorry:(.
##### antialias_physorg
5 / 5 (1) Nov 30, 2013
It happens. Don't worry. I'm not here for the ratings.

## More news stories

#### Micro-macro entangled 'cat states' could one day test quantum gravity

(Phys.org) —In Schrödinger's famous thought experiment, a cat's quantum state becomes entangled with the quantum state of a decaying nucleus, resulting in the odd situation that the cat is both alive and ...

#### Scientists capture ultrafast snapshots of light-driven superconductivity

A new study pins down a major factor behind the appearance of superconductivity—the ability to conduct electricity with 100 percent efficiency—in a promising copper-oxide material.

#### Information storage for the next generation of plastic computers

Inexpensive computers, cell phones and other systems that substitute flexible plastic for silicon chips may be one step closer to reality, thanks to research published on April 16 in the journal Nature Communications.

#### Global scientific team 'visualizes' a new crystallization process (w/ video)

Sometimes engineers invent something before they fully comprehend why it works. To understand the "why," they must often create new tools and techniques in a virtuous cycle that improves the original invention ...

#### How to test the twin paradox without using a spaceship

Forget about anti-ageing creams and hair treatments. If you want to stay young, get a fast spaceship. That is what Einstein's Theory of Relativity predicted a century ago, and it is commonly known as "twin ...

#### Chemical vapor deposition used to grow atomic layer materials on top of each other

Researchers at Penn State's Center for Two-Dimensional and Layered Materials and the University of Texas at Dallas have shown the ability to grow high quality, single-layer materials one on top of the other ...

#### Earliest ancestor of land herbivores discovered

New research from the University of Toronto Mississauga demonstrates how carnivores transitioned into herbivores for the first time on land.

#### Researchers see hospitalization records as additional tool

Comparing hospitalization records with data reported to local boards of health presents a more accurate way to monitor how well communities track disease outbreaks, according to a paper published April 16 in the journal PLOS ON ...

#### Ebola virus in Africa outbreak is a new strain

Scientists say that the Ebola (ee-BOH'-lah) virus that has killed scores of people this year in Guinea (GIH'-nee) is a new strain. That means it did not spread there from outbreaks in some other African nations.

#### Off-season doesn't allow brain to recover from football hits, study says

Six months off may not be long enough for the brains of football players to completely heal after a single season, putting them at even greater risk of head injury the next season.