An online game reveals something fishy about mathematical models

December 1, 2015, Uppsala University
A school of sardines in Italy. Credit: Wikimedia / Alessandro Duci

How can you tell if your mathematical model is good enough? In a new study, researchers from Uppsala University implemented a Turing test in the form of an online game (with over 1700 players) to assess how good their models were at reproducing collective motion of real fish schools. The results are published in Biology Letters.

Mathematical models allow us to understand how patterns and processes in the real world are generated and how complex behaviour, such as the collective movement of animal groups, can be produced from simple individual level rules. Fitting models based on the large scale properties of the data is one way to choose between different models, but can we be satisfied with our model when this has been achieved? How can we apply other methods to see how good our model fit is?

James Herbert-Read, researcher at the Department of Mathematics at Uppsala University, and his colleagues highlight and propose a solution to this problem by implementing a Turing test to assess how good their models were at reproducing .

They designed an where members of the public (over 1700 players online) and a small group of experts were asked to differentiate between the collective movements of real fish schools and those simulated by a model.

"By putting the game online, and though crowd sourcing this problem, the public have not only become engaged in science, they have also helped our research," says James Herbert-Read.

Even though the statistical properties of the model matched those of the real data, both experts and members of the public could differentiate between simulated and real fish. The researchers asked the online players that answered all six questions correctly to give feedback on how they differentiated between the real schools and the simulated ones.

"These players commonly suggested that the spatial organization of the groups and smoothness of the trajectories appeared different between the simulated and real schools. These are aspects of the model we can try to improve in the future", says James Herbert-Read.

"Our results highlight that we can use ourselves as Mechanical Turks through 'citizen science' to improve and refine fitting".

Explore further: Fish follow the rules to school

More information: A Turing Test for Collective Motion, Biology Letters, rsbl.royalsocietypublishing.or … .1098/rsbl.2015.0674

See the online game that was used in the study:

also see the authors' new game: … s/fishindanger/webgl

Related Stories

Fish follow the rules to school

November 7, 2011

The rules of school are simple: it is all about watching the kid nearest to you and making sure you do what they do. Researchers at the mathematics department at Uppsala University, together with biologists at Sydney University ...

Information is contagious among social connections

November 16, 2015

New research using advanced computer modeling sheds light on how behaviors may become "contagious" in large groups, showing that the memory of one individual can indirectly influence that of another via shared social connections. ...

Ants' movements hide mathematical patterns

May 12, 2015

When ants go exploring in search of food they end up choosing collective routes that fit statistical distributions of probability. This has been demonstrated by a team of mathematicians after analysing the trails of a species ...

Game theory experts to analyse space debris removal

October 22, 2015

Researchers from the University of Liverpool are using strategic game theory to analyse the accumulation of space debris, and to assess removal efforts and mitigation measures to limit its growth.

Recommended for you

In colliding galaxies, a pipsqueak shines bright

February 20, 2019

In the nearby Whirlpool galaxy and its companion galaxy, M51b, two supermassive black holes heat up and devour surrounding material. These two monsters should be the most luminous X-ray sources in sight, but a new study using ...

Research reveals why the zebra got its stripes

February 20, 2019

Why do zebras have stripes? A study published in PLOS ONE today takes us another step closer to answering this puzzling question and to understanding how stripes actually work.

When does one of the central ideas in economics work?

February 20, 2019

The concept of equilibrium is one of the most central ideas in economics. It is one of the core assumptions in the vast majority of economic models, including models used by policymakers on issues ranging from monetary policy ...

Correlated nucleons may solve 35-year-old mystery

February 20, 2019

A careful re-analysis of data taken at the Department of Energy's Thomas Jefferson National Accelerator Facility has revealed a possible link between correlated protons and neutrons in the nucleus and a 35-year-old mystery. ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.