An online game reveals something fishy about mathematical models

December 1, 2015, Uppsala University
A school of sardines in Italy. Credit: Wikimedia / Alessandro Duci

How can you tell if your mathematical model is good enough? In a new study, researchers from Uppsala University implemented a Turing test in the form of an online game (with over 1700 players) to assess how good their models were at reproducing collective motion of real fish schools. The results are published in Biology Letters.

Mathematical models allow us to understand how patterns and processes in the real world are generated and how complex behaviour, such as the collective movement of animal groups, can be produced from simple individual level rules. Fitting models based on the large scale properties of the data is one way to choose between different models, but can we be satisfied with our model when this has been achieved? How can we apply other methods to see how good our model fit is?

James Herbert-Read, researcher at the Department of Mathematics at Uppsala University, and his colleagues highlight and propose a solution to this problem by implementing a Turing test to assess how good their models were at reproducing .

They designed an where members of the public (over 1700 players online) and a small group of experts were asked to differentiate between the collective movements of real fish schools and those simulated by a model.

"By putting the game online, and though crowd sourcing this problem, the public have not only become engaged in science, they have also helped our research," says James Herbert-Read.

Even though the statistical properties of the model matched those of the real data, both experts and members of the public could differentiate between simulated and real fish. The researchers asked the online players that answered all six questions correctly to give feedback on how they differentiated between the real schools and the simulated ones.

"These players commonly suggested that the spatial organization of the groups and smoothness of the trajectories appeared different between the simulated and real schools. These are aspects of the model we can try to improve in the future", says James Herbert-Read.

"Our results highlight that we can use ourselves as Mechanical Turks through 'citizen science' to improve and refine fitting".

Explore further: Fish follow the rules to school

More information: A Turing Test for Collective Motion, Biology Letters, rsbl.royalsocietypublishing.or … .1098/rsbl.2015.0674

See the online game that was used in the study:

also see the authors' new game: … s/fishindanger/webgl

Related Stories

Fish follow the rules to school

November 7, 2011

The rules of school are simple: it is all about watching the kid nearest to you and making sure you do what they do. Researchers at the mathematics department at Uppsala University, together with biologists at Sydney University ...

Information is contagious among social connections

November 16, 2015

New research using advanced computer modeling sheds light on how behaviors may become "contagious" in large groups, showing that the memory of one individual can indirectly influence that of another via shared social connections. ...

Ants' movements hide mathematical patterns

May 12, 2015

When ants go exploring in search of food they end up choosing collective routes that fit statistical distributions of probability. This has been demonstrated by a team of mathematicians after analysing the trails of a species ...

Game theory experts to analyse space debris removal

October 22, 2015

Researchers from the University of Liverpool are using strategic game theory to analyse the accumulation of space debris, and to assess removal efforts and mitigation measures to limit its growth.

Recommended for you

Oldest evidence for animals found

October 15, 2018

Researchers at the University of California, Riverside, have found the oldest clue yet of animal life, dating back at least 100 million years before the famous Cambrian explosion of animal fossils.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.