Simple statistics can be good enough

November 7, 2017, King Abdullah University of Science and Technology
Simple statistics can be good enough
Gaussian distributions are simple and easy to understand, but for some data such as rainfall and wind speed, they can result in physically impossible tails to negative values. Credit: Marek Uliasz / Alamy Stock Photo

Study of the mismatch between spatial environmental data and a commonly used statistical analysis suggests simpler statistics are sufficient in many cases.

Environmental scientists and their statistician colleagues face a common dilemma: Do simpler statistical tests properly characterize a data set? And is it worth the effort to derive and apply statistical methods that are possibly better matched but more difficult to interpret? In most cases the path of least resistance wins, but the choice of a simple statistical basis can cast slight doubt on the validity of statistically derived study results.

KAUST researcher Marc Genton and his doctoral student Yuan Yan developed a framework to test exactly how inaccurate a mismatch between data and could be, and the results are surprising.

"Researchers tend to fit spatial data with a simple Gaussian model—the classic symmetric bell curve around the average value—even though data might have an asymmetric distribution with features that diverge from Gaussian," says Yan. "We investigated the effect of the 'non-Gaussianity' of data on statistical estimation and prediction under the wrong Gaussian assumption."

Gaussian distributions are generally intuitive, with an average value and standard deviations from the average that imply some narrow or broad distribution of data. They are widely applied and understood, both from a practitioner perspective and for nontechnical users. But, in many situations, particularly for environmental data, the distribution of data is skewed. Wind speed and rainfall, for example, cannot be less than zero, yet a Gaussian distribution with a small average value but extended distribution to higher values can have a tail at the lower end that extends to negative values—certainly wrong, but by how much?

One of the most important concepts in spatial statistical analyses is how strongly data influence each other when a certain distance apart, which is given by what is known as the covariance function. Genton and Yan set out to systematically study the effect of applying a Gaussian model to estimate the covariance function for non-Gaussian data.

"We developed a tailored simulation scheme to generate non-Gaussian spatial data with a given covariance structure," says Genton. "We showed through our simulation study that when spatial data are non-Gaussian, the Gaussian likelihood estimator of covariance parameters still performs better than an alternative weighted least-squares estimator for data that are not heavily skewed."

The finding suggests that the simple Gaussian model is in fact generally adequate for parameter estimation for spatial data in many cases, offering some comfort to spatial scientists about their choice of statistical approach.

Explore further: Dataset size counts for better climate and environmental predictions

More information: Yuan Yan et al. Gaussian likelihood inference on data from trans-Gaussian random fields with Matérn covariance function, Environmetrics (2017). DOI: 10.1002/env.2458

Related Stories

Improving connections for spatial analysis

March 7, 2017

A statistical model that accounts for common dependencies in spatial data yields more realistic results for studies of temperature, wind and pollution levels.

Going to extremes to predict natural disasters

July 10, 2017

Predicting natural disasters remains one of the most challenging problems in simulation science because not only are they rare but also because only few of the millions of entries in datasets relate to extreme events. A systematic ...

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

EPA adviser is promoting harmful ideas, scientists say

March 22, 2019

The Trump administration's reliance on industry-funded environmental specialists is again coming under fire, this time by researchers who say that Louis Anthony "Tony" Cox Jr., who leads a key Environmental Protection Agency ...

The taming of the light screw

March 22, 2019

DESY and MPSD scientists have created high-order harmonics from solids with controlled polarization states, taking advantage of both crystal symmetry and attosecond electronic dynamics. The newly demonstrated technique might ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.