Unraveling positional and structural errors in numerical weather forecast models

weather forecasting
Credit: CC0 Public Domain

Due to the chaotic nature of the atmosphere, weather forecasts, even with ever improving numerical weather prediction models, eventually lose their accuracy. Meteorologists have a strong desire to better understand this process as they try to trace forecast error back to observational gaps and to provide a means for improvement.

Root mean square (rms, or its square, the variance distance) is often used to measure differences between simulated and observed fields. In this case, scientists measured the distance between a model field within its grid and the verifying analysis field that represents all real-world observations. However, one must consider that atmospheric features, like fronts and pressure systems are three dimensional weather features in space that computer models displace and also structurally distort as the numerical forecast moves away from initiation. Variance or rms error metrics do not quantify the displacement and distortion of weather systems.

In a recently published paper in Advances in Atmospheric Sciences, a team of scientists with the National Oceanic and Atmospheric Administration (NOAA), the Massachusetts Institute of Technology (MIT), and the University of Connecticut set out to find a general approach to assess the positional and structural components of the total difference between two fields. Essentially, meteorologists want to assess the accuracy of many different weather features within a model forecast compared to a verifying analysis based on real-world observations.

Unraveling positional and structural errors in numerical weather forecast models
Fig. 1. Schematic for total forecast error reduction: (1) Spatially align a forecast with the verifying analysis field; (2) Smooth original and aligned forecast and analysis to remove unpredictable scales; (3) Decompose total error into orthogonal (right angle) components of (i) large scale positional error, (ii) large scale structural error, and (iii) small scale noise. Credit: Isidora Jankov

Sai Ravela from MIT, a co-author of this study, previously developed a Field Alignment method. In this case, his approach aligns the model forecast field with the observationally based analysis in a smooth fashion so their difference is minimized. Next, small scale errors from uncertain origins are removed from all three fields (the original and aligned forecast as well as the verifying analysis, or proxy for observations) through a process called spatial filtering or smoothing. The total variance distance, or difference, is then partitioned into three unique components. Positional error, which is the variance distance between the smoothed original model forecast and smoothed aligned forecast fields, and structural error that is the variance distance between the smoothed aligned forecast and the smoothed verifying analysis fields, are two sides of a right angle triangle, and fine scale noise, which are the uncertain small-scale errors removed from the original forecast and verifying analysis, or observation fields.

This method outputs the three orthogonal error components as scalar fields, as well as a vector field indicating the large-scale displacement of the forecast compared to the observational analysis field. Interestingly, throughout all regions and lead times that the team studied, more than half of the total error variance is associated with the misplacement of weather features. Therefore, displacement is more pronounced than distortion in forecast fields: only about 25% error variance is associated with structural inaccuracies of the partially predictable features, such as fronts and low pressure systems. The rest of the error variance remains unexplained or unpredictable variability, or noise.

Unraveling positional and structural errors in numerical weather forecast models
Fig. 2. 3.5-day forecast (black contour) and verifying analysis (shades of color) of mean sea level pressure for Hurricane Katia, valid at 12 UTC 6 September 2011. Moving the forecast along with the blue arrows aligns it with the observational analysis. Credit: Isidora Jankov

"How noise grows in error variance as a function of forecast lead time, and whether a positional-structural-noise decomposition of the spread among an ensemble of perturbed forecasts captures forecast error components is the subject of ongoing studies," said Dr. Jankov from NOAA, the lead author of the study.

Explore further

Scientists explore the potential for further improvements to tropical cyclone track forecasts

More information: Isidora Jankov et al, Partition of Forecast Error into Positional and Structural Components, Advances in Atmospheric Sciences (2021). DOI: 10.1007/s00376-021-0251-7
Journal information: Advances in Atmospheric Sciences

Citation: Unraveling positional and structural errors in numerical weather forecast models (2021, May 10) retrieved 13 June 2021 from https://phys.org/news/2021-05-unraveling-positional-errors-numerical-weather.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments