Wisdom of the crowd? Building better forecasts from suboptimal predictors

Credit: George Hodan/Public Domain

Researchers at the University of Tokyo and Kozo Keikaku Engineering Inc. have introduced a method for enhancing the power of existing algorithms to forecast the future of unknown time series. By combining the predictions of many suboptimal forecasts, they were able to construct a consensus prediction that tended to outperform existing methods. This research may help provide early warnings for floods, economic shocks, or changes in the weather.

In , a gyrating graph might represent the water level of a river, the price of a stock, or the daily high temperature in a city, for example. Advance knowledge of the future movements of a time series could be used to avert or prepare for future undesirable events. However, forecasting is extremely difficult because the underlying dynamics that generate the values are nonlinear (even if assumed to be deterministic) and therefore subject to wild fluctuations.

Delay embedding is a widely used method to make sense of time series data and attempt to predict future values. This approach takes a sequence of observations and "embeds" them in a higher-dimensional space by combining the current value with evenly spaced lagged values from the past. For example, to create a three-dimensional delay embedding of the S&P 500 closing price, you can take the closing prices today, yesterday and the day before as the x-, y-, and z-coordinates, respectively. However, the possible choices for dimension and delay lag make finding the most useful representation for making forecasts a matter of trial and error.

Now, researchers at the University of Tokyo and Kozo Keikaku Engineering Inc. have showed a way to select and optimize a collection of delay embeddings so that their combined forecast does better than any individual predictor. "We found that the 'wisdom of the crowd,' in which the consensus prediction is better than each on its own, can be true even with mathematical models," first author Shunya Okuno explains.

The researchers tested their method on real-world flood data, as well as theoretical equations with chaotic behavior. "We expect that this approach will find many in forecasting time series data, and reinvigorate the use of delay embeddings," senior author Yoshito Hirata says. Forecasting a future system state is an important task in many fields including neuroscience, ecology, finance, , weather and disaster prevention, hence, this work has potential for use in a wide range of applications. The study is published in Scientific Reports.

More information: "Forecasting high-dimensional dynamics exploiting suboptimal embeddings" Scientific Reports, DOI: 10.1038/s41598-019-57255-4

Journal information: Scientific Reports

Citation: Wisdom of the crowd? Building better forecasts from suboptimal predictors (2020, January 20) retrieved 5 June 2023 from https://phys.org/news/2020-01-wisdom-crowd-suboptimal-predictors.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

GPS helping provide more precise precipitation predictions


Feedback to editors