Seasonal prediction of Horn of Africa long rains using machine learning: the pitfalls of preselecting correlated predictors

Deman, Victoria M. H., Koppa, Akash, Waegeman, Willem, MacLeod, David A., Bliss Singer, Michael and Miralles, Diego G. 2022. Seasonal prediction of Horn of Africa long rains using machine learning: the pitfalls of preselecting correlated predictors. Frontiers in Water 4 , 1053020. 10.3389/frwa.2022.1053020

	PDF - Published Version Available under License Creative Commons Attribution. Download (2MB)
	PDF - Supplemental Material Available under License Creative Commons Attribution. Download (858kB)

Abstract

The Horn of Africa is highly vulnerable to droughts and floods, and reliable long-term forecasting is a key part of building resilience. However, the prediction of the “long rains” season (March–May) is particularly challenging for dynamical climate prediction models. Meanwhile, the potential for machine learning to improve seasonal precipitation forecasts in the region has yet to be uncovered. Here, we implement and evaluate four data-driven models for prediction of long rains rainfall: ridge and lasso linear regressions, random forests and a single-layer neural network. Predictors are based on SSTs, zonal winds, land state, and climate indices, and the target variables are precipitation totals for each separate month (March, April, and May) in the Horn of Africa drylands, with separate predictions made for lead-times of 1–3 months. Results reveal a tendency for overfitting when predictors are preselected based on correlations to the target variable over the entire historical period, a frequent practice in machine learning-based seasonal forecasting. Using this conventional approach, the data-driven methods—and particularly the lasso and ridge regressions—often outperform dynamical seasonal hindcasts. However, when the selection of predictors is done independently of both the train and test data, by performing this predictor selection within the cross-validation loop, the performance of all four data-driven models is poorer than that of the dynamical hindcasts. These findings should not discourage future applications of machine learning for rainfall forecasting in the region. Yet, they should be seen as a note of caution to prevent optimistically biased results that are not indicative of the true power in operational forecast systems.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Earth and Environmental Sciences
Additional Information:	License information from Publisher: LICENSE 1: URL: http://creativecommons.org/licenses/by/4.0/
Publisher:	Frontiers Media
Date of First Compliant Deposit:	23 December 2022
Date of Acceptance:	22 November 2022
Last Modified:	11 Oct 2023 19:56
URI:	https://orca.cardiff.ac.uk/id/eprint/155266

Citation Data

Cited 1 time in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item