- Research Article
48
- 10.1002/hyp.9679
Hydrological ensemble prediction systems
- Dec 21, 2012
- Hydrological Processes
- Hannah L Cloke + 1 more +1
[Departement_IRSTEA]Eaux [TR1_IRSTEA]ARCEAU
Abstract We investigate the ability of hydrological multimodel ensemble predictions to enhance the skill of streamflow forecasts at short‐ to medium‐range timescales. To generate the multimodel ensembles, we implement a new statistical postprocessor, namely, quantile regression‐Bayesian model averaging (QR‐BMA). Quantile regression‐Bayesian model averaging uses quantile regression to bias correct the ensemble streamflow forecasts from the individual models and Bayesian model averaging to optimally combine their probability density functions. Additionally, we use an information‐theoretic measure, namely, conditional mutual information, to quantify the skill enhancements from the multimodel forecasts. We generate ensemble streamflow forecasts at lead times from 1 to 7 days using three hydrological models: (i) Antecedent Precipitation Index‐Continuous, (ii) Hydrology Laboratory‐Research Distributed Hydrologic Model, and (iii) Weather Research and Forecasting Hydrological modeling system. As forcing to the hydrological models, we use weather ensemble forecasts from the National Centers for Environmental Prediction 11‐member Global Ensemble Forecast System Reforecast version 2. The forecasting experiments are performed for four nested basins of the North Branch Susquehanna River, USA. We find that after bias correcting the streamflow forecasts from each model, their skill performance becomes comparable. We find that the multimodel ensemble forecasts have higher skill than the best single‐model forecasts. Furthermore, the skill enhancements obtained by the multimodel ensemble forecasts are found to be dominated by model diversity, rather than by increased ensemble size alone. This result, obtained using conditional mutual information, indicates that each hydrological model contributes additional information to enhance forecast skill. Overall, our results highlight benefits of hydrological multimodel forecasting for improving streamflow predictions.
Hydrological ensemble prediction systems
[Departement_IRSTEA]Eaux [TR1_IRSTEA]ARCEAU
A retrospective streamflow ensemble forecast for an extreme hydrologic event: a case study of Hurricane Irene and on the Hudson River basin
Abstract. This paper investigates the uncertainties in hourly streamflow ensemble forecasts for an extreme hydrological event using a hydrological model forced with short-range ensemble weather prediction models. A state-of-the art, automated, short-term hydrologic prediction framework was implemented using GIS and a regional scale hydrological model (HEC-HMS). The hydrologic framework was applied to the Hudson River basin ( ∼ 36 000 km2) in the United States using gridded precipitation data from the National Centers for Environmental Prediction (NCEP) North American Regional Reanalysis (NARR) and was validated against streamflow observations from the United States Geologic Survey (USGS). Finally, 21 precipitation ensemble members of the latest Global Ensemble Forecast System (GEFS/R) were forced into HEC-HMS to generate a retrospective streamflow ensemble forecast for an extreme hydrological event, Hurricane Irene. The work shows that ensemble stream discharge forecasts provide improved predictions and useful information about associated uncertainties, thus improving the assessment of risks when compared with deterministic forecasts. The uncertainties in weather inputs may result in false warnings and missed river flooding events, reducing the potential to effectively mitigate flood damage. The findings demonstrate how errors in the ensemble median streamflow forecast and time of peak, as well as the ensemble spread (uncertainty) are reduced 48 h pre-event by utilizing the ensemble framework. The methodology and implications of this work benefit efforts of short-term streamflow forecasts at regional scales, notably regarding the peak timing of an extreme hydrologic event when combined with a flood threshold exceedance diagram. Although the modeling framework was implemented on the Hudson River basin, it is flexible and applicable in other parts of the world where atmospheric reanalysis products and streamflow data are available.
Read moreEastern U.S. Verification of Ensemble Precipitation Forecasts
The quality of ensemble precipitation forecasts across the eastern United States is investigated, specifically, version 2 of the National Centers for Environmental Prediction (NCEP) Global Ensemble Forecast System Reforecast (GEFSRv2) and Short Range Ensemble Forecast (SREF) system, as well as NCEP’s Weather Prediction Center probabilistic quantitative precipitation forecast (WPC-PQPF) guidance. The forecasts are verified using multisensor precipitation estimates and various metrics conditioned upon seasonality, precipitation threshold, lead time, and spatial aggregation scale. The forecasts are verified, over the geographic domain of each of the four eastern River Forecasts Centers (RFCs) in the United States, by considering first 1) the three systems or guidance, using a common period of analysis (2012–13) for lead times from 1 to 3 days, and then 2) GEFSRv2 alone, using a longer period (2004–13) and lead times from 1 to 16 days. The verification results indicate that, across the eastern United States, precipitation forecast bias decreases and the skill and reliability improve as the spatial aggregation scale increases; however, all the forecasts exhibit some underforecasting bias. The skill of the forecasts is appreciably better in the cool season than in the warm one. The WPC-PQPFs tend to be superior, in terms of the correlation coefficient, relative mean error, reliability, and forecast skill scores, than both GEFSRv2 and SREF, but the performance varies with the RFC and lead time. Based on GEFSRv2, medium-range precipitation forecasts tend to have skill up to approximately day 7 relative to sampled climatology.
Read moreEvaluating the predictive skill of post‐processed NCEP GFS ensemble precipitation forecasts in China's Huai river basin
The National Center for Environmental Predictions (NCEP) has produced an ensemble meteorological reforecast product by using a fixed version of Global Forecast System (GFS) ensemble prediction system since 1 January 1979. The 15‐member ensemble product, with a global coverage at a 2.5° × 2.5° spatial resolution and a 14‐day lead time, has been used successfully by the River Forecast Centers of the National Weather Service (NWS) to produce basin scale precipitation and temperature ensemble forecasts in the US for several years now. This study evaluates the predictive skill of post‐processed ensemble forecasts based on GFS precipitation reforecast in China's Huai river basin. The evaluation is carried out in 15 sub‐areas of the Huai river basin and covers the 1/1/1981–31/12/2003 period. The Ensemble Pre‐Processing system version 3 (EPP3), developed at NWS, is used to develop joint probability distributions between forecasted ensemble mean precipitation and corresponding observations and to generate individual ensemble members that preserve space–time correlation of the observed precipitation data. Several statistical verification measures are used to quantify the goodness of fit between post‐processed (i.e. EPP3 processed) ensemble mean and observation and to assess the ensemble spread. Results indicate that the post‐processed forecasts have meaningful predictive skill for the first few days for ensemble daily precipitation forecasts. Predictive skill of ensemble forecasts of cumulative precipitation for lead times up to 14 days are significant. The forecast skill is highly dependent on seasonality, with relatively lower skills seen for wet summer season, when convective storm patterns dominate, as compared with other seasons. The predictive skill of the post‐processed ensemble precipitation is much better than the raw forecasts and the climatological ensemble forecasts. The results from this study suggest that the NCEP's GFS reforecasts can be a valuable resource for places other than the US. Copyright © 2012 John Wiley & Sons, Ltd.
Read moreReply on RC2
Developing an ensemble hydrologic prediction system is essential for reservoir operations and flood early warning. However, efforts to build hydrologic ensemble prediction systems considering the influence of reservoirs have been lacking in India. We examine the potential of the Extended Range Forecast System (ERFS, 16 ensemble members) and Global Ensemble Forecast System (GEFS, 21 ensemble members) forecast for streamflow prediction in India using the Narmada River basin as a testbed. We use the Variable Infiltration Capacity (VIC) with reservoir operations (VIC-Res) scheme to simulate the daily river flow at four locations in the Narmada basin. We examined the streamflow forecast skills of the ERFS forecast for the period 2003–2018 at 1–32 day lead. We compared the streamflow forecast skills of raw meteorological forecasts from ERFS and GEFS at a 1–10 day lead for the summer monsoon (June–September) 2019–2020. The ERFS forecast underestimated extreme precipitation against the observations compared to the GEFS during the summer monsoon of 2019–2020. However, both the forecast products showed better skills for minimum and maximum temperatures than precipitation. Ensemble streamflow forecast from the GEFS performed better than the ERFS during 2019–2020. The performance of the GEFS based ensemble streamflow forecast declines after five days lead. Overall, the GEFS ensemble streamflow forecast can provide reliable skills at a 1–5 day lead. Our findings provide directions for developing a flood early warning system based on ensemble streamflow prediction considering the influence of reservoirs in India.
Read moreReply on RC1
Developing an ensemble hydrologic prediction system is essential for reservoir operations and flood early warning. However, efforts to build hydrologic ensemble prediction systems considering the influence of reservoirs have been lacking in India. We examine the potential of the Extended Range Forecast System (ERFS, 16 ensemble members) and Global Ensemble Forecast System (GEFS, 21 ensemble members) forecast for streamflow prediction in India using the Narmada River basin as a testbed. We use the Variable Infiltration Capacity (VIC) with reservoir operations (VIC-Res) scheme to simulate the daily river flow at four locations in the Narmada basin. We examined the streamflow forecast skills of the ERFS forecast for the period 2003–2018 at 1–32 day lead. We compared the streamflow forecast skills of raw meteorological forecasts from ERFS and GEFS at a 1–10 day lead for the summer monsoon (June–September) 2019–2020. The ERFS forecast underestimated extreme precipitation against the observations compared to the GEFS during the summer monsoon of 2019–2020. However, both the forecast products showed better skills for minimum and maximum temperatures than precipitation. Ensemble streamflow forecast from the GEFS performed better than the ERFS during 2019–2020. The performance of the GEFS based ensemble streamflow forecast declines after five days lead. Overall, the GEFS ensemble streamflow forecast can provide reliable skills at a 1–5 day lead. Our findings provide directions for developing a flood early warning system based on ensemble streamflow prediction considering the influence of reservoirs in India.
Read moreQuantifying Risk and Uncertainty in Truckee-Carson Basin Forecasted Operations Using Ensemble Streamflow Forecasts
A system that utilizes an ensemble of streamflow forecasts as input to the Truckee-Carson RiverWare © operational forecast model has been developed to provide operators and stakeholders with an ensemble of operational forecasts. This ensemble of operational forecasts allows users to estimate uncertainty and perform risk-based analyses to assist with operational decisions. The ensemble of streamflow forecasts are provided by the River Forecast Center's Ensemble Streamflow Prediction program which generates the forecasts based upon current hydrologic conditions and historic meteorology records. The streamflow forecasts are input hydrographs for the operational forecast model. The operational forecast model is run once for each trace of the ensemble streamflow forecast. During each run the model simulates daily operation of the river according to current basin policy. Select output is then collected from each run to be analyzed statistically, providing estimates of risk and uncertainty in the operational forecast. The RiverWare © Multiple Run Management tool is employed to facilitate the efficient use of the ensemble forecasts for daily operational decisions. This tool provides an automated process for performing multiple model runs with varying input and compiling select output within one file. An overview of the process and a sample application on Lake Tahoe precautionary release operations will be presented.
Read moreBias correction of ensemble precipitation forecasts in the improvement of summer streamflow prediction skill
Bias correction of ensemble precipitation forecasts in the improvement of summer streamflow prediction skill
Evaluation and Benchmarking of Operational Short-Range Ensemble Mean and Median Streamflow Forecasts for the Ohio River Basin
This study presents findings from a real-time forecast experiment that compares legacy deterministic hydrologic stage forecasts to ensemble mean and median stage forecasts from the NOAA/NWS Meteorological Model-Based Ensemble Forecast System (MMEFS). The NOAA/NWS Ohio River Forecast Center (OHRFC) area of responsibility defines the experimental region. Real-time forecasts from subbasins at 54 forecast point locations, ranging in drainage area, geographic location within the Ohio River valley, and watershed response time serve as the basis for analyses. In the experiment, operational hydrologic forecasts, with a 24-h quantitative precipitation forecast (QPF) and forecast temperatures, are compared to MMEFS hydrologic ensemble mean and median forecasts, with model forcings from the NOAA/NWS National Centers for Environmental Prediction (NCEP) North American Ensemble Forecast System (NAEFS), over the period from 30 November 2010 through 24 May 2012. Experiments indicate that MMEFS ensemble mean and median forecasts exhibit lower errors beginning at about lead time 90 h when forecasts at all locations are aggregated. With fast response basins that peak at ≤24 h, ensemble mean and median forecasts exhibit lower errors much earlier, beginning at about lead time 36 h, which suggests the viability of using MMEFS ensemble forecasts as an alternative to OHRFC legacy forecasts. Analyses show that ensemble median forecasts generally exhibit smaller errors than ensemble mean forecasts for all stage ranges. Verification results suggest that OHRFC MMEFS NAEFS ensemble forecasts are reasonable, but needed improvements are identified.
Read moreA robust multimodel framework for ensemble seasonal hydroclimatic forecasts
We provide a framework for careful analysis of the different methodological choices we make when constructing multimodel ensemble seasonal forecasts of hydroclimatic variables. Specifically, we focus on three common modeling decisions: (i) number of models, (ii) multimodel combination approach, and (iii) lead time for prediction. The analysis scheme includes a multimodel ensemble forecasting algorithm based on nonparametric regression, a set of alternatives for the options previously pointed, and a selection of probabilistic verification methods for ensemble forecast evaluation. The usefulness of this framework is tested through an example application aimed to generate spring/summer streamflow forecasts at multiple locations in Central Chile. Results demonstrate the high impact that subjectivity in decision‐making may have on the quality of ensemble seasonal hydroclimatic forecasts. In particular, we note that the probabilistic verification criteria may lead to different choices regarding the number of models or the multimodel combination method. We also illustrate how this objective analysis scheme may lead to results that are extremely relevant for the case study presented here, such as skillful seasonal streamflow predictions for very dry conditions.
Read moreA barycenter-based approach for the multi-model ensembling of subseasonal forecasts
Combining ensemble forecasts from different models into a multi-model ensemble (MME) have been shown to improve forecast skill at different time-scales, including the sub-seasonal to seasonal (S2S) one. Here, we investigate a new method to build such MME based on barycenter. Recognizing ensemble forecasts as discrete probability distributions, we work directly in the probability distribution space. This allows us to use existing tools in this space, and in particular the concept of barycenter. The barycenter of a collection of distributions (or the ensemble forecasts here) is the distribution that best represents them, based on a given metric. The barycenter can thus be seen as the combination of these distributions, and so used to build a MME. We compare two barycenters based on different metrics: the L2 and the Wasserstein distances. The Wasserstein distance corresponds to the cost of the optimal transport between two distributions and has interesting properties in the distribution space. We compare it to the L2-barycenter which is in fact shown to be equivalent to the well-known “pooling” MME method (i.e. the concatenation of the different ensembles members). Another interesting point of the barycenters is that they allow you to give different weights to the models and so to easily build a weighted-MME. The weights have an important impact on the skill of the MMEs. We are thus optimizing the weights by learning them from the data using cross-validation on the forecasts. The two barycenter-based MMEs are applied to the combination of the models from the S2S project’s database. Their performances are evaluated for the prediction of weekly 2m-temperature during European winter with respect to different metrics. As a proof of concept, we first start with the combination of two models, namely the European Centre Medium-Range Weather Forecasts (ECMWF) and the National Center for Environmental Prediction (NCEP) models. We show that the two MMEs are generally able to perform as well or better than both the single-models, but that the best combination method depends on the chosen metric. We then extend the barycenter approach to the combination of more models, of which we will discuss preliminary results.
Read moreProblems and prospects in long and medium range weather forecasting
Problems and prospects in long and medium range weather forecasting
Improving Operational Ensemble Streamflow Forecasting with Conditional Bias-Penalized Post-Processing of Precipitation Forecast and Assimilation of Streamflow Data
This work aims at improving the accuracy of ensemble streamflow forecasts at short-to-medium ranges with the conditional bias-penalized regression (CBPR)-aided Meteorological Ensemble Forecast Processor (MEFP) and streamflow data assimilation (DA). To assess the potential impact of the CBPR-aided MEFP and streamflow DA, or CBPR-DA, 20-yr hindcast experiments were carried out using the Global Ensemble Forecast System version 12 reforecast dataset for 46 locations in the service areas of 11 River Forecast Centers of the US NWS. The results show that, relative to the current practice of using the MEFP and no DA, or MEFP-NoDA, CBPR-DA improves the accuracy of ensemble forecasts of 3-day flow over lead times of 0 to 3 days by over 40% for 4 RFCs and by over 20% for 9 of the 11 RFCs. The margin of improvement is larger where the predictability of precipitation is larger and the hydrologic memory is stronger. As the lead time increases, the margin of improvement decreases but still exceeds 10% for the prediction of 14-day flow over lead times of 0 to 14 days for all but 3 RFCs.
Read moreBlending Subseasonal-to-Seasonal Hydrological Predictions from Multiple Forecasting Systems
Given the increasing vulnerability due to more frequent and severe hydrological hazards under a changing climate, it is imperative to develop accurate and reliable global and local hydrological prediction systems at subseasonal-to-seasonal (S2S) timescales. However, operational forecasts tailored to specific local regions remain limited due to lack of both local observations and regional hydrological models, while global hydrological models often lack calibration for local conditions, making it challenging for them to capture local-scale dynamics. Additionally, users and decision-makers face difficulties in effectively interpreting ensemble forecasts from multiple hydrological models in operational settings especially when compared to the simplicity and clarity of a single model approach. To bridge this gap, it is essential to integrate existing hydrological forecasting systems across global, regional, and local scales, with the goal of delivering skilful, standardized, and comprehensible predictions. As part of the World Meteorological Organization's (WMO) Global Hydrological Status and Outlook System (HydroSOS) initiative, we are exploring various approaches to: (i) validate and enhance the skill of current hydrological probabilistic forecasts, and (ii) blend multi-model ensemble simulations to develop integrated and reliable operational forecasts. Here, we aim to develop a framework for bias-correcting and blending global multi-model ensemble forecasts, based on the skill of each modelling system for each catchment, to deliver unique probabilistic forecasts. Our research, using global hindcasts from various modelling systems, has demonstrated that applying this framework to post-process raw model simulations can deliver reliable S2S hydrological forecasts across diverse global catchments operationally. This approach has the potential for improved water resource management and hydrological hazard mitigation, particularly in data-sparse regions.
Read moreSub-seasonal to seasonal ensemble streamflow forecasting using a Handoff forecast LSTM
Despite recent advances in operational streamflow forecasting systems, anticipating and forecasting droughts and associated low-flow conditions remain major challenges in hydrology, with substantial impacts on water-dependent sectors such as agriculture and industry. Enhancing sub-seasonal to seasonal streamflow forecasting is therefore critical for improving water resources management. This study investigates the performance of a Handoff forecast Long Short-Term Memory (LSTM) architecture (Nearing et al., 2024) for probabilistic streamflow forecasting at lead times extending up to six months, with a particular emphasis on low-flow conditions.The Handoff forecast LSTM is trained regionally on a subset of 292 basins from the Catchment Attributes and MEteorology for Large-sample Studies - FRance dataset (CAMELS-FR) (Delaigue et al., 2025), after excluding basins affected by unreliable low-flow measurements. Model training relies on basin-averaged hydro-meteorological reanalysis data provided by CAMELS-FR. Evaluation of the model is conducted using ensemble streamflow forecasts generated from historical scenarios and meteorological ensemble predictions from the SEAS5 model from the European Center for Medium-Range Weather Forecasts (ECMWF) (Johnson et al., 2019)The generated ensemble streamflow forecasts are evaluated using a set of probabilistic metrics such as the Continuous Ranked Probability Score (CRPS), the Brier Score, the Area under the ROC curve, and the Talagrand diagram, and using the natural streamflow climatology as a reference. In addition, a sensitivity analysis of static catchment attributes is performed to assess their relative contribution to model performance and to better understand the drivers of predictability across basins.Delaigue, O., Guimarães, G. M., Brigode, P., Génot, B., Perrin, C., Soubeyroux, J.-M., Janet, B., Addor, N., & Andréassian, V. (2025). CAMELS-FR dataset: a large-sample hydroclimatic dataset for France to explore hydrological diversity and support model benchmarking. Earth System Science Data, 17(4), 1461–1479. https://doi.org/10.5194/essd-17-1461-2025Johnson, S. J., Stockdale, T. N., Ferranti, L., Balmaseda, M. A., Molteni, F., Magnusson, L., Tietsche, S., Decremer, D., Weisheimer, A., Balsamo, G., Keeley, S. P. E., Mogensen, K., Zuo, H., & Monge-Sanz, B. M. (2019). SEAS5: The new ECMWF seasonal forecast system. Geoscientific Model Development, 12(3), 1087–1117. https://doi.org/10.5194/gmd-12-1087-2019Nearing, G., Cohen, D., Dube, V., Gauch, M., Gilon, O., Harrigan, S., Hassidim, A., Klotz, D., Kratzert, F., Metzger, A., Nevo, S., Pappenberger, F., Prudhomme, C., Shalev, G., Shenzis, S., Tekalign, T. Y., Weitzner, D., & Matias, Y. (2024). Global prediction of extreme floods in ungauged watersheds. Nature, 627(8004), 559–563. https://doi.org/10.1038/s41586-024-07145-
Read more