Comparison of rainfall-runoff models for flood forecasting. Part 2: Calibration and evaluation of models

Bell, V.A. ORCID: https://orcid.org/0000-0002-0792-5650; Carrington, D.S.; Moore, R.J.. 2001 Comparison of rainfall-runoff models for flood forecasting. Part 2: Calibration and evaluation of models. Bristol, UK, Environment Agency, 239pp. (R&D Technical Report W242, CEH Project Number: C00260)

Before downloading, please read NORA policies.

Preview

Text Comparison_of_Rainfall-Runoff_Models_For_Flood_Forecasting_Part_2.pdf Download (7MB)

Abstract/Summary

The purpose of the project “Comparison of Rainfall-Runoff Models for Flood Forecasting” is to provide guidance to the Environment Agency on the choice of rainfall-runoff model for use in different catchments for flood forecasting purposes. A literature review of models presented in the Part 1 Report recognised that whilst there is a plethora of “brand-name” models there is much similarity between many of them. A rather small set of model functions is common to many models and they differ in the detail of their configuration. Eight models were selected for a more detailed assessment of performance using data from nine catchments of varied character and spread throughout the regions of the Agency. The results are reported in this Part 2 Report along with conclusions and recommendations. The chosen models encompass those used operationally by the EA together with one overseas model and a simple distributed model previously developed for the Agency. Four of the models are lumped, conceptual models with continuous water accounting procedures: the Thames Catchment Model (TCM), the Midlands Catchment Runoff Model (MCRM), the Probability Distributed Moisture model (PDM), and the US National Weather Service Sacramento model (NWS). A fifth model, the Isolated Event Model (IEM), is an event model modified to operate continuously in real-time. Water balance principles are used for soil moisture accounting and water storage routing but an empirical function links the two components, controlling runoff production as a function of soil moisture. The sixth model is a simple Transfer Function (TF) model whilst the seventh is a constrained form of TF model, referred to as the Physically Realisable Transfer Function (PRTF). The TF types of model are black-box models which empirically relate rainfall and flow, can be related to unit hydrographs and can be subject to conceptual interpretation as forms of routing function. The last model, the Grid Model, is included as a simple form of distributed conceptual rainfall-runoff model suitable for use in flood forecasting and able to use weather radar estimates of rainfall in grid form. Each model is associated with an updating procedure whereby recent measurements of flow are incorporated into the model so as to improve forecast performance in real-time. The strategy for assessment used is based on first calibrating all models in “simulation-mode”, where each model is used to transform rainfall (and potential evaporation) to runoff without using flow to update the model forecast. Each model is then evaluated using periods of data not used for calibration. This simulation-mode evaluation serves to focus on the process model capabilities of a given model. Subsequently, each model is evaluated in “forecast-mode” in which an updating scheme is used to incorporate measurements of flow up to the “forecast time-origin”. This emulates the forecast performance expected operationally at different forecast lead times. Perfect foreknowledge of rainfall is assumed so as not to confound the model assessment with uncertainties in rainfall forecasts. The statistics used for model assessment are R2 and a Threshold CSI (Critical Success Index). The R2 statistic, giving the proportion of the variability in the flow accounted for by the model forecasts, is used to provide a broad guide to model performance. The Threshold CSI statistic is used to judge the efficacy of a model to correctly forecast the exceedence of a set of flow thresholds, particularly relevant to the use of a forecast to trigger an alert level of a given severity. Forecasts are also judged more informally via hydrograph plots and scatter plots of observed and forecast flood peaks. Whilst the main assessment relates to the use of raingauge estimates of rainfall as input to the models, for three of the catchments the assessment extends to the use of weather radar, both in raw form and as raingauge-calibrated radar estimates of rainfall. Whilst forecast accuracy is the focus of the model assessment, other issues are taken into consideration including ease of model configuration, initialisation and calibration. The form of model assessment used, employing long continuous records at a fixed 15 minute time-step typically eight months in duration, has meant that it has been difficult to emulate the operational performance of TF and PRTF models. These models are used by the Agency in “event mode” and commonly operate on baseflow separated runoff where baseflow is taken as the flow at the start of the event. The opportunity exists to manually adjust the model parameters affecting the volume, shape and timing of the forecast as the flood develops. Also, the model time-step and model order are commonly chosen with regard to the response characteristics of the catchment. The results reported here relate to TF/PRTF models without baseflow separation, using an automated method of model parameter adjustment and using a fixed model time-step and model order. The approach most resembles that used on the River Medway to support the operation of the Leigh Flood Barrier and the method of automated model gain adjustment has also been used in Anglian Region. The results relating to TF/PRTF models should be interpreted against this background. Overall, the results suggest that no one model consistently out-performs all others across all catchments. The TCM is one of the best performing models when judged using the R2 statistic whilst the PDM is more successful according to the Threshold CSI criterion (relevant to the issuing of flood alerts) and in forecasting flood peaks. Whilst the TCM is the most complex model and can be a challenge to calibrate, the PDM is of intermediate complexity. For a simple model, the IEM is surprisingly successful, particularly in terms of Threshold CSI. The simplest models, the TF and PRTF, are easiest to calibrate and initialise and can provide acceptable forecasts for some catchments. For smaller catchments in particular, TF models compare favourably with other models when used with error prediction rather than state updating. The MCRM proved sensitive to initial conditions of soil moisture but can work well on small-to-medium sized catchments. The NWS model, despite its large number of parameters, proved easy to calibrate using automatic optimisation and provided reasonable performance. Use of radar data gave as good, and sometimes slightly better results than using raingauge data alone, provided the radar was functioning well, and raingauge-calibration generally helped. The Grid Model was the only distributed model assessed and can utilise radar data in grid form. For the three catchments on which it was evaluated in simulation-mode it consistently gave the second best model simulations in terms of R2 but did less well according to the Threshold CSI criterion. Operationally, the TCM, PDM and IEM models appear to be the most appropriate flood forecasting models to use, of those assessed, the choice depending on the complexity of catchment response whilst all models have value in the right situation. The advantage of model familiarity acquired through past use is employed to guide more specific recommendations for each EA region. It is recommended that more automated applications of TF/PRTF models be pursued which accommodate the effects of catchment wetness on runoff production through effective rainfall transformations and incorporate baseflow via parallel “fast” and “slow” transfer function routing components. Opportunities for further research on model formulation and configuration, updating schemes, and catchment-scale rainfall estimation are identified.

Item Type:	Publication - Report
Programmes:	CEH Programmes pre-2009 publications > Water
UKCEH and CEH Sections/Science Areas:	_ Hydrological Risks & Resources Boorman (to September 2014)
ISBN:	1857053974
Funders/Sponsors:	Environment Agency
Additional Information. Not used in RCUK Gateway to Research.:	This report should be cited as follows: Bell, V.A., Carrington, D.S. and Moore, R.J. (2001) Comparison of rainfall-runoff models for flood forecasting. Part 2: Calibration and evaluation of models. Environment Agency R&D Technical Report W242, Research Contractor: Institute of Hydrology, September 2001, Environment Agency, Bristol, UK, 239pp.
Additional Keywords:	Rainfall-runoff model, Floods and flooding, Flood forecasting, Flood warning, Modelling (hydrological)
NORA Subject Terms:	Hydrology
Date made live:	23 Jun 2009 14:01 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/7474

Actions (login required)

View Item

Document Downloads

More statistics for this item...