Rapid evaluation framework for the CMIP7 assessment fast track

Hoffman, Forrest M. ORCID: https://orcid.org/0000-0001-5802-4134; Hassler, Birgit ORCID: https://orcid.org/0000-0003-2724-709X; Swaminathan, Ranjini ORCID: https://orcid.org/0000-0001-5853-2673; Lewis, Jared; Andela, Bouwe ORCID: https://orcid.org/0000-0001-9005-8940; Collier, Nathaniel; Hegedűs, Dóra ORCID: https://orcid.org/0009-0000-8304-513X; Lee, Jiwoo ORCID: https://orcid.org/0000-0002-0016-7199; Pascoe, Charlotte ORCID: https://orcid.org/0000-0002-2361-6778; Pflüger, Mika ORCID: https://orcid.org/0000-0002-7814-8916; Stockhause, Martina ORCID: https://orcid.org/0000-0001-6636-4972; Ullrich, Paul; Xu, Min; Bock, Lisa ORCID: https://orcid.org/0000-0001-7058-5938; Chun, Felicity ORCID: https://orcid.org/0009-0007-0845-0953; Gier, Bettina K. ORCID: https://orcid.org/0000-0002-2928-8664; Kelley, Douglas I. ORCID: https://orcid.org/0000-0003-1413-4969; Lauer, Axel ORCID: https://orcid.org/0000-0002-9270-1044; Lenhardt, Julien ORCID: https://orcid.org/0000-0002-9949-3989; Schlund, Manuel ORCID: https://orcid.org/0000-0001-5251-0158; Sreeush, Mohanan G. ORCID: https://orcid.org/0000-0003-3720-5408; Weigel, Katja ORCID: https://orcid.org/0000-0001-6133-7801; Blockley, Ed ORCID: https://orcid.org/0000-0002-0489-4238; Beadling, Rebecca; Beucher, Romain ORCID: https://orcid.org/0000-0003-3891-5444; Dugassa, Demiso D. ORCID: https://orcid.org/0000-0002-8431-2575; Lembo, Valerio ORCID: https://orcid.org/0000-0001-6085-5914; Lu, Jianhua ORCID: https://orcid.org/0000-0002-8241-3356; Brands, Swen ORCID: https://orcid.org/0000-0002-3254-0277; Tjiputra, Jerry ORCID: https://orcid.org/0000-0002-4600-2453; Malinina, Elizaveta ORCID: https://orcid.org/0000-0002-4102-2877; Mederios, Brian ORCID: https://orcid.org/0000-0003-2188-4784; Scoccimarro, Enrico ORCID: https://orcid.org/0000-0001-7987-4744; Walton, Jeremy ORCID: https://orcid.org/0000-0001-7372-178X; Kershaw, Philip ORCID: https://orcid.org/0000-0002-7646-291X; Marquez, André L. ORCID: https://orcid.org/0000-0001-8719-8045; Roberts, Malcolm J.; O’Rourke, Eleanor; Dingley, Elisabeth; Turner, Briony ORCID: https://orcid.org/0000-0003-3390-3831; Hewitt, Helene ORCID: https://orcid.org/0000-0001-7432-6001; Dunne, John P.. 2025 Rapid evaluation framework for the CMIP7 assessment fast track. EGUsphere, egusphere-2025-2685. 10.5194/egusphere-2025-2685

Before downloading, please read NORA policies.

Preview

Text egusphere-2025-2685.pdf - Submitted Version Available under License Creative Commons Attribution 4.0. Download (966kB) | Preview

Abstract/Summary

As Earth system models (ESMs) grow in complexity and in volumes of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon community evaluation and benchmarking tools. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages best-available observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and finally selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for specific diagnostics as soon as model data are published on ESGF by the originating modelling centres. The REF is designed to be portable across a range of current computational platforms to facilitate use by modelling centres for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and reductions in uncertainties for projections since ESMs are the main tool for studying the global Earth system. Production of reproducible diagnostics and community-based assessments are the key features of the REF that help to inform mitigation and adaptation policies.

Item Type:	Publication - Article
Digital Object Identifier (DOI):	10.5194/egusphere-2025-2685
UKCEH and CEH Sections/Science Areas:	Water and Climate Science (2025-)
Additional Information:	Open Access paper - full text available via Official URL link.
NORA Subject Terms:	Earth Sciences Data and Information
Date made live:	22 Jul 2025 11:00 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/539911

Actions (login required)

View Item

Document Downloads

More statistics for this item...