Evaluating auroral forecasts against satellite observations

Mooney, M.K.; Marsh, M.S.; Forsyth, C.; Sharpe, M.; Hughes, T.; Bingham, S.; Jackson, D.R.; Rae, I.J.; Chisham, G. ORCID: https://orcid.org/0000-0003-1151-5934. 2021 Evaluating auroral forecasts against satellite observations. Space Weather, 19 (8), e2020SW002688. 16, pp. https://doi.org/10.1029/2020SW002688

Before downloading, please read NORA policies.

Preview

Text (Open Access)
© 2021. The Authors.
2020SW002688.pdf - Published Version
Available under License Creative Commons Attribution 4.0.
Download (1MB) | Preview

Official URL: https://agupubs.onlinelibrary.wiley.com/doi/full/1...

Abstract/Summary

The aurora is a readily visible phenomenon of interest to many members of the public. However, the aurora and associated phenomena can also significantly impact communications, ground-based infrastructure, and high-altitude radiation exposure. Forecasting the location of the auroral oval is therefore a key component of space weather forecast operations. A version of the OVATION-Prime 2013 auroral precipitation model (Newell et al., 2014, https://doi.org/10.1002/2014sw001056) was used by the UK Met Office Space Weather Operations Centre (MOSWOC). The operational implementation of the OVATION-Prime 2013 model at the UK Met Office delivered a 30-min forecast of the location of the auroral oval and the probability of observing the aurora. Using weather forecast evaluation techniques, we evaluate the ability of the OVATION-Prime 2013 model forecasts to predict the location and probability of the aurora occurring by comparing the forecasts with auroral boundaries determined from data from the IMAGE satellite between 2000 and 2002. Our analysis shows that the operational model performs well at predicting the location of the auroral oval, with a relative operating characteristic (ROC) score of 0.82. The model performance is reduced in the dayside local time sectors (ROC score = 0.59) and during periods of higher geomagnetic activity (ROC score of 0.55 for Kp = 8). As a probabilistic forecast, OVATION-Prime 2013 tends to underpredict the occurrence of aurora by a factor of 1.1–6, while probabilities of over 90% are overpredicted.

Item Type:	Publication - Article
Digital Object Identifier (DOI):	https://doi.org/10.1029/2020SW002688
ISSN:	1542-7390
Additional Keywords:	Aurora, auroral forecasting, forecast verification, OVATION-Prime 2013, ROC scores, space weather
Date made live:	26 Aug 2021 15:04 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/530936

Item Type:

Publication - Article

Digital Object Identifier (DOI):

https://doi.org/10.1029/2020SW002688

ISSN:

1542-7390

Additional Keywords:

Aurora, auroral forecasting, forecast verification, OVATION-Prime 2013, ROC scores, space weather

Date made live:

26 Aug 2021 15:04 +0 (UTC)

URI:

https://nora.nerc.ac.uk/id/eprint/530936