On the considerations of using near real time data for space weather hazard forecasting

Space weather represents a severe threat to ground-based infrastructure, satellites and communications. Accurately forecasting when such threats are likely (e.g. when we may see large induced currents) will help to mitigate the societal and financial costs. In recent years computational models have been created that can forecast hazardous intervals, however they generally use post-processed “science” solar wind data from upstream of the Earth. In this work we investigate the quality and continuity of the data that are available in Near-Real-Time (NRT) from the ACE and DSCOVR spacecraft. In general, the data available in NRT corresponds well with post-processed data, however there are three main areas of concern: greater short-term variability in the NRT data, occasional anomalous values and frequent data gaps. Some space weather models are able to compensate for these issues if they are also present in the data used to fit (or train) the model, while others will require extra checks to be implemented in order to produce high quality forecasts. We find that the DSCOVR NRT data are generally more continuous, though they have been available for small fraction of a solar cycle and therefore DSCOVR has experienced a limited range of solar wind conditions. We find that short gaps are the most common, and are most frequently found in the plasma data. To maximize forecast availability we suggest the implementation of limited interpolation if possible, e.g. for gaps of five minutes or less, which could increase the fraction of valid input data considerably.