MagPySV: a Python package for processing and denoising geomagnetic observatory data

Cox, G.A.; Brown, W.J.; Billingham, L.; Holme, R.. 2018 MagPySV: a Python package for processing and denoising geomagnetic observatory data. Geochemistry, Geophysics, Geosystems, 19 (9). 3347-3363. https://doi.org/10.1029/2018GC007714

Before downloading, please read NORA policies.

Preview

Text (Open Access Paper)
Cox_et_al-2018-Geochemistry,_Geophysics,_Geosystems.pdf - Published Version
Available under License Creative Commons Attribution 4.0.
Download (2MB) | Preview

Abstract/Summary

Measurements obtained at ground‐based observatories are crucial to understanding the geomagnetic field and its secular variation (SV). However, current data processing methods rely on piecemeal closed‐source codes or are performed on an ad‐hoc basis, hampering efforts to reproduce datasets underlying published results. We present MagPySV, an open‐source Python package designed to provide a consistent and automated means of generating high‐resolution SV datasets from hourly means distributed by the Edinburgh World Data Centre. It applies corrections for documented baseline changes and, optionally, data may be excluded using the ap index, which removes effects from documented high solar activity periods such as geomagnetic storms. Robust statistics are used to identify and remove outliers. Developing existing denoising methods, we use principal component analysis of the covariance matrix of residuals between observed SV and that predicted by a global field model to remove a proxy for external field contamination from observations. This method creates a single covariance matrix for all observatories of interest combined and applies the denoising to all locations simultaneously, resulting in cleaner time series of the internally‐generated SV. In our case studies, we present cleaned data in two geographic regions: monthly first differences are used to investigate geomagnetic jerk morphology in Europe, an area previously well‐studied at lower resolution, and annual differences are investigated for northern high latitude regions, which are often neglected due to their high noise content. MagPySV may be run on the command line or within an interactive Jupyter notebook; two notebooks reproducing the case studies are supplied

Item Type:	Publication - Article
Digital Object Identifier (DOI):	https://doi.org/10.1029/2018GC007714
ISSN:	1525-2027
Date made live:	02 Oct 2018 11:43 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/520884

Item Type:

Publication - Article

Digital Object Identifier (DOI):

https://doi.org/10.1029/2018GC007714

ISSN:

1525-2027

Date made live:

02 Oct 2018 11:43 +0 (UTC)

URI:

https://nora.nerc.ac.uk/id/eprint/520884