Survey of time series database technology

McBride, Brian; Reynolds, Dave. 2020 Survey of time series database technology. Wallingford, UK Centre for Ecology & Hydrology, 33pp. (Unpublished)

Before downloading, please read NORA policies.

Preview

Text
N527832CR.pdf
Download (381kB) | Preview

Abstract/Summary

This report has been prepared by Epimorphics Ltd. as part of the ENTRAIN project (NERC grant number NE/S016244/1) which is a feasibility project within the “NERC Constructing a Digital Environment Strategic Priorities Fund Programme”. The Centre for Ecology and Hydrology(CEH) is a research organisation focusing on land and freshwater ecosystems and their interaction with the atmosphere. The organization manages a number of sensor networks to monitor the environment, and also handles large databases of 3rd party data (e.g. river flows measured by the Environment Agency and equivalents in Scotland and Wales). Data from these networks is stored and made available to users, both internally (through direct query of databases, and externally via web-services). The ENTRAIN project aims to address a number of issues in relation to sensor data storage and integration, using a number of hydrological datasets to help define use cases: COSMOS-UK (a network of ~50 sites measuring soil moisture and meteorological variables at 1-30 minute resolutions); the CEH Greenhouse Gas (GHG) network (~15 sites measuring sub-second fluxes of gases and moisture, subsequently processed up to 30-minute aggregations); the Thames Initiative (a database of weekly and hourly water quality samples from sites around the Thames basin). In addition this report considers the UK National River Flow Archive, a database of daily river flows and catchment rainfall derived by regional environmental agencies from 15-minute measurements of river levels and flows. CEH commissioned this report to survey alternative technologies for storing sensor data that scale better, could manage larger data volumes more easily and less expensively, and that might be readily deployed on different infrastructures.

Item Type:	Publication - Report
UKCEH and CEH Sections/Science Areas:	Pollution (Science Area 2017-) Water Resources (Science Area 2017-)
Funders/Sponsors:	NERC
Additional Information. Not used in RCUK Gateway to Research.:	UKCEH reviewers: Matt Fry, Oliver Swain, Simon Stanley, Mike Brown.
NORA Subject Terms:	Data and Information
Date made live:	02 Jun 2020 13:14 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/527832

Item Type:

Publication - Report

UKCEH and CEH Sections/Science Areas:

Pollution (Science Area 2017-)
Water Resources (Science Area 2017-)

Funders/Sponsors:

NERC

Additional Information. Not used in RCUK Gateway to Research.:

UKCEH reviewers: Matt Fry, Oliver Swain, Simon Stanley, Mike Brown.

NORA Subject Terms:

Data and Information

Date made live:

02 Jun 2020 13:14 +0 (UTC)