PropBase “Warehouse” architecture

Nayembil, Martin; Richardson, Anne; Smith, Graham; Burden, Simon. 2014 PropBase “Warehouse” architecture. In: PropBASE Technical Discussion, Nottingham, UK & Copenhagen, Denmark, 06/03/2014, 14/08/2014. (Unpublished)

Before downloading, please read NORA policies.

Preview

Text PropBase Architecture.pdf Download (927kB) | Preview

Abstract/Summary

PropBase is a “data warehouse” system that extracts, transforms and loads data into a simplified data model from across BGS’s heterogeneous property data sources into a single view so that the data is compatible and accessible from a single interface. The system consists of: data tables that form the core of a simplified data structure; coding routines that are run at regular intervals for the extraction, transformation and load of data into the simplified data structures, a second tier partitioned denormalized data access layer that serves as the data access point by applications. The system also includes a suite of java coded search utilities that facilitate easy data discovery and download to allow for the complex synthesis of many data types simultaneously. ; There is also a web service to allow for machine‐to‐machine interaction, enabling other software systems to directly interrogate the datasets to visualise and manipulate them. This system will have a significant impact by allowing multiple datasets to be rapidly integrated for scientific understanding whilst ensuring that data is properly managed and available for future use.

Item Type:	Publication - Conference Item (Paper)
Additional Keywords:	database, spatial data, data modelling, datasets, data warehouse, data extraction, transformation and loading loading routines, denormalised, denormalisation, web service, data architecture
NORA Subject Terms:	Earth Sciences Computer Science Data and Information
Date made live:	06 Mar 2015 15:16 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/509988

Actions (login required)

View Item

Document Downloads

More statistics for this item...