nerc.ac.uk

PropBase “Warehouse” architecture

Nayembil, Martin; Richardson, Anne; Smith, Graham; Burden, Simon. 2014 PropBase “Warehouse” architecture. In: PropBASE Technical Discussion, Nottingham, UK & Copenhagen, Denmark, 06/03/2014, 14/08/2014. (Unpublished)

Before downloading, please read NORA policies.
[img]
Preview
Text
PropBase Architecture.pdf

Download (927kB) | Preview

Abstract/Summary

PropBase is a “data warehouse” system that extracts, transforms and loads data into a simplified data model from across BGS’s heterogeneous property data sources into a single view so that the data is compatible and accessible from a single interface. The system consists of: data tables that form the core of a simplified data structure; coding routines that are run at regular intervals for the extraction, transformation and load of data into the simplified data structures, a second tier partitioned denormalized data access layer that serves as the data access point by applications. The system also includes a suite of java coded search utilities that facilitate easy data discovery and download to allow for the complex synthesis of many data types simultaneously. ; There is also a web service to allow for machine‐to‐machine interaction, enabling other software systems to directly interrogate the datasets to visualise and manipulate them. This system will have a significant impact by allowing multiple datasets to be rapidly integrated for scientific understanding whilst ensuring that data is properly managed and available for future use.

Item Type: Publication - Conference Item (Paper)
Additional Keywords: database, spatial data, data modelling, datasets, data warehouse, data extraction, transformation and loading loading routines, denormalised, denormalisation, web service, data architecture
NORA Subject Terms: Earth Sciences
Computer Science
Data and Information
Date made live: 06 Mar 2015 15:16 +0 (UTC)
URI: https://nora.nerc.ac.uk/id/eprint/509988

Actions (login required)

View Item View Item

Document Downloads

Downloads for past 30 days

Downloads per month over past year

More statistics for this item...