PropBase “Warehouse” architecture
Nayembil, Martin; Richardson, Anne; Smith, Graham; Burden, Simon. 2014 PropBase “Warehouse” architecture. In: PropBASE Technical Discussion, Nottingham, UK & Copenhagen, Denmark, 06/03/2014, 14/08/2014. (Unpublished)
Before downloading, please read NORA policies.
|
Text
PropBase Architecture.pdf Download (927kB) | Preview |
Abstract/Summary
PropBase is a “data warehouse” system that extracts, transforms and loads data into a simplified data model from across BGS’s heterogeneous property data sources into a single view so that the data is compatible and accessible from a single interface. The system consists of: data tables that form the core of a simplified data structure; coding routines that are run at regular intervals for the extraction, transformation and load of data into the simplified data structures, a second tier partitioned denormalized data access layer that serves as the data access point by applications. The system also includes a suite of java coded search utilities that facilitate easy data discovery and download to allow for the complex synthesis of many data types simultaneously. ; There is also a web service to allow for machine‐to‐machine interaction, enabling other software systems to directly interrogate the datasets to visualise and manipulate them. This system will have a significant impact by allowing multiple datasets to be rapidly integrated for scientific understanding whilst ensuring that data is properly managed and available for future use.
| Item Type: | Publication - Conference Item (Paper) |
|---|---|
| Additional Keywords: | database, spatial data, data modelling, datasets, data warehouse, data extraction, transformation and loading loading routines, denormalised, denormalisation, web service, data architecture |
| NORA Subject Terms: | Earth Sciences Computer Science Data and Information |
| Date made live: | 06 Mar 2015 15:16 +0 (UTC) |
| URI: | https://nora.nerc.ac.uk/id/eprint/509988 |
Actions (login required)
 |
View Item |
Document Downloads
Downloads for past 30 days
Downloads per month over past year
Tools
Tools
