ROBITT: a tool for assessing the risk-of-bias in studies of temporal trends in ecology

Boyd, Robin J. ORCID: https://orcid.org/0000-0002-7973-9865; Powney, Gary D.; Burns, Fiona; Danet, Alain; Duchenne, François; Grainger, Matthew J.; Jarvis, Susan G. ORCID: https://orcid.org/0000-0001-5382-5135; Martin, Gabrielle; Nilsen, Erlend B.; Porcher, Emmanuelle; Stewart, Gavin B.; Wilson, Oliver J.; Pescott, Oliver L. ORCID: https://orcid.org/0000-0002-0685-8046. 2022 ROBITT: a tool for assessing the risk-of-bias in studies of temporal trends in ecology. Methods in Ecology and Evolution, 13 (7). 1497-1507. https://doi.org/10.1111/2041-210X.13857

Before downloading, please read NORA policies.

Preview

Text N532666JA.pdf - Published Version Available under License Creative Commons Attribution 4.0. Download (2MB) | Preview

Abstract/Summary

1. Aggregated species occurrence and abundance data from disparate sources are increasingly accessible to ecologists for the analysis of temporal trends in biodiversity. However, sampling biases relevant to any given research question are often poorly explored and infrequently reported; this can undermine statistical inference. In other disciplines, it is common for researchers to complete ‘risk-of-bias’ assessments to expose and document the potential for biases to undermine conclusions. The huge growth in available data, and recent controversies surrounding their use to infer temporal trends, indicate that similar assessments are urgently needed in ecology. 2. We introduce ROBITT, a structured tool for assessing the ‘Risk-Of-Bias In studies of Temporal Trends in ecology’. ROBITT has a similar format to its counterparts in other disciplines: it comprises signalling questions designed to elicit information on the potential for bias in key study domains. In answering these, users will define study inferential goal(s) and relevant statistical target populations. This information is used to assess potential sampling biases across domains relevant to the research question (e.g. geography, taxonomy, environment), and how these vary through time. If assessments indicate biases, then users must clearly describe them and/or explain what mitigating action will be taken. 3. Everything that users need to complete a ROBITT assessment is provided: the tool, a guidance document and a worked example. Following other disciplines, the tool and guidance document were developed through a consensus-forming process across experts working in relevant areas of ecology and evidence synthesis. 4. We propose that researchers should be strongly encouraged to include a ROBITT assessment when publishing studies of biodiversity trends, especially when using aggregated data. This will help researchers to structure their thinking, clearly acknowledge potential sampling issues, highlight where expert consultation is required and provide an opportunity to describe data checks that might go unreported. ROBITT will also enable reviewers, editors and readers to establish how well research conclusions are supported given a dataset combined with some analytical approach. In turn, it should strengthen evidence-based policy and practice, reduce differing interpretations of data and provide a clearer picture of the uncertainties associated with our understanding of reality.

Item Type:	Publication - Article
Digital Object Identifier (DOI):	https://doi.org/10.1111/2041-210X.13857
UKCEH and CEH Sections/Science Areas:	Biodiversity (Science Area 2017-) Soils and Land Use (Science Area 2017-)
ISSN:	2041-210X
Additional Information. Not used in RCUK Gateway to Research.:	Open Access paper - full text available via Official URL link.
Additional Keywords:	essential biodiversity variables, indicators, insect declines, risk-of-bias, species occurrence data, temporal trends, uncertainty
NORA Subject Terms:	Ecology and Environment Data and Information
Date made live:	30 May 2022 13:57 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/532666

Actions (login required)

View Item

Document Downloads

More statistics for this item...