Convolutional neural networks for hydrothermal vents substratum classification: An introspective study

Vega, Pedro Juan Soto; Papadakis, Panagiotis; Matabos, Marjolaine; Van Audenhaege, Loïc; Ramiere, Annah; Sarrazin, Jozée; da Costa, Gilson Alexandre Ostwald Pedro. 2024 Convolutional neural networks for hydrothermal vents substratum classification: An introspective study. Ecological Informatics, 80, 102535. https://doi.org/10.1016/j.ecoinf.2024.102535

Before downloading, please read NORA policies.

Preview

Text 1-s2.0-S1574954124000773-main.pdf - Published Version Available under License Creative Commons Attribution 4.0. Download (7MB) | Preview

Abstract/Summary

The increasing availability of seabed images has created new opportunities and challenges for monitoring and better understanding the spatial distribution of fauna and substrata. To date, however, deep-sea substratum classification relies mostly on visual interpretation, which is costly, time-consuming, and prone to human bias or error. Motivated by the success of convolutional neural networks in learning semantically rich representations directly from images, this work investigates the application of state-of-the-art network architectures, originally employed in the classification of non-seabed images, for the task of hydrothermal vent substrata image classification. In assessing their potential, we conduct a study on the generalization, complementarity and human interpretability aspects of those architectures. Specifically, we independently trained deep learning models with the selected architectures using images obtained from three distinct sites within the Lucky-Strike vent field and assessed the models' performances on-site as well as off-site. To investigate complementarity, we evaluated a classification decision committee (CDC) built as an ensemble of networks in which individual predictions were fused through a majority voting scheme. The experimental results demonstrated the suitability of the deep learning models for deep-sea substratum classification, attaining accuracies reaching up to 80% in terms of F1-score. Finally, by further investigating the classification uncertainty computed from the set of individual predictions of the CDC, we describe a semiautomatic framework for human annotation, which prescribes visual inspection of only the images with high uncertainty. Overall, the results demonstrated that high accuracy values of over 90% F1-score can be obtained with the framework, with a small amount of human intervention.

Item Type:	Publication - Article
Digital Object Identifier (DOI):	https://doi.org/10.1016/j.ecoinf.2024.102535
ISSN:	15749541
Additional Keywords:	Image classification, Deep learning, Hydrothermal vents, Uncertainty analysis
Date made live:	25 Apr 2024 15:21 +0 (UTC)
URI:	https://nora.nerc.ac.uk/id/eprint/537344

Actions (login required)

View Item

Document Downloads

More statistics for this item...