Spatio-temporal multi-level attention crop mapping method using time-series SAR imagery
Han, Zhu; Zhang, Ce ORCID: https://orcid.org/0000-0001-5100-3584; Gao, Lianru; Zeng, Zhiqiang; Zhang, Bing; Atkinson, Peter M.. 2023 Spatio-temporal multi-level attention crop mapping method using time-series SAR imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 206. 293-310. 10.1016/j.isprsjprs.2023.11.016
Before downloading, please read NORA policies.Preview |
Text
N536437JA.pdf - Published Version Available under License Creative Commons Attribution 4.0. Download (9MB) | Preview |
Abstract/Summary
Accurate crop mapping is of great significance for crop yield forecasting, agricultural productivity development and agricultural management. Thanks to its all-time and all-weather capability, integrating multi-temporal synthetic aperture radar (SAR) for crop mapping has become essential and challenging task in remote sensing. In recent years, deep learning (DL) has demonstrated excellent crop mapping accuracy to interpret crop dynamics. However, existing DL-based methods tend to be incapable of capturing spatial and temporal features at different scales simultaneously, and this often leads to severe mis-classification due to the complex and heterogeneous distribution of crops and diverse phenological patterns. In this paper, we propose a novel spatio-temporal multi-level attention method, named as STMA, for crop mapping using time-series SAR imagery in an end-to-end fashion to increase the capability of crop phenology retrieval. Specifically, the multi-level attention mechanism is designed to aggregate multi-scale spatio-temporal representations on crops via cascaded spatio-temporal self-attention (STSA) and multi-scale cross-attention (MCA) modalities. To ensure a fine extraction of multi-granularity features, a learnable spatial attention position encoding is proposed to adaptively generate the position priors to facilitate multi-level attention learning. Experimental results on Brandenburg Sentinel-1 dataset, public PASTIS-R dataset and South Africa dataset demonstrated that STMA can achieve state-of-the-art performance in crop mapping tasks, with the accuracy of 96.54% in the Brandenburg Sentinel-1 dataset, 86.77% in the PASTIS-R dataset and 83.37% in the South Africa dataset, validating its effectiveness and superiority. Further comparison of spatio-temporal generalization capability reflected its excellent performance in spatio-temporal modeling on different crops and scenarios. This research provides a viable and intelligent spatio-temporal framework for large-area crop mapping using time-series SAR imagery in complex agricultural systems. The Brandenburg Sentinel-1 dataset and the STMA code will be publicly available at https://github.com/hanzhu97702/ISPRS_STMA.
Item Type: | Publication - Article |
---|---|
Digital Object Identifier (DOI): | 10.1016/j.isprsjprs.2023.11.016 |
UKCEH and CEH Sections/Science Areas: | UKCEH Fellows |
ISSN: | 0924-2716 |
Additional Information. Not used in RCUK Gateway to Research.: | Open Access paper - full text available via Official URL link. |
Additional Keywords: | crop mapping; time-series imagery, spatio-temporal self-attention, multi-scale cross-attention, deep learning |
NORA Subject Terms: | Agriculture and Soil Science Data and Information |
Related URLs: | |
Date made live: | 11 Dec 2023 13:10 +0 (UTC) |
URI: | https://nora.nerc.ac.uk/id/eprint/536437 |
Actions (login required)
View Item |
Document Downloads
Downloads for past 30 days
Downloads per month over past year