Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

TopoFormer: Integrating transformers and ConvLSTMS for coastal topography prediction

Munian, Santosh, Karakuş, Oktay ORCID: https://orcid.org/0000-0001-8009-9319, Russell, William and Nelson, Gwyn 2025. TopoFormer: Integrating transformers and ConvLSTMS for coastal topography prediction. Presented at: IGARSS 2025 - 2025 IEEE International Geoscience and Remote Sensing Symposium, Brisbane, Australia, 03-08 August 2025. IGARSS 2025 - 2025 IEEE International Geoscience and Remote Sensing Symposium. IEEE, pp. 6989-6993. 10.1109/IGARSS55030.2025.11313955

[thumbnail of TopoFormer (1).pdf]
Preview
PDF - Accepted Post-Print Version
Available under License Creative Commons Attribution.

Download (4MB) | Preview

Abstract

This paper presents TopoFormer, a novel hybrid deep learning architecture that integrates transformer-based encoders with convolutional long short-term memory (ConvLSTM) layers for the precise prediction of topographic beach profiles referenced to elevation datums, with a particular focus on Mean Low Water Springs (MLWS) and Mean Low Water Neaps (MLWN). Accurate topographic estimation down to MLWS is critical for coastal management, navigation safety, and environmental monitoring. Leveraging a comprehensive dataset from the Wales Coastal Monitoring Centre (WCMC), consisting of over 2000 surveys across 36 coastal survey units, TopoFormer addresses key challenges in topographic prediction, including temporal variability and data gaps in survey measurements. The architecture uniquely combines multi-head attention mechanisms and ConvLSTM layers to capture both long-range dependencies and localized temporal patterns inherent in beach profiles data. TopoFormer's predictive performance was rigorously evaluated against state-of-the-art models, including DenseNet, 1D/2D CNNs, and LSTMs. While all models demonstrated strong performance, TopoFormer achieved the lowest mean absolute error (MAE), as low as 2 cm, and provided superior accuracy in both indistribution (ID) and out-of-distribution (OOD) evaluations.

Item Type: Conference or Workshop Item (Paper)
Date Type: Published Online
Status: In Press
Schools: Schools > Computer Science & Informatics
Publisher: IEEE
ISBN: 9798331508111
ISSN: 2153-6996
Date of First Compliant Deposit: 9 January 2026
Last Modified: 09 Jan 2026 09:45
URI: https://orca.cardiff.ac.uk/id/eprint/183672

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics