Interpretable ordinal-aware with contrastive-enhanced anomaly severity detection on UAV flight log messages

Silalahi, Swardiantara, Ahmad, Tohari, Studiawan, Hudan, Anthi, Eirini and Williams, Lowri 2025. Interpretable ordinal-aware with contrastive-enhanced anomaly severity detection on UAV flight log messages. IEEE Access 13 , pp. 105361-105379. 10.1109/access.2025.3580056

PDF - Published Version Download (3MB)

Abstract

Detecting abnormalities in a system using log records is a common approach, although such applications may vary between different deployment domains. For example, in drone forensics, existing studies generally consider anomalies as contradictory to normal events. In other words, all types of anomalies are considered equally important. However, the peculiar events experienced by a drone during a flight might contain distinct features indicating the anomalies’ importance or level of urgency. For instance, the message “Critically low power. Aircraft is landing” is more important than “Forward Obstacle Sensing not Working”. This study proposes DroneLog, an interpretable framework for detecting anomalies and the severity levels on drone flight logs, using a multitask learning approach in a unified pipeline. Complying with the multitask learning nature, two target label representations are designed to leverage the shared low-level common features of the input messages over various severity levels. An extensive experiment with a significant hyperparameter search space is performed to find the best-performing model to compare with several baselines and state-of-the-art methods from previous studies. The integrated gradient is employed to investigate the best-performing model’s trustworthiness and interpretability. We found that the model perceived the log messages’ semantics differently and were not aligned with how a human expert would. Therefore, DroneSBERT, a domain-specific embedding trained using contrastive learning, is proposed as a follow-up to the interpretability findings. From the experimental results, the proposed method achieves the highest performance with an improvement in accuracy and F1 scores of 5.128% and 4.453% on the unique-filtered dataset, respectively. Therefore, the proposed method accordingly addresses the task objective with a promising performance while being interpretable and trustworthy.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Schools > Computer Science & Informatics
Additional Information:	License information from Publisher: LICENSE 1: URL: https://creativecommons.org/licenses/by/4.0/legalcode, Start Date: 2025-01-01
Publisher:	Institute of Electrical and Electronics Engineers
Date of First Compliant Deposit:	9 July 2025
Date of Acceptance:	8 June 2025
Last Modified:	09 Jul 2025 10:45
URI:	https://orca.cardiff.ac.uk/id/eprint/179663

Actions (repository staff only)

Edit Item