Automatic sentiment analysis of citizen comments: the case of the Albania earthquake

Contreras, Diana, Veliu, Enes, Antypas, Dimosthenis, Hervas, Javier, Landès, Matthieu, Fallou, Laure, Koxhaj, Damiano, Bossu, Rémy, Wilkinson, Sean, Camacho Collados, Jose ORCID: https://orcid.org/0000-0003-1618-7239 and Dushi, Edmond 2026. Automatic sentiment analysis of citizen comments: the case of the Albania earthquake. GeoHazards 7 (2) , 62. 10.3390/geohazards7020062

PDF - Published Version Available under License Creative Commons Attribution. Download (9MB)

Abstract

Collecting and analysing data after an earthquake is essential to determine its impact. In 2014, the European Mediterranean Seismological Centre launched the LastQuake system. Its app collects reports on the intensity users feel, along with comments that provide situational awareness. However, text data collected through crowdsourcing platforms is unstructured. Therefore, natural language processing techniques such as sentiment analysis and aspect-based sentiment analysis are necessary to extract meaningful information. On the 26 November 2019, following an earthquake in Albania, the LastQuake app recorded 28,220 reports with user comments. For the current analysis, we sampled comments posted on the exact day of the earthquake, in Albanian: 1678 comments (6%). The most frequent polarity detected in comments from LastQuake app users was negative (52%), followed by positive and neutral. However, manual classification is time-consuming and not feasible during the emergency phase. Therefore, we tested the accuracy of two automatic classification models for sentiment analysis: ‘troberta’ and ‘txlm’. These models were fine-tuned using already-classified text data from the 2020 Aegean earthquake. Using the manual classification as the reference to evaluate the accuracy of the automatic classification models for sentiment analysis yields accuracies of 71% for the ‘troberta’ model and 56% for the ‘txlm’ model.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Schools > Earth and Environmental Sciences Schools > Computer Science & Informatics
Additional Information:	License information from Publisher: LICENSE 1: URL: https://creativecommons.org/licenses/by/4.0/, Start Date: 2026-05-27
Publisher:	MDPI
Date of First Compliant Deposit:	10 June 2026
Last Modified:	10 Jun 2026 10:00
URI:	https://orca.cardiff.ac.uk/id/eprint/187501

Actions (repository staff only)

Edit Item