The case of aspect in sentiment analysis: seeking attention or co-dependency?

Zunic, Anastazia, Corcoran, Padraig ORCID: https://orcid.org/0000-0001-9731-3385 and Spasic, Irena ORCID: https://orcid.org/0000-0002-8132-3885 2022. The case of aspect in sentiment analysis: seeking attention or co-dependency? Machine Learning and Knowledge Extraction 4 (2) , pp. 474-487. 10.3390/make4020021

PDF - Published Version Available under License Creative Commons Attribution. Download (824kB)

Abstract

(1) Background: Aspect-based sentiment analysis (SA) is a natural language processing task, the aim of which is to classify the sentiment associated with a specific aspect of a written text. The performance of SA methods applied to texts related to health and well-being lags behind that of other domains. (2) Methods: In this study, we present an approach to aspect-based SA of drug reviews. Specifically, we analysed signs and symptoms, which were extracted automatically using the Unified Medical Language System. This information was then passed onto the BERT language model, which was extended by two layers to fine-tune the model for aspect-based SA. The interpretability of the model was analysed using an axiomatic attribution method. We performed a correlation analysis between the attribution scores and syntactic dependencies. (3) Results: Our fine-tuned model achieved accuracy of approximately 95% on a well-balanced test set. It outperformed our previous approach, which used syntactic information to guide the operation of a neural network and achieved an accuracy of approximately 82%. (4) Conclusions: We demonstrated that a BERT-based model of SA overcomes the negative bias associated with health-related aspects and closes the performance gap against the state-of-the-art in other domains.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics Data Innovation Research Institute (DIURI)
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Publisher:	MDPI
ISSN:	2504-4990
Related URLs:	https://github.com/ispasic/ABSA-attentio...
Date of First Compliant Deposit:	23 June 2022
Date of Acceptance:	9 May 2022
Last Modified:	06 Jan 2024 02:29
URI:	https://orca.cardiff.ac.uk/id/eprint/149750

Actions (repository staff only)

Edit Item