Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

The case of aspect in sentiment analysis: seeking attention or co-dependency?

Zunic, Anastazia, Corcoran, Padraig ORCID: and Spasic, Irena ORCID: 2022. The case of aspect in sentiment analysis: seeking attention or co-dependency? Machine Learning and Knowledge Extraction 4 (2) , pp. 474-487. 10.3390/make4020021

[thumbnail of make-04-00021.pdf] PDF - Published Version
Available under License Creative Commons Attribution.

Download (824kB)


(1) Background: Aspect-based sentiment analysis (SA) is a natural language processing task, the aim of which is to classify the sentiment associated with a specific aspect of a written text. The performance of SA methods applied to texts related to health and well-being lags behind that of other domains. (2) Methods: In this study, we present an approach to aspect-based SA of drug reviews. Specifically, we analysed signs and symptoms, which were extracted automatically using the Unified Medical Language System. This information was then passed onto the BERT language model, which was extended by two layers to fine-tune the model for aspect-based SA. The interpretability of the model was analysed using an axiomatic attribution method. We performed a correlation analysis between the attribution scores and syntactic dependencies. (3) Results: Our fine-tuned model achieved accuracy of approximately 95% on a well-balanced test set. It outperformed our previous approach, which used syntactic information to guide the operation of a neural network and achieved an accuracy of approximately 82%. (4) Conclusions: We demonstrated that a BERT-based model of SA overcomes the negative bias associated with health-related aspects and closes the performance gap against the state-of-the-art in other domains.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Data Innovation Research Institute (DIURI)
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Publisher: MDPI
ISSN: 2504-4990
Related URLs:
Date of First Compliant Deposit: 23 June 2022
Date of Acceptance: 9 May 2022
Last Modified: 22 May 2023 15:28

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics