Detecting and monitoring hate speech in Twitter

Pereira-Kohatsu, Juan Carlos, Quijano-Sánchez, Lara, Liberatore, Federico ORCID: https://orcid.org/0000-0001-9900-5108 and Camacho-Collados, Miguel 2019. Detecting and monitoring hate speech in Twitter. Sensors 19 (21) , 4654. 10.3390/s19214654

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

Social Media are sensors in the real world that can be used to measure the pulse of societies. However, the massive and unfiltered feed of messages posted in social media is a phenomenon that nowadays raises social alarms, especially when these messages contain hate speech targeted to a specific individual or group. In this context, governments and non-governmental organizations (NGOs) are concerned about the possible negative impact that these messages can have on individuals or on the society. In this paper, we present HaterNet, an intelligent system currently being used by the Spanish National Office Against Hate Crimes of the Spanish State Secretariat for Security that identifies and monitors the evolution of hate speech in Twitter. The contributions of this research are many-fold: (1) It introduces the first intelligent system that monitors and visualizes, using social network analysis techniques, hate speech in Social Media. (2) It introduces a novel public dataset on hate speech in Spanish consisting of 6000 expert-labeled tweets. (3) It compares several classification approaches based on different document representation strategies and text classification models. (4) The best approach consists of a combination of a LTSM+MLP neural network that takes as input the tweet’s word, emoji, and expression tokens’ embeddings enriched by the tf-idf, and obtains an area under the curve (AUC) of 0.828 on our dataset, outperforming previous methods presented in the literature.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	MDPI
ISSN:	1424-8220
Date of First Compliant Deposit:	4 December 2019
Date of Acceptance:	21 October 2019
Last Modified:	02 May 2023 16:45
URI:	https://orca.cardiff.ac.uk/id/eprint/127326

Citation Data

Cited 64 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item