Sehaa: A big data analytics tool for healthcare symptoms and diseases detection using Twitter, Apache Spark, and Machine Learning

Alotaibi, Shoayee, Mehmood, Rashid, Katib, Iyad, Rana, Omer ORCID: https://orcid.org/0000-0003-3597-2646 and Albeshri, Aiiad 2020. Sehaa: A big data analytics tool for healthcare symptoms and diseases detection using Twitter, Apache Spark, and Machine Learning. Applied Sciences 10 (4) , -. 10.3390/app10041398

PDF - Published Version Available under License Creative Commons Attribution. Download (6MB)

Abstract

Smartness, which underpins smart cities and societies, is defined by our ability to engage with our environments, analyze them, and make decisions, all in a timely manner. Healthcare is the prime candidate needing the transformative capability of this smartness. Social media could enable a ubiquitous and continuous engagement between healthcare stakeholders, leading to better public health. Current works are limited in their scope, functionality, and scalability. This paper proposes Sehaa, a big data analytics tool for healthcare in the Kingdom of Saudi Arabia (KSA) using Twitter data in Arabic. Sehaa uses Naive Bayes, Logistic Regression, and multiple feature extraction methods to detect various diseases in the KSA. Sehaa found that the top five diseases in Saudi Arabia in terms of the actual aicted cases are dermal diseases, heart diseases, hypertension, cancer, and diabetes. Riyadh and Jeddah need to do more in creating awareness about the top diseases. Taif is the healthiest city in the KSA in terms of the detected diseases and awareness activities. Sehaa is developed over Apache Spark allowing true scalability. The dataset used comprises 18.9 million tweets collected from November 2018 to September 2019. The results are evaluated using well-known numerical criteria (Accuracy and F1-Score) and are validated against externally available statistics.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	MDPI
ISSN:	2076-3417
Date of First Compliant Deposit:	28 February 2020
Date of Acceptance:	11 February 2020
Last Modified:	05 May 2023 01:55
URI:	https://orca.cardiff.ac.uk/id/eprint/130025

Citation Data

Cited 53 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item