A unified understanding of deep NLP models for text classification

Li, Zhen, Wang, Xiting, Yang, Weikai, Wu, Jing ORCID: https://orcid.org/0000-0001-5123-9861, Zhang, Zhengyan, Liu, Zhiyuan, Sun, Maosong, Zhang, Hui and Liu, Shixia 2022. A unified understanding of deep NLP models for text classification. IEEE Transactions on Visualization and Computer Graphics 28 (12) , pp. 4980-4994. 10.1109/TVCG.2022.3184186

Preview

PDF - Accepted Post-Print Version Download (16MB) | Preview

Abstract

The rapid development of deep natural language processing (NLP) models for text classification has led to an urgent need for a unified understanding of these models proposed individually. Existing methods cannot meet the need for understanding different models in one framework due to the lack of a unified measure for explaining both low-level (e.g., words) and high-level (e.g., phrases) features. We have developed a visual analysis tool, DeepNLPVis, to enable a unified understanding of NLP models for text classification. The key idea is a mutual information-based measure, which provides quantitative explanations on how each layer of a model maintains the information of input words in a sample. We model the intra- and inter-word information at each layer measuring the importance of a word to the final prediction as well as the relationships between words, such as the formation of phrases. A multi-level visualization, which consists of a corpus-level, a sample-level, and a word-level visualization, supports the analysis from the overall training set to individual samples. Two case studies on classification tasks and comparison between models demonstrate that DeepNLPVis can help users effectively identify potential problems caused by samples and model architectures and then make informed improvements.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1077-2626
Date of First Compliant Deposit:	20 July 2022
Date of Acceptance:	15 June 2022
Last Modified:	07 Nov 2023 00:33
URI:	https://orca.cardiff.ac.uk/id/eprint/151394

Actions (repository staff only)

Edit Item