Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

J-measure based pruning for advancing classification performance of information entropy based rule generation

Liu, Han ORCID: https://orcid.org/0000-0002-7731-8258, Cocea, Mihaela and Ding, Weili 2018. J-measure based pruning for advancing classification performance of information entropy based rule generation. Presented at: International Conference on Machine Learning and Cybernetics, Chengdu, China, 15-18 July 2018. 2018 International Conference on Machine Learning and Cybernetics (ICMLC). Piscataway, New Jersey: IEEE, pp. 485-490. 10.1109/ICMLC.2018.8527063

This is the latest version of this item.

[thumbnail of ICMLC 2018 Intelligent Systems.pdf]
Preview
PDF - Accepted Post-Print Version
Download (257kB) | Preview

Abstract

Learning of classification rules is a popular approach of machine learning, which can be achieved through two strategies, namely divide-and-conquer and separate-and-conquer. The former is aimed at generating rules in the form of a decision tree, whereas the latter generates if-then rules directly from training data. From this point of view, the above two strategies are referred to as decision tree learning and rule learning, respectively. Both learning strategies can lead to production of complex rule based classifiers that overfit training data, which has motivated researchers to develop pruning algorithms towards reduction of overfitting. In this paper, we propose a J-measure based pruning algorithm, which is referred to as Jmean-pruning. The proposed pruning algorithm is used to advance the performance of the information entropy based rule generation method that follows the separate and conquer strategy. An experimental study is reported to show how Jmean-pruning can effectively help the above rule learning method avoid overfitting. The results show that the use of Jmean-pruning achieves to advance the performance of the rule learning method and the improved performance is very comparable or even considerably better than the one of C4.5.

Item Type: Conference or Workshop Item (Paper)
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: IEEE
ISBN: 978-1-5386-5214-5
Date of First Compliant Deposit: 8 May 2018
Date of Acceptance: 8 May 2018
Last Modified: 25 Oct 2022 13:26
URI: https://orca.cardiff.ac.uk/id/eprint/119823

Available Versions of this Item

Citation Data

Cited 1 time in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics