mailto:uumlib@uum.edu.my 24x7 Service; AnyTime; AnyWhere

Multilabel Over-sampling and Under-sampling with Class Alignment for Imbalanced Multilabel Text Classification

Taha, Adil Yaseen and Tiun, Sabrina and Abd Rahman, Abdul Hadi and Sabah, Ali (2021) Multilabel Over-sampling and Under-sampling with Class Alignment for Imbalanced Multilabel Text Classification. Journal of Information and Communication Technology, 20 (03). pp. 423-456. ISSN 2180-3862

[thumbnail of JICT 20 03 2021 423-456.pdf] PDF - Published Version
Restricted to Registered users only

Download (779kB) | Request a copy

Abstract

Simultaneous multiple labelling of documents, also known as multilabel text classification, will not perform optimally if the class is highly imbalanced. Class imbalanced entails skewness in the fundamental data for distribution that leads to more difficulty in classification. Random over-sampling and under-sampling are common approaches to solve the class imbalanced problem. However, these approaches have several drawbacks; the under-sampling is likely to dispose of useful data, whereas the over-sampling can heighten the probability of overfitting. Therefore, a new method that can avoid discarding useful data and overfitting problems is needed. This study proposes a method to tackle the class imbalanced problem by combining multilabel over-sampling and under-sampling with class alignment (ML-OUSCA). In the proposed ML-OUSCA, instead of using all the training instances, it draws a new training set by over-sampling small size classes and under-sampling big size classes. To evaluate our proposed ML-OUSCA, evaluation metrics of average precision, average recall and average F-measure on three benchmark datasets, namely, Reuters-21578, Bibtex, and Enron datasets, were performed. Experimental results showed that the proposed ML-OUSCA outperformed the chosen baseline random resampling approaches; K-means SMOTE and KNN-US. Thus, based on the results, we can conclude that designing a resampling method based on the class imbalanced together with class alignment will improve multilabel classification even better than just the random resampling method.

Item Type: Article
Additional Information: Printed by UUM Press
Subjects: Q Science > QA Mathematics
Divisions: College of Arts and Sciences
Depositing User: Mrs Nurin Jazlina Hamid
Date Deposited: 31 Jul 2022 07:58
Last Modified: 31 Jul 2022 07:58
URI: https://repo.uum.edu.my/id/eprint/28781

Actions (login required)

View Item View Item