Swesi, Idheba Mohamad Ali Omer and Abu Bakar, Azuraliza (2019) Feature clustering for pso-based feature construction on high-dimensional data. Journal of Information and Communication Technology (JICT), 18 (4). pp. 439-472. ISSN 1675-414X

PDF Restricted to Registered users only Download (3MB) | Request a copy

Abstract

Feature construction (FC) refers to a process that uses the original features to construct new features with better discrimination ability. Particle Swarm Optimisation (PSO) is an effective search technique that has been successfully utilised in FC. However, the application of PSO for feature construction using high dimensional data has been a challenge due to its large search space and high computational cost. Moreover, unnecessary features that were irrelevant, redundant and contained noise were constructed when PSO was applied to the whole feature. Therefore, the main purpose of this paper is to select the most informative features and construct new features from the selected features for a better classification performance. The feature clustering methods were used to aggregate similar features into clusters, whereby the dimensionality of the data was lowered by choosing representative features from every cluster to form the final feature subset. The clustering of each features are proven to be accurate in feature selection (FS), however, only one study investigated its application in FC for classification. The study identified some limitations, such as the implementation of only two binary classes and the decreasing accuracy of the data. This paper proposes a cluster based PSO feature construction approach called ClusPSOFC. The Redundancy-Based Feature Clustering (RFC) algorithm was applied to choose the most informative features from the original data, while PSO was used to construct new features from those selected by RFC. Experimental results were obtained by using six UCI data sets and six high-dimensional data to demonstrate the efficiency of the proposed method when compared to the original full features, other PSO based FC methods, and standard genetic programming based feature construction (GPFC). Hence, the ClusPSOFC method is effective for feature construction in the classification of high dimensional data.

Item Type:	Article
Uncontrolled Keywords:	Particle swarm optimisation, feature construction, genetic programming, classification, high- dimensional data
Subjects:	Q Science > QA Mathematics > QA76 Computer software
Divisions:	School of Law
Depositing User:	Mrs. Norazmilah Yaakub
Date Deposited:	01 Mar 2020 01:04
Last Modified:	01 Mar 2020 01:04
URI:	https://repo.uum.edu.my/id/eprint/26846

Actions (login required)

View Item