Classifier Ensemble Design using Artificial Bee Colony based Feature Selection
Artificial Bee Colony (ABC) is a popular meta-heuristic search algorithm used in solving numerous combinatorial optimization problems. Feature Selection (FS) helps to speed up the process of classification by extracting the relevant and useful information from the dataset. FS is seen as an optimization problem because selecting the appropriate feature subset is very important. Classifier Ensemble is the best solution for the pitfall of accuracy lag in a single classifier. This paper proposes a novel hybrid algorithm ABCE - the combination of ABC algorithm and a classifier ensemble (CE). A classifier ensemble consisting of Support Vector Machine (SVM), Decision Tree and Nave Bayes, performs the task of classification and ABCE is used as a feature selector to select the most informative features as well as to increase the overall classification accuracy of the classifier ensemble. Ten UCI (University of California, Irvine) benchmark datasets have been used for the evaluation of the proposed algorithm. Three ensembles ABC-CE, ABC-Bagging and ABC-Boosting have been constructed from the finally selected feature subsets. From the experimental results, it can be seen that these ensembles have shown up to 12% increase in the classification accuracy compared to the constituent classifiers and the standard ensembles Bagging, Boosting, ACO-Bagging and ACO-Boosting.
Keywords: Feature Selection, Classification, Classifier Ensemble, Ant Colony Optimization, Bee Colony Optimization, Artificial Bee Colony, Meta-heuristic search.
Download Full-Text
ABOUT THE AUTHORS
Shunmugapriya Palanisamy
P.Shunmugapriya received her M.E. degree in 2006 from Department of Computer Science and Engineering, FEAT, Annamalai University, Chidambaram. She had been working as a Senior Lecturer for the past 7 years in the Department of Computer Science and Engineering, Sri Manakula Vinayagar Engineering College, Affiliated to Pondicherry University, Puducherry. Currently she is working towards her Ph.D degree in Optimal Design of Classifier Ensembles using Swarm Intelligent, Meta-Heuristic Search Algorithms. Her areas of interest are Artificial Intelligence, Ontology based Software Engineering, Classifier Ensembles and Swarm Intelligence.
Kanmani S
Dr. S. Kanmani received her B.E and M.E in Computer Science and Engineering from Bharathiyar University and Ph.D in Anna University, Chennai. She had been the faculty of Department of Computer Science and Engineering, Pondicherry Engineering College from 1992 onwards. Presently she is a Professor in the Department of Information Technology, Pondicherry Engineering College, Puducherry. Her research interests are Software Engineering, Software testing, Object oriented system, and Data Mining. She is Member of Computer Society of India, ISTE and Institute of Engineers, India. She has published about 50 papers in various international conferences and journals.
Shunmugapriya Palanisamy
P.Shunmugapriya received her M.E. degree in 2006 from Department of Computer Science and Engineering, FEAT, Annamalai University, Chidambaram. She had been working as a Senior Lecturer for the past 7 years in the Department of Computer Science and Engineering, Sri Manakula Vinayagar Engineering College, Affiliated to Pondicherry University, Puducherry. Currently she is working towards her Ph.D degree in Optimal Design of Classifier Ensembles using Swarm Intelligent, Meta-Heuristic Search Algorithms. Her areas of interest are Artificial Intelligence, Ontology based Software Engineering, Classifier Ensembles and Swarm Intelligence.
Kanmani S
Dr. S. Kanmani received her B.E and M.E in Computer Science and Engineering from Bharathiyar University and Ph.D in Anna University, Chennai. She had been the faculty of Department of Computer Science and Engineering, Pondicherry Engineering College from 1992 onwards. Presently she is a Professor in the Department of Information Technology, Pondicherry Engineering College, Puducherry. Her research interests are Software Engineering, Software testing, Object oriented system, and Data Mining. She is Member of Computer Society of India, ISTE and Institute of Engineers, India. She has published about 50 papers in various international conferences and journals.
