CFP last date
15 May 2024
Reseach Article

Feature Dimensionality Reduction using a Dual Level Metaheuristic Algorithm

by Babatunde R. S., Olabiyisi S. O., Omidiora E. O., Ganiyu R. A.
International Journal of Applied Information Systems
Foundation of Computer Science (FCS), NY, USA
Volume 7 - Number 1
Year of Publication: 2014
Authors: Babatunde R. S., Olabiyisi S. O., Omidiora E. O., Ganiyu R. A.
10.5120/ijais14-451134

Babatunde R. S., Olabiyisi S. O., Omidiora E. O., Ganiyu R. A. . Feature Dimensionality Reduction using a Dual Level Metaheuristic Algorithm. International Journal of Applied Information Systems. 7, 1 ( April 2014), 49-52. DOI=10.5120/ijais14-451134

@article{ 10.5120/ijais14-451134,
author = { Babatunde R. S., Olabiyisi S. O., Omidiora E. O., Ganiyu R. A. },
title = { Feature Dimensionality Reduction using a Dual Level Metaheuristic Algorithm },
journal = { International Journal of Applied Information Systems },
issue_date = { April 2014 },
volume = { 7 },
number = { 1 },
month = { April },
year = { 2014 },
issn = { 2249-0868 },
pages = { 49-52 },
numpages = {9},
url = { https://www.ijais.org/archives/volume7/number1/616-1134/ },
doi = { 10.5120/ijais14-451134 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2023-07-05T18:54:33.515784+05:30
%A Babatunde R. S.
%A Olabiyisi S. O.
%A Omidiora E. O.
%A Ganiyu R. A.
%T Feature Dimensionality Reduction using a Dual Level Metaheuristic Algorithm
%J International Journal of Applied Information Systems
%@ 2249-0868
%V 7
%N 1
%P 49-52
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

The need to reduce the curse of dimensionality has spurred active research in the field of pattern recognition and machine learning. High dimensional data culminates in redundant as well as discriminant features. A vast amount of related literature offered the use of pattern classification methods such as Neural Network, Adaboost, Principal Component Analysis and Support Vector Machine, which adopts metaheuristics to extract important features from a pre-labelled training set. However, most of these individual metaheuristics algorithm are time and memory consuming when used to project the dataset into a lower subspace for subsequent classification. These drawbacks are reduced through a combination of two solution approaches whereby the strengths of two metaheuristics are brought together in a dual level algorithm. This research presents a dual level metaheuristic algorithm for feature dimensionality reduction using ant colony optimization (ACO) algorithm at Level 1 and genetic algorithm (GA) at Level 2. The dimension of the features in a face dataset will be reduced by using ACO at Level 1 to extract the relevant facial features in the training dataset. The output obtained will be fed into GA at Level 2 to select the discriminant feature subset that becomes the optimized parameter used by support vector machine (SVM) for classification. The developed algorithm suggests that the combination of one or more nature inspired metaheuristic algorithm is crucial for obtaining a high performance optimizer for feature dimensionality reduction to solve the problem of classification.

References
  1. Abraham A. , Grosan C. (2008): "Hybridizing a genetic algorithm with an artificial immune system for global optimization". Engineering Evolutionary Intelligent Systems. Springer-Verlag. Vol 38, No. 5, pp. 809 - 814
  2. Bu, Tian-Ming. , Yu, Song Nian. , Guan, Hui-Wei. (2004): "Binary – Coding – Based Ant Colony Optimization and its Convergence. " Vol. 19, No 4, pp. 472 – 478.
  3. Delac Kresimir, Grgic Mislav, Grgic Sonja. (2006): "Independent Comparative Study of PCA, ICA and LDA on the FERET Data Set". Wiley Periodicals, Inc. vol. 15. No. 5, pp. 252-260.
  4. Fagbola, Temitayo. , Olabiyisi, Stephen, Adigun Abimbola. (2012): "Hybrid GA-SVM for Efficient Feature Selection in E-mail Classification". Computer Engineering and Intelligent Systems. Vol. 3 No. 3. pp. 17-28.
  5. Imani Maryam Bahojb, Pourhabibi Tahereh, Keyvanpour Mohammad Reza, and Azmi Reza. (2012): "A New Feature Selection Method Based on Ant Colony and Genetic Algorithm on Persian Font Recognition". International Journal of Machine Learning and Computing. Vol 2 No. 2. Pp 278-282
  6. Li, Na. , Wang, Shoubi. , Li Yulan. (2011): "A hybrid Approach of Genetic Algorithm and Ant Colony Optimization for Vehicle Routing Problem". Journal of Computational Information Systems Vol. 7 No. 13. pp 4939 – 4946.
  7. Mall Anjana, Ghosh Shusmita. (2012): "Neural Network training Based Face Detection and Recognition". International Journal of Computer Science and Management Research. Vol. 1 No. 2. pp. 103-109
  8. Osuna,E. Freund, R. and Girosi, F. (1997): "Training Support Vector Machines: An Application to Face Detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130-136
  9. Platt, C. John. (1998): " Sequential Minimal Optimization. A fast algorithm for Training Support Vector Machines". Technical Report MSR-TR-98-14.
  10. Raymer, M. L. Punch, W. F. , Goodman, E. D. , Kuhn, L. A. , Jain, A. K. (2000): "Dimensionality Reduction using Genetic Algorithms". IEEE Transactions on Evolutionary Computation, Vol. 4 No. 2. pp. 164-171.
  11. Rifkin, R. , Klantan, N. (2004): "In defense of one -vs-all classification. Journal of Machine Learning Research, 5:101 – 141
  12. Guyon, I. , Elisseeff, A. (2008): " Special issue on variable and feature selection". Journal of Machine Learning Research. Vol. 3. pp. 1157-1182.
  13. Hamidreza Rashidy, Karim Kanan1Faez1 and Mehdi Hosseinzadeh. (2007): Face Recognition System Using Ant Colony Optimization-Based Selected Features. Proceedings of the 2007 IEEE Symposium on Computational Intelligence in Security and Defense Applications. Pp. 57-52.
  14. Hjelmas, E. and Low, B. K. (2001): "Face detection: A survey". Computer Vision and Image Understanding, vol. 83, pp. 236-274.
  15. Sawalha Rana, DoushIyad Abu. (2012): "Face Recognition Using Harmony Search- Based Selected Features". International Journal of Hybrid Information Technology. Vol. 5. No 2. pp. 1-16
  16. Venkatesan M. E. Srinivasa R M. (2010): Face Detection by Hybrid Genetic and Ant Colony Optimization Algorithm. International Journal of Computer Applications. Vol. 9. No. 4. pp. 8-13.
  17. Wang, Xiaolei. (2009): "Hybrid Nature-Inspired Computation Methods for Optimization". Doctoral Dissertation. Helsinki University of Technology, Faculty of Electronics, Communications and Automation. Department of Electrical Engineering. Pp. 5-40. Unpublished.
  18. Wu, Xindong. , Kumar, Vipin. , Quinlan, J. Ross. , Ghosh, Joydeep. , Yang, Qiang. , Motoda, Hiroshi. , McLachlan, J. Geoffrey. , Ng, Angus. , Liu, Bing. , Yu, S. Philip. , Zhou, Zhi-Hua. , Steinbach, Michael. , Hand, J. David. , Steinberg, Dan. (2008): "Top 10 Algorithms in Data Mining". Survey Paper. Knowledge Information System. Vol. 14. pp. 1-37.
  19. Yang, M. -H. , Kriegman,D. and N. Ahuja. (2002): "Detecting Faces in Images: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, No. 1, pp. 34-58.
Index Terms

Computer Science
Information Sciences

Keywords

discriminant feature metaheuristic algorithm dual level dimensionality reduction.