Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Annals of West University of Timisoara - Mathematics and Computer Science

The Journal of West University of Timisoara

Editor-in-Chief: Sasu, Bogdan

2 Issues per year


Mathematical Citation Quotient (MCQ) 2016: 0.01

Open Access
Online
ISSN
1841-3307
See all formats and pricing
More options …

A Kernel Based Clustering Algorithm using Particle Swarm Optimization

Bianca Mogoş
  • Corresponding author
  • Faculty of Mathematics and Computer Science University of Bucharest, Academiei no. 14, Bucharest, Romania
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Andrei-Horia Mogoş
  • Corresponding author
  • Faculty of Automatic Control and Computers University Politehnica of Bucharest, Splaiul Independeneţei no. 313, Bucharest, Romania
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2013-08-14 | DOI: https://doi.org/10.2478/awutm-2013-0007

Abstract

Unsupervised learning is one of the major research areas in machine learning, while kernel methods provide eficient solutions for various statistical learning problems. In this paper we propose a kernel based clustering algorithm that uses the Particle Swarm Optimization technique and discriminant functions. The method represents a general framework for solving the clustering problem: once an appropriate clustering validation index is chosen for a given class of datasets, the method performs very well in solving the problem. The method automatically detects the clusters in a given dataset and also, automatically estimates the number of clusters. Due to the use of kernel functions, our approach can be used for both linearly separable and linearly non-separable clusters. Since our algorithm uses the Particle Swarm Optimization technique, parallel computation may be used, if necessary. We evaluate our method on various datasets and we discuss its capabilities.

Keywords: clustering algorithm; kernel function; Particle Swarm Optimization; discriminant function; emergent behaviour

  • [1] B. T. Chen and M. Y. Chen, Applying particles swarm optimization for support vector machines on predicting company _nancial crisis, 2010 International Conference on Business and Economics Research, 1, (2011), 301-305Google Scholar

  • [2] C. Y. Chen and F. Ye, Particle Swarm Optimization Algorithm and Its Application to Clustering Analysis, Proceedings of the 2004 IEEE lnternational Conference on Networking, Sensing & Control, (2004), 789-794Google Scholar

  • [3] C. H. Chou, M. C. Su, and E. Lai, Symmetry as A New Measure for Cluster Validity, Proc. 2nd WSEAS Int. Conf. Sci. Comput. Soft Comput., (2002), 209-213Google Scholar

  • [4] L. Y. Chuang, Y. D. Lin, and C. H. Yang, An Improved Particle Swarm Op- timization for Data Clustering, Proceedings of the International MultiConference of Engineers and Computer Scientists, I, (2012), 440-445Google Scholar

  • [5] S. Das, A. Abraham, and A. Konar, Automatic kernel clustering with a Multi- Elitist Particle Swarm Optimization Algorithm, Pattern Recognition Letters, 29, (2008), 688-699Web of ScienceGoogle Scholar

  • [6] L. Dey and A. Mukhopadhyay, Microarray Gene Expression Data Clustering using PSO based K-means Algorithm, Proc. Int. Conf. Advanced Computing, Com- munication and Networks (ICACCN-2011), (2011), 587-591Google Scholar

  • [7] J. C. Dunn, Well Separated Clusters and Optimal Fuzzy Partitions, Journal of Cybernetica, 4, (1974), 95-104Google Scholar

  • [8] R. C. Eberhart and J. Kennedy, A new optimizer using particle swarm theory, Proceedings of the Sixth International Symposium on Micro Machine and Human Science, (1995), 39-43Google Scholar

  • [9] R. C. Eberhart and Y. Shi, Particle Swarm Optimization: Developments, Appli- cations and Resources, Proc. IEEE International Conference on Evolutionary Com- putation, 1, 81-86Google Scholar

  • [10] D. Enăchescu, Statistical Techniques of Data Mining (in Romanian), Editura Uni- versitatii din Bucuresti, Bucuresti, 2003Google Scholar

  • [11] M. G. Genton, Classes of Kernels for Machine Learning: A Statistics Perspective, Journal of Machine Learning Research, 2, (2001), 299-312Google Scholar

  • [12] N. I. Ghali, N. El-Dessouki, A. N. Mervat, and L. Bakrawi, Exponential Particle Swarm Optimization Approach for Improving Data Clustering, International Journal of Electrical and Electronics Engineering, 3, (2009), 208-212Google Scholar

  • [13] N. Ilc, Modied Dunns cluster validity index based on graph theory, Electrical Re- view, Poland, 2, (2012), 126-131Google Scholar

  • [14] A. K. Jain, M. N. Murty, and P. J. Flynn, Data Clustering: A Review, ACM Computing Reviews, (1999)Google Scholar

  • [15] J. Kennedy and R. C. Eberhart, Particle swarm optimization, Proceedings of the IEEE International Conference on Neural Networks, IV, (1995), 1942-1948Google Scholar

  • [16] J. Kennedy and R. C. Eberhart, Swarm Intelligence, Academic Press, USA, 2001Google Scholar

  • [17] A. Khan, N. G. Bawane, and S. Bodkhe, An Analysis of Particle Swarm Opti- mization with Data Clustering-Technique for Optimization in Data Mining, Interna- tional Journal on Computer Science and Engineering, 2, (2010), 1363-1366Google Scholar

  • [18] F. Kovács, C. Legány, and A. Babos, Cluster Validity Measurement Techniques, Proceedings of the 5th WSEAS International Conference on Arti_cial Intelligence, Knowledge Engineering and Data Bases, (2006), 388-393Google Scholar

  • [19] K. Kryszczuk and P. Hurley, Estimation of the number of clusters using multiple clustering validity indices, MCS'10 Proceedings of the 9th international conference on Multiple Classi_er Systems, (2010), 114-123Google Scholar

  • [20] M. A. Montes de Oca, Particle Swarm Optimization. Introduction, http://iridia.ulb.ac.be/_mmontes/slidesCIL/slides.pdf, last accessed February 2012, (2007)Google Scholar

  • [21] M. Neshat, S. F. Yazdi, D. Yazdani, and M. Sargolzaei, A New Cooperative Algorithm Based on PSO and K-Means for Data Clustering, Journal of Computer Science, 8, (2012), 188-194Google Scholar

  • [22] M. Parimala, D. Lopez, and N.C. Senthilkumar, A Survey on Density Based Clustering Algorithms for Mining Large Spatial Databases, International Journal of Advanced Science and Technology, 31, (2011)Google Scholar

  • [23] P. Rai and S. Singh, A Survey of Clustering Techniques, International Journal of Computer Applications (0975 8887), 7, (2010)Google Scholar

  • [24] S. C. Satapathy, G. Pradhan, S. Pattnaik, J. V. R. Murthy, and P. V. G. D. P. Reddy, Performance Comparisons of PSO based Clustering, InterJRI Computer Science and Networking, 1, (2009), 18-23Google Scholar

  • [25] J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, Cam- bridge University Press, New York, 2004Google Scholar

  • [26] S. Theodoridis and K. Koutroumbas, Pattern Recognition 3rd Edition, Acca- demic Press, 2006 Google Scholar

About the article

Published Online: 2013-08-14

Published in Print: 2013-06-01


Citation Information: Annals of West University of Timisoara - Mathematics, ISSN (Print) 1841-3293, DOI: https://doi.org/10.2478/awutm-2013-0007.

Export Citation

This content is open access.

Comments (0)

Please log in or register to comment.
Log in