Skip to main content
Erschienen in: Journal of Medical Systems 10/2015

01.10.2015 | Systems-Level Quality Improvement

Classification of Medical Datasets Using SVMs with Hybrid Evolutionary Algorithms Based on Endocrine-Based Particle Swarm Optimization and Artificial Bee Colony Algorithms

verfasst von: Kuan-Cheng Lin, Yi-Hsiu Hsieh

Erschienen in: Journal of Medical Systems | Ausgabe 10/2015

Einloggen, um Zugang zu erhalten

Abstract

The classification and analysis of data is an important issue in today’s research. Selecting a suitable set of features makes it possible to classify an enormous quantity of data quickly and efficiently. Feature selection is generally viewed as a problem of feature subset selection, such as combination optimization problems. Evolutionary algorithms using random search methods have proven highly effective in obtaining solutions to problems of optimization in a diversity of applications. In this study, we developed a hybrid evolutionary algorithm based on endocrine-based particle swarm optimization (EPSO) and artificial bee colony (ABC) algorithms in conjunction with a support vector machine (SVM) for the selection of optimal feature subsets for the classification of datasets. The results of experiments using specific UCI medical datasets demonstrate that the accuracy of the proposed hybrid evolutionary algorithm is superior to that of basic PSO, EPSO and ABC algorithms, with regard to classification accuracy using subsets with a reduced number of features.
Literatur
1.
Zurück zum Zitat Raghupathi, W., Data mining in health care. Health. Informat. Improv. Efficienc. Productiv. 211–223, 2010. Raghupathi, W., Data mining in health care. Health. Informat. Improv. Efficienc. Productiv. 211–223, 2010.
2.
Zurück zum Zitat Piateski, G., and Frawley, W., Knowledge discovery in databases. MIT press: Cambridge, MA, USA, 1991. Piateski, G., and Frawley, W., Knowledge discovery in databases. MIT press: Cambridge, MA, USA, 1991.
3.
Zurück zum Zitat Mannila, H., Data mining: machine learning, statistics, and databases. In: Eighth International Conference on Scientific and Statistical Database Systems (pp. 2–9). IEEE Computer Society: Stockholm, 1996. Mannila, H., Data mining: machine learning, statistics, and databases. In: Eighth International Conference on Scientific and Statistical Database Systems (pp. 2–9). IEEE Computer Society: Stockholm, 1996.
4.
Zurück zum Zitat Dash, M., and Liu, H., Feature selection for classification. Intell. Data Anal. 1(3):131–156, 1997.CrossRef Dash, M., and Liu, H., Feature selection for classification. Intell. Data Anal. 1(3):131–156, 1997.CrossRef
5.
Zurück zum Zitat Furey, T. S., Cristianini, N., Duffy, N., Bednarski, D. W., Schummer, M., and Haussler, D., Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16(10):906–914, 2000.CrossRefPubMed Furey, T. S., Cristianini, N., Duffy, N., Bednarski, D. W., Schummer, M., and Haussler, D., Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16(10):906–914, 2000.CrossRefPubMed
6.
Zurück zum Zitat Livadas, C., Walsh, R., Lapsley, D., and Strayer, W. T., Using machine learning techniques to identify botnet traffic. In: The 31st IEEE Conference on Local Computer Networks (pp. 967–974). IEEE: Tampa, FL, 2006. Livadas, C., Walsh, R., Lapsley, D., and Strayer, W. T., Using machine learning techniques to identify botnet traffic. In: The 31st IEEE Conference on Local Computer Networks (pp. 967–974). IEEE: Tampa, FL, 2006.
7.
Zurück zum Zitat Shin, C., Doermann, D., and Rosenfeld, A., Classification of document pages using structure-based features. Int. J. Doc. Anal. Recog. 3(4):232–247, 2001.CrossRef Shin, C., Doermann, D., and Rosenfeld, A., Classification of document pages using structure-based features. Int. J. Doc. Anal. Recog. 3(4):232–247, 2001.CrossRef
8.
Zurück zum Zitat Liu, H., and Motoda, H., Feature selection for knowledge discovery and data mining. Kluwer Academic Publishers: Norwell, MA, USA, 1998. Liu, H., and Motoda, H., Feature selection for knowledge discovery and data mining. Kluwer Academic Publishers: Norwell, MA, USA, 1998.
9.
Zurück zum Zitat Holland, J. H., Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. MIT Press: Cambridge, MA, USA, 1992. Holland, J. H., Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. MIT Press: Cambridge, MA, USA, 1992.
10.
Zurück zum Zitat Kirkpatrick, S., and Vecchi, M. P., Optimization by simmulated annealing. Science 220(4598):671–680, 1983.CrossRefPubMed Kirkpatrick, S., and Vecchi, M. P., Optimization by simmulated annealing. Science 220(4598):671–680, 1983.CrossRefPubMed
11.
Zurück zum Zitat Cortes, C., and Vapnik, V., Support-vector networks. Mach. Learn. 20(3):273–297, 1995. Cortes, C., and Vapnik, V., Support-vector networks. Mach. Learn. 20(3):273–297, 1995.
12.
Zurück zum Zitat Kennedy, J., Particle swarm optimization. Encyclopedia of Machine Learning (pp. 760–766), Springer, US, 1995. Kennedy, J., Particle swarm optimization. Encyclopedia of Machine Learning (pp. 760–766), Springer, US, 1995.
13.
Zurück zum Zitat Chen, D. B., and Zhao, C. X., Particle swarm optimization based on endocrine regulation mechanism. Contr. Theor. Appl. 24(6):126–134, 2007. Chen, D. B., and Zhao, C. X., Particle swarm optimization based on endocrine regulation mechanism. Contr. Theor. Appl. 24(6):126–134, 2007.
14.
Zurück zum Zitat Karaboga, D., An idea based on honey bee swarm for numerical optimization (Vol. 200). Technical report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department, 2005. Karaboga, D., An idea based on honey bee swarm for numerical optimization (Vol. 200). Technical report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department, 2005.
15.
Zurück zum Zitat Youssef, H., Sait, S. M., and Adiche, H., Evolutionary algorithms, simulated annealing and tabu search: a comparative study. Eng. Appl. Artif. Intel. 14(2):167–181, 2001.CrossRef Youssef, H., Sait, S. M., and Adiche, H., Evolutionary algorithms, simulated annealing and tabu search: a comparative study. Eng. Appl. Artif. Intel. 14(2):167–181, 2001.CrossRef
16.
Zurück zum Zitat Wang, X., Hybrid nature-inspired computation methods for optimization. TKK Dissertations, Doctoral Dissertation, Helsinki University of Technology, 2009. Wang, X., Hybrid nature-inspired computation methods for optimization. TKK Dissertations, Doctoral Dissertation, Helsinki University of Technology, 2009.
17.
Zurück zum Zitat Zhi-gang, W., Hybrid optimization algorithm based on particle swarm optimization and artificial bee colony algorithm. Sci. Technol. Eng. 12(20):4921–4925, 2012. Zhi-gang, W., Hybrid optimization algorithm based on particle swarm optimization and artificial bee colony algorithm. Sci. Technol. Eng. 12(20):4921–4925, 2012.
18.
Zurück zum Zitat Guo, Z., A hybrid optimization algorithm based on artificial bee colony and gravitational search algorithm. Int. J. Dig. Cont. Tech. Appl. 6(17):620–626, 2012. Guo, Z., A hybrid optimization algorithm based on artificial bee colony and gravitational search algorithm. Int. J. Dig. Cont. Tech. Appl. 6(17):620–626, 2012.
19.
Zurück zum Zitat Karaboga, D., and Akay, B., A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214(1):108–132, 2009.CrossRef Karaboga, D., and Akay, B., A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214(1):108–132, 2009.CrossRef
20.
Zurück zum Zitat Liu, J., Zhang, X., and Ning, A., Hybrid optimization algorithm of PSO and ABC. Comput. Eng. Appl. 47(35):32–34, 2011. Liu, J., Zhang, X., and Ning, A., Hybrid optimization algorithm of PSO and ABC. Comput. Eng. Appl. 47(35):32–34, 2011.
21.
Zurück zum Zitat Altun, O., and Korkmaz, T., Particle Swarm Optimization–Artificial Bee Colony Chain (PSOABCC): A hybrid meteahuristic algorithm. Scientific Cooperations International Workshops on Electrical and Computer Engineering Subfields (pp. 22–23). Istanbul, Turkey: Koc University, 2014. Altun, O., and Korkmaz, T., Particle Swarm Optimization–Artificial Bee Colony Chain (PSOABCC): A hybrid meteahuristic algorithm. Scientific Cooperations International Workshops on Electrical and Computer Engineering Subfields (pp. 22–23). Istanbul, Turkey: Koc University, 2014.
22.
Zurück zum Zitat Kong, X., Liu, S., and Wang, Z., A new hybrid artificial bee colony algorithm for global optimization. Int. J. Comp. Sci. 10(1), 2013. Kong, X., Liu, S., and Wang, Z., A new hybrid artificial bee colony algorithm for global optimization. Int. J. Comp. Sci. 10(1), 2013.
23.
Zurück zum Zitat Hsu, C. W., Chang, C. C., and Lin, C. J., A practical guide to support vector classification. Technical report, Department of Computer Science, National Taiwan University, 2003. Hsu, C. W., Chang, C. C., and Lin, C. J., A practical guide to support vector classification. Technical report, Department of Computer Science, National Taiwan University, 2003.
25.
Zurück zum Zitat Salzberg, S. L., On comparing classifiers: Pitfalls to avoid and a recommended approach. Data Min. Knowledg. Discov. 1(3):317–328, 1997.CrossRef Salzberg, S. L., On comparing classifiers: Pitfalls to avoid and a recommended approach. Data Min. Knowledg. Discov. 1(3):317–328, 1997.CrossRef
26.
Zurück zum Zitat Shi, Y., and Eberhart, R. C., Empirical study of particle swarm optimization. In Proceedings of the Congress on Evolutionary Computation (CEC '99) (pp. 1945–1950). IEEE Service Center, Piscataway, NJ, USA, 1999. Shi, Y., and Eberhart, R. C., Empirical study of particle swarm optimization. In Proceedings of the Congress on Evolutionary Computation (CEC '99) (pp. 1945–1950). IEEE Service Center, Piscataway, NJ, USA, 1999.
Metadaten
Titel
Classification of Medical Datasets Using SVMs with Hybrid Evolutionary Algorithms Based on Endocrine-Based Particle Swarm Optimization and Artificial Bee Colony Algorithms
verfasst von
Kuan-Cheng Lin
Yi-Hsiu Hsieh
Publikationsdatum
01.10.2015
Verlag
Springer US
Erschienen in
Journal of Medical Systems / Ausgabe 10/2015
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-015-0306-3

Weitere Artikel der Ausgabe 10/2015

Journal of Medical Systems 10/2015 Zur Ausgabe