doi: 10.17706/jsw.12.4.292-302
Comparative Analysis of Gaussian Process Regression Based Extreme Learning Machine
2Department of Basic Courses, Agricultural University of Hebei, Huanghua 061100, China
3Department of Computer Science, Bahauddin Zakariya University, Multan, Pakistan.
Abstract—It is an effective way to overcome the randomization sensibility of extreme learning machine (ELM) by using Gaussian process regression (GPR) to optimize the output-layer weights. The key of GPR based ELM (GPRELM) is the selection of kernel function which is used to measure the similarity between different hidden-layer output vectors. In this paper, we conduct an experimental analysis to compare the classification performances of radial basis function (RBF) kernel and polynomial (Poly) kernel based GPRELMs. The comparative results on 24 UCI data sets reveal that: (1) GPRELMs have the serious over-fitting; (2) GPRELMs can get the better classification accuracies with less hidden-layer nodes in comparison with the original ELM; and (3) the smaller regularization factors usually bring about the higher training accuracies for GPRELMs, while the larger regularization factors usually result in the higher testing accuracies. All these conclusions provide the useful enlightenments and instructions for the theoretical studies and practical applications of GPRELMs.
Index Terms—Extreme learning machine, gaussian process regression; radial basis function kernel; polynomial Kernel.
Cite: Jing Zhou, Rui Ying Liu, Xu Zhou, Rana Aamir Raza Ashfaq, "Comparative Analysis of Gaussian Process Regression Based Extreme Learning Machine," Journal of Software vol. 12, no. 4, pp. 292-302, 2017.
General Information
ISSN: 1796-217X (Online)
Abbreviated Title: J. Softw.
Frequency: Quarterly
APC: 500USD
DOI: 10.17706/JSW
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Cecilia Xie
Abstracting/ Indexing: DBLP, EBSCO,
CNKI, Google Scholar, ProQuest,
INSPEC(IET), ULRICH's Periodicals
Directory, WorldCat, etcE-mail: jsweditorialoffice@gmail.com
-
Oct 22, 2024 News!
Vol 19, No 3 has been published with online version [Click]
-
Jan 04, 2024 News!
JSW will adopt Article-by-Article Work Flow
-
Apr 01, 2024 News!
Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec) [Click]
-
Apr 01, 2024 News!
Papers published in JSW Vol 18, No 1- Vol 18, No 6 have been indexed by DBLP [Click]
-
Jun 12, 2024 News!
Vol 19, No 2 has been published with online version [Click]