Volume 7 Number 4 (Apr. 2012)
Home > Archive > 2012 > Volume 7 Number 4 (Apr. 2012) >
JSW 2012 Vol.7(4): 919-926 ISSN: 1796-217X
doi: 10.4304/jsw.7.4.919-926

Data Dependant Learners Ensemble Pruning

Gang Zhang1, 2, Jian Yin2, Xiaomin He1, and Lianglun Cheng1
1Faculty of Automation, GuangDong University of Technology, GuangZhou, China
2Computer Science Department, SUN YAT-SEN University, GuangZhou, China

Abstract—Ensemble learning aims at combining several slightly different learners to construct stronger learner. Ensemble of a well selected subset of learners would outperform than ensemble of all. However, the well studied accuracy / diversity ensemble pruning framework would lead to over fit of training data, which results a target learner of relatively low generalization ability. We propose to ensemble with base learners trained by both labeled and unlabeled data, by adopting data dependant kernel mapping, which has been proved successful in semisupervised learning, to get more generalized base learners. We bootstrap both training data and unlabeled data, namely point cloud, to build slight different data set, then construct data dependant kernel. With such kernels data point can be mapped to different feature space which results effective ensemble. We also proof that ensemble of learners trained by both labeled and unlabeled data is of better generalization ability in the meaning of graph Laplacian. Experiments on UCI data repository show the effectiveness of the proposed method.

Index Terms—ensemble learning; generalization ability; data dependant kernel; kernel mapping; point cloud kernel


Cite: Gang Zhang, Jian Yin2, Xiaomin He, and Lianglun Cheng, "Data Dependant Learners Ensemble Pruning," Journal of Software vol. 7, no. 4, pp. 919-926, 2012.

General Information

ISSN: 1796-217X (Online)
Frequency:  Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, Google Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Apr 26, 2021 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Jun 22, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 15 No 4 have been indexed by DBLP     [Click]

  • Sep 13, 2021 News!

    The papers published in Vol 16, No 6 have all received dois from Crossref    [Click]

  • Jan 28, 2021 News!

    [CFP] 2021 the annual meeting of JSW Editorial Board, ICCSM 2021, will be held in Rome, Italy, July 21-23, 2021   [Click]

  • Sep 13, 2021 News!

    Vol 16, No 6 has been published with online version     [Click]