Volume 7 Number 4 (Apr. 2012)
Home > Archive > 2012 > Volume 7 Number 4 (Apr. 2012) >
JSW 2012 Vol.7(4): 919-926 ISSN: 1796-217X
doi: 10.4304/jsw.7.4.919-926

Data Dependant Learners Ensemble Pruning

Gang Zhang1, 2, Jian Yin2, Xiaomin He1, and Lianglun Cheng1
1Faculty of Automation, GuangDong University of Technology, GuangZhou, China
2Computer Science Department, SUN YAT-SEN University, GuangZhou, China

Abstract—Ensemble learning aims at combining several slightly different learners to construct stronger learner. Ensemble of a well selected subset of learners would outperform than ensemble of all. However, the well studied accuracy / diversity ensemble pruning framework would lead to over fit of training data, which results a target learner of relatively low generalization ability. We propose to ensemble with base learners trained by both labeled and unlabeled data, by adopting data dependant kernel mapping, which has been proved successful in semisupervised learning, to get more generalized base learners. We bootstrap both training data and unlabeled data, namely point cloud, to build slight different data set, then construct data dependant kernel. With such kernels data point can be mapped to different feature space which results effective ensemble. We also proof that ensemble of learners trained by both labeled and unlabeled data is of better generalization ability in the meaning of graph Laplacian. Experiments on UCI data repository show the effectiveness of the proposed method.

Index Terms—ensemble learning; generalization ability; data dependant kernel; kernel mapping; point cloud kernel


Cite: Gang Zhang, Jian Yin2, Xiaomin He, and Lianglun Cheng, "Data Dependant Learners Ensemble Pruning," Journal of Software vol. 7, no. 4, pp. 919-926, 2012.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Nov 18, 2019 News!

    Papers published in JSW Vol 14, No 1- Vol 14 No 10 have been indexed by DBLP     [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Jul 10, 2019 News!

    Vol 14, No.8 has been published with online version 4 original aritcles from 2 countries are published in this issue.    [Click]

  • Nov 18, 2019 News!

    Vol 14, No 11 has been published with online version 4 original aritcles from 4 countries are published in this issue     [Click]