Volume 8 Number 4 (Apr. 2013)
Home > Archive > 2013 > Volume 8 Number 4 (Apr. 2013) >
JSW 2013 Vol.8(4): 768-775 ISSN: 1796-217X
doi: 10.4304/jsw.8.4.768-775

A Semi-Supervised Approach Based on k-Nearest Neighbor

Zhiliang Liu1, Xiaomin Zhao2, Jianxiao Zou1, Hongbing Xu1
1School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu, P. R. China
2Department of Mechanical Engineering, University of Alberta, Edmonton, Canada

Abstract—k-nearest neighbor (k-NN) needs sufficient labeled instances for training in order to get robust performance; otherwise, performance deterioration occurs if training sets are small. In this paper, a novel algorithm, namely ordinal semi-supervised k-NN, is proposed to handle cases with a few labeled training instances. This algorithm consists of two parts: instance ranking and semi-supervised learning (SSL). Using SSL, the performance of k-NN with small training sets can be improved because SSL enlarges the training set by including unlabeled instances with their predicted labels. Instance ranking is used to pick up the unlabeled instances that are included to the training set. It gives priority to the unlabeled instances that are closer to class boundaries because they are more likely to be correctly predicted (these instances are called high confidence prediction instances). Thus, SSL benefits from high confidence prediction instances if they are added into the training set early. Experimental results demonstrate that the proposed algorithm outperforms the semi-supervised k- NN and the conventional k-NN algorithms if the training set is small.

Index Terms—Instance ranking; semi-supervised learning; k-nearest neighbor; weighted mean.

[PDF]

Cite: Zhiliang Liu, Xiaomin Zhao, Jianxiao Zou, Hongbing Xu, "A Semi-Supervised Approach Based on k-Nearest Neighbor," Journal of Software vol. 8, no. 4, pp. 768-775, 2013.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly (2006-2019); Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, Google Scholar, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Dec 06, 2019 News!

    Vol 14, No 1- Vol 14, No 4 has been indexed by EI (Inspec)   [Click]

  • Jun 22, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 15 No 4 have been indexed by DBLP     [Click]

  • Jun 22, 2020 News!

    The papers published in Vol 15, No 5 have all received dois from Crossref    [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Jun 22, 2020 News!

    Vol 15, No 5 has been published with online version     [Click]