Volume 5 Number 5 (May 2010)
Home > Archive > 2010 > Volume 5 Number 5 (May 2010) >
JSW 2010 Vol.5(5): 530-537 ISSN: 1796-217X
doi: 10.4304/jsw.5.5.530-537

Combining Self Learning and Active Learning for Chinese Named Entity Recognition*

Lin Yao1, Chengjie Sun2, Xiaolong Wang1, Xuan Wang1
1Computer Science Department, Harbin Institute of Technology Shenzhen Graduate School ShenZhen, China
2School of Computer Science and Technology, Harbin Institute of Technology Harbin, China

Abstract—This paper proposes a combination of active learning and self-training method to reduce the labeling effort for Chinese Named Entity Recognition (NER). Active learning and self-training are two different ways to use unlabeled data. They are complement when choosing unlabeled data for further training. A new strategy based on Information Density (ID) for sample selecting in sequential labeling problem is also proposed, which is suitable for both active learning and self-training. Conditional Random Fields (CRFs) is chosen as the underlying model for active learning and self-training in the proposed approach due to its promising performance in many sequence labeling tasks. Experiment results show the effect of the proposed method. On Sighan bakeoff 2006 MSRA NER corpus, an F1 score of 77.4% is achieved by using only 15,000 training sentences chosen by the proposed hybrid method.

Index Terms—self-training, active learning, named entity recognition, information density, condition random fields.


Cite: Lin Yao, Chengjie Sun, Xiaolong Wang, Xuan Wang, "Combining Self Learning and Active Learning for Chinese Named Entity Recognition*," Journal of Software vol. 5, no. 5, pp. 530-537, 2010.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly (2006-2019); Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, Google Scholar, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Dec 06, 2019 News!

    Vol 14, No 1- Vol 14, No 4 has been indexed by EI (Inspec)   [Click]

  • Jun 22, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 15 No 4 have been indexed by DBLP     [Click]

  • Dec 15, 2020 News!

    The papers published in Vol 16, No 1 have all received dois from Crossref    [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Dec 15, 2020 News!

    Vol 16, No 1 has been published with online version     [Click]