Volume 7 Number 11 (Nov. 2012)
Home > Archive > 2012 > Volume 7 Number 11 (Nov. 2012) >
JSW 2012 Vol.7(11): 2511-2517 ISSN: 1796-217X
doi: 10.4304//jsw.7.11.2511-2517

Training MEMM with PSO: A Tool for Part-of- Speech Tagging

Lei La, Qiao Guo, Qimin Cao
School of Automation, Beijing Institute of Technology, Beijing, China

Abstract—Maximum Entropy Markov Models (MEMM) can avoid the assumption of independence in traditional Hidden Markov Models (HMM), and thus take advantage of context information in most text mining tasks. Because the convergence rate of the classic generalized iterative scaling (GIS) algorithm is too low to be tolerated, researchers proposed a lot of improved methods such as IIS, SCGIS and LBFGS for parameters training in MEMM. However these methods sometimes do not satisfy task requirements in efficiency and robustness. This article modifies the traditional Particle Swarm Optimization (PSO) algorithm by using dynamic global mutation probability (DGMP) to solve the local optimum and infinite loops problems and use the modified PSO in MEMM for estimating the parameters. We introduce the MEMM trained by modified PSO into Chinese Part-of-Speech (POS) tagging, analysis the experimental results and find it has higher convergence rate and accuracy than traditional MEMM.

Index Terms—Maximum Entropy Markov Models, Particle Swarm Optimization, dynamic global mutation probability, Part-of-Speech, text mining


Cite: Lei La, Qiao Guo, Qimin Cao, "Training MEMM with PSO: A Tool for Part-of- Speech Tagging," Journal of Software vol. 7, no. 11, pp. 2511-2517, 2012.

General Information

ISSN: 1796-217X
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jsw@iap.org
  • Jan 11, 2019 News!

    Papers published in JSW Vol. 13, No. 1- Vol. 13 No. 12 have been indexed by DBLP.    [Click]

  • Aug 24, 2018 News!

    Vol.12, No.8- Vol.13, No.5 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2019 the annual meeting of JSW Editorial Board, ICCSM 2019, will be held in Barcelona, Spain, July 14-16, 2019.   [Click]

  • Jan 15, 2019 News!

    Welcome Prof. Timothy J Arndt from USA to join the Editorial board of JSW   [Click]

  • Apr 03, 2019 News!

    Vol 14, No. 4 has been published with online version 4 original aritcles from 4 countries are published in this issue.    [Click]