Volume 5 Number 5 (May 2010)
Home > Archive > 2010 > Volume 5 Number 5 (May 2010) >
JSW 2010 Vol.5(5): 490-497 ISSN: 1796-217X
doi: 10.4304/jsw.5.5.490-497

A Novel Probabilistic Model for Dependency Parsing

Shixi Fan, Xuan Wang, Xiaolong Wang
School of Computer Science Harbin Institute of Technology Shenzhen Graduate School C303c, Xili university town, ShenZhen, China

Abstract—A new knowledge based probabilistic dependency parsing (KPDP) is presented to overcome the local optimization problem of native probabilistic models. KPDP is composed of two stages: (1) selecting a set of constituent parse trees with an extensive bottom-up chart parsing algorithm which employs Maximum Entropy Models to calculate single arc probabilities; (2) finding the best parsing tree with the help of word knowledge. Different from previous studies, we incorporate word knowledge into parsing procedure. Based on case grammar theory, the word knowledge is represented as some patterns which group those arcs with the same head. Thus, the KPDP contains both single arc information and the relationship information between relevant arcs. KPDP is evaluated experimentally using the dataset distributed in CoNLL 2008 share-task. An unlabelled arc score of 87 % is reported, which is 3.39% higher than the native model without word knowledge. This work will contribute to and stimulate other researches in the field of parsing.

Index Terms—knowledge based probabilistic dependency parsing, Chart Parsing, Maximum Entropy Models.

[PDF]

Cite: Shixi Fan, Xuan Wang, Xiaolong Wang, "A Novel Probabilistic Model for Dependency Parsing," Journal of Software vol. 5, no. 5, pp. 490-497, 2010.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Aug 21, 2019 News!

    Papers published in JSW Vol 14, No 1- Vol 14 No 8 have been indexed by DBLP     [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2019 the annual meeting of JSW Editorial Board, ICCSM 2019, will be held in Barcelona, Spain, July 14-16, 2019.   [Click]

  • Jul 10, 2019 News!

    Vol 14, No.8 has been published with online version 4 original aritcles from 2 countries are published in this issue.    [Click]

  • Sep 12, 2019 News!

    Vol 14, No 10 has been published with online version 4 original aritcles from 2 countries are published in this issue      [Click]