Volume 9 Number 2 (Feb. 2014)
Home > Archive > 2014 > Volume 9 Number 2 (Feb. 2014) >
JSW 2014 Vol.9(2): 429-436 ISSN: 1796-217X
doi: 10.4304/jsw.9.2.429-436

Automated Essay Scoring Using Incremental Latent Semantic Analysis

Mingqing Zhang1, Shudong Hao1, Yanyan Xu1, Dengfeng Ke2, Hengli Peng3
1School of Information Science and Technology, Beijing Forestry University
2Institute of Automation, Chinese Academy of Sciences
3Institute of Educational Measurement, Beijing Language and Culture University

Abstract—Writing has been increasingly regarded by the testers of language tests as an important indicator to assess the language skill of testees. As such tests become more and more popular and the number of testees becomes larger, it is a huge task to score so many essays by raters. So far, many methods have been used to solve this problem and the traditional method is Latent Semantic Analysis (LSA). In this paper, we introduce a new incremental method of LSA to score essays effectively when the dataset is massive. By comparison of the traditional method and our new incremental method, concerning the running time and memory usage, experimental results make it obvious that the incremental method has a huge advantage over the traditional method. Furthermore, we use real corpora of test essays submitted to the MHK test (Chinese Proficiency Test for Minorities), to demonstrate that the incremental method is not only efficient but also effective in performing LSA. The experimental results also show that when using incremental LSA, the scoring accuracy can reach 88.8%.

Index Terms—automated essay scoring, incremental latent semantic analysis, singular value decomposition

[PDF]

Cite: Mingqing Zhang, Shudong Hao, Yanyan Xu, Dengfeng Ke, Hengli Peng, "Automated Essay Scoring Using Incremental Latent Semantic Analysis," Journal of Software vol. 9, no. 2, pp. 429-436, 2014.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jsw@iap.org
  • Jun 25, 2019 News!

    Papers published in JSW Vol. 14, No. 1- Vol. 14 No. 6 have been indexed by DBLP.    [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2019 the annual meeting of JSW Editorial Board, ICCSM 2019, will be held in Barcelona, Spain, July 14-16, 2019.   [Click]

  • Jul 10, 2019 News!

    Vol 14, No.8 has been published with online version 4 original aritcles from 2 countries are published in this issue.    [Click]

  • Jul 22, 2019 News!

    Welcome Prof Ferhat Khendek from Canada to join the Editorial board of JSW    [Click]