Volume 5 Number 7 (Jul. 2010)
Home > Archive > 2010 > Volume 5 Number 7 (Jul. 2010) >
JSW 2010 Vol.5(7): 705-712 ISSN: 1796-217X
doi: 10.4304/jsw.5.7.705-712

Feature Extraction in Speechreading

Jun He, Hua Zhang

information college, NanChang university

Abstract—To solve the problem of feature extraction in speechreading, several appearance-based feature extraction method are compared and a new improved LDA algorithm is proposed in this paper. In speech or speechreading recognition application, Linear Discriminant Analysis(LDA) usually choose syllable、HMM state or other units as class unit. but the feature dimensionality reduction direction based on this traditional LDA have no direct relations with recognition accuracy,To this problem, A LDA algorithm based on Object (LDAO) which is fit for isolated words recognition in speechreading is proposed, LDAO choose the objects to be recognized as class unit to Linear Discriminant Analysis, which guarantees feature extraction follow the most discriminant directions among objects in theory. Subsequently, training and recognizing method for LDAO was also given. All experiments were performed on bimodal database, Experimental results showed that this algorithm is superior to any other appearance-based feature extraction algorithm in speechreading. Specifically, LDAO is better than DCT+LDA about 3%.

Index Terms—speechreading, feature extraction, LDA, LDAO.


Cite: Jun He, Hua Zhang, "Feature Extraction in Speechreading," Journal of Software vol. 5, no. 7, pp. 705-712, 2010.

General Information

  • ISSN: 1796-217X (Online)
  • Frequency:  Quarterly
  • Editor-in-Chief: Prof. Antanas Verikas
  • Executive Editor: Ms. Yoyo Y. Zhou
  • Abstracting/ Indexing: DBLP, EBSCO, CNKIGoogle Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
  • E-mail: jsweditorialoffice@gmail.com
  • APC: 500USD
  • Jun 12, 2024 News!

    Vol 19, No 2 has been published with online version   [Click]

  • Jan 04, 2024 News!

    JSW will adopt Article-by-Article Work Flow

  • Apr 01, 2024 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Apr 01, 2024 News!

    Papers published in JSW Vol 18, No 1- Vol 18, No 6 have been indexed by DBLP   [Click]

  • Mar 01, 2024 News!

    Vol 19, No 1 has been published with online version    [Click]