Volume 5 Number 7 (Jul. 2010)
Home > Archive > 2010 > Volume 5 Number 7 (Jul. 2010) >
JSW 2010 Vol.5(7): 705-712 ISSN: 1796-217X
doi: 10.4304/jsw.5.7.705-712

Feature Extraction in Speechreading

Jun He, Hua Zhang
information college, NanChang university

Abstract—To solve the problem of feature extraction in speechreading, several appearance-based feature extraction method are compared and a new improved LDA algorithm is proposed in this paper. In speech or speechreading recognition application, Linear Discriminant Analysis(LDA) usually choose syllable、HMM state or other units as class unit. but the feature dimensionality reduction direction based on this traditional LDA have no direct relations with recognition accuracy,To this problem, A LDA algorithm based on Object (LDAO) which is fit for isolated words recognition in speechreading is proposed, LDAO choose the objects to be recognized as class unit to Linear Discriminant Analysis, which guarantees feature extraction follow the most discriminant directions among objects in theory. Subsequently, training and recognizing method for LDAO was also given. All experiments were performed on bimodal database, Experimental results showed that this algorithm is superior to any other appearance-based feature extraction algorithm in speechreading. Specifically, LDAO is better than DCT+LDA about 3%.

Index Terms—speechreading, feature extraction, LDA, LDAO.


Cite: Jun He, Hua Zhang, "Feature Extraction in Speechreading," Journal of Software vol. 5, no. 7, pp. 705-712, 2010.

General Information

ISSN: 1796-217X (Online)
Frequency:  Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, Google Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Apr 26, 2021 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Jun 22, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 15 No 4 have been indexed by DBLP     [Click]

  • Sep 13, 2021 News!

    The papers published in Vol 16, No 6 have all received dois from Crossref    [Click]

  • Jan 28, 2021 News!

    [CFP] 2021 the annual meeting of JSW Editorial Board, ICCSM 2021, will be held in Rome, Italy, July 21-23, 2021   [Click]

  • Sep 13, 2021 News!

    Vol 16, No 6 has been published with online version     [Click]