Volume 6 Number 11 (Nov. 2011)
Home > Archive > 2011 > Volume 6 Number 11 (Nov. 2011) >
JSW 2011 Vol.6(11): 2271-2281 ISSN: 1796-217X
doi: 10.4304/jsw.6.11.2271-2281

A Synthesis of Software Evaluation Methodologies and the Proposal of a New Practical Approach

Armin Azarian, Ali Siadat
Arts et Métiers ParisTech / Laboratoire LCFC, Metz, France

Abstract—A large number of developed, acquired or purchased software tools do not respond to the users’ requirements and expectations which had often been at the origin of the project. This is mainly due to two reasons: firstly because the users’ requirements are not well identified or formalized as they should, secondly because the software and tool evaluation is not robust enough or does not have a minimum required quality [1]. We attempt to propose a new approach in order to assess and quantify the quality of the software evaluation process. The theoretical approach is based on elaborating a matrix (An,m) of software functionalities versus user’s scenarios. The norm of the columns and lines vectors of this matrix may be considered as a quality indicator of the process. Performance metrics are also derived from such indicators to summarize the quality of software evaluation process from the users’ point of view. We have applied such an approach on one case study and derived indicators like task effectiveness and efficiency of the software product evaluation. This method helps in two stages of the development cycle of the software: during the design phase and during the verification and validation. The case study helps to identify software imperfections and insufficiencies in a practical manner early in the development lifecycle. Thus improving subsequent releases of the software product.

Index Terms—Operational Software Evaluation, Functional Matrix Decomposition, Verification and validation Process, Process Quality, Indicator and Metrics

[PDF]

Cite: Armin Azarian, Ali Siadat, "A Synthesis of Software Evaluation Methodologies and the Proposal of a New Practical Approach," Journal of Software vol. 6, no. 11, pp. 2271-2281, 2011.

General Information

ISSN: 1796-217X (Online)
Frequency: Monthly (2006-2019); Bimonthly (Since 2020)
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, etc
E-mail: jsw@iap.org
  • Dec 06, 2019 News!

    Vol 14, No 1- Vol 14, No 4 has been indexed by EI (Inspec)   [Click]

  • Mar 17, 2020 News!

    Papers published in JSW Vol 14, No 1- Vol 14 No 12 have been indexed by DBLP     [Click]

  • Mar 31, 2020 News!

    Vol 15, No 2 has been published with online version   [Click]

  • Aug 01, 2018 News!

    [CFP] 2020 the annual meeting of JSW Editorial Board, ICCSM 2020, will be held in Rome, Italy, July 17-19, 2020   [Click]

  • Jun 25, 2019 News!

    Vol.13, No.9 has been indexed by EI (Inspec).   [Click]