Volume 13 Number 12 (Dec. 2018)
Home > Archive > 2018 > Volume 13 Number 12 (Dec. 2018) >
JSW 2018 Vol.13(12): 654-674 ISSN: 1796-217X
doi: 10.17706/jsw.13.12.654-674

Using Code Coverage Metrics for Improving Software Defect Prediction

Bilal Al-Ahmad*
Computer Information Systems Department, Faculty of Information Technology and Systems, The University of Jordan,AqabaBranch,Jordan

Abstract—Software defect prediction enablessoftware developers to estimate the most defective code parts in order to reduce testing efforts. As the size of software project becomes larger, software defect prediction becomes an urgent need. While static product metrics have been extensively investigated as a static meansto predict software defects, coverage analysis of the software has been abandoned due to the expected complexities. Thispaper proposedanovelhybrid approach that leverages code coverage metrics to improve software defect prediction. We build and compare software defect prediction results for four distinct scenarios:static product, code coverage, hybrid, and feature selection. First scenario resembles static analysis and acts as baseline model. Second scenario addresses coverage issues of the associated test cases for the source code. Third and fourth scenarios are derived from combinations of static product and code coverage scenarios. Each scenario has been modeled and examined using thirteen different machine learning classifiers. Two rounds of experiments have been done. First round employs real data extracted from 23 successivereleasesof Apache Lucene, whereas second round applies oversampling technique for the same releases. The results indicate that code coverage scenario attains a significant improvement in software defect prediction,especially when there is a high-coverage ratio for software modules. In general, hybrid scenario outperforms the other three scenarios. Naive Bayesclassifier attains the best results among all classifiers at the first round, while IBK performs wellfor the second round. The second round experiment exhibits a superior performance compared to the first roundbecause itapproaches two times better recall. Further, we notice a steady improvement in the latest releases of Apache Lucene project compared to the earlier ones.

Index Terms— Code coverage metrics, Machine learning classifier, Software defect prediction, Software quality, Static product metrics

[PDF]

Cite: Bilal Al-Ahmad, "Using Code Coverage Metrics for Improving Software Defect Prediction," Journal of Software vol. 13, no. 12, pp. 654-674, 2018.

General Information

ISSN: 1796-217X
Frequency: Monthly
Editor-in-Chief: Prof. Antanas Verikas
Executive Editor: Ms. Yoyo Y. Zhou
Abstracting/ Indexing: DBLP, EBSCO, ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jsw@iap.org
  • Nov 29, 2018 News!

    Papers published in JSW Vol. 13, No. 1- Vol. 13 No. 10 have been indexed by DBLP.    [Click]

  • Aug 24, 2018 News!

    Vol.12, No.8- Vol.13, No.5 has been indexed by EI (Inspec).   [Click]

  • Aug 01, 2018 News!

    [CFP] 2019 the annual meeting of JSW Editorial Board, ICCSM 2019, will be held in Barcelona, Spain, July 14-16, 2019.   [Click]

  • Nov 08, 2018 News!

    The papers published in Vol.13, No. 10 have all received dois from Crossref.

  • Nov 29, 2018 News!

    Vol 13, No. 12 has been published with online version 4 original aritcles from 3 countries are published in this issue.     [Click]