Volume 13 Number 12 (Dec. 2018)
Home > Archive > 2018 > Volume 13 Number 12 (Dec. 2018) >
JSW 2018 Vol.13(12): 654-674 ISSN: 1796-217X
doi: 10.17706/jsw.13.12.654-674

Using Code Coverage Metrics for Improving Software Defect Prediction

Bilal Al-Ahmad*

Computer Information Systems Department, Faculty of Information Technology and Systems, The University of Jordan,AqabaBranch,Jordan

Abstract—Software defect prediction enablessoftware developers to estimate the most defective code parts in order to reduce testing efforts. As the size of software project becomes larger, software defect prediction becomes an urgent need. While static product metrics have been extensively investigated as a static meansto predict software defects, coverage analysis of the software has been abandoned due to the expected complexities. Thispaper proposedanovelhybrid approach that leverages code coverage metrics to improve software defect prediction. We build and compare software defect prediction results for four distinct scenarios:static product, code coverage, hybrid, and feature selection. First scenario resembles static analysis and acts as baseline model. Second scenario addresses coverage issues of the associated test cases for the source code. Third and fourth scenarios are derived from combinations of static product and code coverage scenarios. Each scenario has been modeled and examined using thirteen different machine learning classifiers. Two rounds of experiments have been done. First round employs real data extracted from 23 successivereleasesof Apache Lucene, whereas second round applies oversampling technique for the same releases. The results indicate that code coverage scenario attains a significant improvement in software defect prediction,especially when there is a high-coverage ratio for software modules. In general, hybrid scenario outperforms the other three scenarios. Naive Bayesclassifier attains the best results among all classifiers at the first round, while IBK performs wellfor the second round. The second round experiment exhibits a superior performance compared to the first roundbecause itapproaches two times better recall. Further, we notice a steady improvement in the latest releases of Apache Lucene project compared to the earlier ones.

Index Terms— Code coverage metrics, Machine learning classifier, Software defect prediction, Software quality, Static product metrics


Cite: Bilal Al-Ahmad, "Using Code Coverage Metrics for Improving Software Defect Prediction," Journal of Software vol. 13, no. 12, pp. 654-674, 2018.

General Information

  • ISSN: 1796-217X (Online)
  • Frequency:  Quarterly
  • Editor-in-Chief: Prof. Antanas Verikas
  • Executive Editor: Ms. Yoyo Y. Zhou
  • Abstracting/ Indexing: DBLP, EBSCO, CNKIGoogle Scholar, ProQuest, INSPEC(IET), ULRICH's Periodicals Directory, WorldCat, etc
  • E-mail: jsweditorialoffice@gmail.com
  • APC: 500USD
  • Jun 12, 2024 News!

    Vol 19, No 2 has been published with online version   [Click]

  • Jan 04, 2024 News!

    JSW will adopt Article-by-Article Work Flow

  • Apr 01, 2024 News!

    Vol 14, No 4- Vol 14, No 12 has been indexed by IET-(Inspec)     [Click]

  • Apr 01, 2024 News!

    Papers published in JSW Vol 18, No 1- Vol 18, No 6 have been indexed by DBLP   [Click]

  • Mar 01, 2024 News!

    Vol 19, No 1 has been published with online version    [Click]