¹Department of Information and Computer Science, King Fahd University of Petroleum and Minerals, Dhahran 31261, Kingdom of Saudi Arabia
²Department of Electrical and Computer Engineering, Edmonton, Alberta T6G 2VB, Canada

---

Abstract—Traditionally most Software Engineering experiments tend to formulate hypotheses and analyze an independent variable or a series of independent variables. This approach greatly reduces the type of research questions which can be explored. In addition, most Software Engineering situations are highly complex with many intertwined or ill-defined concepts, processes and “objects”. Hence, the question arises: are independent variables really sufficient for describing Software Engineering situations? This paper argues that the community needs to consider fuzzier models for Software Engineering artifacts, especially it recommends using composite indices as a mechanism to allow the greater exploration of the experimental design space. However, this extension is not without its risks; and hence in conjunction, it explains how to utilize analysis safeguards (sensitivity and uncertainty analysis) to explore any effects introduced when utilizing experimental formulations with composite metrics.

Index Terms—Composite Metrics, Sensitivity, Uncertainty, Case Study

[PDF]

Cite: Mohamed El-Attar, Ravi Inder Singh, and James Miller, "Embracing Composite Metrics in Software Experiments," Journal of Software vol. 7, no. 7, pp. 1664-1676, 2012.