Assessing Software Cost Estimation Models: criteria for accuracy, consistency and regression
DOI:
https://doi.org/10.3127/ajis.v5i1.348Keywords:
software cost estimation, models, accuracyAbstract
One of the problems in software cost estimation is how to evaluate estimation models. Estimation models are usually evaluated against two attributes: estimation accuracy and estimation consistency. A number of measures are reported in the literature, but they have shortcomings. There is no generally accepted standard to evaluate estimation models and the existing measures sometimes are not consistent among themselves. This paper examines existing measures of estimation accuracy and consistency and proposes two new ones: the weighted mean of quartiles of relative errors (WMQ) as a measure of accuracy and the standard deviation of the ratios of the estimate to actual observation (SDR) as a measure of consistency. Besides, a new regression criterion is proposed to determine model parameters. The proposed measures and criterion were tested with a data set from real world software projects. Results obtained show that these new measures and criterion overcome many of the difficulties of the existing ones.Downloads
How to Cite
Lo, B., & Gao, X. (1997). Assessing Software Cost Estimation Models: criteria for accuracy, consistency and regression. Australasian Journal of Information Systems, 5(1). https://doi.org/10.3127/ajis.v5i1.348
Issue
Section
Research Articles
License
AJIS publishes open-access articles distributed under the terms of a Creative Commons Non-Commercial and Attribution License which permits non-commercial use, distribution, and reproduction in any medium, provided the original author and AJIS are credited. All other rights including granting permissions beyond those in the above license remain the property of the author(s).