1,230
Views
279
CrossRef citations to date
0
Altmetric
General Paper

A better measure of relative prediction accuracy for model selection and model estimation

Pages 1352-1362 | Received 18 Nov 2013, Accepted 23 Sep 2014, Published online: 21 Dec 2017

References

  • AppaGSmithCOn L1 and Chebyshev estimationMathematical Programming197351738710.1007/BF01580112
  • ArmstrongJSLong-range Forecasting: From Crystal Ball to Computer1978
  • ArmstrongJSCollopyFError measures for generalizing about forecasting methods: Empirical comparisonsInternational Journal of Forecasting199281698010.1016/0169-2070(92)90008-W
  • Desharnais J (1989). Analyse statistique de la productivitie des projets informatique a partie de la technique des point des function. Master’s Degree Thesis. University of Montreal.
  • FossTStensrudEKitchenhamBMyrtveitIA simulation study of the model evaluation criterion MMREIEEE Transactions on Software Engineering2003291198599510.1109/TSE.2003.1245300
  • GneitingTMaking and evaluating point forecastsJournal of the American Statistical Association201110649474676210.1198/jasa.2011.r10138
  • GreenKTashmanLPercentage error: What denominator?Foresight: The International Journal of Applied Forecasting200912Winter3640
  • HankeJEWichernDBusiness Forecasting2009
  • Jorgensen M (2007). A critique of how we measure and interpret the accuracy of software development effort estimation. In First International Workshop on Software Productivity Analysis and Cost Estimation. Information Processing Society of Japan: Nagoya.
  • KitchenhamBAPickardLMacDonellSWhat accuracy statistics really measureIEE Proceedings—Software200114838185
  • KoehlerABThe asymmetry of the sAPE measure and other comments on the M3-CompetitionInternational Journal of Forecasting2001174570574
  • KolassaSMartinRPercentage errors can ruin your day (and rolling the dice show howForesight: The International Journal of Applied Forecasting201123Fall2127
  • LoBWNGaoXAssessing software cost estimation models: Criteria for accuracy, consistency and regressionAustralasian Journal of Information Systems199751304410.3127/ajis.v5i1.348
  • Lokan C. (2005). What should you optimize when building an estimation model? In 11th IEEE International Software Metrics Symposium (METRICS 2005).
  • MakridakisSAccuracy measures: Theoretical and practical concernsInternational Journal of Forecasting19939452752910.1016/0169-2070(93)90079-3
  • MiyazakiYTakanouANozakiHNakagawaNOkadaKMethod to estimate parameter values in software prediction modelsInfo Software Technology199133323924310.1016/0950-5849(91)90139-3
  • MiyazakiYTerekadoMOzakiKRobust regression for developing software estimation modelsJournal of Systems and Software199427131610.1016/0164-1212(94)90110-4
  • MyrtveitIStensrudEValidity and reliability of evaluation procedures in comparative studies of effort prediction modelsEmpirical Software Engineering2012171–2233310.1007/s10664-011-9183-7
  • MyrtveitIStensrudEShepperdMReliability and validity in comparative studies of software prediction modelsIEEE Transactions on Software Engineering200531538039110.1109/TSE.2005.58
  • ShepperdMMacDonellSEvaluating prediction systems in software project estimationInformation and Software Technology201254882082710.1016/j.infsof.2011.12.008
  • StensrudEFossTKitchenhamBMyrtveitIA further empirical investigation of the relationship between MRE and project sizeEmpirical Software Engineering20038213916110.1023/A:1023010612345
  • Tofallis C (2008). Percentage least squares regression. Journal of Modern Applied Statistical Methods, 7(2), 526–534.
  • TornqvistLVartiaPVartiaYOHow should relative change be measured?The American Statistician19853914346
  • WilsonJHKeatingBBusiness Forecasting2009

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.