3,429
Views
158
CrossRef citations to date
0
Altmetric
Original Articles

Sample size determination for image classification accuracy assessment and comparison

Pages 5273-5291 | Published online: 29 Sep 2009
 

Abstract

Many factors influence the quality and value of a classification accuracy assessment and evaluation programme. This paper focuses on the size of the testing set(s) used with particular regard to the impacts on accuracy assessment and comparison. Testing set size is important as the use of an inappropriately large or small sample could lead to limited and sometimes erroneous assessments of accuracy and of differences in accuracy. Here, some of the basic statistical principles of sample size determination are outlined, including a discussion of Type II errors and their control. The paper provides a discussion on some of the basic issues of sample size determination for accuracy assessment and includes factors linked to accuracy comparison. With the latter, the researcher should specify the effect size (minimum meaningful difference in accuracy), significance level and power used in an analysis and ideally also fit confidence limits to derived estimates. This will help design a study and aid the use of appropriate sample sizes, as well as facilitate interpretation of results. In particular, it will help avoid problems, such as under-powered analyses, and provide a richer information base for classification evaluation. The paper includes equations that could be used to determine sample sizes for common applications in remote sensing, using both independent and related samples.

Acknowledgements

This is an expanded version of a paper presented at the ‘Accuracy 2008’ conference in Shanghai, July 2008. I am grateful to the referees for their helpful comments that helped to enhance this article.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 689.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.