Stratified even sampling method for accuracy assessment of land use/land cover classification: a case study of Beijing, China

ABSTRACT

Selecting samples with high representativeness is very important in the accuracy assessment of land use and land cover (LULC) classification. By optimizing sampling sites in both feature space and geographical space, this paper presented a stratified even sampling method for accuracy assessment of the GlobeLand30 dataset for Beijing, China. In this method, spatial stratification and area-weighted proportion sampling assignment method were adopted to achieve optimal coverage in feature space; spatial-simulated annealing (SSA) and the minimization of the mean of the shortest distances (MMSD) criterion were used to optimize sampling sites in geographical space. Six sample sets with sizes of 150, 300, 450, 600, 750 and 900 were drawn using the proposed method, spatial even sampling method, stratified random sampling method and simple random sampling method, and their overall accuracy (OA), root-mean-square error (RMSE) and standard deviation (STDEV) values were evaluated. The results suggested that the OA, RMSE and STDEV results of the proposed method were 71.36%-73.91% (Mean, 72.26%), 0.90% and 0.96%, respectively. Compared with the other sampling methods, the average OA of the proposed method was much closer to the true OA and corresponding RMSE and STDEV were much lower than the other three sampling methods, respectively. It can improve the representativeness of both feature and geographical space, and provide a robust operational tool for the validation of LULC datasets.

Disclosure Statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This work was supported by the National Key Research and Development Program of China [2016YFD0800904], the National Natural Science Foundation of China [41801276], the Beijing Natural Science Foundation [8192015] and the Youth Fund of the Beijing Academy of Agricultural and Forestry Sciences [QNJJ201830].