Abstract
Freely available building maps of rapidly changing built and semi-built environments may contain label noise. When temporal correspondence between images and labels does not hold, the labels may be subject to incorrectly observed building instances. For example, in most growing semi-built environments, such as the Kutupalong mega-camp in Bangladesh, labels corresponding to a past date may not be updated or might not have been properly labelled, resulting in label noise. Tagging/labelling can be done either manually (by humans) or automatically (by a machine/model). We manually label images for our stricter evaluation regime, but a trained model can automatically label images without human supervision. Our best performing model generates labels which improve F1-score by 17.2% and improve Intersection-over-Union score by 23.2%, when compared to the fidelity of commonly used noisy labels. Our stricter evaluation regime reveals interesting insights about the paradoxical behaviour of deep neural networks in conjunction to label noise.
Acknowledgements
This work is supported by Faculty Research Grant (CTRG-20-SEPS-14), North South University, Bashundhara, Dhaka 1229, Bangladesh
Disclosure statement
No potential conflict of interest was reported by the authors.
Notes
1 Data catalog of all aerial images collected by UN IOM is available at https://data.humdata.org/dataset/e0f0a2ca-9e9e-4fdd-a214-9effb2e3d083/resource/293e01c5-d53e-4db1-a114-c8e646523350/download/iom-npm-uav-repository.pdf.