A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks

References

• Abdel-Hamid, O., A. Mohamed, H. Jiang, and G. Penn. 2012. “Applying Convolutional Neural Networks Concepts to Hybrid NN-HMM Model for Speech Recognition.” The IEEE International Conference on Acoustics Speech and Signal Processing, 4277–4280, Kyoto. doi:10.1109/icassp.2012.6288864.
   Google Scholar
• Baatz, M., and A. Schäpe. 2000. “Multiresolution Segmentation: An Optimization Approach for High Quality Multi-Scale Image Segmentation.” In Angewandte Geographische Informationsverarbeitung XII, edited by J. Strobl and T. Blaschke, 12–23. Heidelberg: Wichmann Verlag.
   Google Scholar
• Basaeed, E., H. Bhaskar, and M. Al-Mualla. 2013. “A Spectral Water Index Based on Visual Bands.” In Image and Signal Processing for Remote Sensing XIX, Vol. 8892889219. doi:10.1117/12.2028638.
   Google Scholar
• Castelluccio, M., G. Poggi, C. Sansone, and L. Verdoliva. 2015. “Land Use Classification in Remote Sensing Images by Convolutional Neural Networks.” http://arxiv.org/abs/1508.00092
   Google Scholar
• Chander, G., B. Markham, and D. Helder. 2009. “Summary of Current Radiometric Calibration Coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI Sensors.” Remote Sensing of Environment 113 (5): 893–903. doi:10.1016/j.rse.2009.01.007.
   Web of Science ®Google Scholar
• Chen, X., S. Xiang, C. Liu, and C. Pan. 2014. “Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks.” IEEE Geoscience and Remote Sensing Letters 11 (10): 1797–1801. doi:10.1109/LGRS.2014.2309695.
   Web of Science ®Google Scholar
• Ciresan, D., A. Giusti, L. Gambardella, and J. Schmidhuber. 2012. “Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images.” In Advances in Neural Information Processing Systems, Nevada, 2852–2860.
   Google Scholar
• Ciresan, D., A. Giusti, L. Gambardella, and J. Schmidhuber. 2013. “Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks.” In Medical Image Computing and Computer-Assisted Intervention, Vol. 8150 of Lecture Notes in Computer Science, edited by K. Mori, I. Sakuma, Y. Sato, C. Barillot, and N. Navab, 411–418. Heidelberg: Springer. doi:10.1007/978-3-642-40763-5_51.
   Google Scholar
• Ciresan, D., U. Meier, and J. Schmidhuber. 2012. “Multi-Column Deep Neural Networks for Image Classification.” IEEE Conference on Computer Vision and Pattern Recognition, 3642–3649, Providence, RI. IEEE. doi:10.1109/cvpr.2012.6248110.
   Google Scholar
• Collobert, R., and J. Weston. 2008. “A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning.”The 25th International Conference on Machine Learning, 160–167, Helsinki. doi:10.1145/1390156.1390177.
   Google Scholar
• D’Elia, C., G. Poggi, and G. Scarpa. 2003. “A Tree-Structured Markov Random Field Model for Bayesian Image Segmentation.” IEEE Transactions on Image Processing 12 (10): 1259–1273. doi:10.1109/TIP.2003.817257.
   PubMed Web of Science ®Google Scholar
• Gaetano, R., G. Scarpa, and G. Poggi. 2009. “Recursive Texture Fragmentation and Reconstruction Segmentation Algorithm Applied to VHR Images.” IEEE International Geoscience and Remote Sensing Symposium, Vol. 4IV–101–IV–104, University of Cape Town, Cape Town, July. IEEE. doi:10.1109/igarss.2009.5417364.
   Google Scholar
• Guigues, L., J. Cocquerez, and H. Men. 2006. “Scale-Sets Image Analysis.” International Journal of Computer Vision 68 (3): 289–317. doi:10.1007/s11263-005-6299-0.
   Web of Science ®Google Scholar
• Hu, W., Y. Huang, L. Wei, F. Zhang, and H. Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015: 1–12. doi:10.1155/2015/258619.
   Web of Science ®Google Scholar
• Hu, Z., Z. Wu, Q. Zhang, Q. Fan, and J. Xu. 2013. “A Spatially-Constrained Color–Texture Model for Hierarchical VHR Image Segmentation.” IEEE Geoscience and Remote Sensing Letters 10 (1): 120–124. doi:10.1109/LGRS.2012.2194693.
   Web of Science ®Google Scholar
• Jensen, J. 2004. Introductory Digital Image Processing. 3rd ed. Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Jung, C., and C. Kim. 2010. “Segmenting Clustered Nuclei Using H-Minima Transform-Based Marker Extraction and Contour Parameterization.” IEEE Transactions on Biomedical Engineering 57 (10): 2600–2604. doi:10.1109/TBME.2010.2060336.
   PubMed Web of Science ®Google Scholar
• Kim, S., W. Lee, D. Kwak, G. Biging, P. Gong, J. Lee, and H. Cho. 2011. “Forest Cover Classification by Optimal Segmentation of High Resolution Satellite Imagery.” Sensors 11 (12): 1943–1958. doi:10.3390/s110201943.
   PubMed Web of Science ®Google Scholar
• Krizhevsky, A., I. Sutskever, and G. Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” In Advances in Neural Information Processing Systems, Vol. 25, edited by F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, 1097–1105. Pahrump, NV: Curran Associates, Inc.
   Google Scholar
• Lecun, Y., L. Bottou, Y. Bengio, and P. Haffner. 1998. “Gradient-Based Learning Applied to Document Recognition.” Proceedings of the IEEE 86 (11): 2278–2324. doi:10.1109/5.726791.
   Web of Science ®Google Scholar
• Li, H., H. Gu, Y. Han, and J. Yang. 2008. “An Efficient Multi-Scale Segmentation for High-Resolution Remote Sensing Imagery Based on Statistical Region Merging and Minimum Heterogeneity Rule.” International Workshop on Earth Observation and Remote Sensing Applications, 1–6. Beijing, China: IEEE. July. doi:10.1109/eorsa.2008.4620351.
   Google Scholar
• Li, L., J. Ma, and Q. Wen. 2007. “Parallel Fine Spatial Resolution Satellite Sensor Image Segmentation Based on an Improved Pulse-Coupled Neural Network.” International Journal of Remote Sensing 28 (18): 4191–4198. doi:10.1080/01431160701442047.
   Web of Science ®Google Scholar
• Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440, Boston, MA. doi:10.1109/cvpr.2015.7298965.
   Google Scholar
• Marpu, P., M. Neubert, H. Herold, and I. Niemeyer. 2010. “Enhanced Evaluation of Image Segmentation Results.” Journal of Spatial Science 55 (1): 55–68. doi:10.1080/14498596.2010.487850.
   Web of Science ®Google Scholar
• Mikes, S., M. Haindl, and G. Scarpa. 2012. “Remote Sensing Segmentation Benchmark.” IAPR Workshop on Pattern Recognition in Remote Sensing, 1–4, Tsukuba. doi:10.1109/pprs.2012.6398320
   Google Scholar
• Mnih, V. 2013. “Machine learning for aerial image labeling.” Ph.D. thesis. University of Toronto, Toronto, Canda.
   Google Scholar
• Myint, S., P. Gober, A. Brazel, S. Grossman-Clarke, and Q. Weng. 2011. “Per-Pixel Vs. Object-Based Classification of Urban Land Cover Extraction Using High Spatial Resolution Imagery.” Remote Sensing of Environment 115 (5): 1145–1161. doi:10.1016/j.rse.2010.12.017.
   Web of Science ®Google Scholar
• Novack, T., T. Esch, H. Kux, and U. Stilla. 2011. “Machine Learning Comparison between Worldview-2 and Quickbird-2 Simulated Imagery regarding Object-Based Urban Land Cover Classification.” Remote Sensing 3 (12): 2263–2282. doi:10.3390/rs3102263.
   Web of Science ®Google Scholar
• Payne, A., H. Bhaskar, and L. Mihaylova. 2008. “Multi-Resolution Learning Vector Quantisation Based Automatic Colour Clustering.” In The 11th International Conference on Information Fusion, 1–6. Cologne, Germany: IEEE. Jun.
   Google Scholar
• Penatti, O., K. Nogueira, and J. Dos Santos. 2015. “Do Deep Features Generalize from Everyday Objects to Remote Sensing and Aerial Scenes Domains?” In The IEEE Conference on Computer Vision and Pattern Recognition Workshops, 44–51. Boston, MA IEEE. June. doi:10.1109/cvprw.2015.7301382. http://homepages.dcc.ufmg.br/jefersson/pdf/penatti2015cvprw.pdf
   Google Scholar
• Salembier, P., and L. Garrido. 2000. “Binary Partition Tree as an Efficient Representation for Image Processing, Segmentation, and Information Retrieval.” IEEE Transactions on Image Processing 9 (4): 561–576. doi:10.1109/83.841934.
   PubMed Web of Science ®Google Scholar
• Scarpa, G., G. Masi, R. Gaetano, L. Verdoliva, and G. Poggi. 2013. “Dynamic Hierarchical Segmentation of Remote Sensing Images.” In Image Analysis and Processing, edited by A. Petrosino, no. 8156 In Lecture Notes in Computer Science, 371–380. Berlin: Springer. doi:10.1007/978-3-642-41181-6_38.
   Google Scholar
• Scherer, D., A. Müller, and S. Behnke. 2010. “Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition.” In Artificial Neural Networks, edited by K. Diamantaras, W. Duch, and L. Iliadis, no. 6354 In Lecture Notes in Computer Science, 92–101. Berlin: Springer. doi:10.1007/978-3-642-15825-4_10.
   Google Scholar
• Schulz, H., and S. Behnke. 2012. “Learning Object-Class Segmentation with Convolutional Neural Networks.” The 11th European Symposium on Artificial Neural Networks, Vol. 31, Bruges, April.
   Google Scholar
• Sermanet, P., and Y. LeCun. 2011. “Traffic Sign Recognition with Multi-Scale Convolutional Networks.” The International Joint Conference on Neural Networks, 2809–2813, San Jose, CA. doi:10.1109/ijcnn.2011.6033589.
   Google Scholar
• Simard, P., D. Steinkraus, and J. Platt. 2003. “Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis.” In The 12th International Conference on Document Analysis and Recognition. Vol 2958–958. Edinburgh: IEEE. doi:10.1109/icdar.2003.1227801.
   Google Scholar
• Taher, F., N. Werghi, H. Al-Ahmad, and C. Donner. 2013. “Extraction and Segmentation of Sputum Cells for Lung Cancer Early Diagnosis.” Algorithms 6 (3): 512–531. doi:10.3390/a6030512.
   Google Scholar
• Tarabalka, Y., J. Tilton, J. Benediktsson, and J. Chanussot. 2012. “A Marker-Based Approach for the Automated Selection of A Single Segmentation from A Hierarchical Set of Image Segmentations.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5 (1): 262–272. doi:10.1109/JSTARS.2011.2173466.
   Web of Science ®Google Scholar
• Tilton, J., Y. Tarabalka, P. Montesano, and E. Gofman. 2012. “Best Merge Region-Growing Segmentation with Integrated Nonadjacent Region Object Aggregation.” IEEE Transactions on Geoscience and Remote Sensing 50 (11): 4454–4467. doi:10.1109/TGRS.2012.2190079.
   Web of Science ®Google Scholar
• Trias-Sanz, R., G. Stamon, and J. Louchet. 2008. “Using Colour, Texture, and Hierarchial Segmentation for High-Resolution Remote Sensing.” ISPRS Journal of Photogrammetry and Remote Sensing 63 (2): 156–168. doi:10.1016/j.isprsjprs.2007.08.005.
   Web of Science ®Google Scholar
• Tuia, D., M. Volpi, M. Dalla Mura, A. Rakotomamonjy, and R. Flamary. 2014. “Automatic Feature Learning for Spatio-Spectral Image Classification with Sparse SVM.” IEEE Transactions on Geoscience and Remote Sensing 52 (10): 6062–6074. doi:10.1109/TGRS.2013.2294724.
   Web of Science ®Google Scholar
• Ungar, S., J. Pearlman, J. Mendenhall, and D. Reuter. 2003. “Overview of the Earth Observing One (EO-1) mission.” IEEE Transactions on Geoscience and Remote Sensing 41 (6): 1149–1159. doi:10.1109/TGRS.2003.815999.
   Web of Science ®Google Scholar
• Visa, A., K. Valkealahti, and O. Simula. 1991. “Cloud Detection Based on Texture Segmentation by Neural Network Methods.” IIEEE International Joint Conference on Neural Networks, Vol 21001–1006, Singapore. doi:10.1109/ijcnn.1991.170529.
   Google Scholar
• Weng, Q., and X. Hu. 2008. “Medium Spatial Resolution Satellite Imagery for Estimating and Mapping Urban Impervious Surfaces Using LSMA and ANN.” IEEE Transactions on Geoscience and Remote Sensing 46 (8): 2397–2406. doi:10.1109/TGRS.2008.917601.
   Web of Science ®Google Scholar
• Wu, H., and X. Gu. 2015. “Towards Dropout Training for Convolutional Neural Networks.” Neural Networks 71: 1–10. doi:10.1016/j.neunet.2015.07.007.
   PubMed Web of Science ®Google Scholar
• Xiaoying, J. 2007. “Segmentation-Based Image Processing System.” US Patent 2009/0123070A1, filed November 17. http://patentimages.storage.googleapis.com/pdfs/US20090123070.pdf
   Google Scholar
• Yue, J., W. Zhao, S. Mao, and H. Liu. 2015. “Spectral-Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks.” Remote Sensing Letters 6 (6): 468–477. doi:10.1080/2150704X.2015.1047045.
   Web of Science ®Google Scholar
• Zhang, W., R. Li, H. Deng, L. Wang, W. Lin, S. Ji, and D. Shen. 2015. “Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation.” NeuroImage 108: 214–224. doi:10.1016/j.neuroimage.2014.12.061.
   PubMed Web of Science ®Google Scholar