A comprehensive evaluation of classification algorithms for coral reef habitat mapping: challenges related to quantity, quality, and impurity of training samples

References

• Ahmad, W., and D. T. Neil. 1994. “An Evaluation of Landsat Thematic Mapper (TM) Digital Data for Discriminating Coral Reef Zonation: Heron Reef (GBR).” International Journal of Remote Sensing 15: 2583–2597. doi:10.1080/01431169408954268.
   Web of Science ®Google Scholar
• Akbani, R., S. Kwek, and N. Japkowicz. 2004. “Applying Support Vector Machines to Imbalanced Datasets.” In Machine Learning: ECML, edited by J. F. Boulicaut, F. Esposito, F. Giannotti, and D. Pedreschi, 39–50.  Berlin Heidelberg: Springer.
   Google Scholar
• Andréfouët, S. 2008. “Coral Reef Habitat Mapping Using Remote Sensing: A User Vs Producer Perspective. Implications for Research, Management and Capacity Building.” Journal of Spatial Science 53: 113–129. doi:10.1080/14498596.2008.9635140.
   Web of Science ®Google Scholar
• Andréfouët, S., P. Kramer, D. Torres-Pulliza, K. E. Joyce, E. J. Hochberg, R. Garza-Pérez, P. J. Mumby, B. Riegl, H. Yamano, and W. H. White. 2003. “Multi-Site Evaluation of IKONOS Data for Classification of Tropical Coral Reef Environments.” Remote Sensing of Environment 88: 128–143. doi:10.1016/j.rse.2003.04.005.
   Web of Science ®Google Scholar
• Andrefouet, S., L. Roux, Y. Chancerelle, and A. Bonneville. 2000. “A Fuzzy-Possibilistic Scheme of Study for Objects with Indeterminate Boundaries: Application to French Polynesian Reefscapes.” IEEE Transactions on Geoscience and Remote Sensing 38: 257–270. doi:10.1109/36.823918.
   Web of Science ®Google Scholar
• Atkinson, P. M., and A. R. L. Tatnall. 1997. “Introduction Neural Networks in Remote Sensing.” International Journal of Remote Sensing 18: 699–709. doi:10.1080/014311697218700.
   Web of Science ®Google Scholar
• Bandyopadhyay, S., S. Sharma, and A. Bahuguna. 2009. “Artificial Neural Network Based Coral Cover Classifiers Using Indian Remote Sensing (IRS LISS-III) Sensor Data: A Case Study in Gulf of Kachcch, India.” International Journal of Geoinformatics 5 (3): 55–63.
   Google Scholar
• Bao, J., M. Chi, and J. A. Benediktsson. 2013. “Spectral Derivative Features for Classification of Hyperspectral Remote Sensing Images: Experimental Evaluation.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 6: 594–601. doi:10.1109/JSTARS.2013.2237758.
   Web of Science ®Google Scholar
• Beijbom, O., P. J. Edmunds, D. I. Kline, B. G. Mitchell, and D. Kriegman. 2012. “Automated Annotation of Coral Reef Survey Images.” In Computer Vision and Pattern Recognition (CVPR), edited by S. Belongie, A. Blake, J. Luo, and A. Yuille. Piscataway, NJ: IEEE.
   Google Scholar
• Benfield, S. L., H. M. Guzman, J. M. Mair, and J. A. T. Young. 2007. “Mapping the Distribution of Coral Reefs and Associated Sublittoral Habitats in Pacific Panama: A Comparison of Optical Satellite Sensors and Classification Methodologies.” International Journal of Remote Sensing 28: 5047–5070. doi:10.1080/01431160701258062.
   Web of Science ®Google Scholar
• Bray, J. R., and J. T. Curtis. 1957. “An Ordination of the Upland Forest Communities of Southern Wisconsin.” Ecological Monographs 27: 325–349. doi:10.2307/1942268.
   Web of Science ®Google Scholar
• Brown, K. M., G. M. Foody, and P. M. Atkinson. 2009. “Estimating Per‐Pixel Thematic Uncertainty in Remote Sensing Classifications.” International Journal of Remote Sensing 30: 209–229. doi:10.1080/01431160802290568.
   Web of Science ®Google Scholar
• Camps-Valls, G., L. Gómez-Chova, J. Calpe-Maravilla, J. D. Martín-Guerrero, E. Soria-Olivas, L. Alonso-Chordá, and J. Moreno. 2004. “Robust Support Vector Method for Hyperspectral Data Classification and Knowledge Discovery.” IEEE Transactions on Geoscience and Remote Sensing 42: 1530–1542. doi:10.1109/TGRS.2004.827262.
   Web of Science ®Google Scholar
• Candade, N., and B. Dixon, 2004, Multispectral Classification of Landsat Images: A Comparison of Support Vector Machine and Neural Network Classifiers. In ASPRS Annual Conference Proceedings, Denver, Colorado.
   Google Scholar
• Capolsini, P., S. Andréfouët, C. Rion, and C. Payri. 2003. “A Comparison of Landsat ETM+, SPOT HRV, Ikonos, ASTER, and Airborne MASTER Data for Coral Reef Habitat Mapping in South Pacific Islands.” Canadian Journal of Remote Sensing 29: 187–200. doi:10.5589/m02-088.
   Web of Science ®Google Scholar
• Chang, C., and C. Lin. 2011. “LIBSVM: A Library for Support Vector Machines.” ACM Transactions on Intelligent Systems and Technology 2: 27:1-27:27. doi:10.1145/1961189.
   Web of Science ®Google Scholar
• Chawla, N. V., K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer. 2002. “SMOTE: Synthetic Minority Over-Sampling Technique.” Journal of Artificial Intelligence Research 16: 321–357.
   Web of Science ®Google Scholar
• Chegoonian, A. M., M. Mokhtarzade, M. J. Valadon Zoej, and M. Salehi, 2016, Soft Supervised Classification: An Improved Method for Coral Reef Classification Using Medium Resolution Satellite Images. In Geoscience and Remote Sensing Symposium (IGARSS), 2016 (IEEE International).
   Google Scholar
• Chowdhury, P. R., B. Deshmukh, A. K. Goswami, and S. S. Prasad. 2011. “Neural Network Based Dunal Landform Mapping From Multispectral Images Using Texture Features.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 4: 171–184. doi:10.1109/JSTARS.2010.2062491.
   Web of Science ®Google Scholar
• Collin, A., and S. Planes. 2012. “Enhancing Coral Health Detection Using Spectral Diversity Indices from Worldview-2 Imagery and Machine Learners.” Remote Sensing 4: 3244–3264. doi:10.3390/rs4103244.
   Web of Science ®Google Scholar
• Duro, D. C., S. E. Franklin, and M. G. Dubé. 2012. “A Comparison of Pixel-Based and Object-Based Image Analysis with Selected Machine Learning Algorithms for the Classification of Agricultural Landscapes Using SPOT-5 HRG Imagery.” Remote Sensing of Environment 118: 259–272. doi:10.1016/j.rse.2011.11.020.
   Web of Science ®Google Scholar
• Foody, G. M. 1999. “The Significance of Border Training Patterns in Classification by a Feedforward Neural Network Using Back Propagation Learning.” International Journal of Remote Sensing 20: 3549–3562. doi:10.1080/014311699211192.
   Web of Science ®Google Scholar
• Foody, G. M., and M. K. Arora. 1997. “An Evaluation of Some Factors Affecting the Accuracy of Classification by an Artificial Neural Network.” International Journal of Remote Sensing 18: 799–810. doi:10.1080/014311697218764.
   Web of Science ®Google Scholar
• Foody, G. M., and A. Mathur. 2004a. “A Relative Evaluation of Multiclass Image Classification by Support Vector Machines.” IEEE Transactions on Geoscience and Remote Sensing 42: 1335–1343. doi:10.1109/TGRS.2004.827257.
   Web of Science ®Google Scholar
• Foody, G. M., and A. Mathur. 2004b. “Toward Intelligent Training of Supervised Image Classifications: Directing Training Data Acquisition for SVM Classification.” Remote Sensing of Environment 93: 107–117. doi:10.1016/j.rse.2004.06.017.
   Web of Science ®Google Scholar
• Foody, G. M., and A. Mathur. 2006. “The Use of Small Training Sets Containing Mixed Pixels for Accurate Hard Image Classification: Training on Mixed Spectral Responses for Classification by a SVM.” Remote Sensing of Environment 103: 179–189. doi:10.1016/j.rse.2006.04.001.
   Web of Science ®Google Scholar
• Foody, G. M., M. B. McCulloch, and W. B. Yates. 1995. “The Effect of Training Set Size and Composition on Artificial Neural Network Classification.” International Journal of Remote Sensing 16: 1707–1723. doi:10.1080/01431169508954507.
   Web of Science ®Google Scholar
• Green, E. P., P. J. Mumby, A. J. Edwards, and C. D. Clark. 2000. Remote Sensing Handbook for Tropical Coastal Management. paris: UNESCO.
   Google Scholar
• Gu, Q., Z. Li, and J. Han, 2012, Generalized Fisher Score for Feature Selection.” arXiv preprint arXiv:1202.3725.
   Google Scholar
• Hamylton, S. M., J. X. Leon, M. I. Saunders, and C. D. Woodroffe. 2014. “Simulating Reef Response to Sea-Level Rise at Lizard Island: A Geospatial Approach.” Geomorphology 222: 151–161. doi:10.1016/j.geomorph.2014.03.006.
   Web of Science ®Google Scholar
• Hamylton, S. M., A. Pescud, J. X. Leon, and D. P. Callaghan. 2013. “A Geospatial Assessment of the Relationship between Reef Flat Community Calcium Carbonate Production and Wave Energy.” Coral Reefs 32 (pp): 1025–1039. doi:10.1007/s00338-013-1074-5.
   Web of Science ®Google Scholar
• Hochberg, E. J., S. Andrefouet, and M. R. Tyler. 2003. “Sea Surface Correction of High Spatial Resolution Ikonos Images to Improve Bottom Mapping in Near-Shore Environments.” IEEE Transactions on Geoscience and Remote Sensing 41: 1724–1729. doi:10.1109/TGRS.2003.815408.
   Web of Science ®Google Scholar
• Hochberg, E. J., M. J. Atkinson, and S. Andréfouët. 2003. “Spectral Reflectance of Coral Reef Bottom-Types Worldwide and Implications for Coral Reef Remote Sensing.” Remote Sensing of Environment 85: 159–173. doi:10.1016/S0034-4257(02)00201-8.
   Web of Science ®Google Scholar
• Huang, C., L. S. Davis, and J. R. G. Townshend. 2002. “An Assessment of Support Vector Machines for Land Cover Classification.” International Journal of Remote Sensing 23: 725–749. doi:10.1080/01431160110040323.
   Web of Science ®Google Scholar
• Kavousi, J., J. Seyfabadi, H. Rezai, and D. Fenner. 2011. “Coral Reefs and Communities of Qeshm Island, the Persian Gulf.” Zool Stud 50 (pp): 276–283.
   Google Scholar
• Kavzoglu, T. 2009. “Increasing the Accuracy of Neural Network Classification Using Refined Training Data.” Environmental Modelling & Software 24: 850–858. doi:10.1016/j.envsoft.2008.11.012.
   Web of Science ®Google Scholar
• Kayanne, H., S. Harii, Y. Ide, and F. Akimoto. 2002. “Recovery of Coral Populations after the 1998 Bleaching on Shiraho Reef, in the Southern Ryukyus, NW Pacific.” Marine Ecology Progress Series 239: 93–103. doi:10.3354/meps239093.
   Web of Science ®Google Scholar
• Knudby, A., L. M. Nordlund, G. Palmqvist, K. Wikström, A. Koliji, R. Lindborg, and M. Gullström. 2014. “Using Multiple Landsat Scenes in an Ensemble Classifier Reduces Classification Error in a Stable Nearshore Environment.” International Journal of Applied Earth Observation and Geoinformation 28: 90–101. doi:10.1016/j.jag.2013.11.015.
   Web of Science ®Google Scholar
• Kohler, K. E., and S. M. Gill. 2006. “Coral Point Count with Excel Extensions (Cpce): A Visual Basic Program for the Determination of Coral and Substrate Coverage Using Random Point Count Methodology.” Computers & Geosciences 32: 1259–1269. doi:10.1016/j.cageo.2005.11.009.
   Web of Science ®Google Scholar
• Landgrebe, D. 1999. “Information Extraction Principles and Methods for Multispectral and Hyperspectral Image Data.” Information Processing for Remote Sensing 82: 3–38.
   Google Scholar
• Leon, J. X., S. R. Phinn, S. Hamylton, and M. I. Saunders. 2012. “A 20 M Spatial Resolution Seamless Multisource Digital Elevation/Depth Model for Lizard Island, Northern Great Barrier Reef.” http://issues.pangaea.de/browse/PDI-4073
   Google Scholar
• Lim, A., J. D. Hedley, E. LeDrew, P. J. Mumby, and C. Roelfsema. 2009. “The Effects of Ecologically Determined Spatial Complexity on the Classification Accuracy of Simulated Coral Reef Images.” Remote Sensing of Environment 113: 965–978. doi:10.1016/j.rse.2009.01.011.
   Web of Science ®Google Scholar
• Lu, D., and Q. Weng. 2007. “A Survey of Image Classification Methods and Techniques for Improving Classification Performance.” International Journal of Remote Sensing 28: 823–870. doi:10.1080/01431160600746456.
   Web of Science ®Google Scholar
• Lyzenga, D. R. 1981. “Remote Sensing of Bottom Reflectance and Water Attenuation Parameters in Shallow Water Using Aircraft and Landsat Data.” International Journal of Remote Sensing 2: 71–82. doi:10.1080/01431168108948342.
   Google Scholar
• Ma, Z., and R. L. Redmond. 1995. “Tau Coefficients for Accuracy Assessment of Classification of Remote Sensing Data.” Photogrammetric Engineering and Remote Sensing 61: 435–439.
   Web of Science ®Google Scholar
• Mountrakis, G., J. Im, and C. Ogole. 2011. “Support Vector Machines in Remote Sensing: A Review.” ISPRS Journal of Photogrammetry and Remote Sensing 66: 247–259. doi:10.1016/j.isprsjprs.2010.11.001.
   Web of Science ®Google Scholar
• Mumby, P. J., C. D. Clark, E. P. Green, and A. J. Edwards. 1998. “Benefits of Water Column Correction and Contextual Editing for Mapping Coral Reefs.” International Journal of Remote Sensing 19: 203–210. doi:10.1080/014311698216521.
   Web of Science ®Google Scholar
• Mumby, P. J., and A. J. Edwards. 2002. “Mapping Marine Environments with IKONOS Imagery: Enhanced Spatial Resolution Can Deliver Greater Thematic Accuracy.” Remote Sensing of Environment 82: 248–257. doi:10.1016/S0034-4257(02)00041-X.
   Web of Science ®Google Scholar
• Mumby, P. J., E. P. Green, A. J. Edwards, and C. D. Clark. 1997. “Coral Reef Habitat Mapping: How Much Detail Can Remote Sensing Provide?” Marine Biology 130: 193–202. doi:10.1007/s002270050238.
   Web of Science ®Google Scholar
• Mumby, P. J., E. P. Green, A. J. Edwards, and C. D. Clark. 1999. “The Cost-Effectiveness of Remote Sensing for Tropical Coastal Resources Assessment and Management.” Journal of Environmental Management 55: 157–166. doi:10.1006/jema.1998.0255.
   Web of Science ®Google Scholar
• Mumby, P. J., and A. R. Harborne. 1999. “Development of a Systematic Classification Scheme of Marine Habitats to Facilitate Regional Management and Mapping of Caribbean Coral Reefs.” Biological Conservation 88: 155–163. doi:10.1016/S0006-3207(98)00108-6.
   Web of Science ®Google Scholar
• Pahlevan, N., Z. Lee, J. Wei, C. B. Schaaf, J. R. Schott, and A. Berk. 2014. “On-Orbit Radiometric Characterization of OLI (Landsat-8) for Applications in Aquatic Remote Sensing.” Remote Sensing of Environment 154: 272–284. doi:10.1016/j.rse.2014.08.001.
   Web of Science ®Google Scholar
• Pal, M., and G. M. Foody. 2012. “Evaluation of SVM, RVM and SMLR for Accurate Image Classification with Limited Ground Data.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5: 1344–1355. doi:10.1109/JSTARS.2012.2215310.
   Web of Science ®Google Scholar
• Pal, M., and P. M. Mather. 2005. “Support Vector Machines for Classification in Remote Sensing.” International Journal of Remote Sensing 26: 1007–1011. doi:10.1080/01431160512331314083.
   Web of Science ®Google Scholar
• Paola, J. D., and R. A. Schowengerdt. 1995. “A Detailed Comparison of Backpropagation Neural Network and Maximum-Likelihood Classifiers for Urban Land Use Classification.” IEEE Transactions On Geoscience And Remote Sensing 33: 981–996. doi:10.1109/36.406684.
   Web of Science ®Google Scholar
• Purkis, S. J., and R. Pasterkamp. 2004. “Integrating in Situ Reef-Top Reflectance Spectra with Landsat TM Imagery to Aid Shallow-Tropical Benthic Habitat Mapping.” Coral Reefs 23: 5–20. doi:10.1007/s00338-003-0351-0.
   Web of Science ®Google Scholar
• Rees, S. A., B. N. Opdyke, P. A. Wilson, L. K. Fifield, and V. Levchenko. 2006. “Holocene Evolution of the Granite Based Lizard Island and Macgillivray Reef Systems, Northern Great Barrier Reef.” Coral Reefs 25: 555–565. doi:10.1007/s00338-006-0138-1.
   Web of Science ®Google Scholar
• Riegl, B. M., and S. J. Purkis. 2012. Coral Reefs of the Gulf: Adaptation to Climatic Extremes in the World’s Hottest Sea. Netherlands: Springer.
   Google Scholar
• Roelfsema, C., and S. Phinn. 2009. A Manual for Conducting Georeferenced Photo Transects Surveys to Assess the Benthos of Coral Reef and Seagrass Habitats. Brisbane: Centre for Remote Sensing and Spatial Information Science, The University of Queensland.
   Google Scholar
• Saunders, M. I., C. M. Roelfsema, S. R. Phinn, R. F. C. Canto, C. J. Brown, S. Atkinson, and J. X. Leon, 2013a, Benthic and Substrate Cover Data Derived from Photo-Transect Surveys in Lizard Island, Great Barrier Reef conducted on October 3-7, 2012.: PANGAEA.
   Google Scholar
• Saunders, M. I., C. M. Roelfsema, S. R. Phinn, R. F. C. Canto, C. J. Brown, and J. X. Leon, 2013b, Benthic and Substrate Cover Data Derived from Photo-Transect Surveys in Lizard Island Reef Conducted on December 10-15, 2011.: PANGAEA.
   Google Scholar
• Shao, Y., and R. S. Lunetta. 2012. “Comparison of Support Vector Machine, Neural Network, and CART Algorithms for the Land-Cover Classification Using Limited Training Data Points.” ISPRS Journal of Photogrammetry and Remote Sensing 70: 78–87. doi:10.1016/j.isprsjprs.2012.04.001.
   Web of Science ®Google Scholar
• Storey, J., M. Choate, and K. Lee. 2014. “Landsat 8 Operational Land Imager On-Orbit Geometric Calibration and Performance.” Remote Sensing 6: 11127–11152. doi:10.3390/rs61111127.
   Web of Science ®Google Scholar
• Wahidin, N., V. P. Siregar, B. Nababan, I. Jaya, and S. Wouthuyzen. 2015. “Object-Based Image Analysis for Coral Reef Benthic Habitat Mapping with Several Classification Algorithms.” Procedia Environmental Sciences 24: 222–227. doi:10.1016/j.proenv.2015.03.029.
   Google Scholar
• Warner, T. A., and F. Nerry. 2009. “Does Single Broadband or Multispectral Thermal Data Add Information for Classification of Visible, Near‐And Shortwave Infrared Imagery of Urban Areas?” International Journal of Remote Sensing 30: 2155–2171. doi:10.1080/01431160802549286.
   Web of Science ®Google Scholar
• Xu, L., J. Li, and A. Brenning. 2014. “A Comparative Study of Different Classification Techniques for Marine Oil Spill Identification Using RADARSAT-1 Imagery.” Remote Sensing of Environment 141: 14–23. doi:10.1016/j.rse.2013.10.012.
   Web of Science ®Google Scholar
• Zhang, C. 2015. “Applying Data Fusion Techniques for Benthic Habitat Mapping and Monitoring in a Coral Reef Ecosystem.” ISPRS Journal of Photogrammetry and Remote Sensing 104: 213–223. doi:10.1016/j.isprsjprs.2014.06.005.
   Web of Science ®Google Scholar
• Zhang, C., D. Selch, Z. Xie, C. Roberts, H. Cooper, and G. Chen. 2013. “Object-Based Benthic Habitat Mapping in the Florida Keys from Hyperspectral Imagery.” Estuarine, Coastal and Shelf Science 134: 88–97. doi:10.1016/j.ecss.2013.09.018.
   Web of Science ®Google Scholar
• Zhou, Z. H., and X. Y. Liu. 2006. “Training Cost-Sensitive Neural Networks with Methods Addressing the Class Imbalance Problem.” IEEE Transactions on Knowledge and Data Engineering 18: 63–77. doi:10.1109/TKDE.2006.17.
   Web of Science ®Google Scholar