Semantic segmentation of major macroalgae in coastal environments using high-resolution ground imagery and deep learning

ABSTRACT

Macroalgae are a fundamental component of coastal ecosystems and play a key role in shaping community structure and functioning. Macroalgae are currently threatened by diverse stressors, particularly climate change and invasive species, but they do not all respond in the same way to the stressors. Effective methods of collecting qualitative and quantitative information are essential to enable better, more efficient management of macroalgae. Acquisition of high-resolution images, in which macroalgae can be distinguished on the basis of their texture and colour, and the automated processing of these images are thus essential. Although ground images are useful, labelling is tedious. This study focuses on the semantic segmentation of five macroalgal species in high-resolution ground images taken in 0.5 × 0.5 m quadrats placed along an intertidal rocky shore at low tide. The target species, Bifurcaria bifurcata, Cystoseira tamariscifolia, Sargassum muticum, Sacchoriza polyschides and Codium spp., which predominate on intertidal shores, belong to different morpho-functional groups. An explanation of how to convert vector-labelled data to raster-labelled data for adaptation to Convolutional Neural Network (CNN) input is provided. Three CNNs (MobileNetV2, Resnet18, Xception) were compared, and ResNet18 yielded the highest accuracy (91.9%). The macroalgae were correctly segmented, and the main confusion occurred at the borders between different macroalgal species, a problem derived from labelling errors. In addition, the interior and exterior of the quadrats were correctly delimited by the CNNs. The results were obtained from only one hundred labelled images and the method can be performed on personal computers, without the need to use external servers. The proposed method helps automation of the labelling process.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This work was supported by the Fundación Biodiversidad, the Ministerio para la Transición Ecológica y el Reto Demográfico through the Pleamar program, co-funded by the European Maritime and Fisheries Fund (EMFF) [call 2018]. It was also partly funded through grants awarded by the Xunta de Galicia for human resources and competitive reference groups [ED481B-2019-061 and ED431C 2016-038]; and by the Ministerio de Ciencia, Innovación y Universidades -Gobierno de España [RTI2018-095893-B-C21]. This document only reflects the views of the authors, and the statements made herein are solely the responsibility of the authors.