An empirical assessment of the consistency of taxonomic identifications

Abstract

Plankton counting and analysis is essential in ecological study, yet scant literature exists as to the reliability of those counts and the consistency of the experts who make the counts. To assess how variable expert taxonomic identifications are, a set of six archived mesozooplankton samples from a series of Longhurst Hardy Plankton Recorder net hauls were counted by expert zooplankton analysts located at six marine laboratories. Sample identifications were repeated on two separate days with over 700 target specimens counted and identified on each day across the samples. Twenty percent of the analysts returned counts that varied by more than 10%. Thirty-three percent of analysts exhibited low identification consistencies, returning Intraclass Correlation Coefficient scores of less than 0.80. Statistical analyses of these data suggest that over 83% of the observed categorical count variance can be attributed to inconsistencies within analysts. We suggest this is the root cause of variation in expert specimen labelling consistency.

Key words:

• Human factors
• expert performance
• mesozooplankton identification
• root cause of variation

Acknowledgements

We acknowledge the generous spirit with which participants entered into this exercise and we thank them for their effort. We also thank Ben Whalley for statistical analysis advice. We also acknowledge the support given to this study by members of SCOR Working Group 130 in Automatic Plankton Identification. This work was carried out under the remit of SCOR WG130.