Inter-observer variation in habitat survey data: investigating the consequences for professional practice

References

• Alexander, R., and A. Millington. 2000. Vegetation Mapping: From Patch to Planet. London: Wiley-Blackwell.
   Google Scholar
• Angold, P.G., A.M. Gurnell, and P.J. Edwards. 1996. “Locational Errors in Maps from Environmental Surveys and their Implications for Information Extraction.” Journal of Environmental Management 47: 341–354.
   Web of Science ®Google Scholar
• Bernard, A.T.F., A. Gotz, S.E. Kerwath, and C.G. Wilke. 2013. “Observer Bias and Detection Probability in Underwater Visual Census of Fish Assemblages Measured with Independent Double-Observers.” Journal of Experimental Marine Biology 443: 75–84.
   Web of Science ®Google Scholar
• Besse-Lototskaya, A., P.F.M. Verdonschot, and J.A. Sinkeldam. 2006. “Uncertainty in Diatom Assessment: Sampling, Identification and Counting Variation.” Hydrobiologia 566: 247–260.
   Web of Science ®Google Scholar
• Botanical Society of Britain and Ireland (BSBI). 2015. Field Identification Certificates. Bristol: BSBI. Accessed August 8, 2015. www.bsbi.org.uk/field_skills.html.
   Google Scholar
• Byron, H., J. Treweek, W. Sheate, and S. Thompson. 2000. “Road Developments in the UK: An Analysis of Ecological Assessment in Environmental Impact Statements Produced Between 1993 and 1997.” Journal of Environmental Planning and Management 43: 71–97.
   Google Scholar
• Chartered Institute of Ecology and Environmental Management (CIEEM). 2006. Competency Framework. Winchester: CIEEM. Accessed August 8, 2015. http://www.cieem.net/competency-framework.
   Google Scholar
• Cherrill, A. 2007. “Reporting, Archiving and Sharing Ecological Survey Data: Do We Need Metadata Standards? Developing Best Practice in Survey and Reporting.” In Proceedings of IEEM's Spring Conference; 18 April 2007; London; 59–62. Winchester: Institute of Ecology and Environmental Management.
   Google Scholar
• Cherrill, A. 2013a. “Repeatability of Vegetation Mapping Using Phase 1 and NVC Approaches: Implications for Professional Practice and Surveyors' Training Requirements.” Bulletin of the Chartered Institute of Ecology and Environmental Management – In Practice 81: 41–45.
   Google Scholar
• Cherrill, A. 2013b. “Issues in Survey Reliability: Launch of a Survey of CIEEM Members.” Bulletin of the Chartered Institute of Ecology and Environmental Management – In Practice 82: 35–36.
   Google Scholar
• Cherrill, A. 2014. “The Occurrence, Causes, and Consequences of Inter-Observer Variation in Identification of Phase 1 and NVC Vegetation Types.” Bulletin of the Chartered Institute of Ecology and Environmental Management – In Practice 86: 25–28.
   Google Scholar
• Cherrill, A., and C. McClean. 1995. “An Investigation of Uncertainty in Field Habitat Mapping and the Implications for Detecting Land Cover Change.” Landscape Ecology 10: 5–21.
   Web of Science ®Google Scholar
• Cherrill, A., and C. McClean. 1999a. “Between Observer Variation in the Application of a Standard Method of Habitat Mapping by Environmental Consultants in the UK.” Journal of Applied Ecology 36: 989–1008.
   Web of Science ®Google Scholar
• Cherrill, A., and C. McClean. 1999b. “The Reliability of Phase 1 Habitat Mapping in the UK: The Extent and Types of Observer Bias.” Landscape and Urban Planning 45: 131–143.
   Web of Science ®Google Scholar
• Cherrill, A., and C. McClean. 2000. “Lack of Precision in Mapping Upland Habitats and Preliminary Conservation Assessments.” Aspects of Applied Biology 58: 167–172.
   Google Scholar
• Cherrill, A.J., and C. McClean. 2001. “Omission and Commission Errors in the Field Mapping of Linear Boundary Features: Implications for the Interpretation of Maps and Organisation of Surveys.” Journal of Environmental Planning and Management 44: 331–343.
   Google Scholar
• Clarke, R.T., and D. Hering. 2006. “Errors and Uncertainty in Bioassessment Methods – Major Results and Conclusions From the STAR Project and Their Applications Using STARBUGS.” Hydrobiologia 566: 433–439.
   Web of Science ®Google Scholar
• Diefenbach, D., D. Brauning, and J. Mattice. 2003. “Variability in Grassland Bird Counts Related to Observer Differences and Species Detection Rates.” The Auk 120: 1168–1179.
   Web of Science ®Google Scholar
• Dines, R.A., and J. Murray-Bligh. 2006. “Quality Assurance and RIVPACS.” In Assessing the Biological Quality of Fresh Waters – RIVPACS and Other Techniques, edited by J.F. Wright, W. Sutcliffe, and M. Furse, 71–78. Ambleside: Freshwater Biological Association.
   Google Scholar
• Drayson, K., and S. Thompson. 2013. “Ecological Mitigation measures in English Environmental Impact Assessment.” Journal of Environmental Management 119: 103–110.
   PubMed Web of Science ®Google Scholar
• Elliot, K.C., and D.B. Resnik. 2015. “Scientific Reproducibility, Human Error, and Public Policy.” BioScience 65: 5–6.
   PubMed Web of Science ®Google Scholar
• Environment Agency. 2003. River Habitat Survey in Britain and Ireland. London: Environment Agency.
   Google Scholar
• Environment Agency. 2009a. River Macrophyte Sampling: Methodologies and Variability. London: Environment Agency.
   Google Scholar
• Environment Agency. 2009b. Uncertainty in WFD Assessments for Rivers Based on Macroinvertebrates and RIVPACS. London: Environment Agency.
   Google Scholar
• Farmer, R.G., M.L. Leonard, and A.G. Horn. 2012. “Observer Effects and Avian-Call-Count Survey Quality: Rare-Species Biases and Overconfidence.” The Auk 129: 76–86.
   Web of Science ®Google Scholar
• Frederick, P., B. Hylton, J. Heath, and M. Ruane. 2003. “Accuracy and Variation in Estimates of Large Numbers of Birds by Individual Observers Using an Aerial Survey Simulator.” Journal of Field Ornithology 74: 281–287.
   Web of Science ®Google Scholar
• Fritsch, G., and A. Bruckner. 2014. “Operator Bias in Software-Aided Bat Call Identification.” Ecology and Evolution 4: 2703–2713.
   PubMed Web of Science ®Google Scholar
• Furse, M., D. Hering, O. Moog, P. Verdonschot, R. Johnson, K. Brabec, K. Gritzalis, et al. 2006. “The STAR Project: Context, Objectives and Approaches.” Hydrobiologia 566: 3–29.
   Web of Science ®Google Scholar
• Garcia-Vazquez, E., D. Campo, and F. Juanes. 2012. “Species Misidentification in Mixed Hake Fisheries May Lead to Overexploitation and Population Bottlenecks.” Fisheries Research 114: 52–55.
   Web of Science ®Google Scholar
• Glasson, J., R. Therivel, and A. Chadwick 2012. Introduction to Environmental Impact Assessment. London: Routledge.
   Google Scholar
• Gray, I.M., and G. Edward-Jones. 1999. “A Review of the Quality of Environmental Impact Assessments in the Scottish Forest Sector.” Forestry 72: 1–10.
   Web of Science ®Google Scholar
• Gurnell, A.M., P.G. Angold, and P.J. Edwards. 1996. “Extracting Information From River Corridor Surveys.” Applied Geography 16: 1–19.
   Web of Science ®Google Scholar
• Hasse, P., J. Murray-Bligh, S. Lohse, S. Pauls, A. Sundermann, R. Gunn, and R.T. Clarke. 2006. “Assessing the Impact of Errors in Sorting and Identifying Macroinvertebrate Samples.” Hydrobiologia 566: 505–521.
   Web of Science ®Google Scholar
• Hasse, P., S.U. Pauls, K. Schindehütte, and A. Sundermann. 2010. “First Audit of Macroinvertebrate Samples from an EU Water Framework Directive Monitoring Program: Human Error Greatly Lowers Precision of Assessment Results.” Journal of the North American Benthological Society 29 (4): 1279–1291.
   Google Scholar
• Hearn, S., J. Healey, M. McDonald, A. Turner, J. Wong, and G. Stewart. 2011. “The Repeatability of Vegetation Classification and Mapping.” Journal of Environmental Management 92: 1174–1184.
   PubMed Web of Science ®Google Scholar
• Hill, D., M. Fasham, G. Tucker, M. Shewry, and P. Shaw. 2005. Handbook of Biodiversity Methods: Survey, Evaluation and Monitoring. Cambridge: Cambridge University Press.
   Google Scholar
• Hill, M.O. 1996. TABLEFIT Version 1.0 for Identification of Vegetation Types. Huntingdon: Institute of Terrestrial Ecology.
   Google Scholar
• Hobbs, R.C., and J.M. Waite. 2010. “Abundance of Harbor Porpoise (Phocoena phocoena) in Three Alaskan Regions, Corrected for Observer Errors Due to Perception Bias and Species Misidentification, and Corrected for Animals Submerged from View.” Fisheries Bulletin 108: 251–267.
   Web of Science ®Google Scholar
• Institute of Environmental Assessment. 1995. Guidelines for Baseline Ecological Assessment. London: E and F.N. Spon.
   Google Scholar
• Institute of Ecology and Environmental Management. 2006. Guidelines for Ecological Impact Assessment in the United Kingdom. Winchester: Institute of Ecology and Environmental Management.
   Google Scholar
• Institute of Ecology and Environmental Management. 2007. Rooting for a Career in Ecology or Environmental Management? Winchester: British Ecological Society/ Institute of Ecology and Environmental Management.
   Google Scholar
• Institute of Ecology and Environmental Management. 2011. Ecological Skills – Shaping the Profession for the 21^st Century. Winchester: Institute of Ecology and Environmental Management.
   Google Scholar
• Jenkins, K.J., and B.F.J. Manly. 2008. “A Double-Observer Method for Reducing Bias in Faecal Pellet Surveys of Forest Ungulates.” Journal of Applied Ecology 45: 1339–1348.
   Web of Science ®Google Scholar
• Joint Nature Conservation Committee 1993, revised 2007. Handbook for Phase 1 Survey – A Technique for Environmental Audit. Peterborough: JNCC.
   Google Scholar
• Kelly, M.G. 1997. “Sources of Counting Error in Estimations of the Trophic Diatom Index.” Diatom Research 12: 255–262.
   Google Scholar
• Kelly, M.G. 2013. “Building Capacity for Ecological Assessment Using Diatoms in UK Rivers.” Journal of Ecology and Environment 36: 89–94.
   Google Scholar
• Kahlert, M., M.G. Kelly, R.-L. Albert, S.F.P. Almeida, T. Besta, S. Blanco, M. Coste, et al. 2012. “Identification Versus Counting Protocols as Sources of Uncertainty in Diatom-Based Ecological Status Assessments.” Hydrobiologia 695: 109–124.
   Web of Science ®Google Scholar
• Kolada, A., H. Ciecierska, J. Ruszcynska, and P. Dynowski. 2014. “Sampling Techniques and Inter-Surveyor Variability as Sources of Uncertainty in Polish Macrophyte Metric for Lake Ecological Status.” Hydrobiologia 737: 265–279.
   Web of Science ®Google Scholar
• Lotz, A., and C.R. Allen. 2007. “Observer Bias in Anuran Call Surveys.” Journal of Wildlife Management 71: 675–679.
   Web of Science ®Google Scholar
• Malloch, A.J.C. 1998. MATCH Version 2. Lancaster: University of Lancaster.
   Google Scholar
• MacDonald, A.J. 2010. “Testing the Reliability of Assessment of Land Management Impacts on Scottish Upland Vegetation.” Plant Ecology and Diversity 3: 301–312.
   Web of Science ®Google Scholar
• McClintock, B.T., L.L. Bailey, K.H. Pollock, and T.R. Simons. 2010. “Unmodeled Observation Error Induces Bias When Inferring Patterns and Dynamics of Species Occurrence via Aural Detections.” Ecology 91: 2446–2454.
   PubMed Web of Science ®Google Scholar
• Meek, P.D., K. Vernes, and G. Falzon. 2013. “On the Reliability of Expert Identification of Small-Medium Sized Mammals from Camera Trap Photos.” Wildlife Biology in Practice 9: 1–19.
   Google Scholar
• Milberg, P., J. Bergstedt, J. Fridman, G. Odell, and L. Westerberg. 2008. “Observer Bias and Random Variation in Vegetation Monitoring Data.” Journal of Vegetation Science 19: 633–644.
   Web of Science ®Google Scholar
• Molianari-Jobin, A., M. Kery, E. Marboutin, P. Molinari, I. Koren, C. Fuxjager, C. Breitenmoser-Wursten, et al. 2012. “Monitoring in the Presence of Species Misidentification: The Case of the Eurasian Lynx in the Alps.” Animal Conservation 15: 266–273.
   Web of Science ®Google Scholar
• Morris, P., and R. Thrivel. 2009. Methods of Environmental Impact Assessment. London: Routledge.
   Google Scholar
• Murray-Bligh, J., J. van der Molen, and P. Verdonschot. 2006. STAR Deliverable No. 7: Audit of Performance Incorporating Results of the La Bresse Sampling and Analysis Workshop. Accessed August 8, 2015. http://www.eu-star.at/pdf/Deliverable7.pdf.
   Google Scholar
• Pierce, B.A., and K.J. Gutzwiller. 2007. “Interobserver Variation in Frog Call Surveys.” Journal of Herpetology 41: 424–429.
   Web of Science ®Google Scholar
• Rich, T.C.G., and P.A. Smith. 1996. “Botanical Recording, Distribution Maps and Species Frequency.” Watsonia 21: 155–167.
   Google Scholar
• Rodwell, J.S. 1991–2000. British Plant Communities Volumes 1-5. Cambridge: Cambridge University Press.
   Google Scholar
• Rodwell, J.S. 2006. National Vegetation Classification Users' Handbook. Peterborough: JNCC.
   Google Scholar
• Scott, W.A., and C. Hallam. 2002. “Assessing Species Misidentification Rates Through Quality Assurance of Vegetation Monitoring.” Plant Ecology 165: 101–115.
   Web of Science ®Google Scholar
• Shea, C.P., J.T. Peterson, J.M. Wisniewski, and N.A. Johnson. 2011. “Misidentification of Freshwater Mussel Species (Bivalvia: Unionidae): Contributing Factors, Management Implications, and Potential Solutions.” Journal of the North American Benthological Society 30: 446–458.
   Google Scholar
• Staniszewski, R., K. Szoszkiwicz, J. Zbierska, J. Lesny, S. Jusik, and R.T. Clarke. 2006. “Assessment of Sources of Uncertainty in Macrophyte Surveys and the Consequences for River Classification.” Hydrobiologia 566: 235–246.
   Web of Science ®Google Scholar
• Stevens, J., T. Blackstock, E. Howe, and D. Stevens. 2004. “Repeatability of Phase 1 Habitat Survey.” Journal of Environmental Management 73: 53–59.
   PubMed Web of Science ®Google Scholar
• Sunde, P., and L. Jessen. 2013. “It Counts Who Counts: An Experimental Evaluation of the Importance of Observer Effects on Spotlight Count Estimates.” European Journal of Wildlife Research 59: 645–653.
   Web of Science ®Google Scholar
• Thackeray, S., P. Noges, M. Dunbar, B. Dudley, B. Skjelbred, G. Morabito, L. Carvalho, et al. 2013. “Quantifying Uncertainties in Biologically-Based Water Quality Assessment: A Pan-European Analysis of Lake Phytoplankton Community Metrics.” Ecological Indicators 29: 34–37.
   Web of Science ®Google Scholar
• Thompson, S., J.R. Treweek and D.J. Thurling 1997. “The Ecological Component of Environmental Impact Assessment: A Critical Review of British Environmental Statements.” Journal of Environmental Planning and Management 40: 151–171.
   Google Scholar
• Treweek, J., S. Thompson, N. Veitch, and C. Japp. 1993. “Ecological Assessment of Proposed Road Developments: A Review of Environmental Statements.” Journal of Environmental Planning and Management 36: 295–307.
   Google Scholar
• Treweek, J., and S. Thompson. 1997. “A Review of Ecological Mitigation Measures in UK Environmental Statements with Respect to Sustainable Development.” International Journal of Sustainable Development and World Ecology 4: 40–50.
   Web of Science ®Google Scholar
• Westcott, D.A., and A. McKeown. 2004. “Observer Error in Exit Counts of Flying-Foxes (Pteropus spp.).” Wildlife Research 31: 551–558.
   Web of Science ®Google Scholar
• Whild, S., and S. Townsend. 2007. The Botanical Skills Pyramid. Bristol: Botanical Society of Britain and Ireland/University of Birmingham. Accessed August 8, 2015. http://www.bsbi.org.uk/Botanical_Skills_Pyramid.pdf.
   Google Scholar