A Strategy for Using Weight-of-Evidence Methods in Ecological Risk Assessments

REFERENCES

• Batley , G E , Burton , G A and Chapman , P M . 2002 . Uncertainties in sediment quality weight-of-evidence (WOE) assessments . Hum Ecol Risk Assess , 8 : 1517 – 47 .
   Web of Science ®Google Scholar
• Bay , S , Berry , W and Chapman , P M . 2007 . Evaluating consistency of best professional judgment in the application of a multiple lines of evidence sediment quality triad . Integ Environ Assess Manage , 3 : 491 – 7 .
   PubMedGoogle Scholar
• Burkhardt-Holm , P and Scheurer , K . 2007 . Application of the weight-of-evidence approach to assess the decline of brown trout (Salmo trutta) in Swiss rivers . Aquatic Sci , 69 : 51 – 70 .
   Web of Science ®Google Scholar
• Burton , G A Jr , Batley , G E and Chapman , P M . 2002 . A weight-of-evidence framework for assessing sediment (or other) contamination: Improving certainty in the decision-making process . Human Ecol Risk Assess , 8 : 1675 – 96 .
   Web of Science ®Google Scholar
• CalEPA (California Environmental Protection Agency) . Water Quality Control Plan for Enclosed Bays and Estuaries—Part 1 Sediment Quality . State Water Resources Control Board Resolution No. 2008–007 , Sacramento, CA , , USA
   Google Scholar
• CH2M HILL . 2005 . Final Tier2/Tier 3 Ecological Risk Assessment Addendum, Former Kelly Air Force Base , San Antonio, Texas : CH2M HILL . Contract F41624-00-D-8021-0134 Available at http://afrpaar.lackland.af.mil/ar/docsearch.aspx?Base=12 (accessed 17 September 2013)
   Google Scholar
• Chapman , PM. 2003 . The sediment quality triad: Then, now and tomorrow . Int J Environ Poll , 13 : 351 – 6 .
   Google Scholar
• Chapman , P M and Anderson , J A . 2005 . Decision-making framework for sediment contamination . Integ Environ Assess Manage , 1 : 163 – 73 .
   PubMed Web of Science ®Google Scholar
• Chapman , P M , McDonald , B G and Lawrence , G S . 2002 . Weight-of-evidence issues and frameworks for sediment quality (and other) assessments . Human Ecol Risk Assess , 8 : 1489 – 515 .
   Web of Science ®Google Scholar
• Cormier , S M and Suter , G W II . 2008 . A framework for thoroughly integrating environmental assessments . Environ Manage , 42 : 543 – 56 .
   PubMed Web of Science ®Google Scholar
• Critto , A , Torresan , S and Semenzin , E . 2007 . Development of a site-specific ecological risk assessment for contaminated sites: Part I. A multi-criteria based system for the selection of ecotoxicological tests and ecological observations . Sci Total Environ , 379 : 16 – 33 .
   PubMed Web of Science ®Google Scholar
• Dale , V H , Biddinger , G R and Newman , M C . 2008 . Enhancing the ecological risk assessment process . Integ Environ Assess Manage , 4 : 306 – 13 .
   PubMedGoogle Scholar
• ECHA (European Chemicals Agency) . Practical Guide 2: How to Report Weight of Evidence , Helsinki , , Finland
   Google Scholar
• ECOFRAM (Ecological Committee on FIFRA Risk Assessment Methods) . 1999 . Terrestrial Draft Report , Washington, DC , , USA : Office of Pesticide Programs . Available at www.epa.gov/oppefed1/ecorisk/ecorisk_ecofram.htm (accessed 17 September 2013)
   Google Scholar
• Environment Agency . 2008 . Guidance on the Attribution of Cause and Effect in Ecological Risk Assessment. Science report SC070009/SR2e , Bristol , , UK : Environment Agency .
   Google Scholar
• Environment Canada . 2012 . Federal Contaminated Sites Action Plan (FCSAP): Ecological Risk Assessment Guidance , Vancouver, BC , , Canada : Pacific and Yukon Environmental Stewardship Branch .
   Google Scholar
• Exponent . 2009 . “ Focused Literature Review of Weight-of-Evidence Approaches ” . In Prepared for Science Advisory Board for Contaminated Sites in British Columbia, Victoria, British Columbia Seattle, WA , , USA Document No. 0906563.000 01F1 1109 SD23
   Google Scholar
• Fairbrother , A. 2003 . Lines of evidence in wildlife risk assessments . Hum Ecol Risk Assess , 9 : 1475 – 91 .
   Web of Science ®Google Scholar
• Forbes , V E and Calow , P . 2002 . Applying weight-of-evidence in retrospective ecological risk assessment when quantitative data are limited . Hum Ecol Risk Assess , 8 : 1625 – 39 .
   Web of Science ®Google Scholar
• Forbes , V E and Calow , P . 2004 . Systematic approach to weight of evidence in sediment quality assessment: Challenges and opportunities . Aquatic Ecosys Health Manage , 7 : 339 – 50 .
   Google Scholar
• Gold , J I and Shadlen , M N . 2007 . The neural basis of decision making . An Rev Neurosci , 30 : 535 – 74 .
   PubMed Web of Science ®Google Scholar
• Good , IJ. 1991 . “ Weight of evidence and the Bayesian likelihood ratio ” . In The Use of Statistics in Forensics Science , Edited by: Aitken , C GG and Stoney , D . 85 – 106 . Boca Raton, FL , , USA : CRC Press .
   Google Scholar
• Good , I J . 2003 . The accumulation of imprecise weights of evidence . Society for Imprecise Probability Theory and Applications (SIPTA) Newsletter , 1 : 2 – 8 .
   Google Scholar
• Hall , L WJ , Dauer , D M and III , R WA . 2005 . An integrated case study for evaluating the impacts of an oil refinery effluent on aquatic biota in the Delaware River: Sediment quality triad studies . Hum Ecol Risk Assess , 11 : 657 – 770 .
   Web of Science ®Google Scholar
• Johnston , R K , Munns , W R Jr and Tyler , P L . 2002 . Weighing the evidence of ecological risk from chemical contamination in the estuarine environment adjacent to the Portsmouth Naval Shipyard, Kittery, Maine, USA . Environ Toxicol Chem , 21 : 182 – 94 .
   PubMed Web of Science ®Google Scholar
• Kaplan , S and Garrick , B J . 1981 . On the quantitative definition of risk . Risk Anal , 1 : 11 – 27 .
   Google Scholar
• Klimisch , H J , Andreae , E and Tillmann , U . 1997 . A systematic approach for evaluating the quality of experimental and ecotoxicological data . Reg Toxicol Pharmacol , 25 : 1 – 5 .
   PubMed Web of Science ®Google Scholar
• Krimsky , S. 2005 . The weight of scientific evidence in policy and law . Am J Public Health , 95 : S129 – S136 .
   PubMed Web of Science ®Google Scholar
• Linkov , I , Loney , D and Cormier , S . 2009 . Weight-of-evidence evaluation in environmental assessment: Review of qualitative and quantitative approaches . Sci Total Environ , 407 : 5199 – 205 .
   PubMed Web of Science ®Google Scholar
• Lowell , R B , Culp , J M and Dube , M G . 2000 . A weight-of-evidence approach for northern river risk assessment: Integrating the effects of multiple stressors . Environ Toxicol Risk Assess , 19 : 1182 – 90 .
   Google Scholar
• McDonald , B G and Chapman , P M . 2007 . Selenium effects: A weight-of-evidence approach . Integ Environ Assess Manage , 3 : 129 – 36 .
   PubMed Web of Science ®Google Scholar
• McDonald , B G , deBruyn , A M and Wernick , B G . 2007 . Design and application of a transparent and scalable weight-of-evidence framework: An example from Wabamun Lake, Alberta, Canada . Integ Environ Assess Manage , 3 : 476 – 83 .
   PubMedGoogle Scholar
• MacDonald , D D , Moore , D R and Ingersoll , C G . 2011a . Baseline ecological risk assessment of the Calcasieu Estuary, Louisiana: Part 1. Overview and problem formulation . Arch Environ Contam Toxicol , 61 : 1 – 13 .
   PubMed Web of Science ®Google Scholar
• MacDonald , D D , Ingersoll , C G and Smorong , D E . 2011b . Baseline ecological risk assessment of the Calcasieu Estuary, Louisiana: Part 2. An evaluation of the predictive ability of effects-based sediment-quality guidelines . Arch Environ Contam Toxicol , 61 : 14 – 28 .
   PubMed Web of Science ®Google Scholar
• MacDonald , D D , Ingersoll , C G and Kemble , N E . 2011c . Part 3. An evaluation of the risks to benthic invertebrates associated with exposure to contaminated sediments . Arch Environ Contam Toxicol , 61 : 29 – 58 .
   PubMed Web of Science ®Google Scholar
• Menzie , C , Henning , M H and Cura , J . 1996 . Special report of the Massachusetts Weight-of-Evidence Workgroup: A weight-of-evidence approach for evaluating ecological risks . Hum Ecol Risk Assess , 2 : 277 – 304 .
   Web of Science ®Google Scholar
• MIL . 2010 . Standard Practice, System Safety, Environment, Safety, and Occupational Health, Risk Management Methodology for Systems Engineering , Washington, DC , , USA : MIL-STD-882D w/Change 1 (draft). US Department of Defense .
   Google Scholar
• Moraes , R , Gerhard , P and Andersson , L . 2003 . Establishing causality between exposure to metals and effects on fish . Hum Ecol Risk Assess , 9 : 149 – 69 .
   Web of Science ®Google Scholar
• Reynoldson , T B , Thompson , S P and Milani , D . 2002 . Integrating multiple toxicological endpoints in a decision-making framework for contaminated sediments . Hum Ecol Risk Assess , 8 : 1569 – 84 .
   Web of Science ®Google Scholar
• SABCS (Science Advisory Board for Contaminated Sites in British Columbia) . 2010 . Guidance for a Weight of Evidence Approach in Conducting Detailed Ecological Risk Assessments (DERA) in British Columbia , Victoria, BC , , Canada : Ministry of Environment .
   Google Scholar
• Seife , C. 2010 . Proofiness: The Dark Arts of Mathematical Deception , New York, NY , , USA : Viking .
   Google Scholar
• SFF (Sustainable Fisheries Foundation) . Workshop to Support the Development of Guidance on the Assessment of Contaminated Sediments in British Columbia: Workshop summary report . Prepared for British Columbia Ministry of Environment, Land Remediation Section—December, 2007 , Victoria, BC , , Canada
   Google Scholar
• Smith , E P , Lipkovich , I and Ye , K . 2002 . Weight-of-Evidence (WOE): Quantitative estimation of probability of impairment for individual and multiple lines of evidence . Hum Ecol Risk Assess , 8 : 1585 – 96 .
   Web of Science ®Google Scholar
• Stahl , R G Jr . 1998 . Issues addressed and unaddressed in EPA's ecological risk guidelines. Risk Policy Report . April , 17 : 35 – 7 .
   Google Scholar
• Stoddard , J L , Larsen , D P and Hawkins , C P . 2006 . Setting expectations for the ecological condition of streams: The concept of reference condition . Ecol Appl , 16 : 1267 – 76 .
   PubMed Web of Science ®Google Scholar
• Suter , II GW . 1996a . Abuse of hypothesis testing statistics in ecological risk assessment . Hum Ecol Risk Assess , 2 : 331 – 47 .
   Web of Science ®Google Scholar
• Suter , G W II . 1996b . Risk Characterization for Ecological Risk Assessment of Contaminated Sites. ES/ER/TM-20 , Oak Ridge, TN , , USA : Office of Environmental Management, US Department of Energy .
   Google Scholar
• Suter , G W II and Cormier , S M . 2010 . When is a formal assessment process worthwhile? . Hum Ecol Risk Assess , 16 : 1 – 3 .
   Web of Science ®Google Scholar
• Suter , G W II and Cormier , S M . 2011 . Why and how to combine evidence in environmental assessments: Weighing evidence and building cases . Sci Total Environ , 409 : 1406 – 17 .
   PubMed Web of Science ®Google Scholar
• Suter , G W II and Cormier , S M . 2013 . A method for assessing the potential for confounding applied to ionic strength in central Appalachian streams . Environ Toxicol Chem , 32 : 288 – 95 .
   PubMed Web of Science ®Google Scholar
• USEPA (US Environmental Protection Agency) . 1992 . Framework for Ecological Risk Assessment. EPA/630/R-92/001 , Washington, DC , , USA : Risk Assessment Forum .
   Google Scholar
• USEPA . 1997 . “ Ecological Risk Assessment Guidance for Superfund: Process for Designing and Conducting Ecological Risk Assessments ” . Washington, DC , , USA : Office of Solid Waste and Emergency Response . EPA 540-R-97-006
   Google Scholar
• USEPA . 1998 . Guidelines for Ecological Risk Assessment , Washington, DC : Risk Assessment Forum . EPA/630/R-95/002F
   Google Scholar
• USEPA . 2000 . Risk Characterization Handbook , Washington, DC , , USA : Office of Science Policy . EPA 100-B-00-002
   Google Scholar
• USEPA . 2003 . Generic Ecological Assessment Endpoints (GEAEs) for Ecological Risk Assessment , Washington, DC , , USA : Risk Assessment Forum . EPA/630/P-02/004F
   Google Scholar
• USEPA . 2011 . Callahan Mine Superfund Site Factsheet . Available at www.epa.gov/region1/superfund/sites/callahan/482893.pdf (accessed 17 September 2013)
   Google Scholar
• USEPA . 2012 . Region 8 Risk Assessment, Risk Characterization . Available at http://www2.epa.gov/region8/eco-risk-characterization (accessed 17 September 2013)
   Google Scholar
• VanStraalen , N M . 2002 . Threshold models for species sensitivity distributions applied to aquatic risk assessment for zinc . Environ Toxicol Pharmacol , 11 : 167 – 72 .
   PubMed Web of Science ®Google Scholar
• Wandall , B . 2004 . Values in science and risk assessment . Toxicol Lett , 152 : 265 – 72 .
   PubMed Web of Science ®Google Scholar
• Weed , D L . 2005 . Weight of evidence: A review of concept and methods . Risk Anal , 25 : 1545 – 57 .
   PubMed Web of Science ®Google Scholar