Identifying Uncertainty in Environmental Risk Assessments: The Development of a Novel Typology and Its Implications for Risk Characterization

REFERENCES

• Acosta , H , Wu , D and Forrest , B M . 2010 . Fuzzy experts on recreational vessels, a risk modelling approach for marine invasions . Ecol Model , 2215 : 850 – 63 .
   Web of Science ®Google Scholar
• Alcamo , J and Bartnicki , J. 1987 . A framework for error analysis of a long-range transport model with emphasis on parameter uncertainty . Atmos Environ , 21 : 2121 – 31 .
   Web of Science ®Google Scholar
• Arhonditsis , G , Qian , S Stow , C . 2007 . Eutrophication risk assessment using Bayesian calibration of process-based models: Application to a mesotrophic lake . Ecol Model , 208 ( 2–4 ) : 215 – 29 .
   Web of Science ®Google Scholar
• Ascough , II JC , Maier , H R Ravalico , J K . 2008 . Future research challenges for incorporation of uncertainty in environmental and ecological decision-making . Ecol Model , 2193–4 : 383 – 99 .
   Web of Science ®Google Scholar
• Aspinall , W , Woo , G Voight , B . 2003 . Evidence-based volcanology: Application to eruption crises . J Volcanol Geoth Res , 128 : 273 – 85 .
   Web of Science ®Google Scholar
• Avagliano , S and Parrella , L. 2009 . Managing uncertainty in risk-based corrective action design: Global sensitivity analysis of contaminant fate and exposure models used in the dose assessment . Environ Model Assess , 141 : 47 – 57 .
   Web of Science ®Google Scholar
• Beck , M. 1987 . Water quality modeling: A review of the analysis of uncertainty . Water Resour Res , 23 : 1393 – 442 .
   Web of Science ®Google Scholar
• Bedford , T and Cooke , R M . 2001 . Probabilistic Risk Analysis: Foundations and Methods , Cambridge , , UK : Cambridge University Press .
   Google Scholar
• Beer , T. 2006 . Ecological risk assessment and quantitative consequence analysis . Hum Ecol Risk Assess , 12 : 51 – 65 .
   Web of Science ®Google Scholar
• Bevington , P and Robinson , D. 2002 . “ Data Reduction and Error Analysis for the Physical Sciences ” . Vol. 3 , New York , , NY, USA : McGraw-Hill .
   Google Scholar
• Brouwer , R and De Blois , C. 2008 . Integrated modelling of risk and uncertainty underlying the cost and effectiveness of water quality measures . Environ Modell Softw , 23 : 922 – 37 .
   Web of Science ®Google Scholar
• Brown , J. 2004 . Knowledge, uncertainty and physical geography: Towards the development of methodologies for questioning belief . T I Brit Geogr , 29 : 367 – 81 .
   Web of Science ®Google Scholar
• Cesar , A , Marin , A Marin-Guirao , L . 2009 . Integrative ecotoxicological assessment of sediment in Postman Bay (Southeast Spain) . Ecotox Environ Safe , 72 : 1832 – 41 .
   PubMed Web of Science ®Google Scholar
• Chapman , PM. 2007 . Determining when contamination is pollution—Weight of evidence determinations for sediments and effluents . Environ Internat , 334 : 492 – 501 .
   Web of Science ®Google Scholar
• Chen , C , Ma , H and Reckhow , K. 2007 . Assessment of water quality management with a systematic qualitative uncertainty analysis . Sci Total Environ , 374 ( 1 ) : 13 – 25 .
   PubMed Web of Science ®Google Scholar
• Croke , B , Ticehurst , T Letcher , R . 2007 . Integrated assessment of water resources: Australian experiences . Water Resour Manag , 21 ( 1 ) : 351 – 73 .
   Web of Science ®Google Scholar
• Department for Environment, Food and Rural Affairs . 2011 . Guidelines for Environmental Risk Assessment and Management: Green Leaves III , London , , UK : HMSO .
   Google Scholar
• Dewulf , A , Craps , M Bouwen , R . 2005 . Integrated management of natural resources: Dealing with ambiguous issues, multiple actors and diverging frames . Water Sci Technol , 52 : 115 – 24 .
   PubMed Web of Science ®Google Scholar
• Ducey , M and Larson , B. 1999 . A fuzzy set approach to the problem of sustainability . Forest Ecol Manag , 115 ( 1 ) : 29 – 40 .
   Web of Science ®Google Scholar
• El-Ghonemy , H , Watts , L and Fowler , L. 2005 . Treatment of uncertainty and developing conceptual models for environmental risk assessments and radioactive waste disposal safety cases . Environ Internat , 31 ( 1 ) : 89 – 97 .
   PubMed Web of Science ®Google Scholar
• Environmental Protection Act . 1990 . Environmental Protection Act: Chapter 43, Section 1 , London , , UK : HMSO .
   Google Scholar
• European Commission Directive 2001/18/EC of the European Parliament and of the Council of 12 March 2001 on the Deliberate Release into the Environment of Genetically Modified Organisms and Repealing Council Directive 90/220/EEC . Official J European Communities , L106 1 – 39 .
   Google Scholar
• Fairman , R , Mead , C Williams , W . 1998 . Environmental Risk Assessment: Approaches, Experiences And Information Sources , Luxembourg : Office for Official Publications of the European Communities .
   Google Scholar
• Faucheux , S and Froger , G. 1995 . Decision-making under environmental uncertainty . Ecol Econ , 15 : 29 – 42 .
   Web of Science ®Google Scholar
• Finkel , A. 1990 . Confronting Uncertainty in Risk Management: A Guide for Decision-Makers , Washington , , DC, USA : Center for Risk Management, Resources for the Future .
   Google Scholar
• Funtowicz , S O and Ravetz , J R . 1990 . Uncertainty and Quality in Science for Policy , Dordrecht , , The Netherlands : Kluwer .
   Google Scholar
• Godduhn , A and Duffy , L K . 2003 . Multi-generation health risks of persistent organic pollution in the far north: Use of the precautionary approach in the Stockholm Convention . Environ Sci Policy , 64 : 341 – 53 .
   Web of Science ®Google Scholar
• Gottschalk , F , Sonderer , T Scholz , R W . 2010 . Possibilities and limitations of modeling environmental exposure to engineered nanomaterials by probabilistic material flow analysis . Environ Toxicol Chem , 29 : 1036 – 48 .
   PubMed Web of Science ®Google Scholar
• Griffin , S , Goodrum , P E Diamond , G L . 1999 . Application of a probabilistic risk assessment methodology to a lead smelter site . Hum Ecol Risk Assess , 5–4 : 845 – 68 .
   Web of Science ®Google Scholar
• Hart , A , Roelofs , W Crocker , J . 2007 . Defra Research Contract CPEC38: Quantitative Approaches to the Risk Assessment of GM crops , York , , UK : Central Science Laboratory .
   Google Scholar
• Hartigan , JA. 1975 . Clustering Algorithms , New York , , NY, USA : John Wiley & Sons .
   Google Scholar
• Hayes , K , Regan , H Burgman , M . 2006 . “ Methods to address uncertainty in ecological risk assessment of Genetically Modified Organisms ” . In Ninth International Symposium on the Biosafety of Genetically Modified Organisms Jeju Island , , South Korea September 24-29, 2006
   Google Scholar
• Helton , JC. 1994 . Treatment of uncertainty in performance assessments for complex systems . Risk Anal , 14 : 483 – 511 .
   Web of Science ®Google Scholar
• Helton , J C , Johnson , J D and Sallaberry , C J . 2011 . Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty . Reliab Eng Syst Safe , 96 ( 9 ) : 1014 – 33 .
   Web of Science ®Google Scholar
• Henrion , M and Fischhoff , B. 1986 . Assessing uncertainty in physical constants . Am J Phys , 54 : 791 – 7 .
   Web of Science ®Google Scholar
• Hoffman , F and Hammonds , J. 1994 . Propagation of uncertainty in risk assessments: The need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability . Risk Anal , 14 : 707 – 12 .
   PubMed Web of Science ®Google Scholar
• Hromkovic , J. 2005 . Design and Analysis of Randomized Algorithms: Introduction to Design Paradigms , New York , , NY, USA : Springer-Verlag .
   Google Scholar
• Huijbregts , M AJ , Norris , G Bretz , R . 2001 . Framework for modelling data uncertainty in life cycle inventories . Internat J Life Cycle Ass , 63 : 127 – 32 .
   Web of Science ®Google Scholar
• Janssen , P , Petersen , A van der Sluijs , J . 2003 . “ RIVM/MNP Guidance for Uncertainty Assessment and Communication: Quickscan Hints & Actions List. RIVM/MNP Guidance for Uncertainty Assessment and Communication Series 2 ” . Utrecht , , The Netherlands : Copernicus Institute for Sustainable Development, Universität Utrecht und RIVM-MNP .
   Google Scholar
• Jorgensen , R , Hauser , T and D’Hertefeldt , T . 2009 . The variability of processes involved in transgene dispersal – case studies from Brassica and related genera . Environ Sci Poll Res , 16 ( 4 ) : 389 – 95 .
   PubMed Web of Science ®Google Scholar
• Kandlikar , M , Ramachandran , G and Maynard , A . 2007 . Health risk assessment for nanoparticles: A case for using expert judgment . JNR , 91 : 137 – 56 .
   Google Scholar
• Kelly , E and Campbell , K. 2000 . Separating variability and uncertainty in environmental risk assessment-making choices . Hum Ecol Risk Assess , 6 ( 1 ) : 1 – 13 .
   Web of Science ®Google Scholar
• Khan , F , Sadiq , R and Husain , T. 2002 . GreenPro-I: A risk-based life cycle assessment and decision-making methodology for process plant design . Environ Modell Softw , 17 ( 8 ) : 669 – 92 .
   Web of Science ®Google Scholar
• Knol , A B , Petersen , A C van der Sluijs , J P . 2009 . Dealing with uncertainties in environmental burden of disease assessment . Environ Health , 8 : 21 – 34 .
   PubMed Web of Science ®Google Scholar
• Kumar , V , Mari , M Schuhmacher , M . 2009 . Partitioning total variance in risk assessment: Application to a municipal solid waste incinerator . Environ Modell Softw , 242 : 247 – 61 .
   Web of Science ®Google Scholar
• Li , H L , Huang , G H and Zou , Y. 2008 . An integrated fuzzy-stochastic modeling approach for assessing health-impact risk from air pollution . Stoch Environ Res Risk Assess , 226 : 789 – 803 .
   Web of Science ®Google Scholar
• Li , J , Huang , G H Zeng , G . 2007 . An integrated fuzzy-stochastic modeling approach for risk assessment of groundwater contamination . J Environ Manage , 822 : 173 – 88 .
   Web of Science ®Google Scholar
• Linkov , L P , Loney , S Cormier , F . 2009 . Weight of evidence evaluation in environmental risk assessment: Review of qualitative and quantitative approaches . Sci Total Environ , 407 : 5199 – 205 .
   PubMed Web of Science ®Google Scholar
• Linkov , I and Moberg , E. 2011 . “ Multi-Criteria Decision Analysis: Environmental Applications and Case Studies ” . Boca Raton , , FL, USA : CRC Press .
   Google Scholar
• Linkov , I , Satterstrom , F K Stevens , J . 2007 . Multi-criteria decision analysis and environmental risk assessment for nanomaterials . JNR , 94 : 543 – 54 .
   Web of Science ®Google Scholar
• Linkov , I , Loney , D Cormier , S . 2009 . Weight-of-evidence evaluation in environmental assessment: Review of qualitative and quantitative approaches . ScTEn , 40719 : 5199 – 205 .
   Google Scholar
• Luttik , R , Mineau , P and Roelofs , W. 2005 . A review of interspecies toxicity extrapolation in birds and mammals and a proposal for long-term toxicity data . Ecotoxicology , 14 ( 8 ) : 817 – 32 .
   PubMed Web of Science ®Google Scholar
• Maier , H R , Ascough , II JC Wattenbach , M . 2008 . Chapter Five—Uncertainty in Environmental Decision Making: Issues, Challenges and Future Directions . Developments Integrated Environ Assess , 3 : 69 – 85 .
   Google Scholar
• Meek , M E and Hughes , K. 1995 . Approach to health risk determination for metals and their compounds under the Canadian Environmental Protection Act . Regul Toxicol Pharm , 22 ( 3 ) : 206 – 12 .
   PubMed Web of Science ®Google Scholar
• Merz , B and Thieken , A H . 2009 . Flood risk curves and uncertainty bounds . Nat Hazards , 513 : 437 – 58 .
   Web of Science ®Google Scholar
• Morgan , M , Henrion , M and Small , M. 1990 . “ Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis ” . Cambridge , , UK : Cambridge University Press .
   Google Scholar
• Oughton , D H , Agüero , A Avila , R . 2008 . Addressing uncertainties in the ERICA Integrated Approach . J Environ. Radioactivity , 99 : 1384 – 92 .
   PubMed Web of Science ®Google Scholar
• Petersen , AC. 2006 . Simulating Nature: A Philosophical Study of Computer-Simulation Uncertainties and Their Role in Climate Science and Policy Advice , Amsterdam , , The Netherlands : Aksant Academic Pub .
   Google Scholar
• Phillips , K P , Foster , W G Leiss , W . 2008 . Assessing and managing risks arising from exposure to endocrine-active chemicals . J Toxicol Environ Heal B: Critical Reviews , 113–4 : 351 – 72 .
   Web of Science ®Google Scholar
• Qin , X S and Huang , G H . 2009 . Characterizing uncertainties associated with contaminant transport modeling through a coupled fuzzy-stochastic approach . Water Air Soil Poll , 1971 ( 1 ) : 331 – 48 .
   Web of Science ®Google Scholar
• Ramirez , A J , Jensen , A C and Cheng , B HC . 2012 . A taxonomy of uncertainty for dynamically adaptive systems , 99 – 108 . ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems . 4–5 June 2012, Zurich, Switzerland
   Google Scholar
• Refsgaard , J , van Der Sluijs , J Hojberg , A . 2007 . Uncertainty in the environmental modelling process—A framework and guidance . Environ Modell Softw , 22 : 1543 – 56 .
   Web of Science ®Google Scholar
• Regan , H M , Colyvan , M and Burgman , M A . 2002 . A taxonomy and treatment of uncertainty for ecology and conservation biology . Ecol Appl , 12 ( 2 ) : 618 – 28 .
   Web of Science ®Google Scholar
• Rowe , W. 1994 . Understanding uncertainty . Risk Anal , 14 : 743 – 50 .
   Web of Science ®Google Scholar
• Stephens , M , Goodwin , B and Andres , T. 1993 . Deriving parameter probability density functions . Reliab Eng Sys Safe , 42 ( 2–3 ) : 271 – 291 .
   Web of Science ®Google Scholar
• Stirling , A. 1999 . Risk at a turning point? . J Risk Res , 1 : 97 – 109 .
   Google Scholar
• Stirling , A. 2012 . Opening up the politics of knowledge and power in bioscience . PLoS Biol , 10 ( 1 ) : e1001233
   PubMed Web of Science ®Google Scholar
• Suter , G W II and Cormier , S M . 2011 . Why and how to combine evidence in environmental assessments: Weighing evidence and building cases . Sci Total Environ , 409 : 1406 – 17 .
   PubMed Web of Science ®Google Scholar
• Troldborg , M. 2010 . Risk Assessment Models and Uncertainty Estimation of Groundwater Contamination from Point Sources , Copenhagen , , Denmark : Technical University of Denmark . PhD Thesis
   Google Scholar
• USEPA (US Environmental Protection Agency) . 1998 . Guidelines for Ecological Risk Assessment , Washington , , DC, USA : Risk Assessment Forum .
   Google Scholar
• van Asselt , M and Rotmans , J. 2002 . Uncertainty in integrated assessment modelling . Climatic Change , 54 : 75 – 105 .
   Web of Science ®Google Scholar
• van der Keur , P , Henriksen , H Refsgaard , J . 2008 . Identification of major sources of uncertainty in current IWRM practice. Illustrated for the Rhine basin . Water Resour Manag , 22 ( 11 ) : 1677 – 708 .
   Web of Science ®Google Scholar
• van der Sluijs , J . 1997 . Anchoring Amid Uncertainty: On the Management of Uncertainties in Risk Assessment of Anthropogenic Climate Change , The Netherlands : Utrecht University . PhD Thesis
   Google Scholar
• van der Sluiijs , J P , Janssen , P HM Petersen , A C . 2004 . “ RIVM/MNP guidance for uncertainty assessment and communication: Tool catalogue for uncertainty assessment. RIVM/MNP Guidance for Uncertainty Assessment and Communication Series 2 ” . Utrecht , , The Netherlands : Copernicus Institute for Sustainable Development, Universitat Utrecht und RIVM-MNP .
   Google Scholar
• Vesely , W and Rasmuson , D. 1984 . Uncertainties in nuclear probabilistic risk analyses . Risk Anal , 4 : 313 – 22 .
   Web of Science ®Google Scholar
• Vose , D. 2000 . Risk Analysis , Chichester , , UK : John Wiley & Sons .
   Google Scholar
• Walker , W E , Harremoës , P Rotmans , J . 2003 . Defining uncertainty: A conceptual basis for uncertainty management in model-based decision support . Integrated Assess , 41 : 5 – 17 .
   Google Scholar
• Williams , B K , Szaro , R C and Shapiro , C D . 2009 . “ Adaptive Management: The U.S. Department of the Interior Technical Guide ” . Washington , , DC, USA : Adaptive Management Working Group, US Department of Interior .
   Google Scholar
• Wright-Walters , M , Volz , C Talbott , E . 2011 . An updated weight of evidence approach to the aquatic hazard assessment of Bisphenol A and the derivation a new predicted no effect concentration (PNEC) using a non-parametric methodology . Sci Total Environ , 409 ( 4 ) : 676 – 85 .
   PubMed Web of Science ®Google Scholar
• Wu , F C and Tsang , Y P . 2004 . Second-order Monte Carlo uncertainty/variability analysis using correlated model parameters: Application to salmonid embryo survival risk assessment . Ecol Model , 177 ( 3–4 ) : 393 – 414 .
   Web of Science ®Google Scholar
• Wynne , B. 1992 . Uncertainty and environmental learning: Reconceiving science and policy in the preventive paradigm . Global Environ Chang , 2 : 111 – 27 .
   Web of Science ®Google Scholar
• Zalk , D , Paik , S and Swuste , P. 2009 . Evaluating the Control Banding Nanotool: A qualitative risk assessment method for controlling nanoparticle exposures . J Nanopart Res , 11 ( 7 ) : 1685 – 704 .
   Web of Science ®Google Scholar
• Zhang , H , Huang , G H and Zeng , G M . 2009 . Health risks from arsenic-contaminated soil in Flin Flon-Creighton, Canada: Integrating geostatistical simulation and dose-response model . Environ Pollut , 157 ( 8-9 ) : 2413 – 20 .
   PubMed Web of Science ®Google Scholar