Further reflections on EFSA’s work on uncertainty in scientific assessments

References

• Apostolakis, G. E. 1990. “The Concept of Probability in Safety Assessments of Technological Systems.” Science 250: 1359–1364.10.1126/science.2255906
   PubMed Web of Science ®Google Scholar
• Aven, T. 2010. “Some Reflections on Uncertainty Analysis and Management.” Reliability Engineering and System Safety 95: 195–201.10.1016/j.ress.2009.09.010
   Web of Science ®Google Scholar
• Aven, T. 2013a. “How to Define and Interpret a Probability in a Risk and Safety Setting. Discussion Paper, with General Introduction by Associate Editor, Genserik Reniers.” Safety Science 51: 223–231.10.1016/j.ssci.2012.06.005
   Web of Science ®Google Scholar
• Aven, T. 2013b. “On How to Deal with Deep Uncertainties in a Risk Assessment and Management Context.” Risk Analysis 33 (12): 2082–2091.10.1111/risa.2013.33.issue-12
   PubMed Web of Science ®Google Scholar
• Aven, T. 2017a. “Improving the Foundation and Practice of Uncertainty Analysis: Strengthening the Links to Knowledge and Risk.” In Knowledge in Risk Assessment , edited by T. Aven , and E. Zio , 103–125. Chicester: Wiley.
   Google Scholar
• Aven, T. 2017b. “Improving Risk Characterisations in Practical Situations by Highlighting Knowledge Aspects, with Applications to Risk Matrices.” Reliability Engineering and System Safety 167: 42–48. Open Access.10.1016/j.ress.2017.05.006
   Web of Science ®Google Scholar
• Aven, T. , P. Baraldi , R. Flage , and E. Zio . 2014. Uncertainties in Risk Assessments . Chichester: Wiley.10.1002/9781118763032
   Google Scholar
• Aven, T. , and R. Flage . 2017. “Risk Assessment with Broad Uncertainty and Knowledge Characterisations: An Illustrating Example.” In Knowledge in Risk Assessment , edited by T. Aven , and E. Zio , 3–26. Chicester: Wiley.
   Google Scholar
• Aven, T. , and O. Renn . 2015. “An Evaluation of the Treatment of Risk and Uncertainties in the IPCC Reports on Climate Change.” Risk Analysis 35 (4): 701–712. Open Access.10.1111/risa.2015.35.issue-4
   PubMed Web of Science ®Google Scholar
• Aven, T. , and O. Renn . 2017. “Improving Government Policy on Risk: Eight Key Principles.” Submitted.
   Google Scholar
• Aven, T. , and E. Zio . 2013. “Model Output Uncertainty in Risk Assessment.” International Journal of Performability Engineering 9 (5): 475–486.
   Google Scholar
• Bedford, T. , and R. Cooke . 2001. Probabilistic Risk Analysis . Cambridge: Cambridge University Press.10.1017/CBO9780511813597
   Google Scholar
• Berner, C. L. , and R. Flage . 2016. “Comparing and Integrating the NUSAP Notational Scheme with an Uncertainty Based Risk Perspective.” Reliability Engineering and System Safety 156: 185–194.10.1016/j.ress.2016.08.001
   Web of Science ®Google Scholar
• Cox, L. A. T. 2012. “Confronting Deep Uncertainties in Risk Analysis.” Risk Analysis 32: 1607–1629.10.1111/risk.2012.32.issue-10
   PubMed Web of Science ®Google Scholar
• Cox, D. C. , and P. Baybutt . 1981. “Methods for Uncertainty Analysis: A Comparative Study.” Risk Analysis 1 (4): 251–258.10.1111/risk.1981.1.issue-4
   Google Scholar
• Dubois, D. 2010. “Representation, Propagation, and Decision Issues in Risk Analysis Under Incomplete Probabilistic Information.” Risk Analysis 30: 361–368.10.1111/risk.2010.30.issue-3
   PubMed Web of Science ®Google Scholar
• EFSA . 2016. Guidance on Uncertainty in EFSA (European Food Safety Authority) Scientific Assessment: Revised Draft for Internal Testing . Parma: EFSA. Accessed May 27, 2017. https://www.efsa.europa.eu/sites/default/files/160321DraftGDUncertaintyInScientificAssessment.pdf
   Google Scholar
• de Finetti, B. 1937. “La prévision: ses lois logiques, ses sources subjectives.” Annales de l’institut Henri Poincaré 7 (1): 1–68.
   Google Scholar
• Flage, R. , and T. Aven . 2015. “Emerging Risk – Conceptual Definition and a Relation to Black Swan Types of Events.” Reliability Engineering and System Safety 144: 61–67. Open Access.10.1016/j.ress.2015.07.008
   Web of Science ®Google Scholar
• Flage, R. , T. Aven , P. Baraldi , and E. Zio . 2014. “Concerns, Challenges and Directions of Development for the Issue of Representing Uncertainty in Risk Assessment.” Risk Analysis 34 (7): 1196–1207.10.1111/risa.12247
   PubMed Web of Science ®Google Scholar
• Funtowicz, S. O. , and J. R. Ravetz . 1990. Uncertainty and Quality in Science for Policy . Dordrecht: Kluwer Academic .10.1007/978-94-009-0621-1
   Google Scholar
• Funtowicz, S. O. , and J. R. Ravetz . 1993. “Science for the Post-normal Age.” Futures 25: 735–755.
   Web of Science ®Google Scholar
• Hansson, S. O. , and T. Aven . 2014. “Is Risk Analysis Scientific?.” Risk Analysis 34: 1173–1183.
   PubMed Web of Science ®Google Scholar
• Helton, J. C. 1994. “Treatment of Uncertainty in Performance Assessments for Complex Systems.” Risk Analysis 14: 483–511.10.1111/risk.1994.14.issue-4
   Web of Science ®Google Scholar
• Helton, J. C. , J. D. Johnson , and W. L. Oberkampf . 2004. “An Exploration of Alternative Approaches to the Representation of Uncertainty in Model Predictions.” Reliability Engineering and System Safety 85 (1–3): 39–71.10.1016/j.ress.2004.03.025
   Web of Science ®Google Scholar
• ISO . 2009. Risk Management – Vocabulary . Guide 73: 2009.
   Google Scholar
• Kaplan, S. , and B. J. Garrick . 1981. “On the Quantitative Definition of Risk.” Risk Analysis 1: 11–27.10.1111/risk.1981.1.issue-1
   Google Scholar
• Kloprogge, P. , J. van der Sluijs , and A. Petersen . 2005. A Method for the Analysis of Assumptions in Assessments . Bilthoven: Netherlands Environmental Assessment Agency (MNP).
   Google Scholar
• Kloprogge, P. , J. P. van der Sluijs , and A. C. Petersen . 2011. “A Method for the Analysis of Assumptions in Model-based Environmental Assessments.” Environmental Modelling and Software 26: 289–301.10.1016/j.envsoft.2009.06.009
   Web of Science ®Google Scholar
• Laes, E. , G. Meskens , and J. P. van der Sluijs . 2011. “On the Contribution of External Cost Calculations to Energy System Governance: The Case of a Potential Large-scale Nuclear Accident.” Energy Policy 39: 5664–5673.10.1016/j.enpol.2011.04.016
   Web of Science ®Google Scholar
• Lindley, D. V. 2006. Understanding Uncertainty . Hoboken, NJ: Wiley.10.1002/0470055480
   Google Scholar
• Löfstedt, R. , and F. Bouder . 2017. “Evidence Based Uncertainty Analysis: What Should We Now Do in Europe? A View Point.” Journal of Risk Research . doi:10.1080/13669877.2017.1316763.
   PubMed Web of Science ®Google Scholar
• Montgomery, V. J. , F. P. A. Coolen , and A. D. M. Hart . 2009. “Bayesian Probability Boxes in Risk Assessment.” Journal of Statistical Theory and Practice 3 (1): 69–83.10.1080/15598608.2009.10411912
   Google Scholar
• Morgan, M. G. , M. Henrion , and M. Small . 1990. Uncertainty . Cambridge: Cambridge University Press.10.1017/CBO9780511840609
   Google Scholar
• NRC . 2013. US Nuclear Regulatory Commission. Guidance on the Treatment of Uncertainties Associated with PRAs in Risk-Informed Decision Making,Draft Report for Comments (NUREG-1855, Rev. 1). Washington DC.
   Google Scholar
• Parry, G. , and P. W. Winter . 1981. “Characterization and Evaluation of Uncertainty in Probabilistic Risk Analysis.” Nuclear Safety 22 (1): 28–42.
   Google Scholar
• de Rocquigny, E. , N. Devictor , and S. Tarantola . 2008. Uncertainty in Industrial Practice. A Guide to Quantitative Uncertainty Management . Hoboken, NJ: Wiley.10.1002/9780470770733
   Google Scholar
• Sahlin, U. , and M. C. M. Troffaes . 2017. “A Note on EFSA’s Ongoing Efforts to Increase Transparency of Uncertainty in Scientific Opinions.” Journal of Risk Research . doi:10.1080/13669877.2017.1313769.
   PubMedGoogle Scholar
• Savage, L. J. 1954. The Foundations of Statistics . New York : Wiley ( second edition, 1972, New York: Dover).
   Google Scholar
• Singpurwalla, N. D. 2006. Reliability and Risk – A Bayesian Perspective . Chichester: Wiley.
   Google Scholar
• van der Sluijs, J. , M. Craye , S. Funtowicz , P. Kloprogge , J. Ravetz , and J. Risbey . 2005a. “Combining Quantitative and Qualitative Measures of Uncertainty in Model-based Environmental Assessment.” Risk Analysis 25 (2): 481–492.10.1111/risk.2005.25.issue-2
   PubMed Web of Science ®Google Scholar
• van der Sluijs, J. , M. Craye , S. Funtowicz , P. Kloprogge , J. Ravetz , and J. Risbey . 2005b. “Experiences with the NUSAP System for Multidimensional Uncertainty Assessment in Model Based Foresight Studies.” Water Science and Technology 52 (6): 133–144.
   PubMed Web of Science ®Google Scholar
• SRA . 2015. Glossary Society for Risk Analysis . Accessed May 26, 2017. www.sra.org/resources.
   Google Scholar
• Veland, H. , and T. Aven . 2013. “Risk Communication in the Light of Different Risk Perspectives.” Reliability Engineering and System Safety 110: 34–40.10.1016/j.ress.2012.09.007
   Web of Science ®Google Scholar
• Winkler, R. L. 1996. “Uncertainty in Probabilistic Risk Assessment.” Reliability Engineering and System Safety 54: 127–132.10.1016/S0951-8320(96)00070-1
   Web of Science ®Google Scholar