Examining the effectiveness of risk elicitations: comparing a deliberative risk ranking to a nationally representative survey on homeland security risk

Abstract

Comparing homeland security risks is a challenging example of comparative risk assessment. One methodology designed for comparing diverse risks of this sort is the Deliberative Method of Ranking Risks. Previous studies have evaluated the utility of the method in absolute terms, examining informed rankings at various stages of the process; this paper represents the first known approach to compare the method relative to another approach. As the Deliberative Method for Ranking Risks is designed to engage deliberative System 2 thought, we compared the rankings from the method to those from a nationally representative survey (RAND’s American Life Panel) that engages experiential System 1 thought. We find evidence that the Deliberative Method for Ranking Risks works as intended, developing more informed rankings with less evidence of bias. The Deliberative Method for Ranking Risks can be a useful improvement for ad hoc comparisons of risk in the homeland security domain.

Keywords:

• Risk ranking
• Deliberative Method for Ranking Risks
• priority setting
• homeland security

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This research was supported by the United States Department of Homeland Security (DHS) through the National Center for Risk and Economic Analysis of Terrorist Events (CREATE) and the University of Southern California (USC) under award number 2010-ST-061-RE0001. However, any opinions, findings, and conclusions or recommendations in this document are those of the author and do not necessarily represent views of the United States Department of Homeland Security, or the University of Southern California, or CREATE.