4,739
Views
4
CrossRef citations to date
0
Altmetric
Review

Principles of risk decision-making

, , , , , , , & show all

ABSTRACT

Risk management decisions in public health require consideration of a number of complex, often conflicting factors. The aim of this review was to propose a set of 10 fundamental principles to guide risk decision-making. Although each of these principles is sound in its own right, the guidance provided by different principles might lead the decision-maker in different directions. For example, where the precautionary principle advocates for preemptive risk management action under situations of scientific uncertainty and potentially catastrophic consequences, the principle of risk-based decision-making encourages decision-makers to focus on established and modifiable risks, where a return on the investment in risk management is all but guaranteed in the near term. To evaluate the applicability of the 10 principles in practice, one needs to consider 10 diverse risk issues of broad concern and explore which of these principles are most appropriate in different contexts. The 10 principles presented here afford substantive insight into the process of risk management decision-making, although decision-makers will ultimately need to exercise judgment in reaching appropriate risk decisions, accounting for all of the scientific and extra-scientific factors relevant to the risk decision at hand.

Introduction

Over the last three decades, risk science has evolved into a well-established transdisciplinary field, with strong theoretical and applied foundations. Following the publication of the ‘Red Book’ by the U.S. National Research Council in 1983 (NRC: National Research Council Citation1983), which described a structured approach to risk assessment and risk management, subsequent advances have brought increasing sophistication into the field (Krewski et al. Citation2007; NRC: National Research Council Citation1994), including the U.S. Environmental Protection Agency’s recent NexGen framework for the next generation of risk science (Krewski et al. Citation2014).

Although scientific approaches to characterization of public health risks including epidemiological, toxicological, clinical and surveillance approaches have been well-described, principles of risk management decision-making are less well-articulated. The present review sought to introduce and test a set of decision-making principles, describing 10 such principles denoted P1 through P10 for ease of reference throughout this article, which might collectively provide useful guidance to decision-makers. The list of 10 principles was developed from the lived experience of these authors and comprises their combined opinions as being deemed the most appropriate. The principles are presented as a basis for widespread discussion, debate, and future evolution.

To evaluate the utility of these principles in practice, the application in 10 different risk decision contexts, labeled RC1 through RC10, was examined which represents a diverse set of risk management issues of current national and international concerns. The objectives of this paper are three-fold: to (1) articulate fundamental decision-making principles that provide guidance in risk decision-making; (2) explore their relevance and application in real-world risk decisions; and (3) identify the characteristics of different risk contexts that render each of these principles most relevant.

In practice, several valid yet potentially contradictory principles are relevant to most risk contexts. Indeed, the conditions under which each principle is most relevant are important. It is worthwhile noting that while each of the principles offers valuable guidance for decision-making in its own right, various principles might lead the decision-maker in different directions. Risk decision-makers therefore need to exercise judgment in balancing the guidance provided by these principles to reach an appropriate risk management decision.

This review commences with a description of the 10 principles, along with an explanation of the motivation for their use in risk management decision-making. To appreciate their utilization in practice, one subsequently needs to explore the application of the 10 principles across 10 risk decision contexts, highlighting the principles that are most relevant to each context. Attributes of risk decisions that might favor the employment of certain risk decision principles are then discussed, based upon these same 10 examples. Other related risk decision principles are discussed in the Supplementary Material. The concluding section of this article emphasizes the use of the 10 risk decision principles presented here as a guide to making critical risk decisions, concurrently acknowledging the importance of judgment and experience in decision-making, along with consideration of context-specific socio-political considerations.

Principles of risk decision-making

Risk management decisions can be highly complex, requiring consideration of a wide range of scientific and extra-scientific factors. Guidance on risk decision-making, however, is provided by a number of well-established principles that have evolved over time, as well as structured, yet flexible, frameworks for risk assessment and management (Jardine et al. Citation2003). Although outside the scope of the present paper, an important aspect of any risk issue is problem formulation. Clearly defining the ultimate risk management objective can provide clarity on the most appropriate methods and data required for risk assessment, as well as risk management approaches and strategies (Paoli et al. Citation2022). Recently investigators determined the value of information (VOI) analysis by Price et al. (Citation2021) and Hagiwara et al. (Citation2022) which support problem formulation by examining whether additional information that might be collected to fill important data gaps might help to address ultimate risk management objectives.

In this review, 10 fundamental principles that decision-makers might apply when confronted with difficult risk decisions were consolidated. These principles are summarized in and elaborated upon below. It is acknowledged that this collection of principles is not exhaustive and a summary of additional principles relevant to risk decision-making was included in the Supplementary Material, where it is argued that many of these additional principles may be subsumed or made redundant by those outlined below.

Table 1. Principles of Risk Decision-making

P1. Risk-based decision-making

The principle of risk-based decision-making (RBDM) focuses on risks about which there is relatively little uncertainty and which may be modified in a cost-effective manner (Macesker et al. Citation2002). RBDM seeks to allocate finite resources in a manner that optimizes the return on investment in risk management. According to Custer and Janssen (Citation2015, pp. 2040), “assessing risk, and the costs and benefits of mitigating risk, should go hand in hand and serve as complementary evidence in RBDM”. Applications of the RBDM principle in food, agricultural, environmental and medical risk issues have recently been discussed by Morgan, Crawford, and Kowalcyk (Citation2021).

Evidence-based toxicology is a movement that complements RBDM by (1) identifying the best use of scientific evidence for toxicological interpretation, (2) maximizing the quality of results and thus (3) facilitating the RBDM process. This movement is closely associated with that of evidence-based medicine (Hoffmann and Hartung Citation2006): evidence-based risk assessment has been successful, as demonstrated by management of some forms of environmental pollution (See RC1: ambient air pollution). Krewski et al. (Citation2022) recently proposed a framework for evidence-based risk assessment, taking into account multiple evidence streams, including human, animal and mechanistic evidence: looking to the future, new approach methodologies (Krewski et al. Citation2010, Citation2019) developed for chemical risk assessment might provide new types of evidence that might be utilized to further strengthen the evidence base on which risk decisions may be made.

Fundamental to the principle of risk-based decision-making is consideration of the weight of evidence (WoE) supporting a causal relationship between exposure and outcome. Rhomberg et al. (Citation2013) provide a comprehensive review of over 50 WoE frameworks that have been proposed in the literature. More recently, the International Agency for Research on Cancer (IARC) updated its Preamble to the IARC Monographs (Baan and Straif Citation2022), which includes detailed guidance on integrating evidence from multiple evidence streams in identifying agents that induce cancer in humans (Samet et al. Citation2020).

P2. Precautionary principle

The precautionary principle (PP) reflects a “better safe than sorry” conceptualization of risk management and is widely cited in risk management and policy debates (Government of Canada Citation2003; Grandjean Citation2004). Although currently more than 18 definitions of PP exist, the guidance provided by these iterations is generally rooted in Principle 15 of the 1992 Rio Declaration on Environment and Development (United Nations Citation1992, 3):

Where there are threats of serious or irreversible damage, lack of full scientific certainty shall not be used as a reason for postponing cost-effective measures to prevent environmental degradation.

This is the version proposed to be used here. The most important aspect of this and many other versions of the principle is that, unlike RBDM, scientific uncertainty should not preclude risk management interventions for risks that may have serious, even catastrophic, consequences if left unattended. Similar to RBDM, however, PP also recognizes that risk management resources are finite and that expenditures on a risk that may not materialize consume resources that could otherwise be applied toward the reduction of more certain risks. Thus, PP also emphasizes the importance of cost-effective risk management action (Jardine et al. Citation2003). Given this, it would be incorrect to suggest that risk management action motivated by PP cannot also be risk-based. Rather, invoking PP avoids complete inaction in risk contexts where scientific uncertainty may be inherent or unavoidable, as long as cost-effective options are available.

P3. Balancing of benefits and risks

Trade-offs in life are inevitable, and many risks also carry significant benefits. The personal automobile, which is responsible for an estimated 50,000 annual deaths due to roadway accidents in North America (OECD/ITF Citation2015) as well as many other serious risks such as ambient air pollution, also carries significant benefits, including both economic benefits accruing to the automobile industry and lifestyle benefits to the driver and passengers. Economists have developed sophisticated methods that assign economic values to both risks and benefits, which are then used to calculate a benefit-risk ratio. If this ratio is greater than one, the benefits exceed the risks resulting in greater good than harm being done overall. Challenges in operationalizing benefit-risk analyses (BRA) arise as a result of the requirement to place a monetary value on non-marketable goods, such as (1) health gain or loss, (2) environmental damage or loss, and (3) quality-of-life concerns. The observed inconsistencies in such valuations underlie the difficulties with adopting such an approach (Agapova et al. Citation2014). Such approaches were also criticized for demoting ecosystem or human health from the realm of specially valued things to mere commodities (Kelman Citation1981) and for distinguishing between benefits to the environment and human health rather than shared well-being (Rea and Munns Citation2017).

The benefit-cost ratio may be employed to inform risk management decision-making, wherein risk management action is warranted when the ratio is greater than one, as the societal benefits outweigh the risks of that action (Braathen, Lindhjem, and Navrud Citation2009). In reality, BRA is viewed as a decision-support tool, which although helpful in comparing risks and benefits on a common (usually monetary) scale, fails to account for relevant socio-political considerations (see P5 on risk tolerance) and distribution of benefits and risks among individuals and groups (see P7 on equity). Further, the benefit-risk approach assumes an unconstrained risk management budget, a notion inconsistent with finite budgetary resources.

P4. Cost-effectiveness

Invoking the principle of cost-effectiveness (CE) directs the risk manager to consider both allocative and technical efficiency, seeking to invest available resources for risk management with the aim of reaching a specific social objective such as minimizing expected risk. Although economic efficiency in risk management is clearly a desirable goal, strict application of the CE principle would ignore other principles, such as the precautionary (P2) and zero-risk (P6) principles.

It has been argued that application of cost-effectiveness as the sole principle might result in all available risk management resources being applied toward that risk with the lowest CE ratio (cost divided by the specified reduction in risk), to the exclusion of other risks with less favorable CE ratios that also warrant attention (Weinstein and Stason Citation1977). However this is a highly unlikely scenario, given that diminishing marginal returns might occur with respect to investing in efforts to address a specific risk.

P5. Risk tolerance

Since the complete elimination of risk will not be feasible in most risk decision contexts, some level of risk will remain even after appropriate risk management interventions have been implemented (Hunter and Lorna Citation2001), a reality underscored by Lowrance and Klerer (Citation1976) in their pioneering text on Of Acceptable Risk. Certain U.S. regulatory statutes suggest a target level of risk, typically in the range of 10−5 to 10−7 over the course of a lifetime that might be considered de minimus and not warranting further often highly cost-ineffective risk reduction (Castorina and Woodruff Citation2003).Footnote1 This does not imply that such residual risks are necessarily ‘acceptable’; rather, these are benchmarks for what constitutes a reasonable level of risk beyond which it is difficult to justify further remedial action from a societal perspective. At the same time, such statutes do not discourage the pursuit of the ultimate goal of zero risk (next), should this be practically achievable in a cost-effective manner (Hsu and Stedeford Citation2011). It is also important to note that, while thresholds for acceptable risk will vary among risk contexts, with offsetting benefits often increasing risk tolerance, perceptions of risk levels and potential benefits may also vary based upon the attributes of that risk scenario (Fischhoff, Slovic, and Lichtenstein Citation1979).

Another practical approach to determining risk tolerance is provided by risk assessment matrices, which combines information on probability and severity to identify risks of lower or higher concern, typically expressed in the form of a two-dimensional matrix representing various combinations of probability and severity (Bao et al. Citation2017; Jensen and Hansen Citation2020). A priority risk issue, of both high probability and severe impact, needs to be addressed with more urgency than other issues represented in the matrix.

P6. Zero risk

The principle of zero risk sets the complete elimination of risk as the risk management objective. Indeed, surveys of societal attitudes toward risk management have consistently shown that a significant proportion of the Canadian public (40–60%) believes that a risk-free environment is an attainable goal (Krewski et al. Citation2008), despite such a goal being attainable only in limited circumstances. Despite the desirability of zero risk, the complete elimination of risk is generally not possible. Nonetheless, the zero-risk principle is useful in several respects. First, in some cases such as the banning of a risky consumer or therapeutic product it is possible to eliminate risk. Second, even when risk cannot be eliminated, the ultimate goal of zero risk provides an ideal to strive for over the long term, even if it is never fully achieved. Third, the quest for zero risk can be technology-forcing, leading to innovative and cost-effective incremental reductions in risk (Berthoud Citation2014). Although the zero risk principle P6 can be viewed as a special case of P5 in which risk tolerance is set to zero, the concept of zero risk is presented as a separate principle for these reasons.

P7. Risk equity

Risk decisions should be fair and equitable, without disproportionately affecting population subgroups (Adler Citation2008); ideally, both risks and benefits of risk management actions need to be shared in an equitable manner (Benn, Dunphy, and Martin Citation2009; Viscusi Citation2000). Farrow (Citation2010) argues that distributional aspects of risk decisions warrant more attention, including decisions motivated by benefit-cost analysis which may be used in balancing risks and benefits under P3. Focusing on risk management actions that will do the greatest good for most individuals will maximize societal benefit, and avoid expenditure of limited risk management resources on unimportant risks (Zeckhauser and Viscusi Citation1996).

Risk decisions should reflect social, cultural, environmental, economic, legal and other values, which may raise concerns over whether such decision processes and/or decisions favor certain individuals or groups over others (Keller and Sarin Citation1988). This principle therefore implies that risk decisions need to incorporate elements of procedural and distributive fairness to all concerned.

The environmental justice movement that started in the 1960ʹs, partially driven by increasing awareness of environmental inequity of minority and low-income populations, provides useful context for the principle of risk equity. The term ‘environmental racism’ was used to point out that these groups were being exposed to higher levels of pollutants and toxins, increasing their risk burden compared to the general population. In 1994, President Clinton signed the executive order named, “Federal Actions to Address Environmental Justice in Minority Populations and Low-Income Populations,” which legislated environmental protection for all communities (Bowen et al. Citation1995; Ewall Citation2012). The U.S. EPA: Environmental Protection Agency (Citation2017) defines environmental justice as:

“… the fair treatment and meaningful involvement of all people regardless of race, color, national origin, or income with respect to the development, implementation, and enforcement of environmental laws, regulations, and policies. EPA has this goal for all communities and persons across this Nation. It will be achieved when everyone enjoys the same degree of protection from environmental and health hazards and equal access to the decision-making process to have a healthy environment in which to live, learn, and work.”

While disadvantaged groups often face increased barriers to participation, a “double jeopardy” is faced with evidence that disadvantaged groups often face higher adverse exposures while also being more susceptible to these exposures because these individuals face, among other things, a myriad of other risks due to higher workplace exposures, greater levels of psychosocial stress, and enhanced prevalence of chronic diseases (Institute of Medicine Citation1999).

In considering this principle, it follows that disadvantaged individuals or groups need not bear a disproportionate burden of risk, nor a disproportionate share of the cost of risk reduction. Invoking the principle of risk equity in the management of risk might involve balancing considerations of individual and collective ethics in striving to achieve an equitable distribution of risks and benefits through fair and effective risk management choices.

P8. Stakeholder engagement

Democratic societies will immediately recognize the importance of stakeholder engagement in risk decisions. Effective stakeholder engagement in risk management requires subject matter competence in addition to more generalist abilities; and the process needs to be formal, open, and well managed. Appropriate stakeholder engagement may vary for each risk context, with best practices identified and promoted by scholars and practitioners alike (IAP2: International Association for Public Participation Citation2021; Webler and Tuler Citation2021).

Stakeholder involvement might also serve to identify novel approaches to risk management, which may not otherwise have been considered. Involvement of interested and affected parties might build support for (and acceptance of) the ultimate risk management interventions. Considered best practice, a list of stakeholders might include internal, external, community, practitioner, industry, multi-levels of government, and international regulatory bodies. Many risk assessment and management frameworks specify stakeholder involvement throughout the process: examples of this are illustrated in many of the published risk assessment and management frameworks, such as the 2009 Science and Decisions framework NRC: National Research Council Citation2009) the 2007 NRC vision for a new toxicity testing framework (NRC: National Research Council Citation2007), toxicity testing in the 21st century (Krewski et al. Citation2010) the 2014 EPA NexGen framework (Krewski et al. Citation2014), and the International Risk Governance Council (IRGC) Risk Governance Framework (IRGC: International Risk Governance Council Citation2017).

P9. Openness and transparency

With information becoming freely available almost as quickly as it is generated, the public has become increasingly-sophisticated in its efforts to understand the process of risk assessment and management, and more willing to question the underlying basis for risk decisions. Being aware of the importance of modern communications and legitimate demands by public interest groups for more information on risk issues of concern, government agencies responsible for risk management are expected to operate in a more open and transparent manner than ever before. With an emphasis on both ease of access and the fullest possible disclosure, stakeholder engagement with open and transparent processes are key to developing overall trust, credibility and support for decision-making. Many democratic countries have official websites documenting decision-making for government agency rules including proposed rules, public notices and invitations for public comment, including the Federal Register (https://www.federalregister.gov/) in the United States and the Canada Gazette (http://www.gazette.gc.ca/gazette/home-accueil-eng.php) in Canada.

P10. Flexibility

The accelerated pace of knowledge development including scientific evidence on the wide range of risks faced in our daily lives resulted in a need for flexibility in risk decision-making as new risk information becomes available; this often requires enhanced stakeholder engagement. The accumulation of new scientific knowledge might lead to adjustments in, and possibly even reversal of, previous risk decisions. An example of the latter outcome is the saccharin case discussed in RC2. Although research demonstrated that saccharin usage was safe in humans following its ban as an artificial sweetener in 1977, it has proven difficult to reinstate the use of a previously-banned product because of lingering adverse publicity (Harrison and Hoberg Citation1994). In contrast, the teratogen thalidomide, originally used for the treatment of morning sickness during pregnancy in the 1950s and 1960s, and then banned because of disabilities in babies born to mothers taking the drug, is currently indicated as a treatment for leprosy and chemotherapy-induced nausea and vomiting (Mayo Clinic Citation2022). However, its efficacy and safety continue to be evaluated (Wang et al. Citation2020).

A risk management approach or framework needs to be flexible and responsive to changing dynamics and risk levels, but this may be challenging in practice. For example, Saunders-Hastings and colleagues (Citation2018) noted that a weakness of the Canadian response to the 2009 influenza pandemic was the inability to scale the intensity of the risk management response up and down in line with transmission patterns. With the outbreak of COVID-19 in 2019, intense efforts to develop and deploy an effective vaccine against the SARS-Cov2 virus (Ball Citation2020) were instrumental in reducing the number of serious (including fatal) cases (Watson et al. Citation2022).

Other principles

A review of the literature on risk decision-making identified a number of principles beyond the 10 major principles listed above. For example, the ALARA principle (as low as reasonably achievable) is widely used in radiation protection to limit human exposure to ionizing radiation: ALARA is closely related to the risk tolerance principle (P5) discussed above. BATEA (best available technology economically achievable) is similarly employed to encourage the use of advanced technology for risk reduction, with consideration of costs; the guidance provided by this principle is similar to the cost-effective (P4) and zero-risk (P6) principles discussed above. These and other more focused decision-making principles are discussed further in the Supplementary Material.

Application in different risk decision contexts

Different principles might legitimately suggest different risk management trajectories. In this section, it was of interest to determine which principles of risk management would be most relevant and appropriate in different risk decision contexts. Ten risk contexts, RC1 through RC10, are discussed in detail below. These examples were selected to represent a diverse range of complex real-world challenges, including environmental pollution, food additives, therapeutic products, genetic modification, resurgent and emerging pathogens, and natural disasters. These examples will be used to illustrate the application of the 10 risk decision principles introduced above and to explore attributes of risk decisions that may favor the application of some principles over others.

The final three principles (P8, P9, P10) are somewhat universal and as elements of functioning democracies apply in most risk contexts. Active stakeholder engagement (P8) is important to ensure that the views of all segments of society are represented. Openness and transparency of the decision-making process (P9) is needed to foster informed decision-making by individuals and stakeholder groups. Finally, risk decisions need to be flexible (P10), adapting to new evidence as it becomes available (Jardine et al. Citation2003). Although the final 3 principles are expected to apply in virtually all risk contexts, there may be exceptions such as the need for discretion in addressing bioterrorism risks in which these principles may not be evoked.

RC1: Ambient air pollution (P1, P3-P5, P7, P8-P10)

Epidemiological and toxicological studies implicated ambient air pollution as an important cause of adverse health effects in the population (Costa et al. Citation2014; WHO Citation2021), reducing life expectancy by an average of 9 months in the European Union (EU). The effects of particulate matter (PM) are well documented (Chen, Chen, and Yang Citation2019; Eze et al. Citation2015; Schraufnagel et al. Citation2019; Tsai et al. Citation2022; Zhou et al. Citation2021). It has been estimated that the global fraction of adult mortality attributable to the anthropogenic component of PM2.5 is 8% (95% CI: 5.3–10.5) for cardiopulmonary disease, 12.8% (5.9–18.5) for lung cancer, and 9.4% (6.6–11.8) for ischemic heart disease (Evans et al. Citation2013). More recently, Burnett et al. (Citation2018) estimated that more than 8 million annual deaths are attributable to particulate air pollution worldwide.

In this context, the principle of risk-based decision-making (P1) is relevant, as there is a well-documented and well-quantified public health risk that needs to be addressed. The precautionary principle (P2) is not particularly relevant, as there is relatively little uncertainty regarding the health risks of particulate air pollution. Balancing of benefits and risks (P3) is relevant, as the benefit-cost ratio of 4:1, driven largely by an economic valuation of $7.4 M USD (EPA: Environmental Protection Agency Citation2011) for the loss of a single human life, indicates a highly-favorable return on pollution abatement investment Because of the large costs of pollution abatement, it is particularly important to seek efficient (cost-effective) interventions (P4) (WHO: World Health Organization Citation2016). The zero-risk principle (P6) is not particularly relevant in this context, as the complete elimination of ambient air pollution is unachievable, even at an infinite cost. Even if one was able to eliminate all anthropogenic sources of pollution, natural sources such as dust from the Sahara Desert, which is transported worldwide, would remain. Recognizing this, some level of risk needs to be tolerated (P5) as one moves toward but never achieves the idealized goal of zero risk. Risk mitigation efforts might also need to respect the principle of equity among different segments of society (P7), avoiding situations where the benefits accrue to one segment of the population at the expense of another.

The dominant principles in this risk context are likely to be P1 (risk-based), P3 (balancing benefits and risks) and P4 (cost-effective), leading to reduced air pollution levels globally over time in a rational and efficient manner.

RC2: Artificial sweeteners (P6)

Artificial sweeteners have been used to reduce the caloric content of food for over a century. When saccharin was found to produce malignant urinary bladder tumors in a series of two-generation studies involving Sprague-Dawley rats fed up to 7.5% saccharin in their diets, the U.S. Food & Drug Administration (FDA) quickly moved to ban the use of saccharin as a direct food additive in 1977. The ban was subsequently superseded by a series of moratoriums imposed by the U.S. Congress, which has permitted the limited use of saccharin through to the present. This action was consistent with the 1958 Delaney Amendment to the U.S. Food, Drug & Cosmetic Act, which bans the use of carcinogenic food additives such as certain artificial sweeteners or food colors. This amendment overrides the principle of balancing benefits and risks, on the grounds that no organoleptic benefits of direct food additives might offset a cancer risk (FDA: United States Food and Drug Administration Citation2014). In this case, banning a food additive that does not occur naturally in the food supply achieved the ideal goal of zero risk (P6).

Even after the modification of the saccharin ban, the debate over the safety of saccharin has continued. While evidence of an association between saccharin and bladder cancer in humans was found in subsequent epidemiological studies, the results were inconsistent (IARC: International Agency for Research on Cancer Citation1999). The highest doses used in the animal studies (equivalent to consuming several hundreds of bottles of artificially sweetened soft drinks per day) challenged the conclusion that these outcomes reflected human risks. This debate was ultimately resolved when it was demonstrated that the urinary bladder neoplasms in rats exposed to high doses of saccharin were due to the formation of microcrystals in their urine, an effect that would not occur at lower human exposure levels (Cohen Citation1986). Although P10 (flexibility in decision-making) would suggest that the ban on saccharin might be reversed in light of this evidence of safety, there is reluctance to lift the ban on a product that was previously considered to be dangerous.

The saccharin case also illustrates the issue of assessing the risks of substitutes (NRC: National Research Council Citation2014). Saccharin was largely replaced by the approval of aspartame as an artificial sweetener in 1981 (Murray Citation2002). Despite extensive pre-market safety testing, there still remain concerns regarding possible brain cancer risks associated with the consumption of aspartame (Weihrauch and Diehl Citation2004).

RC3: Climate change (P2, P4, P7, P8-P10)

In 1957, oceanographer Roger Revelle and chemist Hans Suess (Citation1957) published what has been called the most famous sentence in the literature on global warming: “Human beings are now carrying out a large scale geophysical experiment of a kind that could not have happened in the past nor be reproduced in the future.” The risk factor in this ‘experiment’ is known as positive radiative forcing, measured in units of watts per square meter, which is the difference between the amount of energy in sunlight striking the earth’s surface less the amount that is re-radiated back into space. The composition of the earth’s atmosphere, in particular the gases methane, carbon dioxide, and nitrous oxide, traps some of this energy, leading to the so-called ‘greenhouse effect.’ The concentrations of those gases in the atmosphere are considered to be the primary driver of the recent rise in global average temperatures.

Since this statement by Revelle and Suess, there has been increasing consensus on the contribution of human activity to global change. The Intergovernmental Panel on Climate Change (IPCC) reiterated in their Fifth Assessment Report that the effects of increases in anthropogenic greenhouse gases (GHGs) since the pre-industrial era, “together with those of other anthropogenic drivers, have been detected throughout the climate system and are extremely likely to have been the dominant cause of the observed warming since the mid-20th century” (IPCC Citation2014a, pp. 151). The Fifth Assessment Report also states: “About half of the cumulative anthropogenic CO2 emissions between 1750 and 2011 have occurred in the last 40 years (high confidence)” (IPCC: Intergovernmental Panel on Climate Change Citation2013, 1535). This recognition has resulted in several targeted efforts and policy directives aiming to curb anthropogenic influence, including the United Nations Framework Convention on Climate Change (UNFCCC) Kyoto Protocol (which came into force in 2005) and the UNFCCC Paris Agreement (which came into force in 2016).

The chief policy goals in addressing climate change are first to stabilize concentrations of GHGs in the atmosphere (that is, ending the annual increases), and then to achieve a steady decrease in those concentrations. The Paris Agreement objectives are to limit the increase in global average temperature (relative to pre-industrial levels) to no more than 2°C, and preferably no more than 1.5°C, through the period of this century. The main adverse effects which the climate change policy goals seek to avoid or mitigate include: sea-level rise, temperature increases, ocean acidification and increasing storm severity, which would lead to impacts on agriculture, forests and marine life, including droughts, flooding, and storm damage. Since a large percentage of the human population currently lives at or near present sea levels, failure to prevent or mitigate these adverse effects could have profound consequences. Recent literature has begun to sharply reduce the timelines within which GHG emissions reductions must commence to avoid surpassing these thresholds (Goodwin et al. Citation2018a, Citation2018b). Further, because of inertia built into the climate and carbon cycle, “increased atmospheric concentration due to past emissions will persist long after emissions are ceased,” and “much of the warming would persist for centuries after greenhouse gas emissions have stopped” (IPCC: Intergovernmental Panel on Climate Change Citation2014b).

The IPCC Sixth Assessment Report (2022) describes global and regional risks for increasing levels of global warming: “Near-term actions [through 2040] that limit global warming to close to 1.5°C would substantially reduce projected losses and damages related to climate change in human systems and ecosystems, compared to higher warming levels, but cannot eliminate them all (very high confidence)” (IPCC: Intergovernmental Panel on Climate Change Citation2022, pg. 15). For the medium and long term (2041–2100), “The magnitude and rate of climate change and associated risks depend strongly on near-term mitigation and adaptation actions, and projected adverse impacts and related losses and damages escalate with every increment of global warming (very high confidence)” (IPCC: Intergovernmental Panel on Climate Change Citation2022, pg.16).

The challenge to realizing policy goals include, above all, the willingness of individual nations, particularly the major emitters of GHGs (China and the United States), to adopt and enforce firm, consistent targets for ceilings and reductions on GHG emissions over the long term, and for the global community of nations to cooperate in this venture. Leiss et al. (Citation2020) examined the gap between science based GHG emission reduction targets and inadequate results of multi-decade international treaty negotiations. Current nationally determined contributions under the Paris Agreement remain shy of the 2030 emissions reductions target and the longer history of ‘action’ on climate change indicates that a considerable period will elapse until the challenges are addressed. In the meantime, global emissions continue to rise, and the inertia of excessive radiative forcing is still pushing the achievement of the chief policy goals far into the future. This situation has prompted some to advocate for geoengineering solutions such as the long-term dispersal of sulfate aerosols into the upper atmosphere, mimicking the effects of volcanic eruptions though this strategy has important uncertainties associated with it, with carbon sequestration, solar radiation management and the removal of carbon dioxide from the atmosphere often viewed as preferable alternatives (Keith et al. Citation2016).

Whether or not global cooperation to reduce greenhouse gas emissions is successful, it is likely that climate change impacts will pose serious and varied threats to public health. Worsening air pollution, extreme weather and reduced crop productivity have already been observed and are likely to continue. The potentially catastrophic implications of climate change suggest that a precautionary, risk-averse approach to management is urgently required (P2), even in the presence of scientific debate regarding the scale and severity of consequences. It is likely, however, that the most successful and sustainable risk management strategies will be those that are cost-effective and anchored in current economic realities (P4); those that are not may be viewed as environmentally-necessary but may be socially or politically unacceptable. In addition, as it is well-understood that vulnerable groups are often the most susceptible and least able to adapt to the consequences of climate change, considerations of where the health burden lies and how resources might be most equitably distributed are essential in risk management efforts (P7). Lastly, the complex, long-term and geographically-variable nature of climate change and its impacts suggests that principles of stakeholder engagement (P8) and transparency (P9) are necessary to design risk management strategies which are globally meaningful, locally relevant, effective and acceptable. As a point of no return is rapidly approaching in mitigating climate change (Leiss et al. Citation2020), it is unclear the extent to which one has the luxury of flexibility (P10) in addressing this global risk issue.

RC4: Nanotechnology (P1, P2, P3, P8-P9)

Nanotechnology is concerned with the design, synthesis, and characterization of materials and devices that are at the nanometer scale (a nanometer is one billionth of a meter). Nanotechnology promises a plethora of benefits to society with the potential to greatly enhance population health through applications of the technology (Kermanizadeh et al. Citation2016; EPA: United States Environmental Protection Agency Citation2005).

Nanomaterials (NM) are a diverse group of chemical compounds that include carbon nanotubes, carbon nanoparticles, inorganic and organic dendrimers, nanoparticles (NP) conjugated with various metals or other materials (antibodies, deoxyribonucleic acid), nano-size polymers (termed dendrimers), and composite materials (NP combined with larger materials). The ability to engineer self-assembling (i.e., self-organizing) substrates at the nanoscale produces macroscopic physical and/or chemical properties that their bulk material counterparts do not possess (Silva Citation2005). These NP may demonstrate new physico-chemical properties and show markedly different toxicities due to quantum effects.

Roco (Citation2004; Citation2006) outlined four generations of nanotechnology development. The current, first generation is comprised of passive nanostructures or NM designed to carry out a single function. It includes NM incorporated into paints, coatings, emulsions, cosmetics and lubricants. The NP are designed to increase or alter specific physical properties such as hardness, durability, anti-oxidation capability, tribological characteristics including reducing friction, decreasing wear, and anti-corrosion, thermal properties, and conductivity.

The second generation of active nanostructures will introduce multi-step reactions at the nanoscale with NP that combine a limited number of chemical steps or reactions. For example, multistep drug delivery devices and multistep sensors. The third-generation nanotechnology will feature more complex, active nanosystems with several interacting reactions creating higher order complexity. The fourth generation of active nanotechnology is predicted to have hierarchical nanosystems functioning and rivaling that of living cells in their complexity.

Research has established that some types of NM may be highly toxic to living systems, thereby adversely impacting both human health and the environment. Other types of NM are seemingly inert. Concerns about the toxicity of NP in the environment include assumed persistence, high bioavailability of certain NM, and bioaccumulation in plants, insects, animals and humans. There is uncertainty regarding the ability of various NP to chemically interact with common compounds already present in the environment that might, in theory, alter the toxicity of either interacting component.

The toxicity of anthropogenic NP is exacerbated by the types and amounts now being manufactured which may lead to increased potential for risk (Moore Citation2006; Mouneyrac, Syberg, and Selck Citation2015). For first generation nanotechnology, adverse health and environmental effects of man-made NP in the environment have already been substantiated. Specifically, research with some types of dispersed nanosized particles demonstrated that these are highly toxic to fish in aquatic environments and to animals when ingested, inhaled or via dermal contact under certain conditions (Abbas Citation2021; Cazenave et al. Citation2019; Egbuna et al. Citation2021; Kermanizadeh, Powell, and Stone Citation2020; Oberdörster, Oberdörster, and Oberdörster Citation2005; Senel Citation2021). The toxicity depends upon some properties of the NP including the nature and size, surface area, shape, aspect ratio, surface coating, crystallinity, dissolution, and agglomeration (Egbuna et al. Citation2021).

New NM present challenges to toxicity testing that may not be easily addressed with existing risk management approaches (Institutes of Medicine, Citation2005). Nanoparticle pathways and entry exposure routes into the body requires further research to inform policy makers and regulatory organizations regarding the toxicological potential of certain NM (Elsaesser and Howard Citation2012; Kermanizadeh, Powell, and Stone Citation2020). Further, the potential for deleterious effects from NM has led to calls for more research on the toxicology of NP by the public, scientific community, and other stakeholders (Colvin Citation2003; Kamali, Khodaparast, and Seifi Citation2013; Service Citation2005; Zhang et al. Citation2021). To address the potential risks current chemical and particulate material regulations, and regulatory frameworks, need to be modified to encompass the uniqueness presented by NM exposure hazards (Tyshenko and Krewski Citation2008).

As nanotechnology develops through successive generations it is expected to undergo vigorous development with applicability to a myriad number of sectors. However, in view of the potential risks presented by nanotechnology’s uncertain advancement, potential synergistic exposures to NP and ubiquity in the environment, it is important to balance economic interests against societal concerns as the technology develops (P3) (Hutchison Citation2008; Sparrow Citation2009). The risks associated with the products of nanotechnology and the trajectory of nanotechnology’s development need to be carefully managed with inclusion of the engagement of stakeholders (P1, P8) (Tyshenko and Krewski Citation2008).

The safest option for nanotechnology’s anticipated future development through the various increasingly complex generations would be the adoption of a precautionary approach that is both inclusive and transparent (P2, P8-P9) (Tyshenko et al. Citation2010). There are two main reasons to consider using a precautionary approach for NM. First, the enormous number of NP each with their different properties such as shape, size, material, functionalities, processes of manufacture, and applications makes it difficult to standardize and adopt a universal measurement method for toxicity (Ramanathan Citation2019). Secondly, uncertainty of active nanotechnology application development going forward in time suggest an increasingly precautionary approach is concomitantly needed at each successive generation of nanotechnology for effective risk management (P2) (Tyshenko et al. Citation2010).

The United Kingdom Royal Society report recommended a precautionary approach with regards to NP: exposure to certain types of NP needs to be avoided or limited with occupational precautions until more is known regarding the environmental and health impacts (UK Royal Society and the Royal Academy of Engineering Citation2004). Risk assessment and management frameworks and strategic plans for NP oversight were proposed (IRGC: International Risk Governance Council Citation2007; Tyshenko and Krewski Citation2008; EFSA Scientific Committee Citation2021a; Citation2021b; U.S. National Science and Technology Council, Citation2021). Additional nanotoxicity research may help to inform efforts to establish standardized regulatory frameworks with the goal of fully exploiting the potential of nanotechnology while minimizing harm to humans (P3). As our understanding of the risks and benefits of this technology matures, greater emphasis may be placed on other risk decision principles, including risk-based decision making (P1) and balancing of risks and benefits (P3).

RC5: Chemotherapeutic agents (P3, P4, P5, P9)

Chemotherapeutic agents used to treat a range of cancers are potent drugs designed to destroy malignant cells. Although such agents target abnormal cells involved in malignant transformation, many chemotherapeutic agents are genotoxic and present a risk of secondary cancers (Sak Citation2012). Estrogen-targeted therapies employed to treat breast cancer may also enhance the risk of serious cardiovascular complications, including heart failure and myocardial infarction (Valachis and Nilsson Citation2015). A decision to take a potentially life-saving drug that might result in serious or even fatal side effects involves a balancing of risks and benefits (P3) taken by the patient in consultation with his or her physician and a tolerance for a certain level of risk (P5). Benefit-risk considerations are particularly appropriate here, as the risks and benefits are borne by the patient and might be made with personal values of the patient as key decision criteria. Further, given the increasing role that consideration of cost-effectiveness plays in terms of reimbursement decisions in relation to health technologies for most publicly-funded health care systems, the principle of cost-effectiveness (P4) is also relevant to this context.

Stakeholder engagement (P8) has not been identified as relevant to RC5, since the patient is essentially the sole stakeholder. The requirement for informed patient consent corresponds more closely to the principle of openness and transparency (P9). Although changes in therapeutic regimen may be viewed as demonstrating flexibility, P10 has not been invoked in this risk context since it pertains more to flexibility in clinical practice than it does to the choice of risk management strategy.

Other medical interventions, notably vaccines, may also involve benefit-risk considerations at the societal as well as the individual level (P3). This is due in large part to ‘herd immunity,’ wherein changes in individual immunity status might have important implications for pathogen transmission dynamics and human health outcomes at the population level (Metcalf et al. Citation2015). Vaccine hesitancy, a behavior manifested among a minority of the population, may reflect a personal view that the risks of vaccination outweigh the personal benefits, in conflict with public health recommendations for standard vaccination protocols for children for diseases such as measles and polio (WHO: World Health Organization Citation2016).

RC6: Natural disaster (extreme weather events) (P2, P4, P7, P8-P10)

Global climate change is expected to increase the frequency and severity of extreme weather events. These weather events have a range of direct and indirect health effects. A well-known and extreme example is the 2005 occurrence of Hurricane Katrina, which caused over 1,100 deaths in Louisiana (Jonkman et al. Citation2009). Severe health consequences have also been associated with ice storms such as the 1998 storm in Eastern Canada (Hartling, Pickett, and Brison Citation1999), tornados (Bourque et al. Citation2007) and extreme precipitation and flooding (Erickson et al. Citation2019; Jagai et al. Citation2015). Other examples include the damage produced by the 2017 Hurricane Maria in Puerto Rico Zorrilla Citation2017) and the cholera outbreak produced by the 2019 Cyclone Idai in Mozambique (Gruenbaum Citation2019). More recently, mental and physical health impacts associated with the 2021 British Columbia heat dome are beginning to be identified (Bratu et al. Citation2022). In each case, a large proportion of health consequences are the result of indirect or secondary impacts on infrastructure and human behavior, presenting important intervention points for risk reduction (Hales, Edwards, and Kovats Citation2003).

Despite improvements in early warning weather systems, a high degree of uncertainty still exists regarding the timing, location, severity and impacts of extreme weather events. The overall burden will be context-dependent, with consequences being exacerbated by weak health systems and response capacity (Austin et al. Citation2015). In addition, there is uncertainty in projections for future climate change (Klima and Jerolleman Citation2014). Considering the potential for a public health emergency to result from an extreme weather event, the precautionary principle (P2) will have relevance to natural disaster risk reduction efforts when there is insufficient evidence to invoke risk-based decision-making (P1).

A review of the health effects of extreme weather events found that much of the associated health burden is linked to five secondary impacts on infrastructure and human behavior (Toronto Public Health Citation2016), specifically: (1) loss of power, (2) essential service disruption, (3) evacuation, (4) improper use of fuel-burning equipment and (5) unsafe cleanup activities (Arrieta et al. Citation2009; Goldman et al. Citation2014; Johnson-Arbor, Quental, and Li Citation2014). Data suggest that a small number of causal nodes drive a substantial proportion of the associated health impact, presenting a pathway for cost-effective policy intervention. An effective strategy for dealing with the inherent uncertainty in climate resilience decision-making is to pursue “no regrets” strategies, which deliver a range of co-benefits beyond climate resilience which encourages the most effective and impactful use of resources (Hay and Mimura Citation2010). The key risk management principle underlying this strategy is that of cost-effectiveness (P4). In the case of extreme weather resilience, promotion of risk management focusing on the five identified causal nodes might form the foundation of an effective strategy.

Certain population groups are particularly vulnerable to experiencing a disproportionate health burden during and immediately following an extreme weather event; these include infants and children, women, the elderly, those with preexisting conditions, low-income or homeless individuals, minorities, Indigenous Peoples and recent immigrants (Clean Air Partnership Citation2009; Health Canada Citation2005, Citation2008). As such, equity (P7) is an important component in developing effective extreme weather resilience and response strategies. That the most vulnerable groups tend to be similar across event types suggests that a focus on these populations will promote all-hazard preparedness and response capacity.

The finding that much of the indirect health burden associated with extreme weather events is associated with maladaptive human behavior suggests a strong need for improved engagement (P8) of the local population to improve adaptive capacity. Locally-relevant educational and advisory material, alongside the active engagement of community leaders, is essential to promoting individual and community disaster resilience (Cutter et al. Citation2008). Open and transparent communication (P9) is necessary to foster public trust, with flexibility (P10) needed to ensure a response proportional to the severity of the weather event.

In sum, uncertainty in the timing, location and severity of an extreme weather event points to the relevance of the precautionary principle (P2), while the commonality of causal nodes and vulnerable groups across weather events supports a strategic emphasis on cost-effective (P4) and equitable (P7) risk management policy.

RC7: Prion diseases (P1, P2, P8-P9)

Prion diseases are caused by a misfolded form of the prion protein, which leads to neurodegeneration through propagation of the misfolded form within neural tissue. Fatal prion diseases have been described in multiple species, including scrapie in sheep, bovine spongiform encephalopathy (BSE) or ‘mad cow disease’ in cattle, chronic wasting disease (CWD) in deer and elk, and variant Creutzfeldt-Jacob disease (vCJD) in humans. Prion diseases may be transmissible between species: for example, BSE is thought to have originated from the inclusion of sheep offal in the diets of cattle in the United Kingdom, with consumption of beef containing the BSE agent leading to the development of vCJD in humans. The outbreak of the BSE epidemic in the UK in 1986 spread to other countries, and enormous negative socioeconomic impacts in BSE-affected countries (Leiss et al. Citation2010). Human prion disease may be transmitted by blood transfusion. Infectious prion proteins were detected in fertility drugs from human urine, presumably arising from donors with asymptomatic vCJD (Van Dorsselaer et al. Citation2011). There remain concerns regarding species transmission of CWD from deer and elk to other cervid species, including caribou (Haley and Hoover Citation2015). There is also increasing evidence that propagated protein misfolding plays a role in other neurodegenerative diseases, including Alzheimer’s disease, Parkinson’s disease, and amyotrophic lateral sclerosis (Herms and Dorostkar Citation2016). At present, there are no effective medical interventions for prion diseases, although a promising vaccine against CWD is currently under development (Goñi et al. Citation2015).

A precautionary approach to prion disease risk management (P2) may be warranted to protect against the emergence of new prion diseases, including those generated through inter- and intra-species transmission. This concern is reinforced by the recent detection of a prion protein genotype (albeit one that reduced susceptibility to chronic wasting disease) among caribou populations in Alberta, Canada (Cheng et al. Citation2017).

For well-established prion diseases, however, the principle of risk-based decision-making (P1) is directly applicable, such as for BSE, CWD, and vCJD whose etiologies are now well-understood. This has been adopted internationally, through a geographically-based risk designation of countries as ‘controlled risk’ or ‘negligible risk’ by the World Organization for Animal Health.

Case studies of the management of BSE in different countries revealed varying degrees of stakeholder engagement (P8) and transparency (P9) by government officials, with Canada acting swiftly to disseminate all available information following the detection of the first domestic case in 2003, whereas Germany was slower to acknowledge the problem following the occurrence of BSE in 2000 (Leiss et al. Citation2010). Because of the significant health, environmental, and socioeconomic implications of prion disease outbreaks, there is limited flexibility (P10) in the application of stringent disease control measures.

RC8: Hydraulic fracturing (P1, P3, P4, P5, P7, P8–P10)

Unconventional tight reservoir formations in the sub-surface, including shales, mudstones, and tight sands, are a growing source of oil, natural gas liquids (NGLs), and natural gas. Further, the commercial extraction and increased use of natural gas, a fossil fuel that emits lower carbon dioxide quantities than oil or coal for equivalent energy delivery, is often viewed as an important transitional component of climate change mitigation through 2050, as the energy supply shifts toward renewable sources. This is deemed a critical period to advance the world’s energy supply to no or lower GHG-emitting energy sources.

Hydraulic fracturing (HF) has become the fastest-growing technological process to develop unconventional resources. Three countries extract unconventional gas resources, with the United States being by far the largest global producer of shale gas, tight gas, and coalbed methane (600 billion cubic meters (BCM)), and Canada then China ranking second and third (95 and 31 BCM, respectively) (IEA: International Energy Agency Citation2018). The principal countries currently extracting crude oil from tight formations (shale oil) with HF are the United States, producing approximately 6.5 million barrels/day (mb/d) (EIA: Energy Information Administration Citation2019) and Canada, producing approximately 350,000 b/d (National Energy Board Citation2018).

Risk management for HF is therefore positioned within a complex spatial framework where “governance (both the substance of the laws and the activities of entities that implement and influence these) is challenged by perceived regional or even global benefits of the technological process, compared with local adverse impacts that can be the purview of several layers of government” (Larkin et al. Citation2018). The broad categories of direct and indirect risks concern (1) land development and infrastructure to gain access to sites and for deliveries of materials; (2) geoscience of the formation; (3) use and disposal of water and spent fracturing fluids; (4) air emissions, with local and global implications; (5) prevailing social and economic cycles in the region, including cumulative effects; and (6) resident and worker health and well-being (Dusseault and Jackson Citation2014).

The years of experience in oil and gas development and ongoing enhancements to regulatory approval processes for HF projects in some jurisdictions (e.g., British Columbia and Alberta) (Larkin et al. Citation2018) point to risk-based decision making (P1) as the dominant risk management approach. HF is not a case for the zero-risk principle (P6); working in the sub-surface, in areas with unknown or abandoned wells, rejects the potential to reach this threshold.

During this decade, growing concerns for international energy security could be juxtaposed with stated greenhouse gas emissions reductions targets and goals to reach net zero emissions by 2050. This might affect risk tolerance (P5) for HF in terms of broad acceptance as opposed to a quantitative risk estimate. To date this appears to be dependent on the jurisdiction. For example, where HF is permitted in Canada, provincial energy policy includes a strategic role for natural gas development (Alberta Government Citation2008; Government of British Columbia Citation2007) and, in the case of British Columbia, also with a goal for LNG plant development for export to the Asian market (Government of British Columbia Citation2013) although progress to date on these initiatives has been limited. These overarching goals may affect whether or not regulators can achieve local social acceptance through risk management interventions in the sense that projects will be approved, regardless of the level of risk. The same is true in the United States, where individual landowners own the sub-surface rights and may therefore choose to permit HF activities even though a neighborhood or community may be opposed.

Other jurisdictions, meanwhile, have determined through public and expert consultation processes that P5 is unattainable (that is, that HF could not be implemented with a level of tolerable risk (Wheeler et al. Citation2015)). The inherent geoscientific complexity and uncertainty of this technology, combined with increased population density, has resulted in moratoriums (e.g., Nova Scotia, New Brunswick, Newfoundland, New York). Further, in the province of Quebec, ongoing uncertainty is evident in a changing position for HF indicating that the precautionary principle (P2) is also at play. For example, the province of Quebec lifted a 5-year moratorium for HF with the 2016 Act to implement the 2030 Energy Policy (National Assembly Citation2016). Then, a 2018 amendment to the Act proposed to ban HF, a proposal that died when a provincial election was called (Canada Energy Regulator Citation2021).

The principle of equity (P7) is applicable to HF, given the range of hazards and potential effects, both at the local and global scales. The activities, by definition, may unfairly impact some individuals or groups, particularly those living in proximity to the extraction operations, with benefits accruing to others. In addition, there is limited local or Indigenous authority to manage the risks of HF. As with the other risk contexts, the risk management principles related to democratization, stakeholder engagement (P8) and openness and transparency (P9), are applied but could yet be improved (Larkin et al. Citation2018).

In the case of HF, the balancing of benefits and risks (P3), social acceptance of tolerable risk (P5) and equity (P7), may not be achievable. The risks are to the local populations and the benefits are largely to others. This is because HF is based on numerous large multi-well pad developments, creating environmental and human health hazards for some, but mostly without major social or economic benefit. Providing compensation directly to local communities has been discussed (IRGC: International Risk Governance Council Citation2014).

The principles of cost-effective risk mitigation (P4) and flexibility (P10) are also relevant. While unconventional oil and gas have been extracted for several decades, HF is classified as an emerging technology precisely because new risk management options continue to be developed (Larkin et al. Citation2018), and the technology is novel to many jurisdictions. The proponents and regulators in active jurisdictions are attempting to mitigate environmental and human health risks of HF such that the above-noted concerns for risk tolerance, equity, and balance in benefits and risks, as well as stakeholder engagement and transparency, may continue to be alleviated.

RC9: Pandemic outbreak (P2, P3, P4, P5, P7, P8-10)

A global infectious disease outbreak, such as the recent COVID-19 pandemic caused by the SARS-CoV-2 virus, may exert enormous public health impact: as of this writing, the World Health Organization (Citation2022) estimates there have been over 545 million cases of COVID-19, and over 6 million deaths worldwide. Such outbreaks emerged as a result of an antigenic shift, wherein genetic components of viruses re-assort to produce a novel viral strain to which humans possess no appreciable immunity (Zambon Citation1999). If the disease can be transmitted easily between humans and manifest in diseases, a global pandemic may thus occur. Over the past one hundred years, the combined global burden of the 1918 Spanish flu, 1957 Asian flu, 1968 Hong Kong flu, and 2009 swine flu has amounted to tens of millions of infections, hospitalizations, and deaths, as well as billions of dollars in associated health and socioeconomic costs (Saunders-Hastings and Krewski Citation2016).

While the timing and characteristics of a global pandemic, particularly with respect to transmissibility and clinical severity, cannot be known in advance of emergence, the occurrence of the future pandemics are a virtual certainty. Because of the high uncertainty and high impact of global pandemics, preparedness efforts tend to favor the precautionary principle (P2) over risk-based decision-making (P1). The expectation of little lead time between emergence and local seeding of an outbreak indicates that interventions need to be implemented even in the absence of reliable epidemiological data charting the future course of the outbreak.

A pandemic has the potential to develop into a public health emergency where treatment resources become scarce. As such, there is a need to allocate resources in a manner that maximizes benefits and minimizes risks (P3) in a cost-effective (P4) way. However, ensuring an equitable distribution of these risks (P7) is crucial to an ethical pandemic response that fosters public trust, even where this may obstruct a maximally cost-effective strategy (Verweij Citation2009). Pandemic plans tend to emphasize the primary goal of saving lives (PHAC: Public Health Agency of Canada Citation2015), the most cost-effective approach to which tends to involve vaccination and other preventive efforts (Appleby Citation2020; Saunders-Hastings et al. Citation2016). While cost-effective prevention efforts are necessary components of pandemic preparedness, these should not be conducted at the expense of investment in treatment. Similarly, hospital triage protocols should promote the diversion of care to those in severe need that are most likely to recover, such as through restricting intensive care admission to those requiring mechanical ventilation, and potentially making resource-allocation decisions based upon likelihood of survival (Christian et al. Citation2006). However, this needs to be implemented in an open and transparent (P9) way alongside efforts to minimize service disruption altogether.

During the course of a pandemic, ‘zero risk’ (P6) is unlikely to be an attainable goal on a national, regional, or individual level. While protection from less transmissible and more clinically visible pathogens might be possible through border control and travel restriction measures, little evidence supports these control measures as being effective against influenza (Cowling et al. Citation2010; Yu et al. Citation2012), in part because individuals become infectious before they are symptomatic. Although travel restrictions were also implemented by many countries following the outbreak of COVID-19, simple public health measures, including handwashing, masking and social distancing, were seen to be effective in reducing the spread of COVID-19 (Talic et al. Citation2021). Challenges encountered in developing effective public health messaging in support of such measures, and in addressing vaccine hesitancy/refusal, underscore the need for effective public health communication to encourage uptake of good public health practices (Fullerton et al. Citation2022). A tolerable level of risk (P5) was being sought at public and organizational levels. Levels of tolerable risk are unclear and disputed, however, when taken in conjunction with the uncertain severity of future pandemics. This has important implications for trigger thresholds for emergency measures such as school and work closure. It might also impact levels of worker absenteeism, especially in essential, high-risk positions related to healthcare provision (Mitchell et al. Citation2012). Open and transparent (P7) stakeholder engagement (P8), combined with flexible response strategies that are agile to emerging data (P10), will be crucial to supporting a practical level of tolerated risk.

Risk management approaches to a pandemic outbreak tend to promote a utilitarian view that emphasizes benefit-risk considerations (P3). Massive government spending related to the COVID-19 pandemic also highlight the need for cost-effectiveness interventions (P4). While these are important components, it is necessary to consider the equitable distribution of risks and benefits (P7). A social gradient of risk was reported for influenza and should provide insight for targeted preparedness and response efforts (O’Sullivan and Bourgoin Citation2010). Most importantly, a lack of certainty should not prevent the implementation of intervention strategies to mitigate the potentially severe consequences of a pandemic outbreak (P2).

In the years ahead, research findings related to risk management of COVID-19 will attempt to shed light on a myriad of responses at the individual, public and organizational levels. New mRNA-based vaccines against COVID-19 developed in record time within a year of the outbreak of the pandemic in December, 2019 also raises questions of evaluating the risks of adverse effects of such vaccines (Alami et al. Citation2022) (P5), and of balancing the risks of vaccination against those of not being vaccinated (P3) (Wagner et al. Citation2021). Equity considerations (P7) also arise in ensuring vaccine access at the global, regional and local levels (Acharya, Ghimire, and Subramanya Citation2021; NASEM: National Academy of Sciences, Engineering and Medicine Citation2020).

RC10: Genetically modified foods (P1, P3–P5, P8–P10)

Genetically modified (GM) foods constitute a particularly controversial risk issue. GM foods include products “derived from crops bioengineered by recombinant deoxyribonucleic acid (rDNA) techniques” (Chao and Krewski Citation2008a, 208), reflecting products that have undergone changes to their DNA through a process called genetic engineering.

Concern likely arises from differential perception, understanding and acceptance of risks associated with GM foods. While Tsatsakis et al. (Citation2017) found that the risk of the environmental impacts of GM plants exerted damaging effects on crop pervasiveness and biodiversity, the risk scenario presented herein focuses on the human health hazards associated with GM foods. Whereas some potential health risks attributable to GM foods remain controversial, targeted safety evaluations of specific crops such as blight-protected potatoes (Habig et al. Citation2018) and herbicide-resistant soybeans (Herman et al. Citation2018) demonstrated that GM foods introduced no additional risks. Similarly, Chao and Krewski (Citation2008a; Citation2008b; Citation2008c) developed a risk-based classification scheme for GM foods, testing the framework using a panel of 20 food products reflecting a range of characteristics. No products were found to be associated with a high risk of adverse human health outcomes.

In 2013, the European Food Safety Authority (EFSA) conducted a systematic review of the scientific literature and national risk assessment frameworks relevant to GM food safety (EFSA: European Food Safety Authority Citation2013). This review found a degree of harmonization in risk assessment practices that is indicative of the underlying risk management principles relevant to GM foods. A common theme that emerged from this in-depth examination of 92 papers and 7 national approaches to GM risk assessment was an approach that relied upon identifying unintended health effects via comparison to the most genetically-similar, conventional (non-GM) food comparator. This comparative assessment of differences between GM foods and their conventional analogues reflects the principle of ‘substantial equivalence’ (see Supplementary Material) and underlies an approach based upon risk-based decision-making (P1) (Chao and Krewski Citation2008a; Kok and Kuiper Citation2003). However, there is a need for further consideration of when and how the precautionary principle (P2) needs to be integrated into risk assessment and profiling, particularly where a history of safe use cannot be established (Ladics et al. Citation2015).

The principle of balancing risks and benefits (P3) is also of notable relevance, with a benefit–risk analysis that considers the potential risks alongside the potential benefits in terms of both quality and quantity of nutrient-rich crops that reduce nutritional deficiencies (Chassy et al. Citation2007; Farrell et al. Citation2022). Similarly, the principle of cost-effectiveness (P4), particularly as it relates to the efficient use of time and resources to reduce regulatory bottlenecks, is highly relevant to GM food risk assessment. Strategies advocate for a flexible, tiered, trait-based approach that prioritizes foods of higher concern and reduces regulatory processing time for low-risk categories (Chao and Krewski Citation2008a; Deng et al. Citation2008).

While GM foods would be more appropriately considered in terms of ‘tolerable’ risk (P5) than ‘zero’ risk, it is understood that there is a very low risk tolerance in this sector (Lucht Citation2015). This is characteristic of risk scenarios involving technological engineering, which are often subject to public and political hesitation and stringent regulatory processes. It is less clear, however, what constitutes the appropriate regulatory threshold in light of the public’s evolving risk tolerance. Risk assessment approaches including national regulatory strategies in Canada and the UK seek to either establish a ‘history of safe use’ for GM foods, or compare them to conventional products with a history of safe use, as noted above (EFSA: European Food Safety Authority Citation2013). This approach is meant to inform risk assessment data needs by building upon previous exposure in large populations. However, the concept of a ‘history of safe use’ is vaguely defined and may vary by jurisdiction, with the most widely applied risk acceptability threshold being that of “no observed adverse effect” (EFSA Citation2013).

While considerations of equity were not reported in any of the national regulatory frameworks, the principles of stakeholder engagement (P8), transparency (P9) and flexibility (P10) were recognized as being of importance. This was largely due to the public uncertainty surrounding GM foods (EFSA: European Food Safety Authority Citation2013) and the gap in risk acceptance among farmers, regulatory agencies and consumers (Lucht Citation2015). Publication of risk assessments and invited consultations in advance of regulatory decision-making in conjunction with a flexible risk assessment approach that considers data needs within the context of risk levels could support these efforts (Kuzma Citation2019).

Attributes of risk decision contexts

The 10 risk contexts analyzed above demonstrate that application of the 10 risk decision principles presented here are context-specific. Each of these contexts has certain attributes that favor the application of specific principles, as illustrated in . Understanding the key attributes of different risk contexts that favor the application of specific principles might help to generalize the present discussion to a much broader suite of risk contexts.

Figure 1. Application of risk-decision principles in different risk decision contexts.

Figure 1. Application of risk-decision principles in different risk decision contexts.

Modifiable risks that are subject to low uncertainty constitute the domain of risk-based decision making (P1). As discussed in our explanation of P1 above, risk-based decision-making includes the careful use of “weight-of-evidence” wherein the total evidentiary record is integrated and assessed in order to the most accurate conclusions. An important practical consideration is the cost of risk mitigation; if the goal is to reduce the overall risk to society by the greatest possible amount, risk managers need to focus on the most cost-effective approaches to diminish risk. The principle of cost-effectiveness (P4) thus represents an important adjunct to the principle of risk-based decision-making.

The literature on the well-known precautionary principle (P2) concludes that a precautionary approach might be most appropriate when the potential consequences are quite serious, yet the realization of such consequences is highly uncertain. That is, the WoE in support of specific action(s) emerging from a risk-based process (P1) is inadequate in itself to justify specific action or inaction to the satisfaction of the decision-maker. The risk of inaction in such cases may be sufficiently great that some action is seen as essential to avoid possible future harm of significant proportions, even in the face of high uncertainty. The precautionary principle does have its limits, however; the definition includes the term “cost-effective” which provides a sense of what is reasonable. High consequences and high uncertainty thus represent two key attributes of risk decisions that favor the application of the precautionary principle. The downside of the precautionary approach is that the allocation of scarce risk management resources to risk issues that do not materialize results in an opportunity cost, had those same resources been re-allocated to more certain risk issues where a decrease in risk might have been achieved. It follows that indiscriminate application of the precautionary principle is inconsistent with the optimal allocation of available risk management resources.

Although balancing of risks and benefits (P3) seems intuitively reasonable when risk cannot be effectively eliminated or there are offsetting benefits, the nature of the benefits and to whom the benefits accrue have important implications when invoking this principle. For example, health risks may be offset by either health, social or economic benefits. Individuals might be more likely to accept health risks in exchange for health benefits, as exemplified by the case of a patient with a serious disease who is offered a possible cure in the form of a therapeutic intervention that itself carries the risk of serious side effects. Equally challenging is the case in which economic benefits accrue to individuals other than those incurring the risk, which can run counter to the principle of equity (P7).

The principle of cost-effectiveness (P4) seeks to achieve the greatest reduction in risk for a fixed investment of risk management resources. This principle can only be applied to risks that are modifiable and requires that risks be well-characterized, ideally with low uncertainty. However, too narrow a focus on cost-effective opportunities for risk reduction might lead to an imbalance in the burden of risk within society: cost-effective risk reduction that favors certain population subgroups over others may need to be considered in concert with the principle of equity and environmental justice (P7) in order to achieve an equitable distribution of risks and benefits in the general population.

The principle of risk tolerance (P5) is included among the 10 risk decision principles considered here in light of the fact that most risks one faces in life cannot be completely eliminated. Unfortunately, the concept of a ‘tolerable’ level of risk is an elusive one, with many authors having explored different concepts within the rubric of ‘acceptable,’ ‘tolerable,’ ‘negligible,’ or ‘de minimus’ risk (Gross et al. Citation2010; Hrudey and Krewski Citation1995; Mumpower Citation1986; Peterson Citation2002). A key consideration here is the fact that concepts of ‘tolerable’ risk invariably invoke societal values, which may differ markedly both within and among societies. Nonetheless, some regulatory guidelines suggested ranges of risk on the order 1 in 100,000 to 1 in 10,000,000 that might be broadly ‘tolerable’, depending in part on whether exposure may occur in the occupational or general environments (Castorina and Woodruff Citation2003; Peterson Citation2002), although in other circumstances humanity elected to live with far higher risks such traffic accidents, smoking/recreational drug use or cosmetic surgeries. In some instances involving involuntary risks such as managing ambient air pollution (RC1), society lives with risks far higher than 1 in 100,000. The concept of ‘virtual elimination’ embodied in the Canadian Environmental Protection Act represents a more qualitative version of this principle, wherein a staged risk management action plan is implemented over a period of time to achieve incremental risk reduction, ultimately resulting in very small, but non-zero, levels of environmental contamination (CEPA Citation1999).

The zero-risk principle (P6) has been included among the 10 risk-decision principles primarily to serve as an idealized, yet largely-unattainable, goal for risks that cannot be completely eliminated. This principle has been operationalized in a number of contexts including the establishment of drinking water quality objectives under the Canadian Environmental Protection Act and the Toxic Substances Control Act that are unlikely to be achieved due to practical limitations in water quality treatment technologies (CEPA Citation1999; EPA Citation1976). In fact, should water treatment technology advance to the point where such idealized objectives are in fact achieved, it is likely that the objectives would be further reduced in a continual, technology-forcing effort to achieve even greater assurances of safety and equity.

The second dimension of the zero-risk principle applies in cases where the risks associated with a particular product or substance can be completely eliminated by banning the production or use of that agent. The Delaney Amendment to the U.S. Food & Drug Act, which precludes the addition of substances to the food supply with carcinogenic potential, would be such an example (NRC: National Research Council Citation1982). In contrast, prescription drugs that may confer great benefits to certain patients may be subject only to certain market restrictions in the presence of serious side effects.

Equity in risk-decision making (P7) is an inarguable goal in all its dimensions, including the related concept of environmental justice. However, the resolution of inequities related to risk management is a long-term goal and is often challenging and expensive if not logistically-impossible to achieve. This is the case when socioeconomic inequities are addressed through economic, cultural and political change. Regardless of the underlying forces responsible for inequity in risks and the extent to which inequities can be resolved, the balancing of risk and benefit across society remains a goal consistent with fundamental human rights.

Although the remaining three principles P8, P9, and P10 are almost universally applicable, openness, transparency and stakeholder engagement might compromise the management of risk issues such as anti-terrorist initiatives and national security. However, setting such exceptions aside, openness and transparency are consistent with fundamental principles of democracy, while stakeholder engagement further serves to promote consideration of diverse perspectives on risk and engender public support for risk decisions. Most risk decisions need to include an element of flexibility, allowing for a review of past decisions in the light of relevant new information. Nonetheless, inflexibility may be appropriate in some contexts, such as the strict application of the Delaney Amendment for carcinogenic food additives, regardless of their organoleptic, preservative, nutrient or other qualities of the additive. Looking to the future, there may be merit in formulating an additional principle targeting risk ethics (ethical considerations arise both with respect to risk assessment, as in attributes of methodologies, engagement, and disclosure of uncertainties; and in risk management, as in ensuring an equitable distribution of both risks and benefits across society (Hansson Citation2018); Koivisto and Douglas Citation2015; Rozell Citation2018). In earlier work, Ersdal and Aven (Citation2008) explored ethical considerations in the application of cost-effectiveness (P4) and the precautionary principle (P2), as well as the subsidiary ALARA principle discussed in Supplementary Material.

Conclusions

While societies throughout the history of mankind have confronted a wide array of health, environmental and other risks, systematic approaches to risk assessment and risk management have only begun to emerge within recent decades. Although increasingly sophisticated methods in risk science have greatly expanded our ability to assess risks in scientific terms, risk management decisions are often complex in the presence of different considerations regarding how the best risk decisions need to be made.

This article proposes 10 fundamental principles of risk management decision-making that are intended to encourage discussion and provide guidance to decision-makers confronted with complex risk decisions. In most real-world decision contexts, more than one principle will be relevant. Although each principle has merit in its own right, not all principles are equally-applicable in different risk decision contexts.

In some cases, there may be a dominant principle that is more relevant than others. For example, with climate change risk reduction, the precautionary principle is generally recognized as being the dominant risk decision principle. Conversely, in considering air quality management, the principles of risk-based decision-making and cost-effectiveness might be viewed as being equally applicable.

Since different principles may lead the decision-maker to different decisions, it is important to appreciate the nature of the risk decision context and to identify those principles that are most relevant in that context. By analyzing 10 different scenarios spanning a wide range of risk issues, which decision-making principles may be most appropriate were explored in different risk contexts and the practical applicability of the principles proposed demonstrated. Since more than one decision-making principle might be relevant in most risk contexts, judgment is required in arriving at an appropriate strategy or strategies to manage specific risks.

While we have stopped short of prescribing which types of principles will be most relevant based upon common attributes of a group of risk scenarios, this might be investigated further in future research involving a larger number of risk decision contexts possibly with the use of multivariate data analytic methods to associate principles with attributes of risk decisions. In the interim, the principles articulated here and the illustrations of their application in diverse risk decision contexts might assist risk managers charged with making critical risk decisions on behalf of society. In making such decisions, the importance of experience and judgment is again emphasized in reaching the right balance among the 10 principles presented, as well as the reality of recognizing the socio-political context in which all risk decisions are ultimately made.

Supplemental material

Supplemental Material

Download MS Word (48.7 KB)

Acknowledgments

DK is the Natural Sciences and Engineering Council of Canada Chair in Risk Science at the University of Ottawa. The authors are grateful to three referees, whose constructive comments served to improve the original draft of this paper. We also thank Abdallah Alami for his assistance in the final formatting of this article.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed online at https://doi.org/10.1080/10937404.2022.2107591

Additional information

Funding

This work was supported in part by the Natural Sciences and Engineering Research Council of Canada [IRCPJ 394852 - 13]. PSH and PL were supported by post doctoral fellowships from the McLauglin Centre for Population Health Risk Assessment at the University of Ottawa.

Notes

1. The lifetime tolerable benchmark risks of 10–5 to 10–7 have been proposed primarily for risks associated with toxic chemicals in the environment, and do not necessarily apply to other risk contexts.

References

  • Abbas, W. T. 2021. Advantages and prospective challenges of nanotechnology applications in fish cultures: A comparative review. Environmental Science Pollution Research Institute 28 (7):7669–90. doi:10.1007/s11356-020-12166-0.
  • Acharya, K. P., T. R. Ghimire, and S. H. Subramanya. 2021. Access to and equitable distribution of COVID-19 vaccine in low-income countries. NPJ Vaccines 6:54–54. doi:10.1038/s41541-021-00323-6.
  • Adler, M. D. 2008. Risk equity: A new proposal. Harvard Environmental Law Review 32:1.
  • Agapova, M., E. B. Devine, B. W. Bresnahan, M. K. Higashi, and L. P. Garrison. 2014. Applying quantitative benefit–risk analysis to aid regulatory decision making in diagnostic imaging. Acad. Radiol. 21 (9):1138–43. doi:10.1016/j.acra.2014.05.006.
  • Alami, A., D. Krewski, D. Mattison, K. Wilson, C. A. Gravel, P. J. Villeneuve, P. J. Farrell, J. A. G. Crispo, and S. Perez-Lloret. 2022. Risk of myocarditis and pericarditis among young adults following mRNA COVID-19 vaccinations. Vaccines 10 (5):722. doi:10.3390/vaccines10050722.
  • Alberta Government. 2008. Alberta’s 2008 climate change strategy. Edmonton, AB: Government of Alberta. Accessed 3 August 2022. https://open.alberta.ca/publications/9780778567899.
  • Appleby, J. 2020. Will covid-19 vaccines be cost effective—and does it matter? Br Med J 371:m4491.
  • Arrieta, M. I., R. D. Foreman, E. D. Crook, and M. L. Icenogle. 2009. Providing continuity of care for chronic diseases in the aftermath of Katrina: From field experience to policy recommendations. Disaster Med Public Health Prep 3:174–82. doi:10.1097/DMP.0b013e3181b66ae4.
  • Austin, S. E., J. D. Ford, L. Berrang-Ford, M. Araos, S. Parker, and M. D. Fleury. 2015. Public health adaptation to climate change in Canadian jurisdictions. International Journal of Environmental Research and Public Health 12 (1):623–51. doi:10.3390/ijerph120100623.
  • Baan, R. A and K., Straif. 2022. The monographs programme of the international agency for research on cancer: A brief history of its preamble. ALTEX 39 443–50. doi:10.14573/altex.2004081.
  • Ball, P. 2020. The lightning-fast quest for COVID vaccines — And what it means for other diseases. Nature 589 (7840):16–18. doi:10.1038/d41586-020-03626-1.
  • Bao, C., D. Wu, J. Wan, J. Li, and J. Chen. 2017. Comparison of different methods to design risk matrices from the perspective of applicability. Procedia Comput Sci 122:455–62. doi:10.1016/j.procs.2017.11.393.
  • Benn, S., D. Dunphy, and A. Martin. 2009. Governance of environmental risk: New approaches to managing stakeholder involvement. Journal of Environmental Management 90 (4):1567–75. doi:10.1016/j.jenvman.2008.05.011.
  • Berthoud, B. 2014. The precautionary principle in EU risk regulation: A matter of priorities. Hamburg: Anchor Academic Publishing.
  • Bourque, L. B., J. M. Siegel, M. Kano, and M. M. Wood. 2007. Morbidity and mortality associated with disasters. In Handbook of disaster research, eds.Rodriguez, H., E.L. Quarantelli and R.R., Dynes , 97–112. New York: Springer.
  • Bowen, W. M., M. J. Salling, K. E. Haynes, and E. J. Cyran. 1995. Toward environmental justice: Spatial equity in Ohio and Cleveland. Annals of the Association of American Geographers 85 (4):641–63. doi:10.1111/j.1467-8306.1995.tb01818.x.
  • Braathen, N., H. Lindhjem, and S. Navrud 2009. Valuing lives saved from environmental, transport and health policies: A meta-analysis of stated preference studies. OECD: Paris. Available at www.oecd.org/env/policies/vsl. (Accessed July 22, 2022).
  • Bratu, A., K. G. Card, K. Closson, N. Aran, C. Marshall, S. Clayton, M. K. Gislason, H. Samji, G. Martin, M. Lem, et al. 2022. The 2021 Western North American heat dome increased climate change anxiety among British Columbians: Results from a natural experiment. Journal of Climate Change and Health 6:100116. doi:10.1016/j.joclim.2022.100116.
  • Burnett, R., H. Chen, M. Szyszkowicz, N. Fann, B. Hubbell, C. A. Pope 3rd, J. S. Apte, M. Brauer, A. Cohen, S. Weichenthal, et al. 2018. Global estimates of mortality associated with long-term exposure to outdoor fine particulate matter. Proc. Natl. Acad. Sci. U.S.A. 115 (38):9592–97.
  • Canada Energy Regulator. 2021. Provincial and territorial energy profiles - Quebec. Accessed 8 August 2022. https://www.cer-rec.gc.ca/en/data-analysis/energy-markets/provincial-territorial-energy-profiles/provincial-territorial-energy-profiles-canada.html.
  • Castorina, R., and T. J. Woodruff. 2003. Assessment of potential risk levels associated with U.S. Environmental protection agency reference values. Environ. Health Perspect. 111 (10):1318–25. doi:10.1289/ehp.6185.
  • Cazenave, J., A. Ale, C. Bacchetta, and A. S. Rossi. 2019. Nanoparticles toxicity in fish models. Current Pharmaceutical Design 25 (37):3927–42. doi:10.2174/1381612825666190912165413.
  • CEPA: Canadian Environmental Protection Act. Environment and Climate Change Canada (1999). https://laws-lois.justice.gc.ca/eng/acts/c-15.31/.
  • Chao, E., and D. Krewski. 2008a. A risk-based classification scheme for genetically modified foods I: Conceptual development. Regulatory Toxicology and Pharmacology 52 (3):208–22. doi:10.1016/j.yrtph.2008.08.006.
  • Chao, E., and D. Krewski. 2008b. A risk-based classification scheme for genetically modified foods II: Graded testing. Regulatory Toxicology and Pharmacology 52 (3):223–34. doi:10.1016/j.yrtph.2008.08.002.
  • Chao, E., and D. Krewski. 2008c. A risk-based classification scheme for genetically modified foods III: Evaluation using a panel of reference foods. Regulatory Toxicology and Pharmacology 52 (3):235–41. doi:10.1016/j.yrtph.2008.08.003.
  • Chassy, B., M. Egnin, Y. Gao, K. Glenn, G. Kleter, P. Nestel, M. Newell-McGloughlin, R. Phipps, and R. Shillito. 2007. Nutritional and safety assessments of foods and feeds nutritionally improved through biotechnology: Case studies: Executive summary of a task force report by the international life sciences institute, Washington, D.C. J. Food Sci. 72:R131–R137.
  • Chen, -C.-C., P.-S. Chen, and V.-Y. Yang. 2019. Relationship between fine particulate air pollution exposure and human adult life expectancy in Taiwan. Journal of Toxicology and Environmental Health A 82 (14):826–32. doi:10.1080/15287394.2019.1658386.
  • Cheng, Y. C., M. Musiani, M. Cavedon, and S. Gilch. 2017. High prevalence of prion protein genotype associated with resistance to chronic wasting disease in one Alberta woodland caribou population. Prion 11 (2):136–42. doi:10.1080/19336896.2017.1300741.
  • Christian, M. D., L. Hawryluck, R. S. Wax, T. Cook, N. M. Lazar, M. S. Herridge, M. P. Muller, D. R. Gowans, W. Fortier, and F. M. Burkle. 2006. Development of a triage protocol for critical care during an influenza pandemic. Can Med Assoc J 175 (11):1377–81. doi:10.1503/cmaj.060911.
  • Clean Air Partnership 2009. Climate change adaptation and health equity: Background report. Toronto, ON, Toronto Public Health: Healthy Public Policy Team.
  • Cohen, S. M. 1986. Saccharin: Past, present, and future. Journal of the American Dietetic Association 86 (7):929–31. doi:10.1016/S0002-8223(21)04048-7.
  • Colvin, V. L. 2003. The potential environmental impact of engineered nanomaterials. Nat. Biotechnol. 21 (10):1166–70. doi:10.1038/nbt875.
  • Costa, S., J. Ferreira, C. Silveira, C. Costa, D. Lopes, H. Relvas, C. Borrego, P. Roebeling, A. I. Miranda, and J. P. Teixeira. 2014. Integrating health on air quality assessment—review report on health risks of two major European outdoor air pollutants: PM and NO 2. Journal of Toxicology and Environmental Health B 17 (6):307–40. doi:10.1080/10937404.2014.946164.
  • Cowling, B. J., L. L. H. Lau, P. Wu, H. W. C. Wong, V. J. Fang, S. Riley, and H. Nishiura. 2010. Entry screening to delay local transmission of 2009 pandemic influenza A (H1N1). BMC Infect. Dis. 10 (1):82–82. doi:10.1186/1471-2334-10-82.
  • Custer, B., and M. P. Janssen. 2015. Health economics and outcomes methods in risk-based decision-making for blood safety. Transfusion 55 (8):2039–47. doi:10.1111/trf.13080.
  • Cutter, S. L., L. Barnes, M. Berry, C. Burton, E. Evans, E. Tate, and J. Webb. 2008. A place-based model for understanding community resilience to natural disasters. Global Environmental Change 18 (4):598–606. doi:10.1016/j.gloenvcha.2008.07.013.
  • Deng, P., X. Zhou, P. Zhou, Z. Du, H. Hou, D. Yang, J. Tan, X. Wu, J. Zhang, Y. Yang, et al. 2008. Edible safety requirements and assessment standards for agricultural genetically modified organisms. Food and Chemical Toxicology 46 (5):1414–36. doi:10.1016/j.fct.2008.01.007.
  • Dusseault, M., and R. Jackson. 2014. Seepage pathway assessment for natural gas to shallow groundwater during well stimulation, in production, and after abandonment. Environmental Geosciences 21 (3):107–26. doi:10.1306/eg.04231414004.
  • EFSA: European Food Safety Authority. 2013. Review of the strategies for the comprehensive food and feed safety and nutritional assessment of GM plants per se. EFSA Supporting Publications 480: 1–115.
  • EFSA Scientific Committee, S. More, V. Bampidis, D. Benford, C. Bragard, T. Halldorsson, A. Hernández-Jerez, S. Hougaard Bennekou, K. Koutsoumanis, and C. Lambré, et al. 2021a. Guidance on risk assessment of nanomaterials to be applied in the food and feed chain: Human and animal health. European Food Safety Authority Journal 19 (8):e06768–e06768. doi:10.2903/j.efsa.2021.6768.
  • EFSA Scientific Committee, More, S., Bampidis, V., Benford, D., Bragard, C., Halldorsson, T., Hernández-Jerez, A., Bennekou, S. H., Koutsoumanis, K., Lambré, C., Machera, K., Naegeli, H., Nielsen, S., Schlatter, J., Schrenk, D., Silano Deceased, V., Turck, D., Younes, M., Castenmiller, J., Chaudhry, Q., … Schoonjans, R. 2021b. Guidance on technical requirements for regulated food and feed product applications to establish the presence of small particles including nanoparticles. EFSA journal. European Food Safety Authority, 19 (8): e06769.https://doi.org/10.2903/j.efsa.2021.6769.
  • Egbuna, C., V. K. Parmar, J. Jeevanandam, S. M. Ezzat, K. C. Patrick-Iwuanyanwu, C. O. Adetunji, J. Khan, E. N. Onyeike, C. Z. Uche, M. Akram, et al. 2021. Toxicity of nanoparticles in biomedical application: Nanotoxicology. J Toxicol 2021:9954443–9954443. doi:10.1155/2021/9954443.
  • EIA: Energy Information Administration. 2019. Annual energy outlook, energy information administration. United States: Department of Energy.
  • Elsaesser, A., and C. V. Howard. 2012. Toxicology of nanoparticles. Adv. Drug Deliv. Rev. 64 (2):129–37. doi:10.1016/j.addr.2011.09.001.
  • EPA: Environmental Protection Agency. 1976. Toxic Substances Control Act. Washington, DC: Environmental Protection Agency.
  • EPA: Environmental Protection Agency. 2005. External review draft nanotechnology white paper. Washington, DC: Science Policy Council, Environmental Protection Agency.
  • EPA: Environmental Protection Agency. 2011. The benefits and costs of the clean air act from 1990 to 2020. U. S. Washington, DC: Environmental Protection Agency.
  • EPA: Environmental Protection Agency. 2017. Environmental Justice. Washington, DC: Environmental Protection Agency.
  • Erickson, T. B., J. Brooks, E. J. Nilles, P. N. Pham, and P. Vinck. 2019. Environmental health effects attributed to toxic and infectious agents following hurricanes, cyclones, flash floods and major hydrometeorological events. Journal of Toxicology and Environmental Health B 22 (5–6):157–71. doi:10.1080/10937404.2019.1654422.
  • Ersdal, G., and T. Aven. 2008. Risk informed decision-making and its ethical basis. Reliability Engineering and AMP; System Safety 93 (2):197–205. doi:10.1016/j.ress.2006.12.018.
  • Evans, J., A. van Donkelaar, R. V. Martin, R. Burnett, D. G. Rainham, N. J. Birkett, and D. Krewski. 2013. Estimates of global mortality attributable to particulate air pollution using satellite imagery. Environ. Res. 120:33–42. doi:10.1016/j.envres.2012.08.005.
  • Ewall, M. 2012. Legal tools for environmental equity vs environmental justice. Sustainable Development Law & Policy 13:55–56.
  • Eze, I. A., L. G. Hemkens, H. C. Bucher, B. Hoffmann, C. Schindler, N. Kunzli, T. Schikowski, and N. M. Probst-Hensch. 2015. Association between ambient air pollution and diabetes mellitus in Europe and North America: Systematic review and meta-analysis. Environ. Health Perspect. 123 (5):381–89. doi:10.1289/ehp.1307823.
  • Farrell, P., P. Aggett, B. Milton, S. Ramoju, D. Mattison, N. Birkett, and D. Krewski. 2022. The use of categorical regression in evidence integration. ALTEX. doi:10.14573/altex.2012022.
  • Farrow, S. 2010. Incorporating equity in regulatory and benefit-cost analysis using risk-based preferences. Risk Analysis 31 (6):902–07. doi:10.1111/j.1539-6924.2010.01474.x.
  • FDA: United States Food and Drug Administration. 2014. Significant dates in U.S. Food and drug law history. Maryland, United States: Silver Spring.
  • Fischhoff, B., P. Slovic, and S. Lichtenstein. 1979. Weighing the risks: Risks: Benefits which risks are acceptable? Environment: Science and Policy for Sustainable Development 21:17–38.
  • Fullerton, M. M., J. Benham, A. Graves, S. Fazel, E. J. Doucette, R. J. Oxoby, M. Mourali, J.-C. Boucher, C. Constantinescu, J. Parsons Leigh, et al. 2022. Challenges and recommendations for COVID-19 public health messaging: A Canada-wide qualitative study using virtual focus groups. BMJ Open 12 (4):e054635–e054635. doi:10.1136/bmjopen-2021-054635.
  • Goldman, A., B. Eggen, B. Golding, and V. Murray. 2014. The health impacts of windstorms: A systematic literature review. Public Health 128 (1):3–28. doi:10.1016/j.puhe.2013.09.022.
  • Goñi, F., C. K. Mathiason, L. Yim, K. Wong, J. Hayes-Klug, A. Nalls, D. Peyser, V. Estevez, N. Denkers, J. Xu, et al. 2015. Mucosal immunization with an attenuated salmonella vaccine partially protects white-tailed deer from chronic wasting disease. Vaccine 33 (5):726–33. doi:10.1016/j.vaccine.2014.11.035.
  • Goodwin, P., S. Brown, I. D. Haigh, R. J. Nicholls, and J. M. Matter. 2018a. Adjusting mitigation pathways to stabilize climate at 1.5°C and 2.0°C rise in global temperatures to year 2300. Earth’s Future 6 (3):601–15. doi:10.1002/2017EF000732.
  • Goodwin, P., A. Katavouta, V. M. Roussenov, G. L. Foster, E. J. Rohling, and R. G. Williams. 2018b. Pathways to 1.5 °C and 2 °C warming based on observational and geological constraints. Nat Geosci 11 (2):102–07. doi:10.1038/s41561-017-0054-8.
  • Government of British Columbia 2013. LNG liquefied natural gas, A strategy for B.C.’s newest industry. Ministry of Energy. Victoria, BC, Canada. Available at: https://news.gov.bc.ca/releases/2013MNGD0049-001916 (Accessed July 15, 2022).
  • Government of British Columbia 2007. The BC energy plan: A vision for clean energy leadership. M. a. P. R. Ministry of Energy. Victoria: Government of BC, Canada: 1–44. Available at: https://www2.gov.bc.ca/assets/gov/farming-natural-resources-and-industry/electricity-alternative-energy/bc_energy_plan_2007.pdf (Accessed July 15, 2022).
  • Government of Canada 2003. A framework for the application of precaution in science-based decision making about risk. Available at: https://publications.gc.ca/site/eng/246284/publication.html (Accessed July 15, 2022).
  • Grandjean, P. 2004. Implications of the precautionary principle for primary prevention and research. Annu. Rev. Public Health 25 (1):199–223. doi:10.1146/annurev.publhealth.25.050503.153941.
  • Gross, M., K. Daginnus, G. Deviller, W. de Wolf, S. Dungey, C. Galli, A. Gourmelon, M. Jacobs, P. Matthiessen, C. Micheletti, et al. 2010. Thresholds of toxicological concern for endocrine active substances in the aquatic environment. Integr Environ Assess Manag 6 (1):2–11. doi:10.1897/IEAM_2008-092.1.
  • Gruenbaum, O. 2019. Commonwealth update. The Commonwealth Journal of International Affairs 108:109–15.
  • Habig, J. W., A. Rowland, M. G. Pence, and C. X. Zhong. 2018. Food safety evaluation for R-proteins introduced by biotechnology: A case study of VNT1 in late blight protected potatoes. Regulatory Toxicology and Pharmacology 95:66–74. doi:10.1016/j.yrtph.2018.03.008.
  • Hagiwara, S., G. M. Paoli, P. S. Price, M. R. Gwinn, A. Guiseppi‐Elie, P. J. Farrell, B. J. Hubbell, D. Krewski, and R. S. Thomas. 2022. A value of information framework for assessing the trade‐offs associated with uncertainty, duration, and cost of chemical toxicity testing. Risk Analysis. Online Ahead of Print. doi:10.1111/risa.13931.
  • Hales, S., S. Edwards, and R. Kovats 2003. Impacts on health of climate extremes. In World Health Organization, climate change and human health: Risks and responses. Geneva: World Health Organization. pp.79–102. Available at https://apps.who.int/iris/bitstream/handle/10665/42742/924156248X_eng.pdf (Accessed July 22, 2022)
  • Haley, N. J., and E. A. Hoover. 2015. Chronic wasting disease of cervids: Current knowledge and future perspectives. Annual Review of Animal Biosciences 3 (1):305–25. doi:10.1146/annurev-animal-022114-111001.
  • Hansson, S. O. 2018. How to perform an ethical risk analysis (eRA). Risk Analysis 38 (9):1820–29. doi:10.1111/risa.12978.
  • Harrison, K., and G. Hoberg. 1994. Risk, science and politics: Regulating toxic substances in Canada and the United States. Montreal: McGill-Queen’s University Press.
  • Hartling, L., W. Pickett, and R. J. Brison. 1999. The injury experience observed in two emergency departments in Kingston, Ontario during ice storm 98. Canadian Journal of Public Health 90 (2):95–98. doi:10.1007/BF03404109.
  • Hay, J., and N. Mimura. 2010. The changing nature of extreme weather and climate events: Risks to sustainable development. Geomatics, Natural Hazards and Risk 1 (1):3–18. doi:10.1080/19475701003643433.
  • Health Canada 2005. Climate change: Preparing for the health impact. In Health Policy Research Bulletin. Ottawa, ON, Health Canada. Available at: https://www.canada.ca/content/dam/hc-sc/migration/hc-sc/sr-sr/alt_formats/hpb-dgps/pdf/pubs/hpr-rps/bull/2005-climat/2005-climat-revis-eng.pdf (Accessed July 15, 2022).
  • Health Canada 2008. Human health in a changing climate. In A Canadian assessment of vulnerabilities and adaptive capacity. Ottawa, Canada, Health Canada. Available from: https://publications.gc.ca/site/eng/9.691579/publication.html (Accessed July 15, 2022).
  • Herman, R. A., R. D. Ekmay, B. W. Schafer, P. Song, B. J. Fast, S. Papineni, G. Shan, and D. R. Juberg. 2018. Food and feed safety of DAS-444Ø6-6 herbicide-tolerant soybean. Regulatory Toxicology and Pharmacology 94:70–74. doi:10.1016/j.yrtph.2018.01.016.
  • Herms, J., and M. M. Dorostkar. 2016. Dendritic spine pathology in neurodegenerative diseases. Annual Review of Pathology: Mechanisms of Disease 11 (1):221–50. doi:10.1146/annurev-pathol-012615-044216.
  • Hoffmann, S., and T. Hartung. 2006. Toward an evidence-based toxicology. Hum Exp Toxicol 25 (9):497–513. doi:10.1191/0960327106het648oa.
  • Hrudey, S. E., and D. Krewski. 1995. Is there a safe level of exposure to a carcinogen? Environ. Sci. Technol. 29 (8):370A–375A. doi:10.1021/es00008a747.
  • Hsu, C.-H., and T. Stedeford. 2011. Cancer Risk assessment: Chemical carcinogenesis, hazard evaluation, and risk quantification. 1st ed. Online Library: Wiley.
  • Hunter, P. R., and F. Lorna. 2001. Acceptable risk. Water quality: Guidelines, standards and health. Risk assessment and management for water-related infectious disease. London, UK: IWA Publishing.
  • Hutchison, J. E. 2008. Greener nanoscience: A proactive approach to advancing applications and reducing implications of nanotechnology. ACS Nano 2 (3):395–402. doi:10.1021/nn800131j.
  • IAP2: International Association for Public Participation 2021. Canada inspiring better decisions together. Available from https://www.iap2canada.ca (Accessed July 15, 2022).
  • IARC: International Agency for Research on Cancer. 1999. IARC working group: Saccharin and its salts. Some chemicals that cause tumours of the kidney or urinary bladder in rodents and some other substances: IARC monographs on the evaluation of carcinogenic risks to humans. International Agency for Research on Cancer. 517–624.
  • IEA: International Energy Agency 2018. Unconventional gas production database. Available at: https://www.iea.org/ugforum/ugd/ (Accessed July 15, 2022).
  • Institute of Medicine. 1999. Toward Environmental Justice: Research, Education, and Health Policy Needs. Washington, DC: National Academies Press.
  • Institute of Medicine. 2005. Implications of Nanotechnology for Environmental Health Research. Washington, DC: National Academies Press.
  • IPCC: Intergovernmental Panel on Climate Change. 2013. Climate change 2013: The physical science basis. Contribution of working group I to the fifth assessment report of the intergovernmental panel on climate change, T. F. Stocker, D. Qin, and G. Plattnered. Geneva, Switzerland: Intergovernmental Panel on Climate Change (IPCC).
  • IPCC: Intergovernmental Panel on Climate Change. 2014a. Climate change 2014: Synthesis report. Contribution of working groups i, ii and iii to the fifth assessment report of the IPCC. Geneva, Switzerland: Intergovernmental Panel on Climate Change (IPCC).
  • IPCC: Intergovernmental Panel on Climate Change 2014b. Frequently asked questions. contribution of working group I contribution to the fifth assessment report of the intergovernmental panel on climate change. IPCC working group I technical support unit. Geneva, Switzerland: Intergovernmental Panel on Climate Change (IPCC).
  • IPCC: Intergovernmental Panel on Climate Change. 2022. Assessment report #6, climate change 2022: Impacts, adaptation and vulnerability, summary for policymakers. Working group ii contribution to the sixth assessment report of the intergovernmental panel on climate change. Geneva, Switzerland: Intergovernmental Panel on Climate Change (IPCC).
  • IRGC: International Risk Governance Council 2007. Nanotechnology risk governance recommendations for a global, coordinated approach to the governance of potential risks. Geneva, Switzerland. Available from https://irgc.org/wp-content/uploads/2018/09/PB_nanoFINAL2_2_.pdf (Accessed July 15, 2022).
  • IRGC: International Risk Governance Council 2014. Risk governance guidelines for unconventional gas development. Lausanne, Switzerland. Available from https://irgc.org/wp-content/uploads/2018/09/IRGC-UGD-Policy-Brief-2014.pdf (Accessed July 15, 2022).
  • IRGC: International Risk Governance Council 2017. Introduction of the IRGC risk governance framework: Revised version. Lausanne, Switzerland. Available from https://irgc.org/wp-content/uploads/2018/09/IRGC.-2017.-An-introduction-to-the-IRGC-Risk-Governance-Framework.-Revised-version.pdf (Accessed July 15, 2022).
  • Jagai, J. S., Q. Li, S. Wang, K. P. Messier, T. J. Wade, and E. D. Hilborn. 2015. Extreme precipitation and emergency room visits for gastrointestinal illness in areas with and without combined sewer systems: An analysis of Massachusetts data, 2003-2007. Environ. Health Perspect. 123 (9):873–79. doi:10.1289/ehp.1408971.
  • Jardine, C., S. Hrudey, J. Shortreed, L. Craig, D. Krewski, C. Furgal, and S. McColl. 2003. Risk management frameworks for human health and environmental risks. Journal of Toxicology and Environmental Health, Part B 6 (6):569–718. doi:10.1080/10937400390208608.
  • Jensen, R. C., and H. Hansen. 2020. Selecting appropriate words for naming the rows and columns of risk assessment matrices. International Journal of Environmental Research and Public Health 17 (15):5521. doi:10.3390/ijerph17155521.
  • Johnson-Arbor, K. K., A. S. Quental, and D. Li. 2014. A comparison of carbon monoxide exposures after snowstorms and power outages. Am J Prev Med 46 (5):481–86. doi:10.1016/j.amepre.2014.01.006.
  • Jonkman, S. N., B. Maaskant, E. Boyd, and M. L. Levitan. 2009. Loss of life caused by the flooding of New Orleans after hurricane Katrina: Analysis of the relationship between flood characteristics and mortality. Risk Analysis 29 (5):676–98. doi:10.1111/j.1539-6924.2008.01190.x.
  • Kamali, M., Z. Khodaparast, and T. Seifi. 2013. Toxicity of engineered nanoparticles – A review. Portugal: University of Beira Interior – Covilhã. https://www.researchgate.net/profile/Tahereh-Seifi/publication/263543579_Toxicity_of_engineered_nanoparticles_-_A_review/links/570ac4f308ae2eb9421fe10e/Toxicity-of-engineered-nanoparticles-A-review.pdf.
  • Keith, D. W., D. K. Weisenstein, J. A. Dykema, and F. N. Keutsch. 2016. Stratospheric solar geoengineering without ozone loss. Proceedings of the National Academy of Sciences of the United States of America 113 (52):14910–14. doi:10.1073/pnas.1615572113.
  • Keller, L. R., and R. K. Sarin. 1988. Equity in social risk: Some empirical observations. Risk Analysis 8 (1):135–46. doi:10.1111/j.1539-6924.1988.tb01160.x.
  • Kelman, S. 1981. Cost-benefit analysis: An ethical critique. Regulation 5 (1):33–40.
  • Kermanizadeh, A., I. Gossens, L. MacCalman, H. Johnston, P. H. Danielsen, N. R. Jacobsen, A.-G. Lenz, T. Fernandes, R. P. F. Schins, F. R. Cassee, et al. 2016. A multilaboratory toxicological assessment of a panel of 10 engineered nanomaterials to human health-ENPRA project-The highlights limitations and current and future challenges. Journal of Toxicology and Environmental Health B 19 (1):1–28. doi:10.1080/10937404.2015.1126210.
  • Kermanizadeh, A., L. G. Powell, and V. Stone. 2020. A review of hepatic nanotoxicology-Summation of recent findings and considerations for the next generation of study designs. Journal of Toxicology and Environmental Health B 23 (4):137–76. doi:10.1080/10937404.2020.1751756.
  • Klima, K., and A. Jerolleman. 2014. Bridging the gap: Hazard mitigation in the global context. Journal of Homeland Security and Emergency Management 11:209–16.
  • Koivisto, R., and D. Douglas 2015. Principles and approaches in ethics assessment. Annex 1.h. ethical assessment of research and innovation: A comparative analysis of practices and institutions in the EU and selected other countries. Available from https://satoriproject.eu/media/1.h-Ethics-and-Risk1.pdf (Accessed July 15, 2022).
  • Kok, E. J., and H. A. Kuiper. 2003. Comparative safety assessment for biotech crops. Trends in Biotechnology 21 (10):439–44. doi:10.1016/j.tibtech.2003.08.003.
  • Krewski, D., D. Acosta, M. Andersen, H. Anderson, J. C. Bailar, K. Boekelheide, R. Brent, G. Charney, V. G. Cheung, S. Green, et al. 2010. Toxicity Testing in the 21st Century: A Vision and a strategy. Journal of Toxicology and Environmental Health B 13 (2–4):51–138. doi:10.1080/10937404.2010.483176.
  • Krewski, D., M. E. Andersen, M. G. Tyshenko, K. Krishnan, T. Hartung, K. Boekelheide, J. F. Wambaugh, D. Jones, M. Whelan, R. Thomas, et al. 2019. Toxicity testing in the 21st century: Progress in the past decade and future perspectives. Arch. Toxicol. 94 (1):1–58. doi:10.1007/s00204-019-02613-4.
  • Krewski, D., V. Hogan, M. C. Turner, P. L. Zeman, I. McDowell, N. Edwards, and J. Losos. 2007. An integrated framework for risk management and population health. Human and Ecological Risk Assessment 13 (6):1288–312. doi:10.1080/10807030701655798.
  • Krewski, D., L. Lemyre, M. C. Turner, J. E. C. Lee, C. Dallaire, L. Bouchard, K. Brand, and P. Mercier. 2008. Public perception of population health risks in Canada: Risk perception beliefs. Health, Risk & Society 10 (2):167–79. doi:10.1080/13698570801919830.
  • Krewski, D., P. Saunders-Hastings, R. A. Baan, T. S. Barton-Maclaren, P. Browne, W. A. Chiu, M. Gwinn, T. Hartung, A. Kraft, J. Lam, et al. 2022. Development of an evidence-based risk assessment framework. ALTEX. In press.
  • Krewski, D., M. Westphal, M. E. Andersen, G. M. Paoli, W. A. Chiu, M. Al-Zoughool, M. C. Croteau, L. D. Burgoon, and I. Cote. 2014. A framework for the next generation of risk science. Environ. Health Perspect. 122 (8):796–805. doi:10.1289/ehp.1307260.
  • Kuzma, J. 2019. Procedurally robust risk assessment framework for novel genetically engineered organisms and gene drives. Regulation & Governance 15 (4):1144–65. doi:10.1111/rego.12245.
  • Ladics, G. S., A. Bartholomaeus, P. Bregitzer, N. G. Doerrer, A. Gray, T. Holzhauser, M. Jordan, P. Keese, E. Kok, P. Macdonald, et al. 2015. Genetic basis and detection of unintended effects in genetically modified crop plants. Transgenic Res. 24 (4):587–603. doi:10.1007/s11248-015-9867-7.
  • Larkin, P., R. Gracie, M. Dusseault, and D. Krewski. 2018. Ensuring health and environmental protection in hydraulic fracturing: A focus on British Columbia and Alberta, Canada. Extractive Industries and Society 5 (4):581–95. doi:10.1016/j.exis.2018.07.006.
  • Leiss, W., M. G. Tyshenko, D. Krewski, N. Cashman, L. Lemyre, M. A. Zoughool, and C. Amaratunga. 2010. Managing the risks of bovine spongiform encephalopathy: A Canadian perspective. Int J Risk Assess Manag 14 (5):381–436. doi:10.1504/IJRAM.2010.035935.
  • Leiss, W., M. G. Tyshenko, P. Larkin, and D. Krewski. 2020. Treaty framing and climate science: Challenges in managing the risk of global warming. International Journal of Global Environmental Issues 19 (1/2/3):273–93. doi:10.1504/IJGENVI.2020.114882.
  • Lowrance, W. W., and J. Klerer. 1976. Of acceptable risk: Science and the determination of safety. Journal of Electrochemical Society 123 (11):373C–373C. doi:10.1149/1.2132690.
  • Lucht, J. M. 2015. Public acceptance of plant biotechnology and GM crops. Viruses 7 (8):4254–81. doi:10.3390/v7082819.
  • Macesker, B., J. J. Myers, V. H. Guthrie, D. A. Walker, and S. G. Schoolcraft. 2002. Quick-reference guide to risk-based decision making (RBDM): A step-by-step example of the RBDM process in the field. https://silo.tips/download/quick-reference-guide-to-risk-based-decision-making-rbdm-a-step-by-step-example.
  • Mayo Clinic. 2022. Thalidomide: Research advances in cancer and other conditions. Available from https://www.mayoclinic.org/diseases-conditions/cancer/in-depth/thalidomide/art-20046534#:~:text=In%20the%201950s%20and%201960s,a%20skin%20condition%20and%20cancer. (Accessed July 15, 2022).
  • Metcalf, C. J. E., M. Ferrari, A. L. Graham, and B. T. Grenfell. 2015. Understanding herd immunity. Trends Immunol. 36 (12):753–55. doi:10.1016/j.it.2015.10.004.
  • Mitchell, R., T. Ogunremi, G. Astrakianakis, E. Bryce, R. Gervais, D. Gravel, L. Johnston, S. Leduc, V. Roth, G. Taylor, et al 2012. Impact of the 2009 influenza A (H1N1) pandemic on Canadian health care workers: A survey on vaccination, illness, absenteeism, and personal protective equipment. American Journal of Infection Control 40 (7):611–16. doi:10.1016/j.ajic.2012.01.011.
  • Moore, M. N. 2006. Do nanoparticles present ecotoxicological risks for the health of the aquatic environment? Environ Int 32 (8):967–76. doi:10.1016/j.envint.2006.06.014.
  • Morgan, K. M., A. Crawford, and B. B. Kowalcyk. 2021. Risk-based decision-making definition: A scoping review of food, agricultural, environmental, and medical literature. Risk Anal. 2021 Oct 27. doi: 10.1111/risa.13845.
  • Mouneyrac, C., K. Syberg, and H. Selck. 2015. Ecotoxicological risk of nanomaterials. Aquatic Ecotoxicology, Elsevier 417–40.
  • Mumpower, J. 1986. An analysis of the de minimis strategy for risk management. Risk Analysis 6 (4):437–46. doi:10.1111/j.1539-6924.1986.tb00956.x.
  • Murray, R. 2002. “How Aspartame Became Legal–the Timeline.” Available from https://www.quantumbalancing.com/news/aspartameapproved.htm (Accessed July 15, 2022).
  • NASEM: National Academies of Sciences, Engineering and Medicine. 2020. Framework for Equitable Allocation of COVID-19 Vaccine, Washington DC: National Academies Press.
  • National Assembly. 2016. An Act to implement the 2030 Energy Policy and to amend various legislative provisions. Quebec: Quebec Official Publisher.
  • National Energy Board. 2018. Canada’s energy future 2017 supplement: Conventional, tight, and shale oil production. Ottawa, Canada: Government of Canada.
  • NRC: National Research Council. 1982. Diet, nutrition, and cancer. nutrition committee on diet, and cancer. Washington, DC: National Academies Press.
  • NRC: National Research Council. 1983. Risk assessment in the federal government: Managing the process. Washington, DC: National Academies Press.
  • NRC: National Research Council. 1994. Science and judgment in risk assessment. Committee on risk assessment of hazardous air pollutants. Washington, DC: National Academies Press.
  • NRC: National Research Council. 2007. Toxicity Testing in the 21st Century: A vision and a strategy. Washington, DC: National Academies Press.
  • NRC: National Research Council. 2009. Science and decisions: Advancing risk assessment. Washington, DC: National Academies Press.
  • NRC: National Research Council. 2014. A framework to guide selection of chemical alternatives. Washington, DC: National Academies Press.
  • O’Sullivan, T., and M. Bourgoin 2010. Vulnerability in an influenza pandemic: Looking beyond medical risk. Funded by the public health agency of Canada. Available from https://ighhub.org/sites/default/files/Lit%20Review%20-%20Vulnerability%20in%20Pandemic_FINAL.pdf (Accessed July 22, 2022)
  • Oberdörster, G., E. Oberdörster, and J. Oberdörster. 2005. Nanotoxicology: An emerging discipline evolving from studies of ultrafine particles [published correction appears in environmental health perspectives 2010:118: A380]. Environ. Health Perspect. 113 (7):823–39. doi:10.1289/ehp.7339.
  • OECD/ITF: Organisation for Economic Co-operation and Development/International Transport Forum 2015. Road Safety Annual Report 2015. Paris, France, OECD.
  • Paoli, P., F. Momoli, M. G. Tyshenko, M. E. Meek, and D. Krewski. 2022. Problem formulation for EFSA scientific assessments 19 (7): 7349E doi:10.2903/sp.efsa.2022.EN-7349.
  • Peterson, M. 2002. What Is a de minimis risk? Risk Management 4 (2):47–55. doi:10.1057/palgrave.rm.8240118.
  • PHAC: Public Health Agency of Canada. 2015. Canadian pandemic influenza preparedness: Planning guidance for the health sector. Ottawa, Canada: Public Health Agency of Canada.
  • Price, P. S., B. J. Hubbell, S. Hagiwara, G. M. Paoli, D. Krewski, A. Guiseppi‐Elie, M. R. Gwinn, N. L. Adkins, and R. S. Thomas. 2021. A framework that considers the impacts of time, cost, and uncertainty in the determination of the cost effectiveness of toxicity‐testing methodologies. Risk Analysis 42 (4):707–29. doi:10.1111/risa.13810.
  • Ramanathan, A. 2019. Toxicity of nanoparticles-challenges and opportunities. Applied Microscopy 49 (2). doi:10.1007/s42649-019-0004-6.
  • Rea, A. W., and W. R. Munns Jr. 2017. The value of nature: Economic, intrinsic, or both? Integr Environ Assess Manag 13 (5):953–55. doi:10.1002/ieam.1924.
  • Revelle, R., and H.E. Suess. 1957. Carbon dioxide exchange between atmosphere and ocean and the question of an increase of atmospheric CO2 during the past decades. Tellus 9:18–27.
  • Rhomberg, L. R., J. E. Goodman, L. A. Bailey, R. L. Prueitt, N. B. Beck, C. Bevan, M. Honeycutt, N. E. Kaminski, G. Paoli, L. H. Pottenger, et al. 2013. A survey of frameworks for best practices in weight-of-evidence analyses. Critical Reviews in Toxicology 43 (9):753–84. doi:10.3109/10408444.2013.832727.
  • Roco, M. C. 2004. Nanoscale science and engineering: Unifying and transforming tools. American Institute of Chemical Engineers Journal 50 (5):890–97. doi:10.1002/aic.10087.
  • Roco, M. C. 2006. What is nanotechnology? Center for Responsible Nanotechnology. Available from http://crnano.org/whatis.htm. (Accessed July 22, 2022)
  • Rozell, D. J. 2018. The ethical foundations of risk analysis. Risk Analysis 38 (8):1529–33. doi:10.1111/risa.12971.
  • Sak, K. 2012. Chemotherapy and dietary phytochemical agents. Chemother Res Pract 2012:282570–282570. doi:10.1155/2012/282570.
  • Samet, J. M., W. A. Chiu, V. Cogliano, J. Jinot, D. Kriebel, R. M. Lunn, F. A. Beland, L. Bero, P. Browne, L. Fritschi, et al. 2020. The IARC monographs: Updated procedures for modern and transparent evidence synthesis in cancer hazard identification. J. Natl. Cancer Inst. 112 (1):30–37. doi:10.1093/jnci/djz169.
  • Saunders-Hastings, P. R., and D. Krewski. 2016. Reviewing the history of pandemic influenza: Understanding patterns of emergence and transmission. Pathogens 5 (4):66. doi:10.3390/pathogens5040066.
  • Saunders-Hastings, P., J. Reisman, D. Krewski, and B. J. Cowling. 2016. Assessing the state of knowledge regarding the effectiveness of interventions to contain pandemic influenza transmission: A systematic review and narrative synthesis. PloS One 11 (12):e0168262. doi:10.1371/journal.pone.0168262.
  • Saunders-Hastings, P., L. Samson, and D. Krewski. 2018. Applying principles of risk decision-making to inform pandemic influenza preparedness and response policy. Chap. 3. In Pandemics: Evolutionary engineering of consciousness and health, ed. P. I. Sidorov. New York: Nova Medicine & Health.
  • Schraufnagel, D. E., J. R. Balmes, C. T. Cowl, S. De Matteis, K. M. S-H-Jung, R. Perez-Padilla, M. B. Rice, H. Riojas-Rodriguez, A. Sood, G. D. Thurston, et al. 2019. Air pollution and noncommunicable diseases: A review by the forum of international respiratory societies environmental committee, part 2: Air pollution and organ systems. Chest 155:417–26. doi:10.1016/j.chest.2018.10.041.
  • Senel, S. 2021. Nanotechnology and animal health. Pharmacy Nanotechnology 9 (1):26–35. doi:10.2174/2211738508666200910101504.
  • Service, R. F. 2005. Calls rise for more research on toxicology of nanomaterials. Science 310 (5754):1609. doi:10.1126/science.310.5754.1609.
  • Silva, G. A. 2005. Nanotechnology approaches for the regeneration and neuroprotection of the central nervous system. Surgical Neurology 63 (4):301–06. doi:10.1016/j.surneu.2004.06.008.
  • Sparrow, R. 2009. The social impacts of nanotechnology: An ethical and political analysis. J Bioeth Inq 6 (1):13–23. doi:10.1007/s11673-009-9139-4.
  • Talic, S., S. Shah, H. Wild, D. Gasevic, A. Maharaj, Z. Ademi, X. Li, W. Xu, I. Mesa-Eguiagaray, J. Rostron, et al. 2021. Effectiveness of public health measures in reducing the incidence of covid-19, SARS-CoV-2 transmission, and COVID-19 mortality: Systematic review and meta-analysis. Br Med J 375:e068302. doi:10.1136/bmj-2021-068302.
  • Toronto Public Health 2016. Building evidence to address the health effects of severe weather. Toronto, Canada, Toronto Public Health. Available from https://www.toronto.ca/legdocs/mmis/2016/hl/bgrd/backgroundfile-98552.pdf (Accessed July 15, 2022).
  • Tsai, -S.-S., Y.-W. Chiu, Y.-H. Weng, and C.-Y. Yang. 2022. Association between fine particulate air pollution and the risk of death from lung cancer in Taiwan. Journal of Toxicology and Environmental Health A 85 (10):431–38. doi:10.1080/15287394.2022.2040672.
  • Tsatsakis, A. M., M. A. Nawaz, D. Kouretas, G. Balias, K. Savolainen, V. A. Tutelyan, K. S. Golokhvast, J. D. Lee, S. H. Yang, and G. Chung. 2017. Environmental impacts of genetically modified plants: A review. Environ. Res. 156:818–33. doi:10.1016/j.envres.2017.03.011.
  • Tyshenko, M. G., N. Farhat, R. Lewis, N. Shilnikova, and D. Krewski. 2010. Applying a precautionary risk management strategy for regulation of nanotechnology. International Journal of Nanotechnology 7 (2/3):243. doi:10.1504/IJNT.2010.031313.
  • Tyshenko, M. G., and D. Krewski. 2008. A risk management framework for the regulation of nanomaterials. International Journal of Nanotechnology 5 (1):143–60. doi:10.1504/IJNT.2008.016553.
  • UK Royal Society and the Royal Academy of Engineering. 2004. Nanoscience and nanotechnologies: Opportunities and uncertainties. London, England: UK Royal Society.
  • United Nations (1992). Rio declaration on environment and development.” In Sustainable Urban Development Reader. Conference on Environment and Development, Routledge,Taylor & Francis.
  • U.S. National Science and Technology Council. 2021. National Nanotechnology Initiative Strategic Plan, A Report by the Subcommittee on Nanoscale Science, Engineering, and Technology Committee on Technology. Alexandria, Virginia pp. 44. https://www.nano.gov/sites/default/files/pub_resource/NNI-2021-Strategic-Plan.pdf
  • Valachis, A., and C. Nilsson. 2015. Cardiac risk in the treatment of breast cancer: Assessment and management. Breast cancer. Vol. 7, 21–35.
  • Van Dorsselaer, A., C. Carapito, F. Delalande, C. Schaeffer-Reiss, D. Thierse, H. Diemer, D. S. McNair, D. Krewski, N. R. Cashman, and J.-L. Darlix. 2011. Detection of prion protein in urine-derived injectable fertility products by a targeted proteomic approach. PloS one 6 (3):e17815. doi:10.1371/journal.pone.0017815.
  • Verweij, M. 2009. Moral principles for allocating scarce medical resources in an influenza pandemic. J Bioeth Inq 6 (2):159–69. doi:10.1007/s11673-009-9161-6.
  • Viscusi, W. K. 2000. Risk Equity. Journal of Legal Studies 29 (S2):843–71. doi:10.1086/468097.
  • Wagner, R., E. Hildt, E. Grabski, Y. Sun, H. Meyer, A. Lommel, B. Keller-Stanislawski, J. Müller-Berghaus, and K. Cichutek. 2021. Accelerated development of COVID-19 vaccines: Technology platforms, benefits, and associated risks. Vaccines 9 (7):747. doi:10.3390/vaccines9070747.
  • Wang, N., P. Xu, Y. Liu, P. Zhao, J. Ruan, Y. Zheng, J. Jin, S. Wang, J. Yao, D. Xiang, et al. 2020. Efficacy and safety of thalidomide for chemotherapy-induced nausea and vomiting. J Cancer 11 (15):4560–70. doi:10.7150/jca.45678.
  • Watson, O. J., G. Barnsley, J. Toor, A. B. Hogan, P. Winskill, and A. C. Ghani. 2022. Global impact of the first year of COVID-19 vaccination: A mathematical modelling study. Lancet. Infectious Diseases S1473-3099 (1422):00320–26.
  • Webler, T., and S. Tuler. 2021. Four decades of public participation in risk decision making. Risk Anal. 41 (3):503–18. doi:10.1111/risa.13250.
  • Weihrauch, M. R., and V. Diehl. 2004. Artificial sweeteners—do they bear a carcinogenic risk? Annals of Oncology 15 (10):1460–65. doi:10.1093/annonc/mdh256.
  • Weinstein, M. C., and W. B. Stason. 1977. Foundations of cost-effectiveness analysis for health and medical practices. New England Journal of Medicine 296 (13):716–21. doi:10.1056/NEJM197703312961304.
  • Wheeler, D., M. MacGregor, F. Atherton, K. Christmas, S. Dalton, M. Dusseault, G. Gagnon, B. Hayes, C. MacIntosh, I. Mauro, et al. 2015. Hydraulic fracturing – Integrating public participation with an independent review of the risks and benefits. Energy Policy 85:299–308. doi:10.1016/j.enpol.2015.06.008.
  • WHO: World Health Organization 2016. Immunization, vaccines and biologicals: addressing vaccine hesitancy, World Health Organization. Available from https://www.who.int/teams/immunization-vaccines-and-biologicals (Accessed July 15, 2022).
  • WHO: World Health Organization 2021. Review of evidence on health aspects of air pollution: REVIHAAP project: Technical report, World Health Organization. Regional Office for Europe. Available from https://apps.who.int/iris/handle/10665/341712 (Accessed July 15, 2022).
  • WHO: World Health Organization 2022. WHO Coronavirus (COVID-19) Dashboard. from https://covid19.who.int/. (Accessed July 15, 2022).
  • Yu, H., S. Cauchemez, C. A. Donnelly, L. Zhou, L. Feng, N. Xiang, J. Zheng, M. Ye, Y. Huai, Q. Liao, et al. 2012. Transmission dynamics, border entry screening, and school holidays during the 2009 influenza A (H1N1) pandemic, China. Emerging Infect. Dis. 18 (5):758–66. doi:10.3201/eid1805.110356.
  • Zambon, M. C. 1999. Epidemiology and pathogenesis of influenza. Journal of Antimicrobial Chemotherapy 44 (Suppl 2):3–9. doi:10.1093/jac/44.suppl_2.3.
  • Zeckhauser, R. J., and W. K. Viscusi. 1996. The risk management dilemma. Annals of the American Academy of Political and Social Science 545 (1):144–55. doi:10.1177/0002716296545001015.
  • Zhang, J., S. Liu, J. Han, Z. Wang, and S. Zhang. 2021. On the developmental toxicity of silver nanoparticles. Mater Des 203:109611. doi:10.1016/j.matdes.2021.109611.
  • Zhou, Y.-M., S.-J. An, E.-J. Tang, C. Xu, Y. Cao, X.-L. Liu, C.-Y. Yao, H. Xiao, Q. Zhang, F. Liu, et al. 2021. Association between short-term air pollution exposure and depression outpatient visits in cold seasons: A time-series analysis in northwestern China. Journal of Toxicology and Environmental Health A 84 (9):389–98. doi:10.1080/15287394.2021.1880507.
  • Zorrilla, C. 2017. The view from Puerto Rico – Hurricane Maria and its aftermath. New England Journal of Medicine 377 (19):1801–03. doi:10.1056/NEJMp1713196.