678
Views
3
CrossRef citations to date
0
Altmetric
Research Article

The Impact of Avalanche Education on Risk Perception, Confidence, and Decision-Making among Backcountry Skiers

ORCID Icon, ORCID Icon & ORCID Icon
Received 22 Apr 2021, Accepted 18 Feb 2022, Published online: 19 Apr 2022

Abstract

With the burgeoning popularity of winter backcountry leisure, there has been an increased interest in implementing education to prevent avalanche related accidents. Yet little research has explored whether avalanche education actually improves avalanche risk awareness. The current study examined why participants enrolled in avalanche education, what they learned, and whether participation led to changes in risk perceptions, risk perception confidence, and decision-making. Backcountry skiers and snowboarders enrolled in an introductory avalanche course in Montana (N = 184, 47.28% female) completed surveys before and after the course that included randomized photos of regional avalanche terrain. Multi-level models demonstrated that participants became more conservative in their risk perceptions and their stated willingness to ski uncertain terrain between pre- and post-test. Perception confidence increased, with larger gains for women, novices, and risk averse skiers. The results provide preliminary evidence that avalanche education may impact risk perceptions and provide useful hands-on skills for winter backcountry recreationalists.

Introduction

A growing number of people are venturing out into the backcountry for winter recreation. Although data on the topic are sparse and precise quantification is challenging, Birkeland et al. (Citation2017) conservatively estimated an eightfold increase in winter recreationalists between 1995 and 2017 in the western US; the Covid-19 pandemic appears to have accelerated that growth (Peipert, Citation2021). As a leisure activity, backcountry skiing or “free-riding” as it is sometimes known, is appealing to those desiring an exciting form of winter recreation. Qualitative research has documented the inherent challenge and freedom involved in the sport, the social connections it facilitates, and the calming focus it brings which enables individuals to “reset” for their everyday lives (Frühauf et al., Citation2020; Mannberg et al., Citation2018). Furthermore, backcountry skiing or snowboardingFootnote1 may have physical health benefits. Previous literature suggests that downhill skiing can increase physical activity and has the potential to positively impact motor control as well as the cardiovascular and musculoskeletal system (Burtscher et al., Citation2018). Although backcountry riding can have numerous physiological, psychological, and social benefits, it can be considered a high-risk sport or adventure activity because of its potential for injury or even death (Breivik, Citation2010; Brymer & Feletti, Citation2020). One notable and dangerous aspect of the sport is that it exposes riders to avalanche terrain and consequently, fatal avalanche accidents.

Although rare, avalanches can have devastating and tragic consequences. Over the last ten years, on average 27 people are killed each year in avalanches in the US and many more are injured (Colorado Avalanche Information Center (CAIC), 2021); estimating non-fatal injuries, as well as partial or complete burials, is challenging because the vast majority of these non-fatal incidents go unreported (CAIC, 2021). The leading cause of death in US National Forests during wintertime, avalanches are caused by snowpack failures combined with decision-making errors. In 90% of avalanche accidents, either the victim themselves or a member of their party triggers the avalanche (Tremper, Citation2008). This direct connection between individuals’ actions and the avalanche event indicates that avalanche education could potentially reduce avalanche accidents by improving avalanche awareness among those with less technical knowledge of terrain and snowpack hazard.

Background: perceiving risk and making decisions in avalanche terrain

Avalanches are difficult to predict, relatively uncommon, and sometimes fatal. Riders are rarely provided opportunities to learn from their mistakes. As such, avalanche terrain has been termed a wicked learning environment due to the lack of direct feedback (see, e.g., Hogarth et al., Citation2015). Four factors must be present to precipitate a slab avalanche. First, the snowpack, which has fallen in layers and undergone metamorphism over time, must develop a layer of relatively weaker snow. Second, this layer of weaker snow needs to be located below a relatively stiffer snow layer above (i.e. the slab). This creates the required layer combination and interface on which the slab avalanche occurs. Third, the slope must be steep enough for the snow to overcome the friction within the snowpack. Generally those slopes are between 30° and 45° with 38° being the “bullseye” slope angle where avalanches are the most common (Tremper, Citation2008, p. 69). The fourth and final criteria is a “triggering event” that causes the slope to release. While this trigger can be a natural event (e.g. new snowfall, wind loading), in the case of accidents, often the trigger is the accident victim or a member of their party.

Backcountry riders face a tradeoff between the lure of untracked powder and the potential for an avalanche. When recreating in avalanche terrain, individuals must assess the perceived risk of a situation. Multiple frameworks across various disciplines explore the interplay between risk perception and decision-making. Decision heuristics—a form of mental process used in decision-making—are a critical way for people to reduce effort while making a decision to arrive at a satisfactory outcome or solution while conserving cognitive resources (Arkes & Blumer, Citation1985; Arnott, Citation1998; De Martino et al., Citation2006; Frame, Citation2012; Kahneman et al., Citation1982; Kahneman & Tversky, Citation1973; Slovic et al., Citation2005; Tversky & Kahneman, Citation1974, Citation1986). In the field of avalanche risk, the decision heuristics framework has dominated as found in post hoc accident analysis carried out by McCammon (Furman et al., Citation2010; Grímsdóttir & Mcclung, Citation2006; Haegeli et al., Citation2010, Citation2012; Johnson et al., Citation2016; Landrø et al., Citation2020; Landrø et al., Citation2020; McCammon, Citation2004, Citation2002, Citation2000, Citation2009).

Two research streams dominate the field of heuristics: the “heuristic and biases” approach - the study of systematic biases in decisions and, the “fast and frugal” program where heuristics are thought of as an effective and precise decision-making tool (Kahneman, Citation2011). Both recognize the limits of available information and mental processing in the effort to seek an acceptable decision (Gigerenzer & Gaissmaier, Citation2011; Grüne-Yanoff & Hertwig, Citation2016). Whereas the heuristics and bias program demonstrates circumstances under which heuristics trade off some accuracy for less effort (Tversky & Kahneman, Citation1974), the study of fast and frugal heuristics focus on the accuracy (or lack of) compared to rational comprehensive decision-making. The heuristics frame is appealing to avalanche educators and students because it reflects the real world of snowpack analysis. That is, risk of snowpack failure and a resultant avalanche is largely hidden and widely variable across space and time so complete and perfect information is elusive.

Photos are a useful tool to understand how individuals perceive of risks and make decisions in the backcountry. There is a broad literature in the field of outdoor recreation that uses a variety of visual methods to understand participants’ opinions, beliefs and behaviors (e.g., Cherem & Driver, Citation1983; Gill et al., Citation2015; Roberts et al., Citation2021; Zajchowski et al., Citation2019). Compared to long written descriptions, the use of photographs can increase standardization and improve ecological validity (Manning & Freimund, Citation2004), but attending to potential measurement biases is important (e.g., Gibson et al., Citation2014). With regard to avalanche-related decision-making, photos of backcountry riding capture some of the allure of the activity and, as such, they may be accompanied by feelings (e.g., of joy, excitement, anticipation, trepidation). Because these feelings may influence decision-making in avalanche terrain, these photos capture an important dimension that would be lost if the scenarios were just depicted using words. In avalanche science, Mannberg et al. (Citation2018, Citation2021) and Haegeli and Strong-Cvetich (Citation2020) and Haegeli et al. (Citation2020) used photos for discrete choice analysis, while Stephensen et al., Citation2021 examined question framing in avalanche terrain (Stephensen et al., Citation2021). The current study follows the approach of Stephensen et al. (Citation2021) that uses photos to examine how participants rate a photo from safe to risky, their confidence in their risk perceptions, and their stated willingness to ski a slope.

Understanding the impacts of avalanche education

In an effort to increase avalanche-related knowledge and promote safe decisions and behaviors in avalanche terrain, local and national organizations offer avalanche education courses. These vary in duration and depth of content that ranges from brief 1 to 2 hour avalanche awareness courses (e.g., Evening Awareness Class, Know Before You Go (https://kbyg.org/)) to the more time-intensive recreational and professional Avalanche Level 1 or Avalanche Level 2 courses. Individuals may enroll in these courses for various reasons (Balent et al., Citation2016) but the overarching goal of the recreational-focused avalanche education courses is to learn to recognize and travel safely through potentially hazardous terrain while recreating in the backcountry. These avalanche education courses represent a type of short intervention program (SIP); their purpose is to disseminate knowledge so that participants learn how to interpret relevant information about avalanches, and thereby make better choices in avalanche terrain. This approach differs from SIPs targeting other risky behaviors (e.g., drug use) that focus on eliminating all user behavior. Substantial evidence demonstrates the ineffectiveness of some of these programs that tell participants to “just say no” (e.g., D.A.R.E.) or engage in “scared straight” tactics (Petrosino et al., Citation2000, Citation2005; West & O’Neal, Citation2004). The goal of avalanche education differs markedly from these approaches as the goal is not to prevent use of backcountry terrain. Instead, by emphasizing when and under what conditions individuals can recreate in possible avalanche terrain, education may actually facilitate increased opportunity to recreate safely in this setting (see Haegeli et al., Citation2020 who make a similar point when discussing avalanche airbags). Therefore, one of the goals of avalanche education is to provide tools to enable, rather than restrict, backcountry leisure activities.

Relatively little research has explored whether and how avalanche education courses may impact participants. Some researchers have argued that despite the increased number of winter recreationalists in the backcountry, the work of avalanche educators and the availability of avalanche information and education to the public have contributed to the declining avalanche fatality rate over the past few decades (Birkeland et al., Citation2017). While this seems plausible, there is limited quantitative evidence to support this, or to provide insight on the relative contributions from these various sources. Avalanche education courses may influence participants’ risk perceptions, beliefs, or behaviors; the assumption is that individuals become more risk averse and safety-oriented, but this is uncertain. Supporting this possibility, one study found that backcountry riders who had participated in an avalanche safety course were more likely to carry avalanche safety gear while recreating than those who had not taken a course (Nichols et al., Citation2018). Another cross-sectional study found that individuals who had participated in formal avalanche education were less likely to accept to ski a risky route in a hypothetical case, than those who had not received formal education (Mannberg et al., Citation2018). By identifying differences between individuals with formal avalanche education and those without, these studies suggest the possibility that avalanche education may have a positive impact on participants with respect to recognizing and minimizing risk. Yet it is also possible that selection factors or preexisting differences may be responsible for these associations. That is, people who enroll in avalanche education courses may hold qualitatively different risk behaviors from those who do not enroll (e.g., those who seek out education may be more risk averse or engage in safer behaviors in the first place, or vice versa). One study did use a pre-post test design with follow-up to examine the impact of the Avaluator decision support tool combined with avalanche education curriculum (Haegeli & Haider, Citation2008). The results documented increases in assessment confidence and evidence of improved decision-making skills as indicated by a higher correlation between participants’ seriousness assessment and the obvious clue method at post-test.

Although education programs may have positive benefits, it is also important to recognize that a short-term avalanche education program may be insufficient to have any measurable impact on participants. Just because a curriculum or program is widespread or accepted by educators does not mean that it works, or that it is as effective as it could be. Indeed, the educational program might even have iatrogenic—or inadvertent deleterious—effects on participants (Petrosino et al., Citation2000). With regard to avalanche education, an example of an iatrogenic effect would be if program participation caused individuals to be excited about skiing more risky slopes or overconfident in their abilities to mitigate the avalanche hazard, thereby causing them to make riskier decisions in the backcountry. Empirically testing and describing what individuals learn in avalanche education is needed to build the evidence-base for the avalanche education field, and document any possible beneficial or detrimental impacts.

Study aims

Drawing from a sample of participants in the US state of Montana, the current study sought to better understand the possible impacts of avalanche education (see for the related logic model).

Figure 1. Logic model for avalanche education.

Figure 1. Logic model for avalanche education.
  • Aim 1: Examine reasons for enrolling in the course and identify what participants learned from the course.

  • Aim 2: Test whether avalanche risk perception, related confidence, or decision-making changed as a result of participating in the course.

  • Aim 3: Identify whether risk perception and perception confidence predict avalanche-related decision-making.

  • Aim 4: Explore whether changes (in perception, confidence, or decision-making) differed by gender, backcountry experience, risk attitudes, and program engagement.

Methods

Procedure

Eligible participants were enrolled in Avalanche Fundamentals, an avalanche safety course offered in southwestern Montana delivered by a local nonprofit organization (Friends of the Gallatin National Forest Avalanche Center). The course covers avalanche terrain, weather and snowpack, decision-making, and rescue. It is accessible to individuals with no experience in the backcountry as well as more experienced riders. Content was delivered online via Zoom® through two classroom sessions (2 hours each) as well as 1 in-person field day (6 hours) for a total of 10 instructional hours. Thus, the course provided more instructional time than a typical 2–3 hour awareness course, but much less than the 20–24 hours for a Level 1 recreational course. The field day for Avalanche Fundamentals was socially distanced due to the Covid-19 pandemic and it occurred on a weekend day within 1–2 weeks of the classroom sessions. During the 2020–2021 season, Avalanche Fundamentals was offered twice, once in December 2020, and once in January 2021.

After obtaining an email list of enrollees, our research team sent personalized emails to participants during the week prior to the start of the course. We described the study and included a link to the survey (the “pre-survey”) via the online survey platform Qualtrics®. Approximately 3–5 days after their scheduled field day (which represents the culmination of the course), participants were emailed a link to the second survey (the “post-survey”). A subsequent follow-up email was sent to encourage participation. To incentivize participation, respondents were entered into a raffle drawing for one of 15 $100 gift certificates to a local ski and outdoor retail shop. All procedures were approved and deemed exempt by the university’s Institutional Review Board (IRB #KG111620-EX). Surveys took about 10 minutes to complete and covered a variety of topics including risk perceptions, risk attitudes, background characteristics, reasons for enrolling (pre-survey), and information learned (post-survey).

The initial pre-survey was completed by 300 people. Because of our interest in how course participation impacted participants, we limited our analysis sample to those participants who provided their email address and completed both pre- and post-surveys (N = 198). Multivariate logistic regression analyses demonstrated that those who completed both the pre and post surveys did not differ from those who completed only the presurvey in terms of gender, race, preferred mode of travel in the backcountry or backcountry experience; however, age was negatively associated with attrition (OR = .96). Older participants were more likely to complete the post-survey (with a median age of 31.8 in the retained sample, compared with 30.9 in the larger participant cohort).

Of the participants who completed both the pre- and post-surveys, we limited our sample to individuals who reported at the pretest that their primary mode of backcountry travel was skiing or snowboarding (omitting 10 snowmobilers who viewed different photos and 3 snowshoers who viewed no snowshoe-specific photos). After omitting one participant for missing data on backcountry experience, our sample consists of one hundred and eighty-four nonmotorized backcountry riders who completed both surveys and were not predominantly snow shoers.

The sample was primarily comprised of backcountry skiers (83.7%); however, 16.3% identified snowboarding as their primary mode of winter travel. Participants ranged in age from 12 to 69 years of age (M = 31.7, SD = 11.5) and slightly over half of participants (52.7%) were male. Most participants were non-Hispanic White (94.0%) while smaller percentages self-identified as Asian American (1.6%), multiracial (2.7%) or Hispanic/Latinx (1.6%). In addition, 24.5% reported no backcountry experience, 52.7% reported being novices, 17.9% were intermediate backcountry skiers and 4.9% self-identified as experts. Previous studies have surveyed the wider population of backcountry users resulting in more experienced respondents (Hendrikx et al., Citation2016; Johnson & Hendrikx, Citation2021; Mannberg et al., Citation2018; Mannberg et al., Citation2021) whereas we targeted students in an introductory course, many of whom have little backcountry experience.

Measures

Risk perception, perception confidence, and decision-making

At both pre- and post-test a series of seven photos of regional avalanche terrain were presented in a randomized order. The photos were chosen by the authors and designed to capture varying levels of avalanche risk. Each photograph was accompanied by a brief statement describing the slope angle, the regional avalanche danger rating (held constant at “moderate”), and the snow conditions. For example, if the caption indicated a 42° slope, and current conditions indicated 2–4” of new snow, then the photo was consistent with this description with a slope that looked to be at about 42°, and for instance not snowing spring/firm conditions. Where photos were from the authors’ personal collection, recorded slope angles, and snow conditions were used to guide the photo caption to ensure that the photo captions matched the observed conditions as closely as possible. Furthermore, photos were independently calibrated on the scale from 0 (Totally Safe) to 7 (Very Dangerous) by the authors prior to the initiation of data collection.

For each scenario, participants rated the risk of the slope, their confidence in their rating, and whether they would ski the slope. For risk perception, participants were asked, “How would you rate the risk of this slope?” on a scale from 0 (Totally Safe) to 7 (Very Dangerous). Subsequently, they were asked “How confident are you in your rating?” and responded a scale from 1 (Not Confident) to 7 (Very Confident). Then participants were asked “Would you ski this slope?” with yes and no response options. presents an example photo – which corresponded to scenario 2. The other 6 photos that were used appear in Appendix A.

Figure 2. Example photo for survey risk perception: scenario 2.

Figure 2. Example photo for survey risk perception: scenario 2.

Scenario type

The photos were classified into three categories: risky (2 photos), safe (2 photos) and uncertain (3 photos). In the multivariate models, uncertain and risky photos are compared to safe photos (the reference category). The word “uncertain” captures the participants’ perspective, as these photos are not clearly at either end of the safer or riskier continuum; they were chosen because of their ambiguity in regards to avalanche risk.

Reasons for taking the course

At pretest, participants were asked “What are your reasons for taking Avalanche Fundamentals?” Following Balent et al. (Citation2016), a list of eight possible reasons for taking the course was presented to participants (see ). The order of the reasons was randomized and participants could choose all that applied. An additional write-in option allowed respondents to identify other reasons for enrolling.

Table 1. Reasons for enrolling in avalanche fundamentals (N = 184).

Skills learned

Participants were asked, What are three important things that you learned from this course?” Open-ended responses were reviewed by two researchers and categorized into six groupings.

Background characteristics

Participants reported their gender identification (female, male or nonbinary/another gender). Prior work documents that most avalanche fatalities are men (Jekich et al., Citation2016; Peitzsch et al., Citation2020), and women have less confidence in their avalanche-related decision-making (McCammon, Citation2009; Volken et al., Citation2007). Furthermore, examining backcountry experience is important because novices and experts weigh avalanche information differently (Burkeljca, Citation2013; Hallandvik et al., Citation2017). Participants identified their experience by selecting from four options: No experience backcountry skiing; novice with a little experience traveling in backcountry avalanche terrain; intermediate with a few years (i.e. <5 years) experience; or expert with many years (i.e. >5 years) of backcountry experience. These categories were combined and dichotomized such that participants with five or more years of experience were compared to those with fewer than five years of experience.

Risk attitudes

Risk-taking in skiing and snowboarding has been examined through a variety of survey methods including single-item measures, scales related to the sport, general scales (i.e., not sport specific) and even person-centered analyses (Haegeli et al., Citation2012; Thomson et al., Citation2012). In the current study, we used a single item that has shown to influence decision-making across a variety of settings (Dohmen et al., Citation2011). We included the context-specific risk question because research demonstrates that context-specific questions have more predictive power than a general question when interested in a specific context such as skiing. Participants were asked, “When it comes to riding or snowmobiling, how willing or unwilling are you to take risks? 0 means that you are completely unwilling to take risks, and 10 means that you are very willing to take risks.” This question was used because of our interest in risk-taking during backcountry skiing; research indicates that risk-seekers prefer to ski riskier routes (Mannberg et al., Citation2021).

Participant engagement

Participant engagement is a multi-dimensional construct that includes the emotional affect, cognitions, and behaviors connecting the participants to a program (Mackenzie et al., Citation2018; Roth & Brooks-Gunn, Citation2016). Outdoor education can bring about optimal “flow” experiences and promote intrinsic motivation because participants are challenged, focused, and enjoying their activities (Mackenzie et al., Citation2018). In the current study, to measure engagement, participants read the following instructions, “These next questions are about the Avalanche Fundamentals program. Please tell us your honest opinions.” They were subsequently presented with three statements “I learned new things from the program,” The program kept my attention”, and “I’m glad I participated in the program,” each of which they rated on a scale from 1 (Strongly Agree) to 7 (Strongly Disagree). These items were reverse-coded and averaged such that higher scores indicated more engagement (Chronbach’s alpha = .77).

Analytical approach

To address aim 1, we used content analysis to examine why participants enrolled in the program and the most important lessons or skills that they learned from participation. Content analysis is a flexible analytical strategy compatible with quantitative and qualitative as well as inductive and deductive approaches (Cho & Lee, Citation2014; Krippendorff, Citation2018; Neuendorf, Citation2017). To analyze what the participants learned, two researchers read the responses, created a set of six categories, coded each response independently, and came to consensus. A third coder provided input on unclear discrepant responses. Code frequencies were tabulated.

To address aim 2, we conducted multivariate multilevel models examining the association between time (pre- versus post-test), gender, backcountry experience, risk attitudes, and the outcomes of interest. Because we expected that changes in perception and willingness to ski might depend on the level of danger depicted in the scenario, we tested the interaction between time and scenario danger (i.e., safe, uncertain, risky) and included it whenever it was statistically significant. Multi-level models are appropriate for the current clustered dataset. These models allow for the clustering of photos (at Level 1) within individual participants (at Level 2) and account for the associated correlated errors (Hoffman, Citation2015; Raudenbush & Bryk, Citation2002).Footnote2 We calculated effect size (f2) for risk perception and confidence after using the variance explained (R2) equation for multi-level models provided by Snijders and Bosker (Lorah, Citation2018; Snijders & Bosker, Citation2012). Subsequently we included risk perception and perception confidence into the model predicting decision-making (i.e., willingness to ski the slope), to address aim 3. Finally, to address aim 4 we tested interactions between time and possible moderators (i.e., gender, backcountry experience, risk attitudes, program engagement) by including them separately in models. Linear regressions were computed for risk perception and perception confidence and logistic regressions were computed when the outcome was dichotomous (i.e., to ski/not ski a slope). We considered probability values of <.05 to be statistically significant.

Results

Reasons for participating and skills learned

The various reasons why individuals enrolled in the program are described in . About three quarters of participants noted that they hoped to gain confidence in avalanche terrain (78.8%), improve decision-making (76.6%), learn more about terrain management in avalanche terrain (75.5%), and learn about the snowpack (72.8%). Many also wanted to be a stronger member of their ski/riding group (69.6%).

After completing the course, participants reported three important things they learned in an open-ended response. 143 individuals (78% of the sample) answered this question and reported learning one or more items. Descriptions were segmented into individual items that represented a singular idea (Nitems = 416). Responses fell into six categories: Terrain Assessment (e.g., slope angle/measurement, route management), Snowpack Assessment and Forecast (e.g., digging/testing snowpits, layers), Rescue Skills (e.g., using beacons, searching, digging), Human Factors and Decision-making (partners, communication, decision-making), Weather, and Other Skills/Terminology/General Statements.

displays the proportions and frequencies of these six categories and provides corresponding example quotes from participants. Participants frequently pointed to hands-on skills that they had acquired through participation in the field day. For example, they not only learned about the slope at which avalanches are likely to occur (30–45 degrees), but they also learned the hands-on skill of using an inclinometer to estimate a slope prior to skiing it. Likewise, participants described learning to test the layers of the snow and check for instability before skiing or riding by digging a snowpit and executing a “compression test” most commonly the Extended Column Test (ECT). Supporting the value of the practical and applied nature of the field day, one participant noted, “I wanted and received hands on experience digging snow pits and evaluating the snowpack.” Furthermore, participants not only learned skills and knowledge (through both traditional and experiential methods), but some acquired new values and articulated their intent to participate in particular safety behaviors in the future. As one participant described, “I will need to continually practice beacon rescue so that I will be able to do it by muscle memory if in a scenario in which performing a beacon search is necessary.” This quote indicates that the participant has internalized the importance of a particular behavior (beacon practice) and views this future behavior as a necessary component of their backcountry skiing experience because it will be useful should they ever have a ski partner that has been buried by an avalanche and needs to be rescued. Taken together, the responses indicate that participants felt as though they had gained knowledge and skills related to perceiving avalanche risk as well as how to use their gear to locate and dig out partners should an avalanche occur.

Table 2. What individuals learned from avalanche fundamentals.

Risk perceptions, perception confidence, and decision-making

Central to safe riding in avalanche terrain is the ability to correctly recognize hazardous slopes under specific conditions, such that one’s risk perception is in line with the objective level of risk posed by the slope. Further, in the face of anticipation, one must be able to express the self-control needed to weigh the risk/reward and make a prudent decision based on the risk perception, and have confidence in that perception. Introductory avalanche courses introduce attendees to the basics of terrain awareness and judicious decision-making, and they aim to improve risk perception.

The results demonstrated that with respect to risk perception, participants identified uncertain and risky scenarios as more dangerous than safe scenarios (see , column 1). Furthermore, there was a Time X Scenario interaction. The change from pre- to post test in risk perception depended on the scenario type. For safe scenarios, participants reported lower perceived risk at post-test whereas for uncertain and risky scenarios participants reported higher perceived risk at post-test. Approximately 29% of the variance in risk assessment could be attributed to the time (pre-post), scenario type, and the interaction between the two. This indicates a medium-to-large effect size, f2 (Cohen, Citation1992).

Table 3. Multi-level linear regression models predicting risk perception, perception confidence, and willingness to ski.

In addition to changing how they assessed risk, participants altered their confidence in their risk perceptions of the photographed avalanche terrain. Across all scenario types, participants reported being substantially more confident in their perception at post-test than they were at pretest. Time (i.e., pre versus post-test) explained 35% of the variance in confidence; the f2 value of .35 indicates that the program had a “large” effect on confidence according to standard guidelines (Cohen, Citation1992). In addition, participants were less confident in their perception of uncertain and risky scenarios compared to safe scenarios (, column 2).

Backcountry experience was also strongly associated with perception confidence; those who had 5 or more years in the backcountry were more confident than those who had little or no backcountry experience. Furthermore, people who self identified that they were more likely to take risks while skiing also reported being more confident in their risk perception.

Participants were less likely to report that they would ski uncertain or risky slopes depicted in the photographs. However, there was a Time X Scenario interaction (, column 3). Participants decreased their willingness to ski uncertain slopes over time, but there was evidence that they increased their willingness to ski safe slopes (model not shown). This interaction was no longer significant when risk perception and perception confidence were included in the model. As shown in , column 3, a higher perceived risk of the slope was associated with a lower likelihood of being willing to ski the slope. Confidence in one’s risk perception was associated with a higher likelihood of intending to ski the slope. Gender and experience were associated with the decision to ski the slope. Men and more experienced riders were more likely to decide to ski the slope than women and less experienced riders.

Examining differential program impact

To identify whether program impacts were consistent or varied by individual characteristics, we tested a series of interactions. These results demonstrated that increases in perceived risk from pretest to post-test were larger for individuals who were more engaged in the program (b = .427, s = .155, p < .01). Furthermore, perception confidence depended on a number of individual characteristics (see ). Novices gained more confidence than more experienced riders and women gained more confidence than men. Those who were more risk averse gained more confidence than risk takers and those who were more engaged in the program gained more confidence than those who were less engaged.

Table 4. Multi-level linear regression models predicting perception confidence.

Specification tests

We conducted specification tests and recomputed the main risk perception and confidence models using ordinal logistic regressions and the substantive findings remained the same. In addition, because one participant was nonbinary, there was insufficient sample size for this category. Classifying this individual as another gender did not impact the substantive results.

Discussion

Drawing from a community sample of participants attending Avalanche Fundamentals an avalanche education course in Montana, the current study suggests that an introductory program may have some important impacts on how participants evaluate terrain and perceive risk in the backcountry, and how they make decisions aimed at mitigating that risk. Furthermore, participants reported learning a variety of hands-on skills that may be useful to them during their backcountry pursuits. These are positive outcomes for avalanche education where the aim is to enable safe and appropriate use of terrain rather than simply restrict all use.

A primary goal of the current study was to understand whether participants perceived photographs of terrain-based risk with limited snowpack information differently after participating in the course. We found clear evidence that participants’ perceptions changed. For scenarios in which the avalanche danger was uncertain or in which there was a high risk of avalanches, participants evaluated the situations as more dangerous after the course. Thus, course attendance was associated with more conservative ratings of the risk of those photos. For safe scenarios, participants correctly assessed the scenario as safer after the class than they had before the class. Taken together, these findings suggest that participants learned new information about potentially risky terrain and the related avalanche hazard, and they could apply this information to novel scenarios. Further, confidence in their decision-making was enhanced after participation in the course. By exploring change over time, the current findings extend the existing literature that has primarily looked at associations between level of avalanche education and avalanche safety practices (Balent et al., Citation2016; Fitzgerald et al., Citation2016; Hendrikx et al., Citation2016; Hendrikx & Johnson, Citation2014, Citation2016; Mannberg et al., Citation2018; McCammon, Citation2004, Citation2000; Sykes et al., Citation2020; Tremper, Citation2008).

In general, the decision to ski the slope corresponded to changes in risk perception. Participants were less likely to report that they would ski uncertain scenarios and more likely to ski safe scenarios than they were at pretest. These are mostly reassuring results, given the possibility of iatrogenic effects associated with avalanche education. It would be problematic if course attendance gave participants a false sense of security or protection. This relates to the idea of risk compensation – that is, when individuals perceive themselves to have lower risk (due to education, experience, safety equipment) they may engage in additional risks to compensate for the perceived increase in their margin of safety (Hedlund, Citation2000; Thompson et al., Citation2001). A large body of literature has examined risk compensation (Thompson et al., Citation2001; Wilde, Citation1998), and support for this idea is mixed. Within the field of avalanche science, research demonstrates that a specific segment of backcountry and out-of-bounds skiers—the risk seekers—may actually engage in riskier behaviors if they are given airbags, a tool to reduce avalanche deaths (Haegeli et al., Citation2020). In our study, we do not find evidence that education results in riskier behaviors. On the whole, participants rated riskier and uncertain scenarios as more dangerous after having attended the course and they were more conservative/less likely to ski the slopes in these scenarios.

Before participants enrolled in the course, they hoped to gain confidence in avalanche terrain. They wanted to be able to recognize hazards, mitigate them, and continue on their tour with the confidence that they had made a good decision. In line with this reason for attending, our results indicated substantial and consistent change in participants’ confidence in their risk perception. Across all scenarios, individuals reported that they had more confidence after having attended the course. In some ways this could be considered a positive outcome. Yet, it is important to remember – especially in any extreme sport or leisure activity – that confidence can be a double-edged sword. Some confidence is a good a thing, but too much – or overconfidence—could be problematic (Groves & Varley, Citation2020). Related to this idea is the finding that risk attitudes predicted perception confidence. This may be because people who are willing to take risks on the mountain are confident (and perhaps overconfident) in their abilities; they think they are good at assessing terrain and avalanche risk and they believe in their likelihood of successfully skiing a slope.

Interestingly, beginners gained much more confidence in their perception than experienced backcountry enthusiasts. At pre-test, less experienced backcountry riders reported less confidence than experienced backcountry riders. By post-test, both groups reported similar confidence in their perceptions. On one hand this is an expected outcome. If students started with little confidence, then new information and training should boost confidence to new levels. The downside is that such confidence may be a manifestation of the Dunning Kruger effect whereby inexperienced participants do not realize how much knowledge is required to make quality decisions. For instance, Balent et al. (Citation2016) used personal interviews with participants who completed an avalanche Level 1 course and found that attendees gained confidence but also expressed uncertainty about their ability to apply lessons from the classroom into the field (Balent et al., Citation2016). Importantly, those who completed the course, but had not yet ventured into the backcountry afterward, demonstrated greater confidence than those who had been out in the backcountry and thus better recognized the challenges involved in applied decision-making.

In terms of who changed the most as a result of participation, our findings suggest that individuals who were more engaged benefited the most. Those who were engaged in the course material – enjoying it and paying attention—gained more confidence than those who were less engaged, emphasizing the importance of providing programming material that keeps participants’ attention and is appropriately challenging. Furthermore, women and novices gained the most confidence in their ability to perceive avalanche risk. For instance, female participants started from a lower level of confidence before the class, but reported confidence similar to men after taking the course. These findings may be useful for avalanche educators seeking to target specific groups and develop tailored and evidence-based programming.

Limitations

Our findings should be interpreted in light of some limitations. The sample was drawn from attendees of a class in Southwestern Montana and therefore results may not generalize to participants attending other classes or classes in other regions utilizing a different curriculum. Nonetheless, because the majority of avalanche deaths in the US occur in the Mountain West region (i.e., Colorado, Idaho, Montana, Utah and Wyoming), this is an appropriate location for an initial study (CAIC, 2021). Another limitation relates to the photos. We purposefully used regional photos so that the scenery and topography would be context specific, and similar to what participants could experience on their backcountry excursions. Nonetheless, these photos differed in a variety of ways that might influence perceptions including photo angle (top of slope, mid slope, etc.) and weather conditions (clear blue sky, cloudy, etc.). Studies in outdoor recreation often control for as many variables as possible to isolate individual factors that are hypothesized to be important (Gibson et al., Citation2014); however, we did not isolate different aspects of the photo scenarios. Additional research is thus needed using a more elaborate design and more participants that systematically varies incline, slope characteristics, danger rating, and new snow to help researchers better understand the most salient factors that drive risk perception and decision-making. Furthermore, we used the same photo scenarios twice to measure change. Future research could consider substituting new, comparable images at pre- or post-test to determine change in risk perceptions; however, this approach would require additional testing to establish the measurement equivalence of the scenarios. In addition, the avalanche research community could cooperate to build a comprehensive library of representative photos to standardize the representation of risky terrain. Another limitation of the current study is the pre- post-test design. Although this design enables us identify change, randomized controlled trials or quasi-randomized designs that include a control group would be necessary to provide clear evidence of program effectiveness (Mihalic & Elliott, Citation2015). However, it would have been premature to conduct a randomized controlled trial or a more rigorous longitudinal evaluation if students do not demonstrate any short-term gains from the program.

Conclusions

Researchers have noted that the increase in backcountry use combined with a stable rate of avalanche fatalities should be considered a “big win” for avalanche educators and education in this domain. Yet, to date, avalanche education has lacked systematic evidence-based information with respect to efficacy. Our study is one of the first to examine what people learn in avalanche education and whether participation is associated with beneficial or harmful outcomes. We demonstrate that individuals gain skills and knowledge that may lead to improvements in risk perception, increased confidence, and safer decisions. Yet, this research is still in its infancy and program evaluation across a range of formats (e.g., awareness, Avalanche Level 1) is needed. Furthermore, important questions remain about the role of emotion in decision-making and whether program participation may lead individuals to become overconfident in their ability to assess the subtleties of terrain and snowpack. Likewise, it is possible that education may increase cumulative exposure to avalanche terrain by enabling individuals to spend more time in the backcountry and seek out more advanced terrain. Thus, the question remains whether the improvements in skills and risk perceptions obtained in avalanche education are sufficient to offset any additional exposure over time. As winter backcountry recreation becomes more popular, adventure sport participants are increasingly enrolling in avalanche education courses. Continued research is needed exploring how these avalanche education courses shape cognitive processes, risk-taking propensity, and behaviors during backcountry leisure pursuits.

Supplemental material

Supplemental Material

Download MS Word (1.5 MB)

Acknowledgments

The authors would like to thank the Friends of the Gallatin National Forest Avalanche Center as well as the Avalanche Fundamentals participants who completed our surveys.

Disclosure statement

The authors declare that they have no potential conflict of interest.

Additional information

Funding

This study was supported by a Scholarship and Creativity grant from Montana State University.

Notes

1 Winter backcountry recreation may include skiing, snowboard riding, snowmobiling, and those traveling on snowshoes. The current study focuses on backcountry skiers and snowboarders who we refer to as “riders.”

2 We did not include a random intercept for photo because the variance component was extremely close to zero, suggesting that the addition of a random intercept was not necessary.

References

  • Arkes, H. R., & Blumer, C. (1985). The psychology of sunk cost. Organizational Behavior and Human Decision Processes, 35(1), 124–140. https://doi.org/10.1016/0749-5978(85)90049-4
  • Arnott, D. (1998). A taxonomy of decision biases. School of Information Management and Systems.
  • Balent, C., Johnson, J., Hendrikx, J., & Shanahan, L. (2016). Student motivations and learning objectives before and after a level one avalanche course. Proceedings of the International Snow Science Workshop, 1054–1056.
  • Birkeland, K. W., Greene, E. M., & Logan, S. (2017). In response to avalanche fatalities in the United States by Jekich et al. Wilderness & Environmental Medicine, 28(4), 380–382. https://doi.org/10.1016/j.wem.2017.06.009
  • Breivik, G. (2010). Trends in adventure sports in a post-modern society. Sport in Society, 13(2), 260–273. https://doi.org/10.1080/17430430903522970
  • Brymer, E., & Feletti, F. (2020). Beyond risk: The importance of adventure in the everyday life of young people. Annals of Leisure Research, 23(3), 429–446. https://doi.org/10.1080/11745398.2019.1659837
  • Burkeljca, J. (2013). Shifting audience and the visual language of avalanche risk communication. Proceedings of the International Snow Science Workshop Grenoble, 415–422.
  • Burtscher, M., Federolf, P. A., Nachbauer, W., & Kopp, M. (2018). Potential health benefits from downhill skiing. Frontiers in Physiology, 9, 1924. https://doi.org/10.3389/fphys.2018.01924
  • Cherem, G. J., & Driver, B. L. (1983). Visitor employed photography: A technique to measure common perceptions of natural environments. Journal of Leisure Research, 15(1), 65–83. https://doi.org/10.1080/00222216.1983.11969541
  • Cho, J. Y., & Lee, E.-H. (2014). Reducing confusion about grounded theory and qualitative content analysis: Similarities and differences. Qualitative Report, 19(64), 1-20.
  • Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
  • De Martino, B., Kumaran, D., Seymour, B., & Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science (New York, N.Y.), 313(5787), 684–687. https://doi.org/10.1126/science.1128356
  • Dohmen, T., Falk, A., Huffman, D., Sunde, U., Schupp, J., & Wagner, G. G. (2011). Individual risk attitudes: Measurement, determinants, and behavioral consequences. Journal of the European Economic Association, 9(3), 522–550. https://doi.org/10.1111/j.1542-4774.2011.01015.x
  • Fitzgerald, K., Kay, J., Hendrikx, J., & Johnson, J. (2016). Backcountry and sidecountry users: An intercept survey approach.Proceedings of the International Snow Science Workshop, Breckenridge, CO, 1057–1063.
  • Frame, J. D. (2012). Framing decisions: Decision-making that accounts for irrationality, people and constraints. John Wiley & Sons.
  • Frühauf, A., Zenzmaier, J., & Kopp, M. (2020). Does age matter? A qualitative comparison of motives and aspects of risk in adolescent and adult freeriders. Journal of Sports Science & Medicine, 19(1), 112–120.
  • Furman, N., Shooter, W., & Schumann, S. (2010). The roles of heuristics, avalanche forecast, and risk propensity in the decision making of backcountry skiers. Leisure Sciences, 32(5), 453–469. https://doi.org/10.1080/01490400.2010.510967
  • Gibson, A. W., Newman, P., Lawson, S., Fristrup, K., Benfield, J. A., Bell, P. A., & Nurse, G. A. (2014). Photograph presentation order and range effects in visual-based outdoor recreation research. Leisure Sciences, 36(2), 183–205. https://doi.org/10.1080/01490400.2013.862886
  • Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review Psychology, 62(1), 451–482. https://doi.org/10.1146/annurev-psych-120709-145346
  • Gill, N., Dun, O., Brennan-Horley, C., & Eriksen, C. (2015). Landscape preferences, amenity, and bushfire risk in New South Wales, Australia. Environmental Management, 56(3), 738–753. https://doi.org/10.1007/s00267-015-0525-x
  • Grímsdóttir, H., & Mcclung, D. (2006). Avalanche risk during backcountry skiing–An analysis of risk factors. Natural Hazards, 39(1), 127–153. https://doi.org/10.1007/s11069-005-5227-x
  • Groves, M. R., & Varley, P. J. (2020). Critical mountaineering decisions: Technology, expertise and subjective risk in adventurous leisure. Leisure Studies, 39(5), 706–720. https://doi.org/10.1080/02614367.2020.1754887
  • Grüne-Yanoff, T., & Hertwig, R. (2016). Nudge versus boost: How coherent are policy and theory? Minds and Machines, 26(1-2), 149–183. https://doi.org/10.1007/s11023-015-9367-9
  • Haegeli, P., & Haider, W. (2008). Evaluating the Avaluator—First reflections on the Canadian decision aid. Proceedings of the International Snow Science Workshop, Whistler, CA, 455–464.
  • Haegeli, P., & Strong-Cvetich, L. R. (2020). Using discrete choice experiments to examine the stepwise nature of avalanche risk management decisions: An example from mountain snowmobiling. Journal of Outdoor Recreation and Tourism, 32, 100165. https://doi.org/10.1016/j.jort.2018.01.007
  • Haegeli, P., Gunn, M., & Haider, W. (2012). Identifying a high-risk cohort in a complex and dynamic risk environment: Out-of-bounds skiing-an example from avalanche safety. Prevention Science: The Official Journal of the Society for Prevention Research, 13(6), 562–573. https://doi.org/10.1007/s11121-012-0282-5
  • Haegeli, P., Haider, W., Longland, M., & Beardmore, B. (2010). Amateur decision-making in avalanche terrain with and without a decision aid: A stated choice survey. Natural Hazards, 52(1), 185–209. https://doi.org/10.1007/s11069-009-9365-4
  • Haegeli, P., Rupf, R., & Karlen, B. (2020). Do avalanche airbags lead to riskier choices among backcountry and out-of-bounds skiers? Journal of Outdoor Recreation and Tourism, 32, 100270. https://doi.org/10.1016/j.jort.2019.100270
  • Hallandvik, L., Andresen, M. S., & Aadland, E. (2017). Decision-making in avalanche terrain-How does assessment of terrain, reading of avalanche forecast and environmental observations differ by skiers’ skill level? Journal of Outdoor Recreation and Tourism, 20, 45–51. https://doi.org/10.1016/j.jort.2017.09.004
  • Hedlund, J. (2000). Risky business: Safety regulations, risks compensation, and individual behavior. Injury Prevention: Journal of the International Society for Child and Adolescent Injury Prevention, 6(2), 82–89. https://doi.org/10.1136/ip.6.2.82
  • Hendrikx, J., & Johnson, J. (2014). Using global crowdsourced data to understand travel behavior in avalanche terrain. Proceedings of the International Snow Science Workshop, Banff, Alberta, Canada, 224–227.
  • Hendrikx, J., & Johnson, J. (2016). Understanding global crowd sourcing data to examine travel behavior in avalanche terrain. Proceedings of the International Snow Science Workshop, Breckenridge, CO, 737–743.
  • Hendrikx, J., Johnson, J., & Shelly, C. (2016). Using GPS tracking to explore terrain preferences of heli-ski guides. Journal of Outdoor Recreation and Tourism, 13, 34–43. https://doi.org/10.1016/j.jort.2015.11.004
  • Hoffman, L. (2015). Longitudinal analysis: Modeling within-person fluctuation and change. Routledge.
  • Hogarth, R. M., Lejarraga, T., & Soyer, E. (2015). The two settings of kind and wicked learning environments. Current Directions in Psychological Science, 24(5), 379–385. https://doi.org/10.1177/0963721415591878
  • Jekich, B. M., Drake, B. D., Nacht, J. Y., Nichols, A., Ginde, A. A., & Davis, C. B. (2016). Avalanche fatalities in the United States: A change in demographics. Wilderness & Environmental Medicine, 27(1), 46–52. https://doi.org/10.1016/j.wem.2015.11.004
  • Johnson, J., & Hendrikx, J. (2021). Using citizen science to document terrain use and decision making of back country users. Citizen Science: Theory and Practice, 6(1), 8–15. https://doi.org/10.5334/cstp.333
  • Johnson, J., Haegeli, P., Hendrikx, J., & Savage, S. (2016). Accident causes and organizational culture among avalanche professionals. Journal of Outdoor Recreation and Tourism, 13, 49–56. https://doi.org/10.1016/j.jort.2015.11.003
  • Kahneman, D. (2011). Thinking, fast and slow. Macmillan.
  • Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80(4), 237–251. https://doi.org/10.1037/h0034747
  • Kahneman, D., Slovic, P., & Tversky, A. (1982). Judgment under uncertainty: Heuristics and biases. Cambridge University Press.
  • Krippendorff, K. (2018). Content analysis: An introduction to its methodology (4th ed.). Sage Publications.
  • Landrø, M., Hetland, A., Engeset, R. V., & Pfuhl, G. (2020). Avalanche decision-making frameworks: Factors and methods used by experts. Cold Regions Science and Technology, 170, 102897. https://doi.org/10.1016/j.coldregions.2019.102897
  • Landrø, M., Pfuhl, G., Engeset, R., Jackson, M., & Hetland, A. (2020). Avalanche decision-making frameworks: Classification and description of underlying factors. Cold Regions Science and Technology, 169, 102903. https://doi.org/10.1016/j.coldregions.2019.102903
  • Lorah, J. (2018). Effect size measures for multilevel models: Definition, interpretation, and TIMSS example. Large-Scale Assessments in Education, 6(1), 8. https://doi.org/10.1186/s40536-018-0061-2
  • Mackenzie, S. H., Son, J. S., & Eitel, K. (2018). Using outdoor adventure to enhance intrinsic motivation and engagement in science and physical activity: An exploratory study. Journal of Outdoor Recreation and Tourism, 21, 76–86. https://doi.org/10.1016/j.jort.2018.01.008
  • Mannberg, A., Hendrikx, J., & Johnson, J. (2021). Risky positioning–social aspirations and risk-taking behaviour in avalanche terrain. Leisure Studies, 40(4), 495–512. https://doi.org/10.1080/02614367.2020.1831046
  • Mannberg, A., Hendrikx, J., Johnson, J., & Hetland, A. (2021). Powder fever and its impact on decision-making in avalanche terrain. International Journal of Environmental Research and Public Health, 18(18), 9496. https://doi.org/10.3390/ijerph18189496
  • Mannberg, A., Hendrikx, J., Landrø, M., & Stefan, M. A. (2018). Who’s at risk in the backcountry? Effects of individual characteristics on hypothetical terrain choices. Journal of Environmental Psychology, 59, 46–53. https://doi.org/10.1016/j.jenvp.2018.08.004
  • Manning, R. E., & Freimund, W. A. (2004). Use of visual research methods to measure standards of quality for parks and outdoor recreation. Journal of Leisure Research, 36(4), 557–579. https://doi.org/10.1080/00222216.2004.11950036
  • McCammon, I. (2000). The role of training in recreational avalanche accidents in the United States. Proceedings of the International Snow Science Workshop, Big Sky, MT, 37–47.
  • McCammon, I. (2002). Evidence of heuristic traps in recreational avalanche accidents. Proceedings of the International Snow Science Workshop, Penticton, British Columbia, 1–8.
  • McCammon, I. (2004). Heuristic traps in recreational avalanche accidents: Evidence and implications. Avalanche News, 68(1), 42–50.
  • McCammon, I. (2009). Human factors in avalanche accidents: Evolution and interventions. Proceedings of the International Snow Science Workshop, Davos, Switzerland, 644–648.
  • Mihalic, S. F., & Elliott, D. S. (2015). Evidence-based programs registry: Blueprints for Healthy Youth Development. Evaluation and Program Planning, 48, 124–131. https://doi.org/10.1016/j.evalprogplan.2014.08.004
  • Neuendorf, K. A. (2017). The content analysis guidebook (2nd.). SAGE.
  • Nichols, T. B., Hawley, A. C., Smith, W. R., Wheeler, A. R., & McIntosh, S. E. (2018). Avalanche safety practices among backcountry skiers and snowboarders in Jackson Hole in 2016. Wilderness & Environmental Medicine, 29(4), 493–498. https://doi.org/10.1016/j.wem.2018.05.004
  • Peipert, T. (2021). Safety issues mount as skiers hit backcountry in pandemic. AP NEWS. https://apnews.com/article/pandemics-avalanches-coronavirus-pandemic-colorado-82884b11eac27e54556a84b2fa06a68e.
  • Peitzsch, E., Boilen, S., Logan, S., Birkeland, K., & Greene, E. (2020). Research note: How old are the people who die in avalanches? A look into the ages of avalanche victims in the United States (1950–2018). Journal of Outdoor Recreation and Tourism, 29, 100255. https://doi.org/10.1016/j.jort.2019.100255
  • Petrosino, A., Petrosino, C. T., & Buehler, J. (2005). Scared straight” and other juvenile awareness programs for preventing juvenile delinquency. Campbell Systematic Reviews, 1(1), 1–62. https://doi.org/10.4073/csr.2004.2
  • Petrosino, A., Turpin-Petrosino, C., & Finckenauer, J. O. (2000). Well-meaning programs can have harmful effects! Lessons from experiments of programs such as scared straight. Crime & Delinquency, 46(3), 354–379. https://doi.org/10.1177/0011128700046003006
  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. SAGE.
  • Roberts, M., Zajchowski, C. A. B., Skibins, J. C., & Leach, N. (2021). Self-reported and observed behaviors during black bear viewing at Alligator River National Wildlife Refuge. Journal for Nature Conservation, 60, 125973. https://doi.org/10.1016/j.jnc.2021.125973
  • Roth, J. L., & Brooks-Gunn, J. (2016). Evaluating youth development programs: Progress and promise. Applied Developmental Science, 20(3), 188–202.
  • Slovic, P., Peters, E., Finucane, M. L., & MacGregor, D. G. (2005). Affect, risk, and decision making. Health Psychology: Official Journal of the Division of Health Psychology, American Psychological Association, 24(4S), S35–S40. https://doi.org/10.1037/0278-6133.24.4.S35
  • Snijders, T. A. B., & Bosker, S. R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling. (2nd ed.). SAGE.
  • Stephensen, M. B., Schulze, C., Landro, M., Hendrikx, J., & Hetland, A. (2021). Should I judge safety or danger? Perceived risk depends on the question frame. Journal of Experimental Psychology Applied, 27(3), 485–502. https://doi.org/10.1037/xap0000354
  • Sykes, J., Hendrikx, J., Johnson, J., & Birkeland, K. W. (2020). Combining GPS tracking and survey data to better understand travel behavior of out-of-bounds skiers. Applied Geography, 122, 102261. https://doi.org/10.1016/j.apgeog.2020.102261
  • Thompson, D. C., Thompson, R. S., & Rivara, F. P. (2001). Risk compensation theory should be subject to systematic reviews of the scientific evidence. Injury Prevention : journal of the International Society for Child and Adolescent Injury Prevention, 7(2), 86–88. https://doi.org/10.1136/ip.7.2.86
  • Thomson, C. J., Morton, K. L., Carlson, S. R., & Rupert, J. (2012). The contextual sensation seeking questionnaire for skiing and snowboarding (CSSQ-S). International Journal of Sport Psychology, 43, 503–521.
  • Tremper, B. (2008). Staying alive in avalanche terrain (2nd ed.). The Mountaineers Books.
  • Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science (New York, N.Y.), 185(4157), 1124–1131. https://doi.org/10.1126/science.185.4157.1124
  • Tversky, A., & Kahneman, D. (1986). Rational choice and the framing of decisions. The Journal of Business, 59(S4), S251–S278. https://doi.org/10.1086/296365
  • Volken, M., Schell, S., & Wheeler, M. (2007). Backcountry skiing: Skills for ski touring and ski mountaineering. The Mountaineers Books.
  • West, S. L., & O’Neal, K. K. (2004). Project D.A.R.E. outcome effectiveness revisited. American Journal of Public Health, 94(6), 1027–1029. https://doi.org/10.2105/ajph.94.6.1027
  • Wilde, G. J. S. (1998). Risk homeostasis theory: An overview. Injury Prevention: Journal of the International Society for Child and Adolescent Injury Prevention, 4(2), 89–91. https://doi.org/10.1136/ip.4.2.89
  • Zajchowski, C. A. B., Brownlee, M. T. J., Blacketer, M., Rose, J., Rumore, D. L., Watson, J., & Dustin, D. L. (2019). “Can you take me higher?”: Normative thresholds for air quality in the Salt Lake City Metropolitan area. Journal of Leisure Research, 50(2), 157–180. https://doi.org/10.1080/00222216.2018.1560238