811
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Examining the effectiveness and acceptability of a group-based ACT intervention delivered by videoconference to international university students during the COVID-19 pandemic

, , , &
Received 13 Jan 2023, Accepted 29 Aug 2023, Published online: 10 Sep 2023

ABSTRACT

 Studies have shown that international students are at increased risk of experiencing poor mental health. The COVID-19 pandemic has had further negative impacts on the psychological well-being of students. In this quasi-experimental study, we examined the impact of a brief acceptance and commitment therapy (ACT) -based group intervention delivered by videoconference (ACT videoconference; n = 48). We used an equivalent in-person group intervention administrated prior to the pandemic as a reference group (ACT face-to-face; n = 53). In addition, we investigated the exposure – response relationship, dropout attrition, acceptability, and user experiences. International university students participated in five online group meetings using a videoconferencing app during the COVID-19 pandemic and were compared with students participating in five face-to-face group meetings prior to the pandemic. Symptoms (stress, anxiety, depression) and process measures (psychological inflexibility, mindfulness, engaged living) indicated similar positive changes in both groups (e.g. PSS-10, ACT videoconference dw = 0.54; ACT face-to face dw = 0.94; AFQ-Y, ACT videoconference dw = 0.55; ACT face-to-face, dw = 0.84), with a slightly larger effect in the ACT face-to-face group. This study suggests that brief ACT-based group workshops can be effective in enhancing the psychological flexibility of international university students, and decreasing symptoms of stress, depression and anxiety whether delivered by videoconference or face-to-face format.

Introduction

The impact of the COVID-19 pandemic on university students

The COVID-19 pandemic placed new and unforeseen stress on individuals, resulting in increased feelings of overwhelm, social isolation, and worry about our own health and that of others. Mental health problems have increased due to the COVID-19 pandemic, prompting numerous disruptions to daily life, unique stressors, increased mental health concerns, and decreased quality of life (Gallagher, Zvolensky, Long, Rogers, & Garey, Citation2020; White & Van Der Boor, Citation2020). Furthermore, university students have been deeply affected by the pandemic, reporting moderate to severe levels of depression and anxiety (e.g. Di Consiglio, Merola, Pascucci, Violani, & Couyoumdjian, Citation2021; Meda et al., Citation2021). Similarly, students’ mobility and study experiences worldwide have been significantly impacted by the COVID-19 pandemic. Preventive measures, such as closing campuses, canceling classes, and transitions to online teaching have adversely affected students’ mental health, particularly that of international students (Lai et al., Citation2020). Lai et al. (Citation2020) found that international students who stayed in their host country during the pandemic experienced higher stress related to personal health and lack of social support, perceived stress, and more severe symptoms of insomnia than students who returned to their home country. Their survey indicated that more than 80% of the students perceived moderate-to-high stress, with females showing higher stress and lower resilience than males (Lai et al., Citation2020). Even without the challenges and burden imposed by the global pandemic, the mental health of international students raises considerable concerns (Forbes-Mewett, Citation2019) as they face many challenges that might negatively affect their psychological well-being and quality of life (Hauschildt, Gwosc, Netz, & Mishra, Citation2015). International students are considered at an elevated risk for psychological problems (Brown & Brown, Citation2013; Jung, Hecht, & Wadsworth, Citation2007; Mori, Citation2000), including stress, loneliness (e.g. Rosenthal, Russell, & Thomson, Citation2006; Russell, Rosenthal, & Thomson, Citation2010; Sawir, Marginson, Deumert, Nyland, & Ramia, Citation2008), depressive symptoms (e.g. Rice, Choi, Zhang, Morero, & Anderson, Citation2012), and anxiety (Shadowen, Williamson, Guerra, Ammigan, & Drexler, Citation2019) and their distress has been found to be even higher than that of domestic students (Forbes-Mewett & Sawyer, Citation2016).

Coping with the effects of the stressful situation caused by the pandemic has the potential to diminish the ability to successfully respond to or be flexible in the face of adversity (Centers for Disease Control and Prevention, Citation2021). Skills related to health, adaptation, resilience, and flexibility are considered protective factors in mental health (Biglan, Hayes, & Pistorello, Citation2008). Indeed, research has demonstrated a strong positive association between COVID-19-related hardship and distress (Pierce et al., Citation2020). One potential mediating factor of this relation is psychological flexibility, a modifiable transdiagnostic process (Hernández-López, Cepeda-Benito, Díaz-Pavón, & Rodríguez-Valverde, Citation2021). There are indications that psychological flexibility and four of its sub-processes (self-as-context, defusion, values, committed action) may mitigate the detrimental impacts of COVID-19 risk factors on mental health such as COVID-19 peritraumatic distress, and symptoms of anxiety and depression (Pakenham et al., Citation2020). Individuals high in psychological flexibility may be less affected by the adverse consequences of the COVID-19 pandemic (e.g. McCracken, Badinlou, Buhrman, & Brocki, Citation2021).

Psychological flexibility and the ACT the model

Psychological flexibility can alleviate suffering and clarify how individuals deal with adversity while also being a potential factor in improving well-being (Mallett, Coyle, Kuang, & Gillanders, Citation2021). In contrast, lower levels of psychological flexibility have been found to be associated with higher levels of depression, anxiety, and COVID-19-related distress (Dawson & Golijani-Moghaddam, Citation2020; Gloster, Walder, Levin, Twohig, & Karekla, Citation2020; Mallett, Coyle, Kuang, & Gillanders, Citation2021). In addition, psychological flexibility has been proven to be a moderating factor in the relationships between social isolation and depression and anxiety (Smith, Twohy, & Smith, Citation2020), COVID-19 risk factors and mental health difficulties (Pakenham et al., Citation2020), and COVID-19 stressors and suicide risk (Crasta, Daks, & Rogge, Citation2020).

Empirical evidence supports psychological flexibility as the mechanism of action in acceptance and commitment therapy (ACT; Doorley, Goodman, Kelso, & Kashdan, Citation2020; Hayes, Citation2016; Mallett, Coyle, Kuang, & Gillanders, Citation2021; Stockton et al., Citation2019; Trompetter, Bohlmeijer, Veehof, & Schreurs, Citation2015). The aim of ACT is to foster psychological flexibility through six related skills: (1) acceptance, (2) defusion, (3) being present, (4) self as context, (5) values, and (6) committed action (Hayes, Citation2019). Acceptance is about being open to one’s own experiences, especially in relation to unpleasant thoughts and emotions. Defusion involves undermining the negative effects of cognitions by teaching skills that enable people to take distance from thoughts. Self as context is a perspective from which an individual can become aware of their experiences without becoming overly attached to them, while contact with the present moment is about flexibly attending to an experience as it is happening in the now. Furthermore, a connection to one’s own values is represented by the ability to choose what matters and acting in service of them by performing value-oriented actions. These six components have also been grouped into two main dimensions of psychological flexibility: (1) Mindfulness and acceptance processes (including acceptance, defusion, being present, self as context) and (2) Commitment and behavior change processes (including values and committed actions). ACT has been found to be effective in a variety of conditions (Gloster, Walder, Levin, Twohig, & Karekla, Citation2020), this review on the empirical status of ACT showed that it is efficacious for all conditions examined, including anxiety (small to medium, Effect Size, ES, g = 0.18–0.57), depression (small to medium ES, g = 0.24–0.76), substance use (small ES, g = 0.40–0.45), pain (small ES, g = 0.44), and transdiagnostic groups (small to large ES, g = 0.17–0.96). Overall, ACT or its components has more than 1,000 randomized controlled trials up to date.

ACT interventions for national and international students

ACT can provide valuable tools to enhance psychological flexibility and well-being, including college settings (Pistorello, Citation2013; Viskovich, Pakenham, & Fowler, Citation2021). A recent systematic review showed that ACT training, implemented in various formats, has a positive, albeit small effect (d = .29) on student well-being (Howell & Passmore, Citation2019), improving the psychological health and well-being of college students (see also Levin et al., Citation2014; Muto, Hayes, & Jeffcoat, Citation2011; Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016; Stafford-Brown & Pakenham, Citation2012). A recent ACT-based online course enhanced student well-being and decreased stress (Katajavuori, Vehkalahti, & Asikainen, Citation2021). Similarly, students showed significantly reduced levels of general psychological distress and negative emotional symptoms at follow-up, and these outcomes were mediated by increases in psychological flexibility and mindfulness (Christodoulou, Flaxman, & Lloyd, Citation2021). A self-help digital intervention conducted during the COVID-19 pandemic improved well-being in students who reported persistent experiences of COVID-related distress but felt better able to cope with general psychological distress, such as anxiety (Shepherd, Golijani-Moghaddam, & Dawson, Citation2022). In general, ACT interventions with students showed positive outcomes.

ACT has been researched in most continents, a vast majority of the studies is set in the USA (Levin et al., Citation2014; Muto, Hayes, & Jeffcoat, Citation2011), but there are many studies also in Europe (Christodoulou, Flaxman, & Lloyd, Citation2021; Katajavuori, Vehkalahti, & Asikainen, Citation2021; Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016; Shepherd, Golijani-Moghaddam, & Dawson, Citation2022), Asia and Australia (Stafford-Brown & Pakenham, Citation2012; Wang et al., Citation2017). In the context of international students, however, ACT has been scarcely examined. For example, ACT has been explored among Japanese international students attending college in the United States, with favourable results (Muto, Hayes, & Jeffcoat, Citation2011), and Chinese students studying abroad in the USA (Xu, O’Brien, & Chen, Citation2020). In Muto, Hayes, and Jeffcoat (Citation2011), students who received the bibliotherapy self-help intervention showed enhancements in general mental health, stress levels, and psychological flexibility. Similarly, in the ACT-based study by Xu, O’Brien, and Chen (Citation2020), students showed reductions in depression, stress, anxiety, and physical symptoms at post-intervention, with the changes being maintained at one-month follow-up.

Videoconference interventions during the pandemic

The COVID-19 pandemic challenged the education system across the world and forced schools, colleges, and universities to discontinue in-person teaching and shift to online teaching (Dhawan, Citation2020). In addition, the use of technology became the only way to offer psychological services (Duan & Zhu, Citation2020; Jiang et al., Citation2020; Li et al., Citation2020; McGuire, Citation2020; Zhou et al., Citation2020). Indeed, the use of videoconferencing applications was noticeably accelerated during the COVID-19 pandemic (Billingsley, Citation2020). Meta-analyses suggest that videoconferencing interventions consistently produce treatment effects largely equivalent to those of in-person interventions (Batastini, Paprzycki, Jones, & MacLean, Citation2021; Varker, Brand, Ward, Terhaag, & Phelps, Citation2019). Furthermore, online group interventions have grown exponentially with COVID-19 (Marmarosh, Forsyth, Strauss, & Burlingame, Citation2020), suggesting that they are effective at reducing depression, anxiety, and stress and that they allow group cohesion similar to that in in-person group therapy (Gentry, Lapid, Clark, & Rummans, Citation2019; López et al., Citation2020). Group cohesion helps people survive during distressing times (Marmarosh, Forsyth, Strauss, & Burlingame, Citation2020); therefore, groups can be important when treating people suffering during COVID-19 and can bring benefits critical to mental health and coping with COVID-19 (Marmarosh, Forsyth, Strauss, & Burlingame, Citation2020). Previous studies suggest that ACT group training could be an effective mental health intervention in educational settings, reducing levels of general psychological distress and negative emotional symptoms and decreasing procrastination (Christodoulou, Flaxman, & Lloyd, Citation2021; Wang et al., Citation2017) as well reducing anxiety and depression symptoms as shown in Iranian adolescents in a videoconference group intervention (Zemestani, Hosseini, Petersen, & Twohig, Citation2022). Dropout, non-completion, and the premature termination of an intervention constitute significant problems that limit the effectiveness of any intervention (Barrett, Chua, Crits-Christoph, Gibbons, & Thompson, Citation2008). Both very low (Browning, Morena, Gould, & Lloyd-Richardson, Citation2022; Yuen et al., Citation2019) and high attrition rates (Shepherd, Golijani-Moghaddam, & Dawson, Citation2022) have been reported in videoconference interventions. Thus, more knowledge of attrition rates in videoconference interventions is needed, especially among international students.

Aim of the study

Considering the large number of students, including international students, who experience psychological problems, there is a need for more research on various types of interventions and the ways to deliver them. Overall, ACT-based interventions targeting students have been found to be effective in promoting students’ overall well-being and psychological flexibility (Howell & Passmore, Citation2019). However, research investigating ACT in the context of international students remains scarce. Therefore, there is a need for more research on how ACT can be delivered to international students in an effective and acceptable way. In particular, during times of immense difficulty, such as the COVID-19 pandemic, there is a need for effective psychological procedures to enhance mental well-being. We observed earlier that a five-week in-person ACT group workshop was effective at reducing psychological symptoms of stress, depression, and anxiety (Brandolin et al., Citation2023). Furthermore, we previously observed low dropout rates and linear reduction in symptoms when the students attended more sessions. In the spring of 2020, the pandemic forced us to shift a group-based in-person intervention offered to international university students into a group-based intervention delivered through the Zoom videoconferencing platform.

The aim of the current study was to investigate the impact of variously delivered ACT-based group interventions (videoconference vs. face-to-face) in terms of effectiveness and acceptability. As we were unable to randomize the participants to the two interventions, and the context of the delivery differed (no-pandemic vs. pandemic), the comparison between the procedures was problematic. However, we were interested in whether the distance intervention (ACT videoconference) during a distressing period would be beneficial to a group of vulnerable students (i.e. international university students) during the pandemic. To evaluate the usefulness of the intervention, we used our previous face-to-face intervention as a reference group (ACT face-to-face). The reference group offered us the possibility to control the effect of attention and repeated measurements and increase the validity of the findings. We were particularly interested in studying the effectiveness of the videoconference intervention on symptoms of stress, anxiety, and depression as well as on psychological flexibility skills reflected by the mindfulness and acceptance processes, and commitment and behavior change processes. Based on the earlier studies that have applied the ACT- and psychological flexibility model among students, we expected the intervention to decrease these symptoms and to increase psychological flexibility skills. This expectation was based on the findings suggesting that psychological flexibility and four of its sub-processes (self-as-context, defusion, values, committed action) may mitigate the detrimental impacts of COVID-19 risk factors on mental health such as symptoms of anxiety and depression (Pakenham et al., Citation2020).

We also wanted to study the adherence to the intervention, that is, the relationship between the number of sessions completed and the magnitude of change in symptoms of stress and psychological flexibility. More specifically, we compared whether the changes in stress and psychological flexibility were larger when the students had completed all five sessions compared to if they had completed three or four sessions. We expected larger changes in stress and psychological flexibility when students had completed more sessions. Moreover, low dropout rate (9%) was observed in our earlier study employing a supported online approach to national university students during a non-pandemic period (Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016). In the current study completed during the pandemic, we were interested in studying the dropout rates (number of completed workshops), and the acceptability, defined here as satisfaction to the intervention and whether they recommended the intervention to others as well as user experiences, for example, what skills they had learned during the intervention. The findings of this study can be used to promote the mental health of international students and provide insight into whether engagement in an ACT intervention delivered via videoconference could be a feasible alternative.

Method

Procedure

To recruit the participants, flyers were advertised on the campus of the university of Jyväskylä and on social media platforms such as Facebook and Instagram, and ads were posted in university newsletters directed to international university students, inviting them to participate in a group intervention consisting of five weekly meetings. The ad specified that the aim of the workshop was to promote student well-being and that it would cover topics such as how to more effectively adapt and cope with life and study-related stressors, mindfulness, and how to engage in life and studies in a more meaningful way. The inclusion criteria were (a) to be enrolled international students at the University of Jyväskylä, (b) to be at least 18 years old, and (c) to have access to the Internet. Students receiving a simultaneous psychological intervention were excluded from the study. However, the pre-existing mental health diagnoses or psychiatric medication was not asked. Students who indicated via email or registration form that they were willing to participate in the workshop were then contacted via email to schedule the first interview. Between the falls of 2017 and 2019, the workshops were administered through in-person group-based sessions (the reference group), and during the COVID-19 pandemic (i.e. from the spring of 2020 to the fall of 2021), they were organized through zoom videoconference workshops in group format (the ACT videoconference), which was also specified in the ad. Thus, the participants were not randomly divided into the intervention conditions.

Participants

A total of 125 international university students were interested in participating in the workshops (ACT videoconference, n = 57; ACT face-to-face, n = 68). However, a total of 24 students dropped out before the pre-measurement. Among them, 16 did not reply, and eight reported a busy schedule (). Therefore, pre-measurements were collected from 48 students participating in the ACT videoconference and 53 students participating in the ACT face-to-face group, who started the five-week intervention. Post-measurements were collected seven to eight weeks later from 43 participants (90%) in the ACT videoconference workshop and 47 participants (89%) in the ACT face-to-face workshop. A flowchart of the participants is presented in .

Figure 1. Flow of participants.

Figure 1. Flow of participants.

Most participants were female (n = 80; 79%) and had a mean age of 26.09 (SD = 6.49; range 18–46). About half of them were degree students (n = 55, 55%), representing 40 nationalities, with nearly 30% of them coming from Asia (n = 29; 29%). Over 60% of the students stayed in Finland for less than six months (n = 62; 61%). The most common faculties and majors were education and psychology (n = 35; 35%), followed by humanities and social sciences (n = 27; 27%). The participants’ characteristics are shown in . There were no statistical differences between the two intervention groups in terms of background variables.

Table 1. Participant characteristics.

The interventions

The ACT intervention conditions differed in terms of delivery format: workshops in group format through the Zoom videoconference application (ACT videoconference) or in-person group workshops (ACT face-to-face). However, both workshops followed a 90-min workshop format, with five group meetings, including a total of 7.5 hours for the workshops and a total of 2–2.5 hours for individual assessment and feedback (2 × 1–1.5 hours). Prior to the workshops (i.e. one week before the start), both groups of students were invited to participate in an individual semi-structured psychosocial interview (either videoconference or face-to-face) based on the model adapted from Strosahl, Robinson, and Gustavsson (Citation2012). The purpose was to obtain an overview of the students’ situation and provide general information about the intervention. During the pre-assessment, they either received a link to complete a set of online questionnaires (ACT videoconference) or completed online questionnaires on site (ACT face-to-face). The intervention was completed in groups of five to 12 students, with two group facilitators in each group. The meetings were conducted in English and led by the first and third authors (FB, SG), who were first international trainee psychologists (2017–2019) trained in administering interviews and the application of ACT models, later (2020–2021) becoming licensed psychologist and postgraduate researchers. They were trained and supervised in ACT methods by the researcher who was a licensed psychologist and expert in ACT with 20 years of experience (RL).

The structure and content of the intervention were constructed by the University of Jyväskylä research group specialized in brief ACT interventions (see, e.g. Lappalainen et al., Citation2014, Citation2021; Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016). During the intervention, the workshop facilitators were supervised by a psychologist and supervisor with more than 20 years of experience in ACT. All participants provided written informed consent, and the study was approved by the board of Central Finland Healthcare District’s Ethics Committee (registration number 14 U/2012).

The videoconference intervention

During the COVID-19 pandemic (i.e. starting from the spring of 2020 to the fall of 2021), we offered the workshops (n = 5) remotely through the Zoom videoconferencing tool. A different ACT process was introduced each week (). Each workshop meeting started with a mindfulness exercise aimed at fostering focus on the contents of the meeting. Second, at the beginning of each session, the past week’s theme was summarized, followed by a discussion in pairs. Next, the topic and core message of ACT were introduced, and a variety of experiential exercises and metaphors, including animated videos, were utilized (). Each group meeting closed with a home assignment to be conducted throughout the week, including ACT skills for application in daily life. Minor adjustments were made due to the delivery format and the COVID-19 lockdown. For example, mindfulness exercises were kept shorter, and the Face Covid protocol (Harris, Citation2020) was introduced (including for example, a set of practical steps for responding effectively to the Corona crisis using the ACT principles). In addition, in the discussions, the participants were encouraged to talk about the current COVID-19 situation (see for details). A website (https://ok.jyu.fi/en) was introduced to provide text and audio exercises on the concepts discussed and the ACT skills to be practiced. Extra material was sent to the students via email the day after each workshop (see ).

Table 2. Structure and content of the intervention (the ACT face-to-face group vs. The ACT videoconference group).

The reference group: the face-to-face intervention

Prior to the COVID-19 pandemic, between the falls of 2017 and 2019, the workshops (n = 7) were administered through face-to-face group sessions. The protocol of the face-to-face group intervention followed the same structure and content as that of the videoconference group intervention (see ).

Measurements

Symptom measures

The Perceived Stress Scale (PSS-10) was used to measure symptoms of stress (Cohen & Williamson, Citation1988; Cohen, Kamarck, & Mermelstein, Citation1983). It includes 10 items on a 5-point Likert scale (0 = never, 4 = very often) prompting the respondents to indicate the level of stress perceived in their daily life in the last month. The PSS-10 score is obtained by reversing the values of four items and then summing up the 10 items (minimum 0, maximum 40). The total score with a minimum of 13 indicates low, 14 to 26 moderate, and 27 to 40 high levels of stress. The PSS has been used in student populations (Tavakoli, Broyles, Reid, Sandoval, & Correa-Fernández, Citation2019), with an internal consistency ranging from .74 to .91 (Lee, Citation2012). In this study, the scale demonstrated good reliability (10 items; α = .81).

The Patient Health Questionnaire (PHQ-9; Kroenke, Spitzer, & Williams, Citation2001) is a tool that allows the evaluation of the presence or absence of the nine criteria of major depression according to the DSM-IV (American Psychiatric Association, 2013) on a scale of 0 (not at all) to 3 (nearly every day). A score of 10 or more indicates symptoms typical of major depression. The total score is obtained by the sum of the items ranging from 0 to 27. A total score of less than 4 is indicative of an absence of minimal levels of depressive symptoms, 5 to 9 mild, 10 to 14 moderate, 15 to 19 moderately severe, and over 20 severe depression. The validity and reliability of the PHQ-9 have been found to be good in previous studies, including student samples (Kroenke, Spitzer, & Williams, Citation2001; Tavakoli, Broyles, Reid, Sandoval, & Correa-Fernández, Citation2019). In this study, the scale demonstrated good reliability (9 items; α = .80).

The Generalized Anxiety Disorder Assessment (GAD-7) is a self-administered questionnaire that evaluates the level of generalized anxiety (Spitzer, Kroenke, Williams, & Löwe, Citation2006). The respondent is asked to rate on a scale from 0 (not at all) to 3 (nearly every day) how often they have experienced anxiety symptoms in the last two weeks (minimum 0, maximum 21). Scores below 5 indicate minimum levels of anxiety, scores from 5 to 9 mild, 10 to 14 moderate, and above 15 high levels of anxiety. The internal consistency of the GAD-7 has been found to be excellent (α = .92; Spitzer, Kroenke, Williams, & Löwe, Citation2006), including in studies of university students (Kim, Maleku, Lemieu, Du, & Chen, Citation2019). In this study, the reliability of the scale at baseline was excellent (7 items; α = .88).

Process measures

Below the mindfulness and acceptance processes (measured by AFQ-Y and FFMQ) and commitment and behavior change processes (measured by ELS) are described in more detail.

The Avoidance and Fusion Questionnaire for Youth (AFQ-Y) measures psychological inflexibility, a construct that refers to the non-adaptive avoidance of thoughts and emotions, typical of many psychopathologies such as anxiety and mood disorders (Greco, Lambert, & Baer, Citation2008). The AFQ-Y includes 17 statements on a scale from 0 to 4 (0 = not at all true, 4 = very true). The score is obtained by summing up all 17 items (minimum 0, maximum 68). Higher scores indicate higher levels of psychological inflexibility (i.e. a higher tendency of cognitive fusion and rumination). The AFQ-Y has shown adequate reliability and validity in child and adolescent (Greco, Lambert, & Baer, Citation2008) and university student samples (Schmalz & Murrell, Citation2010) and in predicting psychological symptoms (Fergus et al., Citation2012). In this study, the reliability of the scale at baseline was excellent (17 items; α = .83).

The Five Facet Mindfulness Questionnaire (FFMQ; Baer, Smith, Hopkins, Krietemeyer, & Toney, Citation2006) was used to measure the participants’ mindfulness skills. It consists of 39 statements prompting respondents to indicate their degree of agreement on a scale from 1 to 5 (1 = rarely or never, 5 = often true or always true). The questionnaire is divided into five subscales: observing (FFMQ-Ob); describing (FFMQ-De); non-judging of inner experience (FFMQ-Nj); non-reactivity of inner experience (FFMQ-Nr); and acting with awareness (FFMQ-Aw). The total score of the FFMQ is obtained by reversing the scores of the positive items and summing up the 39 items to obtain scores ranging from 39–195. Higher scores are indicative of higher levels of mindfulness. The FFMQ has an adequate internal consistency (Baer et al., Citation2008) and is a valid measure of mindfulness among university students (Baer, Smith, Hopkins, Krietemeyer, & Toney, Citation2006; Carmody, Baer, Lykins, & Olendzki, Citation2009). In this study, the FFMQ showed high reliability for the total score (39 items; α = .88) and for observing (8 items; α = .81), describing (8 items; α = .89), non-judging (8 items; α = .89), non-reacting (7 items; α = .74), and acting with awareness (8 items; α = .88).

The Engaged Living Scale (ELS) measures the ability to engage in actions in accordance with their values (Trompetter, Citation2014). It includes 16 items and consists of two subscales: valued living (ELS-VL), which measures the ability to identify one’s own values, and life fulfillment (ELS-LF), which evaluates the ability to act in accordance with one’s values. All items are rated on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). The total scores are calculated for each subscale and the main scale (minimum 0, maximum 80). Higher scores indicate higher levels of engagement in valued actions. Studies with student samples have shown adequate to good psychometric properties (Grégoire, Doucerain, Morin, & Finkelstein-Fox, Citation2021). In this study, the ELS showed excellent reliability for the total score (16 items; α = .92), valued living (11 items; α = .90) and life fulfilment (5 items; α = .85).

Participant satisfaction and experiences

The participants’ feedback relating to their satisfaction with the intervention was collected using a self-constructed feedback questionnaire with rating scales, yes and no questions, and open-ended questions that reflected how students perceived and responded to the intervention. They rated their satisfaction with the intervention on a 10-point Likert scale, with 0 indicating very dissatisfied and 10 very satisfied, and reported whether they recommended the intervention to others or not (1= would not recommend, 5= would highly recommend). Additional feedback from the participants was collected using a 1–5-point Likert scale (1 = strongly disagree, 5 = strongly agree), including questions related to the coaches and the workshop, a selection of yes and no questions about the skills learned during the workshop, and open-ended questions focusing on the perceived benefits (e.g. What did you find most helpful in the workshop?) and suggestions for improvements (e.g. If you could change anything about the workshop, what would it be?).

Statistical analyses

Statistical analyses were conducted using Mplus (version 8.4, Muthén, Citation1998) and IBM SPSS Statistics 26. The baseline differences between the groups were explored with t-tests and chi-square tests. Latent change score (LCS) models were used to investigate whether changes in the face-to-face and videoconference groups differed from the pre- to post-measurement. They were represented by the Wald test score and the associated p-value, significant p-value reflecting an interaction effect (equivalent to repeated ANOVA). All the available information was used in the analyses, and missing data were assumed to be missing at random. Thus, all the participants who completed the pre-measurements were included in the analyses.

Effect sizes (ESs) were reported using Cohen’s d. The corrected between-group ES was calculated by dividing the change in the mean difference between the face-to-face and videoconference groups by the mean of the standard deviation of the pre-measurement (Face:MPre – Mpost + Online: Mpost-MPre) divided by ((Face:SDpre + Online: SDpre) divided by 2), the Excel formula: A4-C4+H4-F4)/((B4+G4)/2). To interpret Cohen’s between- and within-group d, an ES of 0.20 was considered small, 0.50 moderate, and equal to or above 0.80 large (Cohen & Williamson, Citation1988). When calculating Cohen’s d for the within-subjects ESs, we used the average standard deviation of both repeated measures as a standardizer, as recommended by Lakens (Citation2013). Because we expected both interventions to have an impact on our outcome variables, we interpreted that the intervention had shown beneficial effects when the within-group 95% confidence interval (CI) for the within-group ESs did not include or cross through zero indicating significant change (indicated with asterisks in the table).

Results

Dropout rates

As shown in , the overall dropout rate was relatively low. Altogether, 89% (n = 90) of the 101 international university students completed the workshops and were assessed at post-intervention. Among those who discontinued their participation (n = 11, 11%), four provided no specific reason, while six reported a busy schedule. One participant in the face-to-face group interrupted their participation due to a high level of symptoms. The dropout rates were highly similar in both groups (10% videoconference group; 11% face-to-face group). Eighty-nine percent of the participants in the videoconference group and 83% in the face-to-face group attended four to five group meetings. Thus, there were no statistical differences between the groups in the number of sessions attended (videoconference, M = 4.28, SD = 0.67; face-to-face, M = 4.34, SD = 0.76).

Severity of symptoms at pre-measurements

At pre-measurement, 91% (n = 44) of the students in the videoconference group and 87% (n = 46) in the face-to-face group reported moderate to high stress (PSS-10 scores higher than 14). Moderate to high depressive symptom levels (PHQ-9 ≥ 10) were reported by 33% (n = 16) of the students in the videoconference group and 51% (n = 27) in the face-to-face group. Moderate to high anxiety (GAD-7, score of 10 or more) was reported by 35% (n = 17) of the students in the videoconference group and 40% (n = 21) in the face-to-face group. Based on the total scores of PSS-10, PHQ-9, and GAD-7, there were no statistical differences between the groups in the severity of symptoms reported prior to the interventions (p > 0.10).

Changes in symptoms and psychological flexibility

There were no significant interaction effects since both intervention groups showed beneficial changes (). Although the groups did not change statistically differently from pre- to post-intervention, the between- (db) and within- (dw) group ESs indicated slightly larger positive changes in the face-to-face intervention group. The between-group ESs were either very small (d = 0.05 to 0.19) or small (d = 0.20 to 0.36) in favor for the face-to-face intervention. Based on the within-group ESs (), and upon interpreting the 95% CI that did not include zero as a meaningful change and as an indicator for statistical significance, we observed that both intervention groups showed comparable decreases in symptoms of stress and psychological inflexibility and increases in the mindfulness total scores, the mindfulness non-judgement subscale, and the engaged living subscale life fulfillment. Moreover, there were no differences in how much the symptoms changed in the different cultural groups. For example, between the subgroups of students form Asia and students from Central Europe, UK and Baltics, the t-test showed no differences (PSS: t = 1.237 (38), p = 0.224; GAD: t = −0.496 (38), p = 0.623; PHQ-9: t = 0.415 (38), p = 0.681). When comparing the six cultural groups (Asia, n = 24; Central Europe, Baltics & UK, n = 16; East Europe & Russia, n = 16; Mediterranean Europe, n = 15; Middle East, n = 12, and America North & South, n = 7), the changes did not differ significantly for each other (PSS: F(5,84) = 0.980, p = 0.435; GAD: F(5,84) = 1.448, p = 0.216; PHQ-9: F(5,84) = 0.334, p = 0.891). However, the results must be taken with caution because of the low number of students.

Table 3. Pre – post values for symptoms, psychological inflexibility, mindfulness, and engaged living in the videoconference (n = 48) and face-to-face (n = 53) groups. Estimated mean values, standard deviations, Wald test, p-values, between- and within-group effect sizes (including 95% confidence intervals).

Adherence to the intervention

We further investigated the number of sessions attended and the response to the intervention relationship () regarding stress (PSS-10) and psychological inflexibility (AFQ-Y). Of the 43 students in the videoconference group, 11% completed three sessions, 49% four sessions, and 40% five sessions. The corresponding numbers in the face-to-face group were 17%, 32%, and 51%, respectively. In the videoconference group, we observed that those who completed all five sessions (n = 17) did not report larger decrease in stress and psychological inflexibility compared to those who completed three or four sessions (n = 26, ). However, in our reference group (the face-to-face intervention group), those who completed all five sessions (n = 24) also reported larger changes compared to those who completed fewer sessions (n = 23). The pre-post change in psychological inflexibility (AFQ-Y) when completing 3 to 4 sessions (M = 6.74, SD = 9.82) was significantly smaller (t = −2.083, df = 45, p = 0.043) compared to when completing 5 sessions (M = 11.92, SD = 7.06). However, in the videoconference group, the corresponding values were for 3 to 4 sessions (M = 6.58, SD = 11.72), and for 5 sessions (M = 4.29, SD = 11.43, p = 0.532), were similar.

Figure 2. Mean changes of stress (PSS) and psychological inflexibility (AFQ-Y) in the videoconference and face-to-face groups when completing 3 or 4 sessions compared to when completing 5 sessions.

Figure 2. Mean changes of stress (PSS) and psychological inflexibility (AFQ-Y) in the videoconference and face-to-face groups when completing 3 or 4 sessions compared to when completing 5 sessions.

Participant satisfaction and experiences

The overall satisfaction with the intervention was slightly but significantly higher in the ACT face-to-face intervention (M = 8.57, SD = 1.30, n = 47) compared to the ACT videoconference condition (M = 7.88, SD = 1.76, n = 43; t (88) = 2.130, p = 0.039). There was no difference between the groups in the number of participants who recommended the intervention to others (videoconference, 86%, n = 37; face-to-face, 83%, n = 39). The working relationship with the coaches was evaluated equally in both groups (videoconference, 91%, n = 39; face-to-face, 87%, n = 41). Both groups perceived that learning new skills and strategies was most helpful: skills in general (videoconference, 33%, n = 14; face-to-face, 28%, n = 13); defusion (n = 4 vs. 9, 9% vs. 19%); mindfulness (n = 11 vs. 6, 26% vs. 13%); and values (n = 9 vs. 4, 20% vs. 9%). In addition, opportunities to share with others were perceived in a quite similar way (videoconference, 35%, n = 15; face-to-face, 23%, n = 11). The need for improvement included more time for sharing ideas and interactive group activities (videoconference, 30%, n = 13 vs. face-to-face, 19%, n = 9) and more or longer sessions (n = 2 vs. 5, 5% vs. 10%). Among the students in the videoconference group, four expressed the desire for face-to-face group meetings. In sum, the workshops were well accepted by the participants, as illustrated by one of the students in the videoconference group in an open-ended feedback question (e.g. What did you find most helpful in the workshop?): “Through these sessions, I could find the aim and value for my life, and it helps me to work better in my daily life!

Discussion

We were interested in exploring whether a psychological intervention delivered by videoconference during the distressing COVID-19 pandemic could decrease psychological symptoms and increase psychological flexibility skills among international university students. The acceptance and commitment therapy (ACT) -based five-week videoconference workshop reduced symptoms of stress, decreased psychological inflexibility, and increased mindfulness skills and valued-based actions. These changes were comparable to the impact of the face-to-face workshop convened prior to the pandemic. These findings were consistent with earlier ACT-based studies reporting positive outcomes in general (e.g. Grégoire, Lachance, Bouffard, & Dionne, Citation2018; Levin et al., Citation2014; Levin, Hayes, Pistorello, & Seeley, Citation2016; Levin, Krafft, Pistorello, & Seeley, Citation2019; Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016) and international (Muto, Hayes, & Jeffcoat, Citation2011; Xu, O’Brien, & Chen, Citation2020) student populations. Multiple studies have shown that ACT training has a positive effect on student well-being (Howell & Passmore, Citation2019). The current evidence supports the implementation of ACT in various formats for student well-being. For instance, a self-help ACT-based digital intervention conducted during the COVID-19 pandemic helped improve well-being in students who reported COVID-related distress (Shepherd, Golijani-Moghaddam, & Dawson, Citation2022). However, studies investigating group-based ACT videoconferencing interventions for international students during the pandemic are hitherto non-existent.

Overall, research on interventions examining the well-being of international students during the pandemic remains limited. Our findings point to encouraging benefits of the ACT intervention delivered during the pandemic. Even though it was delivered during arduous times, the relatively limited support and guidance provided online helped the students reduce their stress and, perhaps most importantly, decrease non-adaptive avoidance of thoughts and emotions and increase the ability to refrain from judging their thoughts, emotions, and sensations and act in accordance with their values. Interestingly, attending all five videoconference sessions did not produce larger changes compared to attending three or four sessions on psychological inflexibility and stress symptoms. This contrasts with the “dose-response effect” observed in the face-to-face intervention and raises the question of whether a three- or four-session videoconference intervention would have been sufficient for the students’ needs during the pandemic. Also, the differences in changes in psychological inflexibility after 5 sessions compared to after 3–4 sessions between the groups could be because of the COVID-19 pandemic. The pandemic might have negatively affected the changes in psychological flexibility. In other videoconference studies with students, Yuen and colleagues (Yuen et al., Citation2019) found that a 12-session ACT group videoconferencing intervention decreased social anxiety symptoms. On the other hand, a brief 5-session ACT videoconference training for university students during the COVID-19 pandemic (Browning, Morena, Gould, & Lloyd-Richardson, Citation2022) decreased symptoms of stress and anxiety. The sufficient length of videoconference interventions during pandemic remains to be investigated.

We observed a low dropout rate of approximately 10% among the international university students in both intervention groups, indicating that nearly 90% of the participants completed the intervention. A similarly low dropout rate (9%) was reported in an earlier study employing a supported online approach to university students during a non-pandemic period (Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016). Importantly, the videoconference workshop was well received by the students, although delivered by less experienced psychologists. Thus, the dropout rate was not significantly higher for the ACT-based intervention via videoconference compared to the face-to-face delivery. This was also reflected in the studies of Yuen and colleagues (Yuen et al., Citation2019) and Browning and colleagues (Browning, Morena, Gould, & Lloyd-Richardson, Citation2022), with both losing one participant in the post-assessment. However, it contrasts with observations in the videoconference study of Shepherd and colleagues (Shepherd, Golijani-Moghaddam, & Dawson, Citation2022) with only 46% of the participants completing the post-intervention measurements. Thus, the intervention model applied in the current study was well accepted by the international students.

Based on our findings, which included nearly 40 nationalities, it may not be necessary to make interventions or counseling more culturally appropriate for diverse international student populations, as suggested by Forbes-Mewett (Citation2019). Our results, as well as the participants’ feedback, show that a process-based ACT workshops, combined with issues that international university students deem relevant, can be effective and well received by participants regardless of cultural background. We believe that it may be less critical to culturally tailor an intervention to students when applying process-based approaches focused on teaching generic skills, such as in this intervention. Moreover, we found that there were no differences in the impact of the intervention on symptoms between the different cultural groups, for example, between the subgroups of student from Asia and students from Central Europe, UK and Baltics.

Limitations

There were several notable limitations that hinder the generalizability of the results, the most important being the lack of a randomized control group and the small sample size. Moreover, most of the study participants were female (around 80% total), which appears to be an inherent problem in many online and face-to-face interventions, limiting generalizability of our results. Female students may experience higher levels of psychological symptoms, such as anxiety and depression, higher stress, and lower resilience than male students (e.g. Adlaf, Gliksman, Demers, & Newton-Taylor, Citation2001; Lai et al., Citation2020), all of which were arguably reflected in our results. The lack of a control group made it impossible to draw firm causal conclusions. Without a control group, key threats to internal validity such as history, maturation, and regression toward the mean cannot be ruled out. According to Yalom and Leszcz (Citation2005), being with others in the group who experience similar feelings is one of the most curative aspects of groups. Thus, we were not able to separate the impact of group involvement in our results. However, our studies suggest among students the changes in stress (PSS) were comparable whether the interventions were delivered individually (within group d = 0.76, Räsänen, Lappalainen, Muotka, Tolvanen, & Lappalainen, Citation2016) or in group (d = 0.54–0.94, the current study). Future studies are needed in this area. Furthermore, this study included a diverse and heterogeneous student sample who voluntarily decided to participate in a program to improve well-being and stress, limiting again generalizability, mostly because of personal difficulties or curiosity regarding the applied approach. Limited recruitment time may have influenced participation since the intervention had to be delivered within one semester. These observations need to be taken into consideration when drawing conclusions from the study. Further studies with larger samples are needed to investigate whether our findings can be generalized to the overall international student population. Furthermore, the difficult context related to the COVID-19 pandemic and the adjustments made to the protocol may have impacted the results of the intervention. Interestingly, the effect of the videoconference intervention was no different on psychological flexibility skills whether the participants attended all five sessions or three/four sessions. The within group change was significant and moderate while in the face-to-face intervention it was large. This difference could be because of the last session. Further studies are needed to investigate the change mechanisms in videoconference interventions.

Conclusions

University students have been deeply affected by the pandemic (e.g. Di Consiglio, Merola, Pascucci, Violani, & Couyoumdjian, Citation2021; Meda et al., Citation2021) and international students even more so due to their temporary status in their host countries and disruptions to their daily life (Gomes & Forbes-Mewett, Citation2021). Preventive measures, such as closing campuses and transitions to online teaching, have adversely affected students’ mental health, particularly that of international students (Lai et al., Citation2020). It is estimated that mental health issues among international students are increasing in both occurrence and severity (Forbes-Mewett, Citation2019). The current study confirmed this, showing that these students may, indeed, experience significant mental health challenges, which can have adverse impacts on their well-being and delay their studies.

It has been suggested that group treatments engaged people socially while also protecting them from psychological symptoms during the COVID-19 pandemic (Marmarosh, Forsyth, Strauss, & Burlingame, Citation2020). Against this backdrop, this study showed that it was possible to help students during the pandemic by offering them a brief online workshop with the aim of increasing their psychological flexibility skills. Our sample included nearly 40 nationalities suggesting that the investigated intervention is appropriate for students with diverse backgrounds. Many of the observed changes were equivalent to those obtained in a similar face-to-face workshop prior to the pandemic. Learning acceptance skills and encouraging students to pursue a value-driven study life and acting accordingly should be integrated into both the curriculum and counseling services targeting international students in the future. The possibility of effectively delivering similar services online via videoconferencing applications offers a chance to reach those students coming and/or attending the workshop from overseas, or simply from a different location. It would be interesting to broaden the research to identify the ideal amount of support needed, the intervention length, and the components that may have a stronger impact in terms of delivering effective results.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Francesca Brandolin

Francesca Brandolin, PhD. Licensed clinical psychologist in Italy. Previous studies are bachelor in Psychological Sciences and Techniques and an international master’s degree in Clinical Psychology. During the last year of the master and post-graduate internship she got involved in different research projects dealing with brief psychological interventions for student’s wellbeing and stress management, and virtual reality (VR) interventions for social anxiety and public speaking at the department of Psychology, University of Jyväskylä. Her ongoing research in the past six years involve the efficacy of a brief low-threshold workshop on the distress of international students, both delivered face-to-face or online through videoconference during the COVID-19 pandemic. Currently, all three articles that formed her doctoral dissertation are published. Brandolin is an active member in the Association for Contextual Behavioural Science.

Päivi Lappalainen

Päivi Lappalainen, PhD, PostDoctoral Researcher has published over 40 papers in the area of web-based and mobile eHealth interventions based on Acceptance and Commitment Therapy (ACT). She has also been the digital content lead (psychology) for 18 web-based and mobile interventions, including web and mobile applications for preventing stress and promoting well-being of working age individuals, depressive symptoms, insomnia and chronic conditions. Therefore, she is one of the world leading experts in the field of digital ACT interventions. During the last 11 years she has been involved in and managed research projects dealing with web-based and mobile interventions at the department of Psychology, University of Jyväskylä. Her ongoing research projects involve the efficacy of a web-based psychological intervention for parents experiencing stress and burnout, a web-based psychological rehabilitation program for working age individuals suffering from depressive symptoms, and virtual reality (VR) interventions for social anxiety and public speaking. Dr. Lappalainen has been in charge of several randomized controlled trials investigating digital solutions for people of all ages. Currently, she is co-supervising three doctoral students in psychology and several Bachelor and Master’s students. Lappalainen is an active member in the Association for Contextual Behavioural Science.

Simone Gorinelli

Simone Gorinelli, doctoral and project researcher at the Department of Psychology, University of Jyväskylä, Finland. His research focuses on the effectiveness of Virtual Reality (VR) exposure, acceptance and commitment therapy (ACT) and Relational Frame Theory (RFT) training on social and public speaking interaction of university students aimed to increase performing skills of university students through an integration between Psychology and Technology. Project researcher in an international research project VRperGENERE, in which the aim is to reduce intimate partner violence through the deployment of cost-effective prevention and rehabilitation tools based on immersive Virtual Reality (VR). Co-facilitator in the Student Compass wellbeing group workshop for international students.

Joona Muotka

Joona Muotka, university lecturer and researcher specialized in statistics and research methods for social sciences at the Department of Psychology, University of Jyväskylä, Finland. He collaborated in many research projects and papers in various area of psychology such as: MOTILEAD - The importance of leadership motivation in the career paths and well-being of highly educated people, Reducing the workload and usefulness of remote team meetings with physiological metrics, STAIRWAY – From Primary School to Secondary School/Youth COMPASS study promoting learning, school well-being and successful educational transitions.

Raimo Lappalainen

Raimo Lappalainen, in clinical psychology. Professor in clinical psychology and psychotherapy at the Department of Psychology, University of Jyväskylä, Finland. A licensed psychologist and psychotherapist. He has acted as the vice head and the head of the Department of Psychology between years 2008-2013. He has over 25 years’ experience of Cognitive Behavioural Therapies (CBT) with expertise especially in the third wave CBT, acceptance and value –based interventions. Author of more than 100 scientific articles and books. He has special expertise in applying and constructing web- and mobile-based psychological interventions. His main research interests are development of brief psychological interventions, including web- and mobile -based interventions for wellbeing and wellness management. Received the Public Information Award (2015) by the Jyväskylä University Foundation for his research group’s achievement of developing web and mobile interventions.

References

  • Adlaf, E. M., Gliksman, L., Demers, A., & Newton-Taylor, B. (2001). The prevalence of elevated psychological distress among Canadian undergraduates: Findings from the 1998 Canadian Campus survey. Journal of American College Health, 50(2), 67–72. doi:10.1080/07448480109596009
  • Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13(1), 27–45. doi:10.1177/1073191105283504
  • Baer, R., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J. … Williams, M. G. (2008). Construct validity of the five facet mindfulness questionnaire in meditating and nonmeditating samples. Assessment, 15(3), 329–342. doi:10.1177/1073191107313003
  • Barrett, M. S., Chua, W. J., Crits-Christoph, P., Gibbons, M. B., & Thompson, D. (2008). Early withdrawal from mental health treatment: Implications for psychotherapy practice. Psychotherapy: Theory, Research, Practice, Training, 45(2), 247. doi:10.1037/0033-3204.45.2.247
  • Batastini, A. B., Paprzycki, P., Jones, A. C. T., & MacLean, N. (2021). Are videoconferenced mental and behavioral health services just as good as in-person? A meta-analysis of a fast-growing practice. Clinical Psychology Review, 83, 101944. doi:10.1016/J.CPR.2020.101944
  • Biglan, A., Hayes, S. C., & Pistorello, J. (2008). Acceptance and commitment: Implications for prevention science. Prevention Science, 9(3), 139–152. doi:10.1007/s11121-008-0099-4
  • Billingsley, L. (2020). Using video conferencing applications to share the death experience during the COVID-19 pandemic. Journal of Radiology Nursing, 39(4), 275–277. doi:10.1016/J.JRADNU.2020.08.001
  • Brandolin, F., Lappalainen, P., Gorinelli, S., Muotka, J., Räsänen, P., & Lappalainen, R. (2023). The effectiveness of a five-session workshop on the distress of international students in Finland–a pilot study. British Journal of Guidance & Counselling, 1–18. doi:10.1080/03069885.2023.2165636
  • Brown, J., & Brown, L. (2013). The international student sojourn, identity conflict and threats to well-being. British Journal of Guidance & Counselling, 41(4), 395–413. doi:10.1080/03069885.2012.729026
  • Browning, M. E., Morena, A., Gould, E. R., & Lloyd-Richardson, E. R. (2022). Brief ACT for undergraduates: A mixed-methods pilot investigation of acceptance and commitment therapy delivered over Zoom. Online: Journal of College Student Psychotherapy, 37(3), 279–299. doi:10.1080/87568225.2022.2029659
  • Carmody, J., Baer, R. A., Lykins, E. L. B., & Olendzki, N. (2009). An empirical study of the mechanisms of mindfulness in a mindfulness-based stress reduction program. Journal of Clinical Psychology, 65(6), 613–626. doi:10.1002/jclp.20579
  • Centers for Disease control and prevention coronavirus (COVID-19). (2021). https://www.cdc.gov/coronavirus/2019-ncov/index.html
  • Christodoulou, V., Flaxman, P. E., & Lloyd, J. (2021). Acceptance and commitment therapy in group format for college students. Journal of College Counseling, 24(3), 210–223. doi:10.1002/JOCC.12192
  • Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health & Social Behavior, 24(4), 385–396. doi:10.2307/2136404
  • Cohen, S., & Williamson, G. (1988). Perceived stress in a probability sample of the US. In S. Spacapam & S. Oskamp (Eds.), The social psychology of health: The claremont symposium on applied social psychology. Newbury Park, California: Sage Publications.
  • Crasta, D., Daks, J. S., & Rogge, R. D. (2020). Modeling suicide risk among parents during the COVID-19 pandemic: Psychological inflexibility exacerbates the impact of COVID-19 stressors on interpersonal risk factors for suicide. Journal of Contextual Behavioral Science, 18, 117–127. doi:10.1016/J.JCBS.2020.09.003
  • Dawson, D. L., & Golijani-Moghaddam, N. (2020). COVID-19: Psychological flexibility, coping, mental health, and wellbeing in the UK during the pandemic. Journal of Contextual Behavioral Science, 17, 126–134. doi:10.1016/J.JCBS.2020.07.010
  • Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5–22. doi:10.1177/0047239520934018
  • Di Consiglio, M., Merola, S., Pascucci, T., Violani, C., & Couyoumdjian, A. (2021). The impact of COVID-19 pandemic on Italian university students’ mental health: Changes across the waves. International Journal of Environmental Research and Public Health, 18(18), 9897. doi:10.3390/IJERPH18189897/S1
  • Doorley, J. D., Goodman, F. R., Kelso, K. C., & Kashdan, T. B. (2020). Psychological flexibility: What we know, what we do not know, and what we think we know. Social and Personality Psychology Compass, 14(12), 1–11. doi:10.1111/spc3.12566
  • Duan, L., & Zhu, G. (2020). Psychological interventions for people affected by the COVID-19 epidemic. The Lancet Psychiatry, 7(4), 300–302. doi:10.1016/S2215-0366(20)30073-0
  • Fergus, T. A., Valentiner, D. P., Gillen, M. J., Hiraoka, R., Twohig, M. P., Abramowitz, J. S., & McGrath, P. B. (2012). Assessing psychological inflexibility: The psychometric properties of the avoidance and fusion questionnaire for Youth in two adult samples. Psychological Assessment, 24(2), 402–408. doi:10.1037/a0025776
  • Forbes-Mewett, H. (2019). Mental health and international students: Issues, challenges and effective practice. International Education Association of Australia (IEAA). https://www.researchgate.net/publication/334721342_Mental_Health_and_International_Students_Issues_challenges_effective_practice
  • Forbes-Mewett, H., & Sawyer, A.-M. (2016). International students and mental health. Journal of International Students, 6(3), 661–677. doi:10.32674/jis.v6i3.348
  • Gallagher, M. W., Zvolensky, M. J., Long, L. J., Rogers, A. H., & Garey, L. (2020). The impact of COVID-19 experiences and associated stress on anxiety, depression, and functional impairment in American adults. Cognitive Therapy and Research, 44(6), 1043–1051. doi:10.1007/s10608-020-10143-y
  • Gentry, M. T., Lapid, M. I., Clark, M. M., & Rummans, T. A. (2019). Evidence for telehealth group-based treatment: A systematic review. Journal of Telemedicine and Telecare, 25(6), 327–342. doi:10.1177/1357633X18775855
  • Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., & Karekla, M. (2020). The empirical status of acceptance and commitment therapy: A review of meta-analyses. Journal of Contextual Behavioral Science, 18, 181–192. doi:10.1016/j.jcbs.2020.09.009
  • Gomes, C., & Forbes-Mewett, H. (2021). International students in the time of COVID-19. Journal of International Students, 11(2), 1–5. doi:10.32674/JIS.V11IS2.4292
  • Greco, L. A., Lambert, W., & Baer, R. A. (2008). Psychological inflexibility in childhood and adolescence: Development and evaluation of the avoidance and fusion questionnaire for Youth. Psychological Assessment, 20(2), 93–102. doi:10.1037/1040-3590.20.2.93
  • Grégoire, S., Doucerain, M., Morin, L., & Finkelstein-Fox, L. (2021). The relationship between value-based actions, psychological distress and well-being: A multilevel diary study. Journal of Contextual Behavioral Science, 20, 79–88. doi:10.1016/J.JCBS.2021.03.006
  • Grégoire, S., Lachance, L., Bouffard, T., & Dionne, F. (2018). The use of acceptance and commitment therapy to promote mental health and school engagement in university students: A multisite randomized controlled trial. Behavior Therapy, 49(3), 360–372. doi:10.1016/j.beth.2017.10.003
  • Harris, R. (2020). FACE COVID: How to respond effectively to the Corona crisis. https://www.actmindfully.com.au/wp-content/uploads/2020/03/FACE-COVID-eBook-by-Russ-Harris-March-2020.pdf
  • Hauschildt, K., Gwosc, C., Netz, N., & Mishra, S. (2015). Social and Economic Conditions of Student Life in Europe: Synopsis of indicators. Eurostudent V 2012–2015. W. Bertelsmann Verlag. https://www.eurostudent.eu/download_files/documents/EVSynopsisofIndicators.pdf
  • Hayes, S. C. (2016). Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies – republished article. Behavior Therapy, 47(6), 869–885. doi:10.1016/j.beth.2016.11.006
  • Hayes, S. C. (2019). Acceptance and commitment therapy: Towards a unified model of behavior change. World Psychiatry, 18(2), 226. https://doi.org/10.1002/wps.20626
  • Hernández-López, M., Cepeda-Benito, A., Díaz-Pavón, P., & Rodríguez-Valverde, M. (2021). Psychological inflexibility and mental health symptoms during the COVID-19 lockdown in Spain: A longitudinal study. Journal of Contextual Behavioral Science, 19, 42–49. doi:10.1016/J.JCBS.2020.12.002
  • Howell, A. J., & Passmore, H. A. (2019). Acceptance and commitment training (ACT) as a positive psychological intervention: A systematic review and initial meta-analysis regarding ACT’s role in well-being promotion among university students. Journal of Happiness Studies, 20(6), 1995–2010. doi:10.1007/s10902-018-0027-7
  • Jiang, X., Deng, L., Zhu, Y., Ji, H., Tao, L. … Ji, W. (2020). Psychological crisis intervention during the outbreak period of new coronavirus pneumonia from experience in Shanghai. Psychiatry Research, 286, 1–3. doi:10.1016/j.psychres.2020.112903
  • Jung, E., Hecht, M. L., & Wadsworth, B. C. (2007). The role of identity in international students’ psychological well-being in the United States: A model of depression level, identity gaps, discrimination, and acculturation. International Journal of Intercultural Relations, 31(5), 605–624. doi:10.1016/j.ijintrel.2007.04.001
  • Katajavuori, N., Vehkalahti, K., & Asikainen, H. (2021). Promoting university students’ well-being and studying with an acceptance and commitment therapy (ACT)-based intervention. Current Psychology, 42(6), 4900–4912. doi:10.1007/S12144-021-01837-X
  • Kim, Y. K., Maleku, A., Lemieu, C., Du, X., & Chen, Z. (2019). Behavioral health risk and resilience among international students in the United States: A study of socio-demographic differences. Journal of International Students, 9(1), 282–305. doi:10.32674/jis.v9i1.264
  • Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9. Journal of General Internal Medicine, 16(9), 606–613. doi:10.1046/j.1525-1497.2001.016009606.x
  • Lai, A. Y.-K., Lee, L., Wang, M.-P., Feng, Y., Lai, T. T.-K. … Lam, T.-H. (2020). Mental health impacts of the COVID-19 pandemic on international university students, related stressors, and coping strategies. Frontiers in Psychiatry, 11, 11. doi:10.3389/fpsyt.2020.584240
  • Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 4. doi:10.3389/FPSYG.2013.00863
  • Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014). ACT Internet-based vs face-to-face? A randomized controlled trial of two ways to deliver acceptance and commitment therapy for depressive symptoms: An 18-month follow-up. Behaviour Research and Therapy, 61, 43–54. doi:10.1016/J.BRAT.2014.07.006
  • Lappalainen, R., Lappalainen, P., Puolakanaho, A., Hirvonen, R., Eklund, K. … Kiuru, N. (2021). The Youth Compass -the effectiveness of an online acceptance and commitment therapy program to promote adolescent mental health: A randomized controlled trial. Journal of Contextual Behavioral Science, 20, 1–12. doi:10.1016/j.jcbs.2021.01.007
  • Lee, E. H. (2012). Review of the psychometric evidence of the perceived stress scale. Asian Nursing Research, 6(4), 121–127. doi:10.1016/j.anr.2012.08.004
  • Levin, M. E., Hayes, S. C., Pistorello, J., & Seeley, J. R. (2016). Web-based self-help for preventing mental health problems in universities: Comparing acceptance and commitment training to mental health education. Journal of Clinical Psychology, 72(3), 207–225. doi:10.1002/jclp.22254
  • Levin, M. E., Krafft, J., Pistorello, J., & Seeley, J. R. (2019). Assessing psychological inflexibility in university students: Development and validation of the acceptance and action questionnaire for university students (AAQ-US). Journal of Contextual Behavioral Science, 12, 199–206. doi:10.1016/j.jcbs.2018.03.004
  • Levin, M. E., MacLane, C., Daflos, S., Seeley, J. R., Hayes, S. C., Biglan, A., & Pistorello, J. (2014). Examining psychological inflexibility as a transdiagnostic process across psychological disorders. Journal of Contextual Behavioral Science, 3(3), 155–163. doi:10.1016/j.jcbs.2014.06.003
  • Li, W., Yang, Y., Liu, Z.-H., Zhao, Y.-J., Zhang, Q. … Xiang, Y.-T. (2020). Progression of mental health services during the COVID-19 outbreak in China. International Journal of Biological Sciences, 16(10), 1732–1738. doi:10.7150/ijbs.45120
  • López, J., Perez-Rojo, G., Noriega, C., Carretero, I., Velasco, C. … Galarraga, L. (2020). Psychological well-being among older adults during the COVID-19 outbreak: A comparative study of the young–old and the old–old adults. International Psychogeriatrics, 32(11), 1365–1370. doi:10.1017/S1041610220000964
  • Mallett, R., Coyle, C., Kuang, Y., & Gillanders, D. T. (2021). Behind the masks: A cross-sectional study on intolerance of uncertainty, perceived vulnerability to disease and psychological flexibility in relation to state anxiety and wellbeing during the COVID-19 pandemic. Journal of Contextual Behavioral Science, 22, 52–62. doi:10.1016/J.JCBS.2021.09.003
  • Marmarosh, C. L., Forsyth, D. R., Strauss, B., & Burlingame, G. M. (2020). The psychology of the COVID-19 pandemic: A group-level perspective. Group Dynamics: Theory, Research & Practice, 24(3), 122–138. doi:10.1037/GDN0000142
  • McCracken, L. M., Badinlou, F., Buhrman, M., & Brocki, K. C. (2021). The role of psychological flexibility in the context of COVID-19: Associations with depression, anxiety, and insomnia. Journal of Contextual Behavioral Science, 19, 28–35. doi:10.1016/J.JCBS.2020.11.003
  • McGuire, P. (2020). My anxiety tiger is back on the prowl: Online counselling can help us to control our responses to the coronavirus crisis. Irish Times. https://www.irishtimes.com/life-and-style/health-family/here-is-a-list-of-counselling-services-if-you-want-to-talk-to-someone-1.4211976
  • Meda, N., Pardini, S., Slongo, I., Bodini, L., Zordan, M. A. … Novara, C. (2021). Students’ mental health problems before, during, and after COVID-19 lockdown in Italy. Journal of Psychiatric Research, 134, 69–77. doi:10.1016/J.JPSYCHIRES.2020.12.045
  • Mori, S. (2000). Addressing the mental health concerns of international students. Journal of Counseling & Development, 78(2), 137–144. doi:10.1002/j.1556-6676.2000.tb02571.x
  • Muthén, L. K. (1998). Mplus user’s guide. Los Angeles, CA: Muthén & Muthén.
  • Muto, T., Hayes, S. C., & Jeffcoat, T. (2011). The effectiveness of acceptance and commitment therapy bibliotherapy for enhancing the psychological health of Japanese college students living abroad. Behavior Therapy, 42(2), 323–335. doi:10.1016/j.beth.2010.08.009
  • Pakenham, K. I., Landi, G., Boccolini, G., Furlani, A., Grandi, S., & Tossani, E. (2020). The moderating roles of psychological flexibility and inflexibility on the mental health impacts of COVID-19 pandemic and lockdown in Italy. Journal of Contextual Behavioral Science, 17, 109–118. doi:10.1016/J.JCBS.2020.07.003
  • Pierce, M., Hope, H., Ford, T., Hatch, S., Hotopf, M. … Abel, K. M. (2020). Mental health before and during the COVID-19 pandemic: A longitudinal probability sample survey of the UK population. The Lancet Psychiatry, 7(10), 883–892. doi:10.1016/S2215-0366(20)30308-4
  • Pistorello, J. (Ed.). (2013). Mindfulness and acceptance for counseling college students: Theory and practical applications for intervention, prevention, and outreach. Oakland, CA: New Harbinger Publications.
  • Räsänen, P., Lappalainen, P., Muotka, J., Tolvanen, A., & Lappalainen, R. (2016). An online guided ACT intervention for enhancing the psychological wellbeing of university students: A randomized controlled clinical trial. Behaviour Research and Therapy, 78, 30–42. doi:10.1016/j.brat.2016.01.001
  • Rice, G., Choi, C. C., Zhang, Y., Morero, Y. I., & Anderson, D. (2012). Self-critical perfectionism, acculturative stress, and depression among international students. The Counseling Psychologist, 40(4), 575–600. doi:10.1177/0011000011427061
  • Rosenthal, D. A., Russell, V. J., & Thomson, G. D. (2006). A growing experience: The health and well-being of international students at the university of Melbourne. University of Melbourne. https://findanexpert.unimelb.edu.au/scholarlywork/284032-a-growing-experience--the-health-and-well-being-of-international-students-at-the-university-of-melbourne
  • Russell, J., Rosenthal, D., & Thomson, G. (2010). The international student experience: Three styles of adaptation. Higher Education, 60(2), 235–249. doi:10.1007/s10734-009-9297-7
  • Sawir, E., Marginson, S., Deumert, A., Nyland, C., & Ramia, G. (2008). Loneliness and international students: An Australian study. Journal of Studies in International Education, 12(2), 148–180. doi:10.1177/1028315307299699
  • Schmalz, J. E., & Murrell, A. R. (2010). Measuring experiential avoidance in adults: The avoidance and fusion questionnaire. International Journal of Behavioral Consultation & Therapy, 6(3), 198–213. doi:10.1037/h0100908
  • Shadowen, N. L., Williamson, A. A., Guerra, N. G., Ammigan, R., & Drexler, M. L. (2019). Prevalence and correlates of depressive symptoms among international students: Implications for university support offices. Journal of International Students, 9(1), 129–149. doi:10.32674/jis.v9i1.277
  • Shepherd, K., Golijani-Moghaddam, N., & Dawson, D. L. (2022). Acting towards better living during COVID-19: The effects of acceptance and commitment therapy for individuals affected by COVID-19. Journal of Contextual Behavioral Science, 23, 98–108. doi:10.1016/J.JCBS.2021.12.003
  • Smith, B. M., Twohy, A. J., & Smith, G. S. (2020). Psychological inflexibility and intolerance of uncertainty moderate the relationship between social isolation and mental health outcomes during COVID-19. Journal of Contextual Behavioral Science, 18, 162–174. doi:10.1016/j.jcbs.2020.09.005
  • Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. doi:10.1001/archinte.166.10.1092
  • Stafford-Brown, J., & Pakenham, K. I. (2012). The effectiveness of an ACT informed intervention for managing stress and improving therapist qualities in clinical psychology trainees. Journal of Clinical Psychology, 68(6), 592–513. doi:10.1002/jclp.21844
  • Stockton, D., Kellett, S., Berrios, R., Sirois, F., Wilkinson, N., & Miles, G. (2019). Identifying the underlying mechanisms of change during acceptance and commitment therapy (ACT): A systematic review of contemporary mediation studies. Behavioural and Cognitive Psychotherapy, 47(3), 332–362. doi:10.1017/S1352465818000553
  • Strosahl, K. D., Robinson, P. J., & Gustavsson, T. (2012). Brief interventions for radical change: Principles and practice of focused acceptance and commitment therapy. Oakland, CA: New Harbinger Publications.
  • Tavakoli, N., Broyles, A., Reid, E. K., Sandoval, J. R., & Correa-Fernández, V. (2019). Psychological inflexibility as it relates to stress, worry, generalized anxiety, and somatization in an ethnically diverse sample of college students. Journal of Contextual Behavioral Science, 11, 1–5. doi:10.1016/j.jcbs.2018.11.001
  • Trompetter, H. R. (2014). ACT with pain: Measurement, efficacy and mechanisms of acceptance & commitment therapy. Universiteit Twente. doi:10.3990/1.9789036537087
  • Trompetter, H. R., Bohlmeijer, E. T., Veehof, M. M., & Schreurs, K. M. (2015). Internet-based guided self-help intervention for chronic pain based on acceptance and commitment therapy: A randomized controlled trial. Journal of Behavioral Medicine, 38(1), 66–80. doi:10.1007/s10865-014-9579-0
  • Varker, T., Brand, R. M., Ward, J., Terhaag, S., & Phelps, A. (2019). Efficacy of synchronous telepsychology interventions for people with anxiety, depression, posttraumatic stress disorder, and adjustment disorder: A rapid evidence assessment. Psychological Services, 16(4), 621–635. doi:10.1037/ser0000239
  • Viskovich, S., Pakenham, K. I., & Fowler, J. A. (2021). A mixed-methods evaluation of experiential intervention exercises for values and committed action from an acceptance and commitment therapy (ACT) mental health promotion program for university students. Journal of Contextual Behavioral Science, 22, 108–118. doi:10.1016/J.JCBS.2021.10.001
  • Wang, S., Zhou, Y., Yu, S., Ran, L. W., Liu, X. P., & Chen, Y. F. (2017). Acceptance and commitment therapy and cognitive–behavioral therapy as treatments for academic procrastination: A randomized controlled group session. Research on Social Work Practice, 27(1), 48–58. doi:10.1177/1049731515577890
  • White, R. G., & Van Der Boor, C. (2020). Impact of the COVID-19 pandemic and initial period of lockdown on the mental health and well-being of adults in the UK. BJPsych Open, 6(5). doi:10.1192/BJO.2020.79
  • Xu, H., O’Brien, W. H., & Chen, Y. (2020). Chinese international student stress and coping: A pilot study of acceptance and commitment therapy. Journal of Contextual Behavioral Science, 15, 135–141. doi:10.1016/j.jcbs.2019.12.010
  • Yalom, I. D., & Leszcz, M. (2005). The theory and practice of group psychotherapy. New York: Basic Books.
  • Yuen, E. K., Goetter, E. M., Stasio, M. J., Ash, P., Mansour, B. … Watkins, J. (2019). A pilot of acceptance and commitment therapy for public speaking anxiety delivered with group videoconferencing and virtual reality exposure. Journal of Contextual Behavioral Science, 12, 47–54. doi:10.1016/j.jcbs.2019.01.006
  • Zemestani, M., Hosseini, M., Petersen, J. M., & Twohig, M. P. (2022). A pilot randomized controlled trial of culturally-adapted, telehealth group acceptance and commitment therapy for Iranian adolescent females reporting symptoms of anxiety. Journal of Contextual Behavioral Science, 25, 145–152. doi:10.1016/J.JCBS.2022.08.001
  • Zhou, X., Harding, L. E., Edirippulige, S., Smith, A. C., Edirippulige, S., Bai, X., & Smith, A. C. (2020). The role of telehealth in reducing the mental health burden from COVID-19. Telemedicine and E-Health, 26(4), 377–379. doi:10.1089/tmj.2020.0068