861
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Adopting the principles and practices of learning health systems in universities and colleges: recommendations for delivering actionable data to improve student mental health

ORCID Icon & ORCID Icon
Pages 1-30 | Received 01 Sep 2023, Accepted 28 Dec 2023, Published online: 22 Jan 2024

ABSTRACT

Despite efforts to address the growing severity and complexity of student mental health issues, challenges persist in data quality and application, thereby hindering progress. This article is built upon three decades of cumulative expertise from the authors, complemented by insights gathered through the extensive observations of students and practitioners within the realm of student mental health. Drawing from both robust evidence and hands-on experience, it presents evidence-based recommendations aimed at enhancing data capture and utilization in alignment with the principles and methodologies of learning health systems. The approach is based on four interconnected themes: (1) Learning from global insights on university students’ mental health; (2) Measuring, monitoring, and managing data; (3) Involving student and stakeholder perspectives; and (4) Mapping transitions, access, and systems for student mental health services. These themes encompass both the individual student journey and the broader organizational layers of universities and colleges. Ten recommendations are made for supporting universities and colleges to move towards adopting the principles of learning health systems to support students’ mental health.

In recent years, considerable attention across a range of media has focused on the state of student mental health. While various strategies have been adopted to capture and respond to students’ needs, global trends indicate increasing severity and complexity (Lipson et al., Citation2019). Diverse research methods have also been employed to address these needs, such as using large practice-based datasets, systematic reviews and meta-analyses, national and international surveys, and longitudinal data capture (e.g., Hazell et al., Citation2020; Paton et al., Citation2023). The resulting evidence has provided new insights into student mental health trends and strengthened the evidence base (Campbell et al., Citation2022). Nevertheless, challenges persist in the quality of data and its utilization, impeding progress in the field, and impeding universities and colleges not only in collecting actionable data but also in being the beneficiaries of the lessons learnt from the data. Moving in such a direction relies increasingly on utilizing digital technology, connecting systems and infrastructure, and leveraging datasets to enhance in-house (i.e., within the institution) support services and thereby improve student mental health outcomes. This article aims to provide a step toward responding to these data challenges by synthesising evidence-based recommendations for capturing and reporting mental health trends in university and college students.

Our approach draws from over 30 years of collective experience in the realm of student mental health, collaborating with students and practitioners at various levels, and from frontline staff to service leads and directors. We specifically reference psychometrics, research and evaluation, policy, and data informatics to offer initial insights into key concepts required to move towards data-informed student mental health systems. Crucially, our approach draws on a history of working with students, service users, practitioners, heads of services, and professional organizations from the university and college counseling sector to understand the unique challenges they face in their roles in supporting student mental health and wellbeing. In particular, we draw on our experience from the UK Student Counselling Outcomes Research and Evaluation (SCORE) practice-research consortium (see https://score-consortium.sites.sheffield.ac.uk/).

On the basis of this collective experience, we have been drawn to the concept of learning health systems, a concept first outlined by the Institute of Medicine (IOM, Citation2001) in which the generation of evidence (i.e., data) is a “by-product of care delivery” and the application of that evidence is “to support continuous improvement, evidence-based care delivery, and population management” (Guise et al., Citation2018, p. 2237). In effect, evidence generation is paired with evidence application such that “evidence is both generated and applied as a natural product of the care process” (Ramsberg & Platt, Citation2017). A key principle of learning health systems is that the process is a continuous cycle where new knowledge, new data, and new perspectives lead to practice changes which in turn provide new knowledge and so the cycle continues. Currently, at least in the UK, universities do not have a legal duty of care to students in the same way as they do for students aged under 18 and also to their staff, but it has become an issue due to the tragic occurrence of student suicides. We argue that universities and colleges can position themselves to adopt the principles and practices of learning health systems to maximize the natural process of care towards students and their mental health.

In line with this approach, we have identified four themes that are summarized in and act to organize key issues and considerations: (1) Learning from global insights on university and college students’ mental health; (2) Measuring, monitoring, and managing health data; (3) Involving students and stakeholder perspectives; and (4) Mapping transitions, access, and systems for student mental health services. These themes are building blocks-not a comprehensive template-that acknowledge a cyclical sequence moving from the collection of research evidence and local data, through participation with stakeholders, and towards changes in practice that are consistent with the principles of learning health systems (Agency for Healthcare Research and Quality, Citation2019). Central to these principles is the practice of embedding routinely collected outcome measures at each session, providing the infrastructure and resources for services to access and utilize their data, empowering a culture of change and commitment from the organization to learn from the data, as well as an interface with learning from broader, more global evidence.

Figure 1. Framework of themes that underpin universities/colleges adopting principles and practices of learning health systems.

Figure 1. Framework of themes that underpin universities/colleges adopting principles and practices of learning health systems.

Our approach starts by adopting a population approach to identify global insights into student mental health trends and explore potential enablers to inform local clinical groups within the student population. Through this approach, we acknowledge the value of learning from the broader, global literature and incorporating studies of universities/colleges across multiple countries that showcase good practice. Progressing through the themes, we focus on the generation of primary data from individual students and their evolving engagement with mental health support systems over time. As such, natural and routine data generation underpins the principle of a learning health system. Combined with the perspectives and involvement of students themselves, the impact leads to mapping the transitions to universities/colleges, improving access, and developing more effective and efficient mental health systems for students.

Theme 1: learning from global insights on university students’ mental health

The first theme adopts a global public health perspective and explores the global literature as a potential source for information about courses of action that contribute knowledge. Understanding the knowledge and insights from a public or population level has the potential to identify overarching enablers that can direct research and interventions for local clinical populations (i.e., treatment-seeking students and service users). This externally-focused theme addresses a crucial axiom in terms of the principles and procedures of a learning health system.

Global perspectives

A global perspective on university student mental health represents research from national, international, or multi-country studies that have explored trends from large or longitudinal student samples either directly from datasets or via meta-analyses (e.g., Lipson et al., Citation2019; Paton et al., Citation2023). These studies provide insights into the prominent mental health issues among students, potential risk factors that contribute to poor mental health, and the strategies needed to improve student outcomes. Exploring global perspectives helps identify students’ needs and direct service development and research. This broader perspective also allows us to identify common challenges and successful approaches that can be adapted to different contexts.

Numerous studies have investigated mental health trends among university and college students, consistently revealing a rise in mental health conditions over time. Noteworthy research, such as Duffy et al. (Citation2019) and Oswalt et al. (Citation2020), utilized longitudinal data on self-report student mental health symptomatology including the National College Health Assessment (n = 610,543), Healthy Minds Study (n = 177,692), and American College Health Association-National College Health Assessment (n = 454,029). Analyses of these datasets have shown increasing trends for depression, anxiety, panic, self-injury, suicidal ideation, and suicidal attempts, with several incidences doubling over time.

Similar trends of deteriorating mental health have been observed in different countries and among specific student groups. For instance, in Norway, university students, especially women, experienced a 16.5% increase in psychological distress from 2010 to 2018 (Knapstad et al., Citation2021). In the UK, reports have indicated heightened anxiety, depression, loneliness, and a reduced sense of belonging among students (Campbell et al., Citation2022). Additionally, student-athletes, transfer students, and those facing financial difficulties have experienced higher levels of anxiety, depression, academic stress, and suicidal ideation (Bantjes et al., Citation2022; Cheung et al., Citation2020; Karyotaki et al., Citation2020; Rolland et al., Citation2022). Overseas students and home students from ethnic minority backgrounds further report unique challenges that affect their mental health including cultural and language barriers, racism, and stigma (Alang, Citation2019; Cao et al., Citation2021).

World Health Organization (WHO) World Mental Health International College Student (WMH-ICS) initiative: an exemplar

One noteworthy and ongoing program of work is the World Health Organization (WHO) World Mental Health International College Student (WMH-ICS) initiative, which aims to address mental health problems among college students worldwide. This initiative generates a large, longitudinal epidemiological dataset to gain insights into common mental disorders and emotional problems in university and college students (Cuijpers et al., Citation2019a, Citation2019b). The WMH-ICS’s priority areas include generating epidemiological data, implementing digital approaches, disseminating evidence-based interventions, and facilitating regular evaluation through annual surveys. Its collaborations with 18 countries demonstrate its global commitment to addressing mental health needs, providing effective interventions for students, and improving accessibility to mental health services.

Recent findings from a cross-national sample of the WMH-ICS data revealed that only 24.6% (n = 3,440) of students were willing to approach professional services for emotional problems (Ebert et al., Citation2019). Common reasons for help avoidance included preferring to handle issues alone (56.4%) and seeking support from friends or relatives (48.0%). Similar reluctant help-seeking has been reported in the UK with further concerns about the time commitment for using services and experiencing self-stigma (Broglia et al., Citation2021). These findings highlight substantial hesitation among students in seeking mental health support and indicate the need for meaningful co-development with students to personalise communication and promote appropriate early engagement.

A second noteworthy exemplar of combining longitudinal clinical data from university and college counseling centers is the Center for Collegiate Mental Health (CCMH). CCMH connects approximately 750 college counseling centers that have adopted a single student-specific measure-the Counseling Center Assessment of Psychological Symptoms (CCAPS) measure as well as standardized data forms for presenting issues and demographics. Since its establishment in 2004, CCMH has gathered data from 1.5 million clients and generated over 80 publications and 15 annual reports. The latest report presents insights from 180 centers, 190,907 students, and 4,688 clinicians across 1,287,775 appointments. Recent analyses highlight student risk and protective factors for academic success as well as a noticeable increase in reported traumatic events, social anxiety, and marginal rises in thoughts of harming others (see CCMH Annual Report, Citation2022).

Recognising and addressing risk factors that contribute to students’ poor mental health is crucial in meeting their unique needs. Multiple studies have conducted systematic reviews and meta-analyses to identify such risk factors as well as specific student groups who are more susceptible to experiencing mental health challenges (e.g., Hazell et al., Citation2020; Pacheco et al., Citation2017). Early studies suggest that risk factors for poor mental health include race/ethnicity, religiosity, relationship status, living arrangements, and financial situation (Eisenberg et al., Citation2013). In a recent study, Sheldon et al. (Citation2021) identified significant predictors of depression and suicide-related outcomes in undergraduates including current mental health problems, negative rumination, parent separation, parental depression, childhood adversity, sexual harassment, and financial difficulties.

Specific risk factors have also been identified in the UK, such as childhood trauma, LGBTQ identity, and autism (Campbell et al., Citation2022). At the same time, protective factors include having supportive social networks and feeling prepared for the university transition, while lack of engagement and low mental health literacy contribute to poor mental health. Factors specific to the education context have also been identified. For example, Limone and Toto (Citation2022) found that study time, loneliness, and long-term stress predict anxiety and depression as well as childhood trauma, abuse, and neglect. Recognising and responding to these risk factors provide the potential to inform tailored communications, interventions, and service pathways for students.

Theme 2: measuring, monitoring, and managing data

The second theme underscores the significance of systematically collecting and analyzing local data to improve mental health services, decisions, and interventions. This theme considers the importance of comparing embedded measures for shared assessments and comparability and the issues arising from implementing common metrics and standardized approaches in pursuit of improved data quality and reporting of university and college student mental health.

Measurement: standardization vs. idiographic

Several strategic decisions about measurement are key and standardization is a good guiding principle. Standardization can be realized both in the procedures used (i.e., using the same measures) and also in terms of adopting nomothetic measures (i.e., invariant items). Employing measures that allow direct comparisons with other services and countries holds significant appeal and considerable merit. This approach can substantiate the practical aspects of data-sharing. However, standardization can result in the dominance of a single measure that becomes imposed and freezes the field whereby researchers, policymakers and service leads can be reluctant to migrate to a different measure for fear of losing comparisons with existing datasets. Lessons from psychological therapies have shown how a measure such as the Beck Depression Inventory (BDI) dominated the field before being overtaken by a free-to-use, briefer measure, namely the Patient Health Questionnaire-9 (PHQ-9), derived directly from the diagnostic nosology of the Diagnostic Statistical Manual. The tension arises in choosing between a diagnostically-based measure widely utilized in general psychological literature, offering valuable comparator data, and a focus on what may be more meaningful to students.

What is most meaningful to any given student might better be captured by a battery of brief measures or the adoption of idiographic measures. These may be more time-consuming to elicit but can be very insightful if chosen carefully. In effect, idiographic measures are individualized and they engage directly with a student in the construction of a measure -their measure. The idiographic approach provides a more flexible and individualized method to understanding client needs and progress. When idiographic measures have been implemented into adolescent mental health services they have improved collaboration between clients and counsellors and enabled adolescents to convey the seriousness of their concerns. Moreover, counselors described the approach as empowering clients by focusing on “what matters” to clients (Tollefsen et al., Citation2020).

The adoption of idiographic items is an interesting perspective in an increasingly digital world for a method that dates back to the 1960s (e.g., Shapiro, Citation1961, Citation1969). It also directly connects clients with measurement data in a way that nomothetic measures are not able to do. This connection is particularly beneficial to universities and colleges given the specific and unique pressures students face. These contextual factors might suggest that items within idiographic measures enable a more personalised approach centered on student experiences, which in turn, foster greater engagement. Jacob et al. (Citation2023) has taken the idiographic approach one step further as a means to address some of the limitations of standardised measurements in psychotherapy by introducing the concept of idiographic patient reported outcome measures (I-PROMs). This approach combines I-PROMS with traditional measures to capture both individual progress and team-level changes to focus on client-specific needs over a pure symptomology approach. This focus shows promise for universities and colleges to bring focus on what matters to clients/students and to move away from a traditional medicalised model.

Assessment and outcome

A further issue is to ensure there is a clear understanding of the difference but also the relationship between assessment and outcome. They are different processes and have different functions. It’s therefore logical to have different measures for each purpose. The widespread adoption of the PHQ-9 measure in mental health research and in psychological therapies has compounded the issue of assessment and outcome, making them become one and the same. There are advantages in having separate measures for different functions, and this can become important when considering using measures to monitor and feedback progress (see next sub-theme). Some pairings of measures provide a balance between comprehensive assessment instruments and briefer ongoing monitoring instruments: for example, the CCAPS-62 (Broglia et al., Citation2017; Locke et al., Citation2011; assessment) and CCAPS-34 (Locke et al., Citation2011; outcome monitoring); the CORE-OM (Evans et al., Citation2002; assessment) and CORE-10 (Barkham et al., Citation2013; outcome monitoring).

Our combined experience, involving the use of these measures in research and their application in therapy by practitioners, reveals that the decision-making process for clinic managers and service heads inevitably involves trade-offs. The CCAPS-62, widely embraced in counseling centers across the USA, offers a comprehensive assessment tailored for students, capturing mental health concerns and contextual experiences like academic distress. However, concerns about the length of measures have led practitioners to hesitate in adopting routine outcome monitoring through concerns about client burden (e.g., Barkham et al., Citation2023). Concurrently, the CORE-OM and its abbreviated form, the CORE-10, are prevalent in UK university and college counseling services. While not specifically designed for students, the CORE measures, particularly the CORE-10, have been commended for their brevity and sensitivity to change, vital for assessing improvement or deterioration in these short-term services (e.g., Mair, Citation2016).

The CCAPS measures have garnered substantial attention in the USA, implemented by numerous counseling centers along with standardized data forms covering presenting issues and demographics. Notably, the Center for Collegiate Mental Health (CCMH) has driven the adoption of standardized data forms that outline student service experiences, encompassing key categories like presenting issues, demographics, service pathways, and client feedback. This comprehensive approach, integrating routine outcome monitoring and standardized data, enabled CCMH to derive insightful perspectives on student mental health, resulting in impactful strategies and approaches.

However, in the UK, the adoption of CCAPS measures varies, presenting a persistent data challenge: services employ diverse measures and systems (e.g., Broglia et al., Citation2017). The disjointedness resulting from different measures and systems in the UK context impedes insights into student service user populations. Furthermore, combining diverse datasets in the UK compromises data quality due to the use of unstandardized surrounding data fields (Broglia et al., Citation2021). To alleviate these issues, implementing a standardized minimum dataset, akin to those used by CCMH and NHS, would prove advantageous for the UK and other countries facing similar data limitations. Addressing these challenges remains crucial in the UK, particularly as varied measures and systems create disjointed student journeys, potentially impeding future help-seeking. This issue is heightened in recent UK initiatives aiming to bridge university and NHS mental health services. Improved data linkage and aligned reporting standards are vital to facilitate effective partnerships (see Broglia et al., Citation2023).

While there are many popular outcome measures employed in the broader psychotherapy literature, one interesting measure that has also been adopted in university/college counseling centers is the Outcome Questionnaire-45 (OQ-45, Lambert et al., Citation1996). The OQ-45 aims to measure psychological distress and mental health status overtime with insights into clients’ functioning, relationships, and symptoms. Two particular studies in university/college settings standout that showcase the benefits of adopting outcome measures to facilitate nuanced approaches to understanding student mental health needs and outcomes. One example includes analysis of 6000 client records to identify predictors of student distress and noted particular concerns for students who demonstrate high levels of perfectionism or religiosity (Solomon et al., Citation2020). In a second study, outcome data from the OQ-45 were analysed to explore the intersection between student gender and ethnicity. Through this analysis, Sorkhou et al. (Citation2022) identified significantly higher levels of psychological distress among South and East Asian students compared to White students with a further interaction between gender and ethnicity for predicting greater distress. The authors argue that, with correct adoption of outcome measures like the OQ-45, these data show promise for informing targeted or personalised interventions to support student mental health within educational settings.

Assessment and academia

An important consideration for service providers lies in utilizing measures that effectively capture their impact on academic variables while remaining responsive to student needs. University and college counseling services are increasingly expected to showcase their role in enhancing holistic student aspects, encompassing mental health, academic distress, institutional belongingness, and fostering independent learning (Murray et al., Citation2016). The impact of counseling on academic domains has been demonstrated through practice-based evidence, highlighting its effectiveness even when academic factors are not the primary purpose of counseling and studies have revealed clinically significant improvements for students despite facing academic challenges (see Biasi et al., Citation2017; McKenzie et al., Citation2015).

A recent study by Scruggs et al. (Citation2023) utilized real-world data from two university counseling services employing the CORE-OM in conjunction with standardized questions about the influence of counseling on academic proficiency. These services used the Counselling Impact on Academic Outcomes (CIAO) questionnaire, which is widely used in UK university counseling services and analyses of the CIAO data revealed that counseling reduced students’ self-reported problems affecting their academic ability. While opportunities for enhancement exist in the CIAO’s design and application, it offers a means for universities and colleges to showcase how counseling, as reported by students, mitigates challenges affecting their academic achievements. Collectively, these investigations underscore the value of services incorporating academic data, such as the CIAO, to substantiate their broader contributions to student outcomes.

Routine outcome monitoring and matching

To maximize the utility of measurement, counseling centers can adopt routine outcome monitoring (ROM) which, in its simplest form, involves gathering regular patient/client data, providing feedback to therapists and clients based on the data, and adjusting counseling or therapy as necessary. This approach significantly enhances collaborative decision-making, treatment understanding, and the therapeutic alliance by involving patients in outcome monitoring and facilitating feedback integration during therapy sessions (De Jong et al., Citation2021). Recent evidence demonstrates that successful ROM implementation can be cost-effective and, while yielding effects that might traditionally be viewed as small, importantly these are additional to those of standard psychological therapies, equating to an approximate 8% advantage (Barkham et al., Citation2023).

Despite the potential benefits of ROM, there is unanimous agreement regarding the challenges of implementation, a situation that may be particularly acute in student settings. For example, Mellor-Clark et al. (Citation2016) emphasize aligning ROM procedures with behavior change strategies and implementation science for effective and sustainable monitoring. They underscore the importance of organizational readiness, proactive problem-solving, resource development, and comprehensive training to ensure high-quality data collection.

Data-informed approaches in psychological therapies more generally have also been used to improve treatment outcomes by matching clients with therapists (Constantino et al., Citation2021; Delgadillo et al., Citation2020). These studies identified specific therapists that were more effective for particular patient subgroups, suggesting that strategic allocation of patients based on profiles could enhance treatment outcomes. These findings showcase the potential of data-informed methods to optimize therapist-patient matching and emphasize the value of early risk identification for enhanced psychological care. However, matching students to practitioners may not be a viable option in that the pressures on time and staff availability may mean that it is more important to be seen sooner rather than wait for a specific therapist. There may also be a debate about preferences, but these always need to be considered in the context of the presenting issues.

Actionable data and data-informed services

The methods and applications used in these studies can enhance university and college counseling services by leveraging technology, data science, and empirical approaches to improve treatment outcomes for students. This includes transforming in-house counseling services into data-informed spaces, enabling improved decision-making, prediction of risks and outcomes, and identification of mental health subtypes among students. By adopting data-informed approaches, counseling services can gain insights into student needs and preferences, while providing tailored interventions to ensure effective support. These approaches are particularly promising as a way to optimise student outcomes in settings where therapy is typically very short term, with median session numbers falling around 2–4 sessions and noticeably dropping off after 10 sessions in the UK (see Broglia et al., Citation2019). The use of data-informed decision tools and predictive models has the potential to enhance treatment efficiency, reduce dropout, and identify student groups with varying responses to interventions. These tools can also facilitate decisions about resource allocation, proactive intervention, and support for complex cases based on individual student characteristics.

Regardless of the actual measure used, there is a key point to distinguish between data for data’s sake versus actionable data. This issue relates to both the function of the data (why collect it) and to its form (how it is presented). In terms of function, there needs to be an intrinsic understanding and relevance as to why data is being collected and the ability to state the reason when asked by students. The collection of data should be underpinned by an implicit memorandum of understanding between the student and clinic as to why the data is being requested and for what purpose.

In terms of form, there needs to be agreement as to how outcomes are reported, and how the subsequent data are used, that might provide higher-level insights rather than measure-specific ones. Such insights also need to be clinically relevant and used in a way to inform decisions that benefit current and future clients. De Beurs et al. (Citation2022) have proposed three specific actions to improve the collection, comparison, and utilization of data: 1) use common metrics, such as T scores and percentile ranks derived from raw scores; 2) develop crosswalk tables and formulas to aid the conversion of scores into common metrics; and 3) collecting normative data from community samples and conducting international validation studies. A further approach is to adopt Jacobson and Truax’s (Citation1991) criteria for determining reliable/clinical improvement (see also Evans et al., Citation1998). This approach has moved outcomes reporting beyond significance reporting but is premised on the psychometric properties of each outcome measure, making good reliability a premium hallmark. Beyond the specifics, while the criteria of reliable and clinically significant improvement comprise the most stringent and exacting threshold, it is only applicable to clients who are scoring at or above clinical caseness at the time of presentation. Hence, to be inclusive of all students referring to a clinic, the adoption of reliable improvement is likely to be a more inclusive and appropriate criterion.

Theme 3: involving student and stakeholder perspectives

The third theme takes account of the context of a university with a focus on the culture or climate of the organization as reflected in the involvement of students and other stakeholders. Whilst data is a crucial component, it requires all members of the organization to be open to learning from data that is collected as a natural part of the process. Clients and clinicians should also be at the heart of consent procedures to ensure transparency over the collection and utility of their data.

Towards a whole university (and college)

Understanding and enhancing mental health support within university settings requires a comprehensive approach that involves students, academic staff, and practitioner perspectives. Co-creation panel discussions with students indicate that their perspectives and proposals for improving mental health support at universities include enhancing the accessibility and effectiveness of services to respond to diverse student groups. Notably, recommendations focused on improving existing services and providing evidence of their effectiveness to inform help-seeking decisions rather than introducing new ones and to ensure that such services are integrated within the broader structural context (Priestley et al., Citation2022). Similar co-creation research highlights the value students place in enhancing interpersonal and social relationships to improve their mental health and such evidence emphasizes the significance of inclusive social interactions with academic staff, peers, and the local community (see Priestley et al., Citation2022).

One novel and effective method that has been shown to meaningfully involve students in their mental health support is adopting a grassroots strategy to build community-driven mental health initiatives within educational institutions. An early grassroots initiative aimed to address support gaps for grieving students by establishing a national student-led organisation with peer support groups embedded across campuses. The peer-support programme brought together students across faculties to alleviate isolation and complement university services (Fajgenbaum et al., Citation2012). A more recent example from Doherty et al. (Citation2021) showcases effective collaboration between grassroots lived experience groups and social work academics to address systemic advocacy and challenge entrenched power imbalances across educational institutions. Their work involved activities to foster trust-building and meaningful engagement between grassroots groups, academics, and services. The overarching enablers from these grassroots examples include developing clear objectives, deep listening, and genuine partnerships to bring about systemic changes within the mental health support framework.

Brewster et al. (Citation2022) highlight the relationship between staff and student well-being in university settings and argue for a proactive and cohesive approach to embed cultural and structural changes throughout the institution to promote positive well-being outcomes for the entire university community. They suggest that such a strategy relies on considering the interconnectivity of staff and student well-being and a commitment to update institutional policies, training, and culture accordingly to consider the role of workplace culture in supporting well-being and a healthy academic environment. Students advocate mentally healthy university environments with accessible support services, prioritizing individual needs (Priestley et al., Citation2022). Olaniyan and Hayes (Citation2022) explored culturally appropriate support strategies for racial and ethnic minority groups, favoring person-specific services that emphasize cultural relevance and accessibility over rigid protocols. They highlight the importance of fostering humanity and trust through reflective processes that acknowledge cultural differences. Encouraging further research into intersectional influences on help-seeking attitudes among racial and ethnic minorities, this study calls for universities to adopt adaptable approaches to address mental health disparities.

Similarly, Lukenga et al. (Citation2023) studied female students’ perspectives on using digital technologies for academic stress management, uncovering coping mechanisms and the potential of technology adoption to enhance coping strategies and alleviate academic stress. These studies emphasize engaging diverse student stakeholders in research to enhance mental health and academic support with a focus on cultural relevance and individualized approaches. Student and academic staff views on providing a mentally healthy university environment are relatively consistent. For example, Cage et al. (Citation2021) analysed focus group data from UK universities to enhance our understanding of how to improve transitions in student mental health. Both students and staff championed the adoption of a “whole university” approach to mental health, which involves implementing comprehensive and holistic measures throughout the institution to enhance community mental health, wellbeing, and acknowledge the entirety of the student journey. The authors outline a strategic framework encompassing pre-entry transition support, peer mentoring programs, well-defined roles for student services, and assistance during the transition out of university. Notably, both students and staff highlight the significance of effective expectation management, imparting coping skills to students, and nurturing a sense of belonging. Staff members, in particular, voiced the challenges tied to limited resources and heightened demand for mental health services, underscoring the need for enhanced training and resource allocation.

Including staff

Staff perspectives play a crucial role in mental health research and in shaping university strategies to provide mentally healthy campuses. Research on staff experiences of supporting student mental health reveal both positives and obstacles. For example, while some staff display moderate confidence in providing emotional support, a noticeable proportion of staff feel unprepared or lack formal training and clarity about their role (Gulliver et al., Citation2018). Likewise, when staff receive training to improve their depression literacy, they feel more equipped to assist students and make informed decisions about sign-posting (Gulliver et al., Citation2019). While openness to mental health training is evident among academic staff, research suggests that the majority of staff remain untrained (Margrove et al., Citation2014). Moreover, while this research is insightful, there is limited research exploring the views of academic staff despite their pivotal role in supporting students and acting as gatekeepers to services and information. There is also a distinct lack of research involving professional staff working in universities and colleges in shaping student mental health services and campus policies. When their views have been captured, they describe pressure from university leaders to “do more for less” and they may work defensively though a fear of “getting it wrong” (see Broglia et al., Citation2023).

Integrating both student and academic staff perspectives is essential for creating effective and holistic mental health support strategies within university environments. While research has shed light on students’ needs and preferences, understanding the challenges and training gaps faced by academic staff is equally crucial and there is a distinct research gap involving professional staff. These combined studies demonstrate the potential impact of offering training to enhance staff confidence and literacy as well as the necessity of considering their views when designing mental health policies. Moving forward, further research should continue to engage diverse stakeholders, including academic and professional staff, to ensure comprehensive and culturally relevant approaches that foster a mentally healthy university community.

Avoiding a crisis narrative

Given the concerning rise in student mental health issues, it’s crucial to be mindful of the messages conveyed to students. It’s vital to empower and encourage help-seeking rather than discourage or deflate it. This is also true for communications for academic and clinical staff given rising reports of burnout and “compassion fatigue” (e.g., Van Hoy & Rzeszutek, Citation2022). Bantjes et al. (Citation2023) suggest avoiding a “crisis narrative” when communicating and responding to such data. Specifically, they advocate a paradigm shift that acknowledges the inherent resilience of students rather than solely perceiving them as vulnerable and in need of clinical treatment. They emphasise the importance of research and interventions that prioritise understanding and supporting student resilience, accompanied by responsible messaging that avoids medicalizing everyday experiences. In adopting a balanced public health approach, Bantjes et al. (Citation2023) call for resources that avoid pathologizing student mental health and offer effective interventions that cater to the diverse needs of university and college students.

Additional evidence supporting the adoption of tailored communications and interventions for student sub-populations comes from a recent longitudinal study conducted in the UK, which examined the mental health and wellbeing of university students during the COVID-19 pandemic (Paton et al., Citation2023). Among the 4,622 participants, five distinct wellbeing trajectories emerged, comprising two stable, two declining, and one substantially improved trajectory. Notably, risk factors for poorer wellbeing were identified, including identifying as LGBT+, self-declaring a disability, or having a history of mental health conditions.

Theme 4: mapping transitions, access, and systems for student mental health services

The fourth and final theme considers the role of longitudinal data collection that enables connections to be made between organizations across the lifespan of adolescence and young adulthood. It ensures that there is an evidence-base derived from data that can inform ongoing decisions concerning students and their mental health. In this context, we acknowledge the persistent and deeply rooted challenges concerning systems and infrastructure. Establishing connections between data and systems within the university/college mental health ecosystem is vital for services to effectively access and employ their data. However, this integration comes with its own set of challenges.

Transitions

The beginning of a student’s period of study at university/college might appear to be a logical starting point. However, along with others, we have argued previously that there needs to be a strategic focus on transitions and student mental health prior to university/college (e.g., Barkham et al., Citation2019; Campbell et al., Citation2022). The term “student” shouldn’t be confined to university/college but should encompass a specific group within the broader population of young people. Therefore, the perspective on student mental health should be more inclusive, covering the period before university/college and extending to the wider youth population. Studies, like the extensive multinational research by Auerbach et al. (Citation2018) involving 13,984 students, provide evidence indicating that mental health conditions for university students typically begin at 14.2 years old. Therefore, a significant number of already vulnerable young adults enter university, where various potential triggers can negatively impact some students.

In response to this situation, there is an argument to invest in better support for youth whilst still at school so they can be better prepared for the subsequent experience of university/college. Attention has also focused on the potential preventative and facilitative role of wellbeing interventions to foster student mental health. For example, systematic reviews have considered school-based programs in the UK (Mackenzie & Williams, Citation2018), while Gunawardena et al. (Citation2023) reviewed programs in Australia and concluded there to be no substantial enhancement in wellbeing outcomes from such programs. Therefore, despite the appeal of such programs, questions persist regarding their effectiveness.

One example of an attempt to address mental health early in the youth timespan was the MYRIAD (MY Resilience In ADolescence) project, a large 7-year UK program offering mindfulness training and involving 28,000 11–16 year olds and 650 teachers across 100 schools (Kuyken et al., Citation2022). The rationale for the project was relatively simple, namely, that mindfulness worked for adults (Hofmann et al., Citation2010). Unfortunately, the results did not support the provision of mindfulness at the level of individual pupils, with subsequent analyses reporting that 80% of pupils only practiced mindfulness once (Montero-Marin et al., Citation2023). However, the researchers concluded that it positively impacted staff burnout and the school climate overall. Several important lessons arise from this research. First, it cannot be assumed that what works for adults will transpose to youth; there has to be relevance and a suitable fit to students rather than assume that interventions supported in the adult population will generalize. Second, requiring teachers to deliver mindfulness proved unsuccessful, with a limited number considered competent (Crane et al., Citation2020) and raising the important case for recognising that supporting mental health requires specialist training. And third, it may be as important to focus on the organization and its personnel as much as on students themselves given that it is within the organization itself that so many of the potential triggers for negative experiences reside. Consequently, a prudent and research-driven approach is advisable when considering the adoption and assessment of student wellbeing interventions.

Connections and longitudinal cohort studies

A bridge to address the potential disconnect between schools and universities and the associated transition would be to establish a national research strategy premised on the implementation of longitudinal cohort studies that provide trend data across the continuous time span of youth. But crucially, such data needs to relate proximally to the specific student profile of an institution. Many surveys of university students draw on samples from single institutions and single subjects (e.g., psychology) that make either generalizations or targeted information beyond those single institutions vulnerable.

By contrast, national and strategic planning and investment in representative sampling of youth from early adolescence would yield a rich resource of actionable data, which is, in itself, a key component for universities and colleges as learning health systems. This is a primary principle upon which the recommendations in this article are based, namely, the collection of reliable, relevant, and actionable data that is embedded within the university/college mental health support services. Such insights are essential to counteract various pressures faced by universities/colleges. Firstly, to address low-quality studies producing unsupported conclusions that trigger immediate responses. Secondly, to manage media pressure following student suicides. Lastly, to reassure parents and guardians by ensuring access to pertinent information guiding their decisions for their students.

Access and mapping in student mental health services

Focusing specifically on the use of mental health services at university/college, it is important to assess the effective utilization of such services by university students and to consider the rise in mental health issues and the corresponding uptake of services within the general student population (Ayón et al., Citation2022; Lipson et al., Citation2019). However, there may be a greater demand for mental health support as some students choose not to disclose their conditions and certain services remain underutilized (Abreu et al., Citation2017). Disparities in access also persist for marginalized groups, including men, minority ethnic groups, and mature students (Lipson et al., Citation2022; Sagar-Ouriaghli et al., Citation2020). Mapping student access, system infrastructure, and the policies surrounding mental health services is necessary to understand service use and access complexities.

Several studies have explored the use of mental health services among university and college students and identified key factors that affect access and utilization. In the United States, Lipson et al. (Citation2019) conducted a population-level analysis over a 10-year period and found significant increases in mental health treatment rates, lifetime diagnoses of mental health conditions, and a decrease in stigma. These trends indicate a positive shift in attitudes toward seeking help and increased recognition of mental health issues among students. However, differing trends have emerged since the COVID-19 pandemic. For example, Lee et al. (Citation2021) found that the COVID-19 pandemic had a greater impact on students who were female, academically underperforming, from rural campuses, or low-income backgrounds. Despite these deteriorating trends, the majority of students did not utilize mental health services, indicating either a reluctance to seek help or persistent barriers to accessing support.

Disparities in students accessing mental health services exist between countries and within different student populations. In a recent meta-analysis, Osborn et al. (Citation2022) highlight significant variation in student service utilization and a paucity of studies outside the USA. The authors call for international studies into student access as well as efforts to develop service partnerships to improve student access. Attention is also needed to adapt student care pathways and interventions to respond to their unique challenges as evidence suggests that students receiving routine psychological therapy from national services (e.g., the English National Health Service) do not experience the same level of recovery as the general population (Barnett et al., Citation2022).

Mapping student access to and transitions through mental health services is a novel approach that offers numerous benefits for higher education institutions. O’Brien et al. (Citation2020) provided insights into student mental health concerns and educational requirements by mapping support pathways and developing tailored referrals and interventions. Using a mixed-methods approach, they developed a customized mental health program incorporating behavior change techniques to encourage help-seeking behaviors among undergraduates. Mapping techniques have also been used to tailor referral pathways and interventions for medical students, to promote early help-seeking and to address concerns about fitness to study. Effective strategies in this context involve collaborative efforts with medical schools and online student platforms to establish trust, deliver clear messaging, customise referral pathways, and ultimately foster a positive culture for seeking help (e.g., Jacob et al., Citation2020; Shahaf-Oren et al., Citation2021).

The recognition of mapping student referral pathways to mental health services has significantly impacted diverse service networks worldwide. For example, Vallianatos et al. (Citation2019) transformed student mental health services in a Canadian institution through community mapping, network development, and stakeholder engagement. Ongoing monitoring and evaluation allowed the program to adapt to students’ specific needs, facilitating rapid access to services, early case identification, proactive follow-up, and active involvement of students and their families. Similar strategies have been used to develop a centralized student mental health network across Canada to improve mental health literacy, coordinate services, and promote early access to support (see Ecclestone et al., Citation2023).

Coordinated care pathways are also being developed in the UK. For example, Citation2023 explored strategies for developing service partnerships between the education and public health sectors. Their evaluation included five student mental health hubs that aimed to foster collaborations between universities and the National Health Service (NHS). Mapping students’ journeys and service data flow revealed essential factors for partnership working, including developing shared language and communication, joint risk management procedures, and clarifying staff roles. Implementing these strategies to address increasing demands has the potential to enhance service access and quality. Efforts have also been made not only to foster partnerships between services but also to unite researchers, practitioners, and students through the establishment of research networks aimed at enhancing student mental health (e.g., Student Mental Health Research Network (SMaRteN), see https://www.smarten.org.uk/; and Inlight Network, see https://smhr.utoronto.ca/).

Identifying gaps within data flow and decision-making processes informs the development of service infrastructure and partnerships with external providers. Moreover, by adopting collaborative approaches and providing targeted support for specific student groups, universities can enhance access to mental health services while addressing stigma and promoting trust and confidentiality for all students.

Summary from themes

Overall, we have advocated a comprehensive approach, informed by international research and practitioner observations, to address students’ mental health needs. This includes adopting a public mental health perspective comprising professional counseling, evidence-based practices, and interventions that address social determinants of well-being and student sub-groups. Task-sharing models with peer-to-peer support, early identification of at-risk students, pre-university preparations, and promoting mental health literacy contribute to a supportive education environment (Bantjes et al., Citation2023; Campbell et al., Citation2022). Meaningful stakeholder involvement and links with grassroots groups are central to adapting support services, policies, and communication to meet the needs of under-represented and marginalized students (Cao et al., Citation2021).

Recommendations towards learning health systems

The four themes outlined in this article provide key components for universities and colleges adopting the principles and procedures associated with learning health systems. To aid this process, in this final section, we present recommendations derived from the four themes (see ).

  1. Prioritize high-quality and actionable data: Incorporate ROM data into clinical practice and treatment planning. Use feedback to inform interventions, track progress, and identify areas for improvement, empowering both students and mental health professionals. This data-informed approach fosters collaboration and enhances treatment outcomes. The collection of high-quality, robust, and actionable data is critical for the transformation into learning health systems, enabling real-time, informed decision-making with user-controlled data utilization.

  2. Standardize recovery criteria and measurement comparisons: Standardize recovery criteria for consistent outcomes across services and sectors to support collaborations between practitioners and combining research evidence. Promote strategies to compare measures across diverse student groups and settings such as adopting common metrics and creating meaningful classifications. These strategies will enhance treatment planning and reduce measurement burden.

  3. Leverage embedded data from services: To enhance data collection efficiency, colleges and universities can leverage embedded data within existing systems to provide seamless monitoring and understanding of student mental health.

  4. Facilitate learning health systems: Transform colleges and universities into learning health systems that continuously learn from data, empower decision-makers, improve student experiences and outcomes. This transformation ensures services effectively utilize data for better service delivery and student support while implementing data-informed approaches will lead to better service access, quality, and outcomes for students.

  5. Promote choice and flexibility for selecting measures: Enable services to choose measures that are strategic but aligned with their specific goals and capabilities. Encourage the adoption of a battery of brief domain-specific or multi-domain measures to ensure comprehensive data collection. Additionally, consider the acceptability of measures among students and service users to capture cultural diversity needs accurately. This proactive approach allows for a tailored and inclusive data collection process that supports the overall effectiveness of the measures used.

  6. Enhance assessment and measurement strategies: Recognize the distinct functions of assessment and outcome measures, understanding their intended uses, such as risk assessment, profiling needs, or determining recovery. Select measurement tools with sensitivity to encompass psychological, functioning, and academic aspects, ensuring a holistic view of student well-being.

  7. Promote inclusivity through stakeholder involvement: Explore gaps in mental health support for under-represented and marginalized student groups by involving stakeholders in the evaluation and adaptation of support services and policies. Research the acceptability and validity of measures used with these groups for more inclusive data collection and analysis. Collaborate with academic and professional staff to actively participate in research and the development of services to cultivate campuses that prioritize mental health and wellbeing. Engage staff and practitioners as co-creators in shaping university policies, fostering a holistic approach to mental health within the entire academic community.

  8. Develop partnerships and data linkage strategies: Facilitate partnership development between public healthcare and education sectors to enable ethical data integration and offer a comprehensive and holistic view of student mental health. Prioritize transparency and collaboration in documenting data collection procedures to promote data comparability and reproducibility, allowing identification of trends and best practices.

  9. Collect data pre- and during student transitions and service access: To gain valuable insights, collect data on student mental health during transitions from pre-university to university. Map student journeys from accessing services to ongoing experiences for a holistic view and inform targeted interventions to support seamless transitions.

  10. Establish longitudinal cohort studies: Develop national and international cohort studies to produce longitudinal mental health and well-being insights in students. This comprehensive approach deepens understanding of trends and informs evidence-based decision-making.

Table 1. Summary recommendations to aid the collection of actionable data to improve student mental health

The recommendations in this article are derived from interdisciplinary evidence to highlight examples of good practices for improving the collection and utilization of student mental health data. They broadly endorse a comprehensive, public health-oriented approach, covering areas such as overcoming treatment barriers, coordinating services, and improving measurement practices. By implementing these recommendations, we argue that educational institutions can foster supportive environments that promote student mental health by aspiring to be a learning health system that thereby protects academic success. Importantly, while learning health systems can be implemented using a “top-down” model, that is, informed by national registries, they can also be instigated by adopting a “bottom-up” model within single institutions and then building across other organizations with a “think globally, act locally” mantra (Smoyer et al., Citation2016).

Conclusion

In becoming learning health systems, universities and services must prioritize the quality, robustness, and actionability of their data. Embracing these principles creates a dynamic ecosystem that leverages data for continuous improvement and informed decision-making, advancing student well-being and achieving learning health system goals. Through comprehensive data capture and implementation of robust data collection methods, universities and colleges can create an environment where data becomes a powerful tool in enhancing health outcomes and student experiences.

Acknowledgement

Although Michael Barkham contributed to the development of the CORE outcome measures, he does not receive any financial gain from their creation or utilization.

Disclosure statement

No potential conflict of interest was reported by the author(s).

References

  • Abreu, M., Hillier, A., Frye, A., & Goldstein, J. (2017). Student experiences utilizing disability support services in a university setting. College Student Journal, 50(3), 323–328.
  • Agency for Healthcare Research and Quality. (2019, May). About Learning Health systems. https://www.ahrq.gov/learning-health-systems/about.html
  • Alang, S. M. (2019). Mental health care among blacks in America: Confronting racism and constructing solutions. Health Services Research, 54(2), 346–355. https://doi.org/10.1111/1475-6773.13115
  • Auerbach, R. P., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., Hasking, P., Murray, E., Nock, M. K., Pinder-Amaker, S., Sampson, N. A., Stein, D. J., Vilagut, G., Zaslavsky, A. M., Kessler, R. C., & WHO WMH-ICS Collaborators. (2018). WHO world mental health surveys international college student project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623–638.
  • Ayón, C., Ellis, B. D., Hagan, M. J., Enriquez, L. E., & Offidani-Bertrand, C. (2022). Mental health help-seeking among Latina/o/x undocumented college students. Cultural Diversity and Ethnic Minority Psychology. Advance online publication. https://doi.org/10.1037/cdp0000573
  • Bantjes, J., Hunt, X., & Stein, D. J. (2022). Public health approaches to promoting university students’ mental health: A global perspective. Current Psychiatry Reports, 24(12), 809–818. https://doi.org/10.1007/s11920-022-01387-4
  • Bantjes, J., Hunt, X., & Stein, D. J. (2023). Anxious, depressed, and suicidal: Crisis narratives in university student mental health and the need for a balanced approach to student wellness. International Journal of Environmental Research and Public Health, 20(6), 4859. https://doi.org/10.3390/ijerph20064859
  • Barkham, M., Bewick, B., Mullin, T., Gilbody, S., Connell, J., Cahill, J., Mellor-Clark, J., Richards, D., Unsworth, G., & Evans, C. (2013). The CORE-10: A short measure of psychological distress for routine use in the psychological therapies. Counselling and Psychotherapy Research, 13(1), 3–13. https://doi.org/10.1080/14733145.2012.729069
  • Barkham, M., Broglia, E., Dufour, G., Fudge, M., Knowles, L., Percy, A., Turner, A., Williams, C., & SCORE Consortium. (2019). Towards an evidence‐base for student wellbeing and mental health: Definitions, developmental transitions and data sets. Counselling and Psychotherapy Research, 19(4), 351–357. https://doi.org/10.1002/capr.12227
  • Barkham, M., De Jong, K., Delgadillo, J., & Lutz, W. (2023). Routine outcome monitoring (ROM) and feedback: Research review and recommendations. Psychotherapy Research, 33(7), 841–855. https://doi.org/10.1080/10503307.2023.2181114
  • Barnett, P., Saunders, R., Buckman, J. E., Cardoso, A., Cirkovic, M., Leibowitz, J., Main, N., Naqvi, S. A., Singh, S., Stott, J., Varsani, L., Wheatley, J., & Pilling, S. (2022). Are students less likely to respond to routinely delivered psychological treatment? A retrospective cohort analysis. Comprehensive Psychiatry, 119, 152348. https://doi.org/10.1016/j.comppsych.2022.152348
  • Biasi, V., Patrizi, N., Mosca, M., & De Vincenzo, C. (2017). The effectiveness of university counselling for improving academic outcomes and well-being. British Journal of Guidance & Counselling, 45(3), 248–257. https://doi.org/10.1080/03069885.2016.1263826
  • Brewster, L., Jones, E., Priestley, M., Wilbraham, S. J., Spanner, L., & Hughes, G. (2022). ‘Look after the staff and they would look after the students’ cultures of wellbeing and mental health in the university setting. Journal of Further and Higher Education, 46(4), 548–560. https://doi.org/10.1080/0309877X.2021.1986473
  • Broglia, E., Millings, A., & Barkham, M. (2017). The counseling center assessment of psychological symptoms (CCAPS‐62): Acceptance, feasibility, and initial psychometric properties in a UK student population. Clinical Psychology & Psychotherapy, 24(5), 1178–1188. https://doi.org/10.1002/cpp.2070
  • Broglia, E., Millings, A., & Barkham, M. (2021). Student mental health profiles and barriers to help seeking: When and why students seek help for a mental health concern. Counselling and Psychotherapy Research, 21(4), 816–826. https://doi.org/10.1002/capr.12462
  • Broglia, E., Nisbet, K., Bone, C., Simmonds-Buckley, M., Knowles, L., Hardy, G., Gibbon, L., & Barkham, M. (2023). What factors facilitate partnerships between higher education and local mental health services for students? A case study collective. British Medical Journal Open, 13(12), e077040. https://doi.org/10.1136/bmjopen-2023-077040
  • Broglia, E., Ryan, G., Williams, C., Fudge, M., Knowles, L., Turner, A., Dufour, G., Percy, A., Barkham, M., & SCORE Consortium (2021). Profiling student mental health and counselling effectiveness: Lessons from four UK services using complete data and different outcome measures. British Journal of Guidance & Counselling, 51(2), 204–222.
  • Cage, E., Jones, E., Ryan, G., Hughes, G., & Spanner, L. (2021). Student mental health and transitions into, through and out of university: Student and staff perspectives. Journal of Further and Higher Education, 45(8), 1076–1089. https://doi.org/10.1080/0309877X.2021.1875203
  • Campbell, F., Blank, L., Cantrell, A., Baxter, S., Blackmore, C., Dixon, J., & Goyder, E. (2022). Factors that influence mental health of university and college students in the UK: A systematic review. BMC Public Health, 22(1), 1778. https://doi.org/10.1186/s12889-022-13943-x
  • Cao, Q. T., Vuong, Q. H., Pham, H. H., Luong, D. H., Ho, M. T., Hoang, A. D., & Do, M. T. (2021). A bibliometric review of research on international students’ mental health: Science mapping of the literature from 1957 to 2020. European Journal of Investigation in Health, Psychology and Education, 11(3), 781–794. https://doi.org/10.3390/ejihpe11030056
  • CCMH Annual Report. (2022). Center for Collegiate Mental Health 2022 annual report. https://ccmh.psu.edu/annual-reports
  • Cheung, K., Tam, K. Y., Tsang, M. H., Zhang, L. W., & Lit, S. W. (2020). Depression, anxiety and stress in different subgroups of first-year university students from 4-year cohort data. Journal of Affective Disorders, 274, 305–314. https://doi.org/10.1016/j.jad.2020.05.041
  • Constantino, M. J., Boswell, J. F., Coyne, A. E., Swales, T. P., & Kraus, D. R. (2021). Effect of matching therapists to patients vs assignment as usual on adult psychotherapy outcomes: A randomized clinical trial. JAMA Psychiatry, 78(9), 960–969. https://doi.org/10.1001/jamapsychiatry.2021.1221
  • Crane, C., Ganguli, P., Ball, S., Taylor, L., Blakemore, S. J., Byford, S., Dalgleish, T., Ford, T., Greenberg, M., Kuyken, W., Lord, L., Montero-Marin, J., Sonley, A., Ukoumunne, O. C., & Williams, J. M. G. (2020). Training school teachers to deliver a mindfulness program: Exploring scalability, acceptability, effectiveness, and cost-effectiveness. Global Advances in Health and Medicine, 9, 1–15. https://doi.org/10.1177/2164956120964738
  • Cuijpers, P., Auerbach, R. P., Benjet, C., Bruffaerts, R., Ebert, D., Karyotaki, E., & Kessler, R. C. (2019a). Introduction to the special issue: The who world mental health international college student (WMH-ICS) initiative. International Journal of Methods in Psychiatric Research, 28(2), e1762. https://doi.org/10.1002/mpr.1762
  • Cuijpers, P., Auerbach, R. P., Benjet, C., Bruffaerts, R., Ebert, D., Karyotaki, E., & Kessler, R. C. (2019b). The world health organization world mental health international college student initiative: An overview. International Journal of Methods in Psychiatric Research, 28(2), e1761. https://doi.org/10.1002/mpr.1761
  • de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022). Common measures or common metrics? A plea to harmonize measurement results. Clinical Psychology & Psychotherapy, 29(5), 1755–1767. https://doi.org/10.1002/cpp.2742
  • De Jong, K., Conijn, J. M., Gallagher, R., Reshetnikova, A. S., Heij, M., & Lutz, M. C.(2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, 102002. https://doi.org/10.1016/j.cpr.2021.102002
  • Delgadillo, J., Rubel, J., & Barkham, M. (2020). Towards personalized allocation of patients to therapists. Journal of Consulting and Clinical Psychology, 88(9), 799–808. https://doi.org/10.1037/ccp0000507
  • Doherty, M., McGuire, A., Martin, R., & Gillieatt, S. (2021). Disrupting ‘expertise’: Learnings from a grassroots lived experience and social work academic partnership. Advances in Social Work and Welfare Education, 22(2), 39–55.
  • Duffy, M. E., Twenge, J. M., & Joiner, T. E. (2019). Trends in mood and anxiety symptoms and suicide-related outcomes among US undergraduates, 2007–2018: Evidence from two national surveys. Journal of Adolescent Health, 65(5), 590–598. https://doi.org/10.1016/j.jadohealth.2019.04.033
  • Ebert, D. D., Mortier, P., Kaehlke, F., Bruffaerts, R., Baumeister, H., Auerbach, R. P., Alonso, J., Vilagut, G., Martínez, K. I., Lochner, C., Cuijpers, P., Kuechler, A. M., Green, J., Hasking, P., Lapsley, C., Sampson, N. A., Kessler, R. C., & WHO World Mental Health-International College Student Initiative Collaborators. (2019). Barriers of mental health treatment utilization among first-year college students: First cross-national results from the WHO World Mental Health International College Student Initiative. International Journal of Methods in Psychiatric Research, 28(2), e1782. https://doi.org/10.1002/mpr.1782
  • Ecclestone, A., Linden, B., Monaghan, C., & Zheng, S. (2023). Canada’s student mental health network: Protocol for a comprehensive program evaluation. JMIR Research Protocols, 12(1), e41521. https://doi.org/10.2196/41521
  • Eisenberg, D., Hunt, J., & Speer, N. (2013). Mental health in American colleges and universities: Variation across student subgroups and across campuses. The Journal of Nervous and Mental Disease, 201(1), 60–67. https://doi.org/10.1097/NMD.0b013e31827ab077
  • Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM. British Journal of Psychiatry, 180(1), 51–60. https://doi.org/10.1192/bjp.180.1.51
  • Evans, C., Margison, F., & Barkham, M. (1998). The contribution of reliable and clinically significant change methods to evidence-based mental health. Evidence Based Mental Health, 1(3), 70–72. https://doi.org/10.1136/ebmh.1.3.70
  • Fajgenbaum, D., Chesson, B., & Lanzi, R. G. (2012). Building a network of grief support on college campuses: A national grassroots initiative. Journal of College Student Psychotherapy, 26(2), 99–120. https://doi.org/10.1080/87568225.2012.659159
  • Guise, J. M., Savitz, L. A., & Friedman, C. P. (2018). Mind the gap: Putting evidence into practice in the era of learning health systems. Journal of General Internal Medicine, 33(12), 2237–2239. https://doi.org/10.1007/s11606-018-4633-1
  • Gulliver, A., Farrer, L., Bennett, K., Ali, K., Hellsing, A., Katruss, N., & Griffiths, K. M. (2018). University staff experiences of students with mental health problems and their perceptions of staff training needs. Journal of Mental Health, 27(3), 247–256. https://doi.org/10.1080/09638237.2018.1466042
  • Gulliver, A., Farrer, L., Bennett, K., & Griffiths, K. M. (2019). University staff mental health literacy, stigma and their experience of students with mental health problems. Journal of Further and Higher Education, 43(3), 434–442. https://doi.org/10.1080/0309877X.2017.1367370
  • Gunawardena, H., Voukelatos, A., Nair, S., Cross, S., & Hickie, I. B. (2023). Efficacy and effectiveness of universal school-based wellbeing interventions in Australia: A systematic review. International Journal of Environmental Research and Public Health, 20(15), 6508. https://doi.org/10.3390/ijerph20156508
  • Hazell, C. M., Chapman, L., Valeix, S. F., Roberts, P., Niven, J. E., & Berry, C. (2020). Understanding the mental health of doctoral researchers: A mixed methods systematic review with meta-analysis and meta-synthesis. Systematic Reviews, 9(1), 1–30. https://doi.org/10.1186/s13643-020-01443-1
  • Hofmann, S. G., Sawyer, A. T., Witt, A. A., & Oh, D. (2010). The effect of mindfulness-based therapy on anxiety and depression: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78(2), 169–183. https://doi.org/10.1037/a0018555
  • IOM. (2001). Crossing the quality chasm: A new health system for the 21st century. National Academy Press.
  • Jacob, R., Li, T. Y., Martin, Z., Burren, A., Watson, P., Kant, R., Davies, R., & Wood, D. F. (2020). Taking care of our future doctors: A service evaluation of a medical student mental health service. BMC Medical Education, 20(1), 172. https://doi.org/10.1186/s12909-020-02075-8
  • Jacob, J., Rae, J. P., Allegranti, B., Duncan, C., & Cooper, M. (2023). Enhancing mental health and well‐being outcomes for psychotherapy and counselling through idiographic analysis: A four‐quadrant approach. Counselling and Psychotherapy Research, 23(4), 956–964. https://doi.org/10.1002/capr.12645
  • Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037/0022-006X.59.1.12
  • Karyotaki, E., Cuijpers, P., Albor, Y., Alonso, J., Auerbach, R. P., Bantjes, J., Bruffaerts, R., Ebert, D. D., Hasking, P., Kiekens, G., Lee, S., McLafferty, M., Mak, A., Mortier, P., Sampson, N. A., Stein, D. J., Vilagut, G., & Kessler, R. C. (2020). Sources of stress and their associations with mental disorders among college students: Results of the world health organization world mental health surveys international college student initiative. Frontiers in Psychology, 11, 1759. https://doi.org/10.3389/fpsyg.2020.01759
  • Knapstad, M., Sivertsen, B., Knudsen, A. K., Smith, O. R. F., Aarø, L. E., Lønning, K. J., & Skogen, J. C. (2021). Trends in self-reported psychological distress among college and university students from 2010 to 2018. Psychological Medicine, 51(3), 470–478. https://doi.org/10.1017/S0033291719003350
  • Kuyken, W., Ball, S., Crane, C., Ganguli, P., Jones, B., Montero-Marin, J., Nuthall, E., Raja, A., Taylor, L., Tudor, K., Viner, R. M., Allwood, M., Aukland, L., Dunning, D., Casey, T., Dalrymple, N., De Wilde, K., Farley, E. R. … Williams, J. M. G. (2022). Effectiveness and cost-effectiveness of universal school-based mindfulness training compared with normal school provision in reducing risk of mental health problems and promoting well-being in adolescence: The MYRIAD cluster randomised controlled trial. Evidence-Based Mental Health, 25(3), 99–109. https://doi.org/10.1136/ebmental-2021-300396
  • Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. C. (1996). The reliability and validity of the outcome questionnaire. Clinical Psychology & Psychotherapy, 3(4), 249–258. https://doi.org/10.1002/(SICI)1099-0879(199612)3:4<249:AID-CPP106>3.0.CO;2-S
  • Lee, J., Jeong, H. J., & Kim, S. (2021). Stress, anxiety, and depression among undergraduate students during the COVID-19 pandemic and their use of mental health services. Innovative Higher Education, 46(5), 519–538. https://doi.org/10.1007/s10755-021-09552-y
  • Limone, P., & Toto, G. A. (2022). Factors that predispose undergraduates to mental issues: A cumulative literature review for future research perspectives. Frontiers in Public Health, 10, 831349. https://doi.org/10.3389/fpubh.2022.831349
  • Lipson, S. K., Lattie, E. G., & Eisenberg, D. (2019). Increased rates of mental health service utilization by US college students: 10-year population-level trends (2007–2017). Psychiatric Services, 70(1), 60–63. https://doi.org/10.1176/appi.ps.201800332
  • Lipson, S. K., Zhou, S., Abelson, S., Heinze, J., Jirsa, M., Morigney, J., Patterson, A., Singh, M., & Eisenberg, D. (2022). Trends in college student mental health and help-seeking by race/ethnicity: Findings from the national healthy minds study, 2013-2021. Journal of Affective Disorders, 306, 138–147. https://doi.org/10.1016/j.jad.2022.03.038
  • Locke, B. D., Buzolitz, J. S., Lei, P. W., Boswell, J. F., McAleavey, A. A., Sevig, T. D., Dowis, J. D., & Hayes, J. A. (2011). Development of the counseling center assessment of psychological symptoms-62 (CCAPS-62). Journal of Counseling Psychology, 58(1), 97–109. https://doi.org/10.1037/a0021282
  • Lukenga, M. P., Billonnet, L., Gaugue, J., & Denis, J. (2023). Exploring female students’ perceptions of the use of digital technologies in managing academic stress. Frontiers in Psychology, 14, 1199038. https://doi.org/10.3389/fpsyg.2023.1199038
  • Mackenzie, K., & Williams, C. (2018). Universal, school-based interventions to promote mental and emotional well-being: What is being done in the UK and does it work? A systematic review. British Medical Journal Open, 8(9), e022560. https://doi.org/10.1136/bmjopen-2018-022560
  • Mair, D.(2016). Short-term counselling in higher education: Context, theory and practice. Routledge.
  • Margrove, K. L., Gustowska, M., & Grove, L. S. (2014). Provision of support for psychological distress by university staff, and receptiveness to mental health training. Journal of Further and Higher Education, 38(1), 90–106. https://doi.org/10.1080/0309877X.2012.699518
  • McKenzie, K., Murray, K. R., Murray, A. L., & Richelieu, M. (2015). The effectiveness of university counselling for students with academic issues. Counselling and Psychotherapy Research, 15(4), 284–288. https://doi.org/10.1002/capr.12034
  • Mellor-Clark, J., Cross, S., Macdonald, J., & Skjulsvik, T. (2016). Leading horses to water: Lessons from a decade of helping psychological therapy services use routine outcome measurement to improve practice. Administration and Policy in Mental Health, 43(3), 279–285. https://doi.org/10.1007/s10488-014-0587-8
  • Montero-Marin, J., Hinze, V., Crane, C., Dalrymple, N., Kempnich, M. E. J., Lord, L., Slaghekke, Y., Tudor, K., Farley, S., Fletcher, M., Foulkes, S., Kuyken, M., Blakemore, S.-J., Casey, T., De Wilde, D., Ahmed, E.-R., Allwood, K., Ball, L. … Bennett, W. (2023). Do adolescents like school-based mindfulness training? Predictors of mindfulness practice and responsiveness in the MYRIAD trial. The Journal of the American Academy of Child & Adolescent Psychiatry, 62(11), 1256–1269. https://doi.org/10.1016/j.jaac.2023.02.016
  • Murray, A. L., McKenzie, K., Murray, K. R., & Richelieu, M. (2016). An analysis of the effectiveness of university counselling services. British Journal of Guidance & Counselling, 44(1), 130–139. https://doi.org/10.1080/03069885.2015.1043621
  • O’Brien, N., Lawlor, M., Chambers, F., & O’Brien, W. (2020). Mental fitness in higher education: Intervention mapping programme design. Health Education, 120(1), 21–39. https://doi.org/10.1108/HE-09-2019-0042
  • Olaniyan, F. V., & Hayes, G. (2022). Just ethnic matching? Racial and ethnic minority students and culturally appropriate mental health provision at British universities. International Journal of Qualitative Studies on Health and Well-Being, 17(1), 2117444. https://doi.org/10.1080/17482631.2022.2117444
  • Osborn, T. G., Li, S., Saunders, R., & Fonagy, P. (2022). University students’ use of mental health services: A systematic review and meta-analysis. International Journal of Mental Health Systems, 16(1), 1–34. https://doi.org/10.1186/s13033-022-00569-0
  • Oswalt, S. B., Lederer, A. M., Chestnut-Steich, K., Day, C., Halbritter, A., & Ortiz, D. (2020). Trends in college students’ mental health diagnoses and utilization of services, 2009–2015. Journal of American College Health, 68(1), 41–51. https://doi.org/10.1080/07448481.2018.1515748
  • Pacheco, J. P., Giacomin, H. T., Tam, W. W., Ribeiro, T. B., Arab, C., Bezerra, I. M., & Pinasco, G. C. (2017). Mental health problems among medical students in Brazil: A systematic review and meta-analysis. Brazilian Journal of Psychiatry, 39(4), 369–378. https://doi.org/10.1590/1516-4446-2017-2223
  • Paton, L. W., Tiffin, P. A., Barkham, M., Bewick, B. M., Broglia, E., Edwards, L., Knowles, L., McMillan, D., & Heron, P. N. (2023). Mental health trajectories in university students across the COVID-19 pandemic: Findings from the Student wellbeing at Northern England universities prospective cohort study. Frontiers in Public Health, 11, 1188690. https://doi.org/10.3389/fpubh.2023.1188690
  • Priestley, M., Broglia, E., Hughes, G., & Spanner, L. (2022). Student perspectives on improving mental health support services at university. Counselling and Psychotherapy Research, 22(1), 197–206. https://doi.org/10.1002/capr.12391
  • Priestley, M., Hall, A., Wilbraham, S. J., Mistry, V., Hughes, G., & Spanner, L. (2022). Student perceptions and proposals for promoting wellbeing through social relationships at university. Journal of Further and Higher Education, 46(9), 1243–1256. https://doi.org/10.1080/0309877X.2022.2061844
  • Ramsberg, J., & Platt, R. (2017). Opportunities and barriers for pragmatic embedded trials: Triumphs and tribulations. Learning Health Systems, 2(1), e10044. https://doi.org/10.1002/lrh2.10044
  • Rolland, F., Hadouiri, N., Haas-Jordache, A., Gouy, E., Mathieu, L., Goulard, A., Morvan, Y., & Frajerman, A. (2022). Mental health and working conditions among French medical students: A nationwide study. Journal of Affective Disorders, 306, 124–130. https://doi.org/10.1016/j.jad.2022.03.001
  • Sagar-Ouriaghli, I., Brown, J. S. L., Tailor, V., & Godfrey, E. (2020). Engaging male students with mental health support: A qualitative focus group study. BMC Public Health, 20(1), 1–14. https://doi.org/10.1186/s12889-020-09269-1
  • Scruggs, R., Broglia, E., Barkham, M., & Duncan, C. (2023). The impact of psychological distress and university counselling on academic outcomes: Analysis of a routine practice-based dataset. Counselling and Psychotherapy Research, 23(3), 781–789. https://doi.org/10.1002/capr.12640
  • Shahaf-Oren, B., Madan, I., & Henderson, C. (2021). “A lot of medical students, their biggest fear is failing at being seen to be a functional human”: Disclosure and help-seeking decisions by medical students with health problems. BMC Medical Education, 21(1), 1–10. https://doi.org/10.1186/s12909-021-03032-9
  • Shapiro, M. B. (1961). A method of measuring psychological changes specific to the individual psychiatric patient. British Journal of Medical Psychology, 34(2), 151–155. https://doi.org/10.1111/j.2044-8341.1961.tb00940.x
  • Shapiro, M. B. (1969). Short-term improvements in the symptoms of affective disorder. British Journal of Social and Clinical Psychology, 8(2), 187–188. https://doi.org/10.1111/j.2044-8260.1969.tb00606.x
  • Sheldon, E., Simmonds-Buckley, M., Bone, C., Mascarenhas, T., Chan, N., Wincott, M., Gleeson, H., Sow, K., Hind, D., & Barkham, M. (2021). Prevalence and risk factors for mental health problems in university undergraduate students: A systematic review with meta-analysis. Journal of Affective Disorders, 287, 282–292. https://doi.org/10.1016/j.jad.2021.03.054
  • Smoyer, W. E., Embi, P. J., & Moffatt-Bruce, S. (2016). Creating local learning health systems: Think globally, act locally. The Journal of the American Medical Association(JAMA), 316(23), 2481–2482. https://doi.org/10.1001/jama.2016.16459
  • Solomon, E., Nielsen, S. L., & Hardy, S. (2020). Predictors of Client Distress at a University Counseling Center. Undergraduate Thesishttps://scholarsarchive.byu.edu/studentpub_uht/136/
  • Sorkhou, M., Rashid, T., Dere, J., & Uliaszek, A. (2022). Psychological distress in treatment-seeking university students: An intersectional examination of Asian identity and gender identity. Journal of College Student Psychotherapy, 1–21. Advance online publication. https://doi.org/10.1080/87568225.2022.2145252
  • Tollefsen, T. K., Darrow, S. M., Lohne, V., & Berg-Nielsen, T. S. (2020). Experiences with using an idiographic assessment procedure in primary mental health care services for adolescents. International Journal of Qualitative Studies on Health and Well-Being, 15(1), 1763741. https://doi.org/10.1080/17482631.2020.1763741
  • Vallianatos, H., Friese, K., Perez, J. M., Slessor, J., Thind, R., Dunn, J., Chisholm-Nelson, J., Joober, R., Boksa, P., Lal, S., Malla, A., Iyer, S. N., & Shah, J. L. (2019). ACCESS Open Minds at the University of Alberta: Transforming student mental health services in a large Canadian post-secondary educational institution. Early Intervention in Psychiatry, 13(Suppl 1), 56–64. https://doi.org/10.1111/eip.12819
  • Van Hoy, A., & Rzeszutek, M. (2022). Burnout and psychological wellbeing among psychotherapists: A systematic review. Frontiers in Psychology, 13, 928191. https://doi.org/10.3389/fpsyg.2022.928191