8,780
Views
3
CrossRef citations to date
0
Altmetric
Articles

Sense of belonging in higher education students: an Australian longitudinal study from 2013 to 2019

ORCID Icon, , , , , & show all
Pages 395-409 | Received 27 Apr 2023, Accepted 13 Jul 2023, Published online: 21 Jul 2023

ABSTRACT

Student sense of belonging is a current challenge to higher education providers, with consistently declining ratings in national surveys. For universities globally, this is a concern linked to student attrition, student satisfaction, and student success. Importantly, low sense of belonging is typically associated with non-traditional learners, and building strategies to solve this challenge is essential for institutions to build equitable learning environments. This study seeks to understand the causal factors that predict when a student will belong using longitudinal data. Using the Australian national student experience survey data (n = 1,159,768 undergraduate and postgraduate students between 2013 and 2019), this study examines the predictors of a sense of belonging testing the accuracy of four machine learning models. The findings indicate overall educational experience, connection to students outside of class, and support to settle were key predictors, with skill development and curriculum supports a lesser predictor of a sense of belonging. Interestingly, identity and individual differences ratings seemed to have less importance than student experience factors. Implications for higher education policy developers and curriculum writers are considered.

Introduction

Massification of tertiary education has meant sustained growth in enrolment rates (Marginson Citation2016; O’Shea Citation2021). Yet, despite its high prevalence, higher education is still viewed, in many cultures and families, to be an essential step in adulthood for improved job prospects, elevated social status, or higher income earning potential (Ertem and Gokalp Citation2019). A successful transition to university remains important for many students, with a student’s ability to feel a sense of belonging in their new institution a key component contemporary universities have focused on.

Conversely, student attrition remains a major issue for tertiary institutions (Middleton et al. Citation2021), with early drop out, family or work commitments, financial constraints, and study loads commonly reported as causes (Nieuwoudt and Pedler Citation2021). Feelings of belongingness have been recognised as a major antidote to student attrition (e.g. O'Keeffe Citation2013). Feelings of belongingness can help students to overcome challenges, hardships or struggles, and mitigate or reduce non completion of their degree (Ajjawi et al. Citation2019). Similarly, retention is dependent on the extent to which students feel satisfied with the university which is also influenced by feelings of belonging (Meehan and Howells Citation2017).

Belonging, in a general sense, has been defined as a feeling of being accepted, included, and valued (Allen et al. Citation2021). Rooted in Maslow's (Citation1943) hierarchy of needs and Baumeister and Leary's (Citation1995) belongingness hypothesis, the need for belonging is posited as a fundamental human drive, which plays a crucial role in an individual's overall wellbeing, self-esteem, and motivation (Leary Citation2010). Since humans have a natural need or fundamental motive to belong (Baumeister and Leary Citation1995), many people will seek a sense of belonging to multiple groups, places, or people. While human needs for belonging might vary, belonging has been shown to be a universal human need (Baumeister and Leary Citation1995). As far as tertiary institutions are concerned, a sense of belonging to university can involve feelings of acceptance, inclusion, and connectedness not only to the institution but also to its members (e.g. other students and academics) and interestingly, once established, a fulfilled sense of belonging can create positive outcomes (Strayhorn Citation2012). Yet, there are different perspectives on the topic, with Naylor, Baik, and Arkoudis (Citation2018) using questions of likeability and community in their sense of belonging scale. Sense of belonging seems to be connected to early literature on a psychological sense of community, that is themes of loneliness, alienation, rootlessness, and feelings of not belonging were argued as associated with its decline (Sarason Citation1974). In this study, we do not adopt a specific approach on belongingness, and instead explore the data results to generate such meaning, as we discuss further. What is evident is that a sense of belonging is critical for positive university experiences, and understanding causal predictors is the foundation we use to structure this study.

As we go onto discuss, most studies that speak to belonging and student engagement tend to rely on smaller scale datasets using regression and exploratory qualitative research. These studies, discussed in the next section, are critical in seeking to unpack possible student interfaces with belonging. In this study, we seek to take a deep causal analysis of what predicts belonging. To our knowledge, this level of analysis using the size and timeframe of data reported has not occurred, and may offer some direct inferences that universities, governments, and educators can use to change general declines in student sense of belonging. To do this, we begin with a brief discussion of student success, retention, and belonging; with existing evidence suggesting that when people belong, they stay (or are retained and are successful), and discuss the extant literature on belonging in universities and colleges. Next, we consider the machine learning approaches taken, what our results say, and provide an extended discussion on the significance of this data from research, theory, and practice perspectives.

Student success, retention, and belonging

Student success and retention are of considerable importance to universities and governments, regardless of the frame of measurement (e.g. grade performance, students retained, completion rates). This is particularly true in underserved populations, who are often find it more difficult to belong, fit-in, and succeed. In the United States, student attrition was at 45%, with many Australian institutions above 20% student attrition (O'Keeffe Citation2013). These numbers have largely remained the same since, although expectations of education cost increases could place downward pressure on student success.

There have been diverse perspectives on how universities can support student success, as a suggested antecedent to longer-term retention. In one review, academic achievement, critical thinking, and wellbeing were identified as key to first-year student success (van der Zanden et al. Citation2018). Historically, this has changed over time, with a 10 year meta-analysis (1981–1990) indicated grade point average, parental education, and age were the greatest predictors of student success (Campbell and Dickson Citation1996), with academic performance in high school still a key predictor of retention (Han, Farruggia, and Solomon Citation2022). In Citation2018, Sneyers and de Witte identify that interventions like academic probation, student–faculty mentoring, and need-based grants can influence both success and completion rates. Goldrick-Rab (Citation2010) argues that policy beyond the individual level, and recommends for institution- and student-level reforms can support sustained student success.

More recently, approaches to student success and retention have extended on Tinto’s (Citation1975; Citation2006) work on attrition (or ‘dropout’) to focus on creating social integration opportunities for students. This has also extended to understanding the role that sense of belonging plays in creating environments students want to be in, and do well in (Strayhorn Citation2018). Kahu and Nelson (Citation2018) in a proposed model of student engagement articulate that student engagement is the key to achievement, success, and retention. Within their model, they propose that four key psychosocial constructs on the educational interface are critical mechanisms that enable student engagement and success: self-efficacy, emotions, belonging, and wellbeing. In a later empirical test (Crawford et al. Citationforthcoming), this model was held true across multiple geographical contexts; with belonging positioned as the key (negative) predictor of student intentions to leave along with student wellbeing. Bowden, Tickle, and Naumann (Citation2021) with 952 students in an Australian university, confirm the model similarly with antecedents of expectation and involvement as key differences.

Belonging in tertiary student populations

Beyond retention and success, a sense of belonging to university has also been found to increase student well-being and reduce feelings of loneliness. The start of university can mark a major developmental shift in the life of a young adult associated as it is with social group changes, adjustments to social support, changes in relationships with parents, and social identity, which can result in feelings of loneliness and lead to further mental health problems including depression (Parker et al. Citation2020). This can be further exacerbated for international students or students from marginalised social groups, with diverse students identifying material boundaries that enabled social capital in permeability, content, and salience of symbolic boundaries as barriers (Buckley Citation2023). Under these conditions, the ability to successfully form new social bonds at university can not only provide a smooth transition to university but also ensure that feelings of loneliness and its associated negative outcomes can be prevented (Thomas, Orme, and Kerrigan Citation2020).

A major concern about higher education student belonging exists for students who feel they do not belong, or in this study are in the ‘low’ self-reported category of belonging. For example, in one study, it was identified students want their names to be known, as a manifestation that they perceive a relationship to exist between them and their teacher (Cooper et al. Citation2017). Research from two Australian universities highlights that some groups in particular, such as first-in-family, question their ability to succeed, or right to attend the institution in the first place (O’Shea Citation2021). While students with low belonging are a minority, perceptions of fit can vary and students from minority backgrounds are most at risk (Weng et al. Citation2021). For example, Chinese, Indian and Russian international students studying in Melbourne and Hobart had external factors beyond the university that affected their sense of belonging; such as geopolitical relationships between Australia and their home countries or the level of religious support they receive (Weng et al. Citation2021). International students may even benefit the most from a sense of belonging as belonging has been found to be a protective factor for resilience.

Other correlates of belonging found in Australian Universities specifically include associations with motivation, enjoyment, and retention (Pedler, Willis, and Nieuwoudt Citation2022). Student friendship networks, social connections, and having campus spaces for peer interactions and space to ‘be themselves’ also have significant associations with belonging (van Gijn-Grosvenor and Huisman Citation2020). Ahn and Davis (Citation2020), using thematic analysis with 426 participants also extend to highlight expectations that personal space and environmental surrounding influence student sense of belonging. In addition, students also report feeling respected, accepted, and valued when clubs and events are available to them. Young Ahn and Davis (Citation2023) extend identifying that academic and social engagement influence belonging, but were independent of each other.

Current study

In Australia, there are 41 comprehensive universities, primarily public universities established by state-level Acts of Parliament. In Citation2022, Universities Australia reported that Australia has a below-OECD average public investment into university, and an above average private investment. In 2020, there were around 1.05 million domestic students and 413,088 international students, representing the fourth largest economic export for the country. Generally, the larger Australian universities occupy the top five per cent of universities on academic rankings globally, and out-represent most countries in the Times Higher Education Impact Rankings (Citation2023). Across the country, the national Student Experience Survey (SES) is an annual survey conducted on behalf of the Federal Government that measures tertiary students’ higher education experiences across six key indicators: overall educational experience, teaching quality, skills development, learner engagement, learning resources and support services (Social Research Centre Citation2022). Between 2013 and 2019, 1,431,083 responses have been received, with annual data collected and retained by the Australian government. This survey, like many others globally, highlights sustained lows in student belonging when contrasted to other experience metrics (e.g. the National Survey of Student Engagement: NSSE, Citation2021). As we go onto discuss, Australian institutions like others are seeking to respond.

The primary objective of this study is to identify the key predictors of students’ sense of belonging in higher education and to understand how these predictors can be utilised to enhance student success, retention, and overall well-being. Drawing on data from the Australian national Student Experience Survey (SES), we focus on the Australian higher education context to provide insights applicable to a broader global audience. We employ a quantitative approach to examine the relationships between various factors related to student experiences and their sense of belonging, considering demographic information and historical data to determine the most influential predictors. By understanding these predictors, we aim to inform evidence-based strategies that can be implemented by tertiary institutions to create more inclusive and supportive environments for students, thereby fostering a stronger sense of belonging and yielding improved outcomes in terms of student success, retention, and well-being. Specifically What are the student experience predictors of a sense of belonging?

Method

The present study hypothesises that we can predict student belonging using the student experiences and demographics as major predictors. We do this through initially comparing four predictive models. This study uses large scale secondary data collected as part of the national Student Experience Survey between 2013 and 2019. Ali et al. (Citation2021) provide critique on using national and local institutional student survey data without considering validity and reliability prior to data usage, and likewise considering the design and context of administration. In this study, we adopt these recommendations throughout.

Participants

The SES is administered annually online to all commencing and final year undergraduate and, since 2017, postgraduate (coursework) students enrolled at Australian HE institutions, including both domestic and onshore international students. In 2020, the scope of the survey was extended to include students who intended to be onshore at the time of the survey, but were studying offshore due to government-imposed travel restrictions due to the COVID-19 pandemic. Commencing students are defined as first-year students admitted to a course who commenced study in the survey year and enrolled for at least one semester. Final year students are defined as final-year students admitted to a course and generally in their third year of study. While the data offers a somewhat historical analysis, it was essential for us that we gain baseline sense of belonging data without COVID-19 influences (Tice et al. Citation2021). This study offers a critical foundation in understanding what education was like before COVID-19, and indeed allows for us, or future scholars, to then test assumptions like these during and beyond the pandemic context. While there will be value in analysing the 2020 and beyond datasets, a clear pre-COVID-19 baseline is needed; of which this study offers. Indeed, there are several studies that refer to differences in belonging in the pre- and during-pandemic context, in this national survey, the approaches to inclusion criteria changed from 2020 to include a broader set of students. While this may be useful for future analysis, we opted to keep this dataset quarantined to a consistent set of controls around sampling.

A stratified sampling approach was employed, with strata defined on the basis of institution, study area, course level and stage of studies. However, as stratum-level results are reported at a level of precision of ±7.5 percentage points at a 90% level of confidence, the SES is effectively a census of commencing and final year students, except for those universities which offer a generalist degree (Social Research Centre Citation2022). Institutions are required to confirm that the selected students are in-scope. From 2013 to 2019 3,581,218 students received an invitation to participate in the SES. A total of 1,431,083 unique student responses were received, representing an overall response rate of 40%.

Measures

The SES was originally developed as the University Experience Survey (UES) in 2011, to provide a national architecture for collecting feedback on key facets of the HE student experience (Social Research Centre Citation2022). The UES items were selected based on the most relevant aspects of the student experience that research showed to be associated with positive learning outcomes for students in ways that could be generalised across all institutions, educational contexts and different demographic groups, and to focus on aspects of the student experience that can be shaped and influenced by universities (Radloff et al. Citation2011). The survey development process included extensive consultation with experts in the field and the sector more broadly, including focus groups with students. Prior to its implementation, the instrument underwent extensive face and content validation through a pilot with students, psychometric testing, a further review of items, and an independent technical review (Radloff et al. Citation2011). The UES was renamed the SES in 2015 to facilitate the inclusion of students from non-university higher education institutions. Other than minor wording changes to ensure survey relevance, the core SES questionnaire has remained relatively unchanged from the 2013 UES, consisting of 47 items across six focus areas: overall educational experience; teaching quality; learner engagement; learning resources; student support; and skills development. While there is unique value in the data prior to 2013, the differences in the tool prior to that period mean that there are different variables available only over some of the years, resulting in large scale missing data reducing the efficacy of our study. As such, we use data from 2013 onwards.

In this study, we excluded the items relating to careers advisors, other advisors, academic advisors, and English language support (from the student support subscale), and the items relating to laboratory or studio equipment quality and learning platform quality (from the learning resources sub-scale), because they were either only asked in a few timepoints, or they had very high missing or not applicable response rates (>30%). We did include the demographic variables available (listed in ), although none were presented as high feature importance. A self-report student success measure (e.g. self-report GPA) was also included and was less performant than student experience items. The reliability for the SES subscales was consistently high, ranging from α = 0.74 (engage subscale) to α = 0.93 (teach subscale). The full instrument and extended sampling information are available in the Social Research Centre (Citation2022).

Table 1. Description of sample.

Analysis

As the primary hypothesis related to prediction, we used an analysis approach consistent with evaluating the accuracy of predictions on future data (Parker et al. Citation2018). Importantly, prediction models and explanation models are fundamentally different, with social sciences rarely engaging in true prediction research. Our focus is on true prediction (i.e. prediction of unseen data). We collapsed the outcome variable to a binary indicator consisting of low belonging (those responding ‘not at all’ or ‘very little’) and those with more than low belonging (‘some’ or greater). We chose a dichotomous variable as it more closely aligns with the concerns of universities. That is, universities are concerned with accurately determining students who have low levels of belonging requiring intervention, and are less concerned with predicting a student’s exact response. We used a training sample consisting of 80% of the available data, stratified by the outcome variable, with the remaining 20% of data used to evaluate the final models.

Models

To identify the most appropriate model, we evaluated the efficacy of four predictive machine learning modelling parameters using the training data: logistic regression (Friedman et al. Citation2021), random forest (Wright, Wager, and Probst Citation2021), boosted trees (Chen et al. Citation2021), and a neural network (Allaire and Chollet Citation2022). For each model, we performed hyperparameter tuning using five-fold cross-validation to reduce the risk of overfitting. Following the training, we selected the most performant model based on the F-measure (sometimes called the F1-score, Powers Citation2020). The F-measure is the harmonic mean of the precision and recall, and provides a better indicator of model performance than accuracy which can be misleading for unbalanced data. This allowed us to accurately select the appropriate modelling prior to examining the test data. To determine which features were most related with belonging, we examined the Gini index of variable importance. Variable importance is based on if the variable has positive influence on the prediction performance (Wright, Ziegler, and König Citation2016). In addition, we generated partial dependency plots for each item in the subscales. Partial dependency plots show how a prediction is influenced by a value of a variable. That is, as the variable changes value, what is the resulting effect on the prediction.

Results

Description of sample

The study includes annual survey responses between a low of 88,009 (7.6% response rate, 2013) and 211,163 (18% response rate, 2018). The respondents were primarily commencing students (59% first year), studying by internal/mixed mode (92%), were people without a disability (94%), domestic students (78%), and studying full-time (87%). The participants had an average age of 23.62 (standard deviation of 7.95), and only 1.2% identified as indigenous. Participants mainly came from an English-speaking background (77%) and studied at an undergraduate level (82%). For more specific descriptive sample statistics, see . When considering this against the national sample, we considered the Australian Government (Citation2020)’s 2019 student tables, noting there were less students in the population that were commencing (40%), with less internal/mixed mode (84%), and 1.3% identified as indigenous.

Model evaluation

The metrics for the fit models is provided in . Hosmer, Lemeshow, and Sturdivant (Citation2013) recommend a predictive accuracy for the area under the receiver operating characteristic (ROC) curve (AUC) of between 0.80 and 0.90, and all tested models met this criteria. On this basis, we conclude that our primary hypothesis is confirmed. That is, using national survey data we can predict student belonging with reasonable accuracy. The boosted trees model was the most performant across the majority of measures, and is the model used for further evaluation.

Table 2. Model metrics comparison.

Feature importance

shows the eight most important variables in the boosted tree model. These are based on whether the variable has a positive influence on the prediction performance (Wright, Ziegler, and König Citation2016). The quality of the overall educational experience (from the teaching quality subscale) and sense of support for settling into the institution were the most influential features in the model, with other variables having relatively minor influence. The relative variable importance was largely consistent across the boosted trees, logistic regression, and random forest models (data not shown). We did consider whether relative variable importance differed across undergraduate and postgraduate student. Results showed little meaningful differences in the most important features across course level.

Figure 1. Top eight most important predictors of belonging.

Figure 1. Top eight most important predictors of belonging.

Partial dependency analysis

In addition to variable importance, we also investigated how predictions are influenced by various levels of a predictor variable. That is, all other variables are held constant, and the effect of varying a single predictor on the probability of a prediction is measured. We used 25,000 iterations for each predictor variable to estimate the effect. The results are shown in . We observe that for most items, the largest benefit to belonging is created by moving a student’s response from the first or second value (from ‘sometimes’ to ‘often’ on four-point scales, and from ‘very little’ to ‘some’ on five-point scales). For most subscales, the partial dependency plots indicate a small number of areas which have drastic effects on the students who reported an either high or low sense of belonging.

Figure 2. Prediction of above low belonging by subscale.

Figure 2. Prediction of above low belonging by subscale.

Each subscale tended to have one or two items that had a stronger effect than others. In the teaching quality subscale, the quality of the overall educational experience was a strong contributor to changes in student belonging. The quality of student spaces from the learning resources subscale had clear differences in its predictive role. Interaction outside of study, and with local students, and preparedness for study were strong contributors to a sense of belonging (in the learner engagement subscale). It is not surprising that these have a contributory role, given that the sense of belonging item sits inside of the learner engagement scale. The skill development subscale is the exception, providing a substantial number of areas which have a strong impact. Each of these is discussed in more depth within the discussion.

Discussion

Using the Australian SES dataset, the current study sought to determine which student experiences and student demographics predicted their sense of belonging. Of all the features, the self-reported overall quality of the students’ educational experience was found to be the most important influencer of student belonging. This is an important observation, as the item asks, overall how would you rate the quality of your entire educational experience this year? (Social Research Centre Citation2022), which could be a form of general litmus test that students present their general feelings about their experience. Past research has found that the prospect of a better career is one of the driving factors for students’ pursuing higher education (Balloo, Pauli, and Worrell Citation2017). This is also a factor found to determine student choice of university or course selection (Proboyo and Soedarsono Citation2015). Students may attach far greater importance to their educational experience, because this could be perceived as allowing them to fulfil or meet their career aspirations. An interesting contrast to this was the lower relationship between work readiness developed during the course and student belonging.

While results suggest a link between educational experiences and sense of belonging, it is important to note that other factors are likely to mediate this relationship. Poor educational experiences alone, for instance, may not be immediately influenced by the multidimensional construct of belonging or vice versa. The move to higher education can be a significant shift for students and many students can begin university with preconceived ideas for what their experience should look like (Hassel and Ridout Citation2018). These ideas may be based on their experiences in secondary school, and the misalignment between expectations and reality for some students can impact their sense of belonging or academic fit (Worsley, Harrison, and Corcoran Citation2021).

The second most influential factor for belonging was support for settling into the institution. The importance of general support in fostering belonging is well established in the literature and in a general sense, higher perceived support is linked with a greater sense of belonging (Allen et al. Citation2022). However, within the university context, the move to a tertiary institution can be particularly challenging for students and as such, adequate support towards this transition, and predictive models for early detection (Hoffait and Schyns Citation2017) and a welcoming institution are essential for facilitating a sense of belonging.

Arguably the first source of support to settle into the institution may come from the family or prior educational contexts, which play a vital role in a student’s transitional period. Given the importance of support for settling into the institution found in the current study, institutional mechanisms for a concerted and systematic way of offering support well before a student steps foot inside the university grounds (physically or online) may be beneficial to students. Navigating such support may be more crucial for the successful transition of underserved student cohorts such as those living with disability, those with culturally and linguistically diverse backgrounds, first generation students, or those with low socioeconomic backgrounds (McLean, Gaul, and Penco Citation2022). When individuals do not feel like they belong to their university they are more likely to also question their ability to succeed and even their ‘right’ to attend higher education in the first place (O’Shea Citation2021). Therefore it becomes important for institutions to be proactive in ensuring all students feel welcomed, accepted, and supported while settling in.

With respect to providing support to settle in, drawing on the existing strengths of student groups’ support systems is key in providing such support. For example, Weng et al. (Citation2021) found that for Chinese, Indian and Russian international students in two Australian cities, ethnic and religious community organisations offered an immense source of connectedness and belonging. Student groups with similar cultural needs were also important and thus institutions may wish to consider developing effective relationships with cultural and religious groups to enable students to practice their own cultural and religious beliefs while living abroad.

Entering university for the first time also tends to correspond with a major developmental and identity shift towards independence. While in this study, we allowed demographic factors that contribute to identity and individual differences in the machine learning dataset, they did not seem to be as important to a student’s sense of belonging compared to their self-report ratings of factors of experience. This is perhaps quite a contrast to notions of identity-based belonging (e.g. Sulé and Brown Citation2023; Yuval-Davis Citation2006) worthy of future exploration. In the current study, opportunities for genuine connection were key to student belonging. Student ratings saw great incremental predictability at low levels of ratings associated with connection (opportunities to interact with local students, teamwork developed by course, student interaction outside of study), congruent with past research on the importance of peer support (Brouwer et al. Citation2022). Peers are a key source of support as students adjust to university, cope with stress, and academic demands. In addition, through group work and peer tutoring, university students also gain academic support which can enhance their educational experience and further foster belongingness. For many institutions, peer mentoring is a systemic support that facilitates peer interactions, and essential for a smooth transition to university. Such positive transitions ultimately lead to a greater sense of belonging (Worsley, Harrison, and Corcoran Citation2021). Socio-emotional interpersonal knowledge, gained through mutual disclosure, between members of a university community was found in one study to create a sense of community (Nistor et al. Citation2015), and the data in this study may reinforced their conclusions. Other systemic considerations include having places on campus for peers to interact and having clubs and events that facilitate social integration (van Gijn-Grosvenor and Huisman Citation2020).

Inductions and orientations were also great influencers of university students’ sense of belonging. In the Australian context, orientations tend to be in the form of optional ‘O-Week’ activities the week prior to classes commencing. These environments tend to be coordinated by Student Associations and student experience departments, include free food, music, activities, and have heavy student involvement through societies. It may be that inductions and orientations provide a catalyst for making the first meaningful connection with new students, in an exciting on-campus environment, a key foundation to generating a sense of belonging (Baumeister and Leary Citation1995). Yet it appeared to suggest that development employment skills were less important, although this study did not stratify by demographics, and demographics have been shown to be predictive in this area (see Beasy et al. Citation2022).

All staff, but particularly those responsible for student learning may also have a role in facilitating peer interactions for the benefit of student belonging. In some ways, a focus on embedding opportunities to build social connection may align closely to conversations of community building that exist in different higher education jurisdictions (e.g. Dawson Citation2006). Staff professional development training emphasising the importance of belongingness in students is critical, especially in appreciating that belonging is dynamic and for many individuals, relational (Guyotte, Flint, and Latopolski Citation2021). Tice et al. (Citation2021) found that even online, strengthening belonging was possible and that a core mechanism for maintaining belonging – even during uncertain times such as lockdown orders – was through facilitating peer interactions. And while some scholars report challenges for student belonging in online environments (e.g. DiGiacomo et al. Citation2023; Miller-Young, Jamieson, and Beck Citation2023; Mueller, Andrew, and Connor Citation2022), this was challenged in this dataset, with relationships between sense of belonging and student experience as more important.

The role of student skill development was found to have negligible benefits for belonging in the current study, and this comes in direct conflict with current assumptions around one key tenet of the transition pedagogy, which emphasises the importance of skill development for student belonging (Kift, Nelson, and Clarke Citation2010). This would suggest that rather than a focus on embedded critical literacies and skill development, a greater emphasis on connectivity would support students to transition to an institution they felt a sense of belonging to. Student skills developed in class, such as discipline knowledge, critical thinking, complex problem solving, and written communication had low incremental changes on their predictive effect on sense of belonging, whereas skills such as teamwork, confidence to learn independently, and spoken communication development in class were those that saw the greatest improvement over time for belonging. This finding highlights the importance of belonging-based skill and competency development in students specifically related to belonging, social skills, and building peer networks. Skills and attributes that help students relate, and develop a sense of relatedness, to others become very important for belonging alongside opportunities (Allen et al. Citation2021).

Strengths, limitations, and future directions

Given the importance of belonging in student motivation, retention, and enjoyment in studies (Pedler, Willis, and Nieuwoudt Citation2022) this paper provides a rigorous analysis of factors that predict belonging in higher education. The study is strengthened by a large sample size (exceeding one million participants), measured over multiple years (2013–2019), and the use of true prediction (i.e. prediction of unseen data). The latter is not frequently done in social science research. The study however was limited by drawing data from a single item measure of belonging, positioned within an engagement index.

In the literature, engagement and belonging are considered as very distinct and separate constructs (O'Brennan and Furlong Citation2010). Limitations also exist due to the nature of secondary data analysis. Because belonging is multifaceted and dynamic it is likely predicted by many more variables explored in the study. Future research on university policies, programs and learning contexts are needed to fully understand the variables that can be influenced and manipulated to build belonging through higher educational leadership (O’Shea Citation2021).

Despite these limitations, this study is strengthened by its large-scale longitudinal dataset having more than one million student respondents across almost one decade of higher education. To our knowledge, this is the largest scale study conducted on the predictors of belonging using longitudinal data and machine learning to develop predictive models. This study provides direct mechanisms for university policy developers and educators to respond to historically low levels of student belonging globally, using a national dataset. This is consistent with some calls to focus more on relational approaches to pedagogy to build belonging (Graham and Moir Citation2022). An interesting direction of future research relates to the skill development effects on a sense of belonging, which were considerably lower than other predictors. Indeed, a deeper understanding of the conflict that exists with this finding and that of the transition pedagogy is important in supporting diverse student cohorts to transition effectively into higher education.

There is a growing consensus towards understanding belonging as a multifaceted and dynamic (as opposed to static) process involving multiple spaces and experiences of connectedness (Guyotte, Flint, and Latopolski Citation2021). This implies that we can expect that individual student’s sense of belonging may fluctuate as they progress through their university experience, it seems the full dataset does not show that commencing versus final year, and undergraduate versus postgraduate students were not as performant as student experience variables. Generally, we would also expect the experiences of belonging to change in different spaces (physical/ virtual; class/cohort/program/university), for students from different backgrounds (e.g. international students: Weng et al. Citation2021), first in family students (O’Shea Citation2021) and to be influenced by the resources that are made available to foster belonging; yet these seemed less important in the dataset than ratings of student experience. This is perhaps related to what students perceive as ‘belonging’ and may call for deeper analysis with a wider range of subset questions for sense of belonging, as in studies like Naylor, Baik, and Arkoudis (Citation2018).

The national survey data provides only one snapshot of belonging annually, and using a single-item that may be subjective to student perceptions of what it means to feel a sense of belonging. While this is perhaps beneficial to foster a genuine student voice void of academic interpretation, it does present the possibility of divergence between scholarly and student perspectives of belongingness. Universities that want to measure belonging should consider doing so at different time points and even consider experience sampling methodology, or a question battery, to facilitate this. This, of course, also is a limitation of the data. The data is typically captured at the same time point annually, and is situated in Australia only; meaning that while the data represents incredibly diverse and multicultural students, they are all based in Australia. The data is also specifically pre-COVID-19 to minimise the influence that the pandemic is having on students. We encourage future studies to baseline their COVID-19 results against these pre-pandemic indicators of belonging.

An important extension of the theory of the need to belong identified by Baumeister and Leary (Citation1995) emerged from the current work, suggesting that there may be a minimum need for belongingness, and once that minimum need is met, further relationships have diminishing value. In the current study, there were a series of items that created rapid improvements in predictivity at low levels (the scores of 1 and 2 typically); however, they tended to plateau and sometimes decline in the higher levels (scores of typically 3, 4, and 5). We measured and tested belongingness as a binary state of low and above-low, and it seemed that the differences that appeared once a person had satisfied the threshold criteria of above-low, the model did not go on to see significant changes in most items. This perhaps provides evidence that belonging as a need once satisfied does not typically go on to be more deeply satisfied or increase feelings of belongingness once that need is met. This is perhaps a useful question to pose regarding sense of community in parallel; that is, whether sense of community has a saturation point with diminishing returns beyond.

Conclusions

This study sought to leverage the national Student Experience Survey data to better understand the predictors of student belongingness in higher education. Through the use of boosted tree predictive modelling, with high accuracy (0.79), we were able to use the national survey data to identify predictors of student belonging. Overall educational experience, support to settle, student interaction outside of study and with local students, inductions and orientations, course-developed teamwork, quality of teaching, and sense of preparedness were the top predictors of a student’s sense of belonging. We found that skill development, while having a contributory role in sense of belonging, were generally lower in their predictive effect than others. This study contributes to the knowledge base on belonging in higher education by applying novel methods to a large-scale dataset to better understand what predicts a sense of belonging. Beyond this method, we begin to identify and rank the performance of institutional and curriculum supports that foster student belonging, and provide direct opportunities for higher education policy makers and curriculum developers to embed supports that can enable students more opportunities to develop a sense of belonging on and off campus.

Disclosure statement

No potential conflict of interest was reported by the author(s). This manuscript was developed and written without any artificial intelligence support.

References

  • Ahn, M. Y., and H. H. Davis. 2020. “Four Domains of Students’ Sense of Belonging to University.” Studies in Higher Education 45 (3): 622–34. https://doi.org/10.1080/03075079.2018.1564902.
  • Ahn, M. Y., and H. H. Davis. 2023. “Students’ Sense of Belonging and Their Socio-Economic Status in Higher Education: A Quantitative Approach.” Teaching in Higher Education 28 (1): 136–49. https://doi.org/10.1080/13562517.2020.1778664.
  • Ajjawi, R., M. Dracup, N. Zacharias, S. Bennett, and D. Boud. 2019. “Persisting Students’ Explanations of and Emotional Responses to Academic Failure.” Higher Education Research & Development 39 (2): 185–99. https://doi.org/10.1080/07294360.2019.1664999.
  • Ali, A., J. Crawford, L. Cejnar, K. Harman, and K. N. Sim. 2021. “What Student Evaluations Are Not: Scholarship of Teaching and Learning Using Student Evaluations.” Journal of University Teaching & Learning Practice 18 (8): 1. https://doi.org/10.53761/1.18.8.1.
  • Allaire, J., and F. Chollet. 2022. Keras: R Interface to Keras. https://keras.rstudio.com.
  • Allen, K. A., B. Cordoba, T. Ryan, G. Arslan, C. Slaten, J. K. Ferguson, B. Bozoğlan, A. Abdollahi, and D. Vella-Brodrick. 2022. “Examining Predictors of School Belonging Using a Socio-Ecological Perspective.” Journal of Child and Family Studies. Advance online publication. https://doi.org/10.1007/s10826-022-02305-1.
  • Allen, K. A., M. Kern, C. Rozek, D. McInerney, and G. Slavich. 2021. “Belonging: A Review of Conceptual Issues, an Integrative Framework, and Directions for Future Research.” Australian Journal of Psychology 73 (1): 87–102. https://doi.org/10.1080/00049530.2021.1883409.
  • Australian Government. 2020. 2019 Student Summary Table. Department of Education, Skills, and Employment. Accessed June 22, 2023. https://www.education.gov.au/higher-education-statistics/resources/2019-student-summary-tables.
  • Balloo, K., R. Pauli, and M. Worrell. 2017. “Undergraduates’ Personal Circumstances, Expectations and Reasons for Attending University.” Studies in Higher Education 42 (8): 1373–84. https://doi.org/10.1080/03075079.2015.1099623.
  • Baumeister, R., and M. Leary. 1995. “The Need to Belong: Desire for Interpersonal Attachments as a Fundamental Human Motivation.” Psychological Bulletin 117 (3): 497–529. https://doi.org/10.1037/0033-2909.117.3.497.
  • Beasy, K., J. Crawford, S. Young, and J. Kelder. 2022. “A Quantitative Study on Australian Doctoral Students’ Perceptions of Employability Preparedness: How Gender and Age Matter.” Journal of Further and Higher Education. Advance online publication. https://doi.org/10.1080/0309877X.2022.2050687.
  • Bowden, J. L. H., L. Tickle, and K. Naumann. 2021. “The Four Pillars of Tertiary Student Engagement and Success: A Holistic Measurement Approach.” Studies in Higher Education 46 (6): 1207–24. https://doi.org/10.1080/03075079.2019.1672647.
  • Brouwer, J., C. de Matos Fernandes, C. Steglich, E. Jansen, W. Hofman, and A. Flache. 2022. “The Development of Peer Networks and Academic Performance in Learning Communities in Higher Education.” Learning and Instruction 80:101603. https://doi.org/10.1016/j.learninstruc.2022.101603.
  • Buckley, J. B. 2023. “From “Cliques” to “Common Ground”: Social Class, Layered Belonging, and Characteristics of Symbolic Boundaries in the Transition from Public High Schools to a Public University.” The Journal of Higher Education 94 (1): 8–33. https://doi.org/10.1080/00221546.2022.2131963.
  • Campbell, A. R., and C. J. Dickson. 1996. “Predicting Student Success: A 10-Year Review Using Integrative Review and Meta-Analysis.” Journal of Professional Nursing 12 (1): 47–59. https://doi.org/10.1016/S8755-7223(96)80074-3.
  • Chen, T., T. He, M. Benesty, V. Khotilovich, Y. Tang, and Y. Li. 2021. xgboost: Extreme Gradient Boosting. https://github.com/dmlc/xgboost.
  • Cooper, K. M., B. Haney, A. Krieg, and S. E. Brownell. 2017. “What’s in a Name? The Importance of Students Perceiving That an Instructor Knows Their Names in a High-Enrollment Biology Classroom.” CBE—Life Sciences Education 16 (1): ar8. https://doi.org/10.1187/cbe.16-08-0265.
  • Crawford, J., J. Rudolph, O. O’Brien, M. Glowatz, L. Itangata, S. Tan, K. Allen, and J. Kelder. Forthcoming. “Student Engagement in the Educational Interface: A Cross-Cultural Structural Equation Model.”
  • Dawson, S. 2006. “A Study of the Relationship Between Student Communication Interaction and Sense of Community.” The Internet and Higher Education 9 (3): 153–62. https://doi.org/10.1016/j.iheduc.2006.06.007.
  • DiGiacomo, D. K., E. L. Usher, J. Han, J. M. Abney, A. E. Cole, and J. T. Patterson. 2023. “The Benefits of Belonging: Students’ Perceptions of Their Online Learning Experiences.” Distance Education 44 (1): 24–39. https://doi.org/10.1080/01587919.2022.2155615.
  • Ertem, H. Y., and G. Gokalp. 2019. “Role of Personal and Organizational Factors on Student Attrition from Graduate Education: A Mixed-Model Research.” Journal of College Student Retention: Research, Theory & Practice 23 (4): 903–28. https://doi.org/10.1177/1521025119881391.
  • Friedman, J., T. Hastie, R. Tibshirani, B. Narasimhan, K. Tay, N. Simon, and J. Yang. 2021. glmnet: Lasso and Elastic-Net Regularized Generalized Linear Models. https://CRAN.R-project.org/package=glmnet.
  • Goldrick-Rab, S. 2010. “Challenges and Opportunities for Improving Community College Student Success.” Review of Educational Research 80 (3): 437–69. https://doi.org/10.3102/0034654310370163.
  • Graham, C. W., and Z. Moir. 2022. “Belonging to the University or Being in the World: From Belonging to Relational Being.” Journal of University Teaching & Learning Practice 19 (4). https://ro.uow.edu.au/jutlp/vol19/iss4/04.
  • Guyotte, K. W., M. A. Flint, and K. S. Latopolski. 2021. “Cartographies of Belonging: Mapping Nomadic Narratives of First-Year Students.” Critical Studies in Education 62 (5): 543–558.
  • Han, C. W., S. P. Farruggia, and B. J. Solomon. 2022. “Effects of High School Students’ Noncognitive Factors on Their Success at College.” Studies in Higher Education 47 (3): 572–86. https://doi.org/10.1080/03075079.2020.1770715.
  • Hassel, S., and N. Ridout. 2018. “An Investigation of First-Year Students’ and Lecturers’ Expectations of University Education.” Frontiers in Psychology 8:2218. https://doi.org/10.3389/fpsyg.2017.02218.
  • Hoffait, A., and M. Schyns. 2017. “Early Detection of University Students with Potential Difficulties.” Decision Support Systems 101:1–11. https://doi.org/10.1016/j.dss.2017.05.003.
  • Hosmer, D. W., S. Lemeshow, and R. X. Sturdivant. 2013. Applied Logistic Regression. 3rd ed. Hoboken, NJ: Wiley.
  • Kahu, E. R., and K. Nelson. 2018. “Student Engagement in the Educational Interface: Understanding the Mechanisms of Student Success.” Higher Education Research & Development 37 (1): 58–71. https://doi.org/10.1080/07294360.2017.1344197.
  • Kift, S., K. Nelson, and J. Clarke. 2010. “Transition Pedagogy: A Third Generation Approach to FYE-A Case Study of Policy and Practice for the Higher Education Sector.” International Journal of the First Year in Higher Education 1 (1): 1–20. https://doi.org/10.5204/intjfyhe.v1i1.13.
  • Leary, M. R. 2010. “Affiliation, Acceptance, and Belonging: The Pursuit of Interpersonal Connection.” In Handbook of Social Psychology, edited by S. T. Fiske, D. T. Gilbert, and G. Lindzey, 864–97. John Wiley & Sons. https://doi.org/10.1002/9780470561119.socpsy002024.
  • Marginson, S. 2016. “The Worldwide Trend to High Participation in Higher Education: Dynamics of Social Stratification in Inclusive Systems.” Higher Education 72 (4): 413–34. https://doi.org/10.1007/s10734-016-0016-x.
  • Maslow, A. 1943. “A Theory of Human Motivation.” Psychological Review 50 (4): 370. https://doi.org/10.1037/h0054346.
  • McLean, L., D. Gaul, and R. Penco. 2022. “Perceived Social Support and Stress: A Study of 1st Year Students in Ireland.” International Journal of Mental Health and Addiction. Advance online publication. https://doi.org/10.1007/s11469-021-00710-z.
  • Meehan, C., and K. Howells. 2017. “‘What Really Matters to Freshers?’An Evaluation of First Year Student Experience of Transition into University.” Journal of Further and Higher Education 42 (7): 893–907. https://doi.org/10.1080/0309877X.2017.1323194.
  • Middleton, R., R. Fernandez, N. Cutler, C. Jans, C. Antoniou, B. Trostian, and K. Riley. 2021. “Students’ Perceptions of Belonging in the School of Nursing at a Regional University in Australia.” Nurse Education Today 99:104817. https://doi.org/10.1016/j.nedt.2021.104817.
  • Miller-Young, J., M. Jamieson, and S. Beck. 2023. “Diverse Experiences and Belonging in an Online, First-Year, Team-Based Engineering Design Course.” Teaching in Higher Education, 1–17. https://doi.org/10.1080/13562517.2022.2162816.
  • Mueller, B., M. B. Andrew, and M. Connor. 2022. “Building Belonging in Online WIL Environments – Lessons (Re)Learnt in the Pandemic Age: A Collaborative Enquiry.” Journal of University Teaching & Learning Practice 19 (4): 16. https://doi.org/10.53761/1.19.4.14.
  • National Survey of Student Experience. 2021. 2020 National Survey of Student Experience ‘Sense of Belonging’. Indiana University. Accessed June 17, 2021. https://nsse.indiana.edu/nsse/reports-data/nsseoverview.html.
  • Naylor, R., C. Baik, and S. Arkoudis. 2018. “Identifying Attrition Risk Based on the First Year Experience.” Higher Education Research & Development 37 (2): 328–42. https://doi.org/10.1080/07294360.2017.1370438.
  • Nieuwoudt, J., and M. Pedler. 2021. “Student Retention in Higher Education: Why Students Choose to Remain at University.” Journal of College Student Retention: Research, Theory & Practice. https://doi.org/10.1177/1521025120985228.
  • Nistor, N., I. Daxecker, D. Stanciu, and O. Diekamp. 2015. “Sense of Community in Academic Communities of Practice: Predictors and Effects.” Higher Education 69 (2): 257–73. https://doi.org/10.1007/s10734-014-9773-6.
  • O'Brennan, L., and M. Furlong. 2010. “Relations Between Students’ Perceptions of School Connectedness and Peer Victimization.” Journal of School Violence 9 (4): 375–91. https://doi.org/10.1080/15388220.2010.509009.
  • O'Keeffe, P. 2013. “A Sense of Belonging: Improving Student Retention.” College Student Journal 47 (4): 605–13.
  • O’Shea, S. 2021. “‘Kids from Here Don't Go to Uni’: Considering First in Family Students’ Belonging and Entitlement Within the Field of Higher Education in Australia.” European Journal of Education 56 (1): 65–77. https://doi.org/10.1111/ejed.12434.
  • Parker, P., J. Jerrim, A. Chmielewski, and H. Marsh. 2018. “Predicting University Entry Using Machine-Based Models and Solutions.” In Pathways to Adulthood, edited by I. Schoon and R. Silbereisen, 92–110. London, UK: UCL IOE.
  • Parker, P., U. Trautwein, H. Marsh, G. Basarkod, and T. Dicke. 2020. “Development in Relationship Self-Concept from High School to University Predicts Adjustment.” Developmental Psychology 56 (8): 1547. https://doi.org/10.1037/dev0000992.
  • Pedler, M. L., R. Willis, and J. E. Nieuwoudt. 2022. “A Sense of Belonging at University: Student Retention, Motivation and Enjoyment.” Journal of Further and Higher Education 46 (3): 397–408.
  • Powers, D. 2020. “Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness and Correlation.” ArXiv:2010.16061 [Cs, Stat]. http://arxiv.org/abs/2010.16061.
  • Proboyo, A., and R. Soedarsono. 2015. “Influential Factors in Choosing Higher Education Institution: A Case Study of a Private University in Surabaya.” Journal Manajemen Pemasaran 9 (1): 1–7. https://doi.org/10.9744/pemasaran.9.1.1-7.
  • Radloff, A., H. Coates, R. James, and K.-L. Krause. 2011. Report on the Development of the University Experience Survey. Australian Government.
  • Sarason, S. 1974. The Psychological Sense of Community: Prospects for a Community Psychology. San Francisco: CA: Jossey-Bass.
  • Sneyers, E., and K. De Witte. 2018. “Interventions in Higher Education and Their Effect on Student Success: A Meta-Analysis.” Educational Review 70 (2): 208–28. https://doi.org/10.1080/00131911.2017.1300874.
  • Social Research Centre. 2022. 2021 Student Experience Survey. Published Report. Accessed June 22, 2023. https://www.qilt.edu.au/surveys/student-experience-survey-(ses)#report.
  • Strayhorn, T. L. 2012. “Exploring the Impact of Facebook and Myspace Use on First-Year Students’ Sense of Belonging and Persistence Decisions.” Journal of College Student Development 53 (6): 783–96. https://doi.org/10.1353/csd.2012.0078.
  • Strayhorn, T. L. 2018. College Students’ Sense of Belonging: A Key to Educational Success for All Students. New York, NY: Routledge.
  • Sulé, V. T., and R. Brown. 2023. “My Body Is Not an Apology: Black Critical Agency as Sense of Belonging.” Journal of College Student Development 64 (1): 1–15. https://doi.org/10.1353/csd.2023.0011.
  • Thomas, L., E. Orme, and F. Kerrigan. 2020. “Student Loneliness: The Role of Social Media Through Life Transitions.” Computers & Education 146:103754. https://doi.org/10.1016/j.compedu.2019.103754.
  • Tice, D., R. Baumeister, J. Crawford, K.-A. Allen, and A. Percy. 2021. “Student Belongingness in Higher Education: Lessons for Professors from the COVID-19 Pandemic.” Journal of University Teaching and Learning Practice 18 (4): Article 2. https://doi.org/10.53761/1.18.4.2.
  • Times Higher Education. 2023. Impact Rankings 2023. Times Higher Education. Accessed 22 June 2023. https://www.timeshighereducation.com/impactrankings.
  • Tinto, V. 1975. “Dropout from Higher Education: A Theoretical Synthesis of Recent Research.” Review of Educational Research 45 (1): 89–125. https://doi.org/10.3102/00346543045001089.
  • Tinto, V. 2006. “Research and Practice of Student Retention: What Next?” Journal of College Student Retention: Research, Theory & Practice 8 (1): 1–19. https://doi.org/10.2190/4YNU-4TMB-22DJ-AN4W.
  • Universities Australia. 2022. “2022 Higher Education Facts and Figures: June 2022.” Universities Australia. Accessed June 22, 2023. https://www.universitiesaustralia.edu.au/wp-content/uploads/2022/09/220207-HE-Facts-and-Figures-2022_2.0.pdf.
  • van der Zanden, P. J., E. Denessen, A. H. Cillessen, and P. C. Meijer. 2018. “Domains and Predictors of First-Year Student Success: A Systematic Review.” Educational Research Review 23:57–77. https://doi.org/10.1016/j.edurev.2018.01.001.
  • van Gijn-Grosvenor, E., and P. Huisman. 2020. “A Sense of Belonging among Australian University Students.” Higher Education Research & Development 39 (2): 376–89. https://doi.org/10.1080/07294360.2019.1666256.
  • Weng, E., A. Halafoff, G. Barton, and G. Smith. 2021. “Higher Education, Exclusion, and Belonging: Religious Complexity, Coping and Connectedness among International Students During the COVID-19 Pandemic in Australia.” Journal of International Students 11 (S2): 38–57. https://doi.org/10.32674/jis.v11iS2.3553.
  • Worsley, J., P. Harrison, and R. Corcoran. 2021. “Bridging the Gap: Exploring the Unique Transition from Home, School or College into University.” Frontiers in Public Health 9:634285. https://doi.org/10.3389/fpubh.2021.634285.
  • Wright, M., S. Wager, and P. Probst. 2021. Ranger: A Fast Implementation of Random Forests. https://github.com/imbs-hl/ranger.
  • Wright, M., A. Ziegler, and I. König. 2016. “Do Little Interactions Get Lost in Dark Random Forests?” BMC Bioinformatics 17 (1): 145. https://doi.org/10.1186/s12859-016-0995-8.
  • Yuval-Davis, N. 2006. “Belonging and the Politics of Belonging.” Patterns of Prejudice 40 (3): 197–214. https://doi.org/10.1080/00313220600769331.