ABSTRACT
During the academic year 2019–2020, school buildings worldwide closed in response to the COVID-19 pandemic, necessitating a rapid shift to distance education. This study assessed the influence of high-speed broadband availability on student engagement with distance learning during this period in Ireland. Employing data from a representative sample of 206 secondary schools, student engagement as perceived by school principals was estimated to have been more adversely affected among schools located in areas with lower coverage of high-speed broadband. This may be partly explained by a lower probability of poorer student engagement among schools that deployed live online video teaching. While the costs and benefits must be considered, these findings may support the case for government intervention to provide greater equity in access to high-speed broadband. Where distance learning is required in future, secondary teachers should be supported in the use of live online teaching to better foster student engagement.
Introduction
In response to the COVID-19 pandemic, governments across the world closed school buildings to reduce the spread of the virus, forcing an abrupt transition to distance learning. There were nationwide school closures in 188 countries in April 2020, with 1.5 billion children and young people worldwide not physically attending a school premises (UNESCO, Citation2020). Distance learning has been defined as an educational setting “in which the expectation is that the student and instructor will not be physically co-present in the same location” (Allen et al., Citation2004, p. 403). This study investigated the impact of the shutdown of school buildings, and consequent move to distance learning in response to COVID-19, on secondary school student engagement in the Republic of Ireland.
Our aim is to provide an understanding of how engagement in learning on a remote basis was affected by the availability of high-speed broadband and access to information and communications technology (ICT) devices in students’ homes. Research has shown that “if engagement is to be socially just then all students should not only have equality and equity of access to activities, learning at similar levels, but also have similar opportunities beyond school related to these activities” (Zyngier, Citation2008, p. 1769). The contribution of opportunities beyond school to student learning is likely to have increased during the pandemic.
Studying factors that affect student engagement is important since engagement is positively associated with academic achievement (Lei et al., Citation2018), and evidence suggests there is scope for interventions targeting engagement to improve academic achievement (Fredricks et al., Citation2016). Longitudinal evidence has also linked student engagement with post-school and occupational outcomes (Abbott-Chapman et al., Citation2014). Greater insight and evidence on whether student engagement is related to the availability of high-speed broadband at home can inform policymaking and education planning during this period, as well as into the future as transitions to digital societies accelerate globally. The European Commission (EC, 2020) has argued that emergency situations such as COVID-19 demonstrate the necessity for universal access to high-speed broadband, with online education cited as one motivation. Previously, the EC (2016) also identified access to online learning as a motivating factor in its vision for a broadband speed of at least 100 megabits per second available to all European households.
This article presents the findings of a quantitative analysis of evidence gathered from school leaders during the shutdown of school buildings in Ireland.
Impact of COVID-19 school closures
Studies examining the impact of COVID-19 school closures on primary and secondary students, typically using survey data, are rapidly emerging from a range of international jurisdictions. In the Netherlands, primary and secondary students from more advantaged backgrounds were found to benefit from higher levels of parental support and better resources such as owning a computer, indicating a likely effect on inequality in educational opportunities (Bol, Citation2020). Similar issues were evident in the United Kingdom, where school-aged students from middle-class backgrounds were found to be twice as likely as students from working-class homes to participate in live and recorded lessons online every day, and higher levels of concern were apparent among teachers in deprived areas in relation to students having access to electronic devices and adequate Internet access (Cullinane & Montacute, Citation2020).
School-aged children from better-off families in the United Kingdom were also found to spend 30% more time on home learning and to have better access to learning resources (Andrew et al., Citation2020; Eyles et al., Citation2020). A study of households in the United States of America with students in K-12 (primary and secondary) schools found that less educated parents spent the same amount of time helping their children as parents with more education, but that they faced more problems in relation to resources, such as computer and Internet access (Bansak & Starr, Citation2021). A lack of infrastructure, such as electricity and Internet access, was also found to give rise to education inequalities amid COVID-19 school building closures in parts of Kenya (Mabeya, Citation2020). Other emerging research on the experiences of secondary schools during COVID-19 include studies based in Germany (Züchner & Jäkel, Citation2021) and Serbia (Kovács Cerović et al., Citation2021), with the use of, and access to, technology and digital media highlighted as important factors in shaping the learning experience.
Drawing on literature that examined the impact of missing school due to absenteeism, regular breaks, or school closures, Kuhfeld et al. (Citation2020) projected that primary and secondary students in the US would only experience 63%–68% of usual learning gains in reading, and 37%–50% in mathematics, over the academic year due to COVID-19 closures. Another consequence of school building shutdowns has been the outright cancellation of in-person examinations. Andersen and Nielsen (Citation2020) contended that secondary school exam cancellations may result in poorer future exam performance. As well as reduced academic learning, the socio-emotional learning of children of all ages may also be impacted (Outhwaite, Citation2020), which has also been found to affect academic attainment (Panayiotou et al., Citation2019). Some studies have also suggested COVID-19 school closures may reduce future earnings of current students (Azevedo et al., Citation2020; Psacharopoulos et al., Citation2020). In addition to impacting educational inequality and learning, significant challenges relating to the health and mental well-being of students as a result of school closures have been documented (Lee, Citation2020; Liang et al., Citation2020; Rundle et al., Citation2020; Workman, Citation2020).
Distance learning
Although COVID-19 has dramatically increased the use of some elements of distance learning, the practice of distance learning has been the subject of a substantial body of research. It has been pointed out in the literature that while schools worldwide switched to a version of distance learning in response to COVID-19, the short-term nature of these emergency arrangements meant that they did not amount to robust forms of distance learning, which would entail additional instructional design and planning (Doukakis & Alexopoulos, Citation2020). The term emergency remote teaching has been proposed as a more accurate description of the continued education while school buildings were closed during this period (Bozkurt et al., Citation2020; Crompton et al., Citation2021; Doukakis & Alexopoulos, Citation2020).
Several studies have compared the performance of primary and secondary students in distance education with students in traditional classroom-based education, generally finding no significant difference in outcomes (Cavanaugh, Citation2001; Cavanaugh et al., Citation2004; Means et al., Citation2013). A meta-analysis found no significant difference when aggregating data of all 51 included studies across secondary and higher education, but considerable variation in results between studies was noted (Zhao et al., Citation2005). Much of the research in this area, however, has focused on adult education (Allen et al., Citation2004; Rice, Citation2006). A recent systematic review of literature on the use of online distance learning noted that the field has moved away from an emphasis on theoretical articles to more empirical studies (Arnesen et al., Citation2019). This review built on previous reviews of this area (Barbour & Reeves, Citation2009; Cavanaugh et al., Citation2009; Hasler-Waters et al., Citation2014; Rice, Citation2006). Another recent systematic review (Crompton et al., Citation2021) considered empirical research from 2010 to 2020 on the use of emergency remote teaching in primary and secondary education in response to emergencies that cause school building closures. The review noted that the vast majority of this research has been conducted since the start of the COVID-19 pandemic, indicating the growing research interest in this area.
Lesson delivery factors, such as an appropriate balance of human resources and technology, have been identified as factors in successful distance learning (Zhao et al., Citation2005). A distinction may be drawn between asynchronous formats of communication for distance learning such as pre-recorded video and synchronous formats such as live, interactive video. Allen et al. (Citation2004) found no significant reduction in student performance from utilizing asynchronous instead of synchronous learning formats, although Zhao et al. (Citation2005) highlighted the importance of live human instruction for successful distance learning.
Secondary school distance learning is also shaped by student characteristics such as self-regulation skills and responsibility (Roblyer & Marshall, Citation2002). For successful distance learning, Roblyer and Marshall asserted that students also require access to appropriate technology. Teachers in Finland and India identified that not all students were in an equal position to make a transition to remote education in response to COVID-19, with barriers including existing technology, practices, and skills affecting students to varying degrees (Iivari et al., Citation2020). In Northern Ireland, almost a quarter of households engaged in primary and secondary homeschooling due to COVID-19 did not have access to a printer, and only half of students had their own device for accessing online content (Walsh et al., Citation2020).
Studies have also pointed out that the skills required of teachers are different for online distance learning than for traditional learning. One study reviewed literature on the competencies required of primary and secondary teachers for online learning (Pulham & Graham, Citation2018), while another systematic review found wide variation in the content of programs designed to prepare primary and secondary teachers for online distance learning (Moore-Adams et al., Citation2016).
Student engagement
There is broad agreement in the literature that student engagement encompasses three dimensions: behavioral, incorporating participation, effort, persistence and positive conduct; emotional, covering interactions with teachers and classmates and a sense of belonging; and cognitive, including self-regulated learning (Fredricks et al., Citation2016). The presence of strong relationships between students and teachers has emerged as a crucial factor in promoting student engagement (Fredricks et al., Citation2016; Nguyen et al., Citation2018; Quin, Citation2017; Taylor & Parsons, Citation2011; Yang et al., Citation2018). High levels of support from teachers (Havik & Westergård, Citation2020; Lam et al., Citation2016; Strati et al., Citation2017; Virtanen et al., Citation2018) and the provision of regular student feedback (Fredricks et al., Citation2016; Taylor & Parsons, Citation2011) have been found to enhance student engagement. Higher engagement has also been attributed to a positive school climate, characterized by high expectations in academic and discipline domains, coupled with a strong supportive ethos between teachers and students (Konold et al., Citation2018; Yang et al., Citation2018).
Classroom technology has been described as a “tool for engaged learning” (Taylor & Parsons, Citation2011, p. 14). Bond and Bedenlier (Citation2019) proposed a framework for conceptualizing how classroom technology can influence student engagement, informed by literature examining educational technology and student engagement. Benefits of the use of ICT in the classroom were found to include enhanced participation, greater collaboration and the development of skills (McCoy et al., Citation2016). It should be noted, however, that the use of ICT in a classroom is different to using ICT for distance learning, and the benefits of classroom ICT integration may not necessarily extend to a distance learning setting.
There is also evidence to show that student engagement can be shaped by school structural characteristics, as well as the composition of the student body. Student engagement was found to be higher for smaller schools (Fredricks et al., Citation2004) and for more socioeconomically advantaged school settings (McCoy, Smyth, et al., Citation2014). A number of studies also highlighted higher engagement levels among single-sex girls’ schools and for female students more generally (Frawley et al., Citation2014; Havik & Westergård, Citation2020; Lam et al., Citation2016).
It is also worth noting research suggesting that increased student engagement has not always necessarily been positive. Student burnout among highly engaged students was identified among students from the United States of America and Finland in one study (Salmela-Aro et al., Citation2016). In the Irish context, high stress levels in advance of the final secondary school state examination have repeatedly been highlighted, with evidence showing that this persists into the post-school period, particularly for high-achieving female students (McCoy, Smyth, et al., Citation2014). Greater reliance on individual ICT devices for learning can also have unintended consequences. Technology-related distraction can adversely impact on learning or academic performance (Dempsey et al., Citation2019; Zureick et al., Citation2018), and cyberbullying has been found to impact engagement (Yang et al., Citation2020).
One study of the impact of COVID-19 school closures in Ireland indicated that barriers to engagement for secondary students include a lack of interest, a lack of support, and a lack of access to devices, all of which were more prevalent in schools with greater numbers of students from disadvantaged backgrounds (Devitt et al., Citation2020). The research also suggested that the mode of content delivery was associated with student engagement, with better levels of engagement associated with more interactive and collaborative approaches such as the use of assessment with feedback.
Contribution of this research
The quantitative analysis presented in this article adds to a rapidly growing evidence base that charts the experience of schools in transitioning to distance learning during COVID-19. We aim to broaden the literature on the effectiveness of distance learning relative to more traditional, classroom-based methods. This study posed the following research question: Is student access to high-speed broadband and to ICT devices at home associated with the impact of the shift to distance learning on student engagement? Given established links between student engagement and academic achievement (Lei et al., Citation2018), understanding the conditions shaping student engagement with distance learning is important, particularly in the context of COVID-19 school shutdowns. The study examined this question among secondary schools in Ireland and employed novel objective indicators that identified schools located in areas characterized by a lower availability of high-speed broadband.
Secondary education in Ireland
In the academic year 2019–2020, there were 723 secondary-level schools in Ireland (Department of Education and Skills [DES], 2020). Schools are publicly funded, although there is a subset of 51 fee-charging secondary-level schools operating. A total of 198 secondary-level schools are included in the Delivering Equality of Opportunity in Schools (DEIS) program, which aims to address educational inequality by providing additional resources to schools identified as having a high proportion of students from disadvantaged backgrounds (DES, Citation2017; McCoy, Quail et al., Citation2014). The majority of schools are English-language-medium schools, and there are 49 Irish-language-medium schools, known as a Gaelscoil. Further details on the secondary education system in Ireland are outlined in Appendix A.
Materials and methods
Data collection
An online survey of secondary school leaders (typically school principals or deputy principals) in the Republic of Ireland was fielded 2 months after the closure of school buildings (Mohan et al., Citation2020). School leaders are well placed to provide a rich insight on the lived experiences of their students and matters on the ground as they are key decision-makers in responding to the challenges of providing continuity of education. Moreover, during this unprecedented period, school leaders were found to have had more frequent contact with teachers, students, and parents (Mohan et al., Citation2020).
The sampling frame encompassed all 723 secondary schools. The survey was emailed to school principals on 13 May 2020, followed up with several reminders before the survey closed on 29 May 2020. A total of 234 responses were submitted, securing a 32.4% response rate. The sample of responses received was representative of schools nationally as recorded in the secondary school census for 2019–2020 (DES, Citation2020) in terms of geographic location (see Figure B-1 in Appendix B), other key school characteristics (see Figure B-2 in Appendix B), and broadband availability. We found that high-speed broadband was available to less than 90% of residences in the imputed catchment areas of 54% of schools in our sample. The corresponding figure for all 723 secondary schools in Ireland was 46%. The response rate varied by question, and for this study the sample was reduced to 206 schools that had complete data for the outcome variables of interest.
Descriptive statistics for key school characteristics of the sample are documented in . The quantitative analysis related to the level of the school, providing a picture of the overall experience of each school from the perspective of school leaders, rather than the individual experiences of teachers or students within schools.
Variables of interest
Outcomes
School leaders were asked to rate the effect of the transition on student engagement with learning, student attendance in classes, and delivery of lesson content, each on a 5-point Likert scale from much better to much worse. School leader perceptions of the effect of the shutdown on student engagement among 3rd and 6th year students due to sit Junior and Leaving Certificate examinations in June 2020 were also reported on a 5-point scale from very positive to very negative.
The response categories for the perceived engagement variables were aggregated to create binary indicators, framed as a negative outcome. For example, the binary outcome worse student engagement was assigned a value of 1 for a much worse or worse rating, while similar, better or much better responses were given the value of 0, forming the reference category. Details on the wording of questions, responses, and the construction of variables are provided in Appendix C, with the specific response categories chosen by respondents detailed in in Appendix B.
This analysis examined five outcomes, descriptive statistics for which are provided in . The primary outcome of interest was the level of engagement by all students as a result of school closures, as perceived by school principals. This measure of student engagement is likely to capture behavioral engagement, including participation and effort, rather than emotional or cognitive engagement. A conceptual framework of factors that may influence the impact of school closures on student engagement, informed by the literature reviewed in the Introduction section, is illustrated in . Secondary outcomes included engagement among 3rd year (Junior Certificate) students, engagement among 6th year (Leaving Certificate) students, delivery of lesson content and overall student attendance.
Main exposure variables of interest
The capacity of students to engage in distance learning may have been affected by access to high-speed broadband and access to ICT equipment at home. To investigate this, we generated aggregate variables of broadband availability and median household income (as an indicator of economic resources to purchase ICT devices) within the areas surrounding schools. A priori, we anticipated that a lack of access to high-speed broadband or economic resources was likely to result in reduced student engagement during the COVID-19 shutdown.
We created an indicator of the availability of high-speed broadband for every residence in Ireland by spatially linking each residence with the 2019 National Broadband Plan map (Department of Communications, Climate Action and Environment, Citation2019). This map, illustrated in , distinguishes between three areas: (a) where high-speed broadband is currently available, (b) where there is no high-speed broadband available but where a commercial entity currently plans to roll out fiber broadband in the future, and (c) where there is no high-speed broadband available and where state intervention is required to provide broadband through the National Broadband Plan. This defines high-speed broadband as having a download speed of 30 megabits or higher per second.
Using data from the 2016 census, we assigned each residence the household median gross annual income of the electoral division they were located in (Central Statistics Office, Citation2020).
For the purposes of this study, we drew a circular buffer around each school representing the catchment area, with each school’s buffer distance determined by the extent to which the school’s surrounding area was urban. We assigned a distance of 8 km to schools in highly urban areas, and 24 km to schools in highly rural areas, with the buffer distances based on data from both the National Household Travel Survey 2017 (Mooney et al., Citation2018) and the Growing Up in Ireland survey (McNamara et al., Citation2020). We then measured the proportion of residences for which high-speed broadband was available, and the average household income, within each school’s imputed catchment area. For our analysis, we created an indicator variable for each school concerning whether high-speed broadband was available to over 90% of residences in the imputed catchment area, on the basis that high-speed broadband would need to be available to the vast majority of students for it to be practicable for teachers to utilize applications requiring high-speed connectivity. Descriptive statistics of the high-speed broadband availability variable and average household income in imputed school catchment areas are provided in .
Other variables of interest
Additional variables of interest included the use of various distance teaching methods and the prior use of technology in the classroom. Respondents were asked about the use of live video (e.g., via Zoom or Google Hangouts), shared presentations (e.g., via PowerPoint or Prezi) and prerecorded video. Responses were provided on a 4-point scale consisting of all, most, some and no classes, which were aggregated to a binary indicator of whether each method was used in either most or all classes.
School leaders were asked about the extent to which individual ICT devices, such as laptops, tablets, or mobile phones, were used by students for educational purposes in classrooms prior to the shutdown. An indicator of whether individual devices were used by over half of students in the school before the shutdown was created, which may signal whether schools had already embraced these technologies for teaching. Whether ICT equipment, such as school laptops or tablets, had been provided to students prior to, or as a result of, the shutdown was also specified. A chi-square test of independence between these two indicator variables on ICT devices confirmed that they were independent of each other (chi-square statistic = 1.0, p value = 0.31).
Statistical analysis
As shown in , 69.9% of schools in our sample reported a negative impact on student engagement as a result of the shutdown. A logistic regression model of this outcome variable may be expressed as follows (Equation 1):
In Equation 1, Λ represents the cumulative distribution of the logistic function and represents an error term. The outcome is equal to 1 for School if that school reports a negative impact on student engagement, and 0 otherwise. The variable represents whether high-speed broadband was available for over 90% of School ’s catchment area.
represents a vector of all other independent variables, including the natural logarithm of catchment area average household income, along with the previous provision of devices to students and the previous use of individual devices in the classroom (technology-driven). Our models also adjusted for key school structural characteristics, as depicted in and outlined in , which may be expected to affect the outcome variable. For example, DEIS status schools are characterized by populations of students from lower income backgrounds, and student engagement with distance learning may have been lower among these schools (Devitt et al., Citation2020). We combined mutually exclusive fee-paying schools (Fee-paying in ) and Irish-medium-language schools (Gaelscoil in ) into one category due to small numbers in each group, to distinguish these types of schools, which are likely to have more socio-economically advantaged student populations (O’Connell et al., Citation2006), from all other schools. It is worth noting that while our models adjusted for key school structural characteristics, our survey did not capture information on other school-level factors that may be important, such as school climate or ethos (Konold et al., Citation2018; Yang et al., Citation2018).
We hypothesized that broadband availability may have affected how distance teaching was delivered, and it is this method of delivery that may have impacted student engagement. To explore this hypothesis, logistic regression models of overall student engagement were run where the broadband exposure variable was replaced by an indicator of a particular method of distance learning. For example, Equation 2 describes a model which includes the use of live video in most or all classes by School :
All results are presented in the form of odds ratios. A statistically significant odds ratio greater than 1 indicates that the respective independent variable is associated with a higher likelihood of the outcome occurring, while an odds ratio lower than 1 indicates a lower probability.
Results
presents results of the main model described in Equation 1, assessing factors in the impact of school closures on student engagement. The outcome in Model A is student engagement among the overall school population, while Models B and C focus specifically on Junior (3rd year) and Leaving Certificate (6th year) students. The results for Model A indicate that where the availability of high-speed broadband in the catchment area of schools was lower, it was almost three times more likely that the principal reported a negative impact on student engagement from the shutdown. In Model A, schools in areas with higher average income were also significantly more likely to report a negative impact on student engagement, and schools characterized as having previously been technology-driven were less likely to report a negative impact.
also includes odds ratios of similar logistic regression models, looking at delivery of lesson content (Model D) and overall student attendance (Model E). As with student engagement in Model A, a negative impact on the delivery of content in Model D was more likely in areas of higher average income, while technology-driven schools were less likely to report poorer content delivery. Model E was reflective of Model A, suggesting relatively robust results, with a negative impact on student attendance more likely among schools in areas with lower broadband availability.
compares the proportion of schools which employed various teaching methods in most or all classes between schools in areas with high broadband availability and those in areas with lower coverage. The favored methods of distance teaching differed by availability of high-speed broadband, notably with live video utilized in a higher proportion of schools in areas with high broadband availability.
Summary results for six different models based on Equation 2, with student engagement as the outcome and distance teaching methods employed in some or all classes as the main exposure of interest, are presented in .
As shown in , Model F, in which the method of distance teaching included was the use of live video, was the only model where the method of distance teaching was estimated to have a statistically significant odds ratio. In schools that used live video in some or all classes, the odds that the principal reported a negative impact on student engagement was less than half that of schools that did not report using these applications, independent of other school characteristics.
in Appendix B presents results for the ordered logistic regression model as a robustness check on our main results. As in Model A (), a negative impact on student engagement was more likely among schools in areas of lower broadband availability.
Discussion
Econometric modelling revealed that student engagement during COVID-19 school building closures in Ireland was perceived by secondary school principals to be more negatively affected among schools located in areas that had a less than universal availability of high speed-broadband. The level of student engagement was also associated with the method of distance learning used, with lower odds of worse student engagement in schools that employed live video for teaching.
The signals found in Model A in relation to broadband availability and economic resources were not reflected in models focusing on students due to sit state examinations in June 2020, that is, Models B and C. It is possible that the impact on engagement with learning for these groups was instead mainly affected by the cancellation of state examinations, and that this cohort-specific factor diminished any potential influence of broadband availability or economic resources.
In the primary model of student engagement, Model A, higher average household income in a school’s catchment area, which may affect access to ICT devices as well as other aspects of socioeconomic advantage, was significantly associated with a higher likelihood of worse engagement. This appears to be a counterintuitive result, suggesting that student educational engagement was more adversely affected in areas of higher-than-average income, independent of other school characteristics and of broadband availability. One possible explanation for this is that the outcomes represented a perception of change, for example, student engagement being rated worse than normal, and that baseline student engagement may have been systematically higher in areas characterized by a higher average income prior to the shutdown of schools. It may also be that parents residing in more affluent areas may have had greater expectations of schools and school leadership to maintain student engagement during the period, relative to those of more deprived areas. However, we note that this result did not persist in the ordered logistic regression analysis, and therefore this may be considered inconclusive.
Based on this evidence, the availability of high-speed broadband appears to have been important for engaging with distance learning using ICT. From a public policy perspective, this suggests that educational equality may have been affected by a lack of availability of high-speed broadband in certain regions, at least in a context of distance learning. It is likely that the availability of broadband affected how distance learning was delivered, which in turn could have impacted student engagement. The use of live video in most or all classes, a method that could be considered particularly reliant on high-speed broadband relative to others, appeared to be the only distance teaching method that significantly influenced our measure of student engagement.
This result concurs with the findings of Devitt et al. (Citation2020), which revealed that student engagement was higher during the COVID-19 shutdown in Ireland when distance teaching methods were more interactive and collaborative. No such association for prerecorded videos or shared presentations was found, which may corroborate research highlighting the importance of live human instruction in distance learning (Zhao et al., Citation2005).
As 69.9% of schools reported a perceived negative impact of closures on student engagement (see ), this could be interpreted as suggesting that distance learning was less effective than classroom-based learning among secondary students, contrary to some research that found no significant difference in effectiveness between distance learning and traditional learning methods (Allen et al., Citation2004; Cavanaugh, Citation2001; Cavanaugh et al., Citation2004; Means et al., Citation2013; Zhao et al., Citation2005). However, it may be that this was a short-term effect as teachers and students adjusted to an unexpected and unprecedented change in teaching and learning in the context of a pandemic.
Some schools in Ireland present themselves as technology-driven (Marcus-Quinn et al., Citation2019; McCoy et al., Citation2016). It is also worth noting that results presented in this paper suggest that a negative impact on student engagement and on lesson delivery was less likely among schools that previously utilized individual student devices in the classroom more intensively. These schools may have been better equipped to rapidly shift to distance learning. Moreover, it suggests that students’ experience of distance learning varied by the extent to which ICT had previously been integrated into the classroom, raising important questions over educational inequality.
Strengths and limitations
This quantitative analysis employed data from a nationally representative sample of secondary schools in Ireland, capturing one third of the country’s secondary schools. Models controlled for key structural school characteristics such as gender, size, and disadvantaged status, which helped to account for preexisting differences between schools. Geographic data to characterize school catchment areas where students were likely based while school buildings were closed, including objective data on the availability of high-speed broadband, complemented the survey. This allowed us to gain an understanding of the ability of students to engage in distance learning from home.
A number of limitations of this study must also be acknowledged. The survey was targeted at school principals and deputy principals, rather than teachers or students, and responses thus reflected the subjective perceptions of school leaders who may not necessarily have been directly involved in distance teaching and learning. However, we contend that school leaders, as key decision-makers within schools, were well placed to provide a rich insight on the experiences of students.
In addition, school catchment areas were imputed rather than directly observed. The cross-sectional nature means causality cannot be inferred and an omitted variable bias may exist where other characteristics such as school climate, which may be important for student engagement, could not be accounted for.
The study focused on distance learning in secondary education. Although our findings are relevant to researchers, policymakers, teachers, students, and other stakeholders in secondary education, further research is required to determine if any findings can be extended to primary or tertiary education.
Policy implications and directions for future research
While the costs, risks, and benefits of government intervention to provide high-speed broadband to remote areas must be fully evaluated, the influence of broadband availability on student engagement with distance learning could be regarded as one argument in favor of intervention from an educational equality perspective. Universal access to high-speed broadband for online learning has been championed by the EC (2016, 2020). The finding in relation to the use of live online video suggests that teachers could be better encouraged and supported in using these mediums for distance learning. In light of our findings in relation to the relatively better experience of technology-driven schools, enhanced integration of ICT in the classroom more generally could be advantageous in terms of increasing flexibility in learning, thus affording greater preparedness for unforeseen events.
Future research could consider the long-term impacts of the rapid transition to distance learning and the cancellation of state examinations, for example, investigating effects on future test scores, with particular regard for vulnerable groups such as students from lower income backgrounds or those with additional needs.
Conclusions
Secondary school principals perceived a general decline in student engagement during COVID-19 school building closures in Ireland, and statistical modeling revealed that a perceived reduction in engagement was more likely among schools located in areas characterized by lower coverage of high-speed broadband. This may be partly explained by a lower probability of reduced student engagement found among schools that employed live online video applications for teaching in most classes.
This study adds to the emerging literature assessing the impact of COVID-19 on teaching and learning. Studies of the rapid transition to distance learning due to COVID-19 help to document this unparalleled set of events and can develop understanding in this area.
Acknowledgments
The authors would like to acknowledge the contribution of the survey participants who gave their time to inform this work and the support of the National Association of Principals and Deputy Principals in Ireland.
Disclosure statement
The authors have no declarations or conflicts of interest to declare.
Data availability statement
The data that support the findings of this study are available from the corresponding author upon request.
Additional information
Funding
Notes on contributors
Ciarán Mac Domhnaill
Ciarán Mac Domhnaill is a PhD student in the School of Economics and Finance, University of St Andrews. Environment, health, education, and energy economics are among his research interests.
Gretta Mohan
Gretta Mohan is a research officer at the Economic and Social Research Institute in Ireland and assistant professor at Trinity College Dublin. Her research interests include the economic and social impacts of electronic communications and digital technologies.
Selina McCoy
Selina McCoy is an associate research professor at the Economic and Social Research Institute in Ireland and professor at Trinity College Dublin. Her research focuses on educational inequality, inclusion, and digital technologies in teaching and learning.
References
- Abbott-Chapman, J., Martin, K., Ollington, N., Venn, A., Dwyer, T., & Gall, S. (2014). The longitudinal association of childhood school engagement with adult educational and occupational achievement: Findings from an Australian national study. British Educational Research Journal, 40(1), 102–120. https://doi.org/https://doi.org/10.1002/berj.3031
- Allen, M., Mabry, E., Mattrey, M., Bourhis, J., Titsworth, S., & Burrell, N. (2004). Evaluating the effectiveness of distance learning: A comparison using meta-analysis. Journal of Communication, 54(3), 402–420. https://doi.org/https://doi.org/10.1111/j.1460-2466.2004.tb02636.x
- Andersen, S. C., & Nielsen, H. S. (2020). Learning from performance information. Journal of Public Administration Research and Theory, 30(3), 415–431. https://doi.org/https://doi.org/10.1093/jopart/muz036
- Andrew, A., Cattan, S., Costa-Dias, M., Farquharson, C., Kraftman, L., Krutikova, S., Phimister, A., & Sevilla, A. (2020). Learning during the lockdown: Real-time data on children’s experiences during home learning (IFS Briefing Note No. BN288). Institute for Fiscal Studies. https://www.ifs.org.uk/uploads/BN288-Learning-during-the-lockdown-1.pdf
- Arnesen, K. T., Hveem, J., Short, C. R., West, R. E., & Barbour, M. K. (2019). K-12 online learning journal articles: Trends from two decades of scholarship. Distance Education, 40(1), 32–53. https://doi.org/https://doi.org/10.1080/01587919.2018.1553566
- Azevedo, J. P., Hasan, A., Goldemberg, D., Iqbal, S. A., & Geven, K. (2020). Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: A set of global estimates (Policy Research Working Paper No. 9284). World Bank Group. https://bit.ly/3yrKouf
- Bansak, C., & Starr, M. (2021). Covid-19 shocks to education supply: How 200,000 U.S. households dealt with the sudden shift to distance learning. Review of Economics of the Household, 19(1), 63–90. https://doi.org/https://doi.org/10.1007/s11150-020-09540-9
- Barbour, M. K., & Reeves, T. C. (2009). The reality of virtual schools: A review of the literature. Computers & Education, 52(2), 402–416. https://doi.org/https://doi.org/10.1016/j.compedu.2008.09.009
- Bol, T. (2020). Inequality in homeschooling during the corona crisis in the Netherlands. First results from the LISS Panel [Preprint]. SocArXiv. https://doi.org/https://doi.org/10.31235/osf.io/hf32q
- Bond, M., & Bedenlier, S. (2019). Facilitating student engagement through educational technology: Towards a conceptual framework. Journal of Interactive Media in Education, 2019(1). https://doi.org/https://doi.org/10.5334/jime.528
- Bozkurt, A., & Sharma, R. C. (2020). Emergency remote teaching in a time of global crisis due to coronavirus pandemic. Asian Journal of Distance Education, 15(1), i–vi. https://doi.org/https://doi.org/10.5281/ZENODO.3778083
- Cavanaugh, C. S. (2001). The effectiveness of interactive distance education technologies in K-12 learning: A meta-analysis. International Journal of Educational Telecommunications, 7(1), 73–88. https://www.learntechlib.org/primary/p/8461/
- Cavanaugh, C. S., Barbour, M. K., & Clark, T. (2009). Research and practice in K-12 online learning: A review of open access literature. The International Review of Research in Open and Distributed Learning, 10(1). https://doi.org/https://doi.org/10.19173/irrodl.v10i1.607
- Cavanaugh, C. S., Gillan, K. J., Kromrey, J., Hess, M., & Blomeyer, R. (2004). The effects of distance education on K-12 student outcomes: A meta-analysis (ED489533). ERIC. https://files.eric.ed.gov/fulltext/ED489533.pdf
- Central Statistics Office. (2020). Map 1.2 Household median gross income by ED, 2016. https://bit.ly/3fDoDjA
- Crompton, H., Burke, D., Jordan, K., & Wilson, S. W. G. (2021). Learning with technology during emergencies: A systematic review of K‐12 education. British Journal of Educational Technology, 52(4), 1554–1575. https://doi.org/https://doi.org/10.1111/bjet.13114
- Cullinane, C., & Montacute, R. (2020). COVID-19 and social mobility impact brief #1: School shutdown [Research Brief]. The Sutton Trust. https://www.suttontrust.com/wp-content/uploads/2020/04/COVID-19-Impact-Brief-School-Shutdown.pdf
- Dempsey, S., Lyons, S., & McCoy, S. (2019). Later is better: Mobile phone ownership and child academic development, evidence from a longitudinal study. Economics of Innovation and New Technology, 28(8), 798–815. https://doi.org/https://doi.org/10.1080/10438599.2018.1559786
- Department of Communications, Climate Action and Environment. (2019). Delivering the National Broadband Plan. Government of Ireland.
- Department of Education and Skills. (2017). DEIS Plan 2017: Delivering equality of opportunity in schools. https://www.education.ie/en/Publications/Policy-Reports/DEIS-Plan-2017.pdf’
- Department of Education and Skills. (2020). Data on individual schools. https://www.education.ie/en/Publications/Statistics/Data-on-Individual-Schools/
- Devitt, A., Bray, A., Banks, J., & Ní Chorcora, E. (2020). Teaching and learning during school closures: Lessons learned. Irish second-level teacher perspectives. Trinity College Dublin. https://bit.ly/37ljAjt
- Doukakis, S., & Alexopoulos, E. C. (2020). Distance learning for secondary education students. The role of educational neuroscience. In C. Frasson, P. Bamidis, & P. Vlamos (Eds.), Brain function assessment in learning (Vol. 12462, pp. 160–168). Springer International Publishing. https://doi.org/https://doi.org/10.1007/978-3-030-60735-7_17
- European Commission. (2016). Connectivity for a competitive digital single market—Towards a European gigabit society. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions (Communication No. 587). https://bit.ly/3yryBvS
- European Commission. (2020). Connectivity is essential during emergency situations. https://ec.europa.eu/digital-single-market/en/news/connectivity-essential-during-emergency-situations
- Eyles, A., Gibbons, S., & Montebruno, P. (2020). COVID-19 school shutdowns: What will they do to our children’s education? (Paper No. 001; A CEP COVID-19 Analysis). Centre for Economic Performance. https://cep.lse.ac.uk/pubs/download/cepcovid-19-001.pdf
- Frawley, D., McCoy, S., Banks, J., & Thornton, M. (2014). Affective school engagement and self-concept: How are Irish boys and girls faring? Child Indicators Research, 7(4), 843–859. https://doi.org/https://doi.org/10.1007/s12187-014-9247-5
- Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/https://doi.org/10.3102/00346543074001059
- Fredricks, J. A., Filsecker, M., & Lawson, M. A. (2016). Student engagement, context, and adjustment: Addressing definitional, measurement, and methodological issues. Learning and Instruction, 43, 1–4. https://doi.org/https://doi.org/10.1016/j.learninstruc.2016.02.002
- Hasler-Waters, L., Barbour, M. K., & Menchaca, M. P. (2014). The nature of online charter schools: Evolution and emerging concerns. Journal of Educational Technology and Society, 17(4), 379–389. https://drive.google.com/file/d/17njIrPXLUrOnTMtFtNoCBoHMnUYrs-jV/view
- Havik, T., & Westergård, E. (2020). Do teachers matter? Students’ perceptions of classroom interactions and student engagement. Scandinavian Journal of Educational Research, 64(4), 488–507. https://doi.org/https://doi.org/10.1080/00313831.2019.1577754
- Iivari, N., Sharma, S., & Ventä-Olkkonen, L. (2020). Digital transformation of everyday life – How COVID-19 pandemic transformed the basic education of the young generation and why information management research should care? International Journal of Information Management, Article 102183. https://doi.org/https://doi.org/10.1016/j.ijinfomgt.2020.102183
- Konold, T., Cornell, D., Jia, Y., & Malone, M. (2018). School climate, student engagement, and academic achievement: A latent variable, multilevel multi-informant examination. AERA Open, 4(4). https://doi.org/https://doi.org/10.1177/2332858418815661
- Kovács Cerović, T., Mićić, K., & Vračar, S. (2021). A leap to the digital era: What are lower and upper secondary school students’ experiences of distance education during the COVID-19 pandemic in Serbia? European Journal of Psychology of Education. https://doi.org/https://doi.org/10.1007/s10212-021-00556-y
- Kuhfeld, M., Soland, J., Tarasawa, B., Johnson, A., Ruzek, E., & Liu, J. (2020). Projecting the potential impacts of COVID-19 school closures on academic achievement. Educational Researcher, 49(8), 549–565. https://doi.org/https://doi.org/10.26300/CDRV-YW05
- Lam, S., Jimerson, S., Shin, H., Cefai, C., Veiga, F. H., Hatzichristou, C., Polychroni, F., Kikas, E., Wong, B. P. H., Stanculescu, E., Basnett, J., Duck, R., Farrell, P., Liu, Y., Negovan, V., Nelson, B., Yang, H., & Zollneritsch, J. (2016). Cultural universality and specificity of student engagement in school: The results of an international study from 12 countries. British Journal of Educational Psychology, 86(1), 137–153. https://doi.org/https://doi.org/10.1111/bjep.12079
- Lee, J. (2020). Mental health effects of school closures during COVID-19. The Lancet Child & Adolescent Health, 4(6), 421. https://doi.org/https://doi.org/10.1016/S2352-4642(20)30109-7
- Lei, H., Cui, Y., & Zhou, W. (2018). Relationships between student engagement and academic achievement: A meta-analysis. Social Behavior and Personality: An International Journal, 46(3), 517–528. https://doi.org/https://doi.org/10.2224/sbp.7054
- Liang, L., Ren, H., Cao, R., Hu, Y., Qin, Z., Li, C., & Mei, S. (2020). The effect of COVID-19 on youth mental health. Psychiatric Quarterly, 91, 841–852. https://doi.org/https://doi.org/10.1007/s11126-020-09744-3
- Mabeya, M. T. (2020). Distance learning during COVID-19 crisis: Primary and secondary school parents experiences in Kenya. East African Journal of Education Studies, 2(1), 173–186. https://doi.org/https://doi.org/10.37284/eajes.2.1.249
- Marcus-Quinn, A., Hourigan, T., & McCoy, S. (2019). The digital learning movement: How should Irish schools respond? The Economic and Social Review, 50(4), 767–783. https://www.esr.ie/article/view/1332
- McCoy, S., Lyons, S., Coyne, B., & Darmody, M. (2016). Teaching and learning in second-level schools at the advent of high-speed broadband (Paper No. 51; ESRI Research Series). Economic and Social Research Institute. https://www.esri.ie/system/files/media/file-uploads/2016-04/RS51.pdf
- McCoy, S., Quail, A., & Smyth, E. (2014). The effects of school social mix: Unpacking the differences. Irish Educational Studies, 33(3), 307–330. https://doi.org/https://doi.org/10.1080/03323315.2014.955746
- McCoy, S., Smyth, E., Watson, D., & Darmody, M. (2014). Leaving school in Ireland: A longitudinal study of post-school transitions (Paper No. 36; ESRI Research Series). Economic and Social Research Institute. https://www.esri.ie/system/files?file=media/file-uploads/2015-07/RS36.pdf
- McNamara, E., O’Mahony, D., & Murray, A. (2020). Cohort ’08 (infant cohort): Design, instrumentation and procedures for cohort ’08 of Growing Up in Ireland at 9 years old (wave 5) (Paper No. 2020–1; Growing Up in Ireland: National Longitudinal Study of Children. Technical Series). Department of Children and Youth Affairs. https://www.growingup.ie/pubs/Cohort08at9-Design-Report-2020-1.pdf
- Means, B., Toyama, Y., Murphy, R., & Baki, M. (2013). The effectiveness of online and blended learning: A meta-analysis of the empirical literature. Teachers College Record, 115(3), 1–47. https://www.tcrecord.org/content.asp?contentid=16882
- Mohan, G., McCoy, S., Carroll, E., Mihut, G., Lyons, S., & Mac Domhnaill, C. (2020). Learning for all? Second-level education in Ireland during COVID-19 (ESRI Survey and Statistical Report Series No. 92). Economic and Social Research Institute). https://www.esri.ie/system/files/publications/SUSTAT92_3.pdf
- Mooney, R., Healy, S., & Dulat, E. (2018). National household travel survey 2017 (Final Report). National Transport Authority. https://bit.ly/2X1kCPG
- Moore-Adams, B. L., Jones, W. M., & Cohen, J. (2016). Learning to teach online: A systematic review of the literature on K-12 teacher preparation for teaching online. Distance Education, 37(3), 333–348. https://doi.org/https://doi.org/10.1080/01587919.2016.1232158
- Nguyen, T. D., Cannata, M., & Miller, J. (2018). Understanding student behavioral engagement: Importance of student interaction with peers and teachers. The Journal of Educational Research, 111(2), 163–174. https://doi.org/https://doi.org/10.1080/00220671.2016.1220359
- O’Connell, P. J., Clancy, D., & McCoy, S. (2006). Who went to college in 2004? A national survey of new entrants to higher education. Higher Education Authority. https://www.esri.ie/system/files/publications/BKMNEXT72.pdf
- Outhwaite, L. (2020). Briefing note: Academic and social and emotional interventions in response to covid-19 school closures. UCL Center for Education Policy and Equalising Opportunities. https://repec-cepeo.ucl.ac.uk/cepeob/cepeobn5.pdf
- Panayiotou, M., Humphrey, N., & Wigelsworth, M. (2019). An empirical basis for linking social and emotional learning to academic performance. Contemporary Educational Psychology, 56, 193–204. https://doi.org/https://doi.org/10.1016/j.cedpsych.2019.01.009
- Psacharopoulos, G., Collis, V., Patrinos, H. A., & Vegas, E. (2020). Lost wages: The COVID-19 cost of school closures (GLO Discussion Paper No. 548). Global Labor Organization. https://www.econstor.eu/bitstream/10419/217486/1/GLO-DP-0548.pdf
- Pulham, E., & Graham, C. R. (2018). Comparing K-12 online and blended teaching competencies: A literature review. Distance Education, 39(3), 411–432. https://doi.org/https://doi.org/10.1080/01587919.2018.1476840
- Quin, D. (2017). Longitudinal and contextual associations between teacher-student relationships and student engagement: A systematic review. Review of Educational Research, 87(2), 345–387. https://doi.org/https://doi.org/10.3102/0034654316669434
- Rice, K. L. (2006). A comprehensive look at distance education in the K–12 context. Journal of Research on Technology in Education, 38(4), 425–448. https://doi.org/https://doi.org/10.1080/15391523.2006.10782468
- Roblyer, M. D., & Marshall, J. C. (2002). Predicting success of virtual high school students: Preliminary results from an educational success prediction instrument. Journal of Research on Technology in Education, 35(2), 241–255. https://doi.org/https://doi.org/10.1080/15391523.2002.10782384
- Rundle, A. G., Park, Y., Herbstman, J. B., Kinsey, E. W., & Wang, Y. C. (2020). COVID‐19–related school closings and risk of weight gain among children. Obesity, 28(6), 1008–1009. https://doi.org/https://doi.org/10.1002/oby.22813
- Salmela-Aro, K., Moeller, J., Schneider, B., Spicer, J., & Lavonen, J. (2016). Integrating the light and dark sides of student engagement using person-oriented and situation-specific approaches. Learning and Instruction, 43, 61–70. https://doi.org/https://doi.org/10.1016/j.learninstruc.2016.01.001
- Strati, A. D., Schmidt, J. A., & Maier, K. S. (2017). Perceived challenge, teacher support, and teacher obstruction as predictors of student engagement. Journal of Educational Psychology, 109(1), 131–147. https://doi.org/https://doi.org/10.1037/edu0000108
- Taylor, L., & Parsons, J. (2011). Improving student engagement. Current Issues in Education, 14(1). https://cie.asu.edu/ojs/index.php/cieatasu/article/view/745
- UNESCO. (2020, July 6). Education: From disruption to recovery. https://en.unesco.org/covid19/educationresponse
- Virtanen, T. E., Lerkkanen, M.-K., Poikkeus, A.-M., & Kuorelahti, M. (2018). Student engagement and school burnout in Finnish lower-secondary schools: Latent profile analysis. Scandinavian Journal of Educational Research, 62(4), 519–537. https://doi.org/https://doi.org/10.1080/00313831.2016.1258669
- Walsh, G., Purdy, N., Dunn, J., Jones, S., Harris, J., & Ballentine, M. (2020). Home-schooling in Northern Ireland during the COVID-19 crisis. Centre for Research in Educational Underachievement. https://bit.ly/3s0gdYO
- Workman, J. (2020). How much may COVID‐19 school closures increase childhood obesity? Obesity, 28(10), 1787. https://doi.org/https://doi.org/10.1002/oby.22960
- Yang, C., Sharkey, J. D., Reed, L. A., Chen, C., & Dowdy, E. (2018). Bullying victimization and student engagement in elementary, middle, and high schools: Moderating role of school climate. School Psychology Quarterly, 33(1), 54–64. https://doi.org/https://doi.org/10.1037/spq0000250
- Yang, C., Sharkey, J. D., Reed, L. A., & Dowdy, E. (2020). Cyberbullying victimization and student engagement among adolescents: Does school climate matter? School Psychology, 35(2), 158–169. https://doi.org/https://doi.org/10.1037/spq0000353
- Zhao, Y., Jing, L., Yan, B., Lai, C., & Tan, H. S. (2005). What makes the difference? A practical analysis of research on the effectiveness of distance education. Teachers College Record, 107(8), 18–36. https://www.tcrecord.org/content.asp?contentid=12098
- Züchner, I., & Jäkel, H. R. (2021). Fernbeschulung während der COVID-19 bedingten Schulschließungen weiterführender Schulen: Analysen zum Gelingen aus Sicht von Schülerinnen und Schülern [Distance learning during the COVID-19-related school closings: The perspective of students from secondary schools]. Zeitschrift für Erziehungswissenschaft, 24(2), 479–502. https://doi.org/https://doi.org/10.1007/s11618-021-01006-7
- Zureick, A. H., Burk-Rafel, J., Purkiss, J. A., & Hortsch, M. (2018). The interrupted learner: How distractions during live and video lectures influence learning outcomes: Study interruptions and histology performance. Anatomical Sciences Education, 11(4), 366–376. https://doi.org/https://doi.org/10.1002/ase.1754
- Zyngier, D. (2008). (Re)conceptualising student engagement: Doing education not doing time. Teaching and Teacher Education, 24(7), 1765–1776. https://doi.org/https://doi.org/10.1016/j.tate.2007.09.004
Appendix A
Secondary education in Ireland
The Irish education system comprises three key stages: (a) primary, (b) secondary, and (c) further and tertiary education. Education is compulsory up to the age of 16, and secondary school caters for students between 12 and 18 years. In comparative terms, the Irish educational system can be characterized as general, rather than vocationally specific, in nature (Smyth & McCoy, Citation2011). While the established Junior Certificate program at lower secondary level (1st to 3rd years, including a Junior Certificate state examination in 3rd year) was previously criticized as being overly reliant on rote learning and memorization techniques, the Department of Education and Skills’ (DES) recently introduced Framework for Junior Cycle 2015 (DES, 2015) focuses on the integration of innovative approaches to teaching and assessment with the chief aim of enhancing students’ overall experiences within the typical school environment (Marcus-Quinn et al., Citation2019). However, upper secondary (4th to 6th years) qualifications continue to be assessed on the basis of student performance in external, standardized examinations. This is a high-stakes system, where access to tertiary education is based on grades achieved in the upper secondary state examination taken in 6th year, the Leaving Certificate (Banks & Smyth, Citation2015).
In the academic year 2019–2020, there were 723 secondary schools in Ireland (DES, 2020). Education is mostly publicly funded, with a minor private component of 51 fee-paying secondary schools (Newman, Citation2014). In total, 198 secondary schools are included in the Delivering Equality of Opportunity in Schools (DEIS) program, which aims to address educational inequality by providing additional resources to schools identified as having a high proportion of students from disadvantaged backgrounds (DES, 2017; McCoy et al., Citation2014). The majority of schools are English-language-medium schools, and there are 49 Irish-language-medium schools, known as a Gaelscoil.
Although there is a growing appreciation of the potential for digital technologies in supporting learning, infrastructural barriers and constraints in terms of teacher skills and competencies have limited the pedagogical integration of technologies in Irish schools (McCoy et al., Citation2016; Smyth & McCoy, Citation2021). In particular, Ireland has lagged behind many developed countries in terms of integrating digital technologies in education (McCoy et al., Citation2016; Smyth & McCoy, Citation2021). Further, despite stated policy objectives, experts have observed an absence of clear policy on technology use in schools, with high school autonomy meaning decisions on technology use are made at school level (Marcus-Quinn et al., Citation2019). All schools in Ireland have developed ICT plans, though some distinguish themselves as technology-driven, while others favor a more blended or traditional approach; therefore, students’ experience of technology in school varies widely (Marcus-Quinn et al., Citation2019; McCoy et al., Citation2016). Secondary school teachers in Ireland were found to have positive attitudes towards ICT but were more likely to use technology in preparing classes rather than in the classroom itself (Coyne et al., Citation2015). Within and across schools, teachers were found to vary in confidence in using ICT (McCoy et al., Citation2016).
To reduce the spread of COVID-19, the government of Ireland mandated the closure of all education settings on 12 March 2020. There was little warning of the shutdown, so schools had minimal time to prepare for the overnight move to distance learning. In April 2020, the DES announced the cancellation of Junior Certificate (3rd year) state examinations. Following a period of considerable uncertainty, the cancellation of the Leaving Certificate (6th year) state examinations was announced on 8 May 2020 and final assessments were switched to a system of calculated grades. Additional resources totaling €10 million were allocated across all primary and secondary schools to support students experiencing difficulties in engaging with distance learning (Mohan et al., Citation2020).
References
- Banks, J., & Smyth, E. (2015). ‘Your whole life depends on it’: Academic stress and high-stakes testing in Ireland. Journal of Youth Studies, 18(5), 598–616. https://doi.org/https://doi.org/10.1080/13676261.2014.992317 <!--${if: isGetFTREnabled}-->
- Coyne, B., Devitt, N., Lyons, S., & McCoy, S. (2015). Perceived benefits and barriers to the use of high-speed broadband in Ireland’s second-level schools. Irish Educational Studies, 34(4),355–378. https://doi.org/https://doi.org/10.1080/03323315.2015.1128348 <!--${if: isGetFTREnabled}-->
- Department of Education and Skills. (2015). Framework for Junior Cycle 2015. https://www.education.ie/en/Publications/Policy-Reports/Framework-for-Junior-Cycle-2015.pdf <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 web Framework+for+Junior+Cycle+2015 %00empty%00 2015 Department+of+Education+and+Skills.+%282015%29.+Framework+for+Junior+Cycle+2015.+ %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_4_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Dweb%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aucorp%3DDepartment%2520of%2520Education%2520and%2520Skills%26rft.date%3D2015%26rft.atitle%3DFramework%2520for%2520Junior%2520Cycle%25202015 %00empty%00}-->
- Department of Education and Skills. (2017). DEIS plan 2017: Delivering equality of opportunity in schools. https://www.education.ie/en/Publications/Policy-Reports/DEIS-Plan-2017.pdf <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 web DEIS+plan+2017%3A+Delivering+equality+of+opportunity+in+schools %00empty%00 2017 Department+of+Education+and+Skills.+%282017%29.+DEIS+plan+2017%3A+Delivering+equality+of+opportunity+in+schools.+ %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_5_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Dweb%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aucorp%3DDepartment%2520of%2520Education%2520and%2520Skills%26rft.date%3D2017%26rft.atitle%3DDEIS%2520plan%25202017%253A%2520Delivering%2520equality%2520of%2520opportunity%2520in%2520schools %00empty%00}-->
- Department of Education and Skills. (2020). Data on individual schools. https://www.education.ie/en/Publications/Statistics/Data-on-Individual-Schools/ <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 web Data+on+individual+schools %00empty%00 2020 Department+of+Education+and+Skills.+%282020%29.+Data+on+individual+schools.+ %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_6_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Dweb%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aucorp%3DDepartment%2520of%2520Education%2520and%2520Skills%26rft.date%3D2020%26rft.atitle%3DData%2520on%2520individual%2520schools %00empty%00}-->
- Marcus-Quinn, A., Hourigan, T., & McCoy, S. (2019). The digital learning movement: How should Irish schools respond? The Economic and Social Review, 50(4), 767–783. https://www.esr.ie/article/view/1332 <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 journal The+digital+learning+movement%3A+How+should+Irish+schools+respond%3F+The+Economic+and+Social+Review%2C+50%284%29%2C+767%E2%80%93783 author%3DA.+Marcus-Quinn%26author%3DT.+Hourigan%26author%3DS.+McCoy 2019 Marcus-Quinn%2C+A.%2C+Hourigan%2C+T.%2C+%26+McCoy%2C+S.+%282019%29.+The+digital+learning+movement%3A+How+should+Irish+schools+respond%3F+The+Economic+and+Social+Review%2C+50%284%29%2C+767%E2%80%93783.+ %00empty%00 %00empty%00 %00empty%00 %00null%00 %00empty%00 %00empty%00 %00null%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_7_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Darticle%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aulast%3DMarcus-Quinn%26rft.aufirst%3DA.%26rft.date%3D2019%26rft.atitle%3DThe%2520digital%2520learning%2520movement%253A%2520How%2520should%2520Irish%2520schools%2520respond%253F%2520The%2520Economic%2520and%2520Social%2520Review%252C%252050%25284%2529%252C%2520767%25E2%2580%2593783 %00empty%00}-->
- McCoy, S., Lyons, S., Coyne, B., & Darmody, M. (2016). Teaching and learning in second-level schools at the advent of high-speed broadband (Paper No. 51; ESRI Research Series). Economic and Social Research Institute. https://www.esri.ie/system/files/media/file-uploads/2016-04/RS51.pdf <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 journal Teaching+and+learning+in+second-level+schools+at+the+advent+of+high-speed+broadband+%28Paper+No.+51%3B+ESRI+Research+Series%29.+Economic+and+Social+Research+Institute author%3DS.+McCoy%26author%3DS.+Lyons%26author%3DB.+Coyne%26author%3DM.+Darmody 2016 McCoy%2C+S.%2C+Lyons%2C+S.%2C+Coyne%2C+B.%2C+%26+Darmody%2C+M.+%282016%29.+Teaching+and+learning+in+second-level+schools+at+the+advent+of+high-speed+broadband+%28Paper+No.+51%3B+ESRI+Research+Series%29.+Economic+and+Social+Research+Institute.+ %00empty%00 %00empty%00 %00empty%00 %00null%00 %00empty%00 %00empty%00 %00null%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_8_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Darticle%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aulast%3DMcCoy%26rft.aufirst%3DS.%26rft.date%3D2016%26rft.atitle%3DTeaching%2520and%2520learning%2520in%2520second-level%2520schools%2520at%2520the%2520advent%2520of%2520high-speed%2520broadband%2520%2528Paper%2520No.%252051%253B%2520ESRI%2520Research%2520Series%2529.%2520Economic%2520and%2520Social%2520Research%2520Institute %00empty%00}-->
- McCoy, S., Quail, A., & Smyth, E. (2014). The effects of school social mix: Unpacking the differences. Irish Educational Studies, 33(3), 307–330. https://doi.org/https://doi.org/10.1080/03323315.2014.955746 <!--${if: isGetFTREnabled}-->
- Mohan, G., McCoy, S., Carroll, E., Mihut, G., Lyons, S., & Mac Domhnaill, C. (2020). Learning for all? Second-level education in Ireland during COVID-19 (ESRI Survey and Statistical Report Series No. 92). Economic and Social Research Institute). https://www.esri.ie/system/files/publications/SUSTAT92_3.pdf <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 journal Learning+for+all%3F+Second-level+education+in+Ireland+during+COVID-19+%28ESRI+Survey+and+Statistical+Report+Series+No.+92%29.+Economic+and+Social+Research+Institute%29 author%3DG.+Mohan%26author%3DS.+McCoy%26author%3DE.+Carroll%26author%3DG.+Mihut%26author%3DS.+Lyons%26author%3DC.+Mac+Domhnaill 2020 Mohan%2C+G.%2C+McCoy%2C+S.%2C+Carroll%2C+E.%2C+Mihut%2C+G.%2C+Lyons%2C+S.%2C+%26+Mac+Domhnaill%2C+C.+%282020%29.+Learning+for+all%3F+Second-level+education+in+Ireland+during+COVID-19+%28ESRI+Survey+and+Statistical+Report+Series+No.+92%29.+Economic+and+Social+Research+Institute%29.+ %00empty%00 %00empty%00 %00empty%00 %00null%00 %00empty%00 %00empty%00 %00null%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_10_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Darticle%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aulast%3DMohan%26rft.aufirst%3DG.%26rft.date%3D2020%26rft.atitle%3DLearning%2520for%2520all%253F%2520Second-level%2520education%2520in%2520Ireland%2520during%2520COVID-19%2520%2528ESRI%2520Survey%2520and%2520Statistical%2520Report%2520Series%2520No.%252092%2529.%2520Economic%2520and%2520Social%2520Research%2520Institute%2529 %00empty%00}-->
- Newman, C. (2014). Education: Market failure and government interventions. In J. O’Hagan (Ed.), The economy of Ireland: National and sectoral policy issues (12th ed., pp. 338–361). Gill and Macmillan. <!--${if: isGetFTREnabled}--><!--${/if:}--> <!--${ifNot: isGetFTREnabled}--><!--${/ifNot:}--><!--${if: isGetFTREnabled}--><!--${/if:}--><!--${googleScholarLinkReplacer: %00empty%00 book Education%3A+Market+failure+and+government+interventions.+In+J.+O%E2%80%99Hagan+%28Ed.%29%2C+The+economy+of+Ireland%3A+National+and+sectoral+policy+issues+%2812th+ed.%2C+pp.+338%E2%80%93361%29 author%3DC.+Newman 2014 Newman%2C+C.+%282014%29.+Education%3A+Market+failure+and+government+interventions.+In+J.+O%E2%80%99Hagan+%28Ed.%29%2C+The+economy+of+Ireland%3A+National+and+sectoral+policy+issues+%2812th+ed.%2C+pp.+338%E2%80%93361%29.+Gill+and+Macmillan. %00empty%00 %00null%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 %00empty%00 getFTREnabled FULL_TEXT %00empty%00}--><!--${sfxLinkReplacer: e_1_3_5_1_2_6_11_1 %00empty%00 url_ver%3DZ39.88-2004%26rft.genre%3Dbook%26rfr_id%3Dinfo%3Asid%2Fliteratum%253Atandf%26rft.aulast%3DNewman%26rft.aufirst%3DC.%26rft.date%3D2014%26rft.btitle%3DEducation%253A%2520Market%2520failure%2520and%2520government%2520interventions.%2520In%2520J.%2520O%25E2%2580%2599Hagan%2520%2528Ed.%2529%252C%2520The%2520economy%2520of%2520Ireland%253A%2520National%2520and%2520sectoral%2520policy%2520issues%2520%252812th%2520ed.%252C%2520pp.%2520338%25E2%2580%2593361%2529%26rft.pub%3DGill%2520and%2520Macmillan %00empty%00}-->
- Smyth, E., & McCoy, S. (2011). The dynamics of credentialism: Ireland from bust to boom (and back again). Research in Social Stratification and Mobility, 29(1), 91–106. https://doi.org/https://doi.org/10.1016/j.rssm.2011.01.002 <!--${if: isGetFTREnabled}-->
- Smyth, E., & McCoy, S. (2021). School experiences and post-school pathways in the Republic of Ireland. In E. A. Marshall & J. E. Symonds (Eds.), Young adult development at the school-to-work transition: International pathways and processes (pp. 205–221). Oxford University Press. <!--${if: isGetFTREnabled}-->
Appendix B:
Additional figures and tables
Appendix C:
Additional details on survey questions
Overall student engagement
Overall, compared to normal in-school learning, how would you rate teaching and learning since the school closures?
Student engagement with learning responses:
Much better
Better
Similar
Worse
Much worse
I don’t know
Indicator created for negative impact:
0 if much better, better, similar, don’t know.
1 if worse, much worse.
Junior Certificate (3rd year) student engagement
What effect is the COVID-19 shutdown having on the following in your school?
Junior Certificate student engagement responses:
Very positive
Positive
Neither negative nor positive
Negative
Very negative
Don’t know or not applicable
Indicator variable created for negative impact:
0 if very positive, positive, neither negative nor positive, don’t know or not applicable.
1 if negative, very negative.
Leaving Certificate (6th year) student engagement
What effect is the COVID-19 shutdown having on the following in your school?
Leaving Certificate student engagement responses:
Very positive
Positive
Neither negative nor positive
Negative
Very negative
Don’t know or not applicable
Indicator variable created for negative impact:
0 if very positive, positive, neither negative nor positive, don’t know or not applicable.
1 if negative, very negative.
Delivery of lesson content
Overall, compared to normal in-school learning, how would you rate teaching and learning since the school closures?
Delivery of content responses:
Much better
Better
Similar
Worse
Much worse
I don’t know
Indicator created for negative impact:
0 if much better, better, similar, don’t know.
1 if worse, much worse.
Overall student attendance
Overall, compared to normal in-school learning, how would you rate teaching and learning since the school closures?
Student attendance and participation in lessons responses:
Much better
Better
Similar
Worse
Much worse
I don’t know
Indicator created for negative impact:
0 if much better, better, similar, don’t know.
1 if worse, much worse.
Other variables of interest
Distance teaching methods
Across all teachers in school what approaches to distance teaching and learning have been employed during the closure period? Respondents select response from following grid:
Indicator variables created for use of each method in most or all classes:
0 if some classes, no classes.
1 if all classes, most classes.
Individual ICT devices provided to students
Has your school provided ICT equipment to students?
Responses:
Yes – prior to school closures
Yes – as a result of school closures
We are in the process of sourcing or acquiring ICT to provide
No
Indicator variable created of ICT equipment provided to students:
0 if we are in the process of sourcing or acquiring ICT to provide, no.
1 if yes – prior to school closures, or yes – as a result of school closures.
Technology driven
Prior to the shutdown, what proportion of students used the following individual device(s) for educational purposes in any class? Respondents select response from following grid:
Indicator variable created of use of ICT devices in classroom by over half of students prior to shut down:
0 if about half, less than half, none or almost all for all three ICT device types.
1 if most or all, more than half for any ICT device type.