216
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Smartbands and Behavioural Interventions in the Classroom: Multimodal Learning Analytics Stress-Level Visualisations for Primary Education Teachers

ORCID Icon
Received 14 Oct 2022, Accepted 06 May 2024, Published online: 16 May 2024

ABSTRACT

Students’ stress levels may affect their well-being, attentiveness and learning outcomes in primary education classrooms. Positive behavioural interventions and support actions conducted by teachers may alleviate students’ stress levels, especially when addressing special educational needs. In this multimodal learning analytics study, students in a classroom were all given a smartband for their wrist during regular curriculum activities. Data comprised the semester of a single subject as a part of a research project conducted in Sweden. Biobehavioural stress-related arousal of students’ autonomic nervous system was visualised and analysed through distinguished behavioural modes. Additional data include naturalistic observational notes and two short teacher interviews. Research methodology and strategies for innovative implementation were presented and discussed alongside contextual details. For example, stress-level visualisations can aid actionable adjustments of behavioural intervention intensity and provide students’ attentiveness overview for teachers that sequence curricular activities during planning. Findings show an interdisciplinary basis for cost-effective real-time dynamic solutions that involve visual dashboards with advantages to understanding student learning, both at a school-wide system level and for the classroom, if viewed optimistically. However, research on the topic is still in its infancy, notably with ethical risks as a growing pain.

Introduction

A common framework for special educational change in primary education is a system-level improvement approach for learning outcomes and the well-being of students (Bryer & Beamish, Citation2019). Such an improvement approach includes Positive Behavioural Interventions and Support (PBIS) with School-Wide Positive Behavioural Support (SWPBS) implementations (Beamish & Bryer, Citation2019). Nowadays, many students have stressful life circumstances that constantly demand attention in high-stress states, increasing educational challenges as ‘their physiology also becomes persistently at odds with learning’ (Papa & Jackson, Citation2021, p. 125). PBIS actions conducted by teachers may be beneficial for students to regulate stress and attentiveness to maintain focus during curricular activities and may be required for many Special Educational Needs (SEN) that affect stress, attentiveness and well-being (Bryer & Beamish, Citation2019). However, according to Cusumano and Preston (Citation2021), exactly when to execute PBIS actions in a primary education classroom context with student groups is notoriously unclear for teachers to identify. For example, many general labels for students with SEN may not aid teachers in identifying actionable support (Demetriou, Citation2022). These circumstances may be exacerbated by rapid technological innovations that sometimes come with unhealthy consequences for many students, such as smartphone addiction dysphoria (Palalas, Citation2018).

To emphasise the actionability of knowledge for PBIS in primary education, it is appropriate to study contextual relations of student learning through a qualitative basis for data collection methods (Algozzine et al., Citation2021; Potměšil & Qiong, Citation2022). Recent innovations in hardware capacity and sensor quality have expanded data collection sources, with increased research access to- and research interest in non-verbal behavioural data in primary education (Gunnars, Citation2021). This includes behaviour that previously was difficult to observe outside of clinical laboratory settings (Hogan & Baucom, Citation2016; Noroozi et al., Citation2019). For example, deployable wearables such as smartbands, smartwatches, spy glasses, and digital clothes are nowadays a feasible and affordable alternative that extends the ability of researchers in the learning sciences to collect data (Jaldemark et al., Citation2019). Such innovations span across education, computer science, and nursing, providing ‘interdisciplinary understandings of the human condition (e.g. biometric understanding of stress) relative to situated context’ in creating accessibility for students with SEN (Basham et al., Citation2020, p. 36). When emphasised as teacher assistance, such an understanding may act as a counter-argument to a reasonable prevailing fear that vital contextual details will be left out in educational applications of innovative technology (Buckingham Shum & Luckin, Citation2019).

Biobehavioural stress-related arousal of students’ Autonomic Nervous System (ANS) can be observed by optical smartband sensors as measured by Heart Rate (HR), electro dermal activity and recorded movement from accelerometers (Akselrod et al., Citation1981; Ernst, Citation2014; Hoog Antink et al., Citation2021; Noroozi et al., Citation2019). These readings provide unobtrusive evaluations of cognitive stress based on HR interval fluctuations, referred to as Heart Rate Variability (HRV), with the potential of providing an objective assessment of stress and resource exhaustion of the body even when not in movement or during exercise (Kim et al., Citation2018). For example, optical HRV monitoring through reflective Photoplethysmography (PPG) sensors have recently gained interest in scientific research as a cheap and unobtrusive method for clinical applications such as detecting cardiac arrhythmias (Hoog Antink et al., Citation2021). While the HRV measurements through gold standard electrocardiography are more reliable, Hoog Antink et al. (Citation2021, p. 10) determined after rigorous comparison that PPG techniques reliably ‘could be adequate for patient monitoring’. Similarly, the monitoring of student group stress levels may be appropriate with this kind of technique. Further, Larmuseau et al. (Citation2020, p. 1559) claim that ‘it might be useful for future research to integrate the study into regular curriculum’, as many of the current studies on HRV that relate to cognitive activity and learning collect data in experimental settings.

The biobehavioural smartband data are especially suitable for PBIS research, as descriptions based on behavioural data rather than self-reports are considered the most definitive to an applied behaviour analysis due to challenges correlating self-reports with behaviour (Kennedy, Citation2021; Skinner, Citation1950). In this case, the deployable wearables could provide the teacher with an observable indicator of student group stress and attention levels during curricular classroom sessions ‘to identify the most appropriate and effective activities’ (de Arriba-Pérez et al., Citation2017, pp. 326–327). Further, SWPBS depends on access to observable and measurable data for the efficacy of teachers’ PBIS actions to contextually reflect student learning and desirable learning outcomes (Cusumano & Preston, Citation2021). In contrast, generalised implementations often fail to accommodate student differences that is especially relevant for students with SEN (Ferri & Ashby, Citation2017).

Ways to analyse data have also increased and expanded with technological innovations. Researchers’ abilities to represent measurable data are expanding through new database schemas, algorithms, and intuitive user interfaces in research relating to Learning Analytics (LA) (Ifenthaler et al., Citation2021; Noroozi et al., Citation2019). Further expansion of LA by relations between various data types and attributes is emphasised in Multimodal Learning Analytics (MMLA), enabling multiple representations of data (DiMitri et al., Citation2018; Gunnars, Citation2021; Samuelsen et al., Citation2019). Due to the challenges of multimodal data collection, common unimodal LA approaches may solely use one data type for analysis, often collected from higher education management systems (Cukurova et al., Citation2020; Samuelsen et al., Citation2019; Viberg et al., Citation2018). Therefore, LA studies in primary education with multimodal applications may present a knowledge gap that seems relevant to the emphasis on actionable PBIS knowledge.

Thus, this article aims to study how biobehavioural data from deployable wearables in primary education classrooms can provide actionable knowledge for teachers conducting positive behavioural interventions relating to stress during curricular activities.

Research Question 1

What actionable knowledge for behavioural interventions can be visualised from biobehavioural data generated by deployable wearables in a primary education classroom?

Research Question 2

How can positive behavioural interventions and curricular activities in a primary education classroom relate student group stress levels with visualised biobehavioural data?

Global Increase of Behavioural Interventions

SWPBS involves multidisciplinary teams with in-depth applied behaviour analysis knowledge that aids teachers with the identification of suitable PBIS actions for students with various SEN (Beamish & Bryer, Citation2019; Kennedy, Citation2021). The interventions of similar focus have, in 2017–2022, globally increased in frequency alongside national reforms of the school curriculum, relating a higher degree of disability support previously not seen (Bryer & Beamish, Citation2019; Dutt et al., Citation2019; Hepburn, Citation2019; Hwang et al., Citation2019). While legal system reforms have garnered much attention for special education research, research on implementation and the innovative effects of such legal provisions at the school level are currently needed (Potměšil & Qiong, Citation2022; Tsui & Yuen, Citation2020).

Innovation for quality in education sectors may be fostered bottom-up through teachers during real-life curriculum activities in the classroom (Beamish & Bryer, Citation2019; Dutt et al., Citation2019; Hwang et al., Citation2019). However, current studies often ‘occur in settings that are not authentic or representative of real-life places where academic and social behavior are occurring’ (Algozzine et al., Citation2021, p. 515), which may contribute to poor translatability for actionable PBIS knowledge in top-down policy documents and related research. Knowledge actionability is crucial even to minor challenges for teachers since they are constantly limited by scarce resources, training, and materials (Algozzine et al., Citation2021; Beamish & Bryer, Citation2019; Vučinić et al., Citation2022).

Facilitating Special Needs in Primary Education

Student stress, well-being and performance may relate to a more thought-through version of primary education classroom management that promotes student learning flexibility. However, excessive student flexibility may be too demanding for primary education teachers by expanding the role of the teacher to a facilitator in multiple processes simultaneously (Andreozzi & Pietrocarlo, Citation2017). Basham et al. (Citation2020) argue that a key driver for teacher role alterations is technological innovations, which are ongoing at a rapid pace with interdisciplinary iterations and revolutionary consequences for education. For example, smartphones may constantly put a demand on students’ attention in a way that leads to a deprioritisation of learning and other unhealthy consequences (Palalas, Citation2018; Papa & Jackson, Citation2021). Further, the teacher role now demands higher requirements of interpersonal competencies with students, parents and other teachers (Pavlidou & Alevriadou, Citation2022). Such conditions described above may entail connections to emotional exhaustion and teacher burnout, especially related to student groups with a high variety of SEN (Vučinić et al., Citation2022). Teachers and students have criticised the requirement of greater time and ability to master flexible and dynamic educational settings (Dovigo & Rocco, Citation2017). Further, flexible curricular activities with thought-through classroom management may require a higher awareness of contextual relations to student learning, highlighted by Algozzine et al. (Citation2021) as lacking in PBIS research due to a common emphasis on generalisability. Such generalised approaches ‘reducing teacher decision-making and creative problem solving’ may contribute to poor recognition of individual learning differences (Ferri & Ashby, Citation2017, p. 23).

If certain students’ SEN are not attended to, it often leads to greater stress levels, inattention, poor engagement, and low motivation during curricular activities due to lacking well-being (Bryer & Beamish, Citation2019). To prevent this, PBIS actions may be conducted by teachers in inclusive classrooms to reduce student group stress levels, as followed by an analysis of student group behaviour (Cusumano & Preston, Citation2021). While most teachers may already perform versions of classroom management similar to applied behaviour analysis in regular curriculum activities, they may not reach the same effectiveness as a PBIS aiding SWBS team with access to comprehensive and multidisciplinary eco-psychological analysis (Hepburn, Citation2019). For example, such analysis may include environmental stressors such as students’ sleep, levels of happiness and frustration, and learning outcomes across multiple school subjects (Beamish & Bryer, Citation2019). Data on environmental stressors are commonly included in SWPBS implementations through small group instruction that involve students with SEN with PBIS aiding teams for remediation and behavioural support concerning stress reduction and student’s interpersonal functioning (Dutt et al., Citation2019).

One central aspect of PBIS as preventative classroom management is to relate student stress, well-being and performance by emphasising routines, clear rules for flexible student responding, and acknowledgement of appropriate behaviour through timely and context-dependent feedback in regulatory activities (Beamish & Bryer, Citation2019). For example, a common development for classroom management that alleviate student inattention in primary education is to combine curriculum activities with gamified elements such as competitive games on an audio-visual device (Landers, Citation2014). Gamified learning exemplifies how dynamic and interactive experiences with clear feedback rewards may benefit classroom management. Further, as proposed by Palmquist et al. (Citation2021), gamification shares similarities with LA such as providing rich, algorithmically produced and context-related data.

Visualisable Multimodal Aid for Teachers

In SWPBS, students need to be correctly identified according to the three multi-level categorical tiers with different degrees of specific intervention intensity: low-intensity universal interventions in tier 1, medium-intensity targeted group interventions in tier 2, and highly intensive, individual interventions in tier 3 (Beamish & Bryer, Citation2019; Tutton, Citation2019). By supporting common behavioural challenges of tier 1, 80–90% of students may better have their social-emotional needs met at school (Beamish & Bryer, Citation2019). LA classroom management data could address clarity for grouping the students based on stress-related behaviour and managing their differing tiered approaches. For example, tier 2 and tier 3 consist of more frequent, intense, or targeted group-delivered interventions for the 5–10% of students that were unaffected by tier 1, often including students with SEN relating autism, deaf-blindness, intellectual disability, or social-emotional disorders (Beamish & Bryer, Citation2019). Thus, tier 3 requires different interventions when considering student group stress levels as compared to tier 1 and 2. Methods with LA applications could potentially provide actionable aid for narrowing down individual students’ stress through visually summarised and algorithmically adjusted data to represent students’ stress in a classroom non-invasively (Blikstein & Worsley, Citation2016).

Recent LA studies also produce a basis for a visual dashboard on an aiding audio-visual device for teachers that want to increase their awareness and interpretation of student-learning progress (van Leeuwen et al., Citation2019). The concept of a visual dashboard shows the potential for LA to provide live, context-aware data for teachers in real time during curricular activities (Cukurova et al., Citation2020; Ifenthaler et al., Citation2021). Such innovations that relate to students’ stress ‘can proactively employ technology to bridge connections between educators and students’ (Papa & Jackson,Citation2021, p. 126). For example, the dashboard could intuitively visualise aspects of well-being and cognitive performance of student group stress- and attention levels through algorithms of smartband data relating HR and electro dermal activity analysis (de Arriba-Pérez et al., Citation2017; Noroozi et al., Citation2019). The algorithms can generate visualised smartband data that relate to foundations from clinical research.

Distinguished Stress-Related Behaviour

Foundations from clinical research differentiate short-term cardiovascular control of the ANS according to activity and recovery functions (Ernst, Citation2014; Hogan & Baucom, Citation2016). Measurement of the ANS ‘may serve as an index of stress and stress vulnerability’ (Kim et al., Citation2018, p. 237) by objective spectral components of rhythm and variability of HR frequency. The more cognitively demanding and performance-related sympathetic nervous system is characterised by a slow high-frequency HR, and the protective and restorative parasympathetic nervous system is characterised by a faster, lower-frequency HR (Akselrod et al., Citation1981; Ernst, Citation2014; Kim et al., Citation2018). As such, stress level measurements may reliably inform how behaviour with or without movement or exercise adapted to different activities alters resource exhaustion (Kim et al., Citation2018). While studies investigating complex learning phenomena such as specific sympathetic nervous system cognitive function demands concerning HRV analysis have had mixed results in previous research, most of them have indicated that HR and HRV generally are sensitive to stress (Johannessen et al., Citation2020; Larmuseau et al., Citation2020).

The ANS distinctions have provided a better clinical understanding of disorders that relate to resource exhaustion of the body and well-being, such as anxiety disorders that previously had been ‘dominated by models of impaired homeostasis perturbed by sympathetic overreactivity’, but better explained by a dysfunction in the parasympathetic tone (Kamath et al., Citation2013, p. 452). As established from special education research relating students with adverse childhood experiences, such a persistent state of high stress physiologically depletes and deprioritises the bodily resources that are required for learning (Papa & Jackson, Citation2021). PBIS actions, such as brief body exercises that encourage movement, may alter the high-stress cognitive state of sedentary students with depleted body resources (Luiselli, Citation2016).

As discussed above, smartbands with optical PPG sensors and accelerometers may present an unobtrusive alternative for providing data on the stress-related ANS (Hoog Antink et al., Citation2021). Similar analysis may relate PBIS actions based on readings of students’ exertion levels to evaluate appropriate PBIS intensity. According to Kennedy (Citation2021), combining contextual details with the behavioural data type is suitable for effective PBIS actions and implementation fidelity. Thus, teachers may benefit from access to algorithmically produced and visually intuitive aiding analysis of stress-related aspects of students, similar to SWPBS, without administrative requirements. The study in this article presented below provides this kind of data analysis.

Materials and Methods

This study uses an inductive MMLA methodological approach for emphasising visualisations of actionable PBIS knowledge. As such, presented findings start bottom-up from cumulative records of biobehavioural data and relate behavioural findings only when emerging phenomena make this possible (Pierce & Cheney, Citation2017; Skinner, Citation1950). Intuitive aspects of basic statistical analysis with Statistical Package for the Social Sciences 27 (SPSS) was be heavily emphasised to promote qualitative contextual relations between the various collected data types (DiMitri et al., Citation2018; Potměšil & Qiong, Citation2022).

Xiaomi Mi Smart Band 5 with firmware version 1.0.2.66 was used as deployable wearables to determine student and teacher stress levels according to biobehavioural data in a primary education classroom in Sweden. Smartbands were rerouted and tested 6 months before data collection to functionally operate without factory-defaulted internet access requirements to meet the GDPR and national research guidelines (The Swedish Research Council, Citation2017). Preparation also involved locking subjects’ smartband operability and disabling device notifications during data collection. Additional security steps included database encryption during transfer and storage. Smartband management was executed with open-access software Gadgetbridge version 0.60.0. Open-access software SQLite was used as a serverless database engine.

The specific wearable device model was in September 2021 chosen as it was one of the only Gadgetbridge-compatible smartbands at the time that included a PPG sensor for optical light readings, which is a cheaper alternative for measuring HRV than the traditional electrocardiography method that requires electrodes attached with gel adhesives (Hoog Antink et al., Citation2021). Other beneficial factors were the affordability of the device and the toy-like form-factor suitable for primary education students, which both may be crucial if they are to be viably implemented at scale. PPG techniques should be used with caution in HRV analysis for heavy clinical analysis, as outlined by Hoog Antink et al. (Citation2021) in the light of findings of 16% to 19% common relative errors in the low and high-frequency domain. However, for the purposes of this article that studies how deployable wearables can provide actionable knowledge through case-by-case visualisations, such relative errors could be mitigated by grouping all students through mean value estimations and confidence intervals, also seen through recommendations in the literature, e.g. (de Arriba-Pérez et al., Citation2017).

MMLA may encounter ethical issues and dilemmas in research relating to the extensive collection of multiple data types (Slade & Prinsloo, Citation2013). To adequately address national guidelines for conducting research and GDPR, very detailed steps for data collection were necessary. These steps involve relating the location and interpretation of data, informed and signed consent from all related parents, students, school leader and teacher, data deidentification, data management, and storage of data. Three separate introductory sessions without data collection comprised informed consent with the teacher, parents, and students, respectively. In acknowledging the importance of these aspects, thorough collaboration with municipalities and IT departments was maintained throughout, and the Swedish national ethical review board conducted an extensive review of detailed steps.

Data Collection

Data collection was performed in spring 2022 during a semester (5 months) of classes in a single school as a part of a larger MMLA research project conducted in Sweden. The classes contained standard national curricular contents relating to cultural knowledge, with no curricular elements of physical exercise. The school had recently performed SWPBS work based on evaluations related to the childrens’ sense of security and safety. It was currently working on raising the engagement and motivation of the students. The total number of subjects includes 24 students (around 12 years of age) and their teacher. Students were all given one smartband for their wrist during each session. Smartbands and researcher participation did not seem to affect student group behaviour beyond minimal practical concerns, according to comments provided by the teacher between sessions. Validity in contextual considerations for curricular activities was assumed to increase through constant recording conditions that solely focus on a single classroom, partly reducing complexity (Hogan & Baucom, Citation2016).

Every smartband recorded a cumulative record of data rows per minute with various attributes to be exported into separate database files, each session lasting around 60 minutes, generating 157 included database files in totality. After database clean-up of approximately 2200 confirmed read-error values during sessions, 10 088 relevant data rows of students were included for classroom session analysis. Eight sessions (henceforth individually referred to as ‘S#1–8’) were recorded. The first few minutes of each session before the start of curricular activities were determined as partial resting baseline measurements (Hogan & Baucom, Citation2016). The number of students present for each session varied between n = 19 and n = 23. Students were anonymised by being grouped in the analysis. As discussed above, the grouping also strengthened analysis in events of smartband device sensor quality issues (validity, reliability). In addition, researcher and teacher databases were collected to ensure device reliability but were not included in the analysis. See for analysed session database rows.

Table 1. Database records and observational note word count per analysed session.

In conjunction, naturalistic observations, as outlined by Cohen et al. (Citation2018), were made in each session to detail contextual relations. The contextual relations were identified by the taxonomy of multimodal data for learning as recommended by DiMitri et al. (Citation2018), including behavioural observations, noise levels, and environment clutter, for outlining curriculum activities as brief descriptions. Each observational note-related session timestamps (for word count, see ).

Two short interviews were conducted on separate occasions with the teacher after the semester was finished, netting 40 minutes of transcribed speech. Iterated statistical visualisations of smartband data were presented during the interviews to discuss actionability from the teachers’ point of view, further detailing contextual relations.

Smartband Database Coding

Each database file from the smartbands consists of five attributes, henceforth addressed as displayed in their pre-coded states: ‘TIMESTAMP’, ‘STEPS’, ‘HEART_RATE’, ‘RAW_KIND’, and ‘RAW_INTENSITY’ ().

Figure 1. SQLite view of database workspace.

Figure 1. SQLite view of database workspace.

As these devices are designed to load the databases into the official app of the manufacturer, reverse engineer interpretations may not suffice to code variables. To account for this in this study, assumptions for the coding of variables are in addition to source code comparisons published on the Gadgetbridge website, based on identified patterns in database attribute functions outlined below, excluding TIMESTAMP, STEPS AND HEART_RATE which required no interpretation. However, despite thorough attempts for pattern validity, potential challenges are duly noted.

Results

Three behavioural mode variables emerged after the completed coding of RAW_KIND. Adhering to the principle of parsimony as related to PBIS actionability during curricular activities and ANS elements, RAW_KIND values were coded as ‘Movement’, ‘Focused’, and ‘Inattentive’ variables. Baseline recordings indicated that sensor readings were at least in part related HRV, as these durations had a higher prevalence of inattentive than attentive when compared to other activities. Further, comparative charts of focused and inattentive for complete sessions detailed HR patterns indicative of the ANS assumptions when separated from movement activity outlined in STEPS by the smartband accelerometer (see for sample).

Figure 2. Comparison of student group mean minute focused and inattentive HR values in S#1, with movement values removed. Dotted line represents regular 12-year-old HR as reference.

Figure 2. Comparison of student group mean minute focused and inattentive HR values in S#1, with movement values removed. Dotted line represents regular 12-year-old HR as reference.

Inattentive shows a distinguished pattern of intensive swings between high and low HEART_RATE values and generally higher values compared to the focused behavioural mode, which adheres more closely to common HR values of subjects’ age range.

Other patterns emerged after cross-referencing these codes with RAW_INTENSITY. RAW_INTENSITY values are most likely intended to highlight exertion levels of physical exercise, as the attribute presented summarised integer values that were intuitive and visualisable in charts. Higher values denoted more intense activity. Other than relating to other attributes, the algorithm may have distinguished intensity based on HRV and electro dermal activity. While athletic workouts are outside this study’s scope, the function of RAW_INTENSITY seemed to visually differentiate stress from focused and inattentive levels better than HEART_RATE even in the absence of movement. Furthermore, it clearly indicates the strength of short PBIS movement activities.

Thus, RAW_INTENSITY and the behavioural mode variables were key components for outlining student group stress levels and providing actionable knowledge in visualised form for teachers conducting PBIS during regular curricular primary school activities.

Interpreting Intensity Levels for Actionable Knowledge

To relate student group stress-level intensity charts, the mean value of RAW_INTENSITY with a 95% confidence interval was visually represented according to each related minute, combined with markings relating the start of curricular activities for each separate session. The recordings started before the teacher-led activities, included in the charts partly as a contextual baseline. Charts end when the teacher signals for a break, cancelling the final curricular activity, and students leave the classroom. See for S#4.

Figure 3. Mean minute value of student group stress from S#4 with 95% CI. Box 1 denote start of the first curricular activity, ending with the start of the second curricular activity in box 2, and so on.

Figure 3. Mean minute value of student group stress from S#4 with 95% CI. Box 1 denote start of the first curricular activity, ending with the start of the second curricular activity in box 2, and so on.

Most sessions comprised four curricular activities. To relate PBIS elements, a teacher can evaluate student group stress levels depending on curricular activity length and sequence. For example, fluctuating intensity durations might indicate the previous activity as too demanding, which likely would be a good time for focused behavioural mode reinforcement through a PBIS movement activity.

One pattern that directly stands out for the viewer of the visualisations is that curricular activity shifts often influence the student group to increase stress levels, only to drop moments again after. This may indicate that activity shifts, in most cases, alter stress regulation as spikes. For example, in S#4 (), the introduction of three of the four activities seemed to follow this pattern. The first two activities comprised individual work, where quiet focus was desirable. At the end of the second activity, some students presented high-stress levels, indicating that the focus requirements of the activity were too high for some students. In this situation, the teacher that considers student group stress levels could decide to start a PBIS movement exercise to reinforce lower stress levels of the students in need of movement or decide to expose the student group to the challenge of prolonged focus activity.

Interpreting Behavioural Mode Session Totals for Actionable Knowledge

To relate student group stress-related behavioural modes, session total values were calculated, outlined in .

Table 2. Student movement, inattentive and focused behavioural mode session totals.

In conjunction with the produced from data detailing session behavioural mode totals, a teacher could compare sessions and take action to adjust the activities for desired symmetry according to the total stress level of the student group per session.

For example, during S#5, the movement value (1.3%) was lower than the rest of the sessions, thus potentially in need of a PBIS activity that would reinforce movement frequency. In contrast, S#3 and S#8 showed high movement (21,7%, 21%) yet performed at about the same level of focus as S#5 (68%, 68,9% as compared to 74,6%), indicating diminishing stress-reducing returns from the PBIS movement activities.

Relating Curricular Activities to Student Group Stress Levels and Stress Related Behaviour

According to observed phenomena in observational notes, curricular activities related to stress, well-being, behavioural mode variables, and PBIS interventions could be categorised according to social contextual details, focus expectations, and learning outcome assessment requirements.

Generally, activities with expectations of learning outcomes mainly comprised (a) individual assignments or (b) verbal contributions in active group activities. Other activities were either (c) passive group activities, such as watching a movie in front of the class relating to the curricular content or (d) behavioural interventions with or without relation to curricular content, such as brief movement activities for students with ADHD, playful teambuilding activities of throwing a softball to each other, or a game of ‘Kahoot!’ as closing activity of the session. These activity types will henceforth be referred to as ‘(a–d)’ ().

Table 3. Typology of curricular activities as emerged from phenomena in observational notes.

Kahoot! is an example of gamified (d) where students compete against each other by a mediating audio-visual device in front of the class. While situated and presented as a (d), interviews revealed that teacher also, in smaller part, view Kahoot! as an (a).

Based solely on the visualised stress levels, a teacher could evaluate the student group stress levels effects of the behavioural interventions and the sequential structure of various sessions according to curricular activity types and length. For example, S#4 () comprised the sequence (a), (a), (c), (b), which might indicate that such a sequence pattern of session structure is appropriate, as S#4 was the least intensive session and did not seem to require any (d).

Another example relating to the curricular activities and previously discussed S#8 showed high movement (see ).

Figure 4. Mean minute value of student group stress from S#8 with 95% CI. Boxes denote the start of curricular activities: 1(d) ‘change furniture arrangements’, 2(a) ‘study textbooks’, 3(a) ‘make short summaries of textbook content part 1/2’, 4(d) ‘run around school building’, 5(a) ‘make short summaries … part 2/2’, 6(b) ‘discussion of content’.

Figure 4. Mean minute value of student group stress from S#8 with 95% CI. Boxes denote the start of curricular activities: 1(d) ‘change furniture arrangements’, 2(a) ‘study textbooks’, 3(a) ‘make short summaries of textbook content part 1/2’, 4(d) ‘run around school building’, 5(a) ‘make short summaries … part 2/2’, 6(b) ‘discussion of content’.

Looking at the chart of S#8, a movement activity was clearly indicated as very intense by the large intensity spike compared to similar PBIS activities (see ‘4(d): Run around school building’).

In contrast, S#5 might be considered the most stressful session, as it had high inattentive levels (17,6%) and low movement (1,3%). S#5 comprised many group activities, with the overall structure (c), (b), (b), (c), (b). This session also differs more in the highest and lowest intensity values between the mean, with a bias towards higher values, indicating that fewer students preferred group activities than individual ones, at least when placed in the specified sequence pattern of the session structure. For a chart of S#5, see .

Figure 5. Mean minute value of student group stress from S#5 with 95% CI. Boxes denote the start of curricular activities: 1(c) ‘planning of future activities’, 2(b) ‘read aloud from textbook, 3(b) ‘discussion of content’, 4(c) ‘watch movie’, 5(b) ‘discussion of class structure’.

Figure 5. Mean minute value of student group stress from S#5 with 95% CI. Boxes denote the start of curricular activities: 1(c) ‘planning of future activities’, 2(b) ‘read aloud from textbook, 3(b) ‘discussion of content’, 4(c) ‘watch movie’, 5(b) ‘discussion of class structure’.

Another finding available through visual examination is the similarities across S#1, S#2, S#6, and S#7. In these sessions, the students were told at the beginning that they might get to play Kahoot!. In all these instances, the children performed their assigned activities in a timely manner and closed the session structure with Kahoot!. Additionally, three out of four of these sessions presented strong session total focused values (78,9%, 78,5%, 77,4%).

Teacher Beliefs of Visualisations

Visualisations like of all sessions were presented for the teacher interview occasions, along with student behavioural mode variables movement, focused, and inattentive codes visually represented as pie charts from session totals values (see ). During these interviews, intervention actionability based on the student group stress levels were discussed.

The initial reaction to the charts and pie-charts was overwhelmingly positive: ‘when I see these graphs, I get very proud of my students, they seem to have greater [abilities to hold extended] focus than I expected [of them]’.

The teacher highlighted the S#4 slide () and corresponding pie chart as the first mentioned example of particular interest where students performed better than expected: ‘you know, this is very interesting, because after this session, the kids complained how stressful and anxiety-inducing it was, but this shows that they actually were focused despite believing that they were not’.

During S#4, the teacher used tablets with screen recordings in conjunction with an exam: what is interesting about this session is that the exam were fully done on their own iPads, and if I interpret this graph correctly, it seemed to work just fine. Previously this was a group assignment, which required a lot of verbal [−specific SEN] support.

Another aspect is the social relations of the student group. Teacher comments on inattentive levels in S#5 ( and ): ‘these kids that appeared to fight [during 3(b) “discussion of content”] are actually close friends, so they dare to maybe rile each other up in a way that they do not do to other peers in the group’.

The initial positive reactions had some exceptions, however, such as two slides that did not spark any interest: ‘well, this slide did not tell me anything I did not know, really’. Thus, conducting these readings may not always be worth the effort.

Summary of Findings

The findings of this study may be summarised accordingly:

  • Biobehavioural data collected from students in primary education classrooms with deployable wearables appeared to provide objective readings of the ANS and body exertion stress-level intensity.

  • By intuitively visualising curricular activities, the objective readings provided actionable knowledge for the evaluation of positive behavioural interventions, such as determining appropriate movement intensity and estimated attentiveness challenge according to activity duration and type.

  • In-depth analysis of the objective readings alongside observational notes provided plentiful findings that related contextual aspects, such as consistent intensity spikes from activity shifts and optimistic indications of gamified Kahoot! elements.

Conclusion and Discussion

To conclude, this study has, alongside contextual classroom details, analysed MMLA visualisations of the ANS from related biobehavioural data to outline the body exertion intensity of students’ stress levels during regular curricular activities and promote actionable PBIS knowledge. Further, the biobehavioural data collected from primary education classrooms with deployable wearables appeared to distinguish student behavioural modes that require cognitive performance for longer durations. These behavioural modes include focused, inattentive, and movement distinctions, attributable to each minute for session total per cent. These key components related to student group stress levels that, when visualised, showed potential for actionable PBIS knowledge. For example, after a quick glance at visualisations, the intensity of curricular activities with PBIS elements can be adjusted and related in a behaviour analysis that considers students’ stress levels. Additionally, the visualisations were met with overwhelmingly positive teacher reactions, with the immediate realisation of student group stress evaluation regarding their ability to focus during extended durations.

To further conclude, in-depth analysis alongside observational notes revealed curricular activity types suitable for sequencing of activities according to stress levels. One apparent and notable finding across all visualisations indicates that activity shifts in most cases alter stress regulation, with observable and consistent intensity spikes. This finding of intensity spikes between curricular activities mirrors research on students with SEN relating executive functions that highlight the challenges of shifting attention to another cognitive state or task (Bishara & Kaplan, Citation2022). Other findings include prolonged activities that were challenging for the students’ ability to regulate their stress intensity levels. Thus, both curricular activity type and length seemed vital when considering session activity sequences.

Specific contextual findings of curricular activities related to student group stress levels were observed, including optimistic indications of curricular activities with gamified elements such as Kahoot!, a preference of the student group towards individual activities rather than group activities, an example of a PBIS movement activity that perhaps was too strong, and an occasion where social dynamics of a few students influenced peer students’ stress levels.

Assessment of sensor quality may require further studies but did not seem to pose an issue for the aims of this article when the analysis considers the student group as a whole, in addition to thorough database clean-up.

Methodological Implications for Research and Practice

The multimodal data analysis of this study, and similar types, are ripe with uncharted opportunities, with obvious advantages to a greater understanding of student learning (Ifenthaler et al., Citation2021), both at the school-wide system level and for curricular activities of a single subject. For example, the pie-chart visualisations of the three identified behavioural mode variables was in this study analysed at the level of curricular activity length and sequences of the data collection classroom site. However, the charts could also emphasise SWPBS work when combined with other recordable contextual details. For example, light levels, noise, heat, humidity, and air pollution may be relevant for such a multimodal analysis (DiMitri et al., Citation2018). Further, with data collected over a longer timeframe in multiple school classrooms, SWPBS could identify patterns between student groups, curriculum activities, and primary school interiors with precise and objective sensor readings.

Some of these opportunities should rightly, and perhaps as obviously, be considered dangerous if not handled with care, as pointed out by researchers such as Prinsloo and Slade (Citation2017, 2013). However, handling with care to avoid error does not mean advocacy of approaches primarily motivated by error-avoidance (Markham, Citation2018). Rather than error-avoidance, parts of this study’s outlined and applied methodology may be suitable as a developmental basis for further research in the learning sciences. This includes a contextual emphasis that considers actionable knowledge on a case-by-case basis (Cukurova et al., Citation2020).

For further teacher aid, the type of stress reading analysis provided in this study has clear potential to be integrated into a visual dashboard that might provide a useful service for teachers that monitor student group stress levels (de Arriba-Pérez et al., Citation2017; Noroozi et al., Citation2019). Such services may include intuitive ways to improve not only the understanding of students’ well-being or academic performance but also other aspects seen in the findings, such as social group formations.

Theoretical Implications

For the scope of this study, a case-by-case basis may relate to the importance of emphasising teachers’ ability to adjust curricular activity and corresponding sequential session structure as they see fit, as also indicated in previous PBIS-related research (Algozzine et al., Citation2021; Beamish & Bryer, Citation2019; Ferri & Ashby, Citation2017). Analysis with aims of larger scope towards generalised stress level optimisations for student learning in primary education curricular activities also needs a richer set of contexts, such as considerations to the whole day of students’ school experience, including differences between morning and afternoon resource expenditure. This study assumed the desirability of promoting an active sympathetic nervous system, as students with SEN often need support for this ability during curricular activities. However, it is important when considering comprehensive eco-psychological stressors for an applied behavioural analysis that the parasympathetic nervous system may be even more necessary to emphasise in order to enable proper recovery and rest (Ernst, Citation2014). Optimal PBIS actions also need to rely on the different tiers in the SWPBS tier system to adjust intervention intensity (Algozzine et al., Citation2021; Beamish & Bryer, Citation2019; Tutton, Citation2019). Gamified elements in curricular activities may aid in this regard, such as the Kahoot! implementations seen in this study, by generating rich contextual data (Palmquist et al., Citation2021).

Limitations

As discussed above, the biobehavioural data analysed in this study have ethical risks. Dire consequences for students could unveil if contextual emphasis and regulatory guidelines of GDPR or similar to GDPR are ignored, such as forceful surveillance of individual biobehavioural data as part of learning outcome assessment practices without relation to the well-being of students (Cukurova et al., Citation2020). To be absolutely clear, this article does not at this stage advocate for any other use of the presented findings than outlined in the results section. Ideally, sensitive data should be deleted as soon as its purpose is satisfied, and algorithmic analysis should only meet the eyes of a few with professional responsibilities. Reflection should be made on how education can provide special educational solutions for learning alongside technological developments that are ‘adaptive, flexible, and future-ready’ (Basham et al., Citation2020, p. 44). This includes discussing what educational benefits might outweigh the resources required to manage the risks of adopting technological innovations (Buckingham Shum & Luckin, Citation2019). While outlining further extensive ethical considerations is suitable, it is outside the scope of this article.

One key limitation of this study may relate to the validity of the ANS assumptions. For example, raising the sensor quality of individual student readings may require heavier clinical equipment and other methodological considerations. While the assumptions may be debated, heavier clinical equipment, on the other hand presents a challenging trade-off in interference with the naturalistic educational setting, as attachment of electrodes in electrocardiography methods have invasive elements such as movement restriction, skin irritations or skin injuries (Hogan & Baucom, Citation2016; Hoog Antink et al., Citation2021). However, this trade-off limits other uses of findings that may stumble upon risks of reliability, which scientific research that utilises less visually intuitive but more extensive statistical analysis could alleviate, such as spectral analysis (Akselrod et al., Citation1981; Hoog Antink et al., Citation2021), with synthesised modelling or multivariate computations across student group physiology correspondence and pairing, or curricular activities, or classroom interiors. These considerations could further combine perceptions from students’ self-reports, absent in this study and called out for in the literature, e.g. (Larmuseau et al., Citation2020).

Further Research

The findings and its PPG smartband methodology outline objective ANS stress measurements of a primary education student group with intuitive MMLA visualisations for actionable PBIS curriculum activity adjustments. One especially notable finding in this study was observable and consistent intensity spikes during activity shifts, which may have the potential for applications in research relating to students’ executive function (Bishara & Kaplan, Citation2022). Overall, the data has clear implications for future development, such as the proposed PBIS LA dashboard for teachers in a classroom, with innovative SWPBS implementations. The proposed dashboard relates to the, according to Cusumano and Preston (Citation2021), needed aid for contextually identifying exactly when to execute PBIS actions.

While the presented results are promising, the proposed smartband methodology for primary education classrooms is still in its infancy and, therefore, not yet suitable to implement at scale for teachers. It is therefore necessary that further research focus on a bigger scope that includes environmental stressors, for example, to emphasise scalability. Additionally, ANS assumptions related to the behavioural mode variables may require further investigation for the scalability of the findings. However, if systematic challenges (most notably, ethical and validity details) are handled, the findings of this article serve as an empirical basis for viable cost-effective solutions with advantages to a greater understanding of student learning. This understanding would benefit the lives of students with SEN through the continued hard work and iterated implementations of teachers conducting PBIS, practitioners of SWPBS, and researchers in the learning sciences.

Disclosure Statement

No potential conflict of interest was reported by the author(s).

References

  • Akselrod, S., Gordon, D., Ubel, F. A., Shannon, D. C., Berger, A. C., & Cohen, R. J. (1981). Power spectrum analysis of heart rate fluctuation: A quantitative probe of beat-to-beat cardiovascular control. Science, 213(4504), 220–222. https://doi.org/10.1126/science.6166045
  • Algozzine, B., Spooner, F., McLeskey, J., & Waldron, N. L. (2021). Supporting inclusion and inclusive schools. In B. Algozzine, F. Spooner, J. McLeskey & N. L. Waldron (Eds.), Handbook of effective inclusive elementary schools: Research and practice (pp. 507–524). Routledge.
  • Andreozzi, P., & Pietrocarlo, A. (2017). Educational inclusion and organization. In F. Dovigo (Ed.), Special educational needs and inclusive practices (pp. 119–142). Sense Publishers.
  • Basham, J. D., Han, K., Zhang, L., & Yang, S. (2020). Considering the fourth industrial revolution in the preparation of learners with and without disabilities. In M. Yuen, W. Beamish, & V. S. H. Solberg (Eds.), Careers for students with special educational needs (pp. 31–46). Springer.
  • Beamish, W., & Bryer, F. (2019). Emergence of behavioural support in the USA. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: Trends across the asia-pacific region (pp. 27–48). Springer.
  • Bishara, S., & Kaplan, S. (2022). Inhibitory, self-efficacy, and mathematics achievements in students with learning disabilities. International Journal of Disability, Development and Education, 69(3), 868–887. https://doi.org/10.1080/1034912X.2021.1925878
  • Blikstein, P., & Worsley, M. (2016). Multimodal learning analytics and education data mining: Using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220–238. https://doi.org/10.18608/jla.2016.32.11
  • Bryer, F., & Beamish, W. (2019). Western perspectives on teaching, learning, and behaviour. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: Trends across the asia-pacific region (pp. 3–26). Springer.
  • Buckingham Shum, S. J., & Luckin, R. (2019). Learning analytics and AI: Politics, pedagogy and practices. British Journal of Educational Technology, 50(6), 2785–2793. https://doi.org/10.1111/bjet.12880
  • Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge.
  • Cukurova, M., Giannakos, M., & Martinez‐Maldonado, R. (2020). The promise and challenges of multimodal learning analytics. British Journal of Educational Technology, 51(5), 1441–1449. https://doi.org/10.1111/bjet.13015
  • Cusumano, D. L., & Preston, A. I. (2021). Supporting inclusive practices with multi-tiered system of supports. In J. McLeskey, A. Bob, F. Spooner & N. L. Waldron (Eds.), Handbook of effective inclusive elementary schools: Research and practice (pp. 117–138). Routledge.
  • de Arriba-Pérez, F., Caeiro-Rodríguez, M., & Santos-Gago, J. M. (2017). Towards the use of commercial wrist wearables in education. 4th Experiment@ International Conference (Exp. at’17) (pp. 323–328). https://doi.org/10.1109/EXPAT.2017.7984354
  • Demetriou, K. (2022). Special educational needs categorisation systems: To be labelled or not? International Journal of Disability, Development and Education, 69(5), 1772–1794. https://doi.org/10.1080/1034912X.2020.1825641
  • DiMitri, D., Schneider, J., Specht, M., & Drachsler, H. (2018). From signals to knowledge: A conceptual model for multimodal learning analytics. Journal of Computer Assisted Learning, 34(4), 338–349. https://doi.org/10.1111/jcal.12288
  • Dovigo, F., & Rocco, V. (2017). Building evaluation capacity in science education to spread sustainable and inclusive education. In F. Dovigo (Ed.), Special educational needs and inclusive practices (pp. 163–190). Sense Publishers.
  • Dutt, A., Lim, L., & Thaver, T. L. (2019). Behavioural support in singapore. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: Trends across the asia-pacific region (pp. 115–126). Springer.
  • Ernst, G. (2014). Heart rate variability. Springer.
  • Ferri, A. B., & Ashby, C. (2017). US inclusion in the era of neoliberal educational reforms. In F. Dovigo (Ed.), Special educational needs and inclusive practices (pp. 21–32). Sense Publishers.
  • Gunnars, F. (2021). A large-scale systematic review relating behaviorism to research of digital technology in primary education. Computers and Education Open, 2, 100058. https://doi.org/10.1016/j.caeo.2021.100058
  • Hepburn, L. (2019). Behavioural support in an australian government sector. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: Trends across the asia-pacific region (pp. 89–100). Springer.
  • Hogan, J. N., & Baucom, B. R. (2016). Behavioral, affective, and physiological monitoring. In J. K. Luiselli & A. J. Fischer (Eds.), Computer-assisted and web-based innovations in psychology, special education, and health (pp. 3–32). Academic Press.
  • Hoog Antink, C., Mai, Y., Peltokangas, M., Leonhardt, S., Oksala, N., & Vehkaoja, A. (2021). Accuracy of heart rate variability estimated with reflective wrist-PPG in elderly vascular patients. Scientific Reports, 11(1), 8123. https://doi.org/10.1038/s41598-021-87489-0
  • Hwang, Y.-S., Ku, J.-A., Song, M.-J., & Noh, J.-E. (2019). Behavioural support in the republic of korea. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: Trends across the asia-pacific region (pp. 127–139). Springer.
  • Ifenthaler, D., Gibson, D., Prasse, D., Shimada, A., & Yamada, M. (2021). Putting learning back into learning analytics: Actions for policy makers, researchers, and practitioners. Educational Technology Research & Development, 69(4), 2131–2150. https://doi.org/10.1007/s11423-020-09909-8
  • Jaldemark, J., Eriksson Bergström, S., von Zeipel, H., & Westman, A.-K. (2019). Wearable technologies as a research tool for studying learning. In Y. (Aimee) Zhang & D. Cristol (Eds.), Handbook of mobile teaching and learning (2nd ed. pp. 1–15). Springer.
  • Johannessen, E., Szulewski, A., Radulovic, N., White, M., Braund, H., Howes, D., Rodenburg, D., & Davies, C. (2020). Psychophysiologic measures of cognitive load in physician team leaders during trauma resuscitation. Computers in Human Behavior, 111, 106393. https://doi.org/10.1016/j.chb.2020.106393
  • Kamath, M. V., & Watanabe, M., & Upton, A. (Eds.). (2013). Heart rate variability (HRV) signal analysis: Clinical applications. Taylor & Francis Group.
  • Kennedy, C. H. (2021). Intensive behavioral support. In J. McLeskey, F. Spooner, B. Algozzine & N. L. Waldron (Eds.), Handbook of effective inclusive elementary schools: Research and practice (pp. 375–389). Routledge.
  • Kim, H.-G., Cheon, E.-J., Bai, D.-S., Lee, Y. H., & Koo, B.-H. (2018). Stress and heart rate variability: A meta-analysis and review of the literature. Psychiatry Investigation, 15(3), 235–245. https://doi.org/10.30773/pi.2017.08.17
  • Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768. https://doi.org/10.1177/1046878114563660
  • Larmuseau, C., Cornelis, J., Lancieri, L., Desmet, P., & Depaepe, F. (2020). Multimodal learning analytics to investigate cognitive load during online problem solving. British Journal of Educational Technology, 51(5), 1548–1562. https://doi.org/10.1111/bjet.12958
  • Luiselli, J. K. (2016). Increasing and maintaining exercise-physical activity. In J. K. Luiselli (Ed.), Behavioral health promotion and intervention in intellectual and developmental disabilities (pp. 73–93). Academic Press.
  • Markham, A. (2018). Afterword: Ethics as impact – Moving from error-avoidance and concept-driven models to a future-oriented approach. Social Media+ Society, 4(3), 1–11. https://doi.org/10.1177/2056305118784504
  • Noroozi, O., Alikhani, I., Järvelä, S., Kirschner, P. A., Juuso, I., & Seppänen, T. (2019). Multimodal data to design visual learning analytics for understanding regulation of learning. Computers in Human Behavior, 100, 298–304. https://doi.org/10.1016/j.chb.2018.12.019
  • Palalas, A. (2018). Mindfulness in mobile and ubiquitous learning: harnessing the power of attention. In Y. Shengquan, A. Mohamed & T. Avgoustos (Eds.), Mobile and ubiquitous learning: an international handbook (pp. 19–44). Springer. https://doi.org/10.1007/978-981-10-6144-8
  • Palmquist, A., Gunnars, F., Morten, N., Gkini, C., Breien, F., & Jedel, I. (2021). Gamified learning analytics: An initial outline of design concept synergies from two fields. Proceedings of the Nordic Learning Analytics (Summer) Institute (NLASI 2021). http://ceur-ws.org/Vol-2985/
  • (2021). Classrooms in 2051. In Papa, R., & Jackson, K. M. (Eds.), Artificial intelligence, human agency and the educational leader (pp. 103–132). Springer Nature.
  • Pavlidou, K., & Alevriadou, A. (2022). An assessment of general and special education teachers’ and students’ interpersonal competences and its relationship to burnout. International Journal of Disability, Development and Education, 69(3), 1080–1094. https://doi.org/10.1080/1034912X.2020.1755425
  • Pierce, D. W., & Cheney, C. D. (2017). Behavior analysis and learning: A biobehavioral approach (6th ed.). Routledge.
  • Potměšil, M., & Qiong, B. (2022). Special education in tibet: Perspectives on the education of children with special educational needs. Routledge.
  • Prinsloo, P., & Slade, S. (2017). Ethics and learning analytics: Charting the (un) charted. In C. Lang, G. Siemens, A. F. Wise & D. Gašević (Eds.), Handbook of learning analytics (pp. 49–67). Society for Learning Analytics Research (SoLAR). https://doi.org/10.18608/hla17
  • Samuelsen, J., Chen, W., & Wasson, B. (2019). Integrating multiple data sources for learning analytics – Review of literature. Research and Practice in Technology Enhanced Learning, 14(11). https://doi.org/10.1186/s41039-019-0105-4
  • Skinner, B. F. (1950). Are theories of learning necessary? Psychological Review, 57(4), 193. https://doi.org/10.1037/h0054367
  • Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. The American Behavioral Scientist, 57(10), 1510–1529. https://doi.org/10.1177/0002764213479366
  • The Swedish Research Council. (2017). Good research ethics. https://www.vr.se/english/analysis/reports/our-reports/2017-08-31-good-research-practice.html
  • Tsui, J. Y., & Yuen, M. (2020). Career guidance for gifted students in hong kong. In M. Yuen, W. Beamish & V. S. H. Solberg (Eds.), Careers for students with special educational needs (pp. 177–187). Springer.
  • Tutton, T. (2019). Behavioural support within an australian non-government organisation. In F. Bryer & W. Beamish (Eds.), Behavioural support for students with special educational needs: trends across the asia-pacific region (pp. 101–114). Springer.
  • van Leeuwen, A., Rummel, N., & van Gog, T. (2019). What information should CSCL teacher dashboards provide to help teachers interpret CSCL situations? International Journal of Computer-Supported Collaborative Learning, 14(3), 261–289. https://doi.org/10.1007/s11412-019-09299-x
  • Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110. https://doi.org/10.1016/j.chb.2018.07.027
  • Vučinić, V., Stanimirovic, D., Gligorović, M., Jablan, B., & Marinović, M. (2022). Stress and empathy in teachers at general and special education schools. International Journal of Disability, Development and Education, 69(2), 533–549. https://doi.org/10.1080/1034912X.2020.1727421