1,518
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Effect of video styles on learner engagement in MOOCs

ORCID Icon
Pages 1-21 | Received 08 Jun 2021, Accepted 03 Apr 2023, Published online: 13 Sep 2023

ABSTRACT

Video lectures in massive open online courses (MOOCs) provide an opportunity to not only deliver instructional content but also engage learners. While there are many different styles of video lectures, it is not clear how video styles affect learner engagement. This study analysed and critiqued different typologies of video styles and classified MOOC video styles on a speaker-centric to media-centric spectrum. A total of 1372 survey responses were used for data analysis. The findings indicated that the ‘media-centric’ and ‘balanced’ video styles enhanced learner engagement to varying degrees in MOOCs of different study areas. In contrast, the ‘speaker-centric’ video style offered no advantages for promoting engagement in any MOOC study area. Effect sizes ranged from .03 to .07, indicating that video styles had a small to medium effect on engagement. These findings can provide new insights into the design of video lectures for different study areas in MOOCs.

Introduction

By the end of 2021, the number of universities that offer massive open online courses (MOOCs) had exceeded 950, the number of MOOC learners had exceeded 220 million, and the number of MOOCs had exceeded 19,000 (Shah, Citation2022). Early MOOC research tended to emphasise outcome measures valued in traditional higher education settings, particularly academic achievement (Alario-Hoyos et al., Citation2016; Kennedy et al., Citation2015) and retention (Greene et al., Citation2015; Pursel et al., Citation2016). The last three years have witnessed a shift from enhancing learning performance and retention to providing a more engaging learning environment for MOOC participants (Alemayehu & Chen, Citation2021; Romero-Rodríguez et al., Citation2019). The underlying rationale for this shift is that MOOCs are distinct from credit-bearing online courses. MOOC learners display a variety of intrinsic, extrinsic, and social motivations (Deng et al., Citation2019). Topical interest is often the primary reason driving people to register for a MOOC (Ruipérez-Valiente et al., Citation2022). MOOC learners are more concerned with fulfilling personal agendas rather than performing well academically (Jung et al., Citation2019). Only a small percentage of learners intend to complete an entire MOOC and earn a certificate of completion (Semenova, Citation2022). More recent research has explored personal (e.g. Kuo et al., Citation2021; Sun et al., Citation2020) and environmental factors (e.g. Cobos & Ruiz-Garcia, Citation2021; Gallego-Romero et al., Citation2020) contributing to higher levels of learner engagement with MOOCs.

Video lectures are an integral part of MOOCs. MOOC videos play a critical role in assisting learners with understanding difficult concepts, making courses interesting, and responding to learners’ questions and queries (Deng & Benckendorff, Citation2021). They are perceived as a powerful instructional strategy by MOOC participants (Deng & Gao, Citation2023c), regardless of whether learners report high or low learning gains (Watson et al., Citation2016). Phenomenological research has revealed that MOOC participants highly value the intimate, unique, and personal sphere involved in watching videos (Walji et al., Citation2016). Video lectures generate more mouse-click events than any other learning opportunity on MOOC platforms (Hu et al., Citation2020). The number of videos watched by MOOC participants is strongly correlated with academic performance (Stöhr et al., Citation2019) and assignment completion (Lemay & Doleck, Citation2022). In addition, video lectures are viewed as a potentially useful instructional strategy for improving social engagement (Chen et al., Citation2019). To understand learners’ video-watching behaviour, research on MOOC video lectures has often focused on analysing clickstream interactions, such as pause and backward seeking (Lallé & Conati, Citation2020).

The effects of video styles on learner engagement have been investigated in higher education settings. These studies divided instructional videos into two or more styles, such as videos with and without graphics (Carmichael et al., Citation2018), hand-drawn videos and narration over PowerPoint videos (Chen & Thomas, Citation2020), and infographic videos and lecture capture (Lackmann et al., Citation2021). They then explored the effects of video styles on the engagement level of university students. While the value of these studies for designing video-based learning resources is acknowledged, this study highlights the difference between MOOC video lectures and instructional videos designed for university students. MOOC learners are more sensitive to video length than university students and are more resistant to watching videos as they increase in length (Dart, Citation2020). For university students, the quality of explanation and the enthusiasm for delivery are more salient factors in driving engagement (Dart & Gregg, Citation2021). Research has also shown that individuals in fully online courses use videos more adaptively and strategically than learners in blended courses (Seo et al., Citation2021). MOOCs are conventionally organised around videos (Lemay & Doleck, Citation2022), whereas blended and face-to-face learning environments often use videos as supplementary resources (Noetel et al., Citation2021). This contextual difference highlights the importance of investigating the effects of video styles on learner engagement in the MOOC setting.

Despite the importance of MOOC video lectures, few studies have investigated the effects of video styles on learner engagement with MOOCs. Past research exploring this relationship has tended to use clickstream data as a proxy for MOOC engagement. Guo et al. (Citation2014, p. 49) cautioned that researchers ‘cannot measure a student’s true engagement … just from analysing server logs’ and advocated for broader and more flexible interpretations of engagement. Not all MOOC learners manifest their engagement in the same way (Daniels et al., Citation2016; Deng et al., Citation2020). An individual who has watched all videos in a MOOC might not have actively processed the video content (Li & Baker, Citation2018). Meanwhile, a person who watched a few video lectures might be inspired by the content and begin to actively engage in meaningful, content-related course discussion. In light of the above, this study extended the scope of the existing research by conceptualising and operationalising learner engagement in MOOCs as a multidimensional construct incorporating four discrete but related domains and using direct questioning to measure learner engagement in MOOCs.

This research is one of the first scholarly attempts to investigate the effects of video styles on course-level engagement in MOOCs. The next section reviews the literature on different video style typologies to select the most appropriate typology for use; this is followed by a brief review of different approaches to conceptualising learner engagement and hypothesis development. Next, the data collection and analysis procedures are presented. After that, the findings are discussed in the context of the literature on MOOCs and higher education. Based on a discussion of the key findings, the article then outlines a number of avenues for future research. The article concludes with the research limitations, theoretical contributions, and practical implications. Note that the term ‘video lectures’, which is used consistently throughout the article, conveys the same meaning as terms such as ‘educational videos’, ‘instructional videos’, ‘lecture videos’, ‘MOOC videos,’ and ‘MOOC lectures’, which are found in other research papers pertinent to multimedia learning.

Literature review

Typologies of video styles

Over the last two decades, researchers have attempted to classify video styles into distinct categories (). The number of categories usually ranges from 2 to 18, and the labels given to categories in each taxonomy differ greatly. These differences can be attributed to the different classification rationales (e.g. learning outcomes, educational purposes) and the distinct research contexts in which a typology is developed (e.g. streaming, podcasting), as shown in . The purpose of analysing and critiquing these typologies is not to identify the best classification scheme but to select the most appropriate typology for use in this study. A review of recent literature reveals two main approaches to classifying video styles. One is classifying video styles in different or overlapping categories (e.g. Hansch et al., Citation2015); the other is defining video styles on one or more spectrums (e.g. Chorianopoulos, Citation2018).

Table 1. Selected typologies of video styles.

Early typologies tended to divide video styles into different or overlapping categories. These typologies provide useful heuristics for distinguishing mainstream video styles. A closer inspection of these classification schemes, however, shows that many categories in fact carry the same meaning. For instance, ‘presentation’ (Majid et al., Citation2012), ‘enhanced video podcast’ (Kay, Citation2012), ‘slides’ (Guo et al., Citation2014), and ‘presentation slides with voice-over’ (Hansch et al., Citation2015) all refer to the same style, featuring slide shows coupled with audio explanations. Similarly, ‘lecture-based video podcast’ (Kay, Citation2012), ‘lecture’ (Majid et al., Citation2012), ‘classroom’ (Guo et al., Citation2014), and ‘classroom lecture’ (Hansch et al., Citation2015) are used to describe educational videos captured in live classroom settings. The use of different labels to describe similar video styles may cause confusion and is not conducive to investigating the effectiveness of video styles.

Apart from the proliferation of terms, there are also other potential issues associated with existing classification schemes. Categories within some typologies have a narrow scope. For example, ‘Khan-style tablet capture’ and ‘Udacity-style tablet capture’ in the typology of Hansch et al. (Citation2015) are both concerned with instructors drawing content (e.g. mathematical formulas, short texts) on a virtual whiteboard. Classification schemes with a narrow scope run the risk of increasing repetition and may have poor predictive attributes for defining new video styles that do not yet exist. Additionally, categories in some typologies are neither exhaustive nor mutually exclusive. The criteria for creating these typologies appear to be ad hoc and are not thoroughly explained. For instance, Majid et al. (Citation2012) and Guo et al. (Citation2014) did not explain how they classified video styles and ignored common styles such as animation.

More recent typologies arrange video styles on spectrums as opposed to classifying them into distinct categories. Santos Espino et al. (Citation2016) placed MOOC video styles on a speaker-centric to board-centric spectrum. Santos Espino et al. (Citation2016) defined board-centric as videos characterised by a rectangle-shaped surface where instructional content is presented. In board-centric videos, the board fills the full frame or a large frame area, and the visual information (e.g. texts, graphics) is primary. Meanwhile, Santos Espino et al. (Citation2016) defined speaker-centric as videos featuring one or more visible human speakers as the main vehicle for delivering instructional content. In speaker-centric videos, the speakers are visible most of the time and tend to provide oral information. According to Santos Espino et al. (Citation2016), board-centric styles include virtual whiteboards, screencasts, and slides, while examples of speaker-centric styles include talking head videos, interviews, and live lecture recordings. The speaker-centric to board-centric spectrum simplifies category-based classification schemes and has the potential to accommodate novel video styles.

Building on Santos Espino et al. (Citation2016), Chorianopoulos (Citation2018) also placed educational video styles on spectrums. Noting that Santos Espino et al. (Citation2016) presented video styles as opposing conditions in only one dimension, Chorianopoulos (Citation2018) argued that speakers and boards do not compete for the learner’s attention. Based on this assumption, Chorianopoulos (Citation2018) theorised that the styles of educational videos are determined by two complementary dimensions – human embodiment and instructional media – and there are multiple values that range from the digital to the physical spectrum for each of the two dimensions. For example, one can find the video style characterised by presentation slides with a talking head at the mid-range of the instructional media spectrum and at the physical end of the human embodiment spectrum (). The strength of Chorianopoulos’s (Citation2018) work is that the taxonomy defines a two-dimensional space of existing and potential new video styles. The classification scheme considers not only the presence of humans and instructional media but also the level of human presence and the type of instructional media.

Figure 1. Chorianopoulos’s (Citation2018) taxonomy of instructional video styles.

Figure 1. Chorianopoulos’s (Citation2018) taxonomy of instructional video styles.

The classification schemes of Santos Espino et al. (Citation2016) and Chorianopoulos (Citation2018) are both potentially useful for comparing the styles of educational videos. Santos Espino et al. (Citation2016) built their taxonomy based on an empirical examination of frequently used video styles in MOOCs. Chorianopoulos’s taxonomy (Chorianopoulos, Citation2018) is future-proof and is more useful for identifying new video styles that do not yet exist. A key characteristic of a typology is that its dimensions can be based on the notion of an ideal type and are not necessarily something found in empirical reality (Smith, Citation2002). Until now, very few MOOCs have adopted virtual agents (e.g. animated characters, robots) for video instruction. Chorianopoulos (Citation2018) also noted that almost no videos found in major educational video repositories employed artificial agents to manipulate instructional media. The present study aimed to compare video styles frequently adopted in MOOCs. For the above reasons, the taxonomy of Santos Espino et al. (Citation2016) was selected for this study. This study renames ‘board-centric’ as ‘media-centric’ to de-emphasise the rectangular shape and highlight the nature of the instructional content displayed on the board. A ‘balanced’ midpoint was added to represent video styles with a combination of degrees of speaker- and media-centricity. A speaker-centric to media-centric spectrum is used throughout the study ().

Figure 2. The speaker-centric to media-centric spectrum.

Figure 2. The speaker-centric to media-centric spectrum.

Video styles and learner engagement

This study conceptualised learner engagement as a multidimensional construct, comprising behavioural, cognitive, emotional, and social engagement. Guo et al. (Citation2014, p. 43) argued that ‘true engagement is impossible to measure without direct observation and questioning’ and adopted two proxies for engagement: engagement time and assignment submission. This type of engagement is often referred to as behavioural engagement, which is conceptualised as learners’ observable actions and their participation and involvement in educational activities (Appleton et al., Citation2006). Behavioural engagement in MOOCs is typically measured through video use, user progression, and completion of assessment tasks (Deng et al., Citation2019) and has been found to be predictive of desirable learning outcomes such as completion (Jung & Lee, Citation2018). Studies of learner engagement in MOOCs have tended to focus on behavioural engagement because behaviour is overt and relatively easy to identify and track (Deng et al., Citation2019).

Video lectures are potentially useful for enhancing behavioural engagement in MOOCs. Although Costley and Lange (Citation2017) noted that the style of instructional videos was not correlated with the number of videos viewed by university students, Guo et al. (Citation2014) found that MOOC videos that alternated between a speaker’s talking head and slides prompted learners to spend more time on watching video lectures than MOOC videos only presenting PowerPoint slides and code screencasts. Unlike university courses that have face-to-face teaching/contact time and utilise videos as supplementary materials (Manuel et al., Citation2021), MOOCs do not usually organise face-to-face sessions and are mostly built around a series of instructional videos (Deng et al., Citation2019; Lemay & Doleck, Citation2022). In the MOOC context, it is reasonable to speculate that the ‘balanced’ video style featuring both the speaker and media may be more effective in promoting behavioural engagement than the ‘media-centric’ and ‘speaker-centric’ video styles, for it provides some social and emotional clues to help learners make sense of instructional content presented in an almost entirely virtual learning environment (Walji et al., Citation2016). The current study hypothesises the following: The level of behavioural engagement is higher in MOOCs adopting the ‘balanced’ video style than the MOOCs adopting the ‘media-centric’ and ‘speaker-centric’ video styles (H1).

Social engagement, representing learner–instructor and learner–learner interactions in MOOCs (Tawfik et al., Citation2017), is sometimes confounded with behavioural engagement. This is because interacting with instructors and other learners is observable and part of the ‘way of behaving’ in educational activities (Maroco et al., Citation2016). Recent research has shown that social engagement (e.g. learner–learner interaction) is a separate construct from behavioural engagement (e.g. learner– content interaction) in MOOCs (Deng et al., Citation2020). Social engagement is associated with desirable MOOC outcomes such as academic performance and course completion (Deng et al., Citation2019). However, it remains unclear from the extant literature whether certain video styles lead to improved social engagement. This study aimed to fill this knowledge gap and investigate the effects of video styles on social engagement.

Video lectures could be a potentially useful instructional strategy for improving social engagement in MOOCs. MOOC participants often post comments and questions directly related to a specific section of a video lecture (Chen et al., Citation2019). Individuals tend to experience a higher quality of social interaction in online learning environments when different types of media are employed and when the various forms of media complement each other (Kim et al., Citation2011). It is therefore reasonable to suspect that the ‘media-centric’ video style may be more effective in sustaining social engagement in MOOCs than the ‘balanced’ and ‘speaker-centric’ video styles. Because of limited usage of media formats, the ‘speaker-centric’ video style may not play a facilitative role in improving social engagement. This study thus formulates the following hypothesis: The level of social engagement is higher in MOOCs adopting the ‘media-centric’ video style than the MOOCs adopting the ‘balanced’ and ‘speaker-centric’ video styles (H2).

Some researchers have drawn scholarly attention to engagement domains that are less observable and more internal. Li and Baker (Citation2018), for example, revealed that a large proportion of MOOC participants who watched video lectures were not actively processing the instructional content in the videos. In other words, being behaviourally engaged in MOOCs does not necessarily mean being cognitively engaged. Cognitive engagement refers to individuals’ willingness to exert mental effort to comprehend complex ideas, master difficult skills, and strengthen learning and performance (Appleton et al., Citation2006). Cognitive engagement in MOOCs is linked to positive outcomes, such as academic performance (Li & Baker, Citation2018) and perceived learning (Lan & Hew, Citation2020). The present study conceptualised cognitive engagement as an essential domain and explored the effects of video styles on cognitive engagement.

The ‘balanced’ video style may be effective in promoting MOOC learners’ cognitive engagement. Eye-tracking research indicated that the presence of the speaker resulted in a higher percentage of fixation on the speaker and improved learners’ academic performance, suggesting that the processing of the speaker’s image may have provided social cues to facilitate the processing of cognitively relevant information (Wang et al., Citation2020). The speaker’s guided gaze, for example, contributed to a longer dwell time on the content area and enhanced learning performance (Pi et al., Citation2020). This is likely because the speaker successfully drew learners’ attention to important information in the learning materials (Deng & Gao, Citation2023b). However, the level of effectiveness may be dependent on the fields of study. A study indicated that presenting the speaker in video lectures increased individuals’ cognitive load when learning procedural knowledge, a type of knowledge about how to perform a task, but not when learning declarative knowledge, the knowledge of facts and rules (Hong et al., Citation2018). It is reasonable to infer that the ‘balanced’ video style may be more effective in promoting cognitive engagement than the ‘media-centric’ video style, but the degree of effectiveness can vary across study areas. The ‘speaker-centric’ video style may not facilitate cognitive engagement well, for it presents important information through verbal communication only. The following hypothesis is formulated: The level of cognitive engagement is higher in MOOCs adopting the ‘balanced’ video style than the MOOCs adopting the ‘media-centric’ and ‘speaker-centric’ video styles (H3).

Another less overt engagement domain is emotional engagement. Emotional engagement is centred on the emotional connections students make with instructors, peers, and content (Appleton et al., Citation2006). MOOCs afford the creation and distribution of various emotions. Textual emotional expressions, such as altruistic emotions and negativity (Comer et al., Citation2015), were observed in MOOC discussion boards. MOOC video lectures also induce positive (e.g. excited, interesting) and negative (e.g. confused, disappointed) emotions (Chen et al., Citation2017). Emotional engagement in MOOCs was found to positively affect perceived learning (Lan & Hew, Citation2020). Video lectures provide an important avenue for eliciting positive emotions from MOOC participants (Deng & Benckendorff, Citation2021; Deng & Gao, Citation2023c); however, it is not known whether video styles quantitatively affect MOOC participants’ emotional engagement. The current study aimed to fill this knowledge gap by investigating the effects of video styles on emotional engagement.

The ‘balanced’ video style may be effective in strengthening emotional engagement with MOOCs. A recent meta-analysis showed that video lectures incorporating the speaker’s face had a positive, significant effect on motivation to study (Alemdag, Citation2022). Eye-tracking research shows that the speaker’s happy face did not contribute to a longer dwell time on the content or the speaker area, but learners’ academic achievement still improved (Pi et al., Citation2022). This is probably because the speaker elicited beneficial social-emotional responses from learners. It is reasonable to speculate that the ‘balanced’ video style may be more effective than the ‘media-centric’ one in facilitating motivational or affective processes during the study of MOOCs. Emotional processes are inseparable from cognitive processes in multimedia learning (Deng & Gao, Citation2023b; Plass & Kaplan, Citation2016). The ‘speaker-centric’ video style may not be as effective in promoting emotional engagement. This is likely because a lack of textual or visual representations of knowledge on screen may hinder the information selection, organisation, and integration processes required for effective multimedia learning, which in turn may hamper motivational and affective processes (Endres et al., Citation2020). The following hypothesis is proposed: The level of emotional engagement is higher in MOOCs adopting the ‘balanced’ video style than the MOOCs adopting the ‘media-centric’ and ‘speaker-centric’ video styles (H4).

Research methods

Data collection

Prior to data collection, ethics clearance was obtained from the human research ethics committee of the researcher’s university. A self-administered survey was used for data collection. Respondents were asked to nominate a MOOC they had recently participated in and keep that MOOC in mind when completing the survey. A screening question was used to filter out respondents who reported that videos were not used in their nominated MOOC. To minimise the memory effect, individuals who participated in a MOOC in the previous 12 months were selected for data analysis. If a respondent had participated in a MOOC in the last 12 months, they would be directed to the instruction page to fill out the survey. The instruction asked the respondents to think about the most recent MOOC they studied and keep this MOOC in mind when answering all the questions in the survey. The researcher conducted a pilot study with 20 volunteers prior to formal data collection. Results of the pilot study showed that the instructions were clear, and the survey items were comprehensible. Two questions were tweaked based on feedback from the volunteers to make the survey easier to answer.

The convenience sampling approach was adopted for two reasons. First, this research is one of the first scholarly endeavours to empirically investigate the relationship between video styles and learner engagement in MOOCs, and it is exploratory in nature. Second, the population and population composition of MOOC users are not known, and MOOC platforms are usually unwilling to disclose the personal characteristics of their users for privacy reasons, making it difficult to employ probability sampling methods to systematically access MOOC learners.

Participants in this study were individuals who studied one or more MOOCs offered by a research-intensive university on edX and were recruited through email newsletters. This university is an edX charter member and has contributed more than 60 courses to the edX platform. The newsletter contained a brief introduction to the study and the survey URL. Participants were also recruited from social media websites to incorporate learners across a diverse range of MOOCs and MOOC platforms. Data collection lasted a total of four weeks. All the respondents signed the informed consent before responding to the survey. A total of 1372 complete cases were used for data analysis after deleting outliers, surveys with incomplete responses, and unqualified respondents.

All the 1372 respondents had participated in at least one MOOC in the previous 12 months and confirmed the MOOCs they studied used instructional videos as the medium of instruction. The participants had relatively diverse ethnic origins – over 35% of the individuals came from Asia, followed by Africa (15.0%), North America (13.8%), Europe (13.3%), Latin America and the Caribbean (12.2%), the Arab states (5.6%), and Oceania (4.8%). Of the respondents, 63.5% were male. The predominant age groups were 25–34 years old (35.0%), followed by under 25 (34.3%), 35–44 (16.0%), 45–54 (7.6%), and 55 and over (7.1%). Those with at least a bachelor’s degree comprised a large cohort (72.7%), which is consistent with Deng et al’s. (Citation2019) observation that MOOC participants tended to be qualified, experienced learners who already hold a bachelor’s or master’s degree.

Measures

Video styles were treated as the predictor variable and measured at the nominal level. The classification of video styles in this study was built based on Santos Espino et al. (Citation2016). The researcher arranged MOOC video styles on a speaker-centric to media-centric spectrum and developed a question to obtain information about the main style of video lectures used in the respondent’s nominated MOOC. The predictor variable consisted of three categorical, independent groups: ‘media-centric’, ‘speaker-centric,’ and ‘a balance between media-centric and speaker-centric’. The researcher explained the three styles in greater detail to help respondents fully understand the options in the survey. For example, ‘speaker-centric’ indicates that a human speaker is visible most of the time, with little or no multimedia content. To further help respondents identify the main style of the videos utilised in the MOOC they participated in, four illustrations were provided to accompany the text description for each video type. The illustrations were taken from MOOC video lectures in various disciplines on Coursera. The researcher acknowledges that the present study measured perceptions of video styles. The interpretation of the findings is therefore based on the premise that it is learners’ perceptions of video styles that affect engagement, and actions should be taken to design video lectures that are congruent with learners’ perceptions of video styles. The observations between groups were independent, meaning that each group was made up of different MOOC participants.

Learner engagement was treated as the outcome variable and measured at the ordinal level. Learning analytics were not used as proxies for engagement in this study for two reasons. On the one hand, learning analytics only capture individuals’ engagement with online materials (Baker et al., Citation2020). Researchers are likely to miss important insights if learners use alternative study strategies, such as downloading video lectures from the learning management system. On the other hand, learning analytics often oversimplify the learning process by equating observable behaviours with learner engagement (Guzmán-Valenzuela et al., Citation2021). Past research has shown that the extrapolation of cognitive and emotional engagement from learning analytics can be both laborious and inaccurate (Li & Baker, Citation2018).

In view of these challenges, this research employed the MOOC Engagement Scale (MES) to capture learner engagement in MOOCs. The MES was developed and validated by Deng et al. (Citation2020), and it showed desirable reliability, face validity, content validity, construct validity, convergent validity, and discriminant validity. This instrument has been recently applied and/or adapted in a number of educational studies (e.g. Deng & Gao, Citation2023a; Jiang & Peng, Citation2023), and it demonstrated good validity and reliability (e.g. Hoi & Le Hang, Citation2021; Xu et al., Citation2023).

The MES contained 12 statements. A 6-point Likert scale ranging from strongly disagree (1) to strongly agree (6) was used. Each engagement domain was surveyed using three statements. In this study, the Cronbach’s alpha values for the behavioural, cognitive, emotional, and social engagement items were .73, .71, .76, and .83, respectively, demonstrating good internal consistency. To facilitate the discussion of the key findings, the operational definition for each engagement domain is provided below.

  • Behavioural engagement: participants study a MOOC regularly, take notes while studying the MOOC, and review notes when preparing for assessments.

  • Cognitive engagement: participants’ mental investment in the study of a MOOC to comprehend complex ideas, master difficult skills, and strengthen learning and performance.

  • Emotional engagement: the degree to which participants are inspired to expand knowledge in a MOOC and enjoy studying the MOOC.

  • Social engagement: learning-related interactions between participants and instructors or other learners, on and beyond the MOOC platform.

The effects of video styles on learning and learner perceptions can vary across fields of study. This is because each study area has its preferred way of disseminating information and knowledge (Santos Espino et al., Citation2016, Citation2020). In view of these differences, the researcher controlled for the study area when investigating the relationship between video styles and learner engagement. The researcher divided study areas into five categories: ‘arts and humanities’, ‘computers, engineering, and mathematics’, ‘natural sciences’, ‘social sciences,’ and ‘personal development’. The categorisation process was based on course catalogues on Coursera and FutureLearn. To help respondents choose the most relevant study area, the researcher provided examples for each option. For instance, respondents were informed that the ‘arts and humanities’ study area incorporates subjects such as design, history, languages, literature, music, theology, religion, and philosophy. An open-ended question was designed so that respondents who had difficulty identifying the study area could manually input the data. The researcher then reclassified the manually entered data. No new category emerged during the reclassification process.

The researcher used four questions to collect demographic information from the respondents. Previous research has revealed that age, education background, gender, and origin were the most frequently reported demographic variables in the MOOC literature (Deng et al., Citation2019). These factors were compared with recent MOOC publications to ensure that the current study represents a relatively diverse sample.

Data analysis

Descriptive statistics on demographics were calculated using IBM SPSS 26. Principal component analysis (PCA) was implemented to single out items that could be conceived as indicators of behavioural, cognitive, emotional, and social engagement. To comply with the principle of parsimony and reduce measurement error, the researcher created four aggregated rating scales by calculating the sum of the variables comprising each engagement domain of the MES. The original 12 engagement items were substituted by the four aggregated rating scales, ranging from 0 to 18. Aggregated rating scales not only overcome the measurement error inherent in the measured variables to a certain extent, but also represented the multiple facets of a concept in a single measure. The composite scores derived from PCA were retained for further use in the Kruskal– Wallis tests and post-hoc analysis.

Next, Kolmogorov–Smirnov and Shapiro–Wilk tests were performed to check if values on the aggregated scales fit a normal distribution. Results showed that values on the aggregated scales were non-normal. Therefore, non-parametric tests were applied. A series of Kruskal–Wallis tests were undertaken to determine the relationship between video styles and learner engagement in MOOCs. Mann–Whitney U tests were employed for post-hoc pairwise comparisons when the results of the Kruskal–Wallis test showed a significant difference at the .05 level. To reduce the probability of type I errors, the results of the Mann–Whitney U tests were Bonferroni corrected. An inspection of histograms indicated that the sample distributions were similar in shape, but the shape was asymmetric. In view of this, the median is reported in the results section, and significant p-values were interpreted as rejecting the assumption of medians.

Results

shows the demographic information of the MOOC participants (i.e. age, education background, gender, and origin). This research compared the sample composition with that of other MOOC studies to ensure certain subgroups of MOOC learners were not underrepresented or overrepresented. The participants in this study represented a relatively diverse sample and had demographic information comparable to that reported in other recent MOOC studies (e.g. Jung et al., Citation2019; Li, Citation2019).

Table 2. Demographics of MOOC participants.

A total of 1372 cases were used for PCA. The number of observations per variable in this research met the desired ratio of 5:1 recommended by Hair et al. (Citation2014). To determine the items making of each engagement domain, the researcher conducted PCA with varimax orthogonal rotation. Varimax orthogonal rotation was selected because the goal was to reduce data to a small number of variables for subsequent use in Kruskal–Wallis tests. This rotation method loaded a relatively smaller number of variables onto each factor, resulting in more interpretable clusters of factors. The best solution was a four-factor model accounting for 68.52% of the common variance (). The model contains a representative and parsimonious set of factors. The communalities and factor loadings were all > .40, which are considered to meet the requirement for interpretation of the structure (Hair et al., Citation2014). No factors were eliminated in the analysis process owing to low factor loadings or unacceptable communality values. The Kaiser–Meyer–Olkin measure of sampling adequacy index of .84 and a significant chi-square value for Bartlett’s test of sphericity, χ2 (66) = 5712.55, p < .001, suggested that the factor model was appropriate for the data. The factorial dimensions in this study were consistent with Deng et al’s. (Citation2020) instrumentation of learner engagement in MOOCs. The Cronbach’s alpha values ranged from .71 to .83, exceeding a threshold of .70 (Hair et al., Citation2014). The result demonstrated a high degree of reliability of the scales. The composite scores were calculated based on the results of PCA and were treated as outcome variables in the Kruskal–Wallis tests.

Table 3. Summary of PCA results.

The researcher performed Kruskal–Wallis tests to investigate whether video styles affected learner engagement in arts and humanities MOOCs. This procedure was followed by applying post-hoc Mann–Whitney tests to compare differences in the level of engagement between two independent groups. shows that the relationship between video styles and social engagement was statistically significant, H(2) = 6.50, p = .039. Post-hoc Mann–Whitney tests using a Bonferroni-corrected alpha level of .017 were adopted to compare all pairs of groups. The difference in social engagement between the ‘media-centric’ (Mdn = 10.5) and ‘balanced’ groups (Mdn = 8.0) was statistically significant, U = 2247.50, Z = −2.60, p = .009. None of the other comparisons were significant after Bonferroni adjustment.

Table 4. Relationships between video styles and levels of engagement in arts and humanities MOOCs (n = 214).

Next, Kruskal–Wallis tests were conducted to investigate whether video styles affected learner engagement in computers, engineering, and mathematics MOOCs. indicates that video styles had a significant influence on cognitive, emotional, and social engagement. A Bonferroni-corrected alpha level of .017 was adopted to compare all pairs of groups when performing Mann– Whitney tests. For cognitive engagement, H(2) = 13.15, p = .001, the difference between the ‘balanced’ (Mdn = 16.0) and ‘speaker-centric’ groups (Mdn = 15.0) was statistically significant, U = 8375.50, Z = −3.58, p = .0003. For emotional engagement, H(2) = 9.59, p = .008, the difference between the ‘balanced’ (Mdn = 16.0) and ‘speaker-centric’ groups (Mdn = 15.0) was statistically significant, U = 8845.50, Z = −3.00, p = .003. For social engagement, H(2) = 10.54, p = .005, there was a significant difference between the ‘media-centric’ (Mdn = 12.0) and ‘balanced’ groups (Mdn = 9.0), U = 12347.00, Z = −3.20, p = .001. None of the other comparisons were significant after the Mann– Whitney tests were Bonferroni corrected.

Table 5. Relationships between video styles and levels of engagement in computers, engineering, and mathematics MOOCs (n = 461).

The researcher then performed Kruskal–Wallis tests to investigate whether video styles affected learner engagement in natural sciences MOOCs. reveals that video styles significantly affected social engagement in natural sciences MOOCs, H(2) = 6.62, p = .036. A Bonferroni-adjusted alpha level of .017 was applied when conducting Mann–Whitney tests. The difference in social engagement between the ‘media-centric’ (Mdn = 11.5) and ‘speaker-centric’ groups (Mdn = 9.5) was statistically significant, U = 704.00, Z = −2.49, p = .013. None of the other comparisons were significant after Bonferroni correction.

Table 6. Relationships between video styles and levels of engagement in natural sciences MOOCs (n = 155).

Kruskal–Wallis tests were also performed to investigate whether video styles affected levels of engagement in social sciences MOOCs () and personal development MOOCs (). Results showed that statistically significant differences were absent for the four engagement domains, indicating that video styles were independent of learner engagement in social sciences and personal development MOOCs.

Table 7. Relationships between video styles and levels of engagement in social sciences MOOCs (n = 332).

Table 8. Relationships between video styles and levels of engagement in personal development MOOCs (n = 210).

The Kruskal–Wallis tests revealed statistically significant differences in engagement levels for the three groups of MOOC participants who reported the use of different video styles (‘media-centric’, ‘speaker-centric’, ‘balanced’) (). The differences were observed in all study areas, except social science and personal development MOOCs. From the Bonferroni-corrected Mann–Whitney post-hoc tests, this study found that video styles were related to cognitive, emotional, and social engagement but not behavioural engagement. Specifically, the ‘balanced’ group exhibited higher cognitive and emotional engagement than the ‘speaker-centric’ group in computers, engineering, and mathematics MOOCs. The ‘media-centric’ group showed higher social engagement than the ‘balanced’ group in arts and humanities MOOCs and computers, engineering, and mathematics MOOCs. The ‘media-centric’ group also exhibited higher social engagement than the ‘speaker-centric’ group in natural sciences MOOCs. Eta-squared (η2) indicates the percentage of variance in the ranks explained by the predictor variable, namely video styles. The η2 ranged from .03 to .07, indicating a small to medium effect size (Cohen, Citation1988). The summary of the hypotheses testing results is shown in . The results indicate that H1 is not supported, and H2, H3 and H4 are partially supported.

Table 9. Summary of significant relationships between video styles and learner engagement across study areas.

Table 10. Summary of hypotheses testing results.

Discussion

Prior to this study, few attempts had been made to explore how video styles affect learner engagement in MOOCs. Most notably, Guo et al. (Citation2014) found that MOOC videos characterised by a balance between slides and the talking head of the instructor contributed to higher levels of behavioural engagement. The results of this study did not support Hypothesis 1, which predicted that the ‘balanced’ video style would be more effective in promoting behavioural engagement in MOOCs. The present study found that video styles had no significant effects on behavioural engagement – a finding that appears to contradict Guo et al’s. (Citation2014) research. A closer examination of the two studies, however, reveals that the inconsistency in the findings could stem from the different approaches to defining engagement. Guo et al. (Citation2014) measured behavioural engagement through two proxies: engagement time and assignment submission. The present study used three indicators to represent behavioural engagement: studying a MOOC regularly, taking notes when studying MOOCs, and reviewing notes when preparing MOOC assessments.

The different relationships between video styles and behavioural engagement highlight the importance of clearly defining the scope of engagement upfront in academic research. The most commonly adopted indicators of behavioural engagement in MOOCs are the number of video lectures watched and assignments submitted by learners (Li & Baker, Citation2018). However, recent research has shown that simply counting learning activities is not an accurate indication of behavioural engagement since it does not reflect the quality of learning (Deng et al., Citation2020; Lee, Citation2018). For this reason, the current study de-emphasises the number of videos watched and the number of assignments attempted when evaluating behavioural engagement. Many scholars have noted the need for greater engagement in MOOCs but have failed to provide a conceptual or operational definition of engagement (e.g. Sanz-Martínez et al., Citation2019). A clear definition of engagement will add conceptual clarity and facilitate the discussion of this topic across evidence-based studies. MOOC researchers have tended to emphasise the behavioural aspect of learner engagement (Wei et al., Citation2021). The present study maintains that MOOC participants manifest their engagement in different ways, and it extends the scope of engagement to incorporate behavioural, cognitive, emotional, and social domains.

This research provided evidence that the ‘media-centric’ video style was associated with higher levels of social engagement compared to ‘balanced’ and ‘speaker-centric’ video styles, but this association varied across study areas. The level of social engagement was higher in arts and humanities MOOCs, computers, science, and mathematics MOOCs, and natural sciences MOOCs. These results partially support Hypothesis 2. Social engagement can alleviate feelings of being isolated in the MOOC learning space and help reduce the dropout ratio (Wang et al., Citation2019). In arts and humanities MOOCs, for example, it is possible that the ‘media-centric’ video style characterising images, cultural artefacts, and historical materials provided pedagogically relevant information that induced and facilitated social engagement. If the aim is to promote social engagement, practitioners are advised to consider the ‘media-centric’ style as a priority in the production of MOOC video lectures. Recently, Hughes et al. (Citation2019) and Lange and Costley (Citation2020) found that exposing students to multiple types of media during video instruction was conducive to learning. A promising line of research would be to investigate how to combine a range of media types in MOOC video lectures to bolster social engagement. Some MOOC participants are not motivated to interact with other people and intend to learn from videos only (Daniels et al., Citation2016). Future research could explore whether video lectures designed for enhancing social engagement show effectiveness in this learner cohort.

This study also revealed that the ‘balanced’ video style was linked to higher levels of cognitive and emotional engagement compared to the ‘speaker-centric’ video style. However, this relationship only held true for the study area of computers, engineering, and mathematics. These results partially confirm Hypotheses 3 and 4. Cognitive engagement and emotional engagement are relatively under-researched topics in the MOOC literature (Deng et al., Citation2019). Recent research has shown that cognitive and emotional engagement had a positive influence on perceived learning (Lan & Hew, Citation2020). Cognitive engagement was also found to predict academic performance, particularly for individuals who followed the learning pathway intended by the MOOC instructor (Li & Baker, Citation2018). If practitioners aim to enhance cognitive and emotional engagement in computers, engineering, and mathematics MOOCs, the ‘balanced’ video style could be more efficacious and is preferred over the ‘speaker-centric’ video style. The different relationships between video styles and engagement across academic fields also explain why video styles have affected learning and learner perceptions in certain studies (e.g. Wang et al., Citation2020) but not in others (e.g. van Wermeskerken et al., Citation2018). In view of this, future research should consider disciplinary differences when exploring the effects of video styles on learning processes and outcomes.

This study found that the ‘speaker-centric’ video style had no advantages over ‘balanced’ or ‘media-centric’ video styles for enhancing learner engagement in any MOOC study area. A possible explanation is that ‘speaker-centric’ videos provide instructional content through verbal communication only, whereas ‘balanced’ and ‘media-centric’ videos provide content through both verbal and visual channels. The cognitive theory of multimedia learning proposes that students are able to build two mental representations (i.e. verbal and visual) and make connections between the two, and it is better to present an explanation using two modes of representation rather than one (Mayer & Moreno, Citation2002). In the higher education literature, several studies have compared the instructor-present condition with the instructor-absent condition. These studies tend to agree that (a) instructor-present videos attract a considerable amount of visual attention, and (b) university students prefer and are more satisfied with instructor-present videos (Wang et al., Citation2020; Wilson et al., Citation2018). The present study shows that instructor-present videos can be further split into ‘speaker-centric’ and ‘balanced’ video styles, and the ‘speaker-centric’ video style should be used with discretion when prompting engagement is an important consideration. Despite this, it is possible that the relationship between video styles and engagement is moderated by learner characteristics. Recent research has shown that personal characteristics could be important boundary conditions to determine how video design principles work with different types of learners (Deng & Gao, Citation2023b). Individuals with different cultural backgrounds, for example, may exhibit different styles for processing visual stimuli (Haensel et al., Citation2022). In future work, investigations of differences in personal characteristics, such as country of origin, would provide additional insight into the effect of video styles on learner engagement.

Limitations and future direction

This study has some potential limitations along with associated considerations for future research. Firstly, as a preliminary study, this research employed a non-probability sampling approach. Although the participants in this research represented a relatively diverse sample and were comparable to the sample compositions reported in recent MOOC studies, the relationship between video styles and learner engagement is effectively exploratory and may not be generalisable to the entire MOOC population. Future research could aim to collaborate with MOOC platforms so that the population data could be obtained. This would allow for the use of stratified random sampling or random cluster sampling and improve the generalisability of the findings. To provide insight into the generalisability of the findings, future research should also consider potential interactions among video styles, learner engagement, and personal characteristics such as cross-cultural differences in processing audio-visual information.

Secondly, this study asked learners to report the main style of video lecture in their nominated MOOC. Although the researcher provided a detailed description and multiple illustrations to explain each option, there could have been slight variations in respondents’ perceptions of each type of video style. Future research could overcome this potential limitation by employing additional mechanisms to further validate respondents’ identification of the video style used in the MOOCs they participated in. Alternatively, future research could manipulate video styles as a predictor variable in a controlled laboratory study.

Finally, this study divided MOOC study areas into five categories. It should be acknowledged that there are other useful approaches to classifying fields of study. The researcher recommends considering nuanced disciplinary differences when investigating this topic in future research.

Conclusions

This study explored the effects of video styles on learner engagement in MOOCs. The objective was achieved by classifying MOOC video styles on a speaker-centric to media-centric spectrum, conceptualising and operationalising learner engagement as a multidimensional construct comprising four discrete domains, and empirically investigating the effects of video styles on learner engagement after controlling for the MOOC study area. The findings revealed that video styles affected MOOC participants’ cognitive, emotional, and social engagement but not behavioural engagement. Specifically, the ‘media-centric’ video style was linked to higher levels of social engagement in all study areas, except social sciences and personal development. The ‘balanced’ video style was associated with higher levels of cognitive and emotional engagement, but this relationship only held true for computers, engineering, and mathematics MOOCs. The ‘speaker-centric’ video style offered no advantages over the ‘balanced’ or ‘media-centric’ video styles. The effect sizes ranged from .03 to .07, indicating that video styles had a small to medium effect on learner engagement.

This study makes several theoretical contributions to the literature. First, this study critiqued the existing typologies of video styles and classified MOOC video styles on a speaker-centric to media-centric spectrum. Not only does this spectrum have conceptual, heuristic value, but it was also empirically employed to investigate the effects of video styles on learner engagement in MOOCs. Second, this study defined and operationalised learner engagement as a multidimensional construct comprising four discrete but related domains. Prior research tended to simplify learner engagement in MOOCs as overt, observable behaviours and ignore engagement domains that are more internal and less observable (e.g. Perna et al., Citation2014), or adopt a unified approach and measure engagement as the sum of several engagement domains (e.g. Chen & Thomas, Citation2020; Jung & Lee, Citation2018). This study confirmed the four-factor structure of learner engagement in MOOCs and provided a more nuanced understanding of the role of each engagement domain. Last, the present study investigated the effects of video styles on learner engagement with MOOCs and controlled for the MOOC study area when exploring such a relationship. The study differentiates MOOCs and credit-bearing university courses and shifts the focus from traditional outcome measures such as achievement and retention to learner engagement. The study results showed that the relationship between video styles and engagement was different across academic fields, highlighting the importance of considering disciplinary differences when evaluating the design of educational multimedia resources (Deng & Gao, Citation2023b).

Selecting the right video style is conducive to providing a more engaging learning environment for MOOC learners. The results of this study have implications for practitioners such as instructional designers and video producers. First, this study showed that the ‘media-centric’ video style, characterised by instructional content (e.g. text, pictures, animation) with little or no visible speaker, was linked to higher levels of social engagement. Practitioners are advised to prioritise the ‘media-centric’ style in the production of video lectures for (a) arts and humanities MOOCs; (b) computers, science, and mathematics MOOCs; and (c) natural sciences MOOCs. Second, this study revealed that the video style featuring a balance between instructional content and human speakers was associated with higher levels of cognitive and emotional engagement; however, this relationship only held true for the study area of computers, science, and mathematics. That is, the ‘balanced’ video style is preferred if the aim is to enhance cognitive and emotional engagement in computers, science, and mathematics MOOCs. Third, this study found that the ‘speaker-centric’ video style offered no advantages over the ‘media-centric’ or ‘balanced’ video style for promoting learner engagement in any study area. This finding can serve to remind practitioners that the ‘speaker-centric’ video style, featuring one or more human speakers as the main vehicle to deliver instructional content, should be used with discretion.

Acknowledgments

The author would like to thank the anonymous reviewers for their constructive feedback.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by the National Natural Science Foundation of China [grant number 72204072].

Notes on contributors

Ruiqi Deng

Ruiqi Deng is Associate Professor with Jing Hengyi School of Education, Hangzhou Normal University. He received a BITHM(Hons) from the University of Queensland, a MSc in Education from the University of Oxford and a PhD from the University of Queensland. His research interests are teaching and learning in higher education, educational multimedia design and technology-enhanced learning.

References

  • Alario-Hoyos, C., Muñoz-Merino, P. J., Pérez-Sanagustín, M., Delgado Kloos, C., & Parada, G. A. H. (2016). Who are the top contributors in a MOOC? Relating participants’ performance and contributions. Journal of Computer Assisted Learning, 32(3), 232–243. https://doi.org/10.1111/jcal.12127
  • Alemayehu, L., & Chen, H.-L. (2021). Learner and instructor-related challenges for learners’ engagement in MOOCs: A review of 2014–2020 publications in selected SSCI indexed journals. Interactive Learning Environments, 31(5), 3172–3194. Advance online publication. https://doi.org/10.1080/10494820.2021.1920430
  • Alemdag, E. (2022). Effects of instructor-present videos on learning, cognitive load, motivation, and social presence: A meta-analysis. Education and Information Technologies, 27(9), 12713–12742. https://doi.org/10.1007/s10639-022-11154-w
  • Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the student engagement instrument. Journal of School Psychology, 44(5), 427–445. https://doi.org/10.1016/j.jsp.2006.04.002
  • Baker, R., Xu, D., Park, J., Yu, R., Li, Q., Cung, B., Fischer, C., Rodriguez, F., Warschauer, M., & Smyth, P. (2020). The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: Opening the black box of learning processes. International Journal of Educational Technology in Higher Education, 17(1), 13. https://doi.org/10.1186/s41239-020-00187-1
  • Carmichael, M., Reid, A.-K., & Karpicke, J. (2018). Assessing the impact of educational video on student engagement, critical thinking and learning: The current state of play. SAGE.
  • Chen, Y., Gao, Q., Yuan, Q., & Tang, Y. (2019). Facilitating students’ interaction in MOOCs through timeline-anchored discussion. International Journal of Human–Computer Interaction, 35(19), 1781–1799. https://doi.org/10.1080/10447318.2019.1574056
  • Chen, H.-T. M., & Thomas, M. (2020). Effects of lecture video styles on engagement and learning. Educational Technology Research & Development, 68(5), 2147–2164. https://doi.org/10.1007/s11423-020-09757-6
  • Chen, C. J., Wong, V. S., Teh, C. S., & Chuah, K. M. (2017). MOOC videos-derived emotions. Journal of Telecommunication, Electronic and Computer Engineering, 9(2–9), 137–140. https://jtec.utem.edu.my/jtec/article/view/2688
  • Chorianopoulos, K. (2018). A taxonomy of asynchronous instructional video styles. International Review of Research in Open & Distributed Learning, 19(1), 295–311. https://doi.org/10.19173/irrodl.v19i1.2920
  • Cobos, R., & Ruiz-Garcia, J. C. (2021). Improving learner engagement in MOOCs using a learning intervention system: A research study in engineering education. Computer Applications in Engineering Education, 29(4), 733–749. https://doi.org/10.1002/cae.22316
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
  • Comer, D. K., Baker, R., & Wang, Y. (2015). Negativity in massive online open courses: Impacts on learning and teaching and how instructional teams may be able to address it. InSight: A Journal of Scholarly Teaching, 10, 92–113. https://doi.org/10.46504/10201508co
  • Costley, J., & Lange, C. H. (2017). Video lectures in e-learning. Interactive Technology & Smart Education, 14(1), 14–30. https://doi.org/10.1108/ITSE-08-2016-0025
  • Daniels, L. M., Adams, C., & McCaffrey, A. (2016). Emotional and social engagement in a massive open online course: An examination of Dino 101. In M. P. McCreery (Ed.), Emotions, technology, and learning (pp. 25–41). Academic Press.
  • Dart, S. (2020, December 6–9). Khan-style video engagement in undergraduate engineering: Influence of video duration, content type and course. Proceedings of the 31st Annual Conference of the Australasian Association for Engineering Education, Sydney, Australia.
  • Dart, S., & Gregg, A. (2021, December). Know your stuff, show enthusiasm, keep it on message: Factors influencing video engagement in two mechanical engineering courses. Proceedings of the Research in Engineering Education Symposium and Australasian Association for Engineering Education Annual Conference, Australia.
  • Deng, R., & Benckendorff, P. (2021). What are the key themes associated with the positive learning experience in MOOCs? An empirical investigation of learners’ ratings and reviews. International Journal of Educational Technology in Higher Education, 18(1), 9. https://doi.org/10.1186/s41239-021-00244-3
  • Deng, R., Benckendorff, P., & Gannaway, D. (2019). Progress and new directions for teaching and learning in MOOCs. Computers & Education, 129, 48–60. https://doi.org/10.1016/j.compedu.2018.10.019
  • Deng, R., Benckendorff, P., & Gannaway, D. (2020). Learner engagement in MOOCs: Scale development and validation. British Journal of Educational Technology, 51(1), 245–262. https://doi.org/10.1111/bjet.12810
  • Deng, R., & Gao, Y. (2023a). Effects of embedded questions in pre-class videos on learner perceptions, video engagement, and learning performance in flipped classrooms. Active Learning in Higher Education, Advance online publication. https://doi.org/10.1177/14697874231167098
  • Deng, R., & Gao, Y. (2023b). A review of eye tracking research on video-based learning. Education and Information Technologies, 28(6), 7671–7702. https://doi.org/10.1007/s10639-022-11486-7
  • Deng, R., & Gao, Y. (2023c). Using learner reviews to inform instructional video design in MOOCs. Behavioral Sciences, 13(4), 330. https://doi.org/10.3390/bs13040330
  • Endres, T., Weyreter, S., Renkl, A., & Eitel, A. (2020). When and why does emotional design foster learning? Evidence for situational interest as a mediator of increased persistence. Journal of Computer Assisted Learning, 36(4), 514–525. https://doi.org/10.1111/jcal.12418
  • Gallego-Romero, J. M., Alario-Hoyos, C., Estévez-Ayres, I., & Delgado Kloos, C. (2020). Analyzing learners’ engagement and behavior in MOOCs on programming with the Codeboard IDE. Educational Technology Research & Development, 68(5), 2505–2528. https://doi.org/10.1007/s11423-020-09773-6
  • Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015). Predictors of retention and achievement in a massive open online course. American Educational Research Journal, 52(5), 925–955. https://doi.org/10.3102/0002831215584621
  • Guo, P. J., Kim, J., & Rubin, R. (2014, March). How video production affects student engagement: An empirical study of MOOC videos. The first ACM conference on learning at scale, Atlanta, GA.
  • Guzmán-Valenzuela, C., Gómez-González, C., Rojas-Murphy Tagle, A., & Lorca-Vyhmeister, A. (2021). Learning analytics in higher education: A preponderance of analytics but very little learning? International Journal of Educational Technology in Higher Education, 18(1), 23. https://doi.org/10.1186/s41239-021-00258-x
  • Haensel, J. X., Smith, T. J., & Senju, A. (2022). Cultural differences in mutual gaze during face-to-face interactions: A dual head-mounted eye-tracking study. Visual Cognition, 30(1–2), 100–115. https://doi.org/10.1080/13506285.2021.1928354
  • Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis: Pearson new international edition. Pearson.
  • Hansch, A., McConachie, K., Schmidt, P., Hillers, L., Newman, C., & Schildhauer, T. (2015). The role of video in online learning: Findings from the field and critical reflections. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2577882
  • Hoi, V. N., & Le Hang, H. (2021). The structure of student engagement in online learning: A bi-factor exploratory structural equation modelling approach. Journal of Computer Assisted Learning, 37(4), 1141–1153. https://doi.org/10.1111/jcal.12551
  • Hong, J., Pi, Z., & Yang, J. (2018). Learning declarative and procedural knowledge via video lectures: Cognitive load and learning effectiveness. Innovations in Education and Teaching International, 55(1), 74–81. https://doi.org/10.1080/14703297.2016.1237371
  • Hughes, C., Costley, J., & Lange, C. (2019). The effects of multimedia video lectures on extraneous load. Distance Education, 40(1), 54–75. https://doi.org/10.1080/01587919.2018.1553559
  • Hu, H., Zhang, G., Gao, W., & Wang, M. (2020). Big data analytics for MOOC video watching behavior based on Spark. Neural Computing and Applications, 32(11), 6481–6489. https://doi.org/10.1007/s00521-018-03983-z
  • Jiang, Y., & Peng, J.-E. (2023). Exploring the relationships between learners’ engagement, autonomy, and academic performance in an English language MOOC. Computer Assisted Language Learning, 1–26. Advance online publication. https://doi.org/10.1080/09588221.2022.2164777
  • Jung, E., Kim, D., Yoon, M., Park, S., & Oakley, B. (2019). The influence of instructional design on learner control, sense of achievement, and perceived effectiveness in a supersize MOOC course. Computers & Education, 128, 377–388. https://doi.org/10.1016/j.compedu.2018.10.001
  • Jung, Y., & Lee, J. (2018). Learning engagement and persistence in Massive Open Online Courses (MOOCS). Computers & Education, 122, 9–22. https://doi.org/10.1016/j.compedu.2018.02.013
  • Kay, R. H. (2012). Exploring the use of video podcasts in education: A comprehensive review of the literature. Computers in Human Behavior, 28(3), 820–831. https://doi.org/10.1016/j.chb.2012.01.011
  • Kennedy, G., Coffrin, C., de Barba, P., & Corrin, L. (2015, March). Predicting success: How learners’ prior knowledge, skills and activities predict MOOC performance. 5th International Conference on Learning Analytics and Knowledge, New York.
  • Kim, J., Kwon, Y., & Cho, D. (2011). Investigating factors that influence social presence and learning outcomes in distance higher education. Computers & Education, 57(2), 1512–1520. https://doi.org/10.1016/j.compedu.2011.02.005
  • Kuo, T. M., Tsai, C.-C., & Wang, J.-C. (2021). Linking web-based learning self-efficacy and learning engagement in MOOCs: The role of online academic hardiness. The Internet and Higher Education, 51, 100819. https://doi.org/10.1016/j.iheduc.2021.100819
  • Lackmann, S., Léger, P.-M., Charland, P., Aubé, C., & Talbot, J. (2021). The influence of video format on engagement and performance in online learning. Brain Sciences, 11(2), 128. https://doi.org/10.3390/brainsci11020128
  • Lallé, S., & and Conati, C. (2020). A data-driven student model to provide adaptive support during video watching across MOOCs. In I. I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán, Artificial intelligence in education (pp. 282–295). Springer. https://doi.org/10.1007/978-3-030-52237-7_23
  • Lange, C., & Costley, J. (2020). Improving online video lectures: Learning challenges created by media. International Journal of Educational Technology in Higher Education, 17(1), 16. https://doi.org/10.1186/s41239-020-00190-6
  • Lan, M., & Hew, K. F. (2020). Examining learning engagement in MOOCs: A self-determination theoretical perspective using mixed method. International Journal of Educational Technology in Higher Education, 17(1), 7. https://doi.org/10.1186/s41239-020-0179-5
  • Lee, Y. (2018). Effect of uninterrupted time-on-task on students’ success in Massive Open Online Courses (MOOCs). Computers in Human Behavior, 86, 174–180. https://doi.org/10.1016/j.chb.2018.04.043
  • Lemay, D. J., & Doleck, T. (2022). Predicting completion of Massive Open Online Course (MOOC) assignments from video viewing behavior. Interactive Learning Environments, 30(10), 1782–1793. https://doi.org/10.1080/10494820.2020.1746673
  • Li, K. (2019). MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Computers & Education, 132, 16–30. https://doi.org/10.1016/j.compedu.2019.01.003
  • Li, Q., & Baker, R. (2018). The different relationships between engagement and outcomes across participant subgroups in Massive Open Online Courses. Computers & Education, 127, 41–65. https://doi.org/10.1016/j.compedu.2018.08.005
  • Majid, S., Khine, W. K. K., Oo, M. Z. C., & Lwin, Z. M. (2012 , November). An analysis of YouTube videos for teaching information literacy skills. Proceedings of the International Conference on Computers and Advanced Technology in Education (ICCAT 2001). Beijing, China.
  • Manuel, F., Maur, A., Weiser, C., & Winkel, K. (2021). Pre-class video watching fosters achievement and knowledge retention in a flipped classroom. Computers & Education, 179, 104399. https://doi.org/10.1016/j.compedu.2021.104399
  • Maroco, J., Maroco, A. L., Campos, J. A. D. B., & Fredricks, J. A. (2016). University student’s engagement: Development of the University Student Engagement Inventory (USEI). Psicologia: Reflexão e Crítica, 29(1), 1–12. https://doi.org/10.1186/s41155-016-0042-8
  • Mayer, R. E., & Moreno, R. (2002). Animation as an aid to multimedia learning. Educational Psychology Review, 14(1), 87–99. https://doi.org/10.1023/A:1013184611077
  • Noetel, M., Griffith, S., Delaney, O., Sanders, T., Parker, P., Del Pozo Cruz, B., & Lonsdale, C. (2021). Video improves learning in higher education: A systematic review. Review of Educational Research, 91(2), 204–236. https://doi.org/10.3102/0034654321990713
  • Perna, L. W., Ruby, A., Boruch, R. F., Wang, N., Scull, J., Ahmad, S., & Evans, C. (2014). Moving through MOOCs: Understanding the progression of users in massive open online courses. Educational Researcher, 43(9), 421–432. https://doi.org/10.3102/0013189x14562423
  • Pi, Z., Chen, M., Zhu, F., Yang, J., & Hu, W. (2022). Modulation of instructor’s eye gaze by facial expression in video lectures. Innovations in Education and Teaching International, 59(1), 15–23. https://doi.org/10.1080/14703297.2020.1788410
  • Pi, Z., Xu, K., Liu, C., & Yang, J. (2020). Instructor presence in video lectures: Eye gaze matters, but not body orientation. Computers & Education, 144, 103713. https://doi.org/10.1016/j.compedu.2019.103713
  • Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In S. Tettegah & M. Gartmeier (Eds.), Emotions, technology, design, and learning (pp. 131–162). Academic Press.
  • Pursel, B. K., Zhang, L., Jablokow, K. W., Choi, G. W., & Velegol, D. (2016). Understanding MOOC students: Motivations and behaviours indicative of MOOC completion. Journal of Computer Assisted Learning, 32, 202–217. https://doi.org/10.1111/jcal.12131
  • Romero-Rodríguez, L. M., Ramírez-Montoya, M. S., & González, J. R. V. (2019). Gamification in MOOCs: Engagement application test in energy sustainability courses. IEEE Access, 7, 32093–32101. https://doi.org/10.1109/access.2019.2903230
  • Ruipérez-Valiente, J. A., Staubitz, T., Jenner, M., Halawa, S., Zhang, J., Despujol, I., Maldonado-Mahauad, J., Montoro, G., Peffer, M., Rohloff, T., Lane, J., Turro, C., Li, X., Pérez-Sanagustín, M., & Reich, J. (2022). Large scale analytics of global and regional MOOC providers: Differences in learners’ demographics, preferences, and perceptions. Computers & Education, 180, 104426. https://doi.org/10.1016/j.compedu.2021.104426
  • Santos Espino, J. M., Afonso Suárez, M. D., & González-Henríquez, J. J. (2020). Video for teaching: Classroom use, instructor self-production and teachers’ preferences in presentation format. Technology, Pedagogy & Education, 29(2), 147–162. https://doi.org/10.1080/1475939x.2020.1726805
  • Santos Espino, J. M., Afonso Suárez, M. D., & Guerra Artal, C. (2016). Speakers and boards: A survey of instructional video styles in MOOCs. Technical Communication, 63(2), 101–115. https://www.ingentaconnect.com/content/stc/tc/2016/00000063/00000002/art00004
  • Sanz-Martínez, L., Er, E., Martínez-Monés, A., Dimitriadis, Y., & Bote-Lorenzo, M. L. (2019). Creating collaborative groups in a MOOC: A homogeneous engagement grouping approach. Behaviour & Information Technology, 38(11), 1107–1121. https://doi.org/10.1080/0144929x.2019.1571109
  • Semenova, T. (2022). The role of learners’ motivation in MOOC completion. Open Learning: The Journal of Open, Distance & E-Learning, 37(3), 273–287. https://doi.org/10.1080/02680513.2020.1766434
  • Seo, K., Dodson, S., Harandi, N. M., Roberson, N., Fels, S., & Roll, I. (2021). Active learning with online video: The impact of learning context on engagement. Computers & Education, 165. https://doi.org/10.1016/j.compedu.2021.104132
  • Shah, D. (2022). By the numbers: MOOCs in 2021. https://www.classcentral.com/report/mooc-stats-2021/
  • Smith, K. B. (2002). Typologies, taxonomies, and the benefits of policy classification. Policy Studies Journal, 30(3), 379–395. https://doi.org/10.1111/j.1541-0072.2002.tb02153.x
  • Stöhr, C., Stathakarou, N., Mueller, F., Nifakos, S., & McGrath, C. (2019). Videos as learning objects in MOOCs: A study of specialist and non-specialist participants' video activity in MOOCs. British Journal of Educational Technology, 50(1), 166–176.
  • Sun, Y., Guo, Y., & Zhao, Y. (2020). Understanding the determinants of learner engagement in MOOCs: An adaptive structuration perspective. Computers & Education, 157, 103963. https://doi.org/10.1016/j.compedu.2020.103963
  • Tawfik, A. A., Reeves, T. D., Stich, A. E., Gill, A., Hong, C., McDade, J., Pillutla, V. S., Zhou, X., & Giabbanelli, P. J. (2017). The nature and level of learner–learner interaction in a chemistry Massive Open Online Course (MOOC). Journal of Computing in Higher Education, 29(3), 411–431. https://doi.org/10.1007/s12528-017-9135-3
  • Thornhill, S., Asensio, M., & Young, C. (2002). Video streaming: A guide for educational development. JISC Click and Go Video Project.
  • van Wermeskerken, M., Ravensbergen, S., & van Gog, T. (2018). Effects of instructor presence in video modeling examples on attention and learning. Computers in Human Behavior, 89, 430–438. https://doi.org/10.1016/j.chb.2017.11.038
  • Walji, S., Deacon, A., Small, J., & Czerniewicz, L. (2016). Learning through engagement: MOOCs as an emergent form of provision. Distance Education, 37(2), 208–223. https://doi.org/10.1080/01587919.2016.1184400
  • Wang, J., Antonenko, P., & Dawson, K. (2020). Does visual attention to the instructor in online video affect learning and learner perceptions? An eye-tracking analysis. Computers & Education, 146, 1–16. https://doi.org/10.1016/j.compedu.2019.103779
  • Wang, W., Guo, L., He, L., & Wu, Y. J. (2019). Effects of social-interactive engagement on the dropout ratio in online learning: Insights from MOOC. Behaviour & Information Technology, 38(6), 621–636. https://doi.org/10.1080/0144929x.2018.1549595
  • Watson, W. R., Kim, W., & Watson, S. L. (2016). Learning outcomes of a MOOC designed for attitudinal change: A case study of an Animal Behavior and Welfare MOOC. Computers & Education, 96, 83–93. https://doi.org/10.1016/j.compedu.2016.01.013
  • Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers & Education, 163, 104097. https://doi.org/10.1016/j.compedu.2020.104097
  • Wilson, K. E., Martinez, M., Mills, C., D’Mello, S., Smilek, D., & Risko, E. F. (2018). Instructor presence effect: Liking does not always lead to learning. Computers & Education, 122, 205–220. https://doi.org/10.1016/j.compedu.2018.03.011
  • Xu, X., Zhu, X., & Chan, F. M. (2023). System design of Pintrich’s SRL in a supervised-PLE platform: A pilot test in higher education. Interactive Learning Environments, 31(2), 683–700. https://doi.org/10.1080/10494820.2020.1802296