An evaluation of online flipped instruction methods during the COVID-19 pandemic

ABSTRACT

The COVID-19 pandemic caused a sudden switch from face-to-face to online instruction. Switching from face-to-face instruction into fully online classes in a short timeframe could be challenging especially for instructors with little or no online teaching experience. In this research, we design, implement, and evaluate a novel framework to transform face-to-face classes into online flipped instruction for Information Systems (IS) courses. Our proposed framework uniquely combines backward design approach with flipped classroom methodology customized for online education. The framework was successfully applied to the IS courses offered in two colleges in a public university in the US during the COVID-19 period. We measured the effectiveness of the online flipped course elements based on the students’ feedback and developed design considerations and teaching tips to be used during and after the COVID-19 era.

2) Class and Help Sessions

Please rate the effectiveness of the below online class elements on your learning experience and engagement (very ineffective to very effective):

Synchronous (live video conference) class activity sessions. Select not applicable if there were no synchronous classes or you did not participate.

Table

Synchronous (live video conference) homework help sessions.

Select not applicable if synchronous homework help sessions were not offered or you did not participate.

Table

Online office hours

Select not applicable if online office hours were not offered or you did not participate.

Table

One-on-one meetings at your requested time with the professor.

Select not applicable if one-on-one meetings were not offered or you did not participate.

Table

3) Video Lectures and Extra Help Resources

Please rate the effectiveness of the below online class elements on your learning experience (very ineffective to very effective):

Preparation learning activity videos.

Select not applicable if preparation learning activities were not offered or you did not participate.

Table

Video recordings of in-class activities and help sessions.

Select not applicable if video recordings were not offered or you did not use them.

Table

Extra help resources such as lecture notes, tutorials, extra videos, etc.

Select not applicable if extra resources were not offered or you did not use them.

Table

4) Activities and Assignments

Please rate the effectiveness of the below online class elements on your learning experience and engagement (very ineffective to very effective):

Preparation assignments.

Select not applicable if preparation assignments were not offered or you did not complete them.

Table

Mini-activities and problem-solving questions discuss during the class.

Select not applicable if mini activities were not offered or you did not complete them.

Table

Homework assignments.

Select not applicable if homework assignments were not offered or you did not complete them.

Table

Class discussions.

Select not applicable if class discussions were not offered or you did not participate.

Table

Exams.

Select not applicable if exams were not offered or you did not complete them.

Table

5) Technology

Please rate the effectiveness of the below online class technologies on your learning experience and engagement:

Class LMS: ISMS or Blackboard (whichever applicable).

Select not applicable if the course was not offered on LMS or you did not use it.

Table

Microsoft Teams and channels.

Select not applicable if the course did not use teams or you did not use it.

Table

Virtual Desktop Environment (VDI).

Select not applicable if the course did not use VDI or you did not use it.

Table

Demographic Questions

The following questions help us understand the correlation between learning experience and demographics (age, gender, etc.). Please leave them unanswered if you do not wish to provide this information.

What is your age?

• Under 18 years old

• 18-29 years old

• 30-49 years old

• 50-64 years old

• 65 years or older

What is your gender?

• Male

• Female

• Other

What is your current level of education?

• undergraduate - freshman

• undergraduate - Sophomore

• undergraduate - junior

• undergraduate - senior

• graduate - master

• graduate - PhD

• Other, please specify: ________________________________________________

Which college are you in?

• College of Engineering

• College of Business

• Other, please specify: ________________________________________________

Please provide us with any comments you may have about this survey: __________________________

Additional information

Notes on contributors

Anahita Sanandaji

Anahita Sanandaji is an Assistant Professor of Analytics and Information Systems at Ohio University. Her research interests are Human Computer Interaction (HCI), data visualization and analytics, social computing, and User Experience (UX) research and design.

Saeed Ghanbartehrani is an Assistant Professor of Industrial and Systems Engineering at Ohio University. His research involves data driven optimization and decision making in the areas of network location, supply chain design, and logistics.