1,415
Views
111
CrossRef citations to date
0
Altmetric
Original Articles

Emote aloud during learning with AutoTutor: Applying the Facial Action Coding System to cognitive–affective states during learning

, , &
Pages 777-788 | Received 05 Sep 2005, Published online: 24 Jun 2008
 

Abstract

In an attempt to discover the facial action units for affective states that occur during complex learning, this study adopted an emote-aloud procedure in which participants were recorded as they verbalised their affective states while interacting with an intelligent tutoring system (AutoTutor). Participants’ facial expressions were coded by two expert raters using Ekman's Facial Action Coding System and analysed using association rule mining techniques. The two expert raters received an overall kappa that ranged between .76 and .84. The association rule mining analysis uncovered facial actions associated with confusion, frustration, and boredom. We discuss these rules and the prospects of enhancing AutoTutor with non-intrusive affect-sensitive capabilities.

Acknowledgements

This research conducted by the authors was supported by the National Science Foundation (REC 0106965, ITR 0325428, REC 0633918) the Tutoring Research Group (visit http://www.autotutor.org). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of NSF.

We would also like to thank Laurentiu Cristofor for use of the ARMiner client server data mining application used for the association rule mining.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.