Advanced search
Publication Cover
Applied Artificial Intelligence
An International Journal
Volume 23, 2009 - Issue 2
Submit an article Journal homepage
2,399
Views
94
CrossRef citations to date
0
Altmetric
Original Articles

AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE

Sidney D'Mello The University of Memphis, Department of Computer Science, Memphis, TennesseeCorrespondence[email protected]
&
Art Graesser The University of Memphis, Department of Computer Science, Memphis, Tennessee
Pages 123-150 | Published online: 04 Feb 2009

Citations (94)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (3)

Med Nadjib Kouahla, Adil Boughida, Imed Chebata, Zohra Mehenaoui & Yacine Lafifi. (2022) Emorec: a new approach for detecting and improving the emotional state of learners in an e-learning environment. Interactive Learning Environments 0:0, pages 1-19.
Read now
John G. Sharp, Jane C. Sharp & Emma Young. (2020) Academic boredom, engagement and the achievement of undergraduate students at university: a review and synthesis of relevant literature. Research Papers in Education 35:2, pages 144-184.
Read now
Vedrana Vidulin & Matjaž Gams. (2011) IMPACT OF HIGH-LEVEL KNOWLEDGE ON ECONOMIC WELFARE THROUGH INTERACTIVE DATA MINING. Applied Artificial Intelligence 25:4, pages 267-291.
Read now

Articles from other publishers (91)

K. Ezzameli & H. Mahersia. (2023) Emotion recognition from unimodal to multimodal analysis: A review. Information Fusion 99, pages 101847.
Crossref
Ivonne Angelica Castiblanco Jimenez, Juan Sebastian Gomez Acevedo, Federica Marcolin, Enrico Vezzetti & Sandro Moos. (2022) Towards an integrated framework to measure user engagement with interactive or physical products. International Journal on Interactive Design and Manufacturing (IJIDeM) 17:1, pages 45-67.
Crossref
Caj Södergård & Timo Laakko. (2023) Inferring Students’ Self-Assessed Concentration Levels in Daily Life Using Biosignal Data From Wearables. IEEE Access 11, pages 30308-30323.
Crossref
T.S. Ashwin, Vijay Prakash & Ramkumar Rajendran. (2023) A systematic review of intelligent tutoring systems based on Gross body movement detected using computer vision. Computers and Education: Artificial Intelligence 4, pages 100125.
Crossref
Janice D. Gobert, Michael A. Sao Pedro, Haiying Li & Christine Lott. 2023. International Encyclopedia of Education(Fourth Edition). International Encyclopedia of Education(Fourth Edition) 460 470 .
Cheryl I. Johnson & Jennifer L. Solberg. 2023. HCI International 2023 – Late Breaking Papers. HCI International 2023 – Late Breaking Papers 116 127 .
Büşra KÖKÇAM & Ayşin SATAN. (2022) Coping Strategies with Boredom in Class: Scale Development and Validation. Research on Education and Psychology 6:2, pages 207-227.
Crossref
Rui Li, Di Liu, Zhijun Li, Jinli Liu, Jincao Zhou, Weiping Liu, Bo Liu, Weiping Fu & Ahmad Bala Alhassan. (2022) A novel EEG decoding method for a facial-expression-based BCI system using the combined convolutional neural network and genetic algorithm. Frontiers in Neuroscience 16.
Crossref
Rui Xu, Chen Wang & Yen Hsu. (2022) Ameliorated New Media Literacy Model Based on an Esthetic Model: The Ability of a College Student Audience to Enter the Field of Digital Art. Frontiers in Psychology 13.
Crossref
Khadeja Ali Hamamy Assiry & Anandhavalli Muniasamy. (2022) Predicting Learning Styles Using Machine Learning Classifiers. Predicting Learning Styles Using Machine Learning Classifiers.
Mingming ZhouMingming Zhou. 2022. Goal Frustration in Academic Achievement Settings. Goal Frustration in Academic Achievement Settings 23 47 .
Chaitali Samani & Madhu Goyal. (2021) Confusion detection using neural networks. Confusion detection using neural networks.
Benedikt Hosp, Myat Su Yin, Peter Haddawy, Ratthaphum Watcharopas, Paphon Sa-Ngasoongsong & Enkelejda Kasneci. (2021) States of Confusion: Eye and Head Tracking Reveal Surgeons’ Confusion during Arthroscopic Surgery. States of Confusion: Eye and Head Tracking Reveal Surgeons’ Confusion during Arthroscopic Surgery.
F Ibrahim, S Mutashar & B Hamed. (2021) A Review of an Invasive and Non-invasive Automatic Confusion Detection Techniques. IOP Conference Series: Materials Science and Engineering 1105:1, pages 012026.
Crossref
Jihyang Lee, Hyo-Jeong So, Seunghye Ha, Eunyoung Kim & Kyudong Park. (2021) Unpacking Academic Emotions in Asynchronous Video-based Learning: Focusing on Korean Learners’ Affective Experiences. The Asia-Pacific Education Researcher 30:3, pages 247-261.
Crossref
Ekin Gedik, Laura Cabrera-Quiros, Claudio Martella, Gwenn Englebienne & Hayley Hung. (2021) Towards Analyzing and Predicting the Experience of Live Performances with Wearable Sensing. IEEE Transactions on Affective Computing 12:1, pages 269-276.
Crossref
Boxun Fu, Fu Li, Yi Niu, Hao Wu, Yang Li & Guangming Shi. (2021) Conditional generative adversarial network for EEG-based emotion fine-grained estimation and visualization. Journal of Visual Communication and Image Representation 74, pages 102982.
Crossref
Chaitali Samani & Madhu Goyal. 2021. Proceedings of International Conference on Communication and Computational Technologies. Proceedings of International Conference on Communication and Computational Technologies 647 657 .
Shree Krishna Subburaj, Angela E.B. Stewart, Arjun Ramesh Rao & Sidney K. D'Mello. (2020) Multimodal, Multiparty Modeling of Collaborative Problem Solving Performance. Multimodal, Multiparty Modeling of Collaborative Problem Solving Performance.
Qiaosi Wang, Shan Jing, David Joyner, Lauren Wilcox, Hong Li, Thomas Plötz & Betsy Disalvo. (2020) Sensing Affect to Empower Students. Sensing Affect to Empower Students.
Temitayo A. Olugbade, Nadia Bianchi-Berthouze, Nicolai Marquardt & Amanda C. de C. Williams. (2020) Human Observer and Automatic Assessment of Movement Related Self-Efficacy in Chronic Pain: From Exercise to Functional Activity. IEEE Transactions on Affective Computing 11:2, pages 214-229.
Crossref
Thorsten Schodde, Laura Hoffmann, Sonja Stange & Stefan Kopp. (2019) Adapt, Explain, Engage—A Study on How Social Robots Can Scaffold Second-language Learning of Children. ACM Transactions on Human-Robot Interaction 9:1, pages 1-27.
Crossref
Pedro Bispo Santos, Caroline Verena Bhowmik & Iryna Gurevych. 2020. Intelligent Tutoring Systems. Intelligent Tutoring Systems 89 94 .
Berardina De Carolis, Francesca D'Errico, Nicola Macchiarulo & Giuseppe Palestra. (2019) “Engaged Faces”: Measuring and Monitoring Student Engagement from Face and Gaze Behavior. “Engaged Faces”: Measuring and Monitoring Student Engagement from Face and Gaze Behavior.
Evan Campbell, Angkoon Phinyomark & Erik Scheme. (2019) Feature Extraction and Selection for Pain Recognition Using Peripheral Physiological Signals. Frontiers in Neuroscience 13.
Crossref
Felicia Goh, Annemaree Carroll & Robyn M. Gillies. (2019) A review of the use of portable technologies as observational aids in the classroom. Information and Learning Sciences 120:3/4, pages 228-241.
Crossref
Taihao Li, Cuifen Du, Tuya Naren, Zhiqiang Chen, Shupeng Liu, Jianshe Zhou & Xiaoyin Xu. (2018) Using feature points and angles between them to recognise facial expression by a neural network approach. IET Image Processing 12:11, pages 1951-1955.
Crossref
Sophie Skach. (2018) Strike A Pose. Strike A Pose.
Jeremy Bailenson. (2018) Protecting Nonverbal Data Tracked in Virtual Reality. JAMA Pediatrics 172:10, pages 905.
Crossref
Athanasios Psaltis, Konstantinos C. Apostolakis, Kosmas Dimitropoulos & Petros Daras. (2018) Multimodal Student Engagement Recognition in Prosocial Games. IEEE Transactions on Games 10:3, pages 292-303.
Crossref
Silvia Rus, Dhanashree Joshi, Andreas Braun & Arjan Kuijper. (2018) The Emotive Couch - Learning Emotions by Capacitively Sensed. Procedia Computer Science 130, pages 263-270.
Crossref
Panpan Wang, Yazhou Zhang, Xiang Li, Yuexian Hou & Dawei Song. (2017) Does tang poetry affect human emotional state? A pilot study by EEG. Does tang poetry affect human emotional state? A pilot study by EEG.
Thorsten Schodde, Laura Hoffmann & Stefan Kopp. (2017) How to manage affective state in child-robot tutoring interactions?. How to manage affective state in child-robot tutoring interactions?.
Miguel Arevalillo-Herráez, Luis Marco-Giménez, David Arnau & José A. González-Calero. (2017) Adding sensor-free intention-based affective support to an Intelligent Tutoring System. Knowledge-Based Systems 132, pages 85-93.
Crossref
Valerie Bennett, Nadine Gourkow & Daniel S. Mills. (2017) Facial correlates of emotional behaviour in the domestic cat (Felis catus). Behavioural Processes 141, pages 342-350.
Crossref
Khalid Almohammadi, Hani Hagras, Bo Yao, Abdulkareem Alzahrani, Daniyal Alghazzawi & Ghadah Aldabbagh. (2015) A type-2 fuzzy logic recommendation system for adaptive teaching. Soft Computing 21:4, pages 965-979.
Crossref
Jacqueline P. Leighton, Wei Tang & Qi Guo. 2017. Understanding and Investigating Response Processes in Validation Research. Understanding and Investigating Response Processes in Validation Research 137 157 .
Prasun Dewan. (2016) Inferred Awareness to Support Mixed-Activity Collaboration. Inferred Awareness to Support Mixed-Activity Collaboration.
Andrea Stevenson WonBrian PeroneMichelle FriendJeremy N. Bailenson. (2016) Identifying Anxiety Through Tracked Head Movements in a Virtual Classroom. Cyberpsychology, Behavior, and Social Networking 19:6, pages 380-387.
Crossref
Juzheng Zhang, Nadia Magnenat Thalmann & Jianmin Zheng. (2016) Combining Memory and Emotion With Dialog on Social Companion. Combining Memory and Emotion With Dialog on Social Companion.
Muneeba Raja & Stephan Sigg. (2016) Applicability of RF-based methods for emotion recognition: A survey. Applicability of RF-based methods for emotion recognition: A survey.
Sintija Petrovica. 2016. Psychology and Mental Health. Psychology and Mental Health 1094 1110 .
Z. Papamitsiou & A.A. Economides. 2016. Formative Assessment, Learning Data Analytics and Gamification. Formative Assessment, Learning Data Analytics and Gamification 117 133 .
Georgios N. Yannakakis, Hector P. Martinez & Maurizio Garbarino. 2016. Emotion in Games. Emotion in Games 119 137 .
Juzheng Zhang, Jianmin Zheng & Nadia Magnenat-Thalmann. 2016. Context Aware Human-Robot and Human-Agent Interaction. Context Aware Human-Robot and Human-Agent Interaction 211 236 .
Melissa C. Duffy, Susanne Lajoie & Kevin Lachapelle. 2016. Educational Technologies in Medical and Health Sciences Education. Educational Technologies in Medical and Health Sciences Education 181 213 .
Mihaela Cocea & George D. Magoulas. (2015) Participatory Learner Modelling Design: A methodology for iterative learner models development. Information Sciences 321, pages 48-70.
Crossref
Mahdi Khezri, Mohammad Firoozabadi & Ahmad Reza Sharafat. (2015) Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Computer Methods and Programs in Biomedicine 122:2, pages 149-164.
Crossref
Fwa Hua Leong. (2015) Automatic detection of frustration of novice programmers from contextual and keystroke logs. Automatic detection of frustration of novice programmers from contextual and keystroke logs.
Ishan Behoora & Conrad S. Tucker. (2015) Machine learning classification of design team members' body language patterns for real time emotional state detection. Design Studies 39, pages 100-127.
Crossref
Esther Vasiete & Tom Yeh. (2015) Multimodal Frustration Detection on Smartphones. Multimodal Frustration Detection on Smartphones.
Keith Nesbitt, Karen Blackmore, Geoffrey Hookham, Frances Kay-Lambkin & Peter Walla. 2015. Serious Games Analytics. Serious Games Analytics 401 434 .
Sinem Aslan, Zehra Cataltepe, Itai Diner, Onur Dundar, Asli A. Esme, Ron Ferens, Gila Kamhi, Ece Oktay, Canan Soysal & Murat Yener. (2014) Learner Engagement Measurement and Classification in 1:1 Learning. Learner Engagement Measurement and Classification in 1:1 Learning.
Melih Kandemir, Akos Vetek, Mehmet Gönen, Arto Klami & Samuel Kaski. (2014) Multi-task and multi-view learning of user state. Neurocomputing 139, pages 97-106.
Crossref
Ali-Akbar Samadani, Rob Gorbet & Dana Kulic. (2014) Affective Movement Recognition Based on Generative and Discriminative Stochastic Dynamic Models. IEEE Transactions on Human-Machine Systems 44:4, pages 454-467.
Crossref
Molly Y. Zhou & William F. Lawless. 2014. Encyclopedia of Information Science and Technology, Third Edition. Encyclopedia of Information Science and Technology, Third Edition 2445 2452 .
Ronnie Taib, Jeremy Tederry & Benjamin Itzstein. (2014) Quantifying driver frustration to improve road safety. Quantifying driver frustration to improve road safety.
Andrea Stevenson Won, Jeremy N. Bailenson & Joris H. Janssen. (2014) Automatic Detection of Nonverbal Behavior Predicts Learning in Dyadic Interactions. IEEE Transactions on Affective Computing 5:2, pages 112-125.
Crossref
Masaya Okada & Masahiro Tada. (2014) Formative assessment method of real-world learning by integrating heterogeneous elements of behavior, knowledge, and the environment. Formative assessment method of real-world learning by integrating heterogeneous elements of behavior, knowledge, and the environment.
Sintija Petrovica. (2014) Tutoring Process in Emotionally Intelligent Tutoring Systems. International Journal of Technology and Educational Marketing 4:1, pages 72-85.
Crossref
Ali-Akbar Samadani, Ali Ghodsi & Dana Kulić. (2013) Discriminative functional analysis of human movements. Pattern Recognition Letters 34:15, pages 1829-1839.
Crossref
Michelle Karg, Ali-Akbar Samadani, Rob Gorbet, Kolja Kuhnlenz, Jesse Hoey & Dana Kulic. (2013) Body Movements for Affective Expression: A Survey of Automatic Recognition and Generation. IEEE Transactions on Affective Computing 4:4, pages 341-359.
Crossref
Abdulaziz Almehmadi, Michael Bourque & Khalil El-Khatib. (2013) A Tweet of the Mind: Automated Emotion Detection for Social Media Using Brain Wave Pattern Analysis. A Tweet of the Mind: Automated Emotion Detection for Social Media Using Brain Wave Pattern Analysis.
Sintija Petrovica. (2013) Adaptation of tutoring to students' emotions in emotionally intelligent tutoring systems. Adaptation of tutoring to students' emotions in emotionally intelligent tutoring systems.
Harry J. Witchel, Carina Westling, Rob Needham, Aoife Healy & Nachiappan Chockalingam. (2013) Mean head and shoulder heights when seated. Mean head and shoulder heights when seated.
Paul J. Silvia. (2013) Interested Experts, Confused Novices: Art Expertise and the Knowledge Emotions. Empirical Studies of the Arts 31:1, pages 107-115.
Crossref
Raquel Faria & Ana Almeida. 2013. Computational Intelligence and Decision Making. Computational Intelligence and Decision Making 323 332 .
Sidney D'mello & Art Graesser. (2013) AutoTutor and affective autotutor. ACM Transactions on Interactive Intelligent Systems 2:4, pages 1-39.
Crossref
John D. Eastwood, Alexandra Frischen, Mark J. Fenske & Daniel Smilek. (2012) The Unengaged Mind. Perspectives on Psychological Science 7:5, pages 482-495.
Crossref
Omar AlZoubi, Sidney K. D'Mello & Rafael A. Calvo. (2012) Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals. IEEE Transactions on Affective Computing 3:3, pages 298-310.
Crossref
Michael Garber-Barron & Mei Si. (2012) Using body movement and posture for emotion detection in non-acted scenarios. Using body movement and posture for emotion detection in non-acted scenarios.
M. M. T. Rodrigo, R. S. J. D. Baker, J. Agapito, J. Nabos, M. C. Repalam, S. S. Reyes & M. O. C. Z. San Pedro. (2012) The Effects of an Interactive Software Agent on Student Affective Dynamics while Using ;an Intelligent Tutoring System. IEEE Transactions on Affective Computing 3:2, pages 224-236.
Crossref
Jennifer J. Vogel-Walcutt, Logan Fiorella, Teresa Carper & Sae Schatz. (2011) The Definition, Assessment, and Mitigation of State Boredom Within Educational Settings: A Comprehensive Review. Educational Psychology Review 24:1, pages 89-111.
Crossref
Sidney D’Mello & Art Graesser. 2012. Adaptive Technologies for Training and Education. Adaptive Technologies for Training and Education 117 139 .
Arthur C. Graesser & Sidney D’Mello. 2012. The Psychology of Learning and Motivation. The Psychology of Learning and Motivation 183 225 .
David Hilton Shanabrook, Ivon Arroyo, Beverly Park Woolf & Winslow Burleson. 2012. Intelligent Tutoring Systems. Intelligent Tutoring Systems 46 51 .
Imène Jraidi, Pierre Chalfoun & Claude Frasson. 2012. Intelligent Tutoring Systems. Intelligent Tutoring Systems 1 10 .
Claude Frasson & Alicia Heraz. 2012. Encyclopedia of the Sciences of Learning. Encyclopedia of the Sciences of Learning 1125 1128 .
Mihaela Cocea & Stephan Weibelzahl. (2011) Disengagement Detection in Online Learning: Validation Studies and Perspectives. IEEE Transactions on Learning Technologies 4:2, pages 114-124.
Crossref
Mieke Vandewaetere, Piet Desmet & Geraldine Clarebout. (2011) The contribution of learner characteristics in the development of computer-based adaptive learning environments. Computers in Human Behavior 27:1, pages 118-130.
Crossref
John Nietfeld & Lucy R. Shores. 2011. Serious Educational Game Assessment. Serious Educational Game Assessment 19 42 .
Michelle Thrasher, Marjolein D. Van der Zwaag, Nadia Bianchi-Berthouze & Joyce H. D. M. Westerink. 2011. Affective Computing and Intelligent Interaction. Affective Computing and Intelligent Interaction 377 386 .
Rui Sun & Elliot MooreIIII. 2011. Affective Computing and Intelligent Interaction. Affective Computing and Intelligent Interaction 91 100 .
Sidney K. D’Mello, Blair Lehman & Art Graesser. 2011. New Perspectives on Affect and Learning Technologies. New Perspectives on Affect and Learning Technologies 113 126 .
Charles E. LanceBryan Dawson, David Birkelbach & Brian J. Hoffman. (2010) Method Effects, Measurement Error, and Substantive Conclusions. Organizational Research Methods 13:3, pages 435-455.
Crossref
Imène Jraidi, Maher Chaouachi & Claude Frasson. (2010) Self-Esteem Conditioning for Learning Conditioning. Self-Esteem Conditioning for Learning Conditioning.
Sidney K. D’Mello & Arthur Graesser. (2010) Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features. User Modeling and User-Adapted Interaction 20:2, pages 147-187.
Crossref
George Veletsianos, Robert Heller, Scott Overmyer & Mike Procter. (2010) Conversational agents in virtual worlds: Bridging disciplines. British Journal of Educational Technology 41:1, pages 123-140.
Crossref
Alicia Heraz & Claude Frasson. 2010. Intelligent Tutoring Systems. Intelligent Tutoring Systems 337 339 .
Sidney D’Mello, Blair Lehman, Jeremiah Sullins, Rosaire Daigle, Rebekah Combs, Kimberly Vogt, Lydia Perkins & Art Graesser. 2010. Intelligent Tutoring Systems. Intelligent Tutoring Systems 245 254 .
Ryan W. Buell, Kamalini Ramdas & Nazli Sonmez. (2020) Can Shared Service Delivery Increase Customer Engagement? A Study of Shared Medical Appointments. SSRN Electronic Journal.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.