Evaluation of Internal and External Validity of a Virtual Environment for Learning a Long Procedure

References

• Anastassova, M., Burkhardt, J.-M., Mégard, C., & Ehanno, P. (2007). L’ergonomie de la réalité augmentée pour l’apprentissage: Une revue. Le Travail Humain, 70 (2), 97–125.
   Google Scholar
• Anderson, J. (1982). Acquisition of cognitive skill. Psychological Review, 89 (4), 369–406.
   Web of Science ®Google Scholar
• Anderson, J. (1998, August). Instructional applications of ACT: Past, present, and future. Presented at ITS’98 (p. 1), San Antonio, TX.
   Google Scholar
• Anderson, J. (2013). The architecture of cognition (2nd ed.). New York, NY: Psychology Press.
   Google Scholar
• Anderson, J., Reder, L., & Simon, H. (1996). Situated learning and education. Educational Researcher, 25 (4), 5–11.
   Google Scholar
• Annetta, L., Minogue, J., Holmes, S., & Cheng, M. (2009). Investigating the impact of video games on high school students’ engagement and learning about genetics. Computers & Education, 53 (1), 74–85.
   Web of Science ®Google Scholar
• Arnaldi, B., Fuchs, P., & Tisseau, J. (2003). Introduction. In Les Presses de l’École des Mines de Paris (Ed.), Traité de la réalité virtuelle. Volume 1 : L’homme et l’environnement virtuel (pp. 3–21). Paris, France: Les Presses de l’Ecole de Mines de Paris.
   Google Scholar
• Beyer-Berjot, L., Palter, V., Grantcharov, T., & Aggarwal, R. (2014). Advanced training in laparoscopic abdominal surgery: A systematic review. Surgery, 156 (3), 676–688.
   PubMed Web of Science ®Google Scholar
• Bliss, J., Tidwell, P., & Guest, M. (1997). The effectiveness of virtual reality for administering spatial navigation training to firefighters. Presence, 6 (1), 73–86.
   Google Scholar
• Bossard, C., Kermarrec, G., Buche, C., & Tisseau, J. (2004). Transfer of learning in virtual environments : A new challenge? Virtual Reality, 12 (3), 151–161.
   Google Scholar
• Boud, A. C., Baber, C., & Steiner, S. J. (2000). Virtual reality: A tool for assembly? Presence, 9 (5), 486–496.
   Google Scholar
• Bracke, D. (1998). Vers un modèle théorique du transfert: Les contraintes à respecter. Revue Des Sciences De L’éducation, 24 (2), 235–266.
   Google Scholar
• Bransford, J. D., & Schwartz, D. L. (2001). Rethinking transfer: A simple proposal with multiple implications. Research in Education, 24 (3), 61–100.
   Google Scholar
• Brooks, F. P. (1999, December). What’s real about virtual reality? IEEE Computer Graphics and Application, 19 (6), 16–27.
   Web of Science ®Google Scholar
• Bruwaene, S. V., Schijven, M., & Miserez, M. (2014). Assessment of procedural skills using virtual simulation remains a challenge. Journal of Surgical Education, 71 (5), 654–661.
   PubMed Web of Science ®Google Scholar
• Butterfield, E., & Nelson, G. (1989). Theory and practice of teaching for transfer. Educational Technology Research and Development, 37 (3), 5–38.
   Web of Science ®Google Scholar
• Carlson, P., Peters, A., Gilbert, S., Vance, J. M., & Luse, A. (2015). Virtual training: Learning transfer of assembly tasks. IEEE Transactions on Visualization and Computer Graphics, 2626 (c), 1–14.
   Google Scholar
• Carpentier, K., & Lourdeaux, D. (2013, May). Sélection dynamique de situations d’apprentissage en environnement virtuel. Presented at Environnements Informatiques pour l’Apprentissage Humain (pp. 129–140), Toulouse, France.
   Google Scholar
• Cazeaux, E., Devillers, F., & Saint-Romas, C. (2005). Giat virtual training formation a la maintenance. Laval, Quebec, Canada: Laval Virtual.
   Google Scholar
• Chen, J. A., Tutwiler, M. S., Metcalf, S. J., Kamarainen, A., Grotzer, T., & Dede, C. (2016). A multi-user virtual environment to support students’ self-efficacy and interest in science: A latent growth model analysis. Learning and Instruction, 41, 11–22.
   Web of Science ®Google Scholar
• Chittaro, L., & Buttussi, F. (2015). Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety. IEEE Transactions on Visualization and Computer Graphics, 21 (4), 529–538.
   PubMed Web of Science ®Google Scholar
• Dalgarno, B., & Lee, M. (2010). What are the learning affordances of 3‐D virtual environments? British Journal of Educational Technology, 41 (1), 10–32.
   Web of Science ®Google Scholar
• Dede, C., Salzman, M., Loftin, R., & Ash, K. (1997). Using virtual reality technology to convey abstract scientific concepts. In M. Jacobson & R. Kozma (Eds.), Learning the sciences of the 21st century: Research, design, and implementing advanced technology learning environments (pp. 361–413). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Dixon, P., Harrison, K., & Taylor, D. (1993). Effects of sentence form on the construction of mental plans from procedural discourse. Canadian Journal of Experimental Psychology, 47 (2), 375.
   PubMed Web of Science ®Google Scholar
• Dorn, L., & Barker, D. (2005). The effects of driver training on simulated driving performance. Accident Analysis & Prevention, 37 (1), 63–69.
   PubMed Web of Science ®Google Scholar
• El-Chaar, J., Boer, C. R., Pedrazzoli, P., Mazzola, S., & Maso, G. D. (2011, June). Interactive 3D virtual environments for industrial operation training and maintenance. Presented at ICRMS’2011 - Safety First, Reliability Primary: Proceedings of 2011 9th International Conference on Reliability, Maintainability and Safety (pp. 1376–1381), Guiyang, China.
   Google Scholar
• Fuchs, P. (1996). Les interfaces de la réalité virtuelle. Paris, France: Les Presses de l’Ecole de Mines de Paris.
   Google Scholar
• Gallagher, A., & Cates, C. (2004). Approval of virtual reality training for carotid stenting: What this means for procedural-based medicine. Jama, 292 (24), 3024–3026.
   PubMed Web of Science ®Google Scholar
• Gallagher, A., Seymour, N., Jordan-Black, J., McGlade, K., & Satava, R. (2013). Prospective, randomized assessment of transfer of training (ToT) and transfer effectiveness ratio (TER) of virtual reality simulation training for laparoscopic skill. Annals of Surgery, 257 (6), 1025–1031.
   PubMed Web of Science ®Google Scholar
• Ganier, F. (2004). Factors affecting the processing of procedural instructions: Implications for document design. IEEE Transactions on Professional Communication, 47 (1), 15–26.
   Web of Science ®Google Scholar
• Ganier, F., Hoareau, C., & Devillers, F. (2013). Évaluation des performances et de la Charge de travail induits par l’apprentissage de procédures de maintenance en environnement virtuel. Le Travail Humain, 76 (4), 335–363.
   Web of Science ®Google Scholar
• Ganier, F., Hoareau, C., & Tisseau, J. (2014). Evaluation of procedural learning transfer from a virtual environment to a real situation: A case study on tank maintenance training. Ergonomics, 57 (6), 828–843.
   PubMed Web of Science ®Google Scholar
• Ginns, P. (2005). Meta-analysis of the modality effect. Learning and Instruction, 15(4), 313–331.
   Web of Science ®Google Scholar
• Girard, C., Ecalle, J., & Magnan, A. (2013). Serious games as new educational tools: How effective are they? A meta-analysis of recent studies. Journal of Computer Assisted Learning, 29 (3), 207–219.
   Web of Science ®Google Scholar
• Greunke, L., & Sadagic, A. (2016). Taking immersive leap in training of landing signal officers. IEEE Transactions on Visualization and Computer Graphics, 22 (4), 1482–1491.
   PubMed Web of Science ®Google Scholar
• Grumbach, A., & Klinger, E. (2007). Virtuel et cognition. Intellectica, 1 (45), 7–22.
   Google Scholar
• Hale, K., & Stanney, K. (2015). Handbook of virtual environments: Design, implementation, and applications. Boca Raton, FL: CRC Press.
   Google Scholar
• Hapeshi, K., & Jones, D. (1992). Interactive multimedia for instruction: A cognitive analysis of the role of audition and vision. International Journal of Human–Computer Interaction, 4 (1), 79–99.
   Google Scholar
• Haskell, R. (2000). Transfer of learning: Cognition, instruction, and reasoning. London, England: Academic Press.
   Google Scholar
• Hasselbring, T., & Sherwood, R. (1987). An evaluation of a level-one instructional videodisc program. Journal of Educational Technology Systems, 16 (2), 151–169.
   Google Scholar
• Heurley, L. (1997). Vers une définition du concept de texte procédural: Le point de vue de la psycholinguistique. Les Cahiers Du Français Contemporain, 4, 109–133.
   Google Scholar
• Heurley, L., & Ganier, F. (2006). L â€TM utilisation des textes procéduraux : Lecture, compréhension et exécution d â€TM instructions écrites. Intellectica, 2 (44), 1–18.
   Google Scholar
• Hoareau, C., Ganier, F., Querrec, R., Corre, F. L., Buche, C., Le Corre, F., & Buche, C. (2013). Evolution of cognitive load when learning a procedure in a virtual environment for training. Presented at International Cognitive Load Theory Conference (pp. 130–132), Toulouse. France.
   Google Scholar
• Huegel, J. C., Celik, O., Israr, A., & O’Malley, M. K. (2009). Expertise-based performance measures in a virtual training environment. Presence: Teleoperators and Virtual Environments, 18 (6), 449–467.
   Web of Science ®Google Scholar
• Jorge, V. A. M., Sarmiento, W. J., Maciel, A., Nedel, L., Collazos, C. A., Faria, F., & Oliveira, J. (2013). Interacting with danger in an immersive environment: Issues on cognitive load and risk perception. Presented at 19th ACM Symposium on Virtual Reality Software and Technology - VRST ’13 (pp. 83–92), Singapore, Singapore.
   Google Scholar
• Jou, M., & Wang, J. (2013, October). Investigation of effects of virtual reality environments on learning performance of technical skills. Computers in Human Behavior, 29 (2), 433–438.
   Web of Science ®Google Scholar
• Kho, R. (2011). Comparison of robotic-assisted laparoscopy versus conventional laparoscopy on skill acquisition and performance. Clinical Obstetrics and Gynecology, 54 (3), 376–381.
   PubMed Web of Science ®Google Scholar
• Kieras, D. E., & Bovair, S. (1986). The acquisition of procedures from text : A production-system analysis of transfer of training. Journal of Memory and Language, 25 (5), 507–524.
   Web of Science ®Google Scholar
• Kim, J. W., Ritter, F. E., & Koubek, R. J. (2013). An integrated theory for improved skill acquisition and retention in the three stages of learning. Ergonomics Science, 14 (1), 22–37.
   Google Scholar
• Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effect of direct instruction and discovery learning. Psychological Science, 15 (10), 661–667.
   PubMed Web of Science ®Google Scholar
• Kozak, J., Hancock, P., Arthur, E., & Chrysler, S. (1993). Transfer of training from virtual reality. Ergonomics, 36 (7), 777–784.
   Web of Science ®Google Scholar
• Lam, C. K., Sundaraj, K., & Sulaiman, M. N. N. (2014). A review of computer-generated simulation in the pedagogy of cataract surgery training and assessment. International Journal of Human–Computer Interaction, 29 (10), 661–669.
   Web of Science ®Google Scholar
• Lave, J. (1988). Cognition in practice: Mind, mathematics and culture in everyday life. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Le Corre, F., Fauvel, C., Hoareau, C., Querrec, R., & Buche, C. (2012, November). Chrysaor: An agent-based intelligent tutoring system in virtual environment. Presented at International Conference on Virtual Learning (pp. 39–45), Brasov, Romania.
   Google Scholar
• Lee, A. (1998). Transfer as a measure of intellectual functioning. Perspectives on Fundamental Processes in Intellectual Functioning: A Survey of Research Approaches, 1, 351–366.
   Google Scholar
• Lee, A., & Pennington, N. (1993). Learning computer programming: A route to general reasoning skills. In C. R. Cook, J. C. Scholtz, & J. C. Spohrer (Eds.), Empirical studies of programmers: Fifth workshop (pp. 113–136). Norwood, NJ: Ablex Publishing Corporation.
   Google Scholar
• Legendre, G., Sahmoune Rachedi, L., Descamps, P., & Fernandez, H. (2014). Apport d’un simulateur virtuel d’anatomie périnéale (Pelvic Mentor) dans l’apprentissage de la pelvi-périnéologie : Résultats d’une étude préliminaire. Journal De Gynecologie, Obstetrique Et Biologie De La Reproduction, 44 (1), 72–77.
   PubMed Web of Science ®Google Scholar
• Littlefield, J., Delclos, V., Bransford, J., Clayton, K., & Franks, J. (1989). Some prerequisites for teaching thinking: Methodological issues in the study of LOGO programming. Cognition and Instruction, 6 (4), 331–366.
   Web of Science ®Google Scholar
• Loukas, C., Nikiteas, N., Kanakis, M., & Georgiou, E. (2011). Evaluating the effectiveness of virtual reality simulation training in intravenous cannulation. Simulation in Healthcare: Journal of the Society for Simulation in Healthcare, 6 (4), 213–217.
   PubMedGoogle Scholar
• Loup-Escande, É., Burkhardt, J.-M., & Richir, S. (2013). Anticiper et évaluer l’utilité dans la conception ergonomique des technologies émergentes: Une revue. Le Travail Humain, 76 (1), 27–55.
   Web of Science ®Google Scholar
• Masciocchi, C., Dark, V., & Parkhurst, D. (2007). Evaluation of virtual reality snowplow simulation training. Ames, IA: Iowa State University.
   Google Scholar
• Mayer, R. E. (2009). Multimedia Learning. Cambridge, UK: Cambridge University Press.
   Google Scholar
• McKeown, M., & Beck, I. (1983). The effects of long-term vocabulary instruction on reading comprehension: A replication. Journal of Literacy Research, 15 (1), 3–18.
   Web of Science ®Google Scholar
• Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40.
   Web of Science ®Google Scholar
• Miles, H., Musembi, N., Pop, S. R., & John, N. W. (2013, October). Investigation of a virtual environment for rugby skills training. Presented at International Conference on Cyberworlds (pp. 56–63), Yokohama, Japan.
   Google Scholar
• Moskaliuk, J., Bertram, J., & Cress, U. (2013). Training in virtual environments: Putting theory into practice. Ergonomics, 56 (2), 195–204.
   PubMed Web of Science ®Google Scholar
• Mousavi, S., Low, R., & Sweller, J. (1995). Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology, 87(2), 319–334.
   Web of Science ®Google Scholar
• Oren, M., Carlson, P., Gilbert, S., & Vance, J. M. (2012, March). Puzzle assembly training: Real world vs. virtual environment. Presented at IEEE virtual reality (pp. 27–30), Iowa.
   Google Scholar
• Paiva, P. V. D. F., Machado, L. S., & Valenca, A. M. G. (2013, May). A virtual environment for training and assessment of surgical teams. Presented at 2013 XV Symposium on Virtual and Augmented Reality (pp. 17–26), Cuiabá, Brazil.
   Google Scholar
• Park, C.-H., Jang, G., & Chai, Y.-H. (2006). Development of a virtual reality training system for live-line workers. International Journal of Human–Computer Interaction, 20 (3), 285–303.
   Web of Science ®Google Scholar
• Pennington, N., Nicolich, R., & Rahm, J. (1995). Transfer of training between cognitive subskills: Is knowledge use specific? Cognitive Psychology, 28, 175–224.
   Web of Science ®Google Scholar
• Perkins, D., & Salomon, G. (1992). The science and art of transfer. In A. L. Costa, J. A. Bellanca, & R. Fogarty (Eds.), If minds matter: A foreword to the future (pp. 201–210). Oxford, England.
   Google Scholar
• Presseau, A. (2000). Analyse de l ’ efficacité d ’ interventions sur le transfert des apprentissages en mathématiques. Revue Des Sciences De L’éducation, XXVI(3), 515–544.
   Google Scholar
• Rauter, G., Sigrist, R., Koch, C., & Crivelli, F. (2013). Transfer of complex skill learning from virtual to real rowing. Plos ONE, 8 (12), 1–18.
   Web of Science ®Google Scholar
• Raynal, F., & Rieunier, A. (2012). Pédagogie: Dictionnaire des concepts clés: Apprentissages, formation, psychologie cognitive (9ème ed.). Issy-les-Moulineaux, France: ESF éditeur.
   Google Scholar
• Rose, F., Attree, E., Brooks, B. M., Parslow, D. M., Penn, P. R., & Ambihaipahan, N. (1998). Transfer of training from virtual to real environments. Presented at 2nd European Conference on Disability, Virtual Reality and Associated Technologies (pp. 69–75), Skövde, Sweden.
   Google Scholar
• Rose, F., Brooks, B. M., Parslow, D. M., Penn, P. R., Ambihaipahan, N., Attree, E., … Penn, P. R. (2000, September). Training in virtual environments: Transfer to real world tasks and equivalence to real training. Ergonomics, 43 (4), 494–511.
   PubMed Web of Science ®Google Scholar
• Rouet, J.-F. (2005). La conception des ressources multimédias pour l’apprentissage: Apports des recherches en psychologie du langage. Revue Française De Pédagogie, 152, 79–87.
   Google Scholar
• Singley, M., & Anderson, J. (1987). A keystroke analysis of learning and transfer in text editing. Human–Computer Interaction, 3 (3), 223–274.
   Google Scholar
• Spruit, E. N., Band, G. P. H., Hamming, J. F., & Ridderinkhof, K. R. (2014). Optimal training design for procedural motor skills: A review and application to laparoscopic surgery. Psychological Research, 78 (6), 878–891.
   PubMed Web of Science ®Google Scholar
• Tardif, J. (1999). Le transfert des apprentissages. Montreal, Canada: Editions Logiques.
   Google Scholar
• Thorndike, E., & Woodworth, R. (1901). The influence of improvement in one mental function upon the efficiency of other functions: III. Functions involving attention, observation and discrimination. Psychological Review, 8 (6), 247–261.
   Google Scholar
• Wenger, E., & Lave, J. (1991). Situated learning: Legitimate peripheral participation (Learning in doing: Social, cognitive and computational perspectives). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Witmer, B., & Singer, M. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7 (3), 225–240.
   Web of Science ®Google Scholar
• Wrzesien, M., & Raya, M. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education, 55 (1), 178–187.
   Web of Science ®Google Scholar