Using Knowledge Construction Theory to Evaluate Learning Processes: A Randomized Controlled Trial on Showing Gradually Built-up Concept Maps Alongside a Scientific Text

References

• Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2016). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed., pp. 522–560). Routledge.
   Google Scholar
• Allen, M. J., & Yen, W. M. (2002). Introduction to measurement theory (reissued ed.). Waveland Press.
   Google Scholar
• American Psychological Association (2018, April). APA dictionary of psychology. Retrieved September 6, 2023, from https://dictionary.apa.org/
   Google Scholar
• Austin, P. C., & Brunner, L. J. (2003, May) Type I error inflation in the presence of a ceiling effect. The American Statistician, 57(2), 97–104. https://doi.org/10.1198/0003130031450
   Web of Science ®Google Scholar
• Brysbaert, M. (2019). How many words do we read per minute? A review and meta-analysis of reading rate. Journal of Memory and Language, 109, 104047. https://doi.org/10.1016/j.jml.2019.104047
   Web of Science ®Google Scholar
• Burton-Jones, A., & Meso, P. (2008). The effects of decomposition quality and multiple forms of information on novices’ understanding of a domain from a conceptual model. Journal of the Association for Information Systems, 9(12), 748–802. https://doi.org/10.17705/1jais.00179
   Web of Science ®Google Scholar
• Cambridge University Press & Assessment (2017a, October). The Cambridge English Scale. Retrieved from https://www.cambridgeenglish.org/exams-and-tests/cambridge-english-scale/
   Google Scholar
• Cambridge University Press & Assessment (2017b, January). General English – Test your English. Retrieved from https://www.cambridgeenglish.org/test-your-english/general-english/
   Google Scholar
• Cañas, A. J., Carff, R., Hill, G., Carvalho, M., Arguedas, M., Eskridge, T. C., … Carvajal, R. (2005). Concept maps: Integrating knowledge and information visualization. In Knowledge and information visualization (pp. 205–219). Springer.
   Google Scholar
• Castle, K. (1997). Constructing knowledge of constructivism. Journal of Early Childhood Teacher Education, 18(1), 55–67. https://doi.org/10.1080/10901029708549137
   Google Scholar
• Chan, J. C., & McDermott, K. B. (2007). The testing effect in recognition memory: A dual process account. Journal of Experimental Psychology. Learning, Memory, and Cognition, 33(2), 431–437. https://doi.org/10.1037/0278-7393.33.2.431
   PubMed Web of Science ®Google Scholar
• Chang, K.-E., Sung, Y.-T., & Chen, S.-F. (2001). Learning through computer-based concept mapping with scaffolding aid. Journal of Computer Assisted Learning, 17(1), 21–33. https://doi.org/10.1111/j.1365-2729.2001.00156.x
   Web of Science ®Google Scholar
• Chang, S.-F., Smith, J. R., Beigi, M., & Benitez, A. (1997). Visual information retrieval from large distributed online repositories. Communications of the ACM, 40(12), 63–71. https://doi.org/10.1145/265563.265573
   Web of Science ®Google Scholar
• Chen, C. (2013). Mapping scientific frontiers: The quest for knowledge visualization. Springer Science & Business Media.
   Google Scholar
• Chevalier, F., Dragicevic, P., Bezerianos, A., & Fekete, J.-D. (2010). Using text animated transitions to support navigation in document histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 683–692). Association for Computing Machinery. https://doi.org/10.1145/1753326.1753427
   Google Scholar
• Collins, B., & Nyenhuis, R. (2021). The effectiveness of concept maps for students’ learning and retention. Journal of Political Science Education, 17(sup1), 897–909. https://doi.org/10.1080/15512169.2020.1775090
   Web of Science ®Google Scholar
• Council of Europe, Council for Cultural Co-operation, Education Committee, Modern Languages Division (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge University Press.
   Google Scholar
• Cress, U., & Kimmerle, J. (2008). A systemic and cognitive view on collaborative knowledge building with wikis. International Journal of Computer-Supported Collaborative Learning, 3(2), 105–122. https://doi.org/10.1007/s11412-007-9035-z
   Web of Science ®Google Scholar
• D’Mello, S., & Graesser, A. (2013). Autotutor and affective autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back. ACM Transactions on Interactive Intelligent Systems, 2(4), 1–39. https://doi.org/10.1145/2395123.2395128
   Google Scholar
• Disch, L., Fessl, A., & Pammer-Schindler, V. (2022). Designing for knowledge construction to facilitate the uptake of open science: Laying out the design space. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1–16). https://doi.org/10.1145/3491102.3517450
   Google Scholar
• Dole, J. A., & Sinatra, G. M. (1998). Reconceptalizing change in the cognitive construction of knowledge. Educational Psychologist, 33(2–3), 109–128. https://doi.org/10.1207/s15326985ep3302&3_5
   Web of Science ®Google Scholar
• Edmondson, K. M. (2005). Chapter 2 – Assessing science understanding through concept maps. In J. J. Mintzes, J. H. Wandersee, & J. D. Novak (Eds.), Assessing science understanding (pp. 15–40). Academic Press.
   Google Scholar
• Eerland, A., Guadalupe, T. M., & Zwaan, R. A. (2011). Leaning to the left makes the Eiffel tower seem smaller: Posture-modulated estimation. Psychological Science, 22(12), 1511–1514. https://doi.org/10.1177/0956797611420731
   PubMed Web of Science ®Google Scholar
• Eppler, M. J. (2006). A comparison between concept maps, mind maps, conceptual diagrams, and visual metaphors as complementary tools for knowledge construction and sharing. Information Visualization, 5(3), 202–210. https://doi.org/10.1057/palgrave.ivs.9500131
   Google Scholar
• Falke, T. (2019). Automatic structured text summarization with concept maps.
   Google Scholar
• Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using g* power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
   PubMed Web of Science ®Google Scholar
• Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G* power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/bf03193146
   PubMed Web of Science ®Google Scholar
• Fischer, F., Bruhn, J., Gräsel, C., & Mandl, H. (2002). Fostering collaborative knowledge construction with visualization tools. Learning and Instruction, 12(2), 213–232. https://doi.org/10.1016/S0959-4752(01)00005-6
   Web of Science ®Google Scholar
• Fischer, G. (2001). User modeling in human–computer interaction. User Modeling and User-Adapted Interaction, 11(1/2), 65–86. https://doi.org/10.1023/A:1011145532042
   Web of Science ®Google Scholar
• Flemming, D., Kimmerle, J., Cress, U., & Sinatra, G. M. (2020). Research is tentative, but that’s okay: Overcoming misconceptions about scientific tentativeness through refutation texts. Discourse Processes, 57(1), 17–35. https://doi.org/10.1080/0163853X.2019.1629805
   Web of Science ®Google Scholar
• Gunawardena, C. N., Lowe, C. A., & Anderson, T. (1997). Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research, 17(4), 397–431. https://doi.org/10.2190/7MQV-X9UJ-C7Q3-NRAG
   Web of Science ®Google Scholar
• Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255–282. https://doi.org/10.1007/BF02288892
   PubMed Web of Science ®Google Scholar
• Hammadou, J. (1991). Interrelationships among prior knowledge, inference, and language proficiency in foreign language reading. The Modern Language Journal, 75(1), 27–38. https://doi.org/10.1111/j.1540-4781.1991.tb01080.x
   Web of Science ®Google Scholar
• Harbarth, L., Delsing, S., Richtscheid, F., Yücepur, V., Feldmann, F., Akhavanfarm, M., Manske, S., Othlinghaus, J., & Hoppe, H. U. (2018). Learning by tagging–supporting constructive learning in video-based environments. DeLFI 2018-Die 16. E-Learning Fachtagung Informatik.
   Google Scholar
• Hicks, M. (2009). Perceptual and design principles for effective interactive visualisations. In Trends in interactive visualization (pp. 155–174). Springer.
   Google Scholar
• Hmelo-Silver, C. E. (2003). Analyzing collaborative knowledge construction: Multiple methods for integrated understanding. Computers & Education, 41(4), 397–420. https://doi.org/10.1016/j.compedu.2003.07.001
   Web of Science ®Google Scholar
• Jankowski, J., Samp, K., Irzynska, I., Jozwowicz, M., & Decker, S. (2010). Integrating text with video and 3D graphics: The effects of text drawing styles on text readability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1321–1330). Association for Computing Machinery.
   Google Scholar
• Kimmerle, J., Moskaliuk, J., Oeberst, A., & Cress, U. (2015). Learning and collective knowledge construction with social media: A process-oriented perspective. Educational Psychologist, 50(2), 120–137. https://doi.org/10.1080/00461520.2015.1036273
   PubMed Web of Science ®Google Scholar
• Kline, P. (2013). Handbook of psychological testing. Routledge.
   Google Scholar
• Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
   PubMed Web of Science ®Google Scholar
• Kowata, J. H., Cury, D., Boeres, M. (2010). A review of semi-automatic approaches to build concept maps. In Proceedings of 4th International Conference on Concept Mapping(pp. 40–48).
   Google Scholar
• Liaw, S.-S., & Huang, H.-M. (2006). Information retrieval from the world wide web: A user-focused approach based on individual experience with search engines. Computers in Human Behavior, 22(3), 501–517. https://doi.org/10.1016/j.chb.2004.10.007
   Web of Science ®Google Scholar
• Liaw, S.-S., Hatala, M., & Huang, H.-M. (2010). Investigating acceptance toward mobile learning to assist individual knowledge management: Based on activity theory approach. Computers & Education, 54(2), 446–454. https://doi.org/10.1016/j.compedu.2009.08.029
   Web of Science ®Google Scholar
• Liu, P., Li, F., & Yang, Z. (2020). A grounded theory approach for modelling the knowledge construction process in exploratory search. In JCDL '20: The ACM/IEEE Joint Conference on Digital Libraries in 2020 (pp. 409–412). Association for Computing Machinery. https://doi.org/10.1145/3383583.3398600
   Google Scholar
• McNamara, D. S. (2007). Reading comprehension strategies: Theories, interventions, and technologies. Psychology Press.
   Google Scholar
• Medin, D. L. (1989). Concepts and conceptual structure. The American Psychologist, 44(12), 1469–1481. https://doi.org/10.1037/0003-066x.44.12.1469
   PubMed Web of Science ®Google Scholar
• Morsi, R., Ibrahim, W., Williams, F. (2007). Concept maps: Development and validation of engineering curricula. In 2007 37th Annual Frontiers in Education Conference-Global Engineering: Knowledge without Borders, Opportunities without Passports (pp. T3H–T18).
   Google Scholar
• Nesbit, J. C., & Adesope, O. O. (2006). Learning with concept and knowledge maps: A meta-analysis. Review of Educational Research, 76(3), 413–448. https://doi.org/10.3102/00346543076003413
   Web of Science ®Google Scholar
• Novak, J. D. (1993). Human constructivism: A unification of psychological and epistemological phenomena in meaning making. International Journal of Personal Construct Psychology, 6(2), 167–193. https://doi.org/10.1080/08936039308404338
   Google Scholar
• Novak, J. D., & Cañas, A. J. (2006). The theory underlying concept maps and how to construct them. Florida Institute for Human and Machine Cognition, 1(1), 1–31. https://cmap.ihmc.us/Publications/ResearchPapers/TheoryUnderlyingConceptMaps.pdf
   Google Scholar
• Novak, J. D., & Gowin, D. B. (1984). Learning how to learn. Cambridge University Press.
   Google Scholar
• O’Donnell, A. M., Dansereau, D. F., & Hall, R. H. (2002). Knowledge maps as scaffolds for cognitive processing. Educational Psychology Review, 14(1), 71–86. https://doi.org/10.1023/A:1013132527007
   Web of Science ®Google Scholar
• Padilla, S., Methven, T. S., Robb, D. A., & Chantler, M. J. (2017). Understanding concept maps: A closer look at how people organise ideas. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 815–827). Association for Computing Machinery.
   Google Scholar
• Plavén-Sigray, P., Matheson, G. J., Schiffler, B. C., & Thompson, W. H. (2017, September). Research: The readability of scientific texts is decreasing over time. eLife, 6(1), 1–14. https://doi.org/10.7554/eLife.27725
   Google Scholar
• Presch, C. (2020). [Semi-automatic creation of concept maps] [Unpublished master’s thesis]. Research Unit of Computer Graphics, Institute of Visual Computing and Human-Centered Technology, Faculty of Informatics, TU Wien.
   Google Scholar
• Restle, F. (1970). Speed of adding and comparing numbers. Journal of Experimental Psychology, 83(2, Pt.1), 274–278. https://doi.org/10.1037/h0028573
   Google Scholar
• Revelle, W. (2023). psych: Procedures for psychological, psychometric, and personality research [Computer software manual] (R package version 2.3.6). Retrieved from https://CRAN.R-project.org/package=psych
   Google Scholar
• Rowan, K. E. (1991). When simple language fails: Presenting difficult science to the public. Journal of Technical Writing and Communication, 21(4), 369–382. https://doi.org/10.2190/D3BD-32RC-FGW0-C5JB
   Google Scholar
• Salita, J. T. (2015). Writing for lay audiences: A challenge for scientists. Medical Writing, 24(4), 183–189. https://doi.org/10.1179/2047480615Z.000000000320
   Google Scholar
• Serafini, F. (2015). Multimodal literacy: From theories to practices. Language Arts, 92(6), 412–423. http://www.jstor.org/stable/24577533
   Google Scholar
• Shams, L., & Seitz, A. R. (2008). Benefits of multisensory learning. Trends in Cognitive Sciences, 12(11), 411–417. https://doi.org/10.1016/j.tics.2008.07.006
   PubMed Web of Science ®Google Scholar
• Stahl, G. (2000). A model of collaborative knowledge-building. In Fourth International Conference of the Learning Sciences(Vol. 10, pp. 70–77).
   Google Scholar
• Sultanum, N., Brudno, M., Wigdor, D., & Chevalier, F. (2018). More text please! Understanding and supporting the use of visualization for clinical text overview. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–13). Association for Computing Machinery.
   Google Scholar
• Sun, L., Williams, S., & Liu, K. (2004). Knowledge construction in e-learning: Designing an e-learning environment. In Enterprise information systems v (pp. 308–315). Springer.
   Google Scholar
• Suthers, D., Vatrapu, R., Medina, R., Joseph, S., & Dwyer, N. (2007). Conceptual representations enhance knowledge construction in asynchronous collaboration. In Proceedings of the 8th International Conference on Computer Supported Collaborative Learning (pp. 705–714). International Society of the Learning Sciences. https://doi.org/10.3115/1599600.1599729
   Google Scholar
• Sweller, J., Chandler, P., Tierney, P., & Cooper, M. (1990). Cognitive load as a factor in the structuring of technical material. Journal of Experimental Psychology: General, 119(2), 176–192. https://doi.org/10.1037/0096-3445.119.2.176
   Web of Science ®Google Scholar
• Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131. https://doi.org/10.1126/science.185.4157.1124
   PubMed Web of Science ®Google Scholar
• Uttl, B. (2005). Measurement of individual differences: Lessons from memory assessment in research and clinical practice. Psychological Science, 16(6), 460–467. https://doi.org/10.1111/j.0956-7976.2005.01557.x
   PubMed Web of Science ®Google Scholar
• Valerio, A., Leake, D. B., & Canas, A. J. (2012). Using automatically generated concept maps for document understanding: A human subjects experiment. In 5th International Conference on Concept Mapping.
   Google Scholar
• van Aalst, J. (2009). Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses. International Journal of Computer-Supported Collaborative Learning, 4(3), 259–287. https://doi.org/10.1007/s11412-009-9069-5
   PubMed Web of Science ®Google Scholar
• Vicente-Saez, R., & Martinez-Fuentes, C. (2018). Open science now: A systematic literature review for an integrated definition. Journal of Business Research, 88, 428–436. https://doi.org/10.1016/j.jbusres.2017.12.043
   Web of Science ®Google Scholar
• Wang, L., Zhang, Z., McArdle, J. J., & Salthouse, T. A. (2008). Investigating ceiling effects in longitudinal data analysis. Multivariate Behavioral Research, 43(3), 476–496. https://doi.org/10.1080/00273170802285941
   Web of Science ®Google Scholar
• Webb, S. A. (2012). Receptive learning. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 2783–2785). Springer US.
   Google Scholar
• Wharton Credibility Lab-University of Pennsylvania (2015). Aspredicted. Retrieved from https://aspredicted.org/
   Google Scholar
• Yildiz, I. G. (2015). Sample scientific texts analysis through textlinguistic approach. ELT Research Journal, 4(4), 257. https://dergipark.org.tr/tr/download/article-file/296314
   Google Scholar
• Zouaq, A., & Nkambou, R. (2008). Building domain ontologies from text for educational purposes. IEEE Transactions on Learning Technologies, 1(1), 49–62. https://doi.org/10.1109/TLT.2008.12
   Web of Science ®Google Scholar
• Zouaq, A., & Nkambou, R. (2009). Evaluating the generation of domain ontologies in the knowledge puzzle project. IEEE Transactions on Knowledge and Data Engineering, 21(11), 1559–1572. https://doi.org/10.1109/TKDE.2009.25
   Web of Science ®Google Scholar