107
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Knowledge-Aware Learning Framework Based on Schema Theory to Complement Large Learning Models

, , &

References

  • Abbasi, A.; and Chen, H. CyberGate: A design framework and system for text analysis of computer-mediated communication. MIS Quarterly, 32, 4 (2008), 811–837.
  • Aizawa, A. An information-theoretic perspective of tf–idf measures. Information Processing & Management, 39, 1 (2003), 45–65.
  • Alba, J.W.; and Hasher, L. Is memory schematic? Psychological Bulletin, 93, 2 (1983), 203–231.
  • Alexander, P.A.; and Judy, J.E. The interaction of domain-specific and strategic knowledge in academic performance. Review of Educational Research, 58, 4 (1988), 375–404.
  • An, S. Schema Theory in Reading. Theory & Practice in Language Studies, 3, 1 (2013), 130–134.
  • Anderson, R.C. Schema-directed processes in language comprehension. In A.M. Lesgold, J.W. Pellegrino, S.D. Fokkema, and R. Glaser (eds.), Cognitive Psychology and Instruction. New York: Springer, 1978, pp. 67–82.
  • Anderson, R.C. The notion of schemata and the educational enterprise: General discussion of the conference. In R.C. Anderson, R.J. Spiro, and W.E. Montague (eds.), Schooling and the Acquisition of Knowledge. London: Routledge, 2017, pp. 415–431.
  • Anderson, R.C.; and Pearson, P.D. A schema-theoretic view of basic processes in reading comprehension. Handbook of Reading Research, 1 (1984), 255–291.
  • Anderson, R.C.; Spiro, R.J.; and Anderson, M.C. Schemata as scaffolding for the representation of information in connected discourse. American Educational Research Journal, 15, 3 (1978), 433–440.
  • Apeldoorn, D.; and Kern-Isberner, G. When should learning agents switch to explicit knowledge? In C. Benzmüller, G. Sutcliffe, and R. Rojas (eds.), Global Conference on Artificial Intelligence (GCAI), Berlin, 2016, pp. 174–186.
  • Arbib, M.A. Schema theory. The Encyclopedia of Artificial Intelligence, 2 (1992), 1427–1443.
  • Batmanghelich, K.; Saeedi, A.; Narasimhan, K.; and Gershman, S. Nonparametric spherical topic modeling with word embeddings. In K. Erk, and N.A. Smith (eds.), Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin: Association of Computational Linguistics, 2016, pp. 537–542.
  • Baxter, G.P.; Elder, A.D.; and Glaser, R. Knowledge-based cognition and performance assessment in the science classroom. Educational Psychologist, 31, 2 (1996), 133–140.
  • Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; and Yakhnenko, O. Translating embeddings for modeling multi-relational data. In C.J. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K.Q. Weinberger (eds.), Advances in Neural Information Processing Systems. Lake Tahoe. 2013, pp. 2787–2795.
  • Boyd-Graber, J.; Mimno, D.; and Newman, D. Care and feeding of topic models: Problems, diagnostics, and improvements. In E.M. Airoldi, D. Blei, E.A. Erosheva, and S.E. Fienberg (eds.), Handbook of Mixed Membership Models and Their Applications, New York: Chapman and Hall/CRC, 2014, pp. 3–41.
  • Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; and Askell, A. Language models are few-shot learners. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (eds.), Advances in Neural Information Processing Systems. Virtual, 2020, pp. 1877–1901.
  • Carrell, P.L.; and Eisterhold, J.C. Schema theory and ESL reading pedagogy. TESOL Quarterly, 17, 4 (1983), 553–573.
  • Chen, Q.; Zhu, X.; Ling, Z.-H.; Inkpen, D.; and Wei, S. Neural natural language inference models enhanced with external knowledge. arXiv preprint arXiv:1711.04289 (2017).
  • Chi, M.T. Knowledge development and memory performance. In M.P. Friedman, J.P. Das, and N. O’Connor (eds.), Intelligence and Learning. Springer, 1981, pp. 221–229.
  • De Jong, T.; and Ferguson-Hessler, M.G. Types and qualities of knowledge. Educational Psychologist, 31, 2 (1996), 105–113.
  • Dellermann, D.; Ebel, P.; Söllner, M.; and Leimeister, J.M. Hybrid intelligence. Business & Information Systems Engineering, 61, 5 (2019), 637–643.
  • Devlin, J.; Chang, M.-W.; Lee, K.; and Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
  • Dienes, Z.; and Perner, J. A theory of implicit and explicit knowledge. Behavioral and Brain Sciences, 22, 5 (1999), 735–808.
  • Dong, Q.; Liu, Y.; Cheng, S.; Wang, S.; Cheng, Z.; Niu, S.; and Yin, D. Incorporating explicit knowledge in pre-trained language models for passage re-ranking. arXiv preprint arXiv:2204.11673 (2022).
  • Dorsey, D.W.; Campbell, G.E.; Foster, L.L.; and Miles, D.E. Assessing knowledge structures: Relations with experience and posttraining performance. Human Performance, 12, 1 (1999), 31–57.
  • Faust, O.; Hagiwara, Y.; Hong, T.J.; Lih, O.S.; and Acharya, U.R. Deep learning for healthcare applications based on physiological signals: A review. Computer Methods and Programs in Biomedicine, 161 (2018), 1–13.
  • Firestone, C. Performance vs. competence in human–machine comparisons. Proceedings of the National Academy of Sciences, 117, 43 (2020), 26562–26571.
  • Floridi, L. AI as agency without intelligence: On ChatGPT, large language models, and other generative models. Philosophy & Technology, 36, 1 (2023), 15–21.
  • Forbus, K.D.; and Hinrichs, T.R. Companion cognitive systems: A step toward Human-Level AI. AI Magazine, 27, 2 (2006), 83–83.
  • Gilakjani, A.P.; and Ahmadi, S.M. The relationship between L2 reading comprehension and schema theory: A matter of text familiarity. International Journal of Information and Education Technology, 1, 2 (2011), 142–149.
  • Gregor, S.; and Hevner, A.R. Positioning and presenting design science research for maximum impact. MIS Quarterly, 37, 2 (2013), 337–355.
  • Halkias, G. Mental representation of brands: A schema-based approach to consumers’ organization of market knowledge. Journal of Product & Brand Management, 24, 5 (2015), 438–448.
  • He, P.; Liu, X.; Gao, J.; and Chen, W. Deberta: Decoding-enhanced bert with disentangled attention. arXiv preprintarXiv:2006.03654 (2020).
  • Hern, A. ‘What should the limits be?’ The father of ChatGPT on whether AI will save humanity – or destroy it. 2023. https://www.theguardian.com/technology/2023/jun/07/what-should-the-limits-be-the-father-of-chatgpt-on-whether-ai-will-save-humanity-or-destroy-it (accessed August 30, 2023).
  • Hevner, A.; and Chatterjee, S. Design science research in information systems. In A. Hevner and S. Chatterjee (eds.), Design Research in Information Systems. Springer, 2010, pp. 9–22.
  • Hevner, A.R.; March, S.T.; Park, J.; and Ram, S. Design science in information systems research. MIS Quarterly, 28, 1 (2004), 75–105.
  • Hu, L.; Liu, Z.; Zhao, Z.; Hou, L.; Nie, L.; and Li, J. A survey of knowledge enhanced pre-trained language models. IEEE Transactions on Knowledge and Data Engineering, (2023), 1–19.
  • Ji, S.; Pan, S.; Cambria, E.; Marttinen, P.; and Philip, S.Y. A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Transactions on Neural Networks and Learning Systems, 33, 2 (2021), 494–514.
  • Ji, S.; Pan, S.; Cambria, E.; Marttinen, P.; and Philip, S.Y. A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Transactions on Neural Networks and Learning Systems, (2021), 494–514.
  • Jin, Y.; Lee, H.C.B.; Ba, S.; and Stallaert, J. Winning by learning? Effect of knowledge sharing in crowdsourcing contests. Information Systems Research, 32, 3 (2021), 836–859.
  • Johnson, M.; Albizri, A.; Harfouche, A.; and Fosso-Wamba, S. Integrating human knowledge into artificial intelligence for complex and ill-structured problems: Informed artificial intelligence. International Journal of Information Management, 64 (2022), 102479.
  • Johnson, M.; Murthy, D.; Robertson, B.W.; Smith, W.R.; and Stephens, K.K. Moving Emergency Response Forward: Leveraging Machine-Learning Classification of Disaster-Related Images Posted on Social Media. Journal of Management Information Systems, 40, 1 (2023), 163–182.
  • Jonassen, D.H.; Yacci, M., and Beissner, K. Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge. New York: Routledge, 2013.
  • Kang, B.; Liu, Z.; Wang, X.; Yu, F.; Feng, J.; and Darrell, T. Few-shot object detection via feature reweighting. Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019, 8420–8429.
  • Kim, J.U.; and Kishore, R. Do we fully understand information systems failure? An exploratory study of the cognitive schema of IS professionals. Information Systems Frontiers, 21, 6 (2019), 1385–1419.
  • Kipf, T.N.; and Welling, M. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).
  • Knight, W. OpenAI’s CEO Says the Age of Giant AI Models Is Already Over. 2023. https://www.wired.com/story/openai-ceo-sam-altman-the-age-of-giant-ai-models-is-already-over/ (accessed August 30, 2023).
  • Lake, B.M.; Ullman, T.D.; Tenenbaum, J.B.; and Gershman, S.J. Building machines that learn and think like people. Behavioral and Brain Sciences, 40 (2017), 1–72.
  • Lau, J.H.; Baldwin, T.; and Newman, D. On collocations and topic models. ACM Transactions on Speech and Language Processing (TSLP), 10, 3 (2013), 1–14.
  • LeCun, Y.; Bengio, Y.; and Hinton, G. Deep learning. Nature, 521, 7553 (2015), 436–444.
  • Li, J.; Larsen, K.; and Abbasi, A. TheoryOn: A design framework and system for unlocking behavioral knowledge through ontology learning. MIS Quarterly, 44, 4 (2020), 1733–1772.
  • Li, X.-H.; Cao, C.C.; Shi, Y.; Bai, W.; Gao, H.; Qiu, L.; Wang, C.; Gao, Y.; Zhang, S.; and Xue, X. A survey of data-driven and knowledge-aware explainable ai. IEEE Transactions on Knowledge and Data Engineering, 34, 1 (2020), 29–49.
  • Li, Z.; Liu, H.; Zhang, Z.; Liu, T.; and Xiong, N.N. Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Transactions on Neural Networks and Learning Systems (2021), 3961–3973.
  • Lieto, A. Cognitive Design for Artificial Minds. London: Routledge, 2021.
  • Lim, S.Y.; Jarvenpaa, S.L.; and Lanham, H.J. Barriers to interorganizational knowledge transfer in post-hospital care transitions: Review and directions for information systems research. Journal of Management Information Systems, 32, 3 (2015), 48–74.
  • Lin, B.Y.; Chen, X.; Chen, J.; and Ren, X. Kagnet: Knowledge-aware graph networks for commonsense reasoning. arXiv preprint arXiv:1909.02151 (2019).
  • Lin, J.; Zhao, Y.; Huang, W.; Liu, C.; and Pu, H. Domain knowledge graph-based research progress of knowledge representation. Neural Computing and Applications, 33 (2021), 681–690.
  • Liu, Y. An empirical study of schema theory and its role in reading comprehension. Journal of Language Teaching and Research, 6, 6 (2015), 1349–1356.
  • Lin, Y.; Meng, Y.; Sun, X.; Han, Q.; Kuang, K.; Li, J.; and Wu, F. Bertgcn: Transductive text classification by combining gcn and bert. arXiv preprint arXiv:2105.05727 (2021).
  • Liu, Y.; Ott, M.; Goyal, N.; Du, J.; Joshi, M.; Chen, D.; Levy, O.; Lewis, M.; Zettlemoyer, L.; and Stoyanov, V. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019).
  • Ma, T.; Huang, L.; Lu, Q.; and Hu, S. Kr-gcn: Knowledge-aware reasoning with graph convolution network for explainable recommendation. ACM Transactions on Information Systems, 41, 1 (2023), 1–27.
  • Marino, K.; Chen, X.; Parikh, D.; Gupta, A.; and Rohrbach, M. Krisp: Integrating implicit and symbolic knowledge for open-domain knowledge-based vqa. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville, 2021, 14111–14121.
  • Marshall, S.P. Assessing schema knowledge. In N. Frederiksen, R.J. Mislevy, I.I. Bejar (eds.), Test Theory for a New Generation of Tests. New York, London: Routledge, 2012, pp. 155–180.
  • Meyer, D. OpenAI’s Sam Altman says giant A.I. models are over—but going small won’t appease regulators. 2023. https://finance.yahoo.com/news/openai-sam-altman-says-giant-164924270.html (accessed August 30, 2023).
  • Min, B.; Ross, H.; Sulem, E.; Veyseh, A.P.B.; Nguyen, T.H.; Sainz, O.; Agirre, E.; Heintz, I.; and Roth, D. Recent advances in natural language processing via large pre-trained language models: A survey. ACM Computing Surveys, 56, 2 (2021), 1–40.
  • Mohamed, S.K.; Nováček, V.; and Nounu, A. Discovering protein drug targets using knowledge graph embeddings. Bioinformatics, 36, 2 (2020), 603–610.
  • Nassaji, H. Schema theory and knowledge‐based processes in second language reading comprehension: A need for alternative perspectives. Language Learning, 52, 2 (2002), 439–481.
  • Nickel, M.; Murphy, K.; Tresp, V.; and Gabrilovich, E. A review of relational machine learning for knowledge graphs. Proceedings of the IEEE, 104, 1 (2015), 11–33.
  • Nishida, H. A cognitive approach to intercultural communication based on schema theory. International Journal of Intercultural Relations, 23, 5 (1999), 753–777.
  • Nissen, M.E. Dynamic knowledge patterns to inform design: A field study of knowledge stocks and flows in an extreme organization. Journal of Management Information Systems, 22, 3 (2005), 225–263.
  • Ozmen Garibay, O.; Winslow, B.; Andolina, S.; Antona, M.; Bodenschatz, A.; Coursaris, C.; Falco, G.; Fiore, S.M.; Garibay, I.; and Grieman, K. Six human-centered artificial intelligence grand challenges. International Journal of Human–Computer Interaction, 39, 3 (2023), 391–437.
  • Pan, S.; Luo, L.; Wang, Y.; Chen, C.; Wang, J.; and Wu, X. Unifying large language models and knowledge graphs: A roadmap. IEEE Transactions on Knowledge and Data Engineering, 99 (2024), 1–20.
  • Pan, S.J.; and Yang, Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22, 10 (2009), 1345–1359.
  • Peng, G.; Dey, D.; and Lahiri, A. Healthcare IT adoption: An analysis of knowledge transfer in socioeconomic networks. Journal of Management Information Systems, 31, 3 (2014), 7–34.
  • Pennington, J.; Socher, R.; and Manning, C.D. Glove: Global vectors for word representation. In A. Moschitti, B. Pang, and W. Daelemans.(eds.), Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha: Association of Computational Linguistics, 2014, pp. 1532–1543.
  • Perrigo, B. The A to Z of Artificial Intelligence. 2023. https://time.com/6271657/a-to-z-of-artificial-intelligence/ (accessed August 30, 2023).
  • Pilault, J.; Elhattami, A.; and Pal, C. Conditionally adaptive multi-task learning: Improving transfer learning in nlp using fewer parameters & less data. arXiv preprint arXiv:2009.09139 (2020).
  • Revilla, E.; Saenz, M.J.; Seifert, M.; and Ma, Y. Human–artificial intelligence collaboration in prediction: A field experiment in the retail industry. Journal of Management Information Systems, 40, 4 (2023), 1071–1098.
  • Rumelhart, D.E.; and Ortony, A. The representation of knowledge in memory. Schooling and the Acquisition of Knowledge, (1977), 99–135.
  • Sadoski, M.; Paivio, A.; and Goetz, E.T. Commentary: A critique of schema theory in reading and a dual coding alternative. Reading Research Quarterly (1991), 463–484.
  • Samtani, S.; Zhu, H.; Padmanabhan, B.; Chai, Y.; Chen, H.; and Nunamaker Jr, J.F. Deep learning for information systems research. Journal of Management Information Systems, 40, 1 (2023), 271–301.
  • Sap, M.; Le Bras, R.; Allaway, E.; Bhagavatula, C.; Lourie, N.; Rashkin, H.; Roof, B.; Smith, N.A.; and Choi, Y. Atomic: An atlas of machine commonsense for if-then reasoning. Proceedings of the AAAI Conference on Artificial Intelligence. San Francisco: AAAI Press, 2019, pp. 3027–3035.
  • Saxe, A.; Nelli, S.; and Summerfield, C. If deep learning is the answer, what is the question? Nature Reviews Neuroscience, 22, 1 (2021), 55–67.
  • Schneider, M.; Rittle-Johnson, B.; and Star, J.R. Relations among conceptual knowledge, procedural knowledge, and procedural flexibility in two samples differing in prior knowledge. Developmental Psychology, 47, 6 (2011), 1525–1538.
  • Shah, S.; Mishra, A.; Yadati, N.; and Talukdar, P.P. Kvqa: Knowledge-aware visual question answering. Proceedings of the AAAI Conference on Artificial Intelligence. Washington DC: AAAI Press, 2019, pp. 8876–8884.
  • Singhal, K.; Azizi, S.; Tu, T.; Mahdavi, S.S.; Wei, J.; Chung, H.W.; Scales, N.; Tanwani, A.; Cole-Lewis, H.; and Pfohl, S. Large language models encode clinical knowledge. Nature, 620, 7972 (2023), 172–180.
  • Speer, R.; Chin, J.; and Havasi, C. Conceptnet 5.5: An open multilingual graph of general knowledge. Thirty-first AAAI Conference on Artificial Intelligence. San Francisco: AAAI Press, 2017, pp. 4444–4451.
  • Star, J.R.; and Seifert, C. The development of flexibility in equation solving. Contemporary Educational Psychology, 31, 3 (2006), 280–300.
  • Sun, R.; Zhang, X.; Slusarz, P.; and Mathews, R. The interaction of implicit learning, explicit hypothesis testing learning and implicit-to-explicit knowledge extraction. Neural Networks, 20, 1 (2007), 34–47.
  • Talmor, A.; Tafjord, O.; Clark, P.; Goldberg, Y.; and Berant, J. Leap-of-thought: Teaching pre-trained models to systematically reason over implicit knowledge. Advances in Neural Information Processing Systems, 33 (2020), 20227–20237.
  • Trantopoulos, K.; von Krogh, G.; Wallin, M.W.; and Woerter, M. External knowledge and information technology: Implications for process innovation performance. MIS Quarterly, 41, 1 (2017), 287–300.
  • Turner, R. Adaptive Reasoning for Real-World Problems: A Schema-Based Approach. New York: Psychology Press, 2013.
  • Walls, J.G.; Widmeyer, G.R.; and El Sawy, O.A. Building an information system design theory for vigilant EIS. Information Systems Research, 3, 1 (1992), 36–59.
  • Wang, H.; Zhang, F.; Xie, X.; and Guo, M. DKN: Deep knowledge-aware network for news recommendation. In P.A. Champin, F. Gandon, and L. Médini (eds.), Proceedings of the 2018 World Wide Web Conference. Geneva, 2018, pp. 1835–1844.
  • Wang, J.; Wang, Z.; Zhang, D.; and Yan, J. Combining knowledge with deep convolutional neural networks for short text classification. In C. Sierra (ed.), International Joint Conference on Artificial Intelligence. Melbourne: AAAI Press, 2017, pp. 2915–2921.
  • Wang, Q.; Mao, Z.; Wang, B.; and Guo, L. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering, 29, 12 (2017), 2724–2743.
  • Wang, S.; Fang, H.; Khabsa, M.; Mao, H.; and Ma, H. Entailment as few-shot learner. arXiv preprint arXiv:2104.14690 (2021).
  • Wang, X.; Gao, T.; Zhu, Z.; Zhang, Z.; Liu, Z.; Li, J.; and Tang, J. KEPLER: A unified model for knowledge embedding and pre-trained language representation. Transactions of the Association for Computational Linguistics, 9 (2021), 176–194.
  • Weiss, K.; Khoshgoftaar, T.M.; and Wang, D. A survey of transfer learning. Journal of Big Data, 3, 1 (2016), 1–40.
  • Wu, H.; Huang, C.; and Deng, S. Improving aspect-based sentiment analysis with Knowledge-aware Dependency Graph Network. Information Fusion, 92 (2023), 289–299.
  • Xie, J.; Chai, Y.; and Liu, X. Unbox the black-box: Predict and interpret YouTube viewership using deep learning. Journal of Management Information Systems, 40, 2 (2023), 541–579.
  • Xu, D.; Hu, P.J.-H.; and Fang, X. Deep learning-based imputation method to enhance crowdsourced data on online business directory platforms for improved services. Journal of Management Information Systems, 40, 2 (2023), 624–654.
  • Yan, R.; Sun, L.; Wang, F.; and Zhang, X. A general method for transferring explicit knowledge into language model pretraining. Security and Communication Networks, 2021 (2021), 1–8.
  • Yang, Z.; Dai, Z.; Yang, Y.; Carbonell, J.; Salakhutdinov, R.R.; and Le, Q.V. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché-Buc, E. Fox, and R.; Garnett (eds.), Xlnet: Generalized autoregressive pretraining for language understanding. Advances in Neural Information Processing Systems. Vancouver, 32 (2019).
  • Yao, L.; Mao, C.; and Luo, Y. Graph convolutional networks for text classification. Proceedings of the AAAI Conference on Artificial Intelligence. Honolulu: AAAI Press, 2019, pp. 7370–7377.
  • Yu, Y.; Huang, K.; Zhang, C.; Glass, L.M.; Sun, J.; and Xiao, C. SumGNN: Multi-typed drug interaction prediction via efficient knowledge graph summarization. Bioinformatics, 37, 18 (2021), 2988–2995.
  • Zhang, N.; Deng, S.; Sun, Z.; Wang, G.; Chen, X.; Zhang, W.; and Chen, H. Long-tail relation extraction via knowledge graph embeddings and graph convolution networks. arXiv preprint arXiv:1903.01306 (2019).
  • Zhang, Y.; Jiang, M.; and Zhao, Q. Explicit Knowledge Incorporation for Visual Reasoning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans, 2021, pp. 1356–1365.
  • Zhang, Z.; Han, X.; Liu, Z.; Jiang, X.; Sun, M.; and Liu, Q. ERNIE: Enhanced language representation with informative entities. arXiv preprint arXiv:1905.07129 (2019).

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.