The comparison of general tips for mathematical problem solving generated by generative AI with those generated by human teachers

References

• Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Gianinazzi, L., Gajda, J. , and Hoefler, T. (2023). Graph of thoughts: Solving elaborate problems with large language models. arXiv preprint arXiv:2308.09687.
   Google Scholar
• Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.https://arxiv.org/abs/2005.14165
   Google Scholar
• Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., Nori, H., & Zhang, Y. (2023). Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712.
   Google Scholar
• Dao, X. Q., & Le, N. B. (2023). Investigating the effectiveness of ChatGPT in mathematical reasoning and problem solving: Evidence from the Vietnamese National high school graduation examination. arXiv preprint arXiv:2306.06331.
   Google Scholar
• Frieder, S., Pinchetti, L., Griffiths, R. R., Salvatori, T., Lukasiewicz, T., Petersen, P. C., Chevalier, A., & Berner, J. (2023). Mathematical capabilities of chatgpt. arXiv preprint arXiv:2301.13867.
   Google Scholar
• Garcia, X., Bansal, Y., Cherry, C., Foster, G., Krikun, M., Johnson, M., & Firat, O. (2023). The unreasonable effectiveness of few-shot learning for machine translation. arXiv preprint arXiv:2302.01398.
   Google Scholar
• Han, L. (2010). The characteristics and application of guided tips in mathematics teaching. Teaching & Administration, 2010(10), 59–61.
   Google Scholar
• Hao, H., & Zhang, J. (2006). A study of the effect of strategic tips on the performance of mathematical underachieving students in word problems. Theory and Practice of Education, 26(11), 40–42.
   Google Scholar
• Jia, J. (2015). Intelligent tutoring systems. In M. Spector (Ed.), Encyclopedia of educational technology (pp. 411–413). Sage.
   Google Scholar
• Jia, J., Le, H., Zhang, Y., Liu, H., Chen, A., & Li, S. (2023). The design of an intelligent assessment and tutoring system based on big data mining. China Educational Technology, 3, 112–119. https://doi.org/10.3969/j.issn.1006-9860.2023.03.016
   Google Scholar
• Jia, J., Zhang, Y., Liu, H., & Li, S. (2023). Intelligent assessment and tutoring system helps to reform student assessment and alleviate burdens for efficiency. E-Education Research, 44(6), 74–80+89.
   Google Scholar
• Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
   Web of Science ®Google Scholar
• Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022). Large language models are zero-shot reasoners. Advances in Neural Information Processing Systems, 35, 22199–22213. https://arxiv.org/abs/2205.11916
   Google Scholar
• Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: A meta-analytic review. Review of Educational Research, 86(1), 42–78. https://doi.org/10.3102/0034654315581420
   Web of Science ®Google Scholar
• Lee, C.I. (2016). An appropriate prompts system based on the Polya method for mathematical problem-solving. Eurasia Journal of Mathematics, Science and Technology Education, 13(3), 893–910. https://doi.org/10.12973/eurasia.2017.00649a
   Web of Science ®Google Scholar
• Liu, V., & Chilton, L. B. (2022, April). Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, New Orleans, Louisana, USA (pp. 1–23).
   Google Scholar
• Li, H., Zhang, Y., Koto, F., Yang, Y., Zhao, H., Gong, Y., Duan, N., Baldwin, T., & Baldwin, T. (2023). CMMLU: Measuring massive multitask language understanding in Chinese. arXiv preprint arXiv:2306.09212.
   Google Scholar
• Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
   Web of Science ®Google Scholar
• Nov, O., Singh, N., & Mann, D. M. (2023). Putting ChatGPT’s medical advice to the (Turing) test. arXiv preprint arXiv:230110035, cs.HC
   Google Scholar
• Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155, 2022.
   Google Scholar
• Russo, J., Minas, M., Hewish, T., & McCosh, J. (2020). Using prompts to empower learners: Exploring primary students’ attitudes towards enabling prompts when learning mathematics through problem solving. Mathematics Teacher Education & Development, 22(1), 48–67.
   Google Scholar
• Sanh, V., Webson, A., Raffel, C., Bach, S. H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T. L., Raja, A., Dey, M., & Rush, A.M. (2021). Multitask prompted training enables zero-shot task generalization. arXiv preprint arXiv:2110.08207.
   Google Scholar
• Song, Y., Wang, T., Cai, P., Mondal, S. K., & Sahoo, J. P. (2023). A comprehensive survey of few-shot learning: Evolution, applications, challenges, and opportunities. ACM Computing Surveys.
   Google Scholar
• Tang, R., Zhang, Y., Cao, Y., Liu, H., & Jia, J. (2023, July). Design and effect of guided and adaptive tutoring tips for helping school mathematics problems solving. In: C. Li. (Ed.), Proceedings of International Conference on Blended Learning (pp. 273–284). Cham: Springer Nature Switzerland.
   Google Scholar
• Turing, A. (1950). Computing machinery and intelligence. Mind, LIX(236), 433–460. https://doi.org/10.1093/mind/LIX.236.433
   Google Scholar
• VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221. https://doi.org/10.1080/00461520.2011.611369
   Web of Science ®Google Scholar
• Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), em2286. https://doi.org/10.29333/ejmste/13272
   Google Scholar
• Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. arXiv preprint arXiv:2201.11903, 2022b.
   Google Scholar
• Winata, G.I., Madotto, A., Lin, Z., Liu, R., Yosinski, J., & Fung, P. (2021). Language models are few-shot multilingual learners. arXiv preprint arXiv:2109.07684.
   Google Scholar
• Yang, C.H., Gu, Y., Liu, Y., Ghosh, S., Bulyko, I., & Stolcke, A. (2023). Generative speech recognition error correction with large language models. arXiv preprint arXiv: 2309.15649.
   Google Scholar
• Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023). Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601.
   Google Scholar
• Zheng, C., Liu, Z., Xie, E., Li, Z., & Li, Y. (2023). Progressive-hint prompting improves reasoning in large language models. arXiv preprint arXiv:2304.09797.
   Google Scholar
• Zhong, W., Cui, R., Guo, Y., Liang, Y., Lu, S., Wang, Y., Saied, A., Chen, W., & Duan, N. (2023). Agieval: A human-centric benchmark for evaluating foundation models. arXiv preprint arXiv:2304.06364.
   Google Scholar