Supporting self-directed learning and self-assessment using TeacherGAIA, a generative AI chatbot application: Learning approaches and prompt engineering

References

• Adamopoulou, E., & Moussiades, L. (2020). An overview of chatbot technology. Artificial Intelligence Applications and Innovations: 16th IFIP WG 12.5 International Conference, AIAI, Neos Marmaras, Greece, June 5–7, 2020, Proceedings, Part II 16
   Google Scholar
• Andrade, H. L. (2019). A critical review of research on student self-assessment. Frontiers in Education, 4, 87. https://doi.org/10.3389/feduc.2019.00087
   Google Scholar
• Anglin, G. J., Vaez, H., & Cunningham, K. L. (2013). Visual representations and learning: The role of static and animated graphics. In M. D. M. J. M. Spector & M. J. B. Jan Elen (Eds.), Handbook of research on educational communications and technology (pp. 854–905). Routledge.
   Google Scholar
• Biswas, G., Leelawong, K., Belynne, K., Viswanath, K., Vye, N., Schwartz, D., & Davis, J. (2001). Incorporating self regulated learning techniques into learning by teaching environments. Proceedings of the Annual Meeting of the Cognitive Science Society, 26(26), 120–125.
   Google Scholar
• Brandt, W. C. (2020). A review of the literature on self-directed learning: 21st Century success skills. National Center for the Improvement of Educational Assessment.
   Google Scholar
• Brown, G., & Harris, L. (2013). Student self-assessment. In J. McMillan (Ed.), Handbook of research on classroom assessment (pp. 367–394). SAGE Publications, Inc.
   Google Scholar
• Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., & Askell, A. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://dl.acm.org/doi/abs/10.5555/3495724.3495883
   Google Scholar
• De Jong, T., Lazonder, A. W., Chinn, C. A., Fischer, F., Gobert, J., Hmelo-Silver, C. E., Koedinger, K. R., Krajcik, J. S., Kyza, E. A., & Linn, M. C. (2023). Let’s talk evidence – the case for combining inquiry-based and direct instruction. Educational Research Review, 39, 100536. https://doi.org/10.1016/j.edurev.2023.100536
   Web of Science ®Google Scholar
• Dole, J. A., & Sinatra, G. M. (1998). Reconceptalizing change in the cognitive construction of knowledge. Educational Psychologist, 33(2–3), 109–128. https://doi.org/10.1080/00461520.1998.9653294
   Web of Science ®Google Scholar
• Duran, D. (2017). Learning-by-teaching. Evidence and implications as a pedagogical mechanism. Innovations in Education and Teaching International, 54(5), 476–484. https://doi.org/10.1080/14703297.2016.1156011
   Web of Science ®Google Scholar
• Erdem, C. (2022). A comparative meta-analysis of the effects of problem-based learning model on K-12 students’ cognitive outputs. Educational Studies, 1–22. https://doi.org/10.1080/03055698.2022.2103650
   Web of Science ®Google Scholar
• Fiorella, L., & Mayer, R. E. (2016). Eight ways to promote generative learning. Educational Psychology Review, 28(4), 717–741. https://doi.org/10.1007/s10648-015-9348-9
   Web of Science ®Google Scholar
• Gibbons, M. (2003). The self-directed learning handbook: Challenging adolescent students to excel. John Wiley & Sons.
   Google Scholar
• Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235–266. https://doi.org/10.1023/B:EDPR.0000034022.16470.f3
   Web of Science ®Google Scholar
• Jeong, H., Hmelo-Silver, C. E., & Jo, K. (2019). Ten Years of computer-supported collaborative learning: A meta-analysis of CSCL in STEM education during 2005–2014. Educational Research Review, 28, 100284. https://doi.org/10.1016/j.edurev.2019.100284
   Web of Science ®Google Scholar
• Joyner, D. A., & Goel, A. K. (2015). Improving inquiry-driven modeling in science education through interaction with intelligent tutoring agents. Proceedings of the 20th International Conference on Intelligent User Interfaces, Atlanta, Georgia, United States (pp. 5–16).
   Google Scholar
• Knowles, M. S. (1975). Self-directed learning: A guide for learners and teachers. Association Press.
   Google Scholar
• Kobayashi, K. (2019a). Interactivity: A potential determinant of learning by preparing to teach and teaching. Frontiers in Psychology, 9, 2755. https://doi.org/10.3389/fpsyg.2018.02755
   PubMed Web of Science ®Google Scholar
• Kobayashi, K. (2019b). Learning by preparing‐to‐teach and teaching: A meta‐analysis. Japanese Psychological Research, 61(3), 192–203. https://doi.org/10.1111/jpr.12221
   Web of Science ®Google Scholar
• Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018. https://doi.org/10.1007/s10639-022-11177-3
   Web of Science ®Google Scholar
• Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 86(3), 681–718. https://doi.org/10.3102/0034654315627366
   Web of Science ®Google Scholar
• Mayer, R. E. (1996). Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction. Educational Psychology Review, 8(4), 357–371. https://doi.org/10.1007/BF01463939
   Web of Science ®Google Scholar
• Meehan, S., School, W. S. S. O. S. B. S. N., Holmes, B., & Tangney, B. (2001). Who wants to be a teacher? An exploration of the theory of communal constructivism at the chalk face. Teacher Development, 5(2), 177–190. https://doi.org/10.1080/13664530100200153
   Google Scholar
• Mishra, A., Soni, U., Arunkumar, A., Huang, J., Kwon, B. C., & Bryan, C. (2023). PromptAid: Prompt exploration, perturbation, testing and iteration using Visual analytics for large language models. ArXiv Preprint, arXiv, 2304.01964. https://doi.org/10.48550/arXiv.2304.01964
   Google Scholar
• Morris, T. H. (2019). Self-directed learning: A fundamental competence in a rapidly changing world. International Review of Education, 65(4), 633–653. https://doi.org/10.1007/s11159-019-09793-2
   Web of Science ®Google Scholar
• Okonkwo, C. W., & Ade Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033. https://doi.org/10.1016/j.caeai.2021.100033
   Google Scholar
• OpenAI. (2023). GPT-4 technical report. arXiv, 2303.08774. https://doi.org/10.48550/arXiv.2303.08774
   Google Scholar
• Palinscar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1(2), 117–175. https://doi.org/10.1207/s1532690xci0102_1
   Google Scholar
• Pedaste, M., Mäeots, M., Siiman, L. A., Jong, T. D., Riesen, S. V., Kamp, E. T., Manoli, C. C., Zacharia, Z. C., & Tsourlidaki, E. (2015). Phases of inquiry-based learning: Definitions and the inquiry cycle. Educational Research Review, 14, 47–61. https://doi.org/10.1016/j.edurev.2015.02.003
   Web of Science ®Google Scholar
• Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAi, 1(8), 9.
   Google Scholar
• Sanchez, C. E., Atkinson, K. M., Koenka, A. C., Moshontz, H., & Cooper, H. (2017). Self-grading and peer-grading for formative and summative assessments in 3rd through 12th grade classrooms: A meta-analysis. Journal of Educational Psychology, 109(8), 1049. https://doi.org/10.1037/edu0000190
   Web of Science ®Google Scholar
• Singapore Ministry of Education. (2022). Desired Outcomes of Education. www.moe.gov.sg/education-in-sg/desired-outcomes
   Google Scholar
• Van Aalst, J. (2009). Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses. International Journal of Computer-Supported Collaborative Learning, 4(3), 259–287. https://doi.org/10.1007/s11412-009-9069-5
   PubMed Web of Science ®Google Scholar
• Van Deur, P. (2017). Managing self-directed learning in primary school education: Emerging research and opportunities. IGI Global. https://doi.org/10.4018/978-1-5225-2613-1
   Google Scholar
• Von Glasersfeld, E. (2013). Radical constructivism. Routledge.
   Google Scholar
• Webb, N. M., Troper, J. D., & Fall, R. (1995). Constructive activity and learning in collaborative small groups. Journal of Educational Psychology, 87(3), 406. https://doi.org/10.1037/0022-0663.87.3.406
   Web of Science ®Google Scholar
• Wei, A., Haghtalab, N., & Steinhardt, J. (2023). Jailbroken: How does LLM safety training fail? ArXiv Preprint, arXiv, 2307.02483. https://doi.org/10.48550/arXiv.2307.02483
   Google Scholar
• White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., & Schmidt, D. C. (2023). A prompt pattern catalog to enhance prompt engineering with chatgpt. ArXiv Preprint, arXiv, 2302.11382. https://doi.org/10.48550/arXiv.2302.11382
   Google Scholar
• Wies, N., Levine, Y., & Shashua, A. (2023). The learnability of in-context learning. arXiv preprint arXiv:2303.07895. https://doi.org/10.48550/arXiv.2303.07895
   Google Scholar
• Wu, R., & Yu, Z. (2023). Do AI chatbots improve students learning outcomes? Evidence from a meta‐analysis. British Journal of Educational Technology. https://doi.org/10.1111/bjet.13334
   PubMedGoogle Scholar
• Zamfirescu-Pereira, J., Wong, R. Y., Hartmann, B., & Yang, Q. (2023). Why Johnny can’t prompt: How non-AI experts try (and fail) to design LLM prompts. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany (pp. 1–21).
   Google Scholar