Developing a framework to re-design writing assignment assessment for the era of Large Language Models

References

• Association of American Colleges and Universities [AAC&U]. (2009, June 10). Information Literacy VALUE Rubric. Retrieved from https://www.aacu.org/initiatives/value-initiative/value-rubrics/value-rubrics-information-literacy
   Google Scholar
• Bearman, M., Dawson, P., Ajjawi, R., Tai, J., & Boud, D. (2020). Re-Imagining University Assessment in a Digital World. Springer. https://doi.org/10.1007/978-3-030-41956-1
   Google Scholar
• Biggs, J., & Tang, C. (2007). Teaching for quality learning at university. Open University Press.
   Google Scholar
• Bishop, L. (2023). A computer wrote this paper: What ChatGPT means for education, research, and writing. SSRN Electronic Journal.
   Google Scholar
• Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., van Haeringen, K., Saddiqui, S., & Rozenberg, P. (2019). Contract cheating and assessment design: Exploring the relationship. Assessment & Evaluation in Higher Education, 44(5), 676–691. https://doi.org/10.1080/02602938.2018.1527892
   Web of Science ®Google Scholar
• Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. https://doi.org/10.1080/14703297.2023.2190148
   Web of Science ®Google Scholar
• Crawford, J., Cowling, M., & Allen, K. (2023). Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching & Learning Practice, 20(3). https://doi.org/10.53761/1.20.3.02
   Web of Science ®Google Scholar
• Dawson, P. (2020). Cognitive offloading and assessment. In M. Bearman, P. Dawson, R. Ajjawi, J. Tai, & D. Boud (Eds.), Re-imagining university assessment in a digital world (pp. 37–48). Springer International Publishing. https://doi.org/10.1007/978-3-030-41956-1_4
   Google Scholar
• Dawson, P., & Sutherland-Smith, W. (2018). Can markers detect contract cheating? Results from a pilot study. Assessment & Evaluation in Higher Education, 43(2), 286–293. https://doi.org/10.1080/02602938.2017.1336746
   Web of Science ®Google Scholar
• Eaton, S. E. (2022). Contract cheating in higher education: Global perspectives on theory, practice, and policy. Palgrave Macmillan. https://doi.org/10.1007/978-3-031-12680-2
   Google Scholar
• Ellis, C., van Haeringen, K., Harper, R., Bretag, T., Zucker, I., McBride, S., Rozenberg, P., Newton, P., & Saddiqui, S. (2020). Does authentic assessment assure academic integrity? Evidence from contract cheating data. Higher Education Research & Development, 39(3), 454–469. https://doi.org/10.1080/07294360.2019.1680956
   Web of Science ®Google Scholar
• Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1–15. https://doi.org/10.1080/14703297.2023.2195846
   Web of Science ®Google Scholar
• Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States medical licensing examination? The implications of Large Language Models for medical education and knowledge assessment. JMIR Medical Education, 9, e45312. https://doi.org/10.2196/45312
   PubMedGoogle Scholar
• Gimpel, H., Hall, K., Decker, S., Eymann, T., Lämmermann, L., Maedche, A., Röglinger, M., Ruiner, C., Schoch, M., Schoop, M., Urbach, N., & Vandirk, S. (2023). Unlocking the power of generative AI models and systems such as GPT-4 and ChatGPT for higher education. Hohenheim Discussion Papers in Business, Economics and Social Sciences. https://doi.org/10.13140/RG.2.2.20710.09287/2
   Google Scholar
• Koenders, L., & Prins, F. (2023). ChatGPT in education: Can you still use take-home exams and essays?. Utrecht University. https://www.uu.nl/en/education/educational-development-training/knowledge-dossier/the-influence-of-chatgpt-on-assessment-can-you-still-use-take-home-exams-and-essays
   Google Scholar
• Kuhn, D. (1999). A developmental model of critical thinking. Educational Researcher, 28(2), 16–46. https://doi.org/10.3102/0013189x028002016
   Google Scholar
• Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
   Web of Science ®Google Scholar
• Mills, A. (2023 June 10). Rethinking Writing for Assessment in the Era of Artificial Intelligence. Retrieved from https://docs.google.com/presentation/d/1v0C78ZFoFDjFOpmMCgl0c-9ZBqb2XPST/edit#slide=id.p17
   Google Scholar
• Mollick, E. R., & Mollick, L. (2022). New modes of learning enabled by AI chatbots: Three methods and assignments. SSRN Electronic Journal. http://dx.doi.org/10.2139/ssrn.4300783
   Google Scholar
• Moore, B., & Stanley, T. (2013). Critical thinking and formative assessments: Increasing the rigor in your classroom. Routledge. https://doi.org/10.4324/9781315856261
   Google Scholar
• Paul, R., & Elder, L. (2001). Critical thinking: Tools for taking charge of your learning and your life. Prentice Hall. https://books.google.nl/books?id=FUgEAAAACAAJ
   Google Scholar
• Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A design science research methodology for information systems research. Journal of Management Information Systems, 24(3), 45–77. https://doi.org/10.2753/MIS0742-1222240302
   Web of Science ®Google Scholar
• Perkins, M. (2023). Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching and Learning Practice, 20(2). https://doi.org/10.53761/1.20.02.07
   Web of Science ®Google Scholar
• Perkins, M., Roe, J., Postma, D., McGaughran, J., & Hickerson, D. (2023). Game of tones: Faculty detection of GPT-4 generated content in university assessments . https://www.researchgate.net/publication/371136175_Game_of_Tones_Faculty_detection_of_GPT-4_generated_content_in_university_assessments
   Google Scholar
• Rudolph, J., Tan, S., & Tan, S. (2023a). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9
   Google Scholar
• Rudolph, J., Tan, S., & Tan, S. (2023b). War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.23
   Google Scholar
• University, W. (2023). Guidelines for using ChatGPT and other AI tools in writing and research. https://academics.waldenu.edu/artificial-intelligence/home
   Google Scholar
• Van Aken, J., & Berends, H. (2018). Design science research: Developing generic solutions for field problems. In H. Berends & J. E. van Aken (Eds.), Problem solving in organizations: A methodological handbook for business and management students (3 ed, pp. 223–240). Cambridge University Press. https://doi.org/10.1017/9781108236164
   Google Scholar
• Wargo, K. (2020). A conceptual framework for authentic writing assignments: Academic and everyday meet. Journal of Adolescent & Adult Literacy, 63(5), 539–547. https://doi.org/10.1002/jaal.1022
   Web of Science ®Google Scholar