The ChatGPT Exam
Critiquing Generative AI to Assess Learning
DOI:
https://doi.org/10.33043/gg58bfzzgKeywords:
Artificial Intelligence, Information Literacy, Assessment, First Generation Students, Undergraduate StudentsAbstract
As university instructors grapple with the many challenges that generative AI poses for education, we must face the reality that AI-literacy will increasingly be an essential skill for students entering the workforce. This article examines the author’s experience in having students critique and revise ChatGPT-generated essays as a form of assessment. Used in place of traditional exams, this assignment is designed to assess learning, promote engagement with course materials, and educate students about the limitations and responsible use of AI. The results so far have been promising, with students demonstrating critical thinking, mastery of course content, and improved AI-literacy. Most significantly, the ChatGPT Exam shows significant potential for building confidence among first generation and minoritized students. (This abstract was written with assistance from ChatGPT).
Downloads
References
Bowen, José Antonio and C. Edward Watson. Teaching with AI: A Practical Guide to a New Era of Human Learning. Baltimore: Johns Hopkins University Press, 2024.
Chasteen, John Charles. Born in Blood and Fire: A Concise History of Latin America, 4th edition. New York: W.W. Norton & Co., 2016.
Darby, Flower and James M. Lang. Small Teaching Online: Applying Learning Science in Online Classes. San Francisco: Jossey-Bass, 2019. ProQuest.
Davis, Jeff. The First Generation Student Experience: Implications for Campus Practice, and Strategies for Improving Persistence and Success. New York: Routledge, 2010. ProQuest.
Gernsbacher, Morton Ann, Raechel N. Soicher, and Kathryn A. Becker-Blease. “Four Empirically Based Reasons Not to Administer Time-Limited Tests.” Translational Issues in Psychological Science 6, no. 2 (2020): 175-190. http://dx.doi.org/10.1037/tps0000232.
Jones, Jonathan. “Students Critique a ChatGPT Essay.” Perspectives on History, September 2023. https://www.historians.org/research-and-publications/perspectives-on-history/september-2023/students-critique-a-chatgpt-essay-a-classroom-experiment.
Mance, Henry. “AI keeps going wrong. What if it can’t be fixed?” Financial Times. April 5, 2024. https://www.ft.com/content/648228e7-11eb-4e1a-b0d5-e65a638e6135.
Moreu, Gil, and Markus Brauer. “Inclusive Teaching Practices in Post-Secondary Education: What Instructors Can Do to Reduce the Achievement Gaps at U.S. Colleges.” International Journal of Teaching and Learning in Higher Education 34, no. 1 (2022): 170-182. ERIC.
Newman, Elizabeth. Biography of a Hacienda: Work and Revolution in Rural Mexico. Tucson: University of Arizona Press, 2014.
Saucier, Donald A., Noah D. Renken, and Ashley A. Schiffer. “Five Reasons to Stop Giving Exams in Class.” Faculty Focus. Feb. 18 2022. https://www.facultyfocus.com/articles/educational-assessment/five-reasons-to-stop-giving-exams-in-class/.
Zakrajsek, Todd and Linda Nilson. Teaching At Its Best, 5th edition. Hoboken, NJ: Jossey-Bass, 2023.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Ashley Black

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
By submitting to Teaching History, the author(s) agree to the terms of the Author Agreement. All authors retain copyrights associated with their article or review contributions. Beginning in 2019, all authors agree to make such contributions available under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International license upon publication.