The ChatGPT Exam

Critiquing Generative AI to Assess Learning

Authors

DOI:

https://doi.org/10.33043/gg58bfzzg

Keywords:

Artificial Intelligence, Information Literacy, Assessment, First Generation Students, Undergraduate Students

Abstract

As university instructors grapple with the many challenges that generative AI poses for education, we must face the reality that AI-literacy will increasingly be an essential skill for students entering the workforce. This article examines the author’s experience in having students critique and revise ChatGPT-generated essays as a form of assessment. Used in place of traditional exams, this assignment is designed to assess learning, promote engagement with course materials, and educate students about the limitations and responsible use of AI. The results so far have been promising, with students demonstrating critical thinking, mastery of course content, and improved AI-literacy. Most significantly, the ChatGPT Exam shows significant potential for building confidence among first generation and minoritized students. (This abstract was written with assistance from ChatGPT).

Downloads

Download data is not yet available.

References

Bowen, José Antonio and C. Edward Watson. Teaching with AI: A Practical Guide to a New Era of Human Learning. Baltimore: Johns Hopkins University Press, 2024.

Chasteen, John Charles. Born in Blood and Fire: A Concise History of Latin America, 4th edition. New York: W.W. Norton & Co., 2016.

Darby, Flower and James M. Lang. Small Teaching Online: Applying Learning Science in Online Classes. San Francisco: Jossey-Bass, 2019. ProQuest.

Davis, Jeff. The First Generation Student Experience: Implications for Campus Practice, and Strategies for Improving Persistence and Success. New York: Routledge, 2010. ProQuest.

Gernsbacher, Morton Ann, Raechel N. Soicher, and Kathryn A. Becker-Blease. “Four Empirically Based Reasons Not to Administer Time-Limited Tests.” Translational Issues in Psychological Science 6, no. 2 (2020): 175-190. http://dx.doi.org/10.1037/tps0000232.

Jones, Jonathan. “Students Critique a ChatGPT Essay.” Perspectives on History, September 2023. https://www.historians.org/research-and-publications/perspectives-on-history/september-2023/students-critique-a-chatgpt-essay-a-classroom-experiment.

Mance, Henry. “AI keeps going wrong. What if it can’t be fixed?” Financial Times. April 5, 2024. https://www.ft.com/content/648228e7-11eb-4e1a-b0d5-e65a638e6135.

Moreu, Gil, and Markus Brauer. “Inclusive Teaching Practices in Post-Secondary Education: What Instructors Can Do to Reduce the Achievement Gaps at U.S. Colleges.” International Journal of Teaching and Learning in Higher Education 34, no. 1 (2022): 170-182. ERIC.

Newman, Elizabeth. Biography of a Hacienda: Work and Revolution in Rural Mexico. Tucson: University of Arizona Press, 2014.

Saucier, Donald A., Noah D. Renken, and Ashley A. Schiffer. “Five Reasons to Stop Giving Exams in Class.” Faculty Focus. Feb. 18 2022. https://www.facultyfocus.com/articles/educational-assessment/five-reasons-to-stop-giving-exams-in-class/.

Zakrajsek, Todd and Linda Nilson. Teaching At Its Best, 5th edition. Hoboken, NJ: Jossey-Bass, 2023.

Published

2025-01-16

How to Cite

Black, Ashley. 2025. “The ChatGPT Exam: Critiquing Generative AI to Assess Learning”. Teaching History: A Journal of Methods 49 (1):34-41. https://doi.org/10.33043/gg58bfzzg.

Issue

Section

Special Section