# Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models

“Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models” (2023), by Tiffany H. Kung et al. Medicine research paper. Original abstract below, unchanged. A free PDF is available.

- Authors: Tiffany H. Kung, Morgan Cheatham, ChatGPT, Arielle Medenilla, Czarina Sillos, Lorie De Leon, Camille Elepaño, Maria Madriaga, Rimel Aggabao, Giezel Diaz-Candido et al.
- Published: February 9, 2023
- Field: Medicine
- DOI: https://doi.org/10.1371/journal.pdig.0000198
- Free PDF: https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000198&type=printable

## Abstract

We evaluated the performance of a large language model called ChatGPT on the United States Medical Licensing Exam (USMLE), which consists of three exams: Step 1, Step 2CK, and Step 3. ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforcement. Additionally, ChatGPT demonstrated a high level of concordance and insight in its explanations. These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making.

Canonical page: https://nerdi.pages.dev/paper/W4319662928
Read three real papers a day in Nerdi (iPhone): https://apps.apple.com/app/apple-store/id6813826387?pt=128757794&ct=web-paper&mt=8