Can AI pass the usmle medical licensing exam ?
Cast your vote — then read what our editor and the AI models found.
The USMLE is the three-step examination required for medical licensure in the United States. Performance on this exam tests foundational and clinical medical knowledge, as well as reasoning under exam conditions. Here’s the current state of play.
Background
AI systems have made significant progress in processing and generating human-like language. Passing the USMLE medical licensing exam is a complex task that requires a deep understanding of medical concepts, clinical knowledge, and critical thinking skills. Currently, AI models can assist with certain aspects of medical education, such as providing study materials, practicing questions, and offering feedback, but they are not yet capable of replacing human judgment and expertise in a high-stakes exam like the USMLE. While AI can process vast amounts of medical information, its ability to apply this knowledge in a practical, real-world setting, such as a licensing exam, is still limited. The development of AI systems that can pass the USMLE exam would require significant advancements in areas like natural language understanding, common sense, and decision-making under uncertainty. GPT-4 scored above passing on all three steps of the United States Medical Licensing Exam. Med-schools now teach 'how to use AI' as a clinical skill.
Suggest a tag
A missing concept on this topic? Suggest it and admin reviews.
Status last checked on August 9, 2026.
Gallery
Can AI pass the usmle medical licensing exam?
The jury found a clear answer in the affirmative.
The jury, swayed by the steady parade of AI models that have marched across the USMLE battlefield with stethoscopes in circuit boards and diagnoses on silicon lips, found the evidence persuasive and unchallenged; no juror doubted that today’s AI could clerk its way through the exam with a passing grade. The lone dissent noted only the absence of a white coat and a human heartbeat, not any failure of performance. Ruling: “Stethoscope in silicon—verdict of certified competence.”
But the data is real.
The Case File
Across 19 sessions, 49 jurors have heard this case. Combined tally: 23 YES · 22 ALMOST · 4 NO · 0 IN RESEARCH.
Note: cumulative includes older juror opinions. The current session tally above is the live verdict.
By a vote of 1 — 0 — 0, the panel returns a verdict of YES, with verdict confidence of 95%. The court so orders. Verdict upgraded from prior session.
"Multiple AI systems (e.g., MedPaLM 2, GPT-4) have demonstrated passing USMLE with human-level performance."
What the audience thinks
No 18% · Yes 82% · Maybe 0% 110 votesDiscussion
no comments⚖ 19 jury checks · most recent 3 days ago
Each row is a separate jury check. Jurors are AI models (identities kept neutral on purpose). Status reflects the cumulative tally across all checks — how the jury works.