This paper is in the following e-collection/theme issue:

Artificial Intelligence (AI) in Medical Education (131) Testing and Assessment in Medical Education (74) Generative Language Models Including ChatGPT (534) New Methods and Approaches in Medical Education (319) Quality of Medical Educational and Instructional Material (33)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/63430, first published .
ChatGPT-4 Omni Performance in USMLE Disciplines and Clinical Skills: Comparative Analysis

ChatGPT-4 Omni Performance in USMLE Disciplines and Clinical Skills: Comparative Analysis

ChatGPT-4 Omni Performance in USMLE Disciplines and Clinical Skills: Comparative Analysis

Authors of this article:

Brenton T Bicknell1 Author Orcid Image ;   Danner Butler2 Author Orcid Image ;   Sydney Whalen3 Author Orcid Image ;   James Ricks4 Author Orcid Image ;   Cory J Dixon5 Author Orcid Image ;   Abigail B Clark6 Author Orcid Image ;   Olivia Spaedy7 Author Orcid Image ;   Adam Skelton1 Author Orcid Image ;   Neel Edupuganti8 Author Orcid Image ;   Lance Dzubinski9 Author Orcid Image ;   Hudson Tate1 Author Orcid Image ;   Garrett Dyess2 Author Orcid Image ;   Brenessa Lindeman1 Author Orcid Image ;   Lisa Soleymani Lehmann4, 10 Author Orcid Image
Article Authors Cited by (11) Tweetations (7) Metrics

Journals

  1. McHugh J, Challener D, Tabaja H. Change of Heart: Can Artificial Intelligence Transform Infective Endocarditis Management?. Pathogens 2025;14(4):371 View
  2. Elkin P, Mehta G, LeHouillier F, Resnick M, Mullin S, Tomlin C, Resendez S, Liu J, Nebeker J, Brown S. Semantic Clinical Artificial Intelligence vs Native Large Language Model Performance on the USMLE. JAMA Network Open 2025;8(4):e256359 View
  3. Tekin M, Yurdal M, Toraman Ç, Korkmaz G, Uysal İ. Is AI the future of evaluation in medical education?? AI vs. human evaluation in objective structured clinical examination. BMC Medical Education 2025;25(1) View
  4. Wang L, Li J, Zhuang B, Huang S, Fang M, Wang C, Li W, Zhang M, Gong S. Accuracy of Large Language Models When Answering Clinical Research Questions: Systematic Review and Network Meta-Analysis. Journal of Medical Internet Research 2025;27:e64486 View
  5. Bolgova O, Ganguly P, Mavrych V. Comparative analysis of LLMs performance in medical embryology: A cross‐platform study of ChatGPT, Claude, Gemini, and Copilot. Anatomical Sciences Education 2025 View
  6. Wang W, Fu J, Zhang Y, Hu K. A Comparative Analysis of GPT-4o and ERNIE Bot in a Chinese Radiation Oncology Exam. Journal of Cancer Education 2025 View
  7. Wu J, Wang Z, Qin Y. Performance of DeepSeek-R1 and ChatGPT-4o on the Chinese National Medical Licensing Examination: A Comparative Study. Journal of Medical Systems 2025;49(1) View
  8. Altermatt F, Neyem A, Sumonte N, Villagrán I, Mendoza M, Lacassie H. Evaluating the Performance of Large Language Models on the CONACEM Anesthesiology Certification Exam: A Comparison with Human Participants. Applied Sciences 2025;15(11):6245 View
  9. Bruneti Severino J, Nespolo Berger M, Basei de Paula P, Loures F, Todeschini S, Roeder E, Han Veiga M, Knopfholz J, Lenci Marques G. Performance Benchmarking of Open-Source Large Language Models on the Brazilian Society of Cardiology's Certification Exam. International Journal of Cardiovascular Sciences 2025;38 View
  10. Solomon T, Laye M, Ahmed S. The sports nutrition knowledge of large language model (LLM) artificial intelligence (AI) chatbots: An assessment of accuracy, completeness, clarity, quality of evidence, and test-retest reliability. PLOS One 2025;20(6):e0325982 View
  11. Ucdal M, Bakhshandehpour A, Durak M, Balaban Y, Kekilli M, Simsek C. Evaluating the Role of Artificial Intelligence in Making Clinical Decisions for Treating Acute Pancreatitis. Journal of Clinical Medicine 2025;14(12):4347 View