Accessibility settings

This paper is in the following e-collection/theme issue:

Reviews in Medical Education (93) Testing and Assessment in Medical Education (121) New Methods and Approaches in Medical Education (443) New Resources for Medical Education (140) Artificial Intelligence (AI) in Medical Education (251) Generative Language Models Including ChatGPT (883)

Published on in Vol 11 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/68070, first published .
Young professional using a tablet with a futuristic brain graphic on screen

Evaluating the Potential and Accuracy of ChatGPT-3.5 and 4.0 in Medical Licensing and In-Training Examinations: Systematic Review and Meta-Analysis

Evaluating the Potential and Accuracy of ChatGPT-3.5 and 4.0 in Medical Licensing and In-Training Examinations: Systematic Review and Meta-Analysis

Authors of this article:

Anila Jaleel1 Author Orcid Image ;   Umair Aziz1 Author Orcid Image ;   Ghulam Farid1 Author Orcid Image ;   Muhammad Zahid Bashir1 Author Orcid Image ;   Tehmasp Rehman Mirza1 Author Orcid Image ;   Syed Mohammad Khizar Abbas1 Author Orcid Image ;   Shiraz Aslam1 Author Orcid Image ;   Rana Muhammad Hassaan Sikander1 Author Orcid Image
Article Authors Cited by (10) Tweetations (1) Metrics

Journals

  1. de Boer H, Young G, Bouwer H, Heath K. ChatGPT’s performance on a specialist forensic pathology examination: implications for forensic pathologists and non-specialists. International Journal of Legal Medicine 2026;140(3):1717 View
  2. Fu Q, Ji W, Fan Y, Yao J, Song M, Yan Q. Systematic Mining of Bioactive Compounds for Wound Healing From Cayratia Japonica Exosome-Like Nanovesicles: A Workflow Combining LC-MS and DeepSeek Models. JMIR Bioinformatics and Biotechnology 2026;7:e80539 View
  3. Zouakia Z, Logak E, Szymczak A, Jais J, Burgun A, Tsopra R. AI-Driven Objective Structured Clinical Examination Generation in Digital Health Education: Comparative Analysis of Three GPT-4o Configurations. JMIR Medical Education 2026;12:e82116 View
  4. SEQUI M, LOMBARDO R, COPPOLA L, ROSATO E, ROMAGNOLI M, DE CILLIS S, CHECCUCCI E, AMPARORE D, RAGONESE M, FOSCHI N, SANTARELLI V, SPATAFORA P, GALLO G, PAGLIARULO V, TEMA G, NACCHIA A, CICIONE A, FRANCO A, PASTORE A, AL SALHI Y, ROCCO B, GACCI M, FIORI C, FINAZZI E, SCIARRA A, TUBARO A, DE NUNZIO C. Accuracy, readability, and understandability of EAU Guidelines Bot for urinary infections guidelines. Minerva Urology and Nephrology 2026;78(1) View
  5. López-Úbeda P, Martín-Noguerol T, Luna A. Radiology Board-Style Examinations and Large Language Models: A Scoping Review of Model Performance. Journal of the American College of Radiology 2026;23(5):837 View
  6. Yin C, Sun X, Dai A, Ye X, Lu Y, Wang W, Chen Y, Jiang H, Yu J, Chong S, Jiang M, Xu J, Yang B, Chappa R, Chokkakula S, He K. ChatGPT in precision medicine. APL Bioengineering 2026;10(1) View
  7. Çelik Y, Özer N, Esen Öksüzoğlu M, Macit Ş, Günal Okumuş H, Kaşak M, Efe A, Öztürk Y. Artificial Intelligence in Psychiatry Training: Comparative Insights from Nine Large Language Models Across Cultural and Exam Contexts. Psychiatric Quarterly 2026 View
  8. Lombardo R, Pastore A, Turchi B, Franco A, Romagnoli M, Salhi Y, Fuschi A, Fiori C, Secco S, De Cillis S, Olivero A, Nacchia A, Cicione A, Cindolo L, Tema G, Tubaro A, De Nunzio C. Treatment Regret in Patients Undergoing Minimally Invasive Treatments for Benign Prostatic Hyperplasia. Journal of Clinical Medicine 2026;15(7):2807 View
  9. Dashti M, Khosraviani F, Golrang E. Letter to the Editor. European Journal of Orthodontics 2026;48(3) View
  10. Cheverko C, Mavrych V, Bolgova O, Mohamed F, Westrick J, Juarez L, Rush E, Solka K, Doubleday A, Byram J, Becker R, Gomez V, Ganeng B, Hoffman L, Roach V, Brown K, DeVaul N, Garnett C, Herriott H, Lufler R, Mussell J, Balta J, Pascoe M, Middleton J, Duffy S, Stephens G, Wilson A. The performance of ChatGPT and other large language models on multiple‐choice questions in biomedical disciplines: A meta‐analysis. Anatomical Sciences Education 2026 View