This paper is in the following e-collection/theme issue:

Theme Issue: ChatGPT and Generative Language Models in Medical Education (102) e-Learning and Digital Medical Education (801) Chatbots and Conversational Agents (640) Adoption and Change Management of eHealth Systems (807)

Published on in Vol 9 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48039, first published .
Performance of ChatGPT on the Peruvian National Licensing Medical Examination: Cross-Sectional Study

Performance of ChatGPT on the Peruvian National Licensing Medical Examination: Cross-Sectional Study

Performance of ChatGPT on the Peruvian National Licensing Medical Examination: Cross-Sectional Study

Authors of this article:

Javier A Flores-Cohaila1, 2 Author Orcid Image ;   Abigaíl García-Vicente3, 4 Author Orcid Image ;   Sonia F Vizcarra-Jiménez4, 5 Author Orcid Image ;   Janith P De la Cruz-Galán4, 6 Author Orcid Image ;   Jesús D Gutiérrez-Arratia1 Author Orcid Image ;   Blanca Geraldine Quiroga Torres4 Author Orcid Image ;   Alvaro Taype-Rondan7, 8 Author Orcid Image
Article Authors Cited by (43) Tweetations (34) Metrics

Journals

  1. Torres-Zegarra B, Rios-Garcia W, Ñaña-Cordova A, Arteaga-Cisneros K, Chalco X, Ordoñez M, Rios C, Godoy C, Quezada K, Gutierrez-Arratia J, Flores-Cohaila J. Performance of ChatGPT, Bard, Claude, and Bing on the Peruvian National Licensing Medical Examination: a cross-sectional study. Journal of Educational Evaluation for Health Professions 2023;20:30 View
  2. SeyedAlinaghi S, Abbaspour F, Mehraeen E. The Challenges of ChatGPT in Healthcare Scientific Writing. Shiraz E-Medical Journal 2023;25(2) View
  3. Sallam M, Al-Salahat K. Below average ChatGPT performance in medical microbiology exam compared to university students. Frontiers in Education 2023;8 View
  4. Tangadulrat P, Sono S, Tangtrakulwanich B. Using ChatGPT for Clinical Practice and Medical Education: Cross-Sectional Survey of Medical Students’ and Physicians’ Perceptions. JMIR Medical Education 2023;9:e50658 View
  5. Knopp M, Warm E, Weber D, Kelleher M, Kinnear B, Schumacher D, Santen S, Mendonça E, Turner L. AI-Enabled Medical Education: Threads of Change, Promising Futures, and Risky Realities Across Four Potential Future Worlds. JMIR Medical Education 2023;9:e50373 View
  6. Chau R, Thu K, Yu O, Hsung R, Lo E, Lam W. Performance of Generative Artificial Intelligence in Dental Licensing Examinations. International Dental Journal 2024;74(3):616 View
  7. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  8. Huang C, Hsiao H, Yeh P, Wu K, Kao C. Performance of ChatGPT on Stage 1 of the Taiwanese medical licensing exam. DIGITAL HEALTH 2024;10 View
  9. Funk P, Hoch C, Knoedler S, Knoedler L, Cotofana S, Sofo G, Bashiri Dezfouli A, Wollenberg B, Guntinas-Lichius O, Alfertshofer M. ChatGPT’s Response Consistency: A Study on Repeated Queries of Medical Examination Questions. European Journal of Investigation in Health, Psychology and Education 2024;14(3):657 View
  10. Lubitz M, Latario L. Performance of Two Artificial Intelligence Generative Language Models on the Orthopaedic In-Training Examination. Orthopedics 2024;47(3) View
  11. Nakao T, Miki S, Nakamura Y, Kikuchi T, Nomura Y, Hanaoka S, Yoshikawa T, Abe O. Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study. JMIR Medical Education 2024;10:e54393 View
  12. Sato H, Ogasawara K. ChatGPT (GPT-4) passed the Japanese National License Examination for Pharmacists in 2022, answering all items including those with diagrams: a descriptive study. Journal of Educational Evaluation for Health Professions 2024;21:4 View
  13. Kawahara T, Sumi Y. GPT-4/4V's performance on the Japanese National Medical Licensing Examination. Medical Teacher 2025;47(3):450 View
  14. Hirano Y, Hanaoka S, Nakao T, Miki S, Kikuchi T, Nakamura Y, Nomura Y, Yoshikawa T, Abe O. GPT-4 Turbo with Vision fails to outperform text-only GPT-4 Turbo in the Japan Diagnostic Radiology Board Examination. Japanese Journal of Radiology 2024;42(8):918 View
  15. Liu M, Okuhara T, Chang X, Shirabe R, Nishiie Y, Okada H, Kiuchi T. Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e60807 View
  16. Guo A, Razi B, Kim P, Canagasingham A, Vass J, Chalasani V, Rasiah K, Chung A. The Role of Artificial Intelligence in Patient Education: A Bladder Cancer Consultation with ChatGPT. Société Internationale d’Urologie Journal 2024;5(3):214 View
  17. Hsieh C, Hsieh H, Lin H. Evaluating the performance of ChatGPT-3.5 and ChatGPT-4 on the Taiwan plastic surgery board examination. Heliyon 2024;10(14):e34851 View
  18. Ishida K, Hanada E. Potential of ChatGPT to Pass the Japanese Medical and Healthcare Professional National Licenses: A Literature Review. Cureus 2024 View
  19. Siebielec J, Ordak M, Oskroba A, Dworakowska A, Bujalska-Zadrozny M. Assessment Study of ChatGPT-3.5’s Performance on the Final Polish Medical Examination: Accuracy in Answering 980 Questions. Healthcare 2024;12(16):1637 View
  20. Ishida K, Arisaka N, Fujii K. Analysis of Responses of GPT-4 V to the Japanese National Clinical Engineer Licensing Examination. Journal of Medical Systems 2024;48(1) View
  21. Kim J, Lee S, Kim J, Shin D, Oh E, Kim J, Cho J. ChatGPT vs. sleep disorder specialist responses to common sleep queries: Ratings by experts and laypeople. Sleep Health 2024;10(6):665 View
  22. Jin H, Lee H, Kim E. Performance of ChatGPT-3.5 and GPT-4 in national licensing examinations for medicine, pharmacy, dentistry, and nursing: a systematic review and meta-analysis. BMC Medical Education 2024;24(1) View
  23. Waldock W, Zhang J, Guni A, Nabeel A, Darzi A, Ashrafian H. The Accuracy and Capability of Artificial Intelligence Solutions in Health Care Examinations and Certificates: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e56532 View
  24. Liu M, Okuhara T, Chang X, Okada H, Kiuchi T, Khlaif Z. Performance of ChatGPT in medical licensing examinations in countries worldwide: A systematic review and meta-analysis protocol. PLOS ONE 2024;19(10):e0312771 View
  25. Liu M, Okuhara T, Dai Z, Huang W, Gu L, Okada H, Furukawa E, Kiuchi T. Evaluating the Effectiveness of advanced large language models in medical Knowledge: A Comparative study using Japanese national medical examination. International Journal of Medical Informatics 2025;193:105673 View
  26. Li W, Shi H, Chen X, Lan J, Rehman A, Ge M, Shen L, Hu F, Jia Y, Li X, Chen H. Application of artificial intelligence in medical education: A meta-ethnographic synthesis. Medical Teacher 2024:1 View
  27. Aster A, Laupichler M, Rockwell-Kollmann T, Masala G, Bala E, Raupach T. ChatGPT and Other Large Language Models in Medical Education — Scoping Literature Review. Medical Science Educator 2024;35(1):555 View
  28. Yigitbay A. Evaluation of ChatGPT’s Performance in the Turkish Board of Orthopaedic Surgery Examination. Medical Bulletin of Haseki 2024;62(4):243 View
  29. Al‐Khater K. Comparative assessment of three AI platforms in answering USMLE Step 1 anatomy questions or identifying anatomical structures on radiographs. Clinical Anatomy 2025;38(2):186 View
  30. Kaewboonlert N, Poontananggul J, Pongsuwan N, Bhakdisongkhram G. Factors Associated With the Accuracy of Large Language Models in Basic Medical Science Examinations: Cross-Sectional Study. JMIR Medical Education 2025;11:e58898 View
  31. Jin H, Kim E. Performance of GPT-3.5 and GPT-4 on the Korean Pharmacist Licensing Examination: Comparison Study. JMIR Medical Education 2024;10:e57451 View
  32. Burisch C, Bellary A, Breuckmann F, Ehlers J, Thal S, Sellmann T, Gödde D. ChatGPT-4 Performance on German Continuing Medical Education—Friend or Foe (Trick or Treat)? Protocol for a Randomized Controlled Trial. JMIR Research Protocols 2025;14:e63887 View
  33. Qiu Y, Liu C. Capable exam-taker and question-generator: the dual role of generative AI in medical education assessment. Global Medical Education 2025 View
  34. Li H, Jiang Z, Guan Z, Bao Y, Liu Y, Hu T, Li J, Liu R, Wu L, Cheng D, Ji H, Wang Y, Wang Y, Cheung C, Zheng Y, Wang J, Li Z, Wu W, Lim C, Bee Y, Tan H, Ekinci E, Klonoff D, Echouffo-Tcheugui J, Mathioudakis N, Corsino L, Simó R, Sabanayagam C, Tan G, Cheng C, Wong T, Li H, Cai C, Mao L, Lim L, Tham Y, Sheng B, Jia W. Large language models for diabetes training: a prospective study. Science Bulletin 2025;70(6):934 View
  35. Prazeres F. ChatGPT’s Performance on Portuguese Medical Examination Questions: Comparative Analysis of ChatGPT-3.5 Turbo and ChatGPT-4o Mini. JMIR Medical Education 2025;11:e65108 View
  36. Ye H, Xu J, Huang D, Xie M, Guo J, Yang J, Bao H, Zhang M, Zheng C. Assessment of large language models’ performances and hallucinations for Chinese postgraduate medical entrance examination. Discover Education 2025;4(1) View
  37. Tseng L, Lu Y, Tseng L, Chen Y, Chen H. Performance of ChatGPT-4 on Taiwanese Traditional Chinese Medicine Licensing Examinations: Cross-Sectional Study. JMIR Medical Education 2025;11:e58897 View
  38. Koçak M, Oğuz A, Akçalı Z. The role of artificial intelligence in medical education: an evaluation of Large Language Models (LLMs) on the Turkish Medical Specialty Training Entrance Exam. BMC Medical Education 2025;25(1) View
  39. Yitzhaki S, Peled N, Kaplan E, Kadmon G, Nahum E, Gendler Y, Weissbach A. Comparing ChatGPT‐4 and a Paediatric Intensive Care Specialist in Responding to Medical Education Questions: A Multicenter Evaluation. Journal of Paediatrics and Child Health 2025 View
  40. Wang L, Li J, Zhuang B, Huang S, Fang M, Wang C, Li W, Zhang M, Gong S. Accuracy of Large Language Models When Answering Clinical Research Questions: Systematic Review and Network Meta-Analysis. Journal of Medical Internet Research 2025;27:e64486 View
  41. Park C, An M, Hwang G, Park R, An J. Assessing ChatGPT’s Clinical Competency and Patient Perceptions in Emergency Medicine: Insights from Clinical Performance Examinations (Preprint). JMIR Medical Informatics 2024 View
  42. Guo A, Canagasingham A, Rasiah K, Chalasani V, Mundy J, Chung A. The Growing Role of Artificial Intelligence in Surgical Education: ChatGPT Undertakes the Australian Generic Surgical Sciences Examination. ANZ Journal of Surgery 2025 View
  43. Guo F, Li T, Cunningham C. One year in the classroom with ChatGPT: empirical insights and transformative impacts. Frontiers in Education 2025;10 View