This paper is in the following e-collection/theme issue:

Artificial Intelligence (AI) in Medical Education (109) Generative Language Models Including ChatGPT (413) Research Instruments, Questionnaires, and Tools (632) Artificial Intelligence (1602) Chatbots and Conversational Agents (589) Theme Issue: ChatGPT and Generative Language Models in Medical Education (92)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54393, first published .
Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study

Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study

Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study

Authors of this article:

Takahiro Nakao1 Author Orcid Image ;   Soichiro Miki1 Author Orcid Image ;   Yuta Nakamura1 Author Orcid Image ;   Tomohiro Kikuchi1, 2 Author Orcid Image ;   Yukihiro Nomura1, 3 Author Orcid Image ;   Shouhei Hanaoka4 Author Orcid Image ;   Takeharu Yoshikawa1 Author Orcid Image ;   Osamu Abe4 Author Orcid Image
Article Authors Cited by (18) Tweetations (4) Metrics

Journals

  1. Koga S, Du W, Ono D. Response to “Can ChatGPT Vision diagnose melanoma? An exploratory diagnostic accuracy study.”. Journal of the American Academy of Dermatology 2024;91(3):e61 View
  2. Liu M, Okuhara T, Chang X, Shirabe R, Nishiie Y, Okada H, Kiuchi T. Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e60807 View
  3. Ishida K, Hanada E. Potential of ChatGPT to Pass the Japanese Medical and Healthcare Professional National Licenses: A Literature Review. Cureus 2024 View
  4. Tong W, Zhang X, Zeng H, Pan J, Gong C, Zhang H. Reforming China’s Secondary Vocational Medical Education: Adapting to the Challenges and Opportunities of the AI Era. JMIR Medical Education 2024;10:e48594 View
  5. Liu C, Ho C, Wu T. Custom GPTs Enhancing Performance and Evidence Compared with GPT-3.5, GPT-4, and GPT-4o? A Study on the Emergency Medicine Specialist Examination. Healthcare 2024;12(17):1726 View
  6. Kipp M. From GPT-3.5 to GPT-4.o: A Leap in AI’s Medical Exam Performance. Information 2024;15(9):543 View
  7. Brin D, Sorin V, Konen E, Nadkarni G, Glicksberg B, Klang E. How GPT models perform on the United States medical licensing examination: a systematic review. Discover Applied Sciences 2024;6(10) View
  8. Okada A. Editorial Comment on Can artificial intelligence pass the Japanese urology board examinations?. International Journal of Urology 2024;31(12):1442 View
  9. Morishita M, Fukuda H, Yamaguchi S, Muraoka K, Nakamura T, Hayashi M, Yoshioka I, Ono K, Awano S. An exploratory assessment of GPT-4o and GPT-4 performance on the Japanese National Dental Examination. The Saudi Dental Journal 2024;36(12):1577 View
  10. Zong H, Wu R, Cha J, Wang J, Wu E, Li J, Zhou Y, Zhang C, Feng W, Shen B. Large Language Models in Worldwide Medical Exams: Platform Development and Comprehensive Analysis. Journal of Medical Internet Research 2024;26:e66114 View
  11. Güneş Y, Ülkir M. Comparative Performance Evaluation of Multimodal Large Language Models, Radiologist, and Anatomist in Visual Neuroanatomy Questions. Uludağ Üniversitesi Tıp Fakültesi Dergisi 2025;50(3):551 View
  12. Schramm S, Preis S, Metz M, Jung K, Schmitz-Koep B, Zimmer C, Wiestler B, Hedderich D, Kim S. Impact of Multimodal Prompt Elements on Diagnostic Performance of GPT-4V in Challenging Brain MRI Cases. Radiology 2025;314(1) View
  13. Nguyen H, Dang H, Nguyen T, Hoang V, Nguyen V, Wu J. Accuracy of latest large language models in answering multiple choice questions in dentistry: A comparative study. PLOS ONE 2025;20(1):e0317423 View
  14. Scherr R, Spina A, Dao A, Andalib S, Halaseh F, Blair S, Wiechmann W, Rivera R. Novel Evaluation Metric and Quantified Performance of ChatGPT-4 Patient Management Simulations for Early Clinical Education: Experimental Study. JMIR Formative Research 2025;9:e66478 View
  15. Yang Z, Yao Z, Tasmin M, Vashisht P, Jang W, Ouyang F, Wang B, McManus D, Berlowitz D, Yu H. Unveiling GPT-4V's hidden challenges behind high accuracy on USMLE questions: Observational Study. Journal of Medical Internet Research 2025;27:e65146 View
  16. Mine Y, Taji T, Okazaki S, Takeda S, Peng T, Shimoe S, Kaku M, Nikawa H, Kakimoto N, Murayama T. Analyzing the performance of multimodal large language models on visually-based questions in the Japanese National Examination for Dental Technicians. Journal of Dental Sciences 2025 View