This paper is in the following e-collection/theme issue:

Artificial Intelligence (AI) in Medical Education (182) Chatbots and Conversational Agents (740) Human Factors and Usability Case Studies (1005) Generative Language Models Including ChatGPT (708) Decision Support for Health Professionals (1539) Development and Evaluation of Research Methods, Instruments and Tools (744) Natural Language Processing (917) Cardiology (224)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51282, first published .
Assessing GPT-4’s Performance in Delivering Medical Advice: Comparative Analysis With Human Experts

Assessing GPT-4’s Performance in Delivering Medical Advice: Comparative Analysis With Human Experts

Assessing GPT-4’s Performance in Delivering Medical Advice: Comparative Analysis With Human Experts

Authors of this article:

Eunbeen Jo1 Author Orcid Image ;   Sanghoun Song2 Author Orcid Image ;   Jong-Ho Kim3, 4 Author Orcid Image ;   Subin Lim5 Author Orcid Image ;   Ju Hyeon Kim5 Author Orcid Image ;   Jung-Joon Cha5 Author Orcid Image ;   Young-Min Kim6 Author Orcid Image ;   Hyung Joon Joo1, 3, 4 Author Orcid Image
Article Authors Cited by (15) Tweetations (2) Metrics

Journals

  1. Leon M, Ruaengsri C, Pelletier G, Bethencourt D, Shibata M, Flores M, Shudo Y. Harnessing the Power of ChatGPT in Cardiovascular Medicine: Innovations, Challenges, and Future Directions. Journal of Clinical Medicine 2024;13(21):6543 View
  2. Janumpally R, Nanua S, Ngo A, Youens K. Generative artificial intelligence in graduate medical education. Frontiers in Medicine 2025;11 View
  3. Adarkwah M, Badu S, Osei E, Adu-Gyamfi E, Odame J, Schneider K. ChatGPT in healthcare education: a double-edged sword of trends, challenges, and opportunities. Discover Education 2025;4(1) View
  4. Weisman D, Sugarman A, Huang Y, Gelberg L, Ganz P, Comulada W. Development of a GPT-4–Powered Virtual Simulated Patient and Communication Training Platform for Medical Students to Practice Discussing Abnormal Mammogram Results With Patients: Multiphase Study. JMIR Formative Research 2025;9:e65670 View
  5. Sav N. Assessing the performance of large language models (GPT-3.5 and GPT-4) and accurate clinical information for pediatric nephrology. Pediatric Nephrology 2025;40(9):2879 View
  6. Abu-Faty H, Kafafy A, Hadhoud M, Abdel-Raouf O. Integrating generative AI and machine learning classifiers for solving heterogenous MCGDM: a case of employee churn prediction. Scientific Reports 2025;15(1) View
  7. Chen R, Zhang S, Zheng Y, Yu Q, Wang C. Enhancing treatment decision-making for low back pain: a novel framework integrating large language models with retrieval-augmented generation technology. Frontiers in Medicine 2025;12 View
  8. Zhou S, Xu Z, Zhang M, Xu C, Guo Y, Zhan Z, Fang Y, Ding S, Wang J, Xu K, Xia L, Yeung J, Zha D, Cai D, Melton G, Lin M, Zhang R. Large language models for disease diagnosis: a scoping review. npj Artificial Intelligence 2025;1(1) View
  9. Gün M. Can AI match emergency physicians in managing common emergency cases? A comparative performance evaluation. BMC Emergency Medicine 2025;25(1) View
  10. Wang R, Ding Y, Shen Y, Liu H, Wang P, Gao Z. Comparative Evaluation of Teaching Plans on Prostate Cancer Generated by Various Large Language Models and a Human Expert. Engineering Reports 2025;7(8) View
  11. Yang X, Chen W. The performance of ChatGPT on medical image-based assessments and implications for medical education. BMC Medical Education 2025;25(1) View
  12. Zorlu Ö, Günal U, Yazici S. The quality, accuracy, and readability of information about hidradenitis suppurativa provided by artificial intelligence: Comparative analysis of ChatGPT, Copilot, and Perplexity. Medicine 2025;104(39):e44728 View
  13. Esmaeilzadeh P. Ethical implications of using general-purpose LLMs in clinical settings: a comparative analysis of prompt engineering strategies and their impact on patient safety. BMC Medical Informatics and Decision Making 2025;25(1) View
  14. Caamaño-Gordillo D, Mula J, de la Torre R. Impact of generative artificial intelligence on workload, efficiency and labour productivity. IFAC-PapersOnLine 2025;59(10):1408 View
  15. Wang L, Peng Y, Zhang G, Huang Y, Yang G, Jiang Y, Xu Q, Yu J, Jin J, Qiao H, Wu Q, Wei Z, Tang W, Liu J. Application of Narrative and AI-Assisted Follow-Up After Voluntary Medical Male Circumcision: Multicenter, Double-Blind, Prospective, Randomized Controlled Trial. Journal of Medical Internet Research 2025;27:e68573 View