This paper is in the following e-collection/theme issue:

Theme Issue: ChatGPT and Generative Language Models in Medical Education (92) e-Learning and Digital Medical Education (754) Natural Language Processing (764) Chatbots and Conversational Agents (589) Ontologies, Classifications, and Coding (256) Artificial Intelligence (1602) Telehealth and Telemonitoring (1807)

Published on in Vol 9 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49183, first published .
ChatGPT Versus Consultants: Blinded Evaluation on Answering Otorhinolaryngology Case–Based Questions

ChatGPT Versus Consultants: Blinded Evaluation on Answering Otorhinolaryngology Case–Based Questions

ChatGPT Versus Consultants: Blinded Evaluation on Answering Otorhinolaryngology Case–Based Questions

Authors of this article:

Christoph Raphael Buhr1, 2 Author Orcid Image ;   Harry Smith3 Author Orcid Image ;   Tilman Huppertz1 Author Orcid Image ;   Katharina Bahr-Hamm1 Author Orcid Image ;   Christoph Matthias1 Author Orcid Image ;   Andrew Blaikie2 Author Orcid Image ;   Tom Kelsey3 Author Orcid Image ;   Sebastian Kuhn4 Author Orcid Image ;   Jonas Eckrich1 Author Orcid Image
Article Authors Cited by (18) Tweetations (2) Metrics

Journals

  1. Sauder M, Tritsch T, Rajput V, Schwartz G, Shoja M. Exploring Generative Artificial Intelligence-Assisted Medical Education: Assessing Case-Based Learning for Medical Students. Cureus 2024 View
  2. Teixeira-Marques F, Medeiros N, Nazaré F, Alves S, Lima N, Ribeiro L, Gama R, Oliveira P. Exploring the role of ChatGPT in clinical decision-making in otorhinolaryngology: a ChatGPT designed study. European Archives of Oto-Rhino-Laryngology 2024;281(4):2023 View
  3. Eckrich J, Ellinger J, Cox A, Stein J, Ritter M, Blaikie A, Kuhn S, Buhr C. Urology consultants versus large language models: Potentials and hazards for medical advice in urology. BJUI Compass 2024;5(5):552 View
  4. Jedrzejczak W, Skarzynski P, Raj-Koziak D, Sanfins M, Hatzopoulos S, Kochanek K. ChatGPT for Tinnitus Information and Support: Response Accuracy and Retest after Three and Six Months. Brain Sciences 2024;14(5):465 View
  5. Buhr C, Smith H, Huppertz T, Bahr-Hamm K, Matthias C, Cuny C, Snijders J, Ernst B, Blaikie A, Kelsey T, Kuhn S, Eckrich J. Assessing unknown potential—quality and limitations of different large language models in the field of otorhinolaryngology. Acta Oto-Laryngologica 2024;144(3):237 View
  6. Griewing S, Knitza J, Boekhoff J, Hillen C, Lechner F, Wagner U, Wallwiener M, Kuhn S. Evolution of publicly available large language models for complex decision-making in breast cancer care. Archives of Gynecology and Obstetrics 2024;310(1):537 View
  7. Rotem R, Zamstein O, Rottenstreich M, O'Sullivan O, O'reilly B, Weintraub A. The future of patient education: A study on AI‐driven responses to urinary incontinence inquiries. International Journal of Gynecology & Obstetrics 2024;167(3):1004 View
  8. Li M, Guenier A. ChatGPT and Health Communication. International Journal of E-Health and Medical Communications 2024;15(1):1 View
  9. Yong L, Tung J, Lee Z, Kuan W, Chua M. Performance of Large Language Models in Patient Complaint Resolution: Web-Based Cross-Sectional Survey. Journal of Medical Internet Research 2024;26:e56413 View
  10. Lan L, Yang L, Li J, Hou J, Yan Y, Zhang Y. Establishing a novel score system and using it to assess and compare the quality of ChatGPT‐4 consultation with physician consultation for obstetrics and gynecology: A pilot study. International Journal of Gynecology & Obstetrics 2025;168(3):1251 View
  11. Köroğlu E, Ersoy R, Saçıkara M, Dellal Kahramanca F, Polat Ş, Topaloğlu O, Çakır B. Evaluation of the impact Of ChatGPT support on acromegaly management and patient education. Endocrine 2024;87(3):1141 View
  12. Cuevas-Nunez M, Silberberg V, Arregui M, Jham B, Ballester-Victoria R, Koptseva I, de Tejada M, Posada-Caez R, Manich V, Bara-Casaus J, Fernández-Figueras M. Diagnostic performance of ChatGPT-4.0 in histopathological description analysis of oral and maxillofacial lesions: a comparative study with pathologists. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology 2025;139(4):453 View
  13. Cao Y, Lu W, Shi R, Liu F, Liu S, Xu X, Yang J, Rong G, Xin C, Zhou X, Sun X, Hong J. Performance of Popular Large Language Models in Glaucoma Patient Education: a randomized controlled study. Advances in Ophthalmology Practice and Research 2024 View
  14. Pordzik J, Bahr-Hamm K, Huppertz T, Gouveris H, Seifen C, Blaikie A, Matthias C, Kuhn S, Eckrich J, Buhr C. Patient Support in Obstructive Sleep Apnoea by a Large Language Model – ChatGPT 4o on Answering Frequently Asked Questions on First Line Positive Airway Pressure and Second Line Hypoglossal Nerve Stimulation Therapy: A Pilot Study. Nature and Science of Sleep 2024;Volume 16:2269 View
  15. Buhr C, Ernst B, Blaikie A, Smith H, Kelsey T, Matthias C, Fleischmann M, Jungmann F, Alt J, Brandts C, Kämmerer P, Foersch S, Kuhn S, Eckrich J. Assessment of decision-making with locally run and web-based large language models versus human board recommendations in otorhinolaryngology, head and neck surgery. European Archives of Oto-Rhino-Laryngology 2025;282(3):1593 View
  16. Beheshti M, Toubal I, Alaboud K, Almalaysha M, Ogundele O, Turabieh H, Abdalnabi N, Boren S, Scott G, Dahu B. Evaluating the Reliability of ChatGPT for Health-Related Questions: A Systematic Review. Informatics 2025;12(1):9 View
  17. Tosun B, Yilmaz Z. Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey. Journal of Dental Sciences 2025 View
  18. Li R, Wu T. Application of Artificial Intelligence Generated Content in Medical Examinations. Advances in Medical Education and Practice 2025;Volume 16:331 View