This paper is in the following e-collection/theme issue:

Theme Issue: ChatGPT and Generative Language Models in Medical Education (102) New Methods and Approaches in Medical Education (313) New Methods (1030) Chatbots and Conversational Agents (634) Generative Language Models Including ChatGPT (499)

Published on in Vol 9 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48433, first published .
Examining Real-World Medication Consultations and Drug-Herb Interactions: ChatGPT Performance Evaluation

Examining Real-World Medication Consultations and Drug-Herb Interactions: ChatGPT Performance Evaluation

Examining Real-World Medication Consultations and Drug-Herb Interactions: ChatGPT Performance Evaluation

Authors of this article:

Hsing-Yu Hsu1, 2 Author Orcid Image ;   Kai-Cheng Hsu3, 4 Author Orcid Image ;   Shih-Yen Hou3 Author Orcid Image ;   Ching-Lung Wu5 Author Orcid Image ;   Yow-Wen Hsieh1, 5 Author Orcid Image ;   Yih-Dih Cheng1, 5 Author Orcid Image
Article Authors Cited by (26) Tweetations (12) Metrics

Journals

  1. Zawiah M, Al-Ashwal F, Gharaibeh L, Abu Farha R, Alzoubi K, Abu Hammour K, Qasim Q, Abrah F. ChatGPT and Clinical Training: Perception, Concerns, and Practice of Pharm-D Students. Journal of Multidisciplinary Healthcare 2023;Volume 16:4099 View
  2. Tangadulrat P, Sono S, Tangtrakulwanich B. Using ChatGPT for Clinical Practice and Medical Education: Cross-Sectional Survey of Medical Students’ and Physicians’ Perceptions. JMIR Medical Education 2023;9:e50658 View
  3. Bazzari F, Bazzari A. Utilizing ChatGPT in Telepharmacy. Cureus 2024 View
  4. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  5. Ashraf A, Mackey T, Fittler A. Search Engines and Generative Artificial Intelligence Integration: Public Health Risks and Recommendations to Safeguard Consumers Online. JMIR Public Health and Surveillance 2024;10:e53086 View
  6. Zhu L, Mou W, Hong C, Yang T, Lai Y, Qi C, Lin A, Zhang J, Luo P. The Evaluation of Generative AI Should Include Repetition to Assess Stability. JMIR mHealth and uHealth 2024;12:e57978 View
  7. He W, Zhang W, Jin Y, Zhou Q, Zhang H, Xia Q. Physician Versus Large Language Model Chatbot Responses to Web-Based Questions From Autistic Patients in Chinese: Cross-Sectional Comparative Analysis. Journal of Medical Internet Research 2024;26:e54706 View
  8. Ramasubramanian S, Balaji S, Kannan T, Jeyaraman N, Sharma S, Migliorini F, Balasubramaniam S, Jeyaraman M. Comparative evaluation of artificial intelligence systems' accuracy in providing medical drug dosages: A methodological study. World Journal of Methodology 2024;14(4) View
  9. Grossman S, Zerilli T, Nathan J. Appropriateness of ChatGPT as a resource for medication‐related questions. British Journal of Clinical Pharmacology 2024 View
  10. Moglia A, Georgiou K, Cerveri P, Mainardi L, Satava R, Cuschieri A. Large language models in healthcare: from a systematic review on medical examinations to a comparative analysis on fundamentals of robotic surgery online test. Artificial Intelligence Review 2024;57(9) View
  11. MohanaSundaram A, Emran T. A commentary on ‘ChatGPT in medicine: prospects and challenges: a review article’ – correspondence. International Journal of Surgery 2024;110(8):5178 View
  12. Li X, Guo H, Li D, Zheng Y. Engine of Innovation in Hospital Pharmacy: Applications and Reflections of ChatGPT. Journal of Medical Internet Research 2024;26:e51635 View
  13. Lima T, Bonafé M, Baby A, Visacri M. ChatGPT in Pharmacy Practice: Disruptive or Destructive Innovation? A Scoping Review. Scientia Pharmaceutica 2024;92(4):58 View
  14. Schweitzer S, Conrads M, Naeve J. Claude Rules: An Evaluation of Large Language Models’ Applicability to Solve Cases in German Business Law. Procedia Computer Science 2024;246:2675 View
  15. Ren Y, Luo X, Wang Y, Li H, Zhang H, Li Z, Lai H, Li X, Ge L, ESTILL J, Zhang L, Yang S, Chen Y, Wen C, Bian Z. Large Language Models in Traditional Chinese Medicine: A Scoping Review. Journal of Evidence-Based Medicine 2025;18(1) View
  16. Yassin Y, Nguyen T, Panchal K, Getchell K, Aungst T. Evaluating a generative artificial intelligence accuracy in providing medication instructions from smartphone images. Journal of the American Pharmacists Association 2025;65(1):102284 View
  17. de Donato D, Aguilar G, Ribeiro L, dos Santos L, dos Santos L, Costa W, de Oliveira A. Development and Content Analysis Protocol for Evaluating Artificial Intelligence in Drug‐Related Information. Journal of Evaluation in Clinical Practice 2025;31(1) View
  18. Kusaka S, Akitomo T, Hamada M, Asao Y, Iwamoto Y, Tachikake M, Mitsuhata C, Nomura R. Usefulness of Generative Artificial Intelligence (AI) Tools in Pediatric Dentistry. Diagnostics 2024;14(24):2818 View
  19. Yang H, Hu M, Most A, Hawkins W, Murray B, Smith S, Li S, Sikora A. Evaluating accuracy and reproducibility of large language model performance on critical care assessments in pharmacy education. Frontiers in Artificial Intelligence 2025;7 View
  20. Beheshti M, Toubal I, Alaboud K, Almalaysha M, Ogundele O, Turabieh H, Abdalnabi N, Boren S, Scott G, Dahu B. Evaluating the Reliability of ChatGPT for Health-Related Questions: A Systematic Review. Informatics 2025;12(1):9 View
  21. Aydin S, Karabacak M, Vlachos V, Margetis K. Navigating the potential and pitfalls of large language models in patient-centered medication guidance and self-decision support. Frontiers in Medicine 2025;12 View
  22. Wang Y, Shen H, Chen T, Chiang S, Lin T. Performance of ChatGPT-3.5 and ChatGPT-4 in the Taiwan National Pharmacist Licensing Examination: Comparative Evaluation Study. JMIR Medical Education 2025;11:e56850 View
  23. Kang B, Lee S, Bae H, Kim C. Current Status and Direction of Generative Large Language Model Applications in Medicine : Focusing on East Asian Medicine. Journal of Physiology & Pathology in Korean Medicine 2024;38(2):49 View
  24. Zhang J, Wang J, Zhang J, Xia X, Zhou Z, Zhou X, Wu Y. Young Adult Perspectives on Artificial Intelligence–Based Medication Counseling in China: Discrete Choice Experiment. Journal of Medical Internet Research 2025;27:e67744 View
  25. Kiyomiya K, Aomori T, Kawazoe H, Ohtani H. Current Use of Generative Artificial Intelligence in Pharmacy Practice: A Literature Mini-review. Iryo Yakugaku (Japanese Journal of Pharmaceutical Health Care and Sciences) 2025;51(4):177 View
  26. Khatri S, Sengul A, Moon J, Jackevicius C. Accuracy and reproducibility of ChatGPT responses to real‐world drug information questions. JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY 2025 View