Search Articles

View query in Help articles search

Search Results (1 to 9 of 9 Results)

Download search results: CSV END BibTex RIS


Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

Thus, GPT-4 conclusively demonstrated significantly better performance than GPT-3.5, as evidenced by various official medical exams [8]. Besides the model version, Chat GPT allows users to guide its behavior by adding prompts that describe its system role. These system roles influence the direction of Chat GPT’s answers and may affect its reliability. However, the impact of these system roles on Chat GPT’s performance in medical field has not yet been investigated.

Shuai Ming, Qingge Guo, Wenjun Cheng, Bo Lei

JMIR Med Educ 2024;10:e52784

Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study

Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study

The 2020 GM-ITE was offered at 593 teaching hospitals nationwide, and 7669 residents took the exams. A total of 6816 residents from 588 teaching hospitals participated in the survey on the training environment. The study population consisted of 3013 residents from 215 teaching hospitals with at least 5 GM-ITE examinees and web-based resource use log data from 2017 to 2019. Hospitals in all regions of Japan, namely Hokkaido, Tohoku, Kanto, Chubu, Kinki, Chugoku, Shikoku, Kyushu, and Okinawa, were included.

Koshi Kataoka, Yuji Nishizaki, Taro Shimizu, Yu Yamamoto, Kiyoshi Shikino, Masanori Nojima, Kazuya Nagasaki, Sho Fukui, Sho Nishiguchi, Kohta Katayama, Masaru Kurihara, Rieko Ueda, Hiroyuki Kobayashi, Yasuharu Tokuda

JMIR Med Educ 2024;10:e52207

Performance of GPT-4V in Answering the Japanese Otolaryngology Board Certification Examination Questions: Evaluation Study

Performance of GPT-4V in Answering the Japanese Otolaryngology Board Certification Examination Questions: Evaluation Study

Generally, there are more favorable reports for national medical licensing examinations, while there are comparatively poorer reports for specialist-level exams [16,17]. Even when looking at Japanese language reports, while national examinations and general practice examinations have shown good results [3-5,18], ophthalmology, pharmacist, nursing, and dentistry examinations have around a 50%-70% accuracy rate [19-22], with the otolaryngology field in this study showing comparable results [6].

Masao Noda, Takayoshi Ueno, Ryota Koshu, Yuji Takaso, Mari Dias Shimada, Chizu Saito, Hisashi Sugimoto, Hiroaki Fushiki, Makoto Ito, Akihiro Nomura, Tomokazu Yoshizaki

JMIR Med Educ 2024;10:e57054