Search Articles

View query in Help articles search

Search Results (1 to 10 of 10 Results)

Download search results: CSV END BibTex RIS


Think-Aloud Testing of a Companion App for Colonoscopy Examinations: Usability Study

Think-Aloud Testing of a Companion App for Colonoscopy Examinations: Usability Study

Considering that user research can significantly enhance a tool’s adoption and adherence rates post launch [28], this usability study was conducted to pinpoint strengths and weaknesses in the prototype of a companion app for colonoscopy examinations and to provide detailed insights into its quality regarding usefulness, ease of use, and content comprehension. The goal is to refine the product based on evidence gathered from potential users, ensuring it meets its intended purpose effectively.

Christine Jacob, Roman Müller, Sonja Schüler, Alix Rey, Guillaume Rey, Berj Armenian, Alain Vonlaufen, Michael Drepper, Marius Zimmerli

JMIR Hum Factors 2025;12:e67043

Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

The application of Chat GPT in medical examinations, particularly within the CNMLE framework, offers a pioneering approach to gauge the potential of LLMs in clinical diagnosis and treatment planning. This study comprehensively assessed Chat GPT’s performance in addressing CNMLE questions, focusing on model evolution and system role designation, which has not yet been fully investigated.

Shuai Ming, Qingge Guo, Wenjun Cheng, Bo Lei

JMIR Med Educ 2024;10:e52784

Appraisal of ChatGPT’s Aptitude for Medical Education: Comparative Analysis With Third-Year Medical Students in a Pulmonology Examination

Appraisal of ChatGPT’s Aptitude for Medical Education: Comparative Analysis With Third-Year Medical Students in a Pulmonology Examination

Our study aims to evaluate the performance of Chat GPT in the context of pneumology examinations through a comparative analysis with that of third-year medical students. This research adopts a cross-sectional design and was conducted at the pneumology teaching section of the Faculty of Medicine of Tunis (FMT), Tunisia, in June 2023. The study uses a comparative approach, involving 2 distinct groups: Chat GPT and medical students.

Hela Cherif, Chirine Moussa, Abdel Mouhaymen Missaoui, Issam Salouage, Salma Mokaddem, Besma Dhahri

JMIR Med Educ 2024;10:e52818

The Utility of Wearable Cameras in Developing Examination Questions and Answers on Physical Examinations: Preliminary Study

The Utility of Wearable Cameras in Developing Examination Questions and Answers on Physical Examinations: Preliminary Study

However, they have not been used in medical examinations. This study aimed to examine the utility of wearable cameras in creating examination questions and answers. We developed a single examination question focusing on physical examination skills for resident physicians. In October 2021, authors YN and TS created a simulated outpatient case of appendicitis: a middle-aged man with abdominal pain and localized peritoneal irritation in the right lower quadrant.

Sho Fukui, Taro Shimizu, Yuji Nishizaki, Kiyoshi Shikino, Yu Yamamoto, Hiroyuki Kobayashi, Yasuharu Tokuda

JMIR Med Educ 2024;10:e53193

Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study

Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study

The examinations consist of 60 questions (6 on medical interview/professionalism, 15 on symptomatology/clinical reasoning, 15 on clinical procedure, and 24 on disease knowledge) and include video- and audio-format questions. The GM-ITE was first introduced in 2011 by the Japan Institute for Advancement of the Medical Education Program (JAMEP), a nonprofit organization, and is administered annually.

Koshi Kataoka, Yuji Nishizaki, Taro Shimizu, Yu Yamamoto, Kiyoshi Shikino, Masanori Nojima, Kazuya Nagasaki, Sho Fukui, Sho Nishiguchi, Kohta Katayama, Masaru Kurihara, Rieko Ueda, Hiroyuki Kobayashi, Yasuharu Tokuda

JMIR Med Educ 2024;10:e52207

Performance of GPT-4V in Answering the Japanese Otolaryngology Board Certification Examination Questions: Evaluation Study

Performance of GPT-4V in Answering the Japanese Otolaryngology Board Certification Examination Questions: Evaluation Study

We have verified the effectiveness of large-scale language-processing models in medical licensing and otolaryngology board certification examinations [6]. Although a certain level of accuracy has been achieved through prompt engineering, these validations have been primarily limited to text-based information processing, and challenges remain in the analysis of complex medical data containing images and diagrams.

Masao Noda, Takayoshi Ueno, Ryota Koshu, Yuji Takaso, Mari Dias Shimada, Chizu Saito, Hisashi Sugimoto, Hiroaki Fushiki, Makoto Ito, Akihiro Nomura, Tomokazu Yoshizaki

JMIR Med Educ 2024;10:e57054

Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study

Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study

The latest model, GPT-4, has been reported to achieve passing scores in medical licensing examinations in non–English speaking countries such as Japan, China, Poland, and Peru [8-13]. Despite these successes, there is still a significant challenge in applying LLMs to real-world problems with non–text-based information. Radiological, pathological, and many other types of visual information play a crucial role in determining a patient’s management.

Takahiro Nakao, Soichiro Miki, Yuta Nakamura, Tomohiro Kikuchi, Yukihiro Nomura, Shouhei Hanaoka, Takeharu Yoshikawa, Osamu Abe

JMIR Med Educ 2024;10:e54393

Development of a Clinical Simulation Video to Evaluate Multiple Domains of Clinical Competence: Cross-Sectional Study

Development of a Clinical Simulation Video to Evaluate Multiple Domains of Clinical Competence: Cross-Sectional Study

Therefore, this study developed a clinical simulation video (CSV) named “innovative examination” for the GM-ITE to assess residents’ clinical competency in a real-world setting using two components: (1) a high-quality CSV showing a medical interview and physical examinations with a patient and family in an emergency room and (2) follow-up questions for the residents to provide their diagnosis and recommendations.

Kiyoshi Shikino, Yuji Nishizaki, Sho Fukui, Daiki Yokokawa, Yu Yamamoto, Hiroyuki Kobayashi, Taro Shimizu, Yasuharu Tokuda

JMIR Med Educ 2024;10:e54401

A Novel Evaluation Model for Assessing ChatGPT on Otolaryngology–Head and Neck Surgery Certification Examinations: Performance Study

A Novel Evaluation Model for Assessing ChatGPT on Otolaryngology–Head and Neck Surgery Certification Examinations: Performance Study

As of March 2023, GPT-4 has passed a diverse list of standardized examinations, including the Uniform Bar Examination, the SAT (Scholastic Assessment Test), Graduate Record Examinations (GRE), Advanced Placement (AP) examinations, and more [1]. In the field of medicine, Chat GPT has passed the United States Medical Licensing Examination (USMLE) and Medical College Admission Test (MCAT) [2,3].

Cai Long, Kayle Lowe, Jessica Zhang, André dos Santos, Alaa Alanazi, Daniel O'Brien, Erin D Wright, David Cote

JMIR Med Educ 2024;10:e49970

Performance Comparison of ChatGPT-4 and Japanese Medical Residents in the General Medicine In-Training Examination: Comparison Study

Performance Comparison of ChatGPT-4 and Japanese Medical Residents in the General Medicine In-Training Examination: Comparison Study

Nonetheless, it is crucial to recognize that these licensing examinations are designed for candidates who have completed their pregraduate education. Consequently, the performance of GPT-4 in terms of actual clinical knowledge and skills following the mandatory postgraduate clinical residency training in Japan remains unverified.

Takashi Watari, Soshi Takagi, Kota Sakaguchi, Yuji Nishizaki, Taro Shimizu, Yu Yamamoto, Yasuharu Tokuda

JMIR Med Educ 2023;9:e52202