AI- vs Human-Based Assessment of Medical Interview Transcripts in a Generative AI–Simulated Patient System: Cross-Sectional Validation Study

Hiromizu Takahashi   ¹ , MD, PhD ;   Kiyoshi Shikino   ² , MD, MHPE, PhD ;   Takeshi Kondo   ^{3, 4} , MD, MHPE, PhD ;   Yuji Yamada   ⁵ , MD, MPH, PhD ;   Yoshitaka Tomoda   ⁶ , MD, PhD, FACP ;   Minoru Kishi   ⁷ , MD, PhD ;   Yuki Aiyama   ⁸ , MD ;   Sho Nagai   ⁹ , RN, PHN, MSN ;   Akiko Enomoto   ⁹ , RN, PHN, MSN ;   Yoshinori Tokushima   ¹⁰ , MD, PhD ;   Takahiro Shinohara   ¹¹ , MD ;   Fumiaki Sano   ¹ , MD ;   Takeshi Matsuura   ¹² , MD ;   Rikiya Watanabe   ¹³ , MD ;   Toshio Naito   ¹ , MD, PhD

¹ Department of General Medicine, Faculty of Medicine, Juntendo University, Tokyo, Japan

² Department of Community-Oriented Medical Education, Graduate School of Medicine, Chiba University, Chiba, Japan

³ Center for Postgraduate Clinical Training and Career Development, Nagoya University Hospital, Nagoya, Japan

⁴ The School of Health Professions Education, Maastricht University, Maastricht, The Netherlands

⁵ Brookdale Department of Geriatrics and Palliative Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, United States

⁶ Department of General Internal Medicine, Itabashi Chuo Medical Center, Tokyo, Japan

⁷ Department of Internal Medicine, Nishiwaki Municipal Hospital, Hyogo, Japan

⁸ Anesthesiology and Critical Care Medicine, Tenri Hospital, Nara, Japan

⁹ Department of Nursing, School of Nursing, University of Human Environments, Aichi, Japan

¹⁰ Department of General Medicine, Saga University Hospital, Saga, Japan

¹¹ Department of General Medicine, Graduate School of Medical and Dental Sciences, Institute of Science Tokyo, Tokyo, Japan

¹² Department of General Medicine, Bibai City Hospital, Hokkaido, Japan

¹³ Department of General Internal Medicine, Kita-Harima Medical Center, Hyogo, Japan