Use of Large Language Models for Automated Short-Answer Question Grading in Second-Cycle Medical Education: Performance and Consistency Evaluation Study

Sabrina Sidali   ^{1, 2 *} , MD, PhD ;   Pierre-Antoine Soret   ^{3, 4 *} , MD, PhD ;   Mathilde Wagner   ^{5, 6} , MD, PhD ;   Thibault Voron   ⁷ , MD, PhD ;   Quentin Vanderbecq   ^{5, 6 *} , MD, PhD

¹ Cordeliers Research Center, Sorbonne University, Inserm, University of Paris, Functional Genomics of Solid Tumors Team, French National Cancer League–Accredited Team, Labex OncoImmunology, F-75006 Paris, Île-de-France, France

² University of Paris, Greater Paris University Hospitals (AP-HP), DMU DIGEST, Beaujon Hospital, Reference Center for Vascular Liver Diseases, FILFOIE, ERN RARE-LIVER, Inflammation Research Center, Inserm UMR 1149, Paris, Île-de-France, France

³ Sorbonne University, Inserm, Saint-Antoine Research Center (CRSA), Paris, Île-de-France, France

⁴ Saint-Antoine Hospital, Greater Paris University Hospitals (AP-HP), Paris, Île-de-France, France

⁵ Department of Radiology, Saint-Antoine Hospital, Greater Paris University Hospitals (AP-HP), Paris, Île-de-France, France

⁶ LIB, UMR 7371, Sorbonne University, CNRS, Inserm U1146, Paris, Île-de-France, France

⁷ Department of General and Digestive Surgery, Saint-Antoine Hospital, Greater Paris University Hospitals (AP-HP), Sorbonne University, Paris, Île-de-France, France

*these authors contributed equally