This paper is in the following e-collection/theme issue:

Research Letter (8) Artificial Intelligence (AI) in Medical Education (131) Testing and Assessment in Medical Education (74) Artificial Intelligence (1840) Artificial Intelligence, Machine Learning, and Natural Language Processing for Public Health (68)

Published on in Vol 11 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/72034, first published .
Assessment of Large Language Model Performance on Medical School Essay-Style Concept Appraisal Questions: Exploratory Study

Assessment of Large Language Model Performance on Medical School Essay-Style Concept Appraisal Questions: Exploratory Study

Assessment of Large Language Model Performance on Medical School Essay-Style Concept Appraisal Questions: Exploratory Study

Authors of this article:

Seysha Mehta1 Author Orcid Image ;   Eliot N Haddad1 Author Orcid Image ;   Indira Bhavsar Burke2 Author Orcid Image ;   Alana K Majors1 Author Orcid Image ;   Rie Maeda1 Author Orcid Image ;   Sean M Burke2 Author Orcid Image ;   Abhishek Deshpande1 Author Orcid Image ;   Amy S Nowacki1 Author Orcid Image ;   Christina C Lindenmeyer1 Author Orcid Image ;   Neil Mehta1 Author Orcid Image
Article Authors Cited by Tweetations (4) Metrics
All Time | Last Month | Last Six Months | Last Year
Neil Neil @Neil_Mehta

Can LLM complex essay type questions as well as medical students? Can experienced faculty graders identify LLM responses? Our paper in JMIR @SeyshaMehta https://t.co/uh8e6sEIPB 1/3

12:10 AM · Jun 24, 2025

1
0
Seysha Mehta Seysha Mehta @SeyshaMehta

RT @Neil_Mehta: Can LLM complex essay type questions as well as medical students? Can experienced faculty graders identify LLM responses?…

2:04 PM · Jun 24, 2025

1
1
Med Peds Hospitalist Med Peds Hospitalist @medpedshosp

RT @Neil_Mehta: Can LLM complex essay type questions as well as medical students? Can experienced faculty graders identify LLM responses?…

4:35 AM · Jun 25, 2025

6
2
Melchor Sanchez Melchor Sanchez @melchorsm

RT @Neil_Mehta: Can LLM complex essay type questions as well as medical students? Can experienced faculty graders identify LLM responses?…

10:34 PM · Jun 25, 2025

6
3