This paper is in the following e-collection/theme issue:

Theme Issue: ChatGPT and Generative Language Models in Medical Education (102) e-Learning and Digital Medical Education (793) Artificial Intelligence (1740) New Methods and Approaches in Medical Education (311) Continuing Medical Education (CME) for Doctors (134) Chatbots and Conversational Agents (633) Generative Language Models Including ChatGPT (497)

Published on in Vol 9 (2023)

This is a member publication of University of Cambridge (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48978, first published .
Performance of ChatGPT on the Situational Judgement Test—A Professional Dilemmas–Based Examination for Doctors in the United Kingdom

Performance of ChatGPT on the Situational Judgement Test—A Professional Dilemmas–Based Examination for Doctors in the United Kingdom

Performance of ChatGPT on the Situational Judgement Test—A Professional Dilemmas–Based Examination for Doctors in the United Kingdom

Authors of this article:

Robin J Borchert1, 2 Author Orcid Image ;   Charlotte R Hickman3 Author Orcid Image ;   Jack Pepys4 Author Orcid Image ;   Timothy J Sadler2 Author Orcid Image
Article Authors Cited by (22) Tweetations (4) Metrics

Journals

  1. Park J. Medical students’ patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study. Journal of Educational Evaluation for Health Professions 2023;20:29 View
  2. Sallam M, Al-Salahat K. Below average ChatGPT performance in medical microbiology exam compared to university students. Frontiers in Education 2023;8 View
  3. Morjaria L, Burns L, Bracken K, Levinson A, Ngo Q, Lee M, Sibbald M. Examining the Efficacy of ChatGPT in Marking Short-Answer Assessments in an Undergraduate Medical Program. International Medical Education 2024;3(1):32 View
  4. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  5. Robleto E, Habashi A, Kaplan M, Riley R, Zhang C, Bianchi L, Shehadeh L. Medical students’ perceptions of an artificial intelligence (AI) assisted diagnosing program. Medical Teacher 2024;46(9):1180 View
  6. Gordon M, Daniel M, Ajiboye A, Uraiby H, Xu N, Bartlett R, Hanson J, Haas M, Spadafore M, Grafton-Clarke C, Gasiea R, Michie C, Corral J, Kwan B, Dolmans D, Thammasitboon S. A scoping review of artificial intelligence in medical education: BEME Guide No. 84. Medical Teacher 2024;46(4):446 View
  7. Moulaei K, Yadegari A, Baharestani M, Farzanbakhsh S, Sabet B, Reza Afrash M. Generative artificial intelligence in healthcare: A scoping review on benefits, challenges and applications. International Journal of Medical Informatics 2024;188:105474 View
  8. Hickman L, Dunlop P, Wolf J. The performance of large language models on quantitative and verbal ability tests: Initial evidence and implications for unproctored high‐stakes testing. International Journal of Selection and Assessment 2024;32(4):499 View
  9. Harwood H, Roulin N, Iqbal M. “Anything you can do, I can do”: Examining the use of ChatGPT in situational judgement tests for professional program admission. Journal of Vocational Behavior 2024;154:104013 View
  10. Canagasuriam D, Lukacik E. ChatGPT, can you take my job interview? Examining artificial intelligence cheating in the asynchronous video interview. International Journal of Selection and Assessment 2025;33(1) View
  11. Rashid A, Skelly R, Valdes C, Patel P, Solberg L, Giordano C, Modave F. Evaluating ChatGPT’s moral competence in health care-related ethical problems. JAMIA Open 2024;7(3) View
  12. Liu M, Okuhara T, Chang X, Shirabe R, Nishiie Y, Okada H, Kiuchi T. Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e60807 View
  13. Gan W, Ouyang J, Li H, Xue Z, Zhang Y, Dong Q, Huang J, Zheng X, Zhang Y. Integrating ChatGPT in Orthopedic Education for Medical Undergraduates: Randomized Controlled Trial. Journal of Medical Internet Research 2024;26:e57037 View
  14. Waldock W, Zhang J, Guni A, Nabeel A, Darzi A, Ashrafian H. The Accuracy and Capability of Artificial Intelligence Solutions in Health Care Examinations and Certificates: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2024;26:e56532 View
  15. Aster A, Laupichler M, Rockwell-Kollmann T, Masala G, Bala E, Raupach T. ChatGPT and Other Large Language Models in Medical Education — Scoping Literature Review. Medical Science Educator 2024;35(1):555 View
  16. Kepes S, Keener S, Lievens F, McDaniel M. An Integrative, Systematic Review of the Situational Judgment Test Literature. Journal of Management 2024 View
  17. Lievens F, Dunlop P. Effects of Applicants' Use of Generative AI in Personnel Selection: Towards a More Nuanced View?. International Journal of Selection and Assessment 2025;33(1) View
  18. Iqbal M, Ivan R, Robb C, Derby J. Evaluating factors that impact scoring an open response situational judgment test: a mixed methods approach. Frontiers in Medicine 2025;11 View
  19. Alibrahim A. Is ChatGPT reliable in education?. South African Journal of Education 2024;44(4):1 View
  20. Sikström S, Valavičiūtė I, Kajonius P. Personality in just a few words: Assessment using natural language processing. Personality and Individual Differences 2025;238:113078 View
  21. Li R, Wu T. Evolution of Artificial Intelligence in Medical Education From 2000 to 2024: Bibliometric Analysis. Interactive Journal of Medical Research 2025;14:e63775 View
  22. Luo D, Liu M, Yu R, Liu Y, Jiang W, Fan Q, Kuang N, Gao Q, Yin T, Zheng Z. Evaluating the performance of GPT-3.5, GPT-4, and GPT-4o in the Chinese National Medical Licensing Examination. Scientific Reports 2025;15(1) View