%0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e62838 %T Making Medical Education Courses Visible: Theory-Based Development of a National Database %A Gashi,Andi %A Brodmann Maeder,Monika %A Hennel,Eva K. %K curriculum mapping %K faculty development %K competencies %K database %K medical education %D 2025 %7 16.4.2025 %9 %J JMIR Med Educ %G English %X Background: Medical education has undergone professionalization during the last decades, and internationally, educators are trained in specific medical education courses also known as “train the trainer” courses. As these courses have developed organically based on local needs, the lack of a general structure and terminology can confuse and hinder educators’ information and development. The first aim of this study was to conduct a national search, analyze the findings, and provide a presentation of medical education courses based on international theoretical frameworks to support Swiss course providers and educators searching for courses. The second aim was to provide a blueprint for such a procedure to be used by the international audience. Objective: In this study, we devised a scholarly approach to sorting and presenting medical education courses to make their content accessible to medical educators. This approach is presented in detailed steps and our openly available exemplary database to make it serve as a blueprint for other settings. Methods: Following our constructivist paradigm, we examined content from medical education courses using a theory-informed inductive data approach. Switzerland served as an example, covering 4 languages and different approaches to medical education. Data were gathered through an online search and a nationwide survey with course providers. The acquired data and a concurrently developed keyword system to standardize course terminology are presented using Obsidian, a software that shows data networks. Results: Our iterative search included several strategies (web search, survey, provider enquiry, and snowballing) and yielded 69 courses in 4 languages, with varying terminology, target audiences, and providers. The database of courses is interactive and openly accessible. An open-access template database structure is also available. Conclusions: This study proposes a novel method for sorting and visualizing medical education courses and the competencies they cover to provide an easy-to-use database, helping medical educators’ practical and scholarly development. Notably, our analysis identified a specific emphasis on undergraduate teaching settings, potentially indicating a gap in postgraduate educational offerings. This aspect could be pivotal for future curriculum development and resource allocation. Our method might guide other countries and health care professions, offering a straightforward means of cataloging and making information about medical education courses widely available and promotable. %R 10.2196/62838 %U https://mededu.jmir.org/2025/1/e62838 %U https://doi.org/10.2196/62838 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e67244 %T Large Language Models in Biochemistry Education: Comparative Evaluation of Performance %A Bolgova,Olena %A Shypilova,Inna %A Mavrych,Volodymyr %K ChatGPT %K Claude %K Gemini %K Copilot %K biochemistry %K LLM %K medical education %K artificial intelligence %K NLP %K natural language processing %K machine learning %K large language model %K AI %K ML %K comprehensive analysis %K medical students %K GPT-4 %K questionnaire %K medical course %K bioenergetics %D 2025 %7 10.4.2025 %9 %J JMIR Med Educ %G English %X Background: Recent advancements in artificial intelligence (AI), particularly in large language models (LLMs), have started a new era of innovation across various fields, with medicine at the forefront of this technological revolution. Many studies indicated that at the current level of development, LLMs can pass different board exams. However, the ability to answer specific subject-related questions requires validation. Objective: The objective of this study was to conduct a comprehensive analysis comparing the performance of advanced LLM chatbots—Claude (Anthropic), GPT-4 (OpenAI), Gemini (Google), and Copilot (Microsoft)—against the academic results of medical students in the medical biochemistry course. Methods: We used 200 USMLE (United States Medical Licensing Examination)–style multiple-choice questions (MCQs) selected from the course exam database. They encompassed various complexity levels and were distributed across 23 distinctive topics. The questions with tables and images were not included in the study. The results of 5 successive attempts by Claude 3.5 Sonnet, GPT-4‐1106, Gemini 1.5 Flash, and Copilot to answer this questionnaire set were evaluated based on accuracy in August 2024. Statistica 13.5.0.17 (TIBCO Software Inc) was used to analyze the data’s basic statistics. Considering the binary nature of the data, the chi-square test was used to compare results among the different chatbots, with a statistical significance level of P<.05. Results: On average, the selected chatbots correctly answered 81.1% (SD 12.8%) of the questions, surpassing the students’ performance by 8.3% (P=.02). In this study, Claude showed the best performance in biochemistry MCQs, correctly answering 92.5% (185/200) of questions, followed by GPT-4 (170/200, 85%), Gemini (157/200, 78.5%), and Copilot (128/200, 64%). The chatbots demonstrated the best results in the following 4 topics: eicosanoids (mean 100%, SD 0%), bioenergetics and electron transport chain (mean 96.4%, SD 7.2%), hexose monophosphate pathway (mean 91.7%, SD 16.7%), and ketone bodies (mean 93.8%, SD 12.5%). The Pearson chi-square test indicated a statistically significant association between the answers of all 4 chatbots (P<.001 to P<.04). Conclusions: Our study suggests that different AI models may have unique strengths in specific medical fields, which could be leveraged for targeted support in biochemistry courses. This performance highlights the potential of AI in medical education and assessment. %R 10.2196/67244 %U https://mededu.jmir.org/2025/1/e67244 %U https://doi.org/10.2196/67244 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 27 %N %P e67883 %T Evaluating the Effectiveness of Large Language Models in Providing Patient Education for Chinese Patients With Ocular Myasthenia Gravis: Mixed Methods Study %A Wei,Bin %A Yao,Lili %A Hu,Xin %A Hu,Yuxiang %A Rao,Jie %A Ji,Yu %A Dong,Zhuoer %A Duan,Yichong %A Wu,Xiaorong %+ Jiangxi Medical College, The First Affiliated Hospital, Nanchang University, No.17 Yongwai Zheng Street, Donghu District, Jiangxi Province, Nanchang, 330000, China, 86 136117093259, wxr98021@126.com %K LLM %K large language models %K ocular myasthenia gravis %K patient education %K China %K effectiveness %K deep learning %K artificial intelligence %K health care %K accuracy %K applicability %K neuromuscular disorder %K extraocular muscles %K ptosis %K diplopia %K ophthalmology %K ChatGPT %K clinical practice %K digital health %D 2025 %7 10.4.2025 %9 Original Paper %J J Med Internet Res %G English %X Background: Ocular myasthenia gravis (OMG) is a neuromuscular disorder primarily affecting the extraocular muscles, leading to ptosis and diplopia. Effective patient education is crucial for disease management; however, in China, limited health care resources often restrict patients’ access to personalized medical guidance. Large language models (LLMs) have emerged as potential tools to bridge this gap by providing instant, AI-driven health information. However, their accuracy and readability in educating patients with OMG remain uncertain. Objective: The purpose of this study was to systematically evaluate the effectiveness of multiple LLMs in the education of Chinese patients with OMG. Specifically, the validity of these models in answering patients with OMG-related questions was assessed through accuracy, completeness, readability, usefulness, and safety, and patients’ ratings of their usability and readability were analyzed. Methods: The study was conducted in two phases: 130 choice ophthalmology examination questions were input into 5 different LLMs. Their performance was compared with that of undergraduates, master’s students, and ophthalmology residents. In addition, 23 common patients with OMG-related patient questions were posed to 4 LLMs, and their responses were evaluated by ophthalmologists across 5 domains. In the second phase, 20 patients with OMG interacted with the 2 LLMs from the first phase, each asking 3 questions. Patients assessed the responses for satisfaction and readability, while ophthalmologists evaluated the responses again using the 5 domains. Results: ChatGPT o1-preview achieved the highest accuracy rate of 73% on 130 ophthalmology examination questions, outperforming other LLMs and professional groups like undergraduates and master’s students. For 23 common patients with OMG-related questions, ChatGPT o1-preview scored highest in correctness (4.44), completeness (4.44), helpfulness (4.47), and safety (4.6). GEMINI (Google DeepMind) provided the easiest-to-understand responses in readability assessments, while GPT-4o had the most complex responses, suitable for readers with higher education levels. In the second phase with 20 patients with OMG, ChatGPT o1-preview received higher satisfaction scores than Ernie 3.5 (Baidu; 4.40 vs 3.89, P=.002), although Ernie 3.5’s responses were slightly more readable (4.31 vs 4.03, P=.01). Conclusions: LLMs such as ChatGPT o1-preview may have the potential to enhance patient education. Addressing challenges such as misinformation risk, readability issues, and ethical considerations is crucial for their effective and safe integration into clinical practice. %M 40209226 %R 10.2196/67883 %U https://www.jmir.org/2025/1/e67883 %U https://doi.org/10.2196/67883 %U http://www.ncbi.nlm.nih.gov/pubmed/40209226 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 14 %N %P e60790 %T Web-Based Human Papillomavirus Education and Professional Skills Intervention for Health Care Providers: Protocol for a Randomized Controlled Trial %A Martinez,Jacob %A Cordero,Jacquelin I %A Whitney,Meagan %A LaRoche,Katie L %A Frietze,Gabriel %A Moya,Eva M %A Gosselink,Kristin %+ Border Biomedical Research Center, College of Science, The University of Texas at El Paso, 500 W University Ave, El Paso, TX, 79968, United States, 1 9157476313, jcordero5@utep.edu %K human papillomavirus %K randomized controlled trial %K HPV knowledge %K HPV vaccine %K health care provider %K provider recommendations %K communication strategies %K Hispanic %D 2025 %7 3.4.2025 %9 Protocol %J JMIR Res Protoc %G English %X Background:  The human papillomavirus (HPV) vaccine is an effective way to prevent HPV and its associated cancers. Provider recommendation has been shown to be one of the most successful strategies for increasing the uptake of the HPV vaccine; however, more training and resources are needed to help boost health care providers’ confidence and communication skills in recommending the HPV vaccine to their patients, particularly in underserved Hispanic communities where vaccination rates among all ages are lower. Objective:  This study aims to compare HPV educational and professional skills intervention effectiveness on improving provider recommendations and patient communication strategies with health care providers serving the El Paso United States–Mexico border region. Methods:  We will conduct a randomized, blinded, multiple posttest-only controlled behavioral trial using a parallel group design that will examine the effectiveness of a fully automated, web-based, culturally tailored HPV education and professional skills intervention containing unique reading material and video role-play, as compared to a standard Centers for Disease Control and Prevention fact sheet and video about general communication skills. Participants were recruited using a purposive sampling technique, both internet-based and in-person outreach events. Study data are being collected and managed using REDCap (Research Electronic Data Capture; Vanderbilt University) hosted at the University of Texas at El Paso. Chi-square analyses, ANOVA, and other statistical tests will be used with 2-tail α to reject null hypotheses at .05 to analyze the self-assessed outcome data. The Mauchly test of sphericity for each ANOVA and the Huynh-Feldt epsilon test or Greenhouse-Geisser correction to the degrees of freedom of the F-ratio will be reported for each significant effect. We may use multiple imputation procedures to handle the missing data (if applicable). This study is being conducted in the west Texas or southeast New Mexico region of the United States. Chi-square analyses will be used to assess associations between variables reported on the baseline provider knowledge, attitudes, and practice scales. We seek to examine self-assessed changes in provider attitudes and behaviors regarding HPV vaccine recommendation 1 month after receiving our unique multimedia and culturally tailored intervention. Results:  Research and data collection for this clinical trial began in December 2023. Participant recruitment was closed by May 2024 (N=128), with final data collection expected to be completed by December 2024. Conclusions:  This study team decided to report on the intervention protocol to help ensure transparency in the research process and facilitate the improvement of the research design. Tailored web-based educational programs for health care professionals, designed to address regional and patient population characteristics, may be a promising approach to enhancing the real-world implementation of clinical practice guidelines. Trial Registration: ClinicalTrials.gov NCT05120869; http://clinicaltrials.gov/ct2/show/NCT05120869 International Registered Report Identifier (IRRID): PRR1-10.2196/60790 %M 40179382 %R 10.2196/60790 %U https://www.researchprotocols.org/2025/1/e60790 %U https://doi.org/10.2196/60790 %U http://www.ncbi.nlm.nih.gov/pubmed/40179382 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e55313 %T Creation of the ECHO Idaho Podcast: Tutorial and Pilot Assessment %A Wiet,Ryan %A Casanova,Madeline P %A Moore,Jonathan D %A Deming,Sarah M %A Baker Jr,Russell T %K Project ECHO %K ECHO Idaho %K medical education %K medical training %K medication teaching %K medical knowledge %K rural health care %K rural medicine %K underserved population %K underserved people %K substance use %K substance use disorder %K SUD %K drug abuse %K drug use %K alcoholism %K addiction %K pain %K behavioral health %K podcast %K webinar %D 2025 %7 21.3.2025 %9 %J JMIR Med Educ %G English %X Background: Project ECHO (Extension for Community Health Outcomes) is an innovative program that uses videoconferencing technology to connect health care providers with experts. The model has been successful in reaching health care providers in rural and underserved areas and positively impacting clinical practice. ECHO Idaho, a replication partner, has developed programming that has increased knowledge and confidence of health care professionals throughout the state of Idaho, United States. Although the ECHO model has a demonstrated ability to recruit, educate, and train health care providers, barriers to attending Project ECHO continuing education (CE) programs remain. The asynchronous nature of podcasts could be used as an innovative medium to help address barriers to CE access that health care professionals face. The ECHO Idaho “Something for the Pain” podcast was developed to increase CE accessibility to rural and frontier providers, while upscaling their knowledge of and competence to treat and assess substance use disorders, pain, and behavioral health conditions. Objective: This paper describes the creation and preliminary assessment of the ECHO Idaho “Something for the Pain” podcast. Methods: Podcast episodes consisted of interviews with individuals as well as didactic lectures. Audio from these recordings were edited for content and length and then professionally reviewed by subject matter experts (eg, featured episode speakers). Target audiences consisted of health care providers and community members interested in behavioral health and substance use disorders. Metrics on podcast listeners were assessed using SoundCloud’s RSS feed, continuing education survey completion, and iECHO. Results: The ECHO Idaho “Something for the Pain” podcast’s inaugural season comprised 14 episodes with 626 minutes of CE material. The podcast series received a total of 2441 listens from individuals in 14 different cities across Idaho, and 63 health care providers listened and claimed CE credits. The largest professional group was social workers (n=22; 35%). Conclusions: We provide preliminary evidence that podcasts can be used to provide health care providers with opportunities to access CE material. Health care providers listened to and claimed CE credits from the ECHO Idaho “Something for the Pain” podcast. Project ECHO programs should consider creating podcasts as an additional platform for disseminating ECHO material. %R 10.2196/55313 %U https://mededu.jmir.org/2025/1/e55313 %U https://doi.org/10.2196/55313 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e72190 %T Examining Multimodal AI Resources in Medical Education: The Role of Immersion, Motivation, and Fidelity in AI Narrative Learning %A Jacobs,Chris %K artificial intelligence %K cinematic clinical narrative %K cinemeducation %K medical education %K narrative learning %K AI %K medical students %K preclinical education %K long-term retention %K pharmacology %K AI tools %K GPT-4 %K image %K applicability %K CCN %D 2025 %7 18.3.2025 %9 %J JMIR Med Educ %G English %X %R 10.2196/72190 %U https://mededu.jmir.org/2025/1/e72190 %U https://doi.org/10.2196/72190 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e72336 %T Author’s Reply: Examining Multimodal AI Resources in Medical Education: The Role of Immersion, Motivation, and Fidelity in AI Narrative Learning %A Bland,Tyler %K artificial intelligence %K cinematic clinical narrative %K cinemeducation %K medical education %K narrative learning %K pharmacology %K AI %K medical students %K preclinical education %K long-term retention %K AI tools %K GPT-4 %K image %K applicability %K CCN %D 2025 %7 18.3.2025 %9 %J JMIR Med Educ %G English %X %R 10.2196/72336 %U https://mededu.jmir.org/2025/1/e72336 %U https://doi.org/10.2196/72336 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 14 %N %P e67673 %T Demonstrating Tactical Combat Casualty Care in Simulated Environments to Enable Passive, Autonomous Documentation: Protocol for a Prospective Simulation-Based Study %A Little,Jeanette R %A Rivera-Nichols,Triana %A Pavliscsak,Holly H %A Badawi,Omar %A Gaudaen,James C %A Yeoman,Chevas R %A Hall,Todd S %A Quist,Ethan T %A Stoor-Burning,Ericka L %+ , The Telemedicine and Advanced Technology Research Center, 1054 Patchel Street, Fort Detrick, MD, 30905-5650, United States, 1 (706) 787 2394, jeanette.r.little.civ@health.mil %K tactical combat casualty care %K TCCC, automation %K medical documentation %K DD form 1380 %K combat casualty care %K artificial intelligence %K AI %K machine learning %K ML %K point of injury %K POI %K simulation %K military health %K passive data collection %K sensors %K algorithms %K medical record %D 2025 %7 17.3.2025 %9 Protocol %J JMIR Res Protoc %G English %X Background: The Telemedicine & Advanced Technology Research Center (TATRC) commenced a new research portfolio specifically addressing Autonomous Casualty Care (AC2) in 2023. The first project within this portfolio addresses the current and historical challenges of capturing tactical combat casualty care (TCCC) data in operational settings. Objective: The initial autonomous casualty care effort, the Passive Data Collection using Autonomous Documentation research project, conducts systematic, simulated patient and casualty care scenarios, leveraging suites of passive sensor inputs to populate a data repository that will automate future combat care. Methods: To obtain the required datasets, TATRC will engage care provider participants who provided consent in one of 6 randomized simulated TCCC scenarios leveraging an institutional review board–approved office protocol (#M-11057). These simulations will leverage mannikins (low and high fidelity) and live simulated patients (eg, human actors who provided consent). All consenting participants (eg, both the care providers and live simulated patients) will be equipped with suites of sensors that will passively collect data on care delivery actions and patient physiology. Simulated data is being collected at Fort Detrick, Maryland; Fort Sam Houston, Texas; Fort Indiantown Gap, Pennsylvania; Fort Liberty, North Carolina; and a commercial site in Greenville, North Carolina. Results: Across all research locations, TATRC will collect and annotate approximately 2500 simulation procedures tasks by March 2025. These study data will generate the first machine learning and artificial intelligence algorithms to populate Department of Defense (DD) Form 1380 fields accurately and reliably. Additional data collected past March 2025 will be used to continue to refine and mature the algorithm. Conclusions: The military health care system (MHS) lacks real-world datasets for TCCC care at the point of injury. Developing a data repository of simulated TCCC data is required as an essential step toward automating TCCC care. If TATRC’s research efforts result in the ability to automate care delivery documentation, this will alleviate the cognitive burden of TCCC care providers in austere, chaotic environments. By generating a TCCC data repository through this Autonomous Documentation research project, TATRC will have opportunities to leverage this research data to create machine learning and artificial intelligence models to advance passive, automated medical documentation across the health care continuum. International Registered Report Identifier (IRRID): DERR1-10.2196/67673 %M 40096684 %R 10.2196/67673 %U https://www.researchprotocols.org/2025/1/e67673 %U https://doi.org/10.2196/67673 %U http://www.ncbi.nlm.nih.gov/pubmed/40096684 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e64768 %T Organizational Leaders’ Views on Digital Health Competencies in Medical Education: Qualitative Semistructured Interview Study %A Zainal,Humairah %A Xiao Hui,Xin %A Thumboo,Julian %A Kok Yong,Fong %+ Department of Rheumatology and Immunology, Singapore General Hospital, 10 Hospital Boulevard, Singapore, 168582, Singapore, 65 6908 8949, fong.kok.yong@singhealth.com.sg %K technology %K medical education %K curriculum %K clinical competence %K digital competence %K Singapore %K digital health %K qualitative study %K medical school %K risk %K comprehensive framework %K doctor %K thematic analysis %K information technology %K evidence-based %K undergraduate %K healthcare systems %K mobile phone %D 2025 %7 7.3.2025 %9 Original Paper %J JMIR Med Educ %G English %X Background: Digital technologies (DTs) have profoundly impacted health care delivery globally and are increasingly used in clinical practice. Despite this, there is a scarcity of guidelines for implementing training in digital health competencies (DHC) in medical schools, especially for clinical practice. A lack of sustained integration of DHC risks creating knowledge gaps due to a limited understanding of how DT should be used in health care. Furthermore, few studies have explored reasons for this lag, both within and beyond the medical school curriculum. Current frameworks to address these barriers are often specific to individual countries or schools and focus primarily on curriculum design and delivery. A comprehensive framework is therefore required to ensure consistent implementation of DHC across various contexts and times. Objective: This study aims to use Singapore as a case study and examine the perspectives of doctors in organizational leadership positions to identify and analyze the barriers to DHC implementation in the undergraduate curriculum of Singapore’s medical schools. It also seeks to apply the Normalization Process Theory (NPT) to address these barriers and bridge the gap between health care systems and digital health education (DHE) training. Methods: Individual semistructured interviews were conducted with doctors in executive and organizational leadership roles. Participants were recruited through purposive sampling, and the data were interpreted using qualitative thematic analysis. Results: A total of 33 doctors participated, 26 of whom are currently in organizational leadership roles and 7 of whom have previously held such positions. A total of 6 barriers were identified: bureaucratic inertia, lack of opportunities to pursue nontraditional career pathways, limited protective mechanisms for experiential learning and experimentation, lack of clear policy guidelines for clinical practice, insufficient integration between medical school education and clinical experience, and poor IT integration within the health care industry. Conclusions: These barriers are also present in other high-income countries experiencing health care digitalization, highlighting the need for a theoretical framework that broadens the generalizability of existing recommendations. Applying the NPT underscores the importance of addressing these barriers to effectively integrate DHC into the curriculum. The active involvement of multiple stakeholders and the incorporation of continuous feedback mechanisms are essential. Our proposed framework provides concrete, evidence-based, and step-by-step recommendations for implementation practice, supporting the introduction of DHC in undergraduate medical education. %M 40053774 %R 10.2196/64768 %U https://mededu.jmir.org/2025/1/e64768 %U https://doi.org/10.2196/64768 %U http://www.ncbi.nlm.nih.gov/pubmed/40053774 %0 Journal Article %@ 2818-3045 %I JMIR Publications %V 2 %N %P e57361 %T A Local Training Program to Increase Awareness of Emerging Extended Reality Technologies Among Health Care Professionals: Development Study %A Galvin,Charlotte %A Watt,Jonathan %A Ghatnekar,Payal %A Peres,Nicholas %A Rees-Lee,Jacqueline %K health care XR %K extended reality in health care %K XR %K virtual reality in health care %K VR %K digital awareness training %K digital deep dive %K digital literacy %K emerging health care technology %K digital future %K extended reality %K virtual reality %D 2025 %7 27.2.2025 %9 %J JMIR XR Spatial Comput %G English %X Background: Demands on health care services can greatly outweigh capacity. Multifactorial causative factors present great challenges, forcing the National Health Service (NHS) to increase efficiency and adaptivity. Concurrently, digital advancements are excelling and long-term plans for NHS sustainability are focusing on the use of technological interventions to benefit patients. As a result, integration of extended reality (XR) technology has become an important focus of health care research. However, models of how the digital literacy of health care workforces can be developed and how frontline staff can be actively involved in the design and development of creative digital interventions are lacking. Such programs are essential to allow the development and upscaling of digital innovation within the NHS for the benefit of the patients. Such a program has been developed in the Digital Futures research lab at Torbay and South Devon NHS Foundation Trust, representing one of the first immersive digital technologies research spaces embedded within the NHS. A “Digital Deep Dive” training program has been developed, allowing local health care workers to recognize the possibilities of digital health care technologies and supporting them in the evolution of ideas for potential bespoke digital solutions appropriate to their own patient groups and care pathways. Objective: This paper aims to explain the development of this unique XR Deep Dive program and present the evaluation that informed future directions for its ongoing development. Methods: The Deep Dive sessions were designed according to relevant pedagogic principles, including experiential, active, and contextual learning theories. Voluntary pilot sessions were held for local clinical teams comprised of junior doctors, consultants, nurses, and allied health professionals. Self-selection sampling was used. Participants completed an anonymous postsession feedback form, which was used to conduct a service evaluation. Data were analyzed using descriptive statistics (quantitative) and thematic analysis (qualitative). Results: In total, 21 completed questionnaires were analyzed. Overall, the sessions were positively received: all participants reported increased awareness of the potential for digital health care innovation postsession and most found it useful and relevant to their clinical careers. Participants valued the sessions being grounded in a context relevant to local practice with opportunities to interact with the technology through the lens of use cases. Conclusions: We have developed a unique training initiative providing contextually relevant XR technology awareness training for health care professionals locally. Despite the growing pace of digital health care innovation, we recognized a knowledge gap in our local workforce regarding the potential of XR technologies within health care. We responded by developing a training program grounded in the concept of digital co-creation—working with staff and service users to develop bespoke solutions integrated within patient pathways. The results from this paper will help to inform future directions for developing digital awareness training in our trust and have implications for wider NHS digital literacy training. %R 10.2196/57361 %U https://xr.jmir.org/2025/1/e57361 %U https://doi.org/10.2196/57361 %0 Journal Article %@ 2292-9495 %I JMIR Publications %V 12 %N %P e63364 %T A Health Professional Mentorship Platform to Improve Equitable Access to Abortion: Development, Usability, and Content Evaluation %A Abdulai,Abdul-Fatawu %A Duong,Cam %A Stroulia,Eleni %A Czerniak,Efrat %A Chiu,Rachel %A Mehta,Aashay %A Koike,Ken %A Norman,Wendy V %K medication abortion %K mifepristone %K web-based platform %K user-centered design %K underserved populations %K abortion %K equitable %K accessibility %K open-access website %K gender-affirming %K user-centered %K Canada %K unwanted pregnancy %K framework %D 2025 %7 19.2.2025 %9 %J JMIR Hum Factors %G English %X Background: Access to safe abortion care is a reproductive right for all individuals across Canada. Underserved populations are overrepresented among those with unintended pregnancies and particularly those seeking abortion. Yet, few resources exist to help health care and allied helping professionals provide culturally competent and gender-affirming abortion care to such a population group. Objective: This project aimed to redesign and adapt an existing subscription-based medication abortion mentorship platform into a culturally appropriate and gender-affirming open-access website of curated health professional resources to promote equitable, accessible, high-quality abortion care, particularly for underserved populations. Methods: We drew on a user-centered design framework to redesign the web platform in 5 iterative phases. Health care and allied helping professionals were engaged in each stage of the development process including the initial design of the platform, curation of the resources, review of the content, and evaluation of the wireframes and the end product. Results: This project resulted in an open-access bilingual (English and French) web-based platform containing comprehensive information and resources on abortion care for health care providers (physicians, nurse practitioners, and pharmacists) and allied helping professionals (midwives, medical officers, community workers, and social workers). The website incorporated information on clinical, logistical, and administrative guidance, including culturally competent and gender-affirming toolkits that could equip health care professionals with the requisite knowledge to provide abortion care for underserved populations. Conclusions: This platform contains resources that can increase the competencies of health care professionals to initiate and sustain culturally and contextually appropriate abortion care for underserved groups while clarifying myths and misconceptions that often militate against initiating abortion. Our resource also has the potential to support equitable access to high-quality abortion care, particularly for those among underserved populations who may have the greatest unmet need for abortion services yet face the greatest barriers to accessing care. %R 10.2196/63364 %U https://humanfactors.jmir.org/2025/1/e63364 %U https://doi.org/10.2196/63364 %0 Journal Article %@ 2818-3045 %I JMIR Publications %V 2 %N %P e60651 %T Understanding the Views of Health Care Professionals on the Usability and Utility of Virtual Reality Multidisciplinary Team Meetings: Usability and Utility Study %A Almashmoum,Maryam %A Payton,Antony %A Johnstone,Emily %A Cunningham,James %A Ainsworth,John %K knowledge sharing %K multidisciplinary team meetings %K artificial intelligence %K heuristic evaluation %K usability %K virtual reality %K VR %K simulation %K virtual environments %K digital environments %D 2025 %7 14.2.2025 %9 %J JMIR XR Spatial Comput %G English %X Background: Multidisciplinary team (MDT) meetings are one of the facilitators that enhance knowledge sharing among health care professionals. However, organizing a face-to-face MDT meeting to discuss patient treatment plans can be time-consuming. Virtual reality software is widely used in health care nowadays to save time and protect lives. Therefore, the use of virtual reality multidisciplinary team (VRMDT) meeting software may help enhance knowledge sharing between health care professionals and make meetings more efficient. Objective: The objectives of this study were to introduce VRMDT software for enhancing knowledge sharing and to evaluate the feasibility and usability of the VRMDT for use by professionals in health care institutions. Methods: We invited participants from The University of Manchester Faculty for Biology, Medicine, and Health who had a health care background. As this was the first stage of software development, individuals who did not usually attend MDT meetings were also invited via email to participate in this study. Participants evaluated VRMDT using a Meta Quest 3 headset, and software developed using the Unity platform. The software contained an onboarding tutorial that taught the participants how to select items, load and rotate 3D Digital Imaging and Communications in Medicine files, talk to a generative artificial intelligence–supported avatar, and make notes. After the evaluation (approximately 15 min), participants received an electronic survey using the Qualtrics survey tool (Qualtrics International Inc) to score the usability and feasibility of the software by responding to the 10-item system usability scale, and 12-point heuristic evaluation questions with Neilsen severity rating. Results: A total of 12 participants, including 4 health informatics, 3 with a nursing background, 2 medical doctors, 1 radiologist, and 2 biostatisticians, participated in the study. The most common age bracket of participants was 20‐30 years (6/12, 50%). Most of the respondents had no experience with virtual reality, either in educational or entertainment settings. The VRMDT received a mean usability score of 72.7 (range between 68 and 80.3), earning an overall “good” rating grade. The mean score of single items in the heuristic evaluation questionnaires was less than 1 out of 4 (the overall mean was 0.6), which indicates that only minor problems were encountered when using this software. Overall, the participant’s feedback was good with highlighted issues including a poor internet connection and the quality of the generative artificial intelligence response. Conclusions: VRMDT software (developed by SentiraXR) was developed with several functions aimed at helping health care professionals to discuss medical conditions efficiently. Participants found that the VRMDT is a powerful, and useful tool for enhancing knowledge sharing among professionals who are involved in MDT meetings due to its functionality and multiuser interactive environments. Additionally, there may be the possibility of using it to train junior professionals to interpret medical reports. %R 10.2196/60651 %U https://xr.jmir.org/2025/1/e60651 %U https://doi.org/10.2196/60651 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e58766 %T Generative Artificial Intelligence in Medical Education—Policies and Training at US Osteopathic Medical Schools: Descriptive Cross-Sectional Survey %A Ichikawa,Tsunagu %A Olsen,Elizabeth %A Vinod,Arathi %A Glenn,Noah %A Hanna,Karim %A Lund,Gregg C %A Pierce-Talsma,Stacey %K artificial intelligence %K medical education %K faculty development %K policy %K AI %K training %K United States %K school %K university %K college %K institution %K osteopathic %K osteopathy %K curriculum %K student %K faculty %K administrator %K survey %K cross-sectional %D 2025 %7 11.2.2025 %9 %J JMIR Med Educ %G English %X Background: Interest has recently increased in generative artificial intelligence (GenAI), a subset of artificial intelligence that can create new content. Although the publicly available GenAI tools are not specifically trained in the medical domain, they have demonstrated proficiency in a wide range of medical assessments. The future integration of GenAI in medicine remains unknown. However, the rapid availability of GenAI with a chat interface and the potential risks and benefits are the focus of great interest. As with any significant medical advancement or change, medical schools must adapt their curricula to equip students with the skills necessary to become successful physicians. Furthermore, medical schools must ensure that faculty members have the skills to harness these new opportunities to increase their effectiveness as educators. How medical schools currently fulfill their responsibilities is unclear. Colleges of Osteopathic Medicine (COMs) in the United States currently train a significant proportion of the total number of medical students. These COMs are in academic settings ranging from large public research universities to small private institutions. Therefore, studying COMs will offer a representative sample of the current GenAI integration in medical education. Objective: This study aims to describe the policies and training regarding the specific aspect of GenAI in US COMs, targeting students, faculty, and administrators. Methods: Web-based surveys were sent to deans and Student Government Association (SGA) presidents of the main campuses of fully accredited US COMs. The dean survey included questions regarding current and planned policies and training related to GenAI for students, faculty, and administrators. The SGA president survey included only those questions related to current student policies and training. Results: Responses were received from 81% (26/32) of COMs surveyed. This included 47% (15/32) of the deans and 50% (16/32) of the SGA presidents (with 5 COMs represented by both the deans and the SGA presidents). Most COMs did not have a policy on the student use of GenAI, as reported by the dean (14/15, 93%) and the SGA president (14/16, 88%). Of the COMs with no policy, 79% (11/14) had no formal plans for policy development. Only 1 COM had training for students, which focused entirely on the ethics of using GenAI. Most COMs had no formal plans to provide mandatory (11/14, 79%) or elective (11/15, 73%) training. No COM had GenAI policies for faculty or administrators. Eighty percent had no formal plans for policy development. Furthermore, 33.3% (5/15) of COMs had faculty or administrator GenAI training. Except for examination question development, there was no training to increase faculty or administrator capabilities and efficiency or to decrease their workload. Conclusions: The survey revealed that most COMs lack GenAI policies and training for students, faculty, and administrators. The few institutions with policies or training were extremely limited in scope. Most institutions without current training or policies had no formal plans for development. The lack of current policies and training initiatives suggests inadequate preparedness for integrating GenAI into the medical school environment, therefore, relegating the responsibility for ethical guidance and training to the individual COM member. %R 10.2196/58766 %U https://mededu.jmir.org/2025/1/e58766 %U https://doi.org/10.2196/58766 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e55206 %T Integration of an Audiovisual Learning Resource in a Podiatric Medical Infectious Disease Course: Multiple Cohort Pilot Study %A Hoyt,Garrik %A Bakshi,Chandra Shekhar %A Basu,Paramita %K learning retention %K preclinical education %K podiatric medical education %K audiovisual learning resources %K multimedia-based learning resource %K animation-supported learning tools %K mnemonics %K spaced repetition %D 2025 %7 11.2.2025 %9 %J JMIR Med Educ %G English %X Background: Improved long-term learning retention leads to higher exam scores and overall course grades, which is crucial for success in preclinical coursework in any podiatric medicine curriculum. Audiovisual mnemonics, in conjunction with text-based materials and an interactive user interface, have been shown to increase memory retention and higher order thinking. Objective: This pilot study aims to evaluate the effectiveness of integrating web-based multimedia learning resources for improving student engagement and increasing learning retention. Methods: A quasi-experimental study was conducted with 2 cohorts totaling 158 second-year podiatric medical students. The treatment group had access to Picmonic’s audiovisual resources, while the control group followed traditional instruction methods. Exam scores, final course grades, and user interactions with Picmonic were analyzed. Logistic regression and correlation analyses were conducted to examine the relationships between Picmonic access, performance outcomes, and student engagement. Results: The treatment group (n=91) had significantly higher average exam scores (P<.001) and final course grades (P<.001) than the control group (n=67). Effect size for the average final grades (d=0.96) indicated the practical significance of these differences. Logistic regression analysis revealed a positive association between Picmonic access with an odds ratio of 2.72 with a 95% confidence interval, indicating that it is positively associated with the likelihood of achieving high final grades. Correlation analysis revealed a positive relationship (r=0.25, P=.02) between the number of in-video questions answered and students’ final grades. Survey responses reflected increased student engagement, comprehension, and higher user satisfaction (3.71 out of 5 average rating) with the multimedia-based resources compared to traditional instructional resources. Conclusions: This pilot study underscores the positive impact of animation-supported web-based instruction on preclinical medical education. The treatment group, equipped with Picmonic, exhibited improved learning outcomes, enhanced engagement, and high satisfaction. These results contribute to the discourse on innovative educational methods and highlight the potential of multimedia-based learning resources to enrich medical curricula. Despite certain limitations, this research suggests that animation-supported audiovisual instruction offers a valuable avenue for enhancing student learning experiences in medical education. %R 10.2196/55206 %U https://mededu.jmir.org/2025/1/e55206 %U https://doi.org/10.2196/55206 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e56369 %T Refining Established Practices for Research Question Definition to Foster Interdisciplinary Research Skills in a Digital Age: Consensus Study With Nominal Group Technique %A Sedlakova,Jana %A Stanikić,Mina %A Gille,Felix %A Bernard,Jürgen %A Horn,Andrea B %A Wolf,Markus %A Haag,Christina %A Floris,Joel %A Morgenshtern,Gabriela %A Schneider,Gerold %A Zumbrunn Wojczyńska,Aleksandra %A Mouton Dorey,Corine %A Ettlin,Dominik Alois %A Gero,Daniel %A Friemel,Thomas %A Lu,Ziyuan %A Papadopoulos,Kimon %A Schläpfer,Sonja %A Wang,Ning %A von Wyl,Viktor %+ Digital Society Initiative, University of Zurich, Raemistrasse 69, Zurich, 8001, Switzerland, 41 0786753991, sedlakova@ifi.uzh.ch %K research question %K digitalization %K digital data %K data science %K health research %K interdisciplinary %D 2025 %7 23.1.2025 %9 Original Paper %J JMIR Med Educ %G English %X Background: The increased use of digital data in health research demands interdisciplinary collaborations to address its methodological complexities and challenges. This often entails merging the linear deductive approach of health research with the explorative iterative approach of data science. However, there is a lack of structured teaching courses and guidance on how to effectively and constructively bridge different disciplines and research approaches. Objective: This study aimed to provide a set of tools and recommendations designed to facilitate interdisciplinary education and collaboration. Target groups are lecturers who can use these tools to design interdisciplinary courses, supervisors who guide PhD and master’s students in their interdisciplinary projects, and principal investigators who design and organize workshops to initiate and guide interdisciplinary projects. Methods: Our study was conducted in 3 steps: (1) developing a common terminology, (2) identifying established workflows for research question formulation, and (3) examining adaptations of existing study workflows combining methods from health research and data science. We also formulated recommendations for a pragmatic implementation of our findings. We conducted a literature search and organized 3 interdisciplinary expert workshops with researchers at the University of Zurich. For the workshops and the subsequent manuscript writing process, we adopted a consensus study methodology. Results: We developed a set of tools to facilitate interdisciplinary education and collaboration. These tools focused on 2 key dimensions— content and curriculum and methods and teaching style—and can be applied in various educational and research settings. We developed a glossary to establish a shared understanding of common terminologies and concepts. We delineated the established study workflow for research question formulation, emphasizing the “what” and the “how,” while summarizing the necessary tools to facilitate the process. We propose 3 clusters of contextual and methodological adaptations to this workflow to better integrate data science practices: (1) acknowledging real-life constraints and limitations in research scope; (2) allowing more iterative, data-driven approaches to research question formulation; and (3) strengthening research quality through reproducibility principles and adherence to the findable, accessible, interoperable, and reusable (FAIR) data principles. Conclusions: Research question formulation remains a relevant and useful research step in projects using digital data. We recommend initiating new interdisciplinary collaborations by establishing terminologies as well as using the concepts of research tasks to foster a shared understanding. Our tools and recommendations can support academic educators in training health professionals and researchers for interdisciplinary digital health projects. %M 39847774 %R 10.2196/56369 %U https://mededu.jmir.org/2025/1/e56369 %U https://doi.org/10.2196/56369 %U http://www.ncbi.nlm.nih.gov/pubmed/39847774 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e50060 %T A Brief Web-Based Person-Centered Care Group Training Program for the Management of Generalized Anxiety Disorder: Feasibility Randomized Controlled Trial in Spain %A Ramos-García,Vanesa %A Rivero-Santana,Amado %A Peñate-Castro,Wenceslao %A Álvarez-Pérez,Yolanda %A Duarte-Díaz,Andrea %A Torres-Castaño,Alezandra %A Trujillo-Martín,María del Mar %A González-González,Ana Isabel %A Serrano-Aguilar,Pedro %A Perestelo-Pérez,Lilisbeth %K person-centered care %K primary care %K shared decision-making %K anxiety disorder %K training program %K SDM %D 2025 %7 16.1.2025 %9 %J JMIR Med Educ %G English %X Background: Shared decision-making (SDM) is a crucial aspect of patient-centered care. While several SDM training programs for health care professionals have been developed, evaluation of their effectiveness is scarce, especially in mental health disorders such as generalized anxiety disorder. Objective: This study aims to assess the feasibility and impact of a brief training program on the attitudes toward SDM among primary care professionals who attend to patients with generalized anxiety disorder. Methods: A feasibility randomized controlled trial was conducted. Health care professionals recruited in primary care centers were randomized to an intervention group (training program) or a control group (waiting list). The intervention consisted of 2 web-based sessions applied by 2 psychologists (VR and YA), based on the integrated elements of the patient-centered care model and including group dynamics and video viewing. The outcome variable was the Leeds Attitudes Towards Concordance scale, second version (LATCon II), assessed at baseline and after the second session (3 months). After the randomized controlled trial phase, the control group also received the intervention and was assessed again. Results: Among 28 randomized participants, 5 withdrew before the baseline assessment. The intervention significantly increased their scores compared with the control group in the total scale (b=0.57; P=.018) and 2 subscales: communication or empathy (b=0.74; P=.036) and shared control (ie, patient participation in decisions: b=0.68; P=.040). The control group also showed significant pre-post changes after receiving the intervention. Conclusions: For a future effectiveness trial, it is necessary to improve the recruitment and retention strategies. The program produced a significant improvement in participants’ attitude toward the SDM model, but due to this study’s limitations, mainly the small sample size, more research is warranted. %R 10.2196/50060 %U https://mededu.jmir.org/2025/1/e50060 %U https://doi.org/10.2196/50060 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e54153 %T Digital Dentists: A Curriculum for the 21st Century %A Mun,Michelle %A Byrne,Samantha %A Shaw,Louise %A Lyons,Kayley %K digital health %K digital transformation %K informatics %K ehealth %K dentistry %K dental informatics %K curriculum %K competence %K capability %K dental education %D 2025 %7 8.1.2025 %9 %J JMIR Med Educ %G English %X Future health professionals, including dentists, must critically engage with digital health technologies to enhance patient care. While digital health is increasingly being integrated into the curricula of health professions, its interpretation varies widely depending on the discipline, health care setting, and local factors. This viewpoint proposes a structured set of domains to guide the designing of a digital health curriculum tailored to the unique needs of dentistry in Australia. The paper aims to share a premise for curriculum development that aligns with the current evidence and the national digital health strategy, serving as a foundation for further discussion and implementation in dental programs. %R 10.2196/54153 %U https://mededu.jmir.org/2025/1/e54153 %U https://doi.org/10.2196/54153 %0 Journal Article %@ 2818-3045 %I JMIR Publications %V 2 %N %P e60792 %T Augmented Reality in Enhancing Operating Room Crisis Checklist Adherence: Randomized Comparative Efficacy Study %A Ebnali Harari,Rayan %A Altaweel,Abdullah %A Anderson,Erik %A Pozner,Charles %A Grossmann,Rafael %A Goldsmith,Andrew %A Shokoohi,Hamid %K augmented reality %K operating room %K crisis checklist %K checklist %K guideline adherence %K quality improvement %K patient safety %K cardiac arrest %K hypotension %K hyperthermia %K critical care %K emergency department %D 2025 %7 6.1.2025 %9 %J JMIR XR Spatial Comput %G English %X Background: Effective crisis management in operating rooms (ORs) is crucial for patient safety. Despite their benefits, adherence to OR crisis checklists is often limited, highlighting the need for innovative solutions. Objective: The objective of this study was to evaluate the efficacy of augmented reality (AR)-enhanced checklists in improving protocol adherence, compared to traditional paper checklists and no checklist scenarios during simulated OR crises. Methods: This study was a randomized comparative efficacy study comparing the utility of AR checklists, paper checklists, and no checklist scenarios using 4 validated and simulated OR crises scenarios: asystolic cardiac arrest, air embolism, unexplained hypotension/hypoxia, and malignant hyperthermia. The study took place in a simulated OR setting and had applicability to the standard procedures in ORs, critical care units, and urgent care scenarios in the emergency department. To form the 24 OR teams, 50 professionals including 24 anesthesiologists, 24 nurses, 1 surgeon, and 1 scrub nurse from two academic hospitals were included. The primary outcome measured was the failure to adhere (FTA) rate for critical actions during simulated OR crises. Adherence was determined using retrospective video analysis involving 595 key processes evaluated across 24 surgical teams. Interrater reliability was assessed using a Cohen κ. Secondary outcomes included checklist usability and cognitive load, as measured by the low-frequency to high-frequency (LF/HF) ratio of the heart rate variability. Results: The AR checklist group showed a significantly lower FTA rate (mean 15.1%, SD 5.77%) compared to the paper checklist (mean 8.32%, SD 5.65%; t23=−2.08; P=.048) and the no checklist groups (mean 29.81%, SD 5.59%; t23=−6.47; P<.001). The AR checklist also resulted in a higher LF/HF ratio for anesthesiologists (F2,46=4.88; P=.02), showing a potential increase in the level of cognitive load. Survey data indicated positive receptions for both AR and paper checklists. Conclusions: These results suggest that AR checklists could offer a viable method for enhancing adherence to critical care protocols. Although, further research is needed to fully assess their impact on clinical outcomes and to address any associated increase in cognitive load. %R 10.2196/60792 %U https://xr.jmir.org/2025/1/e60792 %U https://doi.org/10.2196/60792 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e51101 %T Resilience Training Web App for National Health Service Keyworkers: Pilot Usability Study %A Burrell,Joanna %A Baker,Felicity %A Bennion,Matthew Russell %K resilience %K workplace stress %K National Health Service %K NHS keyworker %K digital learning %K digital health %K usability %K feasibility %K mental health %K pilot study %K learning %K training %K exercise %K primary care provider %K health care professional %K occupational health %K worker %K hospital %K emergency %K survey %K questionnaire %K mobile phone %D 2025 %7 6.1.2025 %9 %J JMIR Med Educ %G English %X Background: It is well established that frontline health care staff are particularly at risk of stress. Resilience is important to help staff to manage daily challenges and to protect against burnout. Objective: This study aimed to assess the usability and user perceptions of a resilience training web app developed to support health care keyworkers in understanding their own stress response and to help them put into place strategies to manage stress and to build resilience. Methods: Nurses (n=7) and other keyworkers (n=1), the target users for the resilience training web app, participated in the usability evaluation. Participants completed a pretraining questionnaire capturing basic demographic information and then used the training before completing a posttraining feedback questionnaire exploring the impact and usability of the web app. Results: From a sample of 8 keyworkers, 6 (75%) rated their current role as “sometimes” stressful. All 8 (100%) keyworkers found the training easy to understand, and 5 of 7 (71%) agreed that the training increased their understanding of both stress and resilience. Further, 6 of 8 (75%) agreed that the resilience model had helped them to understand what resilience is. Many of the keyworkers (6/8, 75%) agreed that the content was relevant to them. Furthermore, 6 of 8 (75%) agreed that they were likely to act to develop their resilience following completion of the training. Conclusions: This study tested the usability of a web app for resilience training specifically targeting National Health Service keyworkers. This work preceded a larger scale usability study, and it is hoped this study will help guide other studies to develop similar programs in clinical settings. %R 10.2196/51101 %U https://mededu.jmir.org/2025/1/e51101 %U https://doi.org/10.2196/51101 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 11 %N %P e63865 %T Enhancing Medical Student Engagement Through Cinematic Clinical Narratives: Multimodal Generative AI–Based Mixed Methods Study %A Bland,Tyler %K artificial intelligence %K cinematic clinical narratives %K cinemeducation %K medical education %K narrative learning %K AI %K medical student %K pharmacology %K preclinical education %K long-term retention %K AI tools %K GPT-4 %K image %K applicability %D 2025 %7 6.1.2025 %9 %J JMIR Med Educ %G English %X Background: Medical students often struggle to engage with and retain complex pharmacology topics during their preclinical education. Traditional teaching methods can lead to passive learning and poor long-term retention of critical concepts. Objective: This study aims to enhance the teaching of clinical pharmacology in medical school by using a multimodal generative artificial intelligence (genAI) approach to create compelling, cinematic clinical narratives (CCNs). Methods: We transformed a standard clinical case into an engaging, interactive multimedia experience called “Shattered Slippers.” This CCN used various genAI tools for content creation: GPT-4 for developing the storyline, Leonardo.ai and Stable Diffusion for generating images, Eleven Labs for creating audio narrations, and Suno for composing a theme song. The CCN integrated narrative styles and pop culture references to enhance student engagement. It was applied in teaching first-year medical students about immune system pharmacology. Student responses were assessed through the Situational Interest Survey for Multimedia and examination performance. The target audience comprised first-year medical students (n=40), with 18 responding to the Situational Interest Survey for Multimedia survey (n=18). Results: The study revealed a marked preference for the genAI-enhanced CCNs over traditional teaching methods. Key findings include the majority of surveyed students preferring the CCN over traditional clinical cases (14/18), as well as high average scores for triggered situational interest (mean 4.58, SD 0.53), maintained interest (mean 4.40, SD 0.53), maintained-feeling interest (mean 4.38, SD 0.51), and maintained-value interest (mean 4.42, SD 0.54). Students achieved an average score of 88% on examination questions related to the CCN material, indicating successful learning and retention. Qualitative feedback highlighted increased engagement, improved recall, and appreciation for the narrative style and pop culture references. Conclusions: This study demonstrates the potential of using a multimodal genAI-driven approach to create CCNs in medical education. The “Shattered Slippers” case effectively enhanced student engagement and promoted knowledge retention in complex pharmacological topics. This innovative method suggests a novel direction for curriculum development that could improve learning outcomes and student satisfaction in medical education. Future research should explore the long-term retention of knowledge and the applicability of learned material in clinical settings, as well as the potential for broader implementation of this approach across various medical education contexts. %R 10.2196/63865 %U https://mededu.jmir.org/2025/1/e63865 %U https://doi.org/10.2196/63865 %0 Journal Article %@ 2561-326X %I JMIR Publications %V 9 %N %P e58426 %T Artificial Intelligence–Powered Training Database for Clinical Thinking: App Development Study %A Wang,Heng %A Zheng,Danni %A Wang,Mengying %A Ji,Hong %A Han,Jiangli %A Wang,Yan %A Shen,Ning %A Qiao,Jie %K artificial intelligence %K clinical thinking ability %K virtual medical records %K distance education %K medical education %K online learning %D 2025 %7 3.1.2025 %9 %J JMIR Form Res %G English %X Background: With the development of artificial intelligence (AI), medicine has entered the era of intelligent medicine, and various aspects, such as medical education and talent cultivation, are also being redefined. The cultivation of clinical thinking abilities poses a formidable challenge even for seasoned clinical educators, as offline training modalities often fall short in bridging the divide between current practice and the desired ideal. Consequently, there arises an imperative need for the expeditious development of a web-based database, tailored to empower physicians in their quest to learn and hone their clinical reasoning skills. Objective: This study aimed to introduce an app named “XueYiKu,” which includes consultations, physical examinations, auxiliary examinations, and diagnosis, incorporating AI and actual complete hospital medical records to build an online-learning platform using human-computer interaction. Methods: The “XueYiKu” app was designed as a contactless, self-service, trial-and-error system application based on actual complete hospital medical records and natural language processing technology to comprehensively assess the “clinical competence” of residents at different stages. Case extraction was performed at a hospital’s case data center, and the best-matching cases were differentiated through natural language processing, word segmentation, synonym conversion, and sorting. More than 400 teaching cases covering 65 kinds of diseases were released for students to learn, and the subjects covered internal medicine, surgery, gynecology and obstetrics, and pediatrics. The difficulty of learning cases was divided into four levels in ascending order. Moreover, the learning and teaching effects were evaluated using 6 dimensions covering systematicness, agility, logic, knowledge expansion, multidimensional evaluation indicators, and preciseness. Results: From the app’s first launch on the Android platform in May 2019 to the last version updated in May 2023, the total number of teacher and student users was 6209 and 1180, respectively. The top 3 subjects most frequently learned were respirology (n=606, 24.1%), general surgery (n=506, 20.1%), and urinary surgery (n=390, 15.5%). For diseases, pneumonia was the most frequently learned, followed by cholecystolithiasis (n=216, 14.1%), benign prostate hyperplasia (n=196, 12.8%), and bladder tumor (n=193, 12.6%). Among 479 students, roughly a third (n=168, 35.1%) scored in the 60 to 80 range, and half of them scored over 80 points (n=238, 49.7%). The app enabled medical students’ learning to become more active and self-motivated, with a variety of formats, and provided real-time feedback through assessments on the platform. The learning effect was satisfactory overall and provided important precedence for establishing scientific models and methods for assessing clinical thinking skills in the future. Conclusions: The integration of AI and medical education will undoubtedly assist in the restructuring of education processes; promote the evolution of the education ecosystem; and provide new convenient ways for independent learning, interactive communication, and educational resource sharing. %R 10.2196/58426 %U https://formative.jmir.org/2025/1/e58426 %U https://doi.org/10.2196/58426 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 14 %N %P e58037 %T Evaluating the Effectiveness of a Multimodal Psychotherapy Training Program for Medical Students in China: Protocol for a Randomized Controlled Trial %A Pei,Tao %A Ding,Yinan %A Tang,Jinsong %A Liao,Yanhui %+ Department of Psychiatry, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 866 Yuhangtang Road, Hangzhou, 310000, China, 86 18814898844, liaoyanhui@zju.edu.cn %K multimodal teaching %K psychotherapy training %K Chinese medical students %K randomized controlled trial %D 2025 %7 3.1.2025 %9 Protocol %J JMIR Res Protoc %G English %X Background: Psychotherapy is central to the treatment of mental disorders, highlighting the importance of medical students and residents developing competencies in this area. Chinese medical residents have expressed a strong need for psychotherapy training, yet they are generally dissatisfied with the current offerings. This paper presents the protocol for an evidence-based, well-structured psychotherapy teaching program aimed at medical students and residents. Objective: This study involves a randomized controlled trial of a 2-day multimodal intensive educational intervention designed to evaluate the effectiveness of a new psychotherapy teaching program for medical students and residents in China. The primary outcomes include participants’ knowledge and utilization of psychotherapy, training program acceptability, self-reported self-efficacy, and motivation to apply psychotherapy. Methods: This 2-arm randomized controlled trial was conducted at Sir Run Run Shaw Hospital. The study aimed to recruit approximately 160 medical students and residents, with about 80 participants in the intervention group and 80 in the control group. Both groups completed a baseline survey before participation, reporting their psychotherapy knowledge, utilization of psychotherapy, self-efficacy, and self-motivation. The intervention group received a 2-day multimodal intensive educational intervention (supervision-based online teaching), while the waitlist control group did not receive any intervention during this period. Both groups were followed up for 8 weeks, completing the same survey administered at baseline. At the end of the study, the control group received the intervention. The primary outcome measure was the change in trainees’ psychotherapy knowledge before and after the intervention training. Secondary outcome measures included changes in the trainees’ utilization of psychotherapy, self-reported self-efficacy, and self-reported motivation for psychotherapy. Additionally, training program acceptability was assessed. Analysis of covariance was used to analyze the primary outcomes. Pearson correlations and regression analysis explored factors associated with the knowledge score at baseline. The secondary outcomes, including participants’ psychotherapy utilization, confidence, and motivation, were analyzed using the same methods as for knowledge. All tests were 2-tailed, with a significance level set at P<.05. Results: A total of 160 participants were recruited and randomized between January 4 and 12, 2024. Baseline assessments were conducted from January 28 to February 1, 2024. The psychotherapy training program for the intervention group took place on February 3 and 4, 2024. Posttraining assessments were conducted starting April 1, 2024. Due to withdrawals, incomplete surveys, and data loss, we had a total of 113 participants: 57 in the intervention group and 56 in the control group. The amount of data varied across measures. The data analysis was finished in August 2024. Conclusions: This study aims to evaluate the effectiveness of the multimodal psychotherapy training program for medical students in China. If this brief, cognitive behavioral therapy–based psychotherapy skill training proves effective, the potential mental health impact of its nationwide expansion could be significant. Trial Registration: ClinicalTrials.gov NCT06258460; https://clinicaltrials.gov/ct2/show/NCT06258460 International Registered Report Identifier (IRRID): DERR1-10.2196/58037 %M 39752191 %R 10.2196/58037 %U https://www.researchprotocols.org/2025/1/e58037 %U https://doi.org/10.2196/58037 %U http://www.ncbi.nlm.nih.gov/pubmed/39752191 %0 Journal Article %@ 2818-3045 %I JMIR Publications %V 1 %N %P e57655 %T Enhancing Mixed Reality Simulation Training Technology With Real-Time Performance Visualization: Mixed Methods Study With Medical First Responders %A Zechner,Olivia %A Schrom-Feiertag,Helmut %A Wespi,Rafael %A Pretolesi,Daniele %A Nguyen,Quynh %A Tscheligi,Manfred %K mixed reality %K immersive technologies %K simulation training %K simulation %K paramedic %K medical first responders %K human performance %K stress %K stress monitoring %K human-centered design %D 2024 %7 24.12.2024 %9 %J JMIR XR Spatial Comput %G English %X Background: Mixed reality (MR) simulation training is emerging in paramedical education as a way to practice responding to stress-intensive scenarios like mass casualty incidents in a safe and controlled environment. Current training platforms, however, lack real-time stress and human performance monitoring tools. Objective: The study aims to enhance MR training for medical first responders through real-time evaluation of performance and stress levels, leveraging biosignal monitoring and advanced analytics to allow instructors to tailor feedback and maintain optimal challenge and safety levels. Methods: The study includes a structured, multiphase approach including initial requirement gathering (structured interviews and cocreation workshops), an online design survey, iterative prototype development, and a field trial (including training observations and interviews). Data were collected from 5 end user consortium members across Europe. Quantitative data from checklists were analyzed using frequencies and percentages to understand feature usage and event occurrences. Qualitative data from semistructured interviews and cocreation workshops were transcribed, coded, and subjected to thematic analysis to identify patterns and insights into the usability and effectiveness of the enhanced features in the MR training. Results: The study identified a number of requirements that medical first responders have for an MR training system, including requirements not included in currently available solutions. A total of 80 performance metrics were initially identified and refined to a set of 54 metrics, which were categorized into key performance indicator groups such as scene safety, triage performance, and communication. Requirements for smart wearables to monitor stress levels are provided and highlight the importance of a user-centered design process to provide users with effective tools that fit their needs. Stress visualization preferences are described in the form of a dashboard as well as in virtual environments surrounding the avatar. Using an iterative design process and user feedback, a training system was developed, integrating real-time performance tracking and stress monitoring. The field trial provided insights into the practical use of these features during a real training exercise, showed interaction preferences between trainer and trainees, and highlighted further improvement opportunities. Conclusions: This research enhances MR training for paramedics by integrating real-time performance metrics and stress indicators based on a human-centered design approach that aligns with end user needs, thereby laying the foundation for developing more effective and immersive training solutions for high-stress professions. %R 10.2196/57655 %U https://xr.jmir.org/2024/1/e57655 %U https://doi.org/10.2196/57655 %0 Journal Article %@ 2563-3570 %I JMIR Publications %V 5 %N %P e65506 %T Effect of a Web-Based Heartfulness Program on the Mental Well-Being, Biomarkers, and Gene Expression Profile of Health Care Students: Randomized Controlled Trial %A Thimmapuram,Jayaram %A Patel,Kamlesh D %A Bhatt,Deepti %A Chauhan,Ajay %A Madhusudhan,Divya %A Bhatt,Kashyap K %A Deshpande,Snehal %A Budhbhatti,Urvi %A Joshi,Chaitanya %+ WellSpan Health, 1001 S George St, York, PA, 17403, United States, 1 7174956027, jthimmapuram@wellspan.org %K heartfulness %K meditation %K stress %K anxiety %K depression %K interleukins %K gene expression %K dehydroepiandrosterone %K DHEA %K gene %K mental health %K meditation %K randomized study %K web-based program %K mental well-being %K well-being %K mental %K health care students %K student %K mRNA %K messenger ribonucleic acid %K youth %K young adults %K web-based %K biomarker %K RNA %K bioinformatics %K randomized %K statistical analysis %K nursing %K physiotherapy %K pharmacy %D 2024 %7 16.12.2024 %9 Original Paper %J JMIR Bioinform Biotech %G English %X Background: Health care students often experience high levels of stress, anxiety, and mental health issues, making it crucial to address these challenges. Variations in stress levels may be associated with changes in dehydroepiandrosterone sulfate (DHEA-S) and interleukin-6 (IL-6) levels and gene expression. Meditative practices have demonstrated effectiveness in reducing stress and improving mental well-being. Objective: This study aims to assess the effects of Heartfulness meditation on mental well-being, DHEA-S, IL-6, and gene expression profile. Methods: The 78 enrolled participants were randomly assigned to the Heartfulness meditation (n=42, 54%) and control (n=36, 46%) groups. The participants completed the Perceived Stress Scale (PSS) and Depression Anxiety Stress Scale (DASS-21) at baseline and after week 12. Gene expression with messenger RNA sequencing and DHEA-S and IL-6 levels were also measured at baseline and the completion of the 12 weeks. Statistical analysis included descriptive statistics, paired t test, and 1-way ANOVA with Bonferroni correction. Results: The Heartfulness group exhibited a significant 17.35% reduction in PSS score (from mean 19.71, SD 5.09 to mean 16.29, SD 4.83; P<.001) compared to a nonsignificant 6% reduction in the control group (P=.31). DASS-21 scores decreased significantly by 27.14% in the Heartfulness group (from mean 21.15, SD 9.56 to mean 15.41, SD 7.87; P<.001) while it increased nonsignificantly by 17% in the control group (P=.04). For the DASS-21 subcomponents—the Heartfulness group showed a statistically significant 28.53% reduction in anxiety (P=.006) and 27.38% reduction in stress (P=.002) versus an insignificant 22% increase in anxiety (P=.02) and 6% increase in stress (P=.47) in the control group. Further, DHEA-S levels showed a significant 20.27% increase in the Heartfulness group (from mean 251.71, SD 80.98 to mean 302.74, SD 123.56; P=.002) compared to an insignificant 9% increase in the control group (from mean 285.33, SD 112.14 to mean 309.90, SD 136.90; P=.10). IL-6 levels showed a statistically significant difference in both the groups (from mean 4.93, SD 1.35 to mean 3.67, SD 1.0; 28.6%; P<.001 [Heartfulness group] and from mean 4.52, SD 1.40 to mean 2.72, SD 1.74; 40%; P<.001 [control group]). Notably, group comparison at 12 weeks revealed a significant difference in perceived stress, DASS-21 and its subcomponents, and IL-6 (all P<.05/4). The gene expression profile with messenger RNA sequencing identified 875 upregulated genes and 1539 downregulated genes in the Heartfulness group compared to baseline, and there were 292 upregulated genes and 1180 downregulated genes in the Heartfulness group compared to the control group after the intervention. Conclusions: Heartfulness practice was associated with decreased depression, anxiety, and stress scores and improved health measures in DHEA-S and IL-6 levels. The gene expression data point toward possible mechanisms of alleviation of symptoms of stress, anxiety and depression. Trial Registration: ISRCTN Registry ISRCTN82860715; https://doi.org/10.1186/ISRCTN82860715 %M 39680432 %R 10.2196/65506 %U https://bioinform.jmir.org/2024/1/e65506 %U https://doi.org/10.2196/65506 %U http://www.ncbi.nlm.nih.gov/pubmed/39680432 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e57451 %T Performance of GPT-3.5 and GPT-4 on the Korean Pharmacist Licensing Examination: Comparison Study %A Jin,Hye Kyung %A Kim,EunYoung %K GPT-3.5 %K GPT-4 %K Korean %K Korean Pharmacist Licensing Examination %K KPLE %D 2024 %7 4.12.2024 %9 %J JMIR Med Educ %G English %X Background: ChatGPT, a recently developed artificial intelligence chatbot and a notable large language model, has demonstrated improved performance on medical field examinations. However, there is currently little research on its efficacy in languages other than English or in pharmacy-related examinations. Objective: This study aimed to evaluate the performance of GPT models on the Korean Pharmacist Licensing Examination (KPLE). Methods: We evaluated the percentage of correct answers provided by 2 different versions of ChatGPT (GPT-3.5 and GPT-4) for all multiple-choice single-answer KPLE questions, excluding image-based questions. In total, 320, 317, and 323 questions from the 2021, 2022, and 2023 KPLEs, respectively, were included in the final analysis, which consisted of 4 units: Biopharmacy, Industrial Pharmacy, Clinical and Practical Pharmacy, and Medical Health Legislation. Results: The 3-year average percentage of correct answers was 86.5% (830/960) for GPT-4 and 60.7% (583/960) for GPT-3.5. GPT model accuracy was highest in Biopharmacy (GPT-3.5 77/96, 80.2% in 2022; GPT-4 87/90, 96.7% in 2021) and lowest in Medical Health Legislation (GPT-3.5 8/20, 40% in 2022; GPT-4 12/20, 60% in 2022). Additionally, when comparing the performance of artificial intelligence with that of human participants, pharmacy students outperformed GPT-3.5 but not GPT-4. Conclusions: In the last 3 years, GPT models have performed very close to or exceeded the passing threshold for the KPLE. This study demonstrates the potential of large language models in the pharmacy domain; however, extensive research is needed to evaluate their reliability and ensure their secure application in pharmacy contexts due to several inherent challenges. Addressing these limitations could make GPT models more effective auxiliary tools for pharmacy education. %R 10.2196/57451 %U https://mededu.jmir.org/2024/1/e57451 %U https://doi.org/10.2196/57451 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 26 %N %P e53344 %T Reflections From the Pandemic: Is Connectivism the Panacea for Clinicians? %A Benjamin,Jennifer %A Pillow,Tyson %A MacNeill,Heather %A Masters,Ken %A Agrawal,Anoop %A Mehta,Neil %+ Texas Children's Hospital, Baylor College of Medicine, 6701 Fannin Street, Houston, TX, 77030, United States, 1 832 824 1000 ext 3436, jennifer.benjamin@bcm.edu %K learning theory %K learning framework %K connectivism %K panacea %K COVID-19 %K generative artificial intelligence %K GAI %K health care community %K clinician %K health care %K airborne disease %K learning %K information %K misinformation %K autonomy %K diversity %D 2024 %7 3.12.2024 %9 Viewpoint %J J Med Internet Res %G English %X The COVID-19 pandemic and the recent increased interest in generative artificial intelligence (GenAI) highlight the need for interprofessional communities’ collaboration to find solutions to complex problems. A personal narrative experience of one of the authors compels us to reflect on current approaches to learning and knowledge acquisition and use solutions to the challenges posed by GenAI through social learning contexts using connectivism. We recognize the need for constructivism and experiential learning for knowledge acquisition to establish foundational understanding. We explore how connectivist approaches can enhance traditional constructivist paradigms amid rapidly changing learning environments and online communities. Learning in connectivism includes interacting with experts from other disciplines and creating nodes of accurate and accessible information while distinguishing between misinformation and accurate facts. Autonomy, connectedness, diversity, and openness are foundational for learners to thrive in this learning environment. Learning in this environment is not just acquiring new knowledge as individuals but being connected to networks of knowledge, enabling health professionals to stay current and up-to-date. Existing online communities with accessible GenAI solutions allow for the application of connectivist principles for learning and knowledge acquisition. %M 39625749 %R 10.2196/53344 %U https://www.jmir.org/2024/1/e53344 %U https://doi.org/10.2196/53344 %U http://www.ncbi.nlm.nih.gov/pubmed/39625749 %0 Journal Article %@ 2561-326X %I JMIR Publications %V 8 %N %P e60670 %T Optimizing Compassion Training in Medical Trainees Using an Adjunct mHealth App: A Preliminary Single-Arm Feasibility and Acceptability Study %A Wooldridge,Jennalee S %A Soriano,Emily C %A Chu,Gage %A Shirazi,Anaheed %A Shapiro,Desiree %A Patterson,Marta %A Kim,Hyun-Chung %A Herbert,Matthew S %+ Mental Health Service, VA San Diego Healthcare System, 3350 La Jolla Village Dr, San Diego, CA, 92161, United States, 1 6194978326, m1herbert@health.ucsd.edu %K mobile phone %K compassion %K empathy %K mHealth %K mobile health %K medical student %K medical resident %K mHealth app %K app %K medical trainee %K training %K feasibility %K acceptability %K pilot %K mindfulness %K self-compassion %K smartphone app %K compassion %K applicability %D 2024 %7 26.11.2024 %9 Original Paper %J JMIR Form Res %G English %X Background: While structured compassion training programs have shown promise for increasing compassion among medical trainees, a major challenge is applying the concepts and practices taught during the program into the complex, dynamic, time-pressured, and often hectic hospital workplace. Objective: The purpose of this pilot study was to examine the feasibility, acceptability, and preliminary effects of Compassion Coach, a mobile health (mHealth) smartphone app designed to bolster a 6-week mindfulness and self-compassion training program for medical trainees. Methods: In Compassion Coach, notifications to remind, encourage, and measure the perceived impact of informal mindfulness and compassion practices taught during the program were delivered at 7 AM, 12 PM, and 7 PM, respectively, 3 times per week over the course of the training program. The app also contained a library of guided audio formal mindfulness and compassion practices to allow quick and easy access. In this pilot study, we collected data from 29 medical students and residents who downloaded Compassion Coach and completed surveys assessing perceived effectiveness and acceptability. Engagement with the Compassion Coach app was passively tracked through notification response rate and library resource access over time. Results: The average response rate to notifications was 58% (SD 29%; range 12%-98%), with a significant decline over time (P=.009; odds ratio 0.98, 95% CI 0.96-0.99). Across all participants and occasions, the majority agreed the informal practices prompted by Compassion Coach helped them feel grounded and centered (110/150, 73%), improved compassion (29/41, 71%), reduced burnout (106/191, 56%), and improved their mood (133/191, 70%). In total, 16 (55%) of the 29 participants accessed guided audio recordings on average 3 (SD 3.4) times throughout the program. At the posttreatment time point, most participants (13/18, 72%) indicated that Compassion Coach helped them engage in compassion practices in daily life, and half (9/18, 50%) indicated that Compassion Coach helped improve interactions with patients. Conclusions: Overall, preliminary results of Compassion Coach are encouraging and suggest the integration of a smartphone app with an ongoing mindfulness and self-compassion training program may bolster the effects of the program on medical trainees. However, there was variability in engagement with Compassion Coach and perceived helpfulness. Additional research is indicated to optimize this novel mHealth approach and conduct a study powered to formally evaluate effects. %M 39589766 %R 10.2196/60670 %U https://formative.jmir.org/2024/1/e60670 %U https://doi.org/10.2196/60670 %U http://www.ncbi.nlm.nih.gov/pubmed/39589766 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e60940 %T Impact of Ophthalmic Knowledge Assessment Program Scores and Surgical Volume on Subspecialty Fellowship Application in Ophthalmology Residency: Retrospective Cohort Study %A Hertel,Amanda Kay %A Ajlan,Radwan S %K residency %K fellowship %K ophthalmology %K OKAP %K surgical training %K ophthalmology resident %K ophthalmology residency program %K examination %K surgical volume exposure %K fellowship training %K surgical volume %K exposure %K Ophthalmic Knowledge Assessment Program %D 2024 %7 13.11.2024 %9 %J JMIR Med Educ %G English %X Background: Ophthalmology residents take the Ophthalmic Knowledge Assessment Program (OKAP) exam annually, which provides percentile rank for multiple categories and the total score. In addition, ophthalmology residency training programs have multiple subspecialty rotations with defined minimum procedure requirements. However, residents’ surgical volumes vary, with some residents exceeding their peers in specific subspecialty rotations. Objective: This study aims to identify if there is a difference in OKAP examination scores and surgical volume exposure during ophthalmology residency training between nonfellowship and fellowship applicants and among various subspecialties. Methods: A retrospective review of OKAP scores and surgical procedure numbers of graduating residents in an accredited academic ophthalmology residency program in the Midwest United States was conducted. Data were collected from 2012 to 2022. Results: A total of 31 residents were identified. Most residents decided to pursue fellowship training upon graduation (20/31, 65% residents), and the rest chose to practice comprehensive ophthalmology (11/31, 35% residents). A total of 18/31 residents had OKAP score reports available. The fellowship group outperformed the nonfellowship group in multiple subsections and the total exam (P=.04). Those pursuing fellowship training in glaucoma performed higher on the Glaucoma section (P=.004) and the total exam (P=.005). Residents pursuing cornea performed higher on nearly all subsections, including External Disease and Cornea (P=.02) and the total exam (P=.007). The majority of the surgical volume exposure was identical between fellowship and nonfellowship groups. Those who pursued glaucoma fellowship performed more glaucoma filtering and shunting procedures (P=.03). Residents going into pediatrics fellowship were primary surgeons in more strabismus cases (P=.01), assisted in fewer strabismus cases (P<.001), and had no difference in the total number of strabismus surgeries. Conclusions: In our program, residents pursuing fellowship training had higher OKAP scores on multiple sections and the total exam. There was no significant difference in the overall surgical volume averages between fellowship and nonfellowship groups, but few differences existed in subspecialty procedures among fellowship applicants. Larger multicenter studies are needed to clarify the relationship between OKAP scores and ophthalmology fellowship decisions nationwide. %R 10.2196/60940 %U https://mededu.jmir.org/2024/1/e60940 %U https://doi.org/10.2196/60940 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 26 %N %P e64221 %T Video Abstracts in Research %A Nachman,Sophie %A Ortiz-Prado,Esteban %A Tucker,Joseph D %+ Institute for Global Health and Infectious Diseases, 130 Mason Farm Road, 2nd Floor, Chapel Hill, NC, 27599, United States, 1 9199662536, jdtucker@med.unc.edu %K video abstract %K abstract %K dissemination %K public engagement %K online %K videos %K public audience %K communication %K infographics %K health literacy %K patient education %K public health %D 2024 %7 4.11.2024 %9 Viewpoint %J J Med Internet Res %G English %X Video abstracts can be useful in health research. A video abstract provides key messages about a research article and can increase public engagement, spark conversations, and may increase academic attention. A growing number of open source software programs make it easier to develop a video abstract. This viewpoint provides practical tips for creating a video abstract for health research. %M 39496154 %R 10.2196/64221 %U https://www.jmir.org/2024/1/e64221 %U https://doi.org/10.2196/64221 %U http://www.ncbi.nlm.nih.gov/pubmed/39496154 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e52924 %T A SIMBA CoMICs Initiative to Cocreating and Disseminating Evidence-Based, Peer-Reviewed Short Videos on Social Media: Mixed Methods Prospective Study %A Elhariry,Maiar %A Malhotra,Kashish %A Goyal,Kashish %A Bardus,Marco %A Team,SIMBA and CoMICs %A Kempegowda,Punith %+ Applied Health Sciences, School of Health Sciences, College of Medicine and Health, University of Birmingham, Edgbaston, Birmingham, B15 2TT, United Kingdom, 44 7721930777, p.kempegowda@bham.ac.uk %K influencers %K social media %K public engagement %K apps %K healthcare %K medical students %K online medical information %K simulation %K peer-reviewed information %D 2024 %7 30.10.2024 %9 Original Paper %J JMIR Med Educ %G English %X Background: Social media is a powerful platform for disseminating health information, yet it is often riddled with misinformation. Further, few guidelines exist for producing reliable, peer-reviewed content. This study describes a framework for creating and disseminating evidence-based videos on polycystic ovary syndrome (PCOS) and thyroid conditions to improve health literacy and tackle misinformation. Objective: The study aims to evaluate the creation, dissemination, and impact of evidence-based, peer-reviewed short videos on PCOS and thyroid disorders across social media. It also explores the experiences of content creators and assesses audience engagement. Methods: This mixed methods prospective study was conducted between December 2022 and May 2023 and comprised five phases: (1) script generation, (2) video creation, (3) cross-platform publication, (4) process evaluation, and (5) impact evaluation. The SIMBA-CoMICs (Simulation via Instant Messaging for Bedside Application–Combined Medical Information Cines) initiative provides a structured process where medical concepts are simplified and converted to visually engaging videos. The initiative recruited medical students interested in making visually appealing and scientifically accurate videos for social media. The students were then guided to create video scripts based on frequently searched PCOS- and thyroid-related topics. Once experts confirmed the accuracy of the scripts, the medical students produced the videos. The videos were checked by clinical experts and experts with lived experience to ensure clarity and engagement. The SIMBA-CoMICs team then guided the students in editing these videos to fit platform requirements before posting them on TikTok, Instagram, YouTube, and Twitter. Engagement metrics were tracked over 2 months. Content creators were interviewed, and thematic analysis was performed to explore their experiences. Results: The 20 videos received 718 likes, 120 shares, and 54,686 views across all platforms, with TikTok (19,458 views) and Twitter (19,678 views) being the most popular. Engagement increased significantly, with follower growth ranging from 5% on Twitter to 89% on TikTok. Thematic analysis of interviews with 8 out of 38 participants revealed 4 key themes: views on social media, advice for using social media, reasons for participating, and reflections on the project. Content creators highlighted the advantages of social media, such as large outreach (12 references), convenience (10 references), and accessibility to opportunities (7 references). Participants appreciated the nonrestrictive participation criteria, convenience (8 references), and the ability to record from home using prewritten scripts (6 references). Further recommendations to improve the content creation experience included awareness of audience demographics (9 references), sharing content on multiple platforms (5 references), and collaborating with organizations (3 references). Conclusions: This study demonstrates the effectiveness of the SIMBA CoMICs initiative in training medical students to create accurate medical information on PCOS and thyroid disorders for social media dissemination. The model offers a scalable solution to combat misinformation and improve health literacy. %M 39475500 %R 10.2196/52924 %U https://mededu.jmir.org/2024/1/e52924 %U https://doi.org/10.2196/52924 %U http://www.ncbi.nlm.nih.gov/pubmed/39475500 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e53462 %T Design, Implementation, and Analysis of an Assessment and Accreditation Model to Evaluate a Digital Competence Framework for Health Professionals: Mixed Methods Study %A Saigí-Rubió,Francesc %A Romeu,Teresa %A Hernández Encuentra,Eulàlia %A Guitert,Montse %A Andrés,Erik %A Reixach,Elisenda %+ Faculty of Health Sciences, Universitat Oberta de Catalunya, Rambla del Poblenou, 156, Barcelona, 08018, Spain, 34 933 263 622, fsaigi@uoc.edu %K eHealth literacy %K eHealth competencies %K digital health %K competencies %K eHealth %K health literacy %K digital technology %K health care professionals %K health care workers %D 2024 %7 17.10.2024 %9 Original Paper %J JMIR Med Educ %G English %X Background: Although digital health is essential for improving health care, its adoption remains slow due to the lack of literacy in this area. Therefore, it is crucial for health professionals to acquire digital skills and for a digital competence assessment and accreditation model to be implemented to make advances in this field. Objective: This study had two objectives: (1) to create a specific map of digital competences for health professionals and (2) to define and test a digital competence assessment and accreditation model for health professionals. Methods: We took an iterative mixed methods approach, which included a review of the gray literature and consultation with local experts. We used the arithmetic mean and SD in descriptive statistics, P values in hypothesis testing and subgroup comparisons, the greatest lower bound in test diagnosis, and the discrimination index in study instrument analysis. Results: The assessment model designed in accordance with the competence content defined in the map of digital competences and based on scenarios had excellent internal consistency overall (greatest lower bound=0.91). Although most study participants (110/122, 90.2%) reported an intermediate self-perceived digital competence level, we found that the vast majority would not attain a level-2 Accreditation of Competence in Information and Communication Technologies. Conclusions: Knowing the digital competence level of health professionals based on a defined competence framework should enable such professionals to be trained and updated to meet real needs in their specific professional contexts and, consequently, take full advantage of the potential of digital technologies. These results have informed the Health Plan for Catalonia 2021-2025, thus laying the foundations for creating and offering specific training to assess and certify the digital competence of such professionals. %M 39418092 %R 10.2196/53462 %U https://mededu.jmir.org/2024/1/e53462 %U https://doi.org/10.2196/53462 %U http://www.ncbi.nlm.nih.gov/pubmed/39418092 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 26 %N %P e50057 %T Impact of Concurrent Media Exposure on Professional Identity: Cross-Sectional Study of 1087 Medical Students During Long COVID %A Wu,Manli %A Yan,Jun %A Qiao,Chongming %A Yan,Chu %+ School of Journalism and Information Communication, Huazhong University of Science and Technology, School of Journalism and Information Communication, HUST, Number 1037, Luoyu Road, Wuhan, 430074, China, 86 18971629738, junyan@hust.edu.cn %K COVID-19 %K media exposure %K social support %K professional identity %K medical students %K Stimulus-Organism-Response framework %D 2024 %7 17.10.2024 %9 Original Paper %J J Med Internet Res %G English %X Background: Long COVID has widened the health gap across society and highlighted the vulnerabilities and risks faced by health care systems. For instance, the global trend of medical workers resigning has become a prominent topic on social media. In response to this severe social problem in global public health within the digital society, it is urgent to investigate how the professional identity of medical students, who are digital natives and the future workforce of medical practitioners, is affected by the media environment. Objective: This study aims to examine how media exposure relates to medical students’ perceptions of informational and emotional support, and how these perceptions further influence the development of their professional identity. Methods: Building on the Stimulus-Organism-Response (SOR) framework, this study develops a theoretical model to illustrate how media exposure affects medical students’ professional identity through the mediation of social support. Specifically, media exposure was assessed through online news media and social media exposure; social support was evaluated in terms of informational and emotional support; and professional identity was measured through medical students’ sense of belonging and professional commitment. A survey was conducted at a medical school in China, yielding 1087 valid responses that were analyzed using SmartPLS 4.0. Results: Consistent with our expectations, online news media exposure was positively associated with both informational support (β=.163; P<.001) and emotional support (β=.084; P=.007). Similarly, social media exposure showed positive associations with informational support (β=.122; P<.001) and emotional support (β=.235; P<.001). Thereafter, informational support (β=.228; P<.001) and emotional support (β=.344; P<.001) were positively associated with students’ sense of belonging. Meanwhile, both informational support (β=.245; P<.001) and emotional support (β=.412; P<.001) positively impacted medical students’ professional commitment. In addition, a mediation test was conducted. The results confirmed that informational support and emotional support partially mediated the effect of online news media, while fully mediating the effect of social media on medical students’ sense of belonging and professional commitment. Conclusions: This study finds that exposure to online news media and social media can enhance medical students’ sense of belonging and professional commitment through the formation of informational and emotional support. It expands the discussion on the role of media in providing social support and facilitating the development of medical students’ professional identity. This is a valuable contribution to addressing complex public health crises through effective media governance in the network era. %M 39418080 %R 10.2196/50057 %U https://www.jmir.org/2024/1/e50057 %U https://doi.org/10.2196/50057 %U http://www.ncbi.nlm.nih.gov/pubmed/39418080 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e51411 %T Medical Education and Artificial Intelligence: Web of Science–Based Bibliometric Analysis (2013-2022) %A Wang,Shuang %A Yang,Liuying %A Li,Min %A Zhang,Xinghe %A Tai,Xiantao %K artificial intelligence %K medical education %K bibliometric analysis %K CiteSpace %K VOSviewer %D 2024 %7 10.10.2024 %9 %J JMIR Med Educ %G English %X Background: Incremental advancements in artificial intelligence (AI) technology have facilitated its integration into various disciplines. In particular, the infusion of AI into medical education has emerged as a significant trend, with noteworthy research findings. Consequently, a comprehensive review and analysis of the current research landscape of AI in medical education is warranted. Objective: This study aims to conduct a bibliometric analysis of pertinent papers, spanning the years 2013‐2022, using CiteSpace and VOSviewer. The study visually represents the existing research status and trends of AI in medical education. Methods: Articles related to AI and medical education, published between 2013 and 2022, were systematically searched in the Web of Science core database. Two reviewers scrutinized the initially retrieved papers, based on their titles and abstracts, to eliminate papers unrelated to the topic. The selected papers were then analyzed and visualized for country, institution, author, reference, and keywords using CiteSpace and VOSviewer. Results: A total of 195 papers pertaining to AI in medical education were identified from 2013 to 2022. The annual publications demonstrated an increasing trend over time. The United States emerged as the most active country in this research arena, and Harvard Medical School and the University of Toronto were the most active institutions. Prolific authors in this field included Vincent Bissonnette, Charlotte Blacketer, Rolando F Del Maestro, Nicole Ledows, Nykan Mirchi, Alexander Winkler-Schwartz, and Recai Yilamaz. The paper with the highest citation was “Medical Students’ Attitude Towards Artificial Intelligence: A Multicentre Survey.” Keyword analysis revealed that “radiology,” “medical physics,” “ehealth,” “surgery,” and “specialty” were the primary focus, whereas “big data” and “management” emerged as research frontiers. Conclusions: The study underscores the promising potential of AI in medical education research. Current research directions encompass radiology, medical information management, and other aspects. Technological progress is expected to broaden these directions further. There is an urgent need to bolster interregional collaboration and enhance research quality. These findings offer valuable insights for researchers to identify perspectives and guide future research directions. %R 10.2196/51411 %U https://mededu.jmir.org/2024/1/e51411 %U https://doi.org/10.2196/51411 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e56128 %T Assessment of ChatGPT-4 in Family Medicine Board Examinations Using Advanced AI Learning and Analytical Methods: Observational Study %A Goodings,Anthony James %A Kajitani,Sten %A Chhor,Allison %A Albakri,Ahmad %A Pastrak,Mila %A Kodancha,Megha %A Ives,Rowan %A Lee,Yoo Bin %A Kajitani,Kari %K ChatGPT-4 %K Family Medicine Board Examination %K artificial intelligence in medical education %K AI performance assessment %K prompt engineering %K ChatGPT %K artificial intelligence %K AI %K medical education %K assessment %K observational %K analytical method %K data analysis %K examination %D 2024 %7 8.10.2024 %9 %J JMIR Med Educ %G English %X Background: This research explores the capabilities of ChatGPT-4 in passing the American Board of Family Medicine (ABFM) Certification Examination. Addressing a gap in existing literature, where earlier artificial intelligence (AI) models showed limitations in medical board examinations, this study evaluates the enhanced features and potential of ChatGPT-4, especially in document analysis and information synthesis. Objective: The primary goal is to assess whether ChatGPT-4, when provided with extensive preparation resources and when using sophisticated data analysis, can achieve a score equal to or above the passing threshold for the Family Medicine Board Examinations. Methods: In this study, ChatGPT-4 was embedded in a specialized subenvironment, “AI Family Medicine Board Exam Taker,” designed to closely mimic the conditions of the ABFM Certification Examination. This subenvironment enabled the AI to access and analyze a range of relevant study materials, including a primary medical textbook and supplementary web-based resources. The AI was presented with a series of ABFM-type examination questions, reflecting the breadth and complexity typical of the examination. Emphasis was placed on assessing the AI’s ability to interpret and respond to these questions accurately, leveraging its advanced data processing and analysis capabilities within this controlled subenvironment. Results: In our study, ChatGPT-4’s performance was quantitatively assessed on 300 practice ABFM examination questions. The AI achieved a correct response rate of 88.67% (95% CI 85.08%-92.25%) for the Custom Robot version and 87.33% (95% CI 83.57%-91.10%) for the Regular version. Statistical analysis, including the McNemar test (P=.45), indicated no significant difference in accuracy between the 2 versions. In addition, the chi-square test for error-type distribution (P=.32) revealed no significant variation in the pattern of errors across versions. These results highlight ChatGPT-4’s capacity for high-level performance and consistency in responding to complex medical examination questions under controlled conditions. Conclusions: The study demonstrates that ChatGPT-4, particularly when equipped with specialized preparation and when operating in a tailored subenvironment, shows promising potential in handling the intricacies of medical board examinations. While its performance is comparable with the expected standards for passing the ABFM Certification Examination, further enhancements in AI technology and tailored training methods could push these capabilities to new heights. This exploration opens avenues for integrating AI tools such as ChatGPT-4 in medical education and assessment, emphasizing the importance of continuous advancement and specialized training in medical applications of AI. %R 10.2196/56128 %U https://mededu.jmir.org/2024/1/e56128 %U https://doi.org/10.2196/56128 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e59009 %T Gender and Sexuality Awareness in Medical Education and Practice: Mixed Methods Study %A Khamisy-Farah,Rola %A Biras,Eden %A Shehadeh,Rabie %A Tuma,Ruba %A Atwan,Hisham %A Siri,Anna %A Converti,Manlio %A Chirico,Francesco %A Szarpak,Łukasz %A Biz,Carlo %A Farah,Raymond %A Bragazzi,Nicola %+ Laboratory for Industrial and Applied Mathematics, Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, ON, M3J 1P3, Canada, 1 416 736 2100, robertobragazzi@gmail.com %K gender medicine %K medical education %K clinical practice %K gender-sensitive care %K gender awareness %K sexuality awareness %K awareness %K medical education and practice %K healthcare %K patient outcomes %K patient %K patients %K medical professionals %K training %K educational interventions %K status-based %K survey %K effectiveness %K medical workforce %D 2024 %7 8.10.2024 %9 Original Paper %J JMIR Med Educ %G English %X Background: The integration of gender and sexuality awareness in health care is increasingly recognized as vital for patient outcomes. Despite this, there is a notable lack of comprehensive data on the current state of physicians’ training and perceptions in these areas, leading to a gap in targeted educational interventions and optimal health care delivery. Objective: The study’s aim was to explore the experiences and perceptions of attending and resident physicians regarding the inclusion of gender and sexuality content in medical school curricula and professional practice in Israel. Methods: This cross-sectional survey targeted a diverse group of physicians across various specializations and experience levels. Distributed through Israeli Medical Associations and professional networks, it included sections on experiences with gender and sexuality content, perceptions of knowledge, the impact of medical school curricula on professional capabilities, and views on integrating gender medicine in medical education. Descriptive and correlational analyses, along with gender-based and medical status-based comparisons, were used, complemented, and enhanced by qualitative analysis of participants’ replies. Results: The survey, encompassing 189 respondents, revealed low-to-moderate exposure to gender and sexuality content in medical school curricula, with a similar perception of preparedness. A need for more comprehensive training was widely recognized. The majority valued training in these areas for enhancing professional capabilities, identifying 10 essential gender-related knowledge areas. The preference for integrating gender medicine throughout medical education was significant. Gender-based analysis indicated variations in exposure and perceptions. Conclusions: The study highlights a crucial need for the inclusion of gender and sexuality awareness in medical education and practice. It suggests the necessity for curriculum development, targeted training programs, policy advocacy, mentorship initiatives, and research to evaluate the effectiveness of these interventions. The findings serve as a foundation for future directions in medical education, aiming for a more inclusive, aware, and prepared medical workforce. %M 39152652 %R 10.2196/59009 %U https://mededu.jmir.org/2024/1/e59009 %U https://doi.org/10.2196/59009 %U http://www.ncbi.nlm.nih.gov/pubmed/39152652 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e64125 %T Psychological Safety Competency Training During the Clinical Internship From the Perspective of Health Care Trainee Mentors in 11 Pan-European Countries: Mixed Methods Observational Study %A Carrillo,Irene %A Skoumalová,Ivana %A Bruus,Ireen %A Klemm,Victoria %A Guerra-Paiva,Sofia %A Knežević,Bojana %A Jankauskiene,Augustina %A Jocic,Dragana %A Tella,Susanna %A Buttigieg,Sandra C %A Srulovici,Einav %A Madarasová Gecková,Andrea %A Põlluste,Kaja %A Strametz,Reinhard %A Sousa,Paulo %A Odalovic,Marina %A Mira,José Joaquín %+ Department of Health Psychology, Miguel Hernández University of Elche, Avenida de la Universidad s/n, Elche, 03202, Spain, 34 966658350, icarrillo@umh.es %K psychological safety %K speaking up %K professional competence %K patient safety %K education %K adverse event %D 2024 %7 7.10.2024 %9 Original Paper %J JMIR Med Educ %G English %X Background: In the field of research, psychological safety has been widely recognized as a contributing factor to improving the quality of care and patient safety. However, its consideration in the curricula and traineeship pathways of residents and health care students is scarce. Objective: This study aims to determine the extent to which health care trainees acquire psychological safety competencies during their internships in clinical settings and identify what measures can be taken to promote their learning. Methods: A mixed methods observational study based on a consensus conference and an open-ended survey among a sample of health care trainee mentors from health care institutions in a pan-European context was conducted. First, we administered an ad hoc questionnaire to assess the perceived degree of acquisition or implementation and significance of competencies (knowledge, attitudes, and skills) and institutional interventions in psychological safety. Second, we asked mentors to propose measures to foster among trainees those competencies that, in the first phase of the study, obtained an average acquisition score of <3.4 (scale of 1-5). A content analysis of the information collected was carried out, and the spontaneity of each category and theme was determined. Results: In total, 173 mentors from 11 pan-European countries completed the first questionnaire (response rate: 173/256, 67.6%), of which 63 (36.4%) participated in the second consultation. The competencies with the lowest acquisition level were related to warning a professional that their behavior posed a risk to the patient, managing their possible bad reaction, and offering support to a colleague who becomes a second victim. The mentors’ proposals for improvement of this competency gap referred to training in communication skills and patient safety, safety culture, work climate, individual attitudes, a reference person for trainees, formal incorporation into the curricula of health care degrees and specialization pathways, specific systems and mechanisms to give trainees a voice, institutional risk management, regulations, guidelines and standards, supervision, and resources to support trainees. In terms of teaching methodology, the mentors recommended innovative strategies, many of them based on technological tools or solutions, including videos, seminars, lectures, workshops, simulation learning or role-playing with or without professional actors, case studies, videos with practical demonstrations or model situations, panel discussions, clinical sessions for joint analysis of patient safety incidents, and debriefings to set and discuss lessons learned. Conclusions: This study sought to promote psychological safety competencies as a formal part of the training of future health care professionals, facilitating the translation of international guidelines into practice and clinical settings in the pan-European context. %M 39374073 %R 10.2196/64125 %U https://mededu.jmir.org/2024/1/e64125 %U https://doi.org/10.2196/64125 %U http://www.ncbi.nlm.nih.gov/pubmed/39374073 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 26 %N %P e49505 %T The Effectiveness of a Digital Mental Fitness Program (Positive Intelligence) on Perceived Stress, Self-Compassion, and Ruminative Thinking of Occupational Therapy Undergraduate Students: Longitudinal Study %A Puah,Shermain %A Pua,Ching Yee %A Shi,Jing %A Lim,Sok Mui %+ SIT Teaching and Learning Academy (STLA), Singapore Institute of Technology, 1 Punggol Coast Road, Singapore, 828608, Singapore, 65 6592 7637, shermain.puah@singaporetech.edu.sg %K mental health %K students %K digital wellness %K mobile health (mHealth) %K perceived stress %K self-compassion %K rumination %D 2024 %7 7.10.2024 %9 Original Paper %J J Med Internet Res %G English %X Background: Health care students often endure numerous stressors throughout their undergraduate education that can have lasting negative effects on their mental well-being. Positive Intelligence (PQ) is a digital mental fitness program designed to enhance self-mastery and help individuals reach their potential by strengthening various “mental muscles.” Objective: This study aims to evaluate the effectiveness of a 6-week app-delivered PQ program in reducing perceived stress, increasing self-compassion, and decreasing rumination tendencies among health care undergraduates. We hypothesized that students would show reductions in perceived stress, increases in self-compassion, and decreases in rumination tendencies by the end of the PQ program, compared with their preprogram scores. We adopted an exploratory approach for the 5-month follow-up due to the limited research consensus on the sustained effects of app-based programs over varying periods. Methods: The PQ program includes weekly hour-long videos, weekly group meetings, and daily 15-minute app-guided practices. Participants were first-year students from the occupational therapy program at a university in Singapore. Participants completed surveys measuring self-compassion, perceived stress, and rumination levels before and after the PQ program, and again at a 5-month follow-up. Data were analyzed using repeated measures ANOVA to assess differences across the pretest, immediate posttest, and follow-up posttest. Results: Out of 87 students enrolled in the study, the final sample consisted of 64 students (n=47, 73%, female; mean age 23 years, SD 5.06 years) with complete data. At the end of the 6 weeks, students exhibited significant increases in self-compassion (before the intervention: mean 3.07, SD 0.35; after the intervention: mean 3.34, SD 0.35; P<.001) and reductions in rumination tendencies (before the intervention: mean 3.57, SD 0.40; after the intervention: mean 3.27, SD 0.34; P<.001). However, no significant change in perceived stress levels was observed (before the intervention: 2.99, SD 0.14; after the intervention: mean 2.97, SD 0.16; P=.50). These effects were not influenced by the daily app-based practice of PQ exercises, and there were no sustained effects on self-compassion (mean 3.17, SD 0.27; P=.09) or rumination tendencies (mean 3.42, SD 0.38; P=.06) at the 5-month follow-up. Additionally, there was a significant increase in perceived stress at follow-up (mean 3.17, SD 0.21; P<.001) compared with pre- and postintervention levels. Conclusions: The PQ program did not directly alter stress perceptions but may have reframed students’ automatic negative thought processes, increased their awareness of self-sabotaging behaviors, and enhanced their self-compassion while reducing ruminative thinking. These findings highlight the importance of self-awareness for students’ well-being. Students can benefit from practices such as mindfulness and peer discussions to enhance self-compassion and reduce rumination. Educators trained in the PQ program can foster a supportive environment that encourages self-compassion, challenges negative self-talk, and helps students manage stress. %M 39374067 %R 10.2196/49505 %U https://www.jmir.org/2024/1/e49505 %U https://doi.org/10.2196/49505 %U http://www.ncbi.nlm.nih.gov/pubmed/39374067 %0 Journal Article %@ 2561-326X %I JMIR Publications %V 8 %N %P e55921 %T Preferences Regarding Information Strategies for Digital Mental Health Interventions Among Medical Students: Discrete Choice Experiment %A Vomhof,Markus %A Bau,Jessica Tabea %A Hüter,Pia %A Stehl,Stefan %A Haastert,Burkhard %A Loerbroks,Adrian %A Icks,Andrea %A Calo,Stella Teresa %A Schuster,Luca %A Pischke,Claudia R %A Kairies-Schwarz,Nadja %A Angerer,Peter %A Apolinário-Hagen,Jennifer %+ Institute of Medical Sociology, Centre for Health and Society, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Moorenstraße 5, Düsseldorf, 40225, Germany, 49 211 8106557, jessica.bau@hhu.de %K preferences %K digital mental health %K medical students %K innovation diffusion %K technology acceptance %K health information %D 2024 %7 4.10.2024 %9 Original Paper %J JMIR Form Res %G English %X Background: Digital mental health interventions (DMHIs) are capable of closing gaps in the prevention and therapy of common mental disorders. Despite their proven effectiveness and approval for prescription, use rates remain low. The reasons include a lack of familiarity and knowledge as well as lasting concerns. Medical students were shown to have a comparatively higher risk for common mental disorders and are thus an important target group for raising awareness about DMHIs. At best, knowledge is already imparted during medical school using context-sensitive information strategies. Yet, little is known about medical students’ information preferences regarding DMHIs. Objective: This study aims to explore information preferences for DMHIs for personal use among medical students in Germany. Methods: A discrete choice experiment was conducted, which was developed using an exploratory sequential mixed methods research approach. In total, 5 attributes (ie, source, delivery mode, timing, recommendation, and quality criteria), each with 3 to 4 levels, were identified using formative research. Data were analyzed using logistic regression models to estimate preference weights and the relative importance of attributes. To identify subgroups of students varying in information preferences, we additionally performed a latent class analysis. Results: Of 309 participants, 231 (74.8%) with reliable data were included in the main analysis (women: 217/309, 70.2%; age: mean 24.1, SD 4.0 y). Overall, the conditional logit model revealed that medical students preferred to receive information about DMHIs from the student council and favored being informed via social media early (ie, during their preclinic phase or their freshman week). Recommendations from other students or health professionals were preferred over recommendations from other users or no recommendations at all. Information about the scientific evidence base was the preferred quality criterion. Overall, the timing of information was the most relevant attribute (32.6%). Latent class analysis revealed 2 distinct subgroups. Class 1 preferred to receive extensive information about DMHIs in a seminar, while class 2 wanted to be informed digitally (via email or social media) and as early as possible in their studies. Conclusions: Medical students reported specific needs and preferences regarding DMHI information provided in medical school. Overall, the timing of information (early in medical education) was considered more important than the information source or delivery mode, which should be prioritized by decision makers (eg, members of faculties of medicine, universities, and ministries of education). Study findings suggest general and subgroup-specific information strategies, which could be implemented in a stepped approach. Easily accessible digital information may promote students’ interest in DMHIs in the first step that might lead to further information-seeking behavior and the attendance of seminars about DMHIs in the second step. %M 39365652 %R 10.2196/55921 %U https://formative.jmir.org/2024/1/e55921 %U https://doi.org/10.2196/55921 %U http://www.ncbi.nlm.nih.gov/pubmed/39365652 %0 Journal Article %@ 2291-9694 %I JMIR Publications %V 12 %N %P e63010 %T Comparative Study to Evaluate the Accuracy of Differential Diagnosis Lists Generated by Gemini Advanced, Gemini, and Bard for a Case Report Series Analysis: Cross-Sectional Study %A Hirosawa,Takanobu %A Harada,Yukinori %A Tokumasu,Kazuki %A Ito,Takahiro %A Suzuki,Tomoharu %A Shimizu,Taro %+ Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, 880 Kitakobayashi, Mibu-cho, Shimotsuga, 321-0293, Japan, 81 282861111, hirosawa@dokkyomed.ac.jp %K artificial intelligence %K clinical decision support %K diagnostic excellence %K generative artificial intelligence %K large language models %K natural language processing %D 2024 %7 2.10.2024 %9 Original Paper %J JMIR Med Inform %G English %X Background: Generative artificial intelligence (GAI) systems by Google have recently been updated from Bard to Gemini and Gemini Advanced as of December 2023. Gemini is a basic, free-to-use model after a user’s login, while Gemini Advanced operates on a more advanced model requiring a fee-based subscription. These systems have the potential to enhance medical diagnostics. However, the impact of these updates on comprehensive diagnostic accuracy remains unknown. Objective: This study aimed to compare the accuracy of the differential diagnosis lists generated by Gemini Advanced, Gemini, and Bard across comprehensive medical fields using case report series. Methods: We identified a case report series with relevant final diagnoses published in the American Journal Case Reports from January 2022 to March 2023. After excluding nondiagnostic cases and patients aged 10 years and younger, we included the remaining case reports. After refining the case parts as case descriptions, we input the same case descriptions into Gemini Advanced, Gemini, and Bard to generate the top 10 differential diagnosis lists. In total, 2 expert physicians independently evaluated whether the final diagnosis was included in the lists and its ranking. Any discrepancies were resolved by another expert physician. Bonferroni correction was applied to adjust the P values for the number of comparisons among 3 GAI systems, setting the corrected significance level at P value <.02. Results: In total, 392 case reports were included. The inclusion rates of the final diagnosis within the top 10 differential diagnosis lists were 73% (286/392) for Gemini Advanced, 76.5% (300/392) for Gemini, and 68.6% (269/392) for Bard. The top diagnoses matched the final diagnoses in 31.6% (124/392) for Gemini Advanced, 42.6% (167/392) for Gemini, and 31.4% (123/392) for Bard. Gemini demonstrated higher diagnostic accuracy than Bard both within the top 10 differential diagnosis lists (P=.02) and as the top diagnosis (P=.001). In addition, Gemini Advanced achieved significantly lower accuracy than Gemini in identifying the most probable diagnosis (P=.002). Conclusions: The results of this study suggest that Gemini outperformed Bard in diagnostic accuracy following the model update. However, Gemini Advanced requires further refinement to optimize its performance for future artificial intelligence–enhanced diagnostics. These findings should be interpreted cautiously and considered primarily for research purposes, as these GAI systems have not been adjusted for medical diagnostics nor approved for clinical use. %M 39357052 %R 10.2196/63010 %U https://medinform.jmir.org/2024/1/e63010 %U https://doi.org/10.2196/63010 %U http://www.ncbi.nlm.nih.gov/pubmed/39357052 %0 Journal Article %@ 2561-326X %I JMIR Publications %V 8 %N %P e53314 %T Creation of an Automated and Comprehensive Resident Progress System for Residents and to Save Hours of Faculty Time: Mixed Methods Study %A Perotte,Rimma %A Berns,Alyssa %A Shaker,Lana %A Ophaswongse,Chayapol %A Underwood,Joseph %A Hajicharalambous,Christina %+ Hackensack University Medical Center, 30 Prospect Ave, Hackensack, NJ, 07601, United States, 1 5519962470, rimma.perotte@hmhn.org %K progress dashboard %K informatics in medical education %K residency learning management system %K residency progress system %K residency education system %K summarization %K administrative burden %K medical education %K resident %K residency %K resident data %K longitudinal %K pilot study %K competency %K dashboards %K dashboard %K faculty %K residents %D 2024 %7 23.9.2024 %9 Original Paper %J JMIR Form Res %G English %X Background: It is vital for residents to have a longitudinal view of their educational progression, and it is crucial for the medical education team to have a clear way to track resident progress over time. Current tools for aggregating resident data are difficult to use and do not provide a comprehensive way to evaluate and display resident educational advancement. Objective: This study aims to describe the creation and assessment of a system designed to improve the longitudinal presentation, quality, and synthesis of educational progress for trainees. We created a new system for residency progress management with 3 goals in mind, that are (1) a long-term and centralized location for residency education data, (2) a clear and intuitive interface that is easy to access for both the residents and faculty involved in medical education, and (3) automated data input, transformation, and analysis. We present evaluations regarding whether residents find the system useful, and whether faculty like the system and perceive that it helps them save time with administrative duties. Methods: The system was created using a suite of Google Workspace tools including Forms, Sheets, Gmail, and a collection of Apps Scripts triggered at various times and events. To assess whether the system had an effect on the residents, we surveyed and asked them to self-report on how often they accessed the system and interviewed them as to whether they found it useful. To understand what the faculty thought of the system, we conducted a 14-person focus group and asked the faculty to self-report their time spent preparing for residency progress meetings before and after the system debut. Results: The system went live in February 2022 as a quality improvement project, evolving through multiple iterations of feedback. The authors found that the system was accessed differently by different postgraduate years (PGY), with the most usage reported in the PGY1 class (weekly), and the least amount of usage in the PGY3 class (once or twice). However, all of the residents reported finding the system useful, specifically for aggregating all of their evaluations in the same place. Faculty members felt that the system enabled a more high-quality biannual clinical competency committee meeting and they reported a combined time savings of 8 hours in preparation for each clinical competency committee as a result of reviewing resident data through the system. Conclusions: Our study reports on the creation of an automated, instantaneous, and comprehensive resident progress management system. The system has been shown to be well-liked by both residents and faculty. Younger PGY classes reported more frequent system usage than older PGY classes. Faculty reported that it helped facilitate more meaningful discussion of training progression and reduced the administrative burden by 8 hours per biannual session. %M 39312292 %R 10.2196/53314 %U https://formative.jmir.org/2024/1/e53314 %U https://doi.org/10.2196/53314 %U http://www.ncbi.nlm.nih.gov/pubmed/39312292 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 13 %N %P e62654 %T Education Program for Enhancing Health Care Students’ Attitudes Toward People Living With Dementia: Protocol for a Single-Arm Pre-Post Study %A Sari,Dianis Wulan %A Kugai,Haruna %A Igarashi,Ayumi %A Takaoka,Manami %A Matsumoto,Hiroshige %A Suzuki,Haruno %A Wu,Jinyan %A Fitryasari,Rizki %A Nasifah,Ike Ayunda %A Has,Eka Mishbahatul M %A Yamamoto-Mitani,Noriko %+ Faculty of Nursing, Universitas Airlangga, jl mulyorejo, Surabaya, 60115, Indonesia, 62 5913257, dianis.wulan.sari@fkp.unair.ac.id %K ageism %K dementia %K health professional %K education program %K long-term care %D 2024 %7 18.9.2024 %9 Protocol %J JMIR Res Protoc %G English %X Background: Health care students are instrumental in shaping the future of dementia care. Cultivating a positive attitude and understanding toward people living with dementia is crucial for diminishing the stigma associated with the condition, providing effective and person-centered care, and enhancing the quality of life for people living with dementia. Educational programs about dementia are increasingly recognizing the potential of gaming tools. Objective: This study aimed to evaluate the effectiveness of gaming-based dementia educational programs in improving attitudes toward people living with dementia among health care students. Methods: This single-arm pre-post study will be conducted among health care students in Indonesian universities. This educational program based on gaming tools will consist of a lecture on dementia, the use of N-impro (gaming tool), and the enactment of short dramas depicting desirable and undesirable communication with people living with dementia behaviors. We will assess attitudes toward people living with dementia, intention to help people living with dementia, knowledge of dementia, and the stigma associated with people living with dementia. The gaming-based dementia education program will be integrated into the curriculum of the health care students. The program will be implemented once with a duration of 90 minutes. Results: Data collection will occur from August 2023 to March 2024. Analysis of the data will be finalized by May 2024, and the outcome will be determined by July 2024. The impact of the gaming-based dementia educational program on improving attitudes toward people living with dementia will be reported. The study findings will be published in a peer-reviewed journal. Conclusions: The gaming education program demonstrates significant potential in enhancing attitudes toward people living with dementia across various countries, introducing an innovative method for the community-based support of people living with dementia. Trial Registration: ClinicalTrials.gov NCT06122623; https://clinicaltrials.gov/study/NCT06122623 International Registered Report Identifier (IRRID): DERR1-10.2196/62654 %M 39293050 %R 10.2196/62654 %U https://www.researchprotocols.org/2024/1/e62654 %U https://doi.org/10.2196/62654 %U http://www.ncbi.nlm.nih.gov/pubmed/39293050 %0 Journal Article %@ 2562-0959 %I JMIR Publications %V 7 %N %P e58396 %T NVIDIA’s “Chat with RTX” Custom Large Language Model and Personalized AI Chatbot Augments the Value of Electronic Dermatology Reference Material %A Kamel Boulos,Maged N %A Dellavalle,Robert %+ School of Medicine, University of Lisbon, Av Prof Egas Moniz MB, Lisbon, 1649-028, Portugal, 351 920531573, mnkboulos@ieee.org %K AI chatbots %K artificial intelligence %K AI %K generative AI %K large language models %K dermatology %K education %K self-study %K NVIDIA RTX %K retrieval-augmented generation %K RAG %D 2024 %7 24.7.2024 %9 Editorial %J JMIR Dermatol %G English %X This paper demonstrates a new, promising method using generative artificial intelligence (AI) to augment the educational value of electronic textbooks and research papers (locally stored on user’s machine) and maximize their potential for self-study, in a way that goes beyond the standard electronic search and indexing that is already available in all of these textbooks and files. The presented method runs fully locally on the user’s machine, is generally affordable, and does not require high technical expertise to set up and customize with the user’s own content. %M 39047285 %R 10.2196/58396 %U https://derma.jmir.org/2024/1/e58396 %U https://doi.org/10.2196/58396 %U http://www.ncbi.nlm.nih.gov/pubmed/39047285 %0 Journal Article %@ 2369-3762 %I %V 10 %N %P e47438 %T Development of a Novel Web-Based Tool to Enhance Clinical Skills in Medical Education %A Aqib,Ayma %A Fareez,Faiha %A Assadpour,Elnaz %A Babar,Tubba %A Kokavec,Andrew %A Wang,Edward %A Lo,Thomas %A Lam,Jean-Paul %A Smith,Christopher %K medical education %K objective structured clinical examination %K OSCE %K e-OSCE %K Medical Council of Canada %K MCC %K virtual health %K exam %K examination %K utility %K usability %K online learning %K e-learning %K medical student %K medical students %K clinical practice %K clinical skills %K clinical skill %K OSCE tool %D 2024 %7 20.6.2024 %9 %J JMIR Med Educ %G English %X A significant component of Canadian medical education is the development of clinical skills. The medical educational curriculum assesses these skills through an objective structured clinical examination (OSCE). This OSCE assesses skills imperative to good clinical practice, such as patient communication, clinical decision-making, and medical knowledge. Despite the widespread implementation of this examination across all academic settings, few preparatory resources exist that cater specifically to Canadian medical students. MonkeyJacket is a novel, open-access, web-based application, built with the goal of providing medical students with an accessible and representative tool for clinical skill development for the OSCE and clinical settings. This viewpoint paper presents the development of the MonkeyJacket application and its potential to assist medical students in preparation for clinical examinations and practical settings. Limited resources exist that are web-based; accessible in terms of cost; specific to the Medical Council of Canada (MCC); and, most importantly, scalable in nature. The goal of this research study was to thoroughly describe the potential utility of the application, particularly its capacity to provide practice and scalable formative feedback to medical students. MonkeyJacket was developed to provide Canadian medical students with the opportunity to practice their clinical examination skills and receive peer feedback by using a centralized platform. The OSCE cases included in the application were developed by using the MCC guidelines to ensure their applicability to a Canadian setting. There are currently 75 cases covering 5 specialties, including cardiology, respirology, gastroenterology, neurology, and psychiatry. The MonkeyJacket application is a web-based platform that allows medical students to practice clinical decision-making skills in real time with their peers through a synchronous platform. Through this application, students can practice patient interviewing, clinical reasoning, developing differential diagnoses, and formulating a management plan, and they can receive both qualitative feedback and quantitative feedback. Each clinical case is associated with an assessment checklist that is accessible to students after practice sessions are complete; the checklist promotes personal improvement through peer feedback. This tool provides students with relevant case stems, follow-up questions that probe for differential diagnoses and management plans, assessment checklists, and the ability to review the trend in their performance. The MonkeyJacket application provides medical students with a valuable tool that promotes clinical skill development for OSCEs and clinical settings. MonkeyJacket introduces a way for medical learners to receive feedback regarding patient interviewing and clinical reasoning skills that is both formative and scalable in nature, in addition to promoting interinstitutional learning. The widespread use of this application can increase the practice of and feedback on clinical skills among medical learners. This will not only benefit the learner; more importantly, it can provide downstream benefits for the most valuable stakeholder in medicine—the patient. %R 10.2196/47438 %U https://mededu.jmir.org/2024/1/e47438 %U https://doi.org/10.2196/47438 %0 Journal Article %@ 2369-3762 %I %V 10 %N %P e54283 %T The Performance of ChatGPT-4V in Interpreting Images and Tables in the Japanese Medical Licensing Exam %A Takagi,Soshi %A Koda,Masahide %A Watari,Takashi %K ChatGPT %K medical licensing examination %K generative artificial intelligence %K medical education %K large language model %K images %K tables %K artificial intelligence %K AI %K Japanese %K reliability %K medical application %K medical applications %K diagnostic %K diagnostics %K online data %K web-based data %D 2024 %7 23.5.2024 %9 %J JMIR Med Educ %G English %X %R 10.2196/54283 %U https://mededu.jmir.org/2024/1/e54283 %U https://doi.org/10.2196/54283 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 26 %N %P e54758 %T Utility of Large Language Models for Health Care Professionals and Patients in Navigating Hematopoietic Stem Cell Transplantation: Comparison of the Performance of ChatGPT-3.5, ChatGPT-4, and Bard %A Xue,Elisabetta %A Bracken-Clarke,Dara %A Iannantuono,Giovanni Maria %A Choo-Wosoba,Hyoyoung %A Gulley,James L %A Floudas,Charalampos S %+ Center for Immuno-Oncology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, 9000 Rockville Pike, Building 10, B2L312, Bethesda, MD, 20892, United States, 1 2403518904, elisabetta.xue@nih.gov %K hematopoietic stem cell transplant %K large language models %K chatbot %K chatbots %K stem cell %K large language model %K artificial intelligence %K AI %K medical information %K hematopoietic %K HSCT %K ChatGPT %D 2024 %7 17.5.2024 %9 Original Paper %J J Med Internet Res %G English %X Background: Artificial intelligence is increasingly being applied to many workflows. Large language models (LLMs) are publicly accessible platforms trained to understand, interact with, and produce human-readable text; their ability to deliver relevant and reliable information is also of particular interest for the health care providers and the patients. Hematopoietic stem cell transplantation (HSCT) is a complex medical field requiring extensive knowledge, background, and training to practice successfully and can be challenging for the nonspecialist audience to comprehend. Objective: We aimed to test the applicability of 3 prominent LLMs, namely ChatGPT-3.5 (OpenAI), ChatGPT-4 (OpenAI), and Bard (Google AI), in guiding nonspecialist health care professionals and advising patients seeking information regarding HSCT. Methods: We submitted 72 open-ended HSCT–related questions of variable difficulty to the LLMs and rated their responses based on consistency—defined as replicability of the response—response veracity, language comprehensibility, specificity to the topic, and the presence of hallucinations. We then rechallenged the 2 best performing chatbots by resubmitting the most difficult questions and prompting to respond as if communicating with either a health care professional or a patient and to provide verifiable sources of information. Responses were then rerated with the additional criterion of language appropriateness, defined as language adaptation for the intended audience. Results: ChatGPT-4 outperformed both ChatGPT-3.5 and Bard in terms of response consistency (66/72, 92%; 54/72, 75%; and 63/69, 91%, respectively; P=.007), response veracity (58/66, 88%; 40/54, 74%; and 16/63, 25%, respectively; P<.001), and specificity to the topic (60/66, 91%; 43/54, 80%; and 27/63, 43%, respectively; P<.001). Both ChatGPT-4 and ChatGPT-3.5 outperformed Bard in terms of language comprehensibility (64/66, 97%; 53/54, 98%; and 52/63, 83%, respectively; P=.002). All displayed episodes of hallucinations. ChatGPT-3.5 and ChatGPT-4 were then rechallenged with a prompt to adapt their language to the audience and to provide source of information, and responses were rated. ChatGPT-3.5 showed better ability to adapt its language to nonmedical audience than ChatGPT-4 (17/21, 81% and 10/22, 46%, respectively; P=.03); however, both failed to consistently provide correct and up-to-date information resources, reporting either out-of-date materials, incorrect URLs, or unfocused references, making their output not verifiable by the reader. Conclusions: In conclusion, despite LLMs’ potential capability in confronting challenging medical topics such as HSCT, the presence of mistakes and lack of clear references make them not yet appropriate for routine, unsupervised clinical use, or patient counseling. Implementation of LLMs’ ability to access and to reference current and updated websites and research papers, as well as development of LLMs trained in specialized domain knowledge data sets, may offer potential solutions for their future clinical application. %M 38758582 %R 10.2196/54758 %U https://www.jmir.org/2024/1/e54758 %U https://doi.org/10.2196/54758 %U http://www.ncbi.nlm.nih.gov/pubmed/38758582 %0 Journal Article %@ 2369-3762 %I %V 10 %N %P e53997 %T Digital Health Education for the Future: The SaNuRN (Santé Numérique Rouen-Nice) Consortium’s Journey %A Grosjean,Julien %A Dufour,Frank %A Benis,Arriel %A Januel,Jean-Marie %A Staccini,Pascal %A Darmoni,Stéfan Jacques %K digital health %K medical informatics %K education %K health education %K curriculum %K students %K teaching materials %K hybrid learning %K program development %K capacity building %K access to information %K e-learning %K open access %K open data %K skills framework %K competency-based learning %K telemedicine training %K medical simulation %K objective structured clinical examination %K OSCE %K script concordance test %K SCT %K virtual patient %D 2024 %7 30.4.2024 %9 %J JMIR Med Educ %G English %X Santé Numérique Rouen-Nice (SaNuRN; “Digital Health Rouen-Nice” in English) is a 5-year project by the University of Rouen Normandy (URN) and Côte d’Azur University (CAU) consortium to optimize digital health education for medical and paramedical students, professionals, and administrators. The project includes a skills framework, training modules, and teaching resources. In 2027, SaNuRN is expected to train a significant portion of the 400,000 health and paramedical students at the French national level. Our purpose is to give a synopsis of the SaNuRN initiative, emphasizing its novel educational methods and how they will enhance the delivery of digital health education. Our goals include showcasing SaNuRN as a comprehensive program consisting of a proficiency framework, instructional modules, and educational materials and explaining how SaNuRN is implemented in the participating academic institutions. SaNuRN is aimed at educating and training health and paramedical students in digital health. The project is a cooperative effort between URN and CAU, covering 4 French departments. It is based on the French National Referential on Digital Health (FNRDH), which defines the skills and competencies to be acquired and validated by every student in the health, paramedical, and social professions curricula. The SaNuRN team is currently adapting the existing URN and CAU syllabi to FNRDH and developing short-duration video capsules of 20-30 minutes to teach all the relevant material. The project aims to ensure that the largest student population earns the necessary skills, and it has developed a 2-tier system involving facilitators who will enable the efficient expansion of the project’s educational outreach and support the students in learning the needed material efficiently. With a focus on real-world scenarios and innovative teaching activities integrating telemedicine devices and virtual professionals, SaNuRN is committed to enabling continuous learning for health care professionals in clinical practice. The SaNuRN team introduced new ways of evaluating health care professionals by shifting from a knowledge-based to a competencies-based evaluation, aligning with the Miller teaching pyramid and using the Objective Structured Clinical Examination and Script Concordance Test in digital health education. Drawing on the expertise of URN, CAU, and their public health and digital research laboratories and partners, SaNuRN represents a platform for continuous innovation, including telemedicine training and living labs with virtual and interactive professional activities. SaNuRN provides a comprehensive, personalized, 30-hour training package for health and paramedical students, addressing all 70 FNRDH competencies. The project is enhanced using artificial intelligence and natural language processing to create virtual patients and professionals for digital health care simulation. SaNuRN teaching materials are open access. It collaborates with academic institutions worldwide to develop educational material on digital health in English and multilingual formats. SaNuRN offers a practical and persuasive training approach to meet the current digital health education requirements. %R 10.2196/53997 %U https://mededu.jmir.org/2024/1/e53997 %U https://doi.org/10.2196/53997 %0 Journal Article %@ 2818-3045 %I JMIR Publications %V 1 %N %P e55678 %T Immediate Impact of an 8-Week Virtual Reality Educational Program on Burnout and Work Engagement Among Health Care Professionals: Pre-Post Pilot Study %A Ferrer Costa,Jose %A Moran,Nuria %A Garcia Marti,Carlos %A Colmenares Hernandez,Leomar Javier %A Radu Ciorba Ciorba,Florin %A Ciudad,Maria Jose %+ Innovation and Projects Department, Badalona Serveis Assistencials, Pl Pau Casals 1, Badalona, 08911, Spain, 34 937407482, jferrer10@gmail.com %K virtual reality %K burnout %K mindfulness %K health care professionals %K mental health %K health promotion %K educational intervention %D 2024 %7 25.4.2024 %9 Original Paper %J JMIR XR Spatial Comput %G English %X Background: Health care professionals globally face increasing levels of burnout characterized by emotional exhaustion, depersonalization, and a reduced sense of accomplishment, and it has been notably exacerbated during the COVID-19 pandemic. This condition not only impacts the well-being of health care workers but also affects patient care and contributes to significant economic burden. Traditional approaches to mitigating burnout have included various psychosocial interventions, with mindfulness being recognized for its effectiveness in enhancing mental health and stress management. The emergence of virtual reality (VR) technology offers a novel immersive platform for delivering mindfulness and emotional management training. Objective: This study aimed to evaluate the immediate impact of an 8-week VR educational program on burnout and work engagement among health care professionals. Methods: This nonrandomized pre-post intervention study enrolled 90 health care professionals, including nurses, physicians, and allied health staff, from 3 different centers. Of these 90 professionals, 83 (92%) completed the program. The intervention consisted of 8 weekly VR sessions of 10-13 minutes each, using Meta Quest 2 headsets. The sessions focused on mindfulness and emotional management. The Maslach Burnout Inventory (MBI) and Utrecht Work Engagement Scale (UWES) were used for assessments. Data analysis involved inferential statistical techniques for evaluating the impact on the scales, including paired t tests for normally distributed variables and Wilcoxon signed rank tests for nonnormally distributed variables. The significance of changes was indicated by P values <.05, with effect sizes measured using Cohen d for t tests and Cohen r for Wilcoxon tests for quantifying the magnitude of the intervention’s effect. Results: The statistical analysis revealed significant improvements in the MBI and UWES indices after the intervention (P<.05). Specifically, the MBI showed reductions in emotional exhaustion (t82=5.58; P<.001; Cohen d=0.61) and depersonalization (t82=4.67; P<.001; Cohen d=0.51), and an increase in personal accomplishment (t82=−3.62; P<.001; Cohen d=0.4). The UWES revealed enhancements in vigor (t82=−3.77; P<.001; Cohen d=0.41), dedication (Z=−3.63; P<.001; Cohen r=0.41), and absorption (Z=−3.52; P<.001; Cohen r=0.4). Conclusions: The study provides initial data supporting the effectiveness of VR-based educational programs for reducing burnout and enhancing work engagement among health care professionals. While limitations, such as the absence of a control group, are acknowledged, the significant improvements in burnout and engagement indices coupled with high participant adherence and minimal VR discomfort underline the potential of VR interventions in health care settings. These encouraging findings pave the way for more comprehensive studies, including randomized controlled trials, to further validate and expand upon these results. %R 10.2196/55678 %U https://xr.jmir.org/2024/1/e55678 %U https://doi.org/10.2196/55678 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e52483 %T Embracing ChatGPT for Medical Education: Exploring Its Impact on Doctors and Medical Students %A Wu,Yijun %A Zheng,Yue %A Feng,Baijie %A Yang,Yuqi %A Kang,Kai %A Zhao,Ailin %+ Department of Hematology, West China Hospital, Sichuan University, 37 Guoxue Street, Chengdu, China, 86 17888841669, irenez20@outlook.com %K artificial intelligence %K AI %K ChatGPT %K medical education %K doctors %K medical students %D 2024 %7 10.4.2024 %9 Viewpoint %J JMIR Med Educ %G English %X ChatGPT (OpenAI), a cutting-edge natural language processing model, holds immense promise for revolutionizing medical education. With its remarkable performance in language-related tasks, ChatGPT offers personalized and efficient learning experiences for medical students and doctors. Through training, it enhances clinical reasoning and decision-making skills, leading to improved case analysis and diagnosis. The model facilitates simulated dialogues, intelligent tutoring, and automated question-answering, enabling the practical application of medical knowledge. However, integrating ChatGPT into medical education raises ethical and legal concerns. Safeguarding patient data and adhering to data protection regulations are critical. Transparent communication with students, physicians, and patients is essential to ensure their understanding of the technology’s purpose and implications, as well as the potential risks and benefits. Maintaining a balance between personalized learning and face-to-face interactions is crucial to avoid hindering critical thinking and communication skills. Despite challenges, ChatGPT offers transformative opportunities. Integrating it with problem-based learning, team-based learning, and case-based learning methodologies can further enhance medical education. With proper regulation and supervision, ChatGPT can contribute to a well-rounded learning environment, nurturing skilled and knowledgeable medical professionals ready to tackle health care challenges. By emphasizing ethical considerations and human-centric approaches, ChatGPT’s potential can be fully harnessed in medical education, benefiting both students and patients alike. %M 38598263 %R 10.2196/52483 %U https://mededu.jmir.org/2024/1/e52483 %U https://doi.org/10.2196/52483 %U http://www.ncbi.nlm.nih.gov/pubmed/38598263 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 10 %N %P e50965 %T Comparison of the Performance of GPT-3.5 and GPT-4 With That of Medical Students on the Written German Medical Licensing Examination: Observational Study %A Meyer,Annika %A Riese,Janik %A Streichert,Thomas %+ Institute for Clinical Chemistry, University Hospital Cologne, Kerpener Str 62, Cologne, 50937, Germany, annika.meyer1@uk-koeln.de %K ChatGPT %K artificial intelligence %K large language model %K medical exams %K medical examinations %K medical education %K LLM %K public trust %K trust %K medical accuracy %K licensing exam %K licensing examination %K improvement %K patient care %K general population %K licensure examination %D 2024 %7 8.2.2024 %9 Original Paper %J JMIR Med Educ %G English %X Background: The potential of artificial intelligence (AI)–based large language models, such as ChatGPT, has gained significant attention in the medical field. This enthusiasm is driven not only by recent breakthroughs and improved accessibility, but also by the prospect of democratizing medical knowledge and promoting equitable health care. However, the performance of ChatGPT is substantially influenced by the input language, and given the growing public trust in this AI tool compared to that in traditional sources of information, investigating its medical accuracy across different languages is of particular importance. Objective: This study aimed to compare the performance of GPT-3.5 and GPT-4 with that of medical students on the written German medical licensing examination. Methods: To assess GPT-3.5’s and GPT-4's medical proficiency, we used 937 original multiple-choice questions from 3 written German medical licensing examinations in October 2021, April 2022, and October 2022. Results: GPT-4 achieved an average score of 85% and ranked in the 92.8th, 99.5th, and 92.6th percentiles among medical students who took the same examinations in October 2021, April 2022, and October 2022, respectively. This represents a substantial improvement of 27% compared to GPT-3.5, which only passed 1 out of the 3 examinations. While GPT-3.5 performed well in psychiatry questions, GPT-4 exhibited strengths in internal medicine and surgery but showed weakness in academic research. Conclusions: The study results highlight ChatGPT’s remarkable improvement from moderate (GPT-3.5) to high competency (GPT-4) in answering medical licensing examination questions in German. While GPT-4’s predecessor (GPT-3.5) was imprecise and inconsistent, it demonstrates considerable potential to improve medical education and patient care, provided that medically trained users critically evaluate its results. As the replacement of search engines by AI tools seems possible in the future, further studies with nonprofessional questions are needed to assess the safety and accuracy of ChatGPT for the general population. %M 38329802 %R 10.2196/50965 %U https://mededu.jmir.org/2024/1/e50965 %U https://doi.org/10.2196/50965 %U http://www.ncbi.nlm.nih.gov/pubmed/38329802 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 13 %N %P e50735 %T Evaluating the Appropriateness of Podcasts to Improve the Knowledge and Awareness of Selected Health Topics Among Undergraduate General Nursing Students: Protocol for an International Feasibility Study %A Denny,Alanna %A Curtin,Brian %A Taylor-Robinson,Simon %A Chirambo,Griphin Baxter %A Cilliers,Liezel %A Wu,Tsung-Shu Joseph %A O'Meara,Ciara %A Booth,Richard %A O'Donoghue,John %+ Imperial College London, Electrical Engineering, South Kensington Campus, London, SW7 2AZ, United Kingdom, 44 203 312 6199, s.taylor-robinson@imperial.ac.uk %K podcasting %K podcast %K nursing student %K gestational diabetes %K mental health %K health %K knowledge %D 2024 %7 6.2.2024 %9 Protocol %J JMIR Res Protoc %G English %X Background: Podcasts have proven to be a successful alternative source of educational material for students. Given the ability to listen to podcasts 24/7 and while on the go, this technology has the potential to provide informative and educational material to a large number of people at any given time. Podcasts are usually freely available on commonly used mobile devices, such as smartphones, laptops, and tablets. Objective: This paper describes the impact of health-related podcasts as an intervention tool to support the knowledge and awareness of nursing students on a given topic. Methods: Pre- and postpodcast questionnaires will gather data regarding the participants’ knowledge and awareness of two topics—gestational diabetes and mental health. This intervention will be tested on general nursing undergraduate students. The total number of students (N=2395) from the participating universities are broken down as follows: (1) University College Cork (n=850) and the University of Galway (n=450) in Ireland, (2) Mzuzu University in Malawi (n=719), and (3) University of Fort Hare in South Africa (n=376). Results: The study received ethical approval from the University College Cork Ethics Committee (2022-027A1). The approval obtained from University College Cork sufficed as ethics coverage for the University of Galway in Ireland. Ethics approval was also received from the Mzuzu University Research Ethics Committee (ID MZUNIREC/DOR/23/28) and the Inter-Faculty Research Ethics Committee of the University of Fort Hare (ID CIL002-21). Data collection is currently underway and will continue until the end of February 2024. The quantitative and qualitative data are expected to be analyzed in March 2024. Conclusions: Results from this study will allow for an investigation into the impact of podcasts in different settings: a high-income country (Ireland), an upper-middle–income country (South Africa), and a low-to-middle–income country (Malawi). The data gathered from this feasibility study will provide more clarity on the potential utility of podcasts as an intervention tool. We will gather data regarding listener demographics (eg, country of residence, age, gender, and year of study). International Registered Report Identifier (IRRID): DERR1-10.2196/50735 %M 38319702 %R 10.2196/50735 %U https://www.researchprotocols.org/2024/1/e50735 %U https://doi.org/10.2196/50735 %U http://www.ncbi.nlm.nih.gov/pubmed/38319702 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e48785 %T Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review %A Preiksaitis,Carl %A Rose,Christian %+ Department of Emergency Medicine, Stanford University School of Medicine, 900 Welch Road, Suite 350, Palo Alto, CA, 94304, United States, 1 650 723 6576, cpreiksaitis@stanford.edu %K medical education %K artificial intelligence %K ChatGPT %K Bard %K AI %K educator %K scoping %K review %K learner %K generative %D 2023 %7 20.10.2023 %9 Original Paper %J JMIR Med Educ %G English %X Background: Generative artificial intelligence (AI) technologies are increasingly being utilized across various fields, with considerable interest and concern regarding their potential application in medical education. These technologies, such as Chat GPT and Bard, can generate new content and have a wide range of possible applications. Objective: This study aimed to synthesize the potential opportunities and limitations of generative AI in medical education. It sought to identify prevalent themes within recent literature regarding potential applications and challenges of generative AI in medical education and use these to guide future areas for exploration. Methods: We conducted a scoping review, following the framework by Arksey and O'Malley, of English language articles published from 2022 onward that discussed generative AI in the context of medical education. A literature search was performed using PubMed, Web of Science, and Google Scholar databases. We screened articles for inclusion, extracted data from relevant studies, and completed a quantitative and qualitative synthesis of the data. Results: Thematic analysis revealed diverse potential applications for generative AI in medical education, including self-directed learning, simulation scenarios, and writing assistance. However, the literature also highlighted significant challenges, such as issues with academic integrity, data accuracy, and potential detriments to learning. Based on these themes and the current state of the literature, we propose the following 3 key areas for investigation: developing learners’ skills to evaluate AI critically, rethinking assessment methodology, and studying human-AI interactions. Conclusions: The integration of generative AI in medical education presents exciting opportunities, alongside considerable challenges. There is a need to develop new skills and competencies related to AI as well as thoughtful, nuanced approaches to examine the growing use of generative AI in medical education. %R 10.2196/48785 %U https://mededu.jmir.org/2023/1/e48785/ %U https://doi.org/10.2196/48785 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 12 %N %P e48672 %T Evaluation of Incremental Validity of Casper in Predicting Program and National Licensure Performance of Undergraduate Nursing Students: Protocol for a Mixed Methods Study %A Stevens,Kathleen %A Moralejo,Donna %A Crossman,Renee %+ Faculty of Nursing, Memorial University, 300 Prince Phillip Drive, St John's, NL, A1B 3V6, Canada, 1 7098647100, kathleen.stevens@mun.ca %K communication %K empathy %K incremental validity %K mixed methods %K nursing school admissions %K problem-solving %K professionalism %K situational judgement testing %K undergraduate nursing students %D 2023 %7 18.10.2023 %9 Protocol %J JMIR Res Protoc %G English %X Background: Academic success has been the primary criterion for admission to many nursing programs. However, academic success as an admission criterion may have limited predictive value for success in noncognitive skills. Adding situational judgment tests, such as Casper, to admissions procedures may be one strategy to strengthen decisions and address the limited predictive value of academic admission criteria. In 2021, admissions processes were modified to include Casper based on concerns identified with noncognitive skills. Objective: This study aims to (1) assess the incremental validity of Casper scores in predicting nursing student performance at years 1, 2, 3, and 4 and on the National Council Licensing Examination (NCLEX) performance; and (2) examine faculty members’ perceptions of student performance and influences related to communication, professionalism, empathy, and problem-solving. Methods: We will use a multistage evaluation mixed methods design with 5 phases. At the end of each year, students will complete questionnaires related to empathy and professionalism and have their performance assessed for communication and problem-solving in psychomotor laboratory sessions. The final phase will assess graduate performance on the NCLEX. Each phase also includes qualitative data collection (ie, focus groups with faculty members). The goal of the focus groups is to help explain the quantitative findings (explanatory phase) as well as inform data collection (eg, focus group questions) in the subsequent phase (exploratory sequence). All students enrolled in the first year of the nursing program in 2021 were asked to participate (n=290). Faculty will be asked to participate in the focus groups at the end of each year of the program. Hierarchical multiple regression will be conducted for each outcome of interest (eg, communication, professionalism, empathy, and problem-solving) to determine the extent to which scores on Casper with admission grades, compared to admission grades alone, predict nursing student performance at years 1-4 of the program and success on the national exam. Thematic analysis of focus group transcripts will be conducted using interpretive description. The quantitative and qualitative data will be integrated after each phase is complete and at the end of the study. Results: This study was funded in September 2021, and data collection began in March 2022. Year 1 data collection and analysis are complete. Year 2 data collection is complete, and data analysis is in progress. Conclusions: At the end of the study, we will provide the results of a comprehensive analysis to determine the extent to which the addition of scores on Casper compared to admission grades alone predicts nursing student performance at years 1-4 of the program and on the NCLEX exam. International Registered Report Identifier (IRRID): RR1-10.2196/48672 %M 37851504 %R 10.2196/48672 %U https://www.researchprotocols.org/2023/1/e48672 %U https://doi.org/10.2196/48672 %U http://www.ncbi.nlm.nih.gov/pubmed/37851504 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e43895 %T Coagulation Management of Critically Bleeding Patients With Viscoelastic Testing Presented as a 3D-Animated Blood Clot (The Visual Clot): Randomized Controlled High-Fidelity Simulation Study %A Castellucci,Clara %A Malorgio,Amos %A Budowski,Alexandra Dinah %A Akbas,Samira %A Kolbe,Michaela %A Grande,Bastian %A Braun,Julia %A Noethiger,Christoph B %A Spahn,Donat R %A Tscholl,David Werner %A Roche,Tadzio Raoul %+ Institute of Anaesthesiology, University Hospital Zurich, University of Zurich, Raemistrasse 100, Zurich, 8091, Switzerland, 41 0432530255, tadzioraoul.roche@usz.ch %K avatar technology %K coagulation management %K high-fidelity simulation %K point-of-care testing %K thrombelastography %K user-centered design %K Visual Clot %D 2023 %7 12.10.2023 %9 Original Paper %J J Med Internet Res %G English %X Background: Guidelines recommend using viscoelastic coagulation tests to guide coagulation management, but interpreting the results remains challenging. Visual Clot, a 3D animated blood clot, facilitates interpretation through a user-centered and situation awareness–oriented design. Objective: This study aims to compare the effects of Visual Clot versus conventional viscoelastic test results (rotational thrombelastometry [ROTEM] temograms) on the coagulation management performance of anesthesia teams in critical bleeding situations. Methods: We conducted a prospective, randomized, high-fidelity simulation study in which anesthesia teams (consisting of a senior anesthesiologist, a resident anesthesiologist, and an anesthesia nurse) managed perioperative bleeding scenarios. Teams had either Visual Clot or ROTEM temograms available to perform targeted coagulation management. We analyzed the 15-minute simulations with post hoc video analysis. The primary outcome was correct targeted coagulation therapy. Secondary outcomes were time to targeted coagulation therapy, confidence, and workload. In addition, we have conducted a qualitative survey on user acceptance of Visual Clot. We used Poisson regression, Cox regression, and mixed logistic regression models, adjusted for various potential confounders, to analyze the data. Results: We analyzed 59 simulations. Teams using Visual Clot were more likely to deliver the overall targeted coagulation therapy correctly (rate ratio 1.56, 95% CI 1.00-2.47; P=.05) and administer the first targeted coagulation product faster (hazard ratio 2.58, 95% CI 1.37-4.85; P=.003). In addition, participants showed higher decision confidence with Visual Clot (odds ratio 3.60, 95% CI 1.49-8.71; P=.005). We found no difference in workload (coefficient –0.03, 95% CI –3.08 to 2.88; P=.99). Conclusions: Using Visual Clot led to a more accurate and faster-targeted coagulation therapy than using ROTEM temograms. We suggest that relevant viscoelastic test manufacturers consider augmenting their complex result presentation with intuitive, easy-to-understand visualization to ease users’ burden from unnecessary cognitive load and enhance patient care. %M 37824182 %R 10.2196/43895 %U https://www.jmir.org/2023/1/e43895 %U https://doi.org/10.2196/43895 %U http://www.ncbi.nlm.nih.gov/pubmed/37824182 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e52509 %T System-Wide Change Is Essential to Value the Contributions of Women in Medicine and Science %A Jain,Shikha %A Allan,Jessica M %A Bhayani,Rakhee K %+ Department of Medicine, University of Illinois at Chicago, 1740 W Taylor St, Chicago, IL, 60612, United States, 1 773 960 2567, sjain03@gmail.com %K women %K women physicians %K women scientists %K gender equity %K health care %K diversity %K leadership %K intersectionality %K minority tax %K gratitude tax %K glass ceiling %K glass cliff %K academia %K academic medicine %K hierarchy %K change %D 2023 %7 22.9.2023 %9 Editorial %J J Med Internet Res %G English %X The persistent and pervasive gender gap in health care is a fact backed by data, science, and evidence. This editorial aims to describe some of the challenges that continue to persist. Many of the strategies outlined can be implemented both locally and nationally to effect meaningful change and work toward closing the existing gender gap in health care. %M 37738082 %R 10.2196/52509 %U https://www.jmir.org/2023/1/e52509 %U https://doi.org/10.2196/52509 %U http://www.ncbi.nlm.nih.gov/pubmed/37738082 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e51494 %T Can AI Mitigate Bias in Writing Letters of Recommendation? %A Leung,Tiffany I %A Sagar,Ankita %A Shroff,Swati %A Henry,Tracey L %+ JMIR Publications, 130 Queens Quay East, Unit 1100, Toronto, ON, M5A 0P6, Canada, 1 416 583 2040, tiffany.leung@jmir.org %K sponsorship %K implicit bias %K gender bias %K bias %K letters of recommendation %K artificial intelligence %K large language models %K medical education %K career advancement %K tenure and promotion %K promotion %K leadership %D 2023 %7 23.8.2023 %9 Editorial %J JMIR Med Educ %G English %X Letters of recommendation play a significant role in higher education and career progression, particularly for women and underrepresented groups in medicine and science. Already, there is evidence to suggest that written letters of recommendation contain language that expresses implicit biases, or unconscious biases, and that these biases occur for all recommenders regardless of the recommender’s sex. Given that all individuals have implicit biases that may influence language use, there may be opportunities to apply contemporary technologies, such as large language models or other forms of generative artificial intelligence (AI), to augment and potentially reduce implicit biases in the written language of letters of recommendation. In this editorial, we provide a brief overview of existing literature on the manifestations of implicit bias in letters of recommendation, with a focus on academia and medical education. We then highlight potential opportunities and drawbacks of applying this emerging technology in augmenting the focused, professional task of writing letters of recommendation. We also offer best practices for integrating their use into the routine writing of letters of recommendation and conclude with our outlook for the future of generative AI applications in supporting this task. %M 37610808 %R 10.2196/51494 %U https://mededu.jmir.org/2023/1/e51494 %U https://doi.org/10.2196/51494 %U http://www.ncbi.nlm.nih.gov/pubmed/37610808 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e47784 %T The Careers and Professional Well-Being of Women Oncologists During the COVID-19 Pandemic: Responding for Tomorrow %A Majmudar,Shivani %A Graff,Stephanie L %A Kays,Marah %A Braz,Beatriz X %A Matt-Amaral,Laurie %A Markham,Merry J %A Subbiah,Ishwaria M %A Bergsland,Emily %A Jain,Shikha %+ Department of Medicine, University of Illinois at Chicago, 1740 W Taylor St, Chicago, IL, 60612, United States, 1 773 960 2567, sjain03@gmail.com %K oncology %K women %K gender equity %K COVID-19 %K gender inequity %K oncologist %K health care %K women physician %K burnout %K mental health %K well-being %D 2023 %7 21.8.2023 %9 Editorial %J J Med Internet Res %G English %X The COVID-19 pandemic exacerbated gender inequity in medicine, with women physicians reporting greater household responsibilities than their men counterparts and steeper barriers to career advancement. The pandemic highlighted the systemic assumptions and challenges faced by women physicians, which we anticipate is also true in our field of oncology. Prior literature suggests that women physicians were tasked with increased personal and professional responsibilities without compensation for their additional work, as well as derailments in career progression and significant burnout. Our aims are to highlight areas of opportunity to optimize the workplace experience of the oncology workforce and to invest in the professional well-being and sustainability of women oncologists as a step toward global workplace equity and future pandemic preparedness. %M 37603399 %R 10.2196/47784 %U https://www.jmir.org/2023/1/e47784 %U https://doi.org/10.2196/47784 %U http://www.ncbi.nlm.nih.gov/pubmed/37603399 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e44789 %T Exploring the Educational Value of Popular Culture in Web-Based Medical Education: Pre-Post Study on Teaching Jaundice Using “The Simpsons” %A Dalavaye,Nishaanth %A Baskaran,Ravanth %A Mukhopadhyay,Srinjay %A Gamage,Movin Peramuna %A Ng,Vincent %A Sharif,Hama %A Rutherford,Stephen %+ School of Medicine, Imperial College London, Level 2, Faculty Building,, South Kensington Campus, London, SW7 2AZ, United Kingdom, 44 (0)20 7594, nish.dalavaye21@imperial.ac.uk %K educational innovation %K jaundice %K medical education %K popular culture %K web-based teaching %D 2023 %7 17.8.2023 %9 Original Paper %J JMIR Med Educ %G English %X Background: The potential of popular culture as a tool for knowledge delivery and enhancing engagement in education is promising but not extensively studied. Furthermore, concerns exist regarding learning fatigue due to increased reliance on videoconferencing platforms following the COVID-19 pandemic. To ensure effective web-based teaching sessions that maintain attention spans and enhance understanding, innovative solutions are necessary. Objective: This study aims to evaluate the use of specific popular culture case studies to enhance student engagement in a web-based near-peer teaching session. Methods: We delivered a web-based teaching session to undergraduate medical students in the United Kingdom. The session included clinical vignettes and single-best-answer questions using characters from “The Simpsons” television show as patient analogies for various causes of jaundice. A pre-post survey, employing a 7-point Likert scale, was distributed to gather data from participants. Results: A total of 53 survey responses were collected. Participants reported significantly improved understanding of jaundice after the session compared to before the session (median 6, IQR 5-6 vs median 4, IQR 3-4.5; P<.001). The majority of participants agreed that the inclusion of “The Simpsons” characters enhanced their knowledge and made the teaching session more memorable and engaging (memorability: median 6, IQR 5-7; engagement: median 6, IQR 5-7). Conclusions: When appropriately integrated, popular culture can effectively engage students and improve self-perceived knowledge retention. “The Simpsons” characters can be used pedagogically and professionally as patient analogies to deliver teaching on the topic of jaundice. %M 37590059 %R 10.2196/44789 %U https://mededu.jmir.org/2023/1/e44789 %U https://doi.org/10.2196/44789 %U http://www.ncbi.nlm.nih.gov/pubmed/37590059 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e50945 %T The Role of Large Language Models in Medical Education: Applications and Implications %A Safranek,Conrad W %A Sidamon-Eristoff,Anne Elizabeth %A Gilson,Aidan %A Chartash,David %+ Section for Biomedical Informatics and Data Science, Yale University School of Medicine, 9th Fl, 100 College St, New Haven, CT, 06510, United States, 1 317 440 0354, david.chartash@yale.edu %K large language models %K ChatGPT %K medical education %K LLM %K artificial intelligence in health care %K AI %K autoethnography %D 2023 %7 14.8.2023 %9 Editorial %J JMIR Med Educ %G English %X Large language models (LLMs) such as ChatGPT have sparked extensive discourse within the medical education community, spurring both excitement and apprehension. Written from the perspective of medical students, this editorial offers insights gleaned through immersive interactions with ChatGPT, contextualized by ongoing research into the imminent role of LLMs in health care. Three distinct positive use cases for ChatGPT were identified: facilitating differential diagnosis brainstorming, providing interactive practice cases, and aiding in multiple-choice question review. These use cases can effectively help students learn foundational medical knowledge during the preclinical curriculum while reinforcing the learning of core Entrustable Professional Activities. Simultaneously, we highlight key limitations of LLMs in medical education, including their insufficient ability to teach the integration of contextual and external information, comprehend sensory and nonverbal cues, cultivate rapport and interpersonal interaction, and align with overarching medical education and patient care goals. Through interacting with LLMs to augment learning during medical school, students can gain an understanding of their strengths and weaknesses. This understanding will be pivotal as we navigate a health care landscape increasingly intertwined with LLMs and artificial intelligence. %M 37578830 %R 10.2196/50945 %U https://mededu.jmir.org/2023/1/e50945 %U https://doi.org/10.2196/50945 %U http://www.ncbi.nlm.nih.gov/pubmed/37578830 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e47748 %T Artificial Intelligence Versus Human-Controlled Doctor in Virtual Reality Simulation for Sepsis Team Training: Randomized Controlled Study %A Liaw,Sok Ying %A Tan,Jian Zhi %A Bin Rusli,Khairul Dzakirin %A Ratan,Rabindra %A Zhou,Wentao %A Lim,Siriwan %A Lau,Tang Ching %A Seah,Betsy %A Chua,Wei Ling %+ Alice Lee Centre for Nursing Studies, National University of Singapore, Block MD11, Level 2, 10 Medical Drive, Singapore, 117597, Singapore, 65 65167451, nurliaw@nus.edu.sg %K artificial intelligence %K interprofessional education %K interprofessional communication %K sepsis care %K team training %K virtual reality %K simulation %K AI %K health care education %K nursing student %K nursing education %K medical education %D 2023 %7 26.7.2023 %9 Original Paper %J J Med Internet Res %G English %X Background: Interprofessional communication is needed to enhance the early recognition and management of patients with sepsis. Preparing medical and nursing students using virtual reality simulation has been shown to be an effective learning approach for sepsis team training. However, its scalability is constrained by unequal cohort sizes between medical and nursing students. An artificial intelligence (AI) medical team member can be implemented in a virtual reality simulation to engage nursing students in sepsis team training. Objective: This study aimed to evaluate the effectiveness of an AI-powered doctor versus a human-controlled doctor in training nursing students for sepsis care and interprofessional communication. Methods: A randomized controlled trial study was conducted with 64 nursing students who were randomly assigned to undertake sepsis team training with an AI-powered doctor (AI-powered group) or with medical students using virtual reality simulation (human-controlled group). Participants from both groups were tested on their sepsis and communication performance through simulation-based assessments (posttest). Participants’ sepsis knowledge and self-efficacy in interprofessional communication were also evaluated before and after the study interventions. Results: A total of 32 nursing students from each group completed the simulation-based assessment, sepsis and communication knowledge test, and self-efficacy questionnaire. Compared with the baseline scores, both the AI-powered and human-controlled groups demonstrated significant improvements in communication knowledge (P=.001) and self-efficacy in interprofessional communication (P<.001) in posttest scores. For sepsis care knowledge, a significant improvement in sepsis care knowledge from the baseline was observed in the AI-powered group (P<.001) but not in the human-controlled group (P=.16). Although no significant differences were found in sepsis care performance between the groups (AI-powered group: mean 13.63, SD 4.23, vs human-controlled group: mean 12.75, SD 3.85, P=.39), the AI-powered group (mean 9.06, SD 1.78) had statistically significantly higher sepsis posttest knowledge scores (P=.009) than the human-controlled group (mean 7.75, SD 2.08). No significant differences were found in interprofessional communication performance between the 2 groups (AI-powered group: mean 29.34, SD 8.37, vs human-controlled group: mean 27.06, SD 5.69, P=.21). However, the human-controlled group (mean 69.6, SD 14.4) reported a significantly higher level of self-efficacy in interprofessional communication (P=.008) than the AI-powered group (mean 60.1, SD 13.3). Conclusions: Our study suggested that AI-powered doctors are not inferior to human-controlled virtual reality simulations with respect to sepsis care and interprofessional communication performance, which supports the viability of implementing AI-powered doctors to achieve scalability in sepsis team training. Our findings also suggested that future innovations should focus on the sociability of AI-powered doctors to enhance users’ interprofessional communication training. Perhaps in the nearer term, future studies should examine how to best blend AI-powered training with human-controlled virtual reality simulation to optimize clinical performance in sepsis care and interprofessional communication. Trial Registration: ClinicalTrials.gov NCT05953441; https://clinicaltrials.gov/study/NCT05953441 %M 37494112 %R 10.2196/47748 %U https://www.jmir.org/2023/1/e47748 %U https://doi.org/10.2196/47748 %U http://www.ncbi.nlm.nih.gov/pubmed/37494112 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e48392 %T The ChatGPT (Generative Artificial Intelligence) Revolution Has Made Artificial Intelligence Approachable for Medical Professionals %A Mesko,Bertalan %+ The Medical Futurist Institute, Povl Bang-Jensen u 2/B1 4/1, Budapest, 1118, Hungary, 36 703807260, berci@medicalfuturist.com %K artificial intelligence %K digital health %K future %K technology %K ChatGPT %K medical practice %K large language model %K language model %K generative %K conversational agent %K conversation agents %K chatbot %K generated text %K computer generated %K medical education %K continuing education %K professional development %K curriculum %K curricula %D 2023 %7 22.6.2023 %9 Viewpoint %J J Med Internet Res %G English %X In November 2022, OpenAI publicly launched its large language model (LLM), ChatGPT, and reached the milestone of having over 100 million users in only 2 months. LLMs have been shown to be useful in a myriad of health care–related tasks and processes. In this paper, I argue that attention to, public access to, and debate about LLMs have initiated a wave of products and services using generative artificial intelligence (AI), which had previously found it hard to attract physicians. This paper describes what AI tools have become available since the beginning of the ChatGPT revolution and contemplates how it they might change physicians’ perceptions about this breakthrough technology. %M 37347508 %R 10.2196/48392 %U https://www.jmir.org/2023/1/e48392 %U https://doi.org/10.2196/48392 %U http://www.ncbi.nlm.nih.gov/pubmed/37347508 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e47933 %T Five Strategies Leaders in Academic Medicine Can Implement Now to Enhance Gender Equity %A Allan,Jessica M %A Brooks,Amber K %A Crusto,Cindy %A Feld,Lauren D %A Oxentenko,Amy S %A Spector,Nancy D %A Verduzco-Gutierrez,Monica %A Silver,Julie K %+ Department of Physical Medicine and Rehabilitation, Harvard Medical School, 300 First Avenue, Boston, MA, 02129, United States, 1 617 952 5000, julie_silver@hms.harvard.edu %K gender equity %K diversity %K leadership %K academic medicine %K gender %K medicine %K women in medicine %K strategies %K leadership %K equity %D 2023 %7 13.6.2023 %9 Viewpoint %J J Med Internet Res %G English %X Abundant disparities for women in medicine contribute to many women physicians considering leaving medicine. There is a strong financial and ethical case for leaders in academic medicine to focus on strategies to improve retention. This article focuses on five immediate actions that leaders can take to enhance gender equity and improve career satisfaction for all members of the workplace. %M 37310782 %R 10.2196/47933 %U https://www.jmir.org/2023/1/e47933 %U https://doi.org/10.2196/47933 %U http://www.ncbi.nlm.nih.gov/pubmed/37310782 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e47800 %T Flattening Hierarchical Structures to Empower Women Trainee Leaders on Social Media Teams %A Kays,Marah N %A Rupert,Deborah D %A Negris,Olivia %A Thompson,Beatrix %A Clayman,Marla L %A Mordell,Lisa %A Pendergrast,Tricia %A Bloomgarden,Eve %A Bhayani,Rakhee K %A Jain,Shikha %+ Division of Hematology and Oncology, University of Illinois at Chicago, 1740 W Taylor St, Chicago, IL, 60612, United States, 1 312 355 1625, sjain03@gmail.com %K social media %K medical education %K gender equity %K women %K empowerment %K pyramidal hierarchy %K residency %K medical training %K health care %K women empowerment %D 2023 %7 5.6.2023 %9 Editorial %J J Med Internet Res %G English %X We share our experience empowering women trainees and leadership through a flattened hierarchical social media team structure with supporting evidence from measurable outcomes. %M 37276011 %R 10.2196/47800 %U https://www.jmir.org/2023/1/e47800 %U https://doi.org/10.2196/47800 %U http://www.ncbi.nlm.nih.gov/pubmed/37276011 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e46599 %T Trialling a Large Language Model (ChatGPT) in General Practice With the Applied Knowledge Test: Observational Study Demonstrating Opportunities and Limitations in Primary Care %A Thirunavukarasu,Arun James %A Hassan,Refaat %A Mahmood,Shathar %A Sanghera,Rohan %A Barzangi,Kara %A El Mukashfi,Mohanned %A Shah,Sachin %+ University of Cambridge School of Clinical Medicine, Box 111 Cambridge Biomedical Campus, Cambridge, CB2 0SP, United Kingdom, 44 0 1223 336732 ext 3, ajt205@cantab.ac.uk %K ChatGPT %K large language model %K natural language processing %K decision support techniques %K artificial intelligence %K AI %K deep learning %K primary care %K general practice %K family medicine %K chatbot %D 2023 %7 21.4.2023 %9 Original Paper %J JMIR Med Educ %G English %X Background: Large language models exhibiting human-level performance in specialized tasks are emerging; examples include Generative Pretrained Transformer 3.5, which underlies the processing of ChatGPT. Rigorous trials are required to understand the capabilities of emerging technology, so that innovation can be directed to benefit patients and practitioners. Objective: Here, we evaluated the strengths and weaknesses of ChatGPT in primary care using the Membership of the Royal College of General Practitioners Applied Knowledge Test (AKT) as a medium. Methods: AKT questions were sourced from a web-based question bank and 2 AKT practice papers. In total, 674 unique AKT questions were inputted to ChatGPT, with the model’s answers recorded and compared to correct answers provided by the Royal College of General Practitioners. Each question was inputted twice in separate ChatGPT sessions, with answers on repeated trials compared to gauge consistency. Subject difficulty was gauged by referring to examiners’ reports from 2018 to 2022. Novel explanations from ChatGPT—defined as information provided that was not inputted within the question or multiple answer choices—were recorded. Performance was analyzed with respect to subject, difficulty, question source, and novel model outputs to explore ChatGPT’s strengths and weaknesses. Results: Average overall performance of ChatGPT was 60.17%, which is below the mean passing mark in the last 2 years (70.42%). Accuracy differed between sources (P=.04 and .06). ChatGPT’s performance varied with subject category (P=.02 and .02), but variation did not correlate with difficulty (Spearman ρ=–0.241 and –0.238; P=.19 and .20). The proclivity of ChatGPT to provide novel explanations did not affect accuracy (P>.99 and .23). Conclusions: Large language models are approaching human expert–level performance, although further development is required to match the performance of qualified primary care physicians in the AKT. Validated high-performance models may serve as assistants or autonomous clinical tools to ameliorate the general practice workforce crisis. %M 37083633 %R 10.2196/46599 %U https://mededu.jmir.org/2023/1/e46599 %U https://doi.org/10.2196/46599 %U http://www.ncbi.nlm.nih.gov/pubmed/37083633 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 25 %N %P e42340 %T Psychometric Properties of and Measurement Invariance in the Questionnaire of Stereotypes Toward Older Adulthood in Health Care College Students and Health Professionals of Colombia: Psychometric Study %A Martín-Carbonell,Marta %A Espejo,Begoña %A Castro-Melo,Greys Patricia %A Sequeira-Daza,Doris %A Checa,Irene %+ Universitat de València, Av. Blasco Ibáñez, 21, Valencia, 46010, Spain, 34 963864503, bespejo@uv.es %K psychometric properties %K structural equation modeling %K older adulthood %K geriatric %K gerontology %K health care college students %K health care professionals %K questionnaire %K stereotype %K agism %D 2023 %7 9.3.2023 %9 Original Paper %J J Med Internet Res %G English %X Background: In health professionals, negative stereotypes toward older adulthood have been associated with the difficulty in recognizing pathological processes and the refusal to care for older patients because of assuming that communication with them will be uncomfortable and frustrating. For these reasons, research on stereotypes in these groups has acquired growing importance. The usual strategy to identify and evaluate agist stereotypes is to use scales and questionnaires. Although multiple scales are currently used, in Latin America, the Questionnaire for the Evaluation of Negative Stereotypes Toward Older Adulthood (Cuestionario de Estereotipos Negativos sobre la Vejez [CENVE]), developed in Spain, is widely used but without evidence of construct validity in our context. In addition, although in the original version, a factorial structure of 3 factors was found, in later studies, a unifactorial structure was obtained. Objective: The objective is to study the construct validity of the CENVE in a sample of Colombian health personnel to clarify its factorial structure and concurrent validity. Likewise, the measurement invariance according to gender and age was studied. Methods: A nonprobabilistic sample of 877 Colombian health professionals and intern health students was obtained. The data were collected online using the LimeSurvey tool. To study the factor structure of the CENVE, 2 confirmatory factor analysis (CFA) models were carried out, one to test a single factor and the other to test the 3-related-factor structure. The factor measurement reliability was evaluated with the composite reliability index (CRI) and the average variance extracted (AVE). The measurement invariance was studied according to gender (men and women) and age (emerging adults, 18-29 years old, and adults, 30 years old or older). Using a structural equation model, the relationship between age and the latent CENVE total score was studied to obtain evidence of concurrent validity, since studies indicate that the younger the age, the greater the number of stereotypes. Results: The 1-factor structure was confirmed. The reliability results indicated that both indices show adequate values. Likewise, the existence of a strong invariance in measurement by gender and age group was verified. After contrasting the means of the groups, the results showed that men show more negative stereotypes toward old age than women. Likewise, emerging adults also showed more stereotypes than adults. We also verified that age is inversely related to the latent score of the questionnaire, such that the younger the age, the greater the stereotype. These results are in agreement with those obtained by other authors. Conclusions: The CENVE shows good construct and concurrent validity, as well as good reliability, and it can be used to assess stereotypes toward older adulthood in Colombian health professionals and health sciences college students. This will allow us to better understand the effect of stereotypes on agism. %M 36892936 %R 10.2196/42340 %U https://www.jmir.org/2023/1/e42340 %U https://doi.org/10.2196/42340 %U http://www.ncbi.nlm.nih.gov/pubmed/36892936 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 9 %N %P e43916 %T Teaching Principles of Medical Innovation and Entrepreneurship Through Hackathons: Case Study and Qualitative Analysis %A Preiksaitis,Carl %A Dayton,John R %A Kabeer,Rana %A Bunney,Gabrielle %A Boukhman,Milana %+ Department of Emergency Medicine, Stanford University School of Medicine, 900 Welch Road, Suite 350, Palo Alto, CA, 94043, United States, 1 650 723 6576, cpreiksaitis@stanford.edu %K hackathon %K innovation %K entrepreneurship %K medical education %K gamification %K curriculum %K biodesign %K emergency medicine %K health care innovation %K medical innovation %K training %K design %K implementation %K development %K physician %K educational %D 2023 %7 24.2.2023 %9 Original Paper %J JMIR Med Educ %G English %X Background: Innovation and entrepreneurship training are increasingly recognized as being important in medical education. However, the lack of faculty comfort with the instruction of these concepts as well as limited scholarly recognition for this work has limited the implementation of curricula focused on these skills. Furthermore, this lack of familiarity limits the inclusion of practicing physicians in health care innovation, where their experience is valuable. Hackathons are intense innovation competitions that use gamification principles to increase comfort with creative thinking, problem-solving, and interpersonal collaboration, but they require further exploration in medical innovation. Objective: To address this, we aimed to design, implement, and evaluate a health care hackathon with 2 main goals: to improve emergency physician familiarity with the principles of health care innovation and entrepreneurship and to develop innovative solutions to 3 discrete problems facing emergency medicine physicians and patients. Methods: We used previously described practices for conducting hackathons to develop and implement our hackathon (HackED!). We partnered with the American College of Emergency Physicians, the Stanford School of Biodesign, and the Institute of Design at Stanford (d.school) to lend institutional support and expertise in health care innovation to our event. We determined a location, time frame, and logistics for the competition and settled on 3 use cases for teams to work on. We planned to explore the learning experience of participants within a pragmatic paradigm and complete an abductive thematic analysis using data from a variety of sources. Results: HackED! took place from October 1-3, 2022. In all, 3 teams developed novel solutions to each of the use cases. Our investigation into the educational experience of participants suggested that the event was valuable and uncovered themes suggesting that the learning experience could be understood within a framework from entrepreneurship education not previously described in relation to hackathons. Conclusions: Health care hackathons appear to be a viable method of increasing physician experience with innovation and entrepreneurship principles and addressing complex problems in health care. Hackathons should be considered as part of educational programs that focus on these concepts. %M 36826988 %R 10.2196/43916 %U https://mededu.jmir.org/2023/1/e43916 %U https://doi.org/10.2196/43916 %U http://www.ncbi.nlm.nih.gov/pubmed/36826988 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 3 %P e39794 %T Informatics in Undergraduate Medical Education: Analysis of Competency Frameworks and Practices Across North America %A Chartash,David %A Rosenman,Marc %A Wang,Karen %A Chen,Elizabeth %+ Center for Medical Informatics, Yale University School of Medicine, 300 George Street Suite 501, New Haven, CT, 06511, United States, 1 203 737 5325, dchartas@ieee.org %K undergraduate medical education %K medical informatics %K curriculum %K medical education %K education %K North America %K framework %K clinical %K informatics %K Canada %K United States %K US %K teaching %K management %K cognitive %D 2022 %7 13.9.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: With the advent of competency-based medical education, as well as Canadian efforts to include clinical informatics within undergraduate medical education, competency frameworks in the United States have not emphasized the skills associated with clinical informatics pertinent to the broader practice of medicine. Objective: By examining the competency frameworks with which undergraduate medical education in clinical informatics has been developed in Canada and the United States, we hypothesized that there is a gap: the lack of a unified competency set and frame for clinical informatics education across North America. Methods: We performed directional competency mapping between Canadian and American graduate clinical informatics competencies and general graduate medical education competencies. Directional competency mapping was performed between Canadian roles and American common program requirements using keyword matching at the subcompetency and enabling competency levels. In addition, for general graduate medical education competencies, the Physician Competency Reference Set developed for the Liaison Committee on Medical Education was used as a direct means of computing the ontological overlap between competency frameworks. Results: Upon mapping Canadian roles to American competencies via both undergraduate and graduate medical education competency frameworks, the difference in focus between the 2 countries can be thematically described as a difference between the concepts of clinical and management reasoning. Conclusions: We suggest that the development or deployment of informatics competencies in undergraduate medical education should focus on 3 items: the teaching of diagnostic reasoning, such that the information tasks that comprise both clinical and management reasoning can be discussed; precision medical education, where informatics can provide for more fine-grained evaluation; and assessment methods to support traditional pedagogical efforts (both at the bedside and beyond). Assessment using cases or structured assessments (eg, Objective Structured Clinical Examinations) would help students draw parallels between clinical informatics and fundamental clinical subjects and would better emphasize the cognitive techniques taught through informatics. %M 36099007 %R 10.2196/39794 %U https://mededu.jmir.org/2022/3/e39794 %U https://doi.org/10.2196/39794 %U http://www.ncbi.nlm.nih.gov/pubmed/36099007 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 11 %N 6 %P e38126 %T Women Physicians in Transition Learning to Navigate the Pipeline from Early to Mid-Career: Protocol for a Qualitative Study %A Leung,Tiffany I %A Wang,Karen H %A Lin,Tammy L %A Gin,Geneen T %A Pendharkar,Sima S %A Chen,Chwen-Yuen Angie %+ Care and Public Health Research Institute, Maastricht University, Postbus 5800, Maastricht, 6202AZ, Netherlands, 31 43 388 2222, t.leung@maastrichtuniversity.nl %K gender equity %K women physician %K female physicians %K career development %K professional development %K career pipeline %K leaky pipeline %K mid-career physicians %K early-career physicians %K physician %K healthcare profession %K peer support %K physician perspective %K physician experience %K professional learning %K healthcare %K health care %K healthcare education %K career support %K gender equality %K gender bias %K healthcare learning %D 2022 %7 2.6.2022 %9 Protocol %J JMIR Res Protoc %G English %X Background: Women physicians face unique obstacles while progressing through their careers, navigating career advancement and seeking balance between professional and personal responsibilities. Systemic changes, along with individual and institutional changes, are needed to overcome obstacles perpetuating physician gender inequities. Developing a deeper understanding of women physicians’ experiences during important transition points could reveal both barriers and opportunities for recruitment, retention, and promotion, and inform best practices developed based on these experiences. Objective: The aim is to learn from the experiences and perspectives of women physicians as they transition from early to mid-career, then develop best practices that can serve to support women physicians as they advance through their careers. Methods: Semistructured interviews were conducted with women physicians in the United States in 2020 and 2021. Eligibility criteria included self-identification as a woman who is in the process of transitioning or who recently transitioned from early to mid-career stage. Purposeful sampling facilitated identification of participants who represented diversity in career pathway, practice setting, specialty, and race/ethnicity. Each participant was offered compensation for their participation. Interviews were audio-recorded and professionally transcribed. Interview questions were open-ended, exploring participants' perceptions of this transition. Qualitative thematic analysis will be performed. We will use an open coding and grounded theory approach on interview transcripts. Results: The Ethics Review Committee of the Faculty of Health, Medicine, and Life Sciences at Maastricht University approved the study; Stanford University expedited review approved the study; and the University of California, San Diego certified the study as exempt from review. Twelve in-depth interviews of 50-100 minutes in duration were completed. Preliminary analyses indicate one key theme is a tension resulting from finite time divided between demands from a physician career and demands from family needs. In turn, this results in constant boundary control between these life domains that are inextricable and seemingly competing against each other within a finite space; family needs impinge on planned career goals, if the boundary between them is not carefully managed. To remedy this, women sought resources to help them redistribute home responsibilities, freeing themselves to have more time, especially for children. Women similarly sought resources to help with career advancement, although not with regard to time directly, but to first address foundational knowledge gaps about career milestones and how to achieve them. Conclusions: Preliminary results provide initial insights about how women identify or activate a career shift and how they marshaled resources and support to navigate barriers they faced. Further analyses are continuing as of March 2022 and are expected to be completed by June 2022. The dissemination plan includes peer-reviewed open-access journal publication of the results and presentation at the annual meeting of the American Medical Association’s Women Physicians Section. %M 35653172 %R 10.2196/38126 %U https://www.researchprotocols.org/2022/6/e38126 %U https://doi.org/10.2196/38126 %U http://www.ncbi.nlm.nih.gov/pubmed/35653172 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 24 %N 5 %P e38508 %T A Short Intervention and an Interactive e-Learning Module to Motivate Medical and Dental Students to Enlist as First Responders: Implementation Study %A Taramarcaz,Victor %A Herren,Tara %A Golay,Eric %A Regard,Simon %A Martin-Achard,Sébastien %A Mach,Francois %A Schnetzler,Nicolas %A Ricci,Gaëtan %A Zamberg,Ido %A Larribau,Robert %A Niquille,Marc %A Suppan,Mélanie %A Schiffer,Eduardo %A Suppan,Laurent %+ Division of Emergency Medicine, Department of Anesthesiology, Clinical Pharmacology, Intensive Care and Emergency Medicine, University of Geneva Hospitals and Faculty of Medicine, Rue Gabrielle-Perret-Gentil 4, Geneva, 1211, Switzerland, 41 223723311, laurent.suppan@hcuge.ch %K basic life support %K cardiopulmonary resuscitation %K first responder %K undergraduate medical education %K out-of-hospital cardiac arrest %K medical education %K e-learning %K digital education %K medical student %K blended learning %D 2022 %7 18.5.2022 %9 Original Paper %J J Med Internet Res %G English %X Background: Prompt and proficient basic life support (BLS) maneuvers are essential to increasing the odds of survival after out-of-hospital cardiac arrest. However, significant time can elapse before the arrival of professional rescuers. To decrease these delays, many countries have developed first responder networks. These networks are composed of BLS-certified lay or professional rescuers who can be dispatched by emergency medical communication centers to take care of those who experience out-of-hospital cardiac arrest. Many systems are, however, limited by a relatively low number of active first responders, and first-year medical and dental students may represent an almost untapped pool of potential rescuers. On top of providing an enhanced BLS coverage to the population, this could also help medical students be better prepared to their future role as certified health care providers and address societal expectations regarding health care students. Objective: Our objective was to describe the impact of a short motivational intervention followed by a blended BLS course (e-learning and practice session) designed to motivate first-year medical and dental students to enlist as first responders. Methods: A short, web-based, motivational intervention presenting this project took place, and first-year University of Geneva, Faculty of Medicine students were provided with a link to the study platform. Those who agreed to participate were redirected to a demographic questionnaire before registering on the platform. The participants were then asked to answer a second questionnaire designed to determine their baseline knowledge prior to following an interactive e-learning module. Upon completion, a web-based booking form enabling them to register for a 1-hour practice session was displayed. These sessions were held by senior medical students who had been trained and certified as BLS instructors. The participants who attended these practice sessions were asked to answer a postcourse questionnaire before receiving the certificate enabling them to register as first responders. Results: Out of the 529 first-year students registered at University of Geneva, Faculty of Medicine on January 14, 2021, 190 (35.9%) initially agreed to participate. Moreover, 102 (19.3%) attended the practice sessions, and 48 (9.1%) had completed all training and enlisted as first responders on the dedicated platform, Save a Life, at 6 months (July 14, 2021). Postcourse confidence in resuscitation skills was associated with a higher likelihood of registering as first responder (P=.03). No association was found between prior BLS knowledge and the probability of registering to a practice session (P=.59), of obtaining a course completion certificate (P=.29), or of enlisting as first responder (P=.56). Conclusions: This study shows that a motivational intervention associated with a short BLS course can convince medical students to enlist as first responders. Further studies are needed to understand the rather low proportion of medical students finally registering as first responders. International Registered Report Identifier (IRRID): RR2-10.2196/24664 %M 35583927 %R 10.2196/38508 %U https://www.jmir.org/2022/5/e38508 %U https://doi.org/10.2196/38508 %U http://www.ncbi.nlm.nih.gov/pubmed/35583927 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 11 %N 5 %P e36448 %T The Impact of Health Care Funding on Interprofessional Collaboration and Integrated Service Delivery in Primary and Allied Care: Protocol for a Scoping Review %A Archer,Jessica %A Robinson,Luke %A Brown,Ted %+ Department of Occupational Therapy, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Level 4, Building G, 47-49 McMahon's Road, Frankston, 3199, Australia, 61 399044462, jessica.archer@monash.edu %K allied health %K healthcare funding %K interprofessional collaboration %K integrated healthcare %K primary health %K primary care %D 2022 %7 13.5.2022 %9 Protocol %J JMIR Res Protoc %G English %X Background: Improving funding models and implementing policies that facilitate greater interprofessional collaboration and integration at the primary and allied health level could improve the ongoing quality and safety and future sustainability of the wider health care system by reducing inefficiencies and inequalities. Defining these key health care funding–related models, policies, and concepts, identifying research gaps, and systematically mapping the associated literature will inform future research on this topic. Objective: The aim of this scoping review is to provide a descriptive overview of contemporary health care funding models and the key policies involved in the delivery of primary and allied health care. Further, it will investigate the impact these models and policies have on interprofessional collaboration and integrated service delivery at the primary and allied health care levels. Methods: A search of published and grey literature will be conducted using the following databases: the Allied and Complementary Medicine Database, CINAHL, Embase, Emcare, MEDLINE, PsycINFO, Scopus, Open Access Theses and Dissertations, and Web of Science. The search will be limited to resources available in the English language and published since 2011. Following the search, an independent screening of titles and abstracts will be undertaken by 2 independent reviewers, with a third reviewer available to resolve any potential disagreements. Full-text resources will then be assessed against the inclusion criteria following the same process. Extracted data will be presented using a convergent narrative approach, accompanied by tables and figures. Results: Electronic database searches have retrieved 8013 articles. The results of this scoping review are expected in May 2022. Conclusions: The findings from this review will be used to inform future research projects investigating the role of primary health care funding, interprofessional collaboration, and service integration in improving health care access, efficiency, effectiveness, and sustainability. International Registered Report Identifier (IRRID): DERR1-10.2196/36448 %M 35559853 %R 10.2196/36448 %U https://www.researchprotocols.org/2022/5/e36448 %U https://doi.org/10.2196/36448 %U http://www.ncbi.nlm.nih.gov/pubmed/35559853 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 11 %N 5 %P e34990 %T A Scalable Service to Improve Health Care Quality Through Precision Audit and Feedback: Proposal for a Randomized Controlled Trial %A Landis-Lewis,Zach %A Flynn,Allen %A Janda,Allison %A Shah,Nirav %+ Department of Learning Health Sciences, University of Michigan Medical School, 1161J North Ingalls Building, 300 N. Ingalls St, Ann Arbor, MI, 48109-5403, United States, 1 7346151313, zachll@umich.edu %K learning health system %K audit and feedback %K anesthesiology %K knowledge-based system %K human-centered design %D 2022 %7 10.5.2022 %9 Proposal %J JMIR Res Protoc %G English %X Background: Health care delivery organizations lack evidence-based strategies for using quality measurement data to improve performance. Audit and feedback (A&F), the delivery of clinical performance summaries to providers, demonstrates the potential for large effects on clinical practice but is currently implemented as a blunt one size fits most intervention. Each provider in a care setting typically receives a performance summary of identical metrics in a common format despite the growing recognition that precisionizing interventions hold significant promise in improving their impact. A precision approach to A&F prioritizes the display of information in a single metric that, for each recipient, carries the highest value for performance improvement, such as when the metric’s level drops below a peer benchmark or minimum standard for the first time, thereby revealing an actionable performance gap. Furthermore, precision A&F uses an optimal message format (including framing and visual displays) based on what is known about the recipient and the intended gist meaning being communicated to improve message interpretation while reducing the cognitive processing burden. Well-established psychological principles, frameworks, and theories form a feedback intervention knowledge base to achieve precision A&F. From an informatics perspective, precision A&F requires a knowledge-based system that enables mass customization by representing knowledge configurable at the group and individual levels. Objective: This study aims to implement and evaluate a demonstration system for precision A&F in anesthesia care and to assess the effect of precision feedback emails on care quality and outcomes in a national quality improvement consortium. Methods: We propose to achieve our aims by conducting 3 studies: a requirements analysis and preferences elicitation study using human-centered design and conjoint analysis methods, a software service development and implementation study, and a cluster randomized controlled trial of a precision A&F service with a concurrent process evaluation. This study will be conducted with the Multicenter Perioperative Outcomes Group, a national anesthesia quality improvement consortium with >60 member hospitals in >20 US states. This study will extend the Multicenter Perioperative Outcomes Group quality improvement infrastructure by using existing data and performance measurement processes. Results: The proposal was funded in September 2021 with a 4-year timeline. Data collection for Aim 1 began in March 2022. We plan for a 24-month trial timeline, with the intervention period of the trial beginning in March 2024. Conclusions: The proposed aims will collectively demonstrate a precision feedback service developed using an open-source technical infrastructure for computable knowledge management. By implementing and evaluating a demonstration system for precision feedback, we create the potential to observe the conditions under which feedback interventions are effective. International Registered Report Identifier (IRRID): PRR1-10.2196/34990 %M 35536637 %R 10.2196/34990 %U https://www.researchprotocols.org/2022/5/e34990 %U https://doi.org/10.2196/34990 %U http://www.ncbi.nlm.nih.gov/pubmed/35536637 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 24 %N 5 %P e34302 %T A Virtual Community of Practice to Support Physician Uptake of a Novel Abortion Practice: Mixed Methods Case Study %A Dunn,Sheila %A Munro,Sarah %A Devane,Courtney %A Guilbert,Edith %A Jeong,Dahn %A Stroulia,Eleni %A Soon,Judith A %A Norman,Wendy V %+ Department of Family and Community Medicine, University of Toronto, 76 Grenville St, Toronto, ON, M5S 1B2, Canada, 1 416 323 6400 ext 4977, sheila.dunn@wchospital.ca %K mifepristone %K abortion %K community of practice %K virtual community of practice %K diffusion of innovation %K learning community %D 2022 %7 5.5.2022 %9 Original Paper %J J Med Internet Res %G English %X Background: Virtual communities of practice (VCoPs) have been used to support innovation and quality in clinical care. The drug mifepristone was introduced in Canada in 2017 for medical abortion. We created a VCoP to support implementation of mifepristone abortion practice across Canada. Objective: The aim of this study was to describe the development and use of the Canadian Abortion Providers Support-Communauté de pratique canadienne sur l’avortement (CAPS-CPCA) VCoP and explore physicians’ experience with CAPS-CPCA and their views on its value in supporting implementation. Methods: This was a mixed methods intrinsic case study of Canadian health care providers’ use and physicians’ perceptions of the CAPS-CPCA VCoP during the first 2 years of a novel practice. We sampled both physicians who joined the CAPS-CPCA VCoP and those who were interested in providing the novel practice but did not join the VCoP. We designed the VCoP features to address known and discovered barriers to implementation of medication abortion in primary care. Our secure web-based platform allowed asynchronous access to information, practice resources, clinical support, discussion forums, and email notices. We collected data from the platform and through surveys of physician members as well as interviews with physician members and nonmembers. We analyzed descriptive statistics for website metrics, physicians’ characteristics and practices, and their use of the VCoP. We used qualitative methods to explore the physicians’ experiences and perceptions of the VCoP. Results: From January 1, 2017, to June 30, 2019, a total of 430 physicians representing all provinces and territories in Canada joined the VCoP and 222 (51.6%) completed a baseline survey. Of these 222 respondents, 156 (70.3%) were family physicians, 170 (80.2%) were women, and 78 (35.1%) had no prior abortion experience. In a survey conducted 12 months after baseline, 77.9% (120/154) of the respondents stated that they had provided mifepristone abortion and 33.9% (43/127) said the VCoP had been important or very important. Logging in to the site was burdensome for some, but members valued downloadable resources such as patient information sheets, consent forms, and clinical checklists. They found email announcements helpful for keeping up to date with changing regulations. Few asked clinical questions to the VCoP experts, but physicians felt that this feature was important for isolated or rural providers. Information collected through member polls about health system barriers to implementation was used in the project’s knowledge translation activities with policy makers to mitigate these barriers. Conclusions: A VCoP developed to address known and discovered barriers to uptake of a novel medication abortion method engaged physicians from across Canada and supported some, including those with no prior abortion experience, to implement this practice. International Registered Report Identifier (IRRID): RR2-10.1136/bmjopen-2018-028443 %M 35511226 %R 10.2196/34302 %U https://www.jmir.org/2022/5/e34302 %U https://doi.org/10.2196/34302 %U http://www.ncbi.nlm.nih.gov/pubmed/35511226 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 2 %P e36948 %T Use of the CPD-REACTION Questionnaire to Evaluate Continuing Professional Development Activities for Health Professionals: Systematic Review %A Ayivi-Vinz,Gloria %A Bakwa Kanyinga,Felly %A Bergeron,Lysa %A Décary,Simon %A Adisso,Évèhouénou Lionel %A Zomahoun,Hervé Tchala Vignon %A Daniel,Sam J %A Tremblay,Martin %A Plourde,Karine V %A Guay-Bélanger,Sabrina %A Légaré,France %+ VITAM – Centre de Recherche en Santé Durable, Centre Intégré Universitaire de Santé et de Services Sociaux de la Capitale-Nationale, Université Laval, 2480 Chemin de la Canardière, Quebec, QC, G1J 2G1, Canada, 1 418 663 5919, France.Legare@mfa.ulaval.ca %K CPD-REACTION %K behavior %K intention %K education medical %K continuing %K health care professionals %K questionnaire %K web-based %K continuing professional development %D 2022 %7 2.5.2022 %9 Review %J JMIR Med Educ %G English %X Background: Continuing professional development (CPD) is essential for physicians to maintain and enhance their knowledge, competence, skills, and performance. Web-based CPD plays an essential role. However, validated theory–informed measures of their impact are lacking. The CPD-REACTION questionnaire is a validated theory–informed tool that evaluates the impact of CPD activities on clinicians’ behavioral intentions. Objective: We aimed to review the use of the CPD-REACTION questionnaire, which measures the impact of CPD activities on health professionals’ intentions to change clinical behavior. We examined CPD activity characteristics, ranges of intention, mean scores, score distributions, and psychometric properties. Methods: We conducted a systematic review informed by the Cochrane review methodology. We searched 8 databases from January 1, 2014, to April 20, 2021. Gray literature was identified using Google Scholar and Research Gate. Eligibility criteria included all health care professionals, any study design, and participants’ completion of the CPD-REACTION questionnaire either before, after, or before and after a CPD activity. Study selection, data extraction, and study quality evaluation were independently performed by 2 reviewers. We extracted data on characteristics of studies, the CPD activity (eg, targeted clinical behavior and format), and CPD-REACTION use. We used the Mixed Methods Appraisal Tool to evaluate the methodological quality of the studies. Data extracted were analyzed using descriptive statistics and the Student t test (2-tailed) for bivariate analysis. The results are presented as a narrative synthesis reported according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Results: Overall, 65 citations were eligible and referred to 52 primary studies. The number of primary studies reporting the use of CPD-REACTION has increased continuously since 2014 from 1 to 16 publications per year (2021). It is available in English, French, Spanish, and Dutch. Most of the studies were conducted in Canada (30/52, 58%). Furthermore, 40 different clinical behaviors were identified. The most common CPD format was e-learning (34/52, 65%). The original version of the CPD-REACTION questionnaire was used in 31 of 52 studies, and an adapted version in 18 of 52 studies. In addition, 31% (16/52) of the studies measured both the pre- and postintervention scores. In 22 studies, CPD providers were university-based. Most studies targeted interprofessional groups of health professionals (31/52, 60%). Conclusions: The use of CPD-REACTION has increased rapidly and across a wide range of clinical behaviors and formats, including a web-based format. Further research should investigate the most effective way to adapt the CPD-REACTION questionnaire to a variety of clinical behaviors and contexts. Trial Registration: PROSPERO CRD42018116492; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=116492 %M 35318188 %R 10.2196/36948 %U https://mededu.jmir.org/2022/2/e36948 %U https://doi.org/10.2196/36948 %U http://www.ncbi.nlm.nih.gov/pubmed/35318188 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 2 %P e32657 %T Perspectives of 360-Degree Cinematic Virtual Reality: Interview Study Among Health Care Professionals %A Beverly,Elizabeth %A Rigot,Brooke %A Love,Carrie %A Love,Matt %+ Ohio University Heritage College of Osteopathic Medicine, 1 Ohio University, Irvine Hall 307, Athens, OH, 45701, United States, 1 740 593 4616, beverle1@ohio.edu %K virtual reality %K qualitative %K medical education %K health care %K digital learning %K learning platform %K health care providers %D 2022 %7 29.4.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: The global market for medical education is projected to increase exponentially over the next 5 years. A mode of delivery expected to drive the growth of this market is virtual reality (VR). VR simulates real-world objects, events, locations, and interactions in 3D multimedia sensory environments. It has been used successfully in medical education for surgical training, learning anatomy, and advancing drug discovery. New VR research has been used to simulate role-playing and clinical encounters; however, most of this research has been conducted with health professions students and not current health care professionals. Thus, more research is needed to explore how health care professionals experience VR with role-playing and clinical encounters. Objective: The aim of this study was to explore health care professionals’ experiences with a cinematic VR (cine-VR) training program focused on role-playing and clinical encounters addressing social determinants of health, Appalachian culture, and diabetes. Cine-VR leverages 360-degree video with the narrative storytelling of cinema to create an engaging educational experience. Methods: We conducted in-depth telephone interviews with health care professionals who participated in the cine-VR training. The interviews were audio recorded and transcribed verbatim. A multidisciplinary team coded and analyzed the data using content and thematic analyses with NVivo software. Results: We conducted 24 in-depth interviews with health care professionals (age=45.3, SD 11.3, years; n=16, 67%, women; n=22, 92%, White; and n=4, 17%, physicians) to explore their experiences with the cine-VR training. Qualitative analysis revealed five themes: immersed in the virtual world: seeing a 360-degree sphere allowed participants to immerse themselves in the virtual world; facilitated knowledge acquisition: all the participants accurately recalled the culture of Appalachia and listed the social determinants of health presented in the training; empathized with multiple perspectives: the cine-VR provided a glimpse into the real life of the main character, and participants described thinking about, feeling, and empathizing with the character’s frustrations and disappointments; perceived ease of use of cine-VR: 96% (23/24) of the participants described the cine-VR as easy to use, and they liked the 360-degree movement, image resolution, and sound quality but noted limitations with the buttons on the headsets and risk for motion sickness; and perceived utility of cine-VR as a teaching tool: participants described cine-VR as an effective teaching tool because it activated visual and affective learning for them. Conclusions: Participants emphasized the realism of the cine-VR training program. They attributed the utility of the cine-VR to visual learning in conjunction with the emotional connection to the VR characters. Furthermore, participants reported that the cine-VR increased their empathy for people. More research is needed to confirm an association between the level of immersion and empathy in cine-VR training for health care professionals. %M 35486427 %R 10.2196/32657 %U https://mededu.jmir.org/2022/2/e32657 %U https://doi.org/10.2196/32657 %U http://www.ncbi.nlm.nih.gov/pubmed/35486427 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 2 %P e30988 %T Video-Based Communication Assessment of Physician Error Disclosure Skills by Crowdsourced Laypeople and Patient Advocates Who Experienced Medical Harm: Reliability Assessment With Generalizability Theory %A White,Andrew A %A King,Ann M %A D’Addario,Angelo E %A Brigham,Karen Berg %A Dintzis,Suzanne %A Fay,Emily E %A Gallagher,Thomas H %A Mazor,Kathleen M %+ Department of Medicine, University of Washington School of Medicine, Box 356429, 1959 Pacific St, Seattle, WA, 98195, United States, 1 206 616 1447, andwhite@uw.edu %K medical error disclosure %K simulation studies %K communication assessment %K graduate medical education %K crowdsourcing %K patient-centered care %K generalizability theory %K medical education %K medical error %K communication %D 2022 %7 29.4.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: Residents may benefit from simulated practice with personalized feedback to prepare for high-stakes disclosure conversations with patients after harmful errors and to meet American Council on Graduate Medical Education mandates. Ideally, feedback would come from patients who have experienced communication after medical harm, but medical researchers and leaders have found it difficult to reach this community, which has made this approach impractical at scale. The Video-Based Communication Assessment app is designed to engage crowdsourced laypeople to rate physician communication skills but has not been evaluated for use with medical harm scenarios. Objective: We aimed to compare the reliability of 2 assessment groups (crowdsourced laypeople and patient advocates) in rating physician error disclosure communication skills using the Video-Based Communication Assessment app. Methods: Internal medicine residents used the Video-Based Communication Assessment app; the case, which consisted of 3 sequential vignettes, depicted a delayed diagnosis of breast cancer. Panels of patient advocates who have experienced harmful medical error, either personally or through a family member, and crowdsourced laypeople used a 5-point scale to rate the residents’ error disclosure communication skills (6 items) based on audiorecorded responses. Ratings were aggregated across items and vignettes to create a numerical communication score for each physician. We used analysis of variance, to compare stringency, and Pearson correlation between patient advocates and laypeople, to identify whether rank order would be preserved between groups. We used generalizability theory to examine the difference in assessment reliability between patient advocates and laypeople. Results: Internal medicine residents (n=20) used the Video-Based Communication Assessment app. All patient advocates (n=8) and 42 of 59 crowdsourced laypeople who had been recruited provided complete, high-quality ratings. Patient advocates rated communication more stringently than crowdsourced laypeople (patient advocates: mean 3.19, SD 0.55; laypeople: mean 3.55, SD 0.40; P<.001), but patient advocates’ and crowdsourced laypeople’s ratings of physicians were highly correlated (r=0.82, P<.001). Reliability for 8 raters and 6 vignettes was acceptable (patient advocates: G coefficient 0.82; crowdsourced laypeople: G coefficient 0.65). Decision studies estimated that 12 crowdsourced layperson raters and 9 vignettes would yield an acceptable G coefficient of 0.75. Conclusions: Crowdsourced laypeople may represent a sustainable source of reliable assessments of physician error disclosure skills. For a simulated case involving delayed diagnosis of breast cancer, laypeople correctly identified high and low performers. However, at least 12 raters and 9 vignettes are required to ensure adequate reliability and future studies are warranted. Crowdsourced laypeople rate less stringently than raters who have experienced harm. Future research should examine the value of the Video-Based Communication Assessment app for formative assessment, summative assessment, and just-in-time coaching of error disclosure communication skills. %M 35486423 %R 10.2196/30988 %U https://mededu.jmir.org/2022/2/e30988 %U https://doi.org/10.2196/30988 %U http://www.ncbi.nlm.nih.gov/pubmed/35486423 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 2 %P e34042 %T Digital Health and Learning in Speech-Language Pathology, Phoniatrics, and Otolaryngology: Survey Study for Designing a Digital Learning Toolbox App %A Lin,Yuchen %A Lemos,Martin %A Neuschaefer-Rube,Christiane %+ Clinic for Phoniatrics, Pedaudiology & Communication Disorders, University Hospital and Medical Faculty, Rheinisch-Westfaelische Technische Hochschule Aachen, Pauwelsstrasse 30, Aachen, 52074, Germany, 49 241 80 88954, yuchen.lin@rwth-aachen.de %K digital learning %K mLearning %K mHealth %K speech-language pathology %K phoniatrics %K otolaryngology %K communication disorders %K mobile phone %D 2022 %7 27.4.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: The digital age has introduced opportunities and challenges for clinical education and practice caused by infinite incoming information and novel technologies for health. In the interdisciplinary field of communication sciences and disorders (CSD), engagement with digital topics has emerged slower than in other health fields, and effective strategies for accessing, managing, and focusing on digital resources are greatly needed. Objective: We aimed to conceptualize and investigate preferences of stakeholders regarding a digital learning toolbox, an app containing a library of current resources for CSD. This cross-sectional survey study conducted in German-speaking countries investigated professional and student perceptions and preferences regarding such an app’s features, functions, content, and associated concerns. Methods: An open web-based survey was disseminated to professionals and students in the field of CSD, including speech-language pathologists (SLPs; German: Logopäd*innen), speech-language pathology students, phoniatricians, otolaryngologists, and medical students. Insights into preferences and perceptions across professions, generations, and years of experience regarding a proposed app were investigated. Results: Of the 164 participants, an overwhelming majority (n=162, 98.8%) indicated readiness to use such an app, and most participants (n=159, 96.9%) perceived the proposed app to be helpful. Participants positively rated app functions that would increase utility (eg, tutorial, quality rating function, filters based on content or topic, and digital format); however, they had varied opinions regarding an app community feature. Regarding app settings, most participants rated the option to share digital resources through social media links (144/164, 87.8%), receive and manage push notifications (130/164, 79.3%), and report technical issues (160/164, 97.6%) positively. However, significant variance was noted across professions (H3=8.006; P=.046) and generations (H3=9.309; P=.03) regarding a username-password function, with SLPs indicating greater perceived usefulness in comparison to speech-language pathology students (P=.045), as was demonstrated by Generation X versus Generation Z (P=.04). Participants perceived a range of clinical topics to be important; however, significant variance was observed across professions, between physicians and SLPs regarding the topic of diagnostics (H3=9.098; P=.03) and therapy (H3=21.236; P<.001). Concerns included technical challenges, data protection, quality of the included resources, and sustainability of the proposed app. Conclusions: This investigation demonstrated that professionals and students show initial readiness to engage in the co-design and use of an interdisciplinary digital learning toolbox app. Specifically, this app could support effective access, sharing, evaluation, and knowledge management in a digital age of rapid change. Formalized digital skills education in the field of CSD is just a part of the solution. It will be crucial to explore flexible, adaptive strategies collaboratively for managing digital resources and tools to optimize targeted selection and use of relevant, high-quality evidence in a world of bewildering data. %M 35475980 %R 10.2196/34042 %U https://mededu.jmir.org/2022/2/e34042 %U https://doi.org/10.2196/34042 %U http://www.ncbi.nlm.nih.gov/pubmed/35475980 %0 Journal Article %@ 1929-0748 %I JMIR Publications %V 11 %N 4 %P e35083 %T Schwartz Rounds for Staff in an Australian Tertiary Hospital: Protocol for a Pilot Uncontrolled Trial %A Ewais,Tatjana %A Hunt,Georgia %A Munro,Jonathan %A Pun,Paul %A Hogan,Christy %A William,Leeroy %A Teodorczuk,Andrew %+ Mater Young Adult Health Centre, Mater Health, Mater Misericordiae Ltd, Level 4, Salmon Building, Raymond Terrace, South Brisbane, 4101, Australia, 61 731638521, Tatjana.Ewais@mater.org.au %K Schwartz Rounds %K compassionate care %K health care staff well-being %D 2022 %7 27.4.2022 %9 Protocol %J JMIR Res Protoc %G English %X Background: Schwartz Rounds are a unique, organization-wide interdisciplinary intervention aimed at enhancing staff well-being, compassionate care, teamwork, and organizational culture in health care settings. They provide a safe space wherein both clinical and nonclinical health staff can connect and share their experiences about the social and emotional aspects of health care. Objective: Although Schwartz Rounds have been assessed and widely implemented in the United States and United Kingdom, they are yet to be formally evaluated in Australian health care settings. The purpose of this study is to evaluate the feasibility and impact of Schwartz Rounds on staff well-being, compassionate care, and organizational culture, in a tertiary metropolitan hospital in Brisbane, Australia. Methods: This mixed methods repeated measures pilot study will recruit 24 participants in 2 groups from 2 departments, the intensive care unit and the gastroenterology department. Participants from each group will take part in 3 unit-based Schwartz Rounds. Primary outcomes will include the study and intervention feasibility measures, while secondary outcomes will include scores on the Maslach Burnout Inventory–Human Services Survey, the Schwartz Centre Compassionate Care Scale, and the Culture of Care Barometer. Primary and secondary outcomes will be collected at baseline, after the Rounds, and 3-month follow-up. Two focus groups will be held approximately 2 months after completion of the Schwartz Rounds. Descriptive statistics, paired t tests, chi-square tests, and analysis of variance will be used to compare quantitative data across time points and groups. Qualitative data from focus groups and free-text survey questions will be analyzed using an inductive thematic analysis approach. Results: The study was approved by the Mater Hospital Human Research Ethics Committee (reference number: HREC/MML/71868) and recruitment commenced in July 2021; study completion is anticipated by May 2022. Conclusions: The study will contribute to the assessment of feasibility and preliminary efficacy of the Schwartz Rounds in a tertiary Australian hospital during the COVID-19 pandemic. Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN12621001473853; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=382769&isReview=true International Registered Report Identifier (IRRID): DERR1-10.2196/35083 %M 35475785 %R 10.2196/35083 %U https://www.researchprotocols.org/2022/4/e35083 %U https://doi.org/10.2196/35083 %U http://www.ncbi.nlm.nih.gov/pubmed/35475785 %0 Journal Article %@ 2291-9279 %I JMIR Publications %V 10 %N 2 %P e34781 %T Augmented Reality-Based Surgery on the Human Cadaver Using a New Generation of Optical Head-Mounted Displays: Development and Feasibility Study %A Puladi,Behrus %A Ooms,Mark %A Bellgardt,Martin %A Cesov,Mark %A Lipprandt,Myriam %A Raith,Stefan %A Peters,Florian %A Möhlhenrich,Stephan Christian %A Prescher,Andreas %A Hölzle,Frank %A Kuhlen,Torsten Wolfgang %A Modabber,Ali %+ Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, Pauwelsstraße 30, Aachen, 52074, Germany, 49 241 80 88231, bpuladi@ukaachen.de %K digital health in surgery %K surgical technique %K surgical training %K computer-assisted surgery %K optical see-through head-mounted display %K HoloLens %K surgical navigation %K medical regulation %K open-source %K AR %K augmented reality %K surgery %K surgeon %K cadaver %K serious game %K head-mounted display %D 2022 %7 25.4.2022 %9 Original Paper %J JMIR Serious Games %G English %X Background: Although nearly one-third of the world’s disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence. Objective: The goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies. Methods: We tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires. Results: The development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment. Conclusions: The development and application of an AR-based surgical system using freely available technologies to perform OST-HMD–guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD–guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies. %M 35468090 %R 10.2196/34781 %U https://games.jmir.org/2022/2/e34781 %U https://doi.org/10.2196/34781 %U http://www.ncbi.nlm.nih.gov/pubmed/35468090 %0 Journal Article %@ 2292-9495 %I JMIR Publications %V 9 %N 2 %P e33630 %T Evaluation of the First Year(s) of Physicians Collaboration on an Interdisciplinary Electronic Consultation Platform in the Netherlands: Mixed Methods Observational Study %A Sanavro,Sanne M %A van der Worp,Henk %A Jansen,Danielle %A Koning,Paul %A Blanker,Marco H %A , %+ Department of General Practice and Elderly Care Medicine, University of Groningen, PO Box 196, Groningen, 9700 AD, Netherlands, 31 50 3616731, sannesanavro@hotmail.com %K primary care %K digital consultation %K interdisciplinary %K specialist care %D 2022 %7 1.4.2022 %9 Original Paper %J JMIR Hum Factors %G English %X Background: Complexity of health problems and aging of the population create an ongoing burden on the health care system with the general practitioner (GP) being the gatekeeper in primary care. In GPs daily practice, collaboration with specialists and exchange of knowledge from the secondary care play a crucial role in this system. Communication between primary and secondary care has shortcomings for health care workers that want to practice sustainable patient-centered health care. Therefore, a new digital interactive platform was developed: Prisma. Objective: This study aims to describe the development of a digital consultation platform (Prisma) to connect GPs with hospital specialists via the Siilo application and to evaluate the first year of use, including consultations, topic diversity, and number of participating physicians. Methods: We conducted a mixed methods observational study, analyzing qualitative and quantitative data for cases posted on the platform between June 2018 and May 2020. Any GP can post questions to an interdisciplinary group of secondary care specialists, with the platform designed to facilitate discussion and knowledge exchange for all users. Results: In total, 3674 cases were posted by 424 GPs across 16 specialisms. Most questions and answers concerned diagnosis, nonmedical treatment, and medication. Mean response time was 76 minutes (range 44-252). An average of 3 users engaged with each case (up to 7 specialists). Almost half of the internal medicine cases received responses from at least two specialisms in secondary care, contrasting with about one-fifth for dermatology. Of note, the growth in consultations was steepest for dermatology. Conclusions: Digital consultations offer the possibility for GPs to receive quick responses when seeking advice. The interdisciplinary approach of Prisma creates opportunities for digital patient-centered networking. %M 35363155 %R 10.2196/33630 %U https://humanfactors.jmir.org/2022/2/e33630 %U https://doi.org/10.2196/33630 %U http://www.ncbi.nlm.nih.gov/pubmed/35363155 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e32183 %T Technology Literacy in Undergraduate Medical Education: Review and Survey of the US Medical School Innovation and Technology Programs %A Wang,Judy Jiaqi %A Singh,Rishabh K %A Miselis,Heather Hough %A Stapleton,Stephanie Nicole %+ Department of Emergency Medicine, Boston University School of Medicine, Boston Medical Center, 1 Boston Medical Center Place, Boston, MA, 02118, United States, 1 6174144892, snstaple13@gmail.com %K curricular development %K medical innovation %K medical technology %K student engagement %D 2022 %7 31.3.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: Modern innovations, like machine learning, genomics, and digital health, are being integrated into medical practice at a rapid pace. Physicians in training receive little exposure to the implications, drawbacks, and methodologies of upcoming technologies prior to their deployment. As a result, there is an increasing need for the incorporation of innovation and technology (I&T) training, starting in medical school. Objective: We aimed to identify and describe curricular and extracurricular opportunities for innovation in medical technology in US undergraduate medical education to highlight challenges and develop insights for future directions of program development. Methods: A review of publicly available I&T program information on the official websites of US allopathic medical schools was conducted in June 2020. Programs were categorized by structure and implementation. The geographic distribution of these categories across US regions was analyzed. A survey was administered to school-affiliated student organizations with a focus on I&T and publicly available contact information. The data collected included the founding year, thematic focus, target audience, activities offered, and participant turnout rate. Results: A total of 103 I&T opportunities at 69 distinct Liaison Committee on Medical Education–accredited medical schools were identified and characterized into the following six categories: (1) integrative 4-year curricula, (2) facilitated doctor of medicine/master of science dual degree programs in a related field, (3) interdisciplinary collaborations, (4) areas of concentration, (5) preclinical electives, and (6) student-run clubs. The presence of interdisciplinary collaboration is significantly associated with the presence of student-led initiatives (P=.001). “Starting and running a business in healthcare” and “medical devices” were the most popular thematic focuses of student-led I&T groups, representing 87% (13/15) and 80% (12/15) of respondents, respectively. “Career pathways exploration for students” was the only type of activity that was significantly associated with a high event turnout rate of >26 students per event (P=.03). Conclusions: Existing school-led and student-driven opportunities in medical I&T indicate growing national interest and reflect challenges in implementation. The greater visibility of opportunities, collaboration among schools, and development of a centralized network can be considered to better prepare students for the changing landscape of medical practice. %M 35357319 %R 10.2196/32183 %U https://mededu.jmir.org/2022/1/e32183 %U https://doi.org/10.2196/32183 %U http://www.ncbi.nlm.nih.gov/pubmed/35357319 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e33934 %T Leveraging Machine Learning to Understand How Emotions Influence Equity Related Education: Quasi-Experimental Study %A Sukhera,Javeed %A Ahmed,Hasan %+ Institute of Living, Hartford Hospital, 200 Retreat Avenue, Hartford, CT, 06106, United States, 1 8605457629, javeedsukhera@gmail.com %K bias %K equity %K sentiment analysis %K medical education %K emotion %K education %D 2022 %7 30.3.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: Teaching and learning about topics such as bias are challenging due to the emotional nature of bias-related discourse. However, emotions can be challenging to study in health professions education for numerous reasons. With the emergence of machine learning and natural language processing, sentiment analysis (SA) has the potential to bridge the gap. Objective: To improve our understanding of the role of emotions in bias-related discourse, we developed and conducted a SA of bias-related discourse among health professionals. Methods: We conducted a 2-stage quasi-experimental study. First, we developed a SA (algorithm) within an existing archive of interviews with health professionals about bias. SA refers to a mechanism of analysis that evaluates the sentiment of textual data by assigning scores to textual components and calculating and assigning a sentiment value to the text. Next, we applied our SA algorithm to an archive of social media discourse on Twitter that contained equity-related hashtags to compare sentiment among health professionals and the general population. Results: When tested on the initial archive, our SA algorithm was highly accurate compared to human scoring of sentiment. An analysis of bias-related social media discourse demonstrated that health professional tweets (n=555) were less neutral than the general population (n=6680) when discussing social issues on professionally associated accounts (χ2 [2, n=555)]=35.455; P<.001), suggesting that health professionals attach more sentiment to their posts on Twitter than seen in the general population. Conclusions: The finding that health professionals are more likely to show and convey emotions regarding equity-related issues on social media has implications for teaching and learning about sensitive topics related to health professions education. Such emotions must therefore be considered in the design, delivery, and evaluation of equity and bias-related education. %M 35353048 %R 10.2196/33934 %U https://mededu.jmir.org/2022/1/e33934 %U https://doi.org/10.2196/33934 %U http://www.ncbi.nlm.nih.gov/pubmed/35353048 %0 Journal Article %@ 2292-9495 %I JMIR Publications %V 9 %N 1 %P e35199 %T The Effects of Introducing a Mobile App–Based Procedural Logbook on Trainee Compliance to a Central Venous Catheter Insertion Accreditation Program: Before-and-After Study %A Tamblyn,Robert %A Brieva,Jorge %A Cain,Madeleine %A Martinez,F Eduardo %+ Division of Critical Care, John Hunter Hospital, Hunter New England Local Health District, Lookout Rd, New Lambton Heights, Newcastle, 2305, Australia, 61 432032151, robert.d.tamblyn@gmail.com %K logbook %K education %K training %K central venous catheter %K CVC %K intensive care %K smartphone %K mobile phone %K mobile apps %K mHealth %K mobile health %K accreditation program %K digital health %K digital record %D 2022 %7 7.3.2022 %9 Original Paper %J JMIR Hum Factors %G English %X Background: To reduce complications associated with central venous catheter (CVC) insertions, local accreditation programs using a supervised procedural logbook are essential. To increase compliance with such a logbook, a mobile app could provide the ideal platform for training doctors in an adult intensive care unit (ICU). Objective: The aim of this paper was to compare trainee compliance with the completion of a logbook as part of a CVC insertion accreditation program, before and after the introduction of an app-based logbook. Methods: This is a retrospective observational study of logbook data, before and after the introduction of a purpose-built, app-based, electronic logbook to complement an existing paper-based logbook. Carried out over a 2-year period in the adult ICU of the John Hunter Hospital, Newcastle, NSW, Australia, the participants were ICU trainee medical officers completing a CVC insertion accreditation program. The primary outcome was the proportion of all CVC insertions documented in the patients’ electronic medical records appearing as logbook entries. To assess logbook entry quality, we measured and compared the proportion of logbook entries that were approved by a supervisor and contained a supervisor’s signature for the before and after periods. We also analyzed trainee participation before and after the intervention by comparing the total number of active logbook users, and the proportion of first-time users who logged 3 or more CVC insertions. Results: Of the 2987 CVC insertions documented in the electronic medical records between April 7, 2019, and April 6, 2021, 2161 (72%) were included and separated into cohorts before and after the app’s introduction. Following the introduction of the app-based logbook, the percentage of CVC insertions appearing as logbook entries increased from 3.6% (38/1059) to 20.5% (226/1102; P<.001). There was no difference in the proportion of supervisor-approved entries containing a supervisor’s signature before and after the introduction of the app, with 76.3% (29/38) and 83.2% (188/226), respectively (P=.31). After the introduction of the app, there was an increase in the percentage of active logbook users from 15.3% (13/85) to 62.8% (54/86; P<.001). Adherence to one’s logbook was similar in both groups with 60% (6/10) of first-time users in the before group and 79.5% (31/39) in the after group going on to log at least 3 or more CVCs during their time working in ICU. Conclusions: The addition of an electronic app-based logbook to a preexisting paper-based logbook was associated with a higher rate of logbook compliance in trainee doctors undertaking an accreditation program for CVC insertion in an adult ICU. There was a large increase in logbook use observed without a reduction in the quality of logbook entries. The overall trainee participation also improved with an observed increase in active logbook users and no reduction in the average number of entries per user following the introduction of the app. Further studies on app-based logbooks for ICU procedural accreditation programs are warranted. %M 35051900 %R 10.2196/35199 %U https://humanfactors.jmir.org/2022/1/e35199 %U https://doi.org/10.2196/35199 %U http://www.ncbi.nlm.nih.gov/pubmed/35051900 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e23845 %T A Comprehensive COVID-19 Daily News and Medical Literature Briefing to Inform Health Care and Policy in New Mexico: Implementation Study %A Jarratt,LynnMarie %A Situ,Jenny %A King,Rachel D %A Montanez Ramos,Estefania %A Groves,Hannah %A Ormesher,Ryen %A Cossé,Melissa %A Raboff,Alyse %A Mahajan,Avanika %A Thompson,Jennifer %A Ko,Randy F %A Paltrow-Krulwich,Samantha %A Price,Allison %A Hurwitz,Ariel May-Ling %A CampBell,Timothy %A Epler,Lauren T %A Nguyen,Fiona %A Wolinsky,Emma %A Edwards-Fligner,Morgan %A Lobo,Jolene %A Rivera,Danielle %A Langsjoen,Jens %A Sloane,Lori %A Hendrix,Ingrid %A Munde,Elly O %A Onyango,Clinton O %A Olewe,Perez K %A Anyona,Samuel B %A Yingling,Alexandra V %A Lauve,Nicolas R %A Kumar,Praveen %A Stoicu,Shawn %A Nestsiarovich,Anastasiya %A Bologa,Cristian G %A Oprea,Tudor I %A Tollestrup,Kristine %A Myers,Orrin B %A Anixter,Mari %A Perkins,Douglas J %A Lambert,Christophe Gerard %+ Center for Global Health, Division of Translational Informatics, Department of Internal Medicine, University of New Mexico Health Sciences Center, BRF #323A, MSC10-5550, 915 Camino de Salud NE, Albuquerque, NM, 87131, United States, 1 505 272 9709, cglambert@unm.edu %K COVID-19 %K pandemic %K daily report %K policy %K epidemics %K global health %K SARS-CoV-2 %K New Mexico %K medical education %D 2022 %7 23.2.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: On March 11, 2020, the New Mexico Governor declared a public health emergency in response to the COVID-19 pandemic. The New Mexico medical advisory team contacted University of New Mexico (UNM) faculty to form a team to consolidate growing information on severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and its disease to facilitate New Mexico’s pandemic management. Thus, faculty, physicians, staff, graduate students, and medical students created the “UNM Global Health COVID-19 Intelligence Briefing.” Objective: In this paper, we sought to (1) share how to create an informative briefing to guide public policy and medical practice and manage information overload with rapidly evolving scientific evidence; (2) determine the qualitative usefulness of the briefing to its readers; and (3) determine the qualitative effect this project has had on virtual medical education. Methods: Microsoft Teams was used for manual and automated capture of COVID-19 articles and composition of briefings. Multilevel triaging saved impactful articles to be reviewed, and priority was placed on randomized controlled studies, meta-analyses, systematic reviews, practice guidelines, and information on health care and policy response to COVID-19. The finalized briefing was disseminated by email, a listserv, and posted on the UNM digital repository. A survey was sent to readers to determine briefing usefulness and whether it led to policy or medical practice changes. Medical students, unable to partake in direct patient care, proposed to the School of Medicine that involvement in the briefing should count as course credit, which was approved. The maintenance of medical student involvement in the briefings as well as this publication was led by medical students. Results: An average of 456 articles were assessed daily. The briefings reached approximately 1000 people by email and listserv directly, with an unknown amount of forwarding. Digital repository tracking showed 5047 downloads across 116 countries as of July 5, 2020. The survey found 108 (95%) of 114 participants gained relevant knowledge, 90 (79%) believed it decreased misinformation, 27 (24%) used the briefing as their primary source of information, and 90 (79%) forwarded it to colleagues. Specific and impactful public policy decisions were informed based on the briefing. Medical students reported that the project allowed them to improve on their scientific literature assessment, stay current on the pandemic, and serve their community. Conclusions: The COVID-19 briefings succeeded in informing and guiding New Mexico policy and clinical practice. The project received positive feedback from the community and was shown to decrease information burden and misinformation. The virtual platforms allowed for the continuation of medical education. Variability in subject matter expertise was addressed with training, standardized article selection criteria, and collaborative editing led by faculty. %M 35142625 %R 10.2196/23845 %U https://mededu.jmir.org/2022/1/e23845 %U https://doi.org/10.2196/23845 %U http://www.ncbi.nlm.nih.gov/pubmed/35142625 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e32747 %T Digital Teaching in Medical Education: Scientific Literature Landscape Review %A Yeung,Andy Wai Kan %A Parvanov,Emil D %A Hribersek,Mojca %A Eibensteiner,Fabian %A Klager,Elisabeth %A Kletecka-Pulker,Maria %A Rössler,Bernhard %A Schebesta,Karl %A Willschke,Harald %A Atanasov,Atanas G %A Schaden,Eva %+ Ludwig Boltzmann Institute for Digital Health and Patient Safety, Medical University of Vienna, Spitalgasse 23, Vienna, 1090, Austria, 43 664 1929 852, Atanas.Atanasov@dhps.lbg.ac.at %K medical education %K digital teaching %K virtual reality %K augmented reality %K anatomy %K basic life support %K satisfaction %K bibliometric %K medicine %K life support %K online learning %K literature %K trend %K citation %D 2022 %7 9.2.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: Digital teaching in medical education has grown in popularity in the recent years. However, to the best of our knowledge, no bibliometric report to date has been published that analyzes this important literature set to reveal prevailing topics and trends and their impacts reflected in citation counts. Objective: We used a bibliometric approach to unveil and evaluate the scientific literature on digital teaching research in medical education, demonstrating recurring research topics, productive authors, research organizations, countries, and journals. We further aimed to discuss some of the topics and findings reported by specific highly cited works. Methods: The Web of Science electronic database was searched to identify relevant papers on digital teaching research in medical education. Basic bibliographic data were obtained by the “Analyze” and “Create Citation Report” functions of the database. Complete bibliographic data were exported to VOSviewer for further analyses. Visualization maps were generated to display the recurring author keywords and terms mentioned in the titles and abstracts of the publications. Results: The analysis was based on data from 3978 papers that were identified. The literature received worldwide contributions with the most productive countries being the United States and United Kingdom. Reviews were significantly more cited, but the citations between open access vs non–open access papers did not significantly differ. Some themes were cited more often, reflected by terms such as virtual reality, innovation, trial, effectiveness, and anatomy. Different aspects in medical education were experimented for digital teaching, such as gross anatomy education, histology, complementary medicine, medicinal chemistry, and basic life support. Some studies have shown that digital teaching could increase learning satisfaction, knowledge gain, and even cost-effectiveness. More studies were conducted on trainees than on undergraduate students. Conclusions: Digital teaching in medical education is expected to flourish in the future, especially during this era of COVID-19 pandemic. %M 35138260 %R 10.2196/32747 %U https://mededu.jmir.org/2022/1/e32747 %U https://doi.org/10.2196/32747 %U http://www.ncbi.nlm.nih.gov/pubmed/35138260 %0 Journal Article %@ 2292-9495 %I JMIR Publications %V 9 %N 1 %P e30804 %T Status of Compassionate, Respectful, and Caring Health Service Delivery: Scoping Review %A Nigusie,Adane %A Endehabtu,Berhanu F %A Angaw,Dessie Abebaw %A Teklu,Alemayehu %A Mekonnen,Zeleke Abebaw %A Feletto,Marta %A Assan,Abraham %A Samuel,Assegid %A Sheikh,Kabir %A Tilahun,Binyam %K compassionate %K respectful %K caring %K CRC %K health care delivery %D 2022 %7 7.2.2022 %9 Review %J JMIR Hum Factors %G English %X Background: A compassionate, respectful, and caring (CRC) health professional is very important for human-centered care, serving clients ethically and with respect, adhering to the professional oath, and serving as a model for young professionals. As countries try to achieve universal health coverage (UHC), quality delivery of health services is crucial. CRC health care is an initiative around the need to provide quality care services to clients and patients. However, there is an evidence gap on the status of CRC health care service delivery. Objective: This scoping review aimed to map global evidence on the status of CRC health service delivery practice. Methods: An exhaustive literature review and Delphi technique were used to answer the 2 research questions: “What is the current status of CRC health care practices among health workers?” and “Is it possible for health professionals, health managers, administrators, and policy makers to incorporate it into their activity while designing strategies that could improve the humanistic and holistic approach to health care provision?” The studies were searched from the year 2014 to September 2020 using electronic databases such as MEDLINE (PubMed), Cochrane Library, Web of Science, Hinari, and the World Health Organization (WHO) library. Additionally, grey literature such as Google, Google Scholar, and WorldWideScience were scrutinized. Studies that applied any study design and data collection and analysis methods related to CRC care were included. Two authors extracted the data and compared the results. Discrepancies were resolved by discussion, or the third reviewer made the decision. Findings from the existing literature were presented using thematic analysis. Results: A total of 1193 potentially relevant studies were generated from the initial search, and 20 studies were included in the final review. From this review, we identified 5 thematic areas: the status of CRC implementation, facilitators for CRC health care service delivery, barriers to CRC health care delivery, disrespectful and abusive care encountered by patients, and perspectives on CRC. The findings of this review indicated that improving the mechanisms for monitoring health facilities, improving accountability, and becoming aware of the consequences of maltreatment within facilities are critical steps to improving health care delivery practices. Conclusions: This scoping review identified that there is limited CRC service provision. Lack of training, patient flow volume, and bed shortages were found to be the main contributors of CRC health care delivery. Therefore, the health care system should consider the components of CRC in health care delivery during in-service training, pre-service training, monitoring and evaluation, community engagement, workload division, and performance appraisal. %M 35129450 %R 10.2196/30804 %U https://humanfactors.jmir.org/2022/1/e30804 %U https://doi.org/10.2196/30804 %U http://www.ncbi.nlm.nih.gov/pubmed/35129450 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e34171 %T An Online International Collaborative Learning Program During the COVID-19 Pandemic for Nursing Students: Mixed Methods Study %A Jung,Dukyoo %A De Gagne,Jennie C %A Choi,Eunju %A Lee,Kyuri %+ College of Nursing, University of Iowa, 50 Newton Road, Iowa City, IA, 52242, United States, 1 3199369033, kyurilee2501@gmail.com %K COVID-19 %K distance education %K global competencies %K nursing students %K program evaluation %K synchronous virtual classroom %K video conferencing %D 2022 %7 24.1.2022 %9 Original Paper %J JMIR Med Educ %G English %X Background: Given the limitations imposed by the COVID-19 pandemic, a better understanding of how nursing programs around the globe have implemented distance education methods and related initiatives to provide international collaborative learning opportunities as well as complementary aspects of practical education would be constructive for nursing students. It is expected that international collaboratives through web-based communication will continue to be increasingly utilized after the pandemic; therefore, it is time to discuss the effects and direction of these developments. Objective: We aimed to examine the impact of an online international collaborative learning program on prelicensure nursing students’ international and global competencies in South Korea. Methods: We conducted a mixed methods study (web-based surveys and focus group interviews). A total of 15 students participated in the study. The surveys were used to examine changes in participants’ global leadership competencies, and the focus group interviews were used to evaluate the program’s effectiveness and to identify opportunities for improvement. The online international collaborative program consisted of 7 synchronous web-based classroom sessions. Each session ran for 60 to 90 minutes. Faculty experts and nurses working in the United States discussed various topics with students, such as nursing education in the United States and evidence-based teaching and learning. The students gave presentations on the South Korean nursing education system. Data were analyzed with descriptive statistics, the Mann-Whitney U test, and content analysis methods. Results: Participants reported improvement in their global leadership competencies. Four main categories emerged from analysis of the focus interviews: (1) realistic applicability, (2) clarification, (3) expansion of perspectives, and (4) initiative. Conclusions: The online international collaborative learning program had a positive impact on the development of students’ international competencies. The findings support the further development of international exchange programs through web-based meetings in the postpandemic era. %M 34982035 %R 10.2196/34171 %U https://mededu.jmir.org/2022/1/e34171 %U https://doi.org/10.2196/34171 %U http://www.ncbi.nlm.nih.gov/pubmed/34982035 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 8 %N 1 %P e28770 %T Distributed Autonomous Organization of Learning: Future Structure for Health Professions Education Institutions %A Cabrera,Daniel %A Nickson,Christopher P %A Roland,Damian %A Hall,Elissa %A Ankel,Felix %+ Department of Emergency Medicine, Mayo Clinic, 200 First St SW, Rochester, MN, 55902, United States, 1 5072842511, Cabrera.Daniel@mayo.edu %K blockchain %K multidisciplinary %K credentialing %K medical education %K health professionals %K education %K decentralization %K training %K curriculum %K instruction %D 2022 %7 4.1.2022 %9 Viewpoint %J JMIR Med Educ %G English %X Current health professions education (HPE) institutions are based on an assembly-line hierarchical structure. The last decade has witnessed the advent of sophisticated networks allowing the exchange of information and educational assets. Blockchain provides an ideal data management framework that can support high-order applications such as learning systems and credentialing in an open and a distributed fashion. These system management characteristics enable the creation of a distributed autonomous organization of learning (DAOL). This new type of organization allows for the creation of decentralized adaptive competency curricula, simplification of credentialing and certification, leveling of information asymmetry among educational market stakeholders, assuring alignment with societal priorities, and supporting equity and transparency. %M 34982722 %R 10.2196/28770 %U https://mededu.jmir.org/2022/1/e28770 %U https://doi.org/10.2196/28770 %U http://www.ncbi.nlm.nih.gov/pubmed/34982722 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 23 %N 12 %P e26763 %T Assessing Physicians’ Recall Bias of Work Hours With a Mobile App: Interview and App-Recorded Data Comparison %A Wang,Hsiao-Han %A Lin,Yu-Hsuan %+ Institute of Population Health Sciences, National Health Research Institutes, 35 Keyan Road, Zhunan Township, Miaoli County, 35053, Taiwan, 886 37 206 166 ext 36383, yuhsuanlin@nhri.edu.tw %K smartphone %K mobile app %K work hours %K recall bias %K time perception %K physicians %K labor policy %D 2021 %7 24.12.2021 %9 Original Paper %J J Med Internet Res %G English %X Background: Previous studies have shown inconsistencies in the accuracy of self-reported work hours. However, accurate documentation of work hours is fundamental for the formation of labor policies. Strict work-hour policies decrease medical errors, improve patient safety, and promote physicians’ well-being. Objective: The aim of this study was to estimate physicians’ recall bias of work hours with a mobile app, and to examine the association between the recall bias and physicians’ work hours. Methods: We quantified recall bias by calculating the differences between the app-recorded and self-reported work hours of the previous week and the penultimate week. We recruited 18 physicians to install the “Staff Hours” app, which automatically recorded GPS-defined work hours for 2 months, contributing 1068 person-days. We examined the association between work hours and two recall bias indicators: (1) the difference between self-reported and app-recorded work hours and (2) the percentage of days for which work hours were not precisely recalled during interviews. Results: App-recorded work hours highly correlated with self-reported counterparts (r=0.86-0.88, P<.001). Self-reported work hours were consistently significantly lower than app-recorded hours by –8.97 (SD 8.60) hours and –6.48 (SD 8.29) hours for the previous week and the penultimate week, respectively (both P<.001). The difference for the previous week was significantly correlated with work hours in the previous week (r=–0.410, P=.01), whereas the correlation of the difference with the hours in the penultimate week was not significant (r=–0.119, P=.48). The percentage of hours not recalled (38.6%) was significantly higher for the penultimate week (38.6%) than for the first week (16.0%), and the former was significantly correlated with work hours of the penultimate week (r=0.489, P=.002) Conclusions: Our study identified the existence of recall bias of work hours, the extent to which the recall was biased, and the influence of work hours on recall bias. %M 34951600 %R 10.2196/26763 %U https://www.jmir.org/2021/12/e26763 %U https://doi.org/10.2196/26763 %U http://www.ncbi.nlm.nih.gov/pubmed/34951600 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 7 %N 4 %P e32356 %T Assessment of Entrustable Professional Activities Using a Web-Based Simulation Platform During Transition to Emergency Medicine Residency: Mixed Methods Pilot Study %A Peng,Cynthia R %A Schertzer,Kimberly A %A Caretta-Weyer,Holly A %A Sebok-Syer,Stefanie S %A Lu,William %A Tansomboon,Charissa %A Gisondi,Michael A %+ Department of Emergency Medicine, Stanford University School of Medicine, 900 Welch Rd, Palo Alto, CA, 94304-1805, United States, 1 6507235111, crp34@cornell.edu %K simulation %K graduate medical education %K assessment %K gamification %K entrustable professional activities %K emergency medicine %K undergraduate medical education %D 2021 %7 17.11.2021 %9 Original Paper %J JMIR Med Educ %G English %X Background: The 13 core entrustable professional activities (EPAs) are key competency-based learning outcomes in the transition from undergraduate to graduate medical education in the United States. Five of these EPAs (EPA2: prioritizing differentials, EPA3: recommending and interpreting tests, EPA4: entering orders and prescriptions, EPA5: documenting clinical encounters, and EPA10: recognizing urgent and emergent conditions) are uniquely suited for web-based assessment. Objective: In this pilot study, we created cases on a web-based simulation platform for the diagnostic assessment of these EPAs and examined the feasibility and acceptability of the platform. Methods: Four simulation cases underwent 3 rounds of consensus panels and pilot testing. Incoming emergency medicine interns (N=15) completed all cases. A maximum of 4 “look for” statements, which encompassed specific EPAs, were generated for each participant: (1) performing harmful or missing actions, (2) narrowing differential or wrong final diagnosis, (3) errors in documentation, and (4) lack of recognition and stabilization of urgent diagnoses. Finally, we interviewed a sample of interns (n=5) and residency leadership (n=5) and analyzed the responses using thematic analysis. Results: All participants had at least one missing critical action, and 40% (6/15) of the participants performed at least one harmful action across all 4 cases. The final diagnosis was not included in the differential diagnosis in more than half of the assessments (8/15, 54%). Other errors included selecting incorrect documentation passages (6/15, 40%) and indiscriminately applying oxygen (9/15, 60%). The interview themes included psychological safety of the interface, ability to assess learning, and fidelity of cases. The most valuable feature cited was the ability to place orders in a realistic electronic medical record interface. Conclusions: This study demonstrates the feasibility and acceptability of a web-based platform for diagnostic assessment of specific EPAs. The approach rapidly identifies potential areas of concern for incoming interns using an asynchronous format, provides feedback in a manner appreciated by residency leadership, and informs individualized learning plans. %M 34787582 %R 10.2196/32356 %U https://mededu.jmir.org/2021/4/e32356 %U https://doi.org/10.2196/32356 %U http://www.ncbi.nlm.nih.gov/pubmed/34787582 %0 Journal Article %@ 1438-8871 %I JMIR Publications %V 23 %N 9 %P e29239 %T Scholarly Productivity Evaluation of KL2 Scholars Using Bibliometrics and Federal Follow-on Funding: Cross-Institution Study %A Qua,Kelli %A Yu,Fei %A Patel,Tanha %A Dave,Gaurav %A Cornelius,Katherine %A Pelfrey,Clara M %+ Health Sciences Library, University of North Carolina at Chapel Hill, 335 S. Columbia Street CB 7585, Chapel Hill, NC, 27599, United States, 1 9199622219, feifei@unc.edu %K bibliometrics %K Clinical and Translational Science Award %K KL2 %K translational research %K career development %D 2021 %7 29.9.2021 %9 Original Paper %J J Med Internet Res %G English %X Background: Evaluating outcomes of the clinical and translational research (CTR) training of a Clinical and Translational Science Award (CTSA) hub (eg, the KL2 program) requires the selection of reliable, accessible, and standardized measures. As measures of scholarly success usually focus on publication output and extramural funding, CTSA hubs have started to use bibliometrics to evaluate the impact of their supported scholarly activities. However, the evaluation of KL2 programs across CTSAs is limited, and the use of bibliometrics and follow-on funding is minimal. Objective: This study seeks to evaluate scholarly productivity, impact, and collaboration using bibliometrics and federal follow-on funding of KL2 scholars from 3 CTSA hubs and to define and assess CTR training success indicators. Methods: The sample included KL2 scholars from 3 CTSA institutions (A-C). Bibliometric data for each scholar in the sample were collected from both SciVal and iCite, including scholarly productivity, citation impact, and research collaboration. Three federal follow-on funding measures (at the 5-year, 8-year, and overall time points) were collected internally and confirmed by examining a federal funding database. Both descriptive and inferential statistical analyses were computed using SPSS to assess the bibliometric and federal follow-on funding results. Results: A total of 143 KL2 scholars were included in the sample with relatively equal groups across the 3 CTSA institutions. The included KL2 scholars produced more publications and citation counts per year on average at the 8-year time point (3.75 publications and 26.44 citation counts) than the 5-year time point (3.4 publications vs 26.16 citation counts). Overall, the KL2 publications from all 3 institutions were cited twice as much as others in their fields based on the relative citation ratio. KL2 scholars published work with researchers from other US institutions over 2 times (5-year time point) or 3.5 times (8-year time point) more than others in their research fields. Within 5 years and 8 years postmatriculation, 44.1% (63/143) and 51.7% (74/143) of KL2 scholars achieved federal funding, respectively. The KL2-scholars of Institution C had a significantly higher citation rate per publication than the other institutions (P<.001). Institution A had a significantly lower rate of nationally field-weighted collaboration than did the other institutions (P<.001). Institution B scholars were more likely to have received federal funding than scholars at Institution A or C (P<.001). Conclusions: Multi-institutional data showed a high level of scholarly productivity, impact, collaboration, and federal follow-on funding achieved by KL2 scholars. This study provides insights on the use of bibliometric and federal follow-on funding data to evaluate CTR training success across institutions. CTSA KL2 programs and other CTR career training programs can benefit from these findings in terms of understanding metrics of career success and using that knowledge to develop highly targeted strategies to support early-stage career development of CTR investigators. %M 34586077 %R 10.2196/29239 %U https://www.jmir.org/2021/9/e29239 %U https://doi.org/10.2196/29239 %U http://www.ncbi.nlm.nih.gov/pubmed/34586077 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 7 %N 3 %P e29157 %T Creation of a Student-Run Medical Education Podcast: Tutorial %A Milligan,Kevin John %A Daulton,Robert Scott %A St Clair,Zachary Taylor %A Epperson,Madison Veronica %A Holloway,Rachel Mackenzie %A Schlaudecker,Jeffrey David %+ University of Cincinnati College of Medicine, 3230 Eden Ave, Cincinnati, OH, 45267, United States, 1 5135587333, milligkj@mail.uc.edu %K podcast %K medical student %K near-peer %K medical education %D 2021 %7 8.7.2021 %9 Tutorial %J JMIR Med Educ %G English %X Background: Podcasting has become a popular medium for medical education content. Educators and trainees of all levels are turning to podcasts for high-quality, asynchronous content. Although numerous medical education podcasts have emerged in recent years, few student-run podcasts exist. Student-run podcasts are a novel approach to supporting medical students. Near-peer mentoring has been shown to promote medical students’ personal and professional identity formation. Student-run podcasts offer a new medium for delivering near-peer advice to medical students in an enduring and accessible manner. Objective: This paper describes the creation of the UnsCripted Medicine Podcast—a student-run medical education podcast produced at the University of Cincinnati College of Medicine. Methods: The planning and preparatory phases spanned 6 months. Defining a target audience and establishing a podcast mission were key first steps. Efforts were directed toward securing funding; obtaining necessary equipment; and navigating the technical considerations of recording, editing, and publishing a podcast. In order to ensure that high professionalism standards were met, key partnerships were created with faculty from the College of Medicine. Results: The UnsCripted Medicine Podcast published 53 episodes in its first 2 years. The number of episodes released per month ranges from 0 to 5, with a mean of 2.0 episodes. The podcast has a Twitter account with 217 followers. The number of listeners who subscribed to the podcast via Apple Podcasts grew to 86 in the first year and then to 218 in the second year. The show has an average rating of 4.8 (out of 5) on Apple Podcasts, which is based on 24 ratings. The podcast has hosted 70 unique guests, including medical students, resident physicians, attending physicians, nurses, physicians’ family members, graduate medical education leadership, and educators. Conclusions: Medical student–run podcasts are a novel approach to supporting medical students and fostering professional identity formation. Podcasts are widely available and convenient for listeners. Additionally, podcast creators can publish content with lower barriers of entry compared to those of other forms of published content. Medical schools should consider supporting student podcast initiatives to allow for near-peer mentoring, augment the community, facilitate professional identity formation, and prepare the rising physician workforce for the technological frontier of medical education and practice. %M 34255694 %R 10.2196/29157 %U https://mededu.jmir.org/2021/3/e29157 %U https://doi.org/10.2196/29157 %U http://www.ncbi.nlm.nih.gov/pubmed/34255694 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 5 %N 1 %P e10400 %T Video-Based Communication Assessment: Development of an Innovative System for Assessing Clinician-Patient Communication %A Mazor,Kathleen M %A King,Ann M %A Hoppe,Ruth B %A Kochersberger,Annie O %A Yan,Jie %A Reim,Jesse D %+ Meyers Primary Care Institute, University of Massachusetts Medical School, Reliant Medical Group and Fallon Health Plan, 385 Grove St, Meyers Primary Care Institute, Worcester, MA, 01605, United States, 1 508 791 7392, Kathleen.mazor@umassmed.edu %K communication %K crowdsourcing %K health care %K mobile phone %K patient-centered care %K video-based communication assessment %D 2019 %7 14.02.2019 %9 Viewpoint %J JMIR Med Educ %G English %X Good clinician-patient communication is essential to provide quality health care and is key to patient-centered care. However, individuals and organizations seeking to improve in this area face significant challenges. A major barrier is the absence of an efficient system for assessing clinicians’ communication skills and providing meaningful, individual-level feedback. The purpose of this paper is to describe the design and creation of the Video-Based Communication Assessment (VCA), an innovative, flexible system for assessing and ultimately enhancing clinicians’ communication skills. We began by developing the VCA concept. Specifically, we determined that it should be convenient and efficient, accessible via computer, tablet, or smartphone; be case based, using video patient vignettes to which users respond as if speaking to the patient in the vignette; be flexible, allowing content to be tailored to the purpose of the assessment; allow incorporation of the patient’s voice by crowdsourcing ratings from analog patients; provide robust feedback including ratings, links to highly rated responses as examples, and learning points; and ultimately, have strong psychometric properties. We collected feedback on the concept and then proceeded to create the system. We identified several important research questions, which will be answered in subsequent studies. The VCA is a flexible, innovative system for assessing clinician-patient communication. It enables efficient sampling of clinicians’ communication skills, supports crowdsourced ratings of these spoken samples using analog patients, and offers multifaceted feedback reports. %M 30710460 %R 10.2196/10400 %U http://mededu.jmir.org/2019/1/e10400/ %U https://doi.org/10.2196/10400 %U http://www.ncbi.nlm.nih.gov/pubmed/30710460 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 4 %N 1 %P e7 %T Self-Reflected Well-Being via a Smartphone App in Clinical Medical Students: Feasibility Study %A Berryman,Elizabeth K %A Leonard,Daniel J %A Gray,Andrew R %A Pinnock,Ralph %A Taylor,Barry %+ Dunedin School of Medicine, University of Otago, PO Box 56, Dunedin, 9054, New Zealand, 64 274067940, berel235@student.otago.ac.nz %K mental health %K medical students %K medical education %K bullying %K teaching %K mhealth %D 2018 %7 07.03.2018 %9 Original Paper %J JMIR Med Educ %G English %X Background: Well-being in medical students has become an area of concern, with a number of studies reporting high rates of clinical depression, anxiety, burnout, and suicidal ideation in this population. Objective: The aim of this study was to increase awareness of well-being in medical students by using a smartphone app. The primary objective of this study was to determine the validity and feasibility of the Particip8 app for student self-reflected well-being data collection. Methods: Undergraduate medical students of the Dunedin School of Medicine were recruited into the study. They were asked to self-reflect daily on their well-being and to note what experiences they had encountered during that day. Qualitative data were also collected both before and after the study in the form of focus groups and “free-text” email surveys. All participants consented for the data collected to be anonymously reported to the medical faculty. Results: A total of 29 participants (69%, 20/29 female; 31%, 9/29 male; aged 21-30 years) were enrolled, with overall median compliance of 71% at the study day level. The self-reflected well-being scores were associated with both positive and negative experiences described by the participants, with most negative experiences associated with around 20% lower well-being scores for that day; the largest effect being “receiving feedback that was not constructive or helpful,” and the most positive experiences associated with around 20% higher scores for that day. Conclusions: The study of daily data collection via the Particip8 app was found to be feasible, and the self-reflected well-being scores showed validity against participant’s reflections of experiences during that day. %M 29514774 %R 10.2196/mededu.9128 %U http://mededu.jmir.org/2018/1/e7/ %U https://doi.org/10.2196/mededu.9128 %U http://www.ncbi.nlm.nih.gov/pubmed/29514774 %0 Journal Article %@ 2369-3762 %I JMIR Publications %V 2 %N 2 %P e14 %T A Critical Analysis of Anesthesiology Podcasts: Identifying Determinants of Success %A Singh,Devin %A Alam,Fahad %A Matava,Clyde %+ Sunnybrook Health Sciences Centre, Department of Anesthesia, University of Toronto, 2075 Bayview Avenue, Toronto, ON, M4N 3M5, Canada, 1 416 480 4864, fahad.alam@sunnybrook.ca %K anesthesia %K podcasts %K peer review %K success %K e-learning %K e-resources %D 2016 %7 17.08.2016 %9 Original Paper %J JMIR Med Educ %G English %X Background: Audio and video podcasts have gained popularity in recent years. Increasingly, podcasts are being used in the field of medicine as a tool to disseminate information. This format has multiple advantages including highly accessible creation tools, low distribution costs, and portability for the user. However, despite its ongoing use in medical education, there are no data describing factors associated with the success or quality of podcasts. Objective: The goal of the study was to assess the landscape of anesthesia podcasts in Canada and develop a methodology for evaluating the quality of the podcast. To achieve our objective, we identified the scope of podcasts in anesthesia specifically, constructed an algorithmic model for measuring success, and identified factors linked to both successful podcasts and a peer-review process. Methods: Independent reviewers performed a systematic search of anesthesia-related podcasts on iTunes Canada. Data and metrics recorded for each podcast included podcast’s authorship, number posted, podcast series duration, target audience, topics, and social media presence. Descriptive statistics summarized mined data, and univariate analysis was used to identify factors associated with podcast success and a peer-review process. Results: Twenty-two podcasts related to anesthesia were included in the final analysis. Less than a third (6/22=27%) were still active. The median longevity of the podcasts’ series was just 13 months (interquartile range: 1-39 months). Anesthesiologists were the target audience for 77% of podcast series with clinical topics being most commonly addressed. We defined a novel algorithm for measuring success: Podcast Success Index. Factors associated with a high Podcast Success Index included podcasts targeting fellows (Spearman R=0.434; P=.04), inclusion of professional topics (Spearman R=0.456-0.603; P=.01-.03), and the use of Twitter as a means of social media (Spearman R=0.453;P=.03). In addition, more than two-thirds (16/22=73%) of podcasts demonstrated evidence of peer review with podcasts targeting anesthesiologists most strongly associated with peer-reviewed podcasts (Spearman R=0.886; P=.004) Conclusions: We present the first report on the scope of anesthesia podcasts in Canada. We have developed a novel tool for assessing the success of an anesthesiology podcast series and identified factors linked to this success measure as well as evidence of a peer-review process for a given podcast. To enable advancement in this area of anesthesia e-resources, podcast creators and users should consider factors associated with success when creating podcasts. The lack of these aspects may be associated with the early demise of a podcast series. %M 27731857 %R 10.2196/mededu.5950 %U http://mededu.jmir.org/2016/2/e14/ %U https://doi.org/10.2196/mededu.5950 %U http://www.ncbi.nlm.nih.gov/pubmed/27731857 %0 Journal Article %@ 2369-3762 %I JMIR Publications Inc. %V 1 %N 2 %P e14 %T Creating a Pilot Educational Psychiatry Website: Opportunities, Barriers, and Next Steps %A Torous,John %A O'Connor,Ryan %A Franzen,Jamie %A Snow,Caitlin %A Boland,Robert %A Kitts,Robert %+ Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, United States, 1 617 667 7000, jtorous@bidmc.harvard.edu %K Psychiatry %K Internet %K Online %K Education %K Website %D 2015 %7 05.11.2015 %9 Original Paper %J JMIR Medical Education %G English %X Background: While medical students and residents may be utilizing websites as online learning resources, medical trainees and educators now have the opportunity to create such educational websites and digital tools on their own. However, the process and theory of building educational websites for medical education have not yet been fully explored. Objective: To understand the opportunities, barriers, and process of creating a novel medical educational website. Methods: We created a pilot psychiatric educational website to better understand the options, opportunities, challenges, and processes involved in the creation of a psychiatric educational website. We sought to integrate visual and interactive Web design elements to underscore the potential of such Web technology. Results: A pilot website (PsychOnCall) was created to demonstrate the potential of Web technology in medical and psychiatric education. Conclusions: Creating an educational website is now technically easier than ever before, and the primary challenge no longer is technology but rather the creation, validation, and maintenance of information for such websites as well as translating text-based didactics into visual and interactive tools. Medical educators can influence the design and implementation of online educational resources through creating their own websites and engaging medical students and residents in the process. %M 27731837 %R 10.2196/mededu.4580 %U http://mededu.jmir.org/2015/2/e14/ %U https://doi.org/10.2196/mededu.4580 %U http://www.ncbi.nlm.nih.gov/pubmed/27731837 %0 Journal Article %@ 1438-8871 %I JMIR Publications Inc. %V 17 %N 10 %P e229 %T Medical Content Searching, Retrieving, and Sharing Over the Internet: Lessons Learned From the mEducator Through a Scenario-Based Evaluation %A Antoniades,Athos %A Nicolaidou,Iolie %A Spachos,Dimitris %A Mylläri,Jarkko %A Giordano,Daniela %A Dafli,Eleni %A Mitsopoulou,Evangelia %A Schizas,Christos N %A Pattichis,Constantinos %A Nikolaidou,Maria %A Bamidis,Panagiotis %+ Lab of Medical Physics, Medical School, Faculty of Health Sciences, Aristotle University of Thessaloniki, PO Box 376, Thessaloniki, 54124, Greece, 30 2310 999310, bamidis@med.auth.gr %K searching and sharing of medical educational content %K repurposing %K metadata %K evaluation %D 2015 %7 09.10.2015 %9 Original Paper %J J Med Internet Res %G English %X Background: The mEducator Best Practice Network (BPN) implemented and extended standards and reference models in e-learning to develop innovative frameworks as well as solutions that enable specialized state-of-the-art medical educational content to be discovered, retrieved, shared, and re-purposed across European Institutions, targeting medical students, doctors, educators and health care professionals. Scenario-based evaluation for usability testing, complemented with data from online questionnaires and field notes of users’ performance, was designed and utilized for the evaluation of these solutions. Objective: The objective of this work is twofold: (1) to describe one instantiation of the mEducator BPN solutions (mEducator3.0 - “MEdical Education LINnked Arena” MELINA+) with a focus on the metadata schema used, as well as on other aspects of the system that pertain to usability and acceptance, and (2) to present evaluation results on the suitability of the proposed metadata schema for searching, retrieving, and sharing of medical content and with respect to the overall usability and acceptance of the system from the target users. Methods: A comprehensive evaluation methodology framework was developed and applied to four case studies, which were conducted in four different countries (ie, Greece, Cyprus, Bulgaria and Romania), with a total of 126 participants. In these case studies, scenarios referring to creating, sharing, and retrieving medical educational content using mEducator3.0 were used. The data were collected through two online questionnaires, consisting of 36 closed-ended questions and two open-ended questions that referred to mEducator 3.0 and through the use of field notes during scenario-based evaluations. Results: The main findings of the study showed that even though the informational needs of the mEducator target groups were addressed to a satisfactory extent and the metadata schema supported content creation, sharing, and retrieval from an end-user perspective, users faced difficulties in achieving a shared understanding of the meaning of some metadata fields and in correctly managing the intellectual property rights of repurposed content. Conclusions: The results of this evaluation impact researchers, medical professionals, and designers interested in using similar systems for educational content sharing in medical and other domains. Recommendations on how to improve the search, retrieval, identification, and obtaining of medical resources are provided, by addressing issues of content description metadata, content description procedures, and intellectual property rights for re-purposed content. %M 26453250 %R 10.2196/jmir.3650 %U http://www.jmir.org/2015/10/e229/ %U https://doi.org/10.2196/jmir.3650 %U http://www.ncbi.nlm.nih.gov/pubmed/26453250