TY - JOUR AU - Madrid, Julian AU - Diehl, Philipp AU - Selig, Mischa AU - Rolauffs, Bernd AU - Hans, Patricius Felix AU - Busch, Hans-Jörg AU - Scheef, Tobias AU - Benning, Leo PY - 2025/3/21 TI - Performance of Plug-In Augmented ChatGPT and Its Ability to Quantify Uncertainty: Simulation Study on the German Medical Board Examination JO - JMIR Med Educ SP - e58375 VL - 11 KW - medical education KW - artificial intelligence KW - generative AI KW - large language model KW - LLM KW - ChatGPT KW - GPT-4 KW - board licensing examination KW - professional education KW - examination KW - student KW - experimental KW - bootstrapping KW - confidence interval N2 - Background: The GPT-4 is a large language model (LLM) trained and fine-tuned on an extensive dataset. After the public release of its predecessor in November 2022, the use of LLMs has seen a significant spike in interest, and a multitude of potential use cases have been proposed. In parallel, however, important limitations have been outlined. Particularly, current LLMs encounter limitations, especially in symbolic representation and accessing contemporary data. The recent version of GPT-4, alongside newly released plugin features, has been introduced to mitigate some of these limitations. Objective: Before this background, this work aims to investigate the performance of GPT-3.5, GPT-4, GPT-4 with plugins, and GPT-4 with plugins using pretranslated English text on the German medical board examination. Recognizing the critical importance of quantifying uncertainty for LLM applications in medicine, we furthermore assess this ability and develop a new metric termed ?confidence accuracy? to evaluate it. Methods: We used GPT-3.5, GPT-4, GPT-4 with plugins, and GPT-4 with plugins and translation to answer questions from the German medical board examination. Additionally, we conducted an analysis to assess how the models justify their answers, the accuracy of their responses, and the error structure of their answers. Bootstrapping and CIs were used to evaluate the statistical significance of our findings. Results: This study demonstrated that available GPT models, as LLM examples, exceeded the minimum competency threshold established by the German medical board for medical students to obtain board certification to practice medicine. Moreover, the models could assess the uncertainty in their responses, albeit exhibiting overconfidence. Additionally, this work unraveled certain justification and reasoning structures that emerge when GPT generates answers. Conclusions: The high performance of GPTs in answering medical questions positions it well for applications in academia and, potentially, clinical practice. Its capability to quantify uncertainty in answers suggests it could be a valuable artificial intelligence agent within the clinical decision-making loop. Nevertheless, significant challenges must be addressed before artificial intelligence agents can be robustly and safely implemented in the medical domain. UR - https://mededu.jmir.org/2025/1/e58375 UR - http://dx.doi.org/10.2196/58375 ID - info:doi/10.2196/58375 ER - TY - JOUR AU - Monzon, Noahlana AU - Hays, Alan Franklin PY - 2025/3/11 TI - Leveraging Generative Artificial Intelligence to Improve Motivation and Retrieval in Higher Education Learners JO - JMIR Med Educ SP - e59210 VL - 11 KW - educational technology KW - retrieval practice KW - flipped classroom KW - cognitive engagement KW - personalized learning KW - generative artificial intelligence KW - higher education KW - university education KW - learners KW - instructors KW - curriculum structure KW - learning KW - technologies KW - innovation KW - academic misconduct KW - gamification KW - self-directed KW - socio-economic disparities KW - interactive approach KW - medical education KW - chatGPT KW - machine learning KW - AI KW - large language models UR - https://mededu.jmir.org/2025/1/e59210 UR - http://dx.doi.org/10.2196/59210 ID - info:doi/10.2196/59210 ER - TY - JOUR AU - Nykiel-Bailey, Sydney AU - Burrows, Kathryn AU - Szafarowicz, E. Bianca AU - Moquin, Rachel PY - 2025/1/21 TI - Faculty Perceptions on the Roles of Mentoring, Advising, and Coaching in an Anesthesiology Residency Program: Mixed Methods Study JO - JMIR Med Educ SP - e60255 VL - 11 KW - coaching KW - faculty perceptions KW - mentoring KW - perception KW - medical education KW - anesthesia KW - modality KW - support KW - Washington University KW - university KW - coaching skills KW - training KW - culture change KW - culture KW - flexibility KW - systematic framework N2 - Background: Mentoring, advising, and coaching are essential components of resident education and professional development. Despite their importance, there is limited literature exploring how anesthesiology faculty perceive these practices and their role in supporting residents. Objective: This study aims to investigate anesthesiology faculty perspectives on the significance, implantation strategies, and challenges associated with mentorship, advising, and coaching in resident education. Methods: A comprehensive survey was administrated to 93 anesthesiology faculty members at Washington University School of Medicine. The survey incorporated quantitative Likert-scale questions and qualitative short-answer responses to assess faculty perceptions of the value, preferred formats, essential skills, and capacity for fulfilling multiple roles in these support practices. Additional areas of focus included the impact of staffing shortages, training requirements, and the potential of these practices to enhance faculty recruitment and retention. Results: The response rate was 44% (n=41). Mentoring was identified as the most important aspect, with 88% (n=36) of faculty respondents indicating its significance, followed by coaching, which was highlighted by 78% (n=32) of respondents. The majority felt 1 faculty member can effectively hold multiple roles for a given trainee. The respondents desired additional training for roles and found roles to be rewarding. All roles were seen as facilitating recruitment and retention. Barriers included faculty burnout; confusion between roles; time constraints; and desire for specialized training, especially in coaching skills. Conclusions: Implementing structured mentoring, advising, and coaching can profoundly impact resident education but requires role clarity, protected time, culture change, leadership buy-in, and faculty development. Targeted training and operational investments could enable programs to actualize immense benefits from high-quality resident support modalities. Respondents emphasized that resident needs evolve over time, necessitating flexibility in appropriate faculty guidance. While coaching demands unique skills, advising hinges on expertise and mentoring depends on relationship-building. Systematic frameworks of coaching, mentoring, and advising programs could unlock immense potential. However, realizing this vision demands surmounting barriers such as burnout, productivity pressures, confusion about logistics, and culture change. Ultimately, prioritizing resident support through high-quality personalized guidance can recenter graduate medical education. UR - https://mededu.jmir.org/2025/1/e60255 UR - http://dx.doi.org/10.2196/60255 ID - info:doi/10.2196/60255 ER - TY - JOUR AU - Wang, Ying-Mei AU - Shen, Hung-Wei AU - Chen, Tzeng-Ji AU - Chiang, Shu-Chiung AU - Lin, Ting-Guan PY - 2025/1/17 TI - Performance of ChatGPT-3.5 and ChatGPT-4 in the Taiwan National Pharmacist Licensing Examination: Comparative Evaluation Study JO - JMIR Med Educ SP - e56850 VL - 11 KW - artificial intelligence KW - ChatGPT KW - chat generative pre-trained transformer KW - GPT-4 KW - medical education KW - educational measurement KW - pharmacy licensure KW - Taiwan KW - Taiwan national pharmacist licensing examination KW - learning model KW - AI KW - Chatbot KW - pharmacist KW - evaluation and comparison study KW - pharmacy KW - statistical analyses KW - medical databases KW - medical decision-making KW - generative AI KW - machine learning N2 - Background: OpenAI released versions ChatGPT-3.5 and GPT-4 between 2022 and 2023. GPT-3.5 has demonstrated proficiency in various examinations, particularly the United States Medical Licensing Examination. However, GPT-4 has more advanced capabilities. Objective: This study aims to examine the efficacy of GPT-3.5 and GPT-4 within the Taiwan National Pharmacist Licensing Examination and to ascertain their utility and potential application in clinical pharmacy and education. Methods: The pharmacist examination in Taiwan consists of 2 stages: basic subjects and clinical subjects. In this study, exam questions were manually fed into the GPT-3.5 and GPT-4 models, and their responses were recorded; graphic-based questions were excluded. This study encompassed three steps: (1) determining the answering accuracy of GPT-3.5 and GPT-4, (2) categorizing question types and observing differences in model performance across these categories, and (3) comparing model performance on calculation and situational questions. Microsoft Excel and R software were used for statistical analyses. Results: GPT-4 achieved an accuracy rate of 72.9%, overshadowing GPT-3.5, which achieved 59.1% (P<.001). In the basic subjects category, GPT-4 significantly outperformed GPT-3.5 (73.4% vs 53.2%; P<.001). However, in clinical subjects, only minor differences in accuracy were observed. Specifically, GPT-4 outperformed GPT-3.5 in the calculation and situational questions. Conclusions: This study demonstrates that GPT-4 outperforms GPT-3.5 in the Taiwan National Pharmacist Licensing Examination, particularly in basic subjects. While GPT-4 shows potential for use in clinical practice and pharmacy education, its limitations warrant caution. Future research should focus on refining prompts, improving model stability, integrating medical databases, and designing questions that better assess student competence and minimize guessing. UR - https://mededu.jmir.org/2025/1/e56850 UR - http://dx.doi.org/10.2196/56850 ID - info:doi/10.2196/56850 ER - TY - JOUR AU - Ramos-García, Vanesa AU - Rivero-Santana, Amado AU - Peñate-Castro, Wenceslao AU - Álvarez-Pérez, Yolanda AU - Duarte-Díaz, Andrea AU - Torres-Castaño, Alezandra AU - Trujillo-Martín, Mar María del AU - González-González, Isabel Ana AU - Serrano-Aguilar, Pedro AU - Perestelo-Pérez, Lilisbeth PY - 2025/1/16 TI - A Brief Web-Based Person-Centered Care Group Training Program for the Management of Generalized Anxiety Disorder: Feasibility Randomized Controlled Trial in Spain JO - JMIR Med Educ SP - e50060 VL - 11 KW - person-centered care KW - primary care KW - shared decision-making KW - anxiety disorder KW - training program KW - SDM N2 - Background: Shared decision-making (SDM) is a crucial aspect of patient-centered care. While several SDM training programs for health care professionals have been developed, evaluation of their effectiveness is scarce, especially in mental health disorders such as generalized anxiety disorder. Objective: This study aims to assess the feasibility and impact of a brief training program on the attitudes toward SDM among primary care professionals who attend to patients with generalized anxiety disorder. Methods: A feasibility randomized controlled trial was conducted. Health care professionals recruited in primary care centers were randomized to an intervention group (training program) or a control group (waiting list). The intervention consisted of 2 web-based sessions applied by 2 psychologists (VR and YA), based on the integrated elements of the patient-centered care model and including group dynamics and video viewing. The outcome variable was the Leeds Attitudes Towards Concordance scale, second version (LATCon II), assessed at baseline and after the second session (3 months). After the randomized controlled trial phase, the control group also received the intervention and was assessed again. Results: Among 28 randomized participants, 5 withdrew before the baseline assessment. The intervention significantly increased their scores compared with the control group in the total scale (b=0.57; P=.018) and 2 subscales: communication or empathy (b=0.74; P=.036) and shared control (ie, patient participation in decisions: b=0.68; P=.040). The control group also showed significant pre-post changes after receiving the intervention. Conclusions: For a future effectiveness trial, it is necessary to improve the recruitment and retention strategies. The program produced a significant improvement in participants? attitude toward the SDM model, but due to this study?s limitations, mainly the small sample size, more research is warranted. UR - https://mededu.jmir.org/2025/1/e50060 UR - http://dx.doi.org/10.2196/50060 ID - info:doi/10.2196/50060 ER - TY - JOUR AU - Pei, Tao AU - Ding, Yinan AU - Tang, Jinsong AU - Liao, Yanhui PY - 2025/1/3 TI - Evaluating the Effectiveness of a Multimodal Psychotherapy Training Program for Medical Students in China: Protocol for a Randomized Controlled Trial JO - JMIR Res Protoc SP - e58037 VL - 14 KW - multimodal teaching KW - psychotherapy training KW - Chinese medical students KW - randomized controlled trial N2 - Background: Psychotherapy is central to the treatment of mental disorders, highlighting the importance of medical students and residents developing competencies in this area. Chinese medical residents have expressed a strong need for psychotherapy training, yet they are generally dissatisfied with the current offerings. This paper presents the protocol for an evidence-based, well-structured psychotherapy teaching program aimed at medical students and residents. Objective: This study involves a randomized controlled trial of a 2-day multimodal intensive educational intervention designed to evaluate the effectiveness of a new psychotherapy teaching program for medical students and residents in China. The primary outcomes include participants? knowledge and utilization of psychotherapy, training program acceptability, self-reported self-efficacy, and motivation to apply psychotherapy. Methods: This 2-arm randomized controlled trial was conducted at Sir Run Run Shaw Hospital. The study aimed to recruit approximately 160 medical students and residents, with about 80 participants in the intervention group and 80 in the control group. Both groups completed a baseline survey before participation, reporting their psychotherapy knowledge, utilization of psychotherapy, self-efficacy, and self-motivation. The intervention group received a 2-day multimodal intensive educational intervention (supervision-based online teaching), while the waitlist control group did not receive any intervention during this period. Both groups were followed up for 8 weeks, completing the same survey administered at baseline. At the end of the study, the control group received the intervention. The primary outcome measure was the change in trainees? psychotherapy knowledge before and after the intervention training. Secondary outcome measures included changes in the trainees? utilization of psychotherapy, self-reported self-efficacy, and self-reported motivation for psychotherapy. Additionally, training program acceptability was assessed. Analysis of covariance was used to analyze the primary outcomes. Pearson correlations and regression analysis explored factors associated with the knowledge score at baseline. The secondary outcomes, including participants? psychotherapy utilization, confidence, and motivation, were analyzed using the same methods as for knowledge. All tests were 2-tailed, with a significance level set at P<.05. Results: A total of 160 participants were recruited and randomized between January 4 and 12, 2024. Baseline assessments were conducted from January 28 to February 1, 2024. The psychotherapy training program for the intervention group took place on February 3 and 4, 2024. Posttraining assessments were conducted starting April 1, 2024. Due to withdrawals, incomplete surveys, and data loss, we had a total of 113 participants: 57 in the intervention group and 56 in the control group. The amount of data varied across measures. The data analysis was finished in August 2024. Conclusions: This study aims to evaluate the effectiveness of the multimodal psychotherapy training program for medical students in China. If this brief, cognitive behavioral therapy?based psychotherapy skill training proves effective, the potential mental health impact of its nationwide expansion could be significant. Trial Registration: ClinicalTrials.gov NCT06258460; https://clinicaltrials.gov/ct2/show/NCT06258460 International Registered Report Identifier (IRRID): DERR1-10.2196/58037 UR - https://www.researchprotocols.org/2025/1/e58037 UR - http://dx.doi.org/10.2196/58037 UR - http://www.ncbi.nlm.nih.gov/pubmed/39752191 ID - info:doi/10.2196/58037 ER - TY - JOUR AU - Tobiaszewska, Ma?gorzata AU - Koweszko, Tytus AU - Jurek, Jonasz AU - Miko?ap, Karolina AU - Gierus, Jacek AU - Mikulski, Jantoni AU - Waszkiewicz, Napoleon PY - 2024/12/31 TI - Personality Types of Medical Students in Terms of Their Choice of Medical Specialty: Cross-Sectional Study JO - Interact J Med Res SP - e60223 VL - 13 KW - personality type KW - characteristics KW - traits KW - psychology KW - psychometric KW - medical students KW - university KW - burnout KW - gender KW - preferences KW - professional KW - job KW - career KW - specialty KW - survey KW - questionnaire N2 - Background: Research on personality types among doctors reveals its impact on medical specialty choices, suggesting that considering personality in career planning may enhance work satisfaction and reduce burnout risks. Objective: This study, encompassing 2104 medical students, explores how personality types, traits, and gender relate to specialty preferences. Methods: Participants of this study were medical students from various universities in Poland. The study surveyed 2104 participants. Each participant completed a general questionnaire and a NERIS Type Explorer personality test, based on the Myers-Briggs Type Indicator inventory and the ?Big Five? personality traits concept. The questionnaire was distributed on social media groups for medical students from all Polish universities. An exploratory statistical analysis was performed to find relationships. For each tested relationship a Fisher exact test was conducted and the significance level was P<.05. Each test resulted in a P value and odds ratio (OR) with a CI. To ensure we included undecided students and obtained meaningful data, we allowed participants to select up to three medical specialties from the 77 available in Poland at the time of the study. Results: The findings unveil significant relationships between gender, personality types, traits, and specialty preferences. Women tended to favor Neonatology (OR 9.15, 95% CI 3.02-45.46), while men leaned toward Orthopedics and traumatology of the locomotor system (OR 7.53, 95% CI 4.87-11.94). Extroverted, Intuitive, Feeling, Prospecting, and Turbulent students showed a heightened interest in Psychiatry (OR 2.23, 95% CI 1.64-3.01), whereas Introverted, Observant, Feeling, Judging, and Turbulent types favored Family Medicine (OR 2.98, 95% CI 2.08-4.24) and Pediatrics (OR 2.13, 95% CI 1.51-2.99). Conclusions: In conclusion, this research establishes a link between personality and medical specialty selection. Taking into account the significant role of personality traits, it should be considered to integrate them into the process of selecting a medical career or designing a medical curriculum. This approach may allow for the customization of programs to match students? traits, thereby cultivating improved clinical communication skills, fostering interprofessional collaboration and ultimately enhancing treatment outcomes and professional fulfillment among physicians. The main limitation of this study is that it was conducted on medical students, who lack the full knowledge of the work as a specific specialist. A study surveying medical doctors with longer internships across different wards could be conducted to check for any variabilities. Moreover, there are other significant factors that influence one?s medical specialty choice. Certainly, this area could be further explored. UR - https://www.i-jmr.org/2024/1/e60223 UR - http://dx.doi.org/10.2196/60223 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/60223 ER - TY - JOUR AU - Wang, Y. Ellen AU - Qian, Daniel AU - Zhang, Lijin AU - Li, S-K Brian AU - Ko, Brian AU - Khoury, Michael AU - Renavikar, Meghana AU - Ganesan, Avani AU - Caruso, J. Thomas PY - 2024/12/23 TI - Acceptance of Virtual Reality in Trainees Using a Technology Acceptance Model: Survey Study JO - JMIR Med Educ SP - e60767 VL - 10 KW - virtual reality KW - technology assessment KW - graduate medical education trainees KW - medical education KW - technology adoption KW - Technology Acceptance Model KW - factor analysis KW - VR KW - TAM KW - United Theory of Acceptance and Use of Technology KW - UTAUT N2 - Background: Virtual reality (VR) technologies have demonstrated therapeutic usefulness across a variety of health care settings. However, graduate medical education (GME) trainee perspectives on VR acceptability and usability are limited. The behavioral intentions of GME trainees with regard to VR as an anxiolytic tool have not been characterized through a theoretical framework of technology adoption. Objective: The primary aim of this study was to apply a hybrid Technology Acceptance Model (TAM) and a United Theory of Acceptance and Use of Technology (UTAUT) model to evaluate factors that predict the behavioral intentions of GME trainees to use VR for patient anxiolysis. The secondary aim was to assess the reliability of the TAM-UTAUT. Methods: Participants were surveyed in June 2023. GME trainees participated in a VR experience used to reduce perioperative anxiety. Participants then completed a survey evaluating demographics, perceptions, attitudes, environmental factors, and behavioral intentions that influence the adoption of new technologies. Results: In total, 202 of 1540 GME trainees participated. Only 198 participants were included in the final analysis (12.9% participation rate). Perceptions of usefulness, ease of use, and enjoyment; social influence; and facilitating conditions predicted intention to use VR. Age, past use, price willing to pay, and curiosity were less strong predictors of intention to use. All confirmatory factor analysis models demonstrated a good fit. All domain measurements demonstrated acceptable reliability. Conclusions: This TAM-UTAUT demonstrated validity and reliability for predicting the behavioral intentions of GME trainees to use VR as a therapeutic anxiolytic in clinical practice. Social influence and facilitating conditions are modifiable factors that present opportunities to advance VR adoption, such as fostering exposure to new technologies and offering relevant training and social encouragement. Future investigations should study the model?s reliability within specialties in different geographic locations. UR - https://mededu.jmir.org/2024/1/e60767 UR - http://dx.doi.org/10.2196/60767 ID - info:doi/10.2196/60767 ER - TY - JOUR AU - Xie, Yao AU - Fadahunsi, Philip Kayode AU - Flynn, Paul AU - Taylor-Robinson, Simon AU - Gallagher, Joseph AU - Cullen, Walter AU - O'Donoghue, John PY - 2024/12/11 TI - Barriers and Facilitators of International Health Care Students? Well-Being in Higher Education: Protocol for a Systematic Integrative Review JO - JMIR Res Protoc SP - e59927 VL - 13 KW - integrative review KW - higher education KW - international students KW - educational migrants KW - barriers KW - facilitators KW - well-being KW - mixed methods synthesis KW - health care students KW - health care education N2 - Background: International health care students encounter unique hurdles as they pursue education in foreign countries. These challenges, stemming from adjustment to new cultural environments and stressful academic programs, significantly impact their well-being. Understanding the barriers and facilitators experienced by international health care students is crucial for ensuring their successful integration into academic and professional spheres. Most existing reviews focus on specific populations or disciplines, thus limiting their generalizability. Objective: This systematic integrative review aims to provide a comprehensive understanding of barriers and facilitators of international health care students? well-being in higher education. Methods: The protocol follows the Joanna Briggs Institute?s guidance for a mixed methods systematic review. The main information sources will include PubMed, Scopus, Web of Science, and EBSCOhost, supplemented with manual reference search and citation tracking using Google Scholar. The study selection will be done independently by 2 reviewers based on predetermined eligibility criteria. The study population will consist of international higher education students enrolled in human health?related disciplines including medicine, pharmacy, nursing, and allied health care fields. Qualitative and quantitative data relating to barriers and facilitators of international health care students? well-being will be extracted using a customized data extraction template in Covidence review management software. Quantitative data will be ?qualitized? and integrated with qualitative data using a convergent integrated approach, as described in the Joanna Briggs Institute?s guidance. The integrated data will then be synthesized using a thematic analysis approach to provide a comprehensive understanding of barriers and facilitators of international health care students? well-being. Results: The initial literature search yielded 2408 papers from the selected databases. The findings of this review will be presented in a narrative format, supported by visualizations such as tables and diagrams. The review is expected to be completed by December 2024. Conclusions: This systematic integrative review will identify barriers and facilitators of international health care students? well-being in higher education. The findings could inform the development of targeted interventions and support initiatives in higher education institutions globally, with the ultimate goal of enhancing the well-being as well as the academic and professional success of international health care students. Trial Registration: PROSPERO CRD42024372785; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42024372785 International Registered Report Identifier (IRRID): PRR1-10.2196/59927 UR - https://www.researchprotocols.org/2024/1/e59927 UR - http://dx.doi.org/10.2196/59927 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/59927 ER - TY - JOUR AU - Yokokawa, Daiki AU - Shikino, Kiyoshi AU - Nishizaki, Yuji AU - Fukui, Sho AU - Tokuda, Yasuharu PY - 2024/12/5 TI - Evaluation of a Computer-Based Morphological Analysis Method for Free-Text Responses in the General Medicine In-Training Examination: Algorithm Validation Study JO - JMIR Med Educ SP - e52068 VL - 10 KW - General Medicine In-Training Examination KW - free-text response KW - morphological analysis KW - Situation, Background, Assessment, and Recommendation KW - video-based question N2 - Background: The General Medicine In-Training Examination (GM-ITE) tests clinical knowledge in a 2-year postgraduate residency program in Japan. In the academic year 2021, as a domain of medical safety, the GM-ITE included questions regarding the diagnosis from medical history and physical findings through video viewing and the skills in presenting a case. Examinees watched a video or audio recording of a patient examination and provided free-text responses. However, the human cost of scoring free-text answers may limit the implementation of GM-ITE. A simple morphological analysis and word-matching model, thus, can be used to score free-text responses. Objective: This study aimed to compare human versus computer scoring of free-text responses and qualitatively evaluate the discrepancies between human- and machine-generated scores to assess the efficacy of machine scoring. Methods: After obtaining consent for participation in the study, the authors used text data from residents who voluntarily answered the GM-ITE patient reproduction video-based questions involving simulated patients. The GM-ITE used video-based questions to simulate a patient?s consultation in the emergency room with a diagnosis of pulmonary embolism following a fracture. Residents provided statements for the case presentation. We obtained human-generated scores by collating the results of 2 independent scorers and machine-generated scores by converting the free-text responses into a word sequence through segmentation and morphological analysis and matching them with a prepared list of correct answers in 2022. Results: Of the 104 responses collected?63 for postgraduate year 1 and 41 for postgraduate year 2?39 cases remained for final analysis after excluding invalid responses. The authors found discrepancies between human and machine scoring in 14 questions (7.2%); some were due to shortcomings in machine scoring that could be resolved by maintaining a list of correct words and dictionaries, whereas others were due to human error. Conclusions: Machine scoring is comparable to human scoring. It requires a simple program and calibration but can potentially reduce the cost of scoring free-text responses. UR - https://mededu.jmir.org/2024/1/e52068 UR - http://dx.doi.org/10.2196/52068 ID - info:doi/10.2196/52068 ER - TY - JOUR AU - Wang, Difan AU - Lin, Bingyan AU - Zhang, Shuangxi AU - Xu, Wei AU - Liu, Xinying PY - 2024/12/4 TI - Effectiveness of an Internet-Based Self-Help Acceptance and Commitment Therapy Program on Medical Students? Mental Well-Being: Follow-Up Randomized Controlled Trial JO - J Med Internet Res SP - e50664 VL - 26 KW - internet-delivered self-help acceptance and commitment therapy KW - depression KW - anxiety KW - stress KW - psychological inflexibility KW - obsessive-compulsive symptoms KW - medical students KW - iACT 2.0 program N2 - Background: Psychological distress is a growing problem among medical students worldwide. This highlights the need for psychological interventions to focus on mental health and improve well-being in this population. Objective: This study developed an internet-based, self-help, acceptance and commitment therapy program (iACT 2.0), aiming to examine its effectiveness in reducing depression, anxiety, stress, psychological inflexibility (PI), and obsessive-compulsive symptoms (OCSs) among medical students. Methods: A total of 520 Chinese postgraduate medical students were randomly assigned to either an iACT 2.0 intervention group (n=260; six online lessons, once every 5 days) or a control condition (n=260; without intervention). Participants completed questionnaires including the 21-item Depression Anxiety Stress Scale, the revised Obsessive-Compulsive Inventory, and the Multidimensional Psychological Flexibility Inventory at the preintervention (T1), postintervention (T2), and 1-month follow-up time points (T3). No therapist support was provided during the 1-month iACT 2.0 intervention period. Data were collected via an online platform and analyzed using repeated-measures ANOVA. Results: Participants in the intervention group demonstrated a significant decrease in depression, anxiety, stress, PI, and OCSs compared to the control group after the intervention (F=22.9-672.04, all P<.001). Specifically, the intervention group showed significant reductions in all measured outcomes from the preintervention to postintervention time point and at the 1-month follow-up (all P<.001). In contrast, no significant changes were observed in the control group over the same period (all P>.05). The groups did not differ significantly at baseline (all P>.05). Significant differences were noted at both the postintervention and follow-up time points (all P<.001). Conclusions: This study demonstrated that the newly developed iACT 2.0 was effective in reducing depression, anxiety, stress, PI, and OCSs. Notably, the positive effects of the intervention persisted at the 1-month follow-up. This program can offer a useful addition to existing mental illness treatment and lead to improvements in clinical and psychotherapy planning while simultaneously reducing the burden on traditional counseling and services. Trial Registration: Chinese Clinical Trial Registry ChiCTR2300070725; https://tinyurl.com/2h75wx8n UR - https://www.jmir.org/2024/1/e50664 UR - http://dx.doi.org/10.2196/50664 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/50664 ER - TY - JOUR AU - Jin, Kyung Hye AU - Kim, EunYoung PY - 2024/12/4 TI - Performance of GPT-3.5 and GPT-4 on the Korean Pharmacist Licensing Examination: Comparison Study JO - JMIR Med Educ SP - e57451 VL - 10 KW - GPT-3.5 KW - GPT-4 KW - Korean KW - Korean Pharmacist Licensing Examination KW - KPLE N2 - Background: ChatGPT, a recently developed artificial intelligence chatbot and a notable large language model, has demonstrated improved performance on medical field examinations. However, there is currently little research on its efficacy in languages other than English or in pharmacy-related examinations. Objective: This study aimed to evaluate the performance of GPT models on the Korean Pharmacist Licensing Examination (KPLE). Methods: We evaluated the percentage of correct answers provided by 2 different versions of ChatGPT (GPT-3.5 and GPT-4) for all multiple-choice single-answer KPLE questions, excluding image-based questions. In total, 320, 317, and 323 questions from the 2021, 2022, and 2023 KPLEs, respectively, were included in the final analysis, which consisted of 4 units: Biopharmacy, Industrial Pharmacy, Clinical and Practical Pharmacy, and Medical Health Legislation. Results: The 3-year average percentage of correct answers was 86.5% (830/960) for GPT-4 and 60.7% (583/960) for GPT-3.5. GPT model accuracy was highest in Biopharmacy (GPT-3.5 77/96, 80.2% in 2022; GPT-4 87/90, 96.7% in 2021) and lowest in Medical Health Legislation (GPT-3.5 8/20, 40% in 2022; GPT-4 12/20, 60% in 2022). Additionally, when comparing the performance of artificial intelligence with that of human participants, pharmacy students outperformed GPT-3.5 but not GPT-4. Conclusions: In the last 3 years, GPT models have performed very close to or exceeded the passing threshold for the KPLE. This study demonstrates the potential of large language models in the pharmacy domain; however, extensive research is needed to evaluate their reliability and ensure their secure application in pharmacy contexts due to several inherent challenges. Addressing these limitations could make GPT models more effective auxiliary tools for pharmacy education. UR - https://mededu.jmir.org/2024/1/e57451 UR - http://dx.doi.org/10.2196/57451 ID - info:doi/10.2196/57451 ER - TY - JOUR AU - Luo, Yuan AU - Miao, Yiqun AU - Zhao, Yuhan AU - Li, Jiawei AU - Chen, Yuling AU - Yue, Yuexue AU - Wu, Ying PY - 2024/12/2 TI - Comparing the Accuracy of Two Generated Large Language Models in Identifying Health-Related Rumors or Misconceptions and the Applicability in Health Science Popularization: Proof-of-Concept Study JO - JMIR Form Res SP - e63188 VL - 8 KW - rumor KW - misconception KW - health science popularization KW - health education KW - large language model KW - LLM KW - applicability KW - accuracy KW - effectiveness KW - health related KW - education KW - health science KW - proof of concept N2 - Background: Health-related rumors and misconceptions are spreading at an alarming rate, fueled by the rapid development of the internet and the exponential growth of social media platforms. This phenomenon has become a pressing global concern, as the dissemination of false information can have severe consequences, including widespread panic, social instability, and even public health crises. Objective: The aim of the study is to compare the accuracy of rumor identification and the effectiveness of health science popularization between 2 generated large language models in Chinese (GPT-4 by OpenAI and Enhanced Representation through Knowledge Integration Bot [ERNIE Bot] 4.0 by Baidu). Methods: In total, 20 health rumors and misconceptions, along with 10 health truths, were randomly inputted into GPT-4 and ERNIE Bot 4.0. We prompted them to determine whether the statements were rumors or misconceptions and provide explanations for their judgment. Further, we asked them to generate a health science popularization essay. We evaluated the outcomes in terms of accuracy, effectiveness, readability, and applicability. Accuracy was assessed by the rate of correctly identifying health-related rumors, misconceptions, and truths. Effectiveness was determined by the accuracy of the generated explanation, which was assessed collaboratively by 2 research team members with a PhD in nursing. Readability was calculated by the readability formula of Chinese health education materials. Applicability was evaluated by the Chinese Suitability Assessment of Materials. Results: GPT-4 and ERNIE Bot 4.0 correctly identified all health rumors and misconceptions (100% accuracy rate). For truths, the accuracy rate was 70% (7/10) and 100% (10/10), respectively. Both mostly provided widely recognized viewpoints without obvious errors. The average readability score for the health essays was 2.92 (SD 0.85) for GPT-4 and 3.02 (SD 0.84) for ERNIE Bot 4.0 (P=.65). For applicability, except for the content and cultural appropriateness category, significant differences were observed in the total score and scores in other dimensions between them (P<.05). Conclusions: ERNIE Bot 4.0 demonstrated similar accuracy to GPT-4 in identifying Chinese rumors. Both provided widely accepted views, despite some inaccuracies. These insights enhance understanding and correct misunderstandings. For health essays, educators can learn from readable language styles of GLLMs. Finally, ERNIE Bot 4.0 aligns with Chinese expression habits, making it a good choice for a better Chinese reading experience. UR - https://formative.jmir.org/2024/1/e63188 UR - http://dx.doi.org/10.2196/63188 ID - info:doi/10.2196/63188 ER - TY - JOUR AU - Dixon, Eric AU - Pannu, Jayden AU - Dhaliwal, Kabir AU - Cheng, Rachel AU - Deol, Gurpal AU - Frangos, Sophie AU - Tawil, Emma AU - Oliveira, Ana AU - Wojkowski, Sarah AU - Quach, Shirley PY - 2024/11/20 TI - Effects of Interprofessional Education on Readiness for Interprofessional Learning in Rehabilitation Science Students From Professional Health Care Programs: Protocol for a Systematic Review JO - JMIR Res Protoc SP - e60830 VL - 13 KW - interprofessional education KW - rehabilitation science KW - health care students KW - interprofessional collaboration KW - prelicensure health care professionals KW - patient care KW - interdisciplinary education KW - rehabilitation education KW - curriculum development KW - team-based learning N2 - Background: The World Health Organization defines interprofessional education (IPE) as a process in which students from different health care programs work together to provide effective care while deepening their knowledge of each other?s roles. Previous literature shows a strong argument for early exposure to IPE as a facilitator for high quality patient care. The goal of IPE is to improve interprofessional collaboration (IPC), the ?gold standard? of care to enhance patients' quality of life, functional ability, and health status, especially for patients who require expertise from a variety of health care professionals. IPC has shown improvements in quality of life, functional ability, and health status. IPE can occur in the form of structured interventions or spontaneously in student placements. Literature has demonstrated that IPE facilitates skill, knowledge development, teamwork, communication skills, and mutual respect among health care professional students. Objective: This systematic review aims to examine IPE outcomes, including readiness for IPC, IPE perceptions, attitudes toward collaborative learning, student confidence, practice efficiency, and team dynamics after IPE interventions in rehabilitation science students. Methods: The study will be conducted as outlined by the Cochrane Handbook for Systematic Reviews and will be reported per the PRISMA (Preferred Reporting of Items for Systematic Reviews and Meta-Analyses) 2015 guidelines. Students have performed literature searches across the databases MEDLINE, Embase, CINAHL, ERIC, Web of Science, and AMED. Studies will be included if their IPE intervention included multiple prelicensure health care professional students in a health care or health care education setting. Based on timelines presented in the Institute of Medicine?s report on the impacts of IPE, relevant studies from 2016 to the present will be included. The Risk of Bias 2 tool will be used to study sources of bias. The GRADE (Grading of Recommendations, Assessment, Development, and Evaluation) working group?s methods will be used to evaluate the quality of the evidence presented. The final 3 authors are assisting as supervisors, providing oversight and feedback as needed. Any deviations from this protocol will be reported in the final paper. Results: The search strategy was finalized and searched across the databases by March 8, 2024. The systematic review was registered with PROSPERO on March 31, 2024. A total of 10,692 citations were retrieved for abstract and title screening, beginning in March 2024, and 756 were eligible for full-text screening in April 2024. Six articles were considered for inclusion and data extraction, which began in July 2024. Finalization of the extracted data and paper will occur in September 2024. Conclusions: This systematic review will provide a summary of the effects of IPE interventions in prelicensure rehabilitation science students. It will provide educators, health care providers, and students with valuable information for understanding the relevance of IPE. It will also shed light on research gaps and highlight areas for further study. Trial Registration: PROSPERO CRD42024506081; https://tinyurl.com/3tf2h9er International Registered Report Identifier (IRRID): PRR1-10.2196/60830 UR - https://www.researchprotocols.org/2024/1/e60830 UR - http://dx.doi.org/10.2196/60830 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/60830 ER - TY - JOUR AU - Lee, Allison AU - Goodman, Stephanie AU - Chen, Miao Chen AU - Landau, Ruth AU - Chatterji, Madhabi PY - 2024/11/19 TI - Electronic Feedback Alone Versus Electronic Feedback Plus in-Person Debriefing for a Serious Game Designed to Teach Novice Anesthesiology Residents to Perform General Anesthesia for Cesarean Delivery: Randomized Controlled Trial JO - JMIR Serious Games SP - e59047 VL - 12 KW - general anesthesia KW - cesarean delivery KW - multiple choice questions KW - serious game KW - debriefing KW - feedback KW - anesthesia KW - anesthesiology KW - anesthesiologist KW - anesthetist KW - cesarean KW - EmergenCSim KW - randomized controlled trial N2 - Background: EmergenCSim is a novel researcher-developed serious game (SG) with an embedded scoring and feedback tool that reproduces an obstetric operating room environment. The learner must perform general anesthesia for emergent cesarean delivery for umbilical cord prolapse. The game was developed as an alternative teaching tool because of diminishing real-world exposure of anesthesiology trainees to this clinical scenario. Traditional debriefing (facilitator-guided reflection) is considered to be integral to experiential learning but requires the participation of an instructor. The optimal debriefing methods for SGs have not been well studied. Electronic feedback is commonly provided at the conclusion of SGs, so we aimed to compare the effectiveness of learning when an in-person debrief is added to electronic feedback compared with using electronic feedback alone. Objective: We hypothesized that an in-person debriefing in addition to the SG-embedded electronic feedback will provide superior learning than electronic feedback alone. Methods: Novice first-year anesthesiology residents (CA-1; n=51) (1) watched a recorded lecture on general anesthesia for emergent cesarean delivery, (2) took a 26-item multiple-choice question pretest, and (3) played EmergenCSim (maximum score of 196.5). They were randomized to either the control group that experienced the electronic feedback alone (group EF, n=26) or the intervention group that experienced the SG-embedded electronic feedback and an in-person debriefing (group IPD+EF, n=25). All participants played the SG a second time, with instructions to try to increase their score, and then they took a 26-item multiple-choice question posttest. Pre- and posttests (maximum score of 26 points each) were validated parallel forms. Results: For groups EF and IPD+EF, respectively, mean pretest scores were 18.6 (SD 2.5) and 19.4 (SD 2.3), and mean posttest scores were 22.6 (SD 2.2) and 22.1 (SD 1.6; F1,49=1.8, P=.19). SG scores for groups EF and IPD+EF, respectively, were?mean first play SG scores of 135 (SE 4.4) and 141 (SE 4.5), and mean second play SG scores of 163.1 (SE 2.9) and 173.3 (SE 2.9; F1,49=137.7, P<.001). Conclusions: Adding an in-person debriefing experience led to greater improvement in SG scores, emphasizing the learning benefits of this practice. Improved SG performance in both groups suggests that SGs have a role as independent, less resource-intensive educational tools. UR - https://games.jmir.org/2024/1/e59047 UR - http://dx.doi.org/10.2196/59047 ID - info:doi/10.2196/59047 ER - TY - JOUR AU - Mun, Michelle AU - Chanchlani, Sonia AU - Lyons, Kayley AU - Gray, Kathleen PY - 2024/10/31 TI - Transforming the Future of Digital Health Education: Redesign of a Graduate Program Using Competency Mapping JO - JMIR Med Educ SP - e54112 VL - 10 KW - digital health KW - digital transformation KW - health care KW - clinical informatics KW - competencies KW - graduate education UR - https://mededu.jmir.org/2024/1/e54112 UR - http://dx.doi.org/10.2196/54112 ID - info:doi/10.2196/54112 ER - TY - JOUR AU - Devlin, M. Paulina AU - Akingbola, Oluwabukola AU - Stonehocker, Jody AU - Fitzgerald, T. James AU - Winkel, Ford Abigail AU - Hammoud, M. Maya AU - Morgan, K. Helen PY - 2024/10/21 TI - Opportunities to Improve Communication With Residency Applicants: Cross-Sectional Study of Obstetrics and Gynecology Residency Program Websites JO - JMIR Med Educ SP - e48518 VL - 10 KW - obstetrics and gynecology KW - residency program KW - residency application KW - website KW - program signals KW - communication best practices N2 - Background: As part of the residency application process in the United States, many medical specialties now offer applicants the opportunity to send program signals that indicate high interest to a limited number of residency programs. To determine which residency programs to apply to, and which programs to send signals to, applicants need accurate information to determine which programs align with their future training goals. Most applicants use a program?s website to review program characteristics and criteria, so describing the current state of residency program websites can inform programs of best practices. Objective: This study aims to characterize information available on obstetrics and gynecology residency program websites and to determine whether there are differences in information available between different types of residency programs. Methods: This was a cross-sectional observational study of all US obstetrics and gynecology residency program website content. The authorship group identified factors that would be useful for residency applicants around program demographics and learner trajectories; application criteria including standardized testing metrics, residency statistics, and benefits; and diversity, equity, and inclusion mission statements and values. Two authors examined all available websites from November 2011 through March 2022. Data analysis consisted of descriptive statistics and one-way ANOVA, with P<.05 considered significant. Results: Among 290 programs, 283 (97.6%) had websites; 238 (82.1%) listed medical schools of current residents; 158 (54.5%) described residency alumni trajectories; 107 (36.9%) included guidance related to the preferred United States Medical Licensing Examination Step 1 scores; 53 (18.3%) included guidance related to the Comprehensive Osteopathic Medical Licensing Examination Level 1 scores; 185 (63.8%) included international applicant guidance; 132 (45.5%) included a program-specific mission statement; 84 (29%) included a diversity, equity, and inclusion statement; and 167 (57.6%) included program-specific media or links to program social media on their websites. University-based programs were more likely to include a variety of information compared to community-based university-affiliated and community-based programs, including medical schools of current residents (113/123, 91.9%, university-based; 85/111, 76.6%, community-based university-affiliated; 40/56, 71.4%, community-based; P<.001); alumni trajectories (90/123, 73.2%, university-based; 51/111, 45.9%, community-based university-affiliated; 17/56, 30.4%, community-based; P<.001); the United States Medical Licensing Examination Step 1 score guidance (58/123, 47.2%, university-based; 36/111, 32.4%, community-based university-affiliated; 13/56, 23.2%, community-based; P=.004); and diversity, equity, and inclusion statements (57/123, 46.3%, university-based; 19/111, 17.1%, community-based university-affiliated; 8/56, 14.3%, community-based; P<.001). Conclusions: There are opportunities to improve the quantity and quality of data on residency websites. From this work, we propose best practices for what information should be included on residency websites that will enable applicants to make informed decisions. UR - https://mededu.jmir.org/2024/1/e48518 UR - http://dx.doi.org/10.2196/48518 ID - info:doi/10.2196/48518 ER - TY - JOUR AU - Martinengo, Laura AU - Ng, Peng Matthew Song AU - Ng, Rong Tony De AU - Ang, Yi-Ian AU - Jabir, Ishqi Ahmad AU - Kyaw, Myint Bhone AU - Tudor Car, Lorainne PY - 2024/10/10 TI - Spaced Digital Education for Health Professionals: Systematic Review and Meta-Analysis JO - J Med Internet Res SP - e57760 VL - 26 KW - digital education KW - e-learning KW - spaced education KW - spaced learning KW - spaced digital education KW - spaced simulation KW - health care professionals KW - continuous medical education KW - systematic review KW - meta-analysis N2 - Background: Spaced digital education applies digital tools to deliver educational content via multiple, repeated learning sessions separated by prespecified time intervals. Spaced digital education appears to promote acquisition and long-term retention of knowledge, skills, and change in clinical behavior. Objective: The aim of this review was to assess the effectiveness of spaced digital education in improving pre- and postregistration health care professionals? knowledge, skills, attitudes, satisfaction, and change in clinical behavior. Methods: This review followed Cochrane?s methodology and PRISMA (Preferred Reporting Items of Systematic Reviews and Meta-Analyses) reporting guidelines. We searched MEDLINE, Embase, Web of Science, ERIC, PsycINFO, CINAHL, CENTRAL, and ProQuest Dissertation and Theses databases from January 1990 to February 2023. We included randomized controlled trials (RCTs), cluster RCTs, and quasi-RCTs comparing spaced digital education with nonspaced education, spaced nondigital education, traditional learning, or no intervention for pre- or postregistration health care professionals. Study selection, data extraction, study quality, and certainty of evidence were assessed by 2 independent reviewers. Meta-analyses were conducted using random effect models. Results: We included 23 studies evaluating spaced online education (n=17, 74%) or spaced digital simulation (n=6, 26%) interventions. Most studies assessed 1 or 2 outcomes, including knowledge (n=15, 65%), skills (n=9, 39%), attitudes (n=8, 35%), clinical behavior change (n=8, 35%), and satisfaction (n=7, 30%). Most studies had an unclear or a high risk of bias (n=19, 83%). Spaced online education was superior to massed online education for postintervention knowledge (n=9, 39%; standardized mean difference [SMD] 0.32, 95% CI 0.13-0.51, I2=66%, moderate certainty of evidence). Spaced online education (n=3, 13%) was superior to massed online education (n=2, 9%) and no intervention (n=1, 4%; SMD 0.67, 95% CI 0.43-0.91, I2=5%, moderate certainty of evidence) for postintervention clinical behavior change. Spaced digital simulation was superior to massed simulation for postintervention surgical skills (n=2, 9%; SMD 1.15, 95% CI 0.34-1.96, I2=74%, low certainty of evidence). Spaced digital education positively impacted confidence and satisfaction with the intervention. Conclusions: Spaced digital education is effective in improving knowledge, particularly in substantially improving surgical skills and promoting clinical behavior change in pre- and postregistration health care professionals. Our findings support the use of spaced digital education interventions in undergraduate and postgraduate health profession education.Trial Registration: PROSPERO CRD42021241969; Trial Registration: PROSPERO CRD42021241969; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=241969 UR - https://www.jmir.org/2024/1/e57760 UR - http://dx.doi.org/10.2196/57760 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/57760 ER - TY - JOUR AU - Khamisy-Farah, Rola AU - Biras, Eden AU - Shehadeh, Rabie AU - Tuma, Ruba AU - Atwan, Hisham AU - Siri, Anna AU - Converti, Manlio AU - Chirico, Francesco AU - Szarpak, ?ukasz AU - Biz, Carlo AU - Farah, Raymond AU - Bragazzi, Nicola PY - 2024/10/8 TI - Gender and Sexuality Awareness in Medical Education and Practice: Mixed Methods Study JO - JMIR Med Educ SP - e59009 VL - 10 KW - gender medicine KW - medical education KW - clinical practice KW - gender-sensitive care KW - gender awareness KW - sexuality awareness KW - awareness KW - medical education and practice KW - healthcare KW - patient outcomes KW - patient KW - patients KW - medical professionals KW - training KW - educational interventions KW - status-based KW - survey KW - effectiveness KW - medical workforce N2 - Background: The integration of gender and sexuality awareness in health care is increasingly recognized as vital for patient outcomes. Despite this, there is a notable lack of comprehensive data on the current state of physicians? training and perceptions in these areas, leading to a gap in targeted educational interventions and optimal health care delivery. Objective: The study?s aim was to explore the experiences and perceptions of attending and resident physicians regarding the inclusion of gender and sexuality content in medical school curricula and professional practice in Israel. Methods: This cross-sectional survey targeted a diverse group of physicians across various specializations and experience levels. Distributed through Israeli Medical Associations and professional networks, it included sections on experiences with gender and sexuality content, perceptions of knowledge, the impact of medical school curricula on professional capabilities, and views on integrating gender medicine in medical education. Descriptive and correlational analyses, along with gender-based and medical status-based comparisons, were used, complemented, and enhanced by qualitative analysis of participants? replies. Results: The survey, encompassing 189 respondents, revealed low-to-moderate exposure to gender and sexuality content in medical school curricula, with a similar perception of preparedness. A need for more comprehensive training was widely recognized. The majority valued training in these areas for enhancing professional capabilities, identifying 10 essential gender-related knowledge areas. The preference for integrating gender medicine throughout medical education was significant. Gender-based analysis indicated variations in exposure and perceptions. Conclusions: The study highlights a crucial need for the inclusion of gender and sexuality awareness in medical education and practice. It suggests the necessity for curriculum development, targeted training programs, policy advocacy, mentorship initiatives, and research to evaluate the effectiveness of these interventions. The findings serve as a foundation for future directions in medical education, aiming for a more inclusive, aware, and prepared medical workforce. UR - https://mededu.jmir.org/2024/1/e59009 UR - http://dx.doi.org/10.2196/59009 UR - http://www.ncbi.nlm.nih.gov/pubmed/39152652 ID - info:doi/10.2196/59009 ER - TY - JOUR AU - Wang, Yun AU - Fu, Junzuo AU - Wang, Shaoping AU - Wang, Huijuan AU - Gao, Wei AU - Huang, Lina PY - 2024/10/3 TI - Impact of Video-Based Error Correction Learning for Cardiopulmonary Resuscitation Training: Quasi-Experimental Study JO - JMIR Serious Games SP - e53577 VL - 12 KW - video-based error correction KW - video-prompting KW - cardiopulmonary resuscitation training KW - anesthesiology resident KW - quasi-experimental study KW - anesthesiology KW - cardiopulmonary KW - cardiopulmonary resuscitation KW - training KW - video KW - learning KW - residents KW - CPR training KW - CPR KW - video prompting N2 - Background: Video-based error correction (VBEC) in medical education could offer immediate feedback, promote enhanced learning retention, and foster reflective practice. However, its application in cardiopulmonary resuscitation (CPR) training has not been investigated. Objective: The objective of this study is to assess whether the VBEC procedure could improve the training performance of CPR among anesthesiology residents. Methods: A quasi-experimental study was conducted among anesthesiology residents between December 2022 and April 2023. Primary outcomes included a posttraining knowledge test and practical assessment scores. Secondary outcomes included the number of residents who correctly conducted CPR at each step, the rate of common mistakes during the CPR process, and the self-assessment results. A total of 80 anesthesiology residents were divided into a VBEC group (n=40) and a control group (n=40). The VBEC group underwent a 15-minute VBEC CPR training, whereas the control group underwent a 15-minute video-prompting CPR training. Results: The posttraining knowledge test score of the VBEC group was significantly higher than that of the control group (73, SD 10.5 vs 65.1, SD 11.4; P=.002). The residents in the VBEC group had lower error rates in ?failure to anticipate the next move? (n=3, 7.5% vs n=13, 32.5%; P=.01) and ?failure to debrief or problem solve after the code? (n=2, 5% vs n=11, 27.5%; P=.01), as well as better performance in the ?secure own safety? step (n=34, 85% vs n=18, 45%; P<.001) than those in the control group. The VBEC group showed significantly higher confidence in CPR than the control group (n=?, 62.5% vs n=?, 35%; P=.03). Conclusions: VBEC may be a promising strategy compared to video prompting for CPR training among anesthesiology residents. UR - https://games.jmir.org/2024/1/e53577 UR - http://dx.doi.org/10.2196/53577 ID - info:doi/10.2196/53577 ER - TY - JOUR AU - Lee, Hwa Kye AU - Lee, Ho Jae AU - Lee, Yura AU - Lee, Hyunna AU - Lee, Sung Ji AU - Jang, Jeon Hye AU - Lee, Hee Kun AU - Han, Hyun Jeong AU - Jang, SuJung PY - 2024/9/25 TI - Impact of Health Informatics Analyst Education on Job Role, Career Transition, and Skill Development: Survey Study JO - JMIR Med Educ SP - e54427 VL - 10 KW - health informatics KW - health informatics training KW - informatics training KW - professional development KW - training program KW - digital health technology KW - informatics workforce KW - informatics competencies KW - competencies KW - job skills KW - continuing education KW - data science N2 - Background: Professionals with expertise in health informatics play a crucial role in the digital health sector. Despite efforts to train experts in this field, the specific impact of such training, especially for individuals from diverse academic backgrounds, remains undetermined. Objective: This study therefore aims to evaluate the effectiveness of an intensive health informatics training program on graduates with respect to their job roles, transitions, and competencies and to provide insights for curriculum design and future research. Methods: A survey was conducted among 206 students who completed the Advanced Health Informatics Analyst program between 2018 and 2022. The questionnaire comprised four categories: (1) general information about the respondent, (2) changes before and after program completion, (3) the impact of the program on professional practice, and (4) continuing education requirements. Results: The study received 161 (78.2%) responses from the 206 students. Graduates of the program had diverse academic backgrounds and consequently undertook various informatics tasks after their training. Most graduates (117/161, 72.7%) are now involved in tasks such as data preprocessing, visualizing results for better understanding, and report writing for data processing and analysis. Program participation significantly improved job performance (P=.03), especially for those with a master?s degree or higher (odds ratio 2.74, 95% CI 1.08?6.95) and those from regions other than Seoul or Gyeonggi-do (odds ratio 10.95, 95% CI 1.08?6.95). A substantial number of respondents indicated that the training had a substantial influence on their career transitions, primarily by providing a better understanding of job roles and generating intrinsic interest in the field. Conclusions: The integrated practical education program was effective in addressing the diverse needs of trainees from various fields, enhancing their capabilities, and preparing them for the evolving industry demands. This study emphasizes the value of providing specialized training in health informatics for graduates regardless of their discipline. UR - https://mededu.jmir.org/2024/1/e54427 UR - http://dx.doi.org/10.2196/54427 ID - info:doi/10.2196/54427 ER - TY - JOUR AU - Byon, Do Ha AU - Park, Sunbok AU - Quatrara, A. Beth AU - Taggart, Jessica AU - Wheeler, Buford Lindsay PY - 2024/9/9 TI - Examining the Evidence on the Statistics Prerequisite for Admission to Doctor of Nursing Practice Programs: Retrospective Cohort Study JO - Asian Pac Isl Nurs J SP - e57187 VL - 8 KW - Doctor of Nursing Practice KW - admission prerequisite KW - statistics requirement KW - biostatistics KW - nursing education N2 - Background: Doctor of Nursing Practice (DNP) programs in the United States confer the highest practice degree in nursing. The proportion of racial and ethnic minority DNP students, including those of Asian descent, keeps increasing in the United States. Statistics is commonly required for DNP programs. However, there is insufficient evidence regarding the number of years within which statistics should be taken and the minimum grade required for admission to the program. Objective: This study aimed to examine the associations of statistics prerequisite durations and grades for admission with the course performances within the DNP program. We also explored whether a postadmission statistics overview course can prepare students for a DNP statistics course as well as a required statistics prerequisite course. Methods: A retrospective cohort study was conducted with a sample of 31 DNP students at a large university in the Mid-Atlantic region. Statistical analysis of data collected over 5 years, between 2018 and 2022, was performed to examine the associations, using Spearman rank correlation analysis and Mann-Whitney U test (U). Results: The performance of students in a DNP statistics course was not associated with prerequisite duration. There was no significant association between the duration and the DNP statistics course letter grades (?=0.12; P=.66), neither with exam 1 (?=0.03; P=.91) nor with exam 2 scores (?=0.01; P=.97). Prerequisite grades were positively associated with exam 1 grades (?=0.59; P=.02), but not exam 2 (?=0.35; P=.19) or course grades (?=0.40; P=.12). In addition, no difference was found in the performance of students whether meeting the prerequisite requirements or taking a 1-month, self-paced overview course (exam 1: U=159, P=.13; exam 2: U=102, P=.50; course letter grade: U=117, P=.92). Conclusions: No evidence was found to support the need for limits on when prerequisites are completed or grade requirements. Opting for a statistics overview course after admission can serve as a viable alternative to the statistics prerequisite, effectively preparing students for advanced quantitative data analysis in a DNP program. UR - https://apinj.jmir.org/2024/1/e57187 UR - http://dx.doi.org/10.2196/57187 UR - http://www.ncbi.nlm.nih.gov/pubmed/39250220 ID - info:doi/10.2196/57187 ER - TY - JOUR AU - Kleib, Manal AU - Arnaert, Antonia AU - Nagle, M. Lynn AU - Sugars, Rebecca AU - da Costa, Daniel PY - 2024/8/19 TI - Newly Qualified Canadian Nurses? Experiences With Digital Health in the Workplace: Comparative Qualitative Analysis JO - JMIR Med Educ SP - e53258 VL - 10 KW - digital health KW - new graduate nurses KW - nursing practice KW - workplace KW - informatics N2 - Background: Clinical practice settings have increasingly become dependent on the use of digital or eHealth technologies such as electronic health records. It is vitally important to support nurses in adapting to digitalized health care systems; however, little is known about nursing graduates? experiences as they transition to the workplace. Objective: This study aims to (1) describe newly qualified nurses? experiences with digital health in the workplace, and (2) identify strategies that could help support new graduates? transition and practice with digital health. Methods: An exploratory descriptive qualitative design was used. A total of 14 nurses from Eastern and Western Canada participated in semistructured interviews and data were analyzed using inductive content analysis. Results: Three themes were identified: (1) experiences before becoming a registered nurse, (2) experiences upon joining the workplace, and (3) suggestions for bridging the gap in transition to digital health practice. Findings revealed more similarities than differences between participants with respect to gaps in digital health education, technology-related challenges, and their influence on nursing practice. Conclusions: Digital health is the foundation of contemporary health care; therefore, comprehensive education during nursing school and throughout professional nursing practice, as well as organizational support and policy, are critical pillars. Health systems investing in digital health technologies must create supportive work environments for nurses to thrive in technologically rich environments and increase their capacity to deliver the digital health future. UR - https://mededu.jmir.org/2024/1/e53258 UR - http://dx.doi.org/10.2196/53258 UR - http://www.ncbi.nlm.nih.gov/pubmed/ ID - info:doi/10.2196/53258 ER - TY - JOUR AU - Kleib, Manal AU - Arnaert, Antonia AU - Nagle, M. Lynn AU - Ali, Shamsa AU - Idrees, Sobia AU - Costa, da Daniel AU - Kennedy, Megan AU - Darko, Mirekuwaa Elizabeth PY - 2024/7/17 TI - Digital Health Education and Training for Undergraduate and Graduate Nursing Students: Scoping Review JO - JMIR Nursing SP - e58170 VL - 7 KW - curriculum KW - digital health KW - health informatics KW - nursing education KW - nursing students KW - undergraduate KW - graduate N2 - Background: As technology will continue to play a pivotal role in modern-day health care and given the potential impact on the nursing profession, it is vitally important to examine the types and features of digital health education in nursing so that graduates are better equipped with the necessary knowledge and skills needed to provide safe and quality nursing care and to keep abreast of the rapidly evolving technological revolution. Objective: In this scoping review, we aimed to examine and report on available evidence about digital health education and training interventions for nursing students at the undergraduate and graduate levels. Methods: This scoping review was conducted using the Joanna Briggs Institute methodological framework and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews). A comprehensive search strategy was developed and applied to identified bibliographic databases including MEDLINE (Ovid; 1946 to present), Embase (Ovid; 1974 to present), CINAHL (EBSCOhost; 1936 to present), ERIC (EBSCOhost; 1966 to present), Education Research Complete (EBSCOhost; inception to present), and Scopus (1976 to present). The initial search was conducted on March 3, 2022, and updated searches were completed on January 11, 2023, and October 31, 2023. For gray literature sources, the websites of select professional organizations were searched to identify relevant digital health educational programs or courses available to support the health workforce development. Two reviewers screened and undertook the data extraction process. The review included studies focused on the digital health education of students at the undergraduate or graduate levels or both in a nursing program. Studies that discussed instructional strategies, delivery processes, pedagogical theory and frameworks, and evaluation strategies for digital health education; applied quantitative, qualitative, and mixed methods; and were descriptive or discussion papers, with the exception of review studies, were included. Opinion pieces, editorials, and conference proceedings were excluded. Results: A total of 100 records were included in this review. Of these, 94 records were identified from database searches, and 6 sources were identified from the gray literature. Despite improvements, there are significant gaps and limitations in the scope of digital health education at the undergraduate and graduate levels, consequently posing challenges for nursing students to develop competencies needed in modern-day nursing practice. Conclusions: There is an urgent need to expand the understanding of digital health in the context of nursing education and practice and to better articulate its scope in nursing curricula and enforce its application across professional nursing practice roles at all levels and career trajectories. Further research is also needed to examine the impact of digital health education on improving patient outcomes, the quality of nursing care, and professional nursing role advancement. International Registered Report Identifier (IRRID): RR2-10.11124/JBIES-22-00266 UR - https://nursing.jmir.org/2024/1/e58170 UR - http://dx.doi.org/10.2196/58170 UR - http://www.ncbi.nlm.nih.gov/pubmed/39018092 ID - info:doi/10.2196/58170 ER - TY - JOUR AU - Nxumalo, Thembelenkosini Celenkosini AU - Pillay, Pavitra AU - Mchunu, Gladness Gugu PY - 2024/6/3 TI - The Durban University of Technology Faculty of Health Sciences Decentralized Clinical Training Project: Protocol for an Implementation Study in KwaZulu-Natal, South Africa JO - JMIR Res Protoc SP - e52243 VL - 13 KW - decentralized clinical training programs KW - curriculum KW - clinical education KW - health science education KW - university of technology KW - pedagogy KW - transformative education KW - teaching KW - higher education KW - South Africa N2 - Background: The Durban University of Technology (DUT) Faculty of Health Sciences (FHS) in KwaZulu-Natal, South Africa, is embarking on a project to implement a Decentralized Clinical Training Program (DCTP). The DUT FHS DCTP project is being conducted in response to the growing demands of students requiring clinical service placements as part of work-integrated learning. The project is also geared toward responding to existing gaps in current practices related to the implementation of a DCTP, which has mainly been through traditional universities providing training to medical, optometry, occupational therapy, and physiotherapy students. In South Africa, a DCTP is yet to be implemented within the context of a university of technology; it is yet to be implemented within health science faculties that offer undergraduate health science programs in mainstream biomedicine and alternative and complementary disciplines. Objective: We aim to design, pilot, and establish an effective DCTP at the DUT FHS in KwaZulu-Natal, South Africa. Methods: Participatory action research comprising various designs?namely, appreciative inquiry, qualitative case study design, phenomenography, and descriptive qualitative study design?will be used to conduct the study. Data will be collected using individual interviews, focus group discussions, nominal group technique, consensus methodology, and narrative inquiry. Study participants will include various internal and external stakeholders of the DUT, namely, academic staff; students; key informants from universities currently using successfully established DCTPs; academic support staff; staff working in human resources, finance, procurement, and accounting; and experts in other disciplines such as engineering and information systems. Overall, 4 undergraduate health science programs?namely, Radiography, Medical Orthotics and Prosthetics, Clinical Technology, and Emergency Medical Care and Rescue?will be part of the project?s pilot phase. Findings from the project?s pilot phase will be used to inform scale-up in the other undergraduate programs in the DUT FHS. The project is being implemented as part of the university?s strategic objective of devising innovative curricula and pedagogical practices to improve the mastery, skill set, and competence of health science graduates. Results: The study has currently commenced with the situational analysis, consisting of engagement with external stakeholders implementing DCTPs. The data to be generated from the completion of the situational analysis are anticipated to be published in 2024. Conclusions: This project is envisioned to facilitate collaboration among the universities of technology, traditional universities, Ministry of Health, and private sector for clinical placement of undergraduate health science students in health establishments that are away from the university, thereby exposing them to real-life experiences related to health care. This will facilitate authentic learning experiences that will contribute to improved competencies of graduates in relation to the health needs of society and the multiple realities of the South African health system. International Registered Report Identifier (IRRID): PRR1-10.2196/52243 UR - https://www.researchprotocols.org/2024/1/e52243 UR - http://dx.doi.org/10.2196/52243 UR - http://www.ncbi.nlm.nih.gov/pubmed/38829695 ID - info:doi/10.2196/52243 ER - TY - JOUR AU - Kataoka, Koshi AU - Nishizaki, Yuji AU - Shimizu, Taro AU - Yamamoto, Yu AU - Shikino, Kiyoshi AU - Nojima, Masanori AU - Nagasaki, Kazuya AU - Fukui, Sho AU - Nishiguchi, Sho AU - Katayama, Kohta AU - Kurihara, Masaru AU - Ueda, Rieko AU - Kobayashi, Hiroyuki AU - Tokuda, Yasuharu PY - 2024/5/30 TI - Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study JO - JMIR Med Educ SP - e52207 VL - 10 KW - clinical knowledge support system KW - GM-ITE KW - postgraduate clinical resident KW - in-training examination performance KW - exam KW - exams KW - examination KW - examinations KW - resident KW - residents KW - cross-sectional KW - national KW - nationwide KW - postgraduate KW - decision support KW - point-of-care KW - UpToDate KW - DynaMed KW - knowledge support KW - medical education KW - performance KW - information behavior KW - information behaviour KW - information seeking KW - teaching KW - pedagogy KW - pedagogical KW - log KW - logs KW - usage KW - evidence-based medicine KW - EBM KW - educational KW - decision support system KW - clinical decision support KW - Japan KW - General Medicine In-Training Examination N2 - Background: The relationship between educational outcomes and the use of web-based clinical knowledge support systems in teaching hospitals remains unknown in Japan. A previous study on this topic could have been affected by recall bias because of the use of a self-reported questionnaire. Objective: We aimed to explore the relationship between the use of the Wolters Kluwer UpToDate clinical knowledge support system in teaching hospitals and residents? General Medicine In-Training Examination (GM-ITE) scores. In this study, we objectively evaluated the relationship between the total number of UpToDate hospital use logs and the GM-ITE scores. Methods: This nationwide cross-sectional study included postgraduate year?1 and ?2 residents who had taken the examination in the 2020 academic year. Hospital-level information was obtained from published web pages, and UpToDate hospital use logs were provided by Wolters Kluwer. We evaluated the relationship between the total number of UpToDate hospital use logs and residents? GM-ITE scores. We analyzed 215 teaching hospitals with at least 5 GM-ITE examinees and hospital use logs from 2017 to 2019. Results: The study population consisted of 3013 residents from 215 teaching hospitals with at least 5 GM-ITE examinees and web-based resource use log data from 2017 to 2019. High-use hospital residents had significantly higher GM-ITE scores than low-use hospital residents (mean 26.9, SD 2.0 vs mean 26.2, SD 2.3; P=.009; Cohen d=0.35, 95% CI 0.08-0.62). The GM-ITE scores were significantly correlated with the total number of hospital use logs (Pearson r=0.28; P<.001). The multilevel analysis revealed a positive association between the total number of logs divided by the number of hospital physicians and the GM-ITE scores (estimated coefficient=0.36, 95% CI 0.14-0.59; P=.001). Conclusions: The findings suggest that the development of residents? clinical reasoning abilities through UpToDate is associated with high GM-ITE scores. Thus, higher use of UpToDate may lead physicians and residents in high-use hospitals to increase the implementation of evidence-based medicine, leading to high educational outcomes. UR - https://mededu.jmir.org/2024/1/e52207 UR - http://dx.doi.org/10.2196/52207 ID - info:doi/10.2196/52207 ER - TY - JOUR AU - Friche, Pauline AU - Moulis, Lionel AU - Du Thanh, Aurélie AU - Dereure, Olivier AU - Duflos, Claire AU - Carbonnel, Francois PY - 2024/5/13 TI - Training Family Medicine Residents in Dermoscopy Using an e-Learning Course: Pilot Interventional Study JO - JMIR Form Res SP - e56005 VL - 8 KW - dermoscopy KW - dermatoscope KW - dermatoscopes KW - dermatological KW - skin KW - training KW - GP KW - family practitioner KW - family practitioners KW - family physician KW - family physicians KW - general practice KW - family medicine KW - primary health care KW - internship and residency KW - education KW - e-learning KW - eLearning KW - dermatology KW - resident KW - residency KW - intern KW - interns KW - internship KW - internships N2 - Background: Skin cancers are the most common group of cancers diagnosed worldwide. Aging and sun exposure increase their risk. The decline in the number of dermatologists is pushing the issue of dermatological screening back onto family doctors. Dermoscopy is an easy-to-use tool that increases the sensitivity of melanoma diagnosis by 60% to 90%, but its use is limited due to lack of training. The characteristics of ?ideal? dermoscopy training have yet to be established. We created a Moodle (Moodle HQ)-based e-learning course to train family medicine residents in dermoscopy. Objective: This study aimed to evaluate the evolution of dermoscopy knowledge among family doctors immediately and 1 and 3 months after e-learning training. Methods: We conducted a prospective interventional study between April and November 2020 to evaluate an educational program intended for family medicine residents at the University of Montpellier-Nîmes, France. They were asked to complete an e-learning course consisting of 2 modules, with an assessment quiz repeated at 1 (M1) and 3 months (M3). The course was based on a 2-step algorithm, a method of dermoscopic analysis of pigmented skin lesions that is internationally accepted. The objectives of modules 1 and 2 were to differentiate melanocytic lesions from nonmelanocytic lesions and to precisely identify skin lesions by looking for dermoscopic morphological criteria specific to each lesion. Each module consisted of 15 questions with immediate feedback after each question. Results: In total, 134 residents were included, and 66.4% (n=89) and 47% (n=63) of trainees fully participated in the evaluation of module 1 and module 2, respectively. This study showed a significant score improvement 3 months after the training course in 92.1% (n=82) of participants for module 1 and 87.3% (n=55) of participants for module 2 (P<.001). The majority of the participants expressed satisfaction (n=48, 90.6%) with the training course, and 96.3% (n=51) planned to use a dermatoscope in their future practice. Regarding final scores, the only variable that was statistically significant was the resident?s initial scores (P=.003) for module 1. No measured variable was found to be associated with retention (midtraining or final evaluation) for module 2. Residents who had completed at least 1 dermatology rotation during medical school had significantly higher initial scores in module 1 at M0 (P=.03). Residents who reported having completed at least 1 dermatology rotation during their family medicine training had a statistically significant higher score at M1 for module 1 and M3 for module 2 (P=.01 and P=.001). Conclusions: The integration of an e-learning training course in dermoscopy into the curriculum of FM residents results in a significant improvement in their diagnosis skills and meets their expectations. Developing a program combining an e-learning course and face-to-face training for residents is likely to result in more frequent and effective dermoscopy use by family doctors. UR - https://formative.jmir.org/2024/1/e56005 UR - http://dx.doi.org/10.2196/56005 UR - http://www.ncbi.nlm.nih.gov/pubmed/38739910 ID - info:doi/10.2196/56005 ER - TY - JOUR AU - Noori, Sofia AU - Khasnavis, Siddharth AU - DeCroce-Movson, Eliza AU - Blay-Tofey, Morkeh AU - Vitiello, Evan PY - 2024/5/13 TI - A Curriculum on Digital Psychiatry for a US-Based Psychiatry Residency Training Program: Pilot Implementation Study JO - JMIR Form Res SP - e41573 VL - 8 KW - digital psychiatry KW - digital mental health KW - didactic curriculum KW - residency training KW - psychiatry residency KW - training classes KW - trainee response KW - residency curriculum KW - trainee feedback N2 - Background: Digital psychiatry, defined as the application of health technologies to the prevention, assessment, and treatment of mental health illnesses, is a growing field. Interest in the clinical use of these technologies continues to grow. However, psychiatric trainees receive limited or no formal education on the topic. Objective: This study aims to pilot a curriculum on digital psychiatry for a US-based psychiatry residency training program and examine the change in learner confidence regarding appraisal and clinical recommendation of digital mental health apps. Methods: Two 60-minute sessions were presented through a web-based platform to postgraduate year 2-4 residents training in psychiatry at a US-based adult psychiatry residency program. Learner confidence was assessed using pre- and postsession surveys. Results: Matched pre- and postsession quizzes showed improved confidence in multiple domains aligning with the course objectives. This included the structured appraisal of digital mental health apps (P=.03), assessment of a patient?s digital health literacy (P=.01), formal recommendation of digital health tools (P=.03), and prescription of digital therapeutics to patients (P=.03). Though an improvement from baseline, mean ratings for confidence did not exceed ?somewhat comfortable? on any of the above measures. Conclusions: Our study shows the feasibility of implementing a digital psychiatry curriculum for residents in multiple levels of training. We also identified an opportunity to increase learner confidence in the appraisal and clinical use of digital mental health apps through the use of a formal curriculum. UR - https://formative.jmir.org/2024/1/e41573 UR - http://dx.doi.org/10.2196/41573 UR - http://www.ncbi.nlm.nih.gov/pubmed/38739423 ID - info:doi/10.2196/41573 ER - TY - JOUR AU - Wang, Shangqiguo AU - Mo, Changgeng AU - Chen, Yuan AU - Dai, Xiaolu AU - Wang, Huiyi AU - Shen, Xiaoli PY - 2024/4/26 TI - Exploring the Performance of ChatGPT-4 in the Taiwan Audiologist Qualification Examination: Preliminary Observational Study Highlighting the Potential of AI Chatbots in Hearing Care JO - JMIR Med Educ SP - e55595 VL - 10 KW - ChatGPT KW - medical education KW - artificial intelligence KW - AI KW - audiology KW - hearing care KW - natural language processing KW - large language model KW - Taiwan KW - hearing KW - hearing specialist KW - audiologist KW - examination KW - information accuracy KW - educational technology KW - healthcare services KW - chatbot KW - health care services N2 - Background: Artificial intelligence (AI) chatbots, such as ChatGPT-4, have shown immense potential for application across various aspects of medicine, including medical education, clinical practice, and research. Objective: This study aimed to evaluate the performance of ChatGPT-4 in the 2023 Taiwan Audiologist Qualification Examination, thereby preliminarily exploring the potential utility of AI chatbots in the fields of audiology and hearing care services. Methods: ChatGPT-4 was tasked to provide answers and reasoning for the 2023 Taiwan Audiologist Qualification Examination. The examination encompassed six subjects: (1) basic auditory science, (2) behavioral audiology, (3) electrophysiological audiology, (4) principles and practice of hearing devices, (5) health and rehabilitation of the auditory and balance systems, and (6) auditory and speech communication disorders (including professional ethics). Each subject included 50 multiple-choice questions, with the exception of behavioral audiology, which had 49 questions, amounting to a total of 299 questions. Results: The correct answer rates across the 6 subjects were as follows: 88% for basic auditory science, 63% for behavioral audiology, 58% for electrophysiological audiology, 72% for principles and practice of hearing devices, 80% for health and rehabilitation of the auditory and balance systems, and 86% for auditory and speech communication disorders (including professional ethics). The overall accuracy rate for the 299 questions was 75%, which surpasses the examination?s passing criteria of an average 60% accuracy rate across all subjects. A comprehensive review of ChatGPT-4?s responses indicated that incorrect answers were predominantly due to information errors. Conclusions: ChatGPT-4 demonstrated a robust performance in the Taiwan Audiologist Qualification Examination, showcasing effective logical reasoning skills. Our results suggest that with enhanced information accuracy, ChatGPT-4?s performance could be further improved. This study indicates significant potential for the application of AI chatbots in audiology and hearing care services. UR - https://mededu.jmir.org/2024/1/e55595 UR - http://dx.doi.org/10.2196/55595 ID - info:doi/10.2196/55595 ER - TY - JOUR AU - Thiesmeier, Robert AU - Orsini, Nicola PY - 2024/4/15 TI - Rolling the DICE (Design, Interpret, Compute, Estimate): Interactive Learning of Biostatistics With Simulations JO - JMIR Med Educ SP - e52679 VL - 10 KW - learning statistics KW - Monte Carlo simulation KW - simulation-based learning KW - survival analysis KW - Weibull UR - https://mededu.jmir.org/2024/1/e52679 UR - http://dx.doi.org/10.2196/52679 UR - http://www.ncbi.nlm.nih.gov/pubmed/38619866 ID - info:doi/10.2196/52679 ER - TY - JOUR AU - Shikino, Kiyoshi AU - Nishizaki, Yuji AU - Fukui, Sho AU - Yokokawa, Daiki AU - Yamamoto, Yu AU - Kobayashi, Hiroyuki AU - Shimizu, Taro AU - Tokuda, Yasuharu PY - 2024/2/29 TI - Development of a Clinical Simulation Video to Evaluate Multiple Domains of Clinical Competence: Cross-Sectional Study JO - JMIR Med Educ SP - e54401 VL - 10 KW - discrimination index KW - General Medicine In-Training Examination KW - clinical simulation video KW - postgraduate medical education KW - video KW - videos KW - training KW - examination KW - examinations KW - medical education KW - resident KW - residents KW - postgraduate KW - postgraduates KW - simulation KW - simulations KW - diagnosis KW - diagnoses KW - diagnose KW - general medicine KW - general practice KW - general practitioner KW - skill KW - skills N2 - Background: Medical students in Japan undergo a 2-year postgraduate residency program to acquire clinical knowledge and general medical skills. The General Medicine In-Training Examination (GM-ITE) assesses postgraduate residents? clinical knowledge. A clinical simulation video (CSV) may assess learners? interpersonal abilities. Objective: This study aimed to evaluate the relationship between GM-ITE scores and resident physicians? diagnostic skills by having them watch a CSV and to explore resident physicians? perceptions of the CSV?s realism, educational value, and impact on their motivation to learn. Methods: The participants included 56 postgraduate medical residents who took the GM-ITE between January 21 and January 28, 2021; watched the CSV; and then provided a diagnosis. The CSV and GM-ITE scores were compared, and the validity of the simulations was examined using discrimination indices, wherein ?0.20 indicated high discriminatory power and >0.40 indicated a very good measure of the subject?s qualifications. Additionally, we administered an anonymous questionnaire to ascertain participants? views on the realism and educational value of the CSV and its impact on their motivation to learn. Results: Of the 56 participants, 6 (11%) provided the correct diagnosis, and all were from the second postgraduate year. All domains indicated high discriminatory power. The (anonymous) follow-up responses indicated that the CSV format was more suitable than the conventional GM-ITE for assessing clinical competence. The anonymous survey revealed that 12 (52%) participants found the CSV format more suitable than the GM-ITE for assessing clinical competence, 18 (78%) affirmed the realism of the video simulation, and 17 (74%) indicated that the experience increased their motivation to learn. Conclusions: The findings indicated that CSV modules simulating real-world clinical examinations were successful in assessing examinees? clinical competence across multiple domains. The study demonstrated that the CSV not only augmented the assessment of diagnostic skills but also positively impacted learners? motivation, suggesting a multifaceted role for simulation in medical education. UR - https://mededu.jmir.org/2024/1/e54401 UR - http://dx.doi.org/10.2196/54401 UR - http://www.ncbi.nlm.nih.gov/pubmed/38421691 ID - info:doi/10.2196/54401 ER - TY - JOUR AU - Acharya, Amish AU - Black, Claire Ruth AU - Smithies, Alisdair AU - Darzi, Ara PY - 2024/2/21 TI - Evaluating the Impact of the National Health Service Digital Academy on Participants? Perceptions of Their Identity as Leaders of Digital Health Change: Mixed Methods Study JO - JMIR Med Educ SP - e46740 VL - 10 KW - digital leadership KW - professional identity KW - dissertation of practice N2 - Background: The key to the digital leveling-up strategy of the National Health Service is the development of a digitally proficient leadership. The National Health Service Digital Academy (NHSDA) Digital Health Leadership program was designed to support emerging digital leaders to acquire the necessary skills to facilitate transformation. This study examined the influence of the program on professional identity formation as a means of creating a more proficient digital health leadership. Objective: This study aims to examine the impact of the NHSDA program on participants? perceptions of themselves as digital health leaders. Methods: We recruited 41 participants from 2 cohorts of the 2-year NHSDA program in this mixed methods study, all of whom had completed it >6 months before the study. The participants were initially invited to complete a web-based scoping questionnaire. This involved both quantitative and qualitative responses to prompts. Frequencies of responses were aggregated, while free-text comments from the questionnaire were analyzed inductively. The content of the 30 highest-scoring dissertations was also reviewed by 2 independent authors. A total of 14 semistructured interviews were then conducted with a subset of the cohort. These focused on individuals? perceptions of digital leadership and the influence of the course on the attainment of skills. In total, 3 in-depth focus groups were then conducted with participants to examine shared perceptions of professional identity as digital health leaders. The transcripts from the interviews and focus groups were aligned with a previously published examination of leadership as a framework. Results: Of the 41 participants, 42% (17/41) were in clinical roles, 34% (14/41) were in program delivery or management roles, 20% (8/41) were in data science roles, and 5% (2/41) were in ?other? roles. Interviews and focus groups highlighted that the course influenced 8 domains of professional identity: commitment to the profession, critical thinking, goal orientation, mentoring, perception of the profession, socialization, reflection, and self-efficacy. The dissertation of the practice model, in which candidates undertake digital projects within their organizations supported by faculty, largely impacted metacognitive skill acquisition and goal orientation. However, the program also affected participants? values and direction within the wider digital health community. According to the questionnaire, after graduation, 59% (24/41) of the participants changed roles in search of more prominence within digital leadership, with 46% (11/24) reporting that the course was a strong determinant of this change. Conclusions: A digital leadership course aimed at providing attendees with the necessary attributes to guide transformation can have a significant impact on professional identity formation. This can create a sense of belonging to a wider health leadership structure and facilitate the attainment of organizational and national digital targets. This effect is diminished by a lack of locoregional support for professional development. UR - https://mededu.jmir.org/2024/1/e46740 UR - http://dx.doi.org/10.2196/46740 UR - http://www.ncbi.nlm.nih.gov/pubmed/38381477 ID - info:doi/10.2196/46740 ER - TY - JOUR AU - Ulin, Lindsey AU - Bernstein, A. Simone AU - Nunes, C. Julio AU - Gu, Alex AU - Hammoud, M. Maya AU - Gold, A. Jessica AU - Mirza, M. Kamran PY - 2023/12/25 TI - Improving Transparency in the Residency Application Process: Survey Study JO - JMIR Form Res SP - e45919 VL - 7 KW - data elaboration KW - information transparency KW - medical school KW - residency application KW - residency programs KW - resident N2 - Background: Increasing numbers of residency applications create challenges for applicants and residency programs to assess if they are a good fit during the residency application and match process. Applicants face limited or conflicting information as they assess programs, leading to overapplying. A holistic review of residency applications is considered a gold standard for programs, but the current volumes and associated time constraints leave programs relying on numerical filters, which do not predict success in residency. Applicants could benefit from increased transparency in the residency application process. Objective: This study aims to determine the information applicants find most beneficial from residency programs when deciding where to apply, by type of medical school education background. Methods: Match 2023 applicants voluntarily completed an anonymous survey through the Twitter and Instagram social media platforms. We asked the respondents to select 3 top factors from a multiple-choice list of what information they would like from residency programs to help determine if the characteristics of their application align with program values. We examined differences in helpful factors selected by medical school backgrounds using ANOVA. Results: There were 4649 survey respondents. When responses were analyzed by United States-allopathic (US-MD), doctor of osteopathic medicine (DO), and international medical graduate (IMG) educational backgrounds, respondents chose different factors as most helpful: minimum United States Medical Licensing Examination (USMLE) or Comprehensive Osteopathic Medical Licensing Examination (COMLEX) Step 2 scores (565/3042, 18.57% US-MD; 485/3042, 15.9% DO; and 1992/3042, 65.48% IMG; P<.001), resident hometown region (281/1132, 24.82% US-MD; 189/1132, 16.7% DO; and 662/1132, 58.48% IMG; P=.02), resident medical school region (476/2179, 22% US-MD; 250/2179, 11.5% DO; and 1453/2179, 66.7% IMG; P=.002), and percent of residents or attendings underrepresented in medicine (417/1815, 22.98% US-MD; 158/1815, 8.71% DO; and 1240/1815, 68.32% IMG; P<.001). Conclusions: When applying to residency programs, this study found that the factors that respondents consider most helpful from programs in deciding where to apply differ by educational background. Across all educational groups, respondents want transparency around standardized exam scores, geography, and the racial or ethnic backgrounds of residents and attendings. UR - https://formative.jmir.org/2023/1/e45919 UR - http://dx.doi.org/10.2196/45919 UR - http://www.ncbi.nlm.nih.gov/pubmed/38145482 ID - info:doi/10.2196/45919 ER - TY - JOUR AU - Davoudi, Kaveh AU - Rakhecha, Tushar AU - Corriero, Chiara Anna AU - Ko, Natalie Kar Chang AU - Ismail, Roseanne AU - King, B. Esther R. AU - Hollén, Linda PY - 2023/11/24 TI - The Impact of UK Medical Students? Demographics and Socioeconomic Factors on Their Self-Reported Familiarity With the Postgraduate Training Pathways and Application Process: Cross-Sectional Study JO - JMIR Med Educ SP - e49013 VL - 9 KW - age KW - career progression KW - clinicians KW - cross-sectional study KW - demographics KW - ethnicity KW - gender KW - leadership KW - medical students demographics KW - medical students KW - online survey KW - research KW - students KW - teaching KW - training N2 - Background: UK medical graduates can apply for specialty training after completing a 2-year internship (foundation training). Postfoundation training application requirements vary depending on specialty but fundamentally require key skills such as teaching, research, and leadership. Objective: This study investigated whether medical student demographics impact their self-reported familiarity with the Post-Foundation Training Pathways (PFTPs) and Post-Foundation Application Process (PFAP). Methods: This was a cross-sectional study using a Bristol Online Survey. We invited all UK medical students to answer a range of questions about their demographics. Students were then asked to rank their familiarity with PFTPs and PFAP on a scale of 1 to 5 (1=least familiar and 5=most familiar). The responses were collected between March 2022 and April 2022 and exported for further analysis. Statistical analysis was conducted in Stata (version 17.1; StataCorp) using chi-square tests. Results: A total of 850 students from 31 UK medical schools took part. There was a significant difference between gender and self-reported familiarity with PFTPs (P<.001) and PFAP (P<.001), with male students expressing higher familiarity. Similarly, there was a difference between ethnicity and self-reported familiarity with PFTPs (P=.02) and PFAP (P<.001), with White students more likely to express higher familiarity than their Black, Asian, or Mixed Ethnic counterparts. Lastly, there was an overall difference between medical background and age and self-reported familiarity with PFTPs and PFAP (all P<.001), with students from medical backgrounds and older students being more likely to express higher familiarity. Conclusions: The impact of gender, ethnicity, age, and medical background on students? self-reported familiarity with PFTPs and PFAP is significant. Further studies are required to evaluate the impact of these factors on tested knowledge of PFTPs and PFAP and whether this impacts the success rate of postfoundation applications. UR - https://mededu.jmir.org/2023/1/e49013 UR - http://dx.doi.org/10.2196/49013 UR - http://www.ncbi.nlm.nih.gov/pubmed/37999951 ID - info:doi/10.2196/49013 ER - TY - JOUR AU - Ozair, Ahmad AU - Bhat, Vivek AU - Detchou, E. Donald K. PY - 2023/8/17 TI - Authors? Reply to: Additional Considerations for US Residency Selection After Pass/Fail USMLE Step 1. Comment on ?The US Residency Selection Process After the United States Medical Licensing Examination Step 1 Pass/Fail Change: Overview for Applicants and Educators? JO - JMIR Med Educ SP - e50109 VL - 9 KW - admission KW - assessment KW - postgraduate training KW - selection KW - standardized testing KW - graduate medical education KW - medical education UR - https://mededu.jmir.org/2023/1/e50109 UR - http://dx.doi.org/10.2196/50109 UR - http://www.ncbi.nlm.nih.gov/pubmed/37590044 ID - info:doi/10.2196/50109 ER - TY - JOUR AU - Sow, Yacine AU - Gangal, Ameya AU - Yeung, Howa AU - Blalock, Travis AU - Stoff, Benjamin PY - 2023/8/17 TI - Additional Considerations for US Residency Selection After Pass/Fail USMLE Step 1. Comment on ?The US Residency Selection Process After the United States Medical Licensing Examination Step 1 Pass/Fail Change: Overview for Applicants and Educators? JO - JMIR Med Educ SP - e47763 VL - 9 KW - admission KW - assessment KW - postgraduate training KW - selection KW - standardized testing KW - USMLE KW - medical school KW - medical students KW - residency application KW - research training UR - https://mededu.jmir.org/2023/1/e47763 UR - http://dx.doi.org/10.2196/47763 UR - http://www.ncbi.nlm.nih.gov/pubmed/37590047 ID - info:doi/10.2196/47763 ER - TY - JOUR AU - Dunn, Tyler AU - Patel, Shyam AU - Milam, J. Adam AU - Brinkman, Joseph AU - Gorlin, Andrew AU - Harbell, W. Monica PY - 2023/6/29 TI - Influence of Social Media on Applicant Perceptions of Anesthesiology Residency Programs During the COVID-19 Pandemic: Quantitative Survey JO - JMIR Med Educ SP - e39831 VL - 9 KW - anesthesiology residency KW - application KW - COVID-19 pandemic KW - social media KW - impact KW - residency KW - anesthesia KW - anesthesiology KW - pandemic KW - effectiveness KW - restrictions KW - barriers KW - rotations KW - visits KW - interviews KW - applicants KW - perception KW - students KW - program N2 - Background: Social media may be an effective tool in residency recruitment, given its ability to engage a broad audience; however, there are limited data regarding the influence of social media on applicants? evaluation of anesthesiology residency programs. Objective: This study evaluates the influence of social media on applicants? perceptions of anesthesiology residency programs during the COVID-19 pandemic to allow programs to evaluate the importance of a social media presence for residency recruitment. The study also sought to understand if there were differences in the use of social media by applicant demographic characteristics (eg, race, ethnicity, gender, and age). We hypothesized that given the COVID-19 pandemic restrictions on visiting rotations and the interview process, the social media presence of anesthesiology residency programs would have a positive impact on the recruitment process and be an effective form of communication about program characteristics. Methods: All anesthesiology residency applicants who applied to Mayo Clinic Arizona were emailed a survey in October 2020 along with statements regarding the anonymity and optional nature of the survey. The 20-item Qualtrics survey included questions regarding subinternship rotation completion, social media resource use and impact (eg, ?residency-based social media accounts positively impacted my opinion of the program?), and applicant demographic characteristics. Descriptive statistics were examined, and perceptions of social media were stratified by gender, race, and ethnicity; a factor analysis was performed, and the resulting scale was regressed on race, ethnicity, age, and gender. Results: The survey was emailed to 1091 individuals who applied to the Mayo Clinic Arizona anesthesiology residency program; there were 640 unique responses recorded (response rate=58.6%). Nearly 65% of applicants reported an inability to complete 2 or more planned subinternships due to COVID-19 restrictions (n=361, 55.9%), with 25% of applicants reporting inability to do any visiting student rotations (n=167). Official program websites (91.5%), Doximity (47.6%), Instagram (38.5%), and Twitter (19.4%) were reported as the most used resources by applicants. The majority of applicants (n=385, 67.3%) agreed that social media was an effective means to inform applicants, and 57.5% (n=328) of them indicated that social media positively impacted their perception of the program. An 8-item scale with good reliability was created, representing the importance of social media (Cronbach ?=.838). There was a positive and statistically significant relationship such that male applicants (standardized ?=.151; P=.002) and older applicants (?=.159; P<.001) had less trust and reliance in social media for information regarding anesthesiology residency programs. The applicants? race and ethnicity were not associated with the social media scale (?=?.089; P=.08). Conclusions: Social media was an effective means to inform applicants, and generally positively impacted applicants? perception of programs. Thus, residency programs should consider investing time and resources toward building a social media presence to improve resident recruitment. UR - https://mededu.jmir.org/2023/1/e39831 UR - http://dx.doi.org/10.2196/39831 UR - http://www.ncbi.nlm.nih.gov/pubmed/37205642 ID - info:doi/10.2196/39831 ER - TY - JOUR AU - Ferreira, Tomas AU - Collins, M. Alexander AU - Horvath, Rita PY - 2023/6/19 TI - Ascertaining the Career Intentions of Medical Students (AIMS) in the United Kingdom Post Graduation: Protocol for a Mixed Methods Study JO - JMIR Res Protoc SP - e45992 VL - 12 KW - medical students KW - NHS KW - National Health Service KW - career intent KW - attitude KW - opinion KW - workforce KW - workforce planning KW - medical education KW - career KW - doctor KW - medical training KW - medical graduate KW - cross-sectional KW - thematic analysis KW - degree KW - rotation N2 - Background: Among doctors in the United Kingdom, there is growing sentiment regarding delaying specialist training, emigrating to practice medicine abroad, or leaving the profession altogether. This trend may have substantial implications for the future of the profession in the United Kingdom. The extent to which this sentiment is also present in the medical student population is not well understood. Objective: Our primary outcome is to determine current medical students? career intentions after graduation and upon completing the foundation program and to establish the motivations behind these intentions. Secondary outcomes include determining which, if any, demographic factors alter the propensity to pursue different career paths available to a medical graduate, determining which specialties medical students plan on pursuing, and understanding current views on the prospect of working in the National Health Service (NHS). Methods: The Ascertaining the Career Intentions of Medical Students (AIMS) study is a national, multi-institution, and cross-sectional study in which all medical students at all medical schools in the United Kingdom are eligible to participate. It was administered via a novel, mixed methods, and web-based questionnaire and disseminated through a collaborative network of approximately 200 students recruited for this purpose. Both quantitative and thematic analyses will be performed. Results: The study was launched nationally on January 16, 2023. Data collection was closed on March 27, 2023, and data analysis has commenced. The results are expected to be available later in the year. Conclusions: Doctors? career satisfaction within the NHS is a well-researched topic; however, there is a shortage of high-powered studies that are able to offer insight into medical students? outlook on their future careers. It is anticipated that the results of this study will bring clarity to this issue. Identified areas of improvement in medical training or within the NHS could be targeted to improve doctors? working conditions and help retain medical graduates. Results may also aid future workforce-planning efforts. International Registered Report Identifier (IRRID): DERR1-10.2196/45992 UR - https://www.researchprotocols.org/2023/1/e45992 UR - http://dx.doi.org/10.2196/45992 UR - http://www.ncbi.nlm.nih.gov/pubmed/37335615 ID - info:doi/10.2196/45992 ER - TY - JOUR AU - Chan, Yi Evelyn Hui AU - Chan, Yan Vernice Hui AU - Roed, Jannie AU - Chen, Yun Julie PY - 2023/5/15 TI - Observed Interactions, Challenges, and Opportunities in Student-Led, Web-Based Near-Peer Teaching for Medical Students: Interview Study Among Peer Learners and Peer Teachers JO - JMIR Med Educ SP - e40716 VL - 9 KW - peer teaching KW - peer-assisted learning KW - medical student KW - medical education KW - web-based education KW - distance learning N2 - Background: Near-peer teaching (NPT) is becoming an increasingly popular pedagogical tool in health professions education. Despite the shift in formal medical education from face-to-face teaching toward encompassing web-based learning activities, NPT has not experienced a similar transition. Apart from the few reports on NPT programs hastily converted to web-based learning in light of the COVID-19 pandemic, no studies to date have explored web-based learning in the specific context of NPT. Objective: This qualitative study examined the nature of interactions among peer learners (PLs), peer teachers (PTs), and the learning content in a student-led, web-based NPT program for medical students. Methods: A 5-month-long voluntary NPT program to support first- and second-year medical students? biomedical science learning in the undergraduate medical curriculum was designed by 2 senior-year medical students and delivered by 25 PTs with 84 PLs participating. In total, 9 PLs and 3 PTs underwent individual semistructured interviews at the end of the program to explore general NPT experience, reasons for joining NPT, the effectiveness of NPT, the demand and importance of NPT, and the feasibility of incorporating NPT in the formal curriculum. Interview transcripts were analyzed using a thematic analysis approach. Results: The first general theme focused on the nature of student-student, student-teacher, and student-content interactions. Although PLs were engaged in web-based NPT, there was minimal interaction between students, as most PLs preferred to learn passively and remain anonymous. PLs believed the web-based NPT learning process to be a unidirectional transmission of knowledge from teacher to learner, with the teacher responsible for driving the interactions. This was in sharp contrast to PTs? expectation that both parties shared responsibility for learning in a collaborative effort. The second general theme identified the advantages and disadvantages of delivering NPT on a web platform, which were mainly convenience and teaching skills development and poor interactivity, respectively. Conclusions: Student-led, web-based NPT offers a flexible and comfortable means of delivering academic and nonacademic guidance to medical students. However, the web-based mode of delivery presents unique challenges in facilitating meaningful interactions among PLs, PTs, and subject content. A blended learning approach may be best suited for this form of student-led NPT program to optimize its efficacy. UR - https://mededu.jmir.org/2023/1/e40716 UR - http://dx.doi.org/10.2196/40716 UR - http://www.ncbi.nlm.nih.gov/pubmed/37184931 ID - info:doi/10.2196/40716 ER - TY - JOUR AU - Kobak, Kenneth AU - Shear, Katherine M. AU - Skritskaya, A. Natalia AU - Bloom, Colleen AU - Bottex, Gaelle PY - 2023/3/27 TI - A Web-Based Therapist Training Tutorial on Prolonged Grief Disorder Therapy: Pre-Post Assessment Study JO - JMIR Med Educ SP - e44246 VL - 9 KW - grief KW - prolonged grief disorder KW - evidence-based practice KW - mental health training KW - therapist training KW - new technology KW - web-based training KW - dissemination KW - e-learning N2 - Background: Prolonged grief disorder (PGD) is a newly recognized mental disorder characterized by pervasive intense grief that persists longer than cultural or social expectations and interferes with functioning. The COVID-19 epidemic has resulted in increased rates of PGD, and few clinicians feel confident in treating this condition. PGD therapy (PGDT) is a simple, short-term, and evidence-based treatment developed in tandem with the validation of the PGD diagnosis. To facilitate the dissemination of PGDT training, we developed a web-based therapist tutorial that includes didactic training on PGDT concepts and principles as well as web-based multimedia patient scenarios and examples of clinical implementation of PGDT. Objective: We aimed to evaluate user satisfaction with the tutorial and whether the tutorial increased trainees? knowledge of PGDT principles and procedures. Moreover, we included a small number of pilot questions to evaluate the PGDT-related clinical skills. Methods: This study evaluated tutorial learning using a pre- and poststudy design. Participants were recruited from professional organization mailing lists, announcements to graduates of the Columbia School of Social Work, and through word of mouth. After signing consent, participants completed a brief demographic survey, a 55-item multiple-choice prestudy test on the concepts and principles of PGD and PGDT covered in the tutorial, and a 4-item pilot web-based prestudy test to gauge PGD clinical implementation skills. The link to the course content was then activated, and participants were given 8 weeks to complete the 11-module tutorial containing information, web-based exercises, simulated patient and video examples, and self-tests. Results: Overall, 406 clinicians signed consent, and 236 (58.1%) started the tutorial. Of these, 83.1% (196/236) completed all 11 modules. Trainee scores on our PDGT assessment improved substantially from pretraining to the postmodule assessment, with the total number of correct answers increasing from a mean of 29 (SD 5.5; 52.7% correct) to 36.7 (SD 5.2; 66.7% correct; t195=18.93; P<.001). In addition, the trainee?s implementation scores on 4 clinical vignettes increased from 2.6 (SD 0.7) correct out of 4 to 3.1 (SD 0.4) out of 4 (t188=7.02; P<.001). Effect sizes (Cohen d) were 1.44 (95% CI 1.23-1.65) for PDGT assessment and 1.06 (95% CI 0.84-1.29) for implementation. Trainees found the tutorial interesting, enjoyable, clearly presented, and useful for professional development. They endorsed a mean score of 3.7 (SD 0.47) on a 1 to 4 scale of agreement with recommending the course to others and feeling satisfied with the tutorial, and a mean of 3.3 (SD 0.57) with feeling able to apply the skills with clients. Conclusions: This pilot study provides support for the usefulness of this web-based training for teaching clinicians how to administer PGDT. The addition of patient scenarios for clinical implementation strategies holds promise for increasing the effectiveness of PGDT training and other evidence-based treatments. Trial Registration: ClinicalTrials.gov NCT05121792; https://www.clinicaltrials.gov/ct2/show/NCT05121792 UR - https://mededu.jmir.org/2023/1/e44246 UR - http://dx.doi.org/10.2196/44246 UR - http://www.ncbi.nlm.nih.gov/pubmed/36972105 ID - info:doi/10.2196/44246 ER - TY - JOUR AU - Ozair, Ahmad AU - Bhat, Vivek AU - Detchou, E. Donald K. PY - 2023/1/6 TI - The US Residency Selection Process After the United States Medical Licensing Examination Step 1 Pass/Fail Change: Overview for Applicants and Educators JO - JMIR Med Educ SP - e37069 VL - 9 KW - admission KW - assessment KW - postgraduate training KW - selection KW - standardized testing UR - https://mededu.jmir.org/2023/1/e37069 UR - http://dx.doi.org/10.2196/37069 UR - http://www.ncbi.nlm.nih.gov/pubmed/36607718 ID - info:doi/10.2196/37069 ER - TY - JOUR AU - Chartash, David AU - Rosenman, Marc AU - Wang, Karen AU - Chen, Elizabeth PY - 2022/9/13 TI - Informatics in Undergraduate Medical Education: Analysis of Competency Frameworks and Practices Across North America JO - JMIR Med Educ SP - e39794 VL - 8 IS - 3 KW - undergraduate medical education KW - medical informatics KW - curriculum KW - medical education KW - education KW - North America KW - framework KW - clinical KW - informatics KW - Canada KW - United States KW - US KW - teaching KW - management KW - cognitive N2 - Background: With the advent of competency-based medical education, as well as Canadian efforts to include clinical informatics within undergraduate medical education, competency frameworks in the United States have not emphasized the skills associated with clinical informatics pertinent to the broader practice of medicine. Objective: By examining the competency frameworks with which undergraduate medical education in clinical informatics has been developed in Canada and the United States, we hypothesized that there is a gap: the lack of a unified competency set and frame for clinical informatics education across North America. Methods: We performed directional competency mapping between Canadian and American graduate clinical informatics competencies and general graduate medical education competencies. Directional competency mapping was performed between Canadian roles and American common program requirements using keyword matching at the subcompetency and enabling competency levels. In addition, for general graduate medical education competencies, the Physician Competency Reference Set developed for the Liaison Committee on Medical Education was used as a direct means of computing the ontological overlap between competency frameworks. Results: Upon mapping Canadian roles to American competencies via both undergraduate and graduate medical education competency frameworks, the difference in focus between the 2 countries can be thematically described as a difference between the concepts of clinical and management reasoning. Conclusions: We suggest that the development or deployment of informatics competencies in undergraduate medical education should focus on 3 items: the teaching of diagnostic reasoning, such that the information tasks that comprise both clinical and management reasoning can be discussed; precision medical education, where informatics can provide for more fine-grained evaluation; and assessment methods to support traditional pedagogical efforts (both at the bedside and beyond). Assessment using cases or structured assessments (eg, Objective Structured Clinical Examinations) would help students draw parallels between clinical informatics and fundamental clinical subjects and would better emphasize the cognitive techniques taught through informatics. UR - https://mededu.jmir.org/2022/3/e39794 UR - http://dx.doi.org/10.2196/39794 UR - http://www.ncbi.nlm.nih.gov/pubmed/36099007 ID - info:doi/10.2196/39794 ER - TY - JOUR AU - Vuku?i? Rukavina, Tea AU - Machala Popla?en, Lovela AU - Majer, Marjeta AU - Reli?, Danko AU - Viski?, Jo?ko AU - Mareli?, Marko PY - 2022/8/9 TI - Defining Potentially Unprofessional Behavior on Social Media for Health Care Professionals: Mixed Methods Study JO - JMIR Med Educ SP - e35585 VL - 8 IS - 3 KW - professionalism KW - e-professionalism KW - internet KW - social media KW - social networking KW - medicine KW - dental medicine KW - health care professionals KW - students KW - faculty N2 - Background: Social media presence among health care professionals is ubiquitous and largely beneficial for their personal and professional lives. New standards are forming in the context of e-professionalism, which are loosening the predefined older and offline terms. With these benefits also come dangers, with exposure to evaluation on all levels from peers, superiors, and the public, as witnessed in the #medbikini movement. Objective: The objectives of this study were to develop an improved coding scheme (SMePROF coding scheme) for the assessment of unprofessional behavior on Facebook of medical or dental students and faculty, compare reliability between coding schemes used in previous research and SMePROF coding scheme, compare gender-based differences for the assessment of the professional content on Facebook, validate the SMePROF coding scheme, and assess the level of and to characterize web-based professionalism on publicly available Facebook profiles of medical or dental students and faculty. Methods: A search was performed via a new Facebook account using a systematic probabilistic sample of students and faculty in the University of Zagreb School of Medicine and School of Dental Medicine. Each profile was subsequently assessed with regard to professionalism based on previously published criteria and compared using the SMePROF coding scheme developed for this study. Results: Intercoder reliability increased when the SMePROF coding scheme was used for the comparison of gender-based coding results. Results showed an increase in the gender-based agreement of the final codes for the category professionalism, from 85% in the first phase to 96.2% in the second phase. Final results of the second phase showed that there was almost no difference between female and male coders for coding potentially unprofessional content for students (7/240, 2.9% vs 5/203, 2.5%) or for coding unprofessional content for students (11/240, 4.6% vs 11/203, 5.4%). Comparison of definitive results between the first and second phases indicated an understanding of web-based professionalism, with unprofessional content being very low, both for students (9/222, 4.1% vs 12/206, 5.8%) and faculty (1/25, 4% vs 0/23, 0%). For assessment of the potentially unprofessional content, we observed a 4-fold decrease, using the SMePROF rubric, for students (26/222, 11.7% to 6/206, 2.9%) and a 5-fold decrease for faculty (6/25, 24% to 1/23, 4%). Conclusions: SMePROF coding scheme for assessing professionalism of health-care professionals on Facebook is a validated and more objective instrument. This research emphasizes the role that context plays in the perception of unprofessional and potentially unprofessional content and provides insight into the existence of different sets of rules for web-based and offline interaction that marks behavior as unprofessional. The level of e-professionalism on Facebook profiles of medical or dental students and faculty available for public viewing has shown a high level of understanding of e-professionalism. UR - https://mededu.jmir.org/2022/3/e35585 UR - http://dx.doi.org/10.2196/35585 UR - http://www.ncbi.nlm.nih.gov/pubmed/35758 ID - info:doi/10.2196/35585 ER - TY - JOUR AU - Allen, Gary AU - Garris, Jenna AU - Lawson, Luan AU - Reeder, Timothy AU - Crotty, Jennifer AU - Hannan, Johanna AU - Brewer, Kori PY - 2022/7/13 TI - An Innovative Use of Twitter to Disseminate and Promote Medical Student Scholarship During the COVID-19 Pandemic: Usability Study JO - JMIR Med Educ SP - e33767 VL - 8 IS - 3 KW - medical education KW - social media KW - web-based learning KW - innovation KW - Twitter KW - dissemination KW - scholarship KW - medical student KW - platform KW - academic promotion KW - COVID-19 N2 - Background: Due to the emergence of the COVID-19 pandemic in March 2020, the cancellation of in-person learning activities forced every aspect of medical education and student engagement to pivot to a web-based format, including activities supporting the performance and dissemination of scholarly work. At that time, social media had been used to augment in-person conference learning, but it had not been used as the sole platform for scholarly abstract presentations. Objective: Our aim was to assess the feasibility of using Twitter to provide a completely web-based forum for real-time dissemination of and engagement with student scholarly work as an alternative to a traditional in-person poster presentation session. Methods: The Brody School of Medicine at East Carolina University launched an online Medical Student Scholarship Forum, using Twitter as a platform for students to present scholarly work and prepare for future web-based presentations. A single student forum participant created posts using a standardized template that incorporated student research descriptions, uniform promotional hashtags, and individual poster presentations. Tweets were released over 5 days and analytic data were collected from the Twitter platform. Outcome measures included impressions, engagements, retweets, likes, media engagements, and average daily engagement rate. Results: During the conference, the student leader published 63 tweets promoting the work of 58 students (55 medical and 3 dental students) over 5 days. During the forum and the following week, tweets from the @BrodyDistinctly Twitter account received 63,142 impressions and 7487 engagements, including 187 retweets, 1427 likes, and 2082 media engagements. During the 5 days of the forum, the average daily engagement rate was 12.72%. Conclusions: Using Twitter as a means of scholarly dissemination resulted in a larger viewing community compared to a traditional in-person event. Early evidence suggests that social media platforms may be an alternative to traditional scholarly presentations. Presenting via Twitter allowed students to receive instantaneous feedback and effectively network with wider academic communities. Additional research is needed to evaluate the effectiveness of knowledge uptake, feedback, and networking. UR - https://mededu.jmir.org/2022/3/e33767 UR - http://dx.doi.org/10.2196/33767 UR - http://www.ncbi.nlm.nih.gov/pubmed/35759753 ID - info:doi/10.2196/33767 ER - TY - JOUR AU - Jensen, Katherine AU - Yan, Qi AU - Davies, G. Mark PY - 2022/6/29 TI - Critical Comparison of the Quality and Content of Integrated Vascular Surgery, Thoracic Surgery, and Interventional Radiology Residency Training Program Websites: Qualitative Study JO - JMIR Med Educ SP - e35074 VL - 8 IS - 2 KW - training KW - recruitment KW - website KW - content KW - quality KW - vascular surgery KW - thoracic surgery KW - interventional radiology KW - radiology KW - surgery KW - web-based KW - web resource KW - surgeon KW - comparison KW - residency KW - integrated program N2 - Background: With the move to virtual interviewing, residency websites are an important recruitment resource, introducing applicants to programs across the country and allowing for comparison. Recruitment is highly competitive from a common potential pool between vascular surgery, thoracic surgery, and interventional radiology with the ratio of applicants to positions being highest in interventional radiology, followed by thoracic surgery and lastly vascular surgery, as reported by the National Resident Matching Program. Objective: The aim of this study is to evaluate the accessibility and availability of online content for those integrated residency programs. Methods: A list of accredited vascular surgery, thoracic surgery, and interventional radiology residencies was obtained from the Accreditation Council for Graduate Medical Education (ACGME) database. Program websites were evaluated by trained independent reviewers (n=2) for content items pertaining to program recruitment and education (scored absent or present). Statistical analysis was performed in R software. Results: Of ACGME-accredited programs, 56 of 61 (92%) vascular surgery, 27 of 27 (100%) thoracic surgery, and 74 of 85 (87%) interventional radiology programs had functional websites (P=.12). Vascular surgery websites contained a median of 26 (IQR 20-32) content items, thoracic surgery websites contained a median of 27 (IQR 21-32) content items, and interventional radiology websites contained a median of 23 (IQR 18-27) content items. Two content items considered highly influential to applicant program decisions are procedural experience and faculty mentorship, which were reported at 32% (18/56) and 11% (6/56) for vascular surgery, 19% (5/27) and 11% (3/27) for thoracic surgery, and 50% (37/74) and 15% (11/74) for interventional radiology (P=.008 and P=.75), respectively. Key deficits were work hours, debt management, and curriculum for interventional radiology; resident profiles, sample contracts, and research interests in vascular surgery; and operative experiences and the program director?s contact and message for thoracic surgery. Interventional radiology deficits were work hours, and thoracic surgery deficits were procedural experience. Both interventional radiology and thoracic surgery websites lacked information on evaluation criteria and faculty mentorship. Conclusions: This study has uncovered key differences in the availability of online content for residencies recruiting from the same pool of applicants. Thoracic surgery has the most information, followed by vascular surgery, with interventional radiology reporting the least content. In the era of virtual interviewing from the same potential pool of applicants, programs should review and revise their web presence with the aim to increase the availability of online content to attract valuable candidates. UR - https://mededu.jmir.org/2022/2/e35074 UR - http://dx.doi.org/10.2196/35074 UR - http://www.ncbi.nlm.nih.gov/pubmed/35767342 ID - info:doi/10.2196/35074 ER - TY - JOUR AU - Yilmaz, Yusuf AU - Jurado Nunez, Alma AU - Ariaeinejad, Ali AU - Lee, Mark AU - Sherbino, Jonathan AU - Chan, M. Teresa PY - 2022/5/27 TI - Harnessing Natural Language Processing to Support Decisions Around Workplace-Based Assessment: Machine Learning Study of Competency-Based Medical Education JO - JMIR Med Educ SP - e30537 VL - 8 IS - 2 KW - natural language processing KW - machine learning algorithms KW - competency-based medical education KW - assessment KW - medical education KW - medical residents KW - machine learning KW - work performance KW - prediction models N2 - Background: Residents receive a numeric performance rating (eg, 1-7 scoring scale) along with a narrative (ie, qualitative) feedback based on their performance in each workplace-based assessment (WBA). Aggregated qualitative data from WBA can be overwhelming to process and fairly adjudicate as part of a global decision about learner competence. Current approaches with qualitative data require a human rater to maintain attention and appropriately weigh various data inputs within the constraints of working memory before rendering a global judgment of performance. Objective: This study explores natural language processing (NLP) and machine learning (ML) applications for identifying trainees at risk using a large WBA narrative comment data set associated with numerical ratings. Methods: NLP was performed retrospectively on a complete data set of narrative comments (ie, text-based feedback to residents based on their performance on a task) derived from WBAs completed by faculty members from multiple hospitals associated with a single, large, residency program at McMaster University, Canada. Narrative comments were vectorized to quantitative ratings using the bag-of-n-grams technique with 3 input types: unigram, bigrams, and trigrams. Supervised ML models using linear regression were trained with the quantitative ratings, performed binary classification, and output a prediction of whether a resident fell into the category of at risk or not at risk. Sensitivity, specificity, and accuracy metrics are reported. Results: The database comprised 7199 unique direct observation assessments, containing both narrative comments and a rating between 3 and 7 in imbalanced distribution (scores 3-5: 726 ratings; and scores 6-7: 4871 ratings). A total of 141 unique raters from 5 different hospitals and 45 unique residents participated over the course of 5 academic years. When comparing the 3 different input types for diagnosing if a trainee would be rated low (ie, 1-5) or high (ie, 6 or 7), our accuracy for trigrams was 87%, bigrams 86%, and unigrams 82%. We also found that all 3 input types had better prediction accuracy when using a bimodal cut (eg, lower or higher) compared with predicting performance along the full 7-point rating scale (50%-52%). Conclusions: The ML models can accurately identify underperforming residents via narrative comments provided for WBAs. The words generated in WBAs can be a worthy data set to augment human decisions for educators tasked with processing large volumes of narrative assessments. UR - https://mededu.jmir.org/2022/2/e30537 UR - http://dx.doi.org/10.2196/30537 UR - http://www.ncbi.nlm.nih.gov/pubmed/35622398 ID - info:doi/10.2196/30537 ER - TY - JOUR AU - Landis-Lewis, Zach AU - Flynn, Allen AU - Janda, Allison AU - Shah, Nirav PY - 2022/5/10 TI - A Scalable Service to Improve Health Care Quality Through Precision Audit and Feedback: Proposal for a Randomized Controlled Trial JO - JMIR Res Protoc SP - e34990 VL - 11 IS - 5 KW - learning health system KW - audit and feedback KW - anesthesiology KW - knowledge-based system KW - human-centered design N2 - Background: Health care delivery organizations lack evidence-based strategies for using quality measurement data to improve performance. Audit and feedback (A&F), the delivery of clinical performance summaries to providers, demonstrates the potential for large effects on clinical practice but is currently implemented as a blunt one size fits most intervention. Each provider in a care setting typically receives a performance summary of identical metrics in a common format despite the growing recognition that precisionizing interventions hold significant promise in improving their impact. A precision approach to A&F prioritizes the display of information in a single metric that, for each recipient, carries the highest value for performance improvement, such as when the metric?s level drops below a peer benchmark or minimum standard for the first time, thereby revealing an actionable performance gap. Furthermore, precision A&F uses an optimal message format (including framing and visual displays) based on what is known about the recipient and the intended gist meaning being communicated to improve message interpretation while reducing the cognitive processing burden. Well-established psychological principles, frameworks, and theories form a feedback intervention knowledge base to achieve precision A&F. From an informatics perspective, precision A&F requires a knowledge-based system that enables mass customization by representing knowledge configurable at the group and individual levels. Objective: This study aims to implement and evaluate a demonstration system for precision A&F in anesthesia care and to assess the effect of precision feedback emails on care quality and outcomes in a national quality improvement consortium. Methods: We propose to achieve our aims by conducting 3 studies: a requirements analysis and preferences elicitation study using human-centered design and conjoint analysis methods, a software service development and implementation study, and a cluster randomized controlled trial of a precision A&F service with a concurrent process evaluation. This study will be conducted with the Multicenter Perioperative Outcomes Group, a national anesthesia quality improvement consortium with >60 member hospitals in >20 US states. This study will extend the Multicenter Perioperative Outcomes Group quality improvement infrastructure by using existing data and performance measurement processes. Results: The proposal was funded in September 2021 with a 4-year timeline. Data collection for Aim 1 began in March 2022. We plan for a 24-month trial timeline, with the intervention period of the trial beginning in March 2024. Conclusions: The proposed aims will collectively demonstrate a precision feedback service developed using an open-source technical infrastructure for computable knowledge management. By implementing and evaluating a demonstration system for precision feedback, we create the potential to observe the conditions under which feedback interventions are effective. International Registered Report Identifier (IRRID): PRR1-10.2196/34990 UR - https://www.researchprotocols.org/2022/5/e34990 UR - http://dx.doi.org/10.2196/34990 UR - http://www.ncbi.nlm.nih.gov/pubmed/35536637 ID - info:doi/10.2196/34990 ER - TY - JOUR AU - Yan, Hui AU - Rahgozar, Arya AU - Sethuram, Claire AU - Karunananthan, Sathya AU - Archibald, Douglas AU - Bradley, Lindsay AU - Hakimjavadi, Ramtin AU - Helmer-Smith, Mary AU - Jolin-Dahel, Kheira AU - McCutcheon, Tess AU - Puncher, Jeffrey AU - Rezaiefar, Parisa AU - Shoppoff, Lina AU - Liddy, Clare PY - 2022/5/2 TI - Natural Language Processing to Identify Digital Learning Tools in Postgraduate Family Medicine: Protocol for a Scoping Review JO - JMIR Res Protoc SP - e34575 VL - 11 IS - 5 KW - digital learning tools KW - medical education KW - primary care KW - digital learning KW - scoping review KW - family medicine KW - bibliometric KW - scientometric KW - natural language processing KW - e-learning KW - medical curriculum KW - medical curricula KW - medical school N2 - Background: The COVID-19 pandemic has highlighted the growing need for digital learning tools in postgraduate family medicine training. Family medicine departments must understand and recognize the use and effectiveness of digital tools in order to integrate them into curricula and develop effective learning tools that fill gaps and meet the learning needs of trainees. Objective: This scoping review will aim to explore and organize the breadth of knowledge regarding digital learning tools in family medicine training. Methods: This scoping review follows the 6 stages of the methodological framework outlined first by Arksey and O?Malley, then refined by Levac et al, including a search of published academic literature in 6 databases (MEDLINE, ERIC, Education Source, Embase, Scopus, and Web of Science) and gray literature. Following title and abstract and full text screening, characteristics and main findings of the included studies and resources will be tabulated and summarized. Thematic analysis and natural language processing (NLP) will be conducted in parallel using a 9-step approach to identify common themes and synthesize the literature. Additionally, NLP will be employed for bibliometric and scientometric analysis of the identified literature. Results: The search strategy has been developed and launched. As of October 2021, we have completed stages 1, 2, and 3 of the scoping review. We identified 132 studies for inclusion through the academic literature search and 127 relevant studies in the gray literature search. Further refinement of the eligibility criteria and data extraction has been ongoing since September 2021. Conclusions: In this scoping review, we will identify and consolidate information and evidence related to the use and effectiveness of existing digital learning tools in postgraduate family medicine training. Our findings will improve the understanding of the current landscape of digital learning tools, which will be of great value to educators and trainees interested in using existing tools, innovators looking to design digital learning tools that meet current needs, and researchers involved in the study of digital tools. Trial Registration: OSF Registries osf.io/wju4k; https://osf.io/wju4k International Registered Report Identifier (IRRID): DERR1-10.2196/34575 UR - https://www.researchprotocols.org/2022/5/e34575 UR - http://dx.doi.org/10.2196/34575 UR - http://www.ncbi.nlm.nih.gov/pubmed/35499861 ID - info:doi/10.2196/34575 ER - TY - JOUR AU - Beverly, Elizabeth AU - Rigot, Brooke AU - Love, Carrie AU - Love, Matt PY - 2022/4/29 TI - Perspectives of 360-Degree Cinematic Virtual Reality: Interview Study Among Health Care Professionals JO - JMIR Med Educ SP - e32657 VL - 8 IS - 2 KW - virtual reality KW - qualitative KW - medical education KW - health care KW - digital learning KW - learning platform KW - health care providers N2 - Background: The global market for medical education is projected to increase exponentially over the next 5 years. A mode of delivery expected to drive the growth of this market is virtual reality (VR). VR simulates real-world objects, events, locations, and interactions in 3D multimedia sensory environments. It has been used successfully in medical education for surgical training, learning anatomy, and advancing drug discovery. New VR research has been used to simulate role-playing and clinical encounters; however, most of this research has been conducted with health professions students and not current health care professionals. Thus, more research is needed to explore how health care professionals experience VR with role-playing and clinical encounters. Objective: The aim of this study was to explore health care professionals? experiences with a cinematic VR (cine-VR) training program focused on role-playing and clinical encounters addressing social determinants of health, Appalachian culture, and diabetes. Cine-VR leverages 360-degree video with the narrative storytelling of cinema to create an engaging educational experience. Methods: We conducted in-depth telephone interviews with health care professionals who participated in the cine-VR training. The interviews were audio recorded and transcribed verbatim. A multidisciplinary team coded and analyzed the data using content and thematic analyses with NVivo software. Results: We conducted 24 in-depth interviews with health care professionals (age=45.3, SD 11.3, years; n=16, 67%, women; n=22, 92%, White; and n=4, 17%, physicians) to explore their experiences with the cine-VR training. Qualitative analysis revealed five themes: immersed in the virtual world: seeing a 360-degree sphere allowed participants to immerse themselves in the virtual world; facilitated knowledge acquisition: all the participants accurately recalled the culture of Appalachia and listed the social determinants of health presented in the training; empathized with multiple perspectives: the cine-VR provided a glimpse into the real life of the main character, and participants described thinking about, feeling, and empathizing with the character?s frustrations and disappointments; perceived ease of use of cine-VR: 96% (23/24) of the participants described the cine-VR as easy to use, and they liked the 360-degree movement, image resolution, and sound quality but noted limitations with the buttons on the headsets and risk for motion sickness; and perceived utility of cine-VR as a teaching tool: participants described cine-VR as an effective teaching tool because it activated visual and affective learning for them. Conclusions: Participants emphasized the realism of the cine-VR training program. They attributed the utility of the cine-VR to visual learning in conjunction with the emotional connection to the VR characters. Furthermore, participants reported that the cine-VR increased their empathy for people. More research is needed to confirm an association between the level of immersion and empathy in cine-VR training for health care professionals. UR - https://mededu.jmir.org/2022/2/e32657 UR - http://dx.doi.org/10.2196/32657 UR - http://www.ncbi.nlm.nih.gov/pubmed/35486427 ID - info:doi/10.2196/32657 ER - TY - JOUR AU - White, A. Andrew AU - King, M. Ann AU - D?Addario, E. Angelo AU - Brigham, Berg Karen AU - Dintzis, Suzanne AU - Fay, E. Emily AU - Gallagher, H. Thomas AU - Mazor, M. Kathleen PY - 2022/4/29 TI - Video-Based Communication Assessment of Physician Error Disclosure Skills by Crowdsourced Laypeople and Patient Advocates Who Experienced Medical Harm: Reliability Assessment With Generalizability Theory JO - JMIR Med Educ SP - e30988 VL - 8 IS - 2 KW - medical error disclosure KW - simulation studies KW - communication assessment KW - graduate medical education KW - crowdsourcing KW - patient-centered care KW - generalizability theory KW - medical education KW - medical error KW - communication N2 - Background: Residents may benefit from simulated practice with personalized feedback to prepare for high-stakes disclosure conversations with patients after harmful errors and to meet American Council on Graduate Medical Education mandates. Ideally, feedback would come from patients who have experienced communication after medical harm, but medical researchers and leaders have found it difficult to reach this community, which has made this approach impractical at scale. The Video-Based Communication Assessment app is designed to engage crowdsourced laypeople to rate physician communication skills but has not been evaluated for use with medical harm scenarios. Objective: We aimed to compare the reliability of 2 assessment groups (crowdsourced laypeople and patient advocates) in rating physician error disclosure communication skills using the Video-Based Communication Assessment app. Methods: Internal medicine residents used the Video-Based Communication Assessment app; the case, which consisted of 3 sequential vignettes, depicted a delayed diagnosis of breast cancer. Panels of patient advocates who have experienced harmful medical error, either personally or through a family member, and crowdsourced laypeople used a 5-point scale to rate the residents? error disclosure communication skills (6 items) based on audiorecorded responses. Ratings were aggregated across items and vignettes to create a numerical communication score for each physician. We used analysis of variance, to compare stringency, and Pearson correlation between patient advocates and laypeople, to identify whether rank order would be preserved between groups. We used generalizability theory to examine the difference in assessment reliability between patient advocates and laypeople. Results: Internal medicine residents (n=20) used the Video-Based Communication Assessment app. All patient advocates (n=8) and 42 of 59 crowdsourced laypeople who had been recruited provided complete, high-quality ratings. Patient advocates rated communication more stringently than crowdsourced laypeople (patient advocates: mean 3.19, SD 0.55; laypeople: mean 3.55, SD 0.40; P<.001), but patient advocates? and crowdsourced laypeople?s ratings of physicians were highly correlated (r=0.82, P<.001). Reliability for 8 raters and 6 vignettes was acceptable (patient advocates: G coefficient 0.82; crowdsourced laypeople: G coefficient 0.65). Decision studies estimated that 12 crowdsourced layperson raters and 9 vignettes would yield an acceptable G coefficient of 0.75. Conclusions: Crowdsourced laypeople may represent a sustainable source of reliable assessments of physician error disclosure skills. For a simulated case involving delayed diagnosis of breast cancer, laypeople correctly identified high and low performers. However, at least 12 raters and 9 vignettes are required to ensure adequate reliability and future studies are warranted. Crowdsourced laypeople rate less stringently than raters who have experienced harm. Future research should examine the value of the Video-Based Communication Assessment app for formative assessment, summative assessment, and just-in-time coaching of error disclosure communication skills. UR - https://mededu.jmir.org/2022/2/e30988 UR - http://dx.doi.org/10.2196/30988 UR - http://www.ncbi.nlm.nih.gov/pubmed/35486423 ID - info:doi/10.2196/30988 ER - TY - JOUR AU - Lauffenburger, C. Julie AU - DiFrancesco, F. Matthew AU - Barlev, A. Renee AU - Robertson, Ted AU - Kim, Erin AU - Coll, D. Maxwell AU - Haff, Nancy AU - Fontanet, P. Constance AU - Hanken, Kaitlin AU - Oran, Rebecca AU - Avorn, Jerry AU - Choudhry, K. Niteesh PY - 2022/4/27 TI - Overcoming Decisional Gaps in High-Risk Prescribing by Junior Physicians Using Simulation-Based Training: Protocol for a Randomized Controlled Trial JO - JMIR Res Protoc SP - e31464 VL - 11 IS - 4 KW - pragmatic trial KW - behavioral science KW - prescribing KW - benzodiazepines KW - antipsychotics KW - impact evaluation N2 - Background: Gaps between rational thought and actual decisions are increasingly recognized as a reason why people make suboptimal choices in states of heightened emotion, such as stress. These observations may help explain why high-risk medications continue to be prescribed to acutely ill hospitalized older adults despite widely accepted recommendations against these practices. Role playing and other efforts, such as simulation training, have demonstrated benefits to help people avoid decisional gaps but have not been tested to reduce overprescribing of high-risk medications. Objective: This study aims to evaluate the impact of a simulation-based training program designed to address decisional gaps on prescribing of high-risk medications compared with control. Methods: In this 2-arm pragmatic trial, we are randomizing at least 36 first-year medical resident physicians (ie, interns) who provide care on inpatient general medicine services at a large academic medical center to either intervention (simulation-based training) or control (online educational training). The intervention comprises a 40-minute immersive individual simulation training consisting of a reality-based patient care scenario in a simulated environment at the beginning of their inpatient service rotation. The simulation focuses on 3 types of high-risk medications, including benzodiazepines, antipsychotics, and sedative hypnotics (Z-drugs), in older adults, and is specifically designed to help the physicians identify their reactions and prescribing decisions in stressful situations that are common in the inpatient setting. The simulation scenario is followed by a semistructured debriefing with an expert facilitator. The trial?s primary outcome is the number of medication doses for any of the high-risk medications prescribed by the interns to patients aged 65 years or older who were not taking one of the medications upon admission. Secondary outcomes include prescribing by all providers on the care team, being discharged on 1 of the medications, and prescribing of related medications (eg, melatonin, trazodone), or the medications of interest for the control intervention. These outcomes will be measured using electronic health record data. Results: Recruitment of interns began on March 29, 2021. Recruitment for the trial ended in Q42021, with follow-up completed by Q12022. Conclusions: This trial will evaluate the impact of a simulation-based training program designed using behavioral science principles on prescribing of high-risk medications by junior physicians. If the intervention is shown to be effective, this approach could potentially be reproducible by others and for a broader set of behaviors. Trial Registration: ClinicalTrials.gov NCT04668248; https://clinicaltrials.gov/ct2/show/NCT04668248 International Registered Report Identifier (IRRID): PRR1-10.2196/31464 UR - https://www.researchprotocols.org/2022/4/e31464 UR - http://dx.doi.org/10.2196/31464 UR - http://www.ncbi.nlm.nih.gov/pubmed/35475982 ID - info:doi/10.2196/31464 ER - TY - JOUR AU - Puladi, Behrus AU - Ooms, Mark AU - Bellgardt, Martin AU - Cesov, Mark AU - Lipprandt, Myriam AU - Raith, Stefan AU - Peters, Florian AU - Möhlhenrich, Christian Stephan AU - Prescher, Andreas AU - Hölzle, Frank AU - Kuhlen, Wolfgang Torsten AU - Modabber, Ali PY - 2022/4/25 TI - Augmented Reality-Based Surgery on the Human Cadaver Using a New Generation of Optical Head-Mounted Displays: Development and Feasibility Study JO - JMIR Serious Games SP - e34781 VL - 10 IS - 2 KW - digital health in surgery KW - surgical technique KW - surgical training KW - computer-assisted surgery KW - optical see-through head-mounted display KW - HoloLens KW - surgical navigation KW - medical regulation KW - open-source KW - AR KW - augmented reality KW - surgery KW - surgeon KW - cadaver KW - serious game KW - head-mounted display N2 - Background: Although nearly one-third of the world?s disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence. Objective: The goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies. Methods: We tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires. Results: The development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment. Conclusions: The development and application of an AR-based surgical system using freely available technologies to perform OST-HMD?guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD?guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies. UR - https://games.jmir.org/2022/2/e34781 UR - http://dx.doi.org/10.2196/34781 UR - http://www.ncbi.nlm.nih.gov/pubmed/35468090 ID - info:doi/10.2196/34781 ER - TY - JOUR AU - Kunkes, Taylor AU - Makled, Basiel AU - Norfleet, Jack AU - Schwaitzberg, Steven AU - Cavuoto, Lora PY - 2022/4/21 TI - Understanding the Cognitive Demands, Skills, and Assessment Approaches for Endotracheal Intubation: Cognitive Task Analysis JO - JMIR Perioper Med SP - e34522 VL - 5 IS - 1 KW - knowledge elicitation KW - knowledge acquisition KW - medical simulation KW - medical training KW - medical assessment KW - critical care KW - cognitive task analysis KW - qualitative methods KW - qualitative KW - endotracheal intubation KW - preoperative KW - training KW - health care professional KW - medical education KW - cognitive skill N2 - Background: Proper airway management is an essential skill for hospital personnel and rescue services to learn, as it is a priority for the care of patients who are critically ill. It is essential that providers be properly trained and competent in performing endotracheal intubation (ETI), a widely used technique for airway management. Several metrics have been created to measure competence in the ETI procedure. However, there is still a need to improve ETI training and evaluation, including a focus on collaborative research across medical specialties, to establish greater competence-based training and assessments. Training and evaluating ETI should also incorporate modern, evidence-based procedural training methodologies. Objective: This study aims to use the cognitive task analysis (CTA) framework to identify the cognitive demands and skills needed to proficiently perform a task, elucidate differences between novice and expert performance, and provide an understanding of the workload associated with a task. The CTA framework was applied to ETI to capture a broad view of task and training requirements from the perspective of multiple medical specialties. Methods: A CTA interview was developed based on previous research into the tasks and evaluation methods of ETI. A total of 6 experts from across multiple medical specialties were interviewed to capture the cognitive skills required to complete this task. Interviews were coded for main themes, subthemes in each category, and differences among specialties. These findings were compiled into a skills tree to identify the training needs and cognitive requirements of each task. Results: The CTA revealed that consistency in equipment setup and planning, through talk or think-aloud methods, is critical to successfully mastering ETI. These factors allow the providers to avoid errors due to patient characteristics and environmental factors. Variation among specialties derived primarily from the environment in which ETI is performed, subsequent treatment plans, and available resources. Anesthesiology typically represented the most ideal cases with a large potential for training, whereas paramedics faced the greatest number of constraints based on the environment and available equipment. Conclusions: Although the skills tree cannot perfectly capture the complexity and detail of all potential cases, it provided insight into the nuanced skills and training techniques used to prepare novices for the variability they may find in practice. Importantly, the CTA identified ways in which challenges faced by novices may be overcome and how this training can be applied to future cases. By making these implicit skills and points of variation explicit, they can be better translated into teachable details. These findings are consistent with previous studies looking at developing improved assessment metrics for ETI and expanding upon their work by delving into methods of feedback and strategies to assist novices. UR - https://periop.jmir.org/2022/1/e34522 UR - http://dx.doi.org/10.2196/34522 UR - http://www.ncbi.nlm.nih.gov/pubmed/35451970 ID - info:doi/10.2196/34522 ER - TY - JOUR AU - Sanavro, M. Sanne AU - van der Worp, Henk AU - Jansen, Danielle AU - Koning, Paul AU - Blanker, H. Marco AU - PY - 2022/4/1 TI - Evaluation of the First Year(s) of Physicians Collaboration on an Interdisciplinary Electronic Consultation Platform in the Netherlands: Mixed Methods Observational Study JO - JMIR Hum Factors SP - e33630 VL - 9 IS - 2 KW - primary care KW - digital consultation KW - interdisciplinary KW - specialist care N2 - Background: Complexity of health problems and aging of the population create an ongoing burden on the health care system with the general practitioner (GP) being the gatekeeper in primary care. In GPs daily practice, collaboration with specialists and exchange of knowledge from the secondary care play a crucial role in this system. Communication between primary and secondary care has shortcomings for health care workers that want to practice sustainable patient-centered health care. Therefore, a new digital interactive platform was developed: Prisma. Objective: This study aims to describe the development of a digital consultation platform (Prisma) to connect GPs with hospital specialists via the Siilo application and to evaluate the first year of use, including consultations, topic diversity, and number of participating physicians. Methods: We conducted a mixed methods observational study, analyzing qualitative and quantitative data for cases posted on the platform between June 2018 and May 2020. Any GP can post questions to an interdisciplinary group of secondary care specialists, with the platform designed to facilitate discussion and knowledge exchange for all users. Results: In total, 3674 cases were posted by 424 GPs across 16 specialisms. Most questions and answers concerned diagnosis, nonmedical treatment, and medication. Mean response time was 76 minutes (range 44-252). An average of 3 users engaged with each case (up to 7 specialists). Almost half of the internal medicine cases received responses from at least two specialisms in secondary care, contrasting with about one-fifth for dermatology. Of note, the growth in consultations was steepest for dermatology. Conclusions: Digital consultations offer the possibility for GPs to receive quick responses when seeking advice. The interdisciplinary approach of Prisma creates opportunities for digital patient-centered networking. UR - https://humanfactors.jmir.org/2022/2/e33630 UR - http://dx.doi.org/10.2196/33630 UR - http://www.ncbi.nlm.nih.gov/pubmed/35363155 ID - info:doi/10.2196/33630 ER - TY - JOUR AU - Nozari, Ala AU - Mukerji, Shivali AU - Lok, Ling-Ling AU - Gu, Qingrou AU - Buhl, Lauren AU - Jain, Sanjay AU - Ortega, Rafael PY - 2022/3/31 TI - Perception of Web-Based Didactic Activities During the COVID-19 Pandemic Among Anesthesia Residents: Pilot Questionnaire Study JO - JMIR Med Educ SP - e31080 VL - 8 IS - 1 KW - resident education KW - COVID-19 KW - barriers to education KW - didactic KW - medical education KW - online education KW - web-based education KW - virtual training KW - anesthesiology residents KW - medical residents KW - pandemic KW - virtual didactics N2 - Background: Physical and social distancing recommendations aimed at limiting exposure during the COVID-19 pandemic have forced residency programs to increasingly rely on videoconferencing and web-based resources. Objective: In this pilot study, we aimed to explore the effects of the COVID-19 pandemic on residency training experience, and to delineate the perceived barriers to the successful implementation of web-based medical education. Methods: A 19-item survey was compiled and distributed electronically using Qualtrics. This anonymous survey included information on the training level of each resident, their participation in formal didactics before and during the pandemic, and their perception of the ease and limitations of virtual didactics. The resident?s opinions on specific educational resources were assessed, and the effectiveness of new delivery methods on resident engagement and learning was examined. Results: Thirty anesthesiology residents were surveyed, 19 of whom agreed to participate in the pilot study. One participant with incomplete responses was excluded, yielding a final cohort of 18 respondents. Most residents (56%, 10/18) reported that the COVID-19 pandemic negatively affected their residency training. The time spent on didactic training and independent studies was, nevertheless, not affected by the pandemic for 90% (16/18) of respondents. Nonetheless, 72% (13/18) of residents were less engaged during virtual lectures in comparison to in-person didactics. Important limitations included distraction from the physical environment (67%, 12/18), internet instability (67%, 12/18), less obligation to participate (44%, 8/18), technical difficulty and unmuted microphones (33%, 6/18, each), and people speaking over each other (28%, 5/18). Despite these limitations, most residents stated that they would like to keep a combination of virtual didactics including live Zoom lectures (56%, 10/18), prerecorded web didactics (56%, 10/18), and virtual ground rounds via Zoom (50%, 9/18) as the ?new normal.? Conclusions: Despite important limitations listed in this report, anesthesia residents would like to keep a combination of virtual lectures and presentations as the new normal after the COVID-19 pandemic. UR - https://mededu.jmir.org/2022/1/e31080 UR - http://dx.doi.org/10.2196/31080 UR - http://www.ncbi.nlm.nih.gov/pubmed/35275840 ID - info:doi/10.2196/31080 ER - TY - JOUR AU - Li, Yaning AU - Ye, Hongqiang AU - Wu, Siyu AU - Zhao, Xiaohan AU - Liu, Yunsong AU - Lv, Longwei AU - Zhang, Ping AU - Zhang, Xiao AU - Zhou, Yongsheng PY - 2022/3/9 TI - Mixed Reality and Haptic?Based Dental Simulator for Tooth Preparation: Research, Development, and Preliminary Evaluation JO - JMIR Serious Games SP - e30653 VL - 10 IS - 1 KW - dental education KW - simulator KW - mixed reality KW - tooth preparation N2 - Background: Virtual reality (VR) dental simulators are currently used in preclinical skills training. However, with the development of extended reality technologies, the use of mixed reality (MR) has shown significant advantages over VR. Objective: This study aimed to describe the research and development of a newly developed MR and haptic?based dental simulator for tooth preparation and to conduct a preliminary evaluation of its face validity. Methods: A prototype of the MR dental simulator for tooth preparation was developed by integrating a head-mounted display (HMD), special force feedback handles, a foot pedal, computer hardware, and software program. We recruited 34 participants and divided them into the Novice group (n=17) and Skilled group (n=17) based on their clinical experience. All participants prepared a maxillary right central incisor for an all-ceramic crown in the dental simulator, completed a questionnaire afterward about their simulation experience, and evaluated hardware and software aspects of the dental simulator. Results: Of the participants, 74% (25/34) were satisfied with the overall experience of using the Unidental MR Simulator. Approximately 90% (31/34, 91%) agreed that it could stimulate their interest in learning, and 82% (28/34) were willing to use it for skills training in the future. Differences between the 2 study groups in their experience with the HMD (resolution: P=.95; wearing comfort: P=.10), dental instruments (P=.95), force feedback of the tooth (P=.08), simulation of the tooth preparation process (P=.79), overall experience with the simulation (P=.47), and attitude toward the simulator (improves skills: P=.47; suitable for learning: P=.36; willing to use: P=.89; inspiring for learning: P=.63) were not significant. The Novice group was more satisfied with the simulator?s ease of use (P=.04). There were significant positive correlations between the overall experience with the simulation and the HMD?s resolution (P=.03) and simulation of the preparation process (P=.001). Conclusions: The newly developed Unidental MR Simulator for tooth preparation has good face validity. It can achieve a higher degree of resemblance to the real clinical treatment environment by improving the positional adjustment of the simulated patients, for a better training experience in dental skills. UR - https://games.jmir.org/2022/1/e30653 UR - http://dx.doi.org/10.2196/30653 UR - http://www.ncbi.nlm.nih.gov/pubmed/35262501 ID - info:doi/10.2196/30653 ER - TY - JOUR AU - Tamblyn, Robert AU - Brieva, Jorge AU - Cain, Madeleine AU - Martinez, Eduardo F. PY - 2022/3/7 TI - The Effects of Introducing a Mobile App?Based Procedural Logbook on Trainee Compliance to a Central Venous Catheter Insertion Accreditation Program: Before-and-After Study JO - JMIR Hum Factors SP - e35199 VL - 9 IS - 1 KW - logbook KW - education KW - training KW - central venous catheter KW - CVC KW - intensive care KW - smartphone KW - mobile phone KW - mobile apps KW - mHealth KW - mobile health KW - accreditation program KW - digital health KW - digital record N2 - Background: To reduce complications associated with central venous catheter (CVC) insertions, local accreditation programs using a supervised procedural logbook are essential. To increase compliance with such a logbook, a mobile app could provide the ideal platform for training doctors in an adult intensive care unit (ICU). Objective: The aim of this paper was to compare trainee compliance with the completion of a logbook as part of a CVC insertion accreditation program, before and after the introduction of an app-based logbook. Methods: This is a retrospective observational study of logbook data, before and after the introduction of a purpose-built, app-based, electronic logbook to complement an existing paper-based logbook. Carried out over a 2-year period in the adult ICU of the John Hunter Hospital, Newcastle, NSW, Australia, the participants were ICU trainee medical officers completing a CVC insertion accreditation program. The primary outcome was the proportion of all CVC insertions documented in the patients? electronic medical records appearing as logbook entries. To assess logbook entry quality, we measured and compared the proportion of logbook entries that were approved by a supervisor and contained a supervisor?s signature for the before and after periods. We also analyzed trainee participation before and after the intervention by comparing the total number of active logbook users, and the proportion of first-time users who logged 3 or more CVC insertions. Results: Of the 2987 CVC insertions documented in the electronic medical records between April 7, 2019, and April 6, 2021, 2161 (72%) were included and separated into cohorts before and after the app?s introduction. Following the introduction of the app-based logbook, the percentage of CVC insertions appearing as logbook entries increased from 3.6% (38/1059) to 20.5% (226/1102; P<.001). There was no difference in the proportion of supervisor-approved entries containing a supervisor?s signature before and after the introduction of the app, with 76.3% (29/38) and 83.2% (188/226), respectively (P=.31). After the introduction of the app, there was an increase in the percentage of active logbook users from 15.3% (13/85) to 62.8% (54/86; P<.001). Adherence to one?s logbook was similar in both groups with 60% (6/10) of first-time users in the before group and 79.5% (31/39) in the after group going on to log at least 3 or more CVCs during their time working in ICU. Conclusions: The addition of an electronic app-based logbook to a preexisting paper-based logbook was associated with a higher rate of logbook compliance in trainee doctors undertaking an accreditation program for CVC insertion in an adult ICU. There was a large increase in logbook use observed without a reduction in the quality of logbook entries. The overall trainee participation also improved with an observed increase in active logbook users and no reduction in the average number of entries per user following the introduction of the app. Further studies on app-based logbooks for ICU procedural accreditation programs are warranted. UR - https://humanfactors.jmir.org/2022/1/e35199 UR - http://dx.doi.org/10.2196/35199 UR - http://www.ncbi.nlm.nih.gov/pubmed/35051900 ID - info:doi/10.2196/35199 ER - TY - JOUR AU - Teng, Minnie AU - Singla, Rohit AU - Yau, Olivia AU - Lamoureux, Daniel AU - Gupta, Aurinjoy AU - Hu, Zoe AU - Hu, Ricky AU - Aissiou, Amira AU - Eaton, Shane AU - Hamm, Camille AU - Hu, Sophie AU - Kelly, Dayton AU - MacMillan, M. Kathleen AU - Malik, Shamir AU - Mazzoli, Vienna AU - Teng, Yu-Wen AU - Laricheva, Maria AU - Jarus, Tal AU - Field, S. Thalia PY - 2022/1/31 TI - Health Care Students? Perspectives on Artificial Intelligence: Countrywide Survey in Canada JO - JMIR Med Educ SP - e33390 VL - 8 IS - 1 KW - medical education KW - artificial intelligence KW - allied health education KW - medical students KW - health care students KW - medical curriculum KW - education N2 - Background: Artificial intelligence (AI) is no longer a futuristic concept; it is increasingly being integrated into health care. As studies on attitudes toward AI have primarily focused on physicians, there is a need to assess the perspectives of students across health care disciplines to inform future curriculum development. Objective: This study aims to explore and identify gaps in the knowledge that Canadian health care students have regarding AI, capture how health care students in different fields differ in their knowledge and perspectives on AI, and present student-identified ways that AI literacy may be incorporated into the health care curriculum. Methods: The survey was developed from a narrative literature review of topics in attitudinal surveys on AI. The final survey comprised 15 items, including multiple-choice questions, pick-group-rank questions, 11-point Likert scale items, slider scale questions, and narrative questions. We used snowball and convenience sampling methods by distributing an email with a description and a link to the web-based survey to representatives from 18 Canadian schools. Results: A total of 2167 students across 10 different health professions from 18 universities across Canada responded to the survey. Overall, 78.77% (1707/2167) predicted that AI technology would affect their careers within the coming decade and 74.5% (1595/2167) reported a positive outlook toward the emerging role of AI in their respective fields. Attitudes toward AI varied by discipline. Students, even those opposed to AI, identified the need to incorporate a basic understanding of AI into their curricula. Conclusions: We performed a nationwide survey of health care students across 10 different health professions in Canada. The findings would inform student-identified topics within AI and their preferred delivery formats, which would advance education across different health care professions. UR - https://mededu.jmir.org/2022/1/e33390 UR - http://dx.doi.org/10.2196/33390 UR - http://www.ncbi.nlm.nih.gov/pubmed/35099397 ID - info:doi/10.2196/33390 ER - TY - JOUR AU - Jung, Younhyun PY - 2022/1/28 TI - Virtual Reality Simulation for Disaster Preparedness Training in Hospitals: Integrated Review JO - J Med Internet Res SP - e30600 VL - 24 IS - 1 KW - virtual reality KW - in-hospital disaster preparedness training KW - mass casualty incidents KW - hospitals N2 - Background: A critical component of disaster preparedness in hospitals is experiential education and training of health care professionals. A live drill is a well-established, effective training approach, but cost restraints and logistic constraints make clinical implementation challenging, and training opportunities with live drills may be severely limited. Virtual reality simulation (VRS) technology may offer a viable training alternative with its inherent features of reproducibility, just-in-time training, and repeatability. Objective: This integrated review examines the scientific evidence pertaining to the effectiveness of VRS and its practical usefulness in training health care professionals for in-hospital disaster preparedness. Methods: A well-known 4-stage methodology was used for the integrated review process. It consisted of problem identification, a literature search and inclusion criteria determination, 2-stage validation and analysis of searched studies, and presentation of findings. A search of diverse publication repositories was performed. They included Web of Science (WOS), PubMed (PMD), and Embase (EMB). Results: The integrated review process resulted in 12 studies being included. Principle findings identified 3 major capabilities of VRS: (1) to realistically simulate the clinical environment and medical practices related to different disaster scenarios, (2) to develop learning effects on increased confidence and enhanced knowledge acquisition, and (3) to enable cost-effective implementation of training programs. Conclusions: The findings from the integrated review suggested that VRS could be a competitive, cost-effective adjunct to existing training approaches. Although the findings demonstrated the applicability of VRS to different training scenarios, these do not entirely cover all disaster scenarios that could happen in hospitals. This integrated review expects that the recent advances of VR technologies can be 1 of the catalysts to enable the wider adoption of VRS training on challenging clinical scenarios that require sophisticated modeling and environment depiction. UR - https://www.jmir.org/2022/1/e30600 UR - http://dx.doi.org/10.2196/30600 UR - http://www.ncbi.nlm.nih.gov/pubmed/35089144 ID - info:doi/10.2196/30600 ER - TY - JOUR AU - Nguyen, Tuan Ba AU - Phung, Lam Toi AU - Khuc, Hanh Thi Hong AU - Nguyen, Thi Van Anh AU - Blizzard, Leigh Christopher AU - Palmer, Andrew AU - Nguyen, Tu Huu AU - Cong Quyet, Thang AU - Nelson, Mark PY - 2022/1/24 TI - Trauma Care Training in Vietnam: Narrative Scoping Review JO - JMIR Med Educ SP - e34369 VL - 8 IS - 1 KW - trauma training KW - Vietnamese medical education system KW - medical curricula KW - short course N2 - Background: The model of trauma in Vietnam has changed significantly over the last decade and requires reforming medical education to deal with new circumstances. Our aim is to evaluate this transition regarding the new target by analyzing trauma and the medical training system as a whole. Objective: This study aimed to establish if medical training in the developing country of Vietnam has adapted to the new disease pattern of road trauma emerging in its economy. Methods: A review was performed of Vietnamese medical school, Ministry of Health, and Ministry of Education and Training literature on trauma education. The review process and final review paper were prepared following the guidelines on scoping reviews and using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart. Results: The current trauma training at the undergraduate level is minimal and involves less than 5% of the total credit. At the postgraduate level, only the specialties of surgery and anesthesia have a significant and increasing trauma training component ranging from 8% to 22% in the content. Trauma training, which focuses on practical skills, accounts for 31% and 32% of the training time of orientation courses for young doctors in ?basic surgery? and ?basic anesthesia,? respectively. Other relevant short course trainings, such as continuing medical education, in trauma are available, but they vary in topics, facilitators, participants, and formats. Conclusions: Medical training in Vietnam has not adapted to the new emerging disease pattern of road trauma. In the interim, the implementation of short courses, such as basic trauma life support and primary trauma care, can be considered as an appropriate method to compensate for the insufficient competency-related trauma care among health care workers while waiting for the effectiveness of medical training reformation. UR - https://mededu.jmir.org/2022/1/e34369 UR - http://dx.doi.org/10.2196/34369 UR - http://www.ncbi.nlm.nih.gov/pubmed/34967756 ID - info:doi/10.2196/34369 ER - TY - JOUR AU - Massanelli, Jackson AU - Sexton, W. Kevin AU - Lesher, T. Chris AU - Jensen, K. Hanna AU - Kimbrough, K. Mary AU - Privratsky, Anna AU - Taylor, R. John AU - Bhavaraju, Avi PY - 2021/12/13 TI - Integration of Web Analytics Into Graduate Medical Education: Usability Study JO - JMIR Form Res SP - e29748 VL - 5 IS - 12 KW - graduate medical education KW - website analysis KW - residency recruitment KW - medical education KW - website KW - analytics KW - usage KW - usability KW - user engagement KW - user-centered design KW - website design N2 - Background: Web analytics is the measurement, collection, analysis, and reporting of website and web application usage data. While common in the e-commerce arena, web analytics is underutilized in graduate medical education (GME). Objective: The University of Arkansas for Medical Sciences Department of Surgery website was revamped with input from in-house surgeons in August 2017. This study investigated the use of web analytics to gauge the impact of our department?s website redesign project. Methods: Google Analytics software was used to measure website performance before and after implementation of the new website. Eight-month matched periods were compared. Factors tracked included total users, new users, total sessions, sessions per user, pages per session, average session duration, total page views, and bounce rate (the percentage of visitors who visit a site and then leave [ie, bounce] without continuing to another page on the same site). Results: Analysis using a nonpaired Student t test demonstrated a statistically significant increase for total page views (before vs after: 33,065 vs 81,852; P<.001) and decrease for bounce rate (before vs after: 50.70% vs 0.23%; P<.001). Total users, new users, total sessions, sessions per user, and pages per session showed improvement. The average session duration was unchanged. Subgroup analysis showed that after the main page, the next 3 most frequently visited pages were related to GME programs in our department. Conclusions: Web analytics is a practical measure of a website?s efficacy. Our data suggest that a modern website significantly improves user engagement. An up-to-date website is essential for contemporary GME recruitment, will likely enhance engagement of residency applicants with GME programs, and warrants further investigation. UR - https://formative.jmir.org/2021/12/e29748 UR - http://dx.doi.org/10.2196/29748 UR - http://www.ncbi.nlm.nih.gov/pubmed/34898459 ID - info:doi/10.2196/29748 ER - TY - JOUR AU - Janssen, Anna AU - Talic, Stella AU - Gasevic, Dragan AU - Kay, Judy AU - Shaw, Tim PY - 2021/12/9 TI - Exploring the Intersection Between Health Professionals? Learning and eHealth Data: Protocol for a Comprehensive Research Program in Practice Analytics in Health Care JO - JMIR Res Protoc SP - e27984 VL - 10 IS - 12 KW - digital health KW - health informatics KW - practice analytics in health care KW - health professions education KW - continuing professional development N2 - Background: There is an increasing amount of electronic data sitting within the health system. These data have untapped potential to improve clinical practice if extracted efficiently and harnessed to change the behavior of health professionals. Furthermore, there is an increasing expectation from the government and peak bodies that both individual health professionals and health care organizations will use electronic data for a range of applications, including improving health service delivery and informing clinical practice and professional accreditation. Objective: The aim of this research program is to make eHealth data captured within tertiary health care organizations more actionable to health professionals for use in practice reflection, professional development, and other quality improvement activities. Methods: A multidisciplinary approach was used to connect academic experts from core disciplines of health and medicine, education and learning sciences, and engineering and information communication technology with government and health service partners to identify key problems preventing the health care industry from using electronic data to support health professional learning. This multidisciplinary approach was used to design a large-scale research program to solve the problem of making eHealth data more accessible to health professionals for practice reflection. The program will be delivered over 5 years by doctoral candidates undertaking research projects with discrete aims that run in parallel to achieving this program?s objectives. Results: The process used to develop the research program identified 7 doctoral research projects to answer the program objectives, split across 3 streams. Conclusions: This research program has the potential to successfully unpack electronic data siloed within clinical sites and enable health professionals to use them to reflect on their practice and deliver informed and improved care. The program will contribute to current practices by fostering stronger connections between industry and academia, interlinking doctoral research projects to solve complex problems, and creating new knowledge for clinical sites on how data can be used to understand and improve performance. Furthermore, the program aims to affect policy by developing insights on how professional development programs may be strengthened to enhance their alignment with clinical practice. The key contributions of this paper include the introduction of a new conceptualized research program, Practice Analytics in Health care, by describing the foundational academic disciplines that the program is formed of and presenting scientific methods for its design and development. International Registered Report Identifier (IRRID): PRR1-10.2196/27984 UR - https://www.researchprotocols.org/2021/12/e27984 UR - http://dx.doi.org/10.2196/27984 UR - http://www.ncbi.nlm.nih.gov/pubmed/34889768 ID - info:doi/10.2196/27984 ER - TY - JOUR AU - Xie, X. Deborah AU - Boss, F. Emily AU - Stewart, Matthew C. PY - 2021/12/8 TI - Audience of Academic Otolaryngology on Twitter: Cross-sectional Study JO - JMIR Med Educ SP - e25654 VL - 7 IS - 4 KW - Twitter KW - otolaryngology KW - residency KW - medical education KW - social media KW - internet N2 - Background: Despite the ubiquity of social media, the utilization and audience reach of this communication method by otolaryngology-head and neck surgery (OHNS) residency programs has not been investigated. Objective: The purpose of this study was to evaluate the content posted to a popular social media platform (Twitter) by OHNS residency programs. Methods: In this cross-sectional study, we identified Twitter accounts for accredited academic OHNS residency programs. Tweets published over a 6-month period (March to August 2019) were extracted. Tweets were categorized and analyzed for source (original versus retweet) and target audience (medical versus layman). A random sample of 100 tweets was used to identify patterns of content, which were then used to categorize additional tweets. We quantified the total number of likes or retweets by health care professionals. Results: Of the 121 accredited programs, 35 (28.9%) had Twitter accounts. Of the 2526 tweets in the 6-month period, 1695 (67.10%) were original-content tweets. The majority of tweets (1283/1695, 75.69%) were targeted toward health care workers, most of which did not directly contain medical information (954/1283, 74.36%). These tweets contained information about the department?s trainees and education (349/954, 36.6%), participation at conferences (263/954, 27.6%), and research publications (112/954, 11.7%). Two-thirds of all tweets did not contain medical information. Medical professionals accounted for 1249/1362 (91.70%) of retweets and 5616/6372 (88.14%) of likes on original-content tweets. Conclusions: The majority of Twitter usage by OHNS residency programs is for intra and interprofessional communication, and only a minority of tweets contain information geared toward the public. Communication and information sharing with patients is not the focus of OHNS departments on Twitter. UR - https://mededu.jmir.org/2021/4/e25654 UR - http://dx.doi.org/10.2196/25654 UR - http://www.ncbi.nlm.nih.gov/pubmed/34889748 ID - info:doi/10.2196/25654 ER - TY - JOUR AU - Vuku?i? Rukavina, Tea AU - Viski?, Jo?ko AU - Machala Popla?en, Lovela AU - Reli?, Danko AU - Mareli?, Marko AU - Jokic, Drazen AU - Sedak, Kristijan PY - 2021/11/17 TI - Dangers and Benefits of Social Media on E-Professionalism of Health Care Professionals: Scoping Review JO - J Med Internet Res SP - e25770 VL - 23 IS - 11 KW - e-professionalism KW - social media KW - internet KW - health care professionals KW - physicians KW - nurses KW - students KW - medicine KW - dental medicine KW - nursing N2 - Background: As we are witnessing the evolution of social media (SM) use worldwide among the general population, the popularity of SM has also been embraced by health care professionals (HCPs). In the context of SM evolution and exponential growth of users, this scoping review summarizes recent findings of the e-professionalism of HCPs. Objective: The purpose of this scoping review is to characterize the recent original peer-reviewed research studies published between November 1, 2014, to December 31, 2020, on e-professionalism of HCPs; to assess the quality of the methodologies and approaches used; to explore the impact of SM on e-professionalism of HCPs; to recognize the benefits and dangers of SM; and to provide insights to guide future research in this area. Methods: A search of the literature published from November 1, 2014, to December 31, 2020, was performed in January 2021 using 3 databases (PubMed, CINAHL, and Scopus). The searches were conducted using the following defined search terms: ?professionalism? AND ?social media? OR ?social networks? OR ?Internet? OR ?Facebook? OR ?Twitter? OR ?Instagram? OR ?TikTok.? The search strategy was limited to studies published in English. This scoping review follows the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Results: Of the 1632 retrieved papers, a total of 88 studies were finally included in this review. Overall, the quality of the studies was satisfactory. Participants in the reviewed studies were from diverse health care professions. Medical health professionals were involved in about three-quarters of the studies. Three key benefits of SM on e-professionalism of HCPs were identified: (1) professional networking and collaboration, (2) professional education and training, and (3) patient education and health promotion. For the selected studies, there were five recognized dangers of SM on e-professionalism of HCPs: (1) loosening accountability, (2) compromising confidentiality, (3) blurred professional boundaries, (4) depiction of unprofessional behavior, and (5) legal issues and disciplinary consequences. This scoping review also recognizes recommendations for changes in educational curricula regarding e-professionalism as opportunities for improvement and barriers that influence HCPs use of SM in the context of e-professionalism. Conclusions: Findings in the reviewed studies indicate the existence of both benefits and dangers of SM on e-professionalism of HCPs. Even though there are some barriers recognized, this review has highlighted existing recommendations for including e-professionalism in the educational curricula of HCPs. Based on all evidence provided, this review provided new insights and guides for future research on this area. There is a clear need for robust research to investigate new emerging SM platforms, the efficiency of guidelines and educational interventions, and the specifics of each profession regarding their SM potential and use. UR - https://www.jmir.org/2021/11/e25770 UR - http://dx.doi.org/10.2196/25770 UR - http://www.ncbi.nlm.nih.gov/pubmed/34662284 ID - info:doi/10.2196/25770 ER - TY - JOUR AU - Peng, R. Cynthia AU - Schertzer, A. Kimberly AU - Caretta-Weyer, A. Holly AU - Sebok-Syer, S. Stefanie AU - Lu, William AU - Tansomboon, Charissa AU - Gisondi, A. Michael PY - 2021/11/17 TI - Assessment of Entrustable Professional Activities Using a Web-Based Simulation Platform During Transition to Emergency Medicine Residency: Mixed Methods Pilot Study JO - JMIR Med Educ SP - e32356 VL - 7 IS - 4 KW - simulation KW - graduate medical education KW - assessment KW - gamification KW - entrustable professional activities KW - emergency medicine KW - undergraduate medical education N2 - Background: The 13 core entrustable professional activities (EPAs) are key competency-based learning outcomes in the transition from undergraduate to graduate medical education in the United States. Five of these EPAs (EPA2: prioritizing differentials, EPA3: recommending and interpreting tests, EPA4: entering orders and prescriptions, EPA5: documenting clinical encounters, and EPA10: recognizing urgent and emergent conditions) are uniquely suited for web-based assessment. Objective: In this pilot study, we created cases on a web-based simulation platform for the diagnostic assessment of these EPAs and examined the feasibility and acceptability of the platform. Methods: Four simulation cases underwent 3 rounds of consensus panels and pilot testing. Incoming emergency medicine interns (N=15) completed all cases. A maximum of 4 ?look for? statements, which encompassed specific EPAs, were generated for each participant: (1) performing harmful or missing actions, (2) narrowing differential or wrong final diagnosis, (3) errors in documentation, and (4) lack of recognition and stabilization of urgent diagnoses. Finally, we interviewed a sample of interns (n=5) and residency leadership (n=5) and analyzed the responses using thematic analysis. Results: All participants had at least one missing critical action, and 40% (6/15) of the participants performed at least one harmful action across all 4 cases. The final diagnosis was not included in the differential diagnosis in more than half of the assessments (8/15, 54%). Other errors included selecting incorrect documentation passages (6/15, 40%) and indiscriminately applying oxygen (9/15, 60%). The interview themes included psychological safety of the interface, ability to assess learning, and fidelity of cases. The most valuable feature cited was the ability to place orders in a realistic electronic medical record interface. Conclusions: This study demonstrates the feasibility and acceptability of a web-based platform for diagnostic assessment of specific EPAs. The approach rapidly identifies potential areas of concern for incoming interns using an asynchronous format, provides feedback in a manner appreciated by residency leadership, and informs individualized learning plans. UR - https://mededu.jmir.org/2021/4/e32356 UR - http://dx.doi.org/10.2196/32356 UR - http://www.ncbi.nlm.nih.gov/pubmed/34787582 ID - info:doi/10.2196/32356 ER - TY - JOUR AU - Zuo, Tianming AU - Sun, Baozhi AU - Guan, Xu AU - Zheng, Bin AU - Qu, Bo PY - 2021/11/9 TI - Evidence of Construct Validity of Computer-Based Tests for Clinical Reasoning: Instrument Validation Study JO - JMIR Serious Games SP - e17670 VL - 9 IS - 4 KW - medical education KW - assessment KW - computer-based test KW - clinical reasoning KW - validity N2 - Background: Clinical reasoning (CR) is a fundamental skill for all medical students. In our medical education system, however, there are shortcomings in the conventional methods of teaching CR. New technology is needed to enhance our CR teaching, especially as we are facing an influx of new health trainees. China Medical University (CMU), in response to this need, has developed a computer-based CR training system (CMU-CBCRT). Objective: We aimed to find evidence of construct validity of the CMU-CBCRT. Methods: We recruited 385 students from fifth year undergraduates to postgraduate year (PGY) 3 to complete the test on CMU-CBCRT. The known-groups technique was used to evaluate the construct validity of the CBCRT by comparing the test scores among 4 training levels (fifth year MD, PGY-1, PGY-2, and PGY-3). Results: We found that test scores increased with years of training. Significant differences were found in the test scores on information collection, diagnosis, and treatment and total scores among different training years of participants. However, significant results were not found for treatment errors. Conclusions: We provided evidence of construct validity of the CMU-CBCRT, which could determine the CR skills of medical students at varying early stage in their careers. UR - https://games.jmir.org/2021/4/e17670 UR - http://dx.doi.org/10.2196/17670 UR - http://www.ncbi.nlm.nih.gov/pubmed/34751658 ID - info:doi/10.2196/17670 ER - TY - JOUR AU - Yan, Qi AU - Jensen, Katherine AU - Field, Alyssa AU - Goei, Christian AU - Dao Campi, E. Haisar AU - Logue, Alicia AU - Perry, Brian W. AU - Davies, G. Mark PY - 2021/10/15 TI - Critical Evaluation of the Efficiency of Colorectal Fellowship Websites: Cross-sectional Study JO - JMIR Med Educ SP - e30736 VL - 7 IS - 4 KW - recruitment KW - GME KW - social media KW - websites KW - content KW - accessibility KW - online information KW - fellowship information KW - colorectal KW - graduate education KW - graduate medical education N2 - Background: Websites are an important source of information for fellowship applicants, as they can influence ongoing interest and potential program selection. Objective: This study aims to evaluate the current state of colorectal fellowship websites. Methods: This cross-sectional study evaluates the quantity and quality of information available on websites of colorectal fellowship programs verified by the Accreditation Council for Graduate Medical Education in 2019. Results: A total of 63 colorectal fellowships were included for evaluation. Websites were surveyed for content items that previous studies have found to be influential to program applicants. The 58 (91%) programs with a functional website were evaluated using an information index (calculated as a function of availability of content items concerning education, application, personnel, and benefits) and an interactive index (calculated as a function of accessibility and usability of the webpage). Programs had a median total score of 27.8 (IQR 21.5-34.5) of 79. The median score for the interactive index was 7.5 of 15 and for the information index was 20 of 64. The median scores for website application, education, personnel, and benefits or life considerations were 5, 5.5, 3.3, and 4 of 13, 24, 13, and 14, respectively. There was no difference in total score between programs in different geographical regions (P=.46). Conclusions: Currently, colorectal surgery fellowship program websites do not provide enough content for applicants to make informed decisions. All training programs, regardless of specialty, should evaluate and improve their digital footprint to ensure their websites are accessible and provide the information desired by applicants. UR - https://mededu.jmir.org/2021/4/e30736 UR - http://dx.doi.org/10.2196/30736 UR - http://www.ncbi.nlm.nih.gov/pubmed/34652282 ID - info:doi/10.2196/30736 ER - TY - JOUR AU - Naaseh, Ariana AU - Thompson, Sean AU - Tohmasi, Steven AU - Wiechmann, Warren AU - Toohey, Shannon AU - Wray, Alisa AU - Boysen-Osborn, Megan PY - 2021/10/5 TI - Evaluating Applicant Perceptions of the Impact of Social Media on the 2020-2021 Residency Application Cycle Occurring During the COVID-19 Pandemic: Survey Study JO - JMIR Med Educ SP - e29486 VL - 7 IS - 4 KW - residency application KW - social media KW - medical education KW - resident KW - medical student KW - perspective KW - residency recruitment KW - virtual application KW - virtual residency N2 - Background: Due to challenges related to the COVID-19 pandemic, residency programs in the United States conducted virtual interviews during the 2020-2021 application season. As a result, programs and applicants may have relied more heavily on social media?based communication and dissemination of information. Objective: We sought to determine social media?s impact on residency applicants during an entirely virtual application cycle. Methods: An anonymous electronic survey was distributed to 465 eligible 2021 Match applicants at 4 University of California Schools of Medicine in the United States. Results: A total of 72 participants (15.5% of eligible respondents), applying to 16 specialties, responded. Of those who responded, 53% (n=38) reported following prospective residency accounts on social media, and 89% (n=34) of those respondents were positively or negatively influenced by these accounts. The top three digital methods by which applicants sought information about residency programs included the program website, digital conversations with residents and fellows of that program, and Instagram. Among respondents, 53% (n=38) attended virtual information sessions for prospective programs. A minority of applicants (n=19, 26%) adjusted the number of programs they applied to based on information found on social media, with most (n=14, 74%) increasing the number of programs to which they applied. Survey respondents ranked social media?s effectiveness in allowing applicants to learn about programs at 6.7 (SD 2.1) on a visual analogue scale from 1-10. Most applicants (n=61, 86%) felt that programs should use social media in future application cycles even if they are nonvirtual. Conclusions: Social media appears to be an important tool for resident recruitment. Future studies should seek more information on its effect on later parts of the application cycle and the Match. UR - https://mededu.jmir.org/2021/4/e29486 UR - http://dx.doi.org/10.2196/29486 UR - http://www.ncbi.nlm.nih.gov/pubmed/34591779 ID - info:doi/10.2196/29486 ER - TY - JOUR AU - Yang, Lin AU - Zheng, Si AU - Xu, Xiaowei AU - Sun, Yueping AU - Wang, Xuwen AU - Li, Jiao PY - 2021/10/1 TI - Medical Data Mining Course Development in Postgraduate Medical Education: Web-Based Survey and Case Study JO - JMIR Med Educ SP - e24027 VL - 7 IS - 4 KW - medical data mining KW - course development KW - online teaching KW - postgraduate medical education N2 - Background: Medical postgraduates? demand for data capabilities is growing, as biomedical research becomes more data driven, integrative, and computational. In the context of the application of big data in health and medicine, the integration of data mining skills into postgraduate medical education becomes important. Objective: This study aimed to demonstrate the design and implementation of a medical data mining course for medical postgraduates with diverse backgrounds in a medical school. Methods: We developed a medical data mining course called ?Practical Techniques of Medical Data Mining? for postgraduate medical education and taught the course online at Peking Union Medical College (PUMC). To identify the background knowledge, programming skills, and expectations of targeted learners, we conducted a web-based questionnaire survey. After determining the instructional methods to be used in the course, three technical platforms?Rain Classroom, Tencent Meeting, and WeChat?were chosen for online teaching. A medical data mining platform called Medical Data Mining - R Programming Hub (MedHub) was developed for self-learning, which could support the development and comprehensive testing of data mining algorithms. Finally, we carried out a postcourse survey and a case study to demonstrate that our online course could accommodate a diverse group of medical students with a wide range of academic backgrounds and programming experience. Results: In total, 200 postgraduates from 30 disciplines participated in the precourse survey. Based on the analysis of students? characteristics and expectations, we designed an optimized course structured into nine logical teaching units (one 4-hour unit per week for 9 weeks). The course covered basic knowledge of R programming, machine learning models, clinical data mining, and omics data mining, among other topics, as well as diversified health care analysis scenarios. Finally, this 9-week course was successfully implemented in an online format from May to July in the spring semester of 2020 at PUMC. A total of 6 faculty members and 317 students participated in the course. Postcourse survey data showed that our course was considered to be very practical (83/83, 100% indicated ?very positive? or ?positive?), and MedHub received the best feedback, both in function (80/83, 96% chose ?satisfied?) and teaching effect (80/83, 96% chose ?satisfied?). The case study showed that our course was able to fill the gap between student expectations and learning outcomes. Conclusions: We developed content for a data mining course, with online instructional methods to accommodate the diversified characteristics of students. Our optimized course could improve the data mining skills of medical students with a wide range of academic backgrounds and programming experience. UR - https://mededu.jmir.org/2021/4/e24027 UR - http://dx.doi.org/10.2196/24027 UR - http://www.ncbi.nlm.nih.gov/pubmed/34596575 ID - info:doi/10.2196/24027 ER - TY - JOUR AU - Raphaely, Shiri AU - Goldberg, B. Simon AU - Moreno, Megan AU - Stowe, Zachary PY - 2021/9/14 TI - Rates of Assessment of Social Media Use in Psychiatric Interviews Prior to and During COVID-19: Needs Assessment Survey JO - JMIR Med Educ SP - e28495 VL - 7 IS - 3 KW - social media KW - screentime KW - problematic Internet use KW - psychiatric interview KW - psychiatric training KW - COVID-19 KW - residency KW - training KW - survey KW - psychiatry KW - evaluation KW - quarantine N2 - Background: Current research suggests that there is a nuanced relationship between mental well-being and social media. Social media offers opportunities for empowerment, information, and connection while also showing links with depression, high-risk behavior, and harassment. As this medium rapidly integrates into interpersonal interactions, incorporation of social media assessment into the psychiatric evaluation warrants attention. Furthermore, the COVID-19 pandemic and containment measures (ie, social distancing) led to increased dependence on social media, allowing an opportunity to assess the adaptation of psychiatric interviews in response to sociocultural changes. Objective: The first aim of this study was to evaluate if general psychiatry residents and child and adolescent psychiatry fellows assessed social media use as part of the clinical interview. Second, the study examined whether changes were made to the social media assessment in response to known increase of social media use secondary to social distancing measures during the COVID-19 pandemic. Methods: As part of a quality improvement project, the authors surveyed general psychiatry residents and child psychiatry fellows in a university-based training program (n=21) about their assessment of social media use in patient evaluations. Soon after the survey closed, ?stay-at-home? orders related to the COVID-19 pandemic began. A subsequent survey was sent out with the same questions to evaluate if residents and fellows altered their interview practices in response to the dramatic sociocultural changes (n=20). Results: Pre-COVID-19 pandemic survey results found that 10% (2/21) of respondents incorporated social media questions in patient evaluations. In a follow-up survey after the onset of the pandemic, 20% (4/20) of respondents included any assessment of social media use. Among the 15 participants who completed both surveys, there was a nonsignificant increase in the likelihood of asking about social media use (2/15, 13% vs 4/15, 27%, for pre- and during COVID-19, respectively; McNemar ?21=0.25, P=.617, Cohen d=0.33). Conclusions: These small survey results raise important questions relevant to the training of residents and fellows in psychiatry. The findings suggest that the assessment of social media use is a neglected component of the psychiatric interview by trainees. The burgeoning use and diversity of social media engagement warrant scrutiny with respect to how this is addressed in interview training. Additionally, given minimal adaptation of the interview in the midst of a pandemic, these findings imply an opportunity for improving psychiatric training that incorporates adapting clinical interviews to sociocultural change. UR - https://mededu.jmir.org/2021/3/e28495 UR - http://dx.doi.org/10.2196/28495 UR - http://www.ncbi.nlm.nih.gov/pubmed/34375297 ID - info:doi/10.2196/28495 ER - TY - JOUR AU - El Shatanofy, Muhammad AU - Brown, Lauryn AU - Berger, Peter AU - Gu, Alex AU - Sharma, K. Abhinav AU - Campbell, Joshua AU - Tabaie, Sean PY - 2021/9/10 TI - Orthopedic Surgery Residency Program Website Content and Accessibility During the COVID-19 Pandemic: Observational Study JO - JMIR Med Educ SP - e30821 VL - 7 IS - 3 KW - orthopedic surgery residency programs KW - COVID-19 KW - website KW - residency applicants KW - residency KW - medical student KW - content KW - accessibility KW - observational KW - surgery N2 - Background: The exceptional competitiveness of the orthopedic surgery specialty, combined with the unclear impact of the COVID-19 pandemic on residency recruitment, has presented significant challenges to applicants and residency program directors. With limited in-person opportunities in the 2020-2021 application cycle, applicants have been pressed to gauge chances and best fit by browsing program websites. Objective: The aim of the study was to assess the accessibility and content of accredited orthopedic surgery residency program websites during the COVID-19 pandemic. Methods: Using the online database of the Electronic Residency Application Service (ERAS), we compiled a list of accredited orthopedic surgery residency programs in the United States. Program websites were evaluated across four domains: program overview, education, research opportunities, and application details. Each website was assessed twice in July 2020, during a period of adjustment to the COVID-19 pandemic, and twice in November 2020, following the October ERAS application deadline. Results: A total of 189 accredited orthopedic surgery residency programs were identified through ERAS. Of these programs, 3 (1.6%) did not have functional website links on ERAS. Data analysis of content in each domain revealed that most websites included program details, a description of the didactic curriculum, and sample rotation schedules. Between the two evaluation periods in July and November 2020, the percentage of program websites containing informative videos and virtual tours rose from 12.2% (23/189) to 48.1% (91/189; P<.001) and from 0.5% (1/189) to 13.2% (25/189; P<.001), respectively. However, the number of programs that included information about a virtual subinternship or virtual interview on their websites did not change. Over the 4-month period, larger residency programs with 5 or more residents were significantly more likely to add a program video (P<.001) or virtual tour (P<.001) to their websites. Conclusions: Most residency program websites offered program details and an overview of educational and research opportunities; however, few addressed the virtual transition of interviews and subinternships during the COVID-19 pandemic. UR - https://mededu.jmir.org/2021/3/e30821 UR - http://dx.doi.org/10.2196/30821 UR - http://www.ncbi.nlm.nih.gov/pubmed/34449406 ID - info:doi/10.2196/30821 ER - TY - JOUR AU - Azab, A. Mohammed AU - Hasaneen, Fawzy Sharef AU - Reda, Ahmed AU - Asous, Ashraf AU - Azzam, Y. Ahmed PY - 2021/8/9 TI - Individual and Institutional Factors Preventing Completion of Research by Medical Graduate Students at Cairo University: Questionnaire Study JO - JMIR Med Educ SP - e23235 VL - 7 IS - 3 KW - research KW - Cairo University KW - medical KW - nonpublication N2 - Background: Medical research plays a significant role in advancing the level of health care worldwide. This research is a crucial part of the development of any educational system. In developing countries, the publication rate related to the medical sciences is lower than that in developed countries. Objective: The aim of this study was to explore the causes of delay in publishing research and the factors that hinder the completion of master?s degree projects in a group of medical graduate students at Cairo University Faculty of Medicine. Methods: A web-based questionnaire was introduced to approximately 150 medical graduates in different specialties through social media. The questionnaire aimed to investigate the reasons for delays in publishing master?s degree manuscripts after graduation among a group of medical graduates. Results: Of the graduates contacted, 130 responded to the web-based survey. The ages of the participants ranged from 23-38 years (SD 3.88); 72 of them were male, and 58 were female. Causes of noncompletion of manuscripts were analyzed; lack of proper research training and the absence of supportive mentorship were top reasons. We found a significant relationship between being married and failing to complete the assigned project from its start up to publication. Moreover, we found that the frequency of nonfulfillment increased among those who experienced poor mentorship. Conclusions: Several factors are contributing to the delay in publication of medical manuscripts related to research projects by medical graduates of the Cairo University Faculty of Medicine. Pensive supervision must be implemented to decipher the persistent institutional problems that obstruct research progress. UR - https://mededu.jmir.org/2021/3/e23235 UR - http://dx.doi.org/10.2196/23235 UR - http://www.ncbi.nlm.nih.gov/pubmed/33858818 ID - info:doi/10.2196/23235 ER - TY - JOUR AU - Gopwani, R. Sumeet AU - Adams, Erin AU - Rooney, Alexandra AU - Tousimis, Eleni AU - Ramsey, Katherine AU - Warusha, Sohan PY - 2021/7/26 TI - Impact of a Workflow-Integrated Web Tool on Resource Utilization and Information-Seeking Behavior in an Academic Anesthesiology Department: Longitudinal Cohort Survey Study JO - JMIR Med Educ SP - e26325 VL - 7 IS - 3 KW - graduate medical education KW - learning technology KW - anesthesiology KW - information-seeking behavior KW - web tool KW - teaching KW - millennial learners N2 - Background: Medical resident reading and information-seeking behavior is limited by time constraints as well as comfort in accessing and assessing evidence-based resources. Educational technology interventions, as the preferred method for millennial leaners, can reduce these barriers. We implemented an educational web tool, consisting of peer-reviewed articles as well as local and national protocols and policies, built into the daily workflow of a university-based anesthesiology department. We hypothesized that this web tool would increase resource utilization and overall perceptions of the educational environment. Objective: The goal of this study was to demonstrate that an educational web tool designed and built into the daily workflow of an academic anesthesia department for trainees could significantly decrease barriers to resource utilization, improve faculty-trainee teaching interactions, and improve the perceptions of the educational environment. Methods: Following Institutional Review Board approval, a longitudinal cohort survey study was conducted to assess trainee resource utilization, faculty evaluation of trainees? resource utilization, and trainee and faculty perceptions about the educational environment. The survey study was conducted in a pre-post fashion 3 months prior to web tool implementation and 3 months following implementation. Data were deidentified and analyzed unpaired using Student t tests for continuous data and chi-square tests for ordinal data. Results: Survey response rates were greater than 50% in all groups: of the 43 trainees, we obtained 27 (63%) preimplementation surveys and 22 (51%) postimplementation surveys; of the 46 faculty members, we obtained 25 (54%) preimplementation surveys and 23 (50%) postimplementation surveys. Trainees showed a significant improvement in utilization of peer-reviewed articles (preimplementation mean 8.67, SD 6.45; postimplementation mean 18.27, SD 12.23; P=.02), national guidelines (preimplementation mean 2.3, SD 2.40; postimplementation mean 6.14, SD 5.01; P<.001), and local policies and protocols (preimplementation mean 2.23, SD 2.72; postimplementation mean 6.95, SD 6.09; P=.02). There was significant improvement in faculty-trainee educational interactions (preimplementation mean 1.67, SD 1.33; postimplementation mean 6.05, SD 8.74; P=.01). Faculty assessment of trainee resource utilization also demonstrated statistically significant improvements across all resource categories. Subgroups among trainees and faculty showed similar trends toward improvement. Conclusions: Learning technology interventions significantly decrease the barriers to resource utilization, particularly among millennial learners. Further investigation has been undertaken to assess how this may impact learning, knowledge retention, and patient outcomes. UR - https://mededu.jmir.org/2021/3/e26325 UR - http://dx.doi.org/10.2196/26325 UR - http://www.ncbi.nlm.nih.gov/pubmed/34309566 ID - info:doi/10.2196/26325 ER - TY - JOUR AU - Herbst, Rachel AU - Rybak, Tiffany AU - Meisman, Andrea AU - Whitehead, Monica AU - Rosen, Brittany AU - Crosby, E. Lori AU - Klein, D. Melissa AU - Real, J. Francis PY - 2021/6/29 TI - A Virtual Reality Resident Training Curriculum on Behavioral Health Anticipatory Guidance: Development and Usability Study JO - JMIR Pediatr Parent SP - e29518 VL - 4 IS - 2 KW - resident education KW - virtual reality KW - behavioral health promotion KW - COVID-19 N2 - Background: Behavioral health disorders have steadily increased and been exacerbated by the COVID-19 pandemic. Though behavioral health disorders can be successfully mitigated with early implementation of evidence-based parent management strategies, education for pediatric residents on behavioral health anticipatory guidance has been limited to date, with training challenges compounded by the physical distancing requirements of the COVID-19 pandemic. Virtual reality (VR) simulations provide an opportunity to train residents on this complex competency by allowing deliberate practice of necessary skills while adhering to current social distancing guidelines. Objective: This study explored the usability of a VR-based behavioral health anticipatory guidance curriculum for pediatric residents. Methods: This mixed methods study included 14 postgraduate third-year pediatric residents who completed the behavioral health anticipatory guidance VR curriculum. Residents completed the MEC Spatial Presence Questionnaire to assess immersion in the virtual environment. Semistructured interviews were used to elucidate residents? perspectives on the curriculum?s content and format. The interviews were analyzed using conventional content analysis. Results: Quantitatively, residents reported a high degree of immersion, spatial presence, and cognitive involvement. Most residents (11/14, 79%) agreed or strongly agreed that it seemed as though they took part in the action of the simulation. Qualitatively, two themes emerged from the data: (1) the curriculum expands behavioral health anticipatory guidance and motivational interviewing knowledge and skills and (2) VR technology is uniquely positioned to develop competence. These themes revealed that the curriculum expanded their current level of knowledge and skill, addressed training gaps, and was applicable to all residents. Additionally, residents experienced VR as immersive, feasible, realistic to the clinic setting, and a safe space to practice and learn new skills. Conclusions: Pilot data indicates that VR may be an effective tool to teach pediatric residents behavioral health anticipatory guidance, meeting a current gap in medical education training. This VR curriculum is particularly relevant in the context of the COVID-19 pandemic given the increased behavioral health concerns of families. UR - https://pediatrics.jmir.org/2021/2/e29518 UR - http://dx.doi.org/10.2196/29518 UR - http://www.ncbi.nlm.nih.gov/pubmed/34081601 ID - info:doi/10.2196/29518 ER - TY - JOUR AU - Luo, Ping AU - Pang, Wenwen AU - Wang, Yingying AU - Liu, Minghui AU - Zhou, Shu AU - Liu, Shuai AU - Zhang, Xian AU - Liu, Li AU - Liu, Yanan AU - Zhou, Fuling PY - 2021/5/25 TI - WeChat as a Platform for Problem-Based Learning Among Hematological Postgraduates: Feasibility and Acceptability Study JO - J Med Internet Res SP - e16463 VL - 23 IS - 5 KW - problem-based learning KW - PBL KW - WeChat KW - hematology KW - postgraduate KW - education N2 - Background: Hematological medicine is a practical discipline that is difficult to study. Problem-based learning (PBL) is an innovative student-centered teaching method wherein students define their own learning objectives from clinically based problems. Considering that WeChat is the most popular communication app in China, we selected it as a new platform for online PBL to reduce the limitations of traditional PBL in hematology teaching. Objective: This study aims to explore a new pedagogical method called WeChat-PBL, which is based on real micro clinical cases for postgraduates majoring in hematology and to demonstrate its feasibility and acceptability. Methods: A total of 48 hematological postgraduates and 7 tutors participated in this study. We divided the participants into 7 groups where students can learn theoretical knowledge. After each course, the members of each group were required to complete in-class quizzes. Moreover, the students and tutors were required to fill out periodic (after each class) and overall (after each semester) evaluations. Results: A total of 8 micro clinical cases were presented in WeChat-PBL. The average quiz score for acute myelogenous leukemia, chronic myeloid leukemia, multiple myeloma, acute promyelocytic leukemia, and lymphoma were 89.0%, 86.0%, 83.4%, 88.8%, and 77.5%, respectively. Periodic evaluations showed that both students and tutors were satisfied with the process of WeChat-PBL. The overall evaluation results showed that WeChat-PBL was able to positively impact the learning experiences of hematological postgraduates. Conclusions: Our results indicate the feasibility and acceptability of the WeChat-PBL teaching method for postgraduates majoring in hematology. UR - https://www.jmir.org/2021/5/e16463 UR - http://dx.doi.org/10.2196/16463 UR - http://www.ncbi.nlm.nih.gov/pubmed/34032573 ID - info:doi/10.2196/16463 ER - TY - JOUR AU - Alcocer Alkureishi, Maria AU - Lenti, Gena AU - Choo, Zi-Yi AU - Castaneda, Jason AU - Weyer, George AU - Oyler, Julie AU - Lee, Wei Wei PY - 2021/4/29 TI - Teaching Telemedicine: The Next Frontier for Medical Educators JO - JMIR Med Educ SP - e29099 VL - 7 IS - 2 KW - telemedicine KW - virtual visits KW - patient-centered care KW - graduate medical education KW - medical education KW - telehealth KW - virtual health KW - graduate students KW - education KW - COVID-19 KW - pandemic UR - https://mededu.jmir.org/2021/2/e29099 UR - http://dx.doi.org/10.2196/29099 UR - http://www.ncbi.nlm.nih.gov/pubmed/33878011 ID - info:doi/10.2196/29099 ER - TY - JOUR AU - Tam, K. Emily AU - Dong, Xuezhi PY - 2021/4/14 TI - Survey of Residency Directors? Views on Entrepreneurship JO - JMIR Med Educ SP - e19079 VL - 7 IS - 2 KW - medical student education KW - medical student innovation KW - health innovation KW - program director UR - https://mededu.jmir.org/2021/2/e19079 UR - http://dx.doi.org/10.2196/19079 UR - http://www.ncbi.nlm.nih.gov/pubmed/33851929 ID - info:doi/10.2196/19079 ER - TY - JOUR AU - Carson, Y. Thaddeus AU - Hatzigeorgiou, Christos AU - Wyatt, R. Tasha AU - Egan, Sarah AU - Beidas, O. Sary PY - 2020/12/29 TI - Development and Implementation of a Web-Based Learning Environment for an Inpatient Internal Medicine Team: Questionnaire Study JO - JMIR Med Educ SP - e18102 VL - 6 IS - 2 KW - inpatient internal medicine KW - academic hospitalist KW - medical education KW - blended learning environment KW - social media KW - online education KW - internal medicine ward KW - internal medicine education N2 - Background: The notion of anytime, anyplace communication is characteristic of the current generation of learners. Such communications have facilitated the growth and integration of a blended or hybrid learning platform in multiple educational settings. However, there are limited reports on the use of an anytime, anyplace communication platform in clinical inpatient medical education. Objective: The setting of a high-demand inpatient clinical rotation is ideal for the use of collaborative software, and this integration is expected to positively influence medical education. The purpose of this study is to evaluate medical students? and residents? educational experiences with incorporating a simple, web-based content management and file sharing platform into an internal medicine inpatient rotation. Methods: During an inpatient internal medicine rotation, faculty and learners jointly used collaborative software for educational purposes, and a postrotation survey tool was used to measure the educational influence of the software. Results: Based on the results of the postrotation survey, the integration of a collaborative software application during clinical rotations improved the learning experience. Learning climate, the communication of rotation goals, and self-directed learning all scored favorably, but feedback from the survey participants was mixed. The learners enthusiastically accepted the practical use of this tool for both communication and information sharing. Conclusions: This generation of learners is accustomed to frequent electronic communication. Based on our survey, these learners appear to be highly receptive to this web-based intervention design for improving clinical education during active patient care. Adding effective blended learning features to a traditional clinical setting is achievable. UR - http://mededu.jmir.org/2020/2/e18102/ UR - http://dx.doi.org/10.2196/18102 UR - http://www.ncbi.nlm.nih.gov/pubmed/33372895 ID - info:doi/10.2196/18102 ER - TY - JOUR AU - Rössler, Julian AU - Kaserer, Alexander AU - Albiez, Benjamin AU - Braun, Julia AU - Breckwoldt, Jan AU - Spahn, Rudolf Donat AU - Nöthiger, Christoph AU - Tscholl, Werner David PY - 2020/4/23 TI - Comparing Classroom Instruction to Individual Instruction as an Approach to Teach Avatar-Based Patient Monitoring With Visual Patient: Simulation Study JO - JMIR Med Educ SP - e17922 VL - 6 IS - 1 KW - avatar KW - computer-assisted KW - diagnosis N2 - Background: Visual Patient is an avatar-based alternative to standard patient monitor displays that significantly improves the perception of vital signs. Implementation of this technology in larger organizations would require it to be teachable by brief class instruction to large groups of professionals. Therefore, our study aimed to investigate the efficacy of such a large-scale introduction to Visual Patient. Objective: In this study, we aimed to compare 2 different educational methods, one-on-one instruction and class instruction, for training anesthesia providers in avatar-based patient monitoring. Methods: We presented 42 anesthesia providers with 30 minutes of class instruction on Visual Patient (class instruction group). We further selected a historical sample of 16 participants from a previous study who each received individual instruction (individual instruction group). After the instruction, the participants were shown monitors with either conventional displays or Visual Patient displays and were asked to interpret vital signs. In the class instruction group, the participants were shown scenarios for either 3 or 10 seconds, and the numbers of correct perceptions with each technology were compared. Then, the teaching efficacy of the class instruction was compared with that of the individual instruction in the historical sample by 2-way mixed analysis of variance and mixed regression. Results: In the class instruction group, when participants were presented with the 3-second scenario, there was a statistically significant median increase in the number of perceived vital signs when the participants were shown the Visual Patient compared to when they were shown the conventional display (3 vital signs, P<.001; effect size ?0.55). No significant difference was found for the 10-second scenarios. There was a statistically significant interaction between the teaching intervention and display technology in the number of perceived vital signs (P=.04; partial ?2=.076). The mixed logistic regression model for correct vital sign perception yielded an odds ratio (OR) of 1.88 (95% CI 1.41-2.52; P<.001) for individual instruction compared to class instruction as well as an OR of 3.03 (95% CI 2.50-3.70; P<.001) for the Visual Patient compared to conventional monitoring. Conclusions: Although individual instruction on Visual Patient is slightly more effective, class instruction is a viable teaching method; thus, large-scale introduction of health care providers to this novel technology is feasible. UR - http://mededu.jmir.org/2020/1/e17922/ UR - http://dx.doi.org/10.2196/17922 UR - http://www.ncbi.nlm.nih.gov/pubmed/32205304 ID - info:doi/10.2196/17922 ER - TY - JOUR AU - Torabi, Asad AU - Khemka, Abhishek AU - Bateman, V. Pantila PY - 2020/4/16 TI - A Cardiology Handbook App to Improve Medical Education for Internal Medicine Residents: Development and Usability Study JO - JMIR Med Educ SP - e14983 VL - 6 IS - 1 KW - mobile learning KW - medical reference app KW - cardiology KW - internal medicine N2 - Background: At most institutions, internal medicine residents struggle with balancing clinical duties and learning opportunities, particularly during busy cardiology ward rotations. To improve learning experiences for residents, we helped develop a cardiology handbook app to supplement cardiology education. Objective: The aim of this study was to report the development, implementation, and preliminary impact of the Krannert Cardiology Handbook app on graduate medical education. Methods: In June 2017, 122 residents at Indiana University were invited to download the digital handbook in the Krannert app. The Krannert app featured a total of 13 chapters written by cardiology fellows and faculty at Indiana University. Residents were surveyed on their self-reported improvement in cardiology knowledge and level of satisfaction after using the Krannert app. Residents were also surveyed regarding their preference for a digital handbook app versus a paper handbook. Results: Of the 122 residents, 38 trainees (31.1%) participated in survey evaluations. Among all respondents, 31 app users (82%) reported that the app helped improve their cardiology knowledge base. The app had an overall favorable response. Conclusions: The Krannert app shows promise in augmenting clinical education in cardiology with mobile learning. Future work includes adding new topics, updating the content, and comparing the app to other learning modalities. UR - http://mededu.jmir.org/2020/1/e14983/ UR - http://dx.doi.org/10.2196/14983 UR - http://www.ncbi.nlm.nih.gov/pubmed/32297866 ID - info:doi/10.2196/14983 ER - TY - JOUR AU - Hsiao, Cheng-Ting AU - Chou, ChihChen Fremen AU - Hsieh, Chih-Cheng AU - Chang, Chun Li AU - Hsu, Chih-Ming PY - 2020/4/14 TI - Developing a Competency-Based Learning and Assessment System for Residency Training: Analysis Study of User Requirements and Acceptance JO - J Med Internet Res SP - e15655 VL - 22 IS - 4 KW - competency-based learning KW - milestones KW - entrustable professional activities KW - assessment KW - learning platform N2 - Background: The increasingly complex medical environment highlights the importance of milestones and entrustable professional activities (EPAs) to realize the ideals of competency-based medical education (CBME). However, if enormous amounts of assessment results need to be compiled, the development of a digital system to manage, integrate, and synthesize learning and assessment data will be necessary. Furthermore, this system should be able to facilitate real-time assessment with feedback and therefore enhance users? learning through coaching in the moment in the clinical workplace. Objective: The main purpose of this study was to develop a competency-based electronic platform system to provide resident physicians with clinical assessments and learning in order to enhance the learning of trainees and reduce the burden of assessments. Methods: A competency-based learning and assessment system (CBLAS) for residency training was designed, developed, and evaluated in this study. Opinion interviews and a focus group consensus meeting of key users, including trainees, clinical teachers, and administrative staff, were conducted as needs assessments. The structure of the CBLAS was designed according to the thematic analysis of needs assessments. Clinical teachers? acceptance of using CBME assessments, according to the constructs of attitude, perceived usefulness, and perceived ease of use, was surveyed in the beginning and half a year after implementation of the CBLAS. Additionally, the satisfaction of using the CBLAS, according to information, system, and service qualities, was surveyed after implementation. Results: The main functions of the CBLAS, including milestones, EPAs, learning portfolios, teacher/student feedback, e-books, learning materials, assessment progress tracking, and statistical analysis of assessment results, were designed and developed for responding to nine themes, which emerged from the needs assessments of the three user groups. Twenty clinical teachers responded to the CBME assessment acceptance surveys before and after CBLAS implementation, which revealed a significant improvement in the factor of ?attitude? (P=.02) but no significant differences in the two factors of ?usefulness? (P=.09) and ?ease of use? (P=.58) for CBME assessments. Furthermore, satisfaction surveys were performed in 117 users, and 87.2% (102/117) were satisfied with the CBLAS in terms of information, system, and service qualities. There was no significant difference in satisfaction among different user groups. Conclusions: The CBLAS is a user-centered platform that supports clinical teachers? assessment exercises and residents? learning, as well as administrative work for staff according to users? needs assessments and operationalized features of CBME assessments. With the system, clinical teachers had a more positive attitude to conduct the assessment activities of milestones and EPAs and learners could arrange their study schedules to enhance their learning effectiveness. The CBLAS sheds light on how to effectively design and develop a digital system to execute milestone- and EPA-based assessments for enhancing competency-based education among residents, according to our experiences in Taiwan. UR - https://www.jmir.org/2020/4/e15655 UR - http://dx.doi.org/10.2196/15655 UR - http://www.ncbi.nlm.nih.gov/pubmed/32286233 ID - info:doi/10.2196/15655 ER - TY - JOUR AU - Hani, Selim AU - Chalouhi, Gihad AU - Lakissian, Zavi AU - Sharara-Chami, Rana PY - 2019/9/26 TI - Introduction of Ultrasound Simulation in Medical Education: Exploratory Study JO - JMIR Med Educ SP - e13568 VL - 5 IS - 2 KW - medical education KW - simulation training KW - ultrasonography N2 - Background: Ultrasound is ubiquitous across all disciplines of medicine; it is one of the most commonly used noninvasive, painless diagnostic tools. However, not many are educated and trained well enough in its use. Ultrasound requires not only theoretical knowledge but also extensive practical experience. The simulated setting offers the safest environment for health care professionals to learn and practice using ultrasound. Objective: This study aimed to (1) assess health care professionals? need for and enthusiasm toward practicing using ultrasound via simulation and (2) gauge their perception and acceptance of simulation as an integral element of ultrasound education in medical curricula. Methods: A day-long intervention was organized at the American University of Beirut Medical Center (AUBMC) to provide a free-of-charge interactive ultrasound simulation workshop?using CAE Vimedix high-fidelity simulator?for health care providers, including physicians, nurses, ultrasound technicians, residents, and medical students. Following the intervention, attendees completed an evaluation, which included 4 demographic questions and 16 close-ended questions based on a Likert scale agree-neutral-disagree. The results presented are based on this evaluation form. Results: A total of 41 participants attended the workshop (46% [19/41] physicians, 30% [12/41] residents, 19% [8/41] sonographers, and 5% [2/41] medical students), mostly from AUBMC (88%, 36/41), with an average experience of 2.27 (SD 3.45) years and 30 (SD 46) scans per attendee. Moreover, 15 out of 41 (36%) participants were from obstetrics and gynecology, 11 (27%) from internal medicine, 4 (10%) from pediatrics, 4 (10%) from emergency medicine, 2 (5%) from surgery and family medicine, and 5 (12%) were technicians. The majority of participants agreed that ultrasound provided a realistic setting (98%, 40/41) and that it allowed for training and identification of pathologies (88%, 36/41). Furthermore, 100% (41/41) of the participants agreed that it should be part of the curriculum either in medical school or residency, and most of the participants approved it for training (98%, 40/41) and teaching (98%, 40/41). Conclusions: All attendees were satisfied with the intervention. There was a positive perception toward the use of simulation for training and teaching medical students and residents in using ultrasound, and there was a definite need and enthusiasm for its integration into curricula. Simulation offers an avenue not only for teaching but also for practicing the ultrasound technology by both medical students and health care providers. UR - http://mededu.jmir.org/2019/2/e13568/ UR - http://dx.doi.org/10.2196/13568 UR - http://www.ncbi.nlm.nih.gov/pubmed/31573944 ID - info:doi/10.2196/13568 ER - TY - JOUR AU - de Leeuw, Robert AU - Scheele, Fedde AU - Walsh, Kieran AU - Westerman, Michiel PY - 2019/07/22 TI - A 9-Step Theory- and Evidence-Based Postgraduate Medical Digital Education Development Model: Empirical Development and Validation JO - JMIR Med Educ SP - e13004 VL - 5 IS - 2 KW - postgraduate medical e-learning KW - instructional design KW - e-learning KW - distance education KW - design model KW - education, medical KW - education, distance KW - models, educational N2 - Background: Digital education tools (e-learning, technology-enhanced learning) can be defined as any educational intervention that is electronically mediated. Decveloping and applying such tools and interventions for postgraduate medical professionals who work and learn after graduation can be called postgraduate medical digital education (PGMDE), which is increasingly being used and evaluated. However, evaluation has focused mainly on reaching the learning goals and little on the design. Design models for digital education (instructional design models) help educators create a digital education curriculum, but none have been aimed at PGMDE. Studies show the need for efficient, motivating, useful, and satisfactory digital education. Objective: Our objective was (1) to create an empirical instructional design model for PGMDE founded in evidence and theory, with postgraduate medical professionals who work and learn after graduation as the target audience, and (2) to compare our model with existing models used to evaluate and create PGMDE. Methods: Previously we performed an integrative literature review, focus group discussions, and a Delphi procedure to determine which building blocks for such a model would be relevant according to experts and users. This resulted in 37 relevant items. We then used those 37 items and arranged them into chronological steps. After we created the initial 9-step plan, we compared these steps with other models reported in the literature. Results: The final 9 steps were (1) describe who, why, what, (2) select educational strategies, (3) translate to the real world, (4) choose the technology, (5) complete the team, (6) plan the budget, (7) plan the timing and timeline, (8) implement the project, and (9) evaluate continuously. On comparing this 9-step model with other models, we found that no other was as complete, nor were any of the other models aimed at PGMDE. Conclusions: Our 9-step model is the first, to our knowledge, to be based on evidence and theory building blocks aimed at PGMDE. We have described a complete set of evidence-based steps, expanding a 3-domain model (motivate, learn, and apply) to an instructional design model that can help every educator in creating efficient, motivating, useful, and satisfactory PGMDE. Although certain steps are more robust and have a deeper theoretical background in current research (such as education), others (such as budget) have been barely touched upon and should be investigated more thoroughly in order that proper guidelines may also be provided for them. UR - http://mededu.jmir.org/2019/2/e13004/ UR - http://dx.doi.org/10.2196/13004 UR - http://www.ncbi.nlm.nih.gov/pubmed/31333194 ID - info:doi/10.2196/13004 ER - TY - JOUR AU - Clavier, Thomas AU - Ramen, Julie AU - Dureuil, Bertrand AU - Veber, Benoit AU - Hanouz, Jean-Luc AU - Dupont, Hervé AU - Lebuffe, Gilles AU - Besnier, Emmanuel AU - Compere, Vincent PY - 2019/04/09 TI - Use of the Smartphone App WhatsApp as an E-Learning Method for Medical Residents: Multicenter Controlled Randomized Trial JO - JMIR Mhealth Uhealth SP - e12825 VL - 7 IS - 4 KW - education, medical, graduate/methods KW - educational measurement KW - anesthesiology KW - internship and residency KW - trauma KW - hemorrhage KW - mobile applications KW - WhatsApp KW - smartphone KW - teaching materials KW - mobile phone N2 - Background: The WhatsApp smartphone app is the most widely used instant messaging app in the world. Recent studies reported the use of WhatsApp for educational purposes, but there is no prospective study comparing WhatsApp?s pedagogical effectiveness to that of any other teaching modality. Objective: The main objective of this study was to measure the impact of a learning program via WhatsApp on clinical reasoning in medical residents. Methods: This prospective, randomized, multicenter study was conducted among first- and second-year anesthesiology residents (offline recruitment) from four university hospitals in France. Residents were randomized in two groups of online teaching (WhatsApp and control). The WhatsApp group benefited from daily delivery of teaching documents on the WhatsApp app and a weekly clinical case supervised by a senior physician. In the control group, residents had access to the same documents via a traditional computer electronic learning (e-learning) platform. Medical reasoning was self-assessed online by a script concordance test (SCT; primary parameter), and medical knowledge was assessed using multiple-choice questions (MCQs). The residents also completed an online satisfaction questionnaire. Results: In this study, 62 residents were randomized (32 to the WhatsApp group and 30 to the control group) and 22 residents in each group answered the online final evaluation. We found a difference between the WhatsApp and control groups for SCTs (60% [SD 9%] vs 68% [SD 11%]; P=.006) but no difference for MCQs (18/30 [SD 4] vs 16/30 [SD 4]; P=.22). Concerning satisfaction, there was a better global satisfaction rate in the WhatsApp group than in the control group (8/10 [interquartile range 8-9] vs 8/10 [interquartile range 8-8]; P=.049). Conclusions: Compared to traditional e-learning, the use of WhatsApp for teaching residents was associated with worse clinical reasoning despite better global appreciation. The use of WhatsApp probably contributes to the dispersion of attention linked to the use of the smartphone. The impact of smartphones on clinical reasoning should be studied further. UR - http://mhealth.jmir.org/2019/4/e12825/ UR - http://dx.doi.org/10.2196/12825 UR - http://www.ncbi.nlm.nih.gov/pubmed/30964435 ID - info:doi/10.2196/12825 ER - TY - JOUR AU - Aylwin, Christopher PY - 2019/4/4 TI - Faculty and Student Interaction in an Online Master?s Course: Survey and Content Analysis JO - JMIR Med Educ SP - e10464 VL - 5 IS - 1 KW - online learning KW - faculty & student interaction KW - Community of Inquiry KW - medicine N2 - Background: The provision of online educational courses has soared since the creation of the World Wide Web, with most universities offering some degree of distance-based programs. The social constructivist pedagogy is widely accepted as the framework to provide education, but it largely relies on the face-to-face presence of students and faculty to foster a learning environment. The concern with online courses is that this physical interaction is removed, and therefore learning may be diminished. Objective: The Community of Inquiry (CoI) is a framework designed to support the educational experience of such courses. This study aims to examine the characteristics of the CoI across the whole of an entirely online master?s course. Methods: This research used a case study method, using a convergent parallel design to study the interactions described by the CoI model in an online master?s program. The MSc program studied is a postgraduate medical degree for doctors or allied health professionals. Different data sources were used to corroborate this dataset including content analysis of both asynchronous and synchronous discussion forums. Results: This study found that a CoI can be created within the different learning activities of the course. The discussion forums integral to online courses are a rich source of interaction, with the ability to promote social interaction, teaching presence, and cognitive learning. Conclusions: The results show that meaningful interaction between faculty and student can be achieved in online courses, which is important to ensure deep learning and reflection. UR - http://mededu.jmir.org/2019/1/e10464/ UR - http://dx.doi.org/10.2196/10464 UR - http://www.ncbi.nlm.nih.gov/pubmed/30958274 ID - info:doi/10.2196/10464 ER - TY - JOUR AU - de Leeuw, Robert AU - de Soet, Anneloes AU - van der Horst, Sabine AU - Walsh, Kieran AU - Westerman, Michiel AU - Scheele, Fedde PY - 2019/04/05 TI - How We Evaluate Postgraduate Medical E-Learning: Systematic Review JO - JMIR Med Educ SP - e13128 VL - 5 IS - 1 KW - distance education KW - learning KW - professional education N2 - Background: Electronic learning (e-learning) in postgraduate medical education has seen a rapid evolution; however, we tend to evaluate it only on its primary outcome or learning aim, whereas its effectiveness also depends on its instructional design. We believe it is important to have an overview of all the methods currently used to evaluate e-learning design so that the preferred method may be identified and the next steps needed to continue to evaluate postgraduate medical e-learning may be outlined. Objective: This study aimed to identify and compare the outcomes and methods used to evaluate postgraduate medical e-learning. Methods: We performed a systematic literature review using the Web of Science, PubMed, Education Resources Information Center, and Cumulative Index of Nursing and Allied Health Literature databases. Studies that used postgraduates as participants and evaluated any form of e-learning were included. Studies without any evaluation outcome (eg, just a description of e-learning) were excluded. Results: The initial search identified 5973 articles, of which we used 418 for our analysis. The types of studies were trials, prospective cohorts, case reports, and reviews. The primary outcomes of the included studies were knowledge, skills, and attitude. A total of 12 instruments were used to evaluate a specific primary outcome, such as laparoscopic skills or stress related to training. The secondary outcomes mainly evaluated satisfaction, motivation, efficiency, and usefulness. We found 13 e-learning design methods across 19 studies (4% 19/418). The methods evaluated usability, motivational characteristics, and the use of learning styles or were based on instructional design theories, such as Gagne?s instructional design, the Heidelberg inventory, Kern?s curriculum development steps, and a scale based on the cognitive load theory. Finally, 2 instruments attempted to evaluate several aspects of a design, based on the experience of creating e-learning. Conclusions: Evaluating the effect of e-learning design is complicated. Given the diversity of e-learning methods, there are many ways to carry out such an evaluation, and probably, many ways to do so correctly. However, the current literature shows us that we have yet to reach any form of consensus about which indicators to evaluate. There is a great need for an evaluation tool that is properly constructed, validated, and tested. This could be a more homogeneous way to compare the effects of e-learning and for the authors of e-learning to continue to improve their product. UR - http://mededu.jmir.org/2019/1/e13128/ UR - http://dx.doi.org/10.2196/13128 UR - http://www.ncbi.nlm.nih.gov/pubmed/30950805 ID - info:doi/10.2196/13128 ER - TY - JOUR AU - Zhang, Wei AU - Li, Zheng-Rong AU - Li, Zhi PY - 2019/03/19 TI - WeChat as a Platform for Problem-Based Learning in a Dental Practical Clerkship: Feasibility Study JO - J Med Internet Res SP - e12127 VL - 21 IS - 3 KW - PBL KW - app KW - WeChat KW - clerkship KW - dental medicine N2 - Background: Problem-Based-Learning (PBL) has been widely accepted in student-centered medical education. Since WeChat is the most popular communication app in China, we have chosen to use WeChat as new platform for online PBL in order to reduce the limitations of traditional PBL in dental practical clerkships. Objective: This study aims to demonstrate the feasibility and acceptability of online PBL using WeChat (WeChat-PBL) in a dental practical clerkship. Methods: A total of 72 students in a dental practical clerkship and 10 tutors participated in this study from June to August 2017. We created 10 WeChat groups to provide a communication platform for the PBL teaching, in which the students selected the PBL cases themselves from their practical clerkship. After each individual PBL case, group members were required to complete an evaluation on the PBL process itself. A final questionnaire survey was completed by the participants to summarize the long-term evaluation of the whole WeChat-PBL experience after the 3-month clerkship. Data from the PBL cases, WeChat messages, periodic evaluations, and long-term evaluations were collected for analysis. Results: There were 45 cases presented in the WeChat-PBL within the 3-month clerkship. All students had positive reactions to the communication within the PBL groups. The results of the periodic evaluation showed that the students and tutors were quite satisfied with the process of WeChat-PBL and appreciated the group members? contributions and performance. The final questionnaire results indicated that the WeChat-PBL had achieved positive effects. Conclusions: The results of this study indicate the feasibility and acceptability of the app, WeChat, for problem-based learning in a dental practical clerkship. UR - http://www.jmir.org/2019/3/e12127/ UR - http://dx.doi.org/10.2196/12127 UR - http://www.ncbi.nlm.nih.gov/pubmed/30888328 ID - info:doi/10.2196/12127 ER - TY - JOUR AU - George, Paul Pradeep AU - Zhabenko, Olena AU - Kyaw, Myint Bhone AU - Antoniou, Panagiotis AU - Posadzki, Pawel AU - Saxena, Nakul AU - Semwal, Monika AU - Tudor Car, Lorainne AU - Zary, Nabil AU - Lockwood, Craig AU - Car, Josip PY - 2019/02/25 TI - Online Digital Education for Postregistration Training of Medical Doctors: Systematic Review by the Digital Health Education Collaboration JO - J Med Internet Res SP - e13269 VL - 21 IS - 2 KW - randomized controlled trials KW - effectiveness KW - systematic review KW - medical education KW - internet N2 - Background: Globally, online and local area network?based (LAN) digital education (ODE) has grown in popularity. Blended learning is used by ODE along with traditional learning. Studies have shown the increasing potential of these technologies in training medical doctors; however, the evidence for its effectiveness and cost-effectiveness is unclear. Objective: This systematic review evaluated the effectiveness of online and LAN-based ODE in improving practicing medical doctors? knowledge, skills, attitude, satisfaction (primary outcomes), practice or behavior change, patient outcomes, and cost-effectiveness (secondary outcomes). Methods: We searched seven electronic databased for randomized controlled trials, cluster-randomized trials, and quasi-randomized trials from January 1990 to March 2017. Two review authors independently extracted data and assessed the risk of bias. We have presented the findings narratively. We mainly compared ODE with self-directed/face-to-face learning and blended learning with self-directed/face-to-face learning. Results: A total of 93 studies (N=16,895) were included, of which 76 compared ODE (including blended) and self-directed/face-to-face learning. Overall, the effect of ODE (including blended) on postintervention knowledge, skills, attitude, satisfaction, practice or behavior change, and patient outcomes was inconsistent and ranged mostly from no difference between the groups to higher postintervention score in the intervention group (small to large effect size, very low to low quality evidence). Twenty-one studies reported higher knowledge scores (small to large effect size and very low quality) for the intervention, while 20 studies reported no difference in knowledge between the groups. Seven studies reported higher skill score in the intervention (large effect size and low quality), while 13 studies reported no difference in the skill scores between the groups. One study reported a higher attitude score for the intervention (very low quality), while four studies reported no difference in the attitude score between the groups. Four studies reported higher postintervention physician satisfaction with the intervention (large effect size and low quality), while six studies reported no difference in satisfaction between the groups. Eight studies reported higher postintervention practice or behavior change for the ODE group (small to moderate effect size and low quality), while five studies reported no difference in practice or behavior change between the groups. One study reported higher improvement in patient outcome, while three others reported no difference in patient outcome between the groups. None of the included studies reported any unintended/adverse effects or cost-effectiveness of the interventions. Conclusions: Empiric evidence showed that ODE and blended learning may be equivalent to self-directed/face-to-face learning for training practicing physicians. Few other studies demonstrated that ODE and blended learning may significantly improve learning outcomes compared to self-directed/face-to-face learning. The quality of the evidence in these studies was found to be very low for knowledge. Further high-quality randomized controlled trials are required to confirm these findings. UR - http://www.jmir.org/2019/2/e13269/ UR - http://dx.doi.org/10.2196/13269 UR - http://www.ncbi.nlm.nih.gov/pubmed/30801252 ID - info:doi/10.2196/13269 ER - TY - JOUR AU - Zhou, Leming AU - Parmanto, Bambang AU - Joshi, James PY - 2018/12/21 TI - Development and Evaluation of a New Security and Privacy Track in a Health Informatics Graduate Program: Multidisciplinary Collaboration in Education JO - JMIR Med Educ SP - e19 VL - 4 IS - 2 KW - information security KW - research projects KW - partnership and collaboration N2 - Background: The widespread application of technologies such as electronic health record systems, mobile health apps, and telemedicine platforms, has made it easy for health care providers to collect relevant data and deliver health care regimens. While efficacious, these new technologies also pose serious security and privacy challenges. Objective: The training program described here aims at preparing well-informed health information security and privacy professionals with enhanced course materials and various approaches. Methods: A new educational track has been built within a health informatics graduate program. Several existing graduate courses have been enhanced with new security and privacy modules. New labs and seminars have been created, and students are being encouraged to participate in research projects and obtain real-world experience from industry partners. Students in this track receive both theoretical education and hands-on practice. Evaluations have been performed on this new track by conducting multiple surveys on a sample of students. Results: We have succeeded in creating a new security track and developing a pertinent curriculum. The newly created security materials have been implemented in multiple courses. Our evaluation indicated that students (N=72) believed that receiving security and privacy training was important for health professionals, the provided security contents were interesting, and having the enhanced security and privacy training in this program was beneficial for their future career. Conclusions: The security and privacy education for health information professionals in this new security track has been significantly enhanced. UR - http://mededu.jmir.org/2018/2/e19/ UR - http://dx.doi.org/10.2196/mededu.9081 UR - http://www.ncbi.nlm.nih.gov/pubmed/30578227 ID - info:doi/10.2196/mededu.9081 ER - TY - JOUR AU - Motz, Patrick AU - Gray, Megan AU - Sawyer, Taylor AU - Kett, Jennifer AU - Danforth, Douglas AU - Maicher, Kellen AU - Umoren, Rachel PY - 2018/05/11 TI - Virtual Antenatal Encounter and Standardized Simulation Assessment (VANESSA): Pilot Study JO - JMIR Serious Games SP - e8 VL - 6 IS - 2 KW - prenatal counseling KW - simulation KW - ethics N2 - Background: Prenatal counseling at the limits of newborn viability involves sensitive interactions between neonatal providers and families. Empathetic discussions are currently learned through practice in times of high stress. Decision aids may help improve provider communication but have not been universally adopted. Virtual standardized patients are increasingly recognized as a modality for education, but prenatal counseling simulations have not been described. To be valuable as a tool, a virtual patient would need to accurately portray emotions and elicit a realistic response from the provider. Objective: To determine if neonatal providers can accurately identify a standardized virtual prenatal patient?s emotional states and examine the frequency of empathic responses to statements made by the patient. Methods: A panel of Neonatologists, Simulation Specialists, and Ethicists developed a dialogue and identified empathic responses. Virtual Antenatal Encounter and Standardized Simulation Assessment (VANESSA), a screen-based simulation of a woman at 23 weeks gestation, was capable of displaying anger, fear, sadness, and happiness through animations. Twenty-four neonatal providers, including a subgroup with an ethics interest, were asked to identify VANESSA?s emotions 28 times, respond to statements, and answer open-ended questions. The emotions were displayed in different formats: without dialogue, with text dialogue, and with audio dialogue. Participants completed a post-encounter survey describing demographics and experience. Data were reported using descriptive statistics. Qualitative data from open ended questions (eg, ?What would you do??) were examined using thematic analysis. Results: Half of our participants had over 10 years of clinical experience. Most participants reported using medical research (18/23, 78%) and mortality calculators (17/23, 74%). Only the ethics-interested subgroup (10/23, 43%) listed counseling literature (7/10, 70%). Of 672 attempts, participants accurately identified VANESSA?s emotions 77.8% (523/672) of the time, and most (14/23, 61%) reported that they were confident in identifying these emotions. The ethics interest group was more likely to choose empathic responses (P=.002). Participants rated VANESSA as easy to use (22/23, 96%) and reported that she had realistic dialogue (15/23, 65%). Conclusions: This pilot study shows that a prenatal counseling simulation is feasible and can yield useful data on prenatal counseling communication. Our participants showed a high rate of emotion recognition and empathy in their responses. UR - http://games.jmir.org/2018/2/e8/ UR - http://dx.doi.org/10.2196/games.9611 UR - http://www.ncbi.nlm.nih.gov/pubmed/29752249 ID - info:doi/10.2196/games.9611 ER - TY - JOUR AU - de Leeuw, Adrianus Robert AU - Walsh, Kieran AU - Westerman, Michiel AU - Scheele, Fedde PY - 2018/04/26 TI - Consensus on Quality Indicators of Postgraduate Medical E-Learning: Delphi Study JO - JMIR Med Educ SP - e13 VL - 4 IS - 1 KW - postgraduate medical education KW - continuing medical education KW - e-learning KW - distance education KW - quality tool KW - quality indicators KW - education, medical KW - education, medical, continuing KW - education, distance N2 - Background: The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. Objective: We aimed to identify an empirically founded set of quality indicators to set the bar for ?good enough? e-learning. Methods: We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. Results: In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. Conclusions: This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items. UR - http://mededu.jmir.org/2018/1/e13/ UR - http://dx.doi.org/10.2196/mededu.9365 UR - http://www.ncbi.nlm.nih.gov/pubmed/29699970 ID - info:doi/10.2196/mededu.9365 ER - TY - JOUR AU - Al Nsour, Mohannad AU - Iblan, Ibrahim AU - Tarawneh, Rasoul Mohammed PY - 2018/04/11 TI - Jordan Field Epidemiology Training Program: Critical Role in National and Regional Capacity Building JO - JMIR Med Educ SP - e12 VL - 4 IS - 1 KW - field epidemiology KW - training program KW - education KW - capacity building KW - disease outbreaks KW - public health surveillance KW - epidemiological monitoring KW - Jordan UR - http://mededu.jmir.org/2018/1/e12/ UR - http://dx.doi.org/10.2196/mededu.9516 UR - http://www.ncbi.nlm.nih.gov/pubmed/29643050 ID - info:doi/10.2196/mededu.9516 ER - TY - JOUR AU - Vaysse, Charlotte AU - Chantalat, Elodie AU - Beyne-Rauzy, Odile AU - Morineau, Louise AU - Despas, Fabien AU - Bachaud, Jean-Marc AU - Caunes, Nathalie AU - Poublanc, Muriel AU - Serrano, Elie AU - Bugat, Roland AU - Rougé Bugat, Marie-Eve AU - Fize, Anne-Laure PY - 2018/03/05 TI - The Impact of a Small Private Online Course as a New Approach to Teaching Oncology: Development and Evaluation JO - JMIR Med Educ SP - e6 VL - 4 IS - 1 KW - oncology KW - health education KW - continuing education KW - e-learning KW - SPOC KW - small private online course KW - education, medical KW - education, medical, continuing N2 - Background: Oncology involves complex care and multidisciplinary management of patients; however, misinformation and ineffective communication remain problematic. Objective: The educational objective of our study was to develop a new teaching method to improve cancer treatment and management by emphasizing the link between hospitals (inpatients) and their surrounding communities (outpatients). Methods: A team of 22 professionals from public and private institutions developed a small private online course (SPOC). Each offering of the course lasted 6 weeks and covered 6 topics: individual health care plans, cancer surgery, ionizing radiation, cancer medicines, clinical research, and oncological supportive care. For participants in the course, we targeted people working in the cancer field. The SPOC used an active teaching method with collaborative and multidisciplinary learning. A final examination was offered in each session. We evaluated participants? satisfaction rate through a questionnaire and the success of the SPOC by participants? completion, success, and commitment rates. Results: Of the total participants (N=1574), 446 completed the evaluation form. Most participants were aged 31 to 45 years. Participants included 56 nurses, 131 pharmacists, 80 from the medical field (including 26 physicians), 53 from patients? associations, 28 health teachers, and 13 students (medical and paramedical). Among the participants, 24.7% (90/446) had an independent medical practice, 38.5% (140/446) worked in a public institution, and 36.8% (134/446) worked in a private institution. After completing the SPOC sessions, 85.9% (384/446) thought they had learned new information, 90.8% (405/446) felt their expectations were met, and 90.4% (403/446) considered that the information had a positive impact on their professional practice. The completion rate was 35.51% (559/1574), the success rate was 71.47% (1025/1574), and the commitment rate was 64.67% (1018/1574). Concerning the cost effectiveness of SPOC compared with a traditional classroom of 25 students, online education became more effective when there were more than 950 participants. Conclusions: SPOCs improved the management of oncology patients. This new digital learning technique is an attractive concept to integrate into teaching practice. It offered optimal propagation of information and met the students? expectations. UR - http://mededu.jmir.org/2018/1/e6/ UR - http://dx.doi.org/10.2196/mededu.9185 UR - http://www.ncbi.nlm.nih.gov/pubmed/29506968 ID - info:doi/10.2196/mededu.9185 ER - TY - JOUR AU - Govender, Pragashnie AU - Chetty, Verusia AU - Naidoo, Deshini AU - Pefile, Ntsikelelo PY - 2018/01/25 TI - Integrated Decentralized Training for Health Professions Education at the University of KwaZulu-Natal, South Africa: Protocol for the I-DecT Project JO - JMIR Res Protoc SP - e19 VL - 7 IS - 1 KW - decentralized clinical training, health science, South Africa, health care N2 - Background: The Integrated Decentralized Training (i-DecT) project was created to address the current need for health care in South Africa among resource poor climates in rural and periurban settings. The University of KwaZulu-Natal (UKZN) in South Africa has embarked on a program within the School of Health Sciences (SHS) to decentralize the clinical learning platform in order to address this disparity. Framed in a pragmatic stance, this proposal is geared towards informing the roll out of decentralized clinical training (DCT) within the province of KwaZulu-Natal. There currently remains uncertainty as to how the implementation of this program will unfold, especially for the diverse SHS, which includes specialities like audiology, dentistry, occupational therapy, optometry, pharmacy, physiotherapy, speech-language pathology, and sport science. Consequently, there is a need to carefully monitor and manage this DCT in order to ensure that the participating students have a positive learning experience and achieve expected academic outcomes, and that the needs of the communities are addressed adequately. Objective: The study aims to explore the factors that will influence the roll-out of the DCT by developing an inclusive and context-specific model that will adhere to the standards set by the SHS for the DCT program at UKZN. Methods: Key role players, including but not limited to, the South African Ministry of Health policy makers, clinicians, policy makers at UKZN, clinical educators, academicians, and students of UKZN within the SHS will participate in this project. Once the infrastructural, staffing and pedagogical enablers and challenges are identified, together with a review of existing models of decentralized training, a context-specific model for DCTl will be proposed based on initial pilot data that will be tested within iterative cycles in an Action Learning Action Research (ALAR) process. Results: The study was designed to fit within the existing structures, and emerging framework and memorandum of understanding between the partners of this initiative, namely, the Ministry of Health and UKZN in order to develop health care professionals that are competent and prepared for the changing dynamics of healthcare in a developing world. Conclusions: It is envisioned that this study, the first to include a combination of health professionals in a DCT platform at UKZN, will not only contribute to effective service delivery, but may also serve to promote an interprofessional cooperation within the SHS and tertiary institutions in similar settings. UR - http://www.researchprotocols.org/2018/1/e19/ UR - http://dx.doi.org/10.2196/resprot.7551 UR - http://www.ncbi.nlm.nih.gov/pubmed/29371175 ID - info:doi/10.2196/resprot.7551 ER - TY - JOUR AU - Cooper, Zafra AU - Bailey-Straebler, Suzanne AU - Morgan, E. Katy AU - O'Connor, E. Marianne AU - Caddy, Caroline AU - Hamadi, Layla AU - Fairburn, G. Christopher PY - 2017/10/18 TI - Using the Internet to Train Therapists: Randomized Comparison of Two Scalable Methods JO - J Med Internet Res SP - e355 VL - 19 IS - 10 KW - psychotherapy KW - training KW - Internet KW - eating disorders KW - cognitive therapy N2 - Background: One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. The currently accepted method of training is not scalable. Recently, a scalable form of training, Web-centered training, has been shown to have promise. Objective: The goal of our research was to conduct a randomized comparison of the relative effects of independent and supported Web-centered training on therapist competence and investigate the persistence of the effects. Methods: Eligible therapists were recruited from across the United States and Canada. They were randomly assigned to 1 of 2 forms of training in enhanced cognitive behavior therapy (CBT-E), a multicomponent evidence-based psychological treatment for any form of eating disorder. Independent training was undertaken autonomously, while supported training was accompanied by support from a nonspecialist worker. Therapist competence was assessed using a validated competence measure before training, after 20 weeks of training, and 6 months after the completion of training. Results: A total of 160 therapists expressed interest in the study, and 156 (97.5%) were randomized to the 2 forms of training (81 to supported training and 75 to independent training). Mixed effects analysis showed an increase in competence scores in both groups. There was no difference between the 2 forms of training, with mean difference for the supported versus independent group being ?0.06 (95% Cl ?1.29 to 1.16, P=.92). A total of 58 participants (58/114, 50.9%) scored above the competence threshold; three-quarters (43/58, 74%) had not met this threshold before training. There was no difference between the 2 groups in the odds of scoring over the competence threshold (odds ratio [OR] 1.02, 95% CI 0.52 to 1.99; P=.96). At follow-up, there was no significant difference between the 2 training groups (mean difference 0.19, 95% Cl ?1.27 to 1.66, P=.80). Overall, change in competence score from end of training to follow-up was not significant (mean difference ?0.70, 95% CI ?1.52 to 0.11, P=.09). There was also no difference at follow-up between the training groups in the odds of scoring over the competence threshold (OR 0.95, 95% Cl 0.34 to 2.62; P=.92). Conclusions: Web-centered training was equally effective whether undertaken independently or accompanied by support, and its effects were sustained. The independent form of Web-centered training is particularly attractive as it provides a means of training large numbers of geographically dispersed therapists at low cost, thereby overcoming several obstacles to the widespread dissemination of psychological treatments. UR - http://www.jmir.org/2017/10/e355/ UR - http://dx.doi.org/10.2196/jmir.8336 UR - http://www.ncbi.nlm.nih.gov/pubmed/29046265 ID - info:doi/10.2196/jmir.8336 ER - TY - JOUR AU - Shah, H. Shikhar AU - Clark, D. Maureen AU - Hu, Kimberly AU - Shoener, A. Jalene AU - Fogel, Joshua AU - Kling, C. William AU - Ronayne, James PY - 2017/10/17 TI - Systems-Based Training in Graduate Medical Education for Service Learning in the State Legislature in the United States: Pilot Study JO - JMIR Med Educ SP - e18 VL - 3 IS - 2 KW - health policy KW - education, public health professional KW - education, medical KW - legislation, medical KW - problem-based learning KW - knowledge management KW - interdisciplinary communication N2 - Background: There is a dearth of advocacy training in graduate medical education in the United States. To address this void, the Legislative Education and Advocacy Development (LEAD) course was developed as an interprofessional experience, partnering a cohort of pediatrics residents, fourth-year medical students, and public health students to be trained in evidence-informed health policy making. Objective: The objective of our study was to evaluate the usefulness and acceptability of a service-based legislative advocacy course. Methods: We conducted a pilot study using a single-arm pre-post study design with 10 participants in the LEAD course. The course?s didactic portion taught learners how to define policy problems, research the background of the situation, brainstorm solutions, determine evaluation criteria, develop communication strategies, and formulate policy recommendations for state legislators. Learners worked in teams to create and present policy briefs addressing issues submitted by participating Illinois State legislators. We compared knowledge and attitudes of learners from pre- and postcourse surveys. We obtained qualitative feedback from legislators and pediatric residency directors. Results: Self-reported understanding of the health care system increased (mean score from 4 to 3.3, P=.01), with answers scored from 1=highly agree to 5=completely disagree. Mean knowledge-based scores improved (6.8/15 to 12.0/15 correct). Pediatric residency program directors and state legislators provided positive feedback about the LEAD course. Conclusions: Promising results were demonstrated for the LEAD approach to incorporate advocacy training into graduate medical education. UR - http://mededu.jmir.org/2017/2/e18/ UR - http://dx.doi.org/10.2196/mededu.7730 UR - http://www.ncbi.nlm.nih.gov/pubmed/29042343 ID - info:doi/10.2196/mededu.7730 ER - TY - JOUR AU - Micheel, M. Christine AU - Anderson, A. Ingrid AU - Lee, Patricia AU - Chen, Sheau-Chiann AU - Justiss, Katy AU - Giuse, B. Nunzia AU - Ye, Fei AU - Kusnoor, V. Sheila AU - Levy, A. Mia PY - 2017/07/25 TI - Internet-Based Assessment of Oncology Health Care Professional Learning Style and Optimization of Materials for Web-Based Learning: Controlled Trial With Concealed Allocation JO - J Med Internet Res SP - e265 VL - 19 IS - 7 KW - e-learning KW - Web-based Instruction KW - learning KW - teaching materials KW - information dissemination KW - online systems KW - education, distance KW - continuing education KW - medical oncology/education N2 - Background: Precision medicine has resulted in increasing complexity in the treatment of cancer. Web-based educational materials can help address the needs of oncology health care professionals seeking to understand up-to-date treatment strategies. Objective: This study aimed to assess learning styles of oncology health care professionals and to determine whether learning style-tailored educational materials lead to enhanced learning. Methods: In all, 21,465 oncology health care professionals were invited by email to participate in the fully automated, parallel group study. Enrollment and follow-up occurred between July 13 and September 7, 2015. Self-enrolled participants took a learning style survey and were assigned to the intervention or control arm using concealed alternating allocation. Participants in the intervention group viewed educational materials consistent with their preferences for learning (reading, listening, and/or watching); participants in the control group viewed educational materials typical of the My Cancer Genome website. Educational materials covered the topic of treatment of metastatic estrogen receptor-positive (ER+) breast cancer using cyclin-dependent kinases 4/6 (CDK4/6) inhibitors. Participant knowledge was assessed immediately before (pretest), immediately after (posttest), and 2 weeks after (follow-up test) review of the educational materials. Study statisticians were blinded to group assignment. Results: A total of 751 participants enrolled in the study. Of these, 367 (48.9%) were allocated to the intervention arm and 384 (51.1%) were allocated to the control arm. Of those allocated to the intervention arm, 256 (69.8%) completed all assessments. Of those allocated to the control arm, 296 (77.1%) completed all assessments. An additional 12 participants were deemed ineligible and one withdrew. Of the 552 participants, 438 (79.3%) self-identified as multimodal learners. The intervention arm showed greater improvement in posttest score compared to the control group (0.4 points or 4.0% more improvement on average; P=.004) and a higher follow-up test score than the control group (0.3 points or 3.3% more improvement on average; P=.02). Conclusions: Although the study demonstrated more learning with learning style-tailored educational materials, the magnitude of increased learning and the largely multimodal learning styles preferred by the study participants lead us to conclude that future content-creation efforts should focus on multimodal educational materials rather than learning style-tailored content. UR - http://www.jmir.org/2017/7/e265/ UR - http://dx.doi.org/10.2196/jmir.7506 UR - http://www.ncbi.nlm.nih.gov/pubmed/28743680 ID - info:doi/10.2196/jmir.7506 ER - TY - JOUR AU - Ma, Zhenyu AU - Yang, Li AU - Yang, Lan AU - Huang, Kaiyong AU - Yu, Hongping AU - He, Huimin AU - Wang, Jiaji AU - Cai, Le AU - Wang, Jie AU - Fu, Hua AU - Quintiliani, Lisa AU - Friedman, H. Robert AU - Xiao, Jian AU - Abdullah, S. Abu PY - 2017/06/12 TI - Developing a Curriculum for Information and Communications Technology Use in Global Health Research and Training: A Qualitative Study Among Chinese Health Sciences Graduate Students JO - JMIR Med Educ SP - e11 VL - 3 IS - 1 KW - information and communication technology KW - ICT KW - global health KW - research KW - training KW - China N2 - Background: Rapid development of information and communications technology (ICT) during the last decade has transformed biomedical and population-based research and has become an essential part of many types of research and educational programs. However, access to these ICT resources and the capacity to use them in global health research are often lacking in low- and middle-income country (LMIC) institutions. Objective: The aim of our study was to assess the practical issues (ie, perceptions and learning needs) of ICT use among health sciences graduate students at 6 major medical universities of southern China. Methods: Ten focus group discussions (FGDs) were conducted from December 2015 to March 2016, involving 74 health sciences graduate students studying at 6 major medical universities in southern China. The sampling method was opportunistic, accounting for the graduate program enrolled and the academic year. All FGDs were audio recorded and thematic content analysis was performed. Results: Researchers had different views and arguments about the use of ICT which are summarized under six themes: (1) ICT use in routine research, (2) ICT-related training experiences, (3) understanding about the pros and cons of Web-based training, (4) attitudes toward the design of ICT training curriculum, (5) potential challenges to promoting ICT courses, and (6) related marketing strategies for ICT training curriculum. Many graduate students used ICT on a daily basis in their research to stay up-to-date on current development in their area of research or study or practice. The participants were very willing to participate in ICT courses that were relevant to their academic majors and would count credits. Suggestion for an ICT curriculum included (1) both organized training course or short lecture series, depending on the background and specialty of the students, (2) a mixture of lecture and Web-based activities, and (3) inclusion of topics that are career focused. Conclusions: The findings of this study suggest that a need exists for a specialized curriculum related to ICT use in health research for health sciences graduate students in China. The results have important implications for the design and implementation of ICT-related educational program in China or other developing countries. UR - http://mededu.jmir.org/2017/1/e11/ UR - http://dx.doi.org/10.2196/mededu.6590 UR - http://www.ncbi.nlm.nih.gov/pubmed/28606894 ID - info:doi/10.2196/mededu.6590 ER - TY - JOUR AU - Dawkins, Rachel AU - King, D. William AU - Boateng, Beatrice AU - Nichols, Michele AU - Desselle, C. Bonnie PY - 2017/01/31 TI - Pediatric Residents? Perceptions of Potential Professionalism Violations on Social Media: A US National Survey JO - JMIR Med Educ SP - e2 VL - 3 IS - 1 KW - social media KW - professionalism KW - resident education KW - pediatrics KW - graduate medical education N2 - Background: The ubiquitous use of social media by physicians poses professionalism challenges. Regulatory bodies have disseminated guidelines related to physicians? use of social media. Objective: This study had 2 objectives: (1) to understand what pediatric residents view as appropriate social media postings, and (2) to recognize the degree to which these residents are exposed to postings that violate social media professionalism guidelines. Methods: We distributed an electronic survey to pediatric residents across the United States. The survey consisted of 5 postings from a hypothetical resident?s personal Facebook page. The vignettes highlighted common scenarios that challenge published social media professionalism guidelines. We asked 2 questions for each vignette regarding (1) the resident?s opinion of the posting?s appropriateness, and (2) their frequency of viewing similar posts. We also elicited demographic data (age, sex, postgraduate year level), frequency of Facebook use, awareness of their institutional policies, and prior social media training. Results: Of 1628 respondents, 1498 (92.01%) of the pediatric residents acknowledged having a Facebook account, of whom 888/1628 (54.55%) reported daily use and 346/1628 (21.25%) reported using Facebook a few times a week. Residents frequently viewed posts that violated professionalism standards, including use of derogatory remarks about patients (1756/3256, 53.93%) and, much less frequently, about attending physicians (114/1628, 7.00%). The majority of the residents properly identified these postings as inappropriate. Residents had frequently viewed a post similar to one showing physicians drinking alcoholic beverages while in professional attire or scrubs and were neutral on this post?s appropriateness. Residents also reported a lack of knowledge about institutional policies on social media (651/1628, or 40.00%, were unaware of a policy; 204/1628, or 12.53%, said that no policy existed). A total of 372/1628 respondents (22.85%) stated that they had never received any structured training on social media professionalism. Conclusions: Today?s residents, like others of their generation, use social media sites to converse with peers without considering the implications for the profession. The frequent use of social media by learners needs to change the emphasis educators and regulatory bodies place on social media guidelines and teaching professionalism in the digital age. UR - http://mededu.jmir.org/2017/1/e2/ UR - http://dx.doi.org/10.2196/mededu.5993 UR - http://www.ncbi.nlm.nih.gov/pubmed/28143804 ID - info:doi/10.2196/mededu.5993 ER - TY - JOUR AU - Dion, Maxime AU - Diouf, Thiab Ndeye AU - Robitaille, Hubert AU - Turcotte, Stéphane AU - Adekpedjou, Rhéda AU - Labrecque, Michel AU - Cauchon, Michel AU - Légaré, France PY - 2016/12/19 TI - Teaching Shared Decision Making to Family Medicine Residents: A Descriptive Study of a Web-Based Tutorial JO - JMIR Med Educ SP - e17 VL - 2 IS - 2 KW - decision making KW - patient participation KW - education, medical, graduate KW - educational measurement KW - program evaluation KW - computer-assisted instruction N2 - Background: DECISION+2, a Web-based tutorial, was designed to train family physicians in shared decision making (SDM) regarding the use of antibiotics for acute respiratory infections (ARIs). It is currently mandatory for second-year family medicine residents at Université Laval, Quebec, Canada. However, little is known about how such tutorials are used, their effect on knowledge scores, or how best to assess resident participation. Objective: The objective of our study was to describe the usage of this Web-based training platform by family medicine residents over time, evaluate its effect on their knowledge scores, and identify what kinds of data are needed for a more comprehensive analysis of usage and knowledge acquisition. Methods: We identified, collected, and analyzed all available data about participation in and current usage of the tutorial and its before-and-after 10-item knowledge test. Residents were separated into 3 log-in periods (2012-2013, 2013-2014, and 2014-2015) depending on the day of their first connection. We compared residents? participation rates between entry periods (Cochran-Armitage test), assessed the mean rank of the difference in total scores and category scores between pre- and posttest (Wilcoxon signed-rank test), and compared frequencies of each. Subsequent to analyses, we identified types of data that would have provided a more complete picture of the usage of the program and its effect on knowledge scores. Results: The tutorial addresses 3 knowledge categories: diagnosing ARIs, treating ARIs, and SDM regarding the use of antibiotics for treating ARIs. From July 2012 to July 2015, all 387 second-year family medicine residents were eligible to take the Web-based tutorial. Out of the 387 eligible residents, 247 (63.8%) logged in at least once. Their participation rates varied between entry periods, most significantly between the 2012-2013 and 2013-2014 cohorts (P=.006). For the 109 out of 387 (28.2%) residents who completed the tutorial and both tests, total and category scores significantly improved between pre- and posttest (all P values <.001). However, the frequencies of those answering correctly on 2 of the 3 SDM questions did not increase significantly (P>.99, P=.25). Distribution of pre- or posttest total and category scores did not increase between entry periods (all P values >.1). Available data were inadequate for evaluating the associations between the tutorial and its impact on the residents? scores and therefore could tell us little about its effect on increasing their knowledge. Conclusion: Residents? use of this Web-based tutorial appeared to increase between entry periods following the changes to the SDM program, and the tutorial seemed less effective for increasing SDM knowledge scores than for diagnosis or treatment scores. However, our results also highlight the need to improve data availability before participation in Web-based SDM tutorials can be properly evaluated or knowledge scores improved. UR - http://mededu.jmir.org/2016/2/e17/ UR - http://dx.doi.org/10.2196/mededu.6442 UR - http://www.ncbi.nlm.nih.gov/pubmed/27993760 ID - info:doi/10.2196/mededu.6442 ER - TY - JOUR AU - DelSignore, A. Lisa AU - Wolbrink, A. Traci AU - Zurakowski, David AU - Burns, P. Jeffrey PY - 2016/11/21 TI - Test-Enhanced E-Learning Strategies in Postgraduate Medical Education: A Randomized Cohort Study JO - J Med Internet Res SP - e299 VL - 18 IS - 11 KW - distance learning KW - computer-assisted instruction KW - medical education KW - educational measurement KW - retention N2 - Background: The optimal design of pedagogical strategies for e-learning in graduate and postgraduate medical education remains to be determined. Video-based e-learning use is increasing, with initial research suggesting that taking short breaks while watching videos (independent of answering test questions) may improve learning by focusing attention on the content presented. Interspersed test questions may also improve knowledge acquisition and retention. Objective: To examine the effect of interspersed test questions and periodic breaks on immediate knowledge acquisition and retention at 6 months by pediatric residents engaged in video-based e-learning. Methods: First- and second-year pediatric residents were randomized to 1 of the following 3 groups: viewing the complete video uninterrupted (full video), viewing the video interrupted with unrelated logic puzzles (logic puzzles), or viewing the video interrupted with brief comprehension test questions (short answer questions). Residents answered pre- and post-tests before and after video viewing, followed by a retention test at 6 months. Primary outcome included comparison of the change in test scores between groups. Results: A total of 49 residents completed the initial testing session. All 3 learning groups had comparable mean increases in immediate knowledge gain, but with no significant differences between groups (F2,46=0.35, P=.71). Thirty-five residents completed retention testing with comparable degrees of knowledge retention in the full video and short answer test questions groups (P<.001), but no significant change in the logic puzzles group (F1,32=2.44, P=.13). Conclusions: Improved knowledge gain was not demonstrated among residents answering interspersed questions or completing logic puzzles during interrupted online video viewing when compared with residents viewing uninterrupted video content. However, residents who either participated in uninterrupted video viewing or answered interspersed questions during interrupted video viewing demonstrated significant knowledge retention at 6 months. UR - http://www.jmir.org/2016/11/e299/ UR - http://dx.doi.org/10.2196/jmir.6199 UR - http://www.ncbi.nlm.nih.gov/pubmed/27872034 ID - info:doi/10.2196/jmir.6199 ER - TY - JOUR AU - Liu, Chunfeng AU - Lim, L. Renee AU - McCabe, L. Kathryn AU - Taylor, Silas AU - Calvo, A. Rafael PY - 2016/09/12 TI - A Web-Based Telehealth Training Platform Incorporating Automated Nonverbal Behavior Feedback for Teaching Communication Skills to Medical Students: A Randomized Crossover Study JO - J Med Internet Res SP - e246 VL - 18 IS - 9 KW - nonverbal communication KW - nonverbal behavior KW - clinical consultation KW - medical education KW - communication skills KW - nonverbal behavior detection KW - automated feedback KW - affective computing N2 - Background: In the interests of patient health outcomes, it is important for medical students to develop clinical communication skills. We previously proposed a telehealth communication skills training platform (EQClinic) with automated nonverbal behavior feedback for medical students, and it was able to improve medical students? awareness of their nonverbal communication. Objective: This study aimed to evaluate the effectiveness of EQClinic to improve clinical communication skills of medical students. Methods: We conducted a 2-group randomized crossover trial between February and June 2016. Participants were second-year medical students enrolled in a clinical communication skills course at an Australian university. Students were randomly allocated to complete online EQClinic training during weeks 1?5 (group A) or to complete EQClinic training during weeks 8?11 (group B). EQClinic delivered an automated visual presentation of students? nonverbal behavior coupled with human feedback from a standardized patient (SP). All students were offered two opportunities to complete face-to-face consultations with SPs. The two face-to-face consultations were conducted in weeks 6?7 and 12?13 for both groups, and were rated by tutors who were blinded to group allocation. Student-Patient Observed Communication Assessment (SOCA) was collected by blinded assessors (n=28) at 2 time points and also by an SP (n=83). Tutor-rated clinical communications skill in face-to-face consultations was the primary outcome and was assessed with the SOCA. We used t tests to examine the students? performance during face-to-face consultations pre- and postexposure to EQClinic. Results: We randomly allocated 268 medical students to the 2 groups (group A: n=133; group B: n=135). SOCA communication skills measures (score range 4?16) from the first face-to-face consultation were significantly higher for students in group A who had completed EQClinic training and reviewed the nonverbal behavior feedback, compared with group B, who had completed only the course curriculum components (P=.04). Furthermore, at the second face-to-face assessment, the group that completed a teleconsultation between the two face-to-face consultations (group B) showed improved communication skills (P=.005), and the one that had teleconsultations before the first face-to-face consultation (group A) did not show improvement. Conclusions: The EQClinic is a useful tool for medical students? clinical communication skills training that can be applied to university settings to improve students clinical communication skills development. UR - http://www.jmir.org/2016/9/e246/ UR - http://dx.doi.org/10.2196/jmir.6299 UR - http://www.ncbi.nlm.nih.gov/pubmed/27619564 ID - info:doi/10.2196/jmir.6299 ER - TY - JOUR AU - Pathipati, S. Akhilesh AU - Azad, D. Tej AU - Jethwani, Kamal PY - 2016/07/12 TI - Telemedical Education: Training Digital Natives in Telemedicine JO - J Med Internet Res SP - e193 VL - 18 IS - 7 KW - telemedicine KW - medical education KW - medical school KW - curriculum reform UR - http://www.jmir.org/2016/7/e193/ UR - http://dx.doi.org/10.2196/jmir.5534 UR - http://www.ncbi.nlm.nih.gov/pubmed/27405323 ID - info:doi/10.2196/jmir.5534 ER - TY - JOUR AU - Bull, Preston Tyler AU - Dewar, Roxanne Alexis AU - Malvey, M. Donna AU - Szalma, Leo James PY - 2016/07/08 TI - Considerations for the Telehealth Systems of Tomorrow: An Analysis of Student Perceptions of Telehealth Technologies JO - JMIR Med Educ SP - e11 VL - 2 IS - 2 KW - telehealth systems KW - younger adults KW - telehealth advantages KW - telehealth disadvantages KW - thematic analysis N2 - Background: While much is known about factors that facilitate telehealth adoption, less is known about why adoption does or does not occur in specific populations, such as students. Objective: This study aims to examine the perceptions of telehealth systems within a large student sample. Methods: Undergraduate students (N=315) participated in a survey of the perceived advantages and disadvantages of telehealth technologies. The responses to the survey were analyzed using thematic analysis. Results: We found that students were likely to adopt telehealth systems for the following reasons: (1) the system worked efficiently, (2) the convenience of telehealth, and (3) to gain access to health services. Students also perceived several disadvantages to telehealth systems, such as issues of trust (ie, security, privacy), the impersonal nature of telehealth systems, and they were concerned about the potential for major system errors. Conclusion: By understanding the current barriers to telehealth adoption in a cohort of students, we can not only better anticipate the future needs of this group, but also incorporate such needs into the design of future telehealth systems. UR - http://mededu.jmir.org/2016/2/e11/ UR - http://dx.doi.org/10.2196/mededu.5392 UR - http://www.ncbi.nlm.nih.gov/pubmed/27731865 ID - info:doi/10.2196/mededu.5392 ER - TY - JOUR AU - Lefebvre, Cedric AU - Mesner, Jason AU - Stopyra, Jason AU - O'Neill, James AU - Husain, Iltifat AU - Geer, Carol AU - Gerancher, Karen AU - Atkinson, Hal AU - Harper, Erin AU - Huang, William AU - Cline, M. David PY - 2016/06/09 TI - Social Media in Professional Medicine: New Resident Perceptions and Practices JO - J Med Internet Res SP - e119 VL - 18 IS - 6 KW - social media KW - professionalism KW - physicians KW - education N2 - Background: For younger generations, unconstrained online social activity is the norm. Little data are available about perceptions among young medical practitioners who enter the professional clinical arena, while the impact of existing social media policy on these perceptions is unclear. Objective: The objective of this study was to investigate the existing perceptions about social media and professionalism among new physicians entering in professional clinical practice; and to determine the effects of formal social media instruction and policy on young professionals? ability to navigate case-based scenarios about online behavior in the context of professional medicine. Methods: This was a prospective observational study involving the new resident physicians at a large academic medical center. Medical residents from 9 specialties were invited to participate and answer an anonymous questionnaire about social media in clinical medicine. Data were analyzed using SAS 9.4 (Cary, NC), chi-square or Fisher?s exact test was used as appropriate, and the correct responses were compared between different groups using the Kruskal?Wallis analysis of variance. Results: Familiarity with current institutional policy was associated with an average of 2.2 more correct responses (P=.01). Instruction on social media use during medical school was related to correct responses for 2 additional questions (P=.03). On dividing the groups into no policy exposure, single policy exposure, or both exposures, the mean differences were found to be statistically significant (3.5, 7.5, and 9.4, respectively) (P=.03). Conclusions: In this study, a number of young physicians demonstrated a casual approach to social media activity in the context of professional medical practice. Several areas of potential educational opportunity and focus were identified: (1) online privacy, (2) maintaining digital professionalism, (3) safeguarding the protected health information of patients, and (4) the impact of existing social media policies. Prior social media instruction and/or familiarity with a social media policy are associated with an improved performance on case-based questions regarding online professionalism. This suggests a correlation between an instruction about online professionalism and more cautious online behavior. Improving the content and delivery of social media policy may assist in preserving institutional priorities, protecting patient information, and safeguarding young professionals from online misadventure. UR - http://www.jmir.org/2016/6/e119/ UR - http://dx.doi.org/10.2196/jmir.5612 UR - http://www.ncbi.nlm.nih.gov/pubmed/27283846 ID - info:doi/10.2196/jmir.5612 ER - TY - JOUR AU - Kunkle, Sarah AU - Christie, Gillian AU - Yach, Derek AU - El-Sayed, M. Abdulrahman PY - 2016/03/14 TI - The Importance of Computer Science for Public Health Training: An Opportunity and Call to Action JO - JMIR Public Health Surveill SP - e10 VL - 2 IS - 1 KW - digital health KW - public health KW - machine learning KW - computer science KW - health technology KW - chronic disease UR - http://publichealth.jmir.org/2016/1/e10/ UR - http://dx.doi.org/10.2196/publichealth.5018 UR - http://www.ncbi.nlm.nih.gov/pubmed/27227145 ID - info:doi/10.2196/publichealth.5018 ER - TY - JOUR AU - Torous, John AU - O'Connor, Ryan AU - Franzen, Jamie AU - Snow, Caitlin AU - Boland, Robert AU - Kitts, Robert PY - 2015/11/05 TI - Creating a Pilot Educational Psychiatry Website: Opportunities, Barriers, and NextSteps JO - JMIR Medical Education SP - e14 VL - 1 IS - 2 KW - Psychiatry KW - Internet KW - Online KW - Education KW - Website N2 - Background: While medical students and residents may be utilizing websites as online learning resources, medical trainees and educators now have the opportunity to create such educational websites and digital tools on their own. However, the process and theory of building educational websites for medical education have not yet been fully explored. Objective: To understand the opportunities, barriers, and process of creating a novel medical educational website. Methods: We created a pilot psychiatric educational website to better understand the options, opportunities, challenges, and processes involved in the creation of a psychiatric educational website. We sought to integrate visual and interactive Web design elements to underscore the potential of such Web technology. Results: A pilot website (PsychOnCall) was created to demonstrate the potential of Web technology in medical and psychiatric education. Conclusions: Creating an educational website is now technically easier than ever before, and the primary challenge no longer is technology but rather the creation, validation, and maintenance of information for such websites as well as translating text-based didactics into visual and interactive tools. Medical educators can influence the design and implementation of online educational resources through creating their own websites and engaging medical students and residents in the process. UR - http://mededu.jmir.org/2015/2/e14/ UR - http://dx.doi.org/10.2196/mededu.4580 UR - http://www.ncbi.nlm.nih.gov/pubmed/27731837 ID - info:doi/10.2196/mededu.4580 ER - TY - JOUR AU - Janssen, Anna AU - Shaw, Tim AU - Goodyear, Peter PY - 2015/09/28 TI - Using Video Games to Enhance Motivation States in Online Education: Protocol for a Team-Based Digital Game JO - JMIR Res Protoc SP - e114 VL - 4 IS - 3 KW - digital games KW - medical education KW - online learning N2 - Background: Video and computer games for education have been of interest to researchers for several decades. Over the last half decade, researchers in the health sector have also begun exploring the value of this medium. However, there are still many gaps in the literature regarding the effective use of video and computer games in medical education, particularly in relation to how learners interact with the platform, and how the games can be used to enhance collaboration. Objective: The objective of the study is to evaluate a team-based digital game as an educational tool for engaging learners and supporting knowledge consolidation in postgraduate medical education. Methods: A mixed methodology will be used in order to establish efficacy and level of motivation provided by a team-based digital game. Second-year medical students will be recruited as participants to complete 3 matches of the game at spaced intervals, in 2 evenly distributed teams. Prior to playing the game, participants will complete an Internet survey to establish baseline data. After playing the game, participants will voluntarily complete a semistructured interview to establish motivation and player engagement. Additionally, metrics collected from the game platform will be analyzed to determine efficacy. Results: The research is in the preliminary stages, but thus far a total of 54 participants have been recruited into the study. Additionally, a content development group has been convened to develop appropriate content for the platform. Conclusions: Video and computer games have been demonstrated to have value for educational purposes. Significantly less research has addressed how the medium can be effectively utilized in the health sector. Preliminary data from this study would suggest there is an interest in games for learning in the medical student body. As such, it is beneficial to undertake further research into how these games teach and engage learners in order to evaluate their role in tertiary and postgraduate medical education in the future. UR - http://www.researchprotocols.org/2002/3/e114/ UR - http://dx.doi.org/10.2196/resprot.4016 UR - http://www.ncbi.nlm.nih.gov/pubmed/26416522 ID - info:doi/10.2196/resprot.4016 ER - TY - JOUR AU - O'Carroll, Marie Aoife AU - Westby, Patricia Erin AU - Dooley, Joseph AU - Gordon, E. Kevin PY - 2015/06/29 TI - Information-Seeking Behaviors of Medical Students: A Cross-Sectional Web-Based Survey JO - JMIR Medical Education SP - e4 VL - 1 IS - 1 KW - information-seeking behavior KW - information retrieval KW - Internet KW - medical education KW - medical students N2 - Background: Medical students face an information-rich environment in which retrieval and appraisal strategies are increasingly important. Objective: To describe medical students? current pattern of health information resource use and characterize their experience of instruction on information search and appraisal. Methods: We conducted a cross-sectional web-based survey of students registered in the four-year MD Program at Dalhousie University (Halifax, Nova Scotia, and Saint John, New Brunswick, sites), Canada. We collected self-reported data on information-seeking behavior, instruction, and evaluation of resources in the context of their medical education. Data were analyzed using descriptive statistics. Results: Surveys were returned by 213 of 462 eligible students (46.1%). Most respondents (165/204, 80.9%) recalled receiving formal instruction regarding information searches, but this seldom included nontraditional tools such as Google (23/107, 11.1%), Wikipedia, or social media. In their daily practice, however, they reported heavy use of these tools, as well as EBM summaries. Accessibility, understandability, and overall usefulness were common features of highly used resources. Students identified challenges managing information and/or resource overload and source accessibility. Conclusions: Medical students receive instruction primarily on searching and assessing primary medical literature. In their daily practice, however, they rely heavily on nontraditional tools as well as EBM summaries. Attention to appropriate use and appraisal of nontraditional sources might enhance the current EBM curriculum. UR - http://mededu.jmir.org/2015/1/e4/ UR - http://dx.doi.org/10.2196/mededu.4267 UR - http://www.ncbi.nlm.nih.gov/pubmed/27731842 ID - info:doi/10.2196/mededu.4267 ER - TY - JOUR AU - Brochhausen, Christoph AU - Winther, B. Hinrich AU - Hundt, Christian AU - Schmitt, H. Volker AU - Schömer, Elmar AU - Kirkpatrick, James C. PY - 2015/05/11 TI - A Virtual Microscope for Academic Medical Education: The Pate Project JO - Interact J Med Res SP - e11 VL - 4 IS - 2 KW - whole-slide imaging KW - WSI KW - virtual microscopy KW - telepathology KW - e-learning KW - databases KW - Internet KW - microscopy N2 - Background: Whole-slide imaging (WSI) has become more prominent and continues to gain in importance in student teaching. Applications with different scope have been developed. Many of these applications have either technical or design shortcomings. Objective: To design a survey to determine student expectations of WSI applications for teaching histological and pathological diagnosis. To develop a new WSI application based on the findings of the survey. Methods: A total of 216 students were questioned about their experiences and expectations of WSI applications, as well as favorable and undesired features. The survey included 14 multiple choice and two essay questions. Based on the survey, we developed a new WSI application called Pate utilizing open source technologies. Results: The survey sample included 216 students?62.0% (134) women and 36.1% (78) men. Out of 216 students, 4 (1.9%) did not disclose their gender. The best-known preexisting WSI applications included Mainzer Histo Maps (199/216, 92.1%), Histoweb Tübingen (16/216, 7.4%), and Histonet Ulm (8/216, 3.7%). Desired features for the students were latitude in the slides (190/216, 88.0%), histological (191/216, 88.4%) and pathological (186/216, 86.1%) annotations, points of interest (181/216, 83.8%), background information (146/216, 67.6%), and auxiliary informational texts (113/216, 52.3%). By contrast, a discussion forum was far less important (9/216, 4.2%) for the students. Conclusions: The survey revealed that the students appreciate a rich feature set, including WSI functionality, points of interest, auxiliary informational texts, and annotations. The development of Pate was significantly influenced by the findings of the survey. Although Pate currently has some issues with the Zoomify file format, it could be shown that Web technologies are capable of providing a high-performance WSI experience, as well as a rich feature set. UR - http://www.i-jmr.org/2015/2/e11/ UR - http://dx.doi.org/10.2196/ijmr.3495 UR - http://www.ncbi.nlm.nih.gov/pubmed/25963527 ID - info:doi/10.2196/ijmr.3495 ER -