Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 12.06.20 in Vol 6, No 1 (2020): Jan-Jun

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/17585, first published Dec 22, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    Self-Perceptions of Readiness to Use Electronic Health Records Among Medical Students: Survey Study

    1Department of Family Medicine and Public Health, University of California San Diego, La Jolla, CA, United States

    2Department of Biomedical Informatics, University of California San Diego Health, La Jolla, CA, United States

    3Shiley Eye Institute and Viterbi Family Department of Ophthalmology, University of California San Diego, La Jolla, CA, United States

    4College of Pharmacy, University of Nebraska Medical Center, Omaha, NE, United States

    5School of Medicine, University of California San Diego, La Jolla, CA, United States

    6Information Services Department, University of California San Diego Health, La Jolla, CA, United States

    7Department of Internal Medicine, University of Nebraska Medical Center, Omaha, NE, United States

    8Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA, United States

    Corresponding Author:

    Lina Lander, SD

    Department of Family Medicine and Public Health

    University of California San Diego

    6500 Gillman Drive

    La Jolla, CA, 92093-0606

    United States

    Phone: 1 8582601917

    Email: linalander@health.ucsd.edu


    ABSTRACT

    Background: Although several national organizations have declared the ability to work with electronic health records (EHRs) as a core competency of medical education, EHR education and use among medical students vary widely. Previous studies have reported EHR tasks performed by medical students, but students’ self-perceived readiness and comfort with EHRs are relatively unknown.

    Objective: This study aimed to better understand medical students’ self-perceived readiness to use EHRs to identify potential curricular gaps and inform future training efforts based on students’ perspectives.

    Methods: The authors deployed a survey investigating self-perceived comfort with EHRs at 2 institutions in the United States in May 2019. Descriptive statistics were generated regarding demographics, comfort level with various EHR-related tasks, and cross-institutional comparisons. We also assessed the impact of extracurricular EHR experience on comfort level.

    Results: In total, 147 medical students responded, of which 80 (54.4%) were female, with equal distribution across all 4 years of training. Overall confidence was generally higher for students with longer extracurricular EHR experience, even when adjusted for age, gender, year of training, and institution. Students were most comfortable with tasks related to looking up information in the EHR and felt less comfortable with tasks related to entering new information and managing medications. Fourth-year students at both schools reported similar levels of comfort with EHR use, despite differences in preclinical EHR training. Open-ended comments emphasized the value of experiential training over didactic formats.

    Conclusions: Information entry and medication management in the EHR represent areas for future curricular development. Experiential training via extracurricular activities and early clinical exposure may be high-yield approaches to help medical students achieve critical EHR competencies.

    JMIR Med Educ 2020;6(1):e17585

    doi:10.2196/17585

    KEYWORDS



    Introduction

    Electronic health records (EHRs) have become widely adopted across the United States [1-4]. EHR use has become an increasingly prominent component of physician work time and effort across multiple specialties, in some cases equaling or surpassing time spent in face-to-face interactions with patients [5-12]. This widespread integration of EHRs has generated a national discussion regarding the role of EHR training in medical school curricula. In response, several national organizations, such as the Association of American Medical College (AAMC) [13], the Alliance for Clinical Education [14], and the Liaison Committee on Medical Education [15], have issued guidance stating that the ability to work in an EHR is a core competency for medical students before beginning residency. In fact, 2 of the AAMC’s core entrustable professional activities for entering residency relate to EHR use: (1) enter and discuss orders and prescriptions and (2) document a clinical encounter in the medical record [16]. The need for medical student preparation and readiness in EHRs has also been echoed by professional medical societies, such as the American Medical Association [17], the American College of Surgeons [18], and the American Academy of Family Physicians [19].

    Despite the recognized need for directed EHR training during medical school, EHR education and use among medical students vary widely among different institutions and clerkships [20-24], and a lack of focused initiatives to engage students in EHR education may leave gaps in the competencies expected of residents [25]. Previous studies have focused on the types of tasks performed within the EHR by medical students during their clinical rotations, such as accessing information, entering information, entering notes, and entering orders. However, knowledge about medical students’ self-perceptions of their comfort and readiness in using EHRs as well as how this sense of readiness may relate to varying curricular approaches is lacking.

    To fill this gap, we deployed a survey to medical students at 2 different institutions to gain an understanding about self-perceptions of EHR readiness. We hypothesized that perceived readiness would be higher among students with prior extracurricular EHR experience as well as among students who participated in an integrated EHR curriculum. The purpose of this study was to better understand medical students’ perceived readiness for EHR use and identify gaps in curriculum and training that could be addressed to improve medical school curricula and address this critical competency of EHR education.


    Methods

    Study Population

    Eligible participants included all medical students from the University of Nebraska Medical Center College of Medicine (UNMC) and the University of California San Diego School of Medicine (UCSD). Currently enrolled medical students at all levels of training were eligible. Both medical schools are affiliated with academic medical centers that use the same EHR vendor. The institutional review boards of both UNMC and UCSD approved this study.

    Curricula and Electronic Health Record Training

    UNMC is a 4-year Doctor of Medicine degree–granting program, affiliated with Nebraska Medicine, which enrolls approximately 135 students per year. Students acquire EHR skills throughout the 4-year curriculum. Medical students begin learning to use the EHR during the first week of school, and formal training continues over the first 18 months before entering clerkships. The UNMC preclinical phase consists of 10 organ systems–based blocks, each containing an EHR exercise. These range from a scavenger hunt, in which students learn where to locate information in the health record, to specific cases designed to help them learn order entry or how to type notes in the EHR. All preclinical exercises are performed in the EHR training environment and are supervised by a faculty member. Early sessions also have information technology staff support to help troubleshoot issues with access or functionality. The initial sessions are used to learn navigation skills—finding specific patient information, laboratory and imaging results, or searching encounter notes and discharge summaries. Once basic skills are established, EHR-based cases are used to improve students’ skills in the medical record to include documenting clinical encounters; entering orders; documenting medical history, allergies, and medications; reviewing pertinent medical information from prior notes; and using alerts and reminders in the EHR to complete health care maintenance tasks. Formal preclinical EHR training was initiated in 2017. During the preclinical phase, students also have the opportunity to practice their skills at the student-run free clinic (SHARING Clinic). Approximately 50% of the preclinical students volunteer for this clinic, which uses the same EHR as the main medical campus. Immediately before clerkships, students have a session to learn shortcuts offered within the EHR—specifically, using templates for note writing. These training exercises are designed to increase competence and confidence with the use of EHR and to promote active participation in the delivery of care during clerkships.

    UCSD is a 4-year Doctor of Medicine degree–granting program, affiliated with the UC San Diego Health, which enrolls approximately 134 students per year. EHR exposure is limited in the preclinical years. There is no formal EHR training in the preclinical curriculum, unless a student elects to participate in the student-run free clinic. Approximately 80% of first- and second-year students volunteer at the student-run free clinic, where students use a clinic-specific EHR from the same vendor as the academic medical center. Students who volunteer in the free clinic undergo a 2-hour orientation session on EHR functionality and clinic-specific workflows. All medical students, irrespective of free clinic participation, receive formal EHR education during a clinical transition week at the beginning of the third year. Students review several web-based modules provided by the vendor and participate in one 2-hour didactic session that covers both inpatient and ambulatory clinic tools and workflows. Examples of skills taught include finding patients on a clinic schedule and navigating summary reports, demographics, patients’ problem lists, notes, and labs.

    At both institutions, third- and fourth-year medical students are actively engaged in EHR use in their clinical clerkships and elective rotations. Both institutions also require subinternships where students function as interns under the close supervision of faculty physicians and senior residents. EHR tasks include placing orders throughout the hospitalization; performing medication reconciliation; and writing admission notes, progress notes, and discharge summaries. However, the main contrast in curricula is that UCSD has little formal EHR training during the preclinical years, whereas UNMC has integrated EHR training throughout the preclinical curriculum.

    Survey

    We modified EHR competency assessment tools provided by the EHR vendor for formal training sessions to develop the self-perceived readiness survey (full survey instrument available in Multimedia Appendix 1). Instead of asking students to perform specific tasks such as finding allergies, immunizations, and others, we rephrased the questions to ask about self-perceived comfort levels while performing each task. Students rated the comfort level with using various EHR components on a 5-point Likert scale, ranging from 1 (very uncomfortable) to 5 (very comfortable). We also asked students to provide their gender, age group, year of training, and content and length of preclinical extracurricular EHR experience. The survey concluded with an open-ended item asking students for general comments about their EHR training and preparedness to work in the EHR. In total, 3 School of Medicine faculty members and 2 medical students from both institutions assessed the survey for face validity, readability, and understanding.

    The electronic survey was administered anonymously via email to all current medical students in May 2019 at UCSD and in July 2019 at UNMC, with 2 reminder emails at 7 and 14 days after the initial invitation. Owing to the timing of the survey administration at UNMC, preclinical students were students between years 1 and 2 of the curriculum; no incoming first-year students were surveyed, as they had not yet started the curriculum. The survey remained open for a total of 30 days. Survey completion required approximately 10 minutes and did not affect students’ grades or evaluations. Survey data were collected using Qualtrics (Qualtrics, Provo, UT, USA).

    Statistical Analyses

    Statistical analysis consisted of descriptive statistics using the mean and SD or counts/frequencies where appropriate. To compare categorical data between institutions, we used the Pearson chi-square test for independence. We used the Student t test to compare mean Likert scores for survey items. Although Likert scale data are classically analyzed with nonparametric testing such as the Mann-Whitney-Wilcoxon test, we chose to compare mean Likert values using the Student t test [26] to facilitate data interpretation. For any t test that generated a P value of less than .10, we conducted the Mann-Whitney-Wilcoxon test as a sensitivity analysis. For clarity, only P values from t tests are reported. In all cases, we reached the same conclusion regarding statistical significance, regardless of whether we used a t test or a Mann-Whitney-Wilcoxon test. For all hypothesis tests and models, statistical significance was defined as a P value of less than .05. Statistical analyses were conducted using Stata version 11 (StataCorp LLC, College Station, TX, USA) and R (RStudio Inc, Boston, MA) [27].


    Results

    General Demographics

    In total, 147 medical students responded to the survey on EHR readiness at the 2 institutions. Of the 506 medical students who received survey invitations at UCSD, 95 (19%) responded. The response rate at UNMC was 13.4% (52/386). About half of the respondents were female (80/147, 54.4%; Table 1). The majority (27/52, 52%) of respondents at UNMC were aged <25 years, whereas the most well-represented group among UCSD respondents were those in the 25 to 27 years age range (P=.02). The gender distribution of the survey respondents was generally consistent with the overall enrollment at the 2 institutions—the proportion of females in the overall UCSD student population was 52.7% (369/700), whereas at UNMC, it was 45.0% (175/389). The age distribution of the survey respondents at UCSD corresponded with that of the overall student population (188/700, 26.9% aged <25 years; 291/700, 41.6% aged 25-27 years; and 221/700, 31.6% aged ≥28 years). The survey respondents at UNMC had a greater proportion of individuals younger than 25 years (27/52, 52% of the survey respondents compared with 104/389, 26.7% in the overall student population).

    Table 1. Characteristics of medical students from the University of California San Diego School of Medicine and the University of Nebraska Medical Center College of Medicine responding to a survey on self-perceived electronic health record readiness.
    View this table

    Impact of Extracurricular Electronic Health Record Experience

    Medical students at both UCSD and UNMC reported engagement with EHRs via extracurricular activities (Table 1). These activities were undertaken by medical students outside of their formal medical school curricula (ie, not formal clinical rotations). Examples included volunteering in student-run free clinics for underserved populations as well as volunteering in inpatient settings or ambulatory clinics. Significantly higher proportions of UCSD medical students reported having 1 month or more of EHR experience in the student-run free clinic and in ambulatory settings compared with respondents at UNMC (67% vs 53% and 65% vs 54%, respectively; P<.001 for both comparisons). The proportion of respondents with 1 month or more of extracurricular EHR experience in inpatient settings was similar between the 2 institutions (47% vs 40%; P=.42).

    We specifically investigated the impact of extracurricular EHR experience on overall confidence using EHRs. Overall confidence was a single Likert score to gauge the students’ overall self-perceived confidence in using EHRs. This overall confidence score was compared between students who had less than 1 month of extracurricular EHR experience and those who had 1 month or more of extracurricular EHR experience (Table 2).

    All settings (ie, free clinic, inpatient, and ambulatory) were evaluated, for the cohort overall and individually at each institution. As expected, the mean Likert scores for overall confidence were generally higher for students with longer extracurricular EHR experience at both institutions. Specifically, medical students who had longer exposures to EHR interactions in inpatient settings and ambulatory clinics reported significantly higher overall confidence in using EHRs, with average Likert scores of 3.5 or greater at both institutions. These differences did not reach statistical significance for longer exposure to the student-run free clinic. Those with less than a month of extracurricular EHR experience in any of the settings had mean Likert scores of less than 3 for overall confidence.

    The effects of extracurricular activities were also evaluated in a multivariable model. The extracurricular ambulatory clinic EHR experience of 1 month or more was associated with significantly higher overall confidence using the EHR after adjusting for institution, year of training, age, and gender (average increase in the Likert score of 0.57 compared with those with <1 month of experience; P=.004). The effect of inpatient experience, however, was borderline significant (average increase in the Likert score of 0.38; P=.06). Similar to the unadjusted analysis, students with ≥1 month EHR experience in the student-run free clinic were not significantly more confident in the multivariable model (P=.14).

    Table 2. Impact of extracurricular electronic health record experience on mean Likert scale score for overall confidence.
    View this table

    Perceptions of Electronic Health Record Readiness Across Various Domains

    The survey included 15 items asking medical students to rate their comfort level with various tasks in the EHR as well as an item to rate their overall confidence in working with EHRs. We grouped task-related items into 3 domains: (1) looking up information, (2) entering new information, and (3) medication management. We compared the mean Likert scores for self-perceived comfort or readiness for each item between the 2 institutions (Table 3).

    In the domain of looking up information, there were no significant differences between UCSD and UNMC. Medical students at both institutions reported high levels of comfort (Likert scores >4) for looking up laboratory values and finding progress notes. Students at both institutions felt less comfortable with identifying clinical documentation errors in the EHR (mean score of 2.3 at UCSD and 2.4 at UNMC).

    Compared with looking up information, medical students at both institutions felt less confident while entering new information, as no mean Likert scores exceeded 4 in this domain at either institution. Of the 8 EHR tasks included in this domain, medical students at UNMC were significantly more comfortable than medical students at UCSD with 4 of these tasks: entering a new diagnosis, updating a patient’s problem list to include a new problem, documenting immunizations in the EHR, and documenting allergies in the EHR (Table 3). UCSD medical students were significantly more comfortable with messaging other providers within the EHR (2.7 vs 1.8 at UNMC; P<.001). Medical students from both institutions had similar comfort levels with documenting past medical history and past social history; documenting clinical encounters using templates within the EHR; and completing documentation of notes such as progress notes, admission notes, and discharge summaries.

    Medical students at both institutions reported lower comfort levels with medication management in the EHR compared with looking up information and entering new information, as no mean scores exceeded 3.5 in this domain. Although UNMC medical students had a significantly greater comfort level with entering new medication orders (3.2 vs 2.5 at UCSD; P=.005), there were no statistically significant differences in the remaining items, such as verifying medication orders, reviewing history and scheduled medications, and performing medication reconciliation.

    In response to the item “Overall, I feel prepared to use the EHR,” medical students from both institutions endorsed a midlevel comfort score, with UCSD students having a mean score of 3.1 and UNMC students having a mean score of 3.2 (P=.65).

    Table 3. Average self-reported feeling of comfort with using various components of the electronic health record by institution.
    View this table

    Comparisons of Electronic Health Record Readiness Among Preclinical Students

    The primary curricular difference between the 2 institutions was that UCSD did not offer formal preclinical EHR training, whereas UNMC did. Therefore, we aggregated data from first- and second-year students to analyze perceptions of EHR readiness among preclinical students (n=131, with 77 from UCSD and 44 from UNMC). The mean Likert scores for comfort and readiness to perform various EHR tasks were compared by institution (Multimedia Appendix 2). There were no significant differences in tasks related to looking up information. Tasks where UNMC preclinical students reported significantly higher levels of readiness included entering new information, such as diagnoses (P<.001), problems (P=.002), immunizations (P=.007), allergies (P<.001), prior medical/social history (P=.003), and medication orders (P<.001). The only task where UCSD preclinical students reported greater levels of comfort than UNMC preclinical students was messaging other providers (P=.002). Despite differences in comfort level with individual tasks, preclinical students from the 2 institutions did not have significantly different overall levels of comfort with the EHR (P=.14).

    Perceptions of Electronic Health Record Readiness Among Fourth-Year Medical Students

    To measure self-perceived readiness in performing EHR-related tasks at the end of undergraduate medical training, we specifically analyzed data from fourth-year medical students. For nearly all survey items, there were no significant differences between fourth-year medical students at the 2 institutions (Multimedia Appendix 3). There were significant differences for only 2 survey items: UCSD fourth-year students were significantly more comfortable with messaging other providers within the EHR (3.0 vs 1.5 at UNMC; P=.001) and exhibited greater overall confidence (4.2 vs 3.5 at UNMC; P=.04). As there were no differences in all other items and because of the relatively small sample size, the data for fourth-year medical students were combined from the 2 institutions to examine general trends among the overall cohort.

    Fourth-year medical students generally felt comfortable with EHR-related tasks, reporting a mean Likert score of 3 or higher for about three-fourths of the EHR-related tasks (11/15, 73%; Figure 1). Tasks for which the mean Likert scores for comfort level were less than 3 for fourth-year medical students were as follows: entering immunizations, messaging other providers, verifying medication orders, and medication reconciliation (Figure 1).

    Figure 1. Mean Likert scores for comfort level with electronic health record–related tasks among senior fourth-year medical students from the University of California San Diego School of Medicine and the University of Nebraska Medical Center College of Medicine, 2019. EHR: electronic health record. Error bars indicate standard deviations.
    View this figure

    Students’ Comments

    Of the 147 respondents, 37 (25.1%) provided open-ended comments (UCSD, n=23 and UNMC, n=14). Comments from the preclinical UCSD students (15/23, 65% of all UCSD commenters) reflected the lack of formal EHR training, for example:

    I have received no training.
    We don’t get any training? Needs to change.
    I only feel very comfortable because I have worked at Epic...Otherwise I have received very little/no training.

    Overall, 2 UCSD students (9% of all UCSD commenters) mentioned exposure to EHR in the student-run free clinic, although some felt it was insufficient. For example, one third-year student wrote:

    Free Clinic was good exposure but I still feel like I could have used more training on note writing before MS3.

    Similarly, a first-year student wrote:

    I feel very unready to work in EHR. I have to struggle through it every time I am at free clinic. Even the 4th years at free clinic struggle to help me sometimes because they are not as well-versed in EHR as they could be.

    Furthermore, 5 third- and fourth-year medical students (22% of all UCSD commenters) stated that they had learned how to use the EHR through prior experience as a scribe before medical school, resident coaching while on rotations, or just “doing the work.” Several students outlined specific areas that could be addressed by training, where they felt relatively less well prepared. These areas included placing orders, more emphasis on inpatient training, and “training focused on common pitfalls or more efficient use of the EHR.”

    At UNMC, 14 students provided free-text comments, evenly split between preclinical students in year 2 and clinical students in years 3 and 4. There were no comments on the lack of formal training, reflecting the structured preclinical EHR curriculum at UNMC. Moreover, 2 students (14% of all UNMC commenters) stated that this training was helpful, such as:

    The allergy small group was really good.
    There are so many tips and tricks that you don’t learn unless someone shows you.

    However, the remaining students emphasized the importance of experiential learning over didactic training. For example, the comments included:

    The EHR is a learn by doing process. I’m in the first three months of clinical rotations, and I have learned more than any of the training sessions.
    I think plain old practice has made the biggest difference for me.
    We can get all the “trainings” you want but if we don't actually practice what we “learn,” it’s gone by the following week.
    I feel like a lot of what I know how to do is through trial and error.

    Similar to UCSD medical students, several UNMC students (4/14, 29%) cited prior work experience and the critical role of residents in helping them feel comfortable with the EHR.

    Furthermore, 11 students (30% of all commenters between both institutions) provided suggestions for improving training, such as the need for formal training at UCSD, interactive small group sessions, request for shorter but more frequent sessions, desire for “training focused on common pitfalls or more efficient use of the EHR,” and “training to personalize EHR.”


    Discussion

    Principal Findings

    The complexity of EHRs was reflected in students’ self-perceived comfort, which varied by the specific EHR components. Across 4 years of medical school, students felt more comfortable with lower-complexity tasks such as looking up existing information and less comfortable with more complex tasks such as entering new information and medication management. Students at both institutions reported lower comfort with looking up clinical documentation errors, entering information on immunizations, reconciling medications, and messaging other providers. This discrepancy persisted even among graduating seniors, with an average comfort with looking up progress notes of 4.9 (out of 5) compared with comfort with reconciling medications of 2.8. Overall, students’ self-reported comfort with working in the EHR was 3.1 at UCSD and 3.2 at UNMC.

    EHR training in medical school curricula could benefit from a combination of lower- and higher-complexity tasks. If the current training focuses primarily on navigation and data acquisition from the chart, more emphasis on information entry and medical decision making (ie, medication management) for medical students may improve their comfort level with these tasks. Case studies or simulated exercises, where students both look up and enter information into a training EHR environment, could be one strategy to increase comfort with higher-complexity tasks.

    For medical trainees, practical experience with EHRs continues to be an important factor in becoming proficient, which has also been highlighted by national guidelines [13-16]. Mean overall confidence was generally higher among students with 1 month or more experience of extracurricular EHR compared with those with less than 1 month of experience. We asked about working or volunteering in different settings because EHR tasks and experience vary by location of usage. With the exception of a student-run free clinic, a longer experience of working in both inpatient and ambulatory settings was associated with higher average comfort of working in the EHR (3.8 vs 2.4 and 3.5 vs 2.3, respectively). The results were similar for both institutions. These effects persisted even after adjusting for other factors such as age, gender, year of training, and institution.

    Although both UCSD and UNMC are similar in class size and general curriculum, there were several notable differences among students. Across all stages of training, scores of UNMC students were consistently higher than those of UCSD students on individual items, although not all items were significant. This could be because of the more structured EHR curriculum at UNMC in the preclinical years. This was reinforced by a subanalysis of preclinical students, where UNMC preclinical students expressed significantly higher levels of comfort across multiple tasks in the EHR than UCSD students. Comfort levels, however, were similar among senior fourth-year students at both UNMC and UCSD, suggesting that firsthand experience during the clinical rotation years using the EHR in the context of patient care closed this initial gap. In fact, overall, graduating UCSD students felt more prepared to work with EHR compared with UNMC students (4.2 vs 3.5; P=.04), despite not having any formal preclinical EHR training.

    For fourth-year medical students, it is possible that tasks with mean comfort Likert scores of <3, such as for entering immunizations, messaging other providers, verifying medication orders, and medication reconciliation, were reflective of difficulty performing the task itself rather than difficulty with performing the task using the EHR. This could be because of hesitation to make permanent changes in the EHR that impact a patient’s medical record outside of the encounter under which the medical student documents.

    Students’ comments emphasized the importance of practical experience, and UCSD respondents reported the lack of formal training. Despite having had a formal preclinical EHR curriculum, UNMC students still emphasized the importance of experiential training. Although the value of didactic training may not be as high as experiential training, it can still provide the foundation and basic familiarity to help students feel more comfortable and confident as they approach their clinical rotations. Students can feel anxious about transitioning to the clinical environment, as they continue to develop their medical knowledge and skills, adjust to working in a clinical environment, and learn to interact with new team members [28-30]. Thus, greater familiarity with EHR could help mitigate some anxiety inherent with this transition to clinical rotations.

    As with clinical skills, mentors and, specifically, residents play a large role in students’ learning of the EHR, which was also highlighted in students’ comments. Although much of the resident-led training happens organically, there could be high variability in experience among students depending on the residents’ own familiarity with the EHR. Graduate medical education programs may consider providing formal evaluations of residents’ EHR competencies and, if needed, training.

    Limitations

    Our study has several limitations, including relatively low survey response rates at both institutions and a cross-sectional design. As such, the results show associations only, and we could not evaluate causality for factors such as the institution and, thus, preclinical EHR curriculum or extracurricular experience. The survey respondents at UNMC tended to be younger than the overall student population, but the demographics of survey respondents at both institutions were consistent with the overall population. We believe that 1 month is generally sufficient to learn basic workflows in 1 setting and decided to use that time frame as a cutoff point for EHR experience. Given the importance of experience in comfort using EHRs, future studies may consider collecting detailed information on prior EHR experience. A longitudinal follow-up may help evaluate how students’ responses change as they progress through the curriculum and help determine the most impactful opportunities for EHR training. In addition, in the survey instrument, we did not collect data regarding absence from medical training, such as that for extended research projects, additional degrees, health issues, or parental leave.

    Strengths

    Our study strengths included multiple institutions and participants in all 4 years of training. Both institutions had vastly different preclinical EHR training curricula. Previous studies that examined EHR use among medical students focused on the types of EHR tasks performed by medical students during their clinical clerkships [20-22,24,31]. We included medical students across the training spectrum, examining the variations in preclinical curricula. In addition, we measured medical students’ self-reported comfort rather than specific tasks they could complete in the EHR. Similar to the movement toward patient-reported outcomes rather than objective clinical outcomes in the realm of clinical research, medical education research should consider the subjective experience of medical students.

    Conclusions

    Medical schools worldwide strive to continue improving the education and well-being of their students. Considering the impact of extracurricular experience on EHR readiness, we should provide more practical opportunities embedded within the preclinical curriculum rather than putting the onus on students to seek out appropriate experiences. Even student-run free clinics may be insufficient to allow all students ample clinical exposure that involves EHR practice. Some medical schools are introducing clinical exposure as formal longitudinal clerkships and introducing clinical rotations earlier in their curricula [32-36]. A combination of didactic and practical experiences combined with structured mentorship and personalization will help provide better EHR training for medical students and address this critical competency in medical education.

    Acknowledgments

    The authors would like to thank all the medical students who participated in this study. This study was supported by the National Institutes of Health/National Library of Medicine (SB; grant T15LM011271).

    Authors' Contributions

    LL and GC conceived and designed the study. LL, GC, KC, RT, LA, and HG acquired the data. LL, GC, and SB analyzed the data. LL and SB drafted the manuscript. All authors contributed to the interpretation of the data and critically revised the manuscript for important intellectual content.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Survey instrument for assessing self-perceived readiness for using electronic health records among medical students.

    PDF File (Adobe PDF File), 63 KB

    Multimedia Appendix 2

    Mean Likert scores for self-perceived readiness to perform various electronic health record–related tasks for preclinical (first- and second-year) medical students by institution.

    DOCX File , 22 KB

    Multimedia Appendix 3

    Mean Likert scores for self-perceived readiness to perform various electronic health record–related tasks for senior fourth-year medical students by institution.

    DOCX File , 22 KB

    References

    1. Adler-Milstein J, des Roches CM, Kralovec P, Foster G, Worzala C, Charles D, et al. Electronic health record adoption in US hospitals: progress continues, but challenges persist. Health Aff (Millwood) 2015 Dec;34(12):2174-2180. [CrossRef] [Medline]
    2. Jha AK, Burke MF, des Roches C, Joshi MS, Kralovec PD, Campbell EG, et al. Progress toward meaningful use: hospitals' adoption of electronic health records. Am J Manag Care 2011 Dec;17(12 Spec No):SP117-SP124 [FREE Full text] [Medline]
    3. Jha AK, DesRoches CM, Kralovec PD, Joshi MS. A progress report on electronic health records in US hospitals. Health Aff (Millwood) 2010 Oct;29(10):1951-1957. [CrossRef] [Medline]
    4. Henry J, Pylypchuk Y, Searcy T, Patel V. Health IT Dashboard. 2016. Adoption of Electronic Health Record Systems among US Non-Federal Acute Care Hospitals: 2008-2015   URL: http:/​/dashboard.​healthit.gov/​evaluations/​data-briefs/​non-federal-acute-care-hospital-ehr-adoption-2008-2015.​php [accessed 2016-09-20]
    5. Wachter R. The Digital Doctor: Hope, Hype, and Harm at the Dawn of Medicine’s Computer Age. New York, USA: McGraw-Hill Education; 2017.
    6. Tipping MD, Forth VE, O'Leary KJ, Malkenson DM, Magill DB, Englert K, et al. Where did the day go?-a time-motion study of hospitalists. J Hosp Med 2010;5(6):323-328. [CrossRef] [Medline]
    7. Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties. Ann Intern Med 2016 Dec 6;165(11):753-760. [CrossRef] [Medline]
    8. Robertson SL, Robinson MD, Reid A. Electronic health record effects on work-life balance and burnout within the I population collaborative. J Grad Med Educ 2017 Aug;9(4):479-484 [FREE Full text] [CrossRef] [Medline]
    9. Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. J Am Med Inform Assoc 2005;12(5):505-516 [FREE Full text] [CrossRef] [Medline]
    10. Joukes E, Abu-Hanna A, Cornet R, de Keizer NF. Time spent on dedicated patient care and documentation tasks before and after the introduction of a structured and standardized electronic health record. Appl Clin Inform 2018 Jan;9(1):46-53 [FREE Full text] [CrossRef] [Medline]
    11. Arndt BG, Beasley JW, Watkinson MD, Temte JL, Tuan W, Sinsky CA, et al. Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations. Ann Fam Med 2017 Sep;15(5):419-426 [FREE Full text] [CrossRef] [Medline]
    12. Tai-Seale M, Olson CW, Li J, Chan AS, Morikawa C, Durbin M, et al. Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine. Health Aff (Millwood) 2017 Apr 1;36(4):655-662 [FREE Full text] [CrossRef] [Medline]
    13. Kirch D. Compliance Advisory: Electronic Health Records (EHRs) in Academic Health Centers. Allowing Medical Student Documentation in the Electronic Health Record   URL: https://www.aamc.org/em/aamc/compliance_advisory.pdf [accessed 2019-09-17]
    14. Hammoud MM, Dalymple JL, Christner JG, Stewart RA, Fisher J, Margo K, et al. Medical student documentation in electronic health records: a collaborative statement from the alliance for clinical education. Teach Learn Med 2012;24(3):257-266. [CrossRef] [Medline]
    15. The Liaison Committee on Medical Education. 2019. Functions and Structure of a Medical School: Standards for Accreditation of Medical Education Programs Leading to the MD Degree   URL: https:/​/lcme.​org/​wp-content/​uploads/​filebase/​standards/​2020-21_Functions-and-Structure_2019-10-04.​docx [accessed 2019-11-30]
    16. AAMC Store. Core Entrustable Professional Activities for Entering Residency   URL: https://store.aamc.org/core-entrustable-professional-activities-for-entering-residency.html [accessed 2019-09-13]
    17. American Medical Association. 2015. AMA Supports Medical Student Access to Electronic Health Records   URL: https:/​/www.​ama-assn.org/​press-center/​press-releases/​ama-supports-medical-student-access-electronic-health-records [accessed 2019-09-18]
    18. The Bulletin. 2018. Statement on Medical Student Use of the Electronic Health Record   URL: http://bulletin.facs.org/2018/04/statement-on-medical-student-use-of-the-electronic-health-record/ [accessed 2019-09-18]
    19. American Academy of Family Physicians. Medical Student Access to Electronic Medical Record (EMR)   URL: https://www.aafp.org/about/policies/all/medical-student.html [accessed 2019-09-18]
    20. Wittels K, Wallenstein J, Patwari R, Patel S. Medical student documentation in the electronic medical record: patterns of use and barriers. West J Emerg Med 2017 Jan;18(1):133-136 [FREE Full text] [CrossRef] [Medline]
    21. Virden RA, Sonnett FM, Khan AN. Medical student documentation in the emergency department in the electronic health record era-a national survey. Pediatr Emerg Care 2019 Mar;35(3):220-225. [CrossRef] [Medline]
    22. Chi J, Bentley J, Kugler J, Chen JH. How are medical students using the electronic health record (EHR)?: an analysis of EHR use on an inpatient medicine rotation. PLoS One 2019;14(8):e0221300 [FREE Full text] [CrossRef] [Medline]
    23. Biagioli FE, Elliot DL, Palmer RT, Graichen CC, Rdesinski RE, Kumar KA, et al. The electronic health record objective structured clinical examination: assessing student competency in patient interactions while using the electronic health record. Acad Med 2017 Jan;92(1):87-91 [FREE Full text] [CrossRef] [Medline]
    24. Foster LM, Cuddy MM, Swanson DB, Holtzman KZ, Hammoud MM, Wallach PM. Medical student use of electronic and paper health records during inpatient clinical clerkships: results of a national longitudinal study. Acad Med 2018 Nov;93(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 57th Annual Research in Medical Education Sessions):S14-S20. [CrossRef] [Medline]
    25. Rajaram A, Hickey Z, Patel N, Newbigging J, Wolfrom B. Training medical students and residents in the use of electronic health records: a systematic review of the literature. J Am Med Inform Assoc 2020 Jan 1;27(1):175-180. [CrossRef] [Medline]
    26. Sullivan GM, Artino AR. Analyzing and interpreting data from likert-type scales. J Grad Med Educ 2013 Dec;5(4):541-542 [FREE Full text] [CrossRef] [Medline]
    27. R-Project. The R Project for Statistical Computing   URL: https://www.r-project.org/ [accessed 2018-11-12]
    28. Wenrich M, Jackson MB, Scherpbier AJ, Wolfhagen IH, Ramsey PG, Goldstein EA. Ready or not? Expectations of faculty and medical students for clinical skills preparation for clerkships. Med Educ Online 2010 Aug 6;15(1):5295 [FREE Full text] [CrossRef] [Medline]
    29. Small RM, Soriano RP, Chietero M, Quintana J, Parkas V, Koestler J. Easing the transition: medical students' perceptions of critical skills required for the clerkships. Educ Health (Abingdon) 2008 Dec;21(3):192. [Medline]
    30. Haglund ME, aan het Rot M, Cooper NS, Nestadt PS, Muller D, Southwick SM, et al. Resilience in the third year of medical school: a prospective study of the associations between stressful events occurring during clinical rotations and student well-being. Acad Med 2009 Feb;84(2):258-268. [CrossRef] [Medline]
    31. White J, Anthony D, WinklerPrins V, Roskos S. Electronic medical records, medical students, and ambulatory family physicians: a multi-institution study. Acad Med 2017 Oct;92(10):1485-1490. [CrossRef] [Medline]
    32. Gheihman G, Jun T, Young GJ, Liebman D, Sharma K, Brandes E, et al. A review of longitudinal clinical programs in US medical schools. Med Educ Online 2018 Dec;23(1):1444900 [FREE Full text] [CrossRef] [Medline]
    33. Latessa R, Beaty N, Royal K, Colvin G, Pathman DE, Heck J. Academic outcomes of a community-based longitudinal integrated clerkships program. Med Teach 2015;37(9):862-867. [CrossRef] [Medline]
    34. Royan R, Wu C, Theyyunni N, Montas S, Cranford J, House J, et al. Anything but shadowing! Early clinical reasoning in emergency department improves clinical skills. West J Emerg Med 2018 Jan;19(1):177-184 [FREE Full text] [CrossRef] [Medline]
    35. Whipple ME, Barlow CB, Smith S, Goldstein EA. Early introduction of clinical skills improves medical student comfort at the start of third-year clerkships. Acad Med 2006 Oct;81(10 Suppl):S40-S43. [CrossRef] [Medline]
    36. Kossoff EH, Hubbard TW, Gowen CW. Early clinical experience enhances third-year pediatrics clerkship performance. Acad Med 1999 Nov;74(11):1238-1241. [CrossRef] [Medline]


    Abbreviations

    AAMC: Association of American Medical College
    EHR: electronic health record
    UCSD: University of California San Diego School of Medicine
    UNMC: University of Nebraska Medical Center College of Medicine


    Edited by G Eysenbach; submitted 22.12.19; peer-reviewed by J Youm, KH Tan; comments to author 24.03.20; revised version received 05.04.20; accepted 09.04.20; published 12.06.20

    ©Lina Lander, Sally L Baxter, Gary L Cochran, Helena E Gali, Kristen Cook, Thomas Hatch, Regan Taylor, Linda Awdishu. Originally published in JMIR Medical Education (http://mededu.jmir.org), 12.06.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on http://mededu.jmir.org/, as well as this copyright and license information must be included.