The following study was conducted at the medical school of Maastricht University in the Netherlands between February and May 2018. During the 6-year-long undergraduate medical curriculum—the duration of the bachelor and master programs are 3 years each—there is no formal education about eHealth. The most likely way students might encounter eHealth is through their medical rotations.

This study was not submitted nor approved by an institutional ethics committee because we did not deem this necessary in accordance with Dutch law. Dutch ethical law states that ethical approval is only necessary in the case of medical research including human test subjects, as can be read in the Medical Research Involving Human Subjects Act (Wet medisch-wetenschappelijk onderzoek met mensen, in Dutch), paragraph 2 [28]. Our research was aimed at the improvement of education and training without submitting the participants to any medical intervention. Therefore, this was not deemed medical research but educational research. Consent to participate was obtained at the beginning of the questionnaire administration. When the participants opened the questionnaire online, they were met with a statement stating that participants consented to participate and the data could be used for research purposes.

A total of 316 medical students enroll at Maastricht University’s medical school every year, resulting in a total of about 1896 students. We promoted the questionnaire via social media groups that are only accessible by our university medical students. The local medical student association allowed us to use their newsletter to promote the questionnaire. In addition to this, we reached out to medical students through their social media accounts by sending them a personal message about the questionnaire with a link to the Google Form. There was no incentive for students to fill out the form and there were no negative consequences if students did not fill out the form. The inclusion criterion was as follows: medical student actively studying at the time of the survey. The reason for applying this criterion was that all participants will have studied the same curriculum.

Descriptive statistics consisting of the mean, standard deviation, 95% confidence interval, and Cronbach α were calculated, and box and whisker plots were drawn to give a graphic, representation of the results. R version 3.5.0 (The R Foundation) was used for all statistical procedures.

In total, 1468 invitations were sent to medical students to participate in the survey using social media, WhatsApp, and the platforms provided by the medical student association. There were 303 responses to the questionnaire, giving a response rate of 20.64% (303/1468). Characteristics of the participants are listed in Table 1. Most participants were female (215/303, 71.0%). The mean age was 22 years (range 20-25). This is comparable to the average age of medical students at our university. Master students were the largest subgroup, with a total of 183 participants out of 303 (60.4%). The other 120 participants were bachelor students (39.6%).

Table 2 shows how prepared the students feel to use eHealth in their future medical practice. The global aggregate statement “I feel prepared to take advantage of the technological developments within the medical field” scored a low value of 4.8 out of 10 (95% CI 4.6-5.0). Figure 1 shows the students’ attitudes toward different topics upon which we questioned them. Students assigned positive values (ie, a score of 6 or higher) to all topics, meaning that they would like to receive more education about a given topic. The least popular topic was that of machine learning, which had a mean score of 6.4 (SD 1.8, 95% CI 6.2-6.9). The most popular topic was that of applying modern electronic technologies in health care, which had a mean score of 7.3 (SD 1.6, 95% CI 7.1-7.4). When comparing the results from the statements about the current curriculum with results from statements about the eHealth topics, there was a difference between the two. There was a discrepancy between eHealth-related content in current medical education and the amount of eHealth training that is considered useful by medical students.

Figure 2 lists the didactical format the students would prefer when learning about the given topics. The most popular format, with a mean score of 7.2 (SD 2.0), was to remotely follow a real patient under the supervision of a doctor. The least popular form of education was the development of a student’s own health app or mobile app. This only received a mean score of 4.9 (SD 2.7).

To the best of our knowledge, this is the largest evaluation of students’ opinions on eHealth training in a medical undergraduate curriculum. We found that medical students have positive attitudes toward incorporating eHealth into the medical curriculum. This study showed that students do not feel well prepared to take advantage of eHealth in medical practice. The students scored an average of 4.8 out of a maximum of 10 when asked how prepared they felt to take advantage of eHealth in medical practice, while the need for education about the given topics scored a minimum of 6.4 and a maximum of 7.3. These results might provide a basis from which to continue a discussion regarding integrating eHealth into the medical curriculum.

eHealth has been proven to be effective in clinical practice [1-13,29,30]; however, eHealth has not yet been implemented into the working standards of many doctors [31-33]. Prior research indicates that training and education for all those involved with implementation and the use of eHealth is a key factor for the successful incorporation of eHealth [13-16,30]. There are various obstacles to implementing eHealth into clinical practice. The two biggest barriers to the use of eHealth in clinical practice are as follows: technically challenged staff (11%) and resistance to change (8%) [32].

Resistance to change is linked to several factors; lack of knowledge and skill obsolescence are major contributing factors [34]. Lack of eHealth skills and training is prevalent among the current medical workforce. This has been shown to be a major barrier to eHealth adoption [35-38]. This results from the fact that the workforce is not adequately trained to implement eHealth in medical practice [25-27,39]. Awareness and knowledge of what needs to change are essential in enabling change [40]. It has previously been shown that education can be used to overcome resistance to change [41,42]. Therefore, education about eHealth for those involved, in this case the undergraduate students, can lessen the barriers previously mentioned and help to create a workforce that is open and able to use eHealth in their daily practice. Many universities do not have dedicated eHealth training in the current curriculum, adding to the resistance to change [17,18]. Universities and their executives are aware that eHealth training is important, but due to the already overcrowded curricula with competing interests, implementation is lacking [18]. Our results suggest that we should dedicate more time to eHealth training, even though the curriculum is already overcrowded. This overcrowding can be overcome by changing education in the same way that clinical practice is being changed by eHealth. Case-based discussions that are based on a fictional patient can be replaced by cased-based discussions that are based on a real-life patient being remotely monitored in in a hospital, simulation patients can be replaced by teleconference simulation patients, and clinical rotations can incorporate remote care. eHealth education can be combined with the current subjects taught in the curriculum without taking up more time. By thinking of eHealth education the same way as eHealth implementation into clinical practice, it should be possible to incorporate this education into the medical curriculum. eHealth is not some added technology that takes up time; it should be an integrated aspect in clinical practice that improves the quality of care while reducing the workload. Showing students early on during their education that eHealth can be used in these ways might add to a certain digital mindset that is needed to use eHealth to its full extent as a clinician.

Medical students are not receiving enough education to prepare them for eHealth competency. The current workforce is not adequately trained to implement new technologies in working practice [17,18,25,26,34-39,43]. The data we gathered support this because the participants indicated they do not feel prepared to benefit from the technological developments in health care. This holds true for both the bachelor and master students. The master students gave the amount of eHealth training in the bachelor program a lower score, which might indicate that during their medical rotations they were confronted by the fact that their digital skills were lacking. The students indicated that during their rotations, they were not learning enough about eHealth and the use of technology within health care. This might be due to the fact that there is no mention of eHealth skills in the national Dutch framework, which states what competencies a future doctor needs. During these medical rotations, opportunities to develop digital skills are lacking. Their teachers make up the current workforce of doctors. We previously established that this workforce is not adequately prepared to take advantage of the possibilities offered by eHealth. Therefore, we cannot expect them to train the new generation of doctors to attain sufficient digital skills. It would be possible to integrate digital skills education during the medical rotations if taught by eHealth or ICT professionals. The skills could then be further developed during medical rotations, providing a solid foundation for the future workforce.

If eHealth education is implemented early in medical education, this might result in professionals being able to benefit from eHealth. Both bachelor and master students indicated that they feel a lack of this type of education. We concluded from this that it would be beneficial to start training the students during their bachelor phase. This would mean that they would be better prepared to use the skills they have learned during their medical rotations and, therefore, gain practical experience using their skills as soon as possible.

This study works as a basis to support the need for eHealth education among medical students. There is still a lot of work that needs to be done with regard to a framework that defines which eHealth competencies are needed by future doctors, what eHealth subjects should be prioritized, and how students should be taught these subjects.

Another factor that may cause insufficient attention with regard to eHealth training is the assumption that today’s students are up to date with technological developments, including an understanding of eHealth, because of the widespread use of technology among this generation [20,44]. However, prior research demonstrates that undergraduate students do not have this knowledge [25-27]. It could mean that health care is missing out on some of the potential benefits of eHealth due to this assumption. Nevertheless, it is important to use the skills that students have already gathered in the digital age while training them for their professions as future doctors. We should, therefore, always invite student panels while creating a future eHealth curriculum.

Incorporating formal eHealth education into the medical curriculum may contribute to creating a necessary digital mindset [27,45]. This digital mindset means more than just the use of tools [31,32]; it would mean that medical professionals would start to think differently regarding how to provide health care. An example would be to think about how to change from traditional in-hospital care to future health care within patients’ homes. We are increasingly able to gather large amounts of patient data and need medical staff that can think in creative ways in using this data [43]. We hope that by supporting the development of a digital mindset in future medical staff that they will see opportunities in techniques such as data science, machine learning, and deep learning.

The first limitation in this study is a low response rate amounting to 20.64% (303/1468). We used Google Forms to poll our students. This platform provides an easy and accessible way for participants to fill out forms. The downside was that it was impossible to make sure that people did not fill out the form multiple times. However, it seems unlikely that people filled out multiple forms. If duplicates had been filled out by certain individuals, this would change the demography of our sample. However, the demography of the participants matches the demography of our student population. Besides that, we checked the time stamps of all the forms to check if there were identical forms filled out in short succession. After checking time stamps and responses of each questionnaire, we found that there was no evidence that duplicate forms had been filled out.

Before we created the questionnaire, we looked for similar surveys, but we were not able to find any related to medical education. That is why we compiled our own questionnaire using the WHO definition for eHealth and recent literature. We took a pragmatic approach when creating our questionnaire, and the final questionnaire was not validated. All participants were from a single university in the Netherlands. This may limit the external validity of our results. During our research, we have noticed that there is a limited amount of literature about eHealth training for medical students and, therefore, we assume that most universities do not have a dedicated eHealth program. In this case, our results could inform other universities about the lack of eHealth training in their curriculum.

The previous statements saying that eHealth education is necessary were top-down statements. This paper adds the students’ views on eHealth and shows that students feel that they are not prepared to take advantage of the possibilities provided by eHealth. This paper shows that students want more education about eHealth topics.

This study demonstrates that students consider themselves insufficiently prepared for the digital aspect of their future medical practices and that they support greater attention to eHealth in the medical curriculum. This study indicates that the lack of eHealth education is not something that is experienced only by researchers who write about eHealth education but also by the medical students themselves.