This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on http://mededu.jmir.org/, as well as this copyright and license information must be included.
Experiential learning plays a critical role in learner development. Kolb’s 4-part experiential learning model consists of concrete experience, reflective observation, abstract conceptualization, and active experimentation in a recurring cycle. Most clinical environments provide opportunities for experiences and active experimentation but rarely offer structured means for reflection and abstract conceptualization that are crucial for learners to learn through experience. We created Learning Moment, a novel Web-based educational tool that integrates principles of asynchronous learning and learning portfolios to fulfill the reflection and abstract conceptualization aspects of Kolb’s learning cycle in the modern clinical learning environment. Medical students log concise clinical “pearls” in the form of “learning moments” for reflection, review, and sharing with peers in a community of practice.
We sought to evaluate learners’ experiences with Learning Moment via a qualitative study.
We employed purposive sampling to recruit medical students who used Learning Moment during their rotation. We conducted 13 semistructured interviews (10 individual interviews and one 3-person group interview) between January and March 2017 using an ethnographic approach and utilized a general inductive method to analyze and code for potential themes.
A total of 13 students (five in their third year of medical school and eight in their fourth year) voluntarily participated in our qualitative interviews. Five of the 13 (38%) students intended to pursue emergency medicine as their chosen field of specialty. The median number of “learning moments” logged by these students is 6. From our analysis, three key themes emerged relating to the perceived impact of Learning Moment on student learning: (1) logging “learning moments” enhanced memorization, (2) improved learning through reflection, and (3) sharing of knowledge and experiences in a community of practice.
Learning Moment was successfully implemented into the educational infrastructure in our department. Students identified three mechanisms by which the application optimizes experiential learning, including enabling the logging of “learning moments” to promote memorization, encouraging reflection to facilitate learning, and fostering the sharing of knowledge and experiences within a community of practice. The Learning Moment concept is potentially scalable to other departments, disciplines, and institutions as we seek to optimize experiential learning ecosystems for all trainees.
Experiential learning, which incorporates both reflection and practice, is critical for successful knowledge acquisition, educational growth, and the development of new skills and behaviors [
With widespread acceptance of experiential learning as a crucial component of medical education [
One such alternative is the use of asynchronous learning as a learner-centered method of teaching that uses online learning resources to overcome time and space constraints in order to facilitate information sharing and interaction among learners [
We developed and implemented an innovative educational tool, Learning Moment [
Learning Moment is a Web-based application through which learners can document and share personal learning experiences that occur in the course of patient care (
We developed the initial build of the Learning Moment electronic platform with two specific goals in mind:
To provide learners with an electronic “note-taking” tool to log their own learning experiences (
To create a searchable and shareable repository of useful, practical, high-yield educational content that benefits peers and colleagues through vicarious learning in the form of a “Community Feed” (
The complete description of the Learning Moment implementation process is described elsewhere [
Learning Moment interface.
Logging learning experiences in Learning Moment. CT: Computerized Tomography.
Learning Moment Community Feed. TPA:Tissue Plasminogen Activator.
A link to the Learning Moment website was made accessible directly from the electronic medical record system to promote ease of access. Experienced clinical faculty facilitated monthly in-person “Learning Moment Reflection” small group discussions with medical students as they reflected on and expounded on their own and peer “learning moments” with faculty guidance. We designed these discussions to complement the virtual features of Learning Moment to further encourage and fulfill the reflection and abstract conceptualization components of experiential learning.
A total of 323 “learning moments” were logged between August, 22, 2016 to Feb. 12, 2017, over the course of six 1-month-long clerkship rotations. Over three-quarters (42/53, 79.2%) of medical students who completed their emergency medicine clerkship rotation logged at least one “learning moment” with a median of six “learning moments” logged. The demographics of the medical student user cohort and frequency of logging “learning moments” are described previously [
We conducted a qualitative analysis of users’ experience of Learning Moment as a learning tool for undergraduate medical education. We employed purposive sampling to recruit medical students who used Learning Moment during their rotation. We sent email invitations with subsequent reminders to all students who rotated in our emergency medicine clerkship from August 2016 to February 2017 to participate in qualitative interviews, regardless of the extent to which they used the Learning Moment platform. Our interviews focused primarily on how medical students used Learning Moment throughout their emergency medicine rotation and how it impacted their learning. We coded the data inductively using the principles of grounded theory to generate a unified, theoretical explanation on how Learning Moment impacted the learning experience of medical students. Our Institutional Review Board approved our study as exempt.
We conducted 13 semistructured interviews, including 10 individual interviews and one 3-person group interview, between January and March 2017. We conducted seven interviews in person and six by telephone due to difficulty arranging face-to-face meetings. In-person interviews were conducted in medical school classrooms and departmental conference rooms. We conducted interviews until we reached thematic saturation as the last several interviews yielded no additional patterns or themes. A single researcher and coauthor (AC) conducted and audiotaped all interviews using the same interview guide (see
After each interview was completed, the researcher and coauthor (AC) who conducted the interviews transcribed the audio recording verbatim. We reviewed all transcribed interviews to ensure accuracy. For analysis, we employed standard qualitative research methods using the principles of grounded theory [
In total, 13 students (five in their third year of medical school and eight in their fourth year) of the 53 who rotated with us during the study period voluntarily participated in our qualitative interviews. Five of the 13 (38%) students intended to pursue emergency medicine as their chosen field of specialty. Detailed demographics of participants are shown in
The number of “learning moments” logged during their month-long emergency medicine rotation by each of the 13 students who participated in our qualitative interviews are shown in
The interview data provided a deeper understanding of learner views and experiences using Learning Moment. Three key themes relating to the impact of Learning Moment on student learning emerged from our analysis: (1) learners expressed that the act of logging of “learning moments” enhanced memorization, (2) learners attributed self-perceived improvement in learning to reflection, and (3) learners appreciated sharing knowledge and experiences in a community of practice.
Learners believed that the physical act of logging a “learning moment” facilitated memorization. Learners appreciated the platform to record information in an easily digestible format thus enabling future review and stimulating knowledge retention.
Demographics of participating medical students (N=13).
Characteristics | Participants, n (%) | |
Third year of medical school | 5 (38) | |
Fourth year of medical school | 8 (62) | |
Female | 11 (85) | |
Male | 2 (15) | |
Emergency Medicine | 5 (38) | |
Other or unsure | 8 (62) |
Number of “learning moments” logged during their month-long emergency medicine rotation by each student who participated in our qualitative interviews.
Student | “Learning moments” logged, n |
1 | 3 |
2 | 13 |
3 | 6 |
4 | 2 |
5 | 14 |
6 | 8 |
7 | 9 |
8 | 2 |
9 | 4 |
10 | 6 |
11 | 5 |
12 | 9 |
13 | 22 |
If I don’t write them down or type them out, then I don’t remember. I like to have them logged in somewhere so, one day, when I review them, I’m like “Oh yeah, I remember learning about that,” and that solidifies what I learned on my rotation.
The thing I took from it the most was the reinforcement of my own learning. Usually you hear clinical pearls from attendings or residents, and you can think about it for that moment. But then you might forget it later on...actually being able to type it down in this database really reinforces that information that you just learned. And then, I think because of that, I was able to retain this information much better.
Not only was the act of typing out “learning moments” viewed as helpful for memorization, but students also commented that recording these “pearls” and thus building their learning portfolios was an effective method to capture, easily organize, and review this information. Students noted that when documenting new learning “pearls” they often looked back and reviewed previously recorded “pearls,” thus refreshing their memory of those previous learning experiences:
You also have the ones you wrote down in the past, so it all kind of jogs your memory. I think it’s a memory tool that lets you quantify some kind of learning that you had every day for every shift.
Later on, it helped me remind me of things I had learned, and that I might have forgotten I have, so it was nice to have that refresher. Because the ones I input are the ones that I remember best.
Learners reported that the often chaotic and frenetic pace of a busy emergency department made it difficult to synthesize and reflect on learning experiences. Learners articulated that Learning Moment provided an intentional and deliberate moment to pause and reflect on the learning that occurred that day and allowed them to think about how to apply it in the future. Through this process, learners recounted more opportunities to reinforce the learning that does occur.
So, I think that being in the emergency room is a very unique setting. So, when you’re in the emergency department as a student, things are very fast-paced...I think in those really quick moments, there are moments of learning and teaching that’s happening that might not otherwise be apparent. So even though you're working in a fast-paced learning environment...the program really helped me to reflect in that way to synthesize...after a really busy 8-hour shift.
The one good thing that it did was that it forced me to stop after every shift...to think about what they actually learned. Because it’s so easy to pop in for eight hours, go in, do your thing, and then leave...not really reflect back on what had happened that day. Because the emergency room is pretty busy, so being able to stop and think about what had happened...that retrospective approach was one of the benefits that LM [Learning Moment] offered.
Most useful was the reflecting. You know, because in a shift, you see a whole bunch of patients. So, reflecting on: was there anything new or different about one of those patients who came in, so that we can think about that patient in the future when other patients come in.
So, I think that the main purpose of it is to give you a chance to step back from the action-packed environment of the emergency department to give you a pointed purpose and opportunity to think beyond what’s going on right now.
Learners believed that the sharing of learning “pearls” facilitated knowledge transfer within a community of practice. Learned enjoyed reviewing the Learning Moment “Community Feed” to learn from the “pearls” and experiences of their peers. Learners appreciated that every “learning moment” recorded was highly applicable in the clinical setting and might not be taught in traditional sources, such as textbooks. Learners frequently referenced that sharing their learning experiences benefited everyone within the community of practice and that Learning Moment encouraged “an environment of teaching” [Student 12].
But also, be able to tap into clinical pearls that other people in the department are gathering. Sort of like collect all that information in one space so you can have like a high yield bank of pearls and things that’ll help you on the floor...And so it is really nice that I could type in a keyword and get all of these clinical pearls, both my own and other people’s. And I liked the fact that we could learn from other people’s pearls.
And skimming through other people’s “learning moments” was also useful and interesting. One of the benefits of using LM.
I think the purpose of the LM was to encourage an environment of teaching. So not only was it to have students and residents reflect on things that they learned during their shift...also to encourage attendings and more senior providers to teach more and provide those learning moments for students on shift. I think that was encouraged, so that aspect of the program was pretty cool.
Learner experiences using Learning Moment were impacted by the level of involvement by others from the ground up. While the current iteration of Learning Moment is focused on medical students in a single emergency medicine clerkship rotation, increasing participation and support from residents and faculty as well as adapting Learning Moment to other rotations are potential future directions as suggested by our learners.
I think the thing with LM is that you need a lot of buy-in for it to be good...if I were using that on every single rotation, or if it were in my residency and everyone in my residency was using it...I would totally use it, because I think it’s a good tool. If everybody’s using it or is using it consistently throughout the year, I would totally use it.
I think if it was part of the curriculum where I was, it would be useful. I don’t think if I was just doing it my own thing that I would use it. If it wasn’t a part of my residency, I don’t know that I would use it.
Incorporating into the culture of the residency. I remember when I was rotating through, somebody brought up LM during our weekly conference and was like, “Oh look at all these learning moments,” and clearly, someone was looking at it, and someone shared different learning moments, and that would be encouraging more people to participate. Whereas if it was something that wasn’t utilized, if I was the only one doing it, then it would be a little harder to incorporate into my daily tasks.
While there is literature supporting the need for educators to design continuing medical education curriculums that transition learners through each stage in sequence of the Kolb experiential learning cycle in order to promote the application of all learning styles [
To explicitly address these gaps, we sought to integrate the concepts of asynchronous learning and learning portfolios, while leveraging technology, to fulfill aspects of Kolb’s learning cycle that are often absent in the clinical learning environment, specifically reflection and abstract conceptualization. According to Kolb, learning is an active, collaborative, and interactive process “whereby knowledge is created through the transformation of experience” [
Furthermore, our data suggest that the Learning Moment platform encourages group learning through sharing of knowledge and experiences within a community of practice. Learning Moment creates a shareable repository of knowledge that benefits the community of practice through vicarious learning [
Terms like learning management system, course management system, and virtual learning environment have been used somewhat interchangeably to describe integrated suites of tools used in e-learning such as Blackboard [
Our study has several important limitations. The sample size was small with only 13 voluntary interview participants. Logistic restrictions from rigorous schedules of medical students, many of whom were from out of state, doing rotations away, or traveling while interviewing for residency positions during the study period significantly limited our efforts to conduct more interviews. As a result, we performed one 3-person group interview in order to accommodate participant schedules. Despite a relatively small sample size, we reached thematic saturation. Learners who self-selected to participate in the study may have strong positive or negative views towards Learning Moment, thus subjecting our results to participation bias. Although in our recruiting email describing the voluntary nature of participation, we stressed that participation would not affect their grade or ranking for residency application in any way, participants may have been motivated to report positive experiences with Learning Moment, thus biasing our results. In addition, our study did not include a control arm. Since we sought to evaluate learners’ experiences with Learning Moment, interviewing learners who did not use Learning Moment was not part of our initial study design. However, exploring reasons behind why some learners did not use Learning Moment despite its availability during the rotation would have been a worthy venture. Last, our results reflect learner perceived impact of Learning Moment on their learning. We cannot comment on specific learning outcomes as we did not measure knowledge acquisition, retention, or change in practice, specifically. Nevertheless, our study was the first of its kind to explore learner experiences regarding their use of our innovative experiential learning platform.
We successfully implemented Learning Moment into the educational infrastructure of our department. Student users identified three mechanisms by which the application was perceived to optimize experiential learning, including enabling the logging of “learning moments” to promote memorization and retention, encouraging reflection to facilitate learning, and fostering sharing of knowledge within a community of practice. While currently institution-based, further research addressing refinements to and enhancements of the tool, as well as potential adoption of the Learning Moment model to new learning environments, potentially as an open-access platform, is warranted as we seek to optimize experiential learning ecosystems for all trainees.
Interview guide.
Learning Moment
The authors humbly acknowledge the Boston University Digital Learning Initiative for providing generous funding to the Learning Moment project. The authors also acknowledge the talented and dedicated Web designers at Vermonster LLC for developing the Learning Moment initial build.
Three of the authors (AYS, RS, JIS) were directly involved in designing and building the Learning Moment platform. However, those who conducted the semistructured interviews, qualitative data collection, and analysis (AC, DB, MLD) did not participate in the development of Learning Moment.