<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "journalpublishing.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="2.0" xml:lang="en" article-type="research-article"><front><journal-meta><journal-id journal-id-type="nlm-ta">JMIR Med Educ</journal-id><journal-id journal-id-type="publisher-id">mededu</journal-id><journal-id journal-id-type="index">20</journal-id><journal-title>JMIR Medical Education</journal-title><abbrev-journal-title>JMIR Med Educ</abbrev-journal-title><issn pub-type="epub">2369-3762</issn></journal-meta><article-meta><article-id pub-id-type="publisher-id">54507</article-id><article-id pub-id-type="doi">10.2196/54507</article-id><title-group><article-title>Evidence-Based Learning Strategies in Medicine Using AI</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes" equal-contrib="yes"><name name-style="western"><surname>Arango-Ibanez</surname><given-names>Juan Pablo</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff1">1</xref><xref ref-type="fn" rid="equal-contrib1">*</xref></contrib><contrib contrib-type="author" equal-contrib="yes"><name name-style="western"><surname>Posso-Nu&#x00F1;ez</surname><given-names>Jose Alejandro</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff1">1</xref><xref ref-type="fn" rid="equal-contrib1">*</xref></contrib><contrib contrib-type="author" equal-contrib="yes"><name name-style="western"><surname>D&#x00ED;az-Sol&#x00F3;rzano</surname><given-names>Juan Pablo</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff1">1</xref><xref ref-type="fn" rid="equal-contrib1">*</xref></contrib><contrib contrib-type="author"><name name-style="western"><surname>Cruz-Su&#x00E1;rez</surname><given-names>Gustavo</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff2">2</xref><xref ref-type="aff" rid="aff3">3</xref></contrib></contrib-group><aff id="aff1"><institution>Centro de Investigaciones Cl&#x00ED;nicas, Fundaci&#x00F3;n Valle del Lili</institution>, <addr-line>Cali</addr-line>, <country>Colombia</country></aff><aff id="aff2"><institution>Departamento de Anestesiolog&#x00ED;a, Fundaci&#x00F3;n Valle del Lili</institution>, <addr-line>Cali</addr-line>, <country>Colombia</country></aff><aff id="aff3"><institution>Unidad de Inteligencia Artificial, Fundaci&#x00F3;n Valle del Lili</institution>, <addr-line>Cali</addr-line>, <country>Colombia</country></aff><contrib-group><contrib contrib-type="editor"><name name-style="western"><surname>Eysenbach</surname><given-names>Gunther</given-names></name></contrib></contrib-group><contrib-group><contrib contrib-type="reviewer"><name name-style="western"><surname>Jantschi</surname><given-names>Lorentz</given-names></name></contrib><contrib contrib-type="reviewer"><name name-style="western"><surname>Ganesh</surname><given-names>Shankar</given-names></name></contrib></contrib-group><author-notes><corresp>Correspondence to Juan Pablo Arango-Ibanez, MD<email>juan.arango.ib@fvl.org.co</email></corresp><fn fn-type="equal" id="equal-contrib1"><label>*</label><p>these authors contributed equally</p></fn></author-notes><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>24</day><month>5</month><year>2024</year></pub-date><volume>10</volume><elocation-id>e54507</elocation-id><history><date date-type="received"><day>12</day><month>11</month><year>2023</year></date><date date-type="rev-recd"><day>20</day><month>01</month><year>2024</year></date><date date-type="accepted"><day>23</day><month>03</month><year>2024</year></date></history><copyright-statement>&#x00A9; Juan Pablo Arango-Ibanez, Jose Alejandro Posso-Nu&#x00F1;ez, Juan Pablo D&#x00ED;az-Sol&#x00F3;rzano, Gustavo Cruz-Su&#x00E1;rez. Originally published in JMIR Medical Education (<ext-link ext-link-type="uri" xlink:href="https://mededu.jmir.org">https://mededu.jmir.org</ext-link>), 24.5.2024. </copyright-statement><copyright-year>2024</copyright-year><license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on <ext-link ext-link-type="uri" xlink:href="https://mededu.jmir.org/">https://mededu.jmir.org/</ext-link>, as well as this copyright and license information must be included.</p></license><self-uri xlink:type="simple" xlink:href="https://mededu.jmir.org/2024/1/e54507"/><abstract><p>Large language models (LLMs), like ChatGPT, are transforming the landscape of medical education. They offer a vast range of applications, such as tutoring (personalized learning), patient simulation, generation of examination questions, and streamlined access to information. The rapid advancement of medical knowledge and the need for personalized learning underscore the relevance and timeliness of exploring innovative strategies for integrating artificial intelligence (AI) into medical education. In this paper, we propose coupling evidence-based learning strategies, such as active recall and memory cues, with AI to optimize learning. These strategies include the generation of tests, mnemonics, and visual cues.</p></abstract><kwd-group><kwd>artificial intelligence</kwd><kwd>large language models</kwd><kwd>ChatGPT</kwd><kwd>active recall</kwd><kwd>memory cues</kwd><kwd>LLMs</kwd><kwd>evidence-based</kwd><kwd>learning strategy</kwd><kwd>medicine</kwd><kwd>AI</kwd><kwd>medical education</kwd><kwd>knowledge</kwd><kwd>relevance</kwd></kwd-group></article-meta></front><body><sec id="s1" sec-type="intro"><title>Introduction</title><p>e-Learning has revolutionized the way medicine is taught and learned through the use of different internet-based technologies that enhance education [<xref ref-type="bibr" rid="ref1">1</xref>]. Among these technologies, artificial intelligence (AI) tools, especially large language models (LLMs), have notably garnered significant attention in recent years, given their promising implications for medical education. LLMs are algorithmic models that are trained by extensive data sets, and they have the capability to comprehend text and generate natural-language text in response to a given prompt (input). This allows for interactive engagement with these technologies in a conversational format akin to a &#x201C;chat&#x201D; [<xref ref-type="bibr" rid="ref2">2</xref>,<xref ref-type="bibr" rid="ref3">3</xref>]. One of the most known LLMs is ChatGPT (owned by OpenAI), and its latest version, ChatGPT-4, was recently released to the public.</p><p>Recent studies have demonstrated the great achievements of LLMs in relation to medical knowledge and reasoning, such as ChatGPT-4 scoring 90% when answering USMLE (United States Medical Licensing Examination)&#x2013;type questions [<xref ref-type="bibr" rid="ref4">4</xref>], ChatGPT-4 passing a neurosurgery written board examination [<xref ref-type="bibr" rid="ref5">5</xref>], and ChatGPT outperforming physicians in terms of providing empathic responses [<xref ref-type="bibr" rid="ref6">6</xref>]. The educational potential of this technology is immense, encompassing a wide variety of applications. These include but are not limited to tutoring (personalized learning), patient simulation, generation of examination questions, and streamlined access to information [<xref ref-type="bibr" rid="ref7">7</xref>-<xref ref-type="bibr" rid="ref9">9</xref>]. The revolutionary potential of LLMs has resulted in researchers and medical students exploring the integration of AI into medical school curricula [<xref ref-type="bibr" rid="ref10">10</xref>,<xref ref-type="bibr" rid="ref11">11</xref>]. The rapid advancement of medical knowledge and the need for personalized learning underscore the relevance and timeliness of exploring innovative strategies for integrating AI into medical education [<xref ref-type="bibr" rid="ref12">12</xref>].</p><p>Although numerous publications have examined the implications of LLMs for medicine and medical education, few have explored, in detail, specific strategies whereby LLMs can be used to optimize learning. In this paper, we propose strategies based on active recall, mnemonics, and the use of ChatGPT-4 [<xref ref-type="bibr" rid="ref13">13</xref>] and DALL&#x00B7;E 3 (through ChatGPT-4) for enhancing learning outcomes regarding factual knowledge and thus help fill this gap of information. These strategies include the creation of pretests and posttest quizzes, the development of mnemonics, and the use of visual cues and mnemonics. Pretests and posttests serve as effective tools for active recall&#x2014;a proven method for improving memory retention. Mnemonics simplify complex information into more digestible and memorable formats. Visual cues provide a graphical representation of information, aiding in better understanding and recall.</p></sec><sec id="s2"><title>Active Recall&#x2013;Based Strategies</title><p>Medical school requires a significant amount of time spent on reading. Research indicates that medical students typically dedicate an average of 1.5 to 6 hours per day to reading [<xref ref-type="bibr" rid="ref14">14</xref>,<xref ref-type="bibr" rid="ref15">15</xref>]. Moreover, teacher-centered lectures, which predominantly focus on passive learning, persist as one of the most used strategies despite challenges in the medical education community with regard to encouraging integration with active learning methods that enhance the retention and application of knowledge [<xref ref-type="bibr" rid="ref16">16</xref>-<xref ref-type="bibr" rid="ref18">18</xref>]. This may be because medical school students might prefer classic didactic lectures over demonstrations, small group discussions, feedback activities, group work (generating test questions and coming up with solutions to a problem), and other active learning methods that have been reported to better enhance memory and retention [<xref ref-type="bibr" rid="ref19">19</xref>].</p><p>It is essential to adopt evidence-based strategies to enhance learning efficiency, especially considering the substantial academic workload and the ongoing reliance on passive learning methods. One such strategy is active recall, which involves actively retrieving information that was initially acquired passively through lectures, articles, or videos. This strategy is known to enhance learning significantly in comparison with passive learning strategies [<xref ref-type="bibr" rid="ref20">20</xref>,<xref ref-type="bibr" rid="ref21">21</xref>]. In this context, it is beneficial for readers to approach their reading proactively. This can be achieved by prefacing their reading with self-directed inquiries, understanding the main topics of the material, consistently formulating questions, and recognizing key concepts of high significance. Some related techniques include elaborative interrogation, which consists of answering &#x201C;why&#x201D; questions about a given concept to enhance medium- to long-term associative memory; self-explanation to relate new information to known information or explain steps taken for solving a problem to improve memory, comprehension, and transfer; and practice testing, which can improve memory, is not as time consuming, and can be applied at different times of the learning process [<xref ref-type="bibr" rid="ref20">20</xref>].</p><p>One application of an active recall&#x2013;based strategy involving the use of AI is illustrated in <xref ref-type="fig" rid="figure1">Figure 1</xref>, which shows ChatGPT being instructed to generate questions about cellulitis, as an example. Students are encouraged to attempt such questions before starting lectures or reading text. Answering questions before attending a lecture or reading a text (pretesting) is a strategy that enhances the learning process [<xref ref-type="bibr" rid="ref22">22</xref>]. Interestingly, making mistakes during the study process can enhance learning by improving later memory; generating correct feedback; facilitating active learning; and stimulating the learner to redirect attention appropriately, especially when a mistake is followed by corrective feedback [<xref ref-type="bibr" rid="ref23">23</xref>,<xref ref-type="bibr" rid="ref24">24</xref>].</p><fig position="float" id="figure1"><label>Figure 1.</label><caption><p>Example of the use of ChatGPT for pretesting.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig01.png"/></fig><p>Taking tests has been proven to enhance learning in various studies [<xref ref-type="bibr" rid="ref25">25</xref>-<xref ref-type="bibr" rid="ref28">28</xref>]. Repeated test-taking increases the transfer of learning [<xref ref-type="bibr" rid="ref25">25</xref>] and improves long-term recall [<xref ref-type="bibr" rid="ref28">28</xref>], and it even outperformed concept mapping for long-term retention in a previous study [<xref ref-type="bibr" rid="ref26">26</xref>]. This strategy can be integrated with AI, as shown in <xref ref-type="fig" rid="figure2">Figure 2</xref>, which depicts our attempt to extract information from a <italic>StatPearls</italic> article on cellulitis [<xref ref-type="bibr" rid="ref29">29</xref>] and request ChatGPT to generate relevant questions. The AI system can produce various question formats, such as multiple-choice, true-false, and fill-in-the-blank questions, when given the appropriate prompts. These questions may be stored and reviewed days or weeks after the initial review to successfully apply spaced repetition, which has been demonstrated to improve learning and the consolidation of knowledge [<xref ref-type="bibr" rid="ref21">21</xref>].</p><p>By using this method, one can input answers to questions and prompt ChatGPT to evaluate the answers&#x2019; accuracy against the provided text. For instance, using questions from <xref ref-type="fig" rid="figure2">Figure 2</xref>, we tested ChatGPT&#x2019;s response by answering a query about common causative bacteria of cellulitis. We intentionally incorporated broad, correct concepts (gram-positive bacteria) and specific yet erroneous details (emphasizing staphylococci, particularly <italic>Staphylococcus aureus</italic>, as primary causatives instead of the correct streptococci) (<xref ref-type="fig" rid="figure3">Figure 3</xref>). ChatGPT feedback was tested again to contrast it with the feedback on a completely wrong answer (<xref ref-type="fig" rid="figure4">Figure 4</xref>).</p><fig position="float" id="figure2"><label>Figure 2.</label><caption><p>Example of the use of ChatGPT for creating a posttest.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig02.png"/></fig><fig position="float" id="figure3"><label>Figure 3.</label><caption><p>Feedback from ChatGPT on a partially correct answer to a question provided by ChatGPT.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig03.png"/></fig><fig position="float" id="figure4"><label>Figure 4.</label><caption><p>Feedback from ChatGPT on a wrong answer to a question provided by ChatGPT.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig04.png"/></fig></sec><sec id="s3"><title>Memory Cues</title><p>Memory cues are learning strategies in which a process of metacognition transforms information in a way that makes the information easier to recall or understand. Cues can be self-generated or generated by external agents, other people, or AI. Evidence has long suggested that self-generated cues are superior to cues generated by other people [<xref ref-type="bibr" rid="ref30">30</xref>,<xref ref-type="bibr" rid="ref31">31</xref>]. Nonetheless, there is available evidence that indicates that memory cues generated by others can still enhance recall [<xref ref-type="bibr" rid="ref32">32</xref>].</p><p>Memory cues are effective because they make difficult-to-remember information into something simpler or meaningful, which facilitates recall [<xref ref-type="bibr" rid="ref32">32</xref>,<xref ref-type="bibr" rid="ref33">33</xref>]. For example, a classic memory cue in medical school for remembering descriptors of pain is the use of the mnemonic &#x201C;SOCRATES&#x201D; (site, onset, character, radiation, associations, time course, exacerbating factors, and severity). In this context, the name of the great philosopher is repurposed to recall how to properly assess pain in a patient, with the name becoming an acronym. In a recent meta-analysis, a statistically significant effect was found for cueing decreasing the learners&#x2019; perceived cognitive load and promoting learning outcomes, namely retention, and the transfer of knowledge [<xref ref-type="bibr" rid="ref34">34</xref>].</p><p>Other modalities of memory cues that are commonly used include pictures, short stories, songs, and rhymes [<xref ref-type="bibr" rid="ref32">32</xref>]. Evidence indicates conflicting conclusions regarding the superiority of a specific modality of cues over another. For instance, in a study conducted by Pearson and Wilbiks [<xref ref-type="bibr" rid="ref35">35</xref>], the authors attempted to evaluate the effect of the number of self-generated memory cues and aimed to test the findings of previous research that showed that the use of multisensory memory cues (ie, audiovisual cues) had a greater effect on recall than the use of one modality (ie, either visual cues [written words] or auditory cues [spoken words]). Their findings were that a greater number of cues led to higher recall, with statistical significance, but the modality of the cues did not have an effect on recall.</p><p>As previously indicated, one way to enhance the creation of an effective mnemonic is by using a common word as a cue to recall information [<xref ref-type="bibr" rid="ref33">33</xref>]. This is one of the various ways that learners attempt to encode new vocabulary, abstract concepts, and master knowledge.</p><p><xref ref-type="fig" rid="figure5">Figure 5</xref> is an example of ChatGPT generating a mnemonic, using the word &#x201C;brains&#x201D; to recall the absolute contraindications of thrombolysis. Other examples are shown in <xref ref-type="fig" rid="figure6">Figure 6</xref>, in which ChatGPT creates a short story, and in <xref ref-type="fig" rid="figure7">Figure 7</xref>, in which ChatGPT creates a poem.</p><fig position="float" id="figure5"><label>Figure 5.</label><caption><p>Acronym created by ChatGPT.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig05.png"/></fig><fig position="float" id="figure6"><label>Figure 6.</label><caption><p>Short story created by ChatGPT.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig06.png"/></fig><fig position="float" id="figure7"><label>Figure 7.</label><caption><p>Poem created by ChatGPT.</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig07.png"/></fig></sec><sec id="s4"><title>Visual Mnemonics</title><p>A visual mnemonic or cue is a tool that uses visual imagery to improve the recall of information. This differs from verbal mnemonics, which use words, phrases, or songs, as visual mnemonics use pictorial cues to forge memorable links. Their effectiveness stems from the incorporation of visual representations, analogies, or symbolism, which fortifies the associations and makes them more distinct. Visual mnemonics aid in recalling abstract or intricate information and facilitate both the sequential and the immediate retrieval of memorized material [<xref ref-type="bibr" rid="ref36">36</xref>,<xref ref-type="bibr" rid="ref37">37</xref>]. The use of mnemonics can be highly useful for learning difficult or abstract information [<xref ref-type="bibr" rid="ref30">30</xref>], which is often found in the field of medicine [<xref ref-type="bibr" rid="ref38">38</xref>]. Multiple studies have demonstrated that using visual or pictorial mnemonics can enhance learning outcomes [<xref ref-type="bibr" rid="ref35">35</xref>,<xref ref-type="bibr" rid="ref39">39</xref>].</p><p>DALL&#x00B7;E 3 is an AI system created by OpenAI that generates images based on prompts provided by the user and can be used for the creation of visual mnemonics. An example is given in <xref ref-type="fig" rid="figure8">Figure 8</xref>; a prompt was given to DALL&#x00B7;E 3 to create an image. For this example, which we created via DALL&#x00B7;E 3, the prompt &#x201C;Fat purple man with long hair falling into a trap in a dry desert&#x201D; was used to help recall some important features of hairy cell leukemia. &#x201C;Fat&#x201D; was used to recall the massive splenomegaly seen in patients with this condition; &#x201C;purple&#x201D; was used to make an association with lymphocytes, which are commonly seen as purple cells via hematoxylin and eosin staining and are involved in the pathogenesis of this neoplasm; &#x201C;long hair&#x201D; helps with recalling the filamentous projections of cells in hairy cell leukemia; &#x201C;trap&#x201D; was used to remember that this disease stains positively in tartrate-resistant acid phosphatase staining; and &#x201C;dry desert&#x201D; was used to recall that bone marrow fibrosis leads to dry tap on aspiration.</p><fig position="float" id="figure8"><label>Figure 8.</label><caption><p>DALL&#x00B7;E 3 creation with the prompt &#x201C;Fat purple man with long hair falling into a trap in a dry desert.&#x201D;</p></caption><graphic alt-version="no" mimetype="image" position="float" xlink:type="simple" xlink:href="mededu_v10i1e54507_fig08.png"/></fig></sec><sec id="s5" sec-type="discussion"><title>Discussion</title><sec id="s5-1"><title>Active Recall</title><p>Active recall is a highly effective learning strategy and significantly outperforms passive restudying when it comes to certain learning outcomes, such as conceptualization and long-term retention [<xref ref-type="bibr" rid="ref21">21</xref>]. It has yielded better evaluation testing performance than traditional studying or rereading. Kornell et al [<xref ref-type="bibr" rid="ref22">22</xref>] reviewed recall when participants were presented with fictional and nonfictional information, modifying the time for pretesting and read-only strategies. The testing strategy yielded a greater amount of correct answers than the read-only strategy, with statistical significance when equal or more time was allocated to the testing condition when the final test was performed more than 24 hours after the learning exercise, as well as in the fictional topic scenarios (<italic>P</italic>&#x003C;.01). Other studies supporting the use of pretesting have been reported [<xref ref-type="bibr" rid="ref22">22</xref>,<xref ref-type="bibr" rid="ref40">40</xref>,<xref ref-type="bibr" rid="ref41">41</xref>]. This highlights the role of pretesting in learning new information.</p><p>The benefits of active learning through testing have also been supported by other authors. Butler [<xref ref-type="bibr" rid="ref25">25</xref>] tested students&#x2019; recall ability when they were either passively restudying or studying via repeated testing. Butler [<xref ref-type="bibr" rid="ref25">25</xref>] found that repeated testing resulted in better performance on a recall test than passive learning strategies and concluded that repeated test-taking increases the transfer of learning. In another study performed by Karpicke and Blunt [<xref ref-type="bibr" rid="ref26">26</xref>], when retrieval practice (testing) was evaluated against passive learning strategies and even concept mapping, it proved to be better for verbatim and inference question answering, resulting in an improvement of about 50% in long-term retention scores (<italic>d</italic>=1.50; <italic>F</italic><sub>1,38</sub>=21.63; &#x03B7;<sub>p</sub><sup>2</sup>=0.36). Additionally, the superiority of retesting over passive restudying for long-term retention has even been proven in a randomized controlled trial, wherein pediatric and emergency medicine residents were randomized to study the same text passages either via testing or repeated studying (ie, rereading). They were then tested on day 1, week 2, week 4, and month 6. The test results showed that the scores of participants who studied via testing were, on average, 13% higher than the scores of participants who performed repeated studying (<italic>P</italic>&#x003C;.001), with an effect size of 0.91 [<xref ref-type="bibr" rid="ref28">28</xref>]. Spaced testing (taking tests on different days between study sessions) has an even better effect on retention, long-term memory, and evaluation performance than repeated test-taking [<xref ref-type="bibr" rid="ref27">27</xref>]. On the other hand, research indicates that spaced repetition (regardless of whether studying is done actively or passively) promotes more efficient and effective learning [<xref ref-type="bibr" rid="ref42">42</xref>].</p><p>The previously mentioned studies highlight the importance of leveraging evidence-based techniques for studying rather than passive learning strategies. As we exemplified, these strategies can be coupled with AI. This approach addresses the limitation of relying solely on teacher-provided tests or textbook tests [<xref ref-type="bibr" rid="ref20">20</xref>]. Moreover, ChatGPT is available on different platforms (web application and mobile app), and it can save chats (interactions) across these platforms. Therefore, students can easily access ChatGPT wherever it is needed and space their study sessions. Further, self-testing with AI reduces the pressure of graded assessments and leverages errors as learning opportunities [<xref ref-type="bibr" rid="ref23">23</xref>,<xref ref-type="bibr" rid="ref24">24</xref>], which research has shown to be particularly effective when the learner is confident in their incorrect answers [<xref ref-type="bibr" rid="ref23">23</xref>]. This could be related to the effect of feedback.</p><p>Several articles on active recall and learning emphasize the role of feedback in enhancing learning processes, which is a characteristic that passive studying lacks. Roediger and Butler [<xref ref-type="bibr" rid="ref27">27</xref>] compared traditional studying with test-taking studying without feedback and test-taking studying with differently timed feedback to determine whether test-taking studying results in better retention and whether retention is enhanced by feedback. They tested participants at different times and highlighted the efficiency of test-taking as a studying strategy, which was superior to that of traditional reading and restudying (22%, 32%, and up to a 43% difference between traditional studying and test-taking studying without feedback, test-taking studying with immediate feedback, and test-taking studying with delayed feedback, respectively). Since feedback has a clear impact on learning, especially when coupled with active recall strategies, non&#x2013;AI-mediated active learning strategies could be limited by the lack of opportunities to offer feedback. Feedback generally comes from a reliable source, such as a teacher or an expert, or is obtained through an appropriate literature search, which can be time consuming. Sometimes, it is not possible to have the timely intervention of a teacher or an expert if there is a lot to study, and it may not be possible for a student to conduct a proper literature search if the student is new to a given topic. Furthermore, there are different types of feedback; some feedback is self-directed (ie, obtained through an introspective process). Feedback in the learning process can be used to enhance or develop skills for setting goals, monitoring one&#x2019;s own learning process, and assimilating input (feedback) toward enhancing performance [<xref ref-type="bibr" rid="ref43">43</xref>]. All of these are important skills to have when one attempts to obtain feedback on their own, such as when using LLMs for feedback.</p><p>AI can enhance medical education by offering feedback and explanations to clarify incorrect responses, thereby increasing study efficiency. By using AI tools like ChatGPT, students can receive detailed feedback on their answers, including the identification of errors and the provision of correct information, as we have shown. ChatGPT presents promising implications in providing technically accurate medical feedback, given the exceptional knowledge it has exhibited, as we previously described. This process, however, should not replace thorough literature research or foundational knowledge acquisition. AI models can also serve as tutors to facilitate discussions on specific knowledge areas, similar to existing models in other fields, such as Khan Academy&#x2019;s Khanmigo, which serves as a fully personalized tutor [<xref ref-type="bibr" rid="ref44">44</xref>]. One limitation of AI systems like ChatGPT is their character limit for inputs, which can be managed by breaking text into sections or using multiple prompts. Additionally, web searching is only available with ChatGPT&#x2019;s paid subscription; for the free version, one should provide ChatGPT with the reference text by copying and pasting it. Further research is needed to explore the potential of AI-assisted tutors in medical education, especially in education on basic subjects.</p></sec><sec id="s5-2"><title>Memory Cues</title><p>Memory cues can be used as effective learning tools that ease the studying experience for a student attempting not only memorization but also mastery of complex concepts and new vocabulary. Evidence has described the superiority of self-generated memory cues over cues created by others [<xref ref-type="bibr" rid="ref30">30</xref>,<xref ref-type="bibr" rid="ref31">31</xref>]. The explanations behind the superiority of self-generated memory cues are (1) the generation effect of creating such cues, that is, the act of generation requires significant cognitive effort, which boosts memory, and (2) the cue selection process itself and the consequential metamnemonic effect. This means that students who identify the learning formats that work best for them are able to create their own memory cues by using a modality that is tailored to their needs [<xref ref-type="bibr" rid="ref31">31</xref>]. For example, if a student prefers to have a visual representation of the ideas that they are attempting to memorize, they might lean toward the creation of mnemonics that create a mental picture to integrate information. Tullis and Fraundorf [<xref ref-type="bibr" rid="ref31">31</xref>] proposed evidence that the benefits of self-generated cues come in great part from the correct selection of a cue from a list of candidates. If students can create multiple cues, they can, with greater effectiveness, select the cue that best benefits retrieval. Tullis and Fraundorf [<xref ref-type="bibr" rid="ref31">31</xref>] further suggested that allowing a learner to select from multiple options of cues requires less cognitive work, takes less time, and may not hinder memorization.</p><p>As we described, the act of generation is effortful and may be time consuming. AI tools like ChatGPT can help students as a result of their seemingly tireless and effortless generative capacity. In addition, these tools can create multiple cues with different modalities (textual-based cues and pictorial cues) when prompted to do so, thereby allowing learners to focus on understanding the material and selecting the most appropriate cue that fits their educational needs. The downside to the use of this method is that multiple attempts may be required for ChatGPT to produce a mnemonic that is subjectively good or fitting enough for a particular student. In addition, it is our opinion that these tools are best used when the user has an idea of what they should learn or memorize, and the user should prompt the AI tool to create a mnemonic device that facilitates the recall of the information they wish to encode. This is because there is abundant evidence of ChatGPT not only making errors but also blatantly providing false information [<xref ref-type="bibr" rid="ref45">45</xref>], which is known as &#x201C;artificial hallucination.&#x201D;</p></sec><sec id="s5-3"><title>Visual Mnemonics</title><p>Previous research has explored the effectiveness of visual mnemonics in improving learning outcomes. An experimental study that compared pictorial mnemonic use to traditional study methods found that pictorial mnemonics aid in learning from text passages by improving the recall of factual knowledge and long-term memory retention in college students [<xref ref-type="bibr" rid="ref46">46</xref>]. Additionally, a randomized trial compared audiovisual mnemonics against traditional text-based learning for retaining medical knowledge; participants who used mnemonics demonstrated significant improvements in free-recall tests, with scores improving by 65%, 161%, and 208% immediately, after 1 week, and after 1 month, respectively, when compared to those who used text materials (<italic>P</italic>&#x003C;.001). Moreover, the group that used mnemonics outperformed the group that used text materials by 55% in a 1-week&#x2013;delayed multiple-choice test that focused on higher-order thinking (<italic>P</italic>&#x003C;.001) [<xref ref-type="bibr" rid="ref47">47</xref>]. In a comparative study of visual mnemonics versus traditional lectures for learning the porphyrin pathway, there was no significant difference in quiz scores immediately or 1 week after the intervention; however, the mnemonic group exhibited a 20% higher score 3 weeks later (<italic>P</italic>=.02) [<xref ref-type="bibr" rid="ref48">48</xref>]. In another randomized trial that compared story-based audiovisual mnemonics with traditional text reading for memory retention among medical students, the audiovisual mnemonics group demonstrated significantly better performance in multiple-choice tests immediately after the intervention (<italic>P</italic>=.04), as well as at 1 week, 2 weeks, and 4 weeks after the intervention [<xref ref-type="bibr" rid="ref49">49</xref>]. These results underscore story-based mnemonics&#x2019; superior effectiveness in enhancing immediate and long-term memory retention in medical education. Although there is some variation in the visual mnemonic techniques across studies (eg, the studies by Yang et al [<xref ref-type="bibr" rid="ref47">47</xref>] and Abdalla et al [<xref ref-type="bibr" rid="ref49">49</xref>] used some audiovisual mnemonics), they consistently demonstrated that factual knowledge can be represented visually and that the use of this type of mnemonic enhances both the recall and long-term retention of knowledge, with large effect sizes.</p><p>The visual mnemonic proposed in our study highly resembles the strategy used in the experiment by Rummel et al [<xref ref-type="bibr" rid="ref46">46</xref>], in which visual mnemonics were created from texts about psychologists, incorporating elements for recalling both the psychologists&#x2019; names and the key aspects of their theories. In our mnemonic, &#x201C;long hair&#x201D; aids in recalling the name of the disease (hairy cell leukemia), and the other elements in the image are used to help recall the disease&#x2019;s main features. The Picmonic System, which uses mnemonics from a web-based educational platform [<xref ref-type="bibr" rid="ref50">50</xref>] that was used in the studies by Yang et al [<xref ref-type="bibr" rid="ref47">47</xref>] and Abdalla et al [<xref ref-type="bibr" rid="ref49">49</xref>], also adopts the visual mnemonic approach by combining visual elements and storytelling to enhance the recall of information; this is also highly similar to our approach. Thus, using DALL&#x00B7;E 3 for mnemonic generation shows promise for improving different learning outcomes, such as test performance, long-term retention, and free recall. Future studies should experimentally investigate the effectiveness of visual mnemonics generated by text-to-image models in learning processes. A significant limitation of using DALL&#x00B7;E 3 for medical mnemonic generation is its restriction on explicit content, prohibiting prompts with terms like &#x201C;blood.&#x201D; By recognizing this limitation, knowledge area&#x2013;specific text-to-image models can be developed to more accurately describe the information needed and enable the use of words that are commonly used in a knowledge area but are censored in current models. Another limitation is that creating stories that accurately reflect the intended factual knowledge for mnemonic cues can be complex, particularly for certain subjects. Effective prompt engineering techniques could help in creating more relevant and coherent visual mnemonics.</p></sec></sec><sec id="s6" sec-type="conclusions"><title>Conclusions</title><p>LLMs, as a form of AI, are transforming the landscape of medical education. They offer a vast range of applications, and their potential has sparked discussions about integrating them into medical school curricula. Active recall&#x2013;based learning strategies can be integrated with AI and can promisingly improve the recall and retention of information. This integration can be effectively applied by using AI to generate pretests and posttest quizzes. Memory cues, including self-generated mnemonics and mnemonics created by AI, can effectively simplify and transform complex information, thereby enhancing recall and optimizing learning. ChatGPT can create multiple types of memory cues, such as acronyms, short stories, and even poems. Moreover, AI tools, like DALL&#x00B7;E 3, can create images based on text and thus can be used to create visual mnemonics. However, crafting the right prompts can be challenging and time consuming, and results may vary. Thus, we believe that the use of new AI-based technologies, such as ChatGPT and DALL&#x00B7;E 3, is a highly useful strategy for learning, especially when these technologies are used with evidence-based principles. Further research is warranted to elucidate the impact of these strategies within the context of medical education.</p></sec></body><back><ack><p>JPAI designed and conceptualized the work. JPAI, JAPN, JPDS, and GCS gathered the data and performed the interpretation. JPAI, JAPN, and JPDS drafted the manuscript. JPAI, JAPN, JPDS, and GCS reviewed and corrected the final version of the manuscript. All authors have read and approved the final version of the paper.</p></ack><fn-group><fn fn-type="conflict"><p>None declared.</p></fn></fn-group><glossary><title>Abbreviations</title><def-list><def-item><term id="abb1">AI</term><def><p>artificial intelligence</p></def></def-item><def-item><term id="abb2">LLM</term><def><p>large language model</p></def></def-item><def-item><term id="abb3">SOCRATES</term><def><p>site, onset, character, radiation, associations, time course, exacerbating factors, and severity</p></def></def-item><def-item><term id="abb4">USMLE</term><def><p>United States Medical Licensing Examination</p></def></def-item></def-list></glossary><ref-list><title>References</title><ref id="ref1"><label>1</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Ruiz</surname><given-names>JG</given-names></name><name name-style="western"><surname>Mintzer</surname><given-names>MJ</given-names></name><name name-style="western"><surname>Leipzig</surname><given-names>RM</given-names></name></person-group><article-title>The impact of e-learning in medical education</article-title><source>Acad Med</source><year>2006</year><month>03</month><volume>81</volume><issue>3</issue><fpage>207</fpage><lpage>212</lpage><pub-id pub-id-type="doi">10.1097/00001888-200603000-00002</pub-id><pub-id pub-id-type="medline">16501260</pub-id></nlm-citation></ref><ref id="ref2"><label>2</label><nlm-citation citation-type="other"><person-group person-group-type="author"><name name-style="western"><surname>Naveed</surname><given-names>H</given-names></name><name name-style="western"><surname>Khan</surname><given-names>AU</given-names></name><name name-style="western"><surname>Qiu</surname><given-names>S</given-names></name><etal/></person-group><article-title>A comprehensive overview of large language models</article-title><source>arXiv</source><comment>Preprint posted online on  Oct 5, 2023</comment><pub-id pub-id-type="doi">10.48550/arXiv.2307.06435</pub-id></nlm-citation></ref><ref id="ref3"><label>3</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Thirunavukarasu</surname><given-names>AJ</given-names></name><name name-style="western"><surname>Ting</surname><given-names>DSJ</given-names></name><name name-style="western"><surname>Elangovan</surname><given-names>K</given-names></name><name name-style="western"><surname>Gutierrez</surname><given-names>L</given-names></name><name name-style="western"><surname>Tan</surname><given-names>TF</given-names></name><name name-style="western"><surname>Ting</surname><given-names>DSW</given-names></name></person-group><article-title>Large language models in medicine</article-title><source>Nat Med</source><year>2023</year><month>08</month><volume>29</volume><issue>8</issue><fpage>1930</fpage><lpage>1940</lpage><pub-id pub-id-type="doi">10.1038/s41591-023-02448-8</pub-id><pub-id pub-id-type="medline">37460753</pub-id></nlm-citation></ref><ref id="ref4"><label>4</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Brin</surname><given-names>D</given-names></name><name name-style="western"><surname>Sorin</surname><given-names>V</given-names></name><name name-style="western"><surname>Vaid</surname><given-names>A</given-names></name><etal/></person-group><article-title>Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments</article-title><source>Sci Rep</source><year>2023</year><month>10</month><day>1</day><volume>13</volume><issue>1</issue><fpage>16492</fpage><pub-id pub-id-type="doi">10.1038/s41598-023-43436-9</pub-id><pub-id pub-id-type="medline">37779171</pub-id></nlm-citation></ref><ref id="ref5"><label>5</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Ali</surname><given-names>R</given-names></name><name name-style="western"><surname>Tang</surname><given-names>OY</given-names></name><name name-style="western"><surname>Connolly</surname><given-names>ID</given-names></name><etal/></person-group><article-title>Performance of ChatGPT and GPT-4 on neurosurgery written board examinations</article-title><source>Neurosurgery</source><year>2023</year><month>12</month><day>1</day><volume>93</volume><issue>6</issue><fpage>1353</fpage><lpage>1365</lpage><pub-id pub-id-type="doi">10.1227/neu.0000000000002632</pub-id><pub-id pub-id-type="medline">37581444</pub-id></nlm-citation></ref><ref id="ref6"><label>6</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Ayers</surname><given-names>JW</given-names></name><name name-style="western"><surname>Poliak</surname><given-names>A</given-names></name><name name-style="western"><surname>Dredze</surname><given-names>M</given-names></name><etal/></person-group><article-title>Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum</article-title><source>JAMA Intern Med</source><year>2023</year><month>06</month><day>1</day><volume>183</volume><issue>6</issue><fpage>589</fpage><lpage>596</lpage><pub-id pub-id-type="doi">10.1001/jamainternmed.2023.1838</pub-id><pub-id pub-id-type="medline">37115527</pub-id></nlm-citation></ref><ref id="ref7"><label>7</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Tsang</surname><given-names>R</given-names></name></person-group><article-title>Practical applications of ChatGPT in undergraduate medical education</article-title><source>J Med Educ Curric Dev</source><year>2023</year><month>05</month><day>24</day><volume>10</volume><fpage>23821205231178449</fpage><pub-id pub-id-type="doi">10.1177/23821205231178449</pub-id><pub-id pub-id-type="medline">37255525</pub-id></nlm-citation></ref><ref id="ref8"><label>8</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Eysenbach</surname><given-names>G</given-names></name></person-group><article-title>The role of ChatGPT, generative language models, and artificial intelligence in medical education: a conversation with ChatGPT and a call for papers</article-title><source>JMIR Med Educ</source><year>2023</year><month>03</month><day>6</day><volume>9</volume><fpage>e46885</fpage><pub-id pub-id-type="doi">10.2196/46885</pub-id><pub-id pub-id-type="medline">36863937</pub-id></nlm-citation></ref><ref id="ref9"><label>9</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Mohammad</surname><given-names>B</given-names></name><name name-style="western"><surname>Supti</surname><given-names>T</given-names></name><name name-style="western"><surname>Alzubaidi</surname><given-names>M</given-names></name><etal/></person-group><article-title>The pros and cons of using ChatGPT in medical education: a scoping review</article-title><source>Stud Health Technol Inform</source><year>2023</year><month>06</month><day>29</day><volume>305</volume><fpage>644</fpage><lpage>647</lpage><pub-id pub-id-type="doi">10.3233/SHTI230580</pub-id><pub-id pub-id-type="medline">37387114</pub-id></nlm-citation></ref><ref id="ref10"><label>10</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Cooper</surname><given-names>A</given-names></name><name name-style="western"><surname>Rodman</surname><given-names>A</given-names></name></person-group><article-title>AI and medical education - a 21st-century Pandora&#x2019;s box</article-title><source>N Engl J Med</source><year>2023</year><month>08</month><day>3</day><volume>389</volume><issue>5</issue><fpage>385</fpage><lpage>387</lpage><pub-id pub-id-type="doi">10.1056/NEJMp2304993</pub-id><pub-id pub-id-type="medline">37522417</pub-id></nlm-citation></ref><ref id="ref11"><label>11</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Civaner</surname><given-names>MM</given-names></name><name name-style="western"><surname>Uncu</surname><given-names>Y</given-names></name><name name-style="western"><surname>Bulut</surname><given-names>F</given-names></name><name name-style="western"><surname>Chalil</surname><given-names>EG</given-names></name><name name-style="western"><surname>Tatli</surname><given-names>A</given-names></name></person-group><article-title>Artificial intelligence in medical education: a cross-sectional needs assessment</article-title><source>BMC Med Educ</source><year>2022</year><month>11</month><day>9</day><volume>22</volume><issue>1</issue><fpage>772</fpage><pub-id pub-id-type="doi">10.1186/s12909-022-03852-3</pub-id><pub-id pub-id-type="medline">36352431</pub-id></nlm-citation></ref><ref id="ref12"><label>12</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Sapci</surname><given-names>AH</given-names></name><name name-style="western"><surname>Sapci</surname><given-names>HA</given-names></name></person-group><article-title>Artificial intelligence education and tools for medical and health informatics students: systematic review</article-title><source>JMIR Med Educ</source><year>2020</year><month>06</month><day>30</day><volume>6</volume><issue>1</issue><fpage>e19285</fpage><pub-id pub-id-type="doi">10.2196/19285</pub-id><pub-id pub-id-type="medline">32602844</pub-id></nlm-citation></ref><ref id="ref13"><label>13</label><nlm-citation citation-type="web"><source>ChatGPT</source><access-date>2024-01-14</access-date><comment><ext-link ext-link-type="uri" xlink:href="https://chat.openai.com">https://chat.openai.com</ext-link></comment></nlm-citation></ref><ref id="ref14"><label>14</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Leff</surname><given-names>B</given-names></name><name name-style="western"><surname>Harper</surname><given-names>GM</given-names></name></person-group><article-title>The reading habits of medicine clerks at one medical school: frequency, usefulness, and difficulties</article-title><source>Acad Med</source><year>2006</year><month>05</month><volume>81</volume><issue>5</issue><fpage>489</fpage><lpage>494</lpage><pub-id pub-id-type="doi">10.1097/01.ACM.0000222273.90705.a6</pub-id><pub-id pub-id-type="medline">16639211</pub-id></nlm-citation></ref><ref id="ref15"><label>15</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Klatt</surname><given-names>EC</given-names></name><name name-style="western"><surname>Klatt</surname><given-names>CA</given-names></name></person-group><article-title>How much is too much reading for medical students? assigned reading and reading rates at one medical school</article-title><source>Acad Med</source><year>2011</year><month>09</month><volume>86</volume><issue>9</issue><fpage>1079</fpage><lpage>1083</lpage><pub-id pub-id-type="doi">10.1097/ACM.0b013e31822579fc</pub-id><pub-id pub-id-type="medline">21785317</pub-id></nlm-citation></ref><ref id="ref16"><label>16</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Prober</surname><given-names>CG</given-names></name><name name-style="western"><surname>Heath</surname><given-names>C</given-names></name></person-group><article-title>Lecture halls without lectures--a proposal for medical education</article-title><source>N Engl J Med</source><year>2012</year><month>05</month><day>3</day><volume>366</volume><issue>18</issue><fpage>1657</fpage><lpage>1659</lpage><pub-id pub-id-type="doi">10.1056/NEJMp1202451</pub-id><pub-id pub-id-type="medline">22551125</pub-id></nlm-citation></ref><ref id="ref17"><label>17</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Prober</surname><given-names>CG</given-names></name><name name-style="western"><surname>Khan</surname><given-names>S</given-names></name></person-group><article-title>Medical education reimagined: a call to action</article-title><source>Acad Med</source><year>2013</year><month>10</month><volume>88</volume><issue>10</issue><fpage>1407</fpage><lpage>1410</lpage><pub-id pub-id-type="doi">10.1097/ACM.0b013e3182a368bd</pub-id><pub-id pub-id-type="medline">23969367</pub-id></nlm-citation></ref><ref id="ref18"><label>18</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Bucklin</surname><given-names>BA</given-names></name><name name-style="western"><surname>Asdigian</surname><given-names>NL</given-names></name><name name-style="western"><surname>Hawkins</surname><given-names>JL</given-names></name><name name-style="western"><surname>Klein</surname><given-names>U</given-names></name></person-group><article-title>Making it stick: use of active learning strategies in continuing medical education</article-title><source>BMC Med Educ</source><year>2021</year><month>01</month><day>11</day><volume>21</volume><issue>1</issue><fpage>44</fpage><pub-id pub-id-type="doi">10.1186/s12909-020-02447-0</pub-id><pub-id pub-id-type="medline">33430843</pub-id></nlm-citation></ref><ref id="ref19"><label>19</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Roffler</surname><given-names>M</given-names></name><name name-style="western"><surname>Sheehy</surname><given-names>R</given-names></name></person-group><article-title>Self-reported learning and study strategies in first and second year medical students</article-title><source>Med Sci Educ</source><year>2022</year><month>03</month><day>18</day><volume>32</volume><issue>2</issue><fpage>329</fpage><lpage>335</lpage><pub-id pub-id-type="doi">10.1007/s40670-022-01533-w</pub-id><pub-id pub-id-type="medline">35528305</pub-id></nlm-citation></ref><ref id="ref20"><label>20</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Dunlosky</surname><given-names>J</given-names></name><name name-style="western"><surname>Rawson</surname><given-names>KA</given-names></name><name name-style="western"><surname>Marsh</surname><given-names>EJ</given-names></name><name name-style="western"><surname>Nathan</surname><given-names>MJ</given-names></name><name name-style="western"><surname>Willingham</surname><given-names>DT</given-names></name></person-group><article-title>Improving students' learning with effective learning techniques: promising directions from cognitive and educational psychology</article-title><source>Psychol Sci Public Interest</source><year>2013</year><month>01</month><volume>14</volume><issue>1</issue><fpage>4</fpage><lpage>58</lpage><pub-id pub-id-type="doi">10.1177/1529100612453266</pub-id><pub-id pub-id-type="medline">26173288</pub-id></nlm-citation></ref><ref id="ref21"><label>21</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Augustin</surname><given-names>M</given-names></name></person-group><article-title>How to learn effectively in medical school: test yourself, learn actively, and repeat in intervals</article-title><source>Yale J Biol Med</source><year>2014</year><month>06</month><day>6</day><volume>87</volume><issue>2</issue><fpage>207</fpage><lpage>212</lpage><pub-id pub-id-type="medline">24910566</pub-id></nlm-citation></ref><ref id="ref22"><label>22</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Kornell</surname><given-names>N</given-names></name><name name-style="western"><surname>Hays</surname><given-names>MJ</given-names></name><name name-style="western"><surname>Bjork</surname><given-names>RA</given-names></name></person-group><article-title>Unsuccessful retrieval attempts enhance subsequent learning</article-title><source>J Exp Psychol Learn Mem Cogn</source><year>2009</year><month>07</month><volume>35</volume><issue>4</issue><fpage>989</fpage><lpage>998</lpage><pub-id pub-id-type="doi">10.1037/a0015729</pub-id><pub-id pub-id-type="medline">19586265</pub-id></nlm-citation></ref><ref id="ref23"><label>23</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Metcalfe</surname><given-names>J</given-names></name></person-group><article-title>Learning from errors</article-title><source>Annu Rev Psychol</source><year>2017</year><month>01</month><day>3</day><volume>68</volume><fpage>465</fpage><lpage>489</lpage><pub-id pub-id-type="doi">10.1146/annurev-psych-010416-044022</pub-id><pub-id pub-id-type="medline">27648988</pub-id></nlm-citation></ref><ref id="ref24"><label>24</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Mera</surname><given-names>Y</given-names></name><name name-style="western"><surname>Rodr&#x00ED;guez</surname><given-names>G</given-names></name><name name-style="western"><surname>Marin-Garcia</surname><given-names>E</given-names></name></person-group><article-title>Unraveling the benefits of experiencing errors during learning: definition, modulating factors, and explanatory theories</article-title><source>Psychon Bull Rev</source><year>2022</year><month>06</month><volume>29</volume><issue>3</issue><fpage>753</fpage><lpage>765</lpage><pub-id pub-id-type="doi">10.3758/s13423-021-02022-8</pub-id><pub-id pub-id-type="medline">34820785</pub-id></nlm-citation></ref><ref id="ref25"><label>25</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Butler</surname><given-names>AC</given-names></name></person-group><article-title>Repeated testing produces superior transfer of learning relative to repeated studying</article-title><source>J Exp Psychol Learn Mem Cogn</source><year>2010</year><month>09</month><volume>36</volume><issue>5</issue><fpage>1118</fpage><lpage>1133</lpage><pub-id pub-id-type="doi">10.1037/a0019902</pub-id><pub-id pub-id-type="medline">20804289</pub-id></nlm-citation></ref><ref id="ref26"><label>26</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Karpicke</surname><given-names>JD</given-names></name><name name-style="western"><surname>Blunt</surname><given-names>JR</given-names></name></person-group><article-title>Retrieval practice produces more learning than elaborative studying with concept mapping</article-title><source>Science</source><year>2011</year><month>02</month><day>11</day><volume>331</volume><issue>6018</issue><fpage>772</fpage><lpage>775</lpage><pub-id pub-id-type="doi">10.1126/science.1199327</pub-id><pub-id pub-id-type="medline">21252317</pub-id></nlm-citation></ref><ref id="ref27"><label>27</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Roediger</surname><given-names>HL</given-names><suffix>3rd</suffix></name><name name-style="western"><surname>Butler</surname><given-names>AC</given-names></name></person-group><article-title>The critical role of retrieval practice in long-term retention</article-title><source>Trends Cogn Sci</source><year>2011</year><month>01</month><volume>15</volume><issue>1</issue><fpage>20</fpage><lpage>27</lpage><pub-id pub-id-type="doi">10.1016/j.tics.2010.09.003</pub-id><pub-id pub-id-type="medline">20951630</pub-id></nlm-citation></ref><ref id="ref28"><label>28</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Larsen</surname><given-names>DP</given-names></name><name name-style="western"><surname>Butler</surname><given-names>AC</given-names></name><name name-style="western"><surname>Roediger</surname><given-names>HL</given-names><suffix>3rd</suffix></name></person-group><article-title>Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial</article-title><source>Med Educ</source><year>2009</year><month>12</month><volume>43</volume><issue>12</issue><fpage>1174</fpage><lpage>1181</lpage><pub-id pub-id-type="doi">10.1111/j.1365-2923.2009.03518.x</pub-id><pub-id pub-id-type="medline">19930508</pub-id></nlm-citation></ref><ref id="ref29"><label>29</label><nlm-citation citation-type="book"><person-group person-group-type="author"><name name-style="western"><surname>Brown</surname><given-names>BD</given-names></name><name name-style="western"><surname>Watson</surname><given-names>KLH</given-names></name></person-group><article-title>Cellulitis</article-title><source>StatPearls</source><year>2023</year><access-date>2024-01-15</access-date><publisher-name>StatPearls Publishing</publisher-name><comment><ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/books/NBK549770/">https://www.ncbi.nlm.nih.gov/books/NBK549770/</ext-link></comment></nlm-citation></ref><ref id="ref30"><label>30</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Tullis</surname><given-names>JG</given-names></name><name name-style="western"><surname>Qiu</surname><given-names>J</given-names></name></person-group><article-title>Generating mnemonics boosts recall of chemistry information</article-title><source>J Exp Psychol Appl</source><year>2022</year><month>03</month><volume>28</volume><issue>1</issue><fpage>71</fpage><lpage>84</lpage><pub-id pub-id-type="doi">10.1037/xap0000350</pub-id><pub-id pub-id-type="medline">33939460</pub-id></nlm-citation></ref><ref id="ref31"><label>31</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Tullis</surname><given-names>JG</given-names></name><name name-style="western"><surname>Fraundorf</surname><given-names>SH</given-names></name></person-group><article-title>Selecting effectively contributes to the mnemonic benefits of self-generated cues</article-title><source>Mem Cognit</source><year>2022</year><month>05</month><volume>50</volume><issue>4</issue><fpage>765</fpage><lpage>781</lpage><pub-id pub-id-type="doi">10.3758/s13421-021-01245-3</pub-id><pub-id pub-id-type="medline">34731430</pub-id></nlm-citation></ref><ref id="ref32"><label>32</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Tullis</surname><given-names>JG</given-names></name><name name-style="western"><surname>Finley</surname><given-names>JR</given-names></name></person-group><article-title>Self-generated memory cues: effective tools for learning, training, and remembering</article-title><source>Policy Insights Behav Brain Sci</source><year>2018</year><month>10</month><volume>5</volume><issue>2</issue><fpage>179</fpage><lpage>186</lpage><pub-id pub-id-type="doi">10.1177/2372732218788092</pub-id></nlm-citation></ref><ref id="ref33"><label>33</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Tullis</surname><given-names>JG</given-names></name><name name-style="western"><surname>Finley</surname><given-names>JR</given-names></name></person-group><article-title>What characteristics make self-generated memory cues effective over time?</article-title><source>Memory</source><year>2021</year><month>11</month><volume>29</volume><issue>10</issue><fpage>1308</fpage><lpage>1319</lpage><pub-id pub-id-type="doi">10.1080/09658211.2021.1979585</pub-id><pub-id pub-id-type="medline">34546833</pub-id></nlm-citation></ref><ref id="ref34"><label>34</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Xie</surname><given-names>H</given-names></name><name name-style="western"><surname>Wang</surname><given-names>F</given-names></name><name name-style="western"><surname>Hao</surname><given-names>Y</given-names></name><etal/></person-group><article-title>The more total cognitive load is reduced by cues, the better retention and transfer of multimedia learning: a meta-analysis and two meta-regression analyses</article-title><source>PLoS One</source><year>2017</year><month>08</month><day>30</day><volume>12</volume><issue>8</issue><fpage>e0183884</fpage><pub-id pub-id-type="doi">10.1371/journal.pone.0183884</pub-id><pub-id pub-id-type="medline">28854205</pub-id></nlm-citation></ref><ref id="ref35"><label>35</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Pearson</surname><given-names>HC</given-names></name><name name-style="western"><surname>Wilbiks</surname><given-names>JMP</given-names></name></person-group><article-title>Effects of audiovisual memory cues on working memory recall</article-title><source>Vision (Basel)</source><year>2021</year><month>03</month><day>19</day><volume>5</volume><issue>1</issue><fpage>14</fpage><pub-id pub-id-type="doi">10.3390/vision5010014</pub-id><pub-id pub-id-type="medline">33808715</pub-id></nlm-citation></ref><ref id="ref36"><label>36</label><nlm-citation citation-type="book"><person-group person-group-type="author"><name name-style="western"><surname>Higbee</surname><given-names>KL</given-names></name></person-group><article-title>Mnemonics, psychology of</article-title><source>International Encyclopedia of the Social &#x0026; Behavioral Sciences</source><year>2001</year><publisher-name>Elsevier</publisher-name><fpage>9915</fpage><lpage>9918</lpage><pub-id pub-id-type="doi">10.1016/B0-08-043076-7/01517-5</pub-id></nlm-citation></ref><ref id="ref37"><label>37</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>O&#x2019;Hanlon</surname><given-names>R</given-names></name><name name-style="western"><surname>Laynor</surname><given-names>G</given-names></name></person-group><article-title>Responding to a new generation of proprietary study resources in medical education</article-title><source>J Med Libr Assoc</source><year>2019</year><month>04</month><volume>107</volume><issue>2</issue><fpage>251</fpage><lpage>257</lpage><pub-id pub-id-type="doi">10.5195/jmla.2019.619</pub-id><pub-id pub-id-type="medline">31019395</pub-id></nlm-citation></ref><ref id="ref38"><label>38</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Qiao</surname><given-names>YQ</given-names></name><name name-style="western"><surname>Shen</surname><given-names>J</given-names></name><name name-style="western"><surname>Liang</surname><given-names>X</given-names></name><etal/></person-group><article-title>Using cognitive theory to facilitate medical education</article-title><source>BMC Med Educ</source><year>2014</year><month>04</month><day>14</day><volume>14</volume><fpage>79</fpage><pub-id pub-id-type="doi">10.1186/1472-6920-14-79</pub-id><pub-id pub-id-type="medline">24731433</pub-id></nlm-citation></ref><ref id="ref39"><label>39</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Reed</surname><given-names>LA</given-names></name><name name-style="western"><surname>Hoffman</surname><given-names>LG</given-names></name></person-group><article-title>Pictorial cues and enhancement of patient recall of instructions or information</article-title><source>J Am Optom Assoc</source><year>1986</year><month>04</month><volume>57</volume><issue>4</issue><fpage>312</fpage><lpage>315</lpage><pub-id pub-id-type="medline">3700955</pub-id></nlm-citation></ref><ref id="ref40"><label>40</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Richland</surname><given-names>LE</given-names></name><name name-style="western"><surname>Kornell</surname><given-names>N</given-names></name><name name-style="western"><surname>Kao</surname><given-names>LS</given-names></name></person-group><article-title>The pretesting effect: do unsuccessful retrieval attempts enhance learning?</article-title><source>J Exp Psychol Appl</source><year>2009</year><month>09</month><volume>15</volume><issue>3</issue><fpage>243</fpage><lpage>257</lpage><pub-id pub-id-type="doi">10.1037/a0016496</pub-id><pub-id pub-id-type="medline">19751074</pub-id></nlm-citation></ref><ref id="ref41"><label>41</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Latimier</surname><given-names>A</given-names></name><name name-style="western"><surname>Riegert</surname><given-names>A</given-names></name><name name-style="western"><surname>Peyre</surname><given-names>H</given-names></name><name name-style="western"><surname>Ly</surname><given-names>ST</given-names></name><name name-style="western"><surname>Casati</surname><given-names>R</given-names></name><name name-style="western"><surname>Ramus</surname><given-names>F</given-names></name></person-group><article-title>Does pre-testing promote better retention than post-testing?</article-title><source>NPJ Sci Learn</source><year>2019</year><month>09</month><day>24</day><volume>4</volume><fpage>15</fpage><pub-id pub-id-type="doi">10.1038/s41539-019-0053-1</pub-id><pub-id pub-id-type="medline">31583117</pub-id></nlm-citation></ref><ref id="ref42"><label>42</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Kang</surname><given-names>SHK</given-names></name></person-group><article-title>Spaced repetition promotes efficient and effective learning: policy implications for instruction</article-title><source>Policy Insights Behav Brain Sci</source><year>2016</year><month>03</month><volume>3</volume><issue>1</issue><fpage>12</fpage><lpage>19</lpage><pub-id pub-id-type="doi">10.1177/2372732215624708</pub-id></nlm-citation></ref><ref id="ref43"><label>43</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>L&#x00FC;deke</surname><given-names>ABEK</given-names></name><name name-style="western"><surname>Olaya</surname><given-names>JFG</given-names></name></person-group><article-title>Effective feedback, an essential component of all stages in medical education</article-title><source>Universitas Medica</source><year>2020</year><volume>61</volume><issue>3</issue><pub-id pub-id-type="doi">10.11144/Javeriana.umed61-3.feed</pub-id></nlm-citation></ref><ref id="ref44"><label>44</label><nlm-citation citation-type="web"><article-title>Meet Khanmigo: Khan Academy's AI-powered teaching assistant &#x0026; tutor</article-title><source>Khan Academy</source><access-date>2024-01-19</access-date><comment><ext-link ext-link-type="uri" xlink:href="https://www.khanacademy.org/khan-labs">https://www.khanacademy.org/khan-labs</ext-link></comment></nlm-citation></ref><ref id="ref45"><label>45</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Alkaissi</surname><given-names>H</given-names></name><name name-style="western"><surname>McFarlane</surname><given-names>SI</given-names></name></person-group><article-title>Artificial hallucinations in ChatGPT: implications in scientific writing</article-title><source>Cureus</source><year>2023</year><month>02</month><day>19</day><volume>15</volume><issue>2</issue><fpage>e35179</fpage><pub-id pub-id-type="doi">10.7759/cureus.35179</pub-id><pub-id pub-id-type="medline">36811129</pub-id></nlm-citation></ref><ref id="ref46"><label>46</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Rummel</surname><given-names>N</given-names></name><name name-style="western"><surname>Levin</surname><given-names>JR</given-names></name><name name-style="western"><surname>Woodward</surname><given-names>MM</given-names></name></person-group><article-title>Do pictorial mnemonic text-learning aids give students something worth writing about?</article-title><source>J Educ Psychol</source><year>2003</year><volume>95</volume><issue>2</issue><fpage>327</fpage><lpage>334</lpage><pub-id pub-id-type="doi">10.1037/0022-0663.95.2.327</pub-id></nlm-citation></ref><ref id="ref47"><label>47</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Yang</surname><given-names>A</given-names></name><name name-style="western"><surname>Goel</surname><given-names>H</given-names></name><name name-style="western"><surname>Bryan</surname><given-names>M</given-names></name><etal/></person-group><article-title>The Picmonic(&#x00AE;) Learning System: enhancing memory retention of medical sciences, using an audiovisual mnemonic web-based learning platform</article-title><source>Adv Med Educ Pract</source><year>2014</year><month>05</month><day>8</day><volume>5</volume><fpage>125</fpage><lpage>132</lpage><pub-id pub-id-type="doi">10.2147/AMEP.S61875</pub-id><pub-id pub-id-type="medline">24868180</pub-id></nlm-citation></ref><ref id="ref48"><label>48</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>De Moll</surname><given-names>EH</given-names></name><name name-style="western"><surname>Routt</surname><given-names>E</given-names></name><name name-style="western"><surname>Heinecke</surname><given-names>G</given-names></name><name name-style="western"><surname>Tsui</surname><given-names>C</given-names></name><name name-style="western"><surname>Levitt</surname><given-names>J</given-names></name></person-group><article-title>The use of an imagery mnemonic to teach the porphyrin biochemical pathway</article-title><source>Dermatol Online J</source><year>2015</year><month>04</month><day>16</day><volume>21</volume><issue>4</issue><fpage>13030/qt4j51j8wt</fpage><pub-id pub-id-type="medline">25933070</pub-id></nlm-citation></ref><ref id="ref49"><label>49</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Abdalla</surname><given-names>MMI</given-names></name><name name-style="western"><surname>Azzani</surname><given-names>M</given-names></name><name name-style="western"><surname>Rajendren</surname><given-names>R</given-names></name><etal/></person-group><article-title>Effect of story-based audiovisual mnemonics in comparison with text-reading method on memory consolidation among medical students: a randomized controlled trial</article-title><source>Am J Med Sci</source><year>2021</year><month>12</month><volume>362</volume><issue>6</issue><fpage>612</fpage><lpage>618</lpage><pub-id pub-id-type="doi">10.1016/j.amjms.2021.07.015</pub-id><pub-id pub-id-type="medline">34606752</pub-id></nlm-citation></ref><ref id="ref50"><label>50</label><nlm-citation citation-type="web"><article-title>Picmonic&#x00AE; picture mnemonics - medical school, nursing school and more!</article-title><source>Picmonic</source><access-date>2024-01-03</access-date><comment><ext-link ext-link-type="uri" xlink:href="https://www.picmonic.com/">https://www.picmonic.com/</ext-link></comment></nlm-citation></ref></ref-list></back></article>