This paper is in the following e-collection/theme issue:

Research Letter (6) Learning and Education (77) Learning and Education (77) New Methods and Approaches in Medical Education (245) Training Tools for Medical Students (132) e-Learning and Digital Medical Education (705) New Methods and Approaches in Medical Education (245) Training Tools for Medical Students (132) e-Learning and Digital Medical Education (705)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/56568, first published .
Collaborative Development of an Electronic Portfolio to Support the Assessment and Development of Medical Undergraduates

Collaborative Development of an Electronic Portfolio to Support the Assessment and Development of Medical Undergraduates

Collaborative Development of an Electronic Portfolio to Support the Assessment and Development of Medical Undergraduates

Authors of this article:

Luiz Ricardo Albano dos Santos1 Author Orcid Image ;   Alan Maicon de Oliveira2 Author Orcid Image ;   Luana Michelly Aparecida Costa dos Santos1 Author Orcid Image ;   Guilherme José Aguilar3 Author Orcid Image ;   Wilbert Dener Lemos Costa1 Author Orcid Image ;   Dantony de Castro Barros Donato1 Author Orcid Image ;   Valdes Roberto Bollela1, 4 Author Orcid Image
Article Authors Cited by Tweetations (6) Metrics

    1Ribeirão Preto Medical School, University of São Paulo, , Ribeirão Preto, , Brazil

    2School of Pharmaceutical Sciences of Ribeirão Preto, University of São Paulo, , Ribeirão Preto, , Brazil

    3Faculty of Philosophy, Sciences and Letters at Ribeirão Preto, University of São Paulo, , Ribeirão Preto, , Brazil

    4Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, , Ribeirão Preto, , Brazil

    *all authors contributed equally

    Corresponding Author:

    Luiz Ricardo Albano dos Santos, PhD


    This study outlines the development of an electronic portfolio (e-portfolio) designed to capture and record the overall academic performance of medical undergraduate students throughout their educational journey. Additionally, it facilitates the capture of narratives on lived experiences and sharing of reflections, fostering collaboration between students and their mentors.

    JMIR Med Educ 2024;10:e56568

    doi:10.2196/56568

    Keywords

    e-portfolio; education; health education; learning; medical students; medical school curriculum; medical education; student support; software 


    The Brazilian curriculum guidelines for medical schools incorporate competencies in information technology, emphasizing students’ co-responsibility in acquiring soft skills such as leadership, teamwork, and continuous professional development [1]. The curriculum experience must foster critical and reflective skills [2].

    Ribeirão Preto Medical School at University of São Paulo, Brazil (FMRP-USP), is a 72-year-old traditional institution that initiated a curriculum change in January 2023. In this new proposal, we introduced a longitudinal axis and curricular unit called personal and professional development (PPD). The primary objective of PPD is to foster self-reflection on lived experiences, regular self-assessment, and monitoring of the students’ progress in curricular and extracurricular activities, with a mentor’s support.

    To support the implementation of the PPD curricular unit, we collaboratively developed a software to serve as the electronic portfolio (e-portfolio) and record the overall academic performance of undergraduate medical students throughout their educational journey. An additional expectation is to encourage and guide teachers to provide and register formative assessments in their disciplines and rotations, and to document their experiences and reflections.


    The collaborative development of the system involved developers, health educators, and students, which was crucial to ensure that the e-portfolio meets the needs and expectations of all stakeholders. Developers contributed technical expertise for functionality and accessibility, while educators shaped content based on educational principles. Students, as primary users, provided valuable feedback.

    The main challenge in developing the e-portfolio was to create an initial set of requirements. With various participants bringing different ideas, there was a multitude of perspectives in the initial phase, which brought fundamental enrichment during development but also increased the difficulty of integrating all perspectives.

    These challenges were overcome with Scrum [3] integrated with socio-technical research methodology to facilitate the collaborative environment. We implement Scrum practices, such as daily 5-minute meetings and biweekly 30-minute sprint reviews, ensuring incremental and continuous deliveries and communication between the development team and stakeholders, mainly regarding system development. Additionally, we integrated the socio-technical research methodology [4] into SCRUM, aiming to understand the software requirements as well as the various social and technological factors involved.

    Regarding software development technologies, we used HTML, CSS, PHP, and the MySQL database management system.


    The study received approval from the research ethics committee of the Clinical Hospital of FMRP-USP (CAAE: 67577523.1.0000.5440).


    The e-portfolio utilizes a web application architecture (Figure 1). Initially, we developed a structure to manage the registration of all the programs within the medical school, different curricular units, and offerings. We created a registration module for students and faculty members, allowing those to act as mentors, teachers, and discipline coordinators. Additionally, e-portfolio enables the recording of direct observed assessments in clinical settings, using preregistered forms based on methods such as mini-clinical evaluation exercise (Mini-CEx) [5], 360-degree assessment [6], One-Minute Preceptor, direct observation of procedural skills (DOPS), and case-based discussion/chart-stimulated recall (CBD/CSR) [7].

    For narratives in medicine [8], there is a specific form to guide students on how to report a lived experience followed by a meaningful reflection, based on the REFLECT rubric for assessing reflective writing [9] (Figure 2).

    Students are allowed to fill in data in their private profile (Figure 1), access their disciplines and received assessments, respond to formative assessments, record significant events for their education, check and compare their performance with their cohort, register extracurricular activities, and consult critical incidents recorded.

    e-Portfolio enables students, discipline coordinators, and members of the student assessment committee to track assessments and feedback received, providing a longitudinal and progressive view of the student’s cognitive, psychomotor (skills), and attitudinal development (Figures 1 and 2).

    ‎
    Figure 1. Profile and performance report of the medical student in the electronic portfolio (e-portfolio). (A) Profile created by the student in the e-portfolio. (B) Student’s performance in various subjects is presented in relation to the radar chart: the blue line represents a comparison with the cohort mean (depicted by the gray area).
    ‎
    Figure 2. Evaluation form in the electronic portfolio (e-portfolio) with narratives and the adapted REFLECT rubric to guide the medical student and the mentor.

    This work presents the successful development of an e-portfolio at FMRP-USP. The e-portfolio is continuously enhanced and updated, and it is currently in a state suitable for use in a pilot study. The use of similar tools has been recognized for stimulating personal reflection, fostering collaboration, and strengthening digital literacy among students, encouraging active participation in the learning process [10].

    The application of Scrum offered an adaptable framework, promoting efficient collaboration among stakeholders. Additionally, socio-technical research methods, such as qualitative interviews involving in-depth conversations with individuals or groups to explore their experiences related to technology, provided valuable insights into the needs and dynamics of end users in the educational context. The use of Scrum with socio-technical research methods enables a more integrated, collaborative, and reflective approach during development.

    Future Steps

    We intend to evaluate e-portfolio usability, effectiveness, acceptance, and satisfaction in practical contexts with the objective of consistently enhancing the system and its outcomes.

    Acknowledgments

    We would like to express our gratitude to the Ribeirão Preto Medical School, University of São Paulo, and the startup Intersection (Ribeirão Preto, Brazil) for their partnership in software development. We would like to thank Prof Francisco S Guimarães for all the support and follow-up with the medical students and mentors. Additionally, we extend our appreciation to the Conselho Nacional de Desenvolvimento Científico e Tecnológico – Brasil (CNPq). This study was financed in part by CNPq (process no.: 001). Furthermore, this study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001.

    Authors' Contributions

    LRAS and VRB contributed to the study concept and design, data acquisition, analysis, interpretation, and manuscript writing. AMO, LMACS, GJA, WDLC, and DCBD contributed to the interpretation, manuscript writing, and critical review of the manuscript for important intellectual content. All authors read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    1. Weinberger SE, Smith LG, Collier VU, Education Committee of the American College of Physicians. Redesigning training for internal medicine. Ann Intern Med. Jun 20, 2006;144(12):927-932. [CrossRef] [Medline]
    2. Elshami WE, Abuzaid MM, Guraya SS, David LR. Acceptability and potential impacts of innovative E-Portfolios implemented in E-Learning systems for clinical training. J Taibah Univ Med Sci. Dec 2018;13(6):521-527. [CrossRef] [Medline]
    3. Sutherland J. Scrum: The Art of Doing Twice the Work in Half the Time. 1st ed. Crown Business; 2014. ISBN: 978-0-385-34645-0
    4. Fuggetta A. Software process: a roadmap. In: ICSE '00: Proceedings of the Conference on The Future of Software Engineering. Association for Computing Machinery; 2000;25-34. [CrossRef]
    5. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med. Nov 15, 1995;123(10):795-799. [CrossRef] [Medline]
    6. Jani H, Narmawala W, Ganjawale J. Evaluation of competencies related to personal attributes of resident doctors by 360 degree. J Clin Diagn Res. Jun 2017;11(6):JC09-JC11. [CrossRef] [Medline]
    7. Furney SL, Orsini AN, Orsetti KE, Stern DT, Gruppen LD, Irby DM. Teaching the one-minute preceptor. a randomized controlled trial. J Gen Intern Med. Sep 2001;16(9):620-624. [CrossRef] [Medline]
    8. Charon R. Narrative and medicine. N Engl J Med. Feb 26, 2004;350(9):862-864. [CrossRef] [Medline]
    9. Wald HS, Borkan JM, Taylor JS, Anthony D, Reis SP. Fostering and evaluating reflective capacity in medical education: developing the REFLECT rubric for assessing reflective writing. Acad Med. Jan 2012;87(1):41-50. [CrossRef] [Medline]
    10. Mudau PK, Modise MMP. Using e-portfolios for active student engagement in the ODeL environment. JITE:Res. 2022;21:425-438. [CrossRef]

    ‎
    CAPES: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Coordination for the Improvement of Higher Education Personnel)
    CBD/CSR: case-based discussion/chart-stimulated recall
    CNPq: Conselho Nacional de Desenvolvimento Científico e Tecnológico (National Council for Scientific and Technological Development)
    DOPS: direct observation of procedural skills
    e-portfolio: electronic portfolio
    FMRP-USP: Ribeirão Preto Medical School, University of São Paulo
    Mini-CEx: mini-clinical evaluation exercise
    PPD: personal and professional development

    Edited by Sreenivasulu Reddy Mogali; submitted 19.01.24; peer-reviewed by Azizollah Arbabisarjou, Iara Souza Lima, Kleython Lacerda; final revised version received 27.02.24; accepted 04.03.24; published 04.04.24.

    Copyright

    © Luiz Ricardo Albano dos Santos, Alan Maicon de Oliveira, Luana Michelly Aparecida Costa dos Santos, Guilherme José Aguilar, Wilbert Dener Lemos Costa, Dantony de Castro Barros Donato, Valdes Roberto Bollela. Originally published in JMIR Medical Education (https://mededu.jmir.org), 4.4.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on https://mededu.jmir.org/, as well as this copyright and license information must be included.