Published on 13.03.18 in Vol 4, No 1 (2018): Jan-Jun
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/9635, first published Dec 11, 2017.
Improving Internal Medicine Residents’ Colorectal Cancer Screening Knowledge Using a Smartphone App: Pilot Study
Background: Colorectal cancer (CRC) is the third most common type of cancer and the second leading cause of cancer death in the United States. About one in three adults in the United States is not getting the CRC screening as recommended. Internal medicine residents are deficient in CRC screening knowledge.
Objective: The objective of our study was to assess the improvement in internal medicine residents’ CRC screening knowledge via a pilot approach using a smartphone app.
Methods: We designed a questionnaire based on the CRC screening guidelines of the American Cancer Society, American College of Gastroenterology, and US Preventive Services Task Force. We emailed the questionnaire via a SurveyMonkey link to all the residents of an internal medicine department to assess their knowledge of CRC screening guidelines. Then we designed an educational intervention in the form of a smartphone app containing all the knowledge about the CRC screening guidelines. The residents were introduced to the app and asked to download it onto their smartphones. We repeated the survey to test for changes in the residents’ knowledge after publication of the smartphone app and compared the responses with the previous survey. We applied the Pearson chi-square test and the Fisher exact test to look for statistical significance.
Results: A total of 50 residents completed the first survey and 41 completed the second survey after publication of the app. Areas of CRC screening that showed statistically significant improvement (P<.05) were age at which CRC screening was started in African Americans, preventive tests being ordered first, identification of CRC screening tests, identification of preventive and detection methods, following up positive tests with colonoscopy, follow-up after colonoscopy findings, and CRC surveillance in diseases.
Conclusions: In this modern era of smartphones and gadgets, developing a smartphone-based app or educational tool is a novel idea and can help improve residents’ knowledge about CRC screening.
JMIR Med Educ 2018;4(1):e10
Colorectal cancer (CRC) is the third most commonly diagnosed cancer among both men and women in the United States. It is the second leading cause of cancer-related death overall. Incidence and mortality rates have been declining because of increased awareness of risk factors such as smoking and red meat consumption, and improvement in screening rates and treatment modalities [- ]. According to the American Cancer Society (ACS), 135,430 new cases and 50,260 deaths from CRC were expected to occur in 2017, and the lifetime risk of developing CRC is about 1 in 21 (4.7%) for men and 1 in 23 (4.4%) for women [ ]. The management of CRC is associated with substantial health care costs, with national expenditures exceeding US $14 billion annually [ , ]. There are striking disparities by age, race, and tumor subsite despite a reduction in CRC incidence and mortality overall. The goal of further reducing CRC incidence and mortality can be achieved by ensuring access to high-quality health care, incentivizing healthy lifestyles, and increasing CRC screening. Meester and colleagues and others estimated that achieving the US National Colorectal Cancer Roundtable’s goal of increasing screening prevalence to 80% by 2018 would prevent 277,000 CRC cases and 203,000 deaths by 2030 [ - ]. About one in three adults in the United States is not getting CRC screening as recommended. According to the US National Health Interview Survey, CRC screening in accordance with the guidelines among adults 50 years of age and older increased from 34% in 2000 to 63% in 2015 [ ].
Generally, it is expected that as resident physicians advance in their training, CRC screening rates should improve with the expected improvement in knowledge of CRC screening. Wong measured performance outcomes in multiple screening categories over 3 years of training and found that actual patient screening rates were similar across all years . One of the reasons for this lack of improvement in CRC screening could be residents’ deficient knowledge about CRC screening, even though guidelines from the American College of Gastroenterology (ACG), ACS, and US Preventive Services Task Force (USPSTF) are mostly in agreement about screening modalities and age [ - ]. Akerman et al [ ] assessed residents’ CRC screening knowledge via a Web-based survey and concluded that there were many deficiencies. They concluded that fecal occult blood testing for screening purposes remains undervalued, and confusion about administering the test persists. The distinction between screening and prevention needs further reinforcement [ ].
Primary medical care of many underserved populations is dependent on resident outpatient practices. The physician-in-training role in health maintenance and screening has been assessed by various studies [- ]. Other factors could be responsible for the compromise in effective health maintenance and screening in resident practice in addition to residents’ knowledge deficiencies. One of these factors could be provider turnover every few years. Some studies even estimate that as many as 50% of patients are lost to follow-up of their chronic medical conditions and screenings when resident physicians graduate and pass their patients on to new providers [ ].
Besides addressing other factors to improve health maintenance and screening in residents’ practice, improving medical knowledge about preventive health and screening is the key. One of the reasons for residents’ deficient knowledge about CRC screening is lack of training and educational tools. We conducted this comprehensive study to improve internal medicine residents’ CRC screening knowledge via a pilot approach using a smartphone app.
This pilot study was completed in 3 parts. Initially, we designed a questionnaire based on the CRC screening guidelines of the ACS, ACG, and USPSTF; we then requested institutional review board approval. The institutional review board of the University of Toledo Medical Center then granted the request for approval after reviewing the app and the survey questionnaire (no. 201713). The survey contained 14 questions on 7 areas of CRC screening,outlines. We emailed the questionnaire via a SurveyMonkey (SurveyMonkey Inc, San Mateo, CA) link to all the residents of an internal medicine department. We analyzed the responses after 4 weeks. The first question simply asked for the year of training, to create a subset for analysis by year of training. Respondents had the ability to answer with multiple correct choices for some questions, reflecting the multiple options presented in the source guidelines. shows the survey form.
In the second part, we designed a smartphone app. The decision to use a smartphone app for education was purely experimental and was based on the recent advancement in technology of smartphones and gadgets and the subsequent growth of the smartphone app industry. First, we collected information about CRC screening based on the ACG, ACS, and USPSTF guidelines, and then made a screen tree based on this information. The screen tree consisted of a total of 9 screens, including the main screen, as, , , and show. The smartphone app was created on an online app creation portal (Mobincube, San Francisco, CA, USA). We designed the app keeping in mind simplicity yet ensuring good visibility of the information. The portal subscription we obtained for the app creation and publication was without advertisements to avoid any conflicts of interest. We tested the trial version of the app on a smartphone and a tablet before publication.
Then we uploaded the app onto the Google Developers Console (Google Inc, Mountain View, CA, USA) and published it the Google Play Store (Google Inc) for Android users. We also sent the app to Apple support for testing before publication in the App Store (Apple Inc, Cupertino, CA, USA). All the residents were introduced to the app via emails and flyers. We tracked the number of app downloads via a developer account in both the Play Store and the App Store. The app was purely educational and there were no interactive components in the app. The purpose of the app was to improve residents’ knowledge about CRC screening.
In the third and final part, we repeated the survey after 4 weeks and compared the responses with those of the first survey. Weekly reminders were sent to residents to complete both the surveys. We gave residents no incentives to complete the surveys. We applied the Pearson chi-square test and the Fisher exact test to look for statistical significance.
Survey Response Rates
We analyzed and compared the data in 3 subsets. In the first subset, we compared responses to the survey questions from respondents in the same training year to determine improvement in knowledge in each training year individually after publication of the smartphone app. In the second subset analysis, we compared responses between each of the 3 resident training years (ie, postgraduate year [PGY]-1, PGY-2, and PGY-3) to look for differences in knowledge between different training levels at baseline and differences in knowledge improvement after publication of the smartphone app. In the third and final analysis, we analyzed responses in aggregate to look for overall improvement in knowledge.
We emailed the survey link to 59 residents during the first phase and allowed 4 weeks for completion of the survey, with weekly reminders sent via email. A total of 50 residents completed the survey, for response rate of 85%. Of the 50 respondents, there were 22 PGY-1 residents, 15 PGY-2 residents, and 13 PGY-3 residents. After publication of the app, we emailed the survey link again. A total of 41 residents responded to the second survey, for a response rate of 69%; of the respondents, there were 20 PGY-1 residents, 11 PGY-2 residents, and 10 PGY-3 residents.
Assessment of Residents’ Knowledge
The first few survey questions assessed the resident’s knowledge about CRC screening in average-risk patients and with a family history of CRC (). Most of the residents correctly identified the screening age in such patients. The residents were lacking knowledge about the ACG recommendation to start screening for CRC in African Americans at age 45 years. But after using the smartphone app, their knowledge improved significantly, from only 4 residents (8%) responding correctly before using the app to 29 residents (71%) responding correctly after using the app (P<.001). Although not statistically significant, knowledge about offering preventive tests first (P=.01) and offering colonoscopy every 5 years to patients with family history of CRC in a first-degree relative at age less than 60 years (P=.17) all improved.
When asked to identify screening modalities for CRC screening, many residents were lacking the knowledge about the various tests that can be offered. The number of correct responses indicating their knowledge about computed tomography (CT) colonography every 5 years, double-contrast barium enema every 5 years, sigmoidoscopy every 10 years with annual fecal immunochemical testing at home, and fecal DNA testing every 1 to 3 years increased with statistical significance after intervention (). The residents were also tested on their ability to identify preventive tests, which can detect precancerous polypoid lesions. Most residents could identify only colonoscopy every 10 years as a preventive test at baseline, but after the intervention, more of them, at all training levels, correctly identified flexible sigmoidoscopy every 5 years, CT colonography every 5 years, and double-contrast barium enema every 5 years as preventive tests ( ).
Detection methods only can detect CRC; they can’t prevent it as prevention methods do by detecting precancerous polypoid lesions. Stool-based CRC screening tests are the detection methods. Residents knowledge for correctly identifying detection methods was not satisfactory at baseline but improved significantly after education with the app, and they were able to identify annual fecal immunochemical testing, fecal occult blood testing at home, and fecal DNA testing every 1 to 3 years as CRC detection methods (). Most residents could identify sigmoidoscopy and fecal occult blood testing as the tests that are to be followed by colonoscopy if the test result is positive. At baseline, they did not all know that positive results on CT colonography, double-contrast barium enema, fecal immunochemical testing, and fecal DNA testing should also be followed by colonoscopy. After using the smartphone app, however, more of the residents identified these tests as needing to be followed by colonoscopy ( ).
The residents were also tested on the recommended follow-up after colonoscopy screening. Overall, the residents’ knowledge was not satisfactory on the follow-up periods of 10 years in the case of small hyperplastic rectal polyps being found, 5 years for 1 or 2 small tubular adenomas, 3 years for 3 to 10 adenomas, 1 to 3 years for more than 10 adenomas, and 2 to 6 months for sessile adenomas. Knowledge improved, but this was statistically significant only in the case of knowledge about the follow-up of sessile adenomas and of more than 10 adenomas (). Finally, residents were asked about surveillance for CRC in familial adenomatous polyposis, Lynch syndrome, and inflammatory bowel disease. Residents’ knowledge about CRC surveillance in familial adenomatous polyposis was lacking before using the smartphone app but improved significantly after the educational intervention ( ).
Most of the recommendations for CRC screening from the ACG, ACS, and USPSTF are similar. For our study, we extracted commonalities and only tested recommendations that were similar between all of these guidelines. Apart from these organizations, others also publish guidelines, most of which reinforce the already-stated recommendations, but they also make some new recommendations, adding to the confusion for residents and other health care professionals. Recently, the US Multi-Society Task Force on Colorectal Cancer made new recommendations, in which they divided the screening tests into three tiers based on performance features, costs, and practical considerations . In our study, we tested the knowledge of residents to identify these screening tests but didn’t test for division of these tests into three tiers.
Our study showed that, regardless of the levels of training, residents in one internal medicine department were lacking knowledge about CRC screening. This finding agrees with that of Sharma et al [, ], who investigated the understanding of CRC screening among primary care physicians and internists. There was no difference in residents’ knowledge between baseline and after the educational intervention in the form of a smartphone app: knowledge improved equally among all 3 PGY levels. This finding is consistent with a study in 2005 [ ], which showed no statistically significant difference in CRC screening rates between different years of training.
Our study was different from previously reported ones in that, first, ours was very comprehensive and covered all aspects of CRC screening and, second, it used the novel approach of a smartphone app for education of the residents. Previously reported studies, such as that of Akerman et al , only tested for identification of CRC screening tests. Beyond testing for knowledge of CRC screening in average-risk patients and with a family history of CRC, we also tested the important concept of differentiation between prevention and detection tests, which is acknowledged in the ACG and ACS guidelines. Residents were lacking knowledge in other areas of CRC screening, such as identifying tests other than colonoscopy, screening in African American patients, following up positive tests with colonoscopy, follow-up after colonoscopy findings, and surveillance for CRC in various diseases such as familial adenomatous polyposis, Lynch syndrome, and inflammatory bowel disease.
Our study showed that residents were knowledgeable about screening of average-risk patients with colonoscopy at age 50 years and those with a family history of CRC. Because ACS guidelines state that colonoscopy should be offered at age 40 years to patients with a family history of CRC in a first-degree relative at or over age 60 years and ACG guidelines state that screening in these patients should be the same as for average-risk patients, we considered both responses correct in our survey analysis. The areas that showed improved knowledge after use of the smartphone app were correctly identifying all of the CRC screening tests, differentiating between prevention and detection tests, and correctly identifying these tests. Also, the postsurvey results showed improved knowledge of screening tests that need to be followed by colonoscopy if the test result is positive. The areas that didn’t improve much were the follow-up of a screening colonoscopy in case of findings, as well as surveillance for CRC in various diseases.
Residents’ knowledge about alternative CRC screening methods is important, as some patients do not wish to have colonoscopies because of the invasive nature of the test. Residents can only offer alternative, less-invasive methods if they have knowledge about them. Although the use of screening colonoscopies has increased over the last few years, it is still far from the National Colorectal Cancer Roundtables’ goal of achieving 80% by 2018, and awareness of alternative methods is important in achieving this target. It is important for residents to know about follow-up after colonoscopy findings and surveillance for CRC in various diseases, as residents ultimately take care of the primary needs of these patients in the clinic.
Various educational strategies have been employed in the past for improving knowledge of CRC screening, ranging from didactic lectures, as shown by Lane et al , to an interactive case-based model, as shown by Schroy et al [ ]. These educational methods showed variable improvement in knowledge, and additional interventions may be needed to improve screening performance. In this modern era of smartphones and gadgets, developing a smartphone-based app or educational tool can work very well for residents’ education, as shown by Shaw and Tan [ ]. Using a smartphone app to improve internal medicine residents’ knowledge of CRC screening is a novel idea and worked very well in our study.
Our response rate was good, but our study was limited by being a single-center study with a small sample size. This intervention can be expanded to other institutions to determine the validity of our results in a multicenter setting. In addition, this study did not check whether the residents’ improved knowledge translated into their clinical practice in terms of an improved CRC screening rate. A multi-institutional study is being planned, and the original study will be expanded to determine the app’s effect on the screening rate. Here it is important to mention that, although this study was not intended to observe a change in practice, a few residents reported that the app was a readily available tool on their smartphone and was helpful to them when they encountered the issue of CRC screening of their patients in an outpatient setting.
While residents seem knowledgeable about colonoscopic CRC screening in average-risk patients, we found significant deficiencies in other areas of the comprehensive evaluation. A smartphone-based app or educational tool is a novel idea and can help improve residents’ knowledge about CRC screening. A smartphone-based educational tool can be a part of residents’ orientation before the start of their residency to reinforce their knowledge about age-appropriate and specific screenings.
ZK designed the study, developed the smartphone app, collected data, conducted statistical analysis, drafted the manuscript, did critical revision, and approved the final manuscript. UD, MN, BK, YAA, and YA collected data and drafted the manuscript. MAK designed the study, collected data, and critically revised the study. WB did statistical analysis and drafted the manuscript. TS and AN did a critical revision for intellectual content and gave final approval of the manuscript.
Conflicts of Interest
Multimedia Appendix 1
Survey form emailed via SurveyMonkey to residents.PDF File (Adobe PDF File), 33KB
Multimedia Appendix 2
Screening in average-risk patients and with a positive family history of colorectal cancer.PDF File (Adobe PDF File), 24KB
Multimedia Appendix 3
Identification of colorectal cancer screening tests.PDF File (Adobe PDF File), 32KB
Multimedia Appendix 4
Identification of colorectal cancer prevention methods.PDF File (Adobe PDF File), 31KB
Multimedia Appendix 5
Identification of colorectal cancer detection methods.PDF File (Adobe PDF File), 29KB
Multimedia Appendix 6
Identification of positive tests to be followed by colonoscopy.PDF File (Adobe PDF File), 33KB
Multimedia Appendix 7
Identification of follow-up after colonoscopy.PDF File (Adobe PDF File), 32KB
Multimedia Appendix 8
Identification of surveillance for colorectal cancer in various diseases.PDF File (Adobe PDF File), 30KB
- Jemal A, Siegel R, Xu J, Ward E. Cancer statistics, 2010. CA Cancer J Clin 2010;60(5):277-300 [FREE Full text] [CrossRef] [Medline]
- Edwards BK, Ward E, Kohler BA, Eheman C, Zauber AG, Anderson RN, et al. Annual report to the nation on the status of cancer, 1975-2006, featuring colorectal cancer trends and impact of interventions (risk factors, screening, and treatment) to reduce future rates. Cancer 2010 Feb 01;116(3):544-573 [FREE Full text] [CrossRef] [Medline]
- Vogelaar I, van Ballegooijen M, Schrag D, Boer R, Winawer SJ, Habbema JDF, et al. How much can current interventions reduce colorectal cancer mortality in the U.S.? Mortality projections for scenarios of risk-factor modification, screening, and treatment. Cancer 2006 Oct 01;107(7):1624-1633 [FREE Full text] [CrossRef] [Medline]
- American Cancer Society. Colorectal cancer facts & figures 2017-2019. Atlanta, GA: American Cancer Society; 2017. URL: https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/colorectal-cancer-facts-and-figures/colorectal-cancer-facts-and-figures-2017-2019.pdf [accessed 2018-03-08] [WebCite Cache]
- Mariotto AB, Yabroff KR, Shao Y, Feuer EJ, Brown ML. Projections of the cost of cancer care in the United States: 2010-2020. J Natl Cancer Inst 2011 Jan 19;103(2):117-128 [FREE Full text] [CrossRef] [Medline]
- May FP, Glenn BA, Crespi CM, Ponce N, Spiegel BMR, Bastani R. Decreasing black-white disparities in colorectal cancer incidence and stage at presentation in the United States. Cancer Epidemiol Biomarkers Prev 2017 May;26(5):762-768. [CrossRef] [Medline]
- Aleksandrova K, Pischon T, Jenab M, Bueno-de-Mesquita HB, Fedirko V, Norat T, et al. Combined impact of healthy lifestyle factors on colorectal cancer: a large European cohort study. BMC Med 2014 Oct 10;12:168 [FREE Full text] [CrossRef] [Medline]
- Kabat GC, Matthews CE, Kamensky V, Hollenbeck AR, Rohan TE. Adherence to cancer prevention guidelines and cancer incidence, cancer mortality, and total mortality: a prospective cohort study. Am J Clin Nutr 2015 Mar;101(3):558-569 [FREE Full text] [CrossRef] [Medline]
- Song M, Giovannucci E. Preventable incidence and mortality of carcinoma associated with lifestyle factors among white adults in the United States. JAMA Oncol 2016 Sep 01;2(9):1154-1161 [FREE Full text] [CrossRef] [Medline]
- Meester RGS, Doubeni CA, Zauber AG, Goede SL, Levin TR, Corley DA, et al. Public health impact of achieving 80% colorectal cancer screening rates in the United States by 2018. Cancer 2015 Jul 01;121(13):2281-2285 [FREE Full text] [CrossRef] [Medline]
- National Center for Health Statistics. Health, United States, 2015: With Special Feature on Racial and Ethnic Disparities. Report No: 2016-1232. Hyattsville, MD: National Center for Health Statistics; May 2016.
- Wong RJ. Marked variations in proximal colon cancer survival by race/ethnicity within the United States. J Clin Gastroenterol 2010 Oct;44(9):625-630. [CrossRef] [Medline]
- Rex DK, Johnson DA, Anderson JC, Schoenfeld PS, Burke CA, Inadomi JM, American College of Gastroenterology. American College of Gastroenterology guidelines for colorectal cancer screening 2009 [corrected]. Am J Gastroenterol 2009 Mar;104(3):739-750. [CrossRef] [Medline]
- Levin B, Lieberman DA, McFarland B, Smith RA, Brooks D, Andrews KS, American Cancer Society Colorectal Cancer Advisory Group, US Multi-Society Task Force, American College of Radiology Colon Cancer Committee. Screening and surveillance for the early detection of colorectal cancer and adenomatous polyps, 2008: a joint guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology. CA Cancer J Clin 2008;58(3):130-160 [FREE Full text] [CrossRef] [Medline]
- Bibbins-Domingo K, Grossman DC, Curry SJ, Davidson KW, Epling JW, García FAR, et al. Screening for colorectal cancer: US Preventive Services Task Force recommendation statement. JAMA 2016 Jun 21;315(23):2564-2575. [CrossRef] [Medline]
- Akerman S, Aronson SL, Cerulli MA, Akerman M, Sultan K. Resident knowledge of colorectal cancer screening assessed by web-based survey. J Clin Med Res 2014 Apr;6(2):120-126 [FREE Full text] [CrossRef] [Medline]
- Borum ML. Cancer screening in women by internal medicine resident physicians. South Med J 1997 Nov;90(11):1101-1105. [Medline]
- Borum ML. Medical residents' colorectal cancer screening may be dependent on ambulatory care education. Dig Dis Sci 1997 Jun;42(6):1176-1178. [Medline]
- Kerns JW, Krist AH, Woolf SH, Flores SK, Johnson RE. Patient perceptions of how physicians communicate during prostate cancer screening discussions: a comparison of residents and faculty. Fam Med 2008 Mar;40(3):181-187 [FREE Full text] [Medline]
- An PG, Ashburner JM, Fosburgh BW, Atlas SJ. Performance on preventive cancer screening tests in the ambulatory setting by internal medicine resident physicians. Teach Learn Med 2010 Jan;22(1):45-49. [CrossRef] [Medline]
- Ward SH, Parameswaran L, Bass SB, Paranjape A, Gordon TF, Ruzek SB. Resident physicians' perceptions of barriers and facilitators to colorectal cancer screening for African Americans. J Natl Med Assoc 2010 Apr;102(4):303-311. [Medline]
- Caines LC, Brockmeyer DM, Tess AV, Kim H, Kriegel G, Bates CK. The revolving door of resident continuity practice: identifying gaps in transitions of care. J Gen Intern Med 2011 Sep;26(9):995-998 [FREE Full text] [CrossRef] [Medline]
- Rex DK, Boland CR, Dominitz JA, Giardiello FM, Johnson DA, Kaltenbach T, et al. Colorectal cancer screening: recommendations for physicians and patients from the U.S. Multi-Society Task Force on Colorectal Cancer. Am J Gastroenterol 2017 Jul;112(7):1016-1030. [CrossRef] [Medline]
- Sharma VK, Corder FA, Raufman JP, Sharma P, Fennerty MB, Howden CW. Survey of internal medicine residents' use of the fecal occult blood test and their understanding of colorectal cancer screening and surveillance. Am J Gastroenterol 2000 Aug;95(8):2068-2073. [CrossRef] [Medline]
- Sharma VK, Vasudeva R, Howden CW. Colorectal cancer screening and surveillance practices by primary care physicians: results of a national survey. Am J Gastroenterol 2000 Jun;95(6):1551-1556. [CrossRef] [Medline]
- Willett LL, Palonen K, Allison JJ, Heudebert GR, Kiefe CI, Massie FS, et al. Differences in preventive health quality by residency year. Is seniority better? J Gen Intern Med 2005 Sep;20(9):825-829 [FREE Full text] [CrossRef] [Medline]
- Lane DS, Messina CR, Cavanagh MF, Chen JJ. A provider intervention to improve colorectal cancer screening in county health centers. Med Care 2008 Sep;46(9 Suppl 1):S109-S116. [CrossRef] [Medline]
- Schroy PC, Glick JT, Geller AC, Jackson A, Heeren T, Prout M. A novel educational strategy to enhance internal medicine residents' familial colorectal cancer knowledge and risk assessment skills. Am J Gastroenterol 2005 Mar;100(3):677-684. [CrossRef] [Medline]
- Shaw CM, Tan SA. Integration of mobile technology in educational materials improves participation: creation of a novel smartphone application for resident education. J Surg Educ 2015;72(4):670-673. [CrossRef] [Medline]
|ACS: American Cancer Society|
|ACG: American College of Gastroenterology|
|CRC: colorectal cancer|
|CT: computed tomography|
|FIT: fecal immunochemical test|
|PGY: postgraduate year|
|USPSTF: US Preventive Services Task Force|
Edited by G Eysenbach; submitted 11.12.17; peer-reviewed by A Koskan, W Leclercq, I Wani; comments to author 24.01.18; revised version received 11.02.18; accepted 11.02.18; published 13.03.18
©Zubair Khan, Umar Darr, Muhammad Ali Khan, Mohamad Nawras, Basmah Khalil, Yousef Abdel-Aziz, Yaseen Alastal, William Barnett, Thomas Sodeman, Ali Nawras. Originally published in JMIR Medical Education (http://mededu.jmir.org), 13.03.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on http://mededu.jmir.org/, as well as this copyright and license information must be included.