Is time really of the essence? Timeliness of narrative feedback in ophthalmology CBME assessments

References

• Bismil R, Dudek NL, Wood TJ. 2014. In-training evaluations: developing an automated screening tool to measure report quality. Med Educ. 48(7):724–732. doi: 10.1111/medu.12490.
   PubMed Web of Science ®Google Scholar
• Branfield Day L, Rassos J, Billick M, Ginsburg S. 2022. Next steps are…’: an exploration of coaching and feedback language in EPA assessment comments. Med Teach. 44(12):1368–1375. doi: 10.1080/0142159X.2022.2098098.
   PubMed Web of Science ®Google Scholar
• Chan TM, Sebok-Syer SS, Sampson C, Monteiro S. 2020. The quality of assessment of learning (qual) score: validity evidence for a scoring system aimed at rating short, workplace-based comments on trainee performance. Teach Learn Med. 32(3):319–329. doi: 10.1080/10401334.2019.1708365.
   PubMed Web of Science ®Google Scholar
• Cohen GS, Blumberg P, Ryan NC, Sullivan PL. 1993. Do final grades reflect written qualitative evaluations of student performance? Teach Learn Med. 5(1):10–15. doi: 10.1080/10401339309539580.
   Google Scholar
• Curtis R, Moon CC, Hanmore T, Hopman W, Baxter S. 2023. Evaluating the effect of assessment form design on the quality of feedback in one Canadian ophthalmology residency program as an early adopter of CBME. Can J Ophthalmol. 58(4):e149–e150. doi: 10.1016/j.jcjo.2023.01.003.
   PubMed Web of Science ®Google Scholar
• Dudek NL, Marks MB, Wood TJ, Curtis Lee A. 2008. Assessing the quality of supervisors’ completed clinical evaluation reports. Med Educ. 42(8):816–822. doi: 10.1111/j.1365-2923.2008.03105.x.
   PubMed Web of Science ®Google Scholar
• Ginsburg S, van der Vleuten CP, Eva KW. 2017. The hidden value of narrative comments for assessment: a quantitative reliability analysis of qualitative data. Acad Med. 92(11):1617–1621. doi: 10.1097/ACM.0000000000001669.
   PubMed Web of Science ®Google Scholar
• Ginsburg S, Watling CJ, Schumacher DJ, Gingerich A, Hatala R. 2021. Numbers encapsulate, words elaborate: toward the best use of comments for assessment and feedback on entrustment ratings. Acad Med. 96(7S):S81–S86. doi: 10.1097/ACM.0000000000004089.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Lobst WF. 2000. Assessment guidebook. [accessed 2023 Jan 27]. https://www.acgme.org/globalassets/pdfs/milestones/guidebooks/assessmentguidebook.pdf
   Google Scholar
• Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. 2010. The role of assessment in competency-based medical education. Med Teach. 32(8):676–682. doi: 10.3109/0142159X.2010.500704.
   PubMed Web of Science ®Google Scholar
• Iobst WF, Holmboe ES. 2020. Programmatic assessment: the secret sauce of effective CBME implementation. J Grad Med Educ. 12(4):518–521. doi: 10.4300/JGME-D-20-00702.1.
   PubMedGoogle Scholar
• Kim MJ, Williams RG, Boehler ML, Ketchum JK, Dunnington GL. 2009. Refining the evaluation of operating room performance. J Surg Educ. 66(2):64. doi: 10.1016/j.jsurg.2009.09.005.
   Google Scholar
• Leclair R, Ho JSS, Braund H, Kouzmina E, Bruzzese S, Awad S, Mann S, Zevin B. 2023. Exploring the quality of narrative feedback provided to residents during ambulatory patient care in medicine and surgery. J Med Educ Curric Dev. 10:23821205231175734. doi: 10.1177/23821205231175734.
   Web of Science ®Google Scholar
• Lefroy J, Watling C, Teunissen PW, Brand P. 2015. Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education. Perspect Med Educ. 4(6):284–299. doi: 10.1007/S40037-015-0231-7.
   PubMed Web of Science ®Google Scholar
• Lockyer J, Carraccio C, Chan MK, Hart D, Smee S, Touchie C, Holmboe ES, Frank JR. 2017. Core principles of assessment in competency-based medical education. Med Teach. 39(6):609–616. doi: 10.1080/0142159X.2017.1315082.
   PubMed Web of Science ®Google Scholar
• Marcotte L, Egan R, Soleas E, Dalgarno N, Norris M, Smith C. 2019. Assessing the quality of feedback to general internal medicine residents in a competency-based environment. Can Med Ed J. 10(4):e32–e47. doi: 10.36834/cmej.57323.
   PubMedGoogle Scholar
• Ramani S, Könings KD, Ginsburg S, Pm van der Vleuten C. 2019. Feedback redefined: principles and practice. J Gen Intern Med. 34(5):744–749. doi: 10.1007/s11606-019-04874-2.
   PubMed Web of Science ®Google Scholar
• Ramani S, Krackov SK. 2012. Twelve tips for giving feedback effectively in the clinical environment. Med Teach. 34(10):787–791. doi: 10.3109/0142159X.2012.684916.
   PubMed Web of Science ®Google Scholar
• Ross S, Huie M, Schipper S. 2015. Use words that count: a content analysis to identify words and phrases that commonly appear in effective formative feedback. International Conference on Residency Education; Vancouver, Canada.
   Google Scholar
• Ross S, Hamza D, Zulla R, Stasiuk S, Nichols D. 2022. Development of and preliminary validity evidence for the EFeCT feedback scoring tool. J Graduate Med Educ. 14(1):71–79. doi: 10.4300/JGME-D-21-00602.1.
   PubMedGoogle Scholar
• Tekian A, Soo Park Y, Tilton S, Prunty PF, Abasolo E, Zar F, Cook DA. 2019. Competencies and feedback on internal medicine residents’ end-of-rotation assessments over time: qualitative and quantitative analyses. Acad Med. 94(12):1961–1969. doi: 10.1097/ACM.0000000000002821.
   PubMed Web of Science ®Google Scholar
• Watling CJ, Kenyon CF, Zibrowski EM, Schulz V, Goldszmidt MA, Singh I, Maddocks HL, Lingard L. 2008. Rules of engagement: residents’ perceptions of the in-training evaluation process. Acad Med. 83:S97–S100. doi: 10.1097/ACM.0b013e318183e78c.
   PubMed Web of Science ®Google Scholar
• Williams RG, Chen X, Sanfey H, Markwell SJ, Mellinger JD, Dunnington GL. 2014. The measured effect of delay in completing operative performance ratings on clarity and detail of ratings assigned. J Surg Educ. 71(6):e132–38–e138. doi: 10.1016/j.jsurg.2014.06.015.
   Google Scholar