Faculty Bibliography

OBJECTIVE:To evaluate a pediatric otoscopy curriculum with the use of outcome measures that included assessment of skills with real patients. METHODS:Thirty-three residents in an intervention group from 2 institutions received the curriculum. In the previous year, 21 residents in a nonintervention group did not receive the curriculum. Both groups were evaluated at the beginning and end of their internship years with the use of the same outcome assessments: 1) a written test, 2) an objective standardized clinical examination (OSCE), and 3) direct observation of skills in real patients with the use of a checklist with established validity. RESULTS:The intervention group had a significant increase in percentage reaching minimum passing levels between the beginning and end of the internship year for the written test (12% vs 97%; P < .001), OSCE (0% vs 78%; P < .001), and direct observation (0% vs 75%; P < .001); significant mean percentage gains for the written test (21%; P < .001), OSCE (28%; P < .001), and direct observation (52%; P = .008); and significantly higher (P < .001) mean percentage gains than the nonintervention group on the written test, OSCE, and direct observation. The nonintervention group did not have a significant increase (P = .99) in percentage reaching minimum passing levels, no significant mean percentage gains in the written test (2.7%; P = .30) and direct observation (6.7%; P = .61), and significant regression in OSCE (-5.2%; P = .03). CONCLUSIONS:A pediatric otoscopy curriculum with multimodal outcome assessments was successfully implemented across different specialties at multiple institutions and found to yield gains, including in skills with real patients.

Rigorous medical education research is critical to effectively develop and evaluate the training we provide our learners. Yet, many clinical medical educators lack the training and skills needed to conduct high quality medical education research. This paper offers guidance on conducting sound quantitative medical education research. Our aim is to equip readers with the key skills and strategies necessary to conduct successful research projects, highlighting new concepts and controversies in the field. We utilize Glassick's criteria for scholarship as a framework to discuss strategies to ensure that the research question of interest is worthy of further study and how to use existing literature and conceptual frameworks to strengthen a research study. Through discussions of the strengths and limitations of commonly used study designs, we expose the reader to particular nuances of these decisions in medical education research and discuss outcomes generally focused upon, as well as strategies for determining the significance of consequent findings. We conclude with information on critiquing research findings and preparing results for dissemination to a broad audience. Practical planning worksheets and comprehensive tables illustrating key concepts are provided in order to guide researchers through each step of the process. Medical education research provides wonderful opportunities to improve how we teach our learners, to satisfy our own intellectual curiosity and ultimately, to enhance the care provided to patients.

BACKGROUND:The serious consequences of inaccurate diagnosis of acute otitis media have led to a call for greater education to develop proficient pediatric otoscopy skills. Despite the clinical and educational needs, peer-reviewed standardized curricula with validated assessment instruments remain limited. This study evaluated a pediatric otoscopy curriculum incorporated into the Pediatric medical student clerkship with use of outcome measures that included assessment of skills with real patients. The objective was to determine whether students who received the intervention would demonstrate significant gains in pediatric otoscopy skills when compared with students with only routine immersion learning exposure. METHODS:During their Pediatric clerkship, an intervention group (IG) of 100 medical students received routine instruction and a curriculum intervention. A non-intervention group (NIG) of 30 students received only routine instruction. Outcome measures included written tests and assessment of skills with real patients. A retention group (RG) consisted of 79 students in the IG who completed a written test at the end of medical school. Paired t-tests were used to compare differences in pre-intervention, post-intervention, and retention scores for the IG, NIG, and RG, while analysis of covariance tests were used to compare differences in scores between the IG and NIG. RESULTS:Pre-intervention scores were similar for the IG and NIG for the written test (mean/SD of 12.9/2.9 for IG and 12.9/1.8 for NIG, p = 0.78) and skills checklist (mean/SD of 11.1/4.4 for IG and 10.9/4.0 for NIG, p = 0.88). The IG had significantly higher post-intervention scores than the NIG for the written test (mean/SD of 22.6/1.7 for IG and 13.9/2.5 for NIG, p < 0.001) and skills checklist (mean/SD of 19.2/3.4 for IG and 11.0/3.8 for NIG, p < 0.001). The IG also had significantly higher gain in scores than the NIG for the written test (mean/SD +9.6/2.8 for IG and +1.0/2.3 for NIG, p < 0.001) and skills checklist (mean/SD of +8.1/4.8 for IG and +0.1/4.5 for NIG, p < 0.001). For the RG, there was a significant decrease (p < 0.001) from the post-intervention scores to retention scores (mean/SD of -7.4/2.7) but a significant increase (p < 0.001) from the pre-intervention score to retention score (mean + 2.6/3.3). CONCLUSIONS:Medical students who received a formal curriculum intervention demonstrated significant gains in pediatric otoscopy skills when compared with students with only routine immersion learning exposure. However, learning gains diminished over time, emphasizing the need for continued practice opportunities to reinforce students' skills. Our study provides a formal curriculum to meet identified educational gaps in the important topic of pediatric otoscopy and offers a model for teaching of other clinical skills using rigorous outcome measures including assessment of skills in real patients.

PURPOSE:The recruitment and retention of community preceptors to teach medical students is difficult. The authors sought to characterize the underlying motivational factors for becoming a preceptor and to identify strategies for recruiting and retaining community-based pediatric preceptors. METHOD:This multicenter qualitative action study included semistructured interviews with community-based pediatric preceptors affiliated with 12 institutions from August to December 2015. Only active preceptors were included, and participating institutions were diverse with respect to geographic location and class size. Interviews were conducted over the telephone and transcribed verbatim. Six investigators used deidentified transcripts to develop a codebook. Through a constant comparative method, codes were revised as data were analyzed and disagreements were resolved through discussion. All investigators organized the themes into dimensions. RESULTS:Fifty-one preceptors were interviewed. Forty-one themes coalesced into four dimensions: (1) least liked aspects of teaching, (2) preparation to teach, (3) inspiration to teach, and (4) ways to improve recruitment and retention. Time constraints and patient care demands were the most commonly cited deterrents to teaching. Successful preceptors balanced their clinical demands with their desire to teach using creative scheduling. External rewards (e.g., recognition, continuing medical education credit) served as incentives. Internal motivation inspired participants to share their enthusiasm for pediatrics and to develop longitudinal relationships with their learners. CONCLUSIONS:Changes in health care delivery have imposed more time constraints on community-based preceptors. However, this study identified underlying factors motivating physicians to volunteer as preceptors. Strategies to recruit new and retain current preceptors must be collaborative.