Faculty Bibliography

BACKGROUND:Few programs train residents in recognizing and responding to distressed colleagues at risk for suicide. AIM/OBJECTIVE:To assess interns' ability to identify a struggling colleague, describe resources, and recognize that physicians can and should help colleagues in trouble. SETTING/METHODS:Residency programs at an academic medical center. PARTICIPANTS/METHODS:One hundred forty-five interns. PROGRAM DESIGN/UNASSIGNED:An OSCE case was designed to give interns practice and feedback on their skills in recognizing a colleague in distress and recommending the appropriate course of action. Embedded in a patient "sign-out" case, standardized health professionals (SHP) portrayed a resident with depressed mood and an underlying drinking problem. The SHP assessed intern skills in assessing symptoms and directing the resident to seek help. PROGRAM EVALUATION/RESULTS:Interns appreciated the opportunity to practice addressing this situation. Debriefing the case led to productive conversations between faculty and residents on available resources. Interns' skills require further development: while 60% of interns asked about their colleague's emotional state, only one-third screened for depression and just under half explored suicidal ideation. Only 32% directed the colleague to specific resources for his depression (higher among those that checked his emotional state, 54%, or screened for depression, 80%). DISCUSSION/CONCLUSIONS:This OSCE case identified varying intern skill levels for identifying and assessing a struggling colleague while also providing experiential learning and supporting a culture of addressing peer wellness.

It is highly unusual for learners to leave medical training in the United States even though some individuals' goals may change and others may not achieve expected competence. There are a number of possible reasons for this: (1) students may feel that they have progressed too far into their careers and amassed too much debt to leave medical training; (2) students may be allowed to graduate despite marginal performance; and (3) students may have entered medical training with risk factors for poor performance that were not addressed. As stewards of the educational process, medical educators have an ethical obligation to students and the public to create off-ramps, or points along the educational continuum at which learners can reassess their goals and educators can assess competence, that allow students to leave medicine.Given the nationwide focus on physician health and wellness, the authors believe the creation of options to leave medical training without compromising one's self-esteem or incurring unmanageable debt (i.e., compassionate off-ramps) is a moral imperative. The practice of medicine should not be an exercise in survival; it should allow people to develop and thrive over the course of their careers. Offering students options to make use of the medical competencies they have accumulated in other attractive careers would enable medical educators to behave compassionately toward individual students and fulfill their societal obligation to graduate competent and committed physicians. To this end, the authors present six recommendations for consideration.

Background: Asthma education should focus on patient self-management support. Objective structured clinical examinations (OSCEs), as measured by standardized patients (SPs), provide a controlled, simulated setting for timed competency assessments while Unannounced Standardized Patients (USPs) measure clinical skills transfer in real world clinical settings. Both enable us to assess skills critical for providing quality care to patients. Learners seeing USPs have added real world stressors such as clinical load. This study describes differences in education and activation skills in two assessment contexts.
Method(s): A cohort of primary care residents (n=20) were assessed during two time points: an OSCE and a USP visit at an urban, safety-net clinic from 2009-2010. Residents consented to use of their de-identified routine educational data for research. The SP and USPs presented with the same case; a female asthmatic patient with limited understanding of illness management and concern over symptom exacerbation. Providers were rated using a behaviorally-anchored checklist upon visit completion. Competency domains assessed included patient education (4 items) and activation (4 items). Within the education domain, items included illness management, while the activation domain items assessed resident communication/counseling style. Responses were scored as not done or well done. Summary scores (mean % well done) were calculated by domain. OSCE vs USP means were compared using a paired samples t-test.
Result(s): Residents were more likely to offer an oral steroid as treatment in the OSCE case (50% vs. 35% for USPs), but performed better with USPs on most other items including domain scores. Residents seeing a USP scored significantly higher on five out of eight individual assessment items (p<.05) including recommending a spacer, helping a patient understand their condition, making patients feel like they can take control of their own health, helping a patient understand illness management, and having a patient leave feeling confident in finding solutions independently. Inhaler technique was assessed rarely in either setting (OSCE: 15%, USP: 5%). Domain summary scores (% well done) from the OSCE (activation: 12%, education: 31%) were lower than USP scores (activation: 84%, education: 37%), with differences in overall activation scores being significant (t(19)=-8.905, p<.001).
Conclusion(s): OSCEs are a widely accepted tool for measuring resident competency in a standardized environment but may be focused primarily on knowledge and technical skills. While SPs are trained to be as objective as possible, rater bias might impact scores. USPs may provide more nuanced assessments of communication skills in a setting with reduced time constraints. Next steps include examining attitudes toward OSCEs vs the clinical setting, looking at impact of provider gender, and examining setting-specific issues that promote or hinder high quality care

Background: The core Entrustable Professional Activities medical school graduates should be able to perform on day 1 of residency provides a framework for readiness for residency. Communication skills are an essential foundation for these core EPAs and yet there have been few studies that describe communication competence across the UME-GME continuum. We report on our OSCE-based assessment of communication skills from the first few weeks of medical school to the first year of medicine residency.
Method(s): Assessment of communication is consistent in our OSCE program across UME and GME. Domains include Information Gathering (5 items), Relationship Development (6 items), and Patient Education (3 items) and these are assessed via a behaviorally anchored checklist (scores=% well done) that has strong reliability and validity evidence. In this study, we report on 3 multi-station OSCEs: the Introductory Clinical Experience (ICE) OSCE that occurs within the first weeks of medical school; the high-stakes, pass/fail Comprehensive Clinical Skills Examination (CCSE) OSCE that is fielded after clerkship year; and the Medicine Residency Program's PGY 1 OSCE. Across 3 classes of medical school (2014-2016) we have complete data for the 24 students who continued on in our Medicine Residency (and who provided consent to include their educational data in an IRB-approved registry). Analyses focus on differences in communication skills over time and between cohorts and the relationship between communication skills measured in medical school and those assessed in residency.
Result(s): Communication scores show significant improvement through medical school (but not into residency) in Information gathering (ICE mean=56%; CCSE mean=76%; PGY1 mean=77%) (F=11.54, p<.001, ICE< CCSE) and in relationship development (ICE=59%; CCSE=78%; PGY1= 74% (F=10.68, p<.001, ICE < CCSE). Mean patient education skills, however, increase significantly across all 3 time points (32% to 50% to 65%; F=31.00, p<.001). Patterns are similar across cohorts except that the Class of 2016 means increase from CCSE to PGY1. Regression analyses show that CCSE information gathering scores are more strongly associated with PGY performance than ICE scores (Std Beta=.32 vs.06), while for relationship development, it is the ICE scores that are more strongly associated (Std Beta=.40 vs.24). ICE and CCSE patient education skills have associations with PGY1 skill of similar size (Std Beta=.30 and.28).
Conclusion(s): Findings, despite the small sample, suggest a clear developmental trajectory for communication skills development and that information gathering and patient education skills may be more influenced by medical school than relationship development. That communication skills seem to level out in PGY1 highlights need for re-consolidation as clinical complexity increases. Results can inform theory development on how communication skills develop and point to transitions where skills practice/feedback may be particularly important

Background: For quality care, physicians must be skilled in diagnosing and treating chronic pain. Some studies have shown gender differences in how providers manage pain. And more broadly, female providers provide more patient-centered communication which in turn has been linked to patient activation and satisfaction with care. We explore, using Unannounced Standardized Patients (USPs), whether resident physician gender is associated with the core underlying skills needed to effectively diagnose and management chronic pain: communication, patient centeredness, and patient activation.
Method(s): We designed two USP cases and sent these undercover patients into primary care clinics at two urban, safety-net clinics. The USP cases were similar: a 30-35 y.o. male, presented as a new patient to the clinic with either shoulder pain induced by heavy lifting or knee pain due to a recreational sports injury. USPs completed a post-visit checklist that assessed patient satisfaction (4 items), patient activation (3 items), and communication skills (13 items) using a behaviorally-anchored scale (not done or partly done vs. well done). Summary scores were calculated for each of the three domains. Residents provided consent for their educational data to be used for research as part of an IRB-approved medical education registry.
Result(s): A total of 135 USP visits (80 female providers, 55 male) occurred between 2012 and 2018. Female providers saw 41 shoulder pain and 39 knee pain cases while male providers saw 21 shoulder and 34 knee cases. ANOVA was used to assess differences in summary scores by provider gender (male vs female) and by case portrayed (knee vs shoulder). Skills did not differ significantly by whether knee or shoulder pain case. Gender effects were not seen for patient centeredness or for patient activation; however female providers performed significantly better at relationship development (83% vs males 72% shoulder pain; 70% vs 66% knee pain case; p<.001) and information gathering (86% vs. males 72% shoulder pain; 79% vs66% in knee case; p<.016). Male providers, however, performed slightly better in patient education and counseling (65% vs 63% for shoulder and 38% vs 33% for knee cases; p<.001).
Conclusion(s): Developing a relationship and gathering information are critical to pain management and female residents performed better than male residents in these areas. Male providers performed slightly better than women in patient education and provider gender was not associated with any differences in patient centeredness or activation. In the future, we plan to link these underlying skills to pain management decisions, documentation and ultimately to patient outcomes. We suspect that patient activation may best be measured at follow-up, something not possible with our current USP methodology. Gender differences could be viewed as striking in the context of our relatively homogeneous sample (medicine residency program) and shared clinical environment/healthcare system

Background: To foster patient engagement and trust, cardiovascular procedural informed consent (IC) discussions must go beyond the routine of risks vs benefits and incorporate shared decision making (SDM). Most trainees report learning the IC process through peer observation with little emphasis on skills that enable SDM. Experiential learning with immediate faculty feedback may make it more likely that fellows incorporate these critical advanced skills into their IC practice. Method(s): We developed 3 observed structured clinical examination (OSCE) cases designed to highlight all aspects of the IC discussion for invasive cardiac procedures. We adapted validated standardized patient checklists and created a faculty observation and feedback tool. After the program, fellows completed a survey assessing the likelihood they would incorporate SDM skills into their practice. Result(s): 28 cardiology fellows successfully completed the IC OSCE. Figure 1 demonstrates that while the majority of fellows reported already routinely discussing risks and alternatives a minority reported using patient engagement skills. The majority reported they are very likely to incorporate these assessments into practice. Conclusion(s): Cardiology fellows participating in this formative IC OSCE identified SDM skills they intend to incorporate into their IC discussion practice. The clinical impact of teaching high level learners important patient engagement skills via this approach should be further studied. [Figure presented]2019 American College of Cardiology Foundation. All rights reserved

OBJECTIVE:To provide evidence for the validity of an Introductory Clinical Experience (ICE) that was implemented as a baseline assessment of medical students' clinical communication skills to support progression of skills over time. METHODS:In this longitudinal study of communication skills, medical students completed the ICE, then a Practice of Medicine (POM) Objective Structured Clinical Exam 8 months later, and the Comprehensive Clinical Skills Exam (CCSE) 25 months later. At each experience, trained Standardized Patients assessed students, using the same behaviorally anchored checklist in 3 domains: Information Gathering, Relationship Development, and Patient Education and Counseling (PEC) with good internal reliability (.70-.87). Skills development patterns were described. ICE as a predictor of later performance was explored. Students' perspectives were elicited. RESULTS: = .48, large effect), in 4 patterns. ICE and POM scores predicted future communication skills. Most students recognized the educational value of ICE. CONCLUSION/CONCLUSIONS:Entering medical students' clinical communication skills increase over time on average and may predict future performance. PRACTICE IMPLICATIONS/CONCLUSIONS:Implementing an ICE is likely a valid strategy for monitoring progress and facilitating communication skills development.