Faculty Bibliography

BACKGROUND: Safe, high quality outpatient care often depends on the degree to which patients understand their situation and how to follow through on physician recommendations. However, we do not know enough about how often physicians focus on ensuring that their patients have achieved these understandings by the end of the visit and whether such end-of-visit practices are associated with physicians' communication, patient education and activating skills. METHODS: Two Unannounced Standardized Patient cases (highly trained actors who present as real patients) were delivered to 71 internal medicine residents in two clinics: one required the physician to identify a patient's depression and engage him in follow-up care, and the other required the physician to recognize a patient's failure to use her asthma medicine correctly and educate her in using it properly. End-of-visit practices were: reviewing the plan; asking if further questions; giving information about follow-up care and further contact; and helping the patient navigate the system in order to follow through on next steps. Each was assessed by the SP as not done, partly done, or well done. SPs also rated physicians' communication skills, patient activating skills, and case-specific education skills. Summary scores were calculated as% of items well done. RESULTS: Close to three-quarters of the physicians reviewed the plan with the patient and invited further questions in the depression case and slightly more than half did so in the asthma case (56 and 60%). Patients were given complete information about follow-up care and how to navigate the system in just under half of depression visits (49 and 47%) and just over half of asthma visits (58 and 58%). On average, residents were rated as performing 61% of these 8 items well (SD 28%) across both cases. Primary care residents performed significantly better than categorical internal medicine residents (67%vs 47%, p = .004). There were no differences by physician gender. End of visit scores were significantly positively correlated with both general and casespecific clinical skills, and after controlling for the variance contributed by the program (R2 = 12%, p = .004), case-specific education scores explained 10% of the variance in end of visit score (p = .005), patient activating skills 10% of the variance (p = .002) and communication skills 13% of the variance (p = .001). With all variables in the model, only the general communication domain of patient education and counseling was independently associated with end of visit scores (Std Beta = .35, p = .015). CONCLUSIONS: Had these patients been real patients, in one-quarter to onehalf of the visits, the patient would have left not fully understanding the plan or how to follow-through on care. Resident physicians with more effective communication and patient activating skills tended to provide safer end-of-visit care, suggesting that these may reflect an outpatient safety orientation or skillset

BACKGROUND: Training residents to effectively practice value-based care is challenging. We hypothesized that residents with better communication skills would order fewer unnecessary tests and prescribe more appropriate care. We used a USP case of a patient with uncontrolled asthma to examine the relationship between value-based care and communication skills. METHODS: A 25 year-old female USP presented as a new patient to a medicine resident's clinic, reporting asthma since childhood with worsening symptoms over the past few months. At the time of the visit, she was using her albuterol inhaler multiple times daily, without any additional asthma treatment, and was unsure whether she was using it properly. Data was collected using two forms of assessment: a post-visit USP checklist and a systematic review of the corresponding clinic note to examine treatment recommendations including referrals and quality of documentation. The USP checklist measured communication, patient education, and assessment skills. Each response option included descriptive behavioral anchors and was rated as not done, partly done, or well done. Domain scores were calculated as percent items rated well done. RESULTS: 141 USP visits were made from 2009 to 2016 with a mean visit length = 88 min, SD= 28 min (range: 40 to 180 min). Almost all residents (92%) evaluated the patient's asthma with a pulmonary examination. The most common treatment prescribed was albuterol and an inhaled steroid, with or without a spacer (79%). The majority of residents (53%) did not order any additional studies; 21% ordered one study, and 26% ordered two or more studies. Study orders fell into one of three categories: gold (appropriate/recommended: PFTs, flu shot, HIV), grey (pulmonary consult, HCG), or inappropriate (TSH, A1C). Across the 141 visits, 129 studies were ordered; 46% were gold, 5% were grey, and 49% were inappropriate. The most common study ordered was a PFT (31%). 87% of single study orders were gold, but 92% of multiple orders included at least one inappropriate study. Residents who did not order any studies had significantly higher patient education and counseling skills than residents who ordered one or more studies (54% vs 34%, p = 0.00) and were more likely to explain how to correctly use an inhaler than residents who ordered one or more studies (48% vs 27%, p = 0.01). These residents also had significantly higher management and treatment skills (61% vs 39%, p = 0.00) and overall communication skills (68% vs 55%, p = 0.01). There were no significant differences between groups in medications prescribed or in quality of documentation. CONCLUSIONS: Effective communication skills may contribute to valuebased care through appropriate patient education and ordering of fewer inappropriate studies. Rigorous curricula and assessment of resident's patient education skills should be in place to help both patients and health care system achieve value-based care

BACKGROUND: All physicians need to be skilled at diagnosing, treating, and managing depression. We designed an unannounced standard patient (USP) case to assess residents' clinical skills in addressing depression and explored how those skills are associated with residents' general clinical skills in order to design targeted curriculum on depression. METHODS: The USP was a 26 y.o. male presenting as a new patient to a clinic complaining of fatigue and problems sleeping. Goals of the case were to diagnose a common presentation of depression and make a treatment/follow-up plan. The USP was trained to have a positive PHQ 2 &PHQ 9, family history of depression, and be willing to engage in medication and/or therapy if offered. A post-visit checklist was used by the SPs to assess communication, patient education, and assessment skills using behaviorally anchored items rated as not done, partly done, or well done. A systematic chart review was conducted to examine treatment, quality of documentation, and referrals. Case fidelity was checked by audiotape and confirmed by PHQ 9 score in the EHR. Evidence based treatment was defined as prescribing an SSRI and/or providing a psychiatric referral; if neither of those, scheduling follow-up for within 2 weeks. RESULTS: 122 residents saw the USP case from 2009-2015. Mean visit length = 45 min, SD 25 (14 to 183 min). The patient was screened for depression with a PHQ 2 in 93% of visits; 82% also had a PHQ 9. Overall, 77 residents (63%) provided appropriate treatment: 8% prescribed an SRRI, 23% provided a referral, 19% did both, 7% prescribed a sleep aid and <2 week follow-up, and 43% provided a combination of these treatments. 45 residents (37%) did not provide appropriate treatment: 27 (60%) prescribed a sleep aid and follow-up >2 weeks and 18 (40%) provided no treatment/referral and follow-up >2 weeks. There were no differences in exploration of medical history or substance use, but 83% of residents who treated appropriately had a PHQ 9 compared to 62% of residents who did not treat appropriately. 71% also included depression on the problem list compared to 13%of residents who did not treat appropriately. Residents who treated appropriately had significantly better clinical skills assessed by the USP including: overall communication (71% vs. 54%, p = 0.00), information gathering (72% vs. 55%, p = 0.01), relationship development (75% vs. 60%, p = 0.03), patient education (55% vs. 21%, p = 0.00), and patient activation skills (33% vs. 13%, p = 0.01). CONCLUSIONS: Although almost all residents obtained the relevant information, only about 50% of residents diagnosed depression. PHQ 9 appears to be associated with providing more effective treatment, supporting the importance of health system screening protocols. Residents' communication and depression-specific patient education and activation skills seem to be related to how they identify and manage depression, suggesting that interventions to build these skills may lead to higher quality care

BACKGROUND: Entrustable Professional Activities (EPAs) and milestones are expert judgments made based on many formative assessments. Their validity is dependent on the number of assessments but attention is increasingly being paid to having a "fair" sample of observations equally distributed across residents and contexts. OSCEs provide such a consistent, fair sample of behavior assessed under controlled conditions but have mostly used been used to provide granular skills feedback. We explore how faculty judge the "entrustability" of residents based on observing OSCE cases and then how these entrustments relate to OSCE skills performance. METHODS: In an 11-case OSCE for primary care residents (n = 25; PGY1-3), SPs rated skills in communication (information gathering, relationship development, education/counseling), assessment, patient education (case-specific), physical exam, professionalism, treatment plan, patient satisfaction and patient activation. Summary scores were calculated as%items rated well done (vs not or partly done; internal consistency > .72). Faculty observers then judged how much supervision the resident would need in actual practice to handle the case: 1-requires direct supervision, 2-requires indirect supervision, 3-ready for unsupervised practice, or 4- can supervise others. Mean entrustment rating across cases was correlated with clinical skills. RESULTS: Mean entrustment =2.46 (SD .37), falling between requires indirect supervision and ready for unsupervised practice. On average, residents were judged to need direct supervision in .40 cases (SD .65), indirect supervision in 4.76 (SD 2.03), ready for unsupervised practice in 2.92 (SD 1.80), and able to supervise others in 1.07 cases (SD 1.15) with PGY1 residents needing direct and indirect supervision in more cases than PGY2 and 3 (p = .037). Associations between OSCE performance and faculty entrustment ranged from essentially zero (communication sub-domains of information gathering and education/counseling; case-specific patient education; patient satisfaction) to negative (communication sub-domain of relationship development r = -.25, p = .16; professionalism r = -.21, p = .22) to positive (case-specific assessment, r = .35, p = .07; physical exam r = .30, p = .13; treatment plan r = .40, p = .04; patient activation r = .51, p = .008). Associations between skills performance and entrustment ratings varied by case. CONCLUSIONS: OSCEs provide a valuable opportunity for faculty to make entrustment judgments based on observing the same, complete encounter across many trainees. Entrustment judgments appear to be capturing elements of competence related to but different from SP assessments of performance, including especially "bottom line" aspects of practice such as assessment, physical exam, treatment plans and patient activation. Interestingly, we consider patient activation skills to be an "educationally sensitive patient outcome" i because both teachable and associated with patient outcomes and our results support the importance of this skill set

BACKGROUND: Interprofessional collaboration (IPC) is essential for quality care. Understanding residents' level of competence is a critical first step to designing targeted curricula and workplace learning activities. In this needs assessment, we measured residents' IPC competence using specifically designed Objective Structured Clinical Exam (OSCE) cases and surveyed residents regarding training needs. METHODS: We developed three cases to capture IPC competence in the context of physician-nurse collaboration. A trained actor played the role of the nurse (Standardized Nurse - SN). The Interprofessional Education Collaborative (IPEC) framework was used to create a ten-item behaviorally anchored IPC performance checklist (scored on a three-point scale: done, partially done, well done) measuring four generic domains: values/ethics; roles/responsibilities; interprofessional communication; and teamwork. Specific skills required for each scenario were also assessed, including teamwork communication (SBAR and CUS) and patient-care-focused tasks. In addition to evaluating IPC skills, the SN assessed communication, history-taking and physical exam skills. IPC scores were computed as percent of items rated well done in each domain (Cronbach's alpha > 0.77). Analyses include item frequencies, comparison of mean domain scores, correlation between IPC and other skills, and content analysis of SN comments and resident training needs. RESULTS: One hundred and seventy-eight residents (of 199 total) completed an IPC case and results are reported for the 162 who participated in our medical education research registry. IPC domain scores were: Roles/responsibilities mean = 37 % well done (SD 37 %); Values/ethics mean = 49 % (SD 40 %); Interprofessional communication mean = 27 % (SD 36 %); Teamwork mean = 47 % (SD 29 %). IPC was not significantly correlated with other core clinical skills. SNs' comments focused on respect and IPC as a distinct skill set. Residents described needs for greater clarification of roles and more workplace-based opportunities structured to support interprofessional education/learning. CONCLUSIONS: The IPC cases and competence checklist are a practical method for conducting needs assessments and evaluating IPC training/curriculum that provides rich and actionable data at both the individual and program levels.