Searched for: person:ccg2
Use of unannounced standardized patients and audit/feedback to improve physician response to social determinants of health [Meeting Abstract]
Zabar, S R; Wilhite, J; Hanley, K; Altshuler, L; Fisher, H; Kalet, A; Hardowar, K; Mari, A; Porter, B; Wallach, A; Gillespie, C
BACKGROUND: While much is known about the importance of addressing Social Determinants of Health (SDoH), less is known about how physicians elicit, respond to, and act upon their patients' SDoH information. We report on the results of a study that 1) sent Unannounced Standardized Patients (USPs) with programmed SDoH into clinics to assess whether providers uncovered, explored and acted upon the SDoH, 2) provided audit/feedback reports with educational components to clinical teams, and 3) tracked the impact of that intervention on provider response to SDoH.
METHOD(S): Highly trained USPs (secret shoppers) portrayed six scenarios (fatigue, asthma, Hepatitis B concern, shoulder pain, back pain, well-visit), each with specific housing (overcrowding, late rent, and mold) and social isolation (shyness, recent break up, and anxiety) concerns that they shared if asked broadly about. USPs assessed team and provider SDoH practices (eliciting, acknowledging/exploring, and providing resources and/or referrals). 383 USP visits were made to residents in 5 primary care teams in 2 urban, safety- net clinics. 123 visits were fielded during baseline period (Feb 2017-Jan 2018); 185 visits during intervention period (Jan 2018-Mar 2019) throughout which quarterly audit/feedback reports of the teams' response to the USPs' SDoH and targeted education on SDoH were distributed; and 75 follow-up phase visits were fielded (Apr-Dec 2019). Analyses compared rates of eliciting and responding to SDoH across the 3 periods (chi- square, z-scores). One team, by design, did not receive the intervention and serves as a comparison group.
RESULT(S): Among the intervention teams, the rate of eliciting the housing SDoH increased from 46% at baseline to 59% during the intervention period (p=.045) and also increased, but not significantly, for the social issue (40% to 52%, p=.077). There was a significant increase from baseline to intervention in providing resources/referrals for housing (from 7% to 24%, p=.001) and for social isolation (from 13% to 24%, p=.042) (mostly resources, very few referrals were made). The comparison team's rates followed a different pattern: eliciting the housing issue and the social isolation issue decreased from baseline to the intervention period (housing: 61% to 45%; social isolation: 39% to 33% of visits) and the rate of providing resources/referrals stayed steady at 13% for both. In the cases where SDoH were most clinically relevant, baseline rates of identifying the SDoH were high (>70%) but rates of acting on the SDoH increased significantly from baseline to intervention. Increases seen in the intervention period were not sustained in the follow-up period.
CONCLUSION(S): Giving providers SDoH data along with targeted education was associated with increased but unsustained rates of eliciting and responding to housing and social issues. The USP methodology was an effective means of presenting controlled SDoH and providing audit/feedback data. Ongoing education and feedback may be needed
EMBASE:633958103
ISSN: 1525-1497
CID: 4803142
Unannounced standardized patients as a measure of longitudinal clinical skill development [Meeting Abstract]
Altshuler, L; Wilhite, J; Mari, A; Chaudhary, S; Hardowar, K; Fisher, H; Hanley, K; Kalet, A; Gillespie, C; Zabar, S R
BACKGROUND: Unannounced Standardized Patients (USPs) provide opportunity to measure residents' clinical skills in actual practice. USPs, or secret shoppers, are trained to ensure accurate case portrayal across encounters, making them optimal for tracking changes in skills longitudinally. At present, little is known about how residents handle USP visits with repeat cases. This study examines variation in resident communication and global domain scores when visited by the sameUSPcase at two separate time points during residency training.
METHOD(S): Primary care residents (n=46) were assessed twice by one of six standardized cases (asthma, fatigue, Hepatitis B concern, back pain, shoulder pain, or well visit) during the course of their residency, typically during their first and third training year. Upon visit completion, residents were rated using a behaviorally-anchored checklist. Communication domains assessed included info gathering (4 items), relationship development (5 items), and patient education (4 items). Other domains included patient activation (4 items) and satisfaction (4 items). Responses were scored as not done, partly done, or well done. Summary scores (mean % well done) were calculated by domain. All cases were combined to create composite scores, due to small sample sizes per case. First and second visit domain scores were compared using a t-test. Finally, we grouped high performers (80% or higher on communication scores during their first visit) because this measure demonstrated competency.
RESULT(S): With cases combined, there were no significant differences based on time of assessment and changes in score between first and second visit were small. 14/46 (30%) learners who performed well on composite overall communication scores (80% or higher) during their first visit outperformed poorer communicators in patient satisfaction (93% vs 61%, P<.001) and activation (48% vs 18%, P<.001). In subsequent visits, these high performers performed at a similar level to their fellow residents, with no significant differences noted. Further, when looking at individual trajectories, individual learner scores in the communication domain increased between visits for 21 learners (46%), decreased for 19 (41%), and stayed same for 7 (15%).
CONCLUSION(S): Results suggest that a learning curve occurs between assessments during the first year in residency and subsequent assessments. This could be due to an increased capacity to engage with a patient occurring training progression, or due to a better understanding of addressing common chief complaints presented with our USP cases. Understanding causes of individual-level score decreases will enable tailoring of educational interventions suitable for specific learner trajectories, as will a deeper dive into the impact of the clinical microsystem on performance. We predict a more nuanced understanding of these mediating factors through our plan of increasing our repeat visit sample size
EMBASE:633957642
ISSN: 1525-1497
CID: 4803202
Development and maintenance of a medical education research registry
Wilhite, Jeffrey A; Altshuler, Lisa; Zabar, Sondra; Gillespie, Colleen; Kalet, Adina
BACKGROUND:Medical Education research suffers from several methodological limitations including too many single institution, small sample-sized studies, limited access to quality data, and insufficient institutional support. Increasing calls for medical education outcome data and quality improvement research have highlighted a critical need for uniformly clean and easily accessible data. Research registries may fill this gap. In 2006, the Research on Medical Education Outcomes (ROMEO) unit of the Program for Medical Innovations and Research (PrMEIR) at New York University's (NYU) Robert I. Grossman School of Medicine established the Database for Research on Academic Medicine (DREAM). DREAM is a database of routinely collected, de-identified undergraduate (UME, medical school leading up to the Medical Doctor degree) and graduate medical education (GME, residency also known as post graduate education leading to eligibility for specialty board certification) outcomes data available, through application, to researchers. Learners are added to our database through annual consent sessions conducted at the start of educational training. Based on experience, we describe our methods in creating and maintaining DREAM to serve as a guide for institutions looking to build a new or scale up their medical education registry. RESULTS:At present, our UME and GME registries have consent rates of 90% (n = 1438/1598) and 76% (n = 1988/2627), respectively, with a combined rate of 81% (n = 3426/4225). 7% (n = 250/3426) of these learners completed both medical school and residency at our institution. DREAM has yielded a total of 61 individual studies conducted by medical education researchers and a total of 45 academic journal publications. CONCLUSION/CONCLUSIONS:We have built a community of practice through the building of DREAM and hope, by persisting in this work the full potential of this tool and the community will be realized. While researchers with access to the registry have focused primarily on curricular/ program evaluation, learner competency assessment, and measure validation, we hope to expand the output of the registry to include patient outcomes by linking learner educational and clinical performance across the UME-GME continuum and into independent practice. Future publications will reflect our efforts in reaching this goal and will highlight the long-term impact of our collaborative work.
PMCID:7305610
PMID: 32560652
ISSN: 1472-6920
CID: 4510572
Evolution of an Accelerated 3-Year Pathway to the MD Degree: The Experience of New York University School of Medicine
Cangiarella, Joan; Cohen, Elisabeth; Rivera, Rafael; Gillespie, Colleen; Abramson, Steven
The revision of the curriculum at New York University School of Medicine in 2010, with a reduction of the preclerkship curriculum to 18 months, made it possible to offer an accelerated 3-year pathway in 2013 for students who know their career path. The goals of the program include individualizing education, reducing student debt, and integrating undergraduate and graduate medical education. This accelerated 3-year doctor of medicine (3YMD) pathway is the first program of its kind in the United States to offer conditional acceptance to residency programs in all specialties through the National Resident Matching Program. Since inception of the pathway 6 years ago, 81 students have graduated. Critical components to successfully launch and implement the program are described.Unwavering commitment to the program as a high institutional priority by the dean and vice dean for education facilitated the support required by department chairs and residency program directors and the flexibility needed for success. Alignment between the 3- and 4-year pathways has made it possible to add points of entry into the 3-year pathway during the second and third years and to shift back into the 4-year pathway, as warranted. Modifications to how 3YMD students are mentored included changing the role of the departmental advisor and adding a dedicated 3YMD pathway advisor who serves as an advocate for both the students and the program. Having a relatively large number of 3YMD students has contributed to the success of the program and facilitated acceptance by the residencies.
PMID: 31577593
ISSN: 1938-808x
CID: 4116272
Subtle skills: Using objective structured clinical examinations to assess gastroenterology fellow performance in system based practice milestones
Papademetriou, Marianna; Perrault, Gabriel; Pitman, Max; Gillespie, Colleen; Zabar, Sondra; Weinshel, Elizabeth; Williams, Renee
BACKGROUND:System based practice (SBP) milestones require trainees to effectively navigate the larger health care system for optimal patient care. In gastroenterology training programs, the assessment of SBP is difficult due to high volume, high acuity inpatient care, as well as inconsistent direct supervision. Nevertheless, structured assessment is required for training programs. We hypothesized that objective structured clinical examination (OSCE) would be an effective tool for assessment of SBP. AIM/OBJECTIVE:To develop a novel method for SBP milestone assessment of gastroenterology fellows using the OSCE. METHODS:For this observational study, we created 4 OSCE stations: Counseling an impaired colleague, handoff after overnight call, a feeding tube placement discussion, and giving feedback to a medical student on a progress note. Twenty-six first year fellows from 7 programs participated. All fellows encountered identical case presentations. Checklists were completed by trained standardized patients who interacted with each fellow participant. A report with individual and composite scores was generated and forwarded to program directors to utilize in formative assessment. Fellows also received immediate feedback from a faculty observer and completed a post-session program evaluation survey. RESULTS:." One hundred percent of the fellows stated they would incorporate OSCE learning into their clinical practice. CONCLUSION/CONCLUSIONS:OSCEs may be used for standardized evaluation of SBP milestones. Trainees scored lower on SBP milestones than other more concrete milestones. Training programs should consider OSCEs for assessment of SBP.
PMCID:7093308
PMID: 32231425
ISSN: 2219-2840
CID: 4371392
In the room where it happens: do physicians need feedback on their real-world communication skills? [Editorial]
Zabar, Sondra; Hanley, Kathleen; Wilhite, Jeffrey A; Altshuler, Lisa; Kalet, Adina; Gillespie, Colleen
PMID: 31704892
ISSN: 2044-5423
CID: 4186612
OSCE CASE BANK INVENTORY 2001-2018: PROGRAMMATIC EVALUATION OF PERFORMANCE BASED ASSESSMENT CASE CHARACTERISTICS [Meeting Abstract]
Mari, Amanda; Kulusic-Ho, Adriana; Bostwick, Amanda; Fisher, Harriet; Altshuler, Lisa; Gillespie, Colleen; Wilhite, Jeffrey; Hanley, Kathleen; Greene, Richard E.; Adams, Jennifer; Zabar, Sondra R.
ISI:000567143602350
ISSN: 0884-8734
CID: 4799292
Erratum: Clinical problem solving and social determinants of health: A descriptive study using unannounced standardized patients to directly observe how resident physicians respond to social determinants of health (Diagnosis (2020) 7: 3 (313-324) DOI: 10.1515/dx-2020-0002)
Wilhite, J A; Hardowar, K; Fisher, H; Porter, B; Wallach, A B; Altshuler, L; Hanley, K; Zabar, S R; Gillespie, C C
Corrigendum to: Jeffrey A. Wilhite*, Khemraj Hardowar, Harriet Fisher, Barbara Porter, Andrew B. Wallach, Lisa Altshuler, Kathleen Hanley, Sondra R. Zabar and Colleen C. Gillespie. Clinical problem solving and social determinants of health: a descriptive study using unannounced standardized patients to directly observe how resident physicians respond to social determinants of health. Diagnosis 2020, Volume 7, Issue 3, pages 313-324. https://urldefense.proofpoint.com/v2/url?u=https-3A__doi.org_10&d=DwIBAg&c=j5oPpO0eBH1iio48DtsedeElZfc04rx3ExJHeIIZuCs&r=CY_mkeBghQnUPnp2mckgsNSbUXISJaiBQUhM-Uz9W58&m=TyoCBAKzCpBZ4-uIICybN67eGKr9ePdBC-WexDhSuSM&s=-H9hUl6CWWk07_DiPQFbSmQyI2qWxw4tQLZIEBIpIVY&e= . 1515/dx-2020-0002. Unfortunately, a typographic error in the results portion of the abstract was missed during final stages of proofing and editing. The count of full elicitors should read as 38/68 rather than 28/68, and the % of negative elicitors is 23%. The corrected results read as follows: Residents fell into three groups when it came to clinical problem-solving around a housing trigger for asthma: those who failed to ask about housing and therefore did not uncover mold as a potential trigger (neglectors - 21%; 14/68); those who asked about housing in negative ways that prevented disclosure and response (negative elicitors - 23%, 16/68); and those who elicited and explored the mold issue (full elicitors - 56%; 38/68).
Copyright
EMBASE:2008498847
ISSN: 2194-8011
CID: 4674562
The use of an observed structured clinical examination to teach communication skills surrounding therapeutic drug monitoring [Meeting Abstract]
Lopatin, S; Zabar, S; Weinshel, E; Gillespie, C; Malter, L
BACKGROUND: According to the 2017 American College of Gastroenterology (AGA) guidelines, therapeutic drug monitoring (TDM) of drug trough concentrations and anti-drug antibodies is recommended to optimize treatment with anti-tumor necrosis factor (TNF) agents and thiopurines1. Specifically, the AGA conditionally recommends reactive TDM in patients with active symptoms of inflammatory bowel disease (IBD) while on anti-TNF agents, as such testing is crucial for differentiating between mechanistic, non-immune mediated pharmacokinetic and immune-mediated pharmacokinetic drug failure, and allows providers to appropriately tailor treatment regimens. As such algorithms for monitoring therapies in IBD have evolved, it has become incumbent on physicians caring for these patients to develop techniques to engage in patient-centered care using the technique of shared decision making. Gastroenterology (GI) trainees may not be well versed in navigating these complex interpersonal skills. The Observed Structured Clinical Examination (OSCE) is a well-validated method of assessing core competencies of communication and professionalism. While it is traditionally used at the undergraduate medical education level, it has been used at the graduate level to address disease-specific competencies. Here, we discuss the use of an OSCE to assess the performance of GI fellows in engaging in shared decision-making on the topic of TDM for a patient with complex IBD refractory to treatment.
METHOD(S): Eleven second-year gastroenterology fellows from 4 GI fellowship programs participated in a 4 station OSCE. Previously validated OSCE checklists were used to assess the fellows' performance in IBD-specific cases, one of which will be discussed here. In the "Therapeutic Drug Monitoring" case, the objective for the fellows was to discuss the indications for infliximab trough and antibody testing and how results of this testing would impact treatment based on the AGA guidelines. Checklists were scored on a 3 and 5-point Likert Scale by the Standardized Patient (SP), mapped to the appropriate ACGME milestones by a GI medical educator and normalized on a scale from 0 to 9. Post-OSCE, the fellows were surveyed to assess their perspective on their performance as well as the exam's educational value.
RESULT(S): 6 ACGME milestones were assessed in this OSCE. Scores ranged from mean of 5.85 to 7.88. Fellows scored lowest on gathering and synthesizing essential and accurate information to define each patient's clinical problem(s) (PC1, mean score 5.85) with an average score of 5.85. They scored highest for overall clinical knowledge (MK1, mean score 7.88). Overall, 9/10 (90%) of fellows would be recommended for their interpersonal skills, but only 4/10 (40%) were deemed effective in their communication skills. The majority of fellows noted improvement in their understanding of when to use and how to interpret TDM after the exercise. CONCLUSION(S): This OSCE was designed to assess clinical and communication skills for gastroenterology surrounding the complex clinical arena of therapeutic drug monitoring utilizing crucial communication skills. The results suggest weaker performance linked to gathering and synthesizing clinical information, with stronger performance in clinical knowledge, developing management plans and various communication skills. This OSCE feedback and assessment can be used to develop targeted educational interventions to strengthen clinical and communication skills for providers
EMBASE:629362048
ISSN: 1572-0241
CID: 4152842
Igniting activation: Using unannounced standardized patients to measure patient activation in smoking cessation
Wilhite, Jeffrey A; Velcani, Frida; Watsula-Morley, Amanda; Hanley, Kathleen; Altshuler, Lisa; Kalet, Adina; Zabar, Sondra; Gillespie, Colleen C
Introduction/UNASSIGNED:Despite a decline, smoking rates have remained high, especially in communities with lower income, education, and limited insurance options. Evidence shows that physician-initiated counseling on smoking cessation is effective and saves lives, and that specific skills are needed to appropriately lead this type of patient-physician communication. Residency is a critical moment for future physicians and may be the optimal time to learn, practice, and refine this skillset. Unannounced Standardized Patients (USPs) have been found to be effective, incognito evaluators of resident practices. Methods/UNASSIGNED:This study introduced rigorously trained actors (USPs) into two urban, safety-net clinics to assess resident ability to engage, activate, and counsel a pre-contemplative smoker. A complementary chart review assessed appropriate documentation in the patient's electronic health record (EHR) and its relationship to counseling style and prescribing practices. Results/UNASSIGNED:Resident scores (% well done) on patient education and engagement were low (33% and 23%, respectively). Residents who coupled cessation advice with an open discussion style activated their patients more than those who solely advised cessation across all comparable measures. On EHR documentation, residents who accurately documented smoking history were more likely to directly advise their patient to quit smoking when compared to residents who did not document (t(97) = 2.828, p = .006, Cohen's D = 0.56). Conclusions/UNASSIGNED:Results highlight the need to reinforce training in patient-centered approaches including motivational interviewing, counseling, and shared decision-making. Future research should focus on the effects of smokers in pre-contemplation on physician counseling style and examine the relationship between medical training and provider communication to guide interventions.
PMCID:6544561
PMID: 31193839
ISSN: 2352-8532
CID: 3930162