Faculty Bibliography

The objective of this study was to compare unannounced standardized patient (USP) and patient reports of care. Patient satisfaction surveys and USP checklist results collected at an urban, public hospital were compared to identify items included in both surveys. Qualitative commentary was reviewed to better understand USP and patient satisfaction survey data. Analyses included χ² and Mann-Whitney U test. Patients provided significantly higher ratings on 10 of the 11 items when compared to USPs. USPs may provide a more objective perspective on a clinical encounter than a real patient, reinforcing the notion that real patients skew overly positive or negative.

BACKGROUND/UNASSIGNED:Nonadherence to antihypertensive medications remains a persistent problem that leads to preventable morbidity and mortality. Behavioral economic strategies represent a novel way to improve antihypertensive medication adherence, but remain largely untested especially in vulnerable populations which stand to benefit the most. The Behavioral Economics Trial To Enhance Regulation of Blood Pressure (BETTER-BP) was designed in this context, to test whether a digitally-enabled incentive lottery improves antihypertensive adherence and reduces systolic blood pressure (SBP). DESIGN/UNASSIGNED:BETTER-BP is a pragmatic randomized trial conducted within 3 safety-net clinics in New York City: Bellevue Hospital Center, Gouveneur Hospital Center, and NYU Family Health Centers - Park Slope. The trial will randomize 435 patients with poorly controlled hypertension and poor adherence (<80% days adherent) in a 2:1 ratio (intervention:control) to receive either an incentive lottery versus passive monitoring. The incentive lottery is delivered via short messaging service (SMS) text messages that are delivered based on (1) antihypertensive adherence tracked via a wireless electronic monitoring device, paired with (2) a probability of lottery winning with variable incentives and a regret component for nonadherence. The study intervention lasts for 6 months, and ambulatory systolic blood pressure (SBP) will be measured at both 6 and 12 months to evaluate immediate and durable lottery effects. CONCLUSIONS/UNASSIGNED:BETTER-BP will generate knowledge about whether an incentive lottery is effective in vulnerable populations to improve antihypertensive medication adherence. If successful, this could lead to the implementation of this novel strategy on a larger scale to improve outcomes.

INTRODUCTION/BACKGROUND:COVID-19 forced health systems to rapidly implement telehealth for routine practice, often without sufficient training or standards. We conducted a longitudinal survey of physicians to explore changes in their perceptions of the challenges and benefits of telehealth and identify recommendations for future practice. METHODS:An anonymous online survey was distributed to a cohort of internal medicine physicians in May to June 2020 and March to June 2021. Changes in responses between 2020 and 2021 and by site (private vs. public) were described. These findings, along with those of a thematic analysis of open-ended responses to questions on telehealth experiences, informed a set of recommendations. RESULTS: = 0.027). Physicians' open-ended responses identified recommendations for further improving the design and use of telehealth. DISCUSSION/CONCLUSIONS:Results suggest that physician experience with telehealth improved but opportunities for training and improved integration remain. Longitudinal assessment can deepen understanding of the evolution of telehealth care.

BACKGROUND:Vaccine hesitancy is challenging for clinicians and of increasing concern since COVID-19 vaccination rollout began. Standardized patients (SPs) provide an ideal method for assessing resident physicians' current skills, providing opportunity to practice and gain immediate feedback, while also informing evaluation of curriculum and training. As such, we designed and implemented an OSCE station where residents were tasked with engaging and educating a vaccine-hesitant patient. AIM/OBJECTIVE:Describe residents' vaccine counseling practices, core communication and interpersonal skills, and effectiveness in meeting the objectives of the case. Explore how effectiveness in overcoming vaccine hesitancy may be associated with communication and interpersonal skills in order to inform educational efforts. SETTING/METHODS:Annual OSCE at a simulation center. PARTICIPANTS/METHODS:106 internal medicine residents (51% PGY1, 49% PGY2). PROGRAM DESCRIPTION/METHODS:Residents participated in an annual residency-wide, multi-station OSCE, one of which included a Black, middle-aged, vaccine-hesitant male presenting for a routine video visit. Residents had 10 min to complete the encounter, during which they sought to educate, explore concerns, and make a recommendation. After each encounter, faculty gave residents feedback on their counseling skills and reviewed best practices for effective communication on the topic. SPs completed a behaviorally anchored checklist (30 items across 7 clinical skill domains and 2 measures of trust in the vaccine's safety and resident) which will inform future curriculum. PROGRAM EVALUATION/RESULTS:Fifty-five percent (SD: 43%) of the residents performed well on the vaccine-specific education domain. PGY2 residents scored significantly higher on two of the seven domains compared to PGY1s (patient education/counseling-PGY1: 35% (SD: 36%) vs. PGY2: 52% (SD: 41%), p = 0.044 and activation-PGY1: 37% (SD: 45%) vs. PGY2: 59% (SD: 46%), p = 0.016). In regression analyses, education/counseling and vaccine-specific communication skills were strongly, positively associated with trust in the resident and in the vaccine's safety. A review of qualitative data from the SPs' perspective suggested that low performers did not use patient-centered communication skills. DISCUSSION/CONCLUSIONS:This needs assessment suggests that many residents needed in-the-moment feedback, additional education, and vaccine-specific communication practice. Our program plans to reinforce evidence-based practices physicians can implement for vaccine hesitancy through ongoing curriculum, practice, and feedback. This type of needs assessment is replicable at other institutions and can be used, as we have, to ultimately shed light on next steps for programmatic improvement.

QUALITY ISSUE:The emergence of COVID-19 highlights the necessity of rapidly identifying and isolating potentially infected individuals. Evaluating this preparedness requires an assessment of the full clinical system, from intake to isolation. INITIAL ASSESSMENT:Unannounced Standardized Patients (USPs) present a nimble, sensitive methodology for assessing this readiness. CHOICE OF SOLUTION:Pilot the Unannounced Standardized Patient methodology, which employs an actor trained to present as a standardized, incognito potentially infected patient, to assess clinical readiness for potential COVID-19 patients at an urban, community safety-net clinic. IMPLEMENTATION:The Unannounced Standardized Patient was trained to present at each team's front desk with the complaint of feeling unwell (reporting a fever of 101 degrees Fahrenheit in the past 24 hours) and exposure to a roommate recently returned from Beijing. The Unannounced Standardized Patient was trained to complete a behaviorally-anchored assessment of the care she received from the clinical system. EVALUATION:There was clear variation in care Unannounced Standardized Patients received; some frontline clerical staff followed best practices; others did not. Signage and information on disease spread prevention publicly available was inconsistent. Qualitative comments shared by the Unannounced Standardized Patients and those gathered during group debrief reinforced the experiences of the Unannounced Standardized Patients and hospital leadership. LESSONS LEARNED:Unannounced Standardized Patients revealed significant variation in care practices within a clinical system. Utilization of this assessment methodology can provide just-in-time clinical information about readiness and safety practices, particularly during emerging outbreaks. Unannounced Standardized Patients will prove especially powerful as clinicians and systems return to outpatient visits while remaining vigilant about potentially infected individuals.

Background/UNASSIGNED:During the rapid onset of the pandemic, clinicians transitioned from traditional outpatient practice to virtual modalities for providing routine care to patient panels. Like training programs nationwide, telemedicine training and assessment had not been systematically incorporated into our residency. In response, a scheduled Internal Medicine (IM) Objective Structured Clinical Examination (OSCE) was adapted to a remote modality to become virtual care-focused learning experience for trainees and to provide valuable feedback to educators. Methods/UNASSIGNED:Standardized Patients (SPs) rated residents on their communication (including information gathering, relationship development and patient education), patient activation and satisfaction, and telemedicine skills. Analyses included a comparison of domain scores for residents who participated in both the 2020 remote and 2019 in-person OSCEs, and a review of written resident comments about the virtual OSCE. Results/UNASSIGNED: = .008). Conclusion/UNASSIGNED:Our reformulated OSCE accomplished 3 goals including; (1) physically distancing residents from SPs per COVID regulations, (2) providing residents with the opportunity to practice critical virtual visit skills, and (3) alerting our educators to curricular improvement areas. Our methods are useful for other institutions and have applications to the larger medical education community.

BACKGROUND: NYU uses the same 14-item checklist for assessing medical student communication skills across our curriculum, which includes highquality Objective Structured Clinical Skills Exams throughout the first three years of medical school: a 3-station Introductory Clinical Experience OSCE (ICE), a 3-station end-of-clinical skills OSCE (Practice of Medicine; POM); and an 8-station, high- stakes OSCE (Comprehensive Clinical Skills Exam; CCSE) after core clerkship. We describe how skills change throughout school and explore how patterns vary by cohort (class) in ways that could be explained by admissions criteria, measurement quality, and/or curriculum changes.
METHOD(S): Three domains are assessed: Info gathering (6 items), relationship development (5 items); and patient education & counseling (3 items). Checklist items use a 3-point scale (not done, partly, well done) with behavioral anchors. Internal consistency (Cronbach's alpha) exceeds .75 for all subdomains and across all years. Domains are supported by Confirmatory Factor Analysis. Mean average % well done was calculated across cases and individuals for each subdomain in an OSCE and compared over the OSCEs and between 8 classes of medical school students entering from 2009 to 2016 (graduating 2013 to 2020) (n=1569).
RESULT(S): Cohorts showed similar patterns communication skills trajectories - improvement over time. Despite changes in admissions criteria and processes, cohorts did not differ in terms of demographics, undergraduate GPA, or MCAT scores. Variability in scores decreased in all cohorts over time while communication improved. Patient education & counseling was significantly and substantially lower than other domains. In terms of cohort effects, communication scores for the entering class of 2013 at the start of medical school (ICE OSCE) were significantly higher than the previous 4. At the end of MS2, scores were similar for cohorts for info gathering and relationship development domains (and high, mean range=77-87% well done) but patient education & counseling varied: Improvement from the 1st to 3rd cohort and then decline for the last 5 cohorts. Within the CCSE (8-station pass/fail, MS3), communication scores increased steadily across entering classes, especially from cohort 4 on. These changes over time and between cohorts were mapped onto a priori descriptions of curricular, measurement and admission changes.
CONCLUSION(S): Our cohort data showed interesting and complex patterns. This study reinforces some limitations of linking curriculum to performance (e.g., no direct measures of the curriculum in terms of content, process and intensity over time, limited data on what makes cohorts different, variable measurement over time, and being unable to control for broader trends likely to influence both cohort and time effects) while also demonstrating the promise of longitudinal perspectives on the development of core competencies. LEARNING OBJECTIVE #1: Understand cohort performance in relation to curricular trends. LEARNING OBJECTIVE #2: Describe variation in performance