Faculty Bibliography

Introduction: The objective structured clinical examination (OSCE) is a common educational strategy to assess interpersonal skills and knowledge gaps, and we have previously shown its benefits in inflammatory bowel disease (IBD) education. As a result of the COVID-19 pandemic, there has been explosive growth in telehealth. Currently, we lack methods to teach and evaluate trainees' related skillset and no telehealth-specific milestones exist. We assessed the telehealth proficiency of gastroenterology (GI) fellows as part of an annual IBD OSCE over Zoom (Z-OSCE).
Method(s): Seven GI fellows from four programs participated in Z-OSCE featuring four clinical scenarios. We used previously validated OSCE checklists to assess the fellows' performance in IBDspecific cases. Telehealth communication skills were also assessed. One of the scenarios required the trainees to conduct a televisit focusing on preventative care for a Crohn's disease patient based on the ACG guideline. Checklists were scored on a 3-point Likert scale by the Standardized Patient (SP).
Result(s): The telehealth behavioral anchored checklist items included: maintaining proper computer etiquette, use of non-verbal communication and positioning to optimize the encounter, optimized technical aspects, and exhibiting comfort and confidence with the virtual platform. In these domains 5 or 6 (out of 7) fellows received 3 points. In contrast less than half of the fellows asked questions of the SP to make sure they understood or acknowledged emotion, and 3 out 7 fellows did not make appropriate eye contact. Despite high performance in the telehealth aspects of the encounter, the SP did not fully recommend fellows for their communication skills without reservations to friends/ family, with all fellows receiving 2 points.
Conclusion(s): Telehealth has quickly become a fixture of our profession, and merits educational opportunities and assessment to improve clinicians' competency, as it will likely outlast the COVID- 19 pandemic. To our knowledge, this is the first OSCE designed to assess telehealth performance in the delivery of IBD care. Z-OSCEs can play a unique role in simulating realistic telehealth visits and this pilot program helps us identify future educational needs. Assessment of fellows' performance during this virtual program can provide an opportunity for learning, growth and reflection as well as prepare trainees for future patient encounters

BACKGROUND:Neurologists need to be adept at disclosing prognosis and breaking bad news. Objective structured clinical examinations (OSCE) allow trainees to practice these skills. METHODS:In 2017, in conjunction with the NYU School of Medicine Simulation Center, neurology faculty designed an OSCE case in which a resident had to inform a standardized patient (SP) her father had severe global hypoxic ischemic injury. The residents were surveyed on the experience using a Likert scale from 1 (worst) to 5 (best). The SP completed a behavioral anchored checklist and marked items as "not done," "partly done," or "well done". RESULTS:57 third and fourth year neurology residents completed the case from 2018 to 2020, 54 (95%) of whom completed the post-OSCE survey. Residents reported feeling moderately prepared for the simulation (mean Likert score 3.7/5), and thought their performance was average (3.4/5). Overall, they found the case to be very helpful (4.6/5). The residents performed well in the realms of maintaining professionalism (64% rated "well done"), developing a relationship (62% rated "well done"), and information gathering (61% rated "well done"). There was room for improvement in the realms of providing education and presenting the bad news (39% and 37% rated "partly/not done," respectively). CONCLUSIONS:OSCE cases can be used to teach neurology trainees how to discuss prognosis and break bad news. Feedback about this simulation was positive, though its efficacy has yet to be evaluated and could be a future direction of study.

OBJECTIVE:New York City was the epicenter of the outbreak of the 2019 coronavirus disease (COVID-19) pandemic in the United States. As a large, quaternary care medical center, NYU Langone Medical Center was one of many New York medical centers that experienced an unprecedented influx of patients during this time. Clinical leadership effectively identified, oriented, and rapidly deployed a "COVID Army," consisting of non-hospitalist physicians, to meet the needs of the patient influx. We share feedback from our providers on our processes and offer specific recommendations for systems experiencing a similar influx in the current and future pandemics. METHODS:To assess the experiences and perceived readiness of these physicians (n = 183), we distributed a 32-item survey between March and June of 2020. Thematic analyses and response rates were examined to develop results. RESULTS:Responses highlighted varying experiences and attitudes of our frontline physicians during an emerging pandemic. Thematic analyses revealed a series of lessons learned, including the need to (1) provide orientations, (2) clarify roles/workflow, (3) balance team workload, (4) keep teams updated on evolving policies, (5) make team members feel valued, and (6) ensure they have necessary tools available. CONCLUSIONS:Lessons from our deployment and assessment are scalable at other institutions.

QUALITY ISSUE:The emergence of COVID-19 highlights the necessity of rapidly identifying and isolating potentially infected individuals. Evaluating this preparedness requires an assessment of the full clinical system, from intake to isolation. INITIAL ASSESSMENT:Unannounced Standardized Patients (USPs) present a nimble, sensitive methodology for assessing this readiness. CHOICE OF SOLUTION:Pilot the Unannounced Standardized Patient methodology, which employs an actor trained to present as a standardized, incognito potentially infected patient, to assess clinical readiness for potential COVID-19 patients at an urban, community safety-net clinic. IMPLEMENTATION:The Unannounced Standardized Patient was trained to present at each team's front desk with the complaint of feeling unwell (reporting a fever of 101 degrees Fahrenheit in the past 24 hours) and exposure to a roommate recently returned from Beijing. The Unannounced Standardized Patient was trained to complete a behaviorally-anchored assessment of the care she received from the clinical system. EVALUATION:There was clear variation in care Unannounced Standardized Patients received; some frontline clerical staff followed best practices; others did not. Signage and information on disease spread prevention publicly available was inconsistent. Qualitative comments shared by the Unannounced Standardized Patients and those gathered during group debrief reinforced the experiences of the Unannounced Standardized Patients and hospital leadership. LESSONS LEARNED:Unannounced Standardized Patients revealed significant variation in care practices within a clinical system. Utilization of this assessment methodology can provide just-in-time clinical information about readiness and safety practices, particularly during emerging outbreaks. Unannounced Standardized Patients will prove especially powerful as clinicians and systems return to outpatient visits while remaining vigilant about potentially infected individuals.

OBJECTIVES/OBJECTIVE:Resident assessment tends to consist of multiple-choice examinations, even in nuanced areas, such as quality assurance. Internal medicine and many other specialties use objective structured clinical examinations, or OSCEs, to evaluate residents. We adapted the OSCE for pathology, termed the Objective Structured Pathology Examination (OSPE). METHODS:The OSPE was used to evaluate first- and second-year residents over 2 years. The simulation included an anatomic pathology sign-out session, where the resident could be evaluated on diagnostic skills and knowledge of key information for cancer staging reports, as well as simulated frozen-section analysis, where the resident could be evaluated on communication skills with a "surgeon." The OSPE also included smaller cases with challenging quality issues, such as mismatched slides or gross description irregularities. All cases were scored based on the Pathology Milestones created by the Accreditation Council for Graduate Medical Education. RESULTS:Using this OSPE, we were able to demonstrate that simulated experiences can be an appropriate tool for standardized evaluation of pathology residents. CONCLUSIONS:Yearly evaluation using the OSPE could be used to track the progress of both individual residents and the residency program as a whole, identifying problem areas for which further educational content can be developed.

BACKGROUND:Point-of-care ultrasound (POCUS) is becoming widely adopted with increasing accessibility of courses. Little is known about the optimal design of the introductory course or longitudinal training programs targeting hospitalists that are critical to success. METHODS:Hospitalists at four academic sites participated in a two-day introductory course and a longitudinal phase comprising clinical POCUS practice, clip uploading with online feedback, hands-on teaching, and monthly ultrasound conferences. Assessments were performed immediately before and after the two-day course and after 1 year. RESULTS:Knowledge increased from baseline to post two-day course (median score 58 and 85%, respectively, p < 0.001) and decreased slightly at 1 year (median score 81%, p = 0.012). After the two-day introductory course, the median score for hands-on image acquisition skills, the principal metric of participant success, was 75%. After 1 year, scores were similar (median score 74%). Confidence increased from baseline to post two-day course (1.5 to 3.1 on a 4 point Likert scale from Not at all confident (1) to Very confident (4), p < 0.001), and remained unchanged after 1 year (2.73). Course elements correlating with a passing score on the final hands-on test included number of clip uploads (r = 0.85, p,0.001), attendance at hands-on sessions (r = 0.7, p = 0.001), and attendance at monthly conferences (r = 0.50, p = 0.03). CONCLUSIONS:The I-ScaN POCUS training program increased hospitalist knowledge, skill and confidence with maintained skill and confidence after 1 year. Uploading clips and attending hands-on teaching sessions were most correlative with participant success.

Background/UNASSIGNED:During the rapid onset of the pandemic, clinicians transitioned from traditional outpatient practice to virtual modalities for providing routine care to patient panels. Like training programs nationwide, telemedicine training and assessment had not been systematically incorporated into our residency. In response, a scheduled Internal Medicine (IM) Objective Structured Clinical Examination (OSCE) was adapted to a remote modality to become virtual care-focused learning experience for trainees and to provide valuable feedback to educators. Methods/UNASSIGNED:Standardized Patients (SPs) rated residents on their communication (including information gathering, relationship development and patient education), patient activation and satisfaction, and telemedicine skills. Analyses included a comparison of domain scores for residents who participated in both the 2020 remote and 2019 in-person OSCEs, and a review of written resident comments about the virtual OSCE. Results/UNASSIGNED: = .008). Conclusion/UNASSIGNED:Our reformulated OSCE accomplished 3 goals including; (1) physically distancing residents from SPs per COVID regulations, (2) providing residents with the opportunity to practice critical virtual visit skills, and (3) alerting our educators to curricular improvement areas. Our methods are useful for other institutions and have applications to the larger medical education community.

INTRODUCTION: Clinicians caring for critically-ill patients must be able to discuss prognosis and deliver bad news. To teach Neurology residents how to do this, we designed an objective structured clinical examination (OSCE) case in which trainees discussed prognosis with a standardized patient (SP).
METHOD(S): In 2017, in conjunction with the NYU School of Medicine Simulation Center, neurology faculty designed an OSCE case in which a resident was tasked with informing a SP her father had severe global hypoxic ischemic injury. The SP was instructed to assess the resident's ability to 1) explain the neurologic findings and 2) to respond to an emotional outburst. A neurology attending observed the encounter via one-way glass. After a 10-minute encounter, the resident was provided 5 minutes of feedback. The residents were surveyed on how prepared they felt for the OSCE, how useful it was, how they rated their performance, and how much they learned from the activity via a Likert scale from 1 (worst) to 5 (best) and free text response. The SP completed a behavioral anchored checklist to assess the residents' ability to gather information, develop a relationship, provide education and counseling, present bad news, and maintain professionalism.
RESULT(S): 57 third and fourth year neurology residents completed the case from 2018-2020, 54 (95%) of whom completed the post-OSCE survey. Residents reported feeling moderately prepared (mean Likert score 3.7/5) and rated their performance as average (3.4/5). Overall they found the case to be very helpful (4.6/5). Several reported difficultly with 1) addressing a complex medical case in a limited amount of time 2) reacting appropriately to an emotional family member and 3) avoiding medical jargon. The SP reported that residents performed well in the realms of non-verbal behavior enriched communication, being non-judgmental, not interrupting, acknowledging emotion, and avoiding medical jargon. Areas in which there was room for improvement included collaborating with the SP to decide upon next steps, identifying a support system, and asking "what is going through your mind right now?".
CONCLUSION(S): OSCE cases can be used to teach clinicians how to discuss prognosis and break bad news. Feedback about this simulation was positive, however its efficacy has yet to be evaluated

BACKGROUND: During the rapid onset of the pandemic, clinicians transitioned from traditional outpatient practice to telemedicine for triaging COVID-19 patients and providing routine care to patient panels. Telemedicine training and assessment had not been systematically incorporated into most residencies. In response, a scheduled Internal Medicine (IM) Objective Structured Clinical Examination (OSCE) was adapted to a telemedicineemphasized, virtual modality to become a just-in- time learning experience for trainees.
METHOD(S): Remote cases deployed on common web-based video conference platform included; (1) a potential COVID-19 triage, (2) educating on buprenorphine maintenance, (2) counselling on mammogram screening, and (3) addressing frustration with electronic health record documentation. Simulated Patients (SPs) rated residents on communication skills, patient activation and satisfaction, and case-specific telemedicine items. Analyses included a comparison of domain scores (mean % well done) for residents who participated in both the 2020 remote and 2019 in-person OSCEs, and a review of written resident feedback.
RESULT(S): Fewer than half (46%) of 2020's residents (n=23) performed well on the COVID-19 case's telemedicine skill domain. Residents excelled in using nonverbal communication to enrich on-camera communication (100%), but struggled with virtual physical exams (13%), gathering information (4%), and optimizing technology (4%). Residents expressed interest in more opportunity to practice telemedicine skills going forward. Residents' overall COVID-19 knowledge was fair (54% of items were rated as 'well done'). Fewer than half (45%) advised the SP that testing was not available at the time, but that he should call the city hotline for information, and about half (55%) provided quarantine/ home care instructions. In comparing 2020 (virtual) to 2019 (in-person) OSCE scores, residents who participated in both assessments (n=9) performed similarly on communication skills including information gathering (84% vs. 83%), and relationship development (93% vs. 92%), patient satisfaction (72% vs. 80%) and activation (65% vs. 66%). Patient education scores were significantly lower during the virtual OSCE (40% vs. 76%, P=.008).
CONCLUSION(S): Our reformulated OSCE accomplished three goals: (1) physically distancing residents from SPs, (2) providing residents the opportunity to practice critical telemedicine skills, and (3) alerting our educators to curricular improvement areas in virtual physical exam, patient education, gathering information and optimizing technology. Our methods are scalable at other institutions and have applications to the larger medical and clinical education community. LEARNING OBJECTIVE #1: Describe challenges and barriers to effective communication and clinical skill utilization during televisits. LEARNING OBJECTIVE #2: Understand resident physician practice patterns and communication regarding infectious disease

Objective structured clinical examinations (OSCEs) provide a controlled, simulated setting for competency assessments, while unannounced simulated patients (USPs) measure competency in situ or real-world settings. This exploratory study describes differences in primary care residents' skills when caring for the same simulated patient case in OSCEs versus in a USP encounter. Data reported describe a group of residents (n=20) who were assessed following interaction with the same simulated patient case in two distinct settings: an OSCE and a USP visit at our safety-net clinic from 2009 to 2010. In both scenarios, the simulated patient presented as an asthmatic woman with limited understanding of illness management. Residents were rated through a behaviourally anchored checklist on visit completion. Summary scores (mean % well done) were calculated by domain and compared using paired sample t-tests. Residents performed significantly better with USPs on 7 of 10 items and in two of three aggregate assessment domains (p<0.05). OSCE structure may impede assessment of activation and treatment planning skills, which are better assessed in real-world settings. This exploration of outcomes from our two assessments using the same clinical case lays a foundation for future research on variation in situated performance. Using both assessments during residency will provide a more thorough understanding of learner competency.