Faculty Bibliography

PURPOSE/OBJECTIVE:For accelerated 3-year MD (3YMD) pathways to be fully adopted in medical education, a comprehensive analysis of outcome data is needed. This study includes 7 accelerated 3YMD graduating classes at NYU Grossman School of Medicine (NYUGSOM) and reports on outcomes from both medical school and internship compared to their 4-year MD (4YMD) counterparts. METHOD/METHODS:Outcomes across the undergraduate-graduate medical education continuum for the first 7 classes of NYUGSOM graduates (matriculated from 2013-2019) from the accelerated 3YMD (n = 136) and 4YMD pathways (n = 681) were compared. For the internship outcomes, 3YMD interns were compared with 4YMD interns who graduated from NYUGSOM and all 4YMD interns (4YMD graduates from NYUGSOM and any other medical school) at NYUGSOM residencies. RESULTS:Accelerated 3YMD students were approximately 5 months older at admission and had higher multiple mini-interview scores than 4YMD students. Overall, accelerated 3YMD students performed similarly to 4YMD students during medical school and internship. Significant differences included higher performance by 3YMD students on preclerkship exams and lower performance on Steps 1 and 2 (average: 5.6 and 8.3 fewer points, respectively) and the physical examination portion of the NYUGSOM Comprehensive Clinical Skills Exam. Internship data indicated comparable team assessments across all residencies, statistically significant higher performance on Step 3 when compared to all 4YMD interns, and, in internal medicine, comparable clinical reasoning between 3YMD and all 4YMD interns. When comparing 3YMD interns to all 4YMD interns in the internal medicine residency program, 3YMD interns had a statistically significantly higher performance on milestones. CONCLUSIONS:The outcomes from 7 years of graduating accelerated 3YMD students at NYUGSOM show similar performance in medical school and early residency to 4YMD graduates. Long-term study of accelerated 3YMD students from NYUGSOM and other medical schools is needed to further validate the success of this innovative medical education pathway.

BACKGROUND:Unannounced standardized patients (USPs) have long been used to measure clinical performance in situ. These incognito actors capture data on clinician skills during an encounter, as well as patient experience more broadly. A robust USP program requires extensive preparation and standardization efforts. Given the widespread expansion of USPs for education, research, and improvement efforts, we conducted a systematic review with the goal of capturing the breadth of uses of USPs across settings, along with the standardization measures employed across studies. METHODS:In collaboration with a medical librarian, we conducted systematic searches across six databases. Two independent researchers screened each report for inclusion. Three coders extracted and reviewed study characteristics and data from the studies deemed eligible for inclusion. We extracted data on: target population, setting, and assessed skills. We also captured the reliability and fidelity measures described in each study, including USP detection, USP training methods, and assessment measures. RESULTS:128 articles were included. Individual clinicians were the most frequently targeted population (n = 114, 89 %). Common clinician roles included physicians (n = 92, 72 %) and pharmacists (n = 12, 9 %). The collective care team was the target in two studies (2 %), and systems and larger healthcare facilities were targeted in only 1 (1 %) and 13 (10 %) studies, respectively. Studies were primarily conducted in ambulatory settings (n = 118, 92 %). History gathering (n = 76, 59 %), communication (n = 55, 43 %), counseling (n = 51, 40 %), and patient education (n = 49, 38 %) were commonly assessed, as were correct diagnosis (n = 34, 27 %), appropriate ordering of labs/tests (n = 30, 23 %), referrals (n = 35, 27 %), and prescriptions (n = 36, 28 %). USP detection reporting was variable across studies; however, no detection information was provided for 48 studies. 62 % of articles reported incorporating a measure of reliability or fidelity into their study, while the remainder either failed to provide adequate information on use of these measures. CONCLUSIONS:We explored USP use across settings and describe the scope and limitations of the literature. USPs capture a range of data domains but a lack uniform report of reliability measures can potentially undermine findings. Future studies should incorporate and uniformly report out on detection, training, and assessment.

BACKGROUND:Suboptimal support for colleagues experiencing discrimination can adversely impact clinician well-being and patient care. AIM/OBJECTIVE:To describe resident performance and experience during an Objective Structured Clinical Examination (OSCE) case centered on supporting a trainee facing discrimination to inform enhanced, supportive learning environments. SETTING/METHODS:Formative, internal medicine OSCE at a simulation center. PARTICIPANTS/METHODS:148 second-year residents across 2018, 2019, 2021, 2022. PROGRAM DESCRIPTION/METHODS:Residents had 10 min to support a Muslim standardized intern (SI) experiencing discrimination from a patient. The SI rated resident performance across Supervision, Relationship Development, and Support domains and provided written feedback. Post-OSCE evaluations elicited resident reflections on case challenges. PROGRAM EVALUATION/RESULTS:Proficient residents (≥ 80% average score across domains, n = 85) performed better in all items, except in not acting defensive and collaborating with SI to develop follow-up plan, compared to non-proficient residents (n = 65). The SI described effective approaches to feeling supported, including using empathetic statements, stating personal stance on discrimination, exhibiting supportive body language, and verbalizing support. Stating knowledge of situation upfront was an area of improvement. Residents found engaging the distressed SI difficult. DISCUSSION/CONCLUSIONS:Use of an explicit discrimination OSCE case can help identify effective approaches to supporting targets of discriminatory patients to inform future training.

BACKGROUND:Coaching has been proposed to support the transition to residency. Clarifying its impact will help define its value and best use. OBJECTIVE:To explore the experiences of residents working with coaches through the residency transition. DESIGN/METHODS:A cohort comparison survey compared experiences of a coached resident cohort with coaches to the prior, uncoached cohort. PARTICIPANTS/METHODS:Post-graduate year (PGY)-2 residents in internal medicine, obstetrics and gynecology, emergency medicine, and pathology at a single academic center. INTERVENTIONS/METHODS:Faculty trained as coaches had semi-structured meetings with graduating medical students and residents throughout the PGY-1 year. MAIN MEASURES/METHODS:An online anonymous survey assessed effects of coaching on measures of self-directed learning, professional development, program support and impact of coaching using existing scales (2-item Maslach Burnout Inventory, Brief Resilient Coping Scale, 2-item Connor-Davidson Resilience Scale, Stanford Professional Fulfillment Inventory), and novel measures adapted for this survey. Bivariate analyses (t-tests and chi-square tests) compared cohort responses. MANOVA assessed the effects of coaching, burnout and their interactions on the survey domains. KEY RESULTS/RESULTS:Of 156 PGY2 residents, 86 (55%) completed the survey. More residents in the "un-coached" cohort reported burnout (69%) than the "coached" cohort (51%). Burnout was significantly and negatively associated (F = 3.97 (df 7, 75); p < .001) with the learning and professional development outcomes, while being coached was significantly and positively associated with those outcomes (F = 5.54 (df 9, 75); p < .001). Significant interaction effects were found for goal-setting attitudes, professional fulfillment, and perceived program career support such that the positive differences in these outcomes between coached and un-coached residents were greater among burned out residents. Coached residents reported a positive impact of coaching across many domains. CONCLUSIONS:Residents experiencing coaching reported better professional fulfillment and development outcomes, with more pronounced differences in trainees experiencing burnout. Coaching is a promising tool to support a fraught professional transition.

Over the last decade there has been tremendous growth in the development of accelerated MD pathways that allow medical students to graduate in three years. Developing an accelerated pathway program requires commitment from students and faculty with intensive re-thinking and altering of the curriculum to ensure adequate content to achieve competency in an accelerated timeline. A re-visioning of assessment and advising must follow and the application of AI and new technologies can be added to support teaching and learning. We describe the curricular revision to an accelerated pathway at NYU Grossman School of Medicine highlighting our thought process, conceptual framework, assessment methods and outcomes over the last ten years.

In medical education, pathology has traditionally been concentrated in only the preclinical years, often without sufficient emphasis on its practical application in clinical practice. Correspondingly, medical students' interest in pathology as a career has been low. To address this issue and foster a deeper understanding of pathology's clinical relevance and encourage appropriate utilization, we introduced a required exposure to pathology in the surgery clerkship featuring clinicopathological case review in a small group setting. Unlike other approaches, we wanted to create a program that concentrates on pathology cases directly linked to patients whom students cared for during their clerkship rotation, emphasizing the relevance of pathology diagnosis. Feedback has been overwhelmingly positive from participating students, who report an increased awareness of pathology's importance in patient management and of the significance of interdisciplinary collaboration between pathologists and clinicians. A notable feature of this program is its relatively low time and personnel requirements, which facilitate inclusion in the busy clerkship and acceptance in the Department of Pathology. Challenges, such as timely case selection and administrative co-ordination, are being addressed to optimize the program's implementation. In the future, we are considering expanding this model to other clerkships. By rekindling interest in pathology through practical engagement and highlighting its real-world relevance, this approach offers a promising strategy to counteract recruitment challenges in this crucial medical field.

OBJECTIVES/OBJECTIVE:Communication and other clinical skills are routinely assessed in medical schools using Objective Structured Clinical Examinations (OSCEs) so routinely that it can be difficult to monitor and maintain validity. We report on the accumulation of validity evidence for the Clinical Communication Skills Assessment Tool (CCSAT) based on its use with 9 cohorts of medical students in a high stakes OSCE. METHODS:) based on continuous quality improvement and use of the CCSAT for feedback, remediation, curricular design, and research. RESULTS:Implementation of the CCSAT over time has facilitated our communication skills curriculum and training. Thoughtful case development and investment in standardized patient training has contributed to data quality. Item analysis supports our behaviorally anchored scale (not done, partly and well done) and the skills domains suggested by an a priori evidence-based clinical communication model were confirmed via analysis of actual student data. Evidence synthesized across the frameworks suggests consistent validity of the CCSAT for generalization inferences (that it captures the construct), responsiveness (sensitivity to change/difference), content validity/internal structure, relationships to other variables, and consequences/implications. More evidence is needed to strengthen validity of CCSAT scores for understanding extrapolation inferences and real-world implications. CONCLUSIONS AND PRACTICE IMPLICATIONS/CONCLUSIONS:This pragmatic approach to evaluating validity within a program of assessment serves as a model for medical schools seeking to continuously monitor the quality of clinical skill assessments, a need made particularly relevant since the US NBME no longer requires the Step 2 Clinical Skills exam, leaving individual schools with the responsibility for ensuring graduates have acquired the requisite core clinical skills. We document strong evidence for CCSAT validity over time and across cohorts as well as areas for improvement and further examination.

PURPOSE/OBJECTIVE:As the COVID-19 pandemic forced most colleges and universities to go online, student health centers rapidly shifted to telehealth platforms without frameworks for virtual care provision. An urban student health center implemented a needs assessment involving unannounced standardized patients (USPs) to evaluate the integration of a new telehealth workflow and clinicians' virtual communication skills. METHODS:From April to May 2021, USPs conducted two video visits with 12 primary care and four women's health clinicians (N = 16 clinicians; 32 visits). Cases included (1) a 21-year-old female presenting for birth control with a positive Patient Health Questionaire-9 and (2) a 21-year-old male, who vapes regularly, with questions regarding safe sex with men. Clinicians were evaluated using a checklist completed by the USP immediately following the visit and a systematic chart review of the electronic health record. RESULTS:USP feedback indicates most clinicians received high ratings for general communication skills but may benefit from educational intervention in several key telemedicine skills. Clinicians struggled with using nonverbal signals to enrich communication (47% well done), acknowledging emotions (34% well done), and using video for information gathering (34% well done). Low rates of standard screenings (e.g., 63% administered the PHQ-2, <50% asked about alcohol use) suggested protocols for in-person care were not easily incorporated into telehealth practices, and clinicians may benefit from enhanced care team support. Performance reports were shared with clinicians and leadership postvisit. DISCUSSION/CONCLUSIONS:Results suggest project design and implementation is scalable and feasible for use at other institutions, offering a structured methodology that can improve general student health care.

BACKGROUND/UNASSIGNED:NYU Langone Health offers a collaborative research block for PGY3 Primary Care residents that employs a secondary data analysis methodology. As discussions of data reuse and secondary data analysis have grown in the data library literature, we sought to understand what attitudes internal medicine residents at a large urban academic medical center had around secondary data analysis. This case report describes a novel survey on resident attitudes around data sharing. METHODS/UNASSIGNED:We surveyed internal medicine residents in three tracks: Primary Care (PC), Categorical, and Clinician-Investigator (CI) tracks as part of a larger pilot study on implementation of a research block. All three tracks are in our institution's internal medicine program. In discussions with residency directors and the chief resident, the term "secondary data analysis" was chosen over "data reuse" due to this being more familiar to clinicians, but examples were given to define the concept. RESULTS/UNASSIGNED:We surveyed a population of 162 residents, and 67 residents responded, representing a 41.36% response rate. Strong majorities of residents exhibited positive views of secondary data analysis. Moreover, in our sample, those with exposure to secondary data analysis research opined that secondary data analysis takes less time and is less difficult to conduct compared to the other residents without curricular exposure to secondary analysis. DISCUSSION/UNASSIGNED:The survey reflects that residents believe secondary data analysis is worthwhile and this highlights opportunities for data librarians. As current residents matriculate into professional roles as clinicians, educators, and researchers, libraries have an opportunity to bolster support for data curation and education.