Faculty Bibliography

BACKGROUND: A core responsibility of medical educators is to foster a strong sense of medical professional identity (PI). Few studies specifically examine the qualities that constitute the PI of physicians recognized for exemplary professionalism. We describe those qualities based on an assessment of PI to inform educational efforts and support learners' development of PI.
METHOD(S): We used Colby and Damon's criteria for selection of moral exemplars (1992) to invite nominations of exemplary faculty physicians at NYUGSOM from faculty and trainees. Participants completed the Professional Identity Essay (PIE), a 9-question reflective writing measure based on a wellknown model of adult development that explores meaning making on PI (Bebeau & Lewis, 2004; Kegan, 1982, 1994). Two raters with extensive training and experience in adult developmental theory rated PIE responses for stage or transition phase. PI stages include independent operator, teamoriented idealist, self-defining, and self-transforming. These stages reflect increasing complexity and internalization of PI. We also gathered information on specialty, years in practice, gender, and race/ethnicity.
RESULT(S): Two hundred and twelve faculty were nominated; 35 were invited to participate (based on number of nominations, diversity of ages, backgrounds and career stage), and 21 completed scorable PIEs. They were from 13 specialties; mean career length was 21.5 years (range 6-45), and 35% were female. All but 2 were Caucasian. PIE scores ranged from 3 to 4.5 (Table 1), demonstrating differing and increasingly complex and internalized ways faculty understand their PI, and that not all nominated exemplars share a singular view of professionalism.
CONCLUSION(S): Physicians nominated as exemplars of professionalism embody a range of professional identities and professionalism world-views. Our study provides rich descriptions of multiple pathways to strengthening a physician's professionalidentities, of critical importance to faculty and physician development in a milieu of challenges to recruitment and retention of physicians. This approach can also inform educators' efforts to support PI development in learners and support the development of learning communities that foster a growth mindset. LEARNING OBJECTIVE #1: Recognize importance of strong role models for MPI. LEARNING OBJECTIVE #2: Describe the varying levels of MPI in a cohort of exemplar physicians

BACKGROUND: Performance-based assessment & feedback during medical training is essential for a successful transition before moving onto residency and independent clinical practice. Learners at New York University's School of Medicine (NYUSOM) participate in a routine comprehensive clinical skills examination (CCSE) that takes place at the tail end of medical school. During this exam, learners interact with standardized patients (SPs) and are rated on specific skills using a standardized checklist, measuring important clinical skills domains. NYUSOM has utilized the same assessment tool since 2005. To date, there is limited evidence on the tool's validity and ability to differentiate among students. We sought to provide evidence for it's reliability, validity, and generalizability.
METHOD(S): 1157 learners participated in the CCSE from 2011-2019 and were included in the analysis. Communication domain items assessed included patient education (3 items), relationship development (4 items), information gathering (6 items) and organization/ time management (3 items). Items were scored using a 3-point behaviorally-anchored scale (not, partly, or well done). In order to determine the degree to which the data mapped onto our theoretically-informed communication domains, we conducted a four-factor confirmatory factor analysis (CFA) allowing for factors to correlate (oblique rotation) and using means and variance adjusted weighted-least squares estimation (WLSMV) in order to account for the ordered categorical nature of the communication items. Model fit was assessed using root mean square of approximation (RMSEA) < 0.08, comparative fit index (CFI) > 0.95, and standardized root mean square error (SRMR) <0.08.
RESULT(S): The model fit the data using RMSEA (0.04), CFI (0.98), and SRMR (0.05). All factors were significantly correlated with one another (p < 0.05), with the largest correlation between patient education and organization/ time management (0.86), and information gathering (0.77). The smallest correlation was between organization/ time management and information gathering (0.66). All items (factor loadings) significantly loaded on the factors they measured. Only one item had an insignificant threshold loading between partly and well done, suggesting this part of the response scale may be hard for SPs to differentiate between students with varying ability on this item. Each factor had at least one item that had a factor loading less than 0.7.
CONCLUSION(S): The analysis suggests each item on the communication checklist significantly measures domains they were designed to measure, and that items can be summated to compute overall scores. Domains had one item with a lower loading than the rest, suggesting these items may be measuring something different. Follow up measurement modeling and profile analysis is the next logical step in determining if there is an important sub-domain that identifies a student group operating differentially. LEARNING OBJECTIVE #1: Understand clinical communication LEARNING OBJECTIVE #2: Describe communication measures

BACKGROUND: Internalizing a strong medical professional identity (PI) is a critical part of medical education. Recent studies of medical students have documented that students' PI, measured by the Professional Identity Essay (PIE), a reflective writing assessment of PI based on Kegan's theory of adult development and Bebeau's developmental model of PI, vary and are impacted by education. Little is known about the PI of exemplary professional physicians. We sought to: 1) describe the PI of physicians who exemplify the highest principles of the medical profession, and 2) evaluate NYU faculty identified as professional exemplars by peers to provide data and demonstrate clear role models for learners METHODS: We elicited nominations for professional exemplar physicians from NYU faculty, chief residents, and 4th-year students, using the definition of professionalism developed by Colby and Damon (1992). Participants were recruited after receiving at least 3 nominations; select participants who received 1 or 2 nominations were also recruited to diversify the participants in terms of specialty, years of practice, gender and race.We also used snowball techniques to get nominations fromstudy participants. After consenting, faculty received the 11-question PIE. We analyzed demographic data of nominated faculty and completed a content analysis of the PIE.
RESULT(S): 206 individual faculty were nominated at least one time by 70 community members. 32 individuals were recruited to the study; to date 22 have completed the PIE. The 206 nominees/22 participants represent: 34/12 specialties, average years in practice 17.6/23.8, range of years in practice 62 for nominees/44 for participants. We identified 3 primary themes through the content analysis: (1) Response to Expectations, "Everything. The profession demands everything.As much as this profession takes fromme, it is dwarfed by what I have received in return." (2) Response to Failure: "I fail to live up to expectations every day. Some days thismotivatesme, other days I disappoint myself." (3) Learning from Others: "I view teaching as integral to medical professionalism." There was a range of developmental levels in the responses with some focusing more on external rather than internal motivations: "I can say that the [malpractice] process for me was very threatening, emotionally consuming and had the potential to alter professional behavior in the wrong way."
CONCLUSION(S): Nominated faculty represented a diverse group with respect to PI. Many participants demonstrated great professionalism and a sense of internal PI in responses to the PIE questions, while others focused onmore externalmotivations to drive their professional behaviors. Further analysis is needed to define the qualities of a true exemplary professional. The range of responses of the exemplars can both serve as role models for learners and provide multiple pathways for learners and faculty to strengthen their own professional identities

One of the main goals of the CoreEPA pilot has been to determine the feasibility of developing a process to make summative entrustment decisions regarding entrustable professional activities (EPAs). Five years into the pilot, we report results of a research study we conducted to explore approaches to the entrustment process undertaken by our ten participating schools. We sought to identify the choices that participating schools made regarding the entrustment process and why these decisions were made. We are sharing these results, highlighting ongoing challenges that were identified with the intent of helping other medical schools that are moving toward EPA-based assessment. We conducted semi-structured interviews with representatives of all 10 medical schools in the CoreEPA pilot to understand their choices in designing the entrustment process. Additional information was obtained through follow-up communication to ensure completeness and accuracy of the findings. Several common themes are described. Our results indicate that, while approaches to the entrustment process vary considerably, all schools demonstrated consistent adherence to the guiding principles of the pilot. Several common barriers to the entrustment process emerged, and there was a consensus that more experience is needed with the process before consequential entrustment decisions can be made. The CoreEPA pilot schools continue to address challenges identified in implementing entrustment processes and making entrustment decisions for our students graduating in the Class of 2020.

Background: The core Entrustable Professional Activities medical school graduates should be able to perform on day 1 of residency provides a framework for readiness for residency. Communication skills are an essential foundation for these core EPAs and yet there have been few studies that describe communication competence across the UME-GME continuum. We report on our OSCE-based assessment of communication skills from the first few weeks of medical school to the first year of medicine residency.
Method(s): Assessment of communication is consistent in our OSCE program across UME and GME. Domains include Information Gathering (5 items), Relationship Development (6 items), and Patient Education (3 items) and these are assessed via a behaviorally anchored checklist (scores=% well done) that has strong reliability and validity evidence. In this study, we report on 3 multi-station OSCEs: the Introductory Clinical Experience (ICE) OSCE that occurs within the first weeks of medical school; the high-stakes, pass/fail Comprehensive Clinical Skills Examination (CCSE) OSCE that is fielded after clerkship year; and the Medicine Residency Program's PGY 1 OSCE. Across 3 classes of medical school (2014-2016) we have complete data for the 24 students who continued on in our Medicine Residency (and who provided consent to include their educational data in an IRB-approved registry). Analyses focus on differences in communication skills over time and between cohorts and the relationship between communication skills measured in medical school and those assessed in residency.
Result(s): Communication scores show significant improvement through medical school (but not into residency) in Information gathering (ICE mean=56%; CCSE mean=76%; PGY1 mean=77%) (F=11.54, p<.001, ICE< CCSE) and in relationship development (ICE=59%; CCSE=78%; PGY1= 74% (F=10.68, p<.001, ICE < CCSE). Mean patient education skills, however, increase significantly across all 3 time points (32% to 50% to 65%; F=31.00, p<.001). Patterns are similar across cohorts except that the Class of 2016 means increase from CCSE to PGY1. Regression analyses show that CCSE information gathering scores are more strongly associated with PGY performance than ICE scores (Std Beta=.32 vs.06), while for relationship development, it is the ICE scores that are more strongly associated (Std Beta=.40 vs.24). ICE and CCSE patient education skills have associations with PGY1 skill of similar size (Std Beta=.30 and.28).
Conclusion(s): Findings, despite the small sample, suggest a clear developmental trajectory for communication skills development and that information gathering and patient education skills may be more influenced by medical school than relationship development. That communication skills seem to level out in PGY1 highlights need for re-consolidation as clinical complexity increases. Results can inform theory development on how communication skills develop and point to transitions where skills practice/feedback may be particularly important

Background/UNASSIGNED:Despite evidence that biological and genetic factors contribute strongly to obesity, many healthcare providers still attribute obesity more to controllable behavioral issues rather than factors outside a person's control. We evaluated whether medical school students' beliefs about obesity correlate with ability to effectively counsel patients with obesity. Methods/UNASSIGNED:Clerkship-year medical students at NYU School of Medicine completed an Objective Structured Clinical Experience (OSCE) that tests ability to effectively counsel standardized actor-patients with obesity. We surveyed these students to evaluate their beliefs about the causes of obesity and their attitudes towards people with obesity. We analyzed correlations between student beliefs, negative obesity attitudes, and OSCE performance. Results/UNASSIGNED: < 0.05). Conclusions/UNASSIGNED:Attribution of obesity to external factors correlated with greater ability to counsel patients with obesity, suggesting that educating providers on the biological causes of obesity could help reduce bias and improve provider care.

OBJECTIVE:1) To explore the links between Indigenous Australian children's perspectives on culture, and healthy lifestyle behaviours. 2) To provide insight into how to approach the development of a health intervention targeting lifestyle behaviours in Australian Indigenous children. METHODS:Seven semi-structured focus groups sessions were conducted with Australian Indigenous children aged 5-12 years living on the South Coast of New South Wales. Audio-recordings were transcribed and thematic analyses were conducted and related to principles of grounded theory. RESULTS:Participants had connections to aspects of Australian Indigenous culture that were embedded in their everyday lives. Healthy lifestyle behaviours (such as healthy eating and physical activity) were found to be interconnected with Australian Indigenous culture and positive emotional wellbeing was identified as an important outcome of connecting Australian Indigenous children to cultural practices. CONCLUSION/CONCLUSIONS:Understanding the importance of culture and its role in healthy lifestyles is critical in the development of health interventions for Indigenous populations. IMPLICATION/CONCLUSIONS:Health interventions embedded with Australian Indigenous culture may have potential to improve physical and emotional health within Australian Indigenous communities. However, it is unlikely that a 'one size fits all' approach to health interventions can be taken.

BACKGROUND: It is critically important for medical schools to understand how well prepared their graduates are for residency and yet we do not have a full understanding of how well competencies, assessed in medical school, transfer to residency. This study explores how communication skills measured in a high-stakes, rigorous, comprehensive OSCE in the 3rd year of medical school are related to performance in a similar OSCE in residency and to Residency Program Directors' ratings of intern competence. METHODS: We analyzed communication skills from three time points in a longitudinal cohort of NYU graduates who entered our Internal Medicine Residency (n = 42). 39 provided consent for their GME-UME data to be compiled into a longitudinal, de-identified educational research database through an IRB-approved Registry. Communication skills were measured using a behaviorally anchored 15-item checklist across the 8-station, pass/fail, MS3 OSCE and then midway through PGY2 of residency in a 6- station OSCE (score =% of items rated well done). SPs also provided an overall rating of communication skills (not recommend, with reservations, recommend, highly recommend). In between, at the end of intern year, residents were also rated by their Program Directors on communication skills (and other competencies) using a 4-pt scale. RESULTS: OSCE communication performance assessed in medical school was modestly associated with performance in residency (r = .26, p = .07) but not with Program Directors' ratings of residents' communication skills as interns (r = .11, p = .28). Number of cases in which medical students were "not recommended" for their communication skills was negatively associated with residency OSCE communication scores (r = -.33, p = .05) and positively associated with number of "not recommends" (r = .46, p = .01) but not with Directors' ratings of interns (r = -.08, p = .49). Number of not recommends independently explained more variance in subsequent residency communication scores than did medical school performance (9% vs. 5%). While average OSCE communication scores improved from medical school to residency (65 to 71%), those with 2 or more "not recommends" improved significantly more than those with 1 or no not recommends. Overall, most learners' (21/39) communication scores improved substantially; less than a quarter (7) decreased; and about a quarter (11) were stable. CONCLUSIONS: While communication scores from medical school are associated with similarly measured scores in residency, SPs' decisions to "not recommend" students appear to serve as an independent indicator of future skill deficits. Patterns of change, however, are not necessarily straightforward: students with the most "not recommends" improved the most. The ability to track competency assessments longitudinally is essential for understanding the transition from medical school to residency and future research will benefit from larger sample sizes and the inclusion of learner characteristics that may explain developmental patterns

NEEDS AND OBJECTIVES: Standardized Patients (SPs) are integral to health care professions (HCPs) training. We must understand this workforce, make effective use of SPs' skills, and ensure they accurately portray cases and rate learners. To be authentic, simulation should reflect the demographics of the population served, while providing exposure to less commonly seen patients. We created an SP database to facilitate our work with SPs; review their demographic characteristics; and align information on SP performance -to better serve our educational mission. SETTING AND PARTICIPANTS: NYSIM (Simulation Center for NYU Langone and the City University of NY) serves hundreds of HCP training programs for learners at all levels. While sharing common resources, many programs independently recruit and train SPs. DESCRIPTION: We fielded a web-based survey for SPs and staff to populate the database. Survey items were iteratively reviewed by staff and SPs to ensure items elicited key information. Questions included basic demographics; SP experience/training; other professional background; and relevant physical findings (eg scars, cardiac findings). SPs also uploaded a headshot and resume. Staff separately input information about SPs' work on cases and programs; information about case portrayals; types of cases for which the SP is best suited, and other relevant information. EVALUATION: To date, we have 232 SP surveys, representing the majority of SPs at NYSIM. Demographics included gender (43% male, 56% female, 1% transgender), age range (x = 34.9 years, range teen to 75+) and selfidentified race (71% Caucasian, 17% African-American, 25.6% Asian/South Asian, 3.5% Middle Eastern, 3% Native American/Pacific Islander and 9% other). 22%are bilingual, with over 20 languages represented. SPs had a broad range of SP experience (x = 2.8 years, S.D. = 1.8, range 0-20 years). Almost all SPs were trained in basic case portrayal, with others being trained in aspects of the physical exam, emotional issues, giving feedback, and high stakes rating. SPs bring other skills to their work, including teaching (75%) or healthcare (12%). Survey information helps educators recruit SPs and identify (re)training needs. SPs who perform high stakes exams or are Unannounced Standardized Patients are shielded from general recruitment in order to maintain their anonymity. DISCUSSION/REFLECTION/LESSONS LEARNED: An SP database is useful for a high volume simulation center. Information in a searchable SP data base allows programs to understand the potential pool and expertise of SPs, and to track learners' exposure to specific SPs (this is relevant as our internal data reveal that SPs with more experience tend rate towards the middle of the scale). The demographic characteristics of our SPs broadly match the profile of our healthcare systems, and tracking the data allows us to maintain a good fit between SPs and our environment

AIM: To assess the feasibility and utility of measuring baseline professional identity formation (PIF) in a theory-based professionalism curriculum for early medical students. METHODS: All 132 entering students completed the professional identity essay (PIE) and the defining issues test (DIT2). Students received score reports with individualized narrative feedback and wrote a structured reflection after a large-group session in which the PIF construct was reviewed. Analysis of PIEs resulted in assignment of a full or transitional PIF stage (1-5). The DIT2 score reflects the proportion of the time students used universal ethical principles to justify a response to 6 moral dilemma cases. Students' reflections were content analyzed. RESULTS: PIF scores were distributed across stage 2/3, stage 3, stage 3/4, and stage 4. No student scores were in stages 1, 2, 4/5, or 5. The mean DIT2 score was 53% (range 9.7?76.5%); the correlation between PIF stage and DIT score was rho = 0.18 (p = 0.03). Students who took an analytic approach to the data and demonstrated both awareness that they are novices and anticipation of continued PIF tended to respond more positively to the feedback. CONCLUSIONS: These PIF scores distributed similarly to novice students in other professions. Developmental-theory based PIF and moral reasoning measures are related. Students reflected on these measures in meaningful ways suggesting utility of measuring PIF scores in medical education.