Faculty Bibliography

NEEDS AND OBJECTIVES: Standardized Patients (SPs) are integral to health care professions (HCPs) training. We must understand this workforce, make effective use of SPs' skills, and ensure they accurately portray cases and rate learners. To be authentic, simulation should reflect the demographics of the population served, while providing exposure to less commonly seen patients. We created an SP database to facilitate our work with SPs; review their demographic characteristics; and align information on SP performance -to better serve our educational mission. SETTING AND PARTICIPANTS: NYSIM (Simulation Center for NYU Langone and the City University of NY) serves hundreds of HCP training programs for learners at all levels. While sharing common resources, many programs independently recruit and train SPs. DESCRIPTION: We fielded a web-based survey for SPs and staff to populate the database. Survey items were iteratively reviewed by staff and SPs to ensure items elicited key information. Questions included basic demographics; SP experience/training; other professional background; and relevant physical findings (eg scars, cardiac findings). SPs also uploaded a headshot and resume. Staff separately input information about SPs' work on cases and programs; information about case portrayals; types of cases for which the SP is best suited, and other relevant information. EVALUATION: To date, we have 232 SP surveys, representing the majority of SPs at NYSIM. Demographics included gender (43% male, 56% female, 1% transgender), age range (x = 34.9 years, range teen to 75+) and selfidentified race (71% Caucasian, 17% African-American, 25.6% Asian/South Asian, 3.5% Middle Eastern, 3% Native American/Pacific Islander and 9% other). 22%are bilingual, with over 20 languages represented. SPs had a broad range of SP experience (x = 2.8 years, S.D. = 1.8, range 0-20 years). Almost all SPs were trained in basic case portrayal, with others being trained in aspects of the physical exam, emotional issues, giving feedback, and high stakes rating. SPs bring other skills to their work, including teaching (75%) or healthcare (12%). Survey information helps educators recruit SPs and identify (re)training needs. SPs who perform high stakes exams or are Unannounced Standardized Patients are shielded from general recruitment in order to maintain their anonymity. DISCUSSION/REFLECTION/LESSONS LEARNED: An SP database is useful for a high volume simulation center. Information in a searchable SP data base allows programs to understand the potential pool and expertise of SPs, and to track learners' exposure to specific SPs (this is relevant as our internal data reveal that SPs with more experience tend rate towards the middle of the scale). The demographic characteristics of our SPs broadly match the profile of our healthcare systems, and tracking the data allows us to maintain a good fit between SPs and our environment

BACKGROUND: Safe, high quality outpatient care often depends on the degree to which patients understand their situation and how to follow through on physician recommendations. However, we do not know enough about how often physicians focus on ensuring that their patients have achieved these understandings by the end of the visit and whether such end-of-visit practices are associated with physicians' communication, patient education and activating skills. METHODS: Two Unannounced Standardized Patient cases (highly trained actors who present as real patients) were delivered to 71 internal medicine residents in two clinics: one required the physician to identify a patient's depression and engage him in follow-up care, and the other required the physician to recognize a patient's failure to use her asthma medicine correctly and educate her in using it properly. End-of-visit practices were: reviewing the plan; asking if further questions; giving information about follow-up care and further contact; and helping the patient navigate the system in order to follow through on next steps. Each was assessed by the SP as not done, partly done, or well done. SPs also rated physicians' communication skills, patient activating skills, and case-specific education skills. Summary scores were calculated as% of items well done. RESULTS: Close to three-quarters of the physicians reviewed the plan with the patient and invited further questions in the depression case and slightly more than half did so in the asthma case (56 and 60%). Patients were given complete information about follow-up care and how to navigate the system in just under half of depression visits (49 and 47%) and just over half of asthma visits (58 and 58%). On average, residents were rated as performing 61% of these 8 items well (SD 28%) across both cases. Primary care residents performed significantly better than categorical internal medicine residents (67%vs 47%, p = .004). There were no differences by physician gender. End of visit scores were significantly positively correlated with both general and casespecific clinical skills, and after controlling for the variance contributed by the program (R2 = 12%, p = .004), case-specific education scores explained 10% of the variance in end of visit score (p = .005), patient activating skills 10% of the variance (p = .002) and communication skills 13% of the variance (p = .001). With all variables in the model, only the general communication domain of patient education and counseling was independently associated with end of visit scores (Std Beta = .35, p = .015). CONCLUSIONS: Had these patients been real patients, in one-quarter to onehalf of the visits, the patient would have left not fully understanding the plan or how to follow-through on care. Resident physicians with more effective communication and patient activating skills tended to provide safer end-of-visit care, suggesting that these may reflect an outpatient safety orientation or skillset

BACKGROUND: Chinese Americans represent the fastest growing immigrant population in the United States, and they face unique mental health challenges. To best care for this population internists should understand the effects of acculturation, defined as the change that occurs when an ethnic minority encounters a dissimilar dominant culture. The relationship between acculturation and mental health is complex. We sought to describe this relationship in Chinese immigrants currently living in New York City. METHODS: We analyzed data from the Chinese American Cardiovascular Health Assessment, a cross-sectional survey of foreign-born Chinese adults living in New York City (n = 2071). Primary outcomes included depression, stress and physical symptoms, and the primary exposure was acculturation. Rates of depression, stress, and physical symptoms were surveyed using validated tools. Acculturation was evaluated using the Stephenson Multigroup Acculturation Scale, which is an assessment of both ethnic and dominant society immersion (ESI and DSI). Mean acculturation, depression and stress scores were stratified by demographics. Differences were assessed using one-way ANOVA analysis. RESULTS: Our population was generally middle-aged, well-educated, and employed. Younger age, female gender, shorter duration of residence in the US, single marital status and poor perceived health were associated with higher rates of depression and stress. Overall the cohort was more acculturated to China (average ESI 3.67 out of 4) than America (DSI 2.11 out of 4). Participants who were depressed had lower acculturation to ethnic society compared to those without depression (ESI 3.59 vs ESI 3.67, p = 7.13e-5). This difference was not seen when comparing acculturation to dominant society in depressed vs not depressed participants (DSI 2.08 vs DSI 2.11, p = 0.53). Higher levels of stress were associated with lower acculturation to both ethnic (ESI 3.62 vs 3.67, p = 0.003) and dominant cultures (DSI 2.0 vs 2.12, p = 0.002). Participants with depression and stress were more likely to have physical symptoms and lower self-rated health. CONCLUSIONS: We performed a descriptive analysis of Chinese immigrants living in NYC to characterize the interaction between acculturation, depression and stress. We observed that depressed participants had lower acculturation to their ethnic society, but not dominant society, perhaps suggesting a protective effect of connection to one's home society. Future mental health interventions may target patients with low acculturation by increasing access to community events, employing Chinese community health workers, or leading group visits to targeted groups. This study is consistent with prior research demonstrating a relationship between physical symptoms and mood in Chinese immigrants. Internists should consider physical symptoms as potential indicators of underlying mood disorders in this underserved population, as early identification may lead to improved diagnosis and treatment

BACKGROUND: Effective smoking cessation counseling improves smokers' health and quality of life. As part of our assessment program, an Unannounced Standardized Patient (USP) case was developed to measure residents' performance in a routine visit with a smoker. METHODS: The USP was a 40 year-old male new patient presenting with heartburn. He began smoking up to two packs/day at 22 years old; at the time of the visit, he reports having cut down to one pack/day and quitting cold turkey twice in the past only to return to smoking. If the resident engages him, he discusses his relationship with smoking and the possibility of quitting. TheUSP received 6 hours of character and checklist training to ensure standardized portrayal and evaluation. Data was collected using 2 forms of assessment: a post-visit USP checklist and a systematic review of the EMR (lab orders, prescriptions, and referrals). The 170- item USP checklist measured communication, patient education, assessment skills, and case-specific items. Each response option included descriptive behavioral anchors and was rated as not done, partly done, or well done. RESULTS: Data was examined from 73 USP visits from 2009-2015. Mean visit length = 37 min, SD = 15 min (range: 15 to 95 min). Overall communication scores ranged from 17 to 100% with an average of 62% (Cronbach's alpha = 0.75). All residents documented History of Tobacco Use or Tobacco Use Disorder in the EMR, and the majority (82%) prescribed smoking cessation medication. There was variation in the sophistication of smoking cessation-counseling approach. Whilemost residents (78%) discussed the risks of smoking and/or the benefits to quitting, significantly fewer (48%) explored the patient's view of the pros and cons of his smoking (p = 0.00). Residents who prescribed smoking cessation medication and discussed risks/benefits to smoking/quitting (N = 31) were compared to residents who did the same but also invited the patient to discuss his personal pros and cons of smoking (N = 29). Groups were not significantly different by PGY or gender. Patients who were asked to discuss their pros/cons rated the resident higher on patient activation questions (0-2 point scale), including "Helped you understand the importance of quitting smoking" (1.38 vs 0.90, p = 0.00), "Made you want to change your smoking" (1.10 vs 0.52, p = 0.00), and "Made you feel like you would be able to quit smoking" (1.07 vs 0.35, p = 0.00). There were no significant differences in labs ordered, referrals to a smoking cessation program, or quality of documentation. CONCLUSIONS: While all residents ask about tobacco use and most appropriately prescribe medication, fewer than half demonstrate the skills known to motivate patients to quit smoking. Curricula needs to reinforce the importance of a patient discussing their personal relationship with smoking in order to feel activated and willing to engage in cessation

BACKGROUND: At Bellevue Hospital Center (BHC), we have a robust Unannounced Standardized Patient (USP) program, where trained actors portraying real patients in the clinical setting, incognito, assess the residents' skills following their visit. We sought to determine the relationship between USP ratings of residents' skills and clinical outcomes among the residents' continuity patient panels to define educationally sensitive patient outcomes. METHODS: We assembled a retrospective cohort of PGY 2 internal medicine residents with at least 2 USP visits between 7/1/14-6/30/15 and ambulatory care patient panels at BHC. The two outcome variables were the percentage of hypertensive patients in the residents' panel with blood pressure (BP) <140/90, and the average of the most recent glycosylated hemoglobin (HbA1C) result among the residents' patients with diabetes. The predictor variables included mean USP ratings of residents' clinical skills and mean faculty rating of the residents' clinic notes (scored for quality on a 0 to 3 scale). USPs used a behaviorally anchored checklist (not done, partly done, well done) for the following domains: communication, case specific assessment, patient education, physical examination, professionalism, management plan, patient satisfaction, and patient activation measure. We tested the correlations between USP scores with BP and HbA1C control, and then developed multivariate, linear regression models of USP scores on BP and HbA1C scores, respectively, each controlling for Avg. Chronic health score (ACHS, derived by scoring different clinical conditions by acuity and used to determine if the panel is getting sicker over time) and total number of patients in the panel (TNPP) because these variables were correlated with both the outcome and predictor variables. RESULTS: 29 PGY 2 residents had a mean of 2.5 (SD 1.0) USP visits during the study period. Residents' patient panels size varied (median 124, range 62- 171) and mean patient age was 48 years (SD 1.4). Patient Activation scores were correlated with Average Chronic Health Score (r = .482, p = .008) and Panel Average last A1c (r = -.311, p = .10). Patient activation scores explained 16% variance in the mean panel last HgA1c, (adjusted R2 .137, p = .08). Case specific Assessment & Patient Education skills across USP cases explained 21.5% of the variance and the Average Chart Note Score explained 14.4% of the variance in % of Hypertension controlled (adjusted R2.378, p < .009). CONCLUSIONS: This exploratory study suggests that learnable resident clinical skills are associated with quality of care indicators for HTN and DM control. In particular, being able to activate patients, assess and educate them and write high quality notes are pathways to quality care. Next steps are to confirm these findings in a larger dataset. Doing so will help align medical education with patient safety and care quality and provide guidance for educational and clinical research aimed at improving the health of populations served

BACKGROUND: It is critically important for medical schools to understand how well prepared their graduates are for residency and yet we do not have a full understanding of how well competencies, assessed in medical school, transfer to residency. This study explores how communication skills measured in a high-stakes, rigorous, comprehensive OSCE in the 3rd year of medical school are related to performance in a similar OSCE in residency and to Residency Program Directors' ratings of intern competence. METHODS: We analyzed communication skills from three time points in a longitudinal cohort of NYU graduates who entered our Internal Medicine Residency (n = 42). 39 provided consent for their GME-UME data to be compiled into a longitudinal, de-identified educational research database through an IRB-approved Registry. Communication skills were measured using a behaviorally anchored 15-item checklist across the 8-station, pass/fail, MS3 OSCE and then midway through PGY2 of residency in a 6- station OSCE (score =% of items rated well done). SPs also provided an overall rating of communication skills (not recommend, with reservations, recommend, highly recommend). In between, at the end of intern year, residents were also rated by their Program Directors on communication skills (and other competencies) using a 4-pt scale. RESULTS: OSCE communication performance assessed in medical school was modestly associated with performance in residency (r = .26, p = .07) but not with Program Directors' ratings of residents' communication skills as interns (r = .11, p = .28). Number of cases in which medical students were "not recommended" for their communication skills was negatively associated with residency OSCE communication scores (r = -.33, p = .05) and positively associated with number of "not recommends" (r = .46, p = .01) but not with Directors' ratings of interns (r = -.08, p = .49). Number of not recommends independently explained more variance in subsequent residency communication scores than did medical school performance (9% vs. 5%). While average OSCE communication scores improved from medical school to residency (65 to 71%), those with 2 or more "not recommends" improved significantly more than those with 1 or no not recommends. Overall, most learners' (21/39) communication scores improved substantially; less than a quarter (7) decreased; and about a quarter (11) were stable. CONCLUSIONS: While communication scores from medical school are associated with similarly measured scores in residency, SPs' decisions to "not recommend" students appear to serve as an independent indicator of future skill deficits. Patterns of change, however, are not necessarily straightforward: students with the most "not recommends" improved the most. The ability to track competency assessments longitudinally is essential for understanding the transition from medical school to residency and future research will benefit from larger sample sizes and the inclusion of learner characteristics that may explain developmental patterns

PURPOSE: Patient education is critical in ensuring patient compliance and good health outcomes. Fellows must be able to effectively communicate with their patients, delivering enough information for the patient to understand their medical problem and maximize patient compliance. We created an objective structured clinical examination (OSCE) with four liver disease cases to assess fellows' knowledge and ability to inform standardized patients about their clinical condition. METHODS: We developed four cases highlighting different aspects of liver disease and created a four station OSCE: hepatitis B, acute hepatitis C, new diagnosis of cirrhosis, and an end-stage cirrhotic non transplant candidate. The standardized patient (SP) with hepatitis B was minimizing the fact that she could not read English. The acute hepatitis C SP was a nursing student who is afraid that having hepatitis C might jeopardize her career. The SP with the new diagnosis of alcoholic cirrhosis needed to stop drinking, and the end-stage liver disease patient had to grapple with his advanced directives. Twelve fellows from four GI training programs participated. Our focus was to assess the fellows' knowledge about liver diseases and the ACGME competencies of health literacy, shared decision making, advanced directives and goals of care. The goal for the fellows was to communicate effectively with the SPs, and acknowledge that each patient had an emotionally charged issue to overcome. The SPs used a checklist to rate fellow's performance. Faculty and the SPs observed the cases and provided feedback. The fellows were surveyed on their performance regarding the case. RESULTS: The majority of fellows were able to successfully summarize findings and discuss a plan with the patient in the new diagnosis of cirrhosis (76.92%) and hepatitis C case (100%), but were less successful in the hepatitis B (30.77%) and end-of-life case (41.67%). Overall, a small percentage of fellows reflected that they did a good job (22-33%), except at the end-of-life case (67%). The fellows' greatest challenge was trying to cover a lot of information in a single outpatient visit. CONCLUSION: Caring for patients with liver diseases can be complex and time consuming. The patients and fellows' observations were discordant in several areas: for example. the fellows believed they excelled in the end-of-life case, but the SP thought only a small percentage of fellows were able to successfully summarize and discuss the plan. This discrepancy and others highlight important areas of focus in training programs. OSCEs are important to help the fellows facilitate striking the right balance of information delivery and empathy, and this will lead to better patient education, compliance, rapport, and satisfaction.

BACKGROUND:A handful of medical schools in the U.S. are awarding medical degrees after three years. While the number of three-year pathway programs is slowly increasing there is little data on the opinions of medical education leaders on the need for shortening training. PURPOSE/OBJECTIVE:To survey deans and program directors (PDs) to understand the current status of 3-year medical degree programs and to elicit perceptions of the need for shortening medical school and the benefits and liabilities of 3-year pathway programs (3YPP). METHODS:Online surveys were emailed to the academic deans of all U.S. medical schools and to a convenience sample of residency and fellowship PDs. Frequency distributions are reported for key survey items and content analysis was used to describe open-ended responses. RESULTS:Of the respondents, 7% have a 3YPP, 4% were developing one, and 35% were considering development. In 2014, 47% of educational deans and 32% of PDs agreed that there may be a need to shorten medical school. From a list of benefits, both deans and PDs agreed that the greatest benefit to a 3YPP was debt reduction (68%). PDs and deans felt reduced readiness for independence, reduced exposure to complementary curricula regarding safety and quality improvement, premature commitment to a specialty, and burnout were all potential liabilities. From a list of concerns, PDs were concerned about depth of clinical exposure, direct patient care experience, ability to assume increased responsibility, level of maturity, and certainty regarding career choice. CONCLUSIONS:Over one-third of medical schools are considering the development of a 3YPP. While there may be benefits for a select group of students, concerns regarding maturity, depth of clinical exposure, and competency must be addressed for these programs to be well received.

ISSUE/OBJECTIVE:Medical educators and educational researchers continue to improve their processes for managing medical student and program evaluation data using sound ethical principles. This is becoming even more important as curricular innovations are occurring across undergraduate and graduate medical education. Dissemination of findings from this work is critical, and peer-reviewed journals often require an institutional review board (IRB) determination. APPROACH/METHODS:IRB data repositories, originally designed for the longitudinal study of biological specimens, can be applied to medical education research. The benefits of such an approach include obtaining expedited review for multiple related studies within a single IRB application and allowing for more flexibility when conducting complex longitudinal studies involving large datasets from multiple data sources and/or institutions. In this paper, we inform educators and educational researchers on our analysis of the use of the IRB data repository approach to manage ethical considerations as part of best practices for amassing, pooling, and sharing data for educational research, evaluation, and improvement purposes. IMPLICATIONS/CONCLUSIONS:Fostering multi-institutional studies while following sound ethical principles in the study of medical education is needed, and the IRB data repository approach has many benefits, especially for longitudinal assessment of complex multi-site data.