Faculty Bibliography

BACKGROUND:Medical Education research suffers from several methodological limitations including too many single institution, small sample-sized studies, limited access to quality data, and insufficient institutional support. Increasing calls for medical education outcome data and quality improvement research have highlighted a critical need for uniformly clean and easily accessible data. Research registries may fill this gap. In 2006, the Research on Medical Education Outcomes (ROMEO) unit of the Program for Medical Innovations and Research (PrMEIR) at New York University's (NYU) Robert I. Grossman School of Medicine established the Database for Research on Academic Medicine (DREAM). DREAM is a database of routinely collected, de-identified undergraduate (UME, medical school leading up to the Medical Doctor degree) and graduate medical education (GME, residency also known as post graduate education leading to eligibility for specialty board certification) outcomes data available, through application, to researchers. Learners are added to our database through annual consent sessions conducted at the start of educational training. Based on experience, we describe our methods in creating and maintaining DREAM to serve as a guide for institutions looking to build a new or scale up their medical education registry. RESULTS:At present, our UME and GME registries have consent rates of 90% (n = 1438/1598) and 76% (n = 1988/2627), respectively, with a combined rate of 81% (n = 3426/4225). 7% (n = 250/3426) of these learners completed both medical school and residency at our institution. DREAM has yielded a total of 61 individual studies conducted by medical education researchers and a total of 45 academic journal publications. CONCLUSION/CONCLUSIONS:We have built a community of practice through the building of DREAM and hope, by persisting in this work the full potential of this tool and the community will be realized. While researchers with access to the registry have focused primarily on curricular/ program evaluation, learner competency assessment, and measure validation, we hope to expand the output of the registry to include patient outcomes by linking learner educational and clinical performance across the UME-GME continuum and into independent practice. Future publications will reflect our efforts in reaching this goal and will highlight the long-term impact of our collaborative work.

The revision of the curriculum at New York University School of Medicine in 2010, with a reduction of the preclerkship curriculum to 18 months, made it possible to offer an accelerated 3-year pathway in 2013 for students who know their career path. The goals of the program include individualizing education, reducing student debt, and integrating undergraduate and graduate medical education. This accelerated 3-year doctor of medicine (3YMD) pathway is the first program of its kind in the United States to offer conditional acceptance to residency programs in all specialties through the National Resident Matching Program. Since inception of the pathway 6 years ago, 81 students have graduated. Critical components to successfully launch and implement the program are described.Unwavering commitment to the program as a high institutional priority by the dean and vice dean for education facilitated the support required by department chairs and residency program directors and the flexibility needed for success. Alignment between the 3- and 4-year pathways has made it possible to add points of entry into the 3-year pathway during the second and third years and to shift back into the 4-year pathway, as warranted. Modifications to how 3YMD students are mentored included changing the role of the departmental advisor and adding a dedicated 3YMD pathway advisor who serves as an advocate for both the students and the program. Having a relatively large number of 3YMD students has contributed to the success of the program and facilitated acceptance by the residencies.

BACKGROUND:System based practice (SBP) milestones require trainees to effectively navigate the larger health care system for optimal patient care. In gastroenterology training programs, the assessment of SBP is difficult due to high volume, high acuity inpatient care, as well as inconsistent direct supervision. Nevertheless, structured assessment is required for training programs. We hypothesized that objective structured clinical examination (OSCE) would be an effective tool for assessment of SBP. AIM/OBJECTIVE:To develop a novel method for SBP milestone assessment of gastroenterology fellows using the OSCE. METHODS:For this observational study, we created 4 OSCE stations: Counseling an impaired colleague, handoff after overnight call, a feeding tube placement discussion, and giving feedback to a medical student on a progress note. Twenty-six first year fellows from 7 programs participated. All fellows encountered identical case presentations. Checklists were completed by trained standardized patients who interacted with each fellow participant. A report with individual and composite scores was generated and forwarded to program directors to utilize in formative assessment. Fellows also received immediate feedback from a faculty observer and completed a post-session program evaluation survey. RESULTS:." One hundred percent of the fellows stated they would incorporate OSCE learning into their clinical practice. CONCLUSION/CONCLUSIONS:OSCEs may be used for standardized evaluation of SBP milestones. Trainees scored lower on SBP milestones than other more concrete milestones. Training programs should consider OSCEs for assessment of SBP.

Corrigendum to: Jeffrey A. Wilhite*, Khemraj Hardowar, Harriet Fisher, Barbara Porter, Andrew B. Wallach, Lisa Altshuler, Kathleen Hanley, Sondra R. Zabar and Colleen C. Gillespie. Clinical problem solving and social determinants of health: a descriptive study using unannounced standardized patients to directly observe how resident physicians respond to social determinants of health. Diagnosis 2020, Volume 7, Issue 3, pages 313-324. https://urldefense.proofpoint.com/v2/url?u=https-3A__doi.org_10&d=DwIBAg&c=j5oPpO0eBH1iio48DtsedeElZfc04rx3ExJHeIIZuCs&r=CY_mkeBghQnUPnp2mckgsNSbUXISJaiBQUhM-Uz9W58&m=TyoCBAKzCpBZ4-uIICybN67eGKr9ePdBC-WexDhSuSM&s=-H9hUl6CWWk07_DiPQFbSmQyI2qWxw4tQLZIEBIpIVY&e= . 1515/dx-2020-0002. Unfortunately, a typographic error in the results portion of the abstract was missed during final stages of proofing and editing. The count of full elicitors should read as 38/68 rather than 28/68, and the % of negative elicitors is 23%. The corrected results read as follows: Residents fell into three groups when it came to clinical problem-solving around a housing trigger for asthma: those who failed to ask about housing and therefore did not uncover mold as a potential trigger (neglectors - 21%; 14/68); those who asked about housing in negative ways that prevented disclosure and response (negative elicitors - 23%, 16/68); and those who elicited and explored the mold issue (full elicitors - 56%; 38/68).
Copyright

BACKGROUND: According to the 2017 American College of Gastroenterology (AGA) guidelines, therapeutic drug monitoring (TDM) of drug trough concentrations and anti-drug antibodies is recommended to optimize treatment with anti-tumor necrosis factor (TNF) agents and thiopurines1. Specifically, the AGA conditionally recommends reactive TDM in patients with active symptoms of inflammatory bowel disease (IBD) while on anti-TNF agents, as such testing is crucial for differentiating between mechanistic, non-immune mediated pharmacokinetic and immune-mediated pharmacokinetic drug failure, and allows providers to appropriately tailor treatment regimens. As such algorithms for monitoring therapies in IBD have evolved, it has become incumbent on physicians caring for these patients to develop techniques to engage in patient-centered care using the technique of shared decision making. Gastroenterology (GI) trainees may not be well versed in navigating these complex interpersonal skills. The Observed Structured Clinical Examination (OSCE) is a well-validated method of assessing core competencies of communication and professionalism. While it is traditionally used at the undergraduate medical education level, it has been used at the graduate level to address disease-specific competencies. Here, we discuss the use of an OSCE to assess the performance of GI fellows in engaging in shared decision-making on the topic of TDM for a patient with complex IBD refractory to treatment.
METHOD(S): Eleven second-year gastroenterology fellows from 4 GI fellowship programs participated in a 4 station OSCE. Previously validated OSCE checklists were used to assess the fellows' performance in IBD-specific cases, one of which will be discussed here. In the "Therapeutic Drug Monitoring" case, the objective for the fellows was to discuss the indications for infliximab trough and antibody testing and how results of this testing would impact treatment based on the AGA guidelines. Checklists were scored on a 3 and 5-point Likert Scale by the Standardized Patient (SP), mapped to the appropriate ACGME milestones by a GI medical educator and normalized on a scale from 0 to 9. Post-OSCE, the fellows were surveyed to assess their perspective on their performance as well as the exam's educational value.
RESULT(S): 6 ACGME milestones were assessed in this OSCE. Scores ranged from mean of 5.85 to 7.88. Fellows scored lowest on gathering and synthesizing essential and accurate information to define each patient's clinical problem(s) (PC1, mean score 5.85) with an average score of 5.85. They scored highest for overall clinical knowledge (MK1, mean score 7.88). Overall, 9/10 (90%) of fellows would be recommended for their interpersonal skills, but only 4/10 (40%) were deemed effective in their communication skills. The majority of fellows noted improvement in their understanding of when to use and how to interpret TDM after the exercise. CONCLUSION(S): This OSCE was designed to assess clinical and communication skills for gastroenterology surrounding the complex clinical arena of therapeutic drug monitoring utilizing crucial communication skills. The results suggest weaker performance linked to gathering and synthesizing clinical information, with stronger performance in clinical knowledge, developing management plans and various communication skills. This OSCE feedback and assessment can be used to develop targeted educational interventions to strengthen clinical and communication skills for providers

Introduction/UNASSIGNED:Despite a decline, smoking rates have remained high, especially in communities with lower income, education, and limited insurance options. Evidence shows that physician-initiated counseling on smoking cessation is effective and saves lives, and that specific skills are needed to appropriately lead this type of patient-physician communication. Residency is a critical moment for future physicians and may be the optimal time to learn, practice, and refine this skillset. Unannounced Standardized Patients (USPs) have been found to be effective, incognito evaluators of resident practices. Methods/UNASSIGNED:This study introduced rigorously trained actors (USPs) into two urban, safety-net clinics to assess resident ability to engage, activate, and counsel a pre-contemplative smoker. A complementary chart review assessed appropriate documentation in the patient's electronic health record (EHR) and its relationship to counseling style and prescribing practices. Results/UNASSIGNED:Resident scores (% well done) on patient education and engagement were low (33% and 23%, respectively). Residents who coupled cessation advice with an open discussion style activated their patients more than those who solely advised cessation across all comparable measures. On EHR documentation, residents who accurately documented smoking history were more likely to directly advise their patient to quit smoking when compared to residents who did not document (t(97) = 2.828, p = .006, Cohen's D = 0.56). Conclusions/UNASSIGNED:Results highlight the need to reinforce training in patient-centered approaches including motivational interviewing, counseling, and shared decision-making. Future research should focus on the effects of smokers in pre-contemplation on physician counseling style and examine the relationship between medical training and provider communication to guide interventions.

Background: Inter-provider variability is a major source of low-value care. The dissemination of clinical practice guidelines (CPGs) has targeted this variability, yet 44% of physicians are non-adherent to CPG. This may be due to factors including exceptionalism and incentive misalignment that present a conflict between comprehensiveness and prudence in work-up. A subset of super-utilizers are notable outliers: fewer than 0.5% of physicians account for 10% of healthcare costs. Super-utilizers order labs, request consults, order imaging, and prescribe medications at rates 30%, 140%, 14%, and 25% higher than the general population. We sought to quantify provider-specific low-value test ordering behaviors across three cases.
Method(s): Unannounced standardized patients (USPs) were trained for standardized simulation of three clinical scenarios: a "Well" visit, a chief complaint of "Fatigue," and a diagnosis of "Asthma." USPs were introduced into medicine residents' clinics in a large urban, safety-net hospital. Diagnostic orders were extracted via retrospective chart review. Scenario-specific appropriateness of diagnostic testing was determined by referencing United States Preventative Services Task Force (USPSTF) and specialty society CPGs. "Excessive" tests were those not explicitly indicated for a given scenario in either USPSTF or society CPGs (versus "indicated" tests). "Discretionary" tests were those conditionally indicated, pending patient-specific factors (such as hemoglobin A1C, pending BMI).
Result(s): One or more excessive tests were ordered in 44%, 22%, and 17% of Well (n=124), Fatigue (n=148), and Asthma (n=148) encounters respectively. Percent of orders that were excessive were 18%, 8%, and 10%, respectively. On average, 1.3 (+/-1.7) excessive orders were made. Within each case, rates of excessive ordering were positively correlated with rates of indicated and discretionary ordering, and negatively correlated with rates of omitting indicated tests. For example, in Fatigue, the correlation between excessive and indicated orders was 0.38, between excessive and discretionary orders rates was 0.59, and between excessive and omitted-indicated tests was-0.25 (all p< 0.05). A similar, statistically-significant pattern was found for the other two cases. 10 (21%) and 4 (8%) of 48 residents completing all scenarios demonstrated excessive ordering at rates atleast 1 and 2 standard deviations above the mean, respectively.
Conclusion(s): Introducing USPs representing clinical scenarios revealed marked inter-provider variability. Positive associations between rates of excessive, discretionary and indicated ordering suggest tendencies for comprehensiveness over prudence. Over one-fifth of residents completing all 3 cases were high-utilizers, and nearly one in ten were super-utilizers. Awareness of provider-level ordering tendencies can guide education and interventions supporting appropriate diagnostic use

Background: To bolster medical student wellbeing and combat burnout, the NYU School of Medicine (NYUSOM) implemented a longitudinal resiliency curriculum coupled with a wellbeing self-assessment tool. We qualitatively studied the impact of this curriculum on knowledge, self-awareness, and behaviors related to wellbeing and resiliency.
Method(s): The MD AWARE curriculum was launched in August 2017 for the NYUSOM class of 2020. Six sessions were implemented at critical junctions of their training. Each session includes a short lecture, followed by a small group activity led by trained facilitators. At the start of each session, students complete an anonymous online self-assessment adapted from three validated assessment tools measuring different aspects of wellbeing and burnout. Students immediately receive scores with explanations and benchmarks of each and then debrief in their small group. After each MD AWARE session, students completed a retrospective pre/post evaluation survey. Focus Groups (FG) were held in December 2017 (after Sessions 1& 2) to gain richer insight into the impact of the curriculum and self-assessment tool. A purposeful sampling strategy with maximal variation was employed to recruit participants; 10 students participated in each FG. Qualitative data was gathered through the surveys and the FG. The FG were recorded and transcribed. Each FG had 2 project staff members and post-session debriefing. Member-checking was also used. Responses were subsequently coded and analyzed by two experienced faculty members (a third colleague assisted in theme triangulation). An iterative data analysis strategy was applied. Throughout the analysis, an audit trail, frequent memo writing and a reflexivity journal was maintained.
Result(s): Themes: Community Building: Connecting with another student it was helpful for my wellbeing Skill and Knowledge Acquisition and Application: The main sort of takeaway is you need to be aware of (Burnout) and if you need help there are resources Importance of Faculty Development: I think that a prep session between those who designed the curriculum and those who facilitate the small-groups could go a long way towards creating the environment I imagine was originally intended Value of Refection: The score didn't add much It was more about the act of answering the questions than the number that came out of it NYU Administration Values Medical Student Wellbeing: Just the fact that NYU has this program and is making it part of orientation already speaks volumes about its priorities: that we matter
Conclusion(s): Thematic analysis of the impact of MD AWARE indicated that it provides concrete information on resources available to the students. Additionally, the students value both protected time with their peers and for self-refection. Lastly, although care must to be taken in selecting faculty to facilitate the small groups, the mere existence of the longitudinal curriculum signaled that the NYUSOM administration values medical student wellbeing