Faculty Bibliography

PROBLEM: Efforts to evaluate and optimize the effectiveness of medical education have been limited by the difficulty of designing medical education research. Longitudinal, epidemiological views of educational outcomes can help overcome limitations, but these approaches require "bigger data"-more learners, sources, and time points. The rich data institutions collect on students and residents can be mined, however, ethical and practical barriers to using these data must first be overcome. APPROACH: In 2008, the authors established the Research on Medical Education Outcomes (ROMEO) Registry, an educational data registry modeled after patient registries. New York University School of Medicine students, residents, and fellows provide consent for routinely collected educational, performance, quality improvement, and clinical practice data to be compiled into a deidentified, longitudinal database. As of January 2015, this registry included 1,225 residents and fellows across 12 programs (71% consent rate) and 841 medical students (86% consent rate). Procedures ensuring voluntary informed consent are essential to ethical enrollment and data use. Substantial resources are required to provide access to and manage the data. OUTCOMES: The registry supports educational scholarship. Seventy-two studies using registry data have been presented or published. These focus on evaluating the curriculum, quality of care, and measurement quality and on assessing needs, competencies, skills development, transfer of skills to practice, remediation patterns, and links between education and patient outcomes. NEXT STEPS: The authors are working to integrate assessment of relevant outcomes into the curriculum, maximize both the quantity and quality of the data, and expand the registry across institutions.

BACKGROUND: In the patient-centered medical home model of health care, both health care providers (HCPs) and patients must understand their respective roles and responsibilities, view the other as a partner, and use communication skills that promote shared decision making. This is particularly necessary in chronic conditions where outcomes depend on behavior change and in underserved populations where the burden of chronic disease is high. OBJECTIVE: The objectives of this study are to determine if a Patient Empowerment Program (PEP) (1) is acceptable to patients and feasible across multiple clinical sites; (2) will increase patient preference for control in medical decision making, improve patient perceptions of patient-HCP communication, and increase patient activation; (3) is associated with an increase in diabetes self-management behaviors; and (4) has an effect on hemoglobin A1c (HbA1c) level. METHODS: This study recruited English-speaking adult patients with type 2 diabetes mellitus from three urban clinical sites in New York City and randomized them to an immediate intervention group that completed the PEP intervention or a deferred intervention group that served as a wait-list control and completed the PEP intervention after 3-4 months. The PEP intervention consists of two facilitated small group sessions. Session 1 focuses on defining HCP and patient roles in the medical encounter by introducing ideal communication behaviors in each role and by providing both positive and negative examples of patient-HCP encounters. Session 2 focuses on practicing communication skills by role-playing with actors who serve as standardized health care providers. After the role play, participants set goals for their own health care and for future interactions with their HCPs. Outcome measures include the Patient Activation Measure; Ask, Understand, Remember Assessment; Krantz Health Opinion Survey; SF-12v2 Health Survey; Diabetes Self-Management Questionnaire; and HbA1c. These measures will be assessed at the time of enrollment, after the waiting period (deferred intervention only), and then postintervention at 1 week, 3 months, and 6 months. RESULTS: Study recruitment occurred from November 2014 to June 2015, with a total of 80 patients enrolled. To date, 45 participants have attended at least one session of the PEP intervention. Further intervention sessions and post-intervention follow-up are ongoing, with data collection set to be completed in April 2016 and results of data analysis available by June 2016. CONCLUSIONS: From preliminary participant self-report data, our PEP intervention is acceptable to low-income, low-health literate patients and feasible to hold across multiple clinical sites. Participants have reported learning specific ways to change their behaviors at their next HCP visit (eg, stating their opinions, asking more questions). With the forthcoming quantitative data on participant attitudinal and behavior change, the PEP intervention may ultimately empower participants within the medical encounter and improve health outcomes.

Simulation in obstetrics and gynecology (OBGYN) training captures a range of interpersonal, cognitive, and technical skills. However, trainee perspectives on simulation-based assessment remain unexplored. After an observed structured clinical examination (OSCE) simulation hybrid exam, two focus groups of residents were conducted. Analysis grounded in a thematic coding guided the qualitative research process. Responses suggest a valuation of cognitive and technical skills over interpersonal skills. Realism was seen as critical and residents perceived the assessment as more valuable for the educator than the learner. Feedback was highly valued. Resident perspectives on this exam give insight into their perceptions of simulation-based assessment as well as their conceptions of their own learning through simulations.

OBJECTIVE: The Test of Integrated Professional Skills (TIPS) is an objective structured clinical examination-simulation hybrid examination that assesses resident integration of technical, cognitive, and affective skills in Obstetrics and Gynecology (OBGYN) residents. The aim of this study was to analyze performance patterns and reactions of residents to the test to understand how it may fit within a comprehensive assessment program. DESIGN: A retrospective, mixed methods review of the design and implementation of the examination, patterns of performance of trainees at different levels of training, focus group data, and description of use of TIPS results for resident remediation and curriculum development. SETTING: OBGYN residents at New York University Langone Medical Center, a tertiary-care, urban academic health center. PARTICIPANTS: OBGYN residents in all years of training, postgraduate year-1 through postgraduate year, all residents completing the TIPS examination and consenting to participate in focus groups were included. RESULTS: In all, 24 residents completed the TIPS examination. Performance on the examination varied widely among individuals at each stage of training, and did not follow developmental trends, except for technical skills. Cronbach alpha for both standardized patient and faculty ratings ranged from 0.69 to 0.84, suggesting internal consistency. Focus group results indicated that residents respond to the TIPS examination in complex ways, ranging from anxiety about performance to mixed feelings about how to use the data for their learning. CONCLUSION: TIPS assesses a range of attributes, and can support both formative and summative evaluation. Lack of clear developmental differences and wide variation in performance by learners at the same level of training support the argument for individualized learning plans and competency-based education.

Standardized patients (SPs) are a widely used, valid, and reliable means of teaching and evaluating healthcare providers (HCPs) across all levels of training and across multiple domains of both clinical and communication skills. Most research on SP programs focuses on outcomes pertinent to the learners (i.e., HCPs) rather than how this experience affects the SPs themselves. This review seeks to summarize the current literature on the risks and benefits of being an SP. We reviewed the literature on the effects that simulation has on adults, children/adolescents, and medical professionals who serve as SPs, in addition to real patients (RPs) who are involved in teaching by sharing their medical histories and experiences. To collect the literature, we conducted two separate systematic searches: one for SPs and one for RPs. Following the searches, we applied standardized eligibility criteria to narrow the literature down to articles within the scope of this review. A total of 67 studies were included that focused on the outcomes of SPs or RPs. The benefits for those portraying SP roles include improved health knowledge and attitudes, relationships with their HCPs, and changed health behaviors. Negative effects of being an SP include anxiety, exhaustion/fatigue, and physical discomfort immediately following a simulation, but the literature to date appears to indicate that there are no long-lasting effects. These findings are consistent across age groups and the type of role being simulated. They are also supported by studies of RPs who are involved in medical education. Overall, the benefits of being an SP appear to outweigh the known risks. However, there are significant limitations in the current literature, and additional studies are needed to better characterize the SP experience.