The TeleHealth OSCE: Preparing Trainees to Use Telemedicine as a Tool for Transitions of Care
Background/UNASSIGNED:Telemedicine holds promise to bridge the transition of care between inpatient and outpatient settings. Despite this, the unique communication and technical skills required for virtual encounters are not routinely taught or practiced in graduate medical education (GME) programs. Objective/UNASSIGNED:To develop an objective structured clinical examination (OSCE) case to assess residents' telemedicine-specific skills and identify potential gaps in our residency program's curriculum. Methods/UNASSIGNED:As part of a multi-station OSCE in 2019, we developed a case simulating a remote encounter between a resident and a recently discharged standardized patient. We developed an assessment tool comprising specific behaviors anchored to "not done," "partly done," and "well done" descriptors to evaluate core communication and telemedicine-specific skills. Results/UNASSIGNED:Seventy-eight NYU internal medicine residents participated in the case. Evaluations from 100% of participants were obtained. Residents performed well in Information Gathering and Relationship Development domains. A mean 95% (SD 3.3%) and 91% (SD 4.9%) of residents received "well done" evaluations across these domains. A mean 78% (SD 14%) received "well done" within Education/Counseling domain. However, only 46% (SD 45%) received "well done" evaluations within the Telemedicine domain; specific weak areas included performing a virtual physical examination (18% well done) and leveraging video to augment history gathering (17% well done). There were no differences in telemedicine-specific skill evaluations when stratified by training track or postgraduate year. Conclusions/UNASSIGNED:We simulate a post-discharge virtual encounter and present a novel assessment tool that uncovers telemedicine-specific knowledge gaps in GME trainees.
THE VIRTUAL OSCE: PREPARING TRAINEES TO USE TELEMEDICINE AS A TOOL FOR TRANSITIONS OF CARE [Meeting Abstract]
MIND THE GAP: TEACHING LIFELONG LEARNING THROUGH METACOGNITIVE AWARENESS [Meeting Abstract]
"I Cannot Take This Any More!": Preparing Interns to Identify and Help a Struggling Colleague
BACKGROUND:Few programs train residents in recognizing and responding to distressed colleagues at risk for suicide. AIM/OBJECTIVE:To assess interns' ability to identify a struggling colleague, describe resources, and recognize that physicians can and should help colleagues in trouble. SETTING/METHODS:Residency programs at an academic medical center. PARTICIPANTS/METHODS:One hundred forty-five interns. PROGRAM DESIGN/UNASSIGNED:An OSCE case was designed to give interns practice and feedback on their skills in recognizing a colleague in distress and recommending the appropriate course of action. Embedded in a patient "sign-out" case, standardized health professionals (SHP) portrayed a resident with depressed mood and an underlying drinking problem. The SHP assessed intern skills in assessing symptoms and directing the resident to seek help. PROGRAM EVALUATION/RESULTS:Interns appreciated the opportunity to practice addressing this situation. Debriefing the case led to productive conversations between faculty and residents on available resources. Interns' skills require further development: while 60% of interns asked about their colleague's emotional state, only one-third screened for depression and just under half explored suicidal ideation. Only 32% directed the colleague to specific resources for his depression (higher among those that checked his emotional state, 54%, or screened for depression, 80%). DISCUSSION/CONCLUSIONS:This OSCE case identified varying intern skill levels for identifying and assessing a struggling colleague while also providing experiential learning and supporting a culture of addressing peer wellness.
Using a group observed standardized clinical experience (GOSE) to teach motivational interviewing [Meeting Abstract]
Needs and Objectives: Didactic training in motivation interviewing (MI) lacks efficacy, because opportunities to practice skills while being directly observed are rare. The goal of our educational innovation was to train interns in the advanced communication skills of motivation interviewing through a group observed standardized clinical experience (GOSCE). Our Learning Objectives were as follows: After an experiential learning session on MI, interns will be able to: 1. Identify opportunities to use MI with patients 2. Recognize "change talk" from a patient as an opportunity to use MI techniques 3. Use MI techniques when discussing behavior change with a patient Setting and Participants: 46 internal medicine interns in an academic internal medicine residency program. Description: Each session began with a 20 minute review of MI for behavior change given by a psychologist trained in Motivational Interviewing. Then, interns participated in a 3 station, one-hour long Group Observed Standardized Clinical Exercise (GOSCE). Interns worked in teams of 3, and for each station, one of the 3 interns was the active physician, while the other 2 observed the encounter. Each intern had an opportunity to be the active physician for a case. Each case was observed by one or two faculty members, one of whom was a psychologist trained in MI. After a 10 minute interaction with the standardized patient, the active physician received feedback on their MI skills and debriefed the encounter with the faculty and their peers. After the 3 cases, the session concluded with a group debrief and summary of the experience. Interns completed a retrospective pre/post survey to assess the impact of the session. Evaluation: Residents reported statistically significant improvement in all domains, including confidence with identifying opportunities to use MI, comfort using reflective and summary statements during MI, and likelihood of using motivational interviewing in future patient encounters. Qualitative comments after the session reflect that residents developed an appreciation for silence as a tool during MI, felt comfortable with tools such as decisional balance, and recognized the value of patient centered-ness during MI. Discussion/Reflection/Lessons Learned: Our interprofessional educational team (psychologists and internists) provided different perspective for both learners and our internal medicine faculty. Our residents appreciated practicing skills and receiving feedback in real time. This academic year (one year after the intern GOSCE), these same learners will participate in an OSCE that includes a case requiring motivational internviewing skills, and we will evaluate the durability of motivation interviewing skills taught during this session. We are interested in expanding opportunities to use GOSCE as a low stakes skills practice and development tool
Faculty feedback that begins with resident self-assessment: motivation is the key to success
CONTEXT/BACKGROUND:The seeking and incorporating of feedback are necessary for continuous performance improvement in medicine. We know that beginning feedback conversations with resident self-assessment may reduce some of the tensions experienced by faculty staff. However, we do not fully understand how residents experience feedback that begins with self-assessment, and whether any existing theoretical frameworks can explain their experiences. METHODS:We conducted a constructivist grounded theory study exploring physical medicine and rehabilitation residents' experiences as they engaged in a structured self-assessment and faculty staff feedback programme. Utilising purposive sampling, we conducted 15 individual interviews and analysed verbatim transcripts iteratively. We implemented several procedures to enhance the credibility of the findings and the protection of participants during recruitment, data collection and data analysis. After defining the themes, we reviewed a variety of existing frameworks to determine if any fitted the data. RESULTS:Residents valued self-assessment followed by feedback (SAFF) and had clear ideas of what makes the process useful. Time pressures and poor feedback quality could lead to a process of 'just going through the motions'. Motivation coloured residents' experiences, with more internalised motivation related to a more positive experience. There were no gender- or year of training-related patterns. CONCLUSIONS:Self-determination theory provided the clearest lens for framing our findings and fitted into a conceptual model linking the quality of the SAFF experience and residents' motivational loci. We identified several study limitations including time in the field, evolving characteristics of the SAFF programme and the absence of faculty voices. We believe that by better understanding residents' experiences of SAFF, educators may be able to tailor the feedback process, enhance clinical performance and ultimately improve patient care.
Charting a Key Competency Domain: Understanding Resident Physician Interprofessional Collaboration (IPC) Skills
BACKGROUND: Interprofessional collaboration (IPC) is essential for quality care. Understanding residents' level of competence is a critical first step to designing targeted curricula and workplace learning activities. In this needs assessment, we measured residents' IPC competence using specifically designed Objective Structured Clinical Exam (OSCE) cases and surveyed residents regarding training needs. METHODS: We developed three cases to capture IPC competence in the context of physician-nurse collaboration. A trained actor played the role of the nurse (Standardized Nurse - SN). The Interprofessional Education Collaborative (IPEC) framework was used to create a ten-item behaviorally anchored IPC performance checklist (scored on a three-point scale: done, partially done, well done) measuring four generic domains: values/ethics; roles/responsibilities; interprofessional communication; and teamwork. Specific skills required for each scenario were also assessed, including teamwork communication (SBAR and CUS) and patient-care-focused tasks. In addition to evaluating IPC skills, the SN assessed communication, history-taking and physical exam skills. IPC scores were computed as percent of items rated well done in each domain (Cronbach's alpha > 0.77). Analyses include item frequencies, comparison of mean domain scores, correlation between IPC and other skills, and content analysis of SN comments and resident training needs. RESULTS: One hundred and seventy-eight residents (of 199 total) completed an IPC case and results are reported for the 162 who participated in our medical education research registry. IPC domain scores were: Roles/responsibilities mean = 37 % well done (SD 37 %); Values/ethics mean = 49 % (SD 40 %); Interprofessional communication mean = 27 % (SD 36 %); Teamwork mean = 47 % (SD 29 %). IPC was not significantly correlated with other core clinical skills. SNs' comments focused on respect and IPC as a distinct skill set. Residents described needs for greater clarification of roles and more workplace-based opportunities structured to support interprofessional education/learning. CONCLUSIONS: The IPC cases and competence checklist are a practical method for conducting needs assessments and evaluating IPC training/curriculum that provides rich and actionable data at both the individual and program levels.
RESIDENCY WELLNESS: CHANGING CULTURE THROUGH EXPERIENTIAL LEARNING [Meeting Abstract]
CALLING IT LIKE YOU SEE IT: THREE-HOUR WORKSHOP IMPROVES HOSPITALISTS OBSERVATION AND FEEDBACK SKILLS [Meeting Abstract]
DOES FLIPPING THE CLASSROOM IMPROVE CLINICAL SKILLS? [Meeting Abstract]