Faculty Bibliography

OBJECTIVES/OBJECTIVE:Communication and other clinical skills are routinely assessed in medical schools using Objective Structured Clinical Examinations (OSCEs) so routinely that it can be difficult to monitor and maintain validity. We report on the accumulation of validity evidence for the Clinical Communication Skills Assessment Tool (CCSAT) based on its use with 9 cohorts of medical students in a high stakes OSCE. METHODS:) based on continuous quality improvement and use of the CCSAT for feedback, remediation, curricular design, and research. RESULTS:Implementation of the CCSAT over time has facilitated our communication skills curriculum and training. Thoughtful case development and investment in standardized patient training has contributed to data quality. Item analysis supports our behaviorally anchored scale (not done, partly and well done) and the skills domains suggested by an a priori evidence-based clinical communication model were confirmed via analysis of actual student data. Evidence synthesized across the frameworks suggests consistent validity of the CCSAT for generalization inferences (that it captures the construct), responsiveness (sensitivity to change/difference), content validity/internal structure, relationships to other variables, and consequences/implications. More evidence is needed to strengthen validity of CCSAT scores for understanding extrapolation inferences and real-world implications. CONCLUSIONS AND PRACTICE IMPLICATIONS/CONCLUSIONS:This pragmatic approach to evaluating validity within a program of assessment serves as a model for medical schools seeking to continuously monitor the quality of clinical skill assessments, a need made particularly relevant since the US NBME no longer requires the Step 2 Clinical Skills exam, leaving individual schools with the responsibility for ensuring graduates have acquired the requisite core clinical skills. We document strong evidence for CCSAT validity over time and across cohorts as well as areas for improvement and further examination.

Excluding this population perpetuates health inequities.

BACKGROUND:Research demonstrates the importance of documenting adaptations to implementation strategies that support integration of evidence-based interventions into practice. While studies have utilized the FRAME-IS [Framework for Reporting Adaptations and Modifications for Implementation Strategies] to collect structured adaptation data, they are limited by a focus on discrete implementation strategies (e.g., training), which do not reflect the complexity of multifaceted strategies like practice facilitation. In this paper, we apply the FRAME-IS to our trial evaluating the effectiveness of PF on implementation fidelity of an evidence-based technology-facilitated team care model for improved hypertension control within a federally qualified health center (FQHC). METHODS:Three data sources are used to document adaptations: (1) implementation committee meeting minutes, (2) narrative reports completed by practice facilitators, and (3) structured notes captured on root cause analysis and Plan-Do-Study-Act worksheets. Text was extracted from the data sources according to the FRAME-IS modules and inputted into a master matrix for content analysis by two authors; a third author conducted member checking and code validation. RESULTS:We modified the FRAME-IS to include part 2 of module 2 (what is modified) to add greater detail of the modified strategy, and a numbering system to track adaptations across the modules. This resulted in identification of 27 adaptations, of which 88.9% focused on supporting practices in identifying eligible patients and referring them to the intervention. About half (52.9%) of the adaptations were made to modify the context of the PF strategy to include a group-based format, add community health workers to the strategy, and to shift the implementation target to nurses. The adaptations were often widespread (83.9%), affecting all practices within the FQHC. While most adaptations were reactive (84.6%), they resulted from a systematic process of reviewing data captured by multiple sources. All adaptations included the FQHC in the decision-making process. CONCLUSION/CONCLUSIONS:With modifications, we demonstrate the ability to document our adaptation data across the FRAME-IS modules, attesting to its applicability and value for a range of implementation strategies. Based on our experiences, we recommend refinement of tracking systems to support more nimble and practical documentation of iterative, ongoing, and multifaceted adaptations. TRIAL REGISTRATION/BACKGROUND:Clinicaltrials.gov NCT03713515, Registration date: October 19, 2018.

BACKGROUND:Non-fatal overdose is a leading predictor of subsequent fatal overdose. For individuals who are incarcerated, the risk of experiencing an overdose is highest when transitioning from a correctional setting to the community. We assessed if enrollment in jail-based medications for opioid use disorder (MOUD) is associated with lower risk of non-fatal opioid overdoses after jail release among individuals with opioid use disorder (OUD). METHODS:This was a retrospective, observational cohort study of adults with OUD who were incarcerated in New York City jails and received MOUD or did not receive any MOUD (out-of-treatment) within the last three days before release to the community in 2011-2017. The outcome was the first non-fatal opioid overdose emergency department (ED) visit within 1 year of jail release during 2011-2017. Covariates included demographic, clinical, incarceration-related, and other characteristics. We performed multivariable cause-specific Cox proportional hazards regression analysis to compare the risk of non-fatal opioid overdose ED visits within 1 year after jail release between groups. RESULTS:MOUD group included 8660 individuals with 17,119 incarcerations; out-of-treatment group included 10,163 individuals with 14,263 incarcerations. Controlling for covariates and accounting for competing risks, in-jail MOUD was associated with lower non-fatal opioid overdose risk within 14 days after jail release (adjusted HR=0.49, 95% confidence interval=0.33-0.74). We found no significant differences 15-28, 29-56, or 57-365 days post-release. CONCLUSION/CONCLUSIONS:MOUD group had lower risk of non-fatal opioid overdose immediately after jail release. Wider implementation of MOUD in US jails could potentially reduce post-release overdoses, ED utilization, and associated healthcare costs.

Interoception is defined as the sense of the internal state of the body. Dysfunctions in interoception are found in several mental disorders, including trauma-related conditions. Mindfulness-Based Interventions (MBIs) have been shown to influence interoceptive processes. Randomised controlled trials (RCTs) have investigated whether MBIs impact symptoms and interoception in patients with trauma-related disorders. We undertook a systematic review and meta-analysis to synthesize these data. We included RCTs with an MBI arm which enrolled adult patients with trauma related-disorders or exposure to a traumatic experience, and addressed changes in interoception and trauma-related symptoms. A random-effects multivariate meta-analytic model was performed to quantify group differences in score change from baseline to follow-up. Twelve studies were included in the systematic review, and eleven in the meta-analysis. Overall, MBIs showed small to moderate positive effects on both interoception and symptoms. Despite a high heterogeneity in results, sensitivity analyses confirmed the robustness of the findings. We conclude that the efficacy of MBIs on trauma-related symptoms and interoception is supported by randomised evidence. However, further research is needed to understand whether changes in interoception might underpin the effectiveness of MBIs in trauma-related disorders.

INTRODUCTION:Intensive weight management programs are effective but often have low enrollment and high attrition. Lack of motivation is a key psychological barrier to enrollment, engagement, and weight loss. Mental Contrasting with Implementation Intentions (MCII) is a unique imagery technique that increases motivation for behavior change. We describe our study protocol to assess the efficacy and implementation of MCII to enhance the effectiveness of VA's MOVE! or TeleMOVE! weight management programs using a procedure called "WOOP" (Wish, Outcome, Obstacle, Plan) for Veterans. We hypothesize that WOOP+MOVE! or TeleMOVE! (intervention) will lead to greater MOVE!/TeleMOVE! program engagment and consequently weight loss than MOVE!/TeleMOVE! alone (control). METHOD:Veterans are randomized to either the intervention or control. Both arms receive the either MOVE! or TeleMOVE! weight management programs. The intervention group receives an hour long WOOP training while the control group receives patient education. Both groups receive telephone follow up calls at 3 days, 4 weeks, and 2 months post-baseline. Eligible participants are Veterans (ages 18-70 years) with either obesity (BMI ≥ 30 kg/m2) or overweight (BMI ≥ 25 kg/m2) and an obesity-associated co-morbidity. At baseline, 6 and 12 months, we assess weight, diet, physical activity in both groups. The primary outcome is mean percent weight change at 6 months. Secondary outcomes include changes in waist circumference, diet, physical activity, and dieting self-efficacy and engagement in regular physical activity. We assess implementation using the RE-AIM framework. CONCLUSION:If WOOP VA is found to be efficacious, it will be an important tool to facilitate weight management and improve weight outcomes. CLINICAL TRIAL REGISTRATION:NCT05014984.