Faculty Bibliography

INTRODUCTION/BACKGROUND:Linking electronic health record (EHR) use to care quality may offer insights into potential interventions improving guideline adherence and closing care gaps. We examine how EHR metadata can measure cognitive load in primary care providers during statin prescribing and identify cognitive load points in EHR workflows associated with guideline-concordant statin initiation. METHODS:We retrospectively extracted 2024 data from EHR primary care encounters from a large academic health system. We identified adult patients who met the criteria for statin initiation and calculated their atherosclerotic cardiovascular disease (ASCVD) risk scores. Cognitive load metrics were derived from EHR metadata. Logistic regressions evaluate associations between cognitive load and statin initiation, adjusting for patient covariates and provider fixed effects. Gradient-boosted forests and Shapley Additive explanations (SHAP) values were used to identify key EHR events and cognitive load patterns associated with statin initiation. RESULTS:Longer encounter duration was associated with increased likelihood of statin initiation, whereas more time spent per EHR event was associated with a decreased likelihood. Nonlinear associations were observed for loop count and distinct event count: predicted initiation probability decreased with increasing loop count to 93.9 loops, then increased beyond this threshold. For distinct events, initiation probability increased up to approximately 18 events and declined at higher counts. In a gradient-boosted decision tree model, average event time was the strongest predictor (72.2% relative contribution). Additional positive predictors included time spent reviewing lab results and on suggested medication order sets. Order list modification and looping back to it were negatively associated with statin initiation. DISCUSSION/CONCLUSIONS:EHR metadata can associate cognitive load with appropriate clinical behavior, revealing nonlinear associations between cognitive load and statin initiation rates. This work suggests opportunities to optimize EHR systems to reduce cognitive burden and support clinical decision-making. Connecting cognitive load to prescribing behavior generates hypotheses about how workflow adjustments and enhanced decision support might improve guideline adherence and patient care through prospective evaluation.

BACKGROUND:Nonadherence to antihypertensive medications is common. Mobile health (mHealth)-based behavioral economic interventions may improve adherence, but remain largely untested, especially in vulnerable populations. OBJECTIVE:The study sought to test whether an mHealth incentive lottery would lower systolic blood pressure (SBP) and improve adherence. METHODS:BETTER-BP (Behavioral Economics Trial To Enhance Regulation of Blood Pressure) was a randomized trial conducted in 3 safety-net clinics in New York City. Eligible participants were adults with hypertension prescribed at least 1 antihypertensive medication, with SBP >140 mm Hg, and poor self-reported adherence. In the intervention arm, an incentive lottery was administered via SMS messaging. All participants received passive adherence monitoring. The intervention lasted 6 months, with continued monitoring until 12 months. The primary clinical endpoint was change in SBP at 6 months. The primary process endpoint was adequate antihypertensive medication adherence (≥80% days adherent) from baseline to 6 months. RESULTS:Four-hundred participants (265 intervention:135 control) were enrolled with median age 57 years, 60.5% women, 61.5% Hispanic, and 20.3% non-Hispanic Black. Over 70% had Medicaid or no insurance. At 6 months, intervention arm participants were twice as likely to achieve adequate adherence (71% vs 34%; adjusted risk ratio: 2.04; 95% CI: 1.58-2.63), but there was no significant change in mean SBP (-6.7 mm Hg intervention vs -5.8 mm Hg control; P = 0.62). From 6 to 12 months, adherence was similar (31% intervention vs 26% control; adjusted risk ratio: 1.17; 95% CI: 0.83-1.65). CONCLUSIONS:In a diverse safety-net population, the BETTER-BP intervention doubled the rate of adequate antihypertensive medication adherence but did not reduce SBP at 6 months.

BACKGROUND:Health equity is receiving increased attention in medical education. However, guidance is often lacking on how to integrate health equity into routine medical education. Journal club presents an opportunity to deepen medical educators' and learners' understanding of health equity principles and use it as a lens through which to critically appraise the literature. AIM/OBJECTIVE:We present a health equity framework, iteratively co-created by faculty and learners, that can be applied in a journal club setting. SETTING/METHODS:Academic medical center in New York City, USA. PARTICIPANTS/METHODS:Faculty, residency program directors, medical students, and residents. PROGRAM DESCRIPTION/METHODS:Authors developed the health equity journal club framework during a medical student selective course. Learner and faculty applied the framework to journal club articles; their feedback informed revisions. Framework domains included authorship, ethics, methodology, language, peer review, and references. PROGRAM EVALUATION/RESULTS:Learner evaluations were overall positive, and 86% (n = 13) of responding residency program directors (n = 15) across 15 departments who were surveyed plan to use the framework moving forward. DISCUSSION/CONCLUSIONS:A health equity journal club framework applied to critical appraisal of the literature may facilitate health equity as a routine part of medical education. Co-creating the framework proved vital to inclusion of learner voices.

BACKGROUND/UNASSIGNED:Usability testing is valuable for assessing a new tool or system's usefulness and ease-of-use. Several established methods of usability testing exist, including think-aloud testing. Although usability testing has been shown to be crucial for successful clinical decision support (CDS) tool development, it is often difficult to conduct across multisite development projects due to its time- and labor-intensiveness, cost, and the skills required to conduct the testing. OBJECTIVE/UNASSIGNED:Our objective was to develop a new method of usability testing that would enable efficient acquisition and dissemination of results among multiple sites. We sought to address the existing barriers to successfully completing usability testing during CDS tool development. METHODS/UNASSIGNED:We combined individual think-aloud testing and focus groups into one session and performed sessions serially across 4 sites (snowball group usability testing) to assess the usability of two CDS tools designed for use by nurses in primary and urgent care settings. We recorded each session and took notes in a standardized format. Each site shared feedback from their individual sessions with the other sites in the study so that they could incorporate that feedback into their tools prior to their own testing sessions. RESULTS/UNASSIGNED:The group testing and snowballing components of our new usability testing method proved to be highly beneficial. We identified 3 main benefits of snowball group usability testing. First, by interviewing several participants in a single session rather than individuals over the course of weeks, each site was able to quickly obtain their usability feedback. Second, combining the individualized think-aloud component with a focus group component in the same session helped study teams to more easily notice similarities in feedback among participants and to discuss and act upon suggestions efficiently. Third, conducting usability testing in series across sites allowed study teams to incorporate feedback based on previous sites' sessions prior to conducting their own testing. CONCLUSIONS/UNASSIGNED:Snowball group usability testing provides an efficient method of obtaining multisite feedback on newly developed tools and systems, while addressing barriers typically associated with traditional usability testing methods. This method can be applied to test a wide variety of tools, including CDS tools, prior to launch so that they can be efficiently optimized.

OBJECTIVE/UNASSIGNED:Our objective was to determine the feasibility and preliminary efficacy of a behavioral nudge on adoption of a clinical decision support (CDS) tool. MATERIALS AND METHODS/UNASSIGNED:We conducted a pilot cluster nonrandomized controlled trial in 2 Emergency Departments (EDs) at a large academic healthcare system in the New York metropolitan area. We tested 2 versions of a CDS tool for pulmonary embolism (PE) risk assessment developed on a web-based electronic health record-agnostic platform. One version included behavioral nudges incorporated into the user interface. RESULTS/UNASSIGNED: < .001). DISCUSSION/UNASSIGNED:We demonstrated feasibility and preliminary efficacy of a PE risk prediction CDS tool developed using insights from behavioral science. The tool is well-positioned to be tested in a large randomized clinical trial. TRIAL REGISTRATION/UNASSIGNED:Clinicaltrials.gov (NCT05203185).

BACKGROUND:During the COVID-19 pandemic, acute respiratory infection (ARI) antibiotic prescribing in ambulatory care markedly decreased. It is unclear if antibiotic prescription rates will remain lowered. METHODS:We used trend analyses of antibiotics prescribed during and after the first wave of COVID-19 to determine whether ARI antibiotic prescribing rates in ambulatory care have remained suppressed compared to pre-COVID-19 levels. Retrospective data was used from patients with ARI or UTI diagnosis code(s) for their encounter from 298 primary care and 66 urgent care practices within four academic health systems in New York, Wisconsin, and Utah between January 2017 and June 2022. The primary measures included antibiotic prescriptions per 100 non-COVID ARI encounters, encounter volume, prescribing trends, and change from expected trend. RESULTS:At baseline, during and after the first wave, the overall ARI antibiotic prescribing rates were 54.7, 38.5, and 54.7 prescriptions per 100 encounters, respectively. ARI antibiotic prescription rates saw a statistically significant decline after COVID-19 onset (step change -15.2, 95% CI: -19.6 to -4.8). During the first wave, encounter volume decreased 29.4% and, after the first wave, remained decreased by 188%. After the first wave, ARI antibiotic prescription rates were no longer significantly suppressed from baseline (step change 0.01, 95% CI: -6.3 to 6.2). There was no significant difference between UTI antibiotic prescription rates at baseline versus the end of the observation period. CONCLUSIONS:The decline in ARI antibiotic prescribing observed after the onset of COVID-19 was temporary, not mirrored in UTI antibiotic prescribing, and does not represent a long-term change in clinician prescribing behaviors. During a period of heightened awareness of a viral cause of ARI, a substantial and clinically meaningful decrease in clinician antibiotic prescribing was observed. Future efforts in antibiotic stewardship may benefit from continued study of factors leading to this reduction and rebound in prescribing rates.

BACKGROUND:Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. OBJECTIVE:The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. METHODS:We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. RESULTS:The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells' criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform's flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells' criteria tool will be reported in a future publication. CONCLUSIONS:The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics "nudges" on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.