Searched for: in-biosketch:true
person:szerea01
Efficacy of a Clinical Decision Support Tool to Promote Guideline-Concordant Evaluations in Patients With High-Risk Microscopic Hematuria: A Cluster Randomized Quality Improvement Project
Matulewicz, Richard S; Tsuruo, Sarah; King, William C; Nagler, Arielle R; Feuer, Zachary S; Szerencsy, Adam; Makarov, Danil V; Wong, Christina; Dapkins, Isaac; Horwitz, Leora I; Blecker, Saul
PURPOSE/UNASSIGNED:We aimed to determine whether implementation of clinical decision support (CDS) tool integrated into the electronic health record of a multisite academic medical center increased the proportion of patients with AUA "high-risk" microscopic hematuria (MH) who receive guideline concordant evaluations. MATERIALS AND METHODS/UNASSIGNED:We conducted a two-arm cluster randomized quality improvement project in which 202 ambulatory sites from a large health system were randomized to either have their physicians receive at time of test results an automated CDS alert for patients with "high-risk" MH with associated recommendations for imaging and cystoscopy (intervention) or usual care (control). Primary outcome was met if a patient underwent both imaging and cystoscopy within 180 days from MH result. Secondary outcomes assessed individual completion of imaging, cystoscopy, or placement of imaging orders. RESULTS/UNASSIGNED:= .09). CONCLUSIONS/UNASSIGNED:Implementing an electronic health record-integrated CDS tool to promote evaluation of patients with high-risk MH did not lead to improvements in patient completion of a full guideline-concordant evaluation. The development of an algorithm to trigger a CDS alert was demonstrated to be feasible and effective. Further multilevel assessment of barriers to evaluation is necessary to continue to improve the approach to evaluating high-risk patients with MH.
PMID: 39854625
ISSN: 1527-3792
CID: 5802662
Pathology-Driven Automation to Improve Updating Documented Follow-Up Recommendations in the Electronic Health Record After Colonoscopy
Stevens, Elizabeth R; Nagler, Arielle; Monina, Casey; Kwon, JaeEun; Olesen Wickline, Amanda; Kalkut, Gary; Ranson, David; Gross, Seth A; Shaukat, Aasma; Szerencsy, Adam
INTRODUCTION/BACKGROUND:Failure to document colonoscopy follow-up needs postpolypectomy can lead to delayed detection of colorectal cancer (CRC). Automating the update of a unified follow-up date in the electronic health record (EHR) may increase the number of patients with guideline-concordant CRC follow-up screening. METHODS:Prospective pre-post design study of an automated rules engine-based tool using colonoscopy pathology results to automate updates to documented CRC screening due dates was performed as an operational initiative, deployed enterprise-wide May 2023. Participants were aged 45-75 years who received a colonoscopy November 2022 to November 2023. Primary outcome measure is rate of updates to screening due dates and proportion with recommended follow-up < 10 years. Multivariable log-binomial regression was performed (relative risk, 95% confidence intervals). RESULTS:Study population included 9,824 standard care and 19,340 intervention patients. Patients had a mean age of 58.6 ± 8.6 years and were 53.4% female, 69.6% non-Hispanic White, 13.5% non-Hispanic Black, 6.5% Asian, and 4.6% Hispanic. Postintervention, 46.7% of follow-up recommendations were updated by the rules engine. The proportion of patients with a 10-year default follow-up frequency significantly decreased (88.7%-42.8%, P < 0.001). The mean follow-up frequency decreased by 1.9 years (9.3-7.4 years, P < 0.001). Overall likelihood of an updated follow-up date significantly increased (relative risk 5.62, 95% confidence intervals: 5.30-5.95, P < 0.001). DISCUSSION/CONCLUSIONS:An automated rules engine-based tool has the potential to increase the accuracy of colonoscopy follow-up dates recorded in patient EHR. The results emphasize the opportunity for more automated and integrated solutions for updating and maintaining EHR health maintenance activities.
PMID: 39665587
ISSN: 2155-384x
CID: 5762892
Cardiologist Perceptions on Automated Alerts and Messages To Improve Heart Failure Care
Maidman, Samuel D; Blecker, Saul; Reynolds, Harmony R; Phillips, Lawrence M; Paul, Margaret M; Nagler, Arielle R; Szerencsy, Adam; Saxena, Archana; Horwitz, Leora I; Katz, Stuart D; Mukhopadhyay, Amrita
Electronic health record (EHR)-embedded tools are known to improve prescribing of guideline-directed medical therapy (GDMT) for patients with heart failure. However, physicians may perceive EHR tools to be unhelpful, and may be therefore hesitant to implement these in their practice. We surveyed cardiologists about two effective EHR-tools to improve heart failure care, and they perceived the EHR tools to be easy to use, helpful, and improve the overall management of their patients with heart failure.
PMID: 39423991
ISSN: 1097-6744
CID: 5718912
Development and evaluation of an artificial intelligence-based workflow for the prioritization of patient portal messages
Yang, Jie; So, Jonathan; Zhang, Hao; Jones, Simon; Connolly, Denise M; Golding, Claudia; Griffes, Esmelin; Szerencsy, Adam C; Wu, Tzer Jason; Aphinyanaphongs, Yindalon; Major, Vincent J
OBJECTIVES/UNASSIGNED:Accelerating demand for patient messaging has impacted the practice of many providers. Messages are not recommended for urgent medical issues, but some do require rapid attention. This presents an opportunity for artificial intelligence (AI) methods to prioritize review of messages. Our study aimed to highlight some patient portal messages for prioritized review using a custom AI system integrated into the electronic health record (EHR). MATERIALS AND METHODS/UNASSIGNED:We developed a Bidirectional Encoder Representations from Transformers (BERT)-based large language model using 40 132 patient-sent messages to identify patterns involving high acuity topics that warrant an immediate callback. The model was then implemented into 2 shared pools of patient messages managed by dozens of registered nurses. A primary outcome, such as the time before messages were read, was evaluated with a difference-in-difference methodology. RESULTS/UNASSIGNED: = 396 466), an improvement exceeding the trend was observed in the time high-scoring messages sit unread (21 minutes, 63 vs 42 for messages sent outside business hours). DISCUSSION/UNASSIGNED:Our work shows great promise in improving care when AI is aligned with human workflow. Future work involves audience expansion, aiding users with suggested actions, and drafting responses. CONCLUSION/UNASSIGNED:Many patients utilize patient portal messages, and while most messages are routine, a small fraction describe alarming symptoms. Our AI-based workflow shortens the turnaround time to get a trained clinician to review these messages to provide safer, higher-quality care.
PMCID:11328532
PMID: 39156046
ISSN: 2574-2531
CID: 5680362
The Impact of an Electronic Best Practice Advisory on Patients' Physical Activity and Cardiovascular Risk Profile
McCarthy, Margaret M; Szerencsy, Adam; Fletcher, Jason; Taza-Rocano, Leslie; Weintraub, Howard; Hopkins, Stephanie; Applebaum, Robert; Schwartzbard, Arthur; Mann, Devin; D'Eramo Melkus, Gail; Vorderstrasse, Allison; Katz, Stuart D
BACKGROUND:Regular physical activity (PA) is a component of cardiovascular health and is associated with a lower risk of cardiovascular disease (CVD). However, only about half of US adults achieved the current PA recommendations. OBJECTIVE:The study purpose was to implement PA counseling using a clinical decision support tool in a preventive cardiology clinic and to assess changes in CVD risk factors in a sample of patients enrolled over 12 weeks of PA monitoring. METHODS:This intervention, piloted for 1 year, had 3 components embedded in the electronic health record: assessment of patients' PA, an electronic prompt for providers to counsel patients reporting low PA, and patient monitoring using a Fitbit. Cardiovascular disease risk factors included PA (self-report and Fitbit), body mass index, blood pressure, lipids, and cardiorespiratory fitness assessed with the 6-minute walk test. Depression and quality of life were also assessed. Paired t tests assessed changes in CVD risk. RESULTS:The sample who enrolled in the remote patient monitoring (n = 59) were primarily female (51%), White adults (76%) with a mean age of 61.13 ± 11.6 years. Self-reported PA significantly improved over 12 weeks ( P = .005), but not Fitbit steps ( P = .07). There was a significant improvement in cardiorespiratory fitness (469 ± 108 vs 494 ± 132 m, P = .0034), and 23 participants (42%) improved at least 25 m, signifying a clinically meaningful improvement. Only 4 participants were lost to follow-up over 12 weeks of monitoring. CONCLUSIONS:Patients may need more frequent reminders to be active after an initial counseling session, perhaps getting automated messages based on their step counts syncing to their electronic health record.
PMCID:10787798
PMID: 37467192
ISSN: 1550-5049
CID: 5738192
Large Language Model-Based Responses to Patients' In-Basket Messages
Small, William R; Wiesenfeld, Batia; Brandfield-Harvey, Beatrix; Jonassen, Zoe; Mandal, Soumik; Stevens, Elizabeth R; Major, Vincent J; Lostraglio, Erin; Szerencsy, Adam; Jones, Simon; Aphinyanaphongs, Yindalon; Johnson, Stephen B; Nov, Oded; Mann, Devin
IMPORTANCE/UNASSIGNED:Virtual patient-physician communications have increased since 2020 and negatively impacted primary care physician (PCP) well-being. Generative artificial intelligence (GenAI) drafts of patient messages could potentially reduce health care professional (HCP) workload and improve communication quality, but only if the drafts are considered useful. OBJECTIVES/UNASSIGNED:To assess PCPs' perceptions of GenAI drafts and to examine linguistic characteristics associated with equity and perceived empathy. DESIGN, SETTING, AND PARTICIPANTS/UNASSIGNED:This cross-sectional quality improvement study tested the hypothesis that PCPs' ratings of GenAI drafts (created using the electronic health record [EHR] standard prompts) would be equivalent to HCP-generated responses on 3 dimensions. The study was conducted at NYU Langone Health using private patient-HCP communications at 3 internal medicine practices piloting GenAI. EXPOSURES/UNASSIGNED:Randomly assigned patient messages coupled with either an HCP message or the draft GenAI response. MAIN OUTCOMES AND MEASURES/UNASSIGNED:PCPs rated responses' information content quality (eg, relevance), using a Likert scale, communication quality (eg, verbosity), using a Likert scale, and whether they would use the draft or start anew (usable vs unusable). Branching logic further probed for empathy, personalization, and professionalism of responses. Computational linguistics methods assessed content differences in HCP vs GenAI responses, focusing on equity and empathy. RESULTS/UNASSIGNED:A total of 16 PCPs (8 [50.0%] female) reviewed 344 messages (175 GenAI drafted; 169 HCP drafted). Both GenAI and HCP responses were rated favorably. GenAI responses were rated higher for communication style than HCP responses (mean [SD], 3.70 [1.15] vs 3.38 [1.20]; P = .01, U = 12 568.5) but were similar to HCPs on information content (mean [SD], 3.53 [1.26] vs 3.41 [1.27]; P = .37; U = 13 981.0) and usable draft proportion (mean [SD], 0.69 [0.48] vs 0.65 [0.47], P = .49, t = -0.6842). Usable GenAI responses were considered more empathetic than usable HCP responses (32 of 86 [37.2%] vs 13 of 79 [16.5%]; difference, 125.5%), possibly attributable to more subjective (mean [SD], 0.54 [0.16] vs 0.31 [0.23]; P < .001; difference, 74.2%) and positive (mean [SD] polarity, 0.21 [0.14] vs 0.13 [0.25]; P = .02; difference, 61.5%) language; they were also numerically longer (mean [SD] word count, 90.5 [32.0] vs 65.4 [62.6]; difference, 38.4%), but the difference was not statistically significant (P = .07) and more linguistically complex (mean [SD] score, 125.2 [47.8] vs 95.4 [58.8]; P = .002; difference, 31.2%). CONCLUSIONS/UNASSIGNED:In this cross-sectional study of PCP perceptions of an EHR-integrated GenAI chatbot, GenAI was found to communicate information better and with more empathy than HCPs, highlighting its potential to enhance patient-HCP communication. However, GenAI drafts were less readable than HCPs', a significant concern for patients with low health or English literacy.
PMCID:11252893
PMID: 39012633
ISSN: 2574-3805
CID: 5686582
Implementing a Clinical Decision Support Tool to Improve Physical Activity
McCarthy, Margaret M; Szerencsy, Adam; Taza-Rocano, Leslie; Hopkins, Stephanie; Mann, Devin; D'Eramo Melkus, Gail; Vorderstrasse, Allison; Katz, Stuart D
BACKGROUND:Currently, only about half of U.S. adults achieve current physical activity guidelines. Routine physical activity is not regularly assessed, nor are patients routinely counseled by their health care provider on achieving recommended levels. The three-question physical activity vital sign (PAVS) was developed to assess physical activity duration and intensity and identify adults not meeting physical activity guidelines. Clinical decision support provided via a best practice advisory in an electronic health record (EHR) system can be triggered as a prompt, reminding health care providers to implement the best practice intervention when appropriate. Remote patient monitoring of physical activity can provide objective data in the EHR. OBJECTIVES/OBJECTIVE:This study aimed to evaluate the feasibility and clinical utility of embedding the PAVS and a triggered best practice advisor into the EHR in an ambulatory preventive cardiology practice setting to alert providers to patients reporting low physical activity and prompt health care providers to counsel these patients as needed. METHODS:Three components based in the EHR were integrated for the purpose of this study: patients completed the PAVS through their electronic patient portal prior to an office visit; a best practice advisory was created to prompt providers to counsel patients who reported low levels of physical activity; and remote patient monitoring via Fitbit synced to the EHR provided objective physical activity data. The intervention was pilot-tested in the Epic EHR for 1 year (July 1, 2021-June 30, 2022). Qualitative feedback on the intervention from both providers and patients was obtained at the completion of the study. RESULTS:Monthly assessments of the use of the PAVS and best practice advisory and remote patient monitoring were completed. Patients' completion of the PAVS varied from 35% to 48% per month. The best practice advisory was signed by providers between 2% and 65% and was acknowledged by 2% to 22% per month. The majority (58%) of patients were able to sync a Fitbit device to their EHR for remote monitoring. DISCUSSION/CONCLUSIONS:Although uptake of each component needs improvement, this pilot demonstrated the feasibility of incorporating a PA promotion intervention into the EHR. Qualitative feedback provided guidance for future implementation.
PMID: 38207172
ISSN: 1538-9847
CID: 5631332
Impact of Visit Volume on the Effectiveness of Electronic Tools to Improve Heart Failure Care
Mukhopadhyay, Amrita; Reynolds, Harmony R; King, William C; Phillips, Lawrence M; Nagler, Arielle R; Szerencsy, Adam; Saxena, Archana; Klapheke, Nathan; Katz, Stuart D; Horwitz, Leora I; Blecker, Saul
BACKGROUND:Electronic health record (EHR) tools can improve prescribing of guideline-recommended therapies for heart failure with reduced ejection fraction (HFrEF), but their effectiveness may vary by physician workload. OBJECTIVES/OBJECTIVE:This paper aims to assess whether physician workload modifies the effectiveness of EHR tools for HFrEF. METHODS:This was a prespecified subgroup analysis of the BETTER CARE-HF (Building Electronic Tools to Enhance and Reinforce Cardiovascular Recommendations for Heart Failure) cluster-randomized trial, which compared effectiveness of an alert vs message vs usual care on prescribing of mineralocorticoid antagonists (MRAs). The trial included adults with HFrEF seen in cardiology offices who were eligible for and not prescribed MRAs. Visit volume was defined at the cardiologist-level as number of visits per 6-month study period (high = upper tertile vs non-high = remaining). Analysis at the patient-level used likelihood ratio test for interaction with log-binomial models. RESULTS:Among 2,211 patients seen by 174 cardiologists, 932 (42.2%) were seen by high-volume cardiologists (median: 1,853; Q1-Q3: 1,637-2,225 visits/6 mo; and median: 10; Q1-Q3: 9-12 visits/half-day). MRA was prescribed to 5.5% in the high-volume vs 14.8% in the non-high-volume groups in the usual care arm, 10.3% vs 19.6% in the message arm, and 31.2% vs 28.2% in the alert arm, respectively. Visit volume modified treatment effect (P for interaction = 0.02) such that the alert was more effective in the high-volume group (relative risk: 5.16; 95% CI: 2.57-10.4) than the non-high-volume group (relative risk: 1.93; 95% CI: 1.29-2.90). CONCLUSIONS:An EHR-embedded alert increased prescribing by >5-fold among patients seen by high-volume cardiologists. Our findings support use of EHR alerts, especially in busy practice settings. (Building Electronic Tools to Enhance and Reinforce Cardiovascular Recommendations for Heart Failure [BETTER CARE-HF]; NCT05275920).
PMID: 38043045
ISSN: 2213-1787
CID: 5597482
A Dynamic Clinical Decision Support Tool to Improve Primary Care Outcomes in a High-Volume, Low-Resource Setting
Dapkins, Isaac; Prescott, Rasheda; Ladino, Nathalia; Anderman, Judd; McCaleb, Chase; Colella, Doreen; Gore, Radhika; Fontil, Valy; Szerencsy, Adam; Blecker, Saul
The Family Health Centers at New York University Langone (FHC), a federally qualified health center network in New York City, created a novel clinical decision support (CDS) tool that alerts primary health care providers to patients"™ gaps in care and triggers a dynamic, individualized order set on the basis of unique patient factors, enabling providers to readily act on each patient"™s specific gaps in care. FHC implemented this tool in 2017, starting with 15 protocols for quality measures; as of February 2024, there are 30 such protocols. During a patient visit with a provider, when there is a gap in care, a best-practice alert (BPA) fires, which includes an order set unique to the patient and visit. The provider can bypass the alert (not open it) or acknowledge the alert (open it). The provider may review the content of the order set and accept it as is or with modifications, or they can decline its recommendations if they believe it is not appropriate or plan to address the gap in care another way during the visit. To accept the dynamic order set is the intended workflow. The authors present data from September 2019 to January 2023 totaling 171,319 patient visits with at least one open gap in care among providers in pediatrics, family medicine, and internal medicine. The rate at which providers acknowledged the BPA in the first 6 months was 45% and steadily increased. In the last 6 months of the period, providers acknowledged the BPA 78% (19,281 of 24,575) of the time. Similarly, in the first 6 months, in all encounters in which a BPA was fired, 28.8% (8,585 of 29,829) had an order placed via the dynamic order set (accepted); that rate increased to 49.7% (12,210 of 24,575) during the last 6 months. This order set completion rate is notable given that most CDS use rates are low. Gap closure was higher when providers acknowledged the alert. In an analysis of all encounters with at least one open gap, spanning 2019"“2023, 46% (48,431 of 105,371) of the time, at least one gap was closed when the alert was acknowledged compared with 33% (21,993 of 65,948) when the alert was bypassed (and the recommendations of the dynamic order set were never followed). The authors show that CDS tools can be successfully implemented in a high-volume, low-resource setting if designed with efficiency in mind, ensuring provider utilization and clinical impact through closing care gaps. CDS tools that are dynamically patient specific can help improve quality of care if they are part of a broader culture of quality improvement.
SCOPUS:85190307342
ISSN: 2642-0007
CID: 5670482
Quantifying the impact of telemedicine and patient medical advice request messages on physicians' work-outside-work
Mandal, Soumik; Wiesenfeld, Batia M; Mann, Devin M; Szerencsy, Adam C; Iturrate, Eduardo; Nov, Oded
The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians' after-hours clinical work ("work-outside-work"). The surge in patients' digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians' after-hours commitments. We examined the impact on physicians' workload from two types of digital demands - patients' messages requesting medical advice (PMARs) sent to physicians' inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians' work-outside-work and that this relationship is moderated by physicians' specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians' work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.
PMCID:10867011
PMID: 38355913
ISSN: 2398-6352
CID: 5635802