Searched for: person:szerea01
in-biosketch:true
Pathology-Driven Automation to Improve Updating Documented Follow-Up Recommendations in the Electronic Health Record After Colonoscopy
Stevens, Elizabeth R; Nagler, Arielle; Monina, Casey; Kwon, JaeEun; Olesen Wickline, Amanda; Kalkut, Gary; Ranson, David; Gross, Seth A; Shaukat, Aasma; Szerencsy, Adam
INTRODUCTION/BACKGROUND:Failure to document colonoscopy follow-up needs postpolypectomy can lead to delayed detection of colorectal cancer (CRC). Automating the update of a unified follow-up date in the electronic health record (EHR) may increase the number of patients with guideline-concordant CRC follow-up screening. METHODS:Prospective pre-post design study of an automated rules engine-based tool using colonoscopy pathology results to automate updates to documented CRC screening due dates was performed as an operational initiative, deployed enterprise-wide May 2023. Participants were aged 45-75 years who received a colonoscopy November 2022 to November 2023. Primary outcome measure is rate of updates to screening due dates and proportion with recommended follow-up < 10 years. Multivariable log-binomial regression was performed (relative risk, 95% confidence intervals). RESULTS:Study population included 9,824 standard care and 19,340 intervention patients. Patients had a mean age of 58.6 ± 8.6 years and were 53.4% female, 69.6% non-Hispanic White, 13.5% non-Hispanic Black, 6.5% Asian, and 4.6% Hispanic. Postintervention, 46.7% of follow-up recommendations were updated by the rules engine. The proportion of patients with a 10-year default follow-up frequency significantly decreased (88.7%-42.8%, P < 0.001). The mean follow-up frequency decreased by 1.9 years (9.3-7.4 years, P < 0.001). Overall likelihood of an updated follow-up date significantly increased (relative risk 5.62, 95% confidence intervals: 5.30-5.95, P < 0.001). DISCUSSION/CONCLUSIONS:An automated rules engine-based tool has the potential to increase the accuracy of colonoscopy follow-up dates recorded in patient EHR. The results emphasize the opportunity for more automated and integrated solutions for updating and maintaining EHR health maintenance activities.
PMID: 39665587
ISSN: 2155-384x
CID: 5762892
Cardiologist Perceptions on Automated Alerts and Messages To Improve Heart Failure Care
Maidman, Samuel D; Blecker, Saul; Reynolds, Harmony R; Phillips, Lawrence M; Paul, Margaret M; Nagler, Arielle R; Szerencsy, Adam; Saxena, Archana; Horwitz, Leora I; Katz, Stuart D; Mukhopadhyay, Amrita
Electronic health record (EHR)-embedded tools are known to improve prescribing of guideline-directed medical therapy (GDMT) for patients with heart failure. However, physicians may perceive EHR tools to be unhelpful, and may be therefore hesitant to implement these in their practice. We surveyed cardiologists about two effective EHR-tools to improve heart failure care, and they perceived the EHR tools to be easy to use, helpful, and improve the overall management of their patients with heart failure.
PMID: 39423991
ISSN: 1097-6744
CID: 5718912
Development and evaluation of an artificial intelligence-based workflow for the prioritization of patient portal messages
Yang, Jie; So, Jonathan; Zhang, Hao; Jones, Simon; Connolly, Denise M; Golding, Claudia; Griffes, Esmelin; Szerencsy, Adam C; Wu, Tzer Jason; Aphinyanaphongs, Yindalon; Major, Vincent J
OBJECTIVES/UNASSIGNED:Accelerating demand for patient messaging has impacted the practice of many providers. Messages are not recommended for urgent medical issues, but some do require rapid attention. This presents an opportunity for artificial intelligence (AI) methods to prioritize review of messages. Our study aimed to highlight some patient portal messages for prioritized review using a custom AI system integrated into the electronic health record (EHR). MATERIALS AND METHODS/UNASSIGNED:We developed a Bidirectional Encoder Representations from Transformers (BERT)-based large language model using 40 132 patient-sent messages to identify patterns involving high acuity topics that warrant an immediate callback. The model was then implemented into 2 shared pools of patient messages managed by dozens of registered nurses. A primary outcome, such as the time before messages were read, was evaluated with a difference-in-difference methodology. RESULTS/UNASSIGNED: = 396 466), an improvement exceeding the trend was observed in the time high-scoring messages sit unread (21 minutes, 63 vs 42 for messages sent outside business hours). DISCUSSION/UNASSIGNED:Our work shows great promise in improving care when AI is aligned with human workflow. Future work involves audience expansion, aiding users with suggested actions, and drafting responses. CONCLUSION/UNASSIGNED:Many patients utilize patient portal messages, and while most messages are routine, a small fraction describe alarming symptoms. Our AI-based workflow shortens the turnaround time to get a trained clinician to review these messages to provide safer, higher-quality care.
PMCID:11328532
PMID: 39156046
ISSN: 2574-2531
CID: 5680362
The Impact of an Electronic Best Practice Advisory on Patients' Physical Activity and Cardiovascular Risk Profile
McCarthy, Margaret M; Szerencsy, Adam; Fletcher, Jason; Taza-Rocano, Leslie; Weintraub, Howard; Hopkins, Stephanie; Applebaum, Robert; Schwartzbard, Arthur; Mann, Devin; D'Eramo Melkus, Gail; Vorderstrasse, Allison; Katz, Stuart D
BACKGROUND:Regular physical activity (PA) is a component of cardiovascular health and is associated with a lower risk of cardiovascular disease (CVD). However, only about half of US adults achieved the current PA recommendations. OBJECTIVE:The study purpose was to implement PA counseling using a clinical decision support tool in a preventive cardiology clinic and to assess changes in CVD risk factors in a sample of patients enrolled over 12 weeks of PA monitoring. METHODS:This intervention, piloted for 1 year, had 3 components embedded in the electronic health record: assessment of patients' PA, an electronic prompt for providers to counsel patients reporting low PA, and patient monitoring using a Fitbit. Cardiovascular disease risk factors included PA (self-report and Fitbit), body mass index, blood pressure, lipids, and cardiorespiratory fitness assessed with the 6-minute walk test. Depression and quality of life were also assessed. Paired t tests assessed changes in CVD risk. RESULTS:The sample who enrolled in the remote patient monitoring (n = 59) were primarily female (51%), White adults (76%) with a mean age of 61.13 ± 11.6 years. Self-reported PA significantly improved over 12 weeks ( P = .005), but not Fitbit steps ( P = .07). There was a significant improvement in cardiorespiratory fitness (469 ± 108 vs 494 ± 132 m, P = .0034), and 23 participants (42%) improved at least 25 m, signifying a clinically meaningful improvement. Only 4 participants were lost to follow-up over 12 weeks of monitoring. CONCLUSIONS:Patients may need more frequent reminders to be active after an initial counseling session, perhaps getting automated messages based on their step counts syncing to their electronic health record.
PMCID:10787798
PMID: 37467192
ISSN: 1550-5049
CID: 5738192
Large Language Model-Based Responses to Patients' In-Basket Messages
Small, William R; Wiesenfeld, Batia; Brandfield-Harvey, Beatrix; Jonassen, Zoe; Mandal, Soumik; Stevens, Elizabeth R; Major, Vincent J; Lostraglio, Erin; Szerencsy, Adam; Jones, Simon; Aphinyanaphongs, Yindalon; Johnson, Stephen B; Nov, Oded; Mann, Devin
IMPORTANCE/UNASSIGNED:Virtual patient-physician communications have increased since 2020 and negatively impacted primary care physician (PCP) well-being. Generative artificial intelligence (GenAI) drafts of patient messages could potentially reduce health care professional (HCP) workload and improve communication quality, but only if the drafts are considered useful. OBJECTIVES/UNASSIGNED:To assess PCPs' perceptions of GenAI drafts and to examine linguistic characteristics associated with equity and perceived empathy. DESIGN, SETTING, AND PARTICIPANTS/UNASSIGNED:This cross-sectional quality improvement study tested the hypothesis that PCPs' ratings of GenAI drafts (created using the electronic health record [EHR] standard prompts) would be equivalent to HCP-generated responses on 3 dimensions. The study was conducted at NYU Langone Health using private patient-HCP communications at 3 internal medicine practices piloting GenAI. EXPOSURES/UNASSIGNED:Randomly assigned patient messages coupled with either an HCP message or the draft GenAI response. MAIN OUTCOMES AND MEASURES/UNASSIGNED:PCPs rated responses' information content quality (eg, relevance), using a Likert scale, communication quality (eg, verbosity), using a Likert scale, and whether they would use the draft or start anew (usable vs unusable). Branching logic further probed for empathy, personalization, and professionalism of responses. Computational linguistics methods assessed content differences in HCP vs GenAI responses, focusing on equity and empathy. RESULTS/UNASSIGNED:A total of 16 PCPs (8 [50.0%] female) reviewed 344 messages (175 GenAI drafted; 169 HCP drafted). Both GenAI and HCP responses were rated favorably. GenAI responses were rated higher for communication style than HCP responses (mean [SD], 3.70 [1.15] vs 3.38 [1.20]; P = .01, U = 12 568.5) but were similar to HCPs on information content (mean [SD], 3.53 [1.26] vs 3.41 [1.27]; P = .37; U = 13 981.0) and usable draft proportion (mean [SD], 0.69 [0.48] vs 0.65 [0.47], P = .49, t = -0.6842). Usable GenAI responses were considered more empathetic than usable HCP responses (32 of 86 [37.2%] vs 13 of 79 [16.5%]; difference, 125.5%), possibly attributable to more subjective (mean [SD], 0.54 [0.16] vs 0.31 [0.23]; P < .001; difference, 74.2%) and positive (mean [SD] polarity, 0.21 [0.14] vs 0.13 [0.25]; P = .02; difference, 61.5%) language; they were also numerically longer (mean [SD] word count, 90.5 [32.0] vs 65.4 [62.6]; difference, 38.4%), but the difference was not statistically significant (P = .07) and more linguistically complex (mean [SD] score, 125.2 [47.8] vs 95.4 [58.8]; P = .002; difference, 31.2%). CONCLUSIONS/UNASSIGNED:In this cross-sectional study of PCP perceptions of an EHR-integrated GenAI chatbot, GenAI was found to communicate information better and with more empathy than HCPs, highlighting its potential to enhance patient-HCP communication. However, GenAI drafts were less readable than HCPs', a significant concern for patients with low health or English literacy.
PMCID:11252893
PMID: 39012633
ISSN: 2574-3805
CID: 5686582
Implementing a Clinical Decision Support Tool to Improve Physical Activity
McCarthy, Margaret M; Szerencsy, Adam; Taza-Rocano, Leslie; Hopkins, Stephanie; Mann, Devin; D'Eramo Melkus, Gail; Vorderstrasse, Allison; Katz, Stuart D
BACKGROUND:Currently, only about half of U.S. adults achieve current physical activity guidelines. Routine physical activity is not regularly assessed, nor are patients routinely counseled by their health care provider on achieving recommended levels. The three-question physical activity vital sign (PAVS) was developed to assess physical activity duration and intensity and identify adults not meeting physical activity guidelines. Clinical decision support provided via a best practice advisory in an electronic health record (EHR) system can be triggered as a prompt, reminding health care providers to implement the best practice intervention when appropriate. Remote patient monitoring of physical activity can provide objective data in the EHR. OBJECTIVES/OBJECTIVE:This study aimed to evaluate the feasibility and clinical utility of embedding the PAVS and a triggered best practice advisor into the EHR in an ambulatory preventive cardiology practice setting to alert providers to patients reporting low physical activity and prompt health care providers to counsel these patients as needed. METHODS:Three components based in the EHR were integrated for the purpose of this study: patients completed the PAVS through their electronic patient portal prior to an office visit; a best practice advisory was created to prompt providers to counsel patients who reported low levels of physical activity; and remote patient monitoring via Fitbit synced to the EHR provided objective physical activity data. The intervention was pilot-tested in the Epic EHR for 1 year (July 1, 2021-June 30, 2022). Qualitative feedback on the intervention from both providers and patients was obtained at the completion of the study. RESULTS:Monthly assessments of the use of the PAVS and best practice advisory and remote patient monitoring were completed. Patients' completion of the PAVS varied from 35% to 48% per month. The best practice advisory was signed by providers between 2% and 65% and was acknowledged by 2% to 22% per month. The majority (58%) of patients were able to sync a Fitbit device to their EHR for remote monitoring. DISCUSSION/CONCLUSIONS:Although uptake of each component needs improvement, this pilot demonstrated the feasibility of incorporating a PA promotion intervention into the EHR. Qualitative feedback provided guidance for future implementation.
PMID: 38207172
ISSN: 1538-9847
CID: 5631332
Impact of Visit Volume on the Effectiveness of Electronic Tools to Improve Heart Failure Care
Mukhopadhyay, Amrita; Reynolds, Harmony R; King, William C; Phillips, Lawrence M; Nagler, Arielle R; Szerencsy, Adam; Saxena, Archana; Klapheke, Nathan; Katz, Stuart D; Horwitz, Leora I; Blecker, Saul
BACKGROUND:Electronic health record (EHR) tools can improve prescribing of guideline-recommended therapies for heart failure with reduced ejection fraction (HFrEF), but their effectiveness may vary by physician workload. OBJECTIVES/OBJECTIVE:This paper aims to assess whether physician workload modifies the effectiveness of EHR tools for HFrEF. METHODS:This was a prespecified subgroup analysis of the BETTER CARE-HF (Building Electronic Tools to Enhance and Reinforce Cardiovascular Recommendations for Heart Failure) cluster-randomized trial, which compared effectiveness of an alert vs message vs usual care on prescribing of mineralocorticoid antagonists (MRAs). The trial included adults with HFrEF seen in cardiology offices who were eligible for and not prescribed MRAs. Visit volume was defined at the cardiologist-level as number of visits per 6-month study period (high = upper tertile vs non-high = remaining). Analysis at the patient-level used likelihood ratio test for interaction with log-binomial models. RESULTS:Among 2,211 patients seen by 174 cardiologists, 932 (42.2%) were seen by high-volume cardiologists (median: 1,853; Q1-Q3: 1,637-2,225 visits/6 mo; and median: 10; Q1-Q3: 9-12 visits/half-day). MRA was prescribed to 5.5% in the high-volume vs 14.8% in the non-high-volume groups in the usual care arm, 10.3% vs 19.6% in the message arm, and 31.2% vs 28.2% in the alert arm, respectively. Visit volume modified treatment effect (P for interaction = 0.02) such that the alert was more effective in the high-volume group (relative risk: 5.16; 95% CI: 2.57-10.4) than the non-high-volume group (relative risk: 1.93; 95% CI: 1.29-2.90). CONCLUSIONS:An EHR-embedded alert increased prescribing by >5-fold among patients seen by high-volume cardiologists. Our findings support use of EHR alerts, especially in busy practice settings. (Building Electronic Tools to Enhance and Reinforce Cardiovascular Recommendations for Heart Failure [BETTER CARE-HF]; NCT05275920).
PMID: 38043045
ISSN: 2213-1787
CID: 5597482
A Dynamic Clinical Decision Support Tool to Improve Primary Care Outcomes in a High-Volume, Low-Resource Setting
Dapkins, Isaac; Prescott, Rasheda; Ladino, Nathalia; Anderman, Judd; McCaleb, Chase; Colella, Doreen; Gore, Radhika; Fontil, Valy; Szerencsy, Adam; Blecker, Saul
The Family Health Centers at New York University Langone (FHC), a federally qualified health center network in New York City, created a novel clinical decision support (CDS) tool that alerts primary health care providers to patients"™ gaps in care and triggers a dynamic, individualized order set on the basis of unique patient factors, enabling providers to readily act on each patient"™s specific gaps in care. FHC implemented this tool in 2017, starting with 15 protocols for quality measures; as of February 2024, there are 30 such protocols. During a patient visit with a provider, when there is a gap in care, a best-practice alert (BPA) fires, which includes an order set unique to the patient and visit. The provider can bypass the alert (not open it) or acknowledge the alert (open it). The provider may review the content of the order set and accept it as is or with modifications, or they can decline its recommendations if they believe it is not appropriate or plan to address the gap in care another way during the visit. To accept the dynamic order set is the intended workflow. The authors present data from September 2019 to January 2023 totaling 171,319 patient visits with at least one open gap in care among providers in pediatrics, family medicine, and internal medicine. The rate at which providers acknowledged the BPA in the first 6 months was 45% and steadily increased. In the last 6 months of the period, providers acknowledged the BPA 78% (19,281 of 24,575) of the time. Similarly, in the first 6 months, in all encounters in which a BPA was fired, 28.8% (8,585 of 29,829) had an order placed via the dynamic order set (accepted); that rate increased to 49.7% (12,210 of 24,575) during the last 6 months. This order set completion rate is notable given that most CDS use rates are low. Gap closure was higher when providers acknowledged the alert. In an analysis of all encounters with at least one open gap, spanning 2019"“2023, 46% (48,431 of 105,371) of the time, at least one gap was closed when the alert was acknowledged compared with 33% (21,993 of 65,948) when the alert was bypassed (and the recommendations of the dynamic order set were never followed). The authors show that CDS tools can be successfully implemented in a high-volume, low-resource setting if designed with efficiency in mind, ensuring provider utilization and clinical impact through closing care gaps. CDS tools that are dynamically patient specific can help improve quality of care if they are part of a broader culture of quality improvement.
SCOPUS:85190307342
ISSN: 2642-0007
CID: 5670482
Quantifying the impact of telemedicine and patient medical advice request messages on physicians' work-outside-work
Mandal, Soumik; Wiesenfeld, Batia M; Mann, Devin M; Szerencsy, Adam C; Iturrate, Eduardo; Nov, Oded
The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians' after-hours clinical work ("work-outside-work"). The surge in patients' digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians' after-hours commitments. We examined the impact on physicians' workload from two types of digital demands - patients' messages requesting medical advice (PMARs) sent to physicians' inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians' work-outside-work and that this relationship is moderated by physicians' specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians' work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.
PMCID:10867011
PMID: 38355913
ISSN: 2398-6352
CID: 5635802
Cluster-Randomized Trial Comparing Ambulatory Decision Support Tools to Improve Heart Failure Care
Mukhopadhyay, Amrita; Reynolds, Harmony R; Phillips, Lawrence M; Nagler, Arielle R; King, William C; Szerencsy, Adam; Saxena, Archana; Aminian, Rod; Klapheke, Nathan; Horwitz, Leora I; Katz, Stuart D; Blecker, Saul
BACKGROUND:Mineralocorticoid receptor antagonists (MRA) are under-prescribed for patients with heart failure with reduced ejection fraction (HFrEF). OBJECTIVE:To compare effectiveness of two automated, electronic health record (EHR)-embedded tools vs. usual care on MRA prescribing in eligible patients with HFrEF. METHODS:BETTER CARE-HF (Building Electronic Tools To Enhance and Reinforce CArdiovascular REcommendations for Heart Failure) was a three-arm, pragmatic, cluster-randomized trial comparing the effectiveness of an alert during individual patient encounters vs. a message about multiple patients between encounters vs. usual care on MRA prescribing. We included adult patients with HFrEF, no active MRA prescription, no contraindication to MRA, and an outpatient cardiologist in a large health system. Patients were cluster-randomized by cardiologist (60 per arm). RESULTS:The study included 2,211 patients (alert: 755, message: 812, usual care [control]: 644), with average age 72.2 years, average EF 33%, who were predominantly male (71.4%) and White (68.9%). New MRA prescribing occurred in 29.6% of patients in the alert arm, 15.6% in the message arm, and 11.7% in the control arm. The alert more than doubled MRA prescribing compared to control (RR: 2.53, 95% CI: 1.77-3.62, p<0.0001), and improved MRA prescribing compared to the message (RR: 1.67, 95% CI: 1.21-2.29, p=0.002). The number of patients with alert needed to result in an additional MRA prescription was 5.6. CONCLUSIONS:An automated, patient-specific, EHR-embedded alert increased MRA prescribing compared to both a message and usual care. Our findings highlight the potential for EHR-embedded tools to substantially increase prescription of life-saving therapies for HFrEF. (NCT05275920).
PMID: 36882134
ISSN: 1558-3597
CID: 5430312