Searched for: department:Medicine. General Internal Medicine
recentyears:2
school:SOM
Evaluating Hospital Course Summarization by an Electronic Health Record-Based Large Language Model
Small, William R; Austrian, Jonathan; O'Donnell, Luke; Burk-Rafel, Jesse; Hochman, Katherine A; Goodman, Adam; Zaretsky, Jonah; Martin, Jacob; Johnson, Stephen; Major, Vincent J; Jones, Simon; Henke, Christian; Verplanke, Benjamin; Osso, Jwan; Larson, Ian; Saxena, Archana; Mednick, Aron; Simonis, Choumika; Han, Joseph; Kesari, Ravi; Wu, Xinyuan; Heery, Lauren; Desel, Tenzin; Baskharoun, Samuel; Figman, Noah; Farooq, Umar; Shah, Kunal; Jahan, Nusrat; Kim, Jeong Min; Testa, Paul; Feldman, Jonah
IMPORTANCE/UNASSIGNED:Hospital course (HC) summarization represents an increasingly onerous discharge summary component for physicians. Literature supports large language models (LLMs) for HC summarization, but whether physicians can effectively partner with electronic health record-embedded LLMs to draft HCs is unknown. OBJECTIVES/UNASSIGNED:To compare the editing effort required by time-constrained resident physicians to improve LLM- vs physician-generated HCs toward a novel 4Cs (complete, concise, cohesive, and confabulation-free) HC. DESIGN, SETTING, AND PARTICIPANTS/UNASSIGNED:Quality improvement study using a convenience sample of 10 internal medicine resident editors, 8 hospitalist evaluators, and randomly selected general medicine admissions in December 2023 lasting 4 to 8 days at New York University Langone Health. EXPOSURES/UNASSIGNED:Residents and hospitalists reviewed randomly assigned patient medical records for 10 minutes. Residents blinded to author type who edited each HC pair (physician and LLM) for quality in 3 minutes, followed by comparative ratings by attending hospitalists. MAIN OUTCOMES AND MEASURES/UNASSIGNED:Editing effort was quantified by analyzing the edits that occurred on the HC pairs after controlling for length (percentage edited) and the degree to which the original HCs' meaning was altered (semantic change). Hospitalists compared edited HC pairs with A/B testing on the 4Cs (5-point Likert scales converted to 10-point bidirectional scales). RESULTS/UNASSIGNED:Among 100 admissions, compared with physician HCs, residents edited a smaller percentage of LLM HCs (LLM mean [SD], 31.5% [16.6%] vs physicians, 44.8% [20.0%]; P < .001). Additionally, LLM HCs required less semantic change (LLM mean [SD], 2.4% [1.6%] vs physicians, 4.9% [3.5%]; P < .001). Attending physicians deemed LLM HCs to be more complete (mean [SD] difference LLM vs physicians on 10-point bidirectional scale, 3.00 [5.28]; P < .001), similarly concise (mean [SD], -1.02 [6.08]; P = .20), and cohesive (mean [SD], 0.70 [6.14]; P = .60), but with more confabulations (mean [SD], -0.98 [3.53]; P = .002). The composite scores were similar (mean [SD] difference LLM vs physician on 40-point bidirectional scale, 1.70 [14.24]; P = .46). CONCLUSIONS AND RELEVANCE/UNASSIGNED:Electronic health record-embedded LLM HCs required less editing than physician-generated HCs to approach a quality standard, resulting in HCs that were comparably or more complete, concise, and cohesive, but contained more confabulations. Despite the potential influence of artificial time constraints, this study supports the feasibility of a physician-LLM partnership for writing HCs and provides a basis for monitoring LLM HCs in clinical practice.
PMID: 40802185
ISSN: 2574-3805
CID: 5906762
Disappearing Text as a Clinical Decision Support Layer: A Case Series
Silberlust, Jared; Small, William; Shah, Darshi; Chakravartty, Eesha; Moawad, Katherine; Moawad, Andrew; Testa, Paul; Feldman, Jonah
OBJECTIVES/OBJECTIVE:This case series aims to evaluate several applications of inline disappearing text (DT) clinical decision support (CDS) tools within clinician documentation. METHODS:DT blocks were created to prompt documentation for perioperative anticoagulation planning (Scenario 1), pre-discharge intravenous antibiotic planning (Scenario 2), and advanced care planning (Scenario 3). In Scenario 1, DT was the only intervention. In Scenario 2, DT was paired with a documentation SmartList. In Scenario 3, DT was paired with a documentation SmartList and an OurPractice Advisory. The number of documented perioperative anticoagulation plans, pre-discharge intravenous antibiotic plans, and Advanced Care Planning notes were measured pre- and post-intervention and compared using Chi-square analyses. RESULTS:In Scenario 1, there was no statistically significant change in the percentage of perioperative anticoagulation plans documented at 0-24 and 24-48 hours before surgery. In Scenario 2, documentation of antibiotic contingency planning in patients expected to be discharged within 24 hours increased from 60% (54 of 90 notes) to 93% (1,850 of 1,994 notes) X2 (1, N=2,084) = 113.1, p < 0.001. In Scenario 3, ACP note documentation by discharge in patients with a positive mandatory surprise question increased from 43% (821 of 1,909 encounters) to 52% (975 of 1,874 encounters) X2 (1, N=3,783) = 30.5, p < 0.001. CONCLUSIONS:Utilizing DT in conjunction with other forms of CDS was associated with an improvement of documentation quality in pre-discharge IV antibiotics and advanced care planning. A sociotechnical analysis explores how interactions between technology, people, workflow, and culture could contextualize how utilizing DT with other forms of CDS was more effective than DT alone.
PMID: 40763805
ISSN: 1869-0327
CID: 5905032
Variations in weight loss and glycemic outcomes after sleeve gastrectomy by race and ethnicity
Vanegas, Sally M; Curado, Silvia; Zhou, Boyan; Illenberger, Nicholas; Merriwether, Ericka N; Armijos, Evelyn; Schmidt, Ann Marie; Ren-Fielding, Christine; Parikh, Manish; Elbel, Brian; Alemán, José O; Jay, Melanie
OBJECTIVE:This study examined racial and ethnic differences in percent total weight loss (%TWL) and glycemic improvement following sleeve gastrectomy (SG) and explored the role of socioeconomic and psychosocial factors in postsurgical outcomes. METHODS:This longitudinal study included patients who underwent SG between 2017 and 2020, with follow-up visits over 24 months. RESULTS:Non-Hispanic Black (NHB) participants had lower %TWL at 3, 12, and 24 months compared with Hispanic (H) and non-Hispanic White (NHW) participants. Fat mass index was initially lower in NHB, with smaller reductions over time and significant group differences persisting at 24 months. NHB participants had higher baseline fat-free mass index values; by 24 months, fat-free mass index values were lower in H participants. Hemoglobin A1c decreased across all groups but remained consistently higher in NHB and H compared with NHW at 24 months. NHB participants reported higher perceived discrimination, sleep disturbance, and perceived stress than H and NHW participants at all time points. Employment status predicted %TWL at 12 months. There was a significant interaction between race and ethnicity and employment status observed at 12 and 24 months, suggesting that employment-related disparities could impact surgical outcomes. CONCLUSIONS:NHB participants experienced less favorable outcomes following SG, emphasizing the need for tailored interventions addressing socioeconomic and psychosocial disparities.
PMID: 40524421
ISSN: 1930-739x
CID: 5870822
Clinical Decision Support Leveraging Health Information Exchange improves Concordance with Patient's Resuscitation Orders and End-Of-Life Wishes
Chakravartty, Eesha; Silberlust, Jared; Blecker, Saul; Zhao, Yunan; Alendy, Fariza; Menzer, Heather; Ahmed, Aamina; Jones, Simon; Ferrauiola, Meg; Austrian, Jonathan Saul
Objectives Improve concordance between patient end-of-life preferences and code status orders by incorporating data from a state registry with Clinical Decision Support (CDS) within the electronic health record (EHR) to preserve patient autonomy and ensure that patients receive care that aligns with their wishes. Methods Leveraging a Health Information exchange (HIE) interface between the New York State Medical Orders for Life-Sustaining Treatment (eMOLST) registry and the EHR of our academic health system, we developed a bundled CDS intervention that displays eMOLST information at the time of code status ordering and provides an in-line alert when providers enter a resuscitation order discordant with wishes documented in the eMOLST registry. To evaluate this intervention, we performed a segmented regression analysis of an interrupted times series to compare percentage of discordant orders before and after implementation among all hospitalizations for which an eMOLST was available. Results We identified a total of 3648 visits that had an eMOLST filed prior to inpatient admission and a code status order placed during admission. There was a statistically significant decrease of discordant resuscitation orders of -5.95% after the intervention went live, with a relative risk reduction of 25%, [95% CI: -9.95%, -1.94%, p=0.009] in the pre- and post-intervention period. Logistic regression model after adjusting for co-variates showed an average marginal effect of -5.12% after the intervention [CI =-9.75%, -0.50%, p=0.03]. Conclusions Our intervention resulted in a decrease in discordant resuscitation orders. This study demonstrates that accessibility to eMOLST data within the provider workflow supported by CDS can reduce discrepancies between patient end-of-life wishes and hospital code status orders.
PMID: 40267976
ISSN: 1869-0327
CID: 5830322
Career Crafting Advice for Medical Trainees: The 6 Bs
Schwartz, Mark D; Meltzer, Kerry; Kalet, Adina; Margolis, Gregg; Michnich, Marie
PMCID:12360259
PMID: 40832084
ISSN: 1949-8357
CID: 5909012
Graying of IBD in the US-An Urgent Call to Action [Editorial]
Rips, Aaron; Faye, Adam S
PMID: 40299291
ISSN: 1573-2568
CID: 5833542
Racial Implicit Bias, Treatment Recommendations, and Perceived Compliance in the Care of Juvenile Idiopathic Arthritis
Akinsete, Alisha; Hossain, Onjona B; Agalliu, Ilir; Wahezi, Dawn M; Silvers, Ellen J; Blanco, Irene; Rubinstein, Tamar; Gonzalez, Cristina
OBJECTIVE:Racial implicit bias may contribute to health disparities in juvenile idiopathic arthritis (JIA) outcomes by impacting provider medical decision-making. Our study assessed racial and racial-medical compliance implicit biases of an international pediatric rheumatology community and investigated whether their biases impact treatment recommendations for patients with JIA. METHODS:A web-based survey, which included a randomized vignette describing either a White or Black patient with JIA, was sent to pediatric rheumatology providers. Participants were prompted to select the best patient management option and to complete two implicit association tests (IATs): race and race compliance. Student's t-tests or analysis of variance were used to compare IAT D-scores between or across groups; all tests were two-sided with P < 0.05 considered statistically significant. Logistic regression models were used to examine associations for two outcomes of interest: recommendation of either adequate (methotrexate monotherapy) or aggressive (methotrexate and adalimumab combination) treatment with each IAT D-score by each vignette. RESULTS:Overall, 165 pediatric rheumatologists completed the survey. Providers showed a slight pro-White bias in the race IAT (mean D-score ± SD 0.26 ± 0.5) and race-medical compliance IAT (mean D-score ± SD 0.16 ± 0.43). Although not statistically significant, a one-point increase in IAT D-scores was associated with a lower likelihood that providers would choose aggressive treatment versus adequate treatment in the Black vignette (odds ratio [OR] 0.55, 95% confidence interval [CI] 0.20-1.47; P = 0.23), and a greater likelihood that providers would choose aggressive treatment in the White vignette (OR 4.07, 95% CI 0.74-22.24; P = 0.11). CONCLUSION/CONCLUSIONS:Implicit bias was not associated with treatment recommendations. Further studies are needed to better evaluate the impact of implicit bias.
PMCID:12358801
PMID: 40878901
ISSN: 2578-5745
CID: 5910662
Environmental Health Investments: A Minimal Part of Nonprofit Hospital Community-Building Expenses
Cronin, Cory E; Chen, Kevin; Chen, Catherine; Fenstemaker, Cheyenne; Cerceo, Elizabeth
CONTEXT/BACKGROUND:Environmental impacts on human health are an urgent concern, requiring greater focus and action from health care organizations. Nonprofit hospitals can address community needs through investing in environmental improvement (EI) projects aimed at reducing harm to the community from environmental hazards. These expenditures provide a useful model for understanding how hospitals can respond to environmental influences on health, but national patterns of EI expenditures are under-researched. OBJECTIVE:To assess nationwide trends in nonprofit hospital EI spending from 2010 to 2021. DESIGN/METHODS:Observational study using Internal Revenue Service tax data. SETTING/METHODS:US nonprofit hospitals. MAIN OUTCOMES AND MEASURES/METHODS:We assessed associations between reported EI spending and hospital organization and community characteristics (hospital revenue (quintiles); bed size (<50, 50-199, 200-399, 400 +); participation in group reporting (yes/no); teaching affiliation (yes/no); rurality status; geographic region (Northeast, Midwest, West, and South), and county poverty (quartile). RESULTS:There were 36 093 nonprofit hospital-years included in our analysis. 10.4% of hospitals reported EI spending. EI spending was positively associated with higher revenue and being in the Midwest region and negatively associated with area poverty. The years 2020 and 2021 were significantly associated with a lower likelihood of spending relative to 2010. 40% of hospitals included utilized group reporting. Only 6% of independently reporting hospitals reported EI spending. Among hospital organizations with any reported community-building expenses, the percentage of their total operating budget dedicated to EI averaged 0.002% each year (0%-1.52%). CONCLUSIONS:Though EI investments are small relative to community-building spending, the characteristics of hospitals reporting these investments provide insight into EI trends over time and which hospitals are conducting these efforts. Future research should consider the specific gaps to stimulating EI, what environmental needs hospitals are equipped to fill, and their relevance to broader environmental health policies and initiatives.
PMID: 40359548
ISSN: 1550-5022
CID: 5844172
Clin-STAR Corner: Practice-Changing Advances at the Interface of Gastroenterology & Geriatrics
Faye, Adam S; Kochar, Bharati; Shaukat, Aasma
With nearly 60 million Americans aged 65 and older, gastrointestinal (GI) conditions are a leading cause of healthcare utilization in this population. Despite this, older adults remain underrepresented in GI clinical trials and research, limiting evidence-based care. This review highlights three pivotal studies addressing this gap: (1) proton pump inhibitors, which are commonly used to treat gastroesophageal reflux disease, are not associated with the later development of dementia; (2) undertreatment of chronic inflammation among older adults with inflammatory bowel disease is associated with a higher rate of adverse events compared to treatment with anti-TNF therapy, a biologic agent; (3) the majority (85%) of surveillance colonoscopies among older adults with a life expectancy of ≥ 10 years did not yield colorectal cancer, advanced dysplasia, or ≥ 3 polyps.
PMID: 40202331
ISSN: 1532-5415
CID: 5823852
Cost-Effectiveness of Endoscopic Stricturotomy Versus Resection Surgery for Crohn's Disease Strictures
Karlin, Kate Lee; Kim, Grace; Lim, Francesca; Faye, Adam S; Hur, Chin; Shen, Bo
PMCID:12346041
PMID: 40805834
ISSN: 2227-9032
CID: 5907482