Searched for: in-biosketch:yes
person:stevee01
Limited Evidence of Shared Decision Making for Prostate Cancer Screening in Audio-Recorded Primary Care Visits Among Black Men and their Healthcare Providers
Stevens, Elizabeth R; Thomas, Jerry; Martinez-Lopez, Natalia; Fagerlin, Angela; Ciprut, Shannon; Shedlin, Michele; Gold, Heather T; Li, Huilin; Davis, J Kelly; Campagna, Ada; Bhat, Sandeep; Warren, Rueben; Ubel, Peter; Ravenell, Joseph E; Makarov, Danil V
Prostate-specific antigen (PSA)-based prostate cancer screening is a preference-sensitive decision for which experts recommend a shared decision making (SDM) approach. This study aimed to examine PSA screening SDM in primary care. Methods included qualitative analysis of audio-recorded patient-provider interactions supplemented by quantitative description. Participants included 5 clinic providers and 13 patients who were: (1) 40-69 years old, (2) Black, (3) male, and (4) attending clinic for routine primary care. Main measures were SDM element themes and "observing patient involvement in decision making" (OPTION) scoring. Some discussions addressed advantages, disadvantages, and/or scientific uncertainty of screening, however, few patients received all SDM elements. Nearly all providers recommended screening, however, only 3 patients were directly asked about screening preferences. Few patients were asked about prostate cancer knowledge (2), urological symptoms (3), or family history (6). Most providers discussed disadvantages (80%) and advantages (80%) of PSA screening. Average OPTION score was 25/100 (range 0-67) per provider. Our study found limited SDM during PSA screening consultations. The counseling that did take place utilized components of SDM but inconsistently and incompletely. We must improve SDM for PSA screening for diverse patient populations to promote health equity. This study highlights the need to improve SDM for PSA screening.
PMID: 38822923
ISSN: 1557-1920
CID: 5662852
Attributes of higher- and lower-performing hospitals in the Consult for Addiction Treatment and Care in Hospitals (CATCH) program implementation: A multiple-case study
Stevens, Elizabeth R; Fawole, Adetayo; Rostam Abadi, Yasna; Fernando, Jasmine; Appleton, Noa; King, Carla; Mazumdar, Medha; Shelley, Donna; Barron, Charles; Bergmann, Luke; Siddiqui, Samira; Schatz, Daniel; McNeely, Jennifer
INTRODUCTION/BACKGROUND:Six hospitals within the New York City public hospital system implemented the Consult for Addiction Treatment and Care in Hospitals (CATCH) program, an interprofessional addiction consult service. A stepped-wedge cluster randomized controlled trial tested the effectiveness of CATCH for increasing initiation and engagement in post-discharge medication for opioid use disorder (MOUD) treatment among hospital patients with opioid use disorder (OUD). The objective of this study was to identify facility characteristics that were associated with stronger performance of CATCH. METHODS:This study used a mixed methods multiple-case study design. The six hospitals in the CATCH evaluation were each assigned a case rating according to intervention reach. Reach was considered high if ≥50 % of hospitalized OUD patients received an MOUD order. Cross-case rating comparison identified attributes of high-performing hospitals and inductive and deductive approaches were used to identify themes. RESULTS:Higher-performing hospitals exhibited attributes that were generally absent in lower-performing hospitals, including (1) complete medical provider staffing; (2) designated office space and resources for CATCH; (3) existing integrated OUD treatment resources; and (4) limited overlap between the implementation period and COVID-19 pandemic. CONCLUSIONS:Hospitals with attributes indicative of awareness and integration of OUD services into general care were generally higher performing than hospitals that had siloed OUD treatment programs. Future implementations of addiction consult services may benefit from an increased focus on hospital- and community-level buy-in and efforts to integrate MOUD treatment into general care.
PMID: 39343141
ISSN: 2949-8759
CID: 5738772
Mixed methods assessment of the influence of demographics on medical advice of ChatGPT
Andreadis, Katerina; Newman, Devon R; Twan, Chelsea; Shunk, Amelia; Mann, Devin M; Stevens, Elizabeth R
OBJECTIVES/OBJECTIVE:To evaluate demographic biases in diagnostic accuracy and health advice between generative artificial intelligence (AI) (ChatGPT GPT-4) and traditional symptom checkers like WebMD. MATERIALS AND METHODS/METHODS:Combination symptom and demographic vignettes were developed for 27 most common symptom complaints. Standardized prompts, written from a patient perspective, with varying demographic permutations of age, sex, and race/ethnicity were entered into ChatGPT (GPT-4) between July and August 2023. In total, 3 runs of 540 ChatGPT prompts were compared to the corresponding WebMD Symptom Checker output using a mixed-methods approach. In addition to diagnostic correctness, the associated text generated by ChatGPT was analyzed for readability (using Flesch-Kincaid Grade Level) and qualitative aspects like disclaimers and demographic tailoring. RESULTS:ChatGPT matched WebMD in 91% of diagnoses, with a 24% top diagnosis match rate. Diagnostic accuracy was not significantly different across demographic groups, including age, race/ethnicity, and sex. ChatGPT's urgent care recommendations and demographic tailoring were presented significantly more to 75-year-olds versus 25-year-olds (P < .01) but were not statistically different among race/ethnicity and sex groups. The GPT text was suitable for college students, with no significant demographic variability. DISCUSSION/CONCLUSIONS:The use of non-health-tailored generative AI, like ChatGPT, for simple symptom-checking functions provides comparable diagnostic accuracy to commercially available symptom checkers and does not demonstrate significant demographic bias in this setting. The text accompanying differential diagnoses, however, suggests demographic tailoring that could potentially introduce bias. CONCLUSION/CONCLUSIONS:These results highlight the need for continued rigorous evaluation of AI-driven medical platforms, focusing on demographic biases to ensure equitable care.
PMID: 38679900
ISSN: 1527-974x
CID: 5651762
Evaluating strategies to recruit health researchers to participate in online survey research
Stevens, Elizabeth R; Cleland, Charles M; Shunk, Amelia; El Shahawy, Omar
BACKGROUND:Engaging researchers as research subjects is key to informing the development of effective and relevant research practices. It is important to understand how best to engage researchers as research subjects. METHODS:factorial experiment, as part of a Multiphase Optimization Strategy, was performed to evaluate effects of four recruitment strategy components on participant opening of an emailed survey link and survey completion. Participants were members of three US-based national health research consortia. A stratified simple random sample was used to assign potential survey participants to one of 16 recruitment scenarios. Recruitment strategy components were intended to address both intrinsic and extrinsic sources of motivation, including: $50 gift, $1,000 raffle, altruistic messaging, and egoistic messaging. Multivariable generalized linear regression analyses adjusting for consortium estimated component effects on outcomes. Potential interactions among components were tested. Results are reported as adjusted odds ratios (aOR) with 95% confidence intervals (95% CI). RESULTS:Surveys were collected from June to December 2023. A total of 418 participants were included from the consortia, with final analytical sample of 400 eligible participants. Out of the final sample, 82% (341) opened the survey link and 35% (147) completed the survey. Altruistic messaging increased the odds of opening the survey (aOR 2.02, 95% CI: 1.35-2.69, p = 0.033), while egoistic messaging significantly reduced the odds of opening the survey (aOR 0.56, 95%CI 0.38-0.75, p = 0.08). The receipt of egoistic messaging increased the odds of completing the survey once opened (aOR 1.81, 95%CI: 1.39-2.23, p < 0.05). There was a significant negative interaction effect between the altruistic appeal and egoistic messaging strategies for survey completion outcome. Monetary incentives did not a have a significant impact on survey completion. CONCLUSION/CONCLUSIONS:Intrinsic motivation is likely to be a greater driver of health researcher participation in survey research than extrinsic motivation. Altruistic and egoistic messaging may differentially impact initial interest and survey completion and when combined may lead to improved rates of recruitment, but not survey completion. Further research is needed to determine how to best optimize message content and whether the effects observed are modified by survey burden.
PMCID:11256559
PMID: 39026149
ISSN: 1471-2288
CID: 5699442
From silos to synergy: integrating academic health informatics with operational IT for healthcare transformation
Mann, Devin M; Stevens, Elizabeth R; Testa, Paul; Mherabi, Nader
We have entered a new age of health informatics—applied health informatics—where digital health innovation cannot be pursued without considering operational needs. In this new digital health era, creating an integrated applied health informatics system will be essential for health systems to achieve informatics healthcare goals. Integration of information technology (IT) and health informatics does not naturally occur without a deliberate and intentional shift towards unification. Recognizing this, NYU Langone Health’s (NYULH) Medical Center IT (MCIT) has taken proactive measures to vertically integrate academic informatics and operational IT through the establishment of the MCIT Department of Health Informatics (DHI). The creation of the NYULH DHI showcases the drivers, challenges, and ultimate successes of our enterprise effort to align academic health informatics with IT; providing a model for the creation of the applied health informatics programs required for academic health systems to thrive in the increasingly digitized healthcare landscape.
PMCID:11233608
PMID: 38982211
ISSN: 2398-6352
CID: 5732312
Large Language Model-Based Responses to Patients' In-Basket Messages
Small, William R; Wiesenfeld, Batia; Brandfield-Harvey, Beatrix; Jonassen, Zoe; Mandal, Soumik; Stevens, Elizabeth R; Major, Vincent J; Lostraglio, Erin; Szerencsy, Adam; Jones, Simon; Aphinyanaphongs, Yindalon; Johnson, Stephen B; Nov, Oded; Mann, Devin
IMPORTANCE/UNASSIGNED:Virtual patient-physician communications have increased since 2020 and negatively impacted primary care physician (PCP) well-being. Generative artificial intelligence (GenAI) drafts of patient messages could potentially reduce health care professional (HCP) workload and improve communication quality, but only if the drafts are considered useful. OBJECTIVES/UNASSIGNED:To assess PCPs' perceptions of GenAI drafts and to examine linguistic characteristics associated with equity and perceived empathy. DESIGN, SETTING, AND PARTICIPANTS/UNASSIGNED:This cross-sectional quality improvement study tested the hypothesis that PCPs' ratings of GenAI drafts (created using the electronic health record [EHR] standard prompts) would be equivalent to HCP-generated responses on 3 dimensions. The study was conducted at NYU Langone Health using private patient-HCP communications at 3 internal medicine practices piloting GenAI. EXPOSURES/UNASSIGNED:Randomly assigned patient messages coupled with either an HCP message or the draft GenAI response. MAIN OUTCOMES AND MEASURES/UNASSIGNED:PCPs rated responses' information content quality (eg, relevance), using a Likert scale, communication quality (eg, verbosity), using a Likert scale, and whether they would use the draft or start anew (usable vs unusable). Branching logic further probed for empathy, personalization, and professionalism of responses. Computational linguistics methods assessed content differences in HCP vs GenAI responses, focusing on equity and empathy. RESULTS/UNASSIGNED:A total of 16 PCPs (8 [50.0%] female) reviewed 344 messages (175 GenAI drafted; 169 HCP drafted). Both GenAI and HCP responses were rated favorably. GenAI responses were rated higher for communication style than HCP responses (mean [SD], 3.70 [1.15] vs 3.38 [1.20]; P = .01, U = 12 568.5) but were similar to HCPs on information content (mean [SD], 3.53 [1.26] vs 3.41 [1.27]; P = .37; U = 13 981.0) and usable draft proportion (mean [SD], 0.69 [0.48] vs 0.65 [0.47], P = .49, t = -0.6842). Usable GenAI responses were considered more empathetic than usable HCP responses (32 of 86 [37.2%] vs 13 of 79 [16.5%]; difference, 125.5%), possibly attributable to more subjective (mean [SD], 0.54 [0.16] vs 0.31 [0.23]; P < .001; difference, 74.2%) and positive (mean [SD] polarity, 0.21 [0.14] vs 0.13 [0.25]; P = .02; difference, 61.5%) language; they were also numerically longer (mean [SD] word count, 90.5 [32.0] vs 65.4 [62.6]; difference, 38.4%), but the difference was not statistically significant (P = .07) and more linguistically complex (mean [SD] score, 125.2 [47.8] vs 95.4 [58.8]; P = .002; difference, 31.2%). CONCLUSIONS/UNASSIGNED:In this cross-sectional study of PCP perceptions of an EHR-integrated GenAI chatbot, GenAI was found to communicate information better and with more empathy than HCPs, highlighting its potential to enhance patient-HCP communication. However, GenAI drafts were less readable than HCPs', a significant concern for patients with low health or English literacy.
PMCID:11252893
PMID: 39012633
ISSN: 2574-3805
CID: 5686582
Single-nucleus sequencing reveals enriched expression of genetic risk factors in extratelencephalic neurons sensitive to degeneration in ALS
Limone, Francesco; Mordes, Daniel A; Couto, Alexander; Joseph, Brian J; Mitchell, Jana M; Therrien, Martine; Ghosh, Sulagna Dia; Meyer, Daniel; Zhang, Yingying; Goldman, Melissa; Bortolin, Laura; Cobos, Inma; Stevens, Beth; McCarroll, Steven A; Kadiu, Irena; Burberry, Aaron; Pietiläinen, Olli; Eggan, Kevin
Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder characterized by a progressive loss of motor function linked to degenerating extratelencephalic neurons/Betz cells (ETNs). The reasons why these neurons are selectively affected remain unclear. Here, to understand the unique molecular properties that may sensitize ETNs to ALS, we performed RNA sequencing of 79,169 single nuclei from cortices of patients and controls. In both patients and unaffected individuals, we found significantly higher expression of ALS risk genes in THY1+ ETNs, regardless of diagnosis. In patients, this was accompanied by the induction of genes involved in protein homeostasis and stress responses that were significantly induced in a wide collection of ETNs. Examination of oligodendroglial and microglial nuclei revealed patient-specific downregulation of myelinating genes in oligodendrocytes and upregulation of an endolysosomal reactive state in microglia. Our findings suggest that selective vulnerability of extratelencephalic neurons is partly connected to their intrinsic molecular properties sensitizing them to genetics and mechanisms of degeneration.
PMCID:11257952
PMID: 38907103
ISSN: 2662-8465
CID: 5731692
Barriers to Implementing Registered Nurse-Driven Clinical Decision Support for Antibiotic Stewardship: Retrospective Case Study
Stevens, Elizabeth R; Xu, Lynn; Kwon, JaeEun; Tasneem, Sumaiya; Henning, Natalie; Feldthouse, Dawn; Kim, Eun Ji; Hess, Rachel; Dauber-Decker, Katherine L; Smith, Paul D; Halm, Wendy; Gautam-Goyal, Pranisha; Feldstein, David A; Mann, Devin M
BACKGROUND:Up to 50% of antibiotic prescriptions for upper respiratory infections (URIs) are inappropriate. Clinical decision support (CDS) systems to mitigate unnecessary antibiotic prescriptions have been implemented into electronic health records, but their use by providers has been limited. OBJECTIVE:As a delegation protocol, we adapted a validated electronic health record-integrated clinical prediction rule (iCPR) CDS-based intervention for registered nurses (RNs), consisting of triage to identify patients with low-acuity URI followed by CDS-guided RN visits. It was implemented in February 2022 as a randomized controlled stepped-wedge trial in 43 primary and urgent care practices within 4 academic health systems in New York, Wisconsin, and Utah. While issues were pragmatically addressed as they arose, a systematic assessment of the barriers to implementation is needed to better understand and address these barriers. METHODS:We performed a retrospective case study, collecting quantitative and qualitative data regarding clinical workflows and triage-template use from expert interviews, study surveys, routine check-ins with practice personnel, and chart reviews over the first year of implementation of the iCPR intervention. Guided by the updated CFIR (Consolidated Framework for Implementation Research), we characterized the initial barriers to implementing a URI iCPR intervention for RNs in ambulatory care. CFIR constructs were coded as missing, neutral, weak, or strong implementation factors. RESULTS:Barriers were identified within all implementation domains. The strongest barriers were found in the outer setting, with those factors trickling down to impact the inner setting. Local conditions driven by COVID-19 served as one of the strongest barriers, impacting attitudes among practice staff and ultimately contributing to a work infrastructure characterized by staff changes, RN shortages and turnover, and competing responsibilities. Policies and laws regarding scope of practice of RNs varied by state and institutional application of those laws, with some allowing more clinical autonomy for RNs. This necessitated different study procedures at each study site to meet practice requirements, increasing innovation complexity. Similarly, institutional policies led to varying levels of compatibility with existing triage, rooming, and documentation workflows. These workflow conflicts were compounded by limited available resources, as well as an implementation climate of optional participation, few participation incentives, and thus low relative priority compared to other clinical duties. CONCLUSIONS:Both between and within health care systems, significant variability existed in workflows for patient intake and triage. Even in a relatively straightforward clinical workflow, workflow and cultural differences appreciably impacted intervention adoption. Takeaways from this study can be applied to other RN delegation protocol implementations of new and innovative CDS tools within existing workflows to support integration and improve uptake. When implementing a system-wide clinical care intervention, considerations must be made for variability in culture and workflows at the state, health system, practice, and individual levels. TRIAL REGISTRATION/BACKGROUND:ClinicalTrials.gov NCT04255303; https://clinicaltrials.gov/ct2/show/NCT04255303.
PMID: 38781006
ISSN: 2561-326x
CID: 5654912
Prevalence and factors associated with second hand smoke exposure among a sample of pregnant women in Cairo, Egypt
Stevens, Elizabeth R; Mead-Morse, Erin L; Labib, Kareem; Kahn, Linda G; Choi, Sugy; Sherman, Scott E; Oncken, Cheryl; Williams, Natasha J; Loney, Tom; Shahawy, Omar El
PURPOSE/OBJECTIVE:This study estimated the prevalence of and factors associated with secondhand smoke (SHS) exposure, and assessed attitudes and knowledge about SHS among pregnant women in Cairo, Egypt. METHODS:Pregnant women in the third trimester were recruited to participate in a survey assessing tobacco smoking and SHS exposure during their current pregnancy. Participants were recruited from three antenatal clinics in Cairo, Egypt, from June 2015 to May 2016. We examined differences in sociodemographic characteristics and SHS exposure, attitudes, and knowledge by smoking/SHS status. We used multivariable ordinary least squares regression to examine the association between husbands' smoking and pregnant women's mean daily hours of SHS exposure, adjusting for women's smoking status, age group, education, and urban (vs. suburban/rural) residence. RESULTS:Of two hundred pregnant women aged 16-37 years, about two-thirds (69%) had a husband who smoked tobacco. During their current pregnancy, most women reported being non-smokers (71%), and 38% of non-smokers reported being SHS-exposed. Non-smokers exposed to SHS tended to live in more rural areas and have husbands who smoked in the home. In adjusted analyses, having a husband who smoked was significantly associated with a greater mean number of hours of SHS exposure per day exposed, and this difference was driven by husbands who smoked in the home (p < 0.001). Women in the SHS-exposed group were less likely than other groups to agree that SHS exposure was harmful to their own or their future child's health; however, all groups agreed that SHS was harmful to newborn health. CONCLUSION/CONCLUSIONS:Among our sample of pregnant women in Cairo, Egypt, there was a high rate of SHS exposure as well as misconceptions about the safety of SHS exposure to a developing fetus. Our findings suggest a need for targeted education and gender-sensitive messaging about SHS exposure, along with improved enforcement of existing tobacco control policies.
PMCID:10898124
PMID: 38409025
ISSN: 1472-6874
CID: 5691382
Trial Participants' Perceptions of the Impact of Ecological Momentary Assessment on Smoking Behaviors: Qualitative Analysis
Stevens, Elizabeth R; Li, Rina; Xiang, Grace; Wisniewski, Rachel; Rojas, Sidney; O'Connor, Katherine; Wilker, Olivia; Vojjala, Mahathi; El-Shahawy, Omar; Sherman, Scott E
BACKGROUND/UNASSIGNED:Ecological momentary assessment (EMA) is an increasingly used tool for data collection in behavioral research, including smoking cessation studies. As previous addiction research suggests, EMA has the potential to elicit cue reactivity by triggering craving and increasing behavioral awareness. However, there has been limited evaluation of its potential influence on behavior. OBJECTIVE/UNASSIGNED:By examining the perspectives of research participants enrolled in a tobacco treatment intervention trial, this qualitative analysis aims to understand the potential impact that EMA use may have had on smoking behaviors that may not have otherwise been captured through other study measures. METHODS/UNASSIGNED:We performed a qualitative analysis of in-depth interviews with participants enrolled in a pilot randomized controlled trial of a tobacco treatment intervention that used SMS text messaging to collect EMA data on smoking behaviors. In the pilot randomized controlled trial, combustible cigarette and e-cigarette use and smoking-related cravings were measured as part of an EMA protocol, in which SMS text messaging served as a smoking diary. SMS text messaging was intended for data collection only and not designed to serve as part of the intervention. After a baseline assessment, participants were asked to record daily nicotine use for 12 weeks by responding to text message prompts that they received 4 times per day. Participants were prompted to share their experiences with the EMA text messaging component of the trial but were not directly asked about the influence of EMA on their behaviors. Transcripts were coded according to the principles of the framework for applied research. The codes were then examined, summarized, and grouped into themes based on the principles of grounded theory. RESULTS/UNASSIGNED:Interviews were analyzed for 26 participants. The themes developed from the analysis suggested the potential for EMA, in the form of an SMS text messaging smoking diary, to influence participants' smoking behaviors. The perceived impacts of EMA text messaging on smoking behaviors were polarized; some participants emphasized the positive impacts of text messages on their efforts to reduce smoking, while others stressed the ways that text messaging negatively impacted their smoking reduction efforts. These contrasting experiences were captured by themes reflecting the positive impacts on smoking behaviors, including increased awareness of smoking behaviors and a sense of accountability, and the negative impacts on emotions and smoking behaviors, including provoking a sense of guilt and triggering smoking behaviors. CONCLUSIONS/UNASSIGNED:The collection of EMA smoking behavior data via SMS text messaging may influence the behaviors and perceptions of participants in tobacco treatment interventions. More research is needed to determine the magnitude of impact and mechanisms, to account for the potential effects of EMA. A broader discussion of the unintended effects introduced by EMA use is warranted among the research community.
PMID: 38270520
ISSN: 2291-5222
CID: 5625222