Faculty Bibliography

There is a growing amount of literature on the benefits of using open-ended questions (OEQs) to assess knowledge in medical education. However, it is unknown how many US medical schools include OEQs in their assessment toolkits and how they are being used. The purpose of this study was to determine if OEQ assessments are an emerging trend in US medical education. We distributed an online survey to assessment leadership at all 156 US accredited allopathic medical schools between September 2022 and April 2024. Questions focused on the use or future interest of OEQs to assess medical knowledge in the pre-clerkship and clerkship curriculum. We calculated descriptive statistics for prevalence and use rates, and completed a conventional content analysis for open-ended comments. Seventy-eight US medical schools completed the survey (50% response rate). Forty schools (51%) reported using OEQs for medical knowledge assessment. OEQs were used during the pre-clerkship (28 schools), clerkship (two schools) or both parts of the curriculum (10 schools). On average, OEQs accounted for 20% of the pre-clerkship and 11% of the clerkship assessments at each school. Schools used OEQs to assess students' understanding, assess certain types of knowledge, and develop students' deeper learning. Representatives at schools not currently using OEQs reported considering using them in the future but expressed concerns about the amount of time needed to implement them. Numerous schools are using OEQs to assess medical knowledge, suggesting that this assessment format is feasible. Institutions can be innovative in their assessments by extending beyond multiple-choice questions and incorporating other question formats, such as OEQs, to fit their educational needs. This study provides a foundation for future research to explore the utility of OEQs and how to overcome the challenges of implementing OEQ assessments.

INTRODUCTION/BACKGROUND:The impact of remote patient monitoring (RPM) for hypertension (HTN) on cardiovascular health (CVH) remains ill-defined. This study characterized the association between a RPM, team-based HTN intervention and CVH markers. METHODS:This retrospective, single-arm cohort study included patients with uncontrolled HTN enrolled February 2022-July 2024 in the ALTA trial (clinicaltrials.gov NCT03713515) at five safety-net practices. The ALTA intervention involves RPM supported by a virtual clinic including a nurse practitioner (NP), registered nurse, and community health worker. Demographics, ALTA utilization, and CVH markers (blood pressure [BP], lipids, glycemic indicators, body mass index [BMI], and smoking) at baseline and 12 months were collected. Five markers were scored (0=poor, 1=intermediate, 2=ideal) and summed into a CVH score. The primary endpoint was the 12-month CVH score change in patients with baseline score ≤7. Secondary endpoints included individual non-BP marker changes in patients with baseline derangements. RESULTS:Among 568 patients (mean age: 56 years), most were female, non-Hispanic Black, and English-speaking. NP visits were more common among females (p=0.04); no other demographics predicted ALTA utilization. The CVH score improved from 4.5 to 5.2 (n=196, p<0.001), independent of ALTA utilization. Total cholesterol (n=86, p<0.001), LDL (n=128, p<0.001), and triglycerides (n=51, p=0.004) improved. Hemoglobin A1c (n=195) dropped among patients with ≥1 NP visit (p=0.02). Fasting glucose (n=135) and BMI (n=289) decreased in the highest tertile of NP visits (p=0.03) and RPM (p=0.02), respectively. 4 of 27 patients quit smoking. CONCLUSIONS:RPM with team-based support was associated with CVH improvements. Benefits may depend on intervention utilization.

IMPORTANCE/UNASSIGNED:Hospital course (HC) summarization represents an increasingly onerous discharge summary component for physicians. Literature supports large language models (LLMs) for HC summarization, but whether physicians can effectively partner with electronic health record-embedded LLMs to draft HCs is unknown. OBJECTIVES/UNASSIGNED:To compare the editing effort required by time-constrained resident physicians to improve LLM- vs physician-generated HCs toward a novel 4Cs (complete, concise, cohesive, and confabulation-free) HC. DESIGN, SETTING, AND PARTICIPANTS/UNASSIGNED:Quality improvement study using a convenience sample of 10 internal medicine resident editors, 8 hospitalist evaluators, and randomly selected general medicine admissions in December 2023 lasting 4 to 8 days at New York University Langone Health. EXPOSURES/UNASSIGNED:Residents and hospitalists reviewed randomly assigned patient medical records for 10 minutes. Residents blinded to author type who edited each HC pair (physician and LLM) for quality in 3 minutes, followed by comparative ratings by attending hospitalists. MAIN OUTCOMES AND MEASURES/UNASSIGNED:Editing effort was quantified by analyzing the edits that occurred on the HC pairs after controlling for length (percentage edited) and the degree to which the original HCs' meaning was altered (semantic change). Hospitalists compared edited HC pairs with A/B testing on the 4Cs (5-point Likert scales converted to 10-point bidirectional scales). RESULTS/UNASSIGNED:Among 100 admissions, compared with physician HCs, residents edited a smaller percentage of LLM HCs (LLM mean [SD], 31.5% [16.6%] vs physicians, 44.8% [20.0%]; P < .001). Additionally, LLM HCs required less semantic change (LLM mean [SD], 2.4% [1.6%] vs physicians, 4.9% [3.5%]; P < .001). Attending physicians deemed LLM HCs to be more complete (mean [SD] difference LLM vs physicians on 10-point bidirectional scale, 3.00 [5.28]; P < .001), similarly concise (mean [SD], -1.02 [6.08]; P = .20), and cohesive (mean [SD], 0.70 [6.14]; P = .60), but with more confabulations (mean [SD], -0.98 [3.53]; P = .002). The composite scores were similar (mean [SD] difference LLM vs physician on 40-point bidirectional scale, 1.70 [14.24]; P = .46). CONCLUSIONS AND RELEVANCE/UNASSIGNED:Electronic health record-embedded LLM HCs required less editing than physician-generated HCs to approach a quality standard, resulting in HCs that were comparably or more complete, concise, and cohesive, but contained more confabulations. Despite the potential influence of artificial time constraints, this study supports the feasibility of a physician-LLM partnership for writing HCs and provides a basis for monitoring LLM HCs in clinical practice.

OBJECTIVES/OBJECTIVE:This case series aims to evaluate several applications of inline disappearing text (DT) clinical decision support (CDS) tools within clinician documentation. METHODS:DT blocks were created to prompt documentation for perioperative anticoagulation planning (Scenario 1), pre-discharge intravenous antibiotic planning (Scenario 2), and advanced care planning (Scenario 3). In Scenario 1, DT was the only intervention. In Scenario 2, DT was paired with a documentation SmartList. In Scenario 3, DT was paired with a documentation SmartList and an OurPractice Advisory. The number of documented perioperative anticoagulation plans, pre-discharge intravenous antibiotic plans, and Advanced Care Planning notes were measured pre- and post-intervention and compared using Chi-square analyses. RESULTS:In Scenario 1, there was no statistically significant change in the percentage of perioperative anticoagulation plans documented at 0-24 and 24-48 hours before surgery. In Scenario 2, documentation of antibiotic contingency planning in patients expected to be discharged within 24 hours increased from 60% (54 of 90 notes) to 93% (1,850 of 1,994 notes) X2 (1, N=2,084) = 113.1, p < 0.001. In Scenario 3, ACP note documentation by discharge in patients with a positive mandatory surprise question increased from 43% (821 of 1,909 encounters) to 52% (975 of 1,874 encounters) X2 (1, N=3,783) = 30.5, p < 0.001. CONCLUSIONS:Utilizing DT in conjunction with other forms of CDS was associated with an improvement of documentation quality in pre-discharge IV antibiotics and advanced care planning. A sociotechnical analysis explores how interactions between technology, people, workflow, and culture could contextualize how utilizing DT with other forms of CDS was more effective than DT alone.

Objectives Improve concordance between patient end-of-life preferences and code status orders by incorporating data from a state registry with Clinical Decision Support (CDS) within the electronic health record (EHR) to preserve patient autonomy and ensure that patients receive care that aligns with their wishes. Methods Leveraging a Health Information exchange (HIE) interface between the New York State Medical Orders for Life-Sustaining Treatment (eMOLST) registry and the EHR of our academic health system, we developed a bundled CDS intervention that displays eMOLST information at the time of code status ordering and provides an in-line alert when providers enter a resuscitation order discordant with wishes documented in the eMOLST registry. To evaluate this intervention, we performed a segmented regression analysis of an interrupted times series to compare percentage of discordant orders before and after implementation among all hospitalizations for which an eMOLST was available. Results We identified a total of 3648 visits that had an eMOLST filed prior to inpatient admission and a code status order placed during admission. There was a statistically significant decrease of discordant resuscitation orders of -5.95% after the intervention went live, with a relative risk reduction of 25%, [95% CI: -9.95%, -1.94%, p=0.009] in the pre- and post-intervention period. Logistic regression model after adjusting for co-variates showed an average marginal effect of -5.12% after the intervention [CI =-9.75%, -0.50%, p=0.03]. Conclusions Our intervention resulted in a decrease in discordant resuscitation orders. This study demonstrates that accessibility to eMOLST data within the provider workflow supported by CDS can reduce discrepancies between patient end-of-life wishes and hospital code status orders.

OBJECTIVE:This study examined racial and ethnic differences in percent total weight loss (%TWL) and glycemic improvement following sleeve gastrectomy (SG) and explored the role of socioeconomic and psychosocial factors in postsurgical outcomes. METHODS:This longitudinal study included patients who underwent SG between 2017 and 2020, with follow-up visits over 24 months. RESULTS:Non-Hispanic Black (NHB) participants had lower %TWL at 3, 12, and 24 months compared with Hispanic (H) and non-Hispanic White (NHW) participants. Fat mass index was initially lower in NHB, with smaller reductions over time and significant group differences persisting at 24 months. NHB participants had higher baseline fat-free mass index values; by 24 months, fat-free mass index values were lower in H participants. Hemoglobin A1c decreased across all groups but remained consistently higher in NHB and H compared with NHW at 24 months. NHB participants reported higher perceived discrimination, sleep disturbance, and perceived stress than H and NHW participants at all time points. Employment status predicted %TWL at 12 months. There was a significant interaction between race and ethnicity and employment status observed at 12 and 24 months, suggesting that employment-related disparities could impact surgical outcomes. CONCLUSIONS:NHB participants experienced less favorable outcomes following SG, emphasizing the need for tailored interventions addressing socioeconomic and psychosocial disparities.

OBJECTIVE:Racial implicit bias may contribute to health disparities in juvenile idiopathic arthritis (JIA) outcomes by impacting provider medical decision-making. Our study assessed racial and racial-medical compliance implicit biases of an international pediatric rheumatology community and investigated whether their biases impact treatment recommendations for patients with JIA. METHODS:A web-based survey, which included a randomized vignette describing either a White or Black patient with JIA, was sent to pediatric rheumatology providers. Participants were prompted to select the best patient management option and to complete two implicit association tests (IATs): race and race compliance. Student's t-tests or analysis of variance were used to compare IAT D-scores between or across groups; all tests were two-sided with P < 0.05 considered statistically significant. Logistic regression models were used to examine associations for two outcomes of interest: recommendation of either adequate (methotrexate monotherapy) or aggressive (methotrexate and adalimumab combination) treatment with each IAT D-score by each vignette. RESULTS:Overall, 165 pediatric rheumatologists completed the survey. Providers showed a slight pro-White bias in the race IAT (mean D-score ± SD 0.26 ± 0.5) and race-medical compliance IAT (mean D-score ± SD 0.16 ± 0.43). Although not statistically significant, a one-point increase in IAT D-scores was associated with a lower likelihood that providers would choose aggressive treatment versus adequate treatment in the Black vignette (odds ratio [OR] 0.55, 95% confidence interval [CI] 0.20-1.47; P = 0.23), and a greater likelihood that providers would choose aggressive treatment in the White vignette (OR 4.07, 95% CI 0.74-22.24; P = 0.11). CONCLUSION/CONCLUSIONS:Implicit bias was not associated with treatment recommendations. Further studies are needed to better evaluate the impact of implicit bias.