Faculty Bibliography

OBJECTIVES/OBJECTIVE:The study aimed to assess the usage and impact of a private and secure instance of a generative artificial intelligence (GenAI) application in a large academic health center. The goal was to understand how employees interact with this technology and the influence on their perception of skill and work performance. MATERIALS AND METHODS/METHODS:New York University Langone Health (NYULH) established a secure, private, and managed Azure OpenAI service (GenAI Studio) and granted widespread access to employees. Usage was monitored and users were surveyed about their experiences. RESULTS:Over 6 months, over 1007 individuals applied for access, with high usage among research and clinical departments. Users felt prepared to use the GenAI studio, found it easy to use, and would recommend it to a colleague. Users employed the GenAI studio for diverse tasks such as writing, editing, summarizing, data analysis, and idea generation. Challenges included difficulties in educating the workforce in constructing effective prompts and token and API limitations. DISCUSSION/CONCLUSIONS:The study demonstrated high interest in and extensive use of GenAI in a healthcare setting, with users employing the technology for diverse tasks. While users identified several challenges, they also recognized the potential of GenAI and indicated a need for more instruction and guidance on effective usage. CONCLUSION/CONCLUSIONS:The private GenAI studio provided a useful tool for employees to augment their skills and apply GenAI to their daily tasks. The study underscored the importance of workforce education when implementing system-wide GenAI and provided insights into its strengths and weaknesses.

BACKGROUND AND OBJECTIVES/OBJECTIVE:Healthcare is increasingly being delivered in the outpatient setting, but robust quality improvement programs and performance metrics are lacking in ambulatory care, particularly specialty-based ambulatory care. METHODS:To promote quality improvement in ambulatory care, we developed an infrastructure to create specialty-specific quality measures and dashboards that could be used to display providers' performance across relevant measures to individual providers and institutional leaders. RESULTS:The products of this program include a governance and infrastructure for specialty-specific ambulatory quality metrics as well as two distinct dashboards for data display. One dashboard is provider-facing, displaying provider's performance on specialty-specific measures as compared to institutional standards. The second dashboard is a leadership dashboard that provides overall and provider-level information on performance across measures. CONCLUSIONS:The Specialty-based Ambulatory Quality program reflects a systematic, institutionally-supported quality improvement framework that can be applied across diverse ambulatory specialties. As next steps, we plan to evaluate the program's impact on provider performance across measures and expand this program to other specialties practicing in the outpatient setting.

OBJECTIVES/OBJECTIVE: This study aimed to highlight the necessity of developing and implementing appropriate reference ranges for transgender and nonbinary (TGNB) patient populations to minimize misinterpretation of laboratory results and ensure equitable health care. CASE REPORT/METHODS: We describe a situation where a TGNB patient's abnormal laboratory values were not flagged due to undefined reference ranges for gender "X" in the Laboratory Information System (LIS). Implementation of additional reference ranges mapped to sex label "X" showed significant improvement in flagging abnormal lab results, utilizing sex-invariant reporting as an interim solution while monitoring developments on TGNB-specific reference ranges. CONCLUSION/CONCLUSIONS: Informatics professionals should assess their institution's policies for registration and lab reporting on TGNB patients as nonimplementation poses significant patient safety risks. Best practices include using TGNB-specific reference ranges emerging in the literature, reporting both male and female reference ranges for clinical interpretation and sex-invariant reporting.

We have entered a new age of health informatics—applied health informatics—where digital health innovation cannot be pursued without considering operational needs. In this new digital health era, creating an integrated applied health informatics system will be essential for health systems to achieve informatics healthcare goals. Integration of information technology (IT) and health informatics does not naturally occur without a deliberate and intentional shift towards unification. Recognizing this, NYU Langone Health’s (NYULH) Medical Center IT (MCIT) has taken proactive measures to vertically integrate academic informatics and operational IT through the establishment of the MCIT Department of Health Informatics (DHI). The creation of the NYULH DHI showcases the drivers, challenges, and ultimate successes of our enterprise effort to align academic health informatics with IT; providing a model for the creation of the applied health informatics programs required for academic health systems to thrive in the increasingly digitized healthcare landscape.

BACKGROUND:Healthcare crowdsourcing events (e.g. hackathons) facilitate interdisciplinary collaboration and encourage innovation. Peer-reviewed research has not yet considered a healthcare crowdsourcing event focusing on generative artificial intelligence (GenAI), which generates text in response to detailed prompts and has vast potential for improving the efficiency of healthcare organizations. Our event, the New York University Langone Health (NYULH) Prompt-a-thon, primarily sought to inspire and build AI fluency within our diverse NYULH community, and foster collaboration and innovation. Secondarily, we sought to analyze how participants' experience was influenced by their prior GenAI exposure and whether they received sample prompts during the workshop. METHODS:Executing the event required the assembly of an expert planning committee, who recruited diverse participants, anticipated technological challenges, and prepared the event. The event was composed of didactics and workshop sessions, which educated and allowed participants to experiment with using GenAI on real healthcare data. Participants were given novel "project cards" associated with each dataset that illuminated the tasks GenAI could perform and, for a random set of teams, sample prompts to help them achieve each task (the public repository of project cards can be found at https://github.com/smallw03/NYULH-Generative-AI-Prompt-a-thon-Project-Cards). Afterwards, participants were asked to fill out a survey with 7-point Likert-style questions. RESULTS:Our event was successful in educating and inspiring hundreds of enthusiastic in-person and virtual participants across our organization on the responsible use of GenAI in a low-cost and technologically feasible manner. All participants responded positively, on average, to each of the survey questions (e.g., confidence in their ability to use and trust GenAI). Critically, participants reported a self-perceived increase in their likelihood of using and promoting colleagues' use of GenAI for their daily work. No significant differences were seen in the surveys of those who received sample prompts with their project task descriptions. CONCLUSION/CONCLUSIONS:The first healthcare Prompt-a-thon was an overwhelming success, with minimal technological failures, positive responses from diverse participants and staff, and evidence of post-event engagement. These findings will be integral to planning future events at our institution, and to others looking to engage their workforce in utilizing GenAI.

Electronic health records have become an integral part of modern health care, but their implementation has led to unintended consequences, such as poor note quality. This case study explores how NYU Langone Health leveraged artificial intelligence (AI) to address the challenge to improve the content and quality of medical documentation. By quickly and accurately analyzing large volumes of clinical documentation and providing feedback to organizational leadership and individually to providers, AI can help support a culture of continuous note quality improvement, allowing organizations to enhance a critical component of patient care.

BACKGROUND:Diabetes mellitus is a common medical complication of pregnancy, and its treatment is complex. Recent years have seen an increase in the application of mobile health tools and advanced technologies, such as remote patient monitoring, with the aim of improving care for diabetes mellitus in pregnancy. Previous studies of these technologies for the treatment of diabetes in pregnancy have been small and have not clearly shown clinical benefit with implementation. OBJECTIVE:Remote patient monitoring allows clinicians to monitor patients' health data (such as glucose values) in near real-time, between office visits, to make timely adjustments to care. Our objective was to determine if using remote patient monitoring for the management of diabetes in pregnancy leads to an improvement in maternal and neonatal outcomes. STUDY DESIGN/METHODS:This was a retrospective cohort study of pregnant patients with diabetes mellitus managed by the maternal-fetal medicine practice at one academic institution between October 2019 and April 2021. This practice transitioned from paper-based blood glucose logs to remote patient monitoring in February 2020. Remote patient monitoring options included (1) device integration with Bluetooth glucometers that automatically uploaded measured glucose values to the patient's Epic MyChart application or (2) manual entry in which patients manually logged their glucose readings into their MyChart application. Values in the MyChart application directly transferred to the patient's electronic health record for review and management by clinicians. In total, 533 patients were studied. We compared 173 patients managed with paper logs to 360 patients managed with remote patient monitoring (176 device integration and 184 manual entry). Our primary outcomes were composite maternal morbidity (which included third- and fourth-degree lacerations, chorioamnionitis, postpartum hemorrhage requiring transfusion, postpartum hysterectomy, wound infection or separation, venous thromboembolism, and maternal admission to the intensive care unit) and composite neonatal morbidity (which included umbilical cord pH <7.00, 5 minute Apgar score <7, respiratory morbidity, hyperbilirubinemia, meconium aspiration, intraventricular hemorrhage, necrotizing enterocolitis, sepsis, pneumonia, seizures, hypoxic ischemic encephalopathy, shoulder dystocia, trauma, brain or body cooling, and neonatal intensive care unit admission). Secondary outcomes were measures of glycemic control and the individual components of the primary composite outcomes. We also performed a secondary analysis in which the patients who used the two different remote patient monitoring options (device integration vs manual entry) were compared. Chi-square, Fisher's exact, 2-sample t, and Mann-Whitney tests were used to compare the groups. A result was considered statistically significant at P<.05. RESULTS:Maternal baseline characteristics were not significantly different between the remote patient monitoring and paper groups aside from a slightly higher baseline rate of chronic hypertension in the remote patient monitoring group (6.1% vs 1.2%; P=.011). The primary outcomes of composite maternal and composite neonatal morbidity were not significantly different between the groups. However, remote patient monitoring patients submitted more glucose values (177 vs 146; P=.008), were more likely to achieve glycemic control in target range (79.2% vs 52.0%; P<.0001), and achieved the target range sooner (median, 3.3 vs 4.1 weeks; P=.025) than patients managed with paper logs. This was achieved without increasing in-person visits. Remote patient monitoring patients had lower rates of preeclampsia (5.8% vs 15.0%; P=.0006) and their infants had lower rates of neonatal hypoglycemia in the first 24 hours of life (29.8% vs 51.7%; P<.0001). CONCLUSION/CONCLUSIONS:Remote patient monitoring for the management of diabetes mellitus in pregnancy is superior to a traditional paper-based approach in achieving glycemic control and is associated with improved maternal and neonatal outcomes.