Faculty Bibliography

BACKGROUND:Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment. OBJECTIVE:This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context. METHODS:This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants' comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes. RESULTS:In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients' clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions. CONCLUSIONS:Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task.

OBJECTIVE:We conducted pre-deployment usability testing and semi-structured group interviews at 6 months post-deployment with 75 providers at 14 intervention clinics across the two sites to collect user feedback. Qualitative data analysis is bifurcated into immediate and delayed stages; we reported on immediate-stage findings from real-time field notes used to generate a set of rapid, pragmatic recommendations for iterative refinement. Monthly utilization rates were calculated and examined over 12 months. RESULTS:We hypothesized a well-validated, user-centered clinical decision support tool would lead to relatively high adoption rates. Then 6 months post-deployment, integrated clinical prediction rule study tool utilization rates were substantially lower than anticipated based on the original integrated clinical prediction rule study trial (68%) at 17% (Health System A) and 5% (Health System B). User feedback at 6 months resulted in recommendations for tool refinement, which were incorporated when possible into tool design; however, utilization rates at 12 months post-deployment remained low at 14% and 4% respectively. DISCUSSION/CONCLUSIONS:Although valuable, findings demonstrate the limitations of a user-centered approach given the complexity of clinical decision support. CONCLUSION/CONCLUSIONS:Strategies for addressing persistent external factors impacting clinical decision support adoption should be considered in addition to the user-centered design and implementation of clinical decision support.

Background/UNASSIGNED:Current guidelines recommend less aggressive target hemoglobin A1c (HbA1c) levels based on older age and lower life expectancy for older adults with diabetes. The effectiveness of electronic health record (EHR) clinical decision support (CDS) in promoting guideline adherence is undermined by alert fatigue and poor workflow integration. Integrating behavioral economics (BE) and CDS tools is a novel approach to improving adherence to guidelines while minimizing clinician burden. Methods/UNASSIGNED: = 8), (2) a 2-h, design-thinking workshop to derive and refine initial module ideas, and (3) semi-structured group interviews at each site with clinic leaders and clinicians to elicit feedback on three proposed nudge module components (navigator section, inbasket refill protocol, medication preference list). Detailed field notes will be summarized by module idea and usability theme for rapid iteration. Frequency of firing and user action taken will be assessed in the first month of implementation via EHR reporting to confirm that module components and related reporting are working as expected as well as assess utilization. To assess the utilization and feasibility of the new tools and generate estimates of clinician compliance with the Choosing Wisely guideline for diabetes management in older adults, a 6-month, single-arm pilot study of the BE-EHR module will be conducted in six outpatient primary care clinics. Discussion/UNASSIGNED:We hypothesize that a low burden, user-centered approach to design will yield a BE-driven, CDS module with relatively high utilization by clinicians. The resulting module will establish a platform for exploring the ability of BE concepts embedded within the EHR to affect guideline adherence for other use cases.

Academic medical centers (AMCs) today prioritize digital innovation. In efforts to develop and disseminate the best technology for their institutions, challenges arise in organizational structure, cross-disciplinary collaboration, and creative and agile problem solving that are essential for successful implementation. To address these challenges, the Digital DesignLab was created at NYU Langone Health to provide structured processes for assessing and supporting the capacity for innovative digital development in our research and clinical community. Digital DesignLab is an enterprise level, multidisciplinary, digital development team that guides faculty and student innovators through a digital development "pipeline", which consists of intake, discovery, bootcamp, development. It also provides a framework for digital health innovation and dissemination at the institution. This paper describes the Digital DesignLab's creation and processes, and highlights key lessons learned to support digital health innovation at AMCs.

Background: The burden of mental, neurological, and substance (MNS) disorders is greater in low- and middle-income countries (LMICs). The rapid growth of digital health (i.e., eHealth) approaches offer new solutions for transforming pediatric mental health services and have the potential to address multiple resource and system barriers. However, little work has been done in applying eHealth to promote young children's mental health in LMICs. It is also not clear how eHealth has been and might be applied to translating existing evidence-based practices/strategies (EBPs) to enable broader access to child mental health interventions and services. Methods: A scoping review was conducted to summarize current eHealth applications and evidence in child mental health. The review focuses on 1) providing an overview of existing eHealth applications, research methods, and effectiveness evidence in child mental health promotion (focused on children of 0-12 years of age) across diverse service contexts; and 2) drawing lessons learned from the existing research about eHealth design strategies and usability data in order to inform future eHealth design in LMICs. Results: Thirty-two (32) articles fitting our inclusion criteria were reviewed. The child mental health eHealth studies were grouped into three areas: i) eHealth interventions targeting families that promote child and family wellbeing; ii) eHealth for improving school mental health services (e.g., promote school staff's knowledge and management skills); and iii) eHealth for improving behavioral health care in the pediatric care system (e.g., promote use of integrated patient-portal and electronic decision support systems). Most eHealth studies have reported positive impacts. Although most pediatric eHealth studies were conducted in high-income countries, many eHealth design strategies can be adapted and modified to fit LMIC contexts. Most user-engagement strategies identified from high-income countries are also relevant for populations in LMICs. Conclusions: This review synthesizes patterns of eHealth use across a spectrum of individual/family and system level of eHealth interventions that can be applied to promote child mental health and strengthen mental health service systems. This review also summarizes critical lessons to guide future eHealth design and delivery models in LMICs. However, more research in testing combinations of eHealth strategies in LMICs is needed.

BACKGROUND:Design thinking and human-centered design approaches have become increasingly common in health care literature, particularly in relation to health information technology (HIT), as a pathway toward the development of usable, diffusible tools and processes. There is a need in academic medical centers tasked with digital innovation for a comprehensive process model to guide development that incorporates current industry trends, including design thinking and lean and agile approaches to digital development. OBJECTIVE:This study aims to describe the foundations and phases of our model for user-centered HIT development. METHODS:Based on our experience, we established an integrated approach and rigorous process for HIT development that leverages design thinking and lean and agile strategies in a pragmatic way while preserving methodological integrity in support of academic research goals. RESULTS:A four-phased pragmatic process model was developed for user-centered digital development in HIT. CONCLUSIONS:The model for user-centered HIT development that we developed is the culmination of diverse innovation projects and represents a multiphased, high-fidelity process for making more creative, flexible, efficient, and effective tools. This model is a critical step in building a rigorous approach to HIT design that incorporates a multidisciplinary, pragmatic perspective combined with academic research practices and state-of-the-art approaches to digital product development to meet the unique needs of health care.

We integrated and optimized patient-reported outcome measures into the electronic health record to provide quantitative, objective data regarding patients' health status, which is important for patient care, payer contracts, and research. With a multidisciplinary team from information technology, clinical informatics, population health, and physician champions, we used formal human-computer interaction techniques and user-centered design to integrate several technology platforms and computerized adaptive testing for the National Institutes of Health Patient-Reported Outcomes Measurement Information System. The patient-reported outcome measure system leverages software frequently used by health systems and provides data for research and clinical care via a mobile-responsive web application using Symfony, with REDCap for configuring assessments and de-identified data storage. The system incorporates Oracle databases and Epic flowsheets. Patients complete patient-reported outcome measures, with data viewable in MyChart and Epic Synopsis Reports. Researchers can access data portals. The highly usable, successful patient-reported outcome measures platform is acceptable to patients and clinicians and achieved 73 percent overall completion rates.