Faculty Bibliography

PURPOSE: Usability evaluations can improve the usability and workflow integration of clinical decision support (CDS). Traditional usability testing using scripted scenarios with think-aloud protocol analysis provide a useful but incomplete assessment of how new CDS tools interact with users and clinical workflow. "Near-live" clinical simulations are a newer usability evaluation tool that more closely mimics clinical workflow and that allows for a complementary evaluation of CDS usability as well as impact on workflow. METHODS: This study employed two phases of testing a new CDS tool that embedded clinical prediction rules (an evidence-based medicine tool) into primary care workflow within a commercial electronic health record. Phase I applied usability testing involving "think-aloud" protocol analysis of 8 primary care providers encountering several scripted clinical scenarios. Phase II used "near-live" clinical simulations of 8 providers interacting with video clips of standardized trained patient actors enacting the clinical scenario. In both phases, all sessions were audiotaped and had screen-capture software activated for onscreen recordings. Transcripts were coded using qualitative analysis methods. RESULTS: In Phase I, the impact of the CDS on navigation and workflow were associated with the largest volume of negative comments (accounting for over 90% of user raised issues) while the overall usability and the content of the CDS were associated with the most positive comments. However, usability had a positive-to-negative comment ratio of only 0.93 reflecting mixed perceptions about the usability of the CDS. In Phase II, the duration of encounters with simulated patients was approximately 12 min with 71% of the clinical prediction rules being activated after half of the visit had already elapsed. Upon activation, providers accepted the CDS tool pathway 82% of times offered and completed all of its elements in 53% of all simulation cases. Only 12.2% of encounter time was spent using the CDS tool. Two predominant clinical workflows, accounting for 75% of all cases simulations, were identified that characterized the sequence of provider interactions with the CDS. These workflows demonstrated a significant variation in temporal sequence of potential activation of the CDS. CONCLUSIONS: This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a new primary care CDS tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to refine both its usability and workflow integration. Synergistic use of "think-aloud" protocol analysis and "near-live" clinical simulations provide a robust assessment of how CDS tools would interact in live clinical environments and allows for enhanced early redesign to augment clinician utilization. The findings suggest the importance of using complementary testing methods before releasing CDS for live use.

Low medication adherence may explain part of the high prevalence of apparent treatment-resistant hypertension (aTRH). The authors assessed medication adherence and aTRH among 4026 participants taking >/= 3 classes of antihypertensive medication in the population-based Reasons for Geographic and Racial Differences in Stroke (REGARDS) trial using the 4-item Morisky Medication Adherence Scale (MMAS). Low adherence was defined as an MMAS score >/= 2. Overall, 66% of participants taking >/= 3 classes of antihypertensive medication had aTRH. Perfect adherence on the MMAS was reported by 67.8% and 70.9% of participants with and without aTRH, respectively. Low adherence was present among 8.1% of participants with aTRH and 5.0% of those without aTRH (P<.001). Among those with aTRH, female sex, residence outside the US stroke belt or stroke buckle, physical inactivity, elevated depressive symptoms, and a history of coronary heart disease were associated with low adherence. In the current study, a small percentage of participants with aTRH had low adherence.

OBJECTIVE: Diabetes incidence is increasing worldwide and providers often do not feel they can effectively counsel about preventive lifestyle changes. The goal of this paper is to describe the development and initial feasibility testing of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) program to enhance counseling about behavior change for patients with pre-diabetes. METHODS: Primary care providers and patients were interviewed about their perspectives on lifestyle changes to prevent diabetes. A multidisciplinary design team incorporated this data to translate elements from behavior change theories to create the ADAPT program. The ADAPT program was pilot tested to evaluate feasibility. RESULTS: Leveraging elements from health behavior theories and persuasion literature, the ADAPT program comprises a shared goal-setting module, implementation intentions exercise, and tailored reminders to encourage behavior change. Feasibility data demonstrate that patients were able to use the program to achieve their behavior change goals. CONCLUSION: Initial findings show that the ADAPT program is feasible for helping improve primary care providers' counseling for behavior change in patients with pre-diabetes. PRACTICE IMPLICATIONS: If successful, the ADAPT program may represent an adaptable and scalable behavior change tool for providers to encourage lifestyle changes to prevent diabetes.

Major depressive disorder (MDD) is prevalent in clinical weight-loss settings and predicts poor weight-loss outcomes. It is unknown whether the severity of depressive symptoms among those with MDD is associated with diet quality or physical activity levels. This knowledge is important for improving weight-loss treatment for these patients. It was hypothesized that more severe depression is associated with poorer diet quality and lower physical activity levels among individuals with obesity and MDD. Participants were 161 women with current MDD and obesity enrolled in the baseline phase of a weight-loss trial between 2007 and 2010. Depression severity was measured with the Beck Depression Inventory II. The Alternate Healthy Eating Index was applied to data from three 24-hour diet recalls to capture overall diet quality. Daily metabolic equivalents expended per day were calculated from three 24-hour physical activity recalls. Greater depression severity was associated with poorer overall diet quality (estimate=-0.26, standard error 0.11; P=0.02), but not with physical activity (estimate=0.07, standard error 0.05; P=0.18), in linear regression models controlling for income, education, depression-related appetite change, binge eating disorder, and other potential confounds. Associations with diet quality were primarily driven by greater intake of sugar (r=0.20; P<0.01), saturated fat (r=0.21; P<0.01), and sodium (r=0.22; P<0.01). More severe depression was associated with poorer overall diet quality, but not physical activity, among treatment-seeking women with MDD and obesity. Future studies should identify mechanisms linking depression to diet quality and determine whether diet quality improves with depression treatment.

The association between within-visit variability of systolic blood pressure (SBP) and diastolic blood pressure (DBP) and all-cause and cardiovascular (CVD) mortality was examined using the Third National Health and Nutrition Survey (n=15,317). Three SBP and DBP readings were taken by physicians during a single medical evaluation. Within-visit variability for each participant was defined using the standard deviation of SBP and DBP across these measurements. Mortality was assessed over 14 years (n=3848 and n=1684 deaths from all causes and CVD, respectively). After age, sex, and race-ethnicity adjustment, the hazard ratios (95% confidence intervals) for all-cause mortality associated with the 4 highest quintiles of within-visit standard deviation of SBP (2.00-2.99 mm Hg, 3.00-3.99 mm Hg, 4.00-5.29 mm Hg, and >/=5.30 mm Hg) compared with participants in the lowest quintile of within-visit standard deviation of SBP (<2.0 mm Hg) were 1.04 (0.87-1.26), 1.09 (0.92-1.29), 1.06 (0.88-1.28), and 1.13 (0.95-1.33), respectively (P=.136). The analogous hazard ratios for CVD mortality were 0.95 (0.69-1.32), 0.96 (0.67-1.36), 0.95 (0.74-1.23), and 1.04 (0.80-1.35), respectively (P=.566). No association with mortality was present after further adjustment and when modeling within-visit standard deviation of SBP as a continuous variable. Standard deviation of DBP was not associated with mortality.

BACKGROUND: Studies have shown that lifestyle behavior changes are most effective to prevent onset of diabetes in high-risk patients. Primary care providers are charged with encouraging behavior change among their patients at risk for diabetes, yet the practice environment and training in primary care often do not support effective provider counseling. The goal of this study is to develop an electronic health record-embedded tool to facilitate shared patient-provider goal setting to promote behavioral change and prevent diabetes. METHODS: The ADAPT (Avoiding Diabetes Thru Action Plan Targeting) trial leverages an innovative system that integrates evidence-based interventions for behavioral change with already-existing technology to enhance primary care providers' effectiveness to counsel about lifestyle behavior changes. Using principles of behavior change theory, the multidisciplinary design team utilized in-depth interviews and in vivo usability testing to produce a prototype diabetes prevention counseling system embedded in the electronic health record. RESULTS: The core element of the tool is a streamlined, shared goal-setting module within the electronic health record system. The team then conducted a series of innovative, "near-live" usability testing simulations to refine the tool and enhance workflow integration. The system also incorporates a pre-encounter survey to elicit patients' behavior-change goals to help tailor patient-provider goal setting during the clinical encounter and to encourage shared decision making. Lastly, the patients interact with a website that collects their longitudinal behavior data and allows them to visualize their progress over time and compare their progress with other study members. The finalized ADAPT system is now being piloted in a small randomized control trial of providers using the system with prediabetes patients over a six-month period. CONCLUSIONS: The ADAPT system combines the influential powers of shared goal setting and feedback, tailoring, modeling, contracting, reminders, and social comparisons to integrate evidence-based behavior-change principles into the electronic health record to maximize provider counseling efficacy during routine primary care clinical encounters. If successful, the ADAPT system may represent an adaptable and scalable technology-enabled behavior-change tool for all primary care providers. TRIAL REGISTRATION: ClinicalTrials.gov Identifier NCT01473654.

Background. East Harlem is an epicenter of the intertwining epidemics of obesity and diabetes in New York. Physical activity is thought to prevent and control a number of chronic illnesses, including diabetes, both independently and through weight control. Using data from a survey collected on adult (age 18+) residents of East Harlem, this study evaluated whether perceptions of safety and community-identified barriers were associated with lower levels of physical activity in a diverse sample. Methods. We surveyed 300 adults in a 2-census tract area of East Harlem and took measurements of height and weight. Physical activity was measured in two ways: respondents were classified as having met the weekly recommended target of 2.5 hours of moderate physical activity (walking) per week (or not) and reporting having engaged in at least one recreational physical activity (or not). Perceived barriers were assessed through five items developed by a community advisory board and perceptions of neighborhood safety were measured through an adapted 7-item scale. Two multivariate logistic regression models with perceived barriers and concerns about neighborhood safety were modeled separately as predictors of engaging in recommended levels of exercise and recreational physical activity, controlling for respondent weight and sociodemographic characteristics. Results. The most commonly reported perceived barriers to physical activity identified by nearly half of the sample were being too tired or having little energy followed by pain with exertion and lack of time. Multivariate regression found that individuals who endorsed a greater number of perceived barriers were less likely to report having met their weekly recommended levels of physical activity and less likely to engage in recreational physical activity controlling for covariates. Concerns about neighborhood safety, though prevalent, were not associated with physical activity levels. Conclusions. Although safety concerns were prevalent in this low-income, minority community, it was individual barriers that correlated with lower physical activity levels.