Faculty Bibliography

Optimal design has been an under-utilized methodology. However, it has significant real-world applications, particularly in mixed methods implementation research. We review the concept and demonstrate how it can be used to assess the sensitivity of design decisions and balance competing needs. For observational studies, this methodology enables selection of the most informative study units. For experimental studies, it entails selecting and assigning study units to intervention conditions in the most informative manner. We blend optimal design methods with purposeful sampling to show how these two concepts balance competing needs when there are multiple study aims, a common situation in implementation research.

Integrating two distinct and complementary paradigms, science and engineering, may produce more effective outcomes for the implementation of evidence-based practices in health care settings. Science formalizes and tests innovations, whereas engineering customizes and optimizes how the innovation is applied tailoring to accommodate local conditions. Together they may accelerate the creation of an evidence-based healthcare system that works effectively in specific health care settings. We give examples of applying engineering methods for better quality, more efficient, and safer implementation of clinical practices, medical devices, and health services systems. A specific example was applying systems engineering design that orchestrated people, process, data, decision-making, and communication through a technology application to implement evidence-based depression care among low-income patients with diabetes. We recommend that leading journals recognize the fundamental role of engineering in implementation research, to improve understanding of design elements that create a better fit between program elements and local context.

Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings.

PURPOSE: Untreated parent mental health problems have deleterious effects upon the family, yet caregivers are unlikely to receive services for their emotional health. We conducted a review of treatments and services for children and adolescents that also offered services to parents. METHODS: Child treatment and service studies were included in the present study if they analyzed parent symptoms or diagnoses over time, and the intervention contained a parent component. RESULTS: Of 200 studies reviewed, 20 contained a component for the parent and assessed the parent's emotional health at multiple time points. Depression and anxiety were the most commonly studied parental mental health problem; most parent components consisted of behavioral strategies in service of the child's psychological health. CONCLUSION: Major shifts in health care policy affecting mental health services provide an opportunity to create integrated and coordinated health and behavioral health systems. Attention must be given to ensure that the workforce of providers, the administrative structures, and the reimbursement strategies are strengthened and connected to serve the needs of parents/caregivers and children in order to enhance family outcomes.

Building on a narrative synthesis of adoption theories by Wisdom et al. (2013), this review identifies 118 measures associated with the 27 adoption predictors in the synthesis. The distribution of measures is uneven across the predictors and predictors vary in modifiability. Multiple dimensions and definitions of predictors further complicate measurement efforts. For state policymakers and researchers, more effective and integrated measurement can advance the adoption of complex innovations such as evidence-based practices.

The purpose of this study was to determine the benefits of a multiple family group (MFG) service delivery model compared with services as usual (SAU) in improving the functioning of youth with oppositional defiant/conduct disorder in families residing in socioeconomically disadvantaged communities. Participants included 320 youth aged 7 to 11 and their families who were referred to participating outpatient clinics. Participants were assigned to the MFG or the SAU condition, with parent report of child oppositional behavior, social competence, and level of youth impairment as primary outcomes at post-treatment. Family engagement to MFG was measured by attendance to each group session. Caregivers of youth in the MFG service delivery model condition reported significant improvement in youth oppositional behavior and social competence compared with youth in the SAU condition. Impairment improved over time for both groups with no difference between treatment conditions. The MFG led to greater percentage of youth with clinically significant improvements in oppositional behavior. Attendance to the MFG was high, given the high-risk nature of the study population. The MFG service delivery model offers an efficient and engaging format to implement evidence-based approaches to improving functioning of youth with oppositional defiant and/or conduct disorder in families from socioeconomically disadvantaged communities.

Objective: Characteristics associated with participation in training in evidence-informed business and clinical practices by 346 outpatient mental health clinics licensed to treat youths in New York State were examined. Methods: Clinic characteristics extracted from state administrative data were used as proxies for variables that have been linked with adoption of innovation (extraorganizational factors, agency factors, clinic provider-level profiles, and clinic client-level profiles). Multiple logistic regression models were used to assess the independent effects of theoretical variables on the clinics' participation in state-supported business and clinical trainings between September 2011 and August 2013 and on the intensity of participation (low or high). Interaction effects between clinic characteristics and outcomes were explored. Results: Clinic characteristics were predictive of any participation in trainings but were less useful in predicting intensity of participation. Clinics affiliated with larger (adjusted odds ratio [AOR]=.65, p<.01), more efficient agencies (AOR=.62, p<.05) and clinics that outsourced more clinical services (AOR=.60, p<.001) had lower odds of participating in any business-practice trainings. Participation in business trainings was associated with interaction effects between agency affiliation (hospital or community) and clinical staff capacity. Clinics with more full-time-equivalent clinical staff (AOR=1.52, p<.01) and a higher proportion of clients under age 18 (AOR=1.90, p<.001) had higher odds of participating in any clinical trainings. Participating clinics with larger proportions of youth clients had greater odds of being high adopters of clinical trainings (odds ratio=1.54, p<.01). Conclusions: Clinic characteristics associated with uptake of business and clinical training could be used to target state technical assistance efforts.

OBJECTIVE: The authors evaluated Project TEACH (PT), a statewide training and consultation program for pediatric primary care providers (PCPs) on identification and treatment of mental health conditions. METHODS: An intervention group of 176 PCPs who volunteered for PT training was compared with a stratified random sample of 200 PCPs who did not receive PT training. Data on prescription practices, diagnoses, and follow-up care were from New York State Medicaid files (2009-2013) for youths seen by the trained (N=21,784) and untrained (N=46,607) PCPs. RESULTS: The percentage of children prescribed psychotropic medication increased after PT training (9% to 12%, p<.001), a larger increase than in the untrained group (4% to 5%, p<.001) (comparison, p<.001). Fewer differences were noted in diagnoses and in medication use and follow-up care among children with depression. CONCLUSIONS: This intervention may have an impact on providers' behaviors, but further research is needed to clarify its effectiveness.

IMPORTANCE: Few studies have examined the effects of individual and organizational characteristics on the use of evidence-based practices in mental health care. Improved understanding of these factors could guide future implementation efforts to ensure effective adoption, implementation, and sustainment of evidence-based practices. OBJECTIVE: To estimate the relative contribution of individual and organizational factors on therapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques within the context of a large-scale effort to increase use of evidence-based practices in an urban public mental health system serving youth and families. DESIGN, SETTING, AND PARTICIPANTS: In this observational, cross-sectional study of 23 organizations, data were collected from March 1 through July 25, 2013. We used purposive sampling to recruit the 29 largest child-serving agencies, which together serve approximately 80% of youth receiving publically funded mental health care. The final sample included 19 agencies with 23 sites, 130 therapists, 36 supervisors, and 22 executive administrators. MAIN OUTCOMES AND MEASURES: Therapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques, as measured by the Therapist Procedures Checklist-Family Revised. RESULTS: Individual factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 16%; family therapy techniques, 7%; and psychodynamic therapy techniques, 20%. Organizational factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 23%; family therapy techniques, 19%; and psychodynamic therapy techniques, 7%. Older therapists and therapists with more open attitudes were more likely to endorse use of cognitive-behavioral therapy techniques, as were those in organizations that had spent fewer years participating in evidence-based practice initiatives, had more resistant cultures, and had more functional climates. Women were more likely to endorse use of family therapy techniques, as were those in organizations employing more fee-for-service staff and with more stressful climates. Therapists with more divergent attitudes and less knowledge about evidence-based practices were more likely to use psychodynamic therapy techniques. CONCLUSIONS AND RELEVANCE: This study suggests that individual and organizational factors are important in explaining therapist behavior and use of evidence-based practices, but the relative importance varies by therapeutic technique.