Faculty Bibliography

BACKGROUND: Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate. METHODS/DESIGN: Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study. DISCUSSION: Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector.

OBJECTIVE: To review recent health policies related to measuring child health care quality, the selection processes of national child health quality measures, the nationally recommended quality measures for child mental health care and their evidence strength, the progress made toward developing new measures, and early lessons learned from these national efforts. METHODS: Methods used included description of the selection process of child health care quality measures from 2 independent national initiatives, the recommended quality measures for child mental health care, and the strength of scientific evidence supporting them. RESULTS: Of the child health quality measures recommended or endorsed during these national initiatives, only 9 unique measures were related to child mental health. CONCLUSIONS: The development of new child mental health quality measures poses methodologic challenges that will require a paradigm shift to align research with its accelerated pace.

Sweeping and profound structural, regulatory, and fiscal changes are rapidly reshaping the contours of health and mental health practice. The community-based practice contexts described in the excellent review by Garland and colleagues are being fundamentally altered with different business models, regional networks, accountability standards, and incentive structures. If community-based mental health services are to remain viable, the two-dimensional and flat research and practice paradigm has to be replaced with three-dimensional thinking. Failure to take seriously the changes that are happening to the larger healthcare context and respond actively through significant system redesign will lead to the demise of specialty mental health services.

OBJECTIVE: Child mental health treatment and services research yields more immediate public health benefit when they focus on outcomes of relevance to a broader group of stakeholders. We reviewed all experimental studies of child and adolescent treatment and service effectiveness published in the last 15 years (1996-2011) and compared the distribution and types of outcome domains to a prior review that focused on studies from the prior 15 years (1980-1995). METHOD: Studies were included if they focused on children from birth to 18 years of age with specific or general psychiatric conditions, employed randomized designs, and examined intervention effects with a six-month or longer post-treatment assessment in treatment studies or a 6-month or longer post-baseline assessment for services studies. Two hundred (n=200) studies met criteria. Reported outcome measures were coded into conceptual categories drawn from the 1980-1995 review. RESULTS: There was a five-fold increase in the total number of studies (38 versus 200) across the two 15-year time periods, with the largest increase in the number of studies that focused on consumer-oriented outcomes (from eight to 47 studies, an almost sixfold increase); two new domains, parent symptoms and health-related outcomes, were identified. The majority of studies (more than 95%) continued to focus on symptoms and diagnoses as an outcome. Impact ratings were higher among studies examining four or more outcomes versus one to two outcomes in all categories with the exception of Posttraumatic Stress Disorder. CONCLUSIONS: Given major shifts in health care policy affecting mental health services, the emergence of health and parent-related outcomes as well as greater attention to consumer perspectives parallels emerging priorities in health care and can enhance the relevance of child outcome studies for implementation in the real world.

ABSTBACKGROUND: Evidence-based practices have not been routinely adopted in community mental health organizations despite the support of scientific evidence and in some cases even legislative or regulatory action. We examined the association of clinician attitudes toward evidence-based practice with organizational culture, climate, and other characteristics in a nationally representative sample of mental health organizations in the United States. METHODS: In-person, group-administered surveys were conducted with a sample of 1,112 mental health service providers in a nationwide sample of 100 mental health service institutions in 26 states in the United States. The study examines these associations with a two-level Hierarchical Linear Modeling (HLM) analysis of responses to the Evidence-Based Practice Attitude Scale (EBPAS) at the individual clinician level as a function of the Organizational Social Context (OSC) measure at the organizational level, controlling for other organization and clinician characteristics. RESULTS: We found that more proficient organizational cultures and more engaged and less stressful organizational climates were associated with positive clinician attitudes toward adopting evidence-based practice. CONCLUSIONS: The findings suggest that organizational intervention strategies for improving the organizational social context of mental health services may contribute to the success of evidence-based practice dissemination and implementation efforts by influencing clinician attitudes.

Treatment participation was examined among youth enrolled in an evaluation of cognitive behavioral therapy (CBT) for trauma following the 9/11 World Trade Center disaster. Staff at nine agencies serving a predominantly low-income ethnically diverse population were trained to deliver CBT and structured engagement strategies. Four hundred and forty-five youth ages 5-19 were eligible for CBT, and 417 (94%) received at least one treatment session. Pretreatment and treatment show rates and overall dose were examined. Treatment participation rates were higher than those typically reported in community studies of children's mental health services. Regression analyses indicated variability across sites in treatment show rates with the highest rates at where services were delivered in schools. However, sites, demographic factors and trauma symptoms accounted for a small amount of variance in treatment participation overall. The study suggests structured engagement strategies, linked to evidence-based treatments may improve treatment participation for youth.

This brief report describes results from an evaluation of NAMI Basics, a peer-delivered family education program for family caregivers of children and adolescents with mental illness. Over six classes, family members are given information (e.g. education about mental illness and treatments), skills training (e.g. family communication skills) and advocacy support. We report data from 36 caregivers who completed pre and posttest instruments measuring self-care, empowerment, and family problem-solving and communication skills. Results showed significant improvements in self-care, empowerment, and "incendiary" family communication after participation in the program. Results suggest that NAMI Basics may improve both parental functioning and familial processes. Implications and future directions are discussed.

Professional family peer advocates are increasingly employed by public mental health systems to deliver family-to-family support that reduces barriers families face in accessing children's mental health care. These services, however, are neither uniformly available nor standardized. This pilot study describes the process, content and context of family-to-family support services. Simulating a parent seeking services, a trained standardized parent participated as a client in meetings with advocates in four programs and collected data through structured observations, a structured survey, and session audiotapes. The "walk-through" process was determined to be feasible and acceptable to family peer advocates as a way of evaluating services. Four family peer advocates provided an average of 25 services during each 2-session simulation with the standardized parent, including the following: information and educational support, instruction and skills development, emotional and affirmational support, instrumental support, and advocacy. Findings also revealed variability in the range of services provided and identified challenges in aspects of service provision, such as boundaries of advocate roles, availability of confidential service environments, and addressing crises and parent concerns about child safety. This paper provides the first in-depth look at services provided by this emerging workforce.

We conducted a review of empirically based prevention programs to identify prevalence and types of family support services within these programs. A total of 238 articles published between 1990 and 2011 that included a family support component were identified; 37 met criteria for inclusion. Following the Institute of Medicine's typology, prevention programs were categorized as universal, selective, or indicated; programs containing more than one prevention level were characterized as multi-level. Family support types included those led by a mental health professional, led by a peer, or team-led. Among the 37 prevention programs reviewed, 27% (n=10) were universal, 41% (n=15) were selective, 16% (n=6) were indicated, and 16% (n=6) were multi-level. The predominant model of family support was professionally led (95%, n=35). Two (n=5%) provided team-led services. None were purely peer-led. In terms of content of family support services, all (100%, n=37) provided instruction/skill build. Information and education was provided by 70% (n=26), followed by emotional support (n=11, 30%) and instrumental or concrete assistance (n=11, 30%). Only 14% (n=5) provided assistance with advocacy. The distribution of models and content of services in prevention studies differ from family support within treatment studies. As family support is likely to be an enduring component of the child and family mental health service continuum, comparative effectiveness studies are needed to inform future development.