Journal of the American Academy of Child & Adolescent Psychiatry
INVITED COLUMN: EVIDENCE-BASED PRACTICEGetting Better at Getting Them Better: Health Outcomes and Evidence-Based Practice Within a System of Care
Section snippets
HAWAII's EVIDENCE-BASED SERVICES INITIATIVE FOR YOUTHS
Hawaii has implemented a diverse and far-reaching evidence-based services initiative that incorporates a wide variety of quality improvement activities (Daleiden and Chorpita, 2005). The initiative may be broadly characterized as a two-pronged strategy: first, building specific empirically supported programs and second, pursuing incremental improvement of current care toward evidence-based ideals. The former strategy involves identifying, selecting, and implementing specific evidence-based
SYSTEM EVALUATION AND OUTCOMES
Procedures for evaluating the Hawaii system of care for youths have evolved over the years, so long-term, well-validated child and system status measures that clearly map the course of the transformation are not available. Nevertheless, progressive information from each of the reform eras can be illuminating. Among the earliest and most enduring evaluation procedures were child and system quality reviews performed by interagency monitoring teams. Trained monitoring teams of parents and
YOUTH STATUS AT A POINT IN TIME
Examination of this interagency review-based child status indicator reveals a general pattern of improvement across the 10 years of reform with a slight discontinuity when the sampling procedures changed (Fig. 1). The most rapid improvement occurred during the middle years of the reform, and the ratings have stabilized in recent years at a high level. It is not clear why the change in random sampling procedures resulted in a lower point estimate. It is possible that the stratification and
YOUTH STATUS AT INTAKE AND DISCHARGE
To better understand quantitative outcomes, the CAMHD implemented a policy of quarterly assessment using the Child and Adolescent Functional Assessment Scale (CAFAS; Hodges, 1998), the Child and Adolescent Level of Care Utilization System (CALOCUS; American Academy of Child and Adolescent Psychiatry Work Group on Systems of Care and American Association of Community Psychiatrists, 1999), and the parent, teacher, and youth report forms of the Achenbach System of Empirically Based Assessment
RATE OF CHANGE IN YOUTH STATUS
Findings indicated a pattern of progressive acceleration in the rate at which youths were improving (Fig. 2). Linear trend analysis indicated that the median rate of change was significantly accelerating across quarters, t14 = −9.65, p <.001, R2 = 0.87. In other words, the CAMHD system appeared to be getting better at getting youths better. The median rate of improvement nearly tripled during the 4-year period, whereas the mean rate approximately doubled. Although not depicted here, similar
CLOSING COMMENTS
A variety of qualitative and quantitative evidence indicates that the Hawaii system of care for youths has improved dramatically during the past decade. Numerous system restructuring and quality improvement activities were implemented during this period. The historical analysis presented here does not allow for attributing the cause of change to any specific initiative. However, these findings are consistent with the conclusion that efforts to implement evidence-based services, to develop care
REFERENCES (15)
- et al.
From data to wisdom: quality improvement strategies supporting large-scale implementation of evidence based services
Child Adolesc Psychiatr Clin N Am
(2005) - et al.
Manual for the ASEBA School-age Forms and Profiles
(2001) - et al.
Child and Adolescent Level of Care Utilization System (CALOCUS) User's Manual, Version 1.1
(1999) - et al.
Using a specialized foster care community treatment model for children and adolescents leaving the state mental hospital
J Community Psychol
(1991) Child and adolescent mental health services: strategic plan 2003-2006
Evidence based services committee biennial report
- et al.
Identifying and selecting the common elements of evidence-based practice: a distillation and matching model
Ment Health Serv Res
(2005)
Cited by (88)
Evaluation of a systems-level technical assistance program to support youth with complex behavioral health needs
2022, Evaluation and Program PlanningProcess, practices, and outcomes of trauma-focused services in a statewide treatment foster care program
2021, Children and Youth Services ReviewBehavioral treatments
2018, Developmental Pathways to Disruptive, Impulse-Control, and Conduct DisordersCompetency Guidelines for Family Collaboration in Behavioral Health Services for Adolescents
2024, Contemporary Family TherapyTreatment Focus Diffusion is Associated with Long-term Outcomes in Youth Public Mental Health Care
2023, Journal of Child and Family StudiesTreatment of complex PTSD with STAIR/narrative therapy
2022, Trauma Sequelae
This project was funded with state general funds through the Hawaii Department of Health Child and Adolescent Mental Health Division. The findings described in this column were produced through the collaborative efforts of countless youths, families, and professionals who contribute to the Hawaii system of care for child and adolescent mental health.
Disclosure: Drs. Daleiden and Chorpita and Ms. Brogan benefit from consulting related to evidence-based services and health systems development. Dr. Daleiden is a consultant to Starboard Capital, Inc., and Real Time Engines, LLC. Dr. Chorpita is president of PracticeWise, LLC. Ms. Brogan is a consultant to Human Systems and Outcomes, Inc. The other authors have no financial relationships to disclose.