Are We on the Same Page? Therapist and Caregiver Agreement on Therapist Evidence-Based Strategy Use in Youth Mental Health

References

• Baldwin, S. A., Imel, Z. E., & Lambert, M. J. (2013). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 258–297). Wiley.
   Google Scholar
• Borntrager, C. F., Chorpita, B. F., Orimoto, T., Love, A., & Mueller, C. W. (2015). Validity of clinician’s self-reported practice elements on the monthly treatment and progress summary. The Journal of Behavioral Health Services & Research, 42(3), 367–382. https://doi.org/10.1007/s11414-013-9363-x
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Baker-Ericzén, M., Stadnick, N., & Taylor, R. (2012). Parent perspectives on community mental health services for children with autism spectrum disorders. Journal of Child and Family Studies, 21(4), 533–544. https://doi.org/10.1007/s10826-011-9506-8
   Web of Science ®Google Scholar
• Brookman-Frazee, L., Chlebowski, C., Villodas, M., Garland, A., McPherson, J., Koenig, Y., & Roesch, S. (2022). The effectiveness of training community mental health therapists in an evidence-based intervention for ASD: Findings from a hybrid effectiveness-implementation trial in outpatient and school-based mental health services. Autism, 26(3), 678–689. https://doi.org/10.1177/13623613211067844
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Chlebowski, C., Villodas, M., Roesch, S., & Martinez, K. (2021). Training community therapists to deliver a mental health intervention for ASD: Changes in caregiver outcomes and mediating role on child outcomes. Journal of the American Academy of Child and Adolescent Psychiatry. https://doi.org/10.1016/j.jaac.2020.07.896
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., & Drahota, A. (2010). An individualized mental health intervention for children with autism spectrum disorders (AIM HI): A model to address challenging behaviors in children with ASD—A therapist manual. University of California.
   Google Scholar
• Brookman-Frazee, L., Drahota, A., & Stadnick, N. (2012). Training community mental health therapists to deliver a package of evidence-based practice strategies for school-age children with autism spectrum disorders: A pilot study. Journal of Autism and Developmental Disorders, 42(8), 1651–1661. https://doi.org/10.1007/s10803-011-1406-7
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Drahota, A., Stadnick, N., & Palinkas, L. A. (2012). Therapist perspectives on community mental health services for children with autism spectrum disorders. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 365–373. https://doi.org/10.1007/s10488-011-0355-y
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Roesch, S., Chlebowski, C., Baker-Ericzen, M., & Ganger, W. (2019). Effectiveness of training therapists to deliver an individualized mental health intervention for children with autism spectrum disorder in publicly-funded mental health services: A cluster randomized trial. JAMA Psychiatry, 76(6), 574. https://doi.org/10.1001/jamapsychiatry.2019.0011
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Stadnick, N. A., Lind, T., Roesch, S., Terrones, L., Barnett, M. L., Regan, J., Kennedy, C. A., Garland, A. F., & Lau, A. S. (2021). Therapist-observer concordance in ratings of EBP strategy delivery: Challenges and targeted directions in pursuing pragmatic measurement in children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 48(1), 155–170. https://doi.org/10.1007/s10488-020-01054-x
   PubMed Web of Science ®Google Scholar
• Brookman-Frazee, L., Vismara, L., Drahota, A., Stahmer, A., & Openden, D. (2009). Parent training interventions for children with autism spectrum disorders. Applied Behavior Analysis for Children with Autism Spectrum Disorders, 237–257. https://doi.org/10.1007/978-1-4419-0088-3_14
   Google Scholar
• Burrell, T. L., & Borrego, J. (2012). Parents' involvement in ASD treatment: What is their role?. Cognitive and Behavioral Practice, 19(3), 423–432. https://doi.org/10.1016/j.cbpra.2011.04.003
   Web of Science ®Google Scholar
• Chapman, J. E., McCart, M. R., Letourneau, E. J., & Sheidow, A. J. (2013). Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of Consulting and Clinical Psychology, 81(4), 674–680. https://doi.org/10.1037/a0033021
   PubMed Web of Science ®Google Scholar
• Chapman, J. E., & Schoenwald, S. K. (2011). Ethnic similarity, therapist adherence, and long-term multisystemic therapy outcomes. Journal of Emotional and Behavioral Disorders, 19(1), 3–16. https://doi.org/10.1177/1063426610376773
   PubMed Web of Science ®Google Scholar
• Constantino, J., & Gruber, C. (2012). Social responsiveness scale: Second edition (SRS-2). Western Psychological Services.
   Google Scholar
• De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483–509. https://doi.org/10.1037/0033-2909.131.4.483
   PubMed Web of Science ®Google Scholar
• Dopp, A.R., Hanson, R.F., Saunders, B.E., Dismuke, C.E., & Moreland, A.D. (2017). Community-based implementation of trauma-focused interventions for youth: Economic impact of the learning collaborative model. Psychological Services, 14(1), 57–65.
   PubMed Web of Science ®Google Scholar
• Dowell, K. A., & Ogles, B. M. (2010). The effects of parent participation on child psychotherapy outcome: A meta-analytic review. Journal of Clinical Child & Adolescent Psychology, 39(2), 151–162. https://doi.org/10.1080/15374410903532585
   PubMed Web of Science ®Google Scholar
• Elliott, C. (2007). Differential Ability Scales-II (DAS-II). Pearson.
   Google Scholar
• Eyberg, S., & Pincus, D. (1999). Eyberg child behavior inventory and sutter-eyberg student behavior inventory-revised: Professional manual. Psychological Assessment Resources.
   Google Scholar
• Fawley-King, K., Haine-Schlagel, R., Trask, E. V., Zhang, J., & Garland, A. F. (2013). Caregiver participation in community-based mental health services for children receiving outpatient care. The Journal of Behavioral Health Services & Research, 40(2), 180–190. https://doi.org/10.1007/s11414-012-9311-1
   PubMed Web of Science ®Google Scholar
• Forman-Hoffman, V. L., Middleton, J. C., McKeeman, J. L., Stambaugh, L. F., Christian, R. B., Gaynes, B. N., Kane, H. L., Kahwati, L. C., Lohr, K. N., & Viswanathan, M. (2017). Quality improvement, implementation, and dissemination strategies to improve mental health care for children and adolescents: A systematic review. Implementation Science, 12(1), 93. https://doi.org/10.1186/s13012-017-0626-4
   PubMedGoogle Scholar
• Frank, H. E., Becker-Haimes, E. M., & Kendall, P. C. (2020). Therapist training in evidence‐based interventions for mental health: A systematic review of training approaches and outcomes. Clinical Psychology: Science and Practice, 27(3). https://doi.org/10.1111/cpsp.12330
   PubMed Web of Science ®Google Scholar
• Fung, J. J., & Lau, A. S. (2010). Factors associated with parent–child (dis)agreement on child behavior and parenting problems in Chinese immigrant families. Journal of Clinical Child & Adolescent Psychology, 39(3), 314–327. https://doi.org/10.1080/15374411003691693
   PubMed Web of Science ®Google Scholar
• Garland, A. F., Lewczyk-Boxmeyer, C. M., Gabayan, E. N., & Hawley, K. M. (2004). Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services, 55(6), 671–676. https://doi.org/10.1176/appi.ps.55.6.671
   PubMed Web of Science ®Google Scholar
• Haine-Schlagel, R., & Walsh, N. E. (2015). A review of parent participation engagement in child and Family Mental Health treatment. Clinical Child and Family Psychology Review, 18(2), 133–150. https://doi.org/10.1007/s10567-015-0182-x
   PubMed Web of Science ®Google Scholar
• Hawley, K. M., & Weisz, J. R. (2003). Child, parent and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70. https://doi.org/10.1037/0022-006x.71.1.62
   PubMed Web of Science ®Google Scholar
• Henggeler, S. W., Borduin, C. M., Schoenwald, S. K., Huey, S. J., & Chapman, J. E. (2006). Multisystemic therapy adherence scale—Revised (TAM-R). Department of Psychiatry & Behavioral Sciences, Medical University of South Carolina.
   Google Scholar
• Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance-abusing and -dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1(3), 171–184. https://doi.org/10.1023/A:1022373813261
   PubMedGoogle Scholar
• Henggeler, S. W., & Sheidow, A. J. (2012). Empirically supported family-based treatments for conduct disorder and delinquency in adolescents. Journal of Marital and Family Therapy, 38(1), 30–58. https://doi.org/10.1111/j.1752-0606.2011.00244.x
   PubMed Web of Science ®Google Scholar
• Hepner, K. A., Azocar, F., Greenwood, G. L., Miranda, J., & Burnam, M. A. (2010). Development of a clinician report measure to assess psychotherapy for depression in usual care settings. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 221–229. https://doi.org/10.1007/s10488-009-0249-4
   PubMed Web of Science ®Google Scholar
• Herschell, A. D., Quetsch, L. B., & Kolko, D. J. (2019). Measuring adherence to key teaching techniques in an evidence-based treatment: A comparison of caregiver, therapist, and behavior observation ratings. Journal of Emotional and Behavioral Disorders. https://doi.org/10.1177/1063426618821901
   Web of Science ®Google Scholar
• Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015). Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: Correspondence between therapists and observers. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 229–243. https://doi.org/10.1007/s10488-014-0548-2
   PubMed Web of Science ®Google Scholar
• Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 230–244. https://doi.org/10.1007/s10488-009-0251-x
   PubMed Web of Science ®Google Scholar
• Imel, Z. E., Baldwin, S. A., Baer, J. S., Hartzler, B., Dunn, C., Rosengren, D. B., & Atkins, D. C. (2014). Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients. Journal of Consulting and Clinical Psychology, 82(3), 472–481. https://doi.org/10.1037/a0036158
   PubMed Web of Science ®Google Scholar
• Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
   PubMed Web of Science ®Google Scholar
• Lau, A. S., & Brookman-Frazee, L. (2016). The 4KEEPS study: Identifying predictors of sustainment of multiple practices fiscally mandated in children’s mental health services. Implementation Science, 11(1), 31–38. https://doi.org/10.1186/s13012-016-0388-4
   PubMedGoogle Scholar
• Lau, A. S., Garland, A. F., Yeh, M., Mccabe, K. M., Wood, P. A., & Hough, R. L. (2004). Race/Ethnicity and inter-informant agreement in Assessing adolescent psychopathology. Journal of Emotional and Behavioral Disorders, 12(3), 145–156. https://doi.org/10.1177/10634266040120030201
   Web of Science ®Google Scholar
• Lind, T., Lau, A. S., Gomez, C., Rodriguez, A., Guan, K., Chlebowski, C., Zhang, A., Chorpita, B., & Brookman-Frazee, L. (2020). Emergent life events in the delivery of a caregiver-mediated evidence-based intervention for children with autism spectrum disorder in publicly funded mental health services. Autism, 24(5), 1286–1299. https://doi.org/10.1177/1362361319881084
   PubMed Web of Science ®Google Scholar
• Lord, C., Rutter, M., DiLavore, P.C., Risi, S., Gotham, K., & Bishop, S. L. (2012). Autism Diagnostic Observation Schedule, (ADOS 2). Torrance, CA: Western Psychological Services.
   Google Scholar
• Manassis, K. (2014). Case formulation with children and adolescents. Guilford Press.
   Google Scholar
• McNeil, C. B., & Hembree-Kligin, T. L. (2010). Intake assessment and therapy orientation session. In M. C. Roberts (Ed.), Parent-child interaction therapy (2nd ed., pp. 31–48). Springer.
   Google Scholar
• Meadan, H., Ostrosky, M. M., Triplett, B., Michna, A., & Fettig, A. (2011). Using visual supports with young children with autism spectrum disorder. TEACHING Exceptional Children, 43(6), 28–35. https://doi.org/10.1177/004005991104300603
   Google Scholar
• Miranda, J., Hepner, K. A., Azocar, F., Greenwood, G., Ngo, V., & Burnam, M. A. (2010). Development of a patient-report measure of psychotherapy for depression. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 245–253. https://doi.org/10.1007/s10488-009-0238-7
   PubMed Web of Science ®Google Scholar
• Reaven, J. (2011). The treatment of anxiety symptoms in youth with high-functioning autism spectrum disorders: Developmental considerations for parents. Brain Research, 1380, 255–263. https://doi.org/10.1016/j.brainres.2010.09.075
   PubMed Web of Science ®Google Scholar
• Regan, J. M. (2014). Client report of session content in an effectiveness trial: In search of efficient fidelity measurement. Los Angeles: University of California. http://www.escholarship.org/uc/item/2np6k11r
   Google Scholar
• Ros, R., Hernandez, J., Graziano, P. A., & Bagner, D. M. (2016). Parent training for children with or at risk for developmental delay: The role of parental homework completion. Behavior Therapy, 47(1), 1–13. https://doi.org/10.1016/j.beth.2015.08.004
   PubMed Web of Science ®Google Scholar
• Schoenwald, S. K., & Garland, A. F. (2013). A review of treatment adherence measurement methods. Psychological Assessment, 25(1), 146–156. https://doi.org/10.1037/a0029715
   PubMed Web of Science ®Google Scholar
• Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2010). Toward the effective and efficient measurement of Implementation Fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. https://doi.org/10.1007/s10488-010-0321-0
   Web of Science ®Google Scholar
• Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39(1), 83–103. https://doi.org/10.1111/j.1545-5300.2000.39109.x
   PubMed Web of Science ®Google Scholar
• Scudder, A., Wong, C., Ober, N., Hoffman, M., Toscolani, J., & Handen, B. L. (2019). Parent–child interaction therapy (PCIT) in young children with autism spectrum disorder. Child & Family Behavior Therapy, 41(4), 201–220. https://doi.org/10.1080/07317107.2019.1659542
   Web of Science ®Google Scholar
• Sheehan, D. V., Lecrubier, Y., & Sheehan, K. H. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry, 59(Suppl 20), 22–33.
   PubMed Web of Science ®Google Scholar
• Sheehan, D. V., Sheehan, K. H., Shytle, R. D., Janavs, J., Bannon, Y., Rogers, J. E., Milo, K. M., Stock, S. L., & Wilkinson, B. (2010). Reliability and validity of the Mini International Neuropsychiatric Interview for children and adolescents (MINI-KID). The Journal of Clinical Psychiatry, 71(3), 313–326. https://doi.org/10.4088/JCP.09m05305whi
   PubMed Web of Science ®Google Scholar
• Sofronoff, K., Attwood, T., & Hinton, S. (2005). A randomised controlled trial of a CBT intervention for anxiety in children with Asperger syndrome. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 46(11), 1152–1160. https://doi.org/10.1111/j.1469-7610.2005.00411.x
   PubMed Web of Science ®Google Scholar
• Stadnick, N., Chlebowski, C., Baker-Ericzén, M., Dyson, M., Garland, A., & Brookman-Frazee, L. (2017). Psychiatric comorbidity in autism spectrum disorder: Correspondence between mental health clinician report and structured parent interview. Autism, 21(7), 841–851. https://doi.org/10.1177/1362361316654083
   PubMed Web of Science ®Google Scholar
• Stadnick, N. A., Drahota, A., & Brookman-Frazee, L. (2013). Parent perspectives of an evidence-based intervention for children with autism served in community mental health clinics. Journal of Child and Family Studies, 22(3), 414–422. https://doi.org/10.1007/s10826-012-9594-0
   PubMed Web of Science ®Google Scholar
• Steinbrenner, J. R., Hume, K., Odom, S. L., Morin, K. L., Nowell, S. W., Tomaszewski, B., Szendrey, S., McIntyre, N. S., Yücesoy-Özkan, S., & Savage, M. N. (2020). Evidence-based practices for children, youth, and young adults with autism. The University of North Carolina at Chapel Hill. Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team.
   Google Scholar
• Stokes, J. O., Jent, J. F., Weinstein, A., Davis, E. M., Brown, T. M., Cruz, L., & Wavering, H. (2016). Does practice make perfect? the relationship between self-reported treatment homework completion and parental skill acquisition and child behaviors. Behavior Therapy, 47(4), 538–549. https://doi.org/10.1016/j.beth.2016.04.004
   PubMed Web of Science ®Google Scholar
• Trevethan, R. (2017). Intraclass correlation coefficients: Clearing the air, extending some cautions, and making some requests. Health Services & Outcomes Research Methodology, 17(2), 127–143. https://doi.org/10.1007/s10742-016-0156-6
   Web of Science ®Google Scholar
• Tryon, G. S., & Winograd, G. (2011). Goal consensus and collaboration. Psychotherapy, 48(1), 50–57. https://doi.org/10.1037/a0022061
   PubMed Web of Science ®Google Scholar
• Tschida, J. E., Maddox, B. B., Bertollo, J. R., Kuschner, E. S., Miller, J. S., Ollendick, T. H., Greene, R. W., & Yerys, B. E. (2021). Caregiver perspectives on interventions for behavior challenges in autistic children. Research in Autism Spectrum Disorders, 81, 101714. https://doi.org/10.1016/j.rasd.2020.101714
   Web of Science ®Google Scholar
• Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence (WASI-II). Pearson.
   Google Scholar
• Whittingham, K., Sofronoff, K., Sheffield, J., & Sanders, M. R. (2009). Stepping stones triple P: An RCT of a parenting program with parents of a child diagnosed with an autism spectrum disorder. Journal of Abnormal Child Psychology, 37(4), 469. https://doi.org/10.1007/s10802-008-9285-x
   PubMed Web of Science ®Google Scholar
• Wong, C., Odom, S. L., Hume, K. A., Cox, A. W., Fettig, A., Kucharczyk, S., Brock, M. E., Plavnick, J. B., Fleury, V. P., & Schultz, T. R. (2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: A comprehensive review. Journal of Autism and Developmental Disorders, 45(7), 1951–1966. https://doi.org/10.1007/s10803-014-2351-z
   PubMed Web of Science ®Google Scholar
• World Health Organization. (1993). The ICD-10 classification of mental and behavioural disorders: Diagnostic criteria for research. WHO.
   Google Scholar
• Wright, B., Lau, A. S., & Brookman-Frazee, L. (2019). Factors associated with caregiver attendance in implementation of multiple evidence-based practices in youth mental health services. Psychiatric Services, 70(9), 808–815. https://doi.org/10.1176/appi.ps.201800443
   PubMed Web of Science ®Google Scholar
• Youngstrom, E., Loeber, R., & Stouthamer-Loeber, M. (2000). Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68(6), 1038–1050. https://doi.org/10.1037/0022-006x.68.6.1038
   PubMed Web of Science ®Google Scholar