Practice-Based Evidence for Children and Adolescents: Advancing the Research Agenda in SchoolsFootnote

Work on this article was supported by grants (MSN103215 and MSN103211) to the first author and the Wisconsin Center for Education Research (WCER) from the U.S. Department of Education. Any opinions, findings, or conclusions expressed in this article are those of the author and do not necessarily reflect the views of the funding agencies, WCER, or cooperating institutions. Support to John R. Weisz came from the Catherine T. MacArthur Foundation, National Institute of Mental Health, and the Norlien Foundation. More detailed information on the themes in this article and the full report from the Task Force may be found at the American Psychological Association Web site (http://www.apa.org/pi/cyf/evidence.html).

References

• AtkinsM. S.FrazierS. L.LeathersS. J.GraczykP. A.TalbottE.AdilJ. A.et al.. (2008). Teacher key opinion leaders and mental health consultation in urban low-income schools. Journal of Consulting and Clinical Psychology, 76, 905–908.
   PubMed Web of Science ®Google Scholar
• American Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.
   PubMed Web of Science ®Google Scholar
• American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents. (2008). Disseminating evidence-based practice for children and adolescents: A systems approach to enhancing care. Washington, DC: American Psychological Association.
   Google Scholar
• BarlowD. H. (2010). Negative effects from psychological treatments: A perspective. American Psychologist, 65, 13–20.
   PubMed Web of Science ®Google Scholar
• BarlowD. H.NockM. K.HersenM. (2009). Single-case experimental designs: Strategies for studying behavior change. (3rd ed.). Boston, MA: Allyn & Bacon.
   Google Scholar
• BickmanL. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 1114–1119.
   PubMed Web of Science ®Google Scholar
• BorckardtJ. J.NashM. R.MurphyM. D.MooreM.ShawD.O'NeilP. (2008). Clinical practice as natural laboratory for psychotherapy research. American Psychologist, 63, 77–95.
   PubMed Web of Science ®Google Scholar
• ChorpitaB. F. (2007). Modular cognitive-behavioral therapy for childhood anxiety disorders. New York: Guilford Press.
   Google Scholar
• ChorpitaB. F.BernsteinA.DaleidenE., & The Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35, 114–123.
   PubMed Web of Science ®Google Scholar
• ChorpitaB. F.ReiseS.WeiszJ. R.GrubbsK.BeckerK. D.KrullJ. L.et al.. (2010). Evaluation of the Brief Problem Checklist: Child and caregiver interviews to measure clinical progress. Journal of Consulting and Clinical Psychology, 78, 526–536.
   PubMed Web of Science ®Google Scholar
• ChorpitaB. F.WeiszJ. R. (2009). Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, or Conduct Problems (MATCH-ADTC). Satellite Beach, FL: PracticeWise, LLC.
   Google Scholar
• ChristT. J. (2006). Short-term estimates of growth using curriculum-based measurement of oral reading fluency: Estimating standard error of the slope to construct confidence intervals. School Psychology Review, 35, 128–133.
   Web of Science ®Google Scholar
• CunninghamP. B.EllisD. A.Naar-KingS. (2010). Treating pediatric obesity using an empirically supported treatment: A case study. Journal of Clinical Child & Adolescent Psychology, 39, 141–150.
   PubMed Web of Science ®Google Scholar
• FalzonL.DavidsonK. W.BrunsD. (2010). Evidence-searching for evidence-based psychology practice. Professional Psychology: Research and Practice, 41, 550–557.
   PubMed Web of Science ®Google Scholar
• FantuzzoJ.McWayneC.BulotskyR. (2003). Forging strategic partnerships to advance mental health science and practice for vulnerable children. School Psychology Review, 32, 17–37.
   Web of Science ®Google Scholar
• FlayB. R.BiglanA.BoruchR. F.CastroF. G.GottfredsonD.KellamS.MościckiE. K.SchinkeS.ValentineJ. C.JiP. (2005). Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination. Prevention Science, 6(3), 151–175.
   PubMed Web of Science ®Google Scholar
• FixsenD. L.NaoomS. F.BlaséK. A.FriedmanR. M.WallaceF. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute.
   Google Scholar
• FormanS. G.OlinS. S.HoagwoodK. E.CroweM.SakaN. (2009). Evidence-based interventions in schools: Developer's views of implementation barriers and facilitators. School Mental Health, 1, 26–36.
   Google Scholar
• FrazierS. L.AdilJ. A.AtkinsM. S.GathrightT.JacksonM. (2007). Can't have one without the other: Mental health providers and community parents reducing barriers to services for families in urban poverty. Journal of Community Psychology, 35, 435–446.
   Web of Science ®Google Scholar
• FrazierS. L.FormosoD.BirmanD.AtkinsM. S. (2008). Closing the research to practice gap: Redefining feasibility. Clinical Psychology: Science and Practice, 15, 125–129.
   Web of Science ®Google Scholar
• FrazierS. L.CappellaE.AtkinsM. S. (2007). Linking mental health and after school systems for children in urban poverty. Preventing problems, promoting possibilities. Administration and Policy in Mental Health and Mental Health Services Research, 34, 389–399.
   PubMed Web of Science ®Google Scholar
• FreibergH. J.LaponteJ. M. (2006). Research-based programs for preventing and solving discipline problems. In EvertsonC. M.WeinsteinC. S. (Eds.), Handbook of classroom management: Research, practice, and contemporary issues (pp. 735–786). Mahwah, NJ: Erlbaum.
   Google Scholar
• FuchsD.FuchsL. S.SteckerP. M. (2010). The “blurring” of special education in a new continuum of general education placements and services. Exceptional Children, 76, 301–323.
   Web of Science ®Google Scholar
• GarlandA. F.BickmanL.ChorpitaB. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Admiration and Policy in Mental Health, 37, 15–26.
   PubMed Web of Science ®Google Scholar
• GlissonC.JamesL. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23, 767–794.
   Web of Science ®Google Scholar
• GlissonC.LandsverkJ.SchoenwaldS. K.KelleherK.HoagwoodK. E.MaybergS.et al.. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for implementation research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 98–113.
   PubMed Web of Science ®Google Scholar
• GloverT. A.DipernaJ. C.VaughnS. (2007). Introduction to the special series on service delivery systems for response to intervention: Considerations for research and practice. School Psychology Review, 36, 523–525.
   Web of Science ®Google Scholar
• GreenL. W. (2006). Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence? American Journal of Public Health, 96, 406–409.
   PubMed Web of Science ®Google Scholar
• GreenwoodC. R.KampsD.TerryB. J.LinebargerD. L. (2007). Primary intervention: A means of preventing special education? In HaagerD.KlingnerJ.VaughnS. (Eds.), Evidence-based practices for response to intervention (pp. 73–103). Baltimore, MD: Brooks Publishing.
   Google Scholar
• GreenwoodC. R.ReynoldsS.AbbottM.TapiaY. (2004). Together we can: Class-Wide Peer Tutoring Learning Management System (CWPT-LMS). Kansas City: Juniper Gardens Children's Project, University of Kansas.
   Google Scholar
• GreenwoodC. W.MaheadyL.CartaJ. J. (1991). Peer tutoring programs in the regular education classroom. In StonerG.ShinnM. R.WalkerH. M. (Eds.), Interventions for achievement and behavior problems (1st ed., pp. 179–200). Washington, DC: National Association of School Psychologists.
   Google Scholar
• GreshamF. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37–50.
   Web of Science ®Google Scholar
• Hagermoser SanettiL. M.KratochwillT. R. (2008). Treatment integrity in behavioral consultation: Measurement, promotion, and outcomes. International Journal of Behavioral Consultation and Therapy, 4, 95–114.
   Google Scholar
• HayesS. C.BarlowD. H.NelsonG. R. (1999). The scientist practitioner: Research and accountability in the age of managed care (2nd ed.). Needham Heights, MA: Allyn & Bacon.
   Google Scholar
• HornerR. H.CarrE. G.HalleJ.McGeeG.OdomS.WoleryM. (2005). The use of single subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179.
   Web of Science ®Google Scholar
• HornerR. H.SugaiG.ToddA. W.Lewis-PalmerT. (2005) School-wide positive behavior support: An alternative approach to discipline in schools. In BambaraL. M.KernL. (Eds.), Individualized supports for students with problem behaviors (pp. 359–390). New York: Guilford Press.
   Google Scholar
• HuangL.StroulB.FriedmanR.MrazekP.FriesenB.PiresS.et al.. (2005). Transforming mental health care for children and their families. American Psychologist, 60, 615–627.
   PubMed Web of Science ®Google Scholar
• Jenson-DossA.HawleyK. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39, 885–896.
   PubMed Web of Science ®Google Scholar
• KazakA. E.HoagwoodK.WeiszJ.HoodK.KratochwillT. R.VargasL. A.et al.. (2010). A meta-systems approach to evidence-based practice for children and adolescents. American Psychologist, 65, 85–97.
   PubMed Web of Science ®Google Scholar
• KazdinA. E. (1982). Single-case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
   Google Scholar
• KazdinA. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146–159.
   PubMed Web of Science ®Google Scholar
• KazdinA. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York: Oxford University Press.
   Google Scholar
• KazdinA. E.KratochwillT. R.Vanden BosG. (1986). Beyond clinical trials: Generalizing from research to practice. Professional Psychology: Research and Practice, 3, 391–398.
   Web of Science ®Google Scholar
• KellamS. G.RebokG. W.IalongoN.MayerL. S. (1994). The course and malleability of aggressive behavior from early first grade into middle school: Results of a developmental epidemiologically-based preventive trial. Journal of Child Psychology and Psychiatry, 25, 259–281.
   Web of Science ®Google Scholar
• KelleyS.de AndradeA.ShefferE.BickmanL. (2010). Exploring the Black Box: Measuring Youth Treatment Process and Progress in Usual Care. Administration and Policy in Mental Health and Mental Health Services Research, 37, 287–300.
   PubMed Web of Science ®Google Scholar
• Klimes-DouganB.AugustG. J.LeeC.-Y. S.RealmutoG. M.BloomquistM. L.HorowitzJ. L.et al.. (2009). Practitioner and site characteristics that relate to fidelity of implementation: The early risers prevention program in a going-to-scale intervention trial. Professional Psychology: Research and Practice, 40, 467–475.
   Web of Science ®Google Scholar
• KratochwillT. R. (1985). Case study research in school psychology. School Psychology Review, 14, 204–215.
   Google Scholar
• KratochwillT. R. (2006). Evidence-based interventions and practices in school psychology: The scientific basis of the profession. In SubotnikR.WalbergH. (Eds.), The scientific basis of educational productivity (pp. 229–267). Washington, DC: American Psychological Association.
   Google Scholar
• KratochwillT. R. (2007). Preparing psychologists for evidence-based practice: Lessons learned and challenges ahead. American Psychologist, 62, 826–843.
   PubMed Web of Science ®Google Scholar
• KratochwillT. R.LevinJ. R. (2010a, June). Methodological and data analysis innovations for single-case intervention designs: Advancing the standards for research. Grant proposal submitted to the Institute for Education Science.
   Google Scholar
• KratochwillT. R.LevinJ. R. (2010b). Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15, 122–144.
   Web of Science ®Google Scholar
• KratochwillT. R.MorrisR. J.RobinsonJ. (2008). Historical perspectives. In HersenM.GrossA. M. (Eds.). Handbook of clinical psychology (Volume 2, Children and Adolescents) (pp. 3–38). New York: Wiley.
   Google Scholar
• KratochwillT. R.PierselW. C. (1983). Time-series research: Contributions to empirical clinical practice. Behavioral Assessment, 5, 165–176.
   Google Scholar
• KratochwillT. R.ClementsM. A.KalymonK. M. (2007). Response to intervention: Conceptual and methodological issues in implementation. In JimersonS. R.BurnsM. K.VanDerHeydenA. M. (Eds.), The handbook of response to intervention: The science and practice of assessment and intervention (pp. 25–52). New York: Springer.
   Google Scholar
• KratochwillT. R.HitchcockJ.HornerR. H.LevinJ. R.OdomS. L.RindskopfD. M.et al.. (2010). Single case designs technical documentation. In What Works Clearinghouse: Procedures and standards handbook (version 2.0). Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_procedures_v2_standards_handbook.pdf
   Google Scholar
• KratochwillT. R.StoiberK. C.GutkinT. B. (2001). Empirically supported interventions in school psychology: The role of negative results in outcome research. Psychology in the Schools, 37, 399–413.
   Web of Science ®Google Scholar
• LambertM. J.WhippleJ. L.HawkinsE. J.VermeeschD. A.NielsenS. L.SmartD. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288–301.
   Web of Science ®Google Scholar
• LandryS. H.AnthonyJ. L.SwankP. R.Monseque-BaileyP. (2009). Effectiveness of comprehensive professional development for teachers of at-risk preschoolers. Journal of Educational Psychology, 101, 448–465.
   Web of Science ®Google Scholar
• LembkeE. S.McMasterK. L.SteckerP. M. (2010). The prevention science of reading research within a response-to-intervention model. Psychology in the Schools, 47, 22–35.
   Web of Science ®Google Scholar
• LevinJ. R.O'DonnellA. M.KratochwillT. R. (2003). Educational/psychological intervention research. In WeinerI. B. (Series Ed.), ReynoldsW. M.MillerG. E. (Volume Eds.), Handbook of psychology: Vol. 7. Educational psychology (pp. 557–581). New York: Wiley.
   Google Scholar
• LewisT. J.NewcomerL. L.TrussellR.RichterM. (2006). School-wide positive behavior support: Building systems to develop and maintain appropriate social behavior. In EvertsonC. M.WeinsteinC. S. (Eds.), Handbook of classroom management: Research, practice, and contemporary issues (pp. 833–854). Mahwah, NJ: Erlbaum.
   Google Scholar
• LilienfeldS. O.AmmiratiR.DavidM. (2010). Distinguishing science from pseudoscience in school psychology (Part 1): Science and scientific thinking as safeguards against human error. Journal of School Psychology.
   Web of Science ®Google Scholar
• LockmanJ. E.PowellN. P.BoxmeyerC. L.QuL.WellsK. C.WindleM. (2009). Implementation of a school-based prevention program: Effects of counselor and school characteristics. Professional Psychology: Research and Practice, 40, 476–482.
   Web of Science ®Google Scholar
• McFallR. M. (1991). Manifesto for a science of clinical psychology. The Clinical Psychologist, 44, 65–88.
   Google Scholar
• McLeodB. D.Southam-GerowM. A.WeiszJ. R. (2009). Conceptual and methodological issues in treatment integrity measurement. School Psychology Review, 38, 541–546.
   Web of Science ®Google Scholar
• MorganD. L.MorganR. K. (2001). Single-participant research design: Bringing science to managed care. American Psychologist, 56, 119–127.
   PubMed Web of Science ®Google Scholar
• NastasiB. K.MooreR. B.VarjasK. M. (2004). School-based mental health services: Creating comprehensive and culturally specific programs. Washington, DC: American Psychological Association.
   Google Scholar
• NewmanD. W.KellettS. C.BeailN. (2003). From research and development to practice based evidence: Clinical governance initiatives in a service for adults with intellectual disabilities and mental health needs. Journal of Intellectual Disability Research, 47, 68–74.
   PubMed Web of Science ®Google Scholar
• No Child Left Behind. 20 U.S.C. § 16301 et seq. (2001).
   Google Scholar
• NorcrossJ. C.HoganT. P.KoocherG. P. (2008). Clinician's guide to evidence-based practices. New York: Oxford Press.
   Google Scholar
• ParkerR. I.Hagan-BurkeS. (2007). Single case research results as clinical outcomes. Journal of School Psychology, 45, 637–653.
   Web of Science ®Google Scholar
• PowerT. J.Blom-HoffmanJ.ClarkeA. T.Riley-TillmanT. C.KelleherC.ManzP. H. (2005). Reconceptualizing intervention integrity: A partnership-based framework for linking research with practice. Psychology in the Schools, 42(5), 495–507.
   Web of Science ®Google Scholar
• RaverC. C.JonesS. M.Li-GriningC.ZhaiF.MetzgerM. W.SolomanB. (2009). Targeting children's behavior problems in preschool classrooms: A cluster-randomized controlled trial. Journal of Consulting and Clinical Psychology, 77, 302–316.
   PubMed Web of Science ®Google Scholar
• ReschlyA. L.BuschT. W.BettsJ.DenoS. L.LongJ. D. (2009). Curriculum-based measurement oral reading as an indicator of reading achievement: A meta-analysis of the correlational evidence. Journal of School Psychology, 47, 427–469.
   PubMed Web of Science ®Google Scholar
• ReschlyD. J.BergstromM. K. (2009). Response to intervention. In GutkinT. B.ReynoldsC. R. (Eds.), The handbook of school psychology (pp. 434–460). New York: Wiley.
   Google Scholar
• ReutherE. T.DavisT. E.IIIMoreeB. N.MatsonJ. L. (2011). Treating selective mutism using modular CBT for child anxiety: A case study. Journal of Clinical Child & Adolescent Psychology, 40, 156–163.
   PubMed Web of Science ®Google Scholar
• ReynoldsC. R.ShaywitzS. E. (2009). Response to intervention: Ready or not? Or, from wait-to-fail to watch-them-fail. School Psychology Quarterly, 24, 130–145.
   PubMed Web of Science ®Google Scholar
• Riley-TillmanT. C.BurnsM. K. (2009). Evaluating educational interventions: Single-case design for measuring response to intervention. New York: Guilford Press.
   Google Scholar
• RobinsonS. L.Richod GriesemerS. M. (2006). Helping individual students with problem behavior. In EvertsonC. M.WeinsteinC. S. (Eds.), Handbook of classroom management: Research, practice, and contemporary issues (pp. 787–802). Mahwah, NJ: Erlbaum.
   Google Scholar
• SanettiL. M.KratochwillT. R. (2009). Treatment integrity assessment in the schools: An evaluation of the Treatment Integrity Planning Protocol (TIPP). School Psychology Quarterly, 24, 24–35.
   Web of Science ®Google Scholar
• ShadishW. R.RindskopfD. M. (2007). Methods for evidence-based practice: Quantitative synthesis of single-case designs. New Directions for Evaluation, 2007(113), 95–109.
   Google Scholar
• ShadishW. R.RindskopfD. M.HedgesL. V. (2008). The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 3, 188–196.
   Google Scholar
• ShiehC. (2006, Fall). Practice-based evidence: How one nurse turned her day-to-day experiences into research. AWHONN Lifelines, 10(5), 375–378.
   PubMedGoogle Scholar
• StoiberK. C.KratochwillT. R. (2002). Outcomes: Planning, monitoring, evaluating. San Antonio, TX: The Psychological Corporation.
   Google Scholar
• VerduinT. L.AbikoffH.KurtzS.M.S. (2008). Evidence-based treatment of attention deficit/hyperactivity disorder in a preschool-aged child: A case study. Journal of Clinical Child & Adolescent Psychology, 37, 477–485.
   PubMed Web of Science ®Google Scholar
• WeiszJ. R. (2004). Psychotherapy for children and adolescents: Evidence-based treatments and case examples. Cambridge, UK: Cambridge University Press.
   Google Scholar
• WeiszJ. R.ChorpitaB. F. (2011). Mod squad for youth psychotherapy: Restructuring evidence-based treatment for clinical practice. In KendallP. C. (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures (pp. 379–397) (4th ed.). New York: Guilford Press.
   Google Scholar
• WeiszJ. R.ChorpitaB. F.FryeA.NgM. Y.LauN.BearmanS. K.et al.. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79, 369–380.
   PubMed Web of Science ®Google Scholar
• WeiszJ. R.ChuB. C.PoloA. J. (2004). Treatment dissemination and evidence-based practice: Strengthening intervention through clinician-researcher collaboration. Clinical Psychology: Science and Practice, 11, 300–307.
   Web of Science ®Google Scholar
• WeiszJ. R.DossA. J.HawleyK. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671–689.
   PubMed Web of Science ®Google Scholar
• WeiszJ. R.HawkeyK. M. (1998). Finding, evaluating, refining, and applying empirically supported treatments for children and adolescents. Journal of Clinical Child Psychology, 27, 205–215.
   Google Scholar
• WeiszJ. R.SandlerI. N.DurlakJ. A.AntonB. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60, 628–648.
   PubMed Web of Science ®Google Scholar