Evidence Base Update for Psychosocial Treatments for Disruptive Behaviors in Children

Figures & data

TABLE 1 Evidence Base Update Criteria

Methods Criteria

M.1. Group design: Study involved a randomized controlled design

M.2. Independent variable defined: Treatment manuals or logical equivalent were used for the treatment

M.3. Population clarified: Conducted with a population, treated for specified problems, for whom inclusion criteria have been clearly delineated

M.4. Outcomes assessed: Reliable and valid outcome assessment measures gauging the problems targeted (at a minimum) were used

M.5. Analysis adequacy: Appropriate data analyses were used & sample size was sufficient to detect expected effects

Level 1: Well-Established Treatments

1.1 Efficacy demonstrated for the treatment in at least two (2) independent research settings and by two (2) independent investigatory teams demonstrating efficacy by showing the treatment to be either:

1.1.a. Statistically significantly superior to pill or psychological placebo or to another active treatment

OR

1.1.b. Equivalent (or not significantly different) to an already well-established treatment in experiments

AND

1.2. All five (5) of the Methods Criteria

Level 2: Probably Efficacious Treatments

2.1. There must be at least two good experiments showing the treatment is superior (statistically significantly so) to a waitlist control group

OR

2.2. One or more good experiments meeting the well-established treatment level with the one exception of having been conducted in at least two independent research settings and by independent investigatory teams

AND

2.3. All five (5) of the Methods Criteria

Level 3: Possibly Efficacious Treatments

3.1. At least one good randomized controlled trial showing the treatment to be superior to a waitlist or no-treatment control group

AND

3.2. All five (5) of the Methods Criteria

OR

3.3. Two or more clinical studies showing the treatment to be efficacious, with two or more meeting the last four (of five) Methods Criteria, but none being randomized controlled trials

Level 4: Experimental Treatments

4.1. Not yet tested in a randomized controlled trial

OR

4.2. Tested in 1 or more clinical studies but not sufficient to meet Level 3 criteria.

Level 5: Treatments of Questionable Efficacy

5.1. Tested in good group-design experiments and found to be inferior to other treatment group and/or waitlist control group, that is, only evidence available from experimental studies suggests the treatment produces no beneficial effect.

TABLE 2 Sample Description for Included Studies

Study Authors, Year	Study Arms	Ethnicity/Race	Country	N (Outcome)^a	Included Outcomes (Informants)
Randomized Studies
Augimeri, Farrington, Koegl, & Day, 2007	1. Group parent behavior therapy + group child behavior therapy	not rep.	Canada	30	CBCL(P)
	2. Attention control
Axberg & Broberg, 2012	1. Group parent behavior therapy	94% both parents Swedish	Sweden	62	ECBI, SESBI
	2. Treatment as usual			(54)	(P, T)
Baker-Henningham, Scott, Jones, & Walker, 2012	1. Teacher training2. No treatment	not rep.	Jamaica	225(210)	DPICS, MOOSES, SESBI, SDQ, Conner, PKBS, ECBI(P, T, O)
Behan, Fitzpatrick, Sharry, Carr, & Waldron, 2001	1. Group parent behavior therapy	not rep.	Ireland	40	PGS, SDQ, CBCL, PSI
	2. No treatment				(P)
Berkovits, O’Brien, Carter, & Eyberg, 2010	1. Individual parent behavior therapy with child participation2. Self-directed parent behavior therapy	67% White 23% African American 7% Hispanic 3% Biracial	U.S.	30(21)	ECBI(P)
Bernal et al., 1980	1. Individual parent behavior therapy with child participation	not rep.	U.S.	36	DBO, TC, Becker(P, O)
	2. Individual parent-focused therapy with child participation
	3. No treatment
Bjorknes & Manger, 2013	1. Group parent behavior therapy2. No treatment	59% Pakistani immigrants41% Somalian immigrants	Norway	96(83)	CP Composite, TRF, ECBI(P, T)
Braet et al., 2009	1. Group parent behavior therapy	not rep.	Belgium	64	CBCL, TRF
	2. No treatment			(40)	(P, T)
Bratton et al., 2013	1. Individual child-centered play therapy2. Attention control	42% African American 39% Hispanic 18% Caucasian	U.S.	54	C–TRF(T)
Chacko et al., 2015	1. Group parent behavior therapy with child participation + Family problem-solving training2. Treatment as usual	51% Hispanic 31% African American 8% Caucasian 3% Native American 7% Other	U.S.	320(306)	IOWA CRS(P)
Christensen et al., 1980	1. Individual parent behavior therapy with child participation	not rep.	U.S.	36(28)	PBOR, Becker, CO(P, O)
	2. Group parent behavior therapy
	3. Self-directed parent behavior therapy
Connell, Sanders, & Markie-Dadds, 1997	1. Self-directed parent behavior therapy	not rep.	Australia	24(23)	ECBI, PDR(P)
	2. No treatment
Cunningham, Bremner, & Boyle, 1995	1. Group parent behavior therapy	18% immigrant	Canada	150	HSQ, CBCL, CO
	2. Individual parent behavior therapy			(114)	(P, O)
	3. No treatment
David, David, & Dobrean, 2014	1. Group parent behavior therapy + Group parent-focused therapy	not rep.	Romania	130(106)	CBCL, TRF(P, T)
	2. No treatment
Enebrink et al., 2012	1. Self-directed parent behavior therapy	97% born in Sweden	Sweden	104(86)	ECBI, SDQ(P)
	2. No treatment
Feinfield & Baker, 2004	1. Individual parent behavior therapy with child participation + Group parent behavior therapy + Group child behavior therapy + Individual child behavior therapy	45% White 17% African American 8% Hispanic 3% Asian 27% mixed	U.S.	47	CBCL, ECBI, HSQ, TBGCR, TRF, SSQ, WMS(P, T)
	2. No treatment
Frank, Keown, & Sanders, 2015	1. Group parent behavior therapy2. No treatment	81% New Zealand European descent 9.5% Maori/Pacific Islander 9.5% Asian	New Zealand	42(40)^b	ECBI(P)
Gardner, Burton, & Klimes, 2006	1. Group parent behavior therapy2. No treatment	not rep.	UK	76(71)	ECBI, CO(P, O)
Havighurst et al., 2013	1. Group parent-focused therapy2. Treatment as usual	77.4% native English speakers22.6% other European or Asian	Australia	54(42)	ECBI, SESBI(P, T)
Homem, Gaspar, Seabra-Santos, Canavarro, & Azevedo, 2014	1. Group parent behavior therapy2. No treatment	not rep.	Portugal	36(33)	PACS, PKBS(P)
Hutchings et al., 2007	1. Group parent behavior therapy	not rep.	UK	153	ECBI, DPICS, SDQ
	2. No treatment			(116)	(P, O)
Kazdin et al., 1987	1. Individual child behavior therapy	76.8% White23.2% Black	U.S.	56(47)	CBCL, SBCL(P, T)
	2. Individual child-centered play therapy
	3. Attention control
Kazdin et al., 1989	1. Individual child behavior therapy	54.5% White45.5% Black	U.S.	112(97)	CBCL, PDR, IAB, SBCL, CATS
	2. Individual child behavior therapy with parent participation				(P, T, C)
	3. Individual child-centered play therapy
Kazdin, Siegel, & Bass, 1992	1. Individual parent behavior therapy with child participation	69.1% White30.9% Black	U.S.	97(76)	CBCL, TRF, IAB, CATS, SDR
	2. Individual child behavior therapy				(P, T, C)
	3. Individual child behavior therapy with parent participation
	4. Individual parent behavior therapy
Kierfeld, Ise, Hanisch, Gortz-Dorten, & Dopfner, 2013	1. Self-directed parent behavior therapy2. No treatment	not rep.	Germany	48(46)	CBCL, FBB-SSV(P)
Kim, Doh, Hong, & Choi, 2011	1. Group child behavior therapy2. Group parent behavior therapy + Group child behavior therapy3. No treatment	100% Korean	South Korea	20	PSBS(T, PR)
Kjobli & Ogden, 2012	1. Individual parent behavior therapy2. Treatment as usual	93.5% Norwegian 1.9% other western European 4.6% other ethnicity	Norway	216	ECBI, HCSBS, SSBS(P, T)
Kjobli et al., 2013	1. Group parent behavior therapy2. Treatment as usual	93% Norwegian 0.7% other western European 7.3% other ethnicity	Norway	137(126)	ECBI, HCSBS, SSBS(P, T)
Kling et al., 2010	1. Group parent behavior therapy	78% Swedish	Sweden	159	ECBI, PDR
	2. Self-directed parent behavior therapy	22% Immigrant		(145)	(P)
	3. No treatment
Kolko et al., 2010	1. Individual child behavior therapy + Individual parent behavior therapy + Medication review + School consultation + Case management + Peer group engagement + Individual parent behavior therapy with child participation2. Treatment as usual	80% Caucasian	U.S.	163(141)	PSC-17, KSADS(P, T)
Larsson et al., 2009	1. Group parent behavior therapy	99% native Norwegians	Norway	127	ECBI, CBCL
	2. Group parent behavior therapy + Group child behavior therapy				(P)
	3. Treatment as usual
Leung et al., 2003	1. Group parent behavior therapy2. Treatment as usual	most were native born Hong Kong residents	Hong Kong	91(69)	PDR, ECBI, SDQ(P)
Lochman, Coie, Underwood, & Terry, 1993	1. Individual child behavior therapy + Group child behavior therapy 2. No treatment	African-American	U.S.	52	TBC, peer nomination (P, PR)
McCabe & Yeh, 2009	1. Individual parent behavior therapy with child participation	Mexican American	U.S.	58(54)	ECBI, CBCL, DPICS, ECI
	2. No treatment				(P, O)
Meany-Walen, Bratton, & Kottman, 2014	1. Individual child-centered play therapy2. Attention control	48% Latino 33% European American 19% African American	U.S.	67(58)	TRF, DOF(T)
Mejia, Calam, & Sanders, 2015	1. Group parent behavior therapy2. No treatment	not rep.	Panama	108(94)	ECBI(P)
Niec et al., 2016	1. Group parent behavior therapy with child participation	86% White 2% Native American	U.S.	94(81)	BASC, ECBI(P)
	2. Individual parent behavior therapy with child participation	10% multi-racial 2% not reported
Nixon, Sweeney, Erickson, & Touyz, 2003	1. Individual parent behavior therapy with child participation	95% Caucasian 5% other: Koori, Chinese, Indian	Australia	54	ECBI, CBCL, HSQ(P)
	2. No treatment
Ogden & Hagen, 2008	1. Individual parent behavior therapy with child participation	94% Norwegian	Norway	112(97)	CBCL, PDR, TRF(P, T)
	2. Treatment as usual	6% other western European
Ojiambo & Bratton, 2014	1. Group child-centered play therapy	All ethnic groups in Uganda represented	Uganda	60	CBCL, TRF(P, T)
	2. Attention control
Patterson, Chamberlain, & Reid, 1982	1. Individual parent behavior therapy with child participation	not rep.	U.S.	19	PDR,TAB(P, O)
	2. Treatment as usual
Peed, Roberts, & Forehand, 1977	1. Individual parent behavior therapy with child participation	not rep.	U.S.	12	BRS, Becker, CO(P, O)
	2. No treatment
Pepler et al., 2010	1. Group parent behavior therapy + Group child behavior therapy2. No treatment	41.9% Caucasian 22.6% African Canadian 3.2% Pacific Islander 3.2% Latino 3.2% Native Canadian 25.8% Other	Canada	80(52)	CBCL, TRF(P, T)
Perrin, Sheldrick, McMenamy, Henson, & Carter, 2014	1. Group parent behavior therapy2. No treatment	Race: 74% White 12% African American 1% Asian 12% other; Ethnicity: 18% Hispanic	U.S.	273(194)	ECBI, DPICS, (P, O)
Porzig-Drummond, Stevenson, & Stevenson, 2015	1. Self-directed parent behavior therapy2. No treatment	not rep.	Australia	84(62)	ECBI(P)
Sanders et al., 2000	1. Individual parent behavior therapy with child participation	predominantly Caucasian	Australia	305(254)	ECBI, PDR, FOS-R-III(P, O)
	2. Individual parent behavior therapy with child participation + Addressing parent mental health needs
	3. Self-directed parent behavior therapy
	4. No treatment
Schuhmann, Foote, Eyberg, Boggs, & Algina, 1998	1. Individual parent behavior therapy with child participation	77% Caucasian, not of Hispanic origin	U.S.	64(42)	ECBI, DPICS(P, O)
	2. No treatment	14% African American; not of Hispanic origin 9% Hispanic, Asian, or mixed
Sumi et al., 2013	1. Individual parent behavior therapy with child participation + Individual child behavior therapy with parent participation + Teacher training	45% White 27% Hispanic 24% African American 13% English language learners	U.S.	286(280)	SSRS, SSBD(P, T)
	2. No treatment
Vitaro, Brendgen, Pagani, Tremblay, & McDuff, 1999	1. Individual parent behavior therapy with child participation	100% French Caucasian	Canada	73	SBQ(P)
	2. No treatment
Walker et al., 1998	1. Individual parent behavior therapy with child participation + Individual child behavior therapy with parent participation + Teacher training	7% minority status	U.S.	42	TRF(T)
	2. No treatment
Webster-Stratton & Hammond, 1997	1. Group parent behavior therapy2. Group child behavior therapy3. Group parent behavior therapy + Group child behavior therapy4. No treatment	86% Caucasian	U.S.	97	ECBI, CBCL, PBQ, DPICS, PPS-I-Care(P, T, O)
Webster-Stratton, 1990	1. Self-directed parent behavior therapy	not rep.	U.S.	47(43)	ECBI, CBCL, PDR, DPICS(P, O)
	2. No treatment
Webster-Stratton, 1992	1. Self-directed parent behavior therapy	not rep.	U.S.	100	ECBI, CBCL, PBQ, PDR, DPICS
	2. No treatment				(P, T, O)
Webster-Stratton, Kolpacoff, & Hollingsworth, 1988	1. Self-directed parent behavior therapy	not rep.	U.S.	194^c(178)	ECBI, CBCL, PBQ, PDR(P, T)
	2. No treatment
Webster-Stratton et al., 2004	1. Group parent behavior therapy2. Group child behavior therapy3. Group child behavior therapy + Teacher training4. Group parent behavior therapy + Teacher training5. Group parent behavior therapy + Group child behavior therapy + Teacher training6. No treatment	79% Euro-American	U.S.	159	ECBI, TASB, SHP, PCSC, MOOSES, DPICS, DPIS(P, T, O)
Wells & Egan, 1988	1. Individual parent behavior therapy with child participation	not rep.	U.S.	23(19)	CO(O)
	2. Individual parent-focused therapy with child participation
Nonrandomized Studies
Abrahamse et al., 2012	1. Individual parent behavior therapy with child participation2. No treatment	62% Caucasian 11% Surinamese 8% Moroccan 3% Turkish 16% other	Netherlands	95(84)	ECBI(P)
Abrahamse et al., 2016	1. Individual parent behavior therapy with child participation	70% Caucasian	Netherlands	45(40)	ECBI, CBCL, DPICS(P)
	2. Treatment as usual
Hanisch et al., 2010	1. Group parent behavior therapy + teacher training	not rep.	Germany	155(121)	CBCL, PCL, HSQ, OBDT
	2. No treatment				(P, T, O)
Leung, Tsang, Heung, & Yiu, 2009	1. Individual parent behavior therapy with child participation	not rep.	Hong Kong	130(110)	ECBI, PSI(P, O)
	2. No treatment
Meany-Walen, Bullis, Kottman, & Dillman Taylor, 2015	1. Group child-centered play therapy2. No treatment (single case design)	100% Caucasian	U.S.	2	DOF(T)
Ollendick et al., 2016	1. Family problem-solving training	83% Caucasian17% non-Caucasian	U.S.	134(100)	DBDRS(P)
	2. Individual parent behavior therapy with child participation
Shapiro, Youngstrom, Youngstrom, & Marcinick, 2012	1. Individual parent behavior therapy2. Treatment as usual	59% African American 25% Caucasian 10% Biracial 5% Hispanic	U.S.	348(194)	CBCL, OS(P)
Stoltz et al., 2013	1. Individual child behavior therapy	68% Dutch32% Immigrant	Netherlands	271(264)	SHP, Observation(T, O)
	2. No treatment

Note: Abbreviations for Outcomes: Becker = Bi-Polar Adjective Checklist; BRS = Behavior Rating Scale; CATS = Children’s Action Tendency Scale; CBCL = Child Behavior Checklist; ChIA = Children’s Inventory of Anger; CO = coded observation; Conner = Conner’s Global Index; CP composite = Conduct problems composite = ECBI and PDR; C–TRF = Teacher report form for children 1.5–5; DBDRS = Disruptive Behavior Disorders Rating Scale; DBO = Deviant Behavior Observation; DOF = Direct Observation Form; DPICS = Dyadic Parent–Child Interaction Coding System; DPIS = Dyadic Peer Interaction Scale; ECBI = Eyberg Child Behavior Inventory; ECI = Early Childhood Inventory; ERQ = Emotion Recognition Questionnaire; FBB-SSV = Fremdbeurteilungsbogen für Störungen des Sozialverhaltens [observation scale for social behavior problems; ODD subscale]; FOS-R-III = Revised Family Observation Schedule; HCSBS = Home and Community Social Behavior Scales; HIS = Home Interview Scale; HSQ = Home Situations Questionnaire; IAB = Interview for Antisocial Behavior; IOWA CRS = IOWA Conners Rating Scale; KSADS = Kiddie-Schedule for Affective Disorders and Schizophrenia; MOOSES = Multi-Option Observation System for Experimental Studies; OBDT = Observed Behavior During the Test; OS = Ohio Scales; PACS = Parent Account of Child Symptoms; PAES = Pediatric Anger Expression Inventory; PBOR = Parent behavior observation record = PBQ = Preschool Behavior Questionnaire (teacher); PCL = Problem Checklist; PCSC = Perceived Competence Scale for Young Children; PDR = Parent Daily Report (aka PDRC = Parent Daily Report Checklist); PGS = Parent Goal Scales; PKBS = Preschool and Kindergarten Behavior Scales; PPS-I-Care = Peer problem solving interaction communication affect rating coding system; PSBS = Preschool Social Behavior Scale; PSC-17 = Pediatric Symptom Checklist; PSI = Parent Stress Index; SBCL = School Behavior Checklist; SBQ = Social Behavior Questionnaire; SDQ = Strengths and Difficulties Questionnaire; SDR = Self-Report Delinquency Checklist; SESBI = Sutter-Eyberg Student Behavior Inventory; SHP = Social Health Profile; SPSM = Social Problem Solving Measure; SSBD = Systematic Screening for Behavior Disorders; SSBS = School Social Behavior Scales; SSQ = School situation questionnaire; SSRS = Social Skills Rating Scale; STAXI = State-Trait Anger Expression Inventory; TAB = Total Aversive Behavior on Family Interaction Coding System; TASB = Teacher Assessment of School Behavior; TBC = Teacher Behavior Checklist; TBGCR = Three Behavior Global Change Rating; TC = Tailored Checklist; TOCA-R = Teacher Observation of Child Adaptation-Revised; TRF = Teacher report form (CBCL); WMS = Walker–McConnell = Scale of Social Competence and School Adjustment. Abbreviations for Informants: P = Parent; T = Teacher; O = Observer or Clinician; C = Child; PR = Peer.

^aOutcome sample size is reported if sample size at post treatment assessment differs from reported sample size.

^bNumber of children; study reported both parents separately.

^c114 families participated.

TABLE 3 Treatment Family and Qualifying Studies, by Level of Evidence

Treatment Family	Qualifying Studies	Gender: % Male	Age in Years: Range (M)	Program	Effect Size^a	Follow-Up	No. of Effects Maintained
Level 1: Well-Established
Group parent behavior therapy	Superior to alternate treatment
	Axberg & Broberg, 2012	84	4–8	Incredible Years Basic	−0.99	1 year	2 of 4
	Kjobli et al., 2013	63	3–12 (9)	PMTO (Norway)	N/A	None	—
	Kling et al., 2010	60	3–10 (6)	COMET	−0.97	6 months	2 of 3 (further improvement) (1 of 3 delayed improvement)
	Larsson et al., 2009	80	4–8 (7)	Incredible Years Basic	−1.41	1 year	0
	Leung et al., 2003	64	3–7 (4)	Triple P (Level 4)	−0.77	None	—
	Equivalent to alternate treatment
	Christensen et al., 1980	78	4–12	PMTO	N/A	None	—
	Cunningham et al., 1995	51	5–6 (Kindergarten)	unnamed	0.02	6 months	1 of 3 (delayed improvement)
	Webster-Stratton et al., 2004	90	4–8 (6)	Incredible Years Basic	−0.64	1 year	3 of 3
Individual parent behavior therapy with child participation	Superior to alternate treatment
	Bernal et al., 1980	86	5–12 (8)	Behavioral parent training	N/A	6 months	3 of 4 (further improvement)
	Ogden & Hagen, 2008	80	4–12 (8)	PMTO (Norway)	−0.54	None	—
	Patterson et al., 1982	68	3–12 (7)	OSLC	−1.11	None	—
	Wells & Egan, 1988	not rep.^b	3–8	Social learning parent training (Hanf model)	−3.68	None
	Equivalent to alternate treatment
	Berkovits et al., 2010	70	3–6 (4)	Abbreviated PCIT	−1.43	6 month	0
	Christensen et al., 1980	78	4–12	PMTO	N/A	None	—
	Kazdin et al., 1992	78	7–13 (11)	Parent Management Training	−0.46	1 year	1 (of 7) (1 delayed, 3 decayed and 2 no effect)
	Sanders et al., 2000	68	3–4 (3)	Triple P Precursor^c	−0.55	1 year	2 (2 no effect, 1 delayed)
Level 2: Probably Efficacious
Group parent behavior therapy + group child behavior therapy	Superior to alternate treatment
	Augimeri et al., 2007	73	< 12 (9)	SNAP Under 12 Outreach Program	N/A	18 months	2 of 2
	Equivalent to alternate treatment
	Larsson et al., 2009	80	4–8 (7)	Incredible Years Basic + Dinosaur School (Norway)	−1.11	1 year	5 of 6 no effect
Group parent behavior therapy with child participation + Family problem-solving training	Superior to alternate treatment
	Chacko et al., 2015	68	7–11 (9)	Multiple Family Group	−0.46	None	—
Group parent behavior therapy with child participation	Equivalent to well-established treatment
	Niec et al., 2016	72	3–6 (4)	Group Parent-Child Interaction Therapy	N/A	None	—
Individual parent behavior therapy	Superior to alternate treatment
	Kjobli & Ogden, 2012	58	3–12 (7)	Brief PMTO (Norway)	−0.53	None	—
	Equivalent to alternate treatment
	Cunningham et al., 1995	51	5–6 (Kindergarten)	unnamed	N/A	None	—
Individual parent behavior therapy with child participation + individual child behavior therapy with parent participation + teacher training	Superior to no treatment
	Sumi et al., 2013	77	1st–3rd grade (8)	First Step to Success	−0.53	1 year	2 (1 delayed, 2 no effect)
	Walker et al., 1998	74	Kindergarten	First Step to Success	−1.08	1–2 years	2 of 2
Self-directed parent behavior therapy	Superior to no treatment
	Connell et al., 1997	43	2–6 (4)	Every Parent	−1.74	4 months	5 (3 delayed)
	Enebrink et al., 2012	58	3–12 (7)	COMET	−1.65	6 months	3 of 3
	Kierfeld et al., 2013	50	3–6	THOP	−1.12	None	—
	Kling et al., 2010	60	3–10 (6)	COMET	−0.52	6 months	3 of 3 further improvement
	Porzig-Drummond et al., 2015	50	2–10 (5)	1–2-3 Magic	N/A	6 months	2 of 2
	Webster-Stratton, 1992	72	3–8 (5)	Incredible Years Precursor^d	−0.88	1 year;	7 of 10; (3 of 10 delayed improvement)
	Equivalent to no treatment
	Sanders et al., 2000	68	3–4 (3)	Self-Directed Behavioral Family Intervention	−0.55	1 year	2 (1 delayed, 2 no effect)
	Webster-Stratton et al., 1988	69	3–8	Incredible Years Precursor	−0.86	None	—
	Webster-Stratton, 1990	91	3–8 (5)	Incredible Years Precursor	−0.76	None	—
Group child behavior therapy	Superior to no treatment
	Kim et al., 2011	75	4–5	unnamed	−0.94	None	—
	Webster-Stratton et al., 2004	90	4–8 (6)	Incredible Years Dinosaur School	−0.32	1 year	2 of 3
Group child behavior therapy	Equivalent to well-established treatment
+ teacher training	Webster-Stratton et al., 2004	90	4–8 (6)	Incredible Years Dinosaur School plus Teacher Training	−0.75	1 year	2 of 3
Individual child behavior therapy	Superior to alternate treatment
	Kazdin et al., 1987	80	7–13 (11)	Problem Solving Skills Training	−1.80	1 year	2 of 2
	Kazdin et al., 1989	78	7–12 (11)	Problem Solving Skills Training	−0.77	1 year	3 of 3 (delayed effect)
Individual child behavior therapy with parent participation	Superior to alternate treatment
	Kazdin et al., 1989	78	7–12 (11)	Problem Solving Skills Training with in vivo practice	−1.34	1 year	3 of 3
	Kazdin et al., 1992	78	7–13 (11)	Problem Solving Skills Training with in vivo practice	−0.84	1 year	6 of 7
Group parent-focused therapy	Superior to alternate treatment
	Havighurst et al., 2013	78	4–6 (6)	Tuning Into Kids	−1.22	6 months	2 of 2 (different measure than reported at posttest)
Group child-centered play therapy	Superior to alternate treatment
	Ojiambo & Bratton, 2014	50	10–12	Group Activity Play Therapy	−0.91	None	—
Individual child-centered play therapy	Superior to alternate treatment
	Meany-Walen et al., 2014	79	5–9 (6)	Adlerian Play Therapy	−0.99	None	—
Level 3: Possibly Efficacious
Group parent behavior therapy + individual parent behavior therapy with child participation + group child behavior therapy + individual child behavior therapy	Superior to no treatment
	Feinfield & Baker, 2004	86	4–8 (7)	Project TEAM	−0.55	5 months	3 of 3 decayed
Group parent behavior therapy + group parent-focused therapy	Superior to no treatment
	David et al., 2014	48	4–12 (6)	Rational Positive Parenting Program	−0.35	1 month	1 of 2
Group parent behavior therapy + teacher training + group child behavior therapy	Superior to no treatment
	Webster-Stratton et al., 2004	90	4–8 (6)	Incredible Years Basic plus Teacher Training plus Dinosaur School	−0.66	1 year	2 of 3
Group parent behavior therapy + teacher training	Superior to no treatment
	Webster-Stratton et al., 2004	90	4–8 (6)	Incredible Years Basic plus Teacher Training	−0.73	1 year	3 of 3
Individual parent behavior therapy with child participation + addressing parental mental health needs	Superior to no treatment
	Sanders et al., 2000	68	3–4 (3)	Enhanced Behavioral Family Intervention	−1.00	1 year	5 of 5
Group child behavior therapy + individual child behavior therapy	Superior to no treatment
	Lochman et al., 1993	52	third grade	unnamed	N/A	None	—
Teacher training	Superior to no treatment
	Baker-Henningham et al., 2012	61	3–6	Incredible Years Teacher Training	−0.34	None	—
Level 4: Experimental
Family problem-solving training	Not yet tested in a randomized trial
	Ollendick et al., 2016	62	7–14 (9)	Collaborative & Proactive Solutions	N/A	6 months	2 of 2

Note. COMET = Communication Method program; OSLO = Oregon Social Learning Center program; PCIT = Parent-Child Interaction Therapy; PMTO = Parent Management Training Oregon; SNAP = Stop Now and Plan; THOP = Therapy program for children with hyperkinetic and oppositional problem behavior.

^aEffect sizes shown represent a simple baseline to posttest change (as a function of baseline standard deviation) among the treatment group based on available data. These effect sizes should not be compared with effect sizes calculated using other methods more typically used in meta-analysis that would incorporate the correlation between baseline and posttest scores into the effect size.

^bBoys and girls included, but proportion not reported.

^cName of program: Standard Behavioral Family Intervention.

^d Name of program: Individually administered videotape modeling parent training program (IVM).

Augimeri, L. K., Farrington, D. P., Koegl, C. J., & Day, D. M. (2007). The SNAP Under 12 Outreach Project: Effects of a community based program for children with conduct problems. Journal of Child and Family Studies, 16(6), 799–807. doi:10.1007/s10826-006-9126-x

 Google Scholar

Axberg, U., & Broberg, A. G. (2012). Evaluation of “the incredible years” in Sweden: The transferability of an American parent-training program to Sweden. Scandinavian Journal of Psychology, 53(3), 224–232. doi:10.1111/sjop.2012.53.issue-3

 PubMed Web of Science ®Google Scholar

Baker-Henningham, H., Scott, S., Jones, K., & Walker, S. (2012). Reducing child conduct problems and promoting social skills in a middle-income country: Cluster randomised controlled trial. British Journal of Psychiatry, 201, 101–108. doi:10.1192/bjp.bp.111.096834

 PubMed Web of Science ®Google Scholar

Behan, J., Fitzpatrick, C., Sharry, J., Carr, A., & Waldron, B. (2001). Evaluation of the Parenting Plus Programme. The Irish Journal of Psychology, 22(3–4), 238–256. doi:10.1080/03033910.2001.10558283

 Google Scholar

Berkovits, M. D., O’Brien, K. A., Carter, C. G., & Eyberg, S. M. (2010). Early identification and intervention for behavior problems in primary care: A comparison of two abbreviated versions of parent-child interaction therapy. Behavior Therapy, 41(3), 375–387. doi:10.1016/j.beth.2009.11.002

 PubMed Web of Science ®Google Scholar

Bernal, M. E., Klinnert, M. D., & Schultz, L. A. (1980). Outcome evaluation of behavioral parent training and client-centered parent counseling for children with conduct problems. Journal of Applied Behavior Analysis, 13(4), 677–691. doi:10.1901/jaba.1980.13-677

 PubMed Web of Science ®Google Scholar

Bjorknes, R., & Manger, T. (2013). Can parent training alter parent practice and reduce conduct problems in ethnic minority children? A randomized controlled trial. Prevention Science, 14(1), 52–63. doi:10.1007/s11121-012-0299-9

 PubMed Web of Science ®Google Scholar

Braet, C., Meerschaert, T., Merlevede, E., Bosmans, G., Van Leeuwen, K., & De Mey, W. (2009). Prevention of antisocial behaviour: Evaluation of an early intervention programme. European Journal of Developmental Psychology, 6(2), 223–240. doi:10.1080/17405620601033194

 Web of Science ®Google Scholar

Bratton, S. C., Ceballos, P. L., Sheely-Moore, A. I., Meany-Walen, K., Pronchenko, Y., & Jones, L. D. (2013). Head start early mental health intervention: Effects of child-centered play therapy on disruptive behaviors. International Journal of Play Therapy, 22(1), 28–42. doi:10.1037/a0030318

 Google Scholar

Chacko, A., Gopalan, G., Franco, L., Dean-Assael, K., Jackson, J., Marcus, S., … McKay, M. (2015). Multiple family group service model for children with disruptive behavior disorders: Child outcomes at post-treatment. Journal of Emotional and Behavioral Disorders, 23(2), 67–77. doi:10.1177/1063426614532690

 PubMed Web of Science ®Google Scholar

Christensen, A., Johnson, S. M., Phillips, S., & Glasgow, R. E. (1980). Cost effectiveness in behavioral family therapy. Behavior Therapy, 11(2), 208–226. doi:10.1016/S0005-7894(80)80021-9

 Web of Science ®Google Scholar

Connell, S., Sanders, M. R., & Markie-Dadds, C. (1997). Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behavior Modification, 21(4), 379–408. doi:10.1177/01454455970214001

 PubMed Web of Science ®Google Scholar

Cunningham, C. E., Bremner, R., & Boyle, M. (1995). Large group community-based parenting programs for families of preschoolers at risk for disruptive behaviour disorders: Utilization, cost effectiveness, and outcome. Child Psychology & Psychiatry & Allied Disciplines, 36(7), 1141–1159. doi:10.1111/j.1469-7610.1995.tb01362.x

 PubMed Web of Science ®Google Scholar

David, O. A., David, D., & Dobrean, A. (2014). Efficacy of the rational positive parenting program for child externalizing behavior: Can an emotion-regulation enhanced cognitive-behavioral parent program be more effective than a standard one? Journal of Evidence-Based Psychotherapies, 14(2), 159–178.

 Web of Science ®Google Scholar

Enebrink, P., Hogstrom, J., Forster, M., & Ghaderi, A. (2012). Internet-based parent management training: A randomized controlled study. Behaviour Research and Therapy, 50(4), 240–249. doi:10.1016/j.brat.2012.01.006

 PubMed Web of Science ®Google Scholar

Feinfield, K. A., & Baker, B. L. (2004). Empirical support for a treatment program for families of young children with externalizing problems. Journal of Clinical Child and Adolescent Psychology, 33(1), 182–195. doi:10.1207/S15374424JCCP3301_17

 PubMed Web of Science ®Google Scholar

Frank, T. J., Keown, L. J., & Sanders, M. R. (2015). Enhancing father engagement and interparental teamwork in an evidence-based parenting intervention: A randomized-controlled trial of outcomes and processes. Behavior Therapy, 46(6), 749–763. doi:10.1016/j.beth.2015.05.008

 PubMed Web of Science ®Google Scholar

Gardner, F., Burton, J., & Klimes, I. (2006). Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: Outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry, 47(11), 1123–1132. doi:10.1111/j.1469-7610.2006.01668.x

 PubMed Web of Science ®Google Scholar

Havighurst, S. S., Wilson, K. R., Harley, A. E., Kehoe, C., Efron, D., & Prior, M. R. (2013). “Tuning into kids”: Reducing young children’s behavior problems using an emotion coaching parenting program. Child Psychiatry and Human Development, 44(2), 247–264. doi:10.1007/s10578-012-0322-1

 PubMed Web of Science ®Google Scholar

Homem, T. C., Gaspar, M. F., Seabra-Santos, M. J., Canavarro, M. C., & Azevedo, A. F. (2014). A pilot study with the Incredible Years parenting training: Does it work for fathers of preschoolers with opppositional behavior symptoms? Fathering, 12(3), 262–282.

 Google Scholar

Hutchings, J., Bywater, T., Daley, D., Gardner, F., Whitaker, C. J., Jones, K., … Edwards, R. T. (2007). Parenting intervention in Sure Start services for children at risk of developing conduct disorder: Pragmatic randomised controlled trial. British Medical Journal, 334, 678. doi:10.1136/bmj.39126.620799.55

 PubMed Web of Science ®Google Scholar

Kazdin, A. E., Esveldt-Dawson, K., French, N. H., & Unis, A. S. (1987). Problem-solving skills training and relationship therapy in the treatment of antisocial child behavior. Journal of Consulting and Clinical Psychology, 55(1), 76–85. doi:10.1037/0022-006X.55.1.76

 PubMed Web of Science ®Google Scholar

Kazdin, A. E., Bass, D., Siegel, T., & Thomas, C. (1989). Cognitive-behavioral therapy and relationship therapy in the treatment of children referred for antisocial behavior. Journal of Consulting and Clinical Psychology, 57(4), 522–535. doi:10.1037/0022-006X.57.4.522

 PubMed Web of Science ®Google Scholar

Kazdin, A. E., Siegel, T. C., & Bass, D. (1992). Cognitive problem-solving skills training and parent management training in the treatment of antisocial behavior in children. Journal of Consulting and Clinical Psychology, 60(5), 733–747. doi:10.1037/0022-006X.60.5.733

 PubMed Web of Science ®Google Scholar

Kierfeld, F., Ise, E., Hanisch, C., Gortz-Dorten, A., & Dopfner, M. (2013). Effectiveness of telephone-assisted parent-administered behavioural family intervention for preschool children with externalizing problem behaviour: A randomized controlled trial. European Child & Adolescent Psychiatry, 22(9), 553–565. doi:10.1007/s00787-013-0397-7

 PubMed Web of Science ®Google Scholar

Kim, M.-J., Doh, H.-S., Hong, J. S., & Choi, M.-K. (2011). Social skills training and parent education programs for aggressive preschoolers and their parents in South Korea. Children and Youth Services Review, 33(6), 838–845. doi:10.1016/j.childyouth.2010.12.001

 Web of Science ®Google Scholar

Kjobli, J., & Ogden, T. (2012). A randomized effectiveness trial of brief parent training in primary care settings. Prevention Science, 13(6), 616–626. doi:10.1007/s11121-012-0289-y

 PubMed Web of Science ®Google Scholar

Kjobli, J., Hukkelberg, S., & Ogden, T. (2013). A randomized trial of group parent training: Reducing child conduct problems in real-world settings. Behaviour Research and Therapy, 51(3), 113–121. doi:10.1016/j.brat.2012.11.006

 PubMed Web of Science ®Google Scholar

Kling, A., Forster, M., Sundell, K., & Melin, L. (2010). A randomized controlled effectiveness trial of parent management training with varying degrees of therapist support. Behavior Therapy, 41(4), 530–542. doi:10.1016/j.beth.2010.02.004

 PubMed Web of Science ®Google Scholar

Kolko, D. J., Campo, J. V., Kelleher, K., & Cheng, Y. (2010). Improving access to care and clinical outcome for pediatric behavioral problems: A randomized trial of a nurse-administered intervention in primary care. Journal of Developmental and Behavioral Pediatrics, 31(5), 393–404. doi:10.1097/DBP.0b013e3181dff307

 PubMed Web of Science ®Google Scholar

Larsson, B., Fossum, S., Clifford, G., Drugli, M. B., Handegard, B. H., & Morch, W.-T. (2009). Treatment of oppositional defiant and conduct problems in young Norwegian children: Results of a randomized controlled trial. European Child & Adolescent Psychiatry, 18(1), 42–52. doi:10.1007/s00787-008-0702-z

 PubMed Web of Science ®Google Scholar

Leung, C., Sanders, M. R., Leung, S., Mak, R., & Lau, J. (2003). An outcome evaluation of the implementation of the Triple P-Positive Parenting Program in Hong Kong. Family Process, 42(4), 531–544. doi:10.1111/j.1545-5300.2003.00531.x

 PubMed Web of Science ®Google Scholar

Lochman, J. E., Coie, J. D., Underwood, M. K., & Terry, R. (1993). Effectiveness of a social relations intervention program for aggressive and nonaggressive, rejected children. Journal of Consulting and Clinical Psychology, 61(6), 1053–1058. doi:10.1037/0022-006X.61.6.1053

 PubMed Web of Science ®Google Scholar

McCabe, K., & Yeh, M. (2009). Parent-child interaction therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child and Adolescent Psychology, 38(5), 753–759. doi:10.1080/15374410903103544

 PubMed Web of Science ®Google Scholar

Meany-Walen, K. K., Bratton, S. C., & Kottman, T. (2014). Effects of Adlerian play therapy on reducing students’ disruptive behaviors. Journal of Counseling & Development, 92, 47–56. doi:10.1002/j.1556-6676.2014.00129.x

 Web of Science ®Google Scholar

Mejia, A., Calam, R., & Sanders, M. R. (2015). A pilot randomized controlled trial of a brief parenting intervention in low-resource settings in Panama. Prevention Science, 16(5), 707–717. doi:10.1007/s11121-015-0551-1

 PubMed Web of Science ®Google Scholar

Niec, L. N., Barnett, M. L., Prewett, M. S., & Shanley Chatham, J. R. (2016). Group parent-child interaction therapy: A randomized control trial for the treatment of conduct problems in young children. Journal of Consulting and Clinical Psychology, 84(8), 682–698. doi:10.1037/a0040218

 PubMed Web of Science ®Google Scholar

Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent-child interaction therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71(2), 251–260. doi:10.1037/0022-006X.71.2.251

 PubMed Web of Science ®Google Scholar

Ogden, T., & Hagen, K. A. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76(4), 607–621. doi:10.1037/0022-006X.76.4.607

 PubMed Web of Science ®Google Scholar

Ojiambo, D., & Bratton, S. C. (2014). Effects of group activity play therapy on problem behaviors of preadolescent Ugandan orphans. Journal of Counseling & Development, 92(3), 355–365. doi:10.1002/jcad.2014.92.issue-3

 Web of Science ®Google Scholar

Patterson, G. R., Chamberlain, P., & Reid, J. B. (1982). A comparative evaluation of a parent-training program. Behavior Therapy, 13(5), 638–650. doi:10.1016/S0005-7894(82)80021-X

 Web of Science ®Google Scholar

Peed, S., Roberts, M., & Forehand, R. (1977). Evaluation of the effectiveness of a standardized parent training program in altering the interaction of mothers and their noncompliant children. Behavior Modification, 1(3), 323–350. doi:10.1177/014544557713003

 Web of Science ®Google Scholar

Pepler, D., Walsh, M., Yuile, A., Levene, K., Jiang, D., Vaughan, A., & Webber, J. (2010). Bridging the gender gap: Interventions with aggressive girls and their parents. Prevention Science, 11(3), 229–238. doi:10.1007/s11121-009-0167-4

 PubMed Web of Science ®Google Scholar

Perrin, E. C., Sheldrick, R. C., McMenamy, J. M., /, B. S., & Carter, A. S. (2014). Improving parenting skills for families of young children in pediatric settings: A randomized clinical trial. JAMA Pediatrics, 168(1), 16–24. doi:10.1001/jamapediatrics.2013.2919

 PubMed Web of Science ®Google Scholar

Porzig-Drummond, R., Stevenson, R. J., & Stevenson, C. (2015). Preliminary evaluation of a self-directed video-based 1-2-3 Magic parenting program: A randomized controlled trial. Behaviour Research and Therapy, 66, 32–42. doi:10.1016/j.brat.2015.01.003

 PubMed Web of Science ®Google Scholar

Sanders, M. R., Markie-Dadds, C., Tully, L. A., & Bor, W. (2000). The Triple P-Positive Parenting Program: A comparison of enhanced, standard, and self-directed behavioral family intervention for parents of children with early onset conduct problems. Journal of Consulting and Clinical Psychology, 68(4), 624–640. doi:10.1037/0022-006X.68.4.624

 PubMed Web of Science ®Google Scholar

Schuhmann, E. M., Foote, R. C., Eyberg, S. M., Boggs, S. R., & Algina, J. (1998). Efficacy of parent-child interaction therapy: Interim report of a randomized trial with short-term maintenance. Journal of Clinical Child Psychology, 27(1), 34–45. doi:10.1207/s15374424jccp2701_4

 PubMed Web of Science ®Google Scholar

Sumi, W. C., Woodbridge, M. W., Javitz, H. S., Thornton, S. P., Wagner, M., Rouspil, K., … Severson, H. H. (2013). Assessing the effectiveness of first step to success: Are short-term results the first step to long-term behavioral improvements? Journal of Emotional and Behavioral Disorders, 21(1), 66–78. doi:10.1177/1063426611429571

 Web of Science ®Google Scholar

Vitaro, F., Brendgen, M., Pagani, L., Tremblay, R. E., & McDuff, P. (1999). Disruptive behavior, peer association, and conduct disorder: Testing the developmental links through early intervention. Development and Psychopathology, 11(2), 287–304. doi:10.1017/S0954579499002060

 PubMed Web of Science ®Google Scholar

Walker, H. M., Kavanagh, K., Stiller, B., Golly, A., Severson, H. H., & Feil, E. G. (1998). First Step to Success: An early intervention approach for preventing school antisocial behavior. Journal of Emotional and Behavioral Disorders, 6(2), 66–80. doi:10.1177/106342669800600201

 Web of Science ®Google Scholar

Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: A comparison of child and parent training interventions. Journal of Consulting and Clinical Psychology, 65(1), 93–109. doi:10.1037/0022-006X.65.1.93

 PubMed Web of Science ®Google Scholar

Webster-Stratton, C. (1990). Enhancing the effectiveness of self-administered videotape parent training for families with conduct-problem children. Journal of Abnormal Child Psychology, 18(5), 479–492. doi:10.1007/BF00911103

 PubMed Web of Science ®Google Scholar

Webster-Stratton, C. (1992). Individually administered videotape parent training: “who benefits?”. Cognitive Therapy and Research, 16(1), 31–52. doi:10.1007/BF01172955

 Web of Science ®Google Scholar

Webster-Stratton, C., Kolpacoff, M., & Hollingsworth, T. (1988). Self-administered videotape therapy for families with conduct-problem children: Comparison with two cost-effective treatments and a control group. Journal of Consulting and Clinical Psychology, 56(4), 558–566. doi:10.1037/0022-006X.56.4.558

 PubMed Web of Science ®Google Scholar

Webster-Stratton, C., Reid, M., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology, 33(1), 105–124. doi:10.1207/S15374424JCCP3301_11

 PubMed Web of Science ®Google Scholar

Wells, K. C., & Egan, J. (1988). Social learning and systems family therapy for childhood Oppositional Disorder: Comparative treatment outcome. Comprehensive Psychiatry, 29(2), 138–146. doi:10.1016/0010-440X(88)90006-5

 PubMed Web of Science ®Google Scholar

Abrahamse, M. E., Junger, M., Chavannes, E., Coelman, F. J., Boer, F., & Lindauer, R. J. (2012). Parent–child interaction therapy for preschool children with disruptive behaviour problems in the Netherlands. Child and Adolescent Psychiatry and Mental Health, 6, 24. doi:10.1186/1753-2000-6-24

 PubMedGoogle Scholar

Abrahamse, M. E., Junger, M., Van Wouwe, M. A. M. M., Boer, F., & Lindauer, R. J. L. (2016). Treating child disruptive behavior in high-risk families: A comparative effectiveness trial from a community-based implementation. Journal of Child and Family Studies, 25(5), 1605–1622. doi:10.1007/s10826-015-0322-4

 PubMed Web of Science ®Google Scholar

Hanisch, C., Freund-Braier, I., Hautmann, C., Jänen, N., Plück, J., Brix, G., … Döpfner, M. (2010). Detecting effects of the indicated prevention programme for externalizing problem behaviour (PEP) on child symptoms, parenting, and parental quality of life in a randomized controlled trial. Behavioural and Cognitive Psychotherapy, 38(1), 95–112. doi:10.1017/S1352465809990440

 PubMed Web of Science ®Google Scholar

Leung, C., Tsang, S., Heung, K., & Yiu, I. (2009). Effectiveness of Parent-Child Interaction Therapy (PCIT) among Chinese families. Research on Social Work Practice, 19(3), 304–313. doi:10.1177/1049731508321713

 Web of Science ®Google Scholar

Meany-Walen, K. K., Bullis, Q., Kottman, T., & Dillman Taylor, D. (2015). Group Adlerian play therapy with children with off-task behaviors. Journal for Specialists in Group Work, 40(3), 294–314. doi:10.1080/01933922.2015.1056569

 Web of Science ®Google Scholar

Ollendick, T. H., Greene, R. W., Austin, K. E., Fraire, M. G., Halldorsdottir, T., Allen, K. B., … Wolff, J. C. (2016). Parent management training and collaborative & proactive solutions: A randomized control trial for oppositional youth. Journal of Clinical Child & Adolescent Psychology, 45(5), 591–604. doi:10.1080/15374416.2015.1004681

 PubMed Web of Science ®Google Scholar

Shapiro, J. P., Youngstrom, J. K., Youngstrom, E. A., & Marcinick, H. F. (2012). Transporting a manualized treatment for children’s disruptive behavior to a community clinic. Journal of Contemporary Psychotherapy, 42(4), 215–225. doi:10.1007/s10879-012-9206-8

 Google Scholar

Stoltz, S., Van Londen, M., Dekovic, M., De Castro, B. O., Prinzie, P., & Lochman, J. E. (2013). Effectiveness of an individual school-based intervention for children with aggressive behaviour: A randomized controlled trial. Behavioural and Cognitive Psychotherapy, 41(5), 525–548. doi:10.1017/S1352465812000525

 PubMed Web of Science ®Google Scholar