Integrating Literacy and Science Instruction in Kindergarten: Results From the Efficacy Study of Zoology One

Figures & data

Table 1. ITT and TOT student samples and attrition.

	Treatment	Control	Total
ITT Sample
Cohort 1	239	253	492
Cohort 2	148	152	300
Combined	387	405	792
TOT Sample^a
Cohort 1	479	472	951
Cohort 2	340	298	638
Combined	819	770	1,589
Partial/no data^b
Cohort 1	123	115	238
Cohort 2	166	130	296
Combined	289	245	534
All known students
Cohort 1	602	587	1189
Cohort 2	506	428	934
Combined	1108	1015	2,123
TOT attrition
Cohort 1	20%	20%	20%
Cohort 2	33%	30%	32%
Combined	26%	24%	25%

Notes: ^aTOT sample includes ITT sample and early joiners. ^bStudents with partial/no data include those who enrolled after fall assessments (140), students who unenrolled before the spring assessment (141), those who enrolled but never attended (140), those who were absent, ineligible, or did not consent (113). All known students are the sum of TOT sample and students with partial/no data.

Table 2. Baseline comparisons by sample and subgroup.

	ITT		TOT
	Control	Treatment	Control	Treatment
Student demographics
ELL	9%	8%	8%	7%
Female	49%	52%	50%	51%
FFT	62%	68%	70%	74%
IEP	6%	9%	7%	8%
Non English Home Language	17%	16%	14%	13%
Fall assessment means (and SD)
WRMT Readiness Cluster	84.27	83.91	81.37	80.68
	(16.60)	(17.20)	(15.90)	(15.90)
DRA Level	0.74	0.81	0.64	0.67
	(0.70)	(0.77)	(0.65)	(0.72)

Note: sample groups were statistically significant on all measured student attributes measured and baseline assessments.

Table 3. ITT and TOT impact analysis results with baseline equivalence findings.

	Baseline	WRMT				District tests		Other assessments
	RRC	WI	WA	WC	PC	LNF	DRA	KRMS	KTEA-3	Science
Intent to treat
Sample size	792	792	792	792	792	471	783	737	518	295
Random effects
School intercept	52.87*	0.93	0.54	0.27	1.74	0.00	0.04	0.00	2.52	20.79
School treatment effect	–	6.19	2.42	4.41	1.33	101.26	0.00	0.00	4.08	0.52
Classroom intercept	0.00	11.49*	5.10*	0.90	4.13	14.44	0.25**	0.00	8.84*	14.07
Residual (student)	237.1**	88.72**	65.3**	45.1**	79.80**	499.38**	0.64**	0.11**	68.81*	225.24**
Fixed effects
Constant	83.70	40.76	55.15	59.06	51.22	−37.03	−1.08	2.35	58.69*	24.07*
Treatment	0.11	1.37	−0.27	1.07	1.90*	8.35*	0.07	0.11*	−0.10	−0.48
Fall RC	–	0.58**	0.42*	0.38**	0.47**	1.01**	0.05**	0.00	0.45**	0.45**
Treatment on the treated
Sample size	1,589	1,589	1,589	1,589	1,589	916	1,562	1,387	933	626
Random effects
School intercept	38.79*	1.64	0.00	0.00	0.82	0.00	0.05	0.00	2.38	12.53
School treatment effect	–	0.51	2.68	4.24*	0.00	58.20	0.00	0.00	0.78	0
Classroom intercept	2.28	14.57**	5.51**	0.80	3.10*	39.62**	0.23**	0.00	9.37*	0
Residual (student)	216.38**	74.54**	57.90**	34.50*	70.90*	507.51**	0.62**	0.11**	58.96**	218.58**
Fixed effects
Constant	81.48	40.45	57.40	64.30	52.74	−44.24	−1.30	2.26	58.39	19.24
Treatment	−0.27	0.66	−0.55	0.83	1.59*	5.00	0.13	0.10**	0.82	1.67
Fall RC	–	0.58**	0.40**	0.34**	0.46**	1.11**	0.05**	0.00*	0.44**	0.48**

Notes: *p < 0.05; ** p < 0.01. RRC: WRMT Reading Readiness Cluster; WA: WRMT Word Attack subtest; WC: WRMT Word Comprehension subtest; PC: WRMT Passage Comprehension subtest; KRMS: Kindergarten Reading Motivation Scale; LNF: AimsWeb Letter Naming Fluency; WI: WRMT Word Identification subtest; DRA: Developmental Reading Assessment; KTEA: Kauffman Test of Educational Achievement.

Table 4. Standardized treatment effects for student samples and subsamples.

	Baseline	WRMT				District tests			Other assessments
	RRC	WI	WA	WC	PC	LNF	DRA	KRMS	KTEA-3	Science
Intent to treat
All	0.01	0.10	−0.03	0.13	0.17*	0.27*	0.05	0.32*	−0.01	−0.03
Female	−0.03	0.09	−0.03	0.08	0.08	0.25	0.01	0.28*	0.07	−0.14
Male	0.04	0.14	0.03	0.21	0.30*	0.31*	0.14	0.33*	−0.05	−0.06
FFT	0.04	0.04	−0.12	0.06	0.12	0.18	0.02	0.20*	−0.04	0.06
Non-FFT	−0.03	0.17	0.22	0.29	0.22	0.33*	0.06	0.44*	0.03	−0.39
ELL	−0.47	−0.01	−0.12	−0.11	−0.01	0.39	0.05	−0.04	0.24	−0.35
Non-ELL	0.03	0.08	−0.03	0.16	0.14	0.21	0.01	0.33*	−0.07	0.01
IEP	−0.09	0.20	−0.13	0.30	0.14	0.51	0.49	0.14	0.48	0.57
Non-IEP	0.00	0.08	−0.02	0.14	0.13	0.20	0.00	0.31*	−0.05	−0.03
English home	0.04	0.11	−0.05	0.14	0.17	0.26	0.03	0.32*	−0.02	−0.07
Non-Engl home	−0.18	0.05	0.08	0.07	0.12	0.38	0.29	0.33	0.08	0.38
Treatment on the treated
All	−0.02	0.05	−0.05	0.10	0.14*	0.16	0.10	0.29*	0.07	0.10
Female	−0.03	0.02	−0.08	0.06	0.09	0.15	0.03	0.21*	0.14	0.09
Male	−0.03	0.09	−0.02	0.14	0.20*	0.19	0.19	0.35*	0.03	0.07
FFT	−0.04	0.03	−0.09	0.04	0.12*	0.16	0.14	0.25*	0.06	0.10
Non-FFT	0.03	0.05	0.05	0.24	0.17	0.17	0.00	0.34*	0.04	0.05
ELL	−0.09	0.05	−0.05	0.05	0.14	0.50*	0.14	0.22	0.16	−0.59
Non-ELL	0.00	0.04	−0.05	0.12	0.14*	0.12	0.09	0.28*	0.05	0.11
IEP	0.00	0.11	−0.11	0.16	0.12	0.32	0.29*	0.16	0.36	0.44
Non-IEP	−0.02	0.05	−0.03	0.11	0.14*	0.14	0.09	0.30*	0.05	0.09
English home	−0.01	0.07	−0.05	0.12	0.15*	0.15	0.10	0.28*	0.10	0.07
Non-Engl home	−0.04	0.00	−0.09	0.02	0.06	0.32	0.13	0.36	0.06	0.14

Notes: *p < 0.05. FFT: Free From TAPE (free & reduced lunch indicator); RRC: WRMT Reading Readiness Cluster; WA: WRMT Word Attack subtest; WC: WRMT Word Comprehension subtest; PC: WRMT Passage Comprehension subtest; KRMS: Kindergarten Reading Motivation Scale; LNF: AimsWeb Letter Naming Fluency; WI: WRMT Word Identification subtest; DRA: Developmental Reading Assessment; KTEA: Kauffman Test of Educational Achievement.

Table 5. Effect of teacher fidelity on student mediators and outcomes.

	Baseline	WRMT				District tests		Other assessments
	RRC	WI	WA	WC	PC	LNF	DRA	KRMS	KTEA-3	Science
Intent to treat
Sample size	210	210	210	210	210	129	207	197	121	61
Random effects
School intercept	14.82∼	0.00	2.09	0.62	0.00	158.28	0.00	0.00	7.15	2.56
Classroom intercept	0.00	6.99∼	0.00	0.33	2.03	0.00	0.17	0.00	0.00	0.00
Residual (student)	226.19**	89.63**	51.11**	29.17**	74.39**	565.82**	0.58**	0.09**	54.03**	191.20**
Fixed effects
Constant	79.35**	44.17**	61.84**	67.29**	55.40**	−34.35*	−0.78*	2.36**	65.12**	13.93
Teacher fidelity	5.70*	4.40*	2.73*	1.88*	2.75∼	0.15	0.26	0.04	3.09	−11.23
Fall RC	–	0.51**	0.31**	0.27**	0.41**	1.04**	0.04**	0.00	0.33**	0.56**
Treatment on the treated
Sample size	423	423	423	423	423	232	414	395	243	156
Random effects
School intercept	15.21*	0.00	0.93	0.27	0.00	92.62∼	0.00	0.00	4.02	0.37
Classroom intercept	0.00	7.80*	3.25	0.14	1.53	0.00	0.20	0.00	0.00	0.00
Residual (student)	199.71**	71.11**	53.12**	25.37**	68.05**	537.85**	0.63**	0.09**	50.81**	197.74**
Fixed effects
constant	77.74**	43.94**	61.74**	69.49**	56.98**	−41.25**	−1.22**	2.35**	60.85**	10.91
Teacher fidelity	3.98∼	4.11*	2.40*	1.79*	1.40	−2.38	0.12	0.03	4.57*	−4.90
Fall RC	–	0.51**	0.31**	0.24**	0.41**	1.13**	0.05**	0.00	0.38**	0.59**

Notes: **p < 0.001,*p < 0.05, ∼p < 0.10, Treatment group only comparing students of teachers with highest and lowest fidelity (quartiles). RRC: WRMT Reading Readiness Cluster; WA: WRMT Word Attack subtest; WC: WRMT Word Comprehension subtest; PC: WRMT Passage Comprehension subtest; KRMS: Kindergarten Reading Motivation Scale; LNF: AimsWeb Letter Naming Fluency; WI: WRMT Word Identification subtest; DRA: Developmental Reading Assessment; KTEA3: Kauffman Test of Educational Achievement.

Table 6. Differences in instructional program between treatment and control.

Program	Treatment	Control
District endorsed programs
Saxon	8%	91%
Lexia	17%	59%
Ready gen	3%	75%
Self-created programs	75%	97%
Teacher reports using “other” programs	50%	94%
Mean number of programs reported	3	6

Note: Quantities rounded to the nearest whole number.

Table 7. Average incremental cost per student of Zoology One.

Ingredient	Treatment quantity	Control quantity	Unit	Total cost	Distribution
Personnel					School	Home
Teaching time	170	170	Min/day
School principal	1	1	Principal
Teacher's assistant	1	1	Assistant
Home reading	40	20	Hours	$160		$160
Training
Coaching sessions	10	0	Sessions	$150	$150
Materials
ARC core materials	1	0	Kit	$160	$160
Additional programs	2	6	Program	−$40	−$40
Data and technology
Computer	1	1	Item
SchoolPace	1	0	Year	$40	$40
Facilities
Reading nook in classroom	1	1	Nook
Total cost:				$480	$320	$160
					67%	33%

Notes: Total costs reflect the incremental resources to produce effects (treatment—control). We use constant 2018 U.S. dollar, rounded to the nearest ten. Averages are weighted to account for the size of program groups. We amortized costs of ingredients with useful life beyond one year using a 3.5% discount rate.