Educators rely on professional development to improve instruction. Research suggests that instructional coaching which utilizes specific coaching practices, such as classroom observation followed by debriefing and goal setting, and integrated strategies such as co-teaching, bring about significant change in instructional practices. The goal of this study was to gauge whether or not the use of a web-based data collection and coaching tool led to changes in focal classroom practices and whether or not improving those practices was, in turn, related to students’ academic and self-regulation gains across the prekindergarten year. To examine the implementation and impact of the coaching app, researchers conducted a cluster-randomized trial, comparing the classroom practices of teachers receiving business-as-usual coaching to those being coached with the app. Classroom observation data showed no significant differences in teachers’ practices across the school year, and student achievement did not differ between conditions. Qualitative data from coach interviews, however, revealed that coaches using the app were more likely to employ integrated coaching strategies associated with improving instruction. The lack of differences in terms of teachers’ practices and students’ assessment gains may be due to a lack of statistical power and inconsistent professional development implementation associated with ongoing disruptions due to the pandemic. Further research examining the effectiveness of educational technologies supporting professional development is needed.
more »
« less
Cost‐Effectiveness of Early Childhood Interventions to Enhance Preschool: Evidence from a Randomized Experiment in Head Start Centers Enrolling Historically Underserved Populations
We evaluate the cost‐effectiveness of two early childhood interventions that use instructional coaching and parent coaching as levers for improvement. The study design allows us to compare the individual effects of each intervention as well as their combined effect on student outcomes. We find that teachers receiving instructional coaching improve their use of evidence‐based instructional practices, while families receiving parent coaching show increases in numerous responsive parenting behaviors associated with positive child outcomes. Both interventions demonstrate positive impacts on students, but only parent coaching shows statistically significant effects across a range of student outcomes. Instructional coaching alone is substantially less costly and may therefore be the most cost‐effective of the three treatment conditions; however, small sample sizes limit our ability to reach definitive conclusions. Policy simulations suggest that implementing these interventions could raise the overall cost‐effectiveness of Head Start by at least 16 percent.
more » « less- PAR ID:
- 10119929
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Journal of Policy Analysis and Management
- Volume:
- 38
- Issue:
- 4
- ISSN:
- 0276-8739
- Page Range / eLocation ID:
- p. 891-917
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
This study introduces recent advances in statistical power analysis methods and tools for designing and analyzing randomized cost-effectiveness trials (RCETs) to evaluate the causal effects and costs of social work interventions. The article focuses on two-level designs, where, for example, students are nested within schools, with interventions applied either at the school level (cluster design) or student level (multisite design). We explore three statistical modeling strategies—random-effects, constant-effects, and fixed-effects models—to assess the cost-effectiveness of interventions, and we develop corresponding power analysis methods and tools. Power is influenced by effect size, sample sizes, and design parameters. We developed a user-friendly tool, PowerUp!-CEA, to aid researchers in planning RCETs. When designing RCETs, it is crucial to consider cost variance, its nested effects, and the covariance between effectiveness and cost data, as neglecting these factors may lead to underestimated power.
-
What are critical features of science curriculum materials that impact student and teacher outcomes?more » « less
Abstract Large investments are made in curriculum materials with the goal of supporting science education reform. However, relatively little evidence is available about what features of curriculum materials really matter to impact student and teacher learning. To address this need, the current study examined curriculum features associated with student and teacher outcomes. We reviewed sample curriculum materials and documentation reporting on the instructional outcomes of 51 research‐based K–12 science curriculum materials. Our findings reveal that teacher supports, rather than student supports, had positive impacts on both student and teacher outcomes. Specifically, positive student outcomes were associated with curriculum materials with a larger scope and with materials that provide teachers with information about students’ ideas and recommended instructional strategies. Positive teacher outcomes were associated with the presence of information about targeted standards and recommended instructional strategies. Relatively fewer studies reported on teacher outcomes, and evidence about other dimensions of curriculum materials impact (e.g., spread, sustainability) was difficult to find. Overall, these results reveal the broad importance of embedding teacher supports and ensuring sufficient scope of content across coordinated curriculum units to support the development of conceptual understanding over time. Implications for the design of new curriculum materials and further research are discussed.
-
more » « less
Impacts of rational number interventions among U.S. students in Grades 3 through 9 with mathematics difficulties are examined using a systematic review and meta-analysis. The primary goal of the meta-analysis was to identify instructional practices that are key drivers of student impacts. From approximately 1,200 published and unpublished study records, we identified 28 studies that met our inclusion criteria and coded the interventions for their instructional practices, intervention characteristics, and study design features. The random-effects mean effect size across all 28 studies (90 effect sizes) was 0.68 ( SE = 0.08, p < .001, 95% confidence interval [CI]: [0.51, 0.85]). The 95% prediction interval was −0.36 to 1.8. Using meta-regression techniques, we found the teaching of mathematical language ( β = 0.50) and the use of the number line ( β = 0.47) during intervention to be significantly associated with positive impacts when adjusted for controls. We discuss implications for intervention practice and study limitations along with the challenges of examining complex, multifaceted interventions.
-
more » « less
Addressing the educational needs of students in math early on is critical given that early gaps in math skills widen further over the course of schooling. This study examines the effectiveness and costs of Kentucky’s Math Achievement Fund—a unique state-level program that combines targeted interventions, peer-coaching, and close collaboration among teachers to improve math achievement in grades K–3. The program is found to improve not only math achievement, but also reading test scores and non-test outcomes including student attendance and disciplinary incidents. The benefits exist across students from various socioeconomic backgrounds, and they are slightly higher for racial minorities.
