Xiao, ZhiMin and Kasim, Adetayo and Higgins, Steve (2016) Same difference? Understanding variation in the estimation of effect sizes from educational trials. International Journal of Educational Research, 77. pp. 1-14. DOI https://doi.org/10.1016/j.ijer.2016.02.001
Xiao, ZhiMin and Kasim, Adetayo and Higgins, Steve (2016) Same difference? Understanding variation in the estimation of effect sizes from educational trials. International Journal of Educational Research, 77. pp. 1-14. DOI https://doi.org/10.1016/j.ijer.2016.02.001
Xiao, ZhiMin and Kasim, Adetayo and Higgins, Steve (2016) Same difference? Understanding variation in the estimation of effect sizes from educational trials. International Journal of Educational Research, 77. pp. 1-14. DOI https://doi.org/10.1016/j.ijer.2016.02.001
Abstract
By applying four analytic models with comparable outcomes and covariates to a dataset of 20 outcomes from 17 educational trials, we found results closely matching in well-powered studies without serious implementation problems. The interventions and evaluations were all funded by the Education Endowment Foundation and independently evaluated. We demonstrated that when an analysis takes little account of research design, or where there were difficulties with implementation and data collection, point estimates of effect differ and estimates of precision vary. This adds to the challenge of understanding the comparative impact of interventions and deciding which are worth scaling up.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Evaluation; Effect size; RCT; Multilevel modelling; Bayesian MLM |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Health and Social Care, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 20 Sep 2021 08:36 |
Last Modified: | 16 May 2024 20:51 |
URI: | http://repository.essex.ac.uk/id/eprint/30843 |
Available files
Filename: Same difference?.pdf
Licence: Creative Commons: Attribution-Noncommercial-No Derivative Works 3.0