Just because we can does not mean we should: Responsible and meaningful uses of administrative data in the evaluation of complex interventions in children’s social care

Holmes, Lisa, Hood, Rick, Mc Grath-Lone, Louise, Méndez Pineda, Rocio, Park, Jeongeun, Scourfield, Jonathan ORCID: https://orcid.org/0000-0001-6218-8158, Soraghan, Joanna and Woodman, Jenny 2026. Just because we can does not mean we should: Responsible and meaningful uses of administrative data in the evaluation of complex interventions in children’s social care. The British Journal of Social Work , bcag017. 10.1093/bjsw/bcag017

PDF - Published Version Available under License Creative Commons Attribution. Download (963kB)

Abstract

Administrative data are increasingly used in impact evaluations of complex interventions in children’s social care (CSC), offering advantages such as longitudinal, population-level coverage, and reduced burden on families and practitioners. However, administrative data alone are insufficient to support meaningful and responsible evaluation. Drawing on insights from two webinars hosted by the Children’s Social Care Data User Group, which focused on presentations about uses of administrative data for evaluations, we identify three core challenges that administrative data cannot resolve in isolation: understanding the intervention, creating a valid comparison group, and measuring relevant outcomes. We explore how the absence of detailed programme theory, limited information on intervention implementation, and lack of nuanced outcome measures constrain the interpretability of evaluation findings. We highlight the risks of confounding in quasi-experiments when key contextual variables are missing from administrative datasets. While we acknowledge the value of administrative data, we caution against over-reliance on datasets designed for operational rather than evaluative purposes. We offer recommendations for more robust evaluation practice, including commitments to building programme theory, prospective data collection, capturing lived experiences, and transparent reporting of study limitations. These recommendations align with emerging policy frameworks and evaluation strategies but require adequate time, funding, and interdisciplinary collaboration.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Schools > Social Sciences (Includes Criminology and Education) Research Institutes & Centres > Children’s Social Care Research and Development Centre (CASCADE)
Additional Information:	License information from Publisher: LICENSE 1: URL: https://creativecommons.org/licenses/by/4.0/, Type: cc-by
Publisher:	Oxford University Press
ISSN:	0045-3102
Date of First Compliant Deposit:	18 March 2026
Date of Acceptance:	21 January 2026
Last Modified:	18 Mar 2026 11:45
URI:	https://orca.cardiff.ac.uk/id/eprint/185839

Actions (repository staff only)

Edit Item