The three stages of building and testing mid-level theories in a realist RCT: a theoretical and methodological case-example

Jamal, Farah, Fletcher, Adam ORCID: https://orcid.org/0000-0001-6705-7659, Shakleton, Nichola, Elbourne, Diana, Viner, Russell and Bonell, Chris 2015. The three stages of building and testing mid-level theories in a realist RCT: a theoretical and methodological case-example. Trials 16 , 466. 10.1186/s13063-015-0980-y

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Background Randomised controlled trials (RCTs) of social interventions are often criticised as failing to open the ‘black box’ whereby they only address questions about ‘what works’ without explaining the underlying processes of implementation and mechanisms of action, and how these vary by contextual characteristics of person and place. Realist RCTs are proposed as an approach to evaluation science that addresses these gaps while preserving the strengths of RCTs in providing evidence with strong internal validity in estimating effects. Methods In the context of growing interest in designing and conducting realist trials, there is an urgent need to offer a worked example to provide guidance on how such an approach might be practically taken forward. The aim of this paper is to outline a three-staged theoretical and methodological process of undertaking a realist RCT using the example of the evaluation of a whole-school restorative intervention aiming to reduce aggression and bullying in English secondary schools. Discussion First, informed by the findings of our initial pilot trial and sociological theory, we elaborate our theory of change and specific a priori hypotheses about how intervention mechanisms interact with context to produce outcomes. Second, we describe how we will use emerging findings from the integral process evaluation within the RCT to refine, and add to, these a priori hypotheses before the collection of quantitative, follow-up data. Third, we will test our hypotheses using a combination of process and outcome data via quantitative analyses of effect mediation (examining mechanisms) and moderation (examining contextual contingencies). The results are then used to refine and further develop the theory of change. Conclusion The aim of the realist RCT approach is thus not merely to assess whether the intervention is effective or not, but to develop empirically informed mid-range theory through a three-stage process. There are important implications for those involved with reporting and reviewing RCTs, including the use of new, iterative protocols.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Social Sciences (Includes Criminology and Education)
Subjects:	H Social Sciences > H Social Sciences (General)
Uncontrolled Keywords:	Realist; Randomised controlled trials; Complex interventions; Social experiments; Generalisability; Social epidemiology; Schools
Publisher:	BioMed Central
ISSN:	1745-6215
Date of First Compliant Deposit:	5 December 2016
Date of Acceptance:	28 September 2015
Last Modified:	06 May 2023 00:02
URI:	https://orca.cardiff.ac.uk/id/eprint/96595

Citation Data

Cited 43 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item