Bartoš, František, Sarafoglou, Alexandra, Aczel, Balazs, Hoogeveen, Suzanne, Chambers, Chris  ORCID: https://orcid.org/0000-0001-6058-4114 and Wagenmakers, Eric-Jan
2025.
Introducing the Journal of Robustness Reports [Editorial].
Journal of Robustness Reports
10.21468/JRobustRep.0-Editorial
|
Preview |
PDF
- Published Version
Available under License Creative Commons Attribution. Download (1MB) | Preview |
Abstract
The vast majority of empirical research articles report a single primary analysis outcome that is the result of a single analysis plan, executed by a single analysis team (usually the team that also designed the experiment and collected the data). However, recent many-analyst projects have demonstrated that different analysis teams generally adopt a unique approach and that there exists considerable variability in the associated conclusions. There appears to be no single optimal statistical analysis plan, and different plausible plans need not lead to the same conclusion. A high variability in outcomes signals that the conclusions are relatively fragile and dependent on the specifics of the analysis plan. Crucially, without multiple teams analyzing the data, it is difficult to gauge the extent to which the conclusions are robust. We have recently proposed that empirical articles of particular scientific interest or societal importance are accompanied by two or three short reports that summarize the results of alternative analyses conducted by independent experts [F. Bartoš et al., Nat. Hum. Behav. (2025)]. In order to showcase the practical feasibility and epistemic benefits of this approach we have founded the Journal of Robustness Reports, which is dedicated to publishing short reanalyses of empirical findings. This editorial describes the scope and the workflow of the Journal of Robustness Reports including the type and format of the published articles. We hope that the Journal of Robustness Reports will help make reanalyses of published findings the norm across the empirical sciences.
| Item Type: | Short Communication |
|---|---|
| Date Type: | Publication |
| Status: | Published |
| Schools: | Schools > Psychology |
| Publisher: | SciPost Foundation |
| ISSN: | 3051-3200 |
| Date of First Compliant Deposit: | 1 May 2025 |
| Date of Acceptance: | 9 April 2025 |
| Last Modified: | 12 Feb 2026 10:14 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/177998 |
Actions (repository staff only)
 |
Edit Item |
Dimensions
Dimensions