Robust misinterpretation of confidence intervals

Hoekstra, Rink, Morey, Richard D. ORCID: https://orcid.org/0000-0001-9220-3179, Rouder, Jeffrey N. and Wagenmakers, Eric-Jan 2014. Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review 21 (5) , pp. 1157-1164. 10.3758/s13423-013-0572-3

Full text not available from this repository.

Abstract

Null hypothesis significance testing (NHST) is undoubtedly the most common inferential technique used to justify claims in the social sciences. However, even staunch defenders of NHST agree that its outcomes are often misinterpreted. Confidence intervals (CIs) have frequently been proposed as a more useful alternative to NHST, and their use is strongly encouraged in the APA Manual. Nevertheless, little is known about how researchers interpret CIs. In this study, 120 researchers and 442 students—all in the field of psychology—were asked to assess the truth value of six particular statements involving different interpretations of a CI. Although all six statements were false, both researchers and students endorsed, on average, more than three statements, indicating a gross misunderstanding of CIs. Self-declared experience with statistics was not related to researchers’ performance, and, even more surprisingly, researchers hardly outperformed the students, even though the students had not received any education on statistical inference whatsoever. Our findings suggest that many researchers do not know the correct interpretation of a CI. The misunderstandings surrounding p-values and CIs are particularly unfortunate because they constitute the main tools by which psychologists draw conclusions from data.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Psychology
Subjects:	B Philosophy. Psychology. Religion > BF Psychology
Uncontrolled Keywords:	Confidence intervals; significance testing; inference.
Publisher:	Springer
ISSN:	1069-9384
Last Modified:	27 Oct 2022 10:07
URI:	https://orca.cardiff.ac.uk/id/eprint/68942

Citation Data

Cited 237 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item