Development and validation of the transcranial magnetic stimulation reporting assessment tool (TMS-RAT)

Székely, Orsolya, Holmes, Nicholas P., Ashton, Jennifer, Breuer, Friederike, Chen, Hsin-Yuan, Di Chiaro, Nunzia Valentina, Duport, Arnaud, Frangou, Polytimi, Gwynne, Louisa, Hassan, Umair, Lowe, Cassandra J., Mathias, Brian, Peng, Nan, Pepper, Jessica L., Phylactou, Phivos, Szymanska, Malgorzata Anna and Tamè, Luigi 2026. Development and validation of the transcranial magnetic stimulation reporting assessment tool (TMS-RAT). Brain Stimulation 19 (5) , 103155. 10.1016/j.brs.2026.103155

PDF - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (3MB)

Abstract

Background A standardised tool for comprehensive reporting can improve transparency, support consistent documentation, and enable comparison across transcranial magnetic stimulation (TMS) studies. To date, the most used reporting checklist lacks definitions of full reporting and was not initially evaluated for usability or reliability. Methods We developed the TMS Reporting Assessment Tool (TMS-RAT), a comprehensive reporting framework that provides clear definitions and examples for its items. We tested the usability and reliability of the TMS-RAT by rating all studies published between 1987 and 31st January 2025 using afferent conditioning (n = 333), protocols that encompass many reporting categories identified during tool development. Seventeen independent raters contributed across three development phases, a validation phase, and a retest phase, with naïve raters introduced in each phase. Iterative refinements of the tool were informed by inter-rater reliability, qualitative rater feedback, and consultation with external TMS experts. Results We present two versions of the tool: the 72-item TMS-RAT v1.0, designed to guide comprehensive reporting, and the TMS-RAT v1.1, a subset of 50 items with the highest inter-rater (overall AC1 = 0.78, range = [0.60–0.99]) and test-retest reliability (overall AC1 = 0.82, range = [0.65–1.0]), intended for retrospective evaluation of reporting in systematic reviews and meta-analyses. The tool has not been validated outside the afferent conditioning literature or on studies not recording motor evoked potentials. Conclusion The TMS-RAT is a comprehensive, reliable tool that seeks to improve transparency and reproducibility in TMS research. We aim to extend the tool to cover additional TMS protocols.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Schools > Healthcare Sciences
Publisher:	Elsevier
ISSN:	1935-861X
Date of First Compliant Deposit:	20 July 2026
Date of Acceptance:	30 June 2026
Last Modified:	20 Jul 2026 11:15
URI:	https://orca.cardiff.ac.uk/id/eprint/188316

Actions (repository staff only)

Edit Item