Development of a minimum checklist to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance

Hoogervorst, Lotje A., Nelissen, Rob G.H.H., Melvin, Tom, Piscoi, Paul, Wilkinson, Chris, Lubbeke, Anne, Gale, Chris P., Epstein, David, Overgaard, Soren, Walmsley, Phil, Szymanski, Piotr, Mohaddes, Maziar, O’Connor, Donal B, Geertsma, Robert E., Hoebert, Joëlle M., Fraser, Alan G., Marang-van de Mheen, Perla J. and CORE-MD study group 2025. Development of a minimum checklist to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance. BMJ Surgery, Interventions, & Health Technologies 7 (1) , e000364. 10.1136/bmjsit-2024-000364

PDF - Published Version Download (812kB)

Abstract

Objectives: Medical device registries in Europe report limited information about their structure and methodological characteristics. This hinders their utility for evaluation of medical device safety and performance under the Medical Device Regulation. This study aimed to define a minimum checklist of items necessary for regulators to assess the quality of evidence produced using registry data for the evaluation of medical device safety and performance. Design: A three-round Delphi panel. Setting: A task within the Coordinating Research and Evidence for Medical Devices project. Participants: 101 experts in the medical device community (healthcare professionals, methodologists, registry experts, regulators, and assessors from notified bodies) were invited. Interventions: Based on a literature review and expert advice, 27 items relating to the quality of registry data and the analysis of medical device safety and performance were selected. In round 1, participants selected which items were required for a minimum checklist. They could also propose new items. Items selected by ≥70% of participants indicated consensus. Remaining items were discussed in round 2, resulting in a final checklist that was ranked by participants for importance (round 3). Main outcome measures: Consensus of items to be included in the minimum checklist. Results: 51 experts participated in round 1, achieving consensus on 18 (67%) items and suggesting 12 items. After discussion in round 2, 5 additional items were selected, resulting in a final set of 15 data quality items and 8 data analysis items. The most important items were ‘completeness of procedures’ (data quality) and ‘definition of outcome analyzed’” (quality of analysis). Conclusions: Reporting all items from the minimum checklist will facilitate judgment of the utility of registry data to evaluate medical devices during post-market surveillance.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Schools > Medicine
Additional Information:	License information from Publisher: LICENSE 1: URL: http://creativecommons.org/licenses/by-nc/4.0/, Start Date: 2025-10-29, Type: open-access
Publisher:	BMJ Publishing Group
Date of First Compliant Deposit:	12 November 2025
Date of Acceptance:	7 October 2025
Last Modified:	13 Nov 2025 02:30
URI:	https://orca.cardiff.ac.uk/id/eprint/182354

Actions (repository staff only)

Edit Item