Measuring harm and informing quality improvement in the Welsh NHS: the longitudinal Welsh national adverse events study

Mayor, Sharon, Baines, Elizabeth, Vincent, Charles, Lankshear, Annette ORCID: https://orcid.org/0000-0002-2418-3783, Edwards, Adrian ORCID: https://orcid.org/0000-0002-6228-4446, Aylward, Mansel, Hogan, Helen, Harper, Paul ORCID: https://orcid.org/0000-0001-7894-4907, Davies, Jan, Mamtora, Ameet, Brockbank, Emily and Gray, Jonathon 2017. Measuring harm and informing quality improvement in the Welsh NHS: the longitudinal Welsh national adverse events study. Health Services and Delivery Research 5 (9) 10.3310/hsdr05090

Preview

PDF - Published Version Download (136kB) | Preview

Abstract

Background, objectives and setting Despite global activity over the past 15 years to improve patient safety, the measurement of adverse events (AEs) remains challenging. Objectives We aimed to obtain definitive longitudinal data on harm across NHS Wales and to compare the performance of the Global Trigger Tool (GTT) with the two-stage retrospective review process, using our findings to consolidate an approach to the ongoing surveillance of harm in Wales. Data sources Eleven of the 13 major Welsh NHS hospitals. Review methods The two-stage retrospective review methodology was used to quantify harm across NHS Wales. In total, 4536 inpatient episodes were screened for AEs by research nurses. Records that were highly suggestive of AEs were further assessed by physicians. NHS-led teams undertook GTT reviews on the same case notes. Results At least one AE was determined in 10.3% of episodes of care [95% confidence interval (CI) 9.4% to 11.2%] and 51.5% were preventable (95% CI 46.9% to 56.1%). The percentage of patients identified with AEs using the GTT methodology was lower, at 9.0% (95% CI 8.82% to 9.18%). Differences in AEs were evident across study sites. Methods were developed to profile the risk of AEs in individual organisations by producing signatures of harm for each NHS site. Analysis indicated that neither the GTT nor the two-stage process was a candidate tool for routine surveillance, and a hybrid one-stage tool (Harm2), based on phase 1 findings, was developed for ongoing AE monitoring. Using the Harm2 tool, AEs were identified in 371 out of 3352 randomly selected discharge reviews (11.3%, 95% CI 10.2% to 12.4%), and 59.6% (95% CI 55.3 to 63.9) of these were preventable. In a cohort of randomly selected deceased patient reviews, at least one AE was determined in 315 out of 1018 admissions (30.1%, 95% CI 28.1% to 33.8%), and 61.7% (95% CI 57.5% to 65.9%) of these were preventable. Factors associated with AEs in the randomly selected discharge reviews included having peripheral vascular disease [odds ratio (OR) 2.52], hemiplegia (OR 2.27) or dementia (OR 2.27). No association with chronic disease was identified in the deceased episodes of care. Limitations The dependence on our health service partners in identifying notes to be reviewed, along with the small sample examined each month, limits the generalisability of these findings and rates were not standardised for hospital and size and level of services provided. We cannot rule out the possibility that the rates we report may be underestimated. Conclusion The extent of harm detected across NHS Wales using both the two-stage retrospective review process and the new Harm2 tool conforms to the findings in the literature, but this is the first longitudinal study using these methods. With training and using a structured review process, non-physician reviewers can undertake case note review efficiently and effectively, and the rates of AEs and of the preventability and the breakdown of problems in care conform to those reported in studies in which physicians undertake these classifications. Whether the patient died or was discharged alive significantly influences the rate and composition of AEs. The Harm2 tool performed with moderate reliability in the determination of AEs. Future work Future large-scale studies should attempt to specify types of AEs, such as hospital-acquired infections and surgical complications, to enable the surveillance of the specific types of harm as well as the overall level of AEs. In the longer term, we need to automate harm surveillance and set measures of harm alongside measures of the beneficial effects of health care. Funding The National Institute for Health Research Health Services and Delivery Research programme.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Mathematics Medicine
Subjects:	Q Science > QA Mathematics R Medicine > R Medicine (General)
Additional Information:	All NIHR Journals Library reports have been produced under the terms of a commissioning contract issued by the Secretary of State for Health. Reports may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Permission to reproduce material from a published report is covered by the UK government’s non-commercial licence for public sector information.
Publisher:	NIHR Journals Library
ISSN:	2050-4349
Funders:	NIHR HS&DR
Date of First Compliant Deposit:	29 March 2017
Date of Acceptance:	30 June 2016
Last Modified:	10 May 2023 22:24
URI:	https://orca.cardiff.ac.uk/id/eprint/99483

Actions (repository staff only)

Edit Item