Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

A framework for fostering transparency in shared artificial intelligence models by increasing visibility of contributions

Barclay, Iain, Taylor, Harrison ORCID: https://orcid.org/0000-0001-5040-0772, Preece, Alun ORCID: https://orcid.org/0000-0003-0349-9057, Taylor, Ian ORCID: https://orcid.org/0000-0001-5040-0772, Verma, Dinesh and de Mel, Geeth 2021. A framework for fostering transparency in shared artificial intelligence models by increasing visibility of contributions. Concurrency and Computation: Practice and Experience 33 (19) , e6129. 10.1002/cpe.6129

[thumbnail of TransparencyFramework.pdf]
Preview
PDF - Accepted Post-Print Version
Download (279kB) | Preview

Abstract

Increased adoption of artificial intelligence (AI) systems into scientific workflows will result in an increasing technical debt as the distance between the data scientists and engineers who develop AI system components and scientists, researchers and other users grows. This could quickly become problematic, particularly where guid- ance or regulations change and once-acceptable best practice becomes outdated, or where data sources are later discredited as biased or inaccurate. This paper presents a novel method for deriving a quantifiable metric capable of ranking the overall transparency of the process pipelines used to generate AI systems, such that users, auditors and other stakeholders can gain confidence that they will be able to validate and trust the data sources and contributors in the AI systems that they rely on. The methodology for calculating the metric, and the type of criteria that could be used to make judgements on the visibility of contributions to systems are eval- uated through models published at ModelHub and PyTorch Hub, popular archives for sharing science resources, and is found to be helpful in driving consideration of the contributions made to generating AI systems and approaches towards effective documentation and improving transparency in machine learning assets shared within scientific communities

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Wiley
ISSN: 1532-0626
Date of First Compliant Deposit: 26 November 2020
Date of Acceptance: 20 November 2020
Last Modified: 12 Nov 2023 19:33
URI: https://orca.cardiff.ac.uk/id/eprint/136638

Citation Data

Cited 3 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics