Reinforcement learning for facilitating human-robot-interaction in manufacturing

Oliff, Harley ORCID: https://orcid.org/0000-0003-4154-8737, Liu, Ying ORCID: https://orcid.org/0000-0001-9319-5940, Kumar, Maneesh ORCID: https://orcid.org/0000-0002-2469-1382, Williams, Michael and Ryan, Michael ORCID: https://orcid.org/0000-0002-8104-0121 2020. Reinforcement learning for facilitating human-robot-interaction in manufacturing. Journal of Manufacturing Systems 56 , pp. 326-340. 10.1016/j.jmsy.2020.06.018

PDF - Accepted Post-Print Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB)

Abstract

For many contemporary manufacturing processes, autonomous robotic operators have become ubiquitous. Despite this, the number of human operators within these processes remains high, and as a consequence, the number of interactions between humans and robots has increased in this context. This is a problem, as human beings introduce a source of disturbance and unpredictability into these processes in the form of performance variation. Despite the natural human aptitude for flexibility, their presence remains a source of disturbance within the system and make modelling and optimization of these systems considerably more challenging, and in many cases impossible. Improving the ability of robotic operators to adapt their behaviour to variations in human task performance is, therefore, a significant challenge to be overcome to enable many ideas in the larger intelligent manufacturing paradigm to be realised. This work presents the development of a methodology to effectively model these systems and a reinforcement learning agent capable of autonomous decision-making. This decision-making provides the robotic operators with greater adaptability, by enabling its behaviour to change based on observed information, both of its environment and human colleagues. The work extends theoretical knowledge on how learning methods can be implemented for robotic control, and how the capabilities that they enable may be leveraged to improve the interaction between robots and their human counterparts. The work further presents a novel methodology for the implementation of a reinforcement learning-based intelligent agent which enables a change in behavioural policy in robotic operators in response to performance variation in their human colleagues. The development and evaluation are supported by a generalized simulation model, which is parameterized to enable appropriate variation in human performance. The evaluation demonstrates that the reinforcement agent can effectively learn to make adjustments to its behaviour based on the knowledge extracted from observed information, and balance the task demands to optimise these adjustments.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Business (Including Economics) Engineering
Publisher:	Elsevier
ISSN:	0278-6125
Date of First Compliant Deposit:	1 July 2020
Date of Acceptance:	26 June 2020
Last Modified:	08 Nov 2023 01:49
URI:	https://orca.cardiff.ac.uk/id/eprint/132913

Citation Data

Cited 35 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item