Learning manipulation skills with demonstrations for the swing process control of dredgers

Wei, Changyun, Bai, Haonan, Wei, Yi, Ji, Ze ORCID: https://orcid.org/0000-0002-8968-9902 and Liu, Zenghui 2022. Learning manipulation skills with demonstrations for the swing process control of dredgers. Ocean Engineering 246 , 110545. 10.1016/j.oceaneng.2022.110545

PDF - Accepted Post-Print Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB)

Abstract

The Cutter Suction Dredger (CSD) is one of the key equipment dedicated to the construction and maintenance projects of harbours, ports and navigational channels. Among the dredging manipulations, the swing process is the most tedious and recurring work for human operators, which often leads to accidents because of carelessness or fatigue of the operators. This paper aims at producing a learning approach for the intelligent control of the swing process of a CSD so as to release human operators from such a boring and heavy task. To this end, the swing process control is formulated as a sequential decision making problem, and Deep Reinforcement Learning (DRL) is employed to design the learning approach based on deterministic policy gradient. The novel feature of the proposed approach is that the manipulation skills are obtained via trial-and-error interactions with a predicting network constructed by human demonstration data. In our approach, human demonstrations can provide a channel to predict state transitions, and also can regulate the exploration procedure for the learning agent. In addition, we carry out empirical studies to investigate how to treat the demonstration data with regard to self exploration, and the experimental results show that the proposed approach provides an effective means of controlling the swing process of CSDs.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Engineering
Publisher:	Elsevier
ISSN:	0029-8018
Date of First Compliant Deposit:	10 January 2022
Date of Acceptance:	3 January 2022
Last Modified:	07 Nov 2023 01:59
URI:	https://orca.cardiff.ac.uk/id/eprint/146498

Actions (repository staff only)

Edit Item