Towards human-centric manufacturing: A reinforcement learning method for physical exertion alleviation in HRCA

You, Yingchao and Ji, Ze ORCID: https://orcid.org/0000-0002-8968-9902 2025. Towards human-centric manufacturing: A reinforcement learning method for physical exertion alleviation in HRCA. Robotics and Computer-Integrated Manufacturing 95 , 103025. 10.1016/j.rcim.2025.103025

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

The advancement of the manufacturing system towards more human-centric, emphasising not only efficiency but also the well-being of workers. However, task planning in human–robot collaborative assembly (HRCA) remains challenging, when considering the physical exertion alleviation of workers, due to the complexities of physical exertion estimation and variations in human assembly operations. Different from conventional methods, this paper proposes a task planning method for physical exertion alleviation of workers in HRCA by leveraging the reinforcement learning (RL) method to train a policy. Initially, a musculoskeletal model-based method driven by human movement data to assess workers’ physical exertion is integrated into this work. Then, the policy is trained in a DuelingDQN-AM framework, utilising a carefully designed reward function informed by the estimated physical exertion of workers. The effectiveness of this approach has been validated through a simulation experiment and a proof-of-concept real assembly experiment. Simulation experiment results demonstrate the advantages of DuelingDQN-AM over other methods in terms of convergence speed and stability across multiple cycles and products of varying complexity. Additionally, real-world experiment results show that the RL strategy reduced physical exertion by 15.63 compared to the baseline method.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Schools > Engineering
Publisher:	Elsevier
ISSN:	0736-5845
Date of First Compliant Deposit:	22 April 2025
Date of Acceptance:	29 March 2025
Last Modified:	23 Apr 2025 12:30
URI:	https://orca.cardiff.ac.uk/id/eprint/177820

Actions (repository staff only)

Edit Item