Deep reinforcement learning with heuristic corrections for UGV navigation

Wei, Changyun, Li, Yajun, Ouyang, Yongping and Ji, Ze ORCID: https://orcid.org/0000-0002-8968-9902 2023. Deep reinforcement learning with heuristic corrections for UGV navigation. Journal of Intelligent and Robotic Systems 109 , 18. 10.1007/s10846-023-01950-y

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview

Abstract

Mapless navigation for mobile Unmanned Ground Vehicles (UGVs) using Deep Reinforcement Learning (DRL) has attracted significantly rising attention in robotic and related research communities. Collision avoidance from dynamic obstacles in unstructured environments, such as pedestrians and other vehicles, is one of the key challenges for mapless navigation. This paper proposes a DRL algorithm based on heuristic correction learning for autonomous navigation of a UGV in mapless configuration. We use a 24-dimensional lidar sensor, and merge the target position information and the speed information of the UGV as the input of the reinforcement learning agent. The actions of the UGV are produced as the output of the agent. Our proposed algorithm has been trained and evaluated in both static and dynamic environments. The experimental result shows that our proposed algorithm can reach the target in less time with shorter distances under the premise of ensuring safety than other algorithms. Especially, the success rate of our proposed algorithm is 2.05 times higher than the second effective algorithm and the trajectory efficiency is improved by 24\% in the dynamic environment. Finally, our proposed algorithm is deployed on a real robot in the real-world environment to validate and evaluate the algorithm performance. Experimental results show that our proposed algorithm can be directly applied to real robots robustly.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Engineering
Publisher:	Springer Verlag (Germany)
ISSN:	0921-0296
Date of First Compliant Deposit:	11 August 2023
Date of Acceptance:	7 August 2023
Last Modified:	29 Sep 2023 04:30
URI:	https://orca.cardiff.ac.uk/id/eprint/161658

Actions (repository staff only)

Edit Item