Reinforcement learning-based pushing-grasping tasks with grasp success prediction

Gong, Meiyuan and Ji, Ze ORCID: https://orcid.org/0000-0002-8968-9902 2025. Reinforcement learning-based pushing-grasping tasks with grasp success prediction. Presented at: 30th International Conference on Automation and Computing (ICAC), Loughborough, United Kingdom, 27-29 August 2025. 2025 30th International Conference on Automation and Computing (ICAC). IEEE, 10.1109/icac65379.2025.11196276

Full text not available from this repository.

Abstract

Robotic grasping in cluttered environments presents significant challenges due to occlusions and physical interactions that hinder successful object retrieval. Traditional grasping strategies often fail in densely cluttered scenes, where direct grasp attempts lead to frequent collisions or inaccessible target objects. To address this limitation, we propose an RL pushing-grasping framework that incorporates a grasp success prediction (GSP) model to guide pre-grasp manipulation. An autoencoder compresses RGB-D data and object masks into a latent representation for a predictor that estimates grasp success. When this estimate falls below a threshold, an SAC-trained agent first chooses to push to improve the object’s pose and then executes the grasp. The proposed method is evaluated in randomised cluttered environments within the PyBullet simulation platform. Experimental results demonstrate that our approach significantly improves grasping performance, achieving an 81% compared to 56% for a heuristic-based baseline, showing that it selects effective movements for rearranging the scene. These results show that predicting grasp success is important for deciding how to prepare the scene, helping the robot retrieve objects more efficiently and reliably in cluttered environments.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Schools > Engineering
Publisher:	IEEE
ISBN:	979-8-3315-2545-3
Last Modified:	30 Oct 2025 11:30
URI:	https://orca.cardiff.ac.uk/id/eprint/181994

Actions (repository staff only)

Edit Item