Modeling driver behavior from demonstrations in dynamic environments using spatiotemporal lattices

Gonzalez, David Sierra, Erkent, Ozgur, Romero Cano, Victor ORCID: https://orcid.org/0000-0003-2910-5116, Dibangoye, Jilles and Laugier, Christian 2018. Modeling driver behavior from demonstrations in dynamic environments using spatiotemporal lattices. Presented at: 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21-25 May 2018. IEEE International Conference on Robotics and Automation (ICRA). IEEE, 10.1109/ICRA.2018.8460208

Preview

PDF - Accepted Post-Print Version Download (3MB) | Preview

Abstract

One of the most challenging tasks in the development of path planners for intelligent vehicles is the design of the cost function that models the desired behavior of the vehicle. While this task has been traditionally accomplished by hand-tuning the model parameters, recent approaches propose to learn the model automatically from demonstrated driving data using Inverse Reinforcement Learning (IRL). To determine if the model has correctly captured the demonstrated behavior, most IRL methods require obtaining a policy by solving the forward control problem repetitively. Calculating the full policy is a costly task in continuous or large domains and thus often approximated by finding a single trajectory using traditional path-planning techniques. In this work, we propose to find such a trajectory using a conformal spatiotemporal state lattice, which offers two main advantages. First, by conforming the lattice to the environment, the search is focused only on feasible motions for the robot, saving computational power. And second, by considering time as part of the state, the trajectory is optimized with respect to the motion of the dynamic obstacles in the scene. As a consequence, the resulting trajectory can be used for the model assessment. We show how the proposed IRL framework can successfully handle highly dynamic environments by modeling the highway tactical driving task from demonstrated driving data gathered with an instrumented vehicle.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Published Online
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	IEEE
Date of First Compliant Deposit:	14 November 2024
Date of Acceptance:	12 March 2018
Last Modified:	20 Dec 2024 02:30
URI:	https://orca.cardiff.ac.uk/id/eprint/174012

Actions (repository staff only)

Edit Item