ワッサースタイン分布ロバスト深層Q学習による経路計画
Path Planning Using Wassertein Distributionally Robust Deep Q-learning
ロボットを確率的線形力学系としてモデル化し、衝突リスクを考慮した連続報酬設計とワッサースタイン分布ロバスト深層Q学習を用いて、雑音不確実性に頑健で安全な経路計画手法を提案した。
著者: Cem Alpturk, Venkatraman Renganathan
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical system, assuming that a collection of process noise samples is available. We cast the risk averse motion planning problem as a Markov decision process and propose a continuous reward function design that explicitly takes into account the risk of collision with obstacles while encouraging the robot's motion towards the goal. We learn the risk-averse robot control actions through Lipschitz approximated Wasserstein distributionally robust deep Q-learning to hedge against the noise uncertainty. The learned control actions result in a safe and risk averse trajectory from the source to the goal, avoiding all the obstacles. Various supporting numerical simulations are presented to demonstrate our proposed approach.
