代替安全行動に基づく衝突回避・トルク制限付きロボット軌道の学習
Learning Collision-free and Torque-limited Robot Trajectories based on Alternative Safe Behaviors
ニューラルネットが生成した動作を、制動軌道の物理シミュレーションで安全確認できた場合のみ実行することで、衝突回避とトルク制限を満たす軌道を強化学習でオンライン生成する手法を提案した。
著者: Jonas C. Kiemel, Torsten Kröger
分類: cs.RO, cs.AI
原文アブストラクト
This paper presents an approach for learning online generation of collision-free and torque-limited robot trajectories. In order to generate future motions, a neural network is periodically invoked. Based on the current kinematic state of the robot and the network output, a trajectory for the current time interval can be calculated. The main idea of our paper is to execute the computed motion only if a collision-free and torque-limited way to continue the trajectory is known. In practice, the motion computed for the current time interval is extended by a braking trajectory and simulated using a physics engine. If the simulated trajectory complies with all safety constraints, the computed motion is carried out. Otherwise, the braking trajectory calculated in the previous time interval serves as an alternative safe behavior. Given a task-specific reward function, the neural network is trained using reinforcement learning. The design of the action space used for reinforcement learning ensures that all computed trajectories comply with kinematic joint limits. For our evaluation, simulated humanoid robots and industrial robots are trained to reach as many randomly placed target points as possible. We show that our method reliably prevents collisions with static obstacles and collisions between the robot arms, while generating motions that respect both torque limits and kinematic joint limits. Experiments with a real robot demonstrate that safe trajectories can be generated in real-time.
関連論文
- 関節制約を満たすロボット軌道の学習強化学習/軌道生成
