時空間Transformerに基づく強化学習によるロボット群衆ナビゲーション
Spatio-Temporal Transformer-Based Reinforcement Learning for Robot Crowd Navigation
空間特徴と時間特徴を別々に扱う従来手法の問題を解決するため、ゲート付き埋め込みで両者を統合しTransformerで時空間情報を符号化する強化学習方策を提案し、群衆環境でのナビゲーション性能を向上させた。
著者: Haodong He, Hao Fu, Qiang Wang, Shuai Zhou, Wei Liu
分類: cs.RO
原文アブストラクト
The social robot navigation is an open and challenging problem. In existing work, separate modules are used to capture spatial and temporal features, respectively. However, such methods lead to extra difficulties in improving the utilization of spatio-temporal features and reducing the conservative nature of navigation policy. In light of this, we present a spatio-temporal transformer-based policy optimization algorithm to enhance the utilization of spatio-temporal features, thereby facilitating the capture of human-robot interactions. Specifically, this paper introduces a gated embedding mechanism that effectively aligns the spatial and temporal representations by integrating both modalities at the feature level. Then Transformer is leveraged to encode the spatio-temporal semantic information, with hope of finding the optimal navigation policy. Finally, a combination of spatio-temporal Transformer and self-adjusting policy entropy significantly reduces the conservatism of navigation policies. Experimental results demonstrate the effectiveness of the proposed framework, where our method shows superior performance.
