強化学習ベースの局所モーションプランナーにおける未知の群衆行動への汎化性能の向上
Improving the Generalization of Unseen Crowd Behaviors for Reinforcement Learning based Local Motion Planners
単一ポリシー内で情報理論的目的を最大化してエージェントの多様性を高め、未知の歩行者群衆行動への適応性を向上させる強化学習ベースの局所モーションプランナーを提案。
著者: Wen Zheng Terence Ng, Jianda Chen, Sinno Jialin Pan, Tianwei Zhang
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Deploying a safe mobile robot policy in scenarios with human pedestrians is challenging due to their unpredictable movements. Current Reinforcement Learning-based motion planners rely on a single policy to simulate pedestrian movements and could suffer from the over-fitting issue. Alternatively, framing the collision avoidance problem as a multi-agent framework, where agents generate dynamic movements while learning to reach their goals, can lead to conflicts with human pedestrians due to their homogeneity. To tackle this problem, we introduce an efficient method that enhances agent diversity within a single policy by maximizing an information-theoretic objective. This diversity enriches each agent's experiences, improving its adaptability to unseen crowd behaviors. In assessing an agent's robustness against unseen crowds, we propose diverse scenarios inspired by pedestrian crowd behaviors. Our behavior-conditioned policies outperform existing works in these challenging scenes, reducing potential collisions without additional time or travel.
