ガードレールに導かれて：ロボット学習の安全インストラクターとしての制御バリア関数
Guided by Guardrails: Control Barrier Functions as Safety Instructors for Robotic Learning
安全行動の時間的影響を連続的な負の報酬でモデル化し、制御バリア関数（CBF）を強化学習に統合する3つの手法を提案。シミュレーションと実機の四輪差動駆動ロボットで、CBFが危険領域回避と学習改善に有効であることを示した。
詳しい要約
1. どんなもの？
2. 先行研究と比べてどこがすごい？
3. 技術・手法の肝は？
4. どうやって有効だと検証した？
5. 議論はある？
6. 次に読むべき論文は？
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Maeva Guerrier, Karthik Soma, Hassan Fouad, Giovanni Beltrame
分類: cs.RO, cs.LG
原文アブストラクト
Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conventional RL frameworks often model safety by using single scalar negative rewards with immediate episode termination, failing to capture the temporal consequences of unsafe actions (e.g., sustained collision damage). In this work, we introduce a novel approach that simulates these temporal effects by applying continuous negative rewards without episode termination. Our experiments reveal that standard RL methods struggle with this model, as the accumulated negative values in unsafe zones create learning barriers. To address this challenge, we demonstrate how Control Barrier Functions (CBFs), with their proven safety guarantees, effectively help robots avoid catastrophic regions while enhancing learning outcomes. We present three CBF-based approaches, each integrating traditional RL methods with Control Barrier Functions, guiding the agent to learn safe behavior. Our empirical analysis, conducted in both simulated environments and real-world settings using a four-wheel differential drive robot, explores the possibilities of employing these approaches for safe robotic learning.
