BMP:Bスプラインと運動プリミティブの橋渡し
BMP: Bridging the Gap between B-Spline and Movement Primitives
Bスプラインを運動プリミティブとして再定式化し、境界条件の充足と軌道分布の高次統計の両立を可能にしたBMPを提案。模倣学習と強化学習で既存手法より高い表現力と適用性を示した。
著者: Weiran Liao, Ge Li, Hongyi Zhou, Rudolf Lioutikov, Gerhard Neumann
分類: cs.RO
原文アブストラクト
This work introduces B-spline Movement Primitives (BMPs), a new Movement Primitive (MP) variant that leverages B-splines for motion representation. B-splines are a well-known concept in motion planning due to their ability to generate complex, smooth trajectories with only a few control points while satisfying boundary conditions, i.e., passing through a specified desired position with desired velocity. However, current usages of B-splines tend to ignore the higher-order statistics in trajectory distributions, which limits their usage in imitation learning (IL) and reinforcement learning (RL), where modeling trajectory distribution is essential. In contrast, MPs are commonly used in IL and RL for their capacity to capture trajectory likelihoods and correlations. However, MPs are constrained by their abilities to satisfy boundary conditions and usually need extra terms in learning objectives to satisfy velocity constraints. By reformulating B-splines as MPs, represented through basis functions and weight parameters, BMPs combine the strengths of both approaches, allowing B-splines to capture higher-order statistics while retaining their ability to satisfy boundary conditions. Empirical results in IL and RL demonstrate that BMPs broaden the applicability of B-splines in robot learning and offer greater expressiveness compared to existing MP variants.
関連論文
- 高次行動監督による強力な方策クラス模倣学習/強化学習
- ConTrack: 適応的トレードオフ制御による拘束付き手の動作追跡模倣学習/強化学習
- 不完全なデモンストレーションからの学習:時間行動木ガイドによる軌道修復模倣学習/強化学習
- IN-RIL: 模倣学習と強化学習を交互に組み合わせた方策ファインチューニング模倣学習/強化学習
- DFM: 表現豊かなダンス動作学習のための深層フーリエ模倣模倣学習/強化学習
- 強化学習によるリザバーダイナミクス変調を用いた効率的なロボットスキル合成模倣学習/強化学習
