CoTaP: コンプライアントタスクパイプラインとコンプライアンス変調を用いた制御器の強化学習
CoTaP: Compliant Task Pipeline and Reinforcement Learning of Its Controller with Compliance Modulation
人間の動作データを活用したヒューマノイド全身制御において、環境との相互作用時の適切なコンプライアンスを実現するため、二段階のデュアルエージェント強化学習とモデルベースのコンプライアンス制御を組み合わせたパイプラインを提案し、シミュレーションで外乱応答を検証した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Zewen He, Chenyuan Chen, Dilshod Azizov, Yoshihiko Nakamura
分類: cs.RO
原文アブストラクト
Humanoid whole-body locomotion control is a critical approach for humanoid robots to leverage their inherent advantages. Learning-based control methods derived from retargeted human motion data provide an effective means of addressing this issue. However, because most current human datasets lack measured force data, and learning-based robot control is largely position-based, achieving appropriate compliance during interaction with real environments remains challenging. This paper presents Compliant Task Pipeline (CoTaP): a pipeline that leverages compliance information in the learning-based structure of humanoid robots. A two-stage dual-agent reinforcement learning framework combined with model-based compliance control for humanoid robots is proposed. In the training process, first a base policy with a position-based controller is trained; then in the distillation, the upper-body policy is combined with model-based compliance control, and the lower-body agent is guided by the base policy. In the upper-body control, adjustable task-space compliance can be specified and integrated with other controllers through compliance modulation on the symmetric positive definite (SPD) manifold, ensuring system stability. We validated the feasibility of the proposed strategy in simulation, primarily comparing the responses to external disturbances under different compliance settings.
