日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

VLAarXiv:2409.03107

RoboKoop: クープマン作用素を用いたロボティクスにおける視覚入力からの効率的な制御条件付き表現

RoboKoop: Efficient Control Conditioned Representations from Visual Input in Robotics using Koopman Operator

シェア:XThreadsFacebookLINEはてブBluesky

クープマン理論に基づき、視覚入力からタスク条件付きの線形化表現を学習し、線形制御器と強化学習を組み合わせて効率的なロボット制御を実現する手法を提案。

著者: Hemant Kumawat, Biswadeep Chakraborty, Saibal Mukhopadhyay

分類: cs.RO, cs.LG, cs.SY, eess.SY

原文アブストラクト

Developing agents that can perform complex control tasks from high-dimensional observations is a core ability of autonomous agents that requires underlying robust task control policies and adapting the underlying visual representations to the task. Most existing policies need a lot of training samples and treat this problem from the lens of two-stage learning with a controller learned on top of pre-trained vision models. We approach this problem from the lens of Koopman theory and learn visual representations from robotic agents conditioned on specific downstream tasks in the context of learning stabilizing control for the agent. We introduce a Contrastive Spectral Koopman Embedding network that allows us to learn efficient linearized visual representations from the agent's visual data in a high dimensional latent space and utilizes reinforcement learning to perform off-policy control on top of the extracted representations with a linear controller. Our method enhances stability and control in gradient dynamics over time, significantly outperforming existing approaches by improving efficiency and accuracy in learning task policies over extended horizons.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI