日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

世界モデルarXiv:2203.11024

マルチビュー・ドリーミング:対照学習を用いたマルチビュー世界モデル

Multi-View Dreaming: Multi-View World Model with Contrastive Learning

シェア:XThreadsFacebookLINEはてブBluesky

複数視点の観測を対照学習で共有潜在空間に統合し、Products of Expertsで制御する強化学習エージェントを提案。実ロボット制御タスクで既存手法の単純拡張を上回る。

著者: Akira Kinose, Masashi Okada, Ryo Okumura, Tadahiro Taniguchi

分類: cs.AI, cs.RO, cs.SY, eess.SY

原文アブストラクト

In this paper, we propose Multi-View Dreaming, a novel reinforcement learning agent for integrated recognition and control from multi-view observations by extending Dreaming. Most current reinforcement learning method assumes a single-view observation space, and this imposes limitations on the observed data, such as lack of spatial information and occlusions. This makes obtaining ideal observational information from the environment difficult and is a bottleneck for real-world robotics applications. In this paper, we use contrastive learning to train a shared latent space between different viewpoints, and show how the Products of Experts approach can be used to integrate and control the probability distributions of latent states for multiple viewpoints. We also propose Multi-View DreamingV2, a variant of Multi-View Dreaming that uses a categorical distribution to model the latent state instead of the Gaussian distribution. Experiments show that the proposed method outperforms simple extensions of existing methods in a realistic robot control task.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI