日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

sim2realarXiv:2201.02798

前景手がかり追従によるゼロショットSim2Real視覚ナビゲーション

RARA: Zero-shot Sim2Real Visual Navigation with Following Foreground Cues

シェア:XThreadsFacebookLINEはてブBluesky

前景の視覚的手がかり(線・ゲート・コーンなど)を追従するカメラベースナビゲーションを、前景と背景のランダム拡張・深層監視とトリプレット損失による正則化・ウェイポイントによる動力学抽象化を組み合わせてシミュレーションで学習し、実世界へゼロショット転移させる手法を提案した。

著者: Klaas Kelchtermans, Tinne Tuytelaars

分類: cs.CV, cs.LG, cs.RO

原文アブストラクト

The gap between simulation and the real-world restrains many machine learning breakthroughs in computer vision and reinforcement learning from being applicable in the real world. In this work, we tackle this gap for the specific case of camera-based navigation, formulating it as following a visual cue in the foreground with arbitrary backgrounds. The visual cue in the foreground can often be simulated realistically, such as a line, gate or cone. The challenge then lies in coping with the unknown backgrounds and integrating both. As such, the goal is to train a visual agent on data captured in an empty simulated environment except for this foreground cue and test this model directly in a visually diverse real world. In order to bridge this big gap, we show it's crucial to combine following techniques namely: Randomized augmentation of the fore- and background, regularization with both deep supervision and triplet loss and finally abstraction of the dynamics by using waypoints rather than direct velocity commands. The various techniques are ablated in our experimental results both qualitatively and quantitatively finally demonstrating a successful transfer from simulation to the real world.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI