日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

群制御arXiv:2107.00771

帯域制限下で障害物を越えるマルチエージェント空間ハンドシェイク

Overcoming Obstructions via Bandwidth-Limited Multi-Agent Spatial Handshaking

シェア:XThreadsFacebookLINEはてブBluesky

ロボット群の未位置合わせRGB画像を帯域制限と遮蔽に耐えながら圧縮・伝播し、分散的に意味セグメンテーションを行う学習可能なMASHネットワークを提案した。

著者: Nathaniel Glaser, Yen-Cheng Liu, Junjiao Tian, Zsolt Kira

分類: cs.RO, cs.CV, cs.MA

原文アブストラクト

In this paper, we address bandwidth-limited and obstruction-prone collaborative perception, specifically in the context of multi-agent semantic segmentation. This setting presents several key challenges, including processing and exchanging unregistered robotic swarm imagery. To be successful, solutions must effectively leverage multiple non-static and intermittently-overlapping RGB perspectives, while heeding bandwidth constraints and overcoming unwanted foreground obstructions. As such, we propose an end-to-end learn-able Multi-Agent Spatial Handshaking network (MASH) to process, compress, and propagate visual information across a robotic swarm. Our distributed communication module operates directly (and exclusively) on raw image data, without additional input requirements such as pose, depth, or warping data. We demonstrate superior performance of our model compared against several baselines in a photo-realistic multi-robot AirSim environment, especially in the presence of image occlusions. Our method achieves an absolute 11% IoU improvement over strong baselines.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI