日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

遠隔操作・状況認識arXiv:2302.00362

仮想全方向視覚による遠隔操作者の状況認識を高める柔軟なフレームワーク

A Flexible Framework for Virtual Omnidirectional Vision to Improve Operator Situation Awareness

シェア:XThreadsFacebookLINEはてブBluesky

ロボットに搭載した複数カメラを融合し、任意の視点に仮想的な全方向視覚を生成するフレームワークを提案。カメラと3D LiDARを統合した色付き点群も生成し、Spotのマルチカメラ系でも有効性を実証した。

著者: Martin Oehler, Oskar von Stryk

分類: cs.RO, cs.CV, cs.HC

原文アブストラクト

During teleoperation of a mobile robot, providing good operator situation awareness is a major concern as a single mistake can lead to mission failure. Camera streams are widely used for teleoperation but offer limited field-of-view. In this paper, we present a flexible framework for virtual projections to increase situation awareness based on a novel method to fuse multiple cameras mounted anywhere on the robot. Moreover, we propose a complementary approach to improve scene understanding by fusing camera images and geometric 3D Lidar data to obtain a colorized point cloud. The implementation on a compact omnidirectional camera reduces system complexity considerably and solves multiple use-cases on a much smaller footprint compared to traditional approaches such as actuated pan-tilt units. Finally, we demonstrate the generality of the approach by application to the multi-camera system of the Boston Dynamics Spot. The software implementation is available as open-source ROS packages on the project page https://tu-darmstadt-ros-pkg.github.io/omnidirectional_vision.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI