日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

ビジュアルサーボarXiv:2503.23171

深層学習によるキーポイント検出を用いた飛行ロボットのビジュアルサーボ

Deep Visual Servoing of an Aerial Robot Using Keypoint Feature Extraction

シェア:XThreadsFacebookLINEはてブBluesky

単眼カメラ映像からCNNでキーポイントを抽出し、マーカー不要で遮蔽や照明変化に頑健な飛行ロボットの画像ベースビジュアルサーボを実現、物理シミュレーションで検証した。

著者: Shayan Sepahvand, Niloufar Amiri, Farrokh Janabi-Sharifi

分類: cs.RO

原文アブストラクト

The problem of image-based visual servoing (IBVS) of an aerial robot using deep-learning-based keypoint detection is addressed in this article. A monocular RGB camera mounted on the platform is utilized to collect the visual data. A convolutional neural network (CNN) is then employed to extract the features serving as the visual data for the servoing task. This paper contributes to the field by circumventing not only the challenge stemming from the need for man-made marker detection in conventional visual servoing techniques, but also enhancing the robustness against undesirable factors including occlusion, varying illumination, clutter, and background changes, thereby broadening the applicability of perception-guided motion control tasks in aerial robots. Additionally, extensive physics-based ROS Gazebo simulations are conducted to assess the effectiveness of this method, in contrast to many existing studies that rely solely on physics-less simulations. A demonstration video is available at https://youtu.be/Dd2Her8Ly-E.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI