日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

空撮/強化学習/sim2realarXiv:1909.06491

セルフィードローンスティック:スマホで操る空撮インターフェース

Selfie Drone Stick: A Natural Interface for Quadcopter Photography

シェア:XThreadsFacebookLINEはてブBluesky

スマホのセンサー情報を使って、ユーザーが望む構図の長距離自撮りをクアッドコプターが自律的に撮影できる自然な操作インターフェースを開発した。実画像とシミュレーションを組み合わせた深層強化学習で制御器を訓練し、実機へ転移させた。

著者: Saif Alabachi, Gita Sukthankar, Rahul Sukthankar

分類: cs.RO, cs.LG

原文アブストラクト

A physical selfie stick extends the user's reach, enabling the acquisition of personal photos that include more of the background scene. Similarly, a quadcopter can capture photos from vantage points unattainable by the user; but teleoperating a quadcopter to good viewpoints is a difficult task. This paper presents a natural interface for quadcopter photography, the SelfieDroneStick that allows the user to guide the quadcopter to the optimal vantage point based on the phone's sensors. Users specify the composition of their desired long-range selfies using their smartphone, and the quadcopter autonomously flies to a sequence of vantage points from where the desired shots can be taken. The robot controller is trained from a combination of real-world images and simulated flight data. This paper describes two key innovations required to deploy deep reinforcement learning models on a real robot: 1) an abstract state representation for transferring learning from simulation to the hardware platform, and 2) reward shaping and staging paradigms for training the controller. Both of these improvements were found to be essential in learning a robot controller from simulation that transfers successfully to the real robot.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI