日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

マルチモーダル強化学習arXiv:1611.08666

マルチモーダル深層強化学習による対話型ヒューマノイドロボットの訓練

Training an Interactive Humanoid Robot Using Multimodal Deep Reinforcement Learning

シェア:XThreadsFacebookLINEはてブBluesky

ヒューマノイドロボットにマルチモーダル深層強化学習を用いて三目並べを教え、知覚・発話・ジェスチャーを統合した対話を実現した研究。

著者: Heriberto Cuayáhuitl, Guillaume Couly, Clément Olalainty

分類: cs.LG, cs.AI, cs.RO

原文アブストラクト

Training robots to perceive, act and communicate using multiple modalities still represents a challenging problem, particularly if robots are expected to learn efficiently from small sets of example interactions. We describe a learning approach as a step in this direction, where we teach a humanoid robot how to play the game of noughts and crosses. Given that multiple multimodal skills can be trained to play this game, we focus our attention to training the robot to perceive the game, and to interact in this game. Our multimodal deep reinforcement learning agent perceives multimodal features and exhibits verbal and non-verbal actions while playing. Experimental results using simulations show that the robot can learn to win or draw up to 98% of the games. A pilot test of the proposed multimodal system for the targeted game---integrating speech, vision and gestures---reports that reasonable and fluent interactions can be achieved using the proposed approach.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI