HoME:家庭内マルチモーダル環境
HoME: a Household Multimodal Environment
視覚・音声・意味・物理・物体や他エージェントとの相互作用を統合した、4万5千以上の3D住宅レイアウトを持つ強化学習向けオープンソース環境を提案した論文。
著者: Simon Brodeur, Ethan Perez, Ankesh Anand, Florian Golemo, Luca Celotti, Florian Strub, Jean Rouat, Hugo Larochelle, Aaron Courville
分類: cs.AI, cs.CL, cs.CV, cs.RO, cs.SD, eess.AS
原文アブストラクト
We introduce HoME: a Household Multimodal Environment for artificial agents to learn from vision, audio, semantics, physics, and interaction with objects and other agents, all within a realistic context. HoME integrates over 45,000 diverse 3D house layouts based on the SUNCG dataset, a scale which may facilitate learning, generalization, and transfer. HoME is an open-source, OpenAI Gym-compatible platform extensible to tasks in reinforcement learning, language grounding, sound-based navigation, robotics, multi-agent learning, and more. We hope HoME better enables artificial agents to learn as humans do: in an interactive, multimodal, and richly contextualized setting.
