確率的な目標配置環境における計画学習のための文脈付きバンディット手法
A Contextual Bandit Approach for Learning to Plan in Environments with Probabilistic Goal Configurations
屋内環境で静止物体だけでなく人の介入で位置が変わる移動物体も探索する物体目標ナビゲーションのため、文脈付きバンディットで各地点から物体を見つける確率を学習し、重み付き最小遅延ソルバで経路を計画するモジュール型フレームワークを提案した。
著者: Sohan Rudra, Saksham Goel, Anirban Santara, Claudio Gentile, Laurent Perron, Fei Xia, Vikas Sindhwani, Carolina Parada, Gaurav Aggarwal
分類: cs.RO, cs.LG, stat.AP
原文アブストラクト
Object-goal navigation (Object-nav) entails searching, recognizing and navigating to a target object. Object-nav has been extensively studied by the Embodied-AI community, but most solutions are often restricted to considering static objects (e.g., television, fridge, etc.). We propose a modular framework for object-nav that is able to efficiently search indoor environments for not just static objects but also movable objects (e.g. fruits, glasses, phones, etc.) that frequently change their positions due to human intervention. Our contextual-bandit agent efficiently explores the environment by showing optimism in the face of uncertainty and learns a model of the likelihood of spotting different objects from each navigable location. The likelihoods are used as rewards in a weighted minimum latency solver to deduce a trajectory for the robot. We evaluate our algorithms in two simulated environments and a real-world setting, to demonstrate high sample efficiency and reliability.
