映画から危険を評価し、危険環境での協調的脱出計画を学習する
Learning to Assess Danger from Movies for Cooperative Escape Planning in Hazardous Environments
映画やTV番組の映像から危険環境データセットを構築し、ロボットのカメラ情報と人間の言語入力をベイズ統合して危険度を推定し、安全な脱出経路を計画する手法を提案した。
著者: Vikram Shree, Sarah Allen, Beatriz Asfora, Jacopo Banfi, Mark Campbell
分類: cs.RO, cs.CV, cs.HC, cs.LG
原文アブストラクト
There has been a plethora of work towards improving robot perception and navigation, yet their application in hazardous environments, like during a fire or an earthquake, is still at a nascent stage. We hypothesize two key challenges here: first, it is difficult to replicate such scenarios in the real world, which is necessary for training and testing purposes. Second, current systems are not fully able to take advantage of the rich multi-modal data available in such hazardous environments. To address the first challenge, we propose to harness the enormous amount of visual content available in the form of movies and TV shows, and develop a dataset that can represent hazardous environments encountered in the real world. The data is annotated with high-level danger ratings for realistic disaster images, and corresponding keywords are provided that summarize the content of the scene. In response to the second challenge, we propose a multi-modal danger estimation pipeline for collaborative human-robot escape scenarios. Our Bayesian framework improves danger estimation by fusing information from robot's camera sensor and language inputs from the human. Furthermore, we augment the estimation module with a risk-aware planner that helps in identifying safer paths out of the dangerous environment. Through extensive simulations, we exhibit the advantages of our multi-modal perception framework that gets translated into tangible benefits such as higher success rate in a collaborative human-robot mission.
