音響素材推定を伴うリアルタイム3次元マッピング
Real-time 3-D Mapping with Estimating Acoustic Materials
視覚情報から室内の音響素材を推定し、移動しながら3次元占有マップに統合するリアルタイムシステムを提案した。
著者: Taeyoung Kim, Youngsun Kwon, Sung-eui Yoon
分類: cs.RO, cs.CV
原文アブストラクト
This paper proposes a real-time system integrating an acoustic material estimation from visual appearance and an on-the-fly mapping in the 3-dimension. The proposed method estimates the acoustic materials of surroundings in indoor scenes and incorporates them to a 3-D occupancy map, as a robot moves around the environment. To estimate the acoustic material from the visual cue, we apply the state-of-the-art semantic segmentation CNN network based on the assumption that the visual appearance and the acoustic materials have a strong association. Furthermore, we introduce an update policy to handle the material estimations during the online mapping process. As a result, our environment map with acoustic material can be used for sound-related robotics applications, such as sound source localization taking into account various acoustic propagation (e.g., reflection).
