複数音源の検出と定位のための深層ニューラルネットワーク
Deep Neural Networks for Multiple Speaker Detection and Localization
ロボットと人の対話環境で複数の音源を同時に検出・定位するため、任意数の音源を扱える尤度ベースのネットワーク出力表現とサブバンド相互相関特徴を提案し、実機データで従来の空間スペクトル法を大きく上回る性能を示した。
著者: Weipeng He, Petr Motlicek, Jean-Marc Odobez
分類: cs.SD, cs.AI, cs.MM, cs.RO, eess.AS
原文アブストラクト
We propose to use neural networks for simultaneous detection and localization of multiple sound sources in human-robot interaction. In contrast to conventional signal processing techniques, neural network-based sound source localization methods require fewer strong assumptions about the environment. Previous neural network-based methods have been focusing on localizing a single sound source, which do not extend to multiple sources in terms of detection and localization. In this paper, we thus propose a likelihood-based encoding of the network output, which naturally allows the detection of an arbitrary number of sources. In addition, we investigate the use of sub-band cross-correlation information as features for better localization in sound mixtures, as well as three different network architectures based on different motivations. Experiments on real data recorded from a robot show that our proposed methods significantly outperform the popular spatial spectrum-based approaches.
