潜在空間表現に基づく異種分散知覚の協調
Coordinated Heterogeneous Distributed Perception based on Latent Space Representation
マルチモーダルVAEの共有潜在空間を用いて、異なるセンサを持つロボット間で検出情報を交換し、DQNで不確実性を最小化するよう協調行動を学習する手法を提案した。
著者: Timo Korthals, Jürgen Leitner, Ulrich Rückert
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
We investigate a reinforcement approach for distributed sensing based on the latent space derived from multi-modal deep generative models. Our contribution provides insights to the following benefits: Detections can be exchanged effectively between robots equipped with uni-modal sensors due to a shared latent representation of information that is trained by a Variational Auto Encoder (VAE). Sensor-fusion can be applied asynchronously due to the generative feature of the VAE. Deep Q-Networks (DQNs) are trained to minimize uncertainty in latent space by coordinating robots to a Point-of-Interest (PoI) where their sensor modality can provide beneficial information about the PoI. Additionally, we show that the decrease in uncertainty can be defined as the direct reward signal for training the DQN.
