マルチモーダル相互情報量学習による堅牢な自己教師あり深層強化学習
Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning
複数の(信頼性の低い可能性もある)センサーから共有表現を学ぶため、相互情報量の下界で訓練する新しいマルチモーダル潜在状態空間モデルを提案し、欠測時にも強い方策学習を実現した。
著者: Kaiqi Chen, Yong Lee, Harold Soh
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
This work focuses on learning useful and robust deep world models using multiple, possibly unreliable, sensors. We find that current methods do not sufficiently encourage a shared representation between modalities; this can cause poor performance on downstream tasks and over-reliance on specific sensors. As a solution, we contribute a new multi-modal deep latent state-space model, trained using a mutual information lower-bound. The key innovation is a specially-designed density ratio estimator that encourages consistency between the latent codes of each modality. We tasked our method to learn policies (in a self-supervised manner) on multi-modal Natural MuJoCo benchmarks and a challenging Table Wiping task. Experiments show our method significantly outperforms state-of-the-art deep reinforcement learning methods, particularly in the presence of missing observations.
関連論文
- 強化学習におけるマルチモーダル表現のための再構成と対照学習の組み合わせマルチモーダル強化学習
- マルチモーダル深層強化学習による対話型ヒューマノイドロボットの訓練マルチモーダル強化学習
