ロボットナビゲーションのための因果性を考慮したTransformerネットワーク
Causality-Aware Transformer Networks for Robotic Navigation
ナビゲーションタスクの因果構造を分析し、環境理解を高める因果理解モジュールを備えたTransformerを提案。タスク固有のバイアスなしでEnd-to-End学習でき、様々な設定で性能を向上。
著者: Ruoyu Wang, Yao Liu, Yuanjiang Cao, Lina Yao
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Current research in Visual Navigation reveals opportunities for improvement. First, the direct adoption of RNNs and Transformers often overlooks the specific differences between Embodied AI and traditional sequential data modelling, potentially limiting its performance in Embodied AI tasks. Second, the reliance on task-specific configurations, such as pre-trained modules and dataset-specific logic, compromises the generalizability of these methods. We address these constraints by initially exploring the unique differences between Navigation tasks and other sequential data tasks through the lens of Causality, presenting a causal framework to elucidate the inadequacies of conventional sequential methods for Navigation. By leveraging this causal perspective, we propose Causality-Aware Transformer (CAT) Networks for Navigation, featuring a Causal Understanding Module to enhance the models's Environmental Understanding capability. Meanwhile, our method is devoid of task-specific inductive biases and can be trained in an End-to-End manner, which enhances the method's generalizability across various contexts. Empirical evaluations demonstrate that our methodology consistently surpasses benchmark performances across a spectrum of settings, tasks and simulation environments. Extensive ablation studies reveal that the performance gains can be attributed to the Causal Understanding Module, which demonstrates effectiveness and efficiency in both Reinforcement Learning and Supervised Learning settings.
