AgentAlign: エージェント間センサ相関のずれに適応する協調知覚フレームワーク
AgentAlign: Misalignment-Adapted Multi-Agent Perception for Resilient Inter-Agent Sensor Correlations
複数車両・インフラ間の異種センサ情報のずれを動的に補正する特徴アライメント手法を提案し、ノイズ環境下でも頑健な協調知覚を実現した。
著者: Zonglin Meng, Yun Zhang, Zhaoliang Zheng, Zhihao Zhao, Jiaqi Ma
分類: cs.CV, cs.RO
原文アブストラクト
Cooperative perception has attracted wide attention given its capability to leverage shared information across connected automated vehicles (CAVs) and smart infrastructures to address sensing occlusion and range limitation issues. However, existing research overlooks the fragile multi-sensor correlations in multi-agent settings, as the heterogeneous agent sensor measurements are highly susceptible to environmental factors, leading to weakened inter-agent sensor interactions. The varying operational conditions and other real-world factors inevitably introduce multifactorial noise and consequentially lead to multi-sensor misalignment, making the deployment of multi-agent multi-modality perception particularly challenging in the real world. In this paper, we propose AgentAlign, a real-world heterogeneous agent cross-modality feature alignment framework, to effectively address these multi-modality misalignment issues. Our method introduces a cross-modality feature alignment space (CFAS) and heterogeneous agent feature alignment (HAFA) mechanism to harmonize multi-modality features across various agents dynamically. Additionally, we present a novel V2XSet-noise dataset that simulates realistic sensor imperfections under diverse environmental conditions, facilitating a systematic evaluation of our approach's robustness. Extensive experiments on the V2X-Real and V2XSet-Noise benchmarks demonstrate that our framework achieves state-of-the-art performance, underscoring its potential for real-world applications in cooperative autonomous driving. The controllable V2XSet-Noise dataset and generation pipeline will be released in the future.
関連論文
- 見通し外へ:複雑シナリオにおけるV2X協調知覚のハイブリッド検証協調知覚/V2X
- EffiComm: 帯域効率の良いマルチエージェント通信協調知覚/V2X
- VALISENS:協調自動運転のための検証済み革新的マルチセンサシステム協調知覚/V2X
- 協調知覚のための確率的V2Xデータ融合フレームワーク協調知覚/V2X
- 協調知覚による自動運転車の安全性と堅牢性の実証協調知覚/V2X
