路側マルチモーダルセンシングにおける高解像度と低解像度のトレードオフ
High and Low Resolution Tradeoffs in Roadside Multimodal Sensing
路側センサの配置と解像度・種類の組み合わせを整数計画法で自動比較し、低解像度LiDARと速度情報付き4Dレーダーの融合が歩行者検出を改善することを示した評価フレームワークを提案。
著者: Shaozu Ding, Yihong Tang, Marco De Vincenzi, Dajiang Suo
分類: cs.RO
原文アブストラクト
Balancing cost and performance is crucial when choosing high- versus low-resolution point-cloud roadside sensors. For example, LiDAR delivers dense point cloud, while 4D millimeter-wave radar, though spatially sparser, embeds velocity cues that help distinguish objects and come at a lower price. Unfortunately, the sensor placement strategies will influence point cloud density and distribution across the coverage area. Compounding the first challenge is the fact that different sensor mixtures often demand distinct neural network architectures to maximize their complementary strengths. Without an evaluation framework that establishes a benchmark for comparison, it is imprudent to make claims regarding whether marginal gains result from higher resolution and new sensing modalities or from the algorithms. We present an ex-ante evaluation that addresses the two challenges. First, we realized a simulation tool that builds on integer programming to automatically compare different sensor placement strategies against coverage and cost jointly. Additionally, inspired by human multi-sensory integration, we propose a modular framework to assess whether reductions in spatial resolution can be compensated by informational richness in detecting traffic participants. Extensive experimental testing on the proposed framework shows that fusing velocity-encoded radar with low-resolution LiDAR yields marked gains (14 percent AP for pedestrians and an overall mAP improvement of 1.5 percent across six categories) at lower cost than high-resolution LiDAR alone. Notably, these marked gains hold regardless of the specific deep neural modules employed in our frame. The result challenges the prevailing assumption that high resolution are always superior to low-resolution alternatives.
関連論文
- 小売環境向け電源投入即稼働ロボットのためのマルチモーダルデータ融合マルチモーダルセンシング
- 深層学習とマルチモーダルセンシングによる小型クアッドコプターの追跡と状態推定マルチモーダルセンシング
