ReSPEC: 動的環境におけるオンライン多スペクトルセンサ再構成フレームワーク
ReSPEC: A Framework for Online Multispectral Sensor Reconfiguration in Dynamic Environments
マルチスペクトルセンサの寄与度を検出器が評価し、強化学習でサンプリング周波数や解像度をリアルタイム制御することで、精度低下を抑えつつ計算負荷を削減する枠組みを提案。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Yanchen Liu, Yuang Fan, Minghui Zhao, Xiaofan Jiang
分類: cs.RO
原文アブストラクト
Multi-sensor fusion is central to robust robotic perception, yet most existing systems operate under static sensor configurations, collecting all modalities at fixed rates and fidelity regardless of their situational utility. This rigidity wastes bandwidth, computation, and energy, and prevents systems from prioritizing sensors under challenging conditions such as poor lighting or occlusion. Recent advances in reinforcement learning (RL) and modality-aware fusion suggest the potential for adaptive perception, but prior efforts have largely focused on re-weighting features at inference time, ignoring the physical cost of sensor data collection. We introduce a framework that unifies sensing, learning, and actuation into a closed reconfiguration loop. A task-specific detection backbone extracts multispectral features (e.g. RGB, IR, mmWave, depth) and produces quantitative contribution scores for each modality. These scores are passed to an RL agent, which dynamically adjusts sensor configurations, including sampling frequency, resolution, sensing range, and etc., in real time. Less informative sensors are down-sampled or deactivated, while critical sensors are sampled at higher fidelity as environmental conditions evolve. We implement and evaluate this framework on a mobile rover, showing that adaptive control reduces GPU load by 29.3\% with only a 5.3\% accuracy drop compared to a heuristic baseline. These results highlight the potential of resource-aware adaptive sensing for embedded robotic platforms.
関連論文
- BODYinTRANSIT-Lab:身体知覚と情動体験の感覚駆動型変化を調べるマルチモーダルデータセットマルチモーダル知覚
- UniOMA:最適輸送によるロボット知覚のための統合マルチモーダル構造アライメントマルチモーダル知覚
- ズームなしで詳細を見るv2:汎化可能なマルチモーダル知覚のための証拠連結マルチモーダル知覚
- SenseWeather: 極限環境下でのロボット知覚を支えるマルチモーダルセンシングマルチモーダル知覚
- ROMA: 実世界の物体中心マルチセンサ能動知覚のためのLLMシステムマルチモーダル知覚
- 深層学習による視覚・超音波ロボットシステム:製造現場におけるガス漏れとアーク放電の検知マルチモーダル知覚
