厳しい照明下での宇宙機姿勢推定のためのイベント-RGB融合
Event-RGB Fusion for Spacecraft Pose Estimation Under Harsh Lighting
RGBカメラとイベントセンサをビームスプリッタで融合し、厳しい照明下でも宇宙機の姿勢推定を可能にする手法を提案。RANSACベースの融合と不確かさ推定で両モダリティの強みを活かす。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Mohsi Jawaid, Marcus Märtens, Tat-Jun Chin
分類: cs.CV, cs.RO
原文アブストラクト
Spacecraft pose estimation is crucial for autonomous in-space operations, such as rendezvous, docking and on-orbit servicing. Vision-based pose estimation methods, which typically employ RGB imaging sensors, is a compelling solution for spacecraft pose estimation, but are challenged by harsh lighting conditions, which produce imaging artifacts such as glare, over-exposure, blooming and lens flare. Due to their much higher dynamic range, neuromorphic or event sensors are more resilient to extreme lighting conditions. However, event sensors generally have lower spatial resolution and suffer from reduced signal-to-noise ratio during periods of low relative motion. This work addresses these individual sensor limitations by introducing a sensor fusion approach combining RGB and event sensors. A beam-splitter prism was employed to achieve precise optical and temporal alignment. Then, a RANSAC-based technique was developed to fuse the information from the RGB and event channels to achieve pose estimation that leveraged the strengths of the two modalities. The pipeline was complemented by dropout uncertainty estimation to detect extreme conditions that affect either channel. To benchmark the performance of the proposed event-RGB fusion method, we collected a comprehensive real dataset of RGB and event data for satellite pose estimation in a laboratory setting under a variety of challenging illumination conditions. Encouraging results on the dataset demonstrate the efficacy of our event-RGB fusion approach and further supports the usage of event sensors for spacecraft pose estimation. To support community research on this topic, our dataset has been released publicly.
関連論文
- 運動学的予測と選択的イベント補正による宇宙機姿勢追跡宇宙機姿勢推定
- 実時間・飛行実装可能な単眼画像による非協力宇宙機の姿勢推定宇宙機姿勢推定
- ニューラルネットワークによる非協力宇宙機の相対姿勢推定宇宙機姿勢推定
