SUM-AgriVLN: 農業用視覚言語ナビゲーションのための空間理解メモリ
SUM-AgriVLN: Spatial Understanding Memory for Agricultural Vision-and-Language Navigation
農業ロボットの視覚言語ナビゲーションにおいて、過去の空間メモリを活用するSUMモジュールを提案し、繰り返し指示への対応精度を向上させた。
詳しい要約
1. どんなもの？
2. 先行研究と比べてどこがすごい？
3. 技術・手法の肝は？
4. どうやって有効だと検証した？
5. 議論はある？
6. 次に読むべき論文は？
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Xiaobei Zhao, Xingqi Lyu, Xin Chen, Xiang Li
分類: cs.RO, cs.AI
原文アブストラクト
Agricultural robots are emerging as powerful assistants across a wide range of agricultural tasks, nevertheless, they are still heavily relying on manual operations or fixed railways for movement. The A2A benchmark and the AgriVLN method pioneeringly extended Vision-and-Language Navigation (VLN) to the agricultural domain, successfully navigating agricultural robots from starting points to target positions following natural language instructions, while we observed a limitation: In practical agricultural scenarios, users often give repetitive instructions, but AgriVLN treats every instruction as an independent episode, overlooking the potential to use past spatial memories to assist present episodes. To address this limitation, we propose the SUM module, which executes spatial understanding via 3D reconstructions and saves spatial memories via 2D representations from the past, thereby assisting the decision-maker to recall the spatial characteristics of the scenes in the present. We integrate it into the AgriVLN backbone to build the SUM-AgriVLN method. When evaluated on A2A, it effectively improves SR from 0.47 to 0.54 with only slight sacrifice on NE from 2.91 m to 2.93 m, demonstrating the state-of-the-art performance in the agricultural VLN domain. Code: https://github.com/AlexTraveling/SUM-AgriVLN.
