実海域の航海シナリオにおける状況理解とCOLREG遵守のためのLLM能力の探求
Exploring LLM Capabilities for Situational Understanding and COLREG compliance on real-world maritime navigation scenarios
AISデータから作成した50の実世界の航海シナリオを用いて、大規模言語モデル(LLM)が海上航行規則(COLREG)と「良き船乗り」の慣行を理解し、適切な行動を推論できるかを評価した。その結果、微調整なしでは大きなオンラインモデルでもこのタスクは難しいことが示された。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Julius Wirbel, P. Nicholas Hansen, Line K. H. Clemmensen, Roberto Galeazzi
分類: cs.AI, cs.RO
原文アブストラクト
Recently, Large Language Models (LLMs) have shown considerable capability for situational understanding, reasoning, and decision making in different domains, most notable in the automotive sector. Therefore, we explore current state-of-the-art LLMs as a tool for maritime navigation, which includes both codified rules in the Collision Regulations (COLREGs) and uncodified best practices summarized in the concept of ``Good Seamanship''. We construct a dataset consisting of 50 diverse, real-world navigation scenarios from AIS data, label scenarios with applicable COLREG rules, recommended actions, and the reasoning for the action. We explore a variety of different LLM architectures and sizes to determine their understanding of maritime navigation tasks as well as evaluate their reasoning capabilities in this domain. The results obtained indicate that the maritime navigation task remains difficult to solve without fine-tuning, even for larger online models.
