Word2Wave: 言語駆動による海洋ロボットの効率的な海底ミッションプログラミング
Word2Wave: Language Driven Mission Programming for Efficient Subsea Deployments of Marine Robots
音声やテキストからAUVのミッションを自動生成する言語インターフェースを開発し、従来の商用インターフェースより10倍以上速く直感的にプログラムできることを示した。
著者: Ruo Chen, David Blow, Adnan Abdullah, Md Jahidul Islam
分類: cs.RO
原文アブストラクト
This paper explores the design and development of a language-based interface for dynamic mission programming of autonomous underwater vehicles (AUVs). The proposed `Word2Wave' (W2W) framework enables interactive programming and parameter configuration of AUVs for remote subsea missions. The W2W framework includes: (i) a set of novel language rules and command structures for efficient language-to-mission mapping; (ii) a GPT-based prompt engineering module for training data generation; (iii) a small language model (SLM)-based sequence-to-sequence learning pipeline for mission command generation from human speech or text; and (iv) a novel user interface for 2D mission map visualization and human-machine interfacing. The proposed learning pipeline adapts an SLM named T5-Small that can learn language-to-mission mapping from processed language data effectively, providing robust and efficient performance. In addition to a benchmark evaluation with state-of-the-art, we conduct a user interaction study to demonstrate the effectiveness of W2W over commercial AUV programming interfaces. Across participants, W2W-based programming required less than 10\% time for mission programming compared to traditional interfaces; it is deemed to be a simpler and more natural paradigm for subsea mission programming with a usability score of 76.25. W2W opens up promising future research opportunities on hands-free AUV mission programming for efficient subsea deployments.
関連論文
- 自然言語コマンドによるロボット軌道の再形成:Transformerを用いたマルチモーダルデータ整合の研究言語インターフェース
- 分解を通じて適応的な言語インターフェースを学習する言語インターフェース
