音声プロソディによるロボット指示理解と曖昧性解消
Enhancing Speech Instruction Understanding and Disambiguation in Robotics via Speech Prosody
音声のプロソディ(抑揚や強調)を直接利用して指示意図を推定し、大規模言語モデルと組み合わせて曖昧な指示を解消する手法を提案。ロボット向けの曖昧音声データセットも構築した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: David Sasu, Kweku Andoh Yamoah, Benedict Quartey, Natalie Schluter
分類: cs.RO, cs.AI, cs.CL, cs.LG
原文アブストラクト
Enabling robots to accurately interpret and execute spoken language instructions is essential for effective human-robot collaboration. Traditional methods rely on speech recognition to transcribe speech into text, often discarding crucial prosodic cues needed for disambiguating intent. We propose a novel approach that directly leverages speech prosody to infer and resolve instruction intent. Predicted intents are integrated into large language models via in-context learning to disambiguate and select appropriate task plans. Additionally, we present the first ambiguous speech dataset for robotics, designed to advance research in speech disambiguation. Our method achieves 95.79% accuracy in detecting referent intents within an utterance and determines the intended task plan of ambiguous instructions with 71.96% accuracy, demonstrating its potential to significantly improve human-robot communication.
