マルチモーダルモデルによる介護支援ロボットの言語ベース調整に向けて
Towards Language-Based Modulation of Assistive Robots through Multimodal Models
介護分野の支援ロボットにおいて、言語・視覚・マルチモーダル入力を用いてタスク実行中にリアルタイムで動作を調整する手法の可能性を検討する初期研究プロジェクト。
著者: Philipp Wicke, Lüfti Kerem Şenel, Shengqiang Zhang, Luis Figueredo, Abdeldjallil Naceri, Sami Haddadin, Hinrich Schütze
分類: cs.RO
原文アブストラクト
In the field of Geriatronics, enabling effective and transparent communication between humans and robots is crucial for enhancing the acceptance and performance of assistive robots. Our early-stage research project investigates the potential of language-based modulation as a means to improve human-robot interaction. We propose to explore real-time modulation during task execution, leveraging language cues, visual references, and multimodal inputs. By developing transparent and interpretable methods, we aim to enable robots to adapt and respond to language commands, enhancing their usability and flexibility. Through the exchange of insights and knowledge at the workshop, we seek to gather valuable feedback to advance our research and contribute to the development of interactive robotic systems for Geriatronics and beyond.
