現場建設作業におけるロボットアシスタントとの直感的な人間対話のための自然言語指示
Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work
建設現場で作業者が自然言語でロボットに指示を出せるようにするため、自然言語理解・情報マッピング・ロボット制御の3段階からなるフレームワークを提案した。
著者: Somin Park, Xi Wang, Carol C. Menassa, Vineet R. Kamat, Joyce Y. Chai
分類: cs.RO, cs.AI, cs.HC
原文アブストラクト
The introduction of robots is widely considered to have significant potential of alleviating the issues of worker shortage and stagnant productivity that afflict the construction industry. However, it is challenging to use fully automated robots in complex and unstructured construction sites. Human-Robot Collaboration (HRC) has shown promise of combining human workers' flexibility and robot assistants' physical abilities to jointly address the uncertainties inherent in construction work. When introducing HRC in construction, it is critical to recognize the importance of teamwork and supervision in field construction and establish a natural and intuitive communication system for the human workers and robotic assistants. Natural language-based interaction can enable intuitive and familiar communication with robots for human workers who are non-experts in robot programming. However, limited research has been conducted on this topic in construction. This paper proposes a framework to allow human workers to interact with construction robots based on natural language instructions. The proposed method consists of three stages: Natural Language Understanding (NLU), Information Mapping (IM), and Robot Control (RC). Natural language instructions are input to a language model to predict a tag for each word in the NLU module. The IM module uses the result of the NLU module and building component information to generate the final instructional output essential for a robot to acknowledge and perform the construction task. A case study for drywall installation is conducted to evaluate the proposed approach. The obtained results highlight the potential of using natural language-based interaction to replicate the communication that occurs between human workers within the context of human-robot teams.
関連論文
- 人間-ロボット間の受け渡しを通じた上肢機能的移動能力の能動的知覚人間ロボット協調
- 人間とロボットの協調における人間フィードバック強化学習のスコーピングレビューと実験研究人間ロボット協調
- 人間とロボットの協調組立における解釈可能な認知作業負荷評価のための注意と行動手がかりを統合した視覚ベースフレームワーク人間ロボット協調
- すべての一致が裏付けとなるわけではない:人間とロボットの協調における型付き行動受理のための来歴保存型多視点融合人間ロボット協調
- 隠れた目標下でのゼロショット人間ロボット協調のための構造化LLM推論人間ロボット協調
- 人間とロボットのチーム成功のための能動的信頼管理:信頼修復から信頼充足の視点へ人間ロボット協調
