果実収穫動作の時系列分類とプリミティブ動作へのセグメンテーションにおけるLLMの能力
On the capabilities of LLMs for classifying and segmenting time series of fruit picking motions into primitive actions
果実収穫動作の時系列データを、事前定義されたプリミティブ動作(押す、引く、ひねるなど)に分類・セグメンテーションするタスクにLLMを適用し、3つのファインチューニング手法を比較評価した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Eleni Konstantinidou, Nikolaos Kounalakis, Nikolaos Efstathopoulos, Dimitrios Papageorgiou
分類: cs.RO
原文アブストラクト
Despite their recent introduction to human society, Large Language Models (LLMs) have significantly affected the way we tackle mental challenges in our everyday lives. From optimizing our linguistic communication to assisting us in making important decisions, LLMs, such as ChatGPT, are notably reducing our cognitive load by gradually taking on an increasing share of our mental activities. In the context of Learning by Demonstration (LbD), classifying and segmenting complex motions into primitive actions, such as pushing, pulling, twisting etc, is considered to be a key-step towards encoding a task. In this work, we investigate the capabilities of LLMs to undertake this task, considering a finite set of predefined primitive actions found in fruit picking operations. By utilizing LLMs instead of simple supervised learning or analytic methods, we aim at making the method easily applicable and deployable in a real-life scenario. Three different fine-tuning approaches are investigated, compared on datasets captured kinesthetically, using a UR10e robot, during a fruit-picking scenario.
関連論文
- 異なる類似度指標を用いた相互相関によるロボット動作のパラメータフリーセグメンテーション動作セグメンテーション
