Transformerによる記憶付きアクションチャンキング:視覚ベースの組織表面スキャンのための模倣学習
Memorized action chunking with Transformers: Imitation learning for vision-based tissue surface scanning
過去の画像列から近未来の行動系列を予測する模倣学習手法MACTを提案し、組織表面の輪郭・領域スキャンタスクにおいてベースラインを大きく上回る成功率を達成した。
著者: Bochen Yang, Kaizhong Deng, Christopher J Peters, George Mylonas, Daniel S. Elson
分類: cs.RO
原文アブストラクト
Optical sensing technologies are emerging technologies used in cancer surgeries to ensure the complete removal of cancerous tissue. While point-wise assessment has many potential applications, incorporating automated large area scanning would enable holistic tissue sampling. However, such scanning tasks are challenging due to their long-horizon dependency and the requirement for fine-grained motion. To address these issues, we introduce Memorized Action Chunking with Transformers (MACT), an intuitive yet efficient imitation learning method for tissue surface scanning tasks. It utilizes a sequence of past images as historical information to predict near-future action sequences. In addition, hybrid temporal-spatial positional embeddings were employed to facilitate learning. In various simulation settings, MACT demonstrated significant improvements in contour scanning and area scanning over the baseline model. In real-world testing, with only 50 demonstration trajectories, MACT surpassed the baseline model by achieving a 60-80% success rate on all scanning tasks. Our findings suggest that MACT is a promising model for adaptive scanning in surgical settings.
関連論文
- カーネル化運動プリミティブを用いた深部静脈血栓症のロボット支援超音波検査のための模倣学習模倣学習/医療ロボティクス
