ロボット手術における疎なランドマーク追跡による道具と組織の相互作用の確率的タスクパラメータ化
Probabilistic Task Parameterization of Tool-Tissue Interaction via Sparse Landmarks Tracking in Robotic Surgery
内視鏡映像から疎なキーポイント追跡と確率的モデリングを組み合わせ、大きな組織変形があっても専門家注釈ランドマークを伝播させ、道具と組織の相対姿勢を予測する枠組みを提案した。
著者: Yiting Wang, Yunxin Fan, Fei Liu
分類: cs.RO, cs.CV, cs.LG, cs.SY, eess.SY
原文アブストラクト
Accurate modeling of tool-tissue interactions in robotic surgery requires precise tracking of deformable tissues and integration of surgical domain knowledge. Traditional methods rely on labor-intensive annotations or rigid assumptions, limiting flexibility. We propose a framework combining sparse keypoint tracking and probabilistic modeling that propagates expert-annotated landmarks across endoscopic frames, even with large tissue deformations. Clustered tissue keypoints enable dynamic local transformation construction via PCA, and tool poses, tracked similarly, are expressed relative to these frames. Embedding these into a Task-Parameterized Gaussian Mixture Model (TP-GMM) integrates data-driven observations with labeled clinical expertise, effectively predicting relative tool-tissue poses and enhancing visual understanding of robotic surgical motions directly from video data.
