SurgTrack: CADモデル不要の実世界手術器具3Dトラッキング
SurgTrack: CAD-Free 3D Tracking of Real-world Surgical Instruments
CADモデルなしで手術器具の3D形状をSDFでモデル化し、姿勢グラフ最適化で遮蔽に頑健な2段階3Dトラッキングを実現した研究。
著者: Wenwu Guo, Jinlin Wu, Zhen Chen, Qingxiang Zhao, Miao Xu, Zhen Lei, Hongbin Liu
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking surgical instruments. Compared with 2D instrument tracking methods, 3D instrument tracking has broader value in clinical practice, but is also more challenging due to weak texture, occlusion, and lack of Computer-Aided Design (CAD) models for 3D registration. To solve these challenges, we propose the SurgTrack, a two-stage 3D instrument tracking method for CAD-free and robust real-world applications. In the first registration stage, we incorporate an Instrument Signed Distance Field (SDF) modeling the 3D representation of instruments, achieving CAD-freed 3D registration. Due to this, we can obtain the location and orientation of instruments in the 3D space by matching the video stream with the registered SDF model. In the second tracking stage, we devise a posture graph optimization module, leveraging the historical tracking results of the posture memory pool to optimize the tracking results and improve the occlusion robustness. Furthermore, we collect the Instrument3D dataset to comprehensively evaluate the 3D tracking of surgical instruments. The extensive experiments validate the superiority and scalability of our SurgTrack, by outperforming the state-of-the-arts with a remarkable improvement. The code and dataset are available at https://github.com/wenwucode/SurgTrack.
関連論文
- MIRAGE:手術ナビゲーションと可視化のための新しい統合フレームワーク手術ナビゲーション
- 信頼性の高いAR誘導手術ナビゲーションに向けて:データ駆動型生体力学とプロンプトを用いた対話的変形モデリング手術ナビゲーション
- 重要解剖構造を保持する地形拡張ナビゲーション(CAPTAiN):椎弓切除術教育への応用手術ナビゲーション
- StraightTrack:経皮的Kワイヤ挿入のための複合現実ナビゲーションシステム手術ナビゲーション
- スペックル構造光を用いた高精度経胸腹穿刺ロボットナビゲーション手術ナビゲーション
- 経皮腹部穿刺ナビゲーションのためのフーリエ強調マルチモーダル3D小物体光学マーカー認識・位置推定法手術ナビゲーション
