網膜下注射のためのロボット自律ナビゲーション:リアルタイム仮想iOCTスライシングの知能化
Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing
術中OCTの3DボリュームをCNNで高速処理し、器具姿勢推定・ロボットとOCTのオンライン位置合わせ・軌道計画を統合して、網膜下注射の自律ナビゲーションを実現した。
著者: Shervin Dehghani, Michael Sommersperger, Peiyao Zhang, Alejandro Martin-Gomez, Benjamin Busam, Peter Gehlbach, Nassir Navab, M. Ali Nasseri, Iulian Iordachita
分類: cs.RO, cs.CV
原文アブストラクト
In the last decade, various robotic platforms have been introduced that could support delicate retinal surgeries. Concurrently, to provide semantic understanding of the surgical area, recent advances have enabled microscope-integrated intraoperative Optical Coherent Tomography (iOCT) with high-resolution 3D imaging at near video rate. The combination of robotics and semantic understanding enables task autonomy in robotic retinal surgery, such as for subretinal injection. This procedure requires precise needle insertion for best treatment outcomes. However, merging robotic systems with iOCT introduces new challenges. These include, but are not limited to high demands on data processing rates and dynamic registration of these systems during the procedure. In this work, we propose a framework for autonomous robotic navigation for subretinal injection, based on intelligent real-time processing of iOCT volumes. Our method consists of an instrument pose estimation method, an online registration between the robotic and the iOCT system, and trajectory planning tailored for navigation to an injection target. We also introduce intelligent virtual B-scans, a volume slicing approach for rapid instrument pose estimation, which is enabled by Convolutional Neural Networks (CNNs). Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method. Finally, we discuss identified challenges in this work and suggest potential solutions to further the development of such systems.
関連論文
- 片手補助:単一チャネル内視鏡的粘膜下層剥離術における牽引のための連続体ロボット把持器医療ロボティクス
- 脳血管内治療における臨床医とAIの協働:自律性スペクトラムにわたるロボットナビゲーションのCopilot支援モードに関するin-vitroユーザー研究医療ロボティクス
- 低悪性度脾外傷の止血に向けた監督付き自律双腕吸引・焼灼システム医療ロボティクス
- 言語条件付き行動クローニングによる自律内視鏡ガイダンス医療ロボティクス
- MCP-Net:ロボットガイドワイヤ操作のためのリアルタイム冠動脈認識ネットワークとトポロジー解析医療ロボティクス
- 手術フェーズ認識と視覚追従を統合した自律腹腔鏡制御フレームワーク医療ロボティクス
