ロボット支援心血管カテーテル治療におけるツールセグメンテーションのための多方向デコーダ分岐による弱教師あり学習
Weakly-Supervised Learning via Multi-Lateral Decoder Branching for Tool Segmentation in Robot-Assisted Cardiovascular Catheterization
1つのエンコーダと複数の分岐デコーダを持つU-Netで擬似ラベルを生成し、部分注釈のみの血管造影データからカテーテル器具を高精度にセグメンテーションする弱教師あり手法を提案した。
著者: Olatunji Mumini Omisore, Toluwanimi Akinyemi, Anh Nguyen, Lei Wang
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
Robot-assisted catheterization has garnered a good attention for its potentials in treating cardiovascular diseases. However, advancing surgeon-robot collaboration still requires further research, particularly on task-specific automation. For instance, automated tool segmentation can assist surgeons in visualizing and tracking of endovascular tools during cardiac procedures. While learning-based models have demonstrated state-of-the-art segmentation performances, generating ground-truth labels for fully-supervised methods is both labor-intensive time consuming, and costly. In this study, we propose a weakly-supervised learning method with multi-lateral pseudo labeling for tool segmentation in cardiovascular angiogram datasets. The method utilizes a modified U-Net architecture featuring one encoder and multiple laterally branched decoders. The decoders generate diverse pseudo labels under different perturbations, augmenting available partial labels. The pseudo labels are self-generated using a mixed loss function with shared consistency across the decoders. The weakly-supervised model was trained end-to-end and validated using partially annotated angiogram data from three cardiovascular catheterization procedures. Validation results show that the model could perform closer to fully-supervised models. Also, the proposed weakly-supervised multi-lateral method outperforms three well known methods used for weakly-supervised learning, offering the highest segmentation performance across the three angiogram datasets. Furthermore, numerous ablation studies confirmed the model's consistent performance under different parameters. Finally, the model was applied for tool segmentation in a robot-assisted catheterization experiments. The model enhanced visualization with high connectivity indices for guidewire and catheter, and a mean processing time of 35 ms per frame.
関連論文
- 前立腺手術ファントムのための解剖学的知識誘導型CT三次元セグメンテーションパイプライン医療画像セグメンテーション
- SIRA: クエリ基準アライメントによる推論対応手術器具セグメンテーション医療画像セグメンテーション
- 視覚特性事前分布による手術器具セグメンテーションの個人化フェデレーテッド学習医療画像セグメンテーション
- Surgical SAM 2: 効率的なフレーム枝刈りによる手術動画のリアルタイムセグメンテーション医療画像セグメンテーション
- 超音波画像における針の動きを考慮したセグメンテーション医療画像セグメンテーション
- ロボット手術器具セグメンテーションのための入れ子型U構造医療画像セグメンテーション
