超音波ロボティクスにおける身体性知能による手術介入の変革
Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics
超音波ロボットに大規模言語モデルと専門知識を組み合わせ、医師の音声指示を動作計画に変換し、患者の動きに応じてリアルタイム調整する身体性知能システムを提案した。
著者: Huan Xu, Jinlin Wu, Guanglin Cao, Zhen Chen, Zhen Lei, Hongbin Liu
分類: cs.RO, cs.AI, cs.CL, cs.HC
原文アブストラクト
Ultrasonography has revolutionized non-invasive diagnostic methodologies, significantly enhancing patient outcomes across various medical domains. Despite its advancements, integrating ultrasound technology with robotic systems for automated scans presents challenges, including limited command understanding and dynamic execution capabilities. To address these challenges, this paper introduces a novel Ultrasound Embodied Intelligence system that synergistically combines ultrasound robots with large language models (LLMs) and domain-specific knowledge augmentation, enhancing ultrasound robots' intelligence and operational efficiency. Our approach employs a dual strategy: firstly, integrating LLMs with ultrasound robots to interpret doctors' verbal instructions into precise motion planning through a comprehensive understanding of ultrasound domain knowledge, including APIs and operational manuals; secondly, incorporating a dynamic execution mechanism, allowing for real-time adjustments to scanning plans based on patient movements or procedural errors. We demonstrate the effectiveness of our system through extensive experiments, including ablation studies and comparisons across various models, showcasing significant improvements in executing medical procedures from verbal commands. Our findings suggest that the proposed system improves the efficiency and quality of ultrasound scans and paves the way for further advancements in autonomous medical scanning technologies, with the potential to transform non-invasive diagnostics and streamline medical workflows.
関連論文
- 片手補助:単一チャネル内視鏡的粘膜下層剥離術における牽引のための連続体ロボット把持器医療ロボティクス
- 脳血管内治療における臨床医とAIの協働:自律性スペクトラムにわたるロボットナビゲーションのCopilot支援モードに関するin-vitroユーザー研究医療ロボティクス
- 低悪性度脾外傷の止血に向けた監督付き自律双腕吸引・焼灼システム医療ロボティクス
- 言語条件付き行動クローニングによる自律内視鏡ガイダンス医療ロボティクス
- MCP-Net:ロボットガイドワイヤ操作のためのリアルタイム冠動脈認識ネットワークとトポロジー解析医療ロボティクス
- 手術フェーズ認識と視覚追従を統合した自律腹腔鏡制御フレームワーク医療ロボティクス
