心臓マイクロサージェリーにおける術者の手・指動作を記録し直感的ロボット遠隔操作に応用するパイロット研究
Mapping Surgeon's Hand/Finger Motion During Conventional Microsurgery to Enhance Intuitive Surgical Robot Teleoperation
心臓マイクロサージェリー中の術者の手・指の微細動作をウェアラブルセンサで記録し、深層ニューラルネットで手術器具の姿勢を推定するシステムを試作した。
著者: Mohammad Fattahi Sani, Raimondo Ascione, Sanja Dogramadzi
分類: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
原文アブストラクト
Purpose: Recent developments in robotics and artificial intelligence (AI) have led to significant advances in healthcare technologies enhancing robot-assisted minimally invasive surgery (RAMIS) in some surgical specialties. However, current human-robot interfaces lack intuitive teleoperation and cannot mimic surgeon's hand/finger sensing and fine motion. These limitations make tele-operated robotic surgery not suitable for micro-surgery and difficult to learn for established surgeons. We report a pilot study showing an intuitive way of recording and mapping surgeon's gross hand motion and the fine synergic motion during cardiac micro-surgery as a way to enhance future intuitive teleoperation. Methods: We set to develop a prototype system able to train a Deep Neural Net-work (DNN) by mapping wrist, hand and surgical tool real-time data acquisition(RTDA) inputs during mock-up heart micro-surgery procedures. The trained network was used to estimate the tools poses from refined hand joint angles. Results: Based on surgeon's feedback during mock micro-surgery, the developed wearable system with light-weight sensors for motion tracking did not interfere with the surgery and instrument handling. The wearable motion tracking system used 15 finger-thumb-wrist joint angle sensors to generate meaningful data-sets representing inputs of the DNN network with new hand joint angles added as necessary based on comparing the estimated tool poses against measured tool pose. The DNN architecture was optimized for the highest estimation accuracy and the ability to determine the tool pose with the least mean squared error. This novel approach showed that the surgical instrument's pose, an essential requirement for teleoperation, can be accurately estimated from recorded surgeon's hand/finger movements with a mean squared error (MSE) less than 0.3%
関連論文
- 片手補助:単一チャネル内視鏡的粘膜下層剥離術における牽引のための連続体ロボット把持器医療ロボティクス
- 脳血管内治療における臨床医とAIの協働:自律性スペクトラムにわたるロボットナビゲーションのCopilot支援モードに関するin-vitroユーザー研究医療ロボティクス
- 低悪性度脾外傷の止血に向けた監督付き自律双腕吸引・焼灼システム医療ロボティクス
- 言語条件付き行動クローニングによる自律内視鏡ガイダンス医療ロボティクス
- MCP-Net:ロボットガイドワイヤ操作のためのリアルタイム冠動脈認識ネットワークとトポロジー解析医療ロボティクス
- 手術フェーズ認識と視覚追従を統合した自律腹腔鏡制御フレームワーク医療ロボティクス
