視覚障害者向け深層学習ベースのウェアラブル支援システム
Deep Learning based Wearable Assistive System for Visually Impaired People
RGBDカメラとイヤホンを備えたウェアラブル端末とスマホを組み合わせ、深層学習で安全な歩行指示を予測し、触覚操作で3D環境理解を支援する視覚障害者向けシステムを提案・評価した。
著者: Yimin Lin, Kai Wang, Wanxin Yi, Shiguo Lian
分類: cs.RO, cs.CV
原文アブストラクト
In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI). The system is composed of a wearable terminal equipped with an RGBD camera and an earphone, a powerful processor mainly for deep learning inferences and a smart phone for touch-based interaction. A data-driven learning approach is proposed to predict safe and reliable walkable instructions using RGBD data and the established semantic map. This map is also used to help VI understand their 3D surrounding objects and layout through well-designed touchscreen interactions. The quantitative and qualitative experimental results show that our learning based obstacle avoidance approach achieves excellent results in both indoor and outdoor datasets with low-lying obstacles. Meanwhile, user studies have also been carried out in various scenarios and showed the improvement of VI's environment perception experience with our system.
