日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

視覚障害支援/ウェアラブルarXiv:1908.03364

視覚障害者向け深層学習ベースのウェアラブル支援システム

Deep Learning based Wearable Assistive System for Visually Impaired People

シェア:XThreadsFacebookLINEはてブBluesky

RGBDカメラとイヤホンを備えたウェアラブル端末とスマホを組み合わせ、深層学習で安全な歩行指示を予測し、触覚操作で3D環境理解を支援する視覚障害者向けシステムを提案・評価した。

著者: Yimin Lin, Kai Wang, Wanxin Yi, Shiguo Lian

分類: cs.RO, cs.CV

原文アブストラクト

In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI). The system is composed of a wearable terminal equipped with an RGBD camera and an earphone, a powerful processor mainly for deep learning inferences and a smart phone for touch-based interaction. A data-driven learning approach is proposed to predict safe and reliable walkable instructions using RGBD data and the established semantic map. This map is also used to help VI understand their 3D surrounding objects and layout through well-designed touchscreen interactions. The quantitative and qualitative experimental results show that our learning based obstacle avoidance approach achieves excellent results in both indoor and outdoor datasets with low-lying obstacles. Meanwhile, user studies have also been carried out in various scenarios and showed the improvement of VI's environment perception experience with our system.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI