Object detection and recognition: using deep learning to assist the visually impaired

References

• Malek S, Melgani F, Mekhalfi ML, et al. Real-time indoor scene description for the visually impaired using autoencoder fusion strategies with visible cameras. Sensors. 2017;17(11):2641.
   Web of Science ®Google Scholar
• Poggi M, Mattoccia S. A wearable mobility aid for the visually impaired based on embedded 3d vision and deep learning. Proceedings of the 2016 IEEE Symposium on Computers and Communication (ISCC); Messina, Italy. 2016. p. 208–213.
   Google Scholar
• Tapu R, Mocanu B, Zaharia T. A computer vision-based perception system for visually impaired. Multimed Tools Appl. 2017;76(9):11771–11807.
   Web of Science ®Google Scholar
• Schmidhuber J. Deep learning in neural networks: an overview. Neural Netw. 61:85–117.
   PubMed Web of Science ®Google Scholar
• Lecun Y, Bengio Y, Hintn G. Deep learning. Nature. 2015;521:436–444.
   PubMed Web of Science ®Google Scholar
• Hirose N, Sadeghian A, Vázquez M, et al. GONet: a semi-supervised deep learning approach for traversability estimation. arXiv preprint arXiv: 1803.03254;2018.
   Google Scholar
• Kumar PM, Gandhi U, Varatharajan R, et al. Intelligent face recognition and navigation system using neural learning for smart security in Internet of Things. Cluster Comput. 2017;1–12.
   Web of Science ®Google Scholar
• Yang K, Wang K, Bergasa LM, et al. Unifying terrain awareness for the visually impaired through real-time semantic segmentation. Sensors. 2018;18(5):1506.
   Web of Science ®Google Scholar
• Dan C, Meier U, Masci J, et al. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence; Barcelona, Spain. 2011. Vol. 2. p. 1237–1242.
   Google Scholar
• Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Venice, Italy. 2015. p. 3431–3440.
   Google Scholar
• Niu L, Qian C, Rizzo JR, et al. A wearable assistive technology for the visually impaired with door knob detection and real-time feedback for hand-to-handle manipulation. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCV); Venice, Italy. 2017. p. 500–1508.
   Google Scholar
• Lin BS, Lee CC, Chiang PY. Simple smartphone-based guiding system for visually impaired people. Sensors. 2017;17(6):1371.
   PubMed Web of Science ®Google Scholar
• Berriel RF, Rossi FS, de Souza AF, et al. Automatic large-scale data acquisition via crowdsourcing for crosswalk classification: a deep learning approach. Comput Graphics. 2017;68:32–42.
   Web of Science ®Google Scholar
• Trabelsi R, Jabri I, Melgani F, et al. Indoor object recognition in RGBD images with complex-valued neural networks for visually-impaired people. Neurocomputing. 2019;330:94–103.
   Web of Science ®Google Scholar
• Zhang H, Ye C. An indoor wayfinding system based on geometric features aided graph SLAM for the visually impaired. IEEE Trans Neural Syst Rehabil Eng. 2017;25(9):1592–1604.
   PubMed Web of Science ®Google Scholar
• Berriel RF, Lopes AT, de Souza AF, et al. Deep learning-based large-scale automatic satellite crosswalk classification. IEEE Geosci Remote Sensing Lett. 2017;14(9):1513–1517.
   Web of Science ®Google Scholar
• Erhan D, Szegedy C, Toshev A, et al. Scalable object detection using deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Columbus, Ohio. 2014. p. 2147–2154.
   Google Scholar
• Wei Y, Xia W, Lin M, et al. HCP: a flexible CNN framework for multi-label image classification. IEEE Trans Pattern Anal Mach Intell. 2016;38(9):1901–1907.
   PubMed Web of Science ®Google Scholar
• Redmon J, Divvala S, Girshick R, et al. You only look once: unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Las Vegas, NV. 2016. p. 779–788.
   Google Scholar
• Cogné M, Taillade M, N’Kaoua B, et al. The contribution of virtual reality to the diagnosis of spatial navigation disorders and to the study of the role of navigational aids: a systematic literature review. Ann Phys Rehabil Med. 2017;60(3):164–176.
   PubMed Web of Science ®Google Scholar
• Wang HC, Katzschmann RK, Teng S, et al. Enabling independent navigation for visually impaired people through a wearable vision-based feedback system. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA); Singapore. 2017. p. 6533–6540.
   Google Scholar
• Mancini A, Frontoni E, Zingaretti P. Mechatronic system to help visually impaired users during walking and running. IEEE Trans Intell Transport Syst. 2018;19(2):649–660.
   Web of Science ®Google Scholar
• Mekhalfi ML, Melgani F, Bazi Y, et al. A compressive sensing approach to describe indoor scenes for blind people. IEEE Trans Circuits Syst Video Technol. 2015;25(7):1246–1257.
   Web of Science ®Google Scholar
• Maturana D, Voxnet SS. A 3D convolutional neural network for real-time object recognition. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); Hamburg, Germany. 2015. p. 922–928.
   Google Scholar
• Katzschmann RK, Araki B, Rus D. Safe local navigation for visually impaired users with a time-of-flight and haptic feedback device. IEEE Trans Neural Syst Rehabil Eng. 2018;26(3):583–593.
   PubMed Web of Science ®Google Scholar
• Grewe L, Kashyap A, Chandran K, et al. iSight: computer vision based system to assist low vision. Proceedings of the Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII; Orlando, Florida. 2018, Vol. 10646. p. 1064613. International Society for Optics and Photonics.
   Google Scholar
• Agarwal P, Arora C. Modelling and implementation of real time texture detection module for mobility assistant for visually impaired system (MAVI) [Doctoral dissertation]. Delhi: IIIT-Delhi; 2017.
   Google Scholar
• Rodríguez A, Yebes JJ, Alcantarilla PF, et al. Assisting the visually impaired: obstacle detection and warning system by acoustic feedback. Sensors. 2012;12(12):17476–17496.
   PubMed Web of Science ®Google Scholar
• Lin Q, Han Y. A dual-field sensing scheme for a guidance system for the blind. Sensors. 2016;16(5):667.
   Web of Science ®Google Scholar
• Kang MC, Chae SH, Sun JY, et al. A novel obstacle detection method based on deformable grid for the visually impaired. IEEE Trans Consumer Electron. 2015;61(3):376–383.
   Web of Science ®Google Scholar
• Dakopoulos D, Bourbakis NG. Wearable obstacle avoidance electronic travel aids for blind: a survey. IEEE Trans Syst Man Cybern C. 2010;40(1):25–35.
   Web of Science ®Google Scholar
• Bhowmick A, Hazarika SM. An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. J Multimodal User Interfaces. 2017;11(2):149–172.
   Web of Science ®Google Scholar
• Hoang VN, Nguyen TH, Le TL, et al. Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile Kinect. Vietnam J Comput Sci. 2017;4(2):71–83.
   Google Scholar
• Nada AA, Fakhr MA, Seddick AF. Assistive infrared sensor based smart stick for blind people. Proceedings of the Science and Information Conference (SAI); London, UK. 2015. p. 1149–1154.
   Google Scholar
• Tian Y. RGB-D sensor-based computer vision assistive technology for visually impaired persons. In: Computer Vision and Machine Learning with RGB-D Sensors. Cham: Springer ebook; 2014.p. 173–194.
   Google Scholar
• Fei Z, Yang E, Hu H, Z, et al. Review of machine vision-based electronic travel aids. Proceedings of the 23rd International Conference on Automation and Computing (ICAC); Huddersfield, UK. 2017. p. 1–7.
   Google Scholar
• Götzelmann T. Visually augmented audio-tactile graphics for visually impaired people. ACM Trans Access Comput. 2018;1(2):8.
   Google Scholar
• Dai J, Li Y, He K, et al. R-FCN: object detection via region-based fully convolutional networks. In: Advances in neural information processing systems. Long Beach, CA. 2016. p. 379–387.
   Google Scholar
• Elmannai W, Elleithy K. Sensor-based assistive devices for visually-impaired people: current status, challenges, and future directions. Sensors. 2017;17(3):565.
   PubMed Web of Science ®Google Scholar
• Ge C, Kasabov N, Liu Z, et al. A spiking neural network model for obstacle avoidance in simulated prosthetic vision. Inf Sci. 2017;399:30–42.
   Web of Science ®Google Scholar
• Cai Z, Fan Q, Feris RS, et al. A unified multi-scale deep convolutional neural network for fast object detection. In: European Conference on Computer Vision; 2016. p. 354–370. Cham: Springer.
   Google Scholar
• Muharram AA, Noaman KM, Alqubati IA. Neural networks and machine learning for pattern recognition. Int J Comput Appl. 2015;122(12).
   Google Scholar
• Leong KY, Egerton S, Chan CK. A wearable technology to negotiate surface discontinuities for the blind and low vision. In Life Sciences Conference (LSC); Sydney, Australia. 2017. p. 115–120.
   Google Scholar
• Spagnol S, Saitis C, Bujacz M, et al. Model-based obstacle sonification for the navigation of visually impaired persons. In: Proceedings of 19th International Conference on Digital Audio Effects (DAFx-16); 2016. p. 309–316.
   Google Scholar
• Suresh A, Arora C, Laha D, et al. Intelligent smart glass for visually impaired using deep learning machine vision techniques and robot operating system (ROS). In: International Conference on Robot Intelligence Technology and Applications; 2017. p. 99–112.
   Google Scholar
• Tapu R, Mocanu B, Zaharia T. DEEP-SEE: joint object detection, tracking and recognition with application to visually impaired navigational assistance. Sensors. 2017;17(11):2473.
   PubMed Web of Science ®Google Scholar
• Poggi M, Nanni L, Mattoccia S. Crosswalk recognition through point-cloud processing and deep-learning suited to a wearable mobility aid for the visually impaired. Proceedings of the International Conference on Image Analysis and Processing; 2015. p. 282–289.
   Google Scholar
• Huang HC, Hsieh CT, Yeh CH. An indoor obstacle detection system using depth information and region growth. Sensors. 2015;15(10):27116–27141.
   PubMed Web of Science ®Google Scholar
• Kaur, B., & Bhattacharya, J. A scene perception system for visually impaired based on object detection and classification using multi-modal DCNN. arXiv preprint arXiv:1805.08798, 2018.
   Google Scholar