Efficient scene analysis by a deep learning-long short-term memory approach based on polarimetric measurements

References

• Wolff LB. Polarization-based material classification from specular reflection. IEEE Trans Pattern Anal Mach Intell. 1990;12(11):1059–1071.
   Web of Science ®Google Scholar
• Joubert E, Miche P, Debrie R. 3-D surface reconstruction using a polarization state analysis. J Opt. 1995;26(1):2–8.
   Web of Science ®Google Scholar
• Fang S, Xia X, Huo X, et al. Image dehazing using polarization effects of objects and airlight. Opt Express. 2014;22(16):19523–19537.
   PubMed Web of Science ®Google Scholar
• Wang LV, Zimnyakov DA. Optical polarization in biomedical applications. New York (NY): Springer; 2006.
   Google Scholar
• Blin R, Ainouz S, Canu S, et al. A new multimodal RGB and polarimetric image dataset for road scenes analysis. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA; 2020. p. 216–217.
   Google Scholar
• Wang Y, Liu Q, Zu H, et al. An end-to-end CNN framework for polarimetric vision tasks based on polarization-parameter-constructing network. CoRR abs/2004.08740; 2020.
   Google Scholar
• Blin R, Ainouz S, Canu S, et al. Adapted learning for polarization-based car detection. In: Proceedings of the SPIE 11172, Fourteenth International Conference on Quality Control by Artificial Vision. Mulhouse: SPIE;2019 p. 1117218.
   Google Scholar
• Wang F, Aainouz S, Lian C, et al. Multimodality semantic segmentation based on polarization and color images. Neurocomputing. 2017;253:193–200. Long-wave infrared polarimetric cluster-based vehicle detection.
   Web of Science ®Google Scholar
• Dickson CN, Wallace AM, Kitchin M, et al. Long-wave infrared polarimetric cluster-based vehicle detection. J Opt Soc Am A. 2015;32:2307–2315.
   Google Scholar
• Li N, Zhao Y, Pan Q, et al. Demosaicking DoFP images using Newton’s polynomial interpolation and polarization difference model. Opt Express. 2019;27(2):1376–1391.
   PubMed Web of Science ®Google Scholar
• Ratliff BM, et al. Exploiting motion-based redundancy to enhance microgrid polarimeter imagery. In Polarization Sci Remote Sens IV. 2009;7461. International Society for Optics and Photonics. San Diego, CA, USA: SPIE. p. 165–174.
   Google Scholar
• Liang Y, Wakaki R, Nobuhara S, et al. Multimodal material segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA; 2022. p. 19800–19808.
   Google Scholar
• Khoshboresh-Masouleh M, Shah-Hosseini R. A deep multi-modal learning method and a new RGB-depth data set for building roof extraction. Photogrammetric Eng Remote Sens. 2021;87(10):759–766.
   Web of Science ®Google Scholar
• Köse SK, Ergünay S, Ott B, et al. Target detection with deep learning in polarimetric imaging. In: Proceedings Volume 10794, Target and Background Signatures IV; SPIE Security + Defence; 2018, Berlin, Germany.
   Google Scholar
• Sheeny M, Wallace AM, Emambakhsh M, et al. POL-LWIR vehicle detection: convolutional neural networks meet polarised infrared sensors. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA; 2018. p. 1247–1253.
   Google Scholar
• Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735–1780.
   PubMed Web of Science ®Google Scholar
• Bickel WS, Bailey WM. Stokes vectors, Mueller matrices, and polarized scattered light. Am J Phys. 1985;53(5):468–478.
   Web of Science ®Google Scholar
• Gers FA, Schmidhuber J, Cummins F. Learning to forget: continual prediction with LSTM. Neural Comput. 2000;12(10):2451–2471.
   PubMed Web of Science ®Google Scholar
• Karim F, Majumdar S, Darabi H, et al. LSTM fully convolutional networks for time series classification. IEEE Access. 2017;6:1662–1669.
   Web of Science ®Google Scholar
• Blin R, Ainouz S, Canu S, et al. Road scenes analysis in adverse weather conditions by polarization-encoded images and adapted deep learning. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC); 2019. IEEE.
   Google Scholar
• Sheeny M, Wallace A, Emambakhsh M, et al. POL-LWIR vehicle detection: convolutional neural networks meet polarised infrared sensors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops; 2018. p. 1247–1253.
   Google Scholar
• Sun R, Sun X, Chen F, et al. An artificial target detection method combining a polarimetric feature extractor with deep convolutional neural networks. Int J Remote Sens. 2020;41(13):4995–5009.
   Web of Science ®Google Scholar
• Zhang Y, Morel O, Blanchon M, et al. Exploration of deep learning-based multimodal fusion for semantic road scene segmentation. In: VISIGRAPP (5: VISAPP); 2019, February. p. 336–343.
   Google Scholar
• Usmani K, Krishnan G, O’connor T, et al. Deep learning polarimetric three-dimensional integral imaging object recognition in adverse environmental conditions. Opt Express. 2021;29(8):12215–12228.
   PubMed Web of Science ®Google Scholar
• Blanchon M, Morel O, Meriaudeau F, et al. Polarimetric image augmentation. In: 2020 25th International Conference on Pattern Recognition (ICPR); 2021. IEEE. p. 7365–7371.
   Google Scholar
• Shen Y, Lin W, Wang Z, et al. Rapid detection of camouflaged artificial target based on polarization imaging and deep learning. IEEE Photonics J. 2021;13(4):1–9.
   Web of Science ®Google Scholar
• Xiang K, Yang K, Wang K. Polarization-driven semantic segmentation via efficient attention-bridged fusion. Opt Express. 2021;29(4):4802–4820.
   PubMed Web of Science ®Google Scholar
• Zhang Y, et al. A central multimodal fusion framework for outdoor scene image segmentation. Multimed Tools Appl. 2022;81(9): 12047–12060.
   Web of Science ®Google Scholar
• Li N, Zhao Y, Pan Q, et al. Full-time monocular road detection using zero-distribution prior of angle of polarization. In: European Conference on Computer Vision; 2020 Aug. Springer, Cham. p. 457–473.
   Google Scholar
• Zerrouki N, Harrou F, Sun Y. Statistical monitoring of changes to land cover. IEEE Geosci Remote Sens Lett. 2018;15(6):927–931.
   Web of Science ®Google Scholar
• Zerrouki N, Houacine A. Automatic classification of human body postures based on curvelet transform. In: International Conference Image Analysis and Recognition; 2014. Springer, Cham. p. 329–337.
   Google Scholar