Fabric surface characterization: assessment of deep learning-based texture representations using a challenging dataset

References

• Arashloo, S. R., & Kittler, J. (2014). Dynamic texture recognition using multiscale binarized statistical image features. IEEE Transactions on Multimedia, 16(8), 2099–2109. doi:10.1109/TMM.2014.2362855
   Web of Science ®Google Scholar
• Balakrishnan, H., Venkataraman, S., & Jayaraman, S. (1998). Fdics: A vision-based system for the identification and classification of fabric defects. Journal of the Textile Institute, 89(2), 365–380. doi:10.1080/00405009808658623
   Web of Science ®Google Scholar
• Bell, S., Upchurch, P., Snavely, N., & Bala, K. (2013). Opensurfaces: A richly annotated catalog of surface appearance. ACM Transactions on Graphics, 32(4), 1. doi:10.1145/2461912.2462002
   Web of Science ®Google Scholar
• Bell, S., Upchurch, P., Snavely, N., & Bala, K. (2015). Material recognition in the wild with the materials in context database, Boston, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3479–3487).
   Google Scholar
• Caputo, B., Hayman, E., & Mallikarjuna, P. (2005). Class-specific material categorisation, Beijing, China. IEEE International Conference on Computer Vision (ICCV), vol. 2, pp. 1597–1604.
   Google Scholar
• Chun, Y. D., Kim, N. C., & Jang, I. H. (2008). Content-based image retrieval using multiresolution color and texture features. IEEE Transactions on Multimedia, 10(6), 1073–1084. doi:10.1109/TMM.2008.2001357
   Web of Science ®Google Scholar
• Ciesielska-Wrobel, I. L., & Langenhove, L. V. (2012). The hand of textiles–definitions, achievements, perspectives–A review. Textile Research Journal, 82(14), 1457–1468.
   Web of Science ®Google Scholar
• Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., & Vedaldi, A. (2014). Describing textures in the wild, Columbus, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3606–3613).
   Google Scholar
• Cimpoi, M., Maji, S., & Vedaldi, A. (2015). Deep filter banks for texture recognition and segmentation, Boston, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3828–3836).
   Google Scholar
• Dana, K. J. (2016). Capturing computational appearance: More than meets the eye. IEEE Signal Processing Magazine, 33(5), 70–80. doi:10.1109/MSP.2016.2580179
   Web of Science ®Google Scholar
• Dana, K. J., Van, B. G., Nayar, S. K., & Koenderink, J. J. (1999). Reflectance and texture of real-world surfaces. ACM Transactions on Graphics (TOG), 18(1), 1–34. doi:10.1145/300776.300778
   Web of Science ®Google Scholar
• Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2014). Decaf: A deep convolutional activation feature for generic visual recognition, Beijing, China. International Conference on Machine Learning (ICML) (pp. 647–655).
   Google Scholar
• Freeman, W. T., & Tenenbaum, J. B. (1997). Learning bilinear models for two-factor problems in vision, San Juan, Puerto Rico. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 554–560).
   Google Scholar
• Hayman, E., Caputo, B., Fritz, M., & Eklundh, J.-O. (2004). On the significance of real-world conditions for material classification, Prague, Czech Republic. European Conference on Computer Vision (ECCV) (pp. 253–266).
   Google Scholar
• He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition, Las Vegas, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 770–778).
   Google Scholar
• Hu, Y., Long, Z., & Alregib, G. (2016). Completed local derivative pattern for rotation invariant texture classification, Phoenix, USA. IEEE International Conference on Image Processing (ICIP) (pp. 3548–3552).
   Google Scholar
• Hu, Y., Long, Z., & AlRegib, G. (2017). Scale selective extended local binary pattern for texture classification, New Orleans, USA. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 1413–1417).
   Google Scholar
• Hu, Y., Long, Z., & AlRegib, G. (2018). A high-speed, real-time vision system for texture tracking and thread counting. IEEE Signal Processing Letters, 25(6), 758–762. doi:10.1109/LSP.2018.2825309
   Web of Science ®Google Scholar
• Hu, Y., Long, Z., & AlRegib, G. (2019). Multi-level texture encoding and representation (multer) based on deep neural networks, Taipei, China. IEEE International Conference on Image Processing (ICIP) (pp. 4410-4414)
   Google Scholar
• Jégou, H., Douze, M., Schmid, C., & Pérez, P. (2010). Aggregating local descriptors into a compact image representation, San Francisco, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3304–3311).
   Google Scholar
• Kampouris, C., Zafeiriou, S., Ghosh, A., & Malassiotis, S. (2016). Fine- grained material classification using micro-geometry and reflectance, Amsterdam, NLD. European Conference on Computer Vision (ECCV) (pp. 778–792).
   Google Scholar
• Kawabata, S. (1980). The standardization and analysis of hand evaluation. The Textile Machinery Society Japan.
   Google Scholar
• Kawabata, S., & Niwa, M. (2017). Objective measurement of fabric hand. In Mastura Raheel (Ed.), Modern textile characterization methods (pp. 329–354). Routledge.
   Google Scholar
• Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks, Lake Tahoe, USA. In Advances in Neural Information Processing Systems (NIPS) (pp. 1097–1105).
   Google Scholar
• Li, R., & Adelson, E. H. (2013). Sensing and recognizing surface textures using a gelsight sensor, Portland, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1241–1247).
   Google Scholar
• Liu, C., Sharan, L., Adelson, E. H., & Rosenholtz, R. R. (2010). Exploring features in a bayesian framework for material recognition, San Francisco, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 239–246).
   Google Scholar
• Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., & Pietikäinen, M. (2019). From bow to cnn: Two decades of texture representation for texture classification. International Journal of Computer Vision, 127(1), 74–109. doi:10.1007/s11263-018-1125-z
   Web of Science ®Google Scholar
• Liu, L., Fieguth, P., Guo, Y., Wang, X., & Pietikäinen, M. (2017). Local binary features for texture classification: Taxonomy and experimental study. Pattern Recognition, 62, 135–160. doi:10.1016/j.patcog.2016.08.032
   Web of Science ®Google Scholar
• Lo, K., Wang, Y. F., & Hua, K. (2016). Example-based image textural style transfer. IEEE Multimedia, 23(4), 60–66. doi:10.1109/MMUL.2016.36
   Web of Science ®Google Scholar
• Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV), 60(2), 91–110. doi:10.1023/B:VISI.0000029664.99615.94
   Web of Science ®Google Scholar
• Ly, N. G. (1990). Fast–fabric assurance by simple testing. Australian Wool Textile Objective Measurement Executive Committee (AWTOMEC) Seminar.
   Google Scholar
• Ojala, T., Pietikäinen, M., & Harwood, D. (1996). A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29(1), 51–59. doi:10.1016/0031-3203(95)00067-4
   Web of Science ®Google Scholar
• Peirce, F. T. (1930). The handle of cloth as a measurable quantity. Journal of the Textile Institute Transactions, 21(9), T377–T416. doi:10.1080/19447023008661529
   Google Scholar
• Perronnin, F., & Dance, C. (2007). Fisher kernels on visual vocabularies for image categorization, Minneapolis, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1–8).
   Google Scholar
• Perronnin, F., Sanchez, J., & Mensink, T. (2010). Improving the fisher kernel for large-scale image classification, Crete, GRC. European Conference on Computer Vision (ECCV) (pp. 143–156).
   Google Scholar
• Rajamanickam, R., Park, S., & Jayaraman, S. (1998). A structured methodology for the design and development of textile structures in a concurrent engineering framework. Journal of the Textile Institute, 89(3), 44–62. doi:10.1080/00405009808658682
   Web of Science ®Google Scholar
• Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., & Fei-Fei, L. (2015). Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115(3), 211–252.
   Web of Science ®Google Scholar
• Sharan, L., Rosenholtz, R., & Adelson, E. (2009). Material perception: What can you see in a brief glance? Journal of Vision, 9(8), 784–784. doi:10.1167/9.8.784
   Google Scholar
• Song, Z., & Liu, S. (2017). Sufficient image appearance transfer combining color and texture. IEEE Transactions on Multimedia, 19(4), 702–711. doi:10.1109/TMM.2016.2631123
   Web of Science ®Google Scholar
• Srinivasan, K., & Jayaraman, S. (1999). The changing role of information technology in manufacturing. Computer Magazine., 32(3), 42–49. doi:10.1109/2.751328
   Web of Science ®Google Scholar
• Strese, M., Lee, J., Schuwerk, C., Han, Q., Kim, H., & Steinbach, E. (2014). A haptic texture database for tool-mediated texture recognition and classification, Richardson, USA. IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings (pp. 118–123).
   Google Scholar
• Sun, W., Yao, B., Chen, B., He, Y., Cao, X., Zhou, T., & Liu, H. (2018). Noncontact surface roughness estimation using 2d complex wavelet enhanced resnet for intelligent evaluation of milled metal surface quality. Applied Sciences, 8(3), 381. doi:10.3390/app8030381
   Google Scholar
• Tamura, H., Mori, S., & Yamawaki, T. (1978). Textural features corresponding to visual perception. IEEE Transactions on Systems, Man, and Cybernetics, 8(6), 460–473. doi:10.1109/TSMC.1978.4309999
   Web of Science ®Google Scholar
• Ujević, D., Kovacčević, S., Wadsworth, L., Schwarz, I., & Ajatovic, B. B. S. (2009). Analysis of artificial leather with textile fabric on the backside. Journal of Textile and Apparel, Technology and Management, 6(2), 1–9.
   Google Scholar
• Wang, T., Zhu, J., Hiroaki, E., Chandraker, M., Efros, A. A., & Ramamoorthi, R. (2016). A 4d light-field dataset and cnn architectures for material recognition, Amsterdam, NLD. European Conference on Computer Vision (ECCV) (pp. 121–138).
   Google Scholar
• Xue, J. (2018). Deep-encoding-pooling-network-DEP. https://github.com/jiaxue1993/Deep-Encoding-Pooling-Network-DEP-git/
   Google Scholar
• Xue, J., Zhang, H., & Dana, K. (2018). Deep texture manifold for ground terrain recognition, Salt Lake City, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 558–567).
   Google Scholar
• Xue, J., Zhang, H., Dana, K., & Nishino, K. (2017). Differential angular imaging for material recognition, Hawaii, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 764–773).
   Google Scholar
• Zhang, H., Dana, K., & Nishino, K. (2015). Reflectance hashing for material recognition, Boston, USA. IEEE Conference on Computer Vision and Pattern Recognition (pp. 3071–3080).
   Google Scholar
• Zhang, H., Xue, J., & Dana, K. (2017). Deep ten: Texture encoding network, Hawaii, USA. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2896–2905).
   Google Scholar
• Zhao, X., Lin, Y., & Heikkilä, J. (2018). Dynamic texture recognition using volume local binary count patterns with an application to 2d face spoofing detection. IEEE Transactions on Multimedia, 20(3), 552–566. doi:10.1109/TMM.2017.2750415
   Web of Science ®Google Scholar
• Zhao, X., Lin, Y., Liu, L., Heikkilä, J., & Zheng, W. (2019). Dynamic texture classification using unsupervised 3d filter learning and local binary encoding. IEEE Transactions on Multimedia, 21(7), 1694–1708. doi:10.1109/TMM.2018.2890362
   Web of Science ®Google Scholar
• Zheng, H., Fang, L., Ji, M., Strese, M., Ozer, Y., & Steinbach, E. (2016). Deep learning for surface material classification using haptic and visual information. IEEE Transactions on Multimedia, 18(12), 2407–2416. doi:10.1109/TMM.2016.2598140
   Web of Science ®Google Scholar