Research on map emotional semantics using deep learning approach

References

• Akhand, M. A. H., Roy, S., Siddique, N., Kamal, M. A. S., & Shimamura, T. (2021). Facial emotion recognition using transfer learning in the deep CNN. Electronics (Switzerland), 10(9), 1036. https://doi.org/10.3390/electronics10091036
   Google Scholar
• Alam, M., Wang, J. F., Guangpei, C., Yunrong, L., & Chen, Y. (2021). Convolutional neural network for the semantic segmentation of remote sensing images. Mobile Networks and Applications, 26(1), 1–16. https://doi.org/10.1007/s11036-020-01703-3
   Web of Science ®Google Scholar
• Campos, V., Jou, B., & Giró-I-Nieto, X. (2017). From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction. Image and Vision Computing, 65, 15–22. https://doi.org/10.1016/j.imavis.2017.01.011
   Web of Science ®Google Scholar
• Cao, Y. B., Hong-Bei, F. U., & Pan, Z. C. (2011). Aesthetic analysis in the map design. Geomatics & Spatial Information Technology, 34(1), 231–233. https://doi.org/10.3969/j.issn.1672-5867.2011.01.070
   Google Scholar
• Chen, M., Zhang, L., & Allebach, J. P. (2015). Learning deep features for image emotion classification. In Proceedings of International Conference on Image Processing (pp. 4491–4495). IEEE. https://doi.org/10.1109/ICIP.2015.7351656
   Google Scholar
• Chowdary, M. K., Nguyen, T. N., & Hemanth, D. J. (2021). Deep learning-based facial emotion recognition for human–computer interaction applications. Neural Computing & Applications. https://doi.org/10.1007/s00521-021-06012-8
   Web of Science ®Google Scholar
• Colombo, C., Del Bimbo, A., & Pala, P. (1999). Semantics in visual information retrieval. IEEE MultiMedia, 6(3), 38–53. https://doi.org/10.1109/93.790610
   Web of Science ®Google Scholar
• Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018). Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nature Medicine, 24(10), 1559–1567. https://doi.org/10.1038/s41591-018-0177-5
   PubMed Web of Science ®Google Scholar
• Das, P., Ghosh, A., & Majumdar, R. (2020). Determining attention mechanism for visual sentiment analysis of an image using svm classifier in deep learning based architecture. In proceedings of 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) (pp. 339–343). IEEE. https://doi.org/10.1109/ICRITO48877.2020.9197899
   Google Scholar
• Deng, J., Dong, W., Socher, R., Li, L. -J., Kai, L., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition (pp. 248–255). IEEE. https://doi.org/10.1109/cvpr.2009.5206848
   Google Scholar
• Dhar, D. B., & Chanda, B. (2006). Extraction and recognition of geographical features from paper maps. International Journal on Document Analysis and Recognition, 8(4), 232–245. https://doi.org/10.1007/s10032-005-0010-9
   Web of Science ®Google Scholar
• Gong, H., Li, Q., Li, C., Dai, H., He, Z., Wang, W., Li, H., Han, F., Tuniyazi, A., & Mu, T. (2021). Multiscale information fusion for hyperspectral image classification based on hybrid 2d‐3d CNN. Remote Sensing, 13(12), 2268. https://doi.org/10.3390/rs13122268
   Web of Science ®Google Scholar
• Gong, R., Wang, Q., Hai, Y., & Shao, X. (2017). Investigation on factors to influence color emotion and color preference responses. Optik - International Journal for Light and Electron Optics, 136, 71–78. https://doi.org/10.1016/j.ijleo.2017.02.026
   Google Scholar
• He, X., King, O., Ma, W. Y., Li, M., & Zhang, H. J. (2003). Learning a semantic space from user’s relevance feedback for image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 13(1), 39–48. https://doi.org/10.1109/TCSVT.2002.808087
   Web of Science ®Google Scholar
• Hussain, M., Bird, J. J., & Faria, D. R. (2019). A study on CNN transfer learning for image classification. In Proceedings of 18th UK Workshop on Computational Intelligence (UKCI) (pp. 191–202). Springer. https://doi.org/10.1007/978-3-319-97982-3_16
   Google Scholar
• Islam, J., & Zhang, Y. (2016). Visual sentiment analysis for social images using transfer learning approach. In Proceedings of 2016 IEEE International Conferences on Big Data and Cloud Computing, BDCloud 2016, Social Computing and Networking, SocialCom 2016 and Sustainable Computing and Communications, SustainCom 2016 (pp. 124–130). IEEE. https://doi.org/10.1109/BDCloud-SocialCom-SustainCom.2016.29
   Google Scholar
• Ji, R., Cao, D., Zhou, Y., & Chen, F. (2016). Survey of visual sentiment prediction for social media analysis. Frontiers of Computer Science, 10(4), 602–611. https://doi.org/10.1007/s11704-016-5453-2
   Web of Science ®Google Scholar
• Jia, J., Wu, S., Wang, X., Hu, P., Cai, L., & Tang, J. (2012). Can we understand van Gogh’s mood? Learning to infer affects from images in social networks. MM ’12 - Proceedings of the 20th ACM International Conference on Multimedia (pp. 857–860). ACM. https://doi.org/10.1145/2393347.2396330
   Google Scholar
• Jindal, S., & Singh, S. (2016, December). Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning. In Proceedings of IEEE International Conference on Information Processing (pp. 447–451). IEEE. https://doi.org/10.1109/INFOP.2015.7489424
   Google Scholar
• Lang, P. J. (1979). A bio-informational theory of emotional imagery. Psychophysiology, 16(6), 495–512. https://doi.org/10.1111/j.1469-8986.1979.tb01511.x
   PubMed Web of Science ®Google Scholar
• Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1998). Emotion, motivation, and anxiety: Brain mechanisms and psychophysiology. In Proceedings of Research Symposium on Brain Neurocircuitry of Anxiety and Fear - Implications for Clinical Research and Practice (pp. 1248–1263). Elsevier. https://doi.org/10.1016/S0006-3223(98)00275-3
   Google Scholar
• Li, H., Wang, Z., Yin, G., Deng, H., Yang, X., Yao, R., Gao, P., & Cao, R. (2019, April). A multi-feature fusion and SSAE-Based deep network for image semantic recognition. In Proceedings of 5th IEEE International Conference on Big Data Service and Applications, BigDataService 2019, Workshop on Big Data in Water Resources, Environment, and Hydraulic Engineering and Workshop on Medical, Healthcare, Using Big Data Technologies (pp. 322–327). IEEE Computer Society. https://doi.org/10.1109/BigDataService.2019.00057
   Google Scholar
• Lu, X., Suryanarayan, P., Adams, R. B., Li, J., Newman, M. G., & Wang, J. Z. (2012). On shape and the computability of emotions. MM ’12 - Proceedings of the 20th ACM International Conference on Multimedia (pp. 229–238). ACM. https://doi.org/10.1145/2393347.2393384
   Google Scholar
• Ma, C., & Fei, L. (2005). Design of visual transmitting in map emotion information. Geomatics and Information Science of Wuhan University, 30(4), 313–316. https://doi.org/10.3969/j.issn.1671-8860.2005.04.008
   Google Scholar
• Machajdik, J., & Hanbury, A. (2010). Affective image classification using features inspired by psychology and art theory. MM’10 - Proceedings of the ACM Multimedia 2010 Inter-national Conference (pp. 83–92). ACM. https://doi.org/10.1145/1873951.1873965
   Google Scholar
• Mikels, J. A., Fredrickson, B. L., Larkin, G. R., Lindberg, C. M., Maglio, S. J., & Reuter-Lorenz, P. A. (2005). Emotional category data on images from the international affective picture system. Behavior Research Methods, 37(4), 626–630. https://doi.org/10.3758/BF03192732
   PubMed Web of Science ®Google Scholar
• Ortis, A., Farinella, G. M., & Battiato, S. (2020). Survey on visual sentiment analysis. IET Image Processing, 14(8), 1440–1456. https://doi.org/10.1049/iet-ipr.2019.1270
   Web of Science ®Google Scholar
• Ou, L. C., Luo, M. R., Woodcock, A., & Wright, A. (2004). A study of colour emotion and colour preference. Part III: Colour preference modeling. Color Research and Application, 29(5), 381–389. https://doi.org/10.1002/col.20047
   Web of Science ®Google Scholar
• Priya, D. T., & Udayan, J. D. (2020). Transfer learning techniques for emotion classification on visual features of images in the deep learning network. International Journal of Speech Technology, 23(8), 361–372. https://doi.org/10.1007/s10772-020-09707-w
   Google Scholar
• Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., & Fei-Fei, L. (2015). ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115(3), 211–252. https://doi.org/10.1007/s11263-015-0816-y
   Web of Science ®Google Scholar
• Sartori, A., Culibrk, D., Yan, Y., & Sebe, N. (2015). Who’s afraid of itten: Using the art theory of color combination to analyze emotions in abstract paintings. MM ’15 - Proc-eedings of the 2015 ACM Multimedia Conference (pp. 311–320). ACM. https://doi.org/10.1145/2733373.2806250
   Google Scholar
• Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020). Grad-CAM: Visual explanations from deep networks via gradient-based localization. International Journal of Computer Vision, 128(2), 336–359. https://doi.org/10.1007/s11263-019-01228-7
   Web of Science ®Google Scholar
• Siersdorfer, S., Minack, E., Deng, F., & Hare, J. (2010). Analyzing and predicting sentiment of images on the social web. MM ’10: Proceedings of the 18th ACM international conference on Multimedia (pp. 715–718). ACM. https://doi.org/10.1145/1873951.1874060
   Google Scholar
• Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. In 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings. International Conference on Learning Representations, ICLR. https://doi.org/10.48550/arXiv.1409.1556
   Google Scholar
• Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015, June). Going deeper with convolutions. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (pp. 1–9). IEEE. https://doi.org/10.1109/CVPR.2015.7298594
   Google Scholar
• Wang, H. F., Sun, Z. X., & Wang, J. (2002). Semantic image retrieval: Review and research. Journal of Computer Research and Development, 39, 513–523. https://www.mendeley.com/catalogue/d4977eb1-d2c7-314c-a317-7f85c730ca37/
   Google Scholar
• Wang, W., & He, Q. (2008, October). A survey on emotional semantic image retrieval. In Proceedings of 15th IEEE International Conference on Image Processing (pp. 117–120). IEEE. https://doi.org/10.1109/ICIP.2008.4711705
   Google Scholar
• Wang, W. N., & Yu, Y. L. (2003). A survey of image emotional semantic research. Journal of Circuits and Systems, 8(5), 101–109. https://doi.org/10.3969/j.issn.1007-0249.2003.05.023
   Google Scholar
• Wang, W. N., Yu, Y. L., & Jiang, S. M. (2006). Image retrieval by emotional semantics: A study of emotional space and feature extraction. In Proceedings of 2006 IEEE International Conference on Systems, Man and Cybernetics (Vol. 4, pp. 3534–3539). IEEE. https://doi.org/10.1109/ICSMC.2006.384667
   Google Scholar
• Wang, X., Guo, Q., Wang, Y., Liu, Q., & Wei, Z. (2019). Feature extraction and automatic recognition method for map images. Geomatics & Spatial Information Technology, 42(9), 28–32. https://doi.org/10.3969/j.issn.1672-5867.2019.09.009
   Google Scholar
• Yanulevskaya, V., van Gemert, J. C., Roth, K., Herbold, A. K., Sebe, N., & Geusebroek, J. M. (2008, October). Emotional valence categorization using holistic image features. In Proceedings of 15th IEEE International Conference on Image Processing (pp. 101–104). IEEE. https://doi.org/10.1109/ICIP.2008.47-11701
   Google Scholar
• You, Q., Luo, J., Jin, H., & Yang, J. (2016, February). Building a large scale dataset for image emotion recognition: The fine print and the benchmark. In Proceedings of 30th AAAI Conference on Artificial Intelligence (pp. 308–314). AAAI. https://doi.org/10.1609/aaai.v30i1.9987
   Google Scholar
• Zeiler, M. D., & Fergus, R. (2014). Visualizing and understanding convolutional networks. In Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) (Vol. 8689 LNCS, pp. 818–833). Springer. https://doi.org/10.1007/978-3-319-10590-1_53
   Google Scholar
• Zhang, H., & Xu, D. (2019). Ethnic painting analysis based on deep learning. Scientia Sinica Informationis, 49(2), 204–215. https://doi.org/10.1360/N112018-00249
   Google Scholar
• Zhang, N., Wei, X., Chen, H., & Liu, W. (2021). FPGA implementation for CNN-based optical remote sensing object detection. Electronics (Switzerland), 10(3), 282. https://doi.org/10.3390/electronics10030282
   Google Scholar
• Zhang, X., & Lou, S. (2018). Image emotional semantic annotation based on fusion features. In Proceedings of the 10th International Congress on Image and Signal Processing, Bio-Medical Engineering and Informatics, (CISP-BMEI 2017) (pp. 1–5). IEEE. https://doi.org/10.1109/CISP-BMEI.2017.8301971
   Google Scholar
• Zhao, S., Gao, Y., Jiang, X., Yao, H., Chua, T. S., & Sun, X. (2014, November). Exploring principles-of-art features for image emotion recognition. In Proceedings of the 2014 ACM Conference on Multimedia (pp. 47–56). ACM. https://doi.org/10.1145/2647868.2654930
   Google Scholar
• Zheng, W., Li, H., Xu, H., Sun, M., University, T., & University, T. (2017). Chinese painting emotion classification based on convolution neural network and SVM. Journal of Nanjing Normal University(Natural Science Edition), 40(3), 74–79,86. https://doi.org/10.3969/j.issn.1001-4616.2017.03.011
   Google Scholar
• Zhu, X., Li, L., Zhang, W., Rao, T., Xu, M., Huang, Q., & Xu, D. (2017, August). Dependency exploitation: A unified CNN-RNN approach for visual emotion recognition. In Proceedings of 26th International Joint Conference on Artificial Intelligence (pp. 3595–3601). IJCAI. https://doi.org/10.24963/ijcai.2017/503
   Google Scholar