A novel PSO-ViT approach for facial emotion recognition

References

• Aloysius N, Geetha M. 2017. A review on deep convolutional neural networks. Proceedings of the 2017 international conference on communication and signal processing (ICCSP); Chennai, India. IEEE. p. 0588–0592.
   Google Scholar
• Altameem T, Altameem A. 2020. Facial expression recognition using human machine interaction and multi-modal visualization analysis for healthcare applications. Image Vis Comput. 103:104044. doi: 10.1016/j.imavis.2020.104044.
   Web of Science ®Google Scholar
• Aouayeb M, Hamidouche W, Soladie C, Kpalma K, Seguier R. 2021. Learning vision transformer with squeeze and excitation for facial expression recognition. arXiv preprint arXiv:2107.03107.
   Google Scholar
• Bansal JC. 2019. Particle swarm optimization. In: Evolutionary and swarm intelligence algorithms. Springer; p. 11–23.
   Google Scholar
• Barsoum E, Zhang C, Ferrer CC, Zhang Z. 2016. Training deep networks for facial expression recognition with crowd-sourced label distribution. Proceedings of the 18th ACM International Conference on Multimodal Interaction; Nov 12–16; Tokyo, Japan. p. 279–283.
   Google Scholar
• Canal FZ, Müller TR, Matias JC, Scotton GG, de Sa Junior AR, Pozzebon E, Sobieranski AC. 2022. A survey on facial emotion recognition techniques: a state-of-the-art literature review. Inf Sci (Ny). 582:593–617. doi: 10.1016/j.ins.2021.10.005.
   Web of Science ®Google Scholar
• Chaudhari A, Bhatt C, Krishna A, Mazzeo PL. 2022. Vitfer: facial emotion recognition with vision transformers. Appl Sys Innovat. 5(4):80. doi: 10.3390/asi5040080.
   Google Scholar
• Cornejo JYR, Pedrini H, Flórez-Revuelta F. 2015. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. Proceedings of the 20th Iberoamerican Congress, CIARP 2015; Nov 9-12; Montevideo, Uruguay. Springer. p. 263–270.
   Google Scholar
• Dalvi C, Rathod M, Patil S, Gite S, Kotecha K. 2021. A survey of ai-based facial emotion recognition: features, ml & dl techniques, age-wise datasets and future directions. IEEE Acces. 9:165806–165840. doi: 10.1109/ACCESS.2021.3131733.
   Web of Science ®Google Scholar
• Domínguez-Jiménez JA, Campo-Landines KC, Martnez-Santos JC, Delahoz EJ, Contreras-Ortiz SH. 2020. A machine learning model for emotion recognition from physiological signals. Biomed Signal Process Control. 55:101646. doi: 10.1016/j.bspc.2019.101646.
   Web of Science ®Google Scholar
• Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, et al. 2021. An image is worth 16x16 words: transformers for image recognition at scale. In: 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. Available from: https://openreview.net/forum?id=YicbFdNTTy.
   Google Scholar
• Gad AG. 2022. Particle swarm optimization algorithm and its applications: a systematic review. Arch Comput Methods Eng. 1–31. doi: 10.1007/s11831-022-09819-3.
   PubMed Web of Science ®Google Scholar
• Gavade PA, Bhat VS, Pujari J. 2022. Improved deep generative adversarial network with illuminant invariant local binary pattern features for facial expression recognition. Comput Methods Biomech Biomed Eng Imaging Vis. 1–18. doi: 10.1080/21681163.2022.2103450.
   Web of Science ®Google Scholar
• Ge H, Zhu Z, Dai Y, Wang B, Wu X. 2022. Facial expression recognition based on deep learning. Comput Methods Programs Biomed. 215:106621. doi: 10.1016/j.cmpb.2022.106621.
   PubMed Web of Science ®Google Scholar
• Ghazouani H. 2021. A genetic programming-based feature selection and fusion for facial expression recognition. Appl Software Comput. 103:107173. doi: 10.1016/j.asoc.2021.107173.
   Web of Science ®Google Scholar
• Goodfellow IJ, Erhan D, Carrier PL, Courville A, Mirza M, Hamner B, Cukierski W, Tang Y, Thaler D, Lee DH, et al. 2013. Challenges in representation learning: a report on three machine learning contests. Proceedings of the 20th International conference on neural information processing; Nov 3-7; Daegu, Korea. Springer. p. 117–124.
   Google Scholar
• Han K, Wang Y, Chen H, Chen X, Guo J, Liu Z, Tang Y, Xiao A, Xu C, Xu Y, et al. 2022. A survey on vision transformer. IEEE Trans Pattern Anal Mach. 45(1): 87–110.
   PubMed Web of Science ®Google Scholar
• Hendrycks D, Gimpel K. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:160608415.
   Google Scholar
• Huang Y, Chen F, Lv S, Wang X. 2019. Facial expression recognition: A survey. Symmetry. 11(10):1189. doi: 10.3390/sym11101189.
   Google Scholar
• Huang Q, Huang C, Wang X, Jiang F. 2021. Facial expression recognition with grid-wise attention and visual transformer. Inf Sci (Ny). 580:35–54. doi: 10.1016/j.ins.2021.08.043.
   Web of Science ®Google Scholar
• Innocente MS, Sienz J. 2021. Coefficients’ settings in particle swarm optimization: insight and guidelines. arXiv preprint arXiv:210111944.
   Google Scholar
• Juneja M, Nagar S. 2016. Particle swarm optimization algorithm and its parameters: a review. Proceedings of the 2016 International Conference on Control, Computing, Communication and Materials (ICCCCM); Oct 21–22; Allahabad, India. IEEE. p. 1–5.
   Google Scholar
• Jung H, Lee S, Yim J, Park S, Kim J. 2015. Joint fine-tuning in deep neural networks for facial expression recognition. Proceedings of the IEEE international conference on computer vision; Dec 7–13; Santiago, Chile. p. 2983–2991.
   Google Scholar
• Kanade T, Cohn JF, Tian Y. 2000. Comprehensive database for facial expression analysis. In: Proceedings fourth IEEE international conference on automatic face and gesture recognition (cat. No. PR00580); Mar 28–30; Grenoble, France. IEEE. p. 46–53.
   Google Scholar
• Kennedy J, Eberhart R. 1995. Particle swarm optimization. Proceedings of ICNN’95-international conference on neural networks; Nov 27–Dec 1; Perth, WA, Australia; vol. 4. IEEE. p. 1942–1948.
   Google Scholar
• Khan AR. 2022. Facial emotion recognition using conventional machine learning and deep learning methods: Current achievements, analysis and remaining challenges. Information. 13(6):268. Available from. doi:10.3390/info13060268.
   Google Scholar
• Khan S, Naseer M, Hayat M, Zamir SW, Khan FS, Shah M. 2022. Transformers in vision: a survey. ACM Comput Surv (CSUR). 54(10s):1–41. doi: 10.1145/3505244.
   Web of Science ®Google Scholar
• Kim S, Nam J, Ko BC. 2022. Facial expression recognition based on squeeze vision transformer. Sensors. 22(10):3729. doi: 10.3390/s22103729.
   PubMed Web of Science ®Google Scholar
• Koduru A, Valiveti HB, Budati AK. 2020. Feature extraction algorithms to improve the speech emotion recognition rate. Int J Speech Technol. 23(1):45–55. doi: 10.1007/s10772-020-09672-4.
   Web of Science ®Google Scholar
• Krizhevsky A, Sutskever I, Hinton GE. 2017. Imagenet classification with deep convolutional neural networks. Commun ACM. 60(6):84–90. doi: 10.1145/3065386.
   Web of Science ®Google Scholar
• Lin T, Wang Y, Liu X, Qiu X. 2022. A survey of transformers. AI Open.
   Google Scholar
• Liu Y, Zhang Y, Wang Y, Hou F, Yuan J, Tian J, Zhang Y, Shi Z, Fan J, He Z. 2021. A survey of visual transformers. IEEE Trans Neural Networks Learn Syst.
   Web of Science ®Google Scholar
• Li J, Wang Y, See J, Liu W. 2019. Micro-expression recognition based on 3d flow convolutional neural network. Pattern Anal Appl. 22(4):1331–1339. doi: 10.1007/s10044-018-0757-5.
   Web of Science ®Google Scholar
• Li Y, Zeng J, Shan S, Chen X. 2018. Occlusion aware facial expression recognition using cnn with attention mechanism. IEEE Trans Image Process. 28(5):2439–2450. doi: 10.1109/TIP.2018.2886767.
   Web of Science ®Google Scholar
• Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I. 2010. The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. Proceedings of the 2010 ieee computer society conference on computer vision and pattern recognition-workshops; Jun 13–18; San Francisco, California, USA. IEEE. p. 94–101.
   Google Scholar
• Mahata J, Phadikar A. 2017. Recent advances in human behaviour understanding: a survey. 2017 devices for Integrated Circuit (DevIC). 751–755.
   Google Scholar
• Maithri M, Raghavendra U, Gudigar A, Samanth J, Barua PD, Murugappan M, Chakole Y, Acharya UR. 2022. Automated emotion recognition: Current trends and future perspectives. Comput Methods Programs Biomed. 215:106646. Computer methods and programs in biomedicine:106646. doi: 10.1016/j.cmpb.2022.106646.
   PubMed Web of Science ®Google Scholar
• Ma F, Sun B, Li S. 2021. Facial expression recognition with visual transformers and attentional selective fusion. IEEE Trans Affective Comput.
   Web of Science ®Google Scholar
• Mishra RK, Urolagin S, Jothi JAA, Gaur P. 2022. Deep hybrid learning for facial expression binary classifications and predictions. Image Vis Comput. 128:104573. doi: 10.1016/j.imavis.2022.104573.
   Web of Science ®Google Scholar
• Saragih RE, To QH. 2022. A survey of face recognition based on convolutional neural network. Indones J Inf Syst. 4(2): doi:10.24002/ijis.v4i2.5439.
   Google Scholar
• Sawat DD, Hegadi RS. 2017. Unconstrained face detection: a deep learning and machine learning combined approach. CSI Transactions On ICT. 5(2):195–199. doi: 10.1007/s40012-016-0149-1.
   Google Scholar
• Shami TM, El-Saleh AA, Alswaitti M, Al-Tashi Q, Summakieh MA, Mirjalili S. 2022. Particle swarm optimization: acomprehensive survey. IEEE Access. 10:10031–10061.
   Web of Science ®Google Scholar
• Sharif M, Naz F, Yasmin M, Shahid MA, Rehman A. 2017. Face recognition: A survey. J Eng Sci Technol Rev. 10(2):166–177. doi: 10.25103/jestr.102.20.
   Google Scholar
• Siddiqi MH, Ali R, Khan AM, Kim ES, Kim GJ, Lee S. 2015. Facial expression recognition using active contour-based face detection, facial movement-based feature extraction, and non-linear feature selection. Multimedia Syst. 21(6):541–555. doi: 10.1007/s00530-014-0400-2.
   Web of Science ®Google Scholar
• Song Z. 2021. Facial expression emotion recognition model integrating philosophy and machine learning theory. Front Psychol. 12: Available from. doi:10.3389/fpsyg.2021.759485.
   Web of Science ®Google Scholar
• Song Z, Nguyen K, Nguyen T, Cho C, Gao J. 2022. Spartan face mask detection and facial recognition system. Healthcare. 10(1):87. MDPI. doi:10.3390/healthcare10010087.
   Web of Science ®Google Scholar
• Tunstall L, von Werra L, Wolf T. 2022. Natural language processing with transformers. O’Reilly Media, Inc.
   Google Scholar
• Vyas AS, Prajapati HB, Dabhi VK. 2019. Survey on face expression recognition using cnn. Proceedings of the 2019 5th international conference on advanced computing & communication systems (ICACCS); Mar 15–16; Coimbatore, India. IEEE. p. 102–106.
   Google Scholar
• Wang D, Tan D, Liu L. 2018. Particle swarm optimization algorithm: an overview. Soft Comput. 22(2):387–408. doi: 10.1007/s00500-016-2474-6.
   Web of Science ®Google Scholar
• Whitehill J, Bartlett MS, Movellan JR. 2013. Automatic facial expression recognition. Social emotions in nature and artifact. 88.
   Google Scholar
• Xue F, Wang Q, Guo G. 2021. Transfer: learning relation-aware facial expression representations with transformers. Proceedings of the IEEE/CVF International Conference on Computer Vision; Oct 11–17; Montreal, BC, Canada. p. 3601–3610.
   Google Scholar
• Xu Y, Wei H, Lin M, Deng Y, Sheng K, Zhang M, Tang F, Dong W, Huang F, Xu C. 2022. Transformers in computational visual media: a survey. Comput Vis Media. 8(1):33–62. doi: 10.1007/s41095-021-0247-3.
   Google Scholar
• Zadeh LA. 1996. Fuzzy logic, neural networks, and soft computing. Fuzzy sets, fuzzy logic, and fuzzy systems: selected papers by Lotfi A Zadeh. World Scientific; p. 775–782.
   Google Scholar