Sentiment classification and aspect-based sentiment analysis on yelp reviews using deep learning and word embeddings

References

• Abdi, A., Shamsuddin, S.M., Hasan, S., & Piran, J. (2019). Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Information Processing and Management, 56(4), 1245–1259. https://doi.org/10.1016/j.ipm.2019.02.018
   Web of Science ®Google Scholar
• Batista, G.E.A.P.A., Prati, R.C., & Monard, M.C. (2004). A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsletter, 6(1), 20–29. https://doi.org/10.1145/1007730.1007735
   Google Scholar
• Chen, D., Denman, S., Fookes, C., & Sridharan, S. (2010). AWD-LSTM. Proceedings of the 2010 digital image computing: Techniques and applications (DICTA 2010), 369–374. Sydney, Australia. https://doi.org/10.1109/DICTA.2010.69
   Google Scholar
• Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. ArXiv. http://arxiv.org/abs/1810.04805
   Google Scholar
• Do, H.H., Prasad, P.W.C., Maag, A., & Alsadoon, A. (2019). Deep learning for aspect-based sentiment analysis: A comparative review. Expert Systems with Applications, 118, 272–299. https://doi.org/10.1016/j.eswa.2018.10.003
   Web of Science ®Google Scholar
• Fu, X., Yang, J., Li, J., Fang, M., & Wang, H. (2018). Lexicon-enhanced LSTM with attention for general sentiment analysis. IEEE Access, 6, 71884–71891. https://doi.org/10.1109/ACCESS.2018.2878425
   Web of Science ®Google Scholar
• Ganu, G., Elhadad, N., & Marian, A. (2009). Beyond the stars: Improving rating predictions using review text content. WebDB, 9, 1–6.
   Google Scholar
• Giménez, M., Palanca, J., & Botti, V. (2020). Semantic-based padding in convolutional neural networks for improving the performance in natural language processing: A case of study in sentiment analysis. Neurocomputing, 378, 315–323. https://doi.org/10.1016/j.neucom.2019.08.096
   Web of Science ®Google Scholar
• Hemmatian, F., & Sohrabi, M.K. (2019). A survey on classification techniques for opinion mining and sentiment analysis. Artificial Intelligence Review, 52(3), 1495–1545. https://doi.org/10.1007/s10462-017-9599-6
   Web of Science ®Google Scholar
• Howard, J., & Ruder, S. (2018). Universal language model fine-tuning for text classification. ACL 2018: 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 1, 328–339. https://doi.org/10.18653/v1/p18-1031
   Google Scholar
• Huang, A. (2008). Similarity measures for text document clustering. New Zealand computer science research student conference, NZCSRSC 2008, 49–56. Christchurch, New Zealand.
   Google Scholar
• Jeong, E.H., & Jang, S.C.S. (2011). Restaurant experiences triggering positive electronic word-of-mouth (eWOM) motivations. International Journal of Hospitality Management, 30(2), 356–366. https://doi.org/10.1016/j.ijhm.2010.08.005
   Web of Science ®Google Scholar
• Jianqiang, Z., Xiaolin, G., & Xuejun, Z. (2018). Deep convolution neural networks for twitter sentiment analysis. IEEE Access, 6, 23253–23260. https://doi.org/10.1109/ACCESS.2017.2776930
   Google Scholar
• Johnson, R., & Zhang, T. (2017). Deep pyramid convolutional neural networks for text categorisation. ACL 2017: 55th annual meeting of the association for computational linguistics, proceedings of the conference (Long papers), 1, 562–570. Vancouver, Canada. https://doi.org/10.18653/v1/P17-1052
   Google Scholar
• Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2017). Bag of tricks for efficient text classification. 15th conference of the European chapter of the association for computational linguistics, EACL 2017, 2, 427–431. Valencia, Spain. https://doi.org/10.18653/v1/e17-2068
   Google Scholar
• Kiritchenko, S., Zhu, X., Cherry, C., & Mohammad, S. (2014). NRC-Canada-2014: Detecting aspects and sentiment in customer reviews. Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), 437–442. Dublin, Ireland. https://doi.org/10.3115/v1/s14-2076
   Google Scholar
• Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2, 1097–1105.
   Google Scholar
• Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019). ALBERT: A lite BERT for self-supervised learning of language representations. ArXiv. http://arxiv.org/abs/1909.11942
   Google Scholar
• Li, G., & Liu, F. (2014). Sentiment analysis based on clustering: A framework in improving accuracy and recognising neutral opinions. Applied Intelligence, 40(3), 441–452. https://doi.org/10.1007/s10489-013-0463-3
   Web of Science ®Google Scholar
• Liu, B. (2010). Sentiment analysis and subjectivity. In N. Indurkhya & F. Damerau (Eds.), Handbook of natural language processing (2nd ed., pp. 627-666). Chapman & Hall: CRC Press.
   Google Scholar
• Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems, 3111–3119. http://arxiv.org/abs/1310.4546
   Google Scholar
• Osuszek, L., Stanek, S., & Twardowski, Z. (2016). Leverage big data analytics for dynamic informed decisions with advanced case management. Journal of Decision Systems, 25(Suppl. 1), 436–449. https://doi.org/10.1080/12460125.2016.1187401
   Google Scholar
• Pennington, J., Socher, R., & Manning, C.D. (2014). GloVe: Global vectors for word representation. EMNLP 2014: 2014 Conference on Empirical Methods in Natural Language Processing, 1532–1543. https://doi.org/10.3115/v1/d14-1162
   Google Scholar
• Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018). Deep contextualised word representations. Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: Human language technologies, 1, 2227–2237. New Orleans, Louisiana. https://doi.org/10.18653/v1/n18-1202
   Google Scholar
• Ramos, J. (2003). Using TF–IDF to determine word relevance in document queries. Proceedings of the first instructional conference on machine learning, 242, 133–142.
   Google Scholar
• Rao, G., Huang, W., Feng, Z., & Cong, Q. (2018). LSTM with sentence representations for document-level sentiment classification. Neurocomputing, 308, 49–57. https://doi.org/10.1016/j.neucom.2018.04.045
   Web of Science ®Google Scholar
• Rezaeinia, S.M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019). Sentiment analysis based on improved pre-trained word embeddings. Expert Systems With Applications, 117, 139–147. https://doi.org/10.1016/j.eswa.2018.08.044
   Web of Science ®Google Scholar
• Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to fine-tune BERT for text classification? Lecture Notes in Computer Science, 11856 LNAI(May), 194–206. https://doi.org/10.1007/978-3-030-32381-3_16
   Google Scholar
• Vairetti, C., Martínez-Cámara, E., Maldonado, S., Luzón, V., & Herrera, F. (2020). Enhancing the classification of social media opinions by optimizing the structural information. Future Generation Computer Systems, 102, 838–846. https://doi.org/10.1016/j.future.2019.09.023
   Web of Science ®Google Scholar
• Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems. NIPS’17: Proceedings of the 31st international conference on neural information processing systems, 6000–6010. Long Beach, CA, USA. http://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
   Google Scholar
• Verhoef, P.C., Broekhuizen, T., Bart, Y., Bhattacharya, A., Qi Dong, J., Fabian, N., & Haenlein, M. (2021). Digital transformation: A multidisciplinary reflection and research agenda. Journal of Business Research, 122, 889-901. https://doi.org/10.1016/j.jbusres.2019.09.022
   Google Scholar
• Wei, Z., Miao, D., Chauchat, J.H., Zhao, R., & Li, W. (2009). N-grams based feature selection and text representation for Chinese text classification. International Journal of Computational Intelligence Systems, 2(4), 365–374. https://doi.org/10.1080/18756891.2009.9727668
   Web of Science ®Google Scholar
• Xu, H., Liu, B., Shu, L., & Yu, P.S. (2018). Double embeddings and CNN-based sequence labeling for aspect extraction. ACL 2018: 56th annual meeting of the association for computational linguistics, proceedings of the conference, 2, 592–598. Melbourne, Australia. https://doi.org/10.18653/v1/p18-2094
   Google Scholar
• Yadav, A., & Vishwakarma, D.K. (2020). Sentiment analysis using deep learning architectures: A review. Artificial Intelligence Review, 53, 4335–4385. https://doi.org/10.1007/s10462-019-09794-5
   Web of Science ®Google Scholar
• Yu, L.C., Wang, J., Lai, K.R., & Zhang, X. (2018). Refining word embeddings using intensity scores for sentiment analysis. IEEE/ACM Transactions on Audio Speech and Language Processing, 26(3), 671–681. https://doi.org/10.1109/TASLP.2017.2788182
   Web of Science ®Google Scholar
• Zhang, H. (2005). Exploring conditions for the optimality of naïve Bayes. International Journal of Pattern Recognition and Artificial Intelligence, 19(2), 183–198. https://doi.org/10.1142/S0218001405003983
   Web of Science ®Google Scholar
• Zhang, X., Zhao, J., & Lecun, Y. (2015). Character-level convolutional networks for text. In NIPS, 649–657.
   Google Scholar
• Zhao, R., & Mao, K. (2018). Fuzzy bag-of-words model for document representation. IEEE Transactions on Fuzzy Systems, 26(2), 794–804. https://doi.org/10.1109/TFUZZ.2017.2690222
   Web of Science ®Google Scholar