Neural Visual Social Comment on Image-Text Content

References

• E. Ferrara, O. Varol, C. Davis, F. Menczer, and A. Flammini, “The rise of social bots,” Commun. ACM., Vol. 59, pp. 96–104, Jul. 2016. doi: 10.1145/2818717
   Web of Science ®Google Scholar
• A. Karataş, and S. A. Şahin. “A review on Social Bot Detection techniques and research directions,” in Proceedings of the International Conference on Information Security and Cryptology, Ankara, Oct. 20–21, 2017, pp.156–161.
   Google Scholar
• S. Weibo. Available: https://www.weibo.com/.
   Google Scholar
• Y. Wu, W. Wu, C. Xing, M. Zhou, and Z. Li. “Sequential matching network: a new architecture for multi-turn response selection in retrieval-based chatbots,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, Jul. 30-Aug. 4, 2017, pp. 496–505.
   Google Scholar
• X. Zhou, L. Li, D. Dong, Y. Liu, Y. Chen, W. X. Zhao, D. Yu, and H. Wu. “Multi-turn response selection for chatbots with deep attention matching network,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Jul. 15–20, 2018, pp. 1118–1127.
   Google Scholar
• C. Tao, W. Wu, C. Xu, W. Hu, D. Zhao, and R. Yan. “Multi-representation fusion network for multi-turn response selection in retrieval-based chatbots,” in Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, Melbourne, Feb. 11–15, 2019, pp. 267–275.
   Google Scholar
• A. Ritter, C. Cherry, and W. B. Dolan. “Data-driven response generation in social media,” in Proceedings of the conference on empirical methods in natural language processing, Edinburgh, Jul. 27–31, 2011, pp. 583–593.
   Google Scholar
• L. Shang, Z. Lu, and H. Li. “Neural responding machine for short-text conversation,” in Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, Jul. 26–31, 2015, pp. 1577–1586.
   Google Scholar
• I. V. Serban, A. Sordoni, Y. Bengio, A. Courville, and J. Pineau. “Building end-to-end dialogue systems using generative hierarchical neural network models,” in Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, Feb. 12–17, 2016, pp. 3776–3783.
   Google Scholar
• C. Xing, W. Wu, Y. Wu, J. Liu, Y. Huang, M. Zhou, and W. Y. Ma. “Topic aware neural response generation,” in Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, Feb. 4–9, 2017, pp. 3351–3357.
   Google Scholar
• C. Xing, Y. Wu, W. Wu, Y. Huang, and M. Zhou. “Hierarchical recurrent attention network for response generation,” in Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Feb. 2–7, 2018, pp. 5610–5617.
   Google Scholar
• D. Bahdanau, K. Cho, and Y. Bengio. “Neural machine translation by jointly learning to align and translate,” arXiv preprint arXiv:1409.0473, 2014.
   Google Scholar
• M. T. Luong, H. Pham, and C. D. Manning. “Effective approaches to attention-based neural machine translation,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Sep. 17–21, 2015, pp. 1412–1421.
   Google Scholar
• L. Mou, Y. Song, R. Yan, G. Li, L. Zhang, and Z. Jin. “Sequence to backward and forward sequences: a content-introducing approach to generative short-text conversation,” in Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, Osaka, Dec. 11–16, 2016, pp. 3349–3358.
   Google Scholar
• M. Ghazvininejad, C. Brockett, M. W. Chang, B. Dolan, J. Gao, W. T. Yih, and M. Galley. “A knowledge-grounded neural conversation model,” in Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Feb. 2–7, 2018, pp. 5110–5117.
   Google Scholar
• J. Li, M. Galley, C. Brockett, and B. Dolan. “A diversity-promoting objective function for neural conversation models,” in Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, Jun. 12–17, 2016, pp. 110–119.
   Google Scholar
• J. Li, and D. Jurafsky. “Mutual information and diverse decoding improve neural machine translation,” arXiv preprint arXiv:1601.00372, 2016.
   Google Scholar
• O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. “Show and tell: A neural image caption generator,” in Proceedings of the IEEE conference on computer vision and pattern recognition, Boston. Jun. 7–12, 2015, pp. 3156–3164.
   Google Scholar
• K. Xu, J. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. S. Zemel, and Y. Bengio. “Show, attend and tell: neural image caption generation with visual attention,” in International conference on machine learning, Lille, Jul. 6–11, 2015, pp. 2048–2057.
   Google Scholar
• S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. Lawrence Zitnick, and D. Parikh. “Vqa: visual question answering,” in Proceedings of the IEEE international conference on computer vision, Santiago, Dec. 7–15, 2015, pp. 2425–2433.
   Google Scholar
• A. Das, S. Kottur, K. Gupta, A. Singh, D. Yadav, J. M. Moura, D. Parikh, and D. Batra. “Visual dialog,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul. 21–26, 2017, pp. 326–335.
   Google Scholar
• L. Zhu, Z. Xu, Y. Yang, and A. G. Hauptmann, “Uncovering the temporal context for video question answering,” Int. J. Comput. Vis., Vol. 124, pp. 409–421, Jul. 2017. doi: 10.1007/s11263-017-1033-7
   Web of Science ®Google Scholar
• K. H. Zeng, T. H. Chen, C. Y. Chuang, Y. H. Liao, J. C. Niebles, and M. Sun. “Leveraging video descriptions to learn video question answering,” in Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, Feb. 4–9, 2017, pp. 4334–4340.
   Google Scholar
• N. Mostafazadeh, C. Brockett, B. Dolan, M. Galley, J. Gao, G. Spithouraki, and L. Vanderwende. “Image-grounded conversations: multimodal context for natural question and response generation,” in Proceedings of the Eighth International Joint Conference on Natural Language Processing, Taipei, Nov. 27-Dec.1, 2017, pp. 462–472.
   Google Scholar
• B. Huber, D. McDuff, C. Brockett, M. Galley, and B. Dolan. “Emotional dialogue generation using image-grounded language models,” in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, Apr. 21–26, 2018, pp. 277.
   Google Scholar
• J. Lu, A. Kannan, J. Yang, D. Parikh, and D. Batra. “Best of both worlds: transferring knowledge from discriminative learning to a generative visual dialog model,” in Advances in Neural Information Processing Systems, Long Beach, Dec. 4–9, 2017, pp. 314–324.
   Google Scholar
• J. Li, W. Monroe, T. Shi, S. Jean, A. Ritter, and D. Jurafsky. “Adversarial learning for neural dialogue generation,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Sep. 7–11, 2017, pp. 2157–2169.
   Google Scholar
• J. Johnson, A. Alahi, and L. Fei-Fei. “Perceptual losses for real-time style transfer and super-resolution,” in European conference on computer vision, Amsterdam, Oct. 8–16, 2016, pp. 694–711.
   Google Scholar
• K. He, X. Zhang, S. Ren, and J. Sun. “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, Jun. 26- Jul. 1, 2016, pp. 770–778.
   Google Scholar
• S. Lai, L. Xu, K. Liu, and J. Zhao. “Recurrent convolutional neural networks for text classification,” in Twenty-ninth AAAI conference on artificial intelligence, Austin, Jan. 25–30, 2015, pp. 2267–2273.
   Google Scholar
• C. J. Maddison, A. Mnih, and Y. W. Teh. “The concrete distribution: A continuous relaxation of discrete random variables,” arXiv preprint arXiv:1611.00712, 2016.
   Google Scholar
• E. Jang, S. Gu, and B. Poole. “Categorical reparameterization with gumbel-softmax,” arXiv preprint arXiv:1611.01144, 2016.
   Google Scholar
• FoolNLTK, Available: https://github.com/rockyzhengwu/FoolNLTK
   Google Scholar
• Y. Song, S. Shi, J. Li, and H. Zhang. “Directional skip-gram: Explicitly distinguishing left and right context for word embeddings,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, Jun. 1–6, 2018, pp. 175–180.
   Google Scholar
• O. Vinyals, and Q. V. Le. “A Neural Conversational Model,” arXiv preprint arXiv:1506.05869, 2015.
   Google Scholar
• K. Papineni, S. Roukos, T. Ward, and W. J. Zhu. “BLEU: a method for automatic evaluation of machine translation,” in Proceedings of the 40th annual meeting on association for computational linguistics, Philadelphia, Jul. 7–12, 2002, pp. 311–318.
   Google Scholar
• C. W. Liu, R. Lowe, I. V. Serban, M. Noseworthy, L. Charlin, and J. Pineau. “How not to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation,” in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Nov. 1–5, 2016, pp. 2122–2132.
   Google Scholar
• J. L. Fleiss, and J. Cohen, “The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability,” Educ. Psychol. Meas., Vol. 33, pp. 613–619, Oct. 1973. doi: 10.1177/001316447303300309
   Web of Science ®Google Scholar