DAISY: An Implementation of Five Core Principles for Transparent and Accountable Conversational AI

References

• Adadi, A., & Berrada, M. (2018). Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access.6, 52138–52160. https://doi.org/10.1109/ACCESS.2018.2870052
   Web of Science ®Google Scholar
• Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., & Le, Q. V. (2020). Towards a human-like open-domain chatbot. arXiv preprint arXiv:2001.09977.
   Google Scholar
• Allen, J., Ferguson, G., & Stent, A. (2001). An architecture for more realistic conversational systems. In Proceedings of the 6th international conference on intelligent user interfaces (pp. 1–8). https://doi.org/10.1145/359784.359822
   Google Scholar
• Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I., & Atkinson, P. M. (2021). Explainable artificial intelligence: An analytical review. Wiley Interdisciplinary Reviews. 11(5), e1424. https://doi.org/10.1002/widm.1424
   Google Scholar
• Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion. 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
   Web of Science ®Google Scholar
• Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction. 24(6), 574–594. https://doi.org/10.1080/10447310802205776
   Web of Science ®Google Scholar
• Bender, E., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of FAccT. https://doi.org/10.1145/3442188.3445922
   Google Scholar
• Blaylock, N. (2005). Towards tractable agent-based dialogue [Unpublished doctoral dissertation]. University of Rochester, Rochester.
   Google Scholar
• Bobrow, D. G., Kaplan, R. M., Kay, M., Norman, D. A., Thompson, H., & Winograd, T. (1977). GUS, a frame-driven dialog system. Artificial Intelligence. 8(2), 155–173. https://doi.org/10.1016/0004-3702(77)90018-2
   Web of Science ®Google Scholar
• Bohus, D., & Rudnicky, A. I. (2009). The RavenClaw dialog management framework: Architecture and systems. Computer Speech & Language. 23(3), 332–361. https://doi.org/10.1016/j.csl.2008.10.001
   Web of Science ®Google Scholar
• Brooke, J. (1996). SUS: A “quick and dirty” usability scale. Usability Evaluation in Industry. 189.
   Google Scholar
• Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. arXiv preprint arXiv:2005.14165.
   Google Scholar
• Budzianowski, P., Wen, T.-H., Tseng, B.-H., Casanueva, I., Ultes, S., Ramadan, O., & Gasic, M. (2018, October–November). MultiWOZ – A large-scale multi-domain Wizard-of-Oz dataset for task-oriented dialogue modelling. In Proceedings of the 2018 conference on empirical methods in natural language processing (pp. 5016–5026). Association for Computational Linguistics. Retrieved from https://www.aclweb.org/anthology/D18-1547, https://doi.org/10.18653/v1/D18-1547
   Google Scholar
• Cer, D., Yang, Y., Kong, S-y., Hua, N., Limtiaco, N., John, R. S., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., Sung, Y. H., Strope, B., & Kurzweil, R. (2018). Universal sentence encoder. arXiv preprint arXiv:1803.11175.
   Google Scholar
• Daws, R. (2020). Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves. AI News. Retrieved July, 2021, from https://shorturl.at/fxKP2.
   Google Scholar
• Dazeley, R., Vamplew, P., Foale, C., Young, C., Aryal, S., & Cruz, F. (2021). Levels of explainable artificial intelligence for human-aligned conversational explanations. Artificial Intelligence. 299, 103525. https://doi.org/10.1016/j.artint.2021.103525
   Web of Science ®Google Scholar
• Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019, June). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the north American chapter of the association for computational linguistics: Human language technologies, (volume 1 (long and short papers), pp. 4171–4186). Association for Computational Linguistics.
   Google Scholar
• Eric, M., Krishnan, L., Charette, F., & Manning, C. D. (2017, August). Key-value retrieval networks for task-oriented dialogue. In Proceedings of the 18th annual SIGdial meeting on discourse and dialogue (pp. 37–49). Association for Computational Linguistics. Retrieved from https://www.aclweb.org/anthology/W17-5506 https://doi.org/10.18653/v1/W17-5506
   Google Scholar
• Hone, K. S., & Graham, R. (2000). Towards a tool for the subjective assessment of speech system interfaces (SASSI). Natural Language Engineering, 6(3&4), e02497. https://doi.org/10.1017/S1351324900002497
   Google Scholar
• Huiyang, S., & Min, W. (2022). Improving interaction experience through lexical convergence: The prosocial effect of lexical alignment in human-human and humancomputer interactions. International Journal of Human–Computer Interaction, 38(1), 28–41. https://doi.org/10.1080/10447318.2021.1921367
   Web of Science ®Google Scholar
• Jurafsky, D., & Martin, J. H. (2009). Speech and language processing (2nd ed.). Prentice-Hall.
   Google Scholar
• Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., & Coiera, E. (2018). Conversational agents in healthcare: A systematic review. Journal of the American Medical Informatics Association, 25(9), 1248–1258. https://doi.org/10.1093/jamia/ocy072
   PubMed Web of Science ®Google Scholar
• Lee, K. J., Chauhan, A., Goh, J., Nilsen, E., & Law, E. (2021). Curiosity notebook: The design of a research platform for learning by teaching. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1–26. https://doi.org/10.48550/arXiv.2108.09809
   PubMedGoogle Scholar
• Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020). Explainable AI: A review of machine learning interpretability methods. Entropy, 23(1), 18. https://doi.org/10.3390/e23010018
   PubMed Web of Science ®Google Scholar
• Madotto, A., Cahyawijaya, S., Winata, G. I., Xu, Y., Liu, Z., Lin, Z., & Fung, P. (2020). Learning knowledge bases with parameters for task-oriented dialogue systems. arXiv preprint arXiv:2009.13656.
   Google Scholar
• Madotto, A., Wu, C.-S., & Fung, P. (2018). Mem2Seq: Effectively incorporating knowledge bases into end-to-end task-oriented dialog systems. In Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1 (Long papers), pp. 1468–1478). https://doi.org/10.18653/v1/P18-1136
   Google Scholar
• McTear, M. (2020). Conversational AI: Dialogue systems, conversational agents, and chatbots. Synthesis Lectures on Human Language Technologies, 13(3), 1–251. https://doi.org/10.2200/S01060ED1V01Y202010HLT048
   Google Scholar
• Nobani, N., Mercorio, F., Mezzanzanica, M. (2021). Towards an explainer-agnostic conversational xai. In Proceedings of the thirtieth international joint conference on artificial intelligence, ijcai-21 (pp. 4909–4910).
   Google Scholar
• Otter, D. W., Medina, J. R., & Kalita, J. K. (2021). A survey of the usages of deep learning for natural language processing. IEEE Transactions on Neural Networks and Learning Systems, 32(2), 604–624. https://doi.org/10.1109/TNNLS.2020.2979670
   PubMed Web of Science ®Google Scholar
• Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2002). BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the association for computational linguistics (pp. 311–318).
   Google Scholar
• Ping, Q., Niu, F., Thattai, G., Chengottusseriyil, J., Gao, Q., Reganti, A., Rajagopal, P., Tur, G., Hakkani-Tur, D., & Nataraja, P. (2020). Interactive teaching for conversational AI. arXiv:2012.00958. https://doi.org/10.48550/arXiv.2012.00958
   Google Scholar
• Qin, L., Liu, Y., Che, W., Wen, H., Li, Y., & Liu, T. (2019, November). Entityconsistent end-to-end task-oriented dialogue system with KB retriever. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (emnlp-ijcnlp) (pp. 133–142). Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1013
   Google Scholar
• Qin, L., Xu, X., Che, W., Zhang, Y., & Liu, T. (2020, July). Dynamic fusion network for multi-domain end-to-end task-oriented dialog. In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 6344–6354). Association for Computational Linguistics. Retrieved from https://www.aclweb.org/anthology/2020.acl-main.565, https://doi.org/10.18653/v1/2020.acl-main.565
   Google Scholar
• Raghu, D., Gupta, N., Mausam  . (2019). Disentangling language and knowledge in task-oriented dialogs. In Proceedings of the 2019 conference of the north American chapter of the association for computational linguistics: Human language technologies, (volume 1 (long and short papers), pp. 1239–1255).
   Google Scholar
• Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021). Systematic review: Trustbuilding factors and implications for conversational agent design. International Journal of Human–Computer Interaction. 37(1), 81–96. https://doi.org/10.1080/10447318.2020.1807710
   Web of Science ®Google Scholar
• Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x
   PubMedGoogle Scholar
• Sejnowski, T. J. (2018). The deep learning revolution. MIT Press.
   Google Scholar
• Serban, I. V., Sankar, C., Germain, M., Zhang, S., Lin, Z., Subramanian, S., Kim, T., Pieper, M., Chandar, S., Rosemary Ke, N., Rajeshwar, S., de Brebisson, A., Sotelo, J. M. R., Suhubdy, D., Michalski, V., Nguyen, A., Pineau, J., & Bengio, Y. (2017). A deep reinforcement learning chatbot. arXiv preprint arXiv:1709.02349.
   Google Scholar
• Stephanidis, C., Salvendy, G., Antona, M., Chen, J. Y. C., Dong, J., Duffy, V. G., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., Guo, Y., Harris, D., Ioannou, A., Jeong, K-a., Konomi, S., Krömker, H., Kurosu, M., Lewis, J. R., Marcus, A., … Zhou, J. (2019). Seven HCI grand challenges. International Journal of Human–Computer Interaction, 35(14), 1229–1269. https://doi.org/10.1080/10447318.2019.1619259
   Web of Science ®Google Scholar
• Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems, 3104–3112. https://doi.org/10.48550/arXiv.1409.3215
   Google Scholar
• Tiedemann, J. (2009). News from OPUS–A collection of multilingual parallel corpora with tools and interfaces. In Recent Advances in Natural Language Processing 5, 237–248. https://doi.org/10.1075/cilt.309.19tie
   Google Scholar
• Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems, 5998–6008.  arXiv:1706.03762v5
   Google Scholar
• Vinyals, O., & Le, Q. (2015). A neural conversational model. arXiv preprint arXiv:1506.05869.
   Google Scholar
• Wahde, M. (2019). A dialogue manager for task-oriented agents based on dialogue building-blocks and generic cognitive processing. In 2019 IEEE International Symposium on INnovations in Intelligent SysTems and Applications (INISTA) (pp. 1–8). https://doi.org/10.1109/INISTA.2019.8778354
   Google Scholar
• Wahde, M., & Virgolin, M. (2021). The five Is: Key principles for interpretable and safe conversational AI. Submitted to the 23rd ACM International Conference on Multimodal Interaction (ICMI). https://doi.org/10.1145/3507623.3507632
   Google Scholar
• Wahde, M., & Virgolin, M. (2022). Conversational agents: Theory and applications. Handbook of Computer Learning and Intelligence (to appear), Retrieved from https://arxiv.org/abs/2202.03164
   Google Scholar
• Wang, S. I., Ginn, S., Liang, P., Manning, C. D. (2017). Naturalizing a programming language via interactive learning. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (volume 1 (Long papers), pp. 929–938).
   Google Scholar
• Ward, W., Issar, S., Huang, X., Hon, H.-W., Hwang, M.-Y., Young, S., Matessa, M., Liu, F.-H., & Stern, R. M. (1992). Speech understanding in open tasks. In Speech and natural language: Proceedings of a workshop held at harriman, New York February 23–26, 1992.
   Google Scholar
• Wen, H., Liu, Y., Che, W., Qin, L., Liu, T. (2018). Sequence-to-sequence learning for task-oriented dialogue with dialogue state representation. In Proceedings of the 27th International Conference on Computational Linguistics (pp. 3781–3792).
   Google Scholar
• Wen, T.-H., Vandyke, D., Mrksic, N., Gasic, M., Rojas-Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. (2017). A network-based end-to-end trainable task-oriented dialogue system. In Proceedings of the 15th conference of the European Chapter of the Association for Computational Linguistics (pp. 438–449). Association for Computational Linguistics.
   Google Scholar
• Werner, C. (2020). Explainable ai through rule-based interactive conversation. In Edbt/icdt workshops.
   Google Scholar
• Wu, C.-S., Socher, R., & Xiong, C. (2019). Global-to-local memory pointer networks for task-oriented dialogue. arXiv preprint arXiv:1901.04713.
   Google Scholar
• Yin, P., Neubig, G. (2017). A syntactic neural model for general-purpose code generation. In Proceedings of the 55th annual meeting of the association for computational linguistics (volume 1: Long papers) (pp. 440–450).
   Google Scholar
• Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018). Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine, 13(3), 55–75. https://doi.org/10.1109/MCI.2018.2840738
   Web of Science ®Google Scholar
• Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020). The design and implementation of XiaoIce, an empathetic social chatbot. Computational Linguistics, 46(1), 53–93. https://doi.org/10.1162/coli_a_00368
   Web of Science ®Google Scholar