Explainable AI for Security of Human-Interactive Robots

References

• Abu Talib, M., Abbas, S., Nasir, Q., & Mowakeh, M. F. (2018). Systematic literature review on internet-of-vehicles communication security. International Journal of Distributed Sensor Networks, 14(12), 155014771881505. https://doi.org/10.1177/1550147718815054
   Web of Science ®Google Scholar
• Ahmad Yousef, K. M., AlMajali, A., Ghalyon, S. A., Dweik, W., & Mohd, B. J. (2018). Analyzing cyber-physical threats on robotic platforms. Sensors, 18(5), 1643. https://doi.org/10.3390/s18051643
   Web of Science ®Google Scholar
• Alemzadeh, H., Chen, D., Li, X., Kesavadas, T., Kalbarczyk, Z. T., & Iyer, R. K. (2016). Targeted attacks on teleoperated surgical robots: Dynamic model-based detection and mitigation. In 2016 46th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) (pp. 395–406). IEEE. https://doi.org/10.1109/DSN.2016.43
   Google Scholar
• Alguliyev, R., Imamverdiyev, Y., & Sukhostat, L. (2018). Cyber-physical systems and their security issues. Computers in Industry, 100, 212–223. https://doi.org/10.1016/j.compind.2018.04.017
   Web of Science ®Google Scholar
• AlMajali, A., Yousef, K. M. A., Mohd, B. J., Dweik, W., Ghalyon, S. A., & Hasan, R. (2018). Semi-quantitative security risk assessment of robotic systems. Jordanian Journal of Computers and Information Technology (JJCIT), 4(03), 185–200.
   Google Scholar
• Almohri, H., Cheng, L., Yao, D., Alemzadeh, H. (2017). On threat modeling and mitigation of medical cyber-physical systems. In 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) (pp. 114–119). IEEE.
   Google Scholar
• Alur, R. (2015). Principles of cyber-physical systems. MIT Press.
   Google Scholar
• Anjomshoae, S., Najjar, A., Calvaresi, D., Främling, K. (2019). Explainable agents and robots: Results from a systematic literature review. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (pp. 1078–1088). International Foundation for Autonomous Agents and Multiagent Systems.
   Google Scholar
• Archibald, C., Schwalm, L., & Ball, J. E. (2017). A survey of security in robotic systems: Vulnerabilities, attacks, andsolutions. International Journal of Robotics and Automation, 32(2), 4705. https://doi.org/10.2316/Journal.206.2017.2.206-4705
   Web of Science ®Google Scholar
• Arnold, T., Kasenberg, D., & Scheutz, M. (2021). Explaining in time: Meeting interactive standards of explanation for robotic systems. ACM Transactions on Human-Robot Interaction, 10(3), 1–23. https://doi.org/10.1145/3457183
   Web of Science ®Google Scholar
• Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
   Web of Science ®Google Scholar
• Biran, O., & Cotton, C. (2017). Explanation and justification in machine learning: A survey. IJCAI-17 Workshop on Explainable AI (XAI), 8, 8–13.
   Google Scholar
• Bonaci, T., Yan, J., Herron, J., Kohno, T., & Chizeck, H. J. (2015). Experimental analysis of denial-of-service attacks on teleoperated robotic systems. In Proceedings of the ACM/IEEE Sixth International Conference on Cyber-Physical Systems (pp. 11–20). https://doi.org/10.1145/2735960.2735980
   Google Scholar
• Borgo, R., Cashmore, M., & Magazzeni, D. (2018). Towards providing explanations for ai planner decisions. In IJCAI/ECAI 2018 Workshop on Explainable Artificial Intelligence (XAI).
   Google Scholar
• Bou-Harb, E. (2016). A brief survey of security approaches for cyber-physical systems. In 2016 8th IFIP International Conference on New Technologies, Mobility and Security (NTMS) (pp. 1–5). IEEE. https://doi.org/10.1109/NTMS.2016.7792424
   Google Scholar
• Bussone, A., Stumpf, S., O’Sullivan, D. (2015). The role of explanations on trust and reliance in clinical decision support systems. In 2015 International Conference on Healthcare Informatics (pp. 160–169). IEEE.
   Google Scholar
• Chakraborti, T., Sreedharan, S., & Kambhampati, S. (2020). The emerging landscape of explainable AI planning and decision making. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence (IJCAI-20) Survey Track.
   Google Scholar
• Chiyah Garcia, F. J., Robb, D. A., Liu, X., Laskov, A., Patron, P., & Hastie, H. (2018). Explainable autonomy: A study of explanation styles for building clear mental models. In Proceedings of the 11th International Conference on Natural Language Generation (pp. 99–108). Tilburg University, The Netherlands. Association for Computational Linguistics. https://doi.org/10.18653/v1/W18-6511
   Google Scholar
• Chowdhury, A., Karmakar, G., & Kamruzzaman, J. (2019). Survey of recent cyber security attacks on robotic systems and their mitigation approaches. In Cyber law, privacy, and security: Concepts, methodologies, tools, and applications (pp. 1426–1441). IGI Global.
   Google Scholar
• Cichonski, P., Millar, T., Grance, T., & Scarfone, K. (2012). Computer security incident handling guide. NIST Special Publication 800-61 Revision 2.
   Google Scholar
• Clark, G. W., Doran, M. V., & Andel, T. R. (2017). Cybersecurity issues in robotics. In 2017 IEEE conference on cognitive and computational aspects of situation management (CogSIMA) (pp. 1–5). IEEE. https://doi.org/10.1109/COGSIMA.2017.7929597
   Google Scholar
• Clinciu, M.-A., & Hastie, H. (2019). A survey of explainable ai terminology. In Proceedings of the 1st Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (NL4XAI 2019) (pp. 8–13). https://doi.org/10.18653/v1/W19-8403
   Google Scholar
• Damodaran, S. K., Rowe, P. D. (2019). Limitations on observability of effects in cyber-physical systems. In Proceedings of the 6th Annual Symposium on Hot Topics in the Science of Security (pp. 1–10). https://doi.org/10.1145/3314058.3314065
   Google Scholar
• Datta, A., Sen, S., & Zick, Y. (2016). Algorithmic transparency via quantitative input influence: Theory and experiments with learning systems. In 2016 IEEE Symposium on Security and Privacy (SP) (pp. 598–617). IEEE. https://doi.org/10.1109/SP.2016.42
   Google Scholar
• Denning, T., Matuszek, C., Koscher, K., Smith, J. R., & Kohno, T. (2009). A spotlight on security and privacy risks with future household robots: Attacks and lessons. In Proceedings of the 11th international conference on Ubiquitous computing (pp. 105–114). https://doi.org/10.1145/1620545.1620564
   Google Scholar
• Ding, D., Han, Q.-L., Xiang, Y., Ge, X., & Zhang, X.-M. (2018). A survey on security control and attack detection for industrial cyber-physical systems. Neurocomputing, 275, 1674–1683. https://doi.org/10.1016/j.neucom.2017.10.009
   Web of Science ®Google Scholar
• Endsley, M. R. (2015). Situation awareness misconceptions and misunderstandings. Journal of Cognitive Engineering and Decision Making, 9(1), 4–32. https://doi.org/10.1177/1555343415572631
   Web of Science ®Google Scholar
• Fiedler, A. (2001a). Dialog-driven adaptation of explanations of proofs. In International Joint Conference on Artificial Intelligence (volume 17, pp. 1295–1300). Citeseer.
   Google Scholar
• Fiedler, A. (2001b). User-adaptive proof explanation [PhD thesis]. Universitat des Saarlandes.
   Google Scholar
• Fox, M., Long, D., Magazzeni, D. (2017). Explainable planning. In Proceedings of the IJCAI-17 Workshop on Explainable AI.
   Google Scholar
• Gatt, A., & Krahmer, E. (2018). Survey of the state of the art in natural language generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research, 61, 65–170. https://doi.org/10.1613/jair.5477
   Web of Science ®Google Scholar
• Giaretta, A., De Donno, M., & Dragoni, N. (2018). Adding salt to pepper: A structured security assessment over a humanoid robot. In Proceedings of the 13th International Conference on Availability, Reliability and Security (pp. 1–8).
   Google Scholar
• Gilpin, L. H. (2020). Anomaly detection through explanations [PhD thesis]. Massachusetts Institute of Technology.
   Google Scholar
• Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018). Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE 5th International Conference on data science and advanced analytics (DSAA) (pp. 80–89). IEEE. https://doi.org/10.1109/DSAA.2018.00018
   Google Scholar
• Giraldo, J., Urbina, D., Cardenas, A., Valente, J., Faisal, M., Ruths, J., Tippenhauer, N. O., Sandberg, H., & Candell, R. (2018). A survey of physics-based attack detection in cyber-physical systems. ACM Computing Surveys, 51(4), 1–36. https://doi.org/10.1145/3203245
   Web of Science ®Google Scholar
• Goodman, B., & Flaxman, S. (2017). European union regulations on algorithmic decision-making and a “right to explanation”. AI Magazine, 38(3), 50–57. https://doi.org/10.1609/aimag.v38i3.2741
   Web of Science ®Google Scholar
• Google. (2019). Google PAIR. People + AI Guidebook. https://pair.withgoogle.com/guidebook/.
   Google Scholar
• Greer, C., Burns, M., Wollman, D., & Griffor, E. (2019). Cyber-physical systems and internet of things. NIST Special Publication, 1900, 202.
   Google Scholar
• Hayes, B., & Shah, J. A. (2017). Improving robot controller transparency through autonomous policy explanation. In 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 303–312). IEEE. https://doi.org/10.1145/2909824.3020233
   Google Scholar
• Hellström, T., & Bensch, S. (2018). Understandable robots-what, why, and how. Paladyn, Journal of Behavioral Robotics, 9(1), 110–123. https://doi.org/10.1515/pjbr-2018-0009
   Google Scholar
• Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018). Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608
   Google Scholar
• Horacek, H. (2007). How to build explanations of automated proofs: A methodology and requirements on domain representations. In Proceedings of AAAI ExaCt: Workshop on Explanation-aware Computing (pp. 34–41).
   Google Scholar
• Hutchins, E. M., Cloppert, M. J., & Amin, R. M. (2011). Intelligence-driven computer network defense informed by analysis of adversary campaigns and intrusion kill chains. Leading Issues in Information Warfare & Security Research, 1(1), 80.
   Google Scholar
• iRobot. (2018). iRobot Create 2 Open Interface (OI) specification based on the iRobot Roomba 600.
   Google Scholar
• ISO. (2018). ISO26262:2018-Road vehicles-functional safety. ISO.
   Google Scholar
• Jahan, F., Sun, W., Niyaz, Q., & Alam, M. (2019). Security modeling of autonomous systems: A. ACM Computing Surveys, 52(5), 1–34. https://doi.org/10.1145/3337791
   Web of Science ®Google Scholar
• Kasenberg, D., Roque, A., Thielstrom, R., Chita-Tegmark, M., & Scheutz, M. (2019). Generating justifications for norm-related agent decisions. In Proceedings of the 12th International Conference on Natural Language Generation. https://doi.org/10.18653/v1/W19-8660
   Google Scholar
• Kasenberg, D., Thielstrom, R., Scheutz, M. (2020). Generating explanations for temporal logic planner decisions. In Proceedings of the 30th International Conference on Automated Planning and Scheduling (ICAPS).
   Google Scholar
• Kim, J., Muise, C., Shah, A., Agarwal, S., & Shah, J. (2019). Bayesian inference of linear temporal logic specifications for contrastive explanations. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19) (pp. 5591–5598).
   Google Scholar
• Kinzler, M., Miller, J., Wu, Z., Williams, A., Perouli, D. (2019). Cybersecurity vulnerabilities in two artificially intelligent humanoids on the market. In Workshop on Technology and Consumer Protection (ConPro ’19), held in conjunction with the 40th IEEE Symposium on Security and Privacy.
   Google Scholar
• Kirovskii, O., & Gorelov, V. (2019). Driver assistance systems: Analysis, tests and the safety case. iso 26262 and iso pas 21448. IOP Conference Series, 534(1), 012019. https://doi.org/10.1088/1757-899X/534/1/012019
   Google Scholar
• Kirschgens, L. A., Ugarte, I. Z., Uriarte, E. G., Rosas, A. M., & Vilches, V. M. (2018). Robot hazards: From safety to security. arXiv preprint arXiv:1806.06681
   Google Scholar
• Krarup, B., Cashmore, M., Magazzeni, D., Miller, T. (2019). Model-based contrastive explanations for explainable planning. In Proceedings of the ICAPS 2019 Workshop on Explainable Planning (XAIP).
   Google Scholar
• Krishna, C. L., & Murphy, R. R. (2017). A review on cybersecurity vulnerabilities for unmanned aerial vehicles. In 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR) (pp. 194–199). IEEE. https://doi.org/10.1109/SSRR.2017.8088163
   Google Scholar
• Kulesza, T., Stumpf, S., Burnett, M., Yang, S., Kwan, I., Wong, W.-K. (2013). Too much, too little, or just right? Ways explanations impact end users’ mental models. In 2013 IEEE Symposium on Visual Languages and Human Centric Computing (pp. 3–10). IEEE.
   Google Scholar
• Lacava, G., Marotta, A., Martinelli, F., Saracino, A., La Marra, A., Gil-Uriarte, E., & Vilches, V. M. (2020). Current research issues on cyber security in robotics. Technical Report Istituto di Informatica e Telematica, TR-05/2020.
   Google Scholar
• Leccadito, M., Bakker, T., Klenke, R., & Elks, C. (2018). A survey on securing uas cyber physical systems. IEEE Aerospace and Electronic Systems Magazine, 33(10), 22–32. https://doi.org/10.1109/MAES.2018.160145
   Web of Science ®Google Scholar
• Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392
   PubMed Web of Science ®Google Scholar
• Leveson, N. (2004). A new accident model for engineering safer systems. Safety Science, 42(4), 237–270. https://doi.org/10.1016/S0925-7535(03)00047-X
   Web of Science ®Google Scholar
• Leveson, N., Thomas, J. (2018). STPA handbook. https://psas.scripts.mit.edu/home/get_file.php?name=STPA_handbook.pdf.
   Google Scholar
• Lim, B. Y., Dey, A. K., Avrahami, D. (2009). Why and why not explanations improve the intelligibility of context-aware intelligent systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2119–2128). ACM.
   Google Scholar
• Lin, H., Alemzadeh, H., Chen, D., Kalbarczyk, Z., & Iyer, R. K. (2016). Safety-critical cyber-physical attacks: Analysis, detection, and mitigation. In Proceedings of the Symposium and Bootcamp on the Science of Security (pp. 82–89).
   Google Scholar
• Madumal, P., Miller, T., Sonenberg, L., Vetere, F. (2020). Explainable reinforcement learning through a causal lens. In Proceedings of AAAI 2020. https://doi.org/10.1609/aaai.v34i03.5631
   Google Scholar
• Magnaguagno, M. C., FRAGA PEREIRA, R., Móre, M. D., & Meneguzzi, F. R. (2017). Web planner: A tool to develop classical planning domains and visualize heuristic state-space search. In 2017 Workshop on User Interfaces and Scheduling and Planning (UISP@ ICAPS), 2017, Estados Unidos.
   Google Scholar
• McDermott, P., Dominguez, C., Kasdaglis, N., Ryan, M., Trhan, I., & Nelson, A. (2018). Human-machine teaming systems engineering guide. Technical report, MITRE, Bedford, MA, United States.
   Google Scholar
• McDermott, P. L., Brink, R. N. t. (2019). Practical guidance for evaluating calibrated trust. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (volume 63, pp. 362–366). SAGE Publications Sage CA. https://doi.org/10.1177/1071181319631379
   Google Scholar
• Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267, 1–38. https://doi.org/10.1016/j.artint.2018.07.007
   Web of Science ®Google Scholar
• Mittelstadt, B., Russell, C., & Wachter, S. (2019). Explaining explanations in AI. In Proceedings of the conference on fairness, accountability, and transparency (pp. 279–288).
   Google Scholar
• Mohseni, S., Zarei, N., & Ragan, E. D. (2018). A multidisciplinary survey and framework for design and evaluation of explainable AI systems. arXiv, p. arXiv–a1811.
   Google Scholar
• Moore, J. D., & Swartout, W. R. (1988). Explanation in expert systems: A survey. Technical Report ISI/RR-88-228. University of Southern California Information Sciences Institute.
   Google Scholar
• Morimoto, S., Wang, F., Zhang, R., & Zhu, J. (2017). Cybersecurity in autonomous vehicles. Introduction to Applied Informatics, University of Hyogo.
   Google Scholar
• Morris, A. C. (2007). Robotic introspection for exploration and mapping of subterranean environments. Carnegie Mellon University.
   Google Scholar
• Nomura, T., & Kawakami, K. (2011). Relationships between robot’s self-disclosures and human’s anxiety toward robots. In 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology (volume 3, pp. 66–69). IEEE.
   Google Scholar
• Phillips, P. J., Hahn, A. C., Fontana, P. C., Broniatowski, D. A., Przybocki, M. A. (2020). Four Principles of Explainable Artificial Intelligence, Draft NISTIR 8312. NIST. https://doi.org/10.6028/NIST.IR.8312-draft, Accessed September 11, 2020.
   Google Scholar
• Pogliani, M., Quarta, D., Polino, M., Vittone, M., Maggi, F., & Zanero, S. (2019). Security of controlled manufacturing systems in the connected factory: The case of industrial robots. Journal of Computer Virology and Hacking Techniques, 15(3), 161–175. https://doi.org/10.1007/s11416-019-00329-8
   Web of Science ®Google Scholar
• Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2018). A survey on deep learning: Algorithms, techniques, and applications. ACM Computing Surveys, 51(5), 1–36. https://doi.org/10.1145/3234150
   Web of Science ®Google Scholar
• Quarta, D., Pogliani, M., Polino, M., Maggi, F., Zanchettin, A. M., & Zanero, S. (2017). An experimental security analysis of an industrial robot controller. In 2017 IEEE Symposium on Security and Privacy (SP) (pp. 268–286). IEEE. https://doi.org/10.1109/SP.2017.20
   Google Scholar
• Reiter, E. (2019). Natural language generation challenges for explainable AI. In Proceedings of the 1st Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (NL4XAI 2019). https://doi.org/10.18653/v1/W19-8402
   Google Scholar
• Reiter, E., Gatt, A., Portet, F., & van der Meulen, M. (2008). The importance of narrative and other lessons from an evaluation of an nlg system that summarises clinical data. In Proceedings of the Fifth International Natural Language Generation Conference (pp. 147–156). https://doi.org/10.3115/1708322.1708349
   Google Scholar
• Ribeiro, M. T., Singh, S., Guestrin, C. (2016). Why should I trust you? Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1135–1144).
   Google Scholar
• Roque, A., Bush, K. B., Degni, C. (2016). Security is about control: Insights from cybernetics. In Proceedings of the Symposium and Bootcamp on the Science of Security (pp. 17–24).
   Google Scholar
• Roque, A., Lin, M., Damodaran, S. (2021). Cybersafety analysis of a natural language user interface for a consumer robotic system. Proceedings of the 7th Workshop on the Security of Industrial Control Systems and of Cyber-Physical Systems (CyberICPS 2021).
   Google Scholar
• Rosenthal, S., Selvaraj, S. P., & Veloso, M. M. (2016). Verbalization: Narration of autonomous robot experience. In Proceedings of International Joint Conference on Artificial Intelligence (volume 16, pp. 862–868).
   Google Scholar
• Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x
   PubMedGoogle Scholar
• Sabaliauskaite, G., Ng, G. S., Ruths, J., & Mathur, A. (2015). Experimental evaluation of stealthy attack detection in a robot. In 2015 IEEE 21st Pacific Rim International Symposium on Dependable Computing (PRDC) (pp. 70–79). IEEE. https://doi.org/10.1109/PRDC.2015.33
   Google Scholar
• Sabaliauskaite, G., Ng, G. S., Ruths, J., & Mathur, A. (2017). A comprehensive approach, and a case study, for conducting attack detection experiments in cyber–physical systems. Robotics and Autonomous Systems, 98, 174–191. https://doi.org/10.1016/j.robot.2017.09.018
   Web of Science ®Google Scholar
• Scheutz, M., Williams, T., Krause, E., Oosterveld, B., Sarathy, V., & Frasca, T. (2019). An overview of the distributed integrated cognition affect and reflection DIARC architecture. In Cognitive Architectures (pp. 165–193). Springer.
   Google Scholar
• Schwartz, S., Ross, A., Carmody, S., Chase, P., Coley, S. C., Connolly, J., Petrozzino, C., & Zuk, M. (2018). The evolving state of medical device cybersecurity. Biomedical Instrumentation & Technology, 52(2), 103–111. https://doi.org/10.2345/0899-8205-52.2.103
   PubMedGoogle Scholar
• Settanni, G., Skopik, F., Shovgenya, Y., Fiedler, R., Carolan, M., Conroy, D., Boettinger, K., Gall, M., Brost, G., Ponchel, C., Haustein, M., Kaufmann, H., Theuerkauf, K., & Olli, P. (2017). A collaborative cyber incident management system for european interconnected critical infrastructures. Journal of Information Security and Applications, 34, 166–182. https://doi.org/10.1016/j.jisa.2016.05.005
   Web of Science ®Google Scholar
• Slack, D., Hilgard, S., Jia, E., Singh, S., & Lakkaraju, H. (2020). Fooling lime and shap: Adversarial attacks on post hoc explanation methods. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (pp. 180–186).
   Google Scholar
• Sreedharan, S., Srivastava, S., Smith, D., & Kambhampati, S. (2019). Why can’t you do that HAL? explaining unsolvability of planning tasks. In International Joint Conference on Artificial Intelligence.
   Google Scholar
• Strom, B. E., Applebaum, A., Miller, D. P., Nickels, K. C., Pennington, A. G., & Thomas, C. B. (2018). Mitre att&ck: Design and philosophy. Technical report
   Google Scholar
• Thielstrom, R., Roque, A., Chita-Tegmark, M., & Scheutz, M. (2020). Generating explanations of action failures in a cognitive robotic architecture. In 2nd Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (pp. 67–72).
   Google Scholar
• Tintarev, N., & Masthoff, J. (2012). Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction, 22(4–5), 399–439. https://doi.org/10.1007/s11257-011-9117-5
   Web of Science ®Google Scholar
• van der Waa, J., van Diggelen, J., van den Bosch, K., Neerincx, M. (2018). Contrastive explanations for reinforcement learning in terms of expected consequence. In Proceedings of the Workshop on Explainable AI on the IJCAI conference, Stockholm, Sweden.
   Google Scholar
• Vasileiou, S., Yeoh, W., & Son, T. C. (2019). A preliminary logic-based approach for explanation generation. In ICAPS Workshop on Explainable AI Planning (XAIP).
   Google Scholar
• Wang, N., Pynadath, D. V., & Hill, S. G. (2016). Trust calibration within a human-robot team: Comparing automatically generated explanations. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 109–116). IEEE. https://doi.org/10.1109/HRI.2016.7451741
   Google Scholar
• Young, W., & Leveson, N. (2013). Systems thinking for safety and security. In Proceedings of the 29th Annual Computer Security Applications Conference (pp. 1–8).
   Google Scholar
• Young, W., & Leveson, N. G. (2014). An integrated approach to safety and security based on systems theory. Communications of the ACM, 57(2), 31–35. https://doi.org/10.1145/2556938
   Web of Science ®Google Scholar
• Zhou, X., Wu, H., Rojas, J., Xu, Z., & Li, S. (2020). Introduction to Robot Introspection (pp. 1–10). Springer.
   Google Scholar