Can designers take the driver’s seat? A new human-centered process to design with data and machine learning

References

• Amershi, S., D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, J. Suh, S. Iqbal, P. N. Bennett, K. Inkpen et al. 2019. “Guidelines for human-AI Interaction.” In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), 1–13. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3290605.3300233
   Google Scholar
• Amit, A. J., S. R. Gautam Shankararam, P. Pradeep, R. Perumalraja, and S. Kamalesh. 2021. “Framework for Preventing Procrastination and Increasing Productivity.” In 2021 3rd International Conference on Signal Processing and Communication (ICPSC), Coimbatore, India, 228–232. https://doi.org/10.1109/ICSPC51351.2021.9451773
   Google Scholar
• Ariely, D., and K. Wertenbroch. 2002. “Procrastination, Deadlines, and Performance: Self-Control by Precommitment.” Psychological Science 13 (3): 219–224. https://doi.org/10.1111/1467-9280.00441
   PubMed Web of Science ®Google Scholar
• Benjamin, J. J., A. Berger, N. Merrill, and J. Pierce. 2021. “Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry.” In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), Article 171, 1–14. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3411764.3445481
   Google Scholar
• Colombo, S., C. Cautela, and L. Rampino. 2017. “New Design Thinking Tools for the Next Generation of Designer-Entrepreneurs.” The Design Journal 20 (sup1): S566–S580. https://doi.org/10.1080/14606925.2017.1353004
   Web of Science ®Google Scholar
• Colombo, Sara, and Costa, Camilla. 2021. “Can Designers Take the Driver's Seat? A New User-Centered Process to Design with Data and Machine Learning.” In 14th International Conference of the European Academy of Design, Safe Harbours for Design Research. São Paulo: Blucher.
   Google Scholar
• Dalsgaard, P., and K. Halskov. 2012. “Reflective Design Documentation.” In Proceedings of the Designing Interactive Systems Conference (DIS '12), 428–437. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/2317956.2318020
   Google Scholar
• Design Council 2005. The ‘double diamond’ design process model.
   Google Scholar
• Dove, G., K. Halskov, J. Forlizzi, and J. Zimmerman. 2017. “UX Design Innovation: Challenges for Working with Machine Learning as a Design Material.” In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 278–288. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3025453.3025739
   Google Scholar
• Elish, M. C., and D. Boyd. 2017. “Situating Methods in the Magic of Big Data and AI.” Communication Monographs 85 (1): 57–80. https://doi.org/10.1080/03637751.2017.1375130
   Web of Science ®Google Scholar
• Google PAIR 2019. People + AI Guidebook. Pair.Withgoogle.Com/Guidebook.
   Google Scholar
• Jansen, A., and S. Colombo. 2022. “Wizard of Errors: Introducing and Evaluating Machine Learning Errors in Wizard of Oz Studies.” In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA '22), Article 426, 1–7. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3491101.3519684
   Google Scholar
• Jansen, A., and S. Colombo. 2023. “Mix & Match Machine Learning: An Ideation Toolkit to Design Machine Learning-Enabled Solutions.” In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction (T‘I '23), Association for Computing Machinery, New York, NY, USA, Article 8, 1–18. https://doi.org/10.1145/3569009.3572739
   Google Scholar
• Lee, I., and Y. J. Shin. 2020. “Machine Learning for Enterprises: Applications, Algorithm Selection, and Challenges.” Business Horizons 63 (2): 157–170. https://doi.org/10.1016/j.bushor.2019.10.005
   Web of Science ®Google Scholar
• Martens, J. B. 2014. “Interactive Statistics with Illmo.” ACM Transactions on Interactive Intelligent Systems 4 (1): 1–28. https://doi.org/10.1145/2509108
   Google Scholar
• Martens, J. B. 2021. “Comparing Experimental Conditions Using Modern Statistics.” Behavior Research Methods 53 (3): 1240–1261. https://doi.org/10.3758/s13428-020-01471-8
   PubMed Web of Science ®Google Scholar
• Paullada, A., I. D. Raji, E. M. Bender, E. Denton, and A. Hanna. 2021. “Data and Its (Dis) Contents: A Survey of Dataset Development and Use in Machine Learning Research.” Patterns (New York, N.Y.) 2 (11): 100336. https://doi.org/10.1016/j.patter.2021.100336
   PubMedGoogle Scholar
• Shen, H., L. Wang, W. H. Deng, C. Brusse, R. Velgersdijk, and H. Zhu. 2022. “The Model Card Authoring Toolkit: Toward Community-Centered, Deliberation-Driven AI Design.” In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22), 440–451. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3531146.3533110
   Google Scholar
• Shipman, F. M., and R. J. McCall. 1997. “Integrating Different Perspectives on Design Rationale: Supporting the Emergence of Design Rationale from Design Communication.” Artificial Intelligence for Engineering Design, Analysis and Manufacturing 11 (2): 141–154. https://doi.org/10.1017/S089006040000192X
   Web of Science ®Google Scholar
• Smith, T. C., and E. Frank. 2016. “Introducing Machine Learning Concepts with WEKA.” In Statistical Genomics: Methods and Protocols, edited by S. Mathé and Ewy Davis, 353–378. New York: Springer. https://doi.org/10.1007/978-1-4939-3578-9_17
   Google Scholar
• Steel, P., T. Brothen, and C. Wambach. 2001. “Procrastination and Personality, Performance, and Mood.” Personality and Individual Differences 30 (1): 95–106. https://doi.org/10.1016/S0191-8869(00)00013-1
   Web of Science ®Google Scholar
• Volonté, P., L. Rampino, and S. Colombo. 2018. “The Specificity of Design Research: How Practice-Based Design Knowledge Can Enter the Great Archive of Science.” In Advancements in the Philosophy of Design, 319–345. Cham: Springer.
   Google Scholar
• Windl, M., S. S. Feger, L. Zijlstra, A. Schmidt, and P. W. Wozniak. 2022. “It is Not Always Discovery Time’: Four Pragmatic Approaches in Designing AI Systems.” In CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3491102.3501943
   Google Scholar
• Yang, Q., A. Scuito, J. Zimmerman, J. Forlizzi, and A. Steinfeld. 2018. “Investigating How Experienced UX Designers Effectively Work with Machine Learning.” In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18), 585–596. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3196709.3196730
   Google Scholar
• Yang, Q., A. Steinfeld, C. Rosé, and J. Zimmerman. 2020. “Re-Examining Whether, Why, and How Human-AI Interaction is Uniquely Difficult to Design.” In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), 1–13. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3313831.3376301
   Google Scholar
• Yang, Q., N. Banovic, and J. Zimmerman. 2018. “Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation.” In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), Paper 130, 1–11. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3173574.3173704
   Google Scholar
• Yildirim, N., A. Kass, T. Tung, C. Upton, D. Costello, R. Giusti, S. Lacin, S. Lovic, J. M. O'Neill, R. O'Reilly Meehan, et al.. 2022. “How Experienced Designers of Enterprise Applications Engage AI as a Design Material.” In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), Article 483, 1–13. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3491102.3517491
   Google Scholar
• Yildirim, N., C. Oh, D. Sayar, K. Brand, S. Challa, V. Turri, N. C. Walton, A. E. Wong, J. Forlizzi, J. McCann, et al. 2023. “Creating Design Resources to Scaffold the Ideation of AI Concepts.” In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS '23), 2326–2346. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3563657.3596058
   Google Scholar
• Zdanowska, S., and A. S. Taylor. 2022. “A Study of UX Practitioners Roles in Designing Real-World, Enterprise ML Systems.” In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), Article 531, 1–15. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/3491102.3517607
   Google Scholar
• Zhou, Z., L. Sun, Y. Zhang, X. Liu, and Q. Gong. 2020. “ML Lifecycle Canvas: Designing Machine Learning-Empowered UX with Material Lifecycle Thinking.” Human–Computer Interaction 35 (5-6): 362–386. https://doi.org/10.1080/07370024.2020.1736075
   Web of Science ®Google Scholar
• Zimmerman, J., C. Oh, N. Yildirim, A. Kass, T. Tung, and J. Forlizzi. 2021. “UX Designers Pushing AI in the Enterprise: A Case for Adaptive UIs.” Interactions 28 (1): 72–77. https://doi.org/10.1145/3436954
   Google Scholar
• Zimmerman, J., E. Stolterman, and J. Forlizzi. 2010. “An Analysis and Critique of Research through Design: Towards a Formalization of a Research Approach.” In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10), 310–319. New York, NY: Association for Computing Machinery. https://doi.org/10.1145/1858171.1858228
   Google Scholar