Smartphone-based augmented reality for end-user creation of home automations

References

• Ashtari, Narges, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. “Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities.” CHI 2020: 1-13.
   Google Scholar
• Bellucci, Andrea, Andrea Vianello, and Yves Florack. 2016. “Giulio Jacucci: Supporting the Serendipitous Use of Domestic Technologies.” IEEE Pervasive Computing 15 (2): 16–25.
   Web of Science ®Google Scholar
• Brackenbury, Will, Abhimanyu Deora, Jillian Ritchey, Jason Vallee, Weijia He, Guan Wang, Michael L. Littman, and Blase Ur. 2019. “How Users Interpret Bugs in Trigger-Action Programming,” Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
   Google Scholar
• Brich, Julia, Marcel Walch, Michael Rietzler, Michael Weber, and Florian Schaub. 2017. “Exploring End User Programming Needs in Home Automation.” ACM Trans. Comput. Hum. Interact 24 (2): 11:1–11:35.
   Web of Science ®Google Scholar
• Brooke, John. 1986. “SUS: a “Quick and Dirty” Usability Scale.” In: Usability Evaluation in Industry, edited by P. W. Jordan, B. Thomas, B. A. Weerdmeester & A. L. McClelland, 189–194. London: Taylor and Francis.
   Google Scholar
• Caivano, Danilo, Daniela Fogli, Rosa Lanzilotti, Antonio Piccinno, and Fabio Cassano. 2018. “Supporting end Users to Control Their Smart Home: Design Implications from a Literature Review and an Empirical Investigation.” J. Syst. Softw 144: 295–313.
   Web of Science ®Google Scholar
• Castelli, Nico, Corinna Ogonowski, Timo Jakobi, Martin Stein, Gunnar Stevens, and Volker Wulf. 2017. What Happened in my Home?: An End-User Development Approach for Smart Home Data Visualization. CHI 2017: 853-866.
   Google Scholar
• Cherry, Erin, and Celine Latulipe. 2014. “Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index.” ACM Transaction on Computer-Human Interaction (TOCHI 21 (4): 1–25.
   Web of Science ®Google Scholar
• Corcella, Luca, Marco Manca, Jan E. Nordvik, Fabio Paternò, Anne-Marie Sanders, and Carmen Santoro. 2019. “Enabling Personalisation of Remote Elderly Assistance.” Multimedia Tools and Applications 78 (15): 21557–21583. doi:10.1007/s11042-019-7449-z.
   Web of Science ®Google Scholar
• Corno, Fulvio, Luigi De Russis, and Alberto Monge Roffarello. 2019. “A High-Level Semantic Approach to End-User Development in the Internet of Things.” Int. J. Hum. Comput. Stud 125: 41–54.
   Web of Science ®Google Scholar
• Coutaz, Joëlle, and James L. Crowley. 2016. “A First-Person Experience with End-User Development for Smart Homes.” IEEE Pervasive Computing 15 (2): 26–39.
   Web of Science ®Google Scholar
• De Russis, Luigi, and Fulvio Corno. 2015. HomeRules: A Tangible End-User Programming Interface for Smart Homes. CHI Extended Abstracts 2015: 2109-2114.
   Google Scholar
• Desolda, Giuseppe, Carmelo Ardito, and Maristella Matera. 2017. “Empowering End Users to Customise Their Smart Environments: Model, Composition Paradigms, and Domain-Specific Tools.” ACM Transactions on Computer-Human Interaction 24 (2). ACM, Article 12, 52 pages. doi:10.1145/3057859.
   Web of Science ®Google Scholar
• Elsden, Chris, Tom Feltwell, Shaun W. Lawson, and John Vines. 2019. Recipes for Programmable Money. CHI 2019: 251.
   Google Scholar
• Fogli, Daniela, Antonio Piccinno, Stefan Carmien, and Gerhard Fischer. 2020. “Exploring Design Trade-Offs for Achieving Social Inclusion in Multi-Tiered Design Problems.” Behav. Inf. Technol 39 (1): 27–46.
   Web of Science ®Google Scholar
• Fröhlich, Peter, Matthias Baldauf, Thomas Meneweger, Manfred Tscheligi, Boris de Ruyter, and Fabio Paternò. 2020. “Everyday Automation Experience: a Research Agenda.” Personal and Ubiquitous Computing 24 (6): 725–734.
   Web of Science ®Google Scholar
• Ghiani, Giuseppe, Marco Manca, Fabio Paternò, and Carmen Santoro. 2017. “Personalization of Context-Dependent Applications Through Trigger-Action Rules.” ACM Transactions on Computer-Human Interaction 24 (2). ACM, Article 14, 33 pages. doi:10.1145/3057861.
   Web of Science ®Google Scholar
• Goumopoulos, Christos, and Irene Mavrommati. 2020. “A Framework for Pervasive Computing Applications Based on Smart Objects and end User Development.” The Journal of Systems and Software 162. doi:10.1016/j.jss.2019.110496.
   Web of Science ®Google Scholar
• He, Weijia, Jesse Martinez, Roshni Padhi, Lefan Zhang, and Blase Ur. 2019. “When Smart Devices Are Stupid: Negative Experiences Using Home Smart Devices.” 2019 IEEE Security and Privacy Workshops (SPW).
   Google Scholar
• Heun, Valentin, James Hobin, and Pattie Maes. 2013. “Reality Editor: Programming Smarter Objects.” UbiComp (Adjunct Publication) 2013: 307-310J.
   Google Scholar
• Huang, Justin, and Maya Cakmak. 2015. “Supporting Mental Model Accuracy in Trigger-Action Programming.” In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ‘15). ACM, New York, NY, USA, 215-225. doi:10.1145/2750858.2805830.
   Google Scholar
• Knierim, Pascal, Paweł W. Woźniak, Yomna Abdelrahman, and Albrecht Schmidt. 2019. “Exploring the Potential of Augmented Reality in Domestic Environments.” In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ‘19). Association for Computing Machinery, New York, NY, USA, Article 31, 1–12. doi:10.1145/3338286.3340142.
   Google Scholar
• Ko, Amy J., Brad A. Myers, Mary Beth Rosson, Gregg Rothermel, Mary Shaw, Susan Wiedenbeck, Robin Abraham, et al. 2011. “The State of the art in end-User Software Engineering.” ACM Computing Surveys 43 (3): 1–44. doi:10.1145/1922649.1922658.
   Web of Science ®Google Scholar
• Lieberman, Henri, Fabio Paternò, Markus Klann, and Volker Wulf. 2006. In End-User Development: An Emerging Paradigm. End User Development, edited by Henry Lieberman, Fabio Paternò, and Volker Wulf, 1–8. Dordrecht: Springer.
   Google Scholar
• Mahroo, Atieh, Luca Greci, and Marco Sacco. 2019. “HoloHome: An Augmented Reality Framework to Manage the Smart Home.” AVR (2) 2019: 137-145.
   Google Scholar
• Manca, Marco, Fabio Paternò, and Carmen Santoro. 2021. “Remote Monitoring of End-User Created Automations in Field Trials.” Journal of Ambient Intelligence and Humanized Computing. doi:10.1007/s12652-021-03239-0.
   Web of Science ®Google Scholar
• Manca, Marco, Fabio Paternò, Carmen Santoro, and Luca Corcella. 2019. “Supporting end-User Debugging of Trigger-Action Rules for IoT Applications.” International Journal of Human-Computer Studies 123: 56–69.
   Web of Science ®Google Scholar
• Salovaara, Antti, Andrea Bellucci, Andrea Vianello, and Giulio Jacucci. 2021. “Programmable Smart Home Toolkits Should Better Address Households’ Social Needs.” In CHI Conference on Human Factors in Computing Systems (CHI ‘21), May 8–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 14 pages. doi:10.1145/3411764.3445770.
   Google Scholar
• Schmidt, Albrecht, and Thomas Herrmann. 2017. “Intervention User Interfaces: a new Interaction Paradigm for Automated Systems.” Interactions 24 (5): 40–45.
   Google Scholar
• Seiger, Ronny, Maria Gohlke, and Uwe Aßmann. 2019. “Augmented Reality-Based Process Modelling for the Internet of Things with HoloFlows.” BPMDS/EMMSAD@CAiSE 2019: 115-129.
   Google Scholar
• Seiger, Ronny, Romina Kühn, Mandy Korzetz, and Uwe Aßmann. 2021. “HoloFlows: Modelling of Processes for the Internet of Things in Mixed Reality.” Software and Systems Modeling. https://www.alexandria.unisg.ch/261944/.
   Google Scholar
• Shneiderman, Ben. 2020. “Human-centered Artificial Intelligence: Reliable, Safe & Trustworthy.” International Journal of Human–Computer Interaction 36 (6): 495–504.
   Web of Science ®Google Scholar
• Stefanidi, Evropi, Dimitrios Arampatzis, Asterios Leonidis, Maria Korozi, Margherita Antona, and George Papagiannakis. 2020. “MagiPlay: An Augmented Reality Serious Game Allowing Children to Program Intelligent Environments.” In Transactions on Computational Science XXXVII. Lecture Notes in Computer Science, edited by M. Gavrilova, C. Tan, J. Chang, and N. Thalmann, vol. 1230. Berlin: Springer. doi:10.1007/978-3-662-61983-4_9
   Google Scholar
• Stefanidi, Evropi, Dimitrios Arampatzis, Asterios Leonidis, and George Papagiannakis. 2019. “BricklAyeR: A Platform for Building Rules for AmI Environments in AR.” CGI 2019: 417-423.
   Google Scholar
• Sun, Yongbin, Alexandre Armengol-Urpi, Sai Nithin Reddy Kantareddy, Joshua Siegel, and Sanjay Sarma. 2019. “MagicHand: Interact with IoT Devices in Augmented Reality Environment.” 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 2019, pp. 1738-1743. doi: 10.1109/VR.2019.8798053.
   Google Scholar
• Tetteroo, Daniel, Paul Vreugdenhil, Ivor Grisel, Marc Michielsen, Els Kuppens, Diana Vanmulken, and Panos Markopoulos. 2015. “Lessons Learnt from Deploying an End-User Development Platform for Physical Rehabilitation.” In: Proceedings CHI ‘15. ACM Press, pp. 4133–4142. doi:10.1145/2702123.2702504.
   Google Scholar
• Ur, Blase, Erin A McManus, Melwyn Pak Yong, and Michael L Littman. 2014. “Practical Trigger-action Programming in the Smart Home.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘14). ACM, New York, NY, USA, 803–812. doi:10.1145/2556288.2557420.
   Google Scholar
• White, Gary, Christian Cabrera, Andrei Palade, and Siobhàn Clarke. 2019. “Augmented Reality in IoT.” In: X. Liu et al. (eds) Service-Oriented Computing – ICSOC 2018 Workshops. ICSOC 2018. Lecture Notes in Computer Science, vol 11434. Cham: Springer. doi:10.1007/978-3-030-17642-6_13.
   Google Scholar
• Yang, Rayoung, and Mark Webster Newman. 2013. “Learning from a Learning Thermostat: Lessons for Intelligent Systems for the Home.” ACM international joint conference on Pervasive and ubiquitous computing, 93–102.
   Google Scholar