Automated Usability Improvement of Two-Dimensional Graphical Interfaces through the Simulation of User’s Operations

References

• Acosta-Vargas, P., Antonio Salvador-Ullauri, L., & Lujan-Mora, S. (2019). A heuristic method to evaluate web accessibility for users with low vision. IEEE Access. 7, 125634–125648. https://doi.org/10.1109/ACCESS.2019.2939068
   Web of Science ®Google Scholar
• Abdullah, D. M., Abdullah, W. M., Babu, N. M., Bhuiyan, M. M. I., Nabi, K. M., Rahman, M. S. (2013, May). VLSI floorplanning design using clonal selection algorithm. In 2013 International Conference on Informatics, Electronics and Vision (ICIEV) (pp. 1–6). IEEE.
   Google Scholar
• Card, S. K., Moran, T. P., & Newell, A. (1980). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23(7), 396–410. https://doi.org/10.1145/358886.358895
   Web of Science ®Google Scholar
• Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. Lawrence Rrlbaum Associates. Inc.
   Google Scholar
• Chan, L., Liao, Y. C., Mo, G. B., Dudley, J. J., Cheng, C. L., Kristensson, P. O., & Oulasvirta, A. (2022). Investigating positive and negative qualities of human-in-the-loop optimization for designing interaction techniques [Paper presentation]. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1–14). https://doi.org/10.1145/3491102.3501850
   Google Scholar
• Chang, Y. C., Chang, Y. W., Wu, G. M., Wu, S. W. (2000, June). B*-trees: A new representation for non-slicing floorplans. In Proceedings of the 37th annual design automation conference (pp. 458–463).
   Google Scholar
• Chavan, A. L., Ajmera, R. (2007, July). When in Rome… be yourself: A perspective on dealing with cultural dissimilarities in ethnography. In International Conference on Usability and Internationalization (pp. 33–36). Springer.
   Google Scholar
• Chen, T. C., & Chang, Y. W. (2006). Modern floorplanning based on B*-tree and fast simulated annealing. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 25(4), 637–650. https://doi.org/10.1109/TCAD.2006.870076
   Web of Science ®Google Scholar
• Cobb, H. G., & Grefenstette, J. J. (1993). Genetic algorithms for tracking changing environments [Paper presentation]. In ICGA, June). (Vol. 1993, pp. 523–530).
   Google Scholar
• Coello, C. A. C., Lamont, G. B., & Van Veldhuizen, D. A. (2007). Evolutionary algorithms for solving multi-objective problems (Vol. 5, pp. 79–104). Springer.
   Google Scholar
• Coffman, D. D. (1990). Effects of mental practice, physical practice, and knowledge of results on piano performance. Journal of Research in Music Education, 38(3), 187–196. https://doi.org/10.2307/3345182
   Web of Science ®Google Scholar
• Dayama, N. R., Todi, K., Saarelainen, T., & Oulasvirta, A. (2020). GRIDS: Interactive Layout Design with Integer Programming [Paper presentation]. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, April). In (pp. 1–13). https://doi.org/10.1145/3313831.3376553
   Google Scholar
• Diego-Mas, J. A., Garzon-Leal, D., Poveda-Bautista, R., & Alcaide-Marzal, J. (2019). User-interfaces layout optimization using eye-tracking, mouse movements and genetic algorithms. Applied Ergonomics, 78, 197–209. https://doi.org/10.1016/j.apergo.2019.03.004
   PubMed Web of Science ®Google Scholar
• Diego-Mas, J. A., Santamarina-Siurana, M. C., Cloquell-Ballester, V. A., & Alcaide-Marzal, J. (2008). Slicing tree’s geometric potential: An indicator for layout problems based on slicing tree structure. International Journal of Production Research, 46(4), 1071–1087. https://doi.org/10.1080/00207540600932061
   Web of Science ®Google Scholar
• Driscoll, D. L. (2011). Introduction to primary research: Observations, surveys, and interviews. In C. Lowe & P. Zemliansky (Eds.), Writing spaces: Readings on writing (Vol. 2, pp. 153–174). Parlor Press LLC.
   Google Scholar
• Driskell, J. E., Copper, C., & Moran, A. (1994). Does mental practice enhance performance? Journal of Applied Psychology, 79(4), 481–492. https://doi.org/10.1037/0021-9010.79.4.481
   Web of Science ®Google Scholar
• Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47(6), 381–391. https://doi.org/10.1037/h0055392
   PubMedGoogle Scholar
• Fonteyn, M. E., Kuipers, B., & Grobe, S. J. (1993). A description of think aloud method and protocol analysis. Qualitative Health Research, 3(4), 430–441. https://doi.org/10.1177/104973239300300403
   Google Scholar
• Gan, K. C., & Hoffmann, E. R. (1988). Geometrical conditions for ballistic and visually controlled movements. Ergonomics, 31(5), 829–839. https://doi.org/10.1080/00140138808966724
   PubMed Web of Science ®Google Scholar
• García-Holgado, A., Reiris, I. T., Kearney, N., Martinus, C., & García-Peñalvo, F. J. (2019). An app to support yoga teachers to implement a yoga-based approach to promote wellbeing among young people: Usability study [Paper presentation]. In International Conference on Human-Computer Interaction, Cham. July). (pp. 38–49). Springer
   Google Scholar
• Goettl, J. S., Brugh, A. W., Julstrom, B. A. (2005, March). Call me e-mail: Arranging the keyboard with a permutation-coded genetic algorithm. In Proceedings of the 2005 ACM Symposium on Applied Computing (pp. 947–951).
   Google Scholar
• Gori, J., Rioul, O., Guiard, Y., Beaudouin-Lafon, M. (2018, April). The perils of confounding factors: How Fitts’ law experiments can lead to false conclusions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–10).
   Google Scholar
• Graves, R. J., Wilhelm, M. R., McGinnis, L. F., Ward, R. E., & Montreuil, B. (1991). A modelling framework for integrating layout design and flow network design. In Material handling’90 (pp. 95–115). Springer.
   Google Scholar
• Grossman, T., & Balakrishnan, R. (2005). A probabilistic approach to modeling two-dimensional pointing. ACM Transactions on Computer-Human Interaction, 12(3), 435–459. https://doi.org/10.1145/1096737.1096741
   Google Scholar
• Hajela, P., & Lin, C. Y. (1992). Genetic search strategies in multicriterion optimal design. Structural Optimization, 4(2), 99–107. https://doi.org/10.1007/BF01759923
   Web of Science ®Google Scholar
• Heragu, S. S., & Kusiak, A. (1991). Efficient models for the facility layout problem. European Journal of Operational Research, 53(1), 1–13. https://doi.org/10.1016/0377-2217(91)90088-D
   Web of Science ®Google Scholar
• Hoffmann, E. R., Chan, A. H., Man, S. S., & Lin, R. F. (2022). Inertia effects in Fitts’ law for movement time. In Human-automation interaction: Manufacturing, services and user experience (pp. 289–307). Springer International Publishing.
   Google Scholar
• Holland, J. H. (1975). Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor.
   Google Scholar
• Jeffries, R., Miller, J. R., Wharton, C., & Uyeda, K. (1991). User interface evaluation in the real world: A comparison of four techniques [Paper presentation]. In [Paper presentation]. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, March). (pp. 119–124). https://doi.org/10.1145/108844.108862
   Google Scholar
• Karrenbauer, A., & Oulasvirta, A. (2014). Improvements to keyboard optimization with integer programming [Paper presentation]. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, October). In (pp. 621–626). https://doi.org/10.1145/2642918.2647382
   Google Scholar
• Kieras, D. (2001). Using the keystroke-level model to estimate execution times. Unpublished report. Department of Psychology, University of Michigan.
   Google Scholar
• Ko, Y. J., Zhao, H., Ramakrishnan, I. V., Zhai, S., & Bi, X. (2021). Issues related to using Finger-Fitts law to model one-dimensional touch pointing tasks [Paper presentation]. The Ninth International Symposium of Chinese CHI, October). In (pp. 41–49). https://doi.org/10.1145/3490355.3490360
   Google Scholar
• Kuo, W. H., & Yang, D. L. (2006). Minimizing the total completion time in a single-machine scheduling problem with a time-dependent learning effect. European Journal of Operational Research, 174(2), 1184–1190. https://doi.org/10.1016/j.ejor.2005.03.020
   Web of Science ®Google Scholar
• Lewis, C., Polson, P. G., Wharton, C., & Rieman, J. (1990). Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces [Paper presentation]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, March). (pp. 235–242). https://doi.org/10.1145/97243.97279
   Google Scholar
• Lin, R. F., & Drury, C. G. (2013). Verification of models for ballistic movement time and endpoint variability. Ergonomics, 56(4), 623–636. https://doi.org/10.1080/00140139.2013.765603
   PubMed Web of Science ®Google Scholar
• Lin, R. F., & Tsai, Y. C. (2015). The use of ballistic movement as an additional method to assess performance of computer mice. International Journal of Industrial Ergonomics, 45, 71–81. https://doi.org/10.1016/j.ergon.2014.12.003
   Web of Science ®Google Scholar
• Liu, Y., & Xi, T. (2019)., December). Study on the interface usability of light control panel in large cruise ship cabin based on eye movement experiment [Paper presentation]. 2019 6th International Conference on Information Science and Control Engineering (ICISCE), In (pp. 913–922). IEEE. https://doi.org/10.1109/ICISCE48695.2019.00185
   Google Scholar
• Mack, Z., & Sharples, S. (2009). The importance of usability in product choice: A mobile phone case study. Ergonomics, 52(12), 1514–1528. https://doi.org/10.1080/00140130903197446
   PubMed Web of Science ®Google Scholar
• MacKenzie, I. S., & Buxton, W. (1992). Extending Fitts’ law to two-dimensional tasks [Paper presentation]. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, June). In (pp. 219–226). https://doi.org/10.1145/142750.142794
   Google Scholar
• MacKenzie, I. S. (1992). Fitts’ law as a research and design tool in human-computer interaction. Human–Computer Interaction, 7(1), 91–139. https://doi.org/10.1207/s15327051hci0701_3
   Google Scholar
• Malas, T. M., Taifour, S. S., & Abandah, G. A. (2008). Toward optimal Arabic keyboard layout using genetic algorithm. In Proc. 9th Int’l Middle Eastern Multiconf. on Simulation and Modeling (MESM 2008), 50–54.
   Google Scholar
• Marler, R. T., & Arora, J. S. (2010). The weighted sum method for multi-objective optimization: New insights. Structural and Multidisciplinary Optimization, 41(6), 853–862. https://doi.org/10.1007/s00158-009-0460-7
   Web of Science ®Google Scholar
• Mathiyazhagan, T., & Nandan, D. (2010). Survey research method. Media Mimansa, 4(1), 34–45.
   Google Scholar
• Mitchell, C. L., Cler, G. J., Fager, S. K., Contessa, P., Roy, S. H., De Luca, G., Kline, J. C., & Vojtech, J. M. (2022). Ability-based methods for personalized keyboard generation. Multimodal Technologies and Interaction, 6(8), 67. https://doi.org/10.3390/mti6080067
   PubMedGoogle Scholar
• Mosheiov, G. (2001). Scheduling problems with a learning effect. European Journal of Operational Research, 132(3), 687–693. https://doi.org/10.1016/S0377-2217(00)00175-2
   Web of Science ®Google Scholar
• Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces [Paper presentation]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, March). (pp. 249–256). https://doi.org/10.1145/97243.97281
   Google Scholar
• Onsorodi, A. H. H., & Korhan, O. (2020). Application of a genetic algorithm to the keyboard layout problem. PLoS One, 15(1), e0226611. https://doi.org/10.1371/journal.pone.0226611
   PubMed Web of Science ®Google Scholar
• Osyczka, A. (1978). An approach to multicriterion optimization problems for engineering design. Computer Methods in Applied Mechanics and Engineering, 15(3), 309–333. https://doi.org/10.1016/0045-7825(78)90046-4
   Web of Science ®Google Scholar
• Otten, R. H. (1982). Automatic floorplan design. In 19th Design Automation Conference, June). In (pp. 261–267). IEEE. https://doi.org/10.1109/DAC.1982.1585510
   Google Scholar
• Oulasvirta, A. (2017). User interface design with combinatorial optimization. Computer Magazine. 50(1), 40–47. https://doi.org/10.1109/MC.2017.6
   Web of Science ®Google Scholar
• Oulasvirta, A. (2017, December). Optimizing user interfaces for human performance. In International conference on intelligent human computer interaction (pp. 3–7). Springer.
   Google Scholar
• Rohan, S., Roy, K., Saha, P. K., Hossain, S., Rahman, F., & Mohammed, N. (2022). Analysis of Bangla keyboard layouts based on keystroke dynamics. In Intelligent systems and sustainable computing: proceedings of ICISSC 2021 (pp. 165–173). Springer Nature Singapore.
   Google Scholar
• Roy, M. C., Dewit, O., & Aubert, B. A. (2001). The impact of interface usability on trust in Web retailers. Internet Research, 11(5), 388–398. https://doi.org/10.1108/10662240110410165
   Web of Science ®Google Scholar
• Santos, C., Miranda, B., Araujo, T., Carneiro, N., Marques, A., Mota, M., Morais, J., & Meiguins, B. (2016). Guidelines for graphical user interface design in mobile augmented reality applications [Paper presentation]. In International Conference on Virtual, Augmented and Mixed Reality, Cham. July). (pp. 71–80). Springer
   Google Scholar
• Shahookar, K., & Mazumder, P. (1991). VLSI cell placement techniques. ACM Computing Surveys, 23(2), 143–220. https://doi.org/10.1145/103724.103725
   Web of Science ®Google Scholar
• Srinivas, N. & Deb, K. (1994). Muiltiobjective optimization using nondominated sorting in genetic algorithms. Evolutionary Computation, 2(3), 221–248. https://doi.org/10.1162/EVCO.1994.2.3.221
   Google Scholar
• Tränkle, U., & Deutschmann, D. (1991). Factors influencing speed and precision of cursor positioning using a mouse. Ergonomics, 34(2), 161–174. https://doi.org/10.1080/00140139108967304
   Web of Science ®Google Scholar
• Van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think aloud method: A practical approach to modelling cognitive. AcademicPress.
   Google Scholar
• Yang, S. (2007, April). Genetic algorithms with elitism-based immigrants for changing optimization problems. In Workshops on applications of evolutionary computation (pp. 627–636). Springer.
   Google Scholar
• Youssef, H., Sait, S. M., & Adiche, H. (2001). Evolutionary algorithms, simulated annealing and tabu search: A comparative study. Engineering Applications of Artificial Intelligence, 14(2), 167–181. https://doi.org/10.1016/S0952-1976(00)00065-8
   Web of Science ®Google Scholar