Neuroaesthetic Indicators from the Perspective of Two-Stage Process Theory: N2 and LPP can Predict Aesthetic Judgment of Human–Computer Interfaces

References

• Amsel, B. D., Urbach, T. P., & Kutas, M. (2013). Alive and grasping: Stable and rapid semantic access to an object category but not object graspability. NeuroImage, 77, 1–13. https://doi.org/10.1016/j.neuroimage.2013.03.058
   PubMed Web of Science ®Google Scholar
• Backlinko Team. (2024). Revealing average screen time statistics. Backlinko. https://backlinko.com/screen-time-statistics
   Google Scholar
• Balconi, M., & Pozzoli, U. (2008). Event-related oscillations (ERO) and event-related potentials (ERP) in emotional face recognition: A regression analysis. International Journal of Neuroscience, 118(10), 1412–1424. https://doi.org/10.1080/00207450601047119
   PubMed Web of Science ®Google Scholar
• Bocquillon, P., Bourriez, J. L., Palmero-Soler, E., Molaee-Ardekani, B., Derambure, P., & Dujardin, K. (2014). The spatiotemporal dynamics of early attention processes: A high-resolution electroencephalographic study of N2 subcomponent sources. Neuroscience, 271, 9–22. https://doi.org/10.1016/j.neuroscience.2014.04.014
   PubMed Web of Science ®Google Scholar
• Bollini, L. (2017). Beautiful interfaces. From user experience to user interface design. The Design Journal, 20(1), S89–S101. https://doi.org/10.1080/14606925.2017.1352649
   Google Scholar
• Bölte, J., Hösker, T. M., Hirschfeld, G., & Thielsch, M. T. (2017). Electrophysiological correlates of aesthetic processing of webpages: A comparison of experts and laypersons. PeerJ, 5, e3440. https://doi.org/10.7717/peerj.3440
   PubMed Web of Science ®Google Scholar
• Bonacci, L. M., Bressler, S., Kwasa, J. A. C., Noyce, A. L., & Shinn-Cunningham, B. G. (2020). Effects of visual scene complexity on neural signatures of spatial attention. Frontiers in Human Neuroscience, 14, 91. https://doi.org/10.3389/fnhum.2020.00091
   PubMed Web of Science ®Google Scholar
• Campbell, A. M., Elbogen, E. B., Johnson, J. L., Hamer, R. M., & Belger, A. (2021). Event related potentials indexing the influence of emotion on cognitive processing in veterans with comorbid post-traumatic stress disorder and traumatic brain injury. Clinical Neurophysiology, 132(7), 1389–1397. https://doi.org/10.1016/j.clinph.2021.03.017
   PubMed Web of Science ®Google Scholar
• Carbine, K. A., Rodeback, R., Modersitzki, E., Miner, M., LeCheminant, J. D., & Larson, M. J. (2018). The utility of event-related potentials (ERPs) in understanding food-related cognition: A systematic review and recommendations. Appetite, 128, 58–78. https://doi.org/10.1016/j.appet.2018.05.135
   PubMed Web of Science ®Google Scholar
• Carretié, L., Hinojosa, J. A., López-Martín, S., & Tapia, M. (2007). An electrophysiological study on the interaction between emotional content and spatial frequency of visual stimuli. Neuropsychologia, 45(6), 1187–1195. https://doi.org/10.1016/j.neuropsychologia.2006.10.013
   PubMed Web of Science ®Google Scholar
• Carretié, L., Hinojosa, J. A., & Mercado, F. (2003). Cerebral patterns of attentional habituation to emotional visual stimuli. Psychophysiology, 40(3), 381–388. https://doi.org/10.1111/1469-8986.00041
   PubMed Web of Science ®Google Scholar
• Cela-Conde, C. J., Agnati, L., Huston, J. P., Mora, F., & Nadal, M. (2011). The neural foundations of aesthetic appreciation. Progress in Neurobiology, 94(1), 39–48. https://doi.org/10.1016/j.pneurobio.2011.03.003
   PubMed Web of Science ®Google Scholar
• Cepeda-Freyre, H. A., Garcia-Aguilar, G., Eguibar, J. R., & Cortes, C. (2020). Brain processing of complex geometric forms in a visual memory task increases P2 amplitude. Brain Sciences, 10(2), 114. https://doi.org/10.3390/brainsci10020114
   PubMed Web of Science ®Google Scholar
• Chen, Y., Zhang, D., & Jiang, D. (2018). Effects of directed attention on subsequent processing of emotions: Increased attention to unpleasant pictures occurs in the late positive potential. Frontiers in Psychology, 9, 1127. https://doi.org/10.3389/fpsyg.2018.01127
   PubMed Web of Science ®Google Scholar
• Correa, Á., Lupiáñez, J., Madrid, E., & Tudela, P. (2006). Temporal attention enhances early visual processing: A review and new evidence from event-related potentials. Brain Research, 1076(1), 116–128. https://doi.org/10.1016/j.brainres.2005.11.074
   PubMed Web of Science ®Google Scholar
• Crites, S. L., Jr., & Cacioppo, J. T. (1996). Electrocortical differentiation of evaluative and nonevaluative categorizations. Psychological Science, 7(5), 318–321. https://doi.org/10.1111/j.1467-9280.1996.tb00381.x
   Web of Science ®Google Scholar
• de Tommaso, M., Pecoraro, C., Sardaro, M., Serpino, C., Lancioni, G., & Livrea, P. (2008). Influence of aesthetic perception on visual event-related potentials. Consciousness and Cognition, 17(3), 933–945. https://doi.org/10.1016/j.concog.2007.09.003
   PubMed Web of Science ®Google Scholar
• Ding, Y., Guo, F., Hu, M., & Cao, Y. (2017). Using event related potentials to investigate visual aesthetic perception of product appearance. Human Factors and Ergonomics in Manufacturing & Service Industries, 27(5), 223–232. https://doi.org/10.1002/hfm.20704
   Web of Science ®Google Scholar
• Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018). Machine learning approaches for clinical psychology and psychiatry. Annual Review of Clinical Psychology, 14(1), 91–118. https://doi.org/10.1146/annurev-clinpsy-032816-045037
   PubMed Web of Science ®Google Scholar
• Elhai, J. D., & Montag, C. (2020). The compatibility of theoretical frameworks with machine learning analyses in psychological research. Current Opinion in Psychology, 36, 83–88. https://doi.org/10.1016/j.copsyc.2020.05.002
   PubMed Web of Science ®Google Scholar
• Else, J. E., Ellis, J., & Orme, E. (2015). Art expertise modulates the emotional response to modern art, especially abstract: An ERP investigation. Frontiers in Human Neuroscience, 9, 525. https://doi.org/10.3389/fnhum.2015.00525
   PubMed Web of Science ®Google Scholar
• Ernst, L. H., Ehlis, A. C., Dresler, T., Tupak, S. V., Weidner, A., & Fallgatter, A. J. (2013). N1 and N2 ERPs reflect the regulation of automatic approach tendencies to positive stimuli. Neuroscience Research, 75(3), 239–249. https://doi.org/10.1016/j.neures.2012.12.005
   PubMed Web of Science ®Google Scholar
• Fields, E. C. (2023). The P300, the LPP, context updating, and memory: What is the functional significance of the emotion-related late positive potential? International Journal of Psychophysiology, 192, 43–52. https://doi.org/10.1016/j.ijpsycho.2023.08.005
   PubMed Web of Science ®Google Scholar
• Fokkema, M., Iliescu, D., Greiff, S., & Ziegler, M. (2022). Machine learning and prediction in psychological assessment. European Journal of Psychological Assessment, 38(3), 165–175. https://doi.org/10.1027/1015-5759/a000714
   Web of Science ®Google Scholar
• Folstein, J. R., & Van Petten, C. (2008). Influence of cognitive control and mismatch on the N2 component of the ERP: A review. Psychophysiology, 45(1), 152–170. https://doi.org/10.1111/j.1469-8986.2007.00602.x
   PubMed Web of Science ®Google Scholar
• Guo, F., Ding, Y., Wang, T., Liu, W., & Jin, H. (2016). Applying event related potentials to evaluate user preferences toward smartphone form design. International Journal of Industrial Ergonomics, 54, 57–64. https://doi.org/10.1016/j.ergon.2016.04.006
   Web of Science ®Google Scholar
• Guo, F., Jiang, J., Tian, X., & Chen, J. (2019). Applying event-related potentials to measure perceptual experience toward the navigation interface of a mobile game for improving the design. Symmetry, 11(5), 710. https://doi.org/10.3390/sym11050710
   Google Scholar
• Guo, F., Li, M., Hu, M., Li, F., & Lin, B. (2019). Distinguishing and quantifying the visual aesthetics of a product: An integrated approach of eye-tracking and EEG. International Journal of Industrial Ergonomics, 71, 47–56. https://doi.org/10.1016/j.ergon.2019.02.006
   Web of Science ®Google Scholar
• Guo, F., Wang, X. S., Shao, H., Wang, X. R., & Liu, W. L. (2020). How user’s first impression forms on mobile user interface: An ERPs study. International Journal of Human-Computer Interaction, 36(9), 870–880. https://doi.org/10.1080/10447318.2019.1699745
   Web of Science ®Google Scholar
• Gupta, R. S., Kujawa, A., & Vago, D. R. (2019). The neural chronometry of threat-related attentional bias: Event-related potential (ERP) evidence for early and late stages of selective attentional processing. International Journal of Psychophysiology, 146, 20–42. https://doi.org/10.1016/j.ijpsycho.2019.08.006
   PubMed Web of Science ®Google Scholar
• Handy, T. C., Smilek, D., Geiger, L., Liu, C., & Schooler, J. W. (2010). ERP evidence for rapid hedonic evaluation of logos. Journal of Cognitive Neuroscience, 22(1), 124–138. https://doi.org/10.1162/jocn.2008.21180
   PubMed Web of Science ®Google Scholar
• Hema, C. R., Paulraj, M. P., & Ramkumar, S. (2014). Classification of eye movements using electrooculography and neural networks. International Journal of Human Computer Interaction, 5(4), 51–63.
   Google Scholar
• Hillyard, S. A., & Anllo-Vento, L. (1998). Event-related brain potentials in the study of visual selective attention. Proceedings of the National Academy of Sciences, 95(3), 781–787. https://doi.org/10.1073/pnas.95.3.781
   PubMed Web of Science ®Google Scholar
• Höfel, L., & Jacobsen, T. (2007a). Electrophysiological indices of processing aesthetics: Spontaneous or intentional processes? International Journal of Psychophysiology, 65(1), 20–31. https://doi.org/10.1016/j.ijpsycho.2007.02.007
   PubMed Web of Science ®Google Scholar
• Höfel, L., & Jacobsen, T. (2007b). Electrophysiological indices of processing symmetry and aesthetics: A result of judgment categorization or judgment report? Journal of Psychophysiology, 21(1), 9–21. https://doi.org/10.1027/0269-8803.21.1.9
   Web of Science ®Google Scholar
• Hoffman, J. E. (1979). A two-stage model of visual search. Perception & Psychophysics, 25(4), 319–327. https://doi.org/10.3758/BF03198811
   PubMedGoogle Scholar
• Howarth, J. (2023). Time spent using smartphones (2024 Statistics). Exploding Topics. https://explodingtopics.com/blog/smartphone-usage-stats#top-smartphone-stats
   Google Scholar
• Hu, C., Huang, Y., Eickhoff, S. B., Peng, K., & Sui, J. (2020). Seeking the “beauty center” in the brain: A meta-analysis of fMRI studies of beautiful human faces and visual art. Cognitive, Affective, & Behavioral Neuroscience, 20(6), 1200–1215. https://doi.org/10.3758/s13415-020-00827-z
   PubMed Web of Science ®Google Scholar
• Ito, T. A., & Cacioppo, J. T. (2000). Electrophysiological evidence of implicit and explicit categorization processes. Journal of Experimental Social Psychology, 36(6), 660–676. https://doi.org/10.1006/jesp.2000.1430
   Web of Science ®Google Scholar
• Jacobsen, T., & Höfel, L. (2001). Aesthetics electrified: An analysis of descriptive symmetry and evaluative aesthetic judgment processes using event-related brain potentials. Empirical Studies of the Arts, 19(2), 177–190. https://doi.org/10.2190/P7W1-5F1F-NJK9-X05B
   Google Scholar
• Jacobsen, T., & Höfel, L. (2003). Descriptive and evaluative judgment processes: Behavioral and electrophysiological indices of processing symmetry and aesthetics. Cognitive, Affective & Behavioral Neuroscience, 3(4), 289–299. https://doi.org/10.3758/CABN.3.4.289
   PubMed Web of Science ®Google Scholar
• Jiang, Q., Deng, L., & Zhang, J. (2024). How dose aesthetic design affect continuance intention in in-vehicle infotainment systems? An exploratory study. International Journal of Human–Computer Interaction, 1–16. https://doi.org/10.1080/10447318.2023.2301253
   Web of Science ®Google Scholar
• Jimenez, M., Hinojosa, J. A., & Montoro, P. R. (2020). Visual awareness and the levels of processing hypothesis: A critical review. Consciousness and Cognition, 85, 103022. https://doi.org/10.1016/j.concog.2020.103022
   PubMed Web of Science ®Google Scholar
• Johannes, S., Münte, T. F., Heinze, H. J., & Mangun, G. R. (1995). Luminance and spatial attention effects on early visual processing. Brain Research. Cognitive Brain Research, 2(3), 189–205. https://doi.org/10.1016/0926-6410(95)90008-X
   PubMedGoogle Scholar
• Karayanidis, F., & Michie, P. T. (1996). Frontal processing negativity in a visual selective attention task. Electroencephalography and Clinical Neurophysiology, 99(1), 38–56. https://doi.org/10.1016/0921-884X(96)95116-4
   PubMedGoogle Scholar
• Kielar, A., & Joanisse, M. F. (2010). Graded effects of regularity in language revealed by N400 indices of morphological priming. Journal of Cognitive Neuroscience, 22(7), 1373–1398. https://doi.org/10.1162/jocn.2009.21353
   PubMed Web of Science ®Google Scholar
• Li, R., Qin, R., Zhang, J., Wu, J., & Zhou, C. (2015). The esthetic preference of Chinese typefaces - An event-related potential study. Brain Research, 1598, 57–65. https://doi.org/10.1016/j.brainres.2014.11.055
   PubMed Web of Science ®Google Scholar
• Liu, W., Cao, Y., & Proctor, R. W. (2022). The roles of visual complexity and order in first impressions of webpages: An ERP study of webpage rapid evaluation. International Journal of Human–Computer Interaction, 38(14), 1345–1358. https://doi.org/10.1080/10447318.2021.2002044
   Web of Science ®Google Scholar
• Lopez-Calderon, J., & Luck, S. J. (2014). ERPLAB: An open-source toolbox for the analysis of event-related potentials. Frontiers in Human Neuroscience, 8, 213. https://doi.org/10.3389/fnhum.2014.00213
   PubMed Web of Science ®Google Scholar
• Luck, S. J., & Hillyard, S. A. (1994). Electrophysiological correlates of feature analysis during visual search. Psychophysiology, 31(3), 291–308. https://doi.org/10.1111/j.1469-8986.1994.tb02218.x
   PubMed Web of Science ®Google Scholar
• Muñoz, F., & Martín-Loeches, M. (2015). Electrophysiological brain dynamics during the esthetic judgment of human bodies and faces. Brain Research, 1594, 154–164. https://doi.org/10.1016/j.brainres.2014.10.061
   PubMed Web of Science ®Google Scholar
• Omoto, S., Kuroiwa, Y., Wang, C., Li, M., Mizuki, N., & Hakii, Y. (2007). The effect of attended color on the P1/N1 component of visual event-related potentials. Neuroscience Letters, 429(1), 22–27. https://doi.org/10.1016/j.neulet.2007.09.075
   PubMed Web of Science ®Google Scholar
• Orrù, G., Monaro, M., Conversano, C., Gemignani, A., & Sartori, G. (2019). Machine learning in psychometrics and psychological research. Frontiers in Psychology, 10, 2970. https://doi.org/10.3389/fpsyg.2019.02970
   PubMed Web of Science ®Google Scholar
• Pargent, F., Schoedel, R., & Stachl, C. (2023). Best practices in supervised machine learning: A tutorial for psychologists. Advances in Methods and Practices in Psychological Science, 6(3), 25152459231162559. https://doi.org/10.1177/25152459231162559
   PubMedGoogle Scholar
• Park, J. Y., Min, B. K., Jung, Y. C., Pak, H., Jeong, Y. H., & Kim, E. (2013). Illumination influences working memory: An EEG study. Neuroscience, 247, 386–394. https://doi.org/10.1016/j.neuroscience.2013.05.016
   PubMed Web of Science ®Google Scholar
• Perez, V., Garrido‐Chaves, R., Zapater‐Fajarí, M., Pulopulos, M. M., Barbosa, F., Hidalgo, V., & Salvador, A. (2022). Deficits in facial emotional valence processing in older people with subjective memory complaints: Behavioral and electrophysiological evidence. Psychophysiology, 59(4), e13989. https://doi.org/10.1111/psyp.13989
   PubMed Web of Science ®Google Scholar
• Proverbio, A. M., Adorni, R., & D'Aniello, G. E. (2011). 250ms to code for action affordance during observation of manipulable objects. Neuropsychologia, 49(9), 2711–2717. https://doi.org/10.1016/j.neuropsychologia.2011.05.019
   PubMed Web of Science ®Google Scholar
• Rendell, A., Adam, M. T. P., Eidels, A., & Teubner, T. (2022). Nature imagery in user interface design: The influence on user perceptions of trust and aesthetics. Behaviour & Information Technology, 41(13), 2762–2778. https://doi.org/10.1080/0144929X.2021.1946592
   Web of Science ®Google Scholar
• Righi, S., Gronchi, G., Pierguidi, G., Messina, S., & Viggiano, M. P. (2017). Aesthetic shapes our perception of every-day objects: An ERP study. New Ideas in Psychology, 47, 103–112. https://doi.org/10.1016/j.newideapsych.2017.03.007
   Web of Science ®Google Scholar
• Righi, S., Orlando, V., & Marzi, T. (2014). Attractiveness and affordance shape tools neural coding: Insight from ERPs. International Journal of Psychophysiology, 91(3), 240–253. https://doi.org/10.1016/j.ijpsycho.2014.01.003
   PubMed Web of Science ®Google Scholar
• Roye, A., Höfel, L., & Jacobsen, T. (2008). Aesthetics of faces: Behavioral and electrophysiological indices of evaluative and descriptive judgment processes. Journal of Psychophysiology, 22(1), 41–57. https://doi.org/10.1027/0269-8803.22.1.41
   Web of Science ®Google Scholar
• Sarasso, P., Ronga, I., Kobau, P., Bosso, T., Artusio, I., Ricci, R., & Neppi-Modona, M. (2020). Beauty in mind: Aesthetic appreciation correlates with perceptual facilitation and attentional amplification. Neuropsychologia, 136, 107282. https://doi.org/10.1016/j.neuropsychologia.2019.107282
   PubMed Web of Science ®Google Scholar
• Schacht, A., Werheid, K., & Sommer, W. (2008). The appraisal of facial beauty is rapid but not mandatory. Cognitive, Affective & Behavioral Neuroscience, 8(2), 132–142. https://doi.org/10.3758/CABN.8.2.132
   PubMed Web of Science ®Google Scholar
• Schindler, S., & Bublatzky, F. (2020). Attention and emotion: An integrative review of emotional face processing as a function of attention. Cortex, 130, 362–386. https://doi.org/10.1016/j.cortex.2020.06.010
   PubMed Web of Science ®Google Scholar
• Shaw, N. A., & Cant, B. R. (1980). Age-dependent changes in the latency of the pattern visual evoked potential. Electroencephalography and Clinical Neurophysiology, 48(2), 237–241. https://doi.org/10.1016/0013-4694(80)90310-7
   PubMedGoogle Scholar
• Tay, L., Woo, S. E., Hickman, L., Booth, B. M., & D’Mello, S. (2022). A conceptual framework for investigating and mitigating machine-learning measurement bias (MLMB) in psychological assessment. Advances in Methods and Practices in Psychological Science, 5(1), 251524592110613. https://doi.org/10.1177/25152459211061337
   Google Scholar
• Tommaso, M. d., Sardaro, M., & Livrea, P. (2008). Aesthetic value of paintings affects pain thresholds. Consciousness and Cognition, 17(4), 1152–1162. https://doi.org/10.1016/j.concog.2008.07.002
   PubMed Web of Science ®Google Scholar
• Turner, A. (2024). How many smartphones are in the world? (2024). Bankmycell. https://www.bankmycell.com/blog/how-many-phones-are-in-the-world
   Google Scholar
• Vogel, E. K., & Luck, S. J. (2000). The visual N1 component as an index of a discrimination process. Psychophysiology, 37(2), 190–203. https://doi.org/10.1111/1469-8986.3720190
   PubMed Web of Science ®Google Scholar
• Wang, P., Feng, H., Du, X., Nie, R., Lin, Y., Ma, C., & Zhang, L. (2023). EEG-based evaluation of aesthetic experience using BiLSTM network. International Journal of Human–Computer Interaction, 1–14. https://doi.org/10.1080/10447318.2023.2278926
   Web of Science ®Google Scholar
• Wascher, E., & Beste, C. (2010). Spatial representations as an emergent feature of perceptual processing. Journal of Psychophysiology, 24(3), 161–172. https://doi.org/10.1027/0269-8803/a000007
   Web of Science ®Google Scholar
• Weinberg, A., Hilgard, J., Bartholow, B. D., & Hajcak, G. (2012). Emotional targets: Evaluative categorization as a function of context and content. International Journal of Psychophysiology, 84(2), 149–154. https://doi.org/10.1016/j.ijpsycho.2012.01.023
   PubMed Web of Science ®Google Scholar
• Xiang, L., Cai, M., Ren, C., & Ng, E. (2021). Modeling pedestrian emotion in high-density cities using visual exposure and machine learning: Tracking real-time physiology and psychology in Hong Kong. Building and Environment, 205, 108273. https://doi.org/10.1016/j.buildenv.2021.108273
   Web of Science ®Google Scholar
• Yarkoni, T., & Westfall, J. (2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 12(6), 1100–1122. https://doi.org/10.1177/1745691617693393
   PubMedGoogle Scholar
• Zabelina, D. L., & Ganis, G. (2018). Creativity and cognitive control: Behavioral and ERP evidence that divergent thinking, but not real-life creative achievement, relates to better cognitive control. Neuropsychologia, 118(Pt A), 20–28. https://doi.org/10.1016/j.neuropsychologia.2018.02.014
   PubMedGoogle Scholar
• Zhang, Z., Xu, B., & Zhang, T. (2021). Aesthetic study of patterns based on event-related potential and eye-tracking: Taking the decorative patterns of the Tang dynasty as an example. Journal of the Society for Information Display, 29(2), 119–129. https://doi.org/10.1002/jsid.958
   Web of Science ®Google Scholar