1,976
Views
2
CrossRef citations to date
0
Altmetric
Research Articles

Measuring Aesthetic Preferences of Neural Style Transfer: More Precision With the Two-Alternative-Forced-Choice Task

ORCID Icon
Pages 755-775 | Received 18 Jun 2021, Accepted 26 Jan 2022, Published online: 25 Apr 2022

References

  • Blanca, M. J., Alarcón, R., Arnau, J., Bono, R., & Bendayan, R. (2017). Non-normal data: Is ANOVA still a valid option? María. Psicothema, 29(4), 552–557. https://doi.org/10.7334/psicothema2016.383
  • Blijlevens, J., Hekkert, P., Leder, H., Thurgood, C., Chen, L. L., & Whitfield, T. W. A. (2017). The aesthetic pleasure in design scale: The development of a scale to measure aesthetic pleasure for designed artifacts. Psychology of Aesthetics, Creativity, and the Arts, 11(1), 86–98. https://doi.org/10.1037/aca0000098
  • Bo, Y., Yu, J., & Zhang, K. (2018). Computational aesthetics and applications. Visual Computing for Industry, Biomedicine, and Art, 1(1), 6–19. https://doi.org/10.1186/s42492-018-0006-1
  • Bogacz, R., Brown, E., Moehlis, J., Holmes, P., & Cohen, J. D. (2006). The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113(4), 700–765. https://doi.org/10.1037/0033-295X.113.4.700
  • Cela-Conde, C. J., Agnati, L., Huston, J. P., Mora, F., & Nadal, M. (2011). The neural foundations of aesthetic appreciation. Progress in Neurobiology, 94(1), 39–48. https://doi.org/10.1016/j.pneurobio.2011.03.003
  • Cela-Conde, C. J., Ayala, F. J., Munar, E., Maestú, F., Nadal, M., Capó, M. A., Del Río, D., López-Ibor, J. J., Ortiz, T., Mirasso, C., & Marty, G. (2009). Sex-related similarities and differences in the neural correlates of beauty. Proceedings of the National Academy of Sciences of the United States of America, 106(10), 3847–3852. https://doi.org/10.1073/pnas.0900304106
  • Chamberlain, R., Mullin, C., Scheerlinck, B., & Wagemans, J. (2018). Putting the art in artificial: Aesthetic responses to a brief history of computer art. Psychology of Aesthetics, Creativity, and the Arts, 12(2), 177–192. https://doi.org/10.1037/aca0000136
  • Champandard, A. J. (2016). Semantic style transfer and turning two-bit doodles into fine artworks. Arxiv. http://arxiv.org/abs/1603.01768
  • Chen, D., Yuan, L., Liao, J., Yu, N., Hua, G. (2018). Stereoscopic neural style transfer. http://arxiv.org/abs/1802.10591
  • Chen, S. (2020). The emerging trend of accurate advertising communication in the era of big data—The case of programmatic, targeted advertising. In J.-S. Pan, A. Ito, P.-W. Tsai, & L. C. Jain (Eds.), Advances in intelligent information hiding and multimedia signal processing (pp. 299–308). Springer.
  • Chen, T. Q., Schmidt, M. (2016). Fast patch-based style transfer of arbitrary style. Arxiv. http://arxiv.org/abs/1612.04337
  • Choi, S. K. (2018). Guess, check and fix: A phenomenology of improvisation in ‘neural’ painting. Digital Creativity, 29(1), 96–114. https://doi.org/10.1080/14626268.2018.1423995
  • Collobert, R., Dundar, A., Farabet, C., Grewe, D., Kavukcuoglu, K., Léonard, N., Chintala, S., Zagoruyko, S. (2018). Torch. In GitHub repository. GitHub. https://github.com/torch/torch7
  • Corradi, G., Belman, M., Currò, T., Chuquichambi, E. G., Rey, C., & Nadal, M. (2019). Aesthetic sensitivity to curvature in real objects and abstract designs. Acta Psychologica, 197(May), 124–130. https://doi.org/10.1016/j.actpsy.2019.05.012
  • Cui, X., Qi, M., Niu, Y., & Li, B. (2018). The intra-class and inter-class relationships in style transfer. Applied Sciences, 8(9), 1681. https://doi.org/10.3390/app8091681
  • Cumming, G., & Finch, S. (2005). Inference by eye: Confidence intervals and how to read pictures of data. The American Psychologist, 60(2), 170–180. https://doi.org/10.1037/0003-066X.60.2.170
  • De Angeli, A., Sutcliffe, A., & Hartmann, J. (2006). Interaction, usability and aesthetics [Paper presentation]. The 6th ACM Conference, Proceedings of on Designing Interactive Systems - DIS ’06, University Park, PA, USA. https://doi.org/10.1145/1142405.1142446
  • Delplanque, J., De Loof, E., Janssens, C., & Verguts, T. (2019). The sound of beauty: How complexity determines aesthetic preference. Acta Psychologica, 192(November 2018), 146–152. https://doi.org/10.1016/j.actpsy.2018.11.011
  • Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2010). ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition (pp. 248–255). IEEE. https://doi.org/10.1109/cvpr.2009.5206848.
  • DiPaola, S., & Gabora, L. (2009). Incorporating characteristics of human creativity into an evolutionary art algorithm. Genetic Programming and Evolvable Machines, 10(2), 97–110. https://doi.org/10.1007/s10710-008-9074-x
  • Everitt, B. (2002). The Cambridge dictionary of statistics (Vol. 106, 2nd ed.). Cambridge University Press.
  • Fechner, G. T., Howes, D. H., & Boring, E. G. (1966). Elements of psychophysics (Vol. 1). Rinehart and Winston New York.
  • Friborg, O., Martinussen, M., & Rosenvinge, J. H. (2006). Likert-based vs. semantic differential-based scorings of positive psychological constructs: A psychometric comparison of two versions of a scale measuring resilience. Personality and Individual Differences, 40(5), 873–884. https://doi.org/10.1016/j.paid.2005.08.015
  • Furnham, A., & Walker, J. (2001). The influence of personality traits, previous experience of art, and demographic variables on artistic preference. Personality and Individual Differences, 31(6), 997–1017. https://doi.org/10.1016/S0191-8869(00)00202-6
  • Gatys, L. A., Ecker, A. S., Bethge, M. (2015). A neural algorithm of artistic style. Arxiv, 3–7. https://doi.org/10.1167/16.12.326
  • Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image style transfer using convolutional neural networks [Paper presentation]. The IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA. https://doi.org/10.1109/CVPR.2016.265
  • Gharibshah, Z., Zhu, X., Hainline, A., & Conway, M. (2020). Deep learning for user interest and response prediction in online display advertising. Data Science and Engineering, 5(1), 12–26. https://doi.org/10.1007/s41019-019-00115-y
  • Ghiasi, G., Lee, H., Kudlur, M., Dumoulin, V., Shlens, J. (2017). Exploring the structure of a real-time, arbitrary neural artistic stylization network. Arxiv, 1705.06830. http://arxiv.org/abs/1705.06830
  • Graf, L. K. M., & Landwehr, J. R. (2017). Aesthetic pleasure versus aesthetic interest: The two routes to aesthetic liking. Frontiers in Psychology, 8(JAN), 15. https://doi.org/10.3389/fpsyg.2017.00015
  • Gundersen, O. E., & Kjensmo, S. (2018). State of the art: Reproducibility in artificial intelligence [Paper presentation]. 32nd AAAI Conference on Artificial Intelligence, AAAI 2018, Hilton New Orleans Riverside, New Orleans, Louisiana, USA.
  • Harper, R. H. R. (2019). The role of HCI in the age of AI. International Journal of Human–Computer Interaction, 35(15), 1331–1344. https://doi.org/10.1080/10447318.2019.1631527
  • Harrison, L., Yang, F., Franconeri, S., & Chang, R. (2014). Ranking visualizations of correlation using Weber's Law. IEEE Transactions on Visualization and Computer Graphics, 20(12), 1943–1952. https://doi.org/10.1109/TVCG.2014.2346979
  • Hassenzahl, M. (2001). The effect of perceived hedonic quality on product appealingness. International Journal of Human-Computer Interaction, 13(4), 481–499. https://doi.org/10.1207/S15327590IJHC1304_07
  • He, K., Zhang, X., Ren, S., Sun, J. (2016). Deep residual learning for image recognition [Paper presentation]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.
  • Hekkert, P. (2006). Design aesthetics: Principles of pleasure in design. Psychology Science, 48(2), 157–172. http://www.pabst-publishers.de/psychology-science/2-2006/06_Hekkert.pdf
  • Hicsonmez, S., Samet, N., Sener, F., & Duygulu, P. (2017). DRAW: Deep networks for recognizing styles of artists who illustrate children’s books [Paper presentation]. Proceedings of ICMR ’17, June 6–9, 2017, Romania. https://doi.org/10.1145/nnnnnnn.nnnnnnn
  • Hocking, R. R. (2013). Methods and applications of linear models: Regression and the analysis of variance. John Wiley & Sons.
  • Huang, H., Wang, H., Luo, W., Ma, L., Jiang, W., Zhu, X., Li, Z., & Liu, W. (2017). Real-time neural style transfer for videos [Paper presentation]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. https://doi.org/10.1109/CVPR.2017.745
  • Huang, X., & Belongie, S. (2017). Arbitrary style transfer in real-time with adaptive instance normalization [Paper presentation]. Proceedings of the IEEE International Conference on Computer Vision, 2017-October, Venice, Italy. https://doi.org/10.1109/ICCV.2017.167
  • Hübner, R., & Fillinger, M. G. (2016). Comparison of objective measures for predicting perceptual balance and visual aesthetic preference. Frontiers in Psychology, 7(MAR), 335–315. https://doi.org/10.3389/fpsyg.2016.00335
  • Hung, W. K., & Chen, L. L. (2012). Effects of novelty and its dimensions on aesthetic preference in product design. International Journal of Design, 6(2), 81–90.
  • Hutson, M. (2018). Artificial intelligence faces reproducibility crisis unpublished code and sensitivity to training conditions make many claims hard to verify. Science, 359(6377), 725–726. https://doi.org/10.1126/science.359.6377.725
  • Jiang, S., Fu, Y. (2017). Fashion style generator. In C. Sierra (Ed.), Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI-17) (pp. 3721–3727). IJCAI.
  • Jing, Y., Yang, Y., Feng, Z., Ye, J., Song, M. (2017). Neural style transfer: A review. Arxiv. http://arxiv.org/abs/1705.04058
  • Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., & Song, M. (2020). Neural style transfer: A review. IEEE Transactions on Visualization and Computer Graphics, 26(11), 3365–3385. https://doi.org/10.1109/TVCG.2019.2921336
  • Johnson, J. (2015). neural-style. In GitHub repository. GitHub. https://github.com/jcjohnson/neural-style
  • Johnson, J. (2016). fast-neural-style. In GitHub repository. GitHub. https://github.com/jcjohnson/fast-neural-style
  • Johnson, J., Alahi, A., & Fei-Fei, L. (2016). Perceptual losses for real-time style transfer and super-resolution. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9906 LNCS, 694–711. https://doi.org/10.1007/978-3-319-46475-6\_43
  • Johnson, M. G., Muday, J. A., & Schirillo, J. A. (2010). When viewing variations in paintings by Mondrian, aesthetic preferences correlate with pupil size. Psychology of Aesthetics, Creativity, and the Arts, 4(3), 161–167. https://doi.org/10.1037/a0018155
  • Jordan, P. W. (2002). Designing pleasurable products: An introduction to the new human factors. CRC Press.
  • Kirk, R. E. (2013). Research strategies and the control of nuisance variables. Experimental Design: Procedures for the Behavioral Sciences, 1–30.
  • Knowles, E. S., & Nathan, K. T. (1997). Acquiescent responding in self-reports: Cognitive style or social concern? Journal of Research in Personality, 31(2), 293–301. https://doi.org/10.1006/jrpe.1997.2180
  • Leyssen, M. H. R., Linsen, S., Sammartino, J., & Palmer, S. E. (2012). Aesthetic preference for spatial composition in multiobject pictures. i-Perception, 3(1), 25–49. https://doi.org/10.1068/i0458aap
  • Li, H. (2018). A literature review of neural style transfer. Arxiv, 1. https://www.cs.princeton.edu/courses/archive/spring18/cos598B/public/projects/LiteratureReview/COS598B_spr2018_NeuralStyleTransfer.pdf
  • Linsen, S., Leyssen, M. H. R., Sammartino, J., & Palmer, S. E. (2011). Aesthetic preferences in the size of images of real-world objects. Perception, 40(3), 291–298. https://doi.org/10.1068/p6835
  • Liu, S., Ou, X., Qian, R., Wei, W., Cao, X. (2016). Makeup like a superstar: Deep localized makeup transfer network. In IJCAI International Joint Conference on Artificial Intelligence (pp. 2568–2575). ACM.
  • Liu, X.-C., Cheng, M.-M., Lai, Y.-K., & Rosin, P. L. (2017). Depth-aware neural style transfer [Paper presentation]. The Symposium, Proceedings of on Non-Photorealistic Animation and Rendering – NPAR ’17, Los Angeles, CA. https://doi.org/10.1145/3092919.3092924
  • Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017). Deep photo style transfer [Paper presentation]. Proceedings – 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-January, Honolulu, HI, USA. https://doi.org/10.1109/CVPR.2017.740
  • Macmillan, N. A., & Creelman, C. D. (2004). Detection theory: A user’s guide. Psychology Press.
  • Mantiuk, R. R. K., Tomaszewska, A., & Mantiuk, R. R. K. (2012). Comparison of four subjective methods for image quality assessment. Computer Graphics Forum, 31(8), 2478–2491. https://doi.org/10.1111/j.1467-8659.2012.03188.x
  • Mayer, S., & Landwehr, J. R. (2018). Quantifying visual aesthetics based on processing fluency theory: Four algorithmic measures for antecedents of aesthetic preferences. Psychology of Aesthetics, Creativity, and the Arts, 12(4), 399–431. https://doi.org/10.1037/aca0000187
  • McCormack, J., & D’Inverno, M. (2012). Computers and creativity: The road ahead. In J. McCormack & M. D'Inverno (Eds.), Computers and creativity. Springer.
  • McCormack, J., Gifford, T., & Hutchings, P. (2019). Autonomy, authenticity, authorship and intention in computer generated art. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11453 LNCS (April), 35–50. https://doi.org/10.1007/978-3-030-16667-0_3
  • McManus, I. C., Cook, R., & Hunt, A. (2010). Beyond the golden section and normative aesthetics: Why do individuals differ so much in their aesthetic preferences for rectangles? Psychology of Aesthetics, Creativity, and the Arts, 4(2), 113–126. https://doi.org/10.1037/a0017316
  • McNicol, D. (2005). A primer of signal detection theory. Psychology Press.
  • Norman, D. A. (2004). Emotional design: Why we love (or hate) everyday things (Vol. 2004). Basic Books. https://doi.org/10.1145/985600.966013
  • Palmer, S. E., & Schloss, K. B. (2010). An ecological valence theory of human color preference. Proceedings of the National Academy of Sciences of the United States of America, 107(19), 8877–8882. https://doi.org/10.1073/pnas.0906172107
  • Palmer, S. E., Schloss, K. B., & Sammartino, J. (2013). Visual aesthetics and human preference. Annual Review of Psychology, 64(1), 77–107. https://doi.org/10.1146/annurev-psych-120710-100504
  • Pelowski, M., Gerger, G., Chetouani, Y., Markey, P. S., & Leder, H. (2017). But is it really art? The classification of images as “art”/“not art” and correlation with appraisal and viewer interpersonal Differences. Frontiers in Psychology, 8(OCT), 1729. https://doi.org/10.3389/fpsyg.2017.01729
  • Pugach, C., Leder, H., & Graham, D. J. (2017). How stable are human aesthetic preferences across the lifespan? Frontiers in Human Neuroscience, 11(May), 289–211. https://doi.org/10.3389/fnhum.2017.00289
  • Ray, J. J. (1983). Reviving the problem of acquiescent response bias. The Journal of Social Psychology, 121(1), 81–96. https://doi.org/10.1080/00224545.1983.9924470
  • Risser, E., Wilmot, P., Barnes, C. (2017). Stable and controllable neural texture synthesis and style transfer using histogram losses. http://arxiv.org/abs/1701.08893
  • Ruder, M., Dosovitskiy, A., & Brox, T. (2016). Artistic style transfer for videos. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9796 LNCS, 26–36. https://doi.org/10.1007/978-3-319-45886-1_3
  • Ruder, S. (2016). An overview of gradient descent optimization algorithms. Arxiv, 1–14. https://doi.org/10.1111/j.0006-341X.1999.00591.x
  • Simonyan, K., Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition [Paper presenation]. 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, San Diego, CA, USA.
  • Sonderegger, A., & Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics, 41(3), 403–410. https://doi.org/10.1016/j.apergo.2009.09.002
  • Sridhar, S., & Sriram, S. (2013). Is online newspaper advertising cannibalizing print advertising? Quantitative Marketing and Economics, 13, 283–318. https://doi.org/10.2139/ssrn.2268112
  • Stephanidis, C., Salvendy, G., Antona, M., Chen, J. Y. C., Dong, J., Duffy, V. G., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., Guo, Y., Harris, D., Ioannou, A., Jeong, K-A (K.)., Konomi, S., Krömker, H., Kurosu, M., Lewis, J. R., Marcus, A., … Zhou, J. (2019). Seven HCI Grand Challenges. International Journal of Human–Computer Interaction, 35(14), 1229–1269. https://doi.org/10.1080/10447318.2019.1619259
  • Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.
  • Thurstone, L. L. (1927). A law of comparative judgement. Psychological Review, 34(4), 273–270. https://doi.org/10.1037/h0070288
  • Udsen, L. E., & Jørgensen, A. H. (2005). The aesthetic turn: Unravelling recent aesthetic approaches to human-computer interaction. Digital Creativity, 16(4), 205–216. https://doi.org/10.1080/14626260500476564
  • Ulyanov, D., Lebedev, V., Vedaldi, A., Lempitsky, V. (2016). Texture networks: Feed-forward synthesis of textures and stylized images. http://arxiv.org/abs/1603.03417
  • Ulyanov, D., Vedaldi, A., Lempitsky, V. (2017). Instance normalization: The missing ingredient for fast stylization. http://arxiv.org/abs/1607.08022
  • Vartanian, O., & Goel, V. (2004). The neural correlates of aesthetic preference for painting. Cognitive Neuroscience and Neurophysiology, 15(9), 893–897. https://doi.org/10.1097/01.wnr.00001
  • Vredenburg, K., Isensee, S., & Righi, C. (2002). User-centered design: An integrated approach. Prentice Hall PTR.
  • Vuong, J., Kaur, S., Heinrich, J., Ho, B. K., Hammang, C. J., Baldi, B. F., & O’Donoghue, S. I. (2018). Versus—A tool for evaluating visualizations and image quality using a 2AFC methodology. Visual Informatics, 2(4), 225–234. https://doi.org/10.1016/j.visinf.2018.12.003
  • Wang, E., Tan, N. (2018). Artistic style transfer. Digital Image Processing. https://web.stanford.edu/class/ee368/Project_Autumn_1617/Reports/report_wang_tan.pdf
  • Wiersema, D. V., van der Schalk, J., & van Kleef, G. A. (2012). Who’s afraid of red, yellow, and blue? Need for cognitive closure predicts aesthetic preferences. Psychology of Aesthetics, Creativity, and the Arts, 6(2), 168–174. https://doi.org/10.1037/a0025878
  • Yang, Q., & Ng, M. L. (2017). Paired comparison/directional difference test/2-alternative forced choice (2-AFC) test, simple difference test/same-different test. In Discrimination testing in sensory science (pp. 109–134). Elsevier.
  • Zhu, S., Fidler, S., Urtasun, R., Lin, D., & Change, C. (2017). Be your own Prada: Fashion synthesis with structural coherence. ArXiv, 1680–1688.