Feel the image: The role of emotions in the image-seeking process

References

• André, P., Cutrell, E., Tan, D. S., & Smith, G. (2009). Designing novel image search interfaces by understanding unique characteristics and usage. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5727 LNCS, 340–353. doi:10.1007/978-3-642-03658-3_40
   Google Scholar
• Arapakis, I., Jose, J. M., & Gray, P. D. G. (2008). Affective feedback: An investigation into the role of emotions in the information seeking process. Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 395–402. doi:10.1145/1390334.1390403
   Google Scholar
• Aurnhammer, M., Hanappe, P., & Steels, L. (2006). Integrating collaborative tagging and emergent semantics for image retrieval. Proceedings of the Collaborative Web Tagging Workshop (WWW’06), 1–5.
   Google Scholar
• Backs, R. W., Da Silva, S. P., & Han, K. (2005). A comparison of younger and older adults’ self-assessment manikin ratings of affective pictures. Experimental Aging Research, 31(4), 421–440. doi:10.1080/03610730500206808
   PubMed Web of Science ®Google Scholar
• Bates, M. (1989). The design of browsing and berrypicking techniques for the online search interface. Online Information Review, 13, 340–353.
   Google Scholar
• Beaudoin, J. (2008). A preliminary investigation of image indexing: The influence of domain knowledge, indexer experience and image characteristics. Proceedings of the 19thWorkshop of the American Society for Information Science and Technology Special Interest Group in Classification Research, Columbus, Ohio.
   Google Scholar
• Bianchi-Berthouze, N. (2002). Mining multimedia subjective feedback. Journal of Intelligent Information Systems, 19(1), 43–59. doi:10.1023/A:1015512403706
   Web of Science ®Google Scholar
• Bianchi-Berthouze, N., & Catarci, T. (2003). K-DIME: An affective image filtering system. IEEE Multimedia, 10(3), 103–106. doi:10.1109/MMUL.2003.1218262
   Web of Science ®Google Scholar
• Bianchi-Berthouze, N., & Lisetti, C. (2002). Modeling multimodal expression of user’s affective subjective experience. User Modeling and User-Adapted Interaction (Special Issue on User Modeling and Adaptation in Affective Computing), 12(1), 49–84. doi:10.1023/A:1013365332180
   Web of Science ®Google Scholar
• Bilal, D. (2000). Children’s use of the Yahooligans! web search engine: I. cognitive, physical, and affective behaviors on fact-based search tasks. Journal of the American Society for Information Science and Technology, 51(7), 646–665. doi:10.1002/(ISSN)1097-4571
   Web of Science ®Google Scholar
• Bilal, D., & Kirby, J. (2002). Differences and similarities in information seeking: Children and adults as web users. Information Processing & Management, 38(5), 649–670. doi:10.1016/S0306-4573(01)00057-7
   Web of Science ®Google Scholar
• Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59. doi:10.1016/0005-7916(94)90063-9
   PubMed Web of Science ®Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. doi:10.1191/1478088706qp063oa
   Google Scholar
• Brave, S., Nass, C., & Hutchinson, K. (2005). Computers that care: Investigating the effects of orientation of emotion exhibited by an embodied computer agent. International Journal of Human Computer Studies. doi:10.1016/j.ijhcs.2004.11.002
   Web of Science ®Google Scholar
• Carretié, L., Mercado, F., Tapia, M., & Hinojosa, J. A. (2001). Emotion, attention, and the “negativity bias”, studied through event-related potentials. International Journal of Psychophysiology, 41(1), 75–85. doi:10.1016/S0167-8760(00)00195-1
   PubMed Web of Science ®Google Scholar
• Chew, B., Rode, J. A., & Sellen, A. (2010). Understanding the everyday use of images on the web. Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries - NordiCHI, 10, 102. doi:10.1145/1868914.1868930
   Google Scholar
• Choi, Y. (2010). Effects of contextual factors on image searching on the web. Journal of the American Society for Information Science and Technology, 61(10), 2011–2028. doi:10.1002/asi.21386
   Web of Science ®Google Scholar
• Chung, E., & Yoon, J. (2011). Image needs in the context of image use: An exploratory study. Journal of Information Science, 37(2), 163–177. doi:10.1177/0165551511400951
   Web of Science ®Google Scholar
• Colby, B. N., Ortony, A., Clore, G. L., & Collins, A. (1989). The cognitive structure of emotions. Contemporary Sociology. doi:10.2307/2074241
   Web of Science ®Google Scholar
• Dellandréa, E., Liu, N., & Chen, L. (2010). Classification of affective semantics in images based on discrete and dimensional models of emotions. Proceedings - International Workshop on Content-Based Multimedia Indexing, 99–104. https://doi.org/10.1109/CBMI.2010.5529906
   Google Scholar
• Deng, L., & Poole, M. S. (2010). Affect in web interfaces: A study of the impacts of web page visual complexity and order. MIS Quarterly, 34(4), 711–A10.
   Web of Science ®Google Scholar
• Dutton, D. (2009). The Art Instinct: Beauty, Pleasure, and Human Evolution. (p. 278). New York, NY: Bloomsbury Press. https://doi.org/10.1111/j.1540-6245.2009.01363_1.x
   Google Scholar
• Evans, J. S. B. T. (2006). The heuristic-analytic theory of reasoning: Extension and evaluation. Psychonomic Bulletin & Review, 13(3), 378–395. doi:10.3758/BF03193858
   PubMed Web of Science ®Google Scholar
• Fontaine, J. R., Scherer, K. R., Roesch, E. B., & Ellsworth, P. (2007). The world of emotion is not two-dimensional. Psychological Science, 18(12), 1050–1057. doi:10.1111/j.1467-9280.2007.02024.x
   PubMed Web of Science ®Google Scholar
• Goodrum, A. A., Bejune, M. M., & Siochi, A. C. (2003). A state transition analysis of image search patterns on the web. In Image and video retrieval (pp. 281–290). eds Erwin M. BakkerMichael S. LewThomas S. HuangNicu SebeXiang Sean Zhou. Springer-Verlag, Berlin, Heidelberg, New York.
   Google Scholar
• Greisdorf, H., & O’Connor, B. (2002). Modelling what users see when they look at images: A cognitive viewpoint. Journal of Documentation, 58(1), 6–29. doi:10.1108/00220410210425386
   Web of Science ®Google Scholar
• Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23–34. doi:10.20982/tqmp.08.1.p023
   PubMedGoogle Scholar
• Hershey, J. C., & Baron, J. (1992). Judgment by outcomes: When is it justified? Organizational Behavior and Human Decision Processes, 53(1), 89–93. doi:10.1016/0749-5978(92)90056-D
   Web of Science ®Google Scholar
• Hollink, L., Schreiber, A. T., Wielinga, B. J., & Worring, M. (2004). Classification of user image descriptions. International Journal of Human Computer Studies, 61(5), 601–626. doi:10.1016/j.ijhcs.2004.03.002
   Web of Science ®Google Scholar
• Hudlicka, E. (2003). To feel or not to feel: The role of affect in human-computer interaction. International Journal of Human Computer Studies, 59(1–2), 1–32. doi:10.1016/S1071-5819(03)00047-8
   Web of Science ®Google Scholar
• James, L., & Nahl, D. (1996). Achieving focus, engagement, and acceptance: Three phases of adapting to internet use. Electronic Journal on Virtual Culture, 4(1), 276–286.
   Google Scholar
• Johnson-Laird, P. N., & Oatley, K. (1989). The language of emotions: An analysis of a semantic field. Cognition & Emotion, 3(2), 81–123. doi:10.1080/02699938908408075
   Google Scholar
• Jorgensen, C. (1995). Image attributes: An investigation. In iSchool information science and technology - dissertations.
   Google Scholar
• Jörgensen, C. (1998). Attributes of images in describing tasks. Information Processing & Management, 34(2–3), 161–174. doi:10.1016/S0306-4573(97)00077-0
   Web of Science ®Google Scholar
• Jörgensen, C. (2007). Image access, the semantic gap, and social tagging as a paradigm shift. In Advances in Classification Research Online, 18. doi:10.7152/acro.v18i1.12868
   Google Scholar
• Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131. doi:10.1126/science.185.4157.1124
   PubMed Web of Science ®Google Scholar
• Kalbach, J. (2006). “I’m feeling lucky”: The role of emotions in seeking information on the Web. Journal of the American Society for Information Science and Technology, 57, 813–818. doi:10.1002/(ISSN)1532-2890
   Web of Science ®Google Scholar
• Kleiman, Y., Lanir, J., Danon, D., Felberbaum, Y., & Cohen-Or, D. (2015). DynamicMaps: Similarity-based browsing through a massive set of images. Proceedings of the ACM CHI’15 Conference on Human Factors in Computing Systems, 1, 995–1004. doi:10.1145/2702123.2702224
   Google Scholar
• Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Education, 79. doi:10.2307/2288384
   Web of Science ®Google Scholar
• Layne, S. S. (1994). Some issues in the indexing of images. Journal of the American Society for Information Science, 45(8), 583–588. doi:10.1002/(SICI)1097-4571(199409)45:8<583::AID-ASI13>3.0.CO;2-N
   Web of Science ®Google Scholar
• Lee, S., & Koubek, R. J. (2011). The impact of cognitive style on user preference based on usability and aesthetics for computer-based systems. International Journal of Human-Computer Interaction, 27(11), 1083–1114. doi:10.1080/10447318.2011.555320
   Web of Science ®Google Scholar
• Lerner, J. S., & Keltner, D. (2000). Beyond valence: Toward a model of emotion-specific influences on judgement and choice. Cognition & Emotion, 14(4), 473–493. doi:10.1080/026999300402763
   Web of Science ®Google Scholar
• Loewenstein, G. F., & Lerner, J. (2003). The role of affect in decision making. Handbook of Affective Science. doi:10.1016/B978-0-444-62604-2.00003-4
   Google Scholar
• Lopatovska, I., & Arapakis, I. (2011). Theories, methods and current research on emotions in library and information science, information retrieval and human–computer interaction. Information Processing & Management, 47(4), 575–592. doi:10.1016/j.ipm.2010.09.001
   Web of Science ®Google Scholar
• Marchionini, G. (2006). Exploratory search: From finding to understanding. Communications of the ACM, 49(4), 41. doi:10.1145/1121949.1121979
   Web of Science ®Google Scholar
• Martino, B. D., Kumaran, D., Seymour, B., & Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science, 313.5787(August), 684–687. doi:10.1126/science.1128356
   Web of Science ®Google Scholar
• McCay‐Peet, L., & Toms, E. (2009). Image use within the work task model: Images as information and illustration. Journal of the American Society for Information Science and Technology, 60(12), 2416–2429. doi:10.1002/asi.21202
   Web of Science ®Google Scholar
• McKeown, G. J. (2013). The analogical peacock hypothesis: The sexual selection of mind-reading and relational cognition in human communication. Review of General Psychology, 17(3), 267–287. doi:10.1037/a0032631
   Web of Science ®Google Scholar
• Mellers, B., Schwartz, A., Ho, K., & Ritov, I. (1997). Decision affect theory: Emotional reactions to the outcomes of risky options. Psychological Science, 8(6), 423–429. doi:10.1111/j.1467-9280.1997.tb00455.x
   Web of Science ®Google Scholar
• Mellers, B., Schwartz, A., & Ritov, I. (1999). Emotion-based choice. Journal of Experimental Psychology: General, 128(3), 332–345. doi:10.1037/0096-3445.128.3.332
   Web of Science ®Google Scholar
• Metzger, M. J., & Flanagin, A. J. (2013). Credibility and trust of information in online environments: The use of cognitive heuristics. Journal of Pragmatics, 59, 210–220. doi:10.1016/j.pragma.2013.07.012
   Web of Science ®Google Scholar
• Moshfeghi, Y., & Jose, J. (2013). On cognition, emotion, and interaction aspects of search tasks with different search intentions. Proceedings of the 22nd International Conference on World Wide Web, 931–941. doi:10.1145/2488388.2488469
   Google Scholar
• Nahl, D., & Bilal, D. (2007). Information and emotion: The emergent affective paradigm in information behavior research and theory. Medford, New Jersey, NJ: Information Today, Inc.
   Google Scholar
• Nahl, D., & Tenopir, C. (1996). Affective and cognitive searching behavior of novice end-users of a full-text database. Journal of the American Society for Information Science, 47(4), 276–286. doi:10.1002/(SICI)1097-4571(199604)47:4<276::AID-ASI3>3.0.CO;2-U
   Google Scholar
• Picard, R. W. (1995). Affective computing. Pattern Recognition, 20(321), 304. doi:10.1007/BF01238028
   Google Scholar
• Picard, R. W. (2003). Affective computing: Challenges. International Journal of Human Computer Studies, 59(1–2), 55–64. doi:10.1016/S1071-5819(03)00052-1
   Web of Science ®Google Scholar
• Picard, R. W., & Klein, J. (2002). Computers that recognise and respond to user emotion: Theoretical and practical implications. Interacting with Computers, 14(2), 141–169. doi:10.1016/S0953-5438(01)00055-8
   Web of Science ®Google Scholar
• Plutchik, R. (1980). A general psychoevolutionary theory of emotion. Theories of Emotion, 1, 3–31. New York, NY: Academic Press.
   Google Scholar
• Rogers, P. (1998). The cognitive psychology of lottery gambling: A theoretical review. Journal of Gambling Studies, 14(2), 111–134. doi:10.1023/A:1023042708217
   PubMedGoogle Scholar
• Rorissa, A. (2008). User-generated descriptions of individual images versus labels of groups of images: A comparison using basic level theory. Information Processing and Management, 44(5), 1741–1753. doi:10.1016/j.ipm.2008.03.004
   Web of Science ®Google Scholar
• Rorissa, A., & Hastings, S. K. (2004). Free sorting of images: Attributes used for categorization. Proceedings of the ASIST Annual Meeting, 41, 360–366. doi:10.1002/meet.1450410142
   Google Scholar
• Russell, J. A. (2003). Core affect and the psychological construction of emotion. Psychological Review, 110(1), 145–172. doi:10.1037/0033-295X.110.1.145
   PubMed Web of Science ®Google Scholar
• Santini, S., Gupta, A., & Jain, R. (2001). Emergent semantics through interaction in image databases. IEEE Transactions on Knowledge and Data Engineering, 13(3), 337–351. doi:10.1109/69.929893
   Web of Science ®Google Scholar
• Savakis, A. E., Etz, S. P., & Loui, A. C. (2000). Evaluation of image appeal in consumer photography. Electronic Imaging, 3959, 111–120. doi:10.1117/12.387147
   Google Scholar
• Schachter, S., & Singer, J. E. (1962). Cognitive, social, and psychological determinants of emotional state. Psychological Review, 69(5), 379. doi:10.1037/h0046234
   PubMed Web of Science ®Google Scholar
• Scherer, K., Schorr, A., & Johnstone, T. (2001). Appraisal processes in emotion: Theory, methods, research (Vol. 60). Newyork, NY: Oxford University Press. doi:10.1002/asi
   Google Scholar
• Schmidt, S., & Stock, W. G. (2009). Collective indexing of emotions in images. A study in emotional information retrieval. Journal of the American Society for Information Science and Technology, 60(5), 863–876. doi:10.1002/asi.21043
   Web of Science ®Google Scholar
• Shatford, S. (1986). Analyzing the subject of a picture: A theoretical approach. Cataloging & Classification Quarterly, 6(3), 39–62. doi:10.1300/J104v06n03_04
   Google Scholar
• Shibata, T., & Kato, T. (1999). “Kansei” image retrieval system for street landscape-discrimination and graphical parameters based on correlation of two images. Systems, Man, and Cybernetics, 1999. IEEE SMC’99 Conference Proceedings. 1999 IEEE International Conference On, 6, 247–252.
   Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420. doi:10.1037/0033-2909.86.2.420
   PubMed Web of Science ®Google Scholar
• Siersdorfer, S., Hare, J., Minack, E., & Deng, F. (2010). Analyzing and predicting sentiment of images on the social web. Proceedings of the 18th ACM International Conference on Multimedia, 715–718. doi:10.1145/1873951.1874060
   Google Scholar
• Sperber, D., & Wilson, D. (1986). Relevance. Oxford, Blackwell.
   Google Scholar
• Teevan, J., & Alvarado, C. (2004). The perfect search engine is not enough: A study of orienteering behavior in directed search. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 6(1), 415–422.
   Google Scholar
• Tenopir, C., Wang, P., Zhang, Y., Simmons, B., & Pollard, R. (2008). Academic users’ interactions with science direct in search tasks: Affective and cognitive behaviors. Information Processing & Management, 44(1), 105–121. doi:10.1016/j.ipm.2006.10.007
   Web of Science ®Google Scholar
• Tomaszczyk, J. C., Fernandes, M. A., & MacLeod, C. M. (2008). Personal relevance modulates the positivity bias in recall of emotional pictures in older adults. Psychonomic Bulletin & Review, 15(1), 191–196. doi:10.3758/PBR.15.1.191
   PubMed Web of Science ®Google Scholar
• Tractinsky, N. (2004). Tools over solutions? comments on interacting with computers special issue on affective computing. Interacting with Computers, 16, 751–757. doi:10.1016/j.intcom.2004.06.003
   Web of Science ®Google Scholar
• Tractinsky, N., Katz, A. S., & Ikar, D. (2000). What is beautiful is usable. Interacting with Computers, 13(2), 127–145. doi:10.1016/S0953-5438(00)00031-X
   Web of Science ®Google Scholar
• Uhrig, M. K., Trautmann, N., Baumgärtner, U., Treede, R.-D., Henrich, F., Hiller, W., & Marschall, S. (2016). Emotion elicitation: A comparison of pictures and films. Frontiers in Psychology, 7, 180. doi:10.3389/fpsyg.2016.00180
   PubMed Web of Science ®Google Scholar
• van Hooff, J. C., Devue, C., Vieweg, P. E., & Theeuwes, J. (2013). Disgust- and not fear-evoking images hold our attention. Acta Psychologica, 143(1), 1–6. doi:10.1016/j.actpsy.2013.02.001
   PubMed Web of Science ®Google Scholar
• Wang, P., Hawk, W. B., & Tenopir, C. (2000). Users’ interaction with World Wide Web resources: An exploratory study using a holistic approach. Information Processing & Management, 36(2), 229–251. doi:10.1016/S0306-4573(99)00059-X
   Web of Science ®Google Scholar
• Wang, S., Chen, E., Wang, S., & Wang, X. (2003). A Kansei image retrieval based on emotion model. Journal of Circuits and Systems, 6, 10.
   Google Scholar
• Wang, S., & Wang, X. (2005). Emotion semantics image retrieval: An brief overview. In Affective computing and intelligent interaction (pp. 490–497). eds Jianhua TaoTieniu TanRosalind W. Picard. Springer-Verlag, Berlin, Heidelberg, New York.
   Google Scholar
• Westman, S., Lustila, A., & Oittinen, P. (2008). Search strategies in multimodal image retrieval. Proceedings of the Second International Symposium on Information Interaction in Context, 13. doi:10.1145/1414694.1414700
   Google Scholar
• Yee, K. P., Swearingen, K., Li, K., & Hearst, M. (2003). Faceted metadata for image search and browsing. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03), 401–408. doi:10.1145/642679.642681
   Google Scholar
• Zhao, S., Gao, Y., Jiang, X., Yao, H., Chua, T., & Sun, X. (2014). Exploring principles-of-art features for image emotion recognition. In Proceedings of the ACM international conference on multimedia, MM’14 (pp. 47–56). eds Hongjiang Zhang, Tat-Seng Chua, Ralf Steinmetz, Mohan Kankanhalli, Lynn Wilcox, New York, NY, USA: ACM Press. doi:10.1145/2647868.2654930
   Google Scholar