2,928
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Artificial intelligence and visual discourse: a multimodal critical discourse analysis of AI-generated images of “Dementia”

, &
Received 28 Nov 2023, Accepted 29 Nov 2023, Published online: 14 Dec 2023

References

  • Alzheimer Europe and European Working Group of People with Dementia. 2022. “Guidelines for the Ethical and Inclusive Communication about Portrayal of Dementia and People with Dementia. Accessed July 13, 2023. https://www.alzheimer-europe.org/sites/default/files/2023-01/Alzheimer%20Europe%20and%20European%20Working%20Group%20of%20People%20with%20Dementia%20Guidelines%20for%20the%20ethical%20and%20inclusive%20communication%20about%20portrayal%20of%20dementia%20and%20people%20with%20dementia.pdf.
  • Alzheimer’s Disease International. 2019. World Alzheimer Report 2019: Attitudes to Dementia. London: ADI.
  • Ang, Pei Soo, Siang Lee Yeo, and Leela Koran. 2023. “Advocating for a Dementia-Inclusive Visual Communication.” Dementia 22 (3): 628–645. https://doi.org/10.1177/14713012231155979.
  • Appel, Gil, Juliana Neelbauer, and David A. Schweidel. 2023. “Generative AI Has an Intellectual Property Problem.” Harvard Business Review. https://hbr.org/2023/04/generative-ai-has-an-intellectual-property-problem.
  • Aquilina, Carmelo, and Julian C. Hughes. 2006. “The Return of the Living Dead: Agency Lost and Found?” In Dementia: Mind, Meaning, and the Person, edited by Julian C. Hughes, Stephen Louw, and Steven R. Sabat, 143–161. Oxford: Oxford University Press.
  • Bailey, Annika, Tom Dening, and Kevin Harvey. 2021. “Battles and Breakthroughs: Representations of Dementia in the British Press.” Ageing and Society 41 (2): 362–376. https://doi.org/10.1017/S0144686X19001120.
  • Barazida, Nir. 2022. “Stable Diffusion: Best Open Source Version of DALL·E 2.” Medium. Towards Data Science (blog). August 30, 2022. https://towardsdatascience.com/stable-diffusion-best-open-source-version-of-dall-e-2-ebcdf1cb64bc.
  • Barthes, Roland. 1977. Image-Music-Text. New York, NY: Farrar, Straus and Giroux.
  • Bartlett, Ruth, and Deborah O’Connor. 2010. Broadening the Dementia Debate: Towards Social Citizenship. Bristol: Policy Press.
  • Beaulieu, Anne. 2000. The Space Inside the Skull : Digital Representations, Brain Mapping and Cognitive Neuroscience in the Decade of the Brain. Amsterdam: Department of Science and Technology, Dynamincs, University of Amsterdam. https://pure.uva.nl/ws/files/1079859/47879_UBA002000265_08.pdf.
  • Benbow, Susan M., and David Jolley. 2012. “Dementia: Stigma and its Effects.” Neurodegenerative Disease Management 2 (2): 165–172. https://doi.org/10.2217/nmt.12.7.
  • Bennett, Jill. 2023. “Visual Communication and Mental Health.” Visual Communication 22 (1): 46–70. https://doi.org/10.1177/14703572221130451.
  • Bianchi, Federico, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, and Aylin Caliskan. 2023. “Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale.” In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT ‘23), 1493–1504. New York, NY: Association for Computing Machinery. https://dl.acm.org/doi/10.1145/3593013.3594095.
  • Bould, Emma. 2018. Dementia-Friendly Media and Broadcast Guide: A Guide to Representing Dementia in the Arts, Culture and Popular Discourse. London: Alzheimer’s Society. https://www.alzheimers.org.uk/sites/default/files/2018-09/Dementia%20Friendly%20Media%20and%20Broadcast%20Guide.pdf.
  • Brookes, Gavin. 2023. “Killer, Thief or Companion? A Corpus-Based Study of Dementia Metaphors in UK Tabloids.” Metaphor and Symbol 38 (3): 213–230. https://doi.org/10.1080/10926488.2022.2142472.
  • Brookes, Gavin, Kevin Harvey, Neil Chadborn, and Tom Dening. 2018. “‘Our Biggest Killer’: Multimodal Discourse Representations of Dementia in the British Press.” Social Semiotics 28 (3): 371–395. https://doi.org/10.1080/10350330.2017.1345111.
  • Brookes, Gavin, Emma Putland, and Kevin Harvey. 2021. “Multimodality: Examining Visual Representations of Dementia in Public Health Discourse.” In Analysing Health Communication: Discourse Approaches, edited by Gavin Brookes, and Daniel Hunt, 241–269. London: Palgrave Macmillan.
  • Burr, Vivien. 2015. Social Constructionism. London: Taylor & Francis Group.
  • Cahill, Suzanne. 2018. Dementia and Human Rights. Bristol: Policy Press.
  • Caldwell, Elizabeth F., Sarah Falcus, and Katsura Sako. 2021. “Depicting Dementia: Representations of Cognitive Health and Illness in Ten Picturebooks for Children.” Children's Literature in Education 52 (1): 106–131. https://doi.org/10.1007/s10583-020-09405-w.
  • Castaño, Emilia. 2020. “Discourse Analysis as a Tool for Uncovering the Lived Experience of Dementia: Metaphor Framing and Well-Being in Early-Onset Dementia Narratives.” Discourse & Communication 14 (2): 115–132. https://doi.org/10.1177/1750481319890385.
  • Castaño, Emilia. 2022. “Blogging through Dementia: Reworking Mainstream Discourse through Metaphor in Online Early-Onset Dementia Narratives.” Dementia 22 (1): 105–124. https://doi.org/10.1177/14713012221136659.
  • Centre for Ageing Better. 2021. “Age-Positive Image Library Launched to Tackle Negative Stereotypes of Later Life.” Accessed July 18, 2023. https://www.ageing-better.org.uk/news/age-positive-image-library-launched.
  • Ciston, Sarah. 2019. “Intersectional AI is Essential: Polyvocal, Multimodal, Experimental Methods to Save Artificial Intelligence.” Journal of Science and Technology of the Arts 11 (2): 3–8. https://doi.org/10.7559/citarj.v11i2.665.
  • Clarke, Juanne. 2006. “The Case of the Missing Person: Alzheimer’s Disease in Mass Print Magazines 1991-2001.” Health Communication 19 (3): 269–276. https://doi.org/10.1207/s15327027hc1903_9.
  • Crawford, Kate, and Trevor Paglen. 2021. “Excavating AI: The Politics of Images in Machine Learning Training Sets.” AI & SOCIETY 36 (4): 1105–1116. https://doi.org/10.1007/s00146-021-01162-8.
  • Dumit, Joseph. 2004. Picturing Personhood: Brain Scans and Biomedical Identity. Oxford: Princeton University Press.
  • Elliott, Larry. 2023. “The AI Industrial Revolution Puts Middle-Class Workers under Threat this Time.” The Guardian. https://www.theguardian.com/technology/2023/feb/18/the-ai-industrial-revolution-puts-middle-classworkers-under-threat-this-time.
  • Entman, Robert M. 1993. “Framing: Toward Clarification of a Fractured Paradigm.” Journal of Communication 43 (4): 51–58. https://doi.org/10.1111/j.1460-2466.1993.tb01304.x.
  • Fairclough, Norman. 2015. Language and Power. 3rd ed. London: Routledge.
  • Farid, Hany. 2022. “Text-to-Image AI: Powerful, Easy-to-Use Technology for Making Art – and Fakes.” The Conversation, 2022. http://theconversation.com/text-to-image-ai-powerful-easy-to-use-technology-for-making-art-and-fakes-195517.
  • Fontana, Andrea, and Ronald Smith. 1989. “Alzheimer’s Disease Victims: The ‘Unbecoming’ of Self and the Normalization of Competence.” Sociological Perspectives 32 (1): 35–46. https://doi.org/10.2307/1389006.
  • Foucault, Michel. 1972. Archaeology of Knowledge. Translated by A. M. Sheridan Smith. London: Routledge.
  • Goffman, Erving. 1963. Stigma: Notes on the Management of Spoiled Identity. Hoboken, NJ: Prentice-Hall.
  • Gordijn, B. 1999. “The Troublesome Concept of the Person.” Theoretical Medicine and Bioethics 20 (4): 347–359. https://doi.org/10.1023/A:1009990632439.
  • Harvey, Kevin, and Gavin Brookes. 2019. “Looking through Dementia: What Do Commercial Stock Images Tell us about Aging and Cognitive Decline?” Qualitative Health Research 29 (7): 987–1003. https://doi.org/10.1177/1049732318814542.
  • Johnstone, Megan-Jane. 2013. “Metaphors, Stigma and the ‘Alzheimerization’ of the Euthanasia Debate.” Dementia 12 (4): 377–393. https://doi.org/10.1177/1471301211429168.
  • Kitwood, Tom M. 1997. Dementia Reconsidered: The Person Comes First. Buckingham: Open University Press.
  • Kontos, Pia, Karen-Lee Miller, and Alexis Kontos. 2017. “Relational Citizenship: Supporting Embodied Selfhood and Relationality in Dementia Care.” Sociology of Health & Illness 39 (2): 182–198. https://doi.org/10.1111/1467-9566.12453.
  • Kress, Gunther, and Theo Van Leeuwen. 2002. “Colour as a Semiotic Mode: Notes for a Grammar of Colour.” Visual Communication 1 (3): 343–368. https://doi.org/10.1177/147035720200100306.
  • Kress, Gunther, and Theo Van Leeuwen. 2020. Reading Images: The Grammar of Visual Design. 3rd ed. London: Routledge.
  • Lakoff, George, and Mark Turner. 2009. More than Cool Reason: A Field Guide to Poetic Metaphor. Chicago, IL: University of Chicago Press.
  • Latimer, Joanna. 2018. “Repelling Neoliberal World-Making? How the Ageing–Dementia Relation Is Reassembling the Social.” The Sociological Review 66 (4): 832–856. https://doi.org/10.1177/0038026118777422.
  • Lawless, Michael, Martha Augoustinos, and Amanda LeCouteur. 2018. “‘Your Brain Matters’: Issues of Risk and Responsibility in Online Dementia Prevention Information.” Qualitative Health Research 28 (10): 1539–1551. https://doi.org/10.1177/1049732317732962.
  • Leone, Carmela, Rachel Winterton, and Irene Blackberry. 2023. “Media Discourses on the Socio-Spatial Rights of Older People Living with Dementia and Their Carers.” Dementia 22 (1): 161–179. https://doi.org/10.1177/14713012221137961.
  • Lock, Margaret. 2013. The Alzheimer Conundrum: Entanglements of Dementia and Aging. Princeton, NJ: Princeton University Press.
  • Machin, David. 2004. “Building the World’s Visual Language: The Increasing Global Importance of Image Banks in Corporate Media.” Visual Communication 3 (3): 316–336. https://doi.org/10.1177/1470357204045785.
  • Machin, David. 2013. “What is Multimodal?” Critical Discourse Studies 10 (4): 347–355. https://doi.org/10.1080/17405904.2013.813770.
  • Machin, David. 2016. “The Need for a Social and Affordance-Driven Multimodal Critical Discourse Studies.” Discourse & Society 27 (3): 322–334. https://doi.org/10.1177/0957926516630903.
  • Machin, David, and Theo Van Leeuwen. 2007. Global Media Discourse: A Critical Introduction. Florence: Taylor & Francis Group.
  • McParland, Patricia, Fiona Kelly, and Anthea Innes. 2017. “Dichotomising Dementia: Is there Another Way?” Sociology of Health & Illness 39 (2): 258–269. https://doi.org/10.1111/1467-9566.12438.
  • Newton, Julianne H. 1998. “The Burden of Visual Truth: The Role of Photojournalism in Mediating Reality.” Visual Communication Quarterly 5 (4): 4–9. https://doi.org/10.1080/15551399809363390.
  • O’Connor, Deborah, Mariko Sakamoto, Kishore Seetharaman, Habib Chaudhury, and Alison Phinney. 2022. “Conceptualizing Citizenship in Dementia: A Scoping Review of the Literature.” Dementia 21 (7): 2310–2350. https://doi.org/10.1177/14713012221111014.
  • Orton, Laura. 2022. “Are Stereotypes, Such as the ‘Headclutcher’, in Stock Images for Mental Illness Stigmatizing?.” https://doi.org/10.21606/drs.2022.354.
  • Pickersgill, Martyn. 2013. “The Social Life of the Brain: Neuroscience in Society.” Current Sociology 61 (3): 322–340. https://doi.org/10.1177/0011392113476464.
  • Post, Stephen. 2000. “The Concept of Alzheimer Disease in a Hypercognitive Society.” In Concepts of Alzheimer Disease: Biological, Clinical, and Cultural Perspectives, edited by Peter Whitehouse, Konrad Maurer, and Jesse Ballenger, 245–255. Baltimore: Johns Hopkins University Press.
  • Putland, Emma. 2022a. Representing Dementia: A Qualitative Analysis of How People Affected by Dementia Situate Themselves in Relation to Different Dementia Discourses. Nottingham: University of Nottingham.
  • Putland, Emma. 2022b. “The (in)Accuracies of Floating Leaves: How People with Varying Experiences of Dementia Differently Position the Same Visual Metaphor.” Dementia 21 (5): 1471–1487. https://doi.org/10.1177/14713012211072507.
  • Sabat, Steven. 2014. “A Bio-Psycho-Social Approach to Dementia.” In Excellence in Dementia Care: Research into Practice, edited by Murna Downs, and Barbara Bowers, 107–121. New York, NY: Open University Press.
  • Sabat, Steven. 2018. Alzheimer’s Disease and Dementia: What Everyone Needs to Know. New York, NY: Oxford University Press.
  • Sandberg, Linn. 2015. “Towards a Happy Ending? Positive Ageing, Heteronormativity and Un/happy Intimacies.” lambda nordica 20 (4): 19–44.
  • Schuhmann, Christoph, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, and Theo Coombes. 2022. “LAION-5B: An Open Large-Scale Dataset for Training Next Generation Image-Text Models.” In Track on Datasets and Benchmarks, 1–50. New York, NY: Cornell University.
  • Semino, Elena. 2008. Metaphor in Discourse. Cambridge: University Press.
  • Shakespeare, Tom, Hannah Zeilig, and Peter Mittler. 2019. “Rights in Mind: Thinking Differently About Dementia and Disability.” Dementia 18 (3): 1075–1088. https://doi.org/10.1177/1471301217701506.
  • Somepalli, Gowthami, Vasu Singla, Micah Goldblum, Jonas Geiping, and Tom Goldstein. 2022. Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models. New York, NY: Computer Science: Machine Learning. Cornell University. http://arxiv.org/abs/2212.03860.
  • Stability AI. 2022. “Stable Diffusion Public Release.” Stability AI, 2022. https://stability.ai/blog/stable-diffusion-public-release.
  • Struppek, Lukas, Dominik Hintersdorf, and Kristian Kersting. 2022. The Biased Artist: Exploiting Cultural Biases via Homoglyphs in Text-Guided Image Generation Models. New York, NY: Computer Science: Machine Learning. Cornell University. http://arxiv.org/abs/2209.08891.
  • Swaffer, Kate. 2016. What the Hell Happened to my Brain? Living Beyond Dementia. London: Jessica Kingsley.
  • Thornton, David. 2011. Brain Culture: Neuroscience and Popular Media. Piscataway, New Jersey: Rutgers University Press.
  • Van Gorp, Baldwin, and Tom Vercruysse. 2012. “Frames and Counter-Frames Giving Meaning to Dementia: A Framing Analysis of Media content.” Social Science & Medicine 74 (8): 1274–1281. https://doi.org/10.1016/j.socscimed.2011.12.045.
  • Venkatesan, Sathyaraj, and Raghavi Kasthuri. 2018. “‘Magic and Laughter’: Graphic Medicine, Recasting Alzheimer Narratives and Dana Walrath’s Aliceheimer’s: Alzheimer’s Through the Looking Glass.” Concentric: Literary and Cultural Studies 44 (1): 61–84. https://doi.org/10.6240/concentric.lit.201803.44(1).0004.
  • Vidal, Fernando. 2009. “Brainhood, Anthropological Figure of Modernity.” History of the Human Sciences 22 (1): 5–36. https://doi.org/10.1177/0952695108099133.
  • World Health Organization. 2023. “Dementia, Fact Sheets.” Accessed October 7, 2023. https://www.who.int/news-room/fact-sheets/detail/dementia.
  • Zeilig, Hannah. 2014. “Dementia as a Cultural Metaphor.” The Gerontologist 54 (2): 258–267. https://doi.org/10.1093/geront/gns203.
  • Zimmermann, Martina. 2017. “Alzheimer’s Disease Metaphors as Mirror and Lens to the Stigma of Dementia.” Literature and Medicine 35 (1): 71–97. https://doi.org/10.1353/lm.2017.0003.