43
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Exploring the use of co-speech hand gestures as treatment outcome measures for aphasia

ORCID Icon &
Received 08 Oct 2023, Accepted 13 May 2024, Published online: 26 May 2024

References

  • Akhavan, N., Göksun, T., and Nozari, N. (2018). Integrity and function of gestures in aphasia. Aphasiology, 32(11), 1310–1335. https://doi.org/10.1080/02687038.2017.1396573
  • Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44, 169–188. https://doi.org/10.1006/jmla.2000.2752
  • Barnes, S., & Bloch, S. (2018). Why is measuring communication difficult? A critical review of current speech pathology concepts and measures. Clinical Linguistics & Phonetics, 33(3), 219–236. https://doi.org/10.1080/02699206.2018.1498541
  • Behrmann, M., & Penn, C. (1984). Non-verbal communication of aphasic patients. The British Journal of Disorders of Communication, 19(2), 155–168. https://doi.org/10.3109/13682828409007186
  • Boyle, E. A., Anderson, A. H., & Newlands, A. (1994). The effects of visibility on dialogue and performance in a cooperative problem-solving task. Language and Speech, 37(1), 1–20.
  • Bryant, L., Ferguson, A., & Spencer, E. (2016). Linguistic analysis of discourse in aphasia: A review of the literature. Clinical Linguistics & Phonetics, 30(7), 489–518. https://doi.org/10.3109/02699206.2016.1145740
  • Campisi, E., & Özyürek, A. (2013). Iconicity as a communicative strategy: Recipient design in multimodal demonstrations for adults and children. Journal of Pragmatics, 47(1), 14–27. https://doi.org/10.1016/j.pragma.2012.12.007
  • Carlomagno, S., & Cristilli, C. (2006). Semantic attributes of iconic gestures in fluent and non-fluent aphasic adults. Brain and Language, 99(1–2), 102–103. https://doi.org/10.1016/j.bandl.2006.06.061
  • Cassell, J., McNeill, D., & McCullough, K. E. (1999). Speech–gesture mismatches: Evidence for one underlying representation of linguistic and non-linguistic information. Pragmatics & Cognition, 7(1), 1–34. https://doi.org/10.1075/pc.7.1.03cas
  • Church, R. B., & Goldin-Meadow, S. (1986). The mismatch between gesture and speech as an index of transitional knowledge. Cognition, 23(1), 43–71. https://doi.org/10.1016/0010-0277(86)90053-3
  • Clark, H. (1996). Using Language. Cambridge University Press.
  • Clough, S., & Duff, M. C. (2020). The role of gesture in communication and cognition: Implications for understanding and treating neurogenic communication disorders. Frontiers in Human Neuroscience, 14, (323). https://doi.org/10.3389/fnhum.2020.00323
  • Cocks, N., Dipper, L., Pritchard, M., & Morgan, G. (2013). The impact of impaired semantic knowledge on spontaneous iconic gesture production. Aphasiology, 27(9), 1050–1069. https://doi.org/10.1080/02687038.2013.770816
  • Cook, S. W., Yip, T. K., & Goldin-Meadow, S. (2012). Gestures, but not meaningless movements, lighten working memory load when explaining math. Language and Cognitive Processes, 27(4), 594–610. https://doi.org/10.1080/01690965.2011.567074
  • Damico, J., Tetnowski, J., Lynch, K., Hartwell, J., Weill, C., Heels, J., & Simmons-Mackie, N. (2015). Facilitating authentic conversation: an intervention employing principles of constructivism and conversation analysis. Aphasiology, 29(3), 400–421, https://doi.org/10.1080/02687038.2014.945388
  • Dargue, N., & Sweller, N. (2018). Not all gestures are created equal: The effects of typical and atypical iconic gestures on narrative comprehension. Journal of Nonverbal Behavior, 42(3), 327–345. https://doi.org/10.1007/s10919-018-0278-3
  • de Beer, C., Carragher, M., van Nispen, K., Hogrefe, K., de Ruiter, J.P., & Rose, M.L. (2017). How much information do people with aphasia convey via gesture? American Journal of Speech-Language Pathology, 26(2), 483–497. https://doi.org/10.1044/2016_AJSLP-15-0027
  • de Beer, C., de Ruiter, J.P., Hielscher-Fastabend, M., & Hogrefe, K. (2019). The production of gesture and speech by people with aphasia: Influence of communicative constraints. Journal of Speech, Language, and Hearing Research, 62(12), 4417–4432. https://doi.org/10.1044/2019_JSLHR-L-19-0020
  • Debreslioska, S., & Gullberg, M. (2020). The semantic content of gestures varies with definiteness, information status and clause structure. Journal of Pragmatics, 168, 36–52. https://doi.org/10.1016/j.pragma.2020.06.005
  • DeDe, G & Hoover, E.L. (2021). Measuring treatment change at the discourse level for people with mild and severe aphasia. Topics in Language Disorders, 41(1), 5–26. DOI: https://doi.org/10.1097/TLD.0000.0000.0000.0243
  • DeDe, G., Hoover, E., & Maas, E. (2019). Two to tango or the more the merrier? A randomized controlled trial of the effects of group size in aphasia conversation treatment on standardized tests. Journal of Speech, Language, and Hearing Research, 62(5), 1437–1451. https://doi.org/10.1044/2019-JSLHR-L-18-0404
  • de Ruiter, J. P. (2006). Can gesticulation help aphasic people speak, or rather, communicate? Advances in Speech Language Pathology, 8(2), 124–127. https://doi.org/10.1080/14417040600667285
  • Devanga, S. R. (2020). Collaborative referencing intervention: Replicating a mixed methods treatment study of aphasia. Poster presentation at the International Aphasia Rehabilitation Conference (IARC) at Van Couver, Canada, June 18–20, 2020 [ Note: Conference was cancelled due to COVID-19].
  • Devanga, S. R., Sherrill, M., & Hengst, J. A. (2021). The efficacy of collaborative referencing intervention in chronic aphasia: A mixed-methods study. American Journal of Speech-Language Pathology, 30(1S), 407–424, https://doi.org/10.1044/2020_AJSLP-19-00108
  • Devanga, S. R., Wilgenhof, R., & Mathew, M. (2022). Collaborative referencing using hand gestures in Wernicke’s aphasia: Discourse analysis of a case study. Aphasiology, 36(9), 1072–1095, https://doi.org/10.1080/02687038.2021.1937919
  • Dietz, A., & Boyle, M. (2018). Discourse measurement in aphasia research: Have we reached the tipping point? Aphasiology, 32(4), 459–464. https://doi.org/10.1080/02687038.2017.1398803
  • Dipper, L., Pritchard, M., Morgan, G., & Cocks, N. (2015). The language-gesture connection: Evidence from aphasia. Clinical Linguistics & Phonetics, 29(8–10), 748–763. https://doi.org/10.3109/02699206.2015.1036462
  • Doedens, W., Bose, A., Lambert, L., & Meteyard, L. (2021). Face-to-face communication in aphasia: The influence of conversation partner familiarity on a collaborative communication Task. Frontiers in Communication, 6, 574051. https://www.frontiersin.org/article/10.3389/fcomm.2021.574051
  • Doedens, W. J., & Meteyard, L. (2022). What is functional communication? A theoretical framework for real-world communication applied to aphasia rehabilitation. Neuropsychology review, 32(4), 937–973. https://doi.org/10.1007/s11065-021-09531-2
  • Elman, R. (2007). The importance of aphasia group treatment for rebuilding community and health. Topics in Language Disorders, 27, 300–308. https://doi.org/10.1097/01.TLD.0000299884.31864.99
  • Feyereisen, P. (1983). Manual activity during speaking in aphasic subjects. International Journal of Psychology, 18(6), 545–556. https://doi.org/10.1080/00207598308247500
  • Feyereisen, P., & de Lannoy, J. D. (1991). Gestures and speech: psychological investigations. Cambridge University Press.
  • Feyereisen, P., & Havard, I. (1999). Mental imagery and production of hand gestures while speaking in younger and older adults. Journal of Nonverbal Behavior, 23(2), 153–171. https://doi.org/10.1023/A:1021487510204
  • Galati, A., & Brennan, S. E. (2014). Speakers adapt gestures to addressees’ knowledge: implications for models of co-speech gesture. Language Cognition and Neuroscience, 29(4), 435–451. https://doi.org/10.1080/01690965.2013.796397
  • Gerwing, J., & Bavelas, J. (2004). Linguistic influences on gesture’s form. Gesture, 4(2), 157–195. https://doi.org/10.1075/gest.4.2.04ger
  • Goldin‐Meadow, S., Nusbaum, H. C., Kelly, S. D., & Wagner, S. M. (2001). Explaining Math: Gesturing lightens the load. Psychological Science, 12(6), 516–522. https://doi.org/10.1111/1467-9280.00395
  • Goldin-Meadow, S., & Alibali, M. W. (2013). Gesture’s role in learning and development. In P. D. Zelazo (Ed.), The oxford handbook of developmental psychology (Vol. 1): Body and mind (pp. 953–973). Oxford University Press.
  • Gullberg, M., & Holmqvist, K. (1999). Keeping an eye on gestures: Visual perception of gestures in face-to-face communication. Pragmatics & Cognition, 7(1), 35–63. https://doi.org/10.1075/pc.7.1.04gul
  • Gunter, T. C., Weinbrenner, J. E. D., & Holle, H. (2015). Inconsistent use of gesture space during abstract pointing impairs language comprehension. Frontiers in Psychology, 6, Article 80. https://doi.org/10.3389/fpsyg.2015.00080
  • Gurland, G. B., Chwat, S. E., & Gerber Wollner, S. (1982). Establishing a communication profile in adult aphasia: Analysis of communicative acts and conversational sequences. In Clinical Aphasiology: Proceedings of the Conference, 18–27. BRK Publishers.
  • Hengst, J. A. (2001). Collaborating on reference: a study of discourse and aphasia. [ Unpublished doctoral dissertation]. University of Illinois Urbana–Champaign. https://guides.library.illinois.edu/ideals
  • Hengst, J. A., Duff, M. C, & Prior, P. A. (2008). Multiple voices in clinical discourse and as clinical intervention. International Journal of Language & Communication Disorders, 43(Sup1), 58–68. https://doi.org/10.1080/13682820701698093
  • Herbert, R., Hickin, J., Howard, D., Osborne, F., & Best, W. (2008). Do picture‐naming tests provide a valid assessment of lexical retrieval in conversation in aphasia?, Aphasiology, 22(2), 184–203, https://doi.org/10.1080/02687030701262613
  • Hersh, D., Worrall, L.E., Howe, T., Sherratt, S., & Davidson, B. (2012). SMARTER goal setting in aphasia rehabilitation. Aphasiology, 26(2), 220–233. https://doi.org/10.1080/02687038.2011.640392
  • Hilliard, C., & Cook, S. W. (2016). Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology. Learning, Memory, and Cognition, 42(1), 91–103. https://doi.org/10.1037/xlm0000154
  • Hillis, A. E. (2007). Aphasia: Progress in the last quarter of a century. Neurology, 69(2), 200–213. https://doi.org/10.1212/01.wnl.0000265600.69385.6f
  • Hoetjes, M., Koolen, R., Goudbeek, M., Krahmer, E., & Swerts, M. (2015). Reduction in gesture during the production of repeated references. Journal of Memory and Language, 79–80, 1–17. https://doi.org/10.1016/j.jml.2014.10.004
  • Hogrefe K., Ziegler W., Weidinger N., Goldenberg G. (2012). Non-verbal communication in severe aphasia: Influence of aphasia, apraxia, or semantic processing? Cortex, 48(8), 952–962. https://doi.org/10.1016/j.cortex.2011.02.022
  • Holland, A.L. (1977). Some practical considerations in aphasia rehabilitation. In M.Sullivan & M. Kommers (Eds.), Rationale for adult aphasia therapy. University of Nebraska Medical Center
  • Holler, J. (2010). Speakers’ use of interactive gestures to mark common ground. In S. Kopp, & I. Wachsmuth (Eds.). Gesture in embodied communication and human-computer interaction. 8th International Gesture Workshop, Bielefeld, Germany, 2009; Selected Revised Papers (pp. 11–22). Springer Verlag.
  • Holler, J., & Bavelas, J. (2017). Multi-modal communication of common ground: A review of social functions. In R. B. Church, M. W. Alibali, & S. D. Kelly (Eds.), Why gesture?: How the hands function in speaking, thinking and communicating (pp. 213–240). John Benjamins Publishing Company. https://doi.org/10.1075/gs.7.11hol
  • Hoover, E. L., Caplan, D., Waters, G., & Budson, A. (2015). Effects of impairment-based individual and socially oriented group therapies on verb production in aphasia. Aphasiology, 29(7), 781–798. https://doi.org/10.1080/02687038.2014.989953
  • Hoover, E. L., DeDe, G., & Maas, E. (2021). A randomized controlled trial of the effects of group conversation treatment on monologic discourse in aphasia. Journal of Speech, Language, and Hearing Research, 64(12), 4861–4875. https://doi.org/10.1044/2021_JSLHR-21-00023
  • Horton, W.S., & Gerrig, R.J. (2005). The impact of memory demands on audience design during language production. Cognition, 96(2), 127–142. https://doi.org/10.1016/j.cognition.2004.07.001
  • Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297–315. https://doi.org/10.1037/a0022128
  • Hostetter, A. B., & Alibali, M. W. (2007). Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production. Gesture, 7(1), 73–95. https://doi.org/10.1075/gest.7.1.05hos
  • Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495–514. https://doi.org/10.3758/pbr.15.3.495
  • Kagan, A., Simmons-Mackie, N., Rowland, A., Huijbregts, M.P., Shumway, E., McEwen, S.E., Threats, T., & Sharp, S. (2008). Counting what counts: A framework for capturing real‐life outcomes of aphasia intervention. Aphasiology, 22(3), 258–280. https://doi.org/10.1080/02687030701282595
  • Kendon, A. (1982). The study of gesture: some observations on its history. Recherches Semiotique/Semiotic Inquiry, 2(1) 25–62.
  • Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press.
  • Kintz, S., & Wright, H. H. (2018). Discourse measurement in aphasia research. Aphasiology, 32(4), 472–474. https://doi.org/10.1080/02687038.2017.1398807
  • Kisa, Y. D., Goldin-Meadow, S., & Casasanto, D. (2022). Do gestures really facilitate speech production? Journal of Experimental Psychology, 151(6), 1252–1271. https://doi.org/10.1037/xge0001135
  • Kistner, J., Dipper, L. T., & Marshall, J. (2020). The use and function of gestures in word-finding difficulties in aphasia. Aphasiology, 33(11), 1372–1392. https://doi.org/10.1080/02687038.2018.1541343
  • Kita, S., Alibali, M. W., & Chu, M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological review, 124(3), 245–266. https://doi.org/10.1037/rev0000059
  • Kong, A. P.H., Law, S.P., & Chak, G. W. C. (2017). A comparison of coverbal gesture use in oral discourse among speakers with fluent and nonfluent aphasia. Journal of Speech, Language, and Hearing Research, 60(7), 2031–2046. https://doi.org/10.1044/2017_JSLHR-L-16-0093
  • Kong, A. P. H., Law, S. P., Wat, W. K. C., & Lai, C. (2015). Co-verbal gestures among speakers with aphasia: Influence of aphasia severity, linguistic and semantic skills, and hemiplegia on gesture employment in oral discourse. Journal of Communication Disorders, 56, 88–102. https://doi.org/10.1016/j.jcomdis.2015.06.007
  • Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15, 155–163.
  • Krauss, R. M. (1998). Why do we gesture when we speak? Current Directions in Psychological Science, 7(2), 54–60. https://doi.org/10.1111/1467-8721.ep13175642
  • Krauss, R.M., Chen, Y., & Gottesman, R. (2000). Lexical gestures and lexical access: a process model. In D. McNeill (Ed.), Language and gesture: window into thought and action. Cambridge University Press.
  • Kroenke, K. M., Kraft, I., Regenbrecht, F., & Obrig, H. (2013). Lexical learning in mild aphasia: Gesture benefit depends on patholinguistic profile and lesion pattern. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior, 49(10), 2637–2649. https://doi.org/10.1016/j.cortex.2013.07.012
  • Lanyon, L., and Rose, M. L. (2009). Do the hands have it? The facilitation effects of arm and hand gesture on word retrieval in aphasia. Aphasiology, 23(7–8), 809–822. https://doi.org/10.1080/02687030802642044
  • Leaman, M. C., & Edmonds, L. A. (2019). Revisiting the correct information unit: Measuring informativeness in unstructured conversations in people with aphasia. American Journal of Speech-Language Pathology, 28(3), 1099–1114. https://doi.org/10.1044/2023_AJSLP-22-00279
  • Leaman, M. C., & Edmonds, L. A. (2023). Analyzing language in the picnic scene picture and in conversation: The type of discourse sample we choose influences findings in people with aphasia. American Journal of Speech-Language Pathology, 32(4), 1413–1430, https://doi.org/10.1044/2023_AJSLP-22-00279.
  • Linebaugh, C. W., Person Margulies, C., & Mackisack, E. L. (1985). Contingent queries and revisions used by aphasic individuals and their most frequent communication partners. [Clinical Aphasiology Paper], 229–236. http://aphasiology.pitt.edu/id/eprint/858
  • Lott, P. (1999). Gesture and Aphasia. berlin: Peter Lang
  • Lubinski, R., Duchan, J., & Weitzner-Lin, B. (1980). Analysis of breakdowns and repairs in aphasic adult communication. In Clinical aphasiology: proceedings of the conference 1980 (pp. 111–116). BRK Publishers.
  • McNeill, D. (1985). So you think gestures are nonverbal? Psychological Review, 92(3), 350–371. https://doi.org/10.1037/0033-295X.92.3.350
  • McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.
  • McNeill, D. (2005). Gesture and thought. University of Chicago Press. https://doi.org/10.7208/chicago/9780226514642.001.0001
  • McNeill, D., & Levy, E. (1982). Conceptual representations in language activity and gesture. In R. Jarvella & W. Klein (Eds.). Speech, place, and action: Studies in deixis and related topics (pp. 271–295). Wiley.
  • Nicholas, L. E., & Brookshire, R. H. (1993). A system for quantifying the informativeness and efficiency of the connected speech of adults with aphasia. Journal of Speech, Language, and Hearing Research, 36(2), 338–350. https://doi.org/10.1044/jshr.3602.338.
  • Pritchard, M., Hilari, K., Cocks, N., & Dipper, L. (2017). Reviewing the quality of discourse information measures in aphasia. International Journal of Language & Communication Disorders, 52(6), 689–732. https://doi.org/10.1111/1460-6984.12318
  • Rochon, E., Saffran, E. M., Berndt, R. S., & Schwartz, M. F. (2000). Quantitative analysis of aphasic sentence production: Further development and new data. Brain and Language, 72(3), 193–218. https://doi.org/10.1006/brln.1999.2285
  • Rose, M. L., Mok, Z., & Sekine, K. (2017). Communicative effectiveness of pantomime gesture in people with aphasia. International Journal of language & Communication Disorders, 52(2), 227–237. https://doi.org/10.1111/1460-6984.12268
  • Sekine, K., & Rose, M. L. (2013). The relationship of aphasia type and gesture production in people with aphasia. American Journal of Speech-Language Pathology, 22(4), 662–672. https://doi.org/10.1044/1058-0360(2013/12-0030)
  • Sekine, K., Rose, M. L., Foster, A. M., Attard, M. C. & Lanyon, L. E. (2013). Gesture production patterns in aphasic discourse: In-depth description and preliminary predictions. Aphasiology, 27(9), 1031–1049. https://doi.org/10.1080/02687038.2013.803017
  • Shattuck-Hufnagel, S., & Ren, A. (2018). The prosodic characteristics of non-referential co-speech gestures in a sample of academic-lecture-style speech. Frontiers in Psychology, 9, 1514. https://doi.org/10.3389/fpsyg.2018.01514
  • Shulman, K. I., Shedletsky, R., & Silver, I. L. (1986). The challenge of time: Clock-drawing and cognitive function in the elderly. International Journal of Geriatric Psychiatry,1(2), 135–140. https://doi.org/10.1002/gps.930010209
  • Simmons-Mackie, N., Savage, M. C., & Worrall, L. (2014). Conversation therapy for aphasia: A qualitative review of the literature. International Journal of Language & Communication Disorders, 49(5), 511–526. https://doi.org/10.1111/1460-6984. 12097
  • Smith, W. G., & Kam, C. L. H. (2015). Children’s use of gesture in ambiguous pronoun interpretation. Journal of Child Language, 42(3), 591–617. https://doi.org/10.1017/S0305000915000045
  • Stark, B. C., Clough, S., & Duff, M. (2021). Suggestions for improving the investigation of gesture in aphasia. Journal of Speech, Language, and Hearing Research, 64(10), 4004–4013. https://doi.org/10.1044/2021_JSLHR-21-00125
  • Sweller, N., Choi, A. J., & Austin, E. (2024). Gesture production at encoding supports narrative recall. Psychological Research, 88(2), 535–546. https://doi.org/10.1007/s00426-023-01886-w
  • Taylor, L. B. (1998). Scoring criteria for the Rey–Osterrieth complex figure test. In O. Spreen & E. Strauss (Eds.), A compendium of neuropsychological tests: Administration, norms, and commentary (pp. 350–351). Oxford University Press.
  • van Nispen, K., van de Sandt-Koenderman, M., Sekine, K., Krahmer, E., & Rose, M. L. (2017). Part of the message comes in gesture: How people with aphasia convey information in different gesture types as compared with information in their speech. Aphasiology, 31(9), 1078–1103. https://doi.org/10.1080/02687038.2017.1301368
  • Worrall, L., Sherratt, S., Rogers, P., Howe, T., Hersh, D., Ferguson, A., & Davidson, B. (2011). What people with aphasia want: Their goals according to the ICF. Aphasiology, 25(3), 309–322. https://doi.org/10.1080/02687038.2010.508530
  • Zwaan, R. A. (2016). Situation models, mental simulations, and abstract concepts in discourse comprehension. Psychonomic Bulletin & Review, 23(4), 1028–1034. https://doi.org/10.3758/s13423-015-0864-x

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.