A comparison of visual scene and grid displays for people with chronic aphasia: a pilot study to improve communication using AAC

ABSTRACT

Background: People with aphasia are using technology-based augmentative and alternative communication (AAC) devices to support their communication. Typically, messages in AAC devices are organised using the following two interfaces: (a) grid displays that organise symbols into semantic categories (e.g., food) and (b) scene displays that organise photographs contextually. However, there is no published research comparing the influence of these displays across communicative outcome variables.

Aims: The purpose of this study was to explore the effect of a grid display and a scene display across several communicative variables (e.g., conversational turns) during conversational interactions with a communication partner (CP). Additionally, we investigated generalisation to an untrained second conversation in one of the two participants.

Methods & Procedures: Two experiments were conducted, and each included a different participant with chronic Broca’s aphasia. In Experiment 1, the participant watched an I Love Lucy episode and was trained to use the grid and scene displays for communicative purposes (e.g., formulating messages with the AAC device). After training, the participant engaged in conversations with a CP using either the grid display or the scene display. Experiment 2 followed the same procedures as Experiment 1; however, this participant watched a second I Love Lucy episode. She did not receive any grid display or scene display training for the second episode. The investigators examined (a) the total conversation time, (b) the number of conversational turns, instances of frustration, and navigational errors, (c) conceptual complexity of utterances, and (d) question response accuracy (measured as a percentage).

Results: Descriptive analyses revealed that the participants’ communicative outcomes were superior in the scene display conditions. Specifically, a greater number of conversational turns were taken with fewer instances of frustration and navigational errors. The utterances in the scene display conditions were longer and more complex than utterances in the grid display conditions. Probe question response accuracy was greater in the scene display condition in comparison with grid display condition.

Conclusion: The experiments represent a preliminary attempt to measure communicative competence in persons with aphasia (PWA) using different displays. The results suggest that scene displays facilitate a greater number of conversational turns for PWA than the grid displays. Additionally, utterance complexity was greater in the scene display condition. However, these results are limited to two individuals with aphasia, and systematic replication is warranted.

KEYWORDS:

• AAC
• scene displays
• grid displays
• graphic symbols
• photographs
• cognition

Summary

These experiments are a preliminary attempt to compare two interface displays in two PWA. The results suggest that the scene display better facilitated communication for these individuals. First, the participants had shorter, more efficient conversation times within the scene display condition (except for SG in Phase I). Second, a greater number of conversational turns and discourse units were used in the scene display conditions (except for SG in Phase I). Third, the participants’ probe question response accuracy was greater in the scene display conditions. Fourth, the participants formulated more conceptually complex utterances while using the scene displays. Finally, fewer frustration signals (FB only) and unsuccessful navigation attempts (FB and SG) were noted in the scene display conditions. The results suggest that the scene display’s interface design and photographic content may have required fewer cognitive resources to operate when compared with the grid display. Additionally, graphic symbols in the grid display may have multiple meanings, potentially making it more difficult to select and combine isolated graphic symbols compared to contextually rich photographs.

Disclosure statement

No potential conflict of interest was reported by the authors.