2,349
Views
14
CrossRef citations to date
0
Altmetric
Articles

Emergent analysis and dissemination within participatory research

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 287-302 | Received 24 Jun 2019, Accepted 24 Mar 2020, Published online: 04 Jun 2020

ABSTRACT

Authentic participation involving jointly undertaken analysis of data and dissemination of findings is rarely evident in participatory research involving disabled people. This paper examines analysis and dissemination which offers greater participation, providing a theoretical underpinning for this approach. This conceptualization arises from ARCHES, a museum education and access research project involving over 200 disabled people and a systematic review undertaken as part of this project. A few studies, including ARCHES, have moved beyond traditional research analysis to recognize the evolving nature of the ‘messy space’ and how this may inform approaches to data and dissemination. This paper frames this space as the While of participation, a concept which emerged from the systematic literature review and from working within ARCHES. It explores how the While of participation is experienced in practice, in relation to analysis and dissemination. In particular it focuses upon its emergent nature. Within this project and occasionally elsewhere in the literature, data analysis and dissemination are not retrospective or separated activities, but arise as part of the ongoing participatory process, where immersion and dialogue are at the root of all knowledge development and sharing.

Introduction

It is widely recognized that within participatory research projects in which disabled people are the focus they are excluded from most data analysis and much of the dissemination. This article reports on theoretical understandings which emerged from four participatory research groups and a systematic literature review. It identifies that within most participatory research the dominant processes of analysis and dissemination have inherent in-research access barriers that work against participation, however an alternative approach is also in evidence. Drawing upon Heidegger amongst others, this paper explores an emergent participatory process of analysis and dissemination. This process was evident within the four participatory research groups and was also identified within some other studies in the systematic literature review.

Background

This paper is based on findings which emerged from ARCHES, a Horizon 2020 funded project involving heritage and technology partners across Europe, which established four participatory research groups within four cities (London, Madrid, Vienna and Oviedo). The aim was to enhance access to heritage for all, through technology and the development of multisensory activities. Within the project we were focussing upon the analysis and dissemination of data for three distinct purposes.

  • Evaluation of technologies leading to recommendations to technology partners

  • Evaluation of activities and sites leading to recommendations to museums

  • Evaluation of process & method leading to recommendations in EU reports

Partners within the project included disabled people, six museums, five technology companies and a range of supporters. These groups met weekly or bi-weekly across a thirty-month period undertaking activities of their own design or in response to requests from the various participant partners. Over two hundred people attended these groups, with regular attendance of between fifteen and twenty-five in each. Sessions ran for between two and half hours and five hours. These research groups involved participants who have a diverse range of access preferences (Garcia Carrizosa et al. Citation2019a). These preferences are frequently associated with the labels of sensory impairments and intellectual impairments.

Participatory research emerged at end of the twentieth century, amongst a variety of research forms which involved disabled adults taking an active role. Swain (Citation1995) talked of six approaches that fit within a participatory framework. He discussed democratic research (Hall Citation1981) which prepares people to be researchers within their own community; critical research (Comstock Citation1982) and praxis research (Lather Citation1986) which raises awareness of the form of the researchers’ oppression; emancipatory research (Carr and Kemmis Citation1986), which focuses upon research that is accountable and open throughout to a group run by disabled people (Barnes Citation2003); co-research (Shakespeare Citation1993) which examines the socio-cultural construction of knowledge through collective and self-reflection; and participatory research (French Citation1993) where disabled people are actively involved in the production of research knowledge and also its selection and presentation. Other terms and forms are also in evidence, for example participatory action research (Whyte, Greenwood, and Lazes Citation1989) which calls for members of a community to be involved actively in the research process; and inclusive research (Walmsley and Johnson Citation2003) which encapsulates both emancipatory and participatory research in the learning disability context.

Within ARCHES we determined to use the term participatory research. In line with Aldridge (Citation2016), our work was to be designed with the needs of participants in mind, involving ongoing dialogue and consultation, in relationships based on mutuality, understanding and trust, seeking to enhance the participant voice in all aspects of the project. We sought to offer clear opportunities for participation as well as being clear about its limitations, whilst being sufficiently flexible to be used within a larger study. We would recognize that vulnerability is not a fixed identity or condition, that transformative outcomes can be in many arenas and that the data can be subject to diverse forms of analysis and interpretation.

At the outset of the project a broad label was proposed, people who experience differences and difficulties associated with perception, memory, cognition and communication; not all the ARCHES participants wished to be defined by this or any other label however. There was a collective agreement early in the project to subsequently refer to us as having access preferences (e.g.: audio-description, signing, subtitles, easy-read, sensory objects). Our use of the deficit labels within this paper exemplifies the manner in which our commitment to voice is compromised when we move into another arena, as does the inaccessibility of some of the language in this paper. As we will discuss later, this is a funneling effect.

Analysis and dissemination in participatory research

Just as the term by which a project defines its research methodology is open to interpretation, so too is the nature of the participation within the project. What might be anticipated as evidence of authentic participation, with jointly undertaken analysis and dissemination of data (Richardson Citation1997) or a collective analysis of the research problem (Cocks and Cockram Citation1995), is very rarely evident in practice. Stack and McDonald (Citation2014), for example, explored 21 action research projects involving people with developmental disabilities, mainly from the U.K. and U.S. The majority had no, low or low-medium levels of participation, with only six projects being on high levels. Three-quarters of these studies had discussed challenges they had faced. Issues included making the research project accessible and engaging for everyone, particularly in relation to data organization and analysis. Challenges also emerged because of academic ways of working, particularly in relation to payment, authorship and ethical approval.

Nind’s commissioned review (Citation2008), looking at research with people with learning disabilities mainly in the UK, showed how little had been written about the process of data analysis compared to other aspects of participatory research. Even basic participant validation (member checking) was little in evidence. In addition, she identified literature which highlighted the struggles of involving participants with learning disabilities in data analysis or generation of theory. Nind (Citation2011) also recognized that the challenges involved were particularly under-explored and needed to be investigated, giving examples of informal and formal, unstructured and structured, trained and untrained, explicit and implicit approaches. She saw authentic reciprocal learning as a potential benefit of participatory analysis, describing ‘an evolving process of interaction' (356); giving as examples, the narrative life-story work of Atkinson and Walmsley and Meininger.

Similar findings were evident in a wider systematic review undertaken as part of ARCHES Project (Rix et al. Citation2019). The overarching question for this review was What lessons could be learned from other participatory projects to inform the development of practice in future participatory research groups? (see ). Unlike earlier studies, this review was focused across the population of disabled people, drawing upon a wider range of international studies, in the context of an applied research project which sought to undertake practical research of immediate relevance to the range of participants in that project (Hammersley Citation2000).

Table 1. Inclusion and exclusion criteria.

The review included 54 papers (see below). It sought an in-depth analysis of participatory research practice involving people with sensory and intellectual impairments. These studies needed to provide detail about what went on in research sessions. We sought to identify and explore who was involved, for how long and what activities and processes they were involved in during the research. As well as extracting data about the specific activities and process in evidence, we also extracted any discussion or description around them which might inform us of about their nature. After this information had been extracted, there was a re-examination of tabulated data to seek patterns and to enable categorization of findings. This was followed by a thematic analysis of the data which reported on the activities and processes, using an approach drawn from grounded theory (Strauss and Corbin Citation1998). Through open-coding, the data were refined to identify concepts which represented aspects of that data. The relevant evidential quotations were allocated to emergent themes. If a point of saturation was reached in relation to an aspect of a theme, then further evidence was not added to the theme. Repetition, where it existed, was only evidenced if it seemed necessary to capture weight of evidence around a particular issue or if there was a nuanced difference because of the context of the study.

Table 2. Thematic evidence base (for the underpinning tensions, meaningful outcomes & component parts of the While of participation).

The findings from the review were used as points of reflection about our own practice within the participatory groups and enabled the development of a theorized understanding of our ways of working (for detailed findings see Rix et al. Citation2019).

Across these studies it was evident that the primary medium for the activities was speech. Papers described processes which were leading to or enabling discussion and a range of activities which were aimed at generating ideas and conversation. There were also activities seeking to move beyond the constraints of everyday communications and everyday mechanisms related to organizing various types of meetings and maintaining their flow. A range of practical tools were in evidence (which may also be seen as constitutive activities) as well as a range of communication strategies and specific actions to support communication. Within the papers it was hard to clarify the difference between many of the approaches and activities, with labels and descriptions often providing too little detail to enable clarification.

Involvement in data analysis was evident in just under 35% of studies. Of these, nearly all linked to thematic analysis and nearly half related to participant verification. Across this review, there was mention of weighting, sorting, ranking, coding, highlighting, negotiation, conversations, meetings and checking, as well as ongoing analysis and revisiting of experiences, ideas & images. There were two examples of participants being involved in processes frequently associated with the quantitative paradigm, in particular frequency analysis (Tarleton and Ward Citation2005) and populating a database (Kramer et al. Citation2013). Eleven studies made some link to collective analysis in some ways (Bigby and Frawley Citation2010; Chin et al. Citation2013; Conder, Milner, and Mirfin-Veitch Citation2011; Dias et al. Citation2012; Haigh et al. Citation2013; Higginbottom, Rivers, and Story Citation2014; Koenig Citation2012; Morgan, Moni, and Cuskelly Citation2013; O’Brien, Mcconkey, and Garcia-Iriarte Citation2014; Rix et al. Citation2010; Stevenson Citation2014).

Generally, if participants were involved in an analysis, an academic researcher would undertake the first stage and the participants would then sort the emergent themes; or inversely the participants would undertake an initial thematic sweep and the academic researchers would then undertake a next stage of analysis. Nine studies described a process of participant verification of findings as part of the working process (Chin et al. Citation2013; Cook and Inglis Citation2012; Haak et al. Citation2015; Haigh et al. Citation2013; Herron, Priest, and Read Citation2015; Keyes and Brandon Citation2012; Raymond and Grenier Citation2015; Richardson Citation2002; Rix et al. Citation2010; Schleien et al. Citation2013; Stevenson Citation2014). One study sought verification from a critical friend (Haigh et al. Citation2013).

Some papers recognized the partial participation evident in their research. Those that focused upon this issue, represented it as the consequence of research priorities and resources, alongside participant preferences and skills. As a consequence, it was perhaps inevitable that skill development was implicit in many studies and explicitly discussed in nine studies (Morgan, Moni, and Cuskelly Citation2013; Flood et al. Citation2013; Walmsley Citation2014; Conder, Milner, and Mirfin-Veitch Citation2011; O’Brien, Mcconkey, and Garcia-Iriarte Citation2014; Dias et al. Citation2012; Tarleton and Ward Citation2005; Strnadovva et al. Citation2014). There was one example, where training was framed around the needs of all those involved including academics, but even here (perhaps quite reasonably) only part of the academic team was involved (Strnadovva et al. Citation2014).

To facilitate data analysis, there were examples of what could be described as easy read summaries of results, as well as questioning frames and research draft findings to facilitate discussion. The use of transcription was evident in a number of papers, but it was frequently hard to tell if this was available to participants or was merely a tool for the academic researchers. The sharing of findings in an accessible format was not evident in all studies but was more commonplace than analysing the data. There were mentions of exhibitions, conference presentations, an open day and final event including the use of signing support, as well as easy read, plain English or accessible reports.

It was hard to be certain how many of the papers were written by participants or the part which participants played if they were named on the papers, as this was frequently not clarified within the text. There were a few alternative outputs identified too, (including American Sign Language (ASL) video blogs, photo novels, newsletters, comic strip, i-poems, a video, photobooks, and a dance performance). Many of these outputs however were not produced by the participants themselves (e.g: accessible reports, I-poems, comic strips or video) and so though they could be accessed by those involved in the research and may re-present their words, ideas or work, it is debatable whether they represent a participatory output.

Typically, across the studies in the review, analysis and the writing up rested with the academic(s) but we propose that it did not need to do so. This was a decision made by those who led the research.

Developing a participatory approach to analysis and dissemination

A few studies moved beyond traditional research analysis, recognizing the evolving nature of the ‘messy space' (Seale et al. Citation2015). They looked beyond skills and training, to build upon the strengths of participants. Richardson (Citation2002) explored in-session analysis involving the discussion of stories created from the data. Northway et al. (Citation2014), in defining questions for research, used a process of group discussion, priority setting and voting, where the outcomes of the discussion become the outcomes of the research. Bigby, Frawley, and Ramcharan (Citation2014) talked of a ‘broad shared purpose' where the focus was the self-advocates life histories, but academics framed the self-advocates’ ideas as research questions. They approached analysis through Flexible Adapted Research Methods, for example moving from formal approaches at co-analysis when they proved unsatisfactory to more open discussions of interview summaries. Keyes and Brandon (Citation2012) talked of data analysis as a continual process, with multiple opportunities for those taking part. This included varied and accessible presentation of themes, with outputs of the project being developed through interactive feedback and evaluation sessions. They worked with participants to develop the idea of Mutual Support, in a project which saw knowledge as being co-constructed in the interaction between researcher and participants.

In looking across the 54 studies (Rix et al. Citation2019), three overarching themes emerged. These were: underpinning tensions, meaningful outcomes and the component parts (see ). This helped with a conceptualization of the participatory process. The underpinning tensions were representative of issues of power, voice and support within each study. These tensions were evidenced through the meaningful nature of outcomes, which were framed as representing lives, moments of learning and value to selves. These outcomes emerged through the practicalities of participation, its component parts. These components parts were identified as:

  • shifting language, roles and attitudes

  • a capacity to adapt practices and spaces that emerge from and enable relationships

  • a recognition of the need for being flexible, taking time, and for people to enjoy themselves.

These tensions, outcomes and component parts are descriptive of the while of participatory research (Rix et al. Citation2019). When we consider any activity, the multiple interactions of participation are 'being' while the activities are – through them, within them and around them. The while of participation is the relational experience that occurs while the group and a participant are in the moment and it defines their experience of being at that moment; it is the experience that emerges from and creates the boundaries in which people find themselves.

As Heidegger (Citation1996) recognized, being is defined by its historicity. Beings are ‘always already together’ (p99). Things show themselves by being within the world and by turning their attention to aspects of that world. This ‘being-in’ is not a quality which being sometimes has and sometimes does not have, nor is it a sum of momentary realities. Only experiences in the actual now are really real. Participation therefore happens in the moment, while you are doing something. It defines the person’s experience of being within that moment; it is the experience that emerges from and contributes to the ‘they’ within which we all are; it is where we can discover our understandings of our separateness and of our boundaries. It is both a personal and physical experience, socially created from the collective resources, understandings and interactions.

Perhaps this echoes what Barnes said of emancipatory disability research (Citation2003), that in its widest sense, it needs to be conceived of as an ongoing process. It certainly echoes Seale et al. (Citation2015), who explored the nature of participatory research within a seminar series with inclusive researchers, in which the insider perspective was allowed to come to the fore. An emergent notion was of participatory research as a shared space. They saw the boundaries between groups of participants defined by common objects and shared interests. Following on from Star (Citation2010) and Star and Griesemer (Citation1989) they saw the boundaries as enabling the production of knowledge and as an essential means of communication.

The challenge of traditional approaches within the while of participation

As Heidegger (Citation1996) suggested, being understands itself by the nature of its own world. Knowledge and learning is inextricably linked to the tensions and component parts of participation, of being within. Knowledge and learning arise as part of the while of participation. However, these understandings of participatory practice set up contradictions in relation to data when we choose to adopt traditional approaches to analysis. Traditional approaches remove the analysis to another context, outside of the emerging while.

If we expand our construction of the original participatory moment to include this separated analysis, the analysis itself will be a new source of data (in need of analysis). It sets up a never-ending shortfall. However, if we do not expand our construction, the processes of traditional analysis will privilege particular kinds of knowledge and particular capacities. These rarely arise from being within the while under analysis. Their being is established beyond, in an alternative arena, in a different experience of participation. This knowledge and capacity from beyond the while will mediate the data within its own constructs. This mediation compromises the representation of the participation and its ‘reality’.

Traditional approaches can also be seen as retrospective processes. It is analysis being-within an alternative arena, undertaken beyond the original participatory site. The retrospective activity by its nature will create a new source of participation, it will be a new source of knowledge and learning, which is applied to the original while. This is not to say that such retrospective examination does not have a role to play. As Heidegger also suggested, the essence of experience will be partially concealed, and what is readily apparent may be a semblance. To more fully understand the while we therefore need to see it from a distance; to attempt to look upon it as ‘there’ so we might better reveal the nature of the participation and explore its authenticity. However, this retrospective analysis is a perspective from beyond the participation which it seeks to represent.

Within ARCHES we undertook a retrospective analysis in the final months of the project, with university researchers interviewing over 50 participants using a validities framework adapted from the International Collaboration for Participatory Health Research (Citation2013). This was to assess the validity of the participatory process overall, as required by the funders and our ethics protocols. This was regarded as the verification of the while (Seale et al. Citation2019). The technology companies also undertook retrospective analysis upon the data provided by the four Exploration groups as responses to requests for information, this data was itself usually a result of analysis which had arisen within the while.

Developing an emergent model within ARCHES

Drawing upon this understanding of the while of participation, ARCHES can be seen to have developed an emergent approach to data analysis and dissemination, using ongoing participant verification and participant representation of data. Since knowledge and learning was our data within the research context then analysis which was under the control of the participants had to be within the while. From this perspective, data was emergent; and so their analysis had to be emergent too. This emergence was a contextual phenomenon fundamentally associated with the dissemination of ideas and experiences. Our questions, thoughts and insights had to be developed and shared internally (within and between the participatory research groups) in order to generate data and undertake its analysis. They also needed to be shared externally (beyond the participatory research groups) in order to achieve the three distinct formal purposes for data collection. Being within the while meant that much of this internal and external dissemination was emergent, but as with the analysis there were occasions when this dissemination was being-beyond and retrospective, such as this paper.

This notion of emergence was evident from the outset of ARCHES and how we conceptualized ourselves as participants within the project. Our notion of participation was context dependent. A person’s presence within the while situated them within the emergent processes; by being at a session they were being a part of what was going on. However, from the outset, we also had a wider conceptualization of ‘participant’, and went beyond being a member of one of the single Exploration groups who met in individual cities. We understood participants to include all those who visited or communicated with these groups in any regular manner. In this way, as a minimum, we all had a commitment to a collective relationship, but we also created a space for alternative perspectives to emerge. We encouraged this with visits from the technologists and by providing them with recordings of activities aimed at answering questions they had. Technology partners and university partners produced their own ways of working documents, as did the museum-based Exploration groups. This helped us recognize that all participants would come with skills and experiences which could lead us in different directions. As Nind (Citation2011) and Bigby, Frawley, and Ramcharan (Citation2014) described, it made sense for people to undertake a role within the group for which they had pre-established resources and motivations. However, it also made sense to recognize that people may well have resources and motivations of which others are unaware, and which are revealed within the evolving context of the groups and their activities.

Within ARCHES, building upon notion of the while of participation, we came to recognize that the outcomes (representing lives, moments of learning and value to selves) had to be inherently linked to the research processes of analysis and dissemination; as the way in which participants were (and are) heard. But we also recognized that analysis and dissemination can be emergent and retrospective. In attempting to conceptualize this process three visual metaphors emerged. These arose as part of a training session involving the academic team and the museum coordinators. They emerged as a way to reflect upon the challenges we faced in representing and working with the multiple views and boundaries of participants (see ). We recognized that these views and boundaries had to be shared, in an inward process, leading to a point of collective experience. It was suggested that as part of this inward process, ideas needed to spread through the group like a ripple (See ); however, to be true to our emancipatory goals, ripples of knowledge also needed to turn outwards beyond the project. This however was constrained by institutional cultures and our relationship with gatekeepers. This created a funneling effect which can have profound influence on inputs and outputs to and from the group (See ) and how they might be represented.

Figure 1. Bringing together.

Figure 1. Bringing together.

Figure 2. The spread of ideas.

Figure 2. The spread of ideas.

Figure 3. A funnel of control.

Figure 3. A funnel of control.

The three purposes of data collection within the project (outlined in the Background section) were not emergent; they provided parameters within which had to operate. From a research perspective, these were our primary funnels of control. We had to produce evaluations which fell under these headings. We needed to create the ripple of ideas as well as delivering on specifics. However, each funnel had a series of internal restrictions too; funnels within the primary funnels. The participants from the technology companies, museums and universities came with their own pre-established intentions, expectations and aspirations; and the same was true of all the individuals who joined the groups. As is evident in the presentation of the four projects in the next section, these funnels, implicit or explicit, acted variously to constrain or foreground the formats and forums through which outcomes were expressed, and the agency of particular voices within specific contexts. However, they could also be fossilized structures hidden from our inspection.

Four experiences of emergent analysis and dissemination

Across the two years, the Exploration groups evaluated their own ways of working, devised ‘rules’, decided how they wished to be represented (for example in demographics) and fed back their views of the project and how it was being run (including presenting on this at a conference). A whole range of in-museum activities emerged, including access audits, relationship building, exploring access preferences, trialling access ideas, and advising on and developing tours and multisensory resources (for details of our ways of working see Garcia Carrizosa, Diaz, and Sisinni Citation2019b). The ideas for these activities were initiated by, and followed up by, regular attenders and the less regular. People came and went and left ideas behind them which continued to spread and have an influence.

Within the sessions we established a routine. People would have an experience (for example; trialling a piece of technology, visiting a gallery, exploring an access preference); they would then reflect upon the experience, share understandings and insights from that experience, summarize those experiences, record them and share them with other participants for clarification and verification. This emergent ongoing analysis typically happened shortly after an experience had occurred, but it could also take a longer view (for example across one of the group’s projects) providing snapshots on the way to producing a final artefact or a representation of that experience (for example: video reports on museum visits sent to the Director, a tapestry representing the highs and lows of participation, a PowerPoint presentation of an evaluation of a museum website shown to the museum, a keyring of creative activities to enhance a museum visit, and feedback to a technology partner).

In nearly all these projects and within activities undertaken within the Exploration groups, there were competing priorities, funnelling our ways of working and what could be achieved with the output. From the outset, activities were constrained and enabled by the overall project funding, and therefore by the goals and practices of the institutions involved in applying for this funding and what we had said the overall project would achieve. Beyond this, however, we would suggest that an emergent analysis and dissemination was in evidence throughout the project. Here is an example from each group, which encapsulates our experiences of this approach to analysis and dissemination.

The Feeling my way project emerged early on within the Vienna Exploration Group. During a session, a group of participants who had a visual impairment took part in a brainstorm session. The emergent notion was that the museum needed a tactile map. This idea was shared across the group and agreed to as a collective goal to work towards. Over five sessions the participants who had identified the opportunity, collectively analyzed the situation and what was possible, deciding what was relevant to show, to what detail and at what size. The need to reflect the museum's design ethos, led the group into to working with a designer to revise and re-design the map mock-ups. The group then wrote and recorded the audio description to go with it and began to test it in an ongoing emergent manner. This ensured that it met both their needs as well as those of the museum, passing through the funnels created by the participants’ and institution’s priorities. At the time of writing the final version is waiting to pass through to final approval prior to being made available to the wider public.

Within the Oviedo Exploration group, a variety of challenges were identified within the context of the museum as a historic building. Early in the project three practical concerns emerged from within the group:

  • the need for Wi-Fi to be available throughout the building;

  • an inability to communicate through visual means with people trapped in the lift if there was an incident;

  • and the use of verbal communication to signify the museum was closing.

The first issue was identified by the museum coordinator working with technologically aware participants. The second two issues emerged through discussion amongst participants mainly from the d/Deaf community, when reporting back after an early tour around the site. The museum worked within considerable constraints due to planning and building regulations and because of the nature of its physical structure all three issues were initially funnelled by what was presumed to be possible within the institution; the sense of frustration associated with these constraints rippled through the group. This ripple reached the museum director, an essential gatekeeper, through the external academic from the UK. This opportunity was itself, emergent, an informal opportunity which presented itself; however, this allowed the ideas that had emerged from the participants’ discussions to be heard. Subsequently, Wi-Fi was introduced throughout the museum, plans were developed to include cameras and screens in the lifts and it was decided that the closure of the museum at the end of the day would be announced both verbally and by raising and lowering the lights.

In London, the QR Code project emerged from a variety of conversations, sparked by an analysis of the access constraints the group faced on visiting the two museums concerned. From this analysis emerged a collective focus on ‘accessing ideas’, which rippled through the wider group and their discussions. This collective focus was directly linked to:

  • one participant’s suggestion to use QR codes to pass on accessible information;

  • and by another’s suggestion (recognizing the failings of previous uses of QR) that you could have a book in each room for different access preferences, with links to accessible, updatable information.

But this focus also came to reflect the ideas of people from across the group. The participants decided to create a single example. Another wave of focussed data collection took place. Out of their discussion emerged a single selected object from the collection and agreed headings for information. It was evident to the group that they could use the knowledge of the institution and so they interviewed a curator and selected what should go into the script that they subsequently developed. At this point the ripple hit the funnel of their own technical inexperience and the financial constraints within which they were working. Access to resources became the constraint, but after some delay the museum partners were able to identify an editor who could work with the group and the university partners were able to organize funding for this work. The group recorded the script, filmed the sign language interpreter, selected images for a video, and worked with an editor who produced the short videos which would be accessed through the QR codes (see ). Designs for the sheets were produced by one of the academics concerned and these were then tested and redesigned on the basis of the emergent analysis of the group. The suggestion for this project emerged early on, and other aspects of the project emerged in small bursts over a two-year period. One or two participants stayed with it the whole way through, but nearly all the London Exploration Group was involved in its development at different times, as it rippled across many sessions. Whether this idea is picked up further will now depend upon gatekeepers within the institutions and institutional priorities as well others beyond this project recognizing its value and wanting the ripple to spread.

Figure 4. An example of a QR code page used for testing.

Figure 4. An example of a QR code page used for testing.

The Welcome to our Museum project was developed by the Madrid Exploration Group. As in London the group considered their experience of visiting the museum. In this instance, an emergent conclusion was a need to focus upon navigation around the museum and to recognize that access is not something that begins when you walk through the front door, nor is it simply about standing in front of works of art when you are there. The group concluded from the evidence of their collective experience that they should produce a video to enable potential visitors to find out about the different resources available to them, and prior to their visit learn something about how to navigate around the museum space to find basic amenities. The emergent intention was for this video to be used on the museum webpage and in other places such as the entrance of the museum or with specific apps such as those being produced by the technology partners. Once again, the ambition of the Exploration Group was funnelled through economic and technical constraints and an institutional need to have a particular standard of output. In this instance, the decision making was also influenced by a local video company. The Exploration group decided on content for the video and accessibility aspects, as well as serving as presenters, writing the script and choosing the actors/voices and giving final approval, but the film was produced by the company for them.

Discussion and conclusion

At the outset of ARCHES we had three distinct purposes for collecting data, however the nature of participation and our ways of working within this context meant we were able to look beyond the constraints of these purposes. Our understanding of the outcomes of participation gave us possibilities beyond these formalized goals. We recognized that the tangible outputs had to have value to all those involved, in terms of what the outputs represented and how they represented the participants. The emergent process were by their nature open to interpretation and operated in a manner akin to theoretical saturation (Strauss and Corbin Citation1998), but they also needed to be democratic and negotiated. This meant the process was not one of ongoing equanimity. People did not always agree. Some people left the project (sometimes) in frustration, whilst others returned as they saw what was emerging. Our emergent way of working, however, allowed for a collective, participatory approach to analysis and dissemination evident in few other projects which identify as participatory.

As a project we have been able to produce a range of publications which have emerged from a retrospective analysis situated beyond the while of participation experienced within the group sessions. This paper falls within that description, but it enables us to make a clear link between the development of theory both within the literature and as it is experienced in practice. It provides a means to explore why participation and participatory research in particular is not a neat process. It is underpinned by tensions which arise from being within the while, and which are situated beyond it. In any moment of participation we can be giving consideration to experiences of where power sits, whose voice is being listened to, and how those involved are being supported; but each of these tensions is not an issue in isolation. Issues of support are also issues of power and voice; whilst issues of voice are also issues of power and support; and issue of power are issues of voice and support. There is a constant interweaving which may reflect a wider series of issues but is emerging (for better or for worse) in that moment of participation.

The wider series of issues will often reflect local values and the differences between cultures, with funnels rooted in the historicity of experience. For example, the emergence of ‘access preferences' as the means by which demographic data was to be collected and as a means by which we identified and referred to our individual and collective needs. This was a concept which emerged from the group in London at the outset of the project and was established in all the other groups as they were set up. The strength of the concept and its capacity to encourage positive practice was welcomed by the vast majority of participants, but nearly everyone involved (including in London) still continued to use the plethora of labels associated with their own identities and with notions of impairment and disability. Our understanding of its usage was (and is) an ongoing process. It reflected the role of boundaries and their exploration as enabling knowledge production and facilitating communication (Nind et al. Citation2016; Star Citation2010; Star and Griesemer Citation1989). The same, perhaps, can be said for all the outputs from ARCHES. Their emergent nature reflected our wider participation in which we are ‘always already together’ and came to better understand our situation by looking from another perspective, a distant ‘there’ (Heidegger Citation1996).

Following the seminar series mentioned above, Nind et al. (Citation2016) suggested the need to develop new models of training and capacity building. In an inclusive immersion model, aspects of research are learned through immersion in the research environment, with its accountable and political nature, where there are problems to learn through, rather than experts to learn from. In a dialogic model, people learn through testing each other’s contributions to knowledge as they engage with each other. Such approaches go beyond training and capacity building, however. Immersion and dialogue are at the root of all knowledge development. Such models respond to ideas of empowerment and social justice evident in ARCHES and in other participatory research involving particular groupings. For example, Nicholls (Citation2009) concludes from research with Indigenous participants that a reflexive process of collaborative ‘sense- making’ is ‘a theoretically consistent tool within participatory methodology' (124), and requires not just being open to new socially situated ways of understanding, but also ceding control of research into data collection, analysis and distribution.

Such an approach to the analysis and dissemination of data sets participatory research on a different path to the majority of qualitative and quantitative approaches. Whereas most research paradigms are rooted in notions of expertise and dependent upon approaches akin to ‘technical rationality’ (Schön Citation1983), participatory approaches must recognize the relational and uncertain nature of participation. The process of emergent analysis and dissemination apparent in ARCHES and some other research, is evidence of a project that seeks to build upon the groups’ collective network of life experiences in all aspects of the project. ‘Valid’ participation is not situated in a singular or neatly defined space. It is based on continual negotiation, with participants needing to move to where others are; shifting the balance from the funnel to the ripple. If this is to be a democratic, equitable process, this movement must be in the direction of all the participants and be supported by the participants rather than being constrained by previously established, top-down research practices and discourse. Emergent analysis and dissemination is a response to this reality, reflecting the nature of the while of participation and enhancing its validity.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by European Union’s Horizon 2020 Research And Innovation Programme [grant number 693229].

References

  • Aldridge, J. 2007. “Picture This: The Use of Participatory Photographic Research Methods with People with Learning Disabilities.” Disability and Society 22 (1): 1–17.
  • Aldridge, J. 2016. Participatory Research: Working with Vulnerable Groups in Research and Practice. Bristol: Policy Press.
  • Barnes, C. 2003. “What Difference a Decade Makes: Reflections on Doing ‘Emancipatory’ Disability Research.” Disability and Society 18 (1): 3–17.
  • Bigby, C., and P. Frawley. 2010. “Reflections on Doing Inclusive Research in the “Making Life Good in the Community” Study.” Journal of Intellectual and Developmental Disability 35 (2): 53–56.
  • Bigby, C., P. Frawley, and P. Ramcharan. 2014. “A Collaborative Group Method of Inclusive Research.” Journal of Applied Research in Intellectual Disabilities 27 (1): 54–64.
  • Brooks, M., S. Davies, and E. Twigg. 2013. “A Measure for Feelings – Using Inclusive Research to Develop a Tool for Evaluating Psychological Therapy (Clinical Outcomes in Routine Evaluation – Learning Disability).” British Journal of Learning Disabilities 41 (4): 320–329.
  • Carr, W., and S. Kemmis. 1986. Becoming Critical: Education, Knowledge and Action Research. Lewes: Falmer Press.
  • Chin, N. P., J. Cuculick, M. Starr, T. Panko, H. Widanka, and A. Dozier. 2013. “Deaf Mothers and Breastfeeding: Do Unique Features of Deaf Culture and Language Support Breastfeeding Success?” Journal of Human Lactation 29 (4): 564–571.
  • Cluley, V. 2017. “Using Photovoice to Include People with Profound and Multiple Learning Disabilities in Inclusive Research.” British Journal of Learning Disabilities 45 (1): 39–46.
  • Cocks, E., and J. Cockram. 1995. “The Participatory Research Paradigm and Intellectual Disability.” Mental Handicap Research 8 (1): 25–37.
  • Comstock, D. 1982. “A Method for Critical Research.” In Knowledge and Values in Educational Research, edited by E. Bredo and W. Fienburg, 370–390. Philadelphia: Temple University Press.
  • Conder, J., P. Milner, and B. Mirfin-Veitch. 2011. “Reflections on a Participatory Project: The Rewards and Challenges for the Lead Researchers.” Journal of Intellectual and Developmental Disability 36 (1): 39–48.
  • Cook, T., and P. Inglis. 2012. “Participatory Research with Men with Learning Disability: Informed Consent.” Tizard Learning Disability Review 17 (2): 92–101.
  • Dias, J., M. Eardley, E. Harkness, L. Townson, C. Brownlee-Chapman, and R. Chapman. 2012. “Keeping Wartime Memory Alive: An Oral History Project About the Wartime Memories of People with Learning Difficulties in Cumbria.” Disability and Society 27 (1): 31–49.
  • Draffan, E. A., A. James, M. Wald, and A. Idris. 2016. “Framework for Selecting Assistive Technology User-Participation Methods.” Journal of Assistive Technologies 10 (2): 92–101.
  • Erdtman, E., M. Tideman, C. Fleetwood, and K. Moller. 2012. “Research Initiation Based on Idea-Circles: From Research Object to Co-Actor.” Disability and Society 27 (6): 879–882.
  • Flood, S., D. Bennett, M. Melsome, and R. Northway. 2013. “Becoming a Researcher.” British Journal of Learning Disabilities 41 (4): 288–295.
  • French, S. 1993. Practical Research: A Guide for Therapists. Oxford: Butterworth-Heinmann.
  • Fudge Schormans, A. 2014. “‘Weightless?’: Disrupting Relations of Power in/Through Photographic Imagery of Persons with Intellectual Disabilities.” Disability & Society 29 (5): 699–713.
  • Garcia-Iriarte, E., J. C. Kramer, J. M. Kramer, and J. Hammel. 2009. “‘Who Did What?’: A Participatory Action Research Project to Increase Group Capacity for Advocacy.” Journal of Applied Research in Intellectual Disabilities 22 (1): 10–22.
  • Garcia Carrizosa, H., J. Diaz, R. Krall, and F. Sisinni Ganly. 2019a. “Cultural Differences in ARCHES: A European Participatory Research Project – Working with Mixed Access Preferences in Different Cultural Heritage Sites.” The International Journal of the Inclusive Museum 12 (3): 33–50.
  • Garcia Carrizosa, H., J. Diaz, and F. Sisinni. 2019b. Towards a Participatory Museum. https://www.arches-project.eu/wp-content/uploads/2019/07/EnglishGuide_Hyperlinks_mid.pdf.
  • Gates, B., and M. Waight. 2007. “Reflections on Conducting Focus Groups with People with Learning Disabilities: Theoretical and Practical Issues.” Journal of Research in Nursing 12 (2): 111–126.
  • Greenstein, A. 2014. “Today’s Learning Objective is to Have a Party: Playing Research with Students in a Secondary School Special Needs Unit.” Journal of Research in Special Educational Needs 14 (2): 71–81.
  • Grundy, A. L., M. K. McGinn, and D. E. Pollon. 2005. “Striving Toward Inclusive Research Practices: The Evolution of the Participant-as-Transcriptionist Method.” Disability and Society 20 (4): 453–468.
  • Haak, M., B. Slaug, F. Oswald, S. M. Schmidt, J. M. Rimland, S. Tomsone, T. Lad, T. Svensson, and S. Iwarsson. 2015. “Cross-National User Priorities for Housing Provision and Accessibility, Findings From the European Innovage Project.” International Journal of Environmental Research and Public Health 12 (3): 2670–2686.
  • Haigh, A., D. Lee, C. Shaw, M. Hawthorne, S. Chamberlain, D. W. Newman, Z. Clarke, and N. Beail. 2013. “What Things Make People with a Learning Disability Happy and Satisfied with Their Lives: An Inclusive Research Project.” Journal of Applied Research in Intellectual Disabilities 26 (1): 26–33.
  • Hall, B. 1981. “The Democratisation of Research in Adult and Non-Formal Education.” In Human Inquiry, edited by P. Reason, and J. Rowan, 447–456. New York: John Wiley & Sons.
  • Hammersley, M. 2000. “Varieties of Social Research: A Typology.” International Journal of Social Research Methodology 3 (3): 221–229.
  • Heidegger, M. 1996. Being and Time: A Translation of Sein und Zeit. New York: SUNY Press.
  • Herron, D., H. Priest, and S. Read. 2015. “Working Alongside Older People with a Learning Disability: Informing and Shaping Research Design.” British Journal of Learning Disabilities 43 (4): 261–226.
  • Higginbottom, G. M., K. Rivers, and R. Story. 2014. “Health and Social Care Needs of Somali Refugees With Visual Impairment (VIP) Living in the United Kingdom: A Focused Ethnography With Somali People With VIP, Their Caregivers, Service Providers, and Members of the Horn of Africa Blind Society.” Journal of Transcultural Nursing 25 (2): 192–201.
  • Hodges, C. E. M., L.-A. Fenge, and W. Cutts. 2014. “Challenging Perceptions of Disability Through Performance Poetry Methods: The ‘Seen but Seldom Heard’ Project.” Disability and Society 29 (7): 1090–1103.
  • International Collaboration for Participatory Health Research [ICPHR]. 2013. What is Participatory Health Research: Position Paper 1. Accessed July 29, 2019. http://www.icphr.org/uploads/2/0/3/9/20399575/ichpr_position_paper_1_defintion_-_version_may_2013.pdf.
  • Keyes, S. E., and T. Brandon. 2012. “Mutual Support: A Model of Participatory Support by and for People with Learning Difficulties.” British Journal of Learning Disabilities 40 (3): 222–228.
  • Koenig, O. 2012. “Any Added Value? Co-Constructing Life Stories of and with People with Intellectual Disabilities.” British Journal of Learning Disabilities 40 (3): 213–221.
  • Kramer, J., Y. Barth, K. Curtis, K. Livingston, M. O’Neil, Z. Smith, S. Vallier, and A. Wolfe. 2013. “Involving Youth with Disabilities in the Development and Evaluation of a New Advocacy Training: Project TEAM.” Disability & Rehabilitation 35 (7): 614–622.
  • Kramer, J. M., J. C. Kramer, E. Garcia-Iriarte, and J. Hammel. 2011. “Following Through to the End: The Use of Inclusive Strategies to Analyse and Interpret Data in Participatory Action Research with Individuals with Intellectual Disabilities.” Journal of Applied Research in Intellectual Disabilities 24 (3): 263–273.
  • Lather, P. 1986. “Research as Praxis.” Harvard Education Research 56 (3): 257–271.
  • Lutz, D., K. R. Fisher, and S. Robinson. 2016. “Sharing the Focus: Engaging with Support Workers to Include People with Communication Needs in Research.” British Journal of Learning Disabilities 44 (2): 138–145.
  • MacDonald, D. 2016. “Creative Ways of Talking: A Narrative Literature Review Concerning Emotional Support for Adults with Mild or Moderate Learning Difficulties.” British Journal of Learning Disabilities 44 (3): 233–239.
  • Malling, S. H. 2013. “Choreography and Performance with Deaf Adults Who Have Mental Illness: Culturally Affirmative Participatory Research.” American Journal of Dance Therapy 35 (2): 118–141.
  • McKee, M., D. Thew, M. Starr, P. Kushalnagar, J. T. Reid, P. Graybill, J. Velasquez, and T. Pearson. 2012. “Engaging the Deaf American Sign Language Community: Lessons From a Community-Based Participatory Research Center.” Progress Community Health Partnership 6 (3): 321–329.
  • Morgan, M., K. Moni, and M. Cuskelly. 2013. “Literacy Strategies Used by Adults with Intellectual Disability in Negotiating Their Everyday Community Environments.” Australian Journal of Adult Learning 53 (3): 411–435.
  • Nicholls, R. 2009. “Research and Indigenous Participation: Critical Reflexive Methods.” International Journal of Social Research Methodology 12 (2): 117–126.
  • Nicolaidis, C., D. Raymaker, M. Katz, M. Oschwald, R. Goe, S. Leotti, L. Grantham, et al. 2015. “The Partnering With People With Disabilities to Address Violence Consortium Community-Based Participatory Research to Adapt Health Measures for Use by People with Developmental Disabilities.” Rural Institute Journal 9 (2): 157–170.
  • Nind, M. 2008. Conducting Qualitative Research with People with Learning, Communication and Other Disabilities: Methodological Challenges. Southampton: National Centre for Research Methods.
  • Nind, M. 2011. “Participatory Data Analysis: A Step Too Far?” Qualitative Research 11 (4): 349–363.
  • Nind, M., R. Chapman, J. Seale, and L. Tilley. 2016. “The Conundrum of Training and Capacity Building for People with Learning Disabilities Doing Research.” Journal of Applied Research in Intellectual Disabilities 29 (6): 542–551.
  • Nind, M., and H. Vinha. 2014. “Doing Research Inclusively: Bridges to Multiple Possibilities in Inclusive Research.” British Journal of Learning Disabilities 42 (2): 102–109.
  • Nind, M., and H. Vinha. 2016. “Creative Interactions with Data: Using Visual and Metaphorical Devices in Repeated Focus Groups.” Qualitative Research 16 (1): 9–26.
  • Noell, J. F., M. P. Diaz, M. V. Sune, and C. P. Rovira. 2016. “People with Intellectual Disabilities as Researchers. Discussions, Challenges and Possibilities of Inclusive Research [Las personas con discapacidad intelectual como investigadoras., retos y posibilidades de la investigacion inclusiva].” Empiria – Revista de Metodología de Ciencias Sociales 33: 111–138.
  • Northway, R., K. Hurley, C. O’Connor, H. Thomas, J. Howarth, E. Langley, and S. Bale. 2014. “Deciding What to Research: An Overview of a Participatory Workshop.” British Journal of Learning Disabilities 42 (4): 323–327.
  • O’Brien, P., R. Mcconkey, and E. Garcia-Iriarte. 2014. “Co-researching with People Who Have Intellectual Disabilities: Insights From a National Survey.” Journal of Applied Research in Intellectual Disabilities 27 (1): 65–75.
  • Povee, K., B. J. Bishop, and L. D. Roberts. 2014. “The Use of Photovoice with People with Intellectual Disabilities: Reflections, Challenges and Opportunities.” Disability and Society 29 (6): 893–907.
  • Raymond, E., and A. Grenier. 2015. “Social Participation at the Intersection of Old Age and Lifelong Disability: Illustrations From a Photo-Novel Project.” Journal of Aging Studies 35: 190–200.
  • Richardson, M. 1997. “Participatory Research Methods: People with Learning Difficulties.” British Journal of Nursing 6 (10): 1114–1121.
  • Richardson, M. 2002. “Involving People in the Analysis: Listening, Reflecting, Discounting Nothing.” Journal of Learning Disabilities 6 (1): 47–60.
  • Rix, J., H. Garcia-Carrisoza, J. Seale, K. Sheehy, and S. Hayhoe. 2019. “The While of Participation: A Systematic Review of Participatory Research Involving People with Sensory and Intellectual Impairments.” Disability and Society. doi:10.1080/09687599.2019.1669431.
  • Rix, J., T. Lowe, M. Heard, D. Harwood, C. Bingham, M. Anderson, R. Bemtham, et al. 2010. “Including People with Learning Difficulties in Cultural and Heritage Sites.” International Journal of Heritage Studies 16 (3): 207–224.
  • Rogers, C., and S. Tuckwell. 2016. “Co-constructed Caring Research and Intellectual Disability: An Exploration of Friendship and Intimacy in Being Human.” Sexualities 19 (5–6): 623–640.
  • Rome, A., J. Hardy, J. Richardson, and F. Shenton. 2015. “Exploring Transitions with Disabled Young People: Our Experiences, Our Rights and Our Views.” Child Care in Practice 1 (3): 287–294.
  • Schleien, S., L. Brake, K. Miller, and G. Walton. 2013. “Using Photovoice to Listen to Adults with Intellectual Disabilities on Being Part of the Community.” Annals of Leisure Research 16 (3): 212–229.
  • Schön, D. 1983. The Reflective Practitioner: How Professionals Think in Action. London: Maurice Temple Smith.
  • Seale, J., H. Garcia Carrizosa, J. Rix, K. Sheehy, and S. Hayhoe. 2019. “A Participatory Approach to the Evaluation of Participatory Museum Research Projects.” International Journal of Research and Method in Education 1–12. doi:10.1080/1743727X.2019.1706468.
  • Seale, J., M. Nind, L. Tilley, and R. Chapman. 2015. “Negotiating a Third Space for Participatory Research with People with Learning Disabilities: An Examination of Boundaries and Spatial Practices.” Innovation: The European Journal of Social Science Research 28 (4): 483–497.
  • Shakespeare, P. 1993. “Performing.” In Reflecting on Research Practice, edited by P. Shakespeare, D. Atkinson, and S. French, 95–105. Milton Keynes: Open University Press.
  • Simmons, B., and D. Watson. 2015. “From Individualism to Co-Construction and Back Again: Rethinking Research Methodology for Children with Profound and Multiple Learning Disabilities.” Child Care in Practice 21 (1): 50–66.
  • Stack, E., and K. McDonald. 2014. “Nothing About Us Without Us: Does Action Research in Developmental Disabilities Research Measure Up?” Journal of Policy and Practice in Intellectual Disabilities 11 (2): 83–91.
  • Star, S. 2010. “This is Not a Boundary Object: Reflections on the Origins of a Concept.” Science, Technology, & Human Values 35 (5): 601–617.
  • Star, S., and J. Griesemer. 1989. “Institutional Ecology, “Translations” and Boundary Objects: Amateurs and Professionals in Berkeley’s Museum of Vertebrate Zoology.” Social Studies of Science 19 (3): 387–420.
  • Stevenson, M. 2014. “Participatory Data Analysis Alongside Co-Researchers Who Have Down Syndrome.” Journal of Applied Research in Intellectual Disabilities 27 (1): 23–33.
  • Strauss, A., and J. Corbin. 1998. Basics of Qualitative Research; Techniques and Procedures for Developing Grounded Theory. Thousand Oaks, CA: Sage Publications.
  • Strnadovva, I., T. Cumming, M. Knox, and T. Parmenter. 2014. “Building an Inclusive Research Team: The Importance of Team Building and Skills Training.” Journal of Applied Research in Intellectual Disabilities 27 (1): 13–22.
  • Swain, J. 1995. “Constructing Participatory Research: in Principle and in Practice.” In Making Difficulties: Research and the Construction of Special Educational Needs, edited by P. Clough and L. Barton, 75–93. London: Paul Chapman.
  • Tarleton, B., and L. Ward. 2005. “Changes and Choices: Finding Out What Information Young People with Learning Disabilities, Their Parents and Supporters Need at Transition.” British Journal of Learning Disabilities 33 (2): 70–76.
  • Tilly, L. 2013. “I Ain’t Been Bothered to Go: Managing Health Problems in People with a Learning Disability Who Live Without Support.” Diversity and Equality in Health and Care 10 (4): 223–230.
  • Walmsley, J. 2014. “Telling the History of Self-Advocacy: A Challenge for Inclusive Research.” Journal of Applied Research in Intellectual Disabilities 27 (1): 34–43.
  • Walmsley, J., and K. Johnson. 2003. Inclusive Research with People with Learning Difficulties. Past, Present and Future. London: Jessica Kingsley.
  • Watson, D., A. Feiler, and B. Tarleton. 2014. “Involving Young Disabled People in the Research Process: The Experiences of the PIE Research Project Team.” Children and Society 28 (4): 316–326.
  • Whyte, W., D. Greenwood, and P. Lazes. 1989. “Participatory Action Research: Through Practice to Science in Social Research.” American Behavioral Scientist 32 (5): 513–551.
  • Wickenden, M., and G. Kembhavi-Tam. 2014. “Ask us Too! Doing Participatory Research with Disabled Children in the Global South.” Childhood 21 (3): 400–417.
  • Williams, V., and K. Simons. 2005. “More Researching Together: The Role of Nondisabled Researchers in Working with People First Members.” British Journal of Learning Disabilities 33 (1): 6–14.
  • Young, A. F., and R. A. Chesson. 2008. “Determining Research Questions on Health Risks by People with Learning Disabilities, Carers and Care-Workers.” British Journal of Learning Disabilities 36 (1): 22–31.