ABSTRACT
Contemporary urban development is increasingly characterized by collaboration and co-production between ‘experts’ and the ‘public’ in urban planning processes. Recently, local planning actors have adopted digital participatory platforms (DPPs) which are specifically built for networked engagement and collaboration purposes. However, the knowledge on embedding DPPs in wider planning dialogues is still limited and scattered. The aim of this paper is to provide a better understanding of the organizational conditions for the successful adoption and implementation of such networked co-production. Through a set of semi-structured interviews with representatives from public agencies and platform companies, we have analysed how organizational conditions for networked co-production manifest themselves in seven cases of DPP implementation. The analysis shows that these conditions are co-constitutive and co-evolutive rather than concurrent or sequential, with strong links between the compatibility of public agencies, attitudes to co-production, organizational cultures and incentives for co-production. The results critically emphasize the need to adopt holistic approaches to networked co-production, allowing for extensive experimentation and ‘learning by doing’.
1. Introduction
Over time, urban planning and community scholars have studied various ways to improve communication and collaboration between ‘experts’ and the ‘public’ in planning processes. Essentially, public participation is seen as ‘a cornerstone of democracy’ (Roberts Citation2004, 315), in which democratic legitimacy strongly depends on the nature and quality of public decision-making. Public participation is also a core component of sustainability. The importance of public participation for sustainable cities and communities is emphasized in the UN Sustainable Development Goal SDG 11, particularly subgoal 11.3.Footnote1 By helping to make institutions more accountable, public participation also strengthens SDG 16.6.Footnote2 Lane (Citation2005) reviews the complex historical legacy of public participation that has underpinned ideological shifts in planning, from blueprint and synoptic planning to the current era characterized by theoretical pluralism. Unsurprisingly, the academic and practice-oriented literature feature dozens of theoretical models, each with their own assumptions and limitations (Babelon Citation2021). A challenge remains the capacity to combine a critical stance with pragmatism to operationalize progressive modes of participation, including the capacity for participants to shape and co-produce the context and aim of public participation itself (cf. Davis and Andrew Citation2018; Swyngedouw Citation2005).
A specific form of public participation is co-production, generally defined as ‘the public sector and citizens making better use of each other’s assets and resources to achieve better outcomes and improved efficiency’ (Bovaird and Loeffler Citation2012, 1121). A renewed interest has appeared in co-production of public services, in light of fiscal pressures and austerity regimes by governments around the world (Voorberg, Bekkers, and Tummers Citation2015; Brandsen and Honingh Citation2016). In the pre-Internet age, the potential for co-production was somewhat constrained by a limited ability of government to effectively coordinate citizen actions and, in some cases, the difficulty of citizens to self-organize. However, ‘the advent of the Internet's unique many-to-many interactivity and ubiquitous communications promises to enable coproduction on an unprecedented scale’ (Linders Citation2012, 446). Social media and Web 2.0 have affected governments’ communication with citizens (De Souza and Bhagwatwar Citation2014; Fredericks and Foth Citation2013).
A particular type of web-based technology adopted by civic organizations or governments is represented by digital participatory platforms (DPPs), used in urban planning and urban development processes. DPPS are defined as a type of social media explicitly built for engagement and collaboration purposes. DPPs enable user-generated content and include a range of functionalities (e.g. analytics, map-based, geo-located inputs, importing/exporting of data, ranking of ideas) which transcend and considerably differ from social media such as Facebook, Twitter or Instagram. Previous studies focus on the potential of DPPs to inform planning decisions, involve large numbers of citizens, foster deliberation and crowdsource geo-located information (Fredericks and Foth Citation2013; Jones et al. Citation2015; Afzalan and Muller Citation2018; Falco and Kleinhans Citation2018a). Other studies have framed DPPs in the context of smart city governance, referring to ‘technologically-mediated municipal reciprocity’ (Webster and Leleux Citation2018) and ‘networked co-production’ in virtual communities of citizens (Meijer Citation2011).
Networked coproduction has not been systematically studied (Linders Citation2012, 447; see also Meijer Citation2011; De Souza and Bhagwatwar Citation2014; Falco and Kleinhans Citation2018a; Webster and Leleux Citation2018). Planning organizations usually do not evaluate the effectiveness of DPPs in terms of co-production (Afzalan and Muller Citation2018, 172). Various conditions related to technology and organizational matters must be met to enable co-production. In view of the scarcity of empirical research, there is a need to look under the proverbial bonnet of DPP-based co-production. Using a basic framework of factors affecting co-production (Voorberg, Bekkers, and Tummers Citation2015), the aim of this paper is to provide a better understanding of the organizational conditions for the successful adoption and implementation of such networked co-production. The research question is: How do key organizational conditions affect the adoption and implementation of DPPs as a tool for co-production of planning solutions?
This paper builds on a previously conducted systematic review of DPPs (Falco and Kleinhans Citation2018a). From this study, we have selected seven DPPs that have been implemented in the years 2017–2019 by nine local governments in five European countries: The Netherlands, Belgium, England, France, and Sweden. This selection will be fully explained in Section 2. While we fully acknowledge the fundamental importance of citizens’ experiences, our study is limited to the perceptions of representatives of local public agencies and the involved platform companies. We have therefore employed a qualitative approach, conducting semi-structured interviews with key informants from public agencies and platform companies. The article is structured as follows: Section 2 addresses theories of co-production and sets out the conceptual background for the study of analysis. Section 3 presents our methodological approach to the data collection and analysis. Section 4 describes the results of the interviews, highlighting the main findings. Section 5 discusses the results. Section 6 offers conclusions and sets out directions for future research.
2. Co-production through digital platforms
2.1. The nature of co-production
The concept of co-production partly stems from Elinor Ostrom’s work on the management of common-pool resources (e.g. Ostrom Citation1996). A renewed interest has appeared in the citizen co-production of public services, partly due to the fiscal pressures faced by many governments around the world as a consequence of the financial crisis of 2008 (Parrado et al. Citation2013, 86; see also Linders Citation2012; Van Eijk and Steen Citation2014, 359). Co-production is also regarded as part of ‘a drive to reinvigorate voluntary participation and strengthen social cohesion in an increasingly fragmented and individualized society’ (Brandsen and Honingh Citation2016, 427). Co-production in urban planning is the result of long-term developments in the processes of state-society engagement (Watson Citation2014). It can be seen as a more recent outcome of consolidated paradigm shifts in urban planning towards a more communicative and collaborative approach (Lane Citation2005; Healey Citation1998). Due to technological developments, emphasis on the role of citizens as (co-)producers of information and data for planning has been placed with the development of concepts such as Volunteered Geographic Information, citizens as sensors, and Public Participation Geographical Information Systems (e.g. Goodchild Citation2007; Brown and Kytta Citation2014; Jankowski et al. Citation2021).
Bovaird and Loeffler (Citation2012) define co-production as the public sector and citizens making better use of each other’s assets and resources to achieve better outcomes and improved efficiency. Conceptually, several types of co-production can be distinguished. These types are based on the extent to which citizens are involved in both the design and implementation of professionally produced services, and the extent to which citizens are engaged in tasks that are part of the core process of service delivery, or complementary to this core process (Brandsen and Honingh Citation2016, 432, see also Bovaird Citation2007; Fung Citation2015). Scholars have identified organizational and individual factors that influence whether co-production ‘works’ in practice. As for the latter, these include personal motivation, the urge for personal control, self-interest (tangible benefits), sociality (an individual’s desire for a sense of belonging), a sense of responsibility, citizens’ perceived ability to effectively influence service provision, and their ability to access social capital (Van Eijk and Steen Citation2014; Voorberg, Bekkers, and Tummers Citation2015).
2.2. Organizational factors affecting co-production
As Ostrom (Citation1996, 1080) cautions, ‘designing institutional arrangements that help induce successful co-productive strategies is far more daunting than demonstrating their theoretical existence’. Co-production places the spotlight on the institutional conditions for using DPPs in dialogues between governments and citizens. Voorberg, Bekkers, and Tummers (Citation2015, 1342) have identified four organizational factors that affect co-production. First, the compatibility of public organizations to citizen participation, i.e. the ‘presence or absence of inviting organizational structures and procedures within the public organization’ and infrastructures to communicate with citizens. For example, Bovaird and Loeffler (Citation2012) observe that co-production requires development of new skills of public sector professionals to work with citizens and recognize their assets (cf. Parrado et al. Citation2013). A second factor is how public officials and politicians perceive co-production upfront. While they may be attracted by the promises of networked co-production, they may also consider it as undesirable, because of unpredictable behaviour of citizens and ‘political and professional reluctance to lose status and control’ (Voorberg, Bekkers, and Tummers Citation2015, 1342). Third, a ‘risk-averse, conservative administrative culture’ may explain why citizens are not seen as a reliable partner (ibid., 1342; Magno and Cassia Citation2015). A fourth organizational factor is the presence or absence of incentives to start co-production. For public officials, ‘it is often unclear to what extent public services can be improved by incorporating citizens or how co-creation creates budgetary benefits’ (Voorberg, Bekkers, and Tummers Citation2015, 1343; see also Magno and Cassia Citation2015). We will elaborate these four, highly interrelated organizational factors in the context of the adoption and implementation of DPPs.
2.2.1. Compatibility of public organizations
Once a public organization has set up a DPP, awareness among the target group of citizens is an important dimension of participation. Reasons or motivations for non-participation can range from lack of awareness to disinterest, abstention, and exclusion (Lutz and Hoffmann Citation2017; Saunders et al. Citation2021). Hence, DPP deployment must be part of a wider embedded multichannel participation approach that taps into offline and online information channels that easily fit with citizens’ daily routines (Afzalan and Muller Citation2018; Falco and Kleinhans Citation2018a; Hjerpe, Glaas, and Storbjörk Citation2018).
According to Bovaird and Loeffler (Citation2012, 1119), ‘citizens are only willing to co-produce in a relatively narrow range of activities that are genuinely important to them and are keen that their co-production effort is not wasted by public agencies’. Therefore, a key challenge for DPP adoption is the extent to which users feel that participation is rewarded by the public organization, by responding to users’ input or highlighting the links between user input and the preferred outcome (Parrado et al. Citation2013). These interactions emphasize the need for a clear phasing of the public engagement process, from crowdsourcing inputs to responses, discussion, filtering, feedback and siphoning towards scenarios or solutions. Here, expectation management is of key importance. New technologies, such as DPPs, often come ‘bundled with the expectations that there will be a positive change or improvement in how citizens relate to governments’ (Robinson and Johnson Citation2020, 60). Users expect that their time and efforts will pay off, particularly if they are aware that it is not always possible to identify how the produced data are employed in the urban planning process (Hasler, Chenal, and Soutter Citation2017; Eriksson, Fredriksson, and Syssner Citation2021; Saunders et al. Citation2021).
Solutions co-created through DPPs usually need to be legitimized and approved in democratic decision-making bodies such as local councils. There is often a time gap between the establishment of a range of options through the DPP and the resulting changes in the built environment, physical infrastructures or community services (Hasler, Chenal, and Soutter Citation2017; Wilson, Tewdwr-Jones, and Comber Citation2019). Furthermore, there is a risk of ‘cherry-picking’ from citizen inputs to support existing presumptions for decision-making, which can affect the transparency of both participation and decision-making processes (Kahila-Tani, Kyttä, and Geertman Citation2019). Hence, digital participation can create an ‘illusion of participation and influence’, as the workings of representative democracy for decision-making in urban affairs may not coincide with the outcomes of participatory decision-making (Swyngedouw Citation2005; Fung Citation2015; Babelon Citation2021).
Another key consideration concerns the question of whether users can remain anonymous or whether they should register in order to use the platform. Anonymous comments or other inputs can raise concerns about their validity and representativeness (Kahila-Tani, Kyttä, and Geertman Citation2019). Registration places substantial demands on planners regarding assessments of data quality, ethical and privacy issues (Hasler, Chenal, and Soutter Citation2017; Afzalan and Muller Citation2018). For instance, different modes of user registration and logging onto DPPs, e.g. through a Facebook or Google account, can hinder participation due to privacy issues, at the same time as user registration may give local authorities insight about participant demographics (Babelon Citation2021).
2.2.2. Attitudes to citizen participation and co-production
In line with the promise of online interactivity and ubiquitous communications, many civil servants and public officials are sincerely supportive towards platform-based co-production with citizens (Linders Citation2012; Afzalan and Muller Citation2018). Even in case of clear political support, some of their colleagues might be hesitant or even outright against an online co-production process with citizens. Apart a reluctance to lose status and control (Voorberg, Bekkers, and Tummers Citation2015), they perceive strong pressure from the public to respond real-time to citizens’ inputs, which requires a lot of resources (Falco and Kleinhans, Citation2018b). Furthermore, making mistakes during the interaction or making promises which cannot be fulfilled, bears the risk of political consequences and sparking or strengthening distrust. Civil servants may also refer to ‘negative participation legacies’. These are previous experiences with public participation attempts that did not work out as expected or simply failed to attract a sufficient critical mass of participants. Finally, civil servants face the daunting task of filtering from the ‘wisdom of the crowds’ towards a narrow selection of inputs in the context of scarce resources (Seltzer and Mahmoudi Citation2013; Hasler, Chenal, and Soutter Citation2017). This process of filtering reveals the power exercised by planning officials in determining which inputs reach formal decision-making (Eriksson, Fredriksson, and Syssner Citation2021) and inherently involves ‘disqualifying’ inputs from users, unless the process is fully based on voting by platform users.
2.2.3. Organizational/administrative culture
The intentions of public agencies to enlarge digital participation by ‘the public’ raise significant organizational challenges. In fact, digital participation often requires a fundamental revision of daily routines, workflows and protocols. First, agencies need to meet regulations on privacy, data protection and security, and accessibility of media, for example for people with various disabilities or language minority groups (Bricout et al. Citation2020). Secondly, agencies need to prepare clear strategy and policy guidelines on how to co-ordinate and stimulate digital participation. Such guidelines should include demographics, target population and stakeholders, feedback, monitoring, and measuring activities on DPPs (Bryer and Zavattaro Citation2011; Falco and Kleinhans Citation2018b). Both factors (regulations and policy guidelines) require signification co-ordination, workflow integration, and collaboration across departments of public agencies. Third, the revision should include necessary changes in the ‘back offices’ of governments to adequately respond to inputs and establish meaningful interactions with and among citizens. This not only requires the availability of expertise and experienced in-house staff capable of ‘managing’ digital participation using DPPs, but also a lot of ‘learning by doing’ (Bryer and Zavattaro Citation2011; Jones et al. Citation2015; Falco and Kleinhans Citation2018b). As a prerequisite to this revision, overcoming an outdated organizational culture which underestimates the value of citizens’ input constitutes a major challenge (Voorberg, Bekkers, and Tummers Citation2015; see also Nabatchi Citation2012).
2.2.4. Incentives for co-production
The take-up rates of co-production platforms and apps can be low, implying unrepresentativeness and that a large segment of the population does not have access to or does not feel comfortable making use of online collaboration tools, risking further empowering only the already empowered (Linders Citation2012, 452; Nabatchi Citation2012). While the COVID-19 pandemic has accelerated a shift to technology-mediated, pervasive, applications across society, disparities in digital literacy, access, affordability and usability continue to pose challenges for marginalized populations (Bricout et al. Citation2020, 94–95; Robinson and Johnson Citation2020). Lowering the adoption barriers and providing user-friendly DPP functionalities are very important but not sufficient conditions for a wide take-up. Basically, target groups must be aware of the existence and purposes of DPPs, so enhancing visibility is crucial. Promotional campaigns across multiple sources and media can provide clear incentives by increasing the visibility and legitimacy of DPPs (Stratigea, Papadopoulou, and Panagiotopoulou Citation2015; Hjerpe, Glaas, and Storbjörk Citation2018), and trained staff should be assigned to facilitate user inputs and online conversations (Jones et al. Citation2015). The added value of pursuing networked co-production through DPPs needs to be clear and shared across all those involved.
Based on the preceding contextualization of organizational conditions for networked co-production, the left part of provides the analytical framework that will be used for the empirical analysis.
3. Methodology
As this paper aims to provide a better understanding of the organizational conditions for successful adoption and implementation of networked co-production, we have chosen to study the adoption and implementation of a limited number of DPPs in more detail. Based on a systematic literature review of participatory platforms across the world (Falco and Kleinhans Citation2018a), we have selected seven platforms which provide relevant examples to answer our research question. The selection was based on three criteria: (1) application to a real-world case where the engagement process had already been completed and final decisions had been made or were close to being made; (2) deployment of multiple platform features that facilitated two-way interaction between citizens and professionals, and (3) feasibility of conducting as many semi-structured interviews as possible. The scarcity of potential, well-documented and ‘completed’ cases required us to cast our net widely, while acknowledging travel resource restrictions, which excluded countries outside Europe. We do not claim that our selection is in any way representative or that it represents certain (dis)connections between institutional and organizational factors across countries, as the selection criteria are more related to practicalities and stages of development. Obviously, implementation of platform-based produced solutions would offer ultimate ‘proof’ of the potential and conditions for DPPs to enable co-production. However, considering the large time gap between plan approval and (offline) realization, at least in urban development, we do not limit ourselves to implemented examples of co-production.
The platforms and the relative cities where they have been/are being adopted and implemented are: TransformCity (Amsterdam), CitizenLab (Hasselt and Schiedam), Commonplace (Newcastle), Carticipe (Lille), Cap Collectif (Grenoble, Rennes), Stickyworld (Hexham), Minstad (Gothenburg). We started our data collection in January 2018 throughout September 2019 by means of semi-structured interviews. These were conducted face to face, with phone interviewing as an alternative when face to face was not feasible. We have conducted a total of 27 semi-structured interviews with three to four key informants per case study (see Appendix). Interviews have been conducted initially with the communication officer or local councillor. Through the snowballing technique, we reached out to project managers, the responsible person at the platform company and to other relevant stakeholders. After obtaining informed consent, the interviews lasted approximately 1 hour and revolved around three main themes: platform adoption, the embedding of the DPP in the public participation process, and offline outcomes and decisions. Interviews were transcribed verbatim in order to avoid any misinterpretation and to minimize personal bias in the analysis of the main aspects. For the coding of the interviews and identifying themes (see the left part of ), we have initially used the software Atlas.ti and completed the coding manually.
4. Results
In this section we highlight the main organizational and process-related conditions that are at the basis of DDP-based co-production in planning. The analysis follows the structure of the analytical framework (see ).
4.1. Compatibility of public organizations
4.1.1. Phasing the engagement process and expectation management
According to our respondents, phasing the engagement process and expectation management deliver ‘by-products’ that are essential to co-production efforts, such as increased trust in government and avoidance of too high or false expectations by engaged citizens regarding how their input will be used and how the process will unfold. Our interviewees highlighted the importance of at least three (overlapping) phases once the co-production process has started on the DPP: (1) input; (2) analysis, which involves qualitative and quantitative analysis of comments, votes, ideas; and (3) feedback. As one interviewee from the platform Cap Collectif stated:
Our methodology is grounded in a stepwise approach to citizen participation, featuring an idea submission phase, different analytical phases, and a feedback phase about what has been decided and why, including a clear explanation of what will be done as a result.
While these phases should have a clearly defined timeline to manage the expectations of citizens, they do not represent a linear process by default, but rather a more iterative one. Communication about the phases of analysis, filtering, approval and implementation of a project or plan is fundamental to avoid loss of interest and disappointment on the part of the citizens and thus feeds into management of expectations. This is one example of the strong relationship between the factors ‘compatibility’ and ‘incentives for co-production’. One of our interviewees, a city councillor, in relation to a co-production project for a new design for a city park highlighted that the platform fell into disuse for a while after the feedback phase:
The political discussion about which plan was approved took longer than we anticipated at first. So, that is one of our lessons that we learned. We put a really strict timing on the platform with a timeline and we were not able to follow it. And there was a really long time between the input we got from the people and the actual results. We took the ideas to a design company, who needed a few months to come up with a plan. And the plan had to go for approval, which was a bit of a discussion (…), and the administrative, legal stuff on finding a contractor and tender process.
Apart from the timing, a key consideration is whether (aggregated) feedback will be provided collectively, or whether feedback is provided individually and on a real time basis. This dilemma is illustrated by one of our interviewees from the Hasselt case, where the ideas that received the most likes on the platform were incorporated into the redesign of the park. Only after the completion of this redesign, the local authority publicly communicated which ideas were used and which ones not used, and for which reasons. However, this ruled out the possibility of individual feedback and subsequent online discussion about this feedback.
Feedback is also relevant for expectation management. Several respondents have suggested a direct relationship between citizens’ perceived level influence of ‘being heard’, involvement, and feedback on their input. It is widespread knowledge in the participation literature that feeling ownership over an issue makes people more likely to speak out, but only if they feel that this can make a difference. This also applies to the use of DPPs (see e.g. Parrado et al. Citation2013; Saunders et al. Citation2021). One interviewee for the Newcastle case study stated that:
… these things are dual-edged, because if you consult and then you ignore most of the feedback that you gain, people very quickly will work out: ‘actually, it is not worth my time or effort to say anything’.
If we consider individual citizen suggestions, it is difficult to measure their actual influence on planning. Apart from the fact that any planning process can include many online suggestions by citizens, it might be difficult to show direct links between citizens’ inputs and final outcomes, because the process subsequently includes (political) choices and other complexities.
4.1.2. Embedding DPP uses in a wider multi-channel process
Technological features play an important role in facilitating co-production. However, as highlighted by previous studies (Falco and Kleinhans, Citation2018b; Royo, Pina, and Garcia-Rayado Citation2020; Babelon Citation2021; Mehmood and Imran Citation2021), it is not the availability of technology per se that determines the success of co-production efforts through DPPs. This is stressed by many interviewees, including the DPP software companies. One interviewee from the Carticipe platform made a plea for a comprehensive approach to the use of DPPs:
We are apostles of what we call the ‘phygital’, which blends both digital and physical/in-person methods, which amount to methodologies that aim to broaden participation and generate results. Building on the premise that we are a process, we aren’t a tool for continuous engagement; we have no intention of become one.
4.1.3. User registration or anonymity?
Posting, commenting and voting are features of all studied DPPs. During the interviews, an interesting discussion appeared with regard to the revealed information of platform users. In some cases, commenting was allowed in an anonymous form, whereas in other cases, user registration was required and anonymity was not allowed. Each of the two options has its pros and cons regarding participation rates, the moderation of comments, data quality, ethics and privacy requirements, and the ‘democratization’ of contributions (e.g. Afzalan and Muller Citation2018; Kahila-Tani, Kyttä, and Geertman Citation2019). Respondents in favour of anonymous comments argue that this allows for more participation quantitatively, by lowering the entry barriers, whereas those in favour of user registration argue that user registration allows for more meaningful and well-considered comments thus leading to a lower need for moderation by the platform administrators, a point that was raised by the engagement officer from the Schiedam.
However, ethical and privacy issues may not only be a concern for planners (Hasler, Chenal, and Soutter Citation2017; Bricout et al. Citation2020). For reasons linked to privacy, convenience or reluctance to engage under one’s own name, user registration may prevent potential participants from submitting an idea, voting, or even comment on other posts. An interviewee at the city of Rennes explained the difficulty of striking a balance regarding the needs of various groups:
For someone who is accustomed to digital tools, it may be irritating to register because it takes time, given also that they are participating without expecting anything in return […] As for someone who is not comfortable with digital technology, such as an older or socially deprived citizen with little access to internet, they might find it complicated to log onto the platform.
4.2. Attitudes towards co-production and the organizational culture
The analysis has revealed that the second and third condition for DPP-based co-production are strongly related, so they will be discussed here jointly. Especially for the stage of adoption, political support is a prerequisite that needs to be in place for any DPP-based co-production effort to work. In line with the literature (e.g. Linders Citation2012; Afzalan and Muller Citation2018), clear political commitment and positive political support have, in fact, been mentioned by all interviewees, regardless of their position. Several respondents highlighted that indispensable support not only concerns processes and procedures, but particularly also willingness of individual civil servants and politicians to use the platform.
However, councillors and officers within local planning agencies can also resist the adoption of DPPs for co-production efforts. The interviews highlighted several reasons why this can happen, which are strongly in line with the literature: lack of adequate staff (Jones et al. Citation2015), fear of giving away power (Voorberg, Bekkers, and Tummers Citation2015), a firm belief in the role and effectiveness of representative democracy, fear of having to dedicate too much time to online moderation (Falco and Kleinhans, Citation2018b), preference for offline methods, and a perception that citizen participation is not much needed at all (Nabatchi Citation2012). Sometimes, the issue basically comes down to insufficient staff capacity to take on the extra work.
Emphasizing the role of representative democracy, the analysis revealed that while city council members may fully support participation, they may also express the opinion that their elected position enables them to decided what is best for all people in their constituency (see also Swyngedouw Citation2005; Fung Citation2015; Babelon Citation2021). One respondent from the Hasselt case revealed various forms of reluctance in the public agency:
From a lot of different angles: the fear of giving away power, of making false expectations, of eh, yes making people unhappy if you ask what they want and then you cannot give it. But also, from the administration there is a fear that it is a lot of work and the fear of a digital platform, that is not easy for everyone.
The interviews revealed that role of the civil servants involved in the co-production process may be expanded to have a say in choosing the platform that best fits their needs and technological expertise, along with the determination of priorities and matters for which a co-production process is appropriate. Regarding the stage of implementation, we find that a DPP-based co-production effort requires input and commitment from various parts of departments within public agencies. To make a participatory process as smooth as possible, existing workflows need to be co-ordinated and integrated, which is dependent on both the organizational culture and the aforementioned preparedness of individual public officers. The need for communication and co-ordination between different departments involved is in line with previous research on organizational requirements for DPPs-based co-production efforts (Falco and Kleinhans, Citation2018b; Afzalan, Sanchez, and Evans-Cowley Citation2017). In view of workflow integration, collaboration and the associated changes in organizational culture, the Rennes case has put in place an interesting initiative called ‘network of public participation ambassadors’ to support co-production. One respondent explained as follows:
We will set up an internal repository with extensive information about public participation, including info sheets about methodologies, case studies, and practical facilitation tools. We will also set up an intra-organizational network of public participation ambassadors. This is a bit of a cut-and-paste from our existing experience with participatory budgeting, whereby we already have a member of staff in the drop-in offices in every neighbourhood who is knowledgeable about participatory budgeting […] And we will launch a training programme for staff around public participation.
While co-production processes may require culture changes, they can also help to grow a new organizational culture underpinned by a strong citizen-centric approach and greater transparency. Several respondents observed that the platform helped to operationalize the city’s wider commitment in terms of transparency: A respondent from Rennes explained that:
We have a transparent accountability of activity on the platform, including a list with the number of paper votes and digital votes per participatory budgeting project. It is part of the city council’s public participation charter, whereby we commit to be as transparent as possible. One can also find such data on the city’s Open Data portal.
4.3. Incentives for co-production
The analysis shows that this condition’s importance is twofold. On the one hand, all interviewees agree on the need to invest heavily in publicity, external communication and promotional campaigning before a DPP-based co-production effort can start (cf. Stratigea, Papadopoulou, and Panagiotopoulou Citation2015; Hjerpe, Glaas, and Storbjörk Citation2018). Obviously, the intention is to engage as many participants as possible across different socioeconomic and demographic profiles. On the other hand, carefully considered incentives and support are needed to mitigate digital illiteracy and the digital divide that still emerges in various guises. In terms of promotional campaigning, the Amsterdam case shows how such efforts can be meaningfully contextualized in the target area. The platform co-founder explained that
… we have done off-line guerrilla-fundraisers in the area itself. We have been putting posters and postcards in the cafes. It is very important (…). We had newsletters, we have social media accounts. We have sessions (…) and events that we organize and we all connect them to the platform. So, it is really on-line/off-line combination. People want to know the faces behind the platform.
With regards to online campaigning, an interviewee from the Hexham case highlighted the advantages of videos and other media content to spark the interest of citizens. In addition, personalization and online branding through the use of city logos and official graphics contributes to the perception on the part of citizens of institutional and official support and adoption. A particularly technology-based incentive for co-production was mentioned in the Gothenburg case. It concerns the importance of map-based visualization in placing and pinning new ideas with a clear spatial location and spatial consequences. The Minstad platform used 3D visualization, which helped enormously to facilitate insight and understanding among platform users:
3D visualisation provides a whole different perspective than 2D maps. One can understand volumes and the overall context in a totally different way. Users can experience the city in 3D, which was what we developed from the beginning. It is much harder on a 2D map to experience space and how things relate to each other.
There were a lot of citizens who actually emailed me and said: ‘can you help me to put this idea, because I have this idea, but I don’t know how to put it on the platform’. Some of them said ‘OK, we looked at the platform but it did not really look like it was for us’. You know, because it looks too technical to them.
After having spoken with neighbourhood representatives, we decided to restore the physical vote rather than just keep the voting procedure digital, because people were not able to use the digital platform, which has led us to question the use of the platform somewhat.
5. Discussion
We structure our analysis of the findings based on our analytical framework (see ). Rather than fully discrete, the four conditions are interdependent and co-constitutive.
5.1. From compatibility to pro-activity/agility
With regards to compatibility of public agencies, the interviews have revealed strong relationships between the iterative phasing of the co-production process, management of expectations towards platform users, and the provision of feedback on platform inputs, provided collectively, individually, at certain moments, or on a real time basis. In fact, the results show that the public agencies and the procured platform companies should not just be compatible to DPP-supported co-production, but should enact pro-active and agile phasing of the participation, multichannel ecologies of (communication) tools, methods, and publics. Agility and pro-activity should also manifest through organizational attitudes, workflows, and cultures (Section 5.2), emphasizing the interdependent nature of the organizational conditions.
A ‘phygital’ approach, i.e. a participatory methodology that is at once digital and in-person/physical, provides an effective entry point into such multichannel participation ecologies. Such a hybrid approach to networked co-production is based on an appropriation of the recursive value potential of well-crafted, human-centred participation both through and beyond DPPs (Babelon Citation2021). Seltzer and Mahmoudi (Citation2013, 13) already highlighted that ‘useful citizen involvement will be the result of a multiplicity of techniques and opportunities in a planning process, not a single form or moment in time’ (see also Saunders et al. Citation2021).
The reasoning behind a ‘phygital’ approach not only concerns addressing various human needs, but also preventing the exclusion of participants. People may feel more confident on a DPP than in a traditional setting where they may experience public speaking anxiety, and thus become excluded – a manifestation of the ‘illusion of transparency’ in participation (Falco Citation2016). While DPPs can limit participation biases arising from the overriding influence of more vocal participants at public meetings, group influence can nonetheless affect the way in which individual users interact with a DPP. Individual users may be influenced by other users’ comments if these are publicly visible (e.g. with Cap Collectif, Carticipe, Commonplace, Stickyworld). While in-person methods may suffer from the illusion of transparency, DPPs can suffer from the ‘illusion of participation’ in various ways. First, the interactive functionalities enable new forms of citizen input which in-person methods cannot offer and which can lead to high expectations from, but also the strong disappointment of, participants. Second, our results show that such functionalities may raise entry barriers and thus generate exclusion due to digital illiteracy. Third, our results show the existence of a sobering time gap between crowdsourced platform solutions and realization after public decision-making (Hasler, Chenal, and Soutter Citation2017; Wilson, Tewdwr-Jones, and Comber Citation2019). Finally, the implemented solutions may differ significantly from those initially proposed by citizens, as they need to be defined, refined, or limited in order to fit the competences and capabilities of the public agency (see e.g. Royo, Pina, and Garcia-Rayado Citation2020; Mehmood and Imran Citation2021).
5.2. Attitudes, appropriation and organizational culture: towards co-transformative practices
Our results confirm that political support for the adoption and implementation is a prerequisite for any DPP-based co-production effort to work. However, political support does not guarantee that all public officials are working together in the same direction. In line with earlier research, the interviews have revealed various reasons for internal reluctance, based on staff and skill deficits, losing status and control, a presumed undermining of representative democracy (Fung Citation2015; Voorberg, Bekkers, and Tummers Citation2015; Kahila-Tani, Kyttä, and Geertman Citation2019; Royo, Pina, and Garcia-Rayado Citation2020), and fear of raising expectations which cannot be met (see also Section 5.1).
Our results show that part of the reluctance within public agencies is rooted in a lack of appropriation of a DPP-based co-production approach due to realistic concerns. Public agencies, and individual staff working there, should be encouraged and able adapt DPPs to their own specific needs and purposes. Such appropriation, particularly if led by ‘champions’ within the organization, can help to change attitudes towards DPPs and co-production during the course of a project or over time across several projects (Babelon Citation2021). Where DPP adoption induces undue staff workloads without the provision of additional resources, e.g. more allocated staff hours or new staff hire, procured consultancy services or in-house training, staff attitudes will unlikely improve.
By providing evidence that DPP technology and workflows shape each other recursively, our findings also indicate that effective adoption and implementation of DPPs is achieved through: (1) continuous realignment between client needs and DPP functionalities; (2) providing resources for experimentation and supporting ‘learning by doing’ approach among organizational staff, especially for first-time adopters; (3) sharing investment costs and benefits across departments; (4) appropriate internal co-ordination and administration of the DPP back-end system, where relevant; and (5) the presence of experienced in-house staff, such as public participation professionals, as opposed to subject-specific planning experts. Ultimately, of course, ‘public participation can only be understood in terms of the decision-making context in which it is embedded’ (Lane Citation2005, 297). A critical pragmatic analysis of the decision-making context, and the way in which it both stems from and encourages transformative practices, deserves an empirical paper of its own, as it extends beyond organizational factors per se.
5.3. From incentives to intrinsic, co-generative motivation
The results show that incentives are needed to start any DPP-based co-production effort and to engage as many participants as possible with various profiles and interests. Beyond the pre-requisites of promotional campaigning and strategies to overcome digital divides, incentives should both comprise forward-looking outcomes (i.e. generating longer-term, less immediately tangible positive outcomes, such as the UN-SDG goals) and offer something to look forward to. Examples of the latter are more immediate rewards, such as rapid self-efficacy in conducting DPP projects, or quick tangible outcomes in terms of massifying public participation compared to more traditional methods. Previous research has also shown the importance of feedback and platform users seeing their contributions being implemented or otherwise taken into account (e.g. Bryer and Zavattaro Citation2011; Falco and Kleinhans Citation2018b; Royo, Pina, and Garcia-Rayado Citation2020; Eriksson, Fredriksson, and Syssner Citation2021). Such intrinsic motivation is ideally shared or co-generative, leading to ‘win-win-win’ situations among public officers, citizens and elected officials, on the basis of growing mutual trust, greater democratic leverage, or rising collective interest in civic matters and urban affairs. Compelling ‘dialogue’ presupposes that participation shapes the very context or ‘frame’ in which participation takes place (Swyngedouw Citation2005). There are also intrinsic differences and complementarities between ‘participation’ as the identification of solutions, and ‘deliberation’ as the identification and exploration of the actual issues at stake (Hildreth Citation2012).
6. Conclusions and further research
Through a set of interviews with public agency and platform stakeholders, this study seeks to answer the question of how key organizational conditions affect the adoption and implementation of DPPs as a tool for co-production of planning solutions. The four co-production conditions in our analytical framework and our results critically emphasize the need to adopt holistic approaches to networked co-production. We conclude that these four key organizational conditions are strongly interrelated in their shaping of the implementation of DPPs for co-production purposes. These conditions can create, nurture but also thwart hybrid ‘ecologies of co-production’ that reflexively harness the evolving interdependencies between technology use and planning practices. Such ‘ecologies of co-production’ recognize both the strengths and limitations of multiple tools, methods and approaches and how these can align with particular moments and phases in the temporal continuum of co-productive planning processes. If used carefully, DPPs can augment the whole life cycle of planning projects and policies (Kahila-Tani Citation2015). Their use-value and return on cost/time investment can accrue over time as both public agency and planning professionals and citizens become more familiar with their use.
This study contributes to the literature in several ways. First, by providing an elaboration of the framework by Voorberg, Bekkers, and Tummers (Citation2015), we show that the organizational conditions in the context of networked co-production through DPPs are co-constitutive and co-evolutive rather than concurrent or sequential. It is precisely for this reason that we use the term ‘ecologies of co-production’ in our conclusion. Second, in light of the ‘widely shared affirmative framing of online participation’ (Lutz and Hoffmann Citation2017, 888) and a lack of empirical analysis, our study offers a look under the proverbial bonnet of DPP-based co-production among public agency ‘forerunners’ across seven European cities. The study shows that DPP use among public agencies not only continues to feature extensive experimentation and ‘learning by doing’, but also reveals a significant scope for improvement. Third, even with networked co-production of a solution, actors need to take into account the extended time and effort for implementing the chosen solution. This step needs to be part of the expectation management towards citizens and can be supported by regular online feedback regarding the implementation process.
Obviously, this study has limitations. By elaborating an existing typology (Voorberg, Bekkers, and Tummers Citation2015), our study cannot offer a fully encompassing analysis of organizational conditions for DPP-based co-production (which is also reflected in the partial coverage of the model in ). Furthermore, our results are based on self-reported attitudes and views from public agencies and platform companies at a fixed point in time, and from different countries with highly different contexts. These offer a limited view on the dynamics over time. Regardless of our deliberate choice to limit our target group to public agencies and platform companies, we fully acknowledge the fundamental importance of citizens’ experiences with DPP-based co-production. Further research should therefore adopt a longitudinal approach and monitor citizens’ and public agency professionals’ perspectives and experiences over the course of a co-production project. Future empirical research can also compare the ways in which different modes of digital participation influence both the type, quality and quantity of input that individual users provide. Finally, our study included only examples of DPPs developed by commercial platform companies. Future research may examine examples of local, non-corporate and open-source platforms that are not owned by private companies, but nevertheless play an important role in urban planning.
DPP_Annex_Anew1.docx
Download MS Word (30.9 KB)Acknowledgements
We are indebted to all representatives of local public agencies and platform companies who participated in the interviews. We also thank the two anonymous reviewers and the editor, whose comments helped us to improve the manuscript.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
Notes
1 SDG 11.3 aims to ‘enhance inclusive and sustainable urbanization and capacity for participatory, integrated and sustainable human settlement planning and management in all countries’.
2 SDG 16.6 aims to ‘develop effective, accountable and transparent institutions at all levels’.
References
- Afzalan, N., and B. Muller. 2018. “Online Participatory Technologies: Opportunities and Challenges for Enriching Participatory Planning.” Journal of the American Planning Association 84 (2): 162–177. doi:https://doi.org/10.1080/01944363.2018.1434010.
- Afzalan, N., T. Sanchez, and J. Evans-Cowley. 2017. “Creating Smarter Cities: Considerations for Selecting Online Participatory Tools.” Cities 67: 21–30. doi:https://doi.org/10.1016/j.cities.2017.04.002.
- Babelon, I. 2021. “Digital Participatory Platforms in Urban Planning.” PhD Thesis, Northumbria University, Newcastle, UK. http://nrl.northumbria.ac.uk/id/eprint/45337/.
- Bovaird, T. 2007. “Beyond Engagement and Participation: User and Community Coproduction of Public Services.” Public Administration Review 67 (5): 846–860. doi:https://doi.org/10.1111/j.1540-6210.2007.00773.x.
- Bovaird, T., and E. Loeffler. 2012. “From Engagement to Co-Production: The Contribution of Users and Communities to Outcomes and Public Value.” Voluntas: International Journal of Voluntary and Nonprofit Organizations 23 (4): 1119–1138. doi:https://doi.org/10.1007/s11266-012-9309-6.
- Brandsen, T., and M. Honingh. 2016. “Distinguishing Different Types of Coproduction: A Conceptual Analysis Based on the Classical Definitions.” Public Administration Review 76 (3): 427–435. doi:https://doi.org/10.1111/puar.12465.
- Bricout, J., P. Baker, N. Moon, and B. Sharma. 2020. “Exploring the Smart Future of Participation: Community, Inclusivity, and People with Disabilities.” International Journal of E-Planning Research 10 (2): 94–108. doi:https://doi.org/10.4018/IJEPR.20210401.oa8.
- Brown, G., and M. Kytta. 2014. “Key Issues and Research Priorities for Public Participation GIS (PPGIS): A Synthesis Based on Empirical Research.” Applied Geography 46: 122–136. doi:https://doi.org/10.1016/j.apgeog.2013.11.004.
- Bryer, T., and S. Zavattaro. 2011. “Social Media and Public Administration.” Administrative Theory & Praxis 33 (3): 325–340. doi:https://doi.org/10.2753/ATP1084-1806330301.
- Davis, A., and J. Andrew. 2018. “From Rationalism to Critical Pragmatism: Revisiting Arnstein’s Ladder of Public Participation in Co-Creation and Consultation.” https://apo.org.au/node/178271.
- De Souza, K., and A. Bhagwatwar. 2014. “Technology-Enabled Participatory Platforms for Civic Engagement: The Case of U.S. Cities.” Journal of Urban Technology 21 (4), 25–50. doi:https://doi.org/10.1080/10630732.2014.954898.
- Eriksson, E., A. Fredriksson, and J. Syssner. 2021. “Opening the Black Box of Participatory Planning: A Study of How Planners Handle Citizens’ Input.” European Planning Studies, 1–19. doi:https://doi.org/10.1080/09654313.2021.1895974.
- Falco, E. 2016. “Digital Community Planning. The Open source way to the top of Arnstein’s Ladder.” International Journal of E-Planning Research 5 (2): 1–22. doi:https://doi.org/10.4018/978-1-5225-7030-1.ch067.
- Falco, E., and R. Kleinhans. 2018a. “Digital Participatory Platforms for Co-Production in Urban Development: A Systematic Review.” International Journal of E-Planning Research 7 (3): 52–79. doi:https://doi.org/10.4018/IJEPR.2018070105.
- Falco, E., and R. Kleinhans. 2018b. “Beyond Information Sharing. A Typology of Government Challenges and Requirements for Two-Way Social Media Communication with Citizens.” Electronic Journal of E-Government 16 (1): 18–31. https://academic-publishing.org/index.php/ejeg/article/view/649/612.
- Fredericks, J., and M. Foth. 2013. “Augmenting Public Participation: Enhancing Planning Outcomes Through the Use of Social Media and Web 2.0.” Australian Planner 50 (3): 244–256. doi:https://doi.org/10.1080/07293682.2012.748083.
- Fung, A. 2015. “Putting the Public Back into Governance: The Challenges of Citizen Participation and Its Future.” Public Administration Review 75 (4): 513–522. doi:https://doi.org/10.1111/puar.12361.
- Goodchild, M. 2007. “Citizens as Sensors: The World of Volunteered Geography.” GeoJournal 69 (4): 211–221. doi:https://doi.org/10.1007/s10708-007-9111-y.
- Gün, A., Y. Demir, and B. Pak. 2019. “Urban Design Empowerment Through ICT-Based Platforms in Europe.” International Journal of Urban Sciences 24 (2): 189–215. doi:https://doi.org/10.1080/12265934.2019.1604250.
- Hasler, S., J. Chenal, and M. Soutter. 2017. “Digital Tools as a Means to Foster Inclusive, Data-Informed Urban Planning.” Civil Engineering and Architecture 5 (6): 230–239. doi:https://doi.org/10.13189/cea.2017.050605.
- Healey, P. 1998. “Collaborative Planning in a Stakeholder Society.” The Town Planning Review 69 (1): 1–21. doi:https://doi.org/10.3828/tpr.69.1.h651u2327m86326p.
- Hildreth, R. 2012. “Word and Deed: A Deweyan Integration of Deliberative and Participatory Democracy.” New Political Science 34 (3): 295–320. doi:https://doi.org/10.1080/07393148.2012.703852.
- Hjerpe, M., E. Glaas, and S. Storbjörk. 2018. “Scrutinizing Virtual Citizen Involvement in Planning: Ten Applications of an Online Participatory Tool.” Politics and Governance 6 (3): 159–169. doi:https://doi.org/10.17645/pag.v6i3.1481.
- Jankowski, P., K. Forss, M. Czepkiewicz, H. Saarikoski, and M. Kahila. 2021. “Assessing Impacts of PPGIS on Urban Land Use Planning: Evidence from Finland and Poland.” European Planning Studies, 1–20. doi:https://doi.org/10.1080/09654313.2021.1882393.
- Jones, P., A. Layard, C. Speed, and C. Lorne. 2015. “MapLocal: Use of Smartphones for Crowdsourced Planning.” Planning Practice and Research 30 (3): 322–3236. doi:https://doi.org/10.1080/02697459.2015.1052940.
- Kahila-Tani, M. 2015. “Reshaping the Planning Process Using Local Experiences: Utilising PPGIS in Participatory Urban Planning.” PhD Thesis, Aalto University, Helsinki. http://urn.fi/URN:ISBN:978-952-60-6604-2.
- Kahila-Tani, M., M. Kyttä, and S. Geertman. 2019. “Does Mapping Improve Public Participation? Exploring the Pros and Cons of Using Public Participation GIS in Urban Planning Practices.” Landscape and Urban Planning 186: 45–55. doi:https://doi.org/10.1016/j.landurbplan.2019.02.019.
- Lane, M. 2005. “Public Participation in Planning: An Intellectual History.” Australian Geographer 36 (3): 283–299. doi:https://doi.org/10.1080/00049180500325694.
- Linders, D. 2012. “From e-Government to We-Government: Defining a Typology for Citizen Coproduction in the Age of Social Media.” Government Information Quarterly 29 (4): 446–454. doi:https://doi.org/10.1016/j.giq.2012.06.003.
- Lutz, C., and C. Hoffmann. 2017. “The Dark Side of Online Participation: Exploring Non-, Passive and Negative Participation.” Information, Communication & Society 20 (6): 876–897. doi:https://doi.org/10.1080/1369118X.2017.1293129.
- Magno, F., and F. Cassia. 2015. “Public Administrators’ Engagement in Services Co-Creation: Factors That Foster and Hinder Organizational Learning About Citizens.” Total Quality Management & Business Excellence 26 (11-12): 1161–1172. doi:https://doi.org/10.1080/14783363.2014.918706.
- Mehmood, A., and M. Imran. 2021. “Digital Social Innovation and Civic Participation: Toward Responsible and Inclusive Transport Planning.” European Planning Studies 29 (10): 1870–1885. doi:https://doi.org/10.1080/09654313.2021.1882946.
- Meijer, A. 2011. “Networked Coproduction of Public Services in Virtual Communities: From a Government-Centric to a Community Approach to Public Service Support.” Public Administration Review 71 (4): 598–607. doi:https://doi.org/10.1111/j.1540-6210.2011.02391.x.
- Nabatchi, T. 2012. “Putting the ‘Public’ Back in Public Values Research: Designing Participation to Identify and Respond to Values.” Public Administration Review 72 (5): 699–708. doi:https://doi.org/10.1111/j.1540-6210.2012.02544.x.
- Ostrom, E. 1996. “Crossing the Great Divide: Coproduction, Synergy, and Development.” World Development 24 (6): 1073–1087. doi:https://doi.org/10.1016/0305-750X(96)00023-X.
- Parrado, S., G. Van Ryzin, T. Bovaird, and E. Löffler. 2013. “Correlates of Co-Production: Evidence from a Five-Nation Survey of Citizens.” International Public Management Journal 16 (1): 85–112. doi:https://doi.org/10.1080/10967494.2013.796260.
- Roberts, N. 2004. “Public Deliberation in an Age of Direct Citizen Participation.” American Review of Public Administration 34 (4): 315–353. doi:https://doi.org/10.1177/0275074004269288.
- Robinson, P., and P. Johnson. 2020. “Pandemic-Driven Technology Adoption: Public Decision Makers Need to Tread Cautiously.” International Journal of E-Planning Research 10 (2): 59–65. doi:https://doi.org/10.4018/IJEPR.20210401.oa5.
- Royo, S., V. Pina, and J. Garcia-Rayado. 2020. “Decide Madrid: A Critical Analysis of an Award-Winning e-Participation Initiative.” Sustainability 12 (4): 1674. doi:https://doi.org/10.3390/su12041674.
- Saunders, M., et al. 2021. Engaging for the Future. London: Commonplace.
- Seltzer, E., and D. Mahmoudi. 2013. “Citizen Participation, Open Innovation, and Crowdsourcing: Challenges and Opportunities for Planning.” Journal of Planning Literature 28 (1): 3–18. doi:https://doi.org/10.1177/0885412212469112.
- Stratigea, A., C. Papadopoulou, and M. Panagiotopoulou. 2015. “Tools and Technologies for Planning the Development of Smart Cities.” Journal of Urban Technology 22 (2): 43–62. doi:https://doi.org/10.1080/10630732.2015.1018725.
- Swyngedouw, E. 2005. “Governance Innovation and the Citizen: The Janus Face of Governance-Beyond-the-State.” Urban Studies 42 (11): 1991–2006. doi:https://doi.org/10.1080/00420980500279869.
- Van Eijk, C., and T. Steen. 2014. “Why People Co-Produce: Analysing Citizens’ Perceptions on Co-Planning Engagement in Health Care Services.” Public Management Review 16 (3): 358–382. doi:https://doi.org/10.1080/14719037.2013.841458.
- Voorberg, W., V. Bekkers, and L. Tummers. 2015. “A Systematic Review of Co-Creation and Co-Production: Embarking on the Social Innovation Journey.” Public Management Review 17 (9): 1333–1357. doi:https://doi.org/10.1080/14719037.2014.930505.
- Watson, V. 2014. “Co-production and Collaboration in Planning: The Difference.” Planning Theory and Practice 15 (1): 62–76. doi:https://doi.org/10.1080/14649357.2013.866266.
- Webster, C., and W. Leleux. 2018. “Smart Governance: Opportunities for Technologically-Mediated Citizen Co-Production.” Information Polity 23 (1): 95–110. doi:https://doi.org/10.3233/IP-170065.
- Wilson, A., M. Tewdwr-Jones, and R. Comber. 2019. “Urban Planning, Public Participation and Digital Technology: App Development as a Method of Generating Citizen Involvement in Local Planning Processes.” Environment and Planning B: Urban Analytics and City Science 46 (2): 286–302. doi:https://doi.org/10.1177/2399808317712515.