3,033
Views
28
CrossRef citations to date
0
Altmetric
Articles

Freezing deliberation through public expert advice

ORCID Icon & ORCID Icon

ABSTRACT

When important public issues are debated, many options for government action should be subjected to serious reflection. Constrained discussions over policy options may hamper democratic legitimacy and accountability, and produce decisions that ignore relevant reasons and facts. Hence, constrained deliberation has important consequences for knowledge construction and utilization. We advance theory on ‘epistemic policy learning’ by showing mechanisms that promote expert consensus in external arenas, and that these can hamper deliberation on public policy. Government-appointed experts, in combination with mass media, can ‘freeze’ deliberation by presenting one unified front. Comparison of national print media coverage in Sweden and Denmark during the 2009 H1N1 influenza pandemic offers support. The similar polities enacted different policies: Sweden sought to vaccinate its full population while neighbouring Denmark targeted small groups. Yet experts dominated both public discourses and echoed each other’s support of national policy. In turn, public policy debates were scant in both contexts.

Introduction

Expert judgments on advantages and pitfalls of alternative policies are often deemed appropriate to avoid policy failures (Haas Citation2004; Howlett and Wellstead Citation2011; Ingold and Gschwend Citation2014; Öberg et al. Citation2015). Recent decades have seen evidence-based policy take centre stage in recommendations for how to improve public policy effectiveness and efficiency. This prescription has been particularly pronounced for health, where randomized controlled trials and other scientific methods have a long history of enabling progress towards better outcomes. Hence, specialized scientific professionals (i.e., experts) possess knowledge that can steer public deliberations about policy. Experts appointed by the government are particularly important. Such ‘certified’ experts (Dunlop Citation2014; Stallings Citation1995) are simultaneously experts and officials, and hence combine the authority, resources and trustworthiness of their professions and of the state.

Simultaneously, normative scholarship on democracy emphasizes that expertise should aid but not dominate policy formulation (Dahl Citation1989; Turner Citation2001). Existing information may be ambiguous (Jennings and Hall Citation2012: 248), experts may have biased agendas (Mahon and MacBride Citation2009; Montpetit Citation2011), and uses of expertise often depend on political context (Boswell Citation2009a; Weible Citation2008; Weible et al. Citation2010, Citation2012). Experts and policy-makers may be conscious of and adjust to such influences (Adler and Haas Citation1992; Dunlop Citation2009: 303; Lundin and Öberg Citation2014; Öberg et al. Citation2015). Hence, expertise is often needed in public policy deliberations but is neither value-free nor purely technical (Fisher and Gottweis Citation2012). Civil society, politicians and generalist bureaucrats are therefore wise to treat expert information judiciously (Christiano Citation2012; Hajer and Wagenaar Citation2003; Hoppe Citation2005: 207; Lundin and Öberg Citation2014; Turner Citation2001).

The present analysis focuses on a quintessential ‘transboundary’ crisis (Ansell et al. Citation2010). During the 2009 H1N1 influenza pandemic (2009 H1N1), European responses were interdependent. Human influenza (flu) spreads easily across open borders (flu is highly contagious and some carriers feel no symptoms). Hence, one country’s flu response policies affect what other countries must do. For instance, vaccination (though costly) reduces the likelihood of flu spread and, hence, of infections abroad. In turn, if countries dislike other countries’ responses, then conflicts may ensue (cf. Europe’s 2015 refugee crisis). Experts can mitigate conflicts by harmonizing policy advice through transnational epistemic communities (Haas Citation1992). But expert voices that publicly legitimize policy differences between interdependent states risk exacerbating conflicts.

This article addresses whether experts in mature democracies facilitate or discourage (‘freeze’) public deliberation about policy alternatives. Given dilemmas posed by expertise, tracing experts’ impacts on policy deliberations must be important to any democratic or European agenda. Two opposing theoretical expectations are weighed. Experts might encourage public deliberation with knowledge that can help citizens form their own opinions about important policy options. Conversely, consensus-seeking within domestic epistemic communities might lead experts to disseminate little information that could spur public debate or aid deliberation on policy options (Cross Citation2013; Dunlop Citation2013; Haas Citation1989).

The article analyses public discourses in two most-similar European cases. Swedish and Danish policy on how many and who to vaccinate against 2009 H1N1 was different (see below). Yet Sweden and Denmark both faced 2009 H1N1 simultaneously, and used the same vaccine (Amato-Gauci et al. Citation2011; Mereckiene et al. Citation2012). They have similar public health conditions and health care institutions (e.g., Esping-Andersen Citation1990). Both populations tend to trust their public officials (e.g., Van de Walle et al. Citation2008). They are close neighbours with similar languages, so one’s public discourse can easily affect the other’s. Hence, the cases are suitable for exploring theories that link expert information and public policy deliberation. The article answers two research questions:

  • Did nationally certified and other experts explain alternative 2009 H1N1 vaccination options in the public arena?

  • To what extent was more than one option publicly debated?

We first review literature on the relationship between expertise and public deliberation. We then use the review’s conclusions to develop theory on logics that may lead experts to communicate a common position in the public discourse, even if they privately disagree. The methods used in our content analyses of national newspaper coverage on 2009 H1N1 vaccination in Sweden and Denmark are described and quantitative and qualitative analyses of the coverage presented with a focus on answering the two research questions.

Theory linking expert information and public deliberation

Why theorize public deliberation on policy alternatives?

Inappropriate policy instruments affect the implementation and outcome of political decisions negatively and may worsen problems that policy-makers aim to solve (e.g., May Citation2003). Uncertainty in public policy-making exacerbates policy failure risk. When policy-makers respond to crises, the risk is further increased because uncertainty coincides with critical threats and urgency (Rosenthal et al. Citation1989). Hence, expertise can reduce the risk of policy failure by reducing uncertainty; that is, by providing critical information on policy options.

In turn, policy failure risk may be reduced by public discourse on a wide range of policy options (Linder and Peters Citation1988: 740, 748). Even if scientific support for one option is overwhelming, evaluating alternatives can be the best course (Jordan et al. Citation2013). Weighing options publicly can make social problems and solutions better understood and make adequately informed decisions more likely (Barabas Citation2004; Hajer and Wagenaar Citation2003; Lundin and Öberg Citation2014; Mansbridge Citation2003: 524; Öberg et al. Citation2015; Parkinson and Mansbridge Citation2012: 11). Deliberation adds democratic legitimacy by increasing the chance of including different perspectives (Parkinson and Mansbridge Citation2012: 10). Hence, gains from public policy deliberations can outweigh burdens of marshalling more information, and considering just one policy option publicly is generally problematic (Öberg et al. Citation2015).

Despite such arguments for generating and reflecting publicly on multiple policy options, few studies have focused on alternatives considered in public discourse on policy (Howlett and Lejano, Citation2012; James and Jorgensen, Citation2009; Öberg et al. Citation2015). In turn, while scholarly interest in expert policy advice (e.g., autonomous government agencies, evidence-based policy) has recently been strong, experts’ impact on the range of policy options considered in public deliberation is under-researched.

Experts, unified public stances and ‘epistemic learning’

Reasoned discussion of policy options requires relevant information. Available information may be contested (Boswell Citation2009a; Fisher and Gottweis Citation2012; Lundin and Öberg Citation2014). But use of expert information (expertise) generally reduces policy failure risk (Christiano Citation2012; Howlett and Wellstead Citation2011; Lindblom and Woodhouse Citation1993: 22).

The ‘expertise’ concept is contested and often under-specified (Turner Citation2001). This article refers to systematically gathered information that meets standards of coherence and honesty and uses generally accepted research methods (Lundin and Öberg Citation2014: 26; Weible et al. Citation2012: 11). Expertise can be produced at universities, research institutes, consultancies, think tanks, public authorities or other organizations (Weible et al. Citation2010).

Experts require legitimation to advise an audience (Turner Citation2001). ‘Experts’ here are specialized professionals who primarily base their legitimacy on university training coupled with advanced research in virology, epidemiology or other public health fields. ‘Certified’ experts may have additional status in public deliberation. The polity appoints (certifies) some individual experts as particularly qualified to guide policy (Dunlop Citation2014; Stallings Citation1995). Certified experts carry the authority of a science and of the state, and may use state resources such as those for media relations (Weingart Citation1999). They hold official title as ‘the’ experts, and are sometimes even government’s official spokespeople on specialized issues (Dunlop Citation2014: 212). Conversely, uncertified experts can be prevented from participating by their lack of official status and resources (Dunlop Citation2014: 216; Ferretti and Pavone Citation2009). Particularly in polities where governments enjoy high public trust (such as the Nordic), ‘the’ (certified) experts are likely to be trusted sources in public deliberation.

Consensus among experts adds power to expertise. Experts commonly belong to epistemic communities of professionals with recognized competences in particular domains and authoritative claims to policy-relevant knowledge (Cross Citation2013: 142; Dunlop Citation2013; Haas Citation1992). In addition, epistemic communities are ‘a main vehicle for authoritative consensual knowledge’ (Dunlop Citation2013: 230) and for coping with complex issues. Through experts, such ‘consensual knowledge’ can ‘inform policy choices’ (Dunlop Citation2013: 230). In ‘epistemic learning’ policy processes (Dunlop Citation2014), epistemic community members use consensual knowledge to ‘teach’ political leaders and the general public about how to solve a collective problem.

Two conditions facilitate epistemic learning. First, overlap between epistemic communities and bureaucratic machineries; for example, in certified experts (Dunlop Citation2013). Second, that the community appears consensual because ‘when a group of professionals with recognized expertise is able to speak with one voice, that voice is often seen as more legitimate because it is based on a well-reasoned consensus among those in the best position to know’ (Cross Citation2013: 147; Dunlop Citation2013; Haas Citation1992). Hence, epistemic learning is likely when ‘the’ experts convey compatible information: consensus gives the information status as knowledge. Epistemic learning becomes significantly less likely when legitimate experts convey incompatible information: one expert’s information becomes mere opinion.

Epistemic community dynamics encourage public consensus among experts. Professionalization pushes community members to share basic understandings of the world (Cross Citation2013: 149). In addition, experts can find consensus strategically important (Ingold and Gschwend Citation2014). Developing consensus may include adjustments to political context (Adler and Haas Citation1992; Dunlop Citation2009). Indeed, national institutions can shape epistemic communities’ policy preferences (Baldwin Citation2005; Baekkeskov Citation2016; Dunlop Citation2013: 232; Vallgårda Citation2007). Hence, epistemic communities may generate true consensus, or may appear consensual because real debates are confined to expert forums (experts then pre-emptively adjust their public message).

Finally, crises impose pressure to appear consensual on participants in response-related debates. Crises tend to combine critical threats, uncertainty and urgency (Rosenthal et al. Citation1989). Urgency means that response delays increase risks that such policy will fail. Debate on how to respond can take time. Apparent consensus among experts may cut debates short because experts proffer one (‘the’) solution. Hence, crises can encourage experts to ‘rally to the flag’ to make responses timely; objections are kept silent for fear of delays. Conceivably, even mass media may ‘rally to the flag’ by reporting expert views that agree while ignoring dissenters (i.e., biased media selection).

In sum, experts who convey consensus can occupy asymmetrical positions as ‘social instructors’ supporting epistemic learning, rather than as debaters symmetrical to other actors in public discourses (Dunlop Citation2014: Hoppe Citation2005). Although experts may actually disagree, epistemic dynamics and crisis conditions increase the likelihood of one unified expert front; unified stances could also reflect true expert consensus or biased media selection.

How unified expert fronts play to media logics

Unified fronts among experts are likely to keep general populations ignorant of real expert disagreements because apparent consensus plays to mass media dynamics. Mass media provide crucial public policy deliberation arenas (e.g., Boswell Citation2009b). Hence, mass media coverage enables citizens to consider policy options and debate solutions. For instance, during 2009 H1N1, most Swedes received their pandemic flu information from television (64 per cent) or newspapers (63 per cent), rather than workplaces or schools (9 per cent), family or friends (4 per cent), or the internet (7 per cent) (Rapport till Socialstyrelsen Citation2009).

Experts are frequently sources in media reports. They communicate research; but they also comment on information produced elsewhere or on policy options presented by government (Albæck et al. Citation2003). Despite experts’ strong voices in mass media, communication forms and logics in experts’ own forums differ from mass media’s. Weingart et al. (Citation2000) have argued that multiple policy-relevant discourses happen in parallel and overlap little. General public discourses occur through mass media reporting and opinion coverage. Professional discourses occur between experts in specialized conferences and journals. These dissimilar discourse dynamics complicate transmission between discourses of arguments and conclusions. Successful transmission depends on ‘playing by the rules’ of each discourse. Hence, effectively publicizing expertise depends on mass media dynamics (indeed, some expert bodies have developed media strategies [Albæck et al. Citation2003: 939]).

Mass media dynamics are shaped by ‘physical limits, organizational features and news values’ (Parkinson Citation2006: 177). Experts’ public messages may fail if incompatible with these fundamentals. Conversely, experts can communicate successfully by adjusting to typical mass media’s short column spaces or time-frames (physical limits), focusing on person-centred narratives and emphasizing attention-grabbing developments (organizational priorities and news value).

Parallel discourses mean that real expert disagreements can stay beneath public view. Open conflict or disagreement attracts media searching for attention-grabbing ‘news’. Conversely, public unity among credible experts leaves disagreement less detectable. Non-experts (such as journalists) are unlikely to follow complex or exclusive expert debates (Weingart et al. 2009). Hence, when experts present unified public fronts, real disagreements are unlikely to become general public knowledge. In turn, apparent consensus allows experts to maintain asymmetries of knowledge on which epistemic learning depends.

In addition, expert policy advisors can access government’s media resources (Dunlop Citation2014; Ferretti and Pavone Citation2009). For instance, certified experts are sometimes summoned to government press conferences that shape agendas for local, national or even international media. In particular, these means give certified experts further capacity to project one message as the expert consensus.

To summarize, mass media frequently use experts to give claims greater credence. But mass media and science follow different discursive rules. Experts can adapt to media dynamics and may prevent disagreements from reaching the public discourse. Certified experts have advantages over others in this regard because of government communication resources. Hence, epistemic learning can be predicated on successful attempts by certified experts to project unity.

In the next section, we use the reviews above to outline an improved understanding of how experts can enable or constrain public deliberation over policy options.

Towards a theory on freezing deliberation through expert advice

Policy options discussed in the public discourse enable citizens to debate or evaluate them (Parkinson and Mansbridge Citation2012: 15). But experts appearing consensual ‘freeze’ public deliberation, and apparent (rather than true) consensus may emerge through epistemic mechanisms that play to medias’ discursive dynamics. Crisis conditions further encourage experts and others to join one front, rather than debate policy options publicly (Ansell et al. Citation2010; Rosenthal et al. Citation1989).

These considerations support two opposing expectations about how expertise affected public deliberation on 2009 H1N1 pandemic vaccination. High degrees of public deliberation on response policy are reasonable to expect in mature democracies. H1N1 was worldwide front page news for many months. In addition, 2009 H1N1 vaccination policies depended on public funding, re-oriented global medicines production on an unprecedented and massive scale, mobilized multitudes of health professionals to administer vaccines and, not least, required citizens’ active acceptance and participation. Hence, liberal mass media could be expected to comprehensively explicate and debate all H1N1 vaccination policy options.

During crises, however, certified and other high-status experts may monopolize the related public discourse (Dunlop Citation2013; Haas Citation1989). Experts rallying to the flag or media focusing on certified experts can dampen dissenting voices. The resulting appearance of consensus permits experts to instruct policy-makers and the public (Dunlop Citation2014), rather than providing comprehensive public information. Mass media’s tendency to simplify stories rather than offering nuance may strengthen such epistemic learning (Boswell Citation2009b; Parkinson Citation2006). The expected result is little or no explication of 2009 H1N1 vaccination policy alternatives; that is, an effective freezing of public deliberation.

The remainder of the article aims to advance theory on public expert advice by investigatigating whether one of these two expectations was fulfilled in Sweden and Denmark. To repeat the research questions: what role did the experts have in the public discourse? And did certified experts explain alternative policy options in the public arena, and was more than one policy option publicly deliberated? Descriptions of the context, cases and data follow next, then quantitative and qualitative analyses.

2009 H1N1 flu vaccination policies as cases of public deliberation

Different countries responded differently to the 2009 H1N1 flu outbreak (Baekkeskov Citation2015). Public deliberation thus had potential to inform policy choices in any polity.

During March and April 2009, United States (US) and Mexican health authorities discovered people infected by a novel H1N1 ‘swine’ flu. The simultaneous discovery of the same disease in different locations indicated spread beyond H1N1′s origin. In addition, hospitalized H1N1 patients in Mexico tended to sicken and die at an alarming rate. Mexican authorities alerted the World Health Organization (WHO) on 24 April. On 25 April, the WHO declared H1N1 a ‘public health emergency of international concern’.

The WHO declaration triggered policy responses lasting through the following winter (Baekkeskov Citation2015). All European Union (EU) member states and many other countries responded. Some governments initially sought to stop H1N1 at borders by screening travellers from Mexico and isolating identified cases. These ‘containment’ measures proved futile, however, making other policies necessary.

The core response in most EU countries became vaccination (Mereckiene et al. Citation2012). Vaccination campaigns mostly began in late October and early November. National policies on whom and how many to offer vaccination were decided during the summer and fall of 2009; but they differed substantially.

Among countries with different policies were Denmark and Sweden (otherwise ‘most similar systems’ [Peters Citation1998]). Sweden offered vaccination to everyone (100 per cent of the population). Denmark offered vaccination only to specified medical risk groups, health care workers and people in critical positions (totalling 20 per cent of the population). Hence, dissimilar policy outcomes for public health, health care systems and government finances could be anticipated.

Experts are often important in crisis response-making (Rosenthal and 't Hart Citation1991). An emerging literature documents that certified experts – virologists, epidemiologists and infectious disease specialists who were policy advisors – were pivotal to countries’ 2009 H1N1 responses (Baekkeskov Citation2016; Keller et al. Citation2012; MacPhail Citation2014). One author’s interviews with 2009 H1N1 policy-makers in Sweden and Denmark indicate that government experts’ advice was generally turned directly into response policy (Linde Citation2014; Nielsen Citation2014; Pedersen Citation2013; Smith Citation2013; Tegnell Citation2014). Written evidence further supports that certified experts’ advice steered 2009 H1N1 vaccination policies (Baekkeskov Citation2016).

The prospect of expert-led 2009 H1N1 policies with different outcomes for otherwise similar countries made public deliberations potential means to policy improvement, explication and legitimacy. To assess whether experts supported or ‘froze’ public deliberation, the analyses that follow consider who participated and with what claims in the public discourses on 2009 H1N1 vaccination in Denmark and Sweden.

Public deliberation can be operationalized using numbers and types of claims from different sources in Swedish and Danish mass media during 2009 pandemic response. Absence in mass media of reason-giving and counter-arguments for several policy options indicates limited public deliberation. Conversely, more reasons and mentions for multiple policy options indicate more public deliberation. Rich public deliberation would be indicated by approximately equal public mention and treatment of multiple policy options.

The analysis uses data on 2009 H1N1 vaccination policy options mentioned in national print mediaFootnote1 and related indicators. Print media constitute one of several important arenas for public deliberation; ideally, all such arenas should be investigated. As emphasized above, however, newspapers and magazines were a principal source of H1N1 information for citizens, and hence conveyed key inputs to potential public deliberations.

We selected texts using print media databases (Retriever Research in Sweden; Infomedia in Denmark). The online addendum details the search frame, search terms, search results and coding.

Content quantitative analyses

As described, Sweden and Denmark adopted significantly different H1N1 vaccination policies in 2009 (100 per cent of Swedes, 20 per cent of Danes). Was national policy uniformly supported or justified by nationally certified experts? Did these experts present and give arguments for available policy alternatives? To what extent did national print media cover policy alternatives? To answer these questions, we analysed the number of claims about vaccination policy made in each discourse, what the claims were, who made them and how they were presented in print media.

Rather than having equal mention of vaccination alternatives, each country’s print media were dominated by one claim (Figure 1 in the online supplemental data). In addition, the dominant claim was consistent with national policy. In Sweden, most attributable claims (74 per cent) supported the general mass vaccination policy (‘all’). In Denmark, a similar proportion of claims (73 per cent) supported the targeted vaccination policy (‘some’).

The 107 claims in Swedish print media were mostly expert opinions on both sides of the argument. The sources for 58 per cent of these were certified experts; 15 per cent were attributed to other experts, 10 per cent each to journalists and civil society, 6 per cent to politicians, and 1 per cent to other civil servants.

The Danish data show a wider range of sources. Experts were the plurality but significant contributions came from politicians, citizens and the media itself. In all, 127 claims were identified. Twnety-eight per cent were from certified experts and 9 per cent from other experts. Civil society contributed 27 per cent, politicians 19 per cent, journalists 9 per cent and other civil servants 7 per cent.

Not all sources made compatible claims; but most supported national policy (Figure 2 in the online supplemental data). Rather than giving equal weight to alternatives, 89 per cent of claims from certified experts in Sweden and 92 per cent in Denmark were consistent with national policy. Media might be expected to call on other (non-certified) experts to counter public authority positions. Even so, 31 per cent of claims by other experts in Sweden and 67 per cent in Denmark were consistent with policy. In both countries, all claims by civil servants supported policy. One hundred per cent of claims by Swedish politicians and 71 per cent of Danish supported policy. Swedish journalists were supportive in 73 per cent of their claims, while Danish journalists were more divided at 50 per cent in support. Finally, with 36 per cent of claims in support, Swedish civil society expressed criticism. Danish civil society claims were more favourable at 59 per cent supportive. Hence, each public discourse drew heavily on experts inside and outside of government and, moreover, mostly contained claims that supported national policy. Alternatives were much less mentioned, and then mostly by non-expert or non-certified sources.

The above analyses aggregate claims across a seven-month period and do not show whether public discourses changed. One-sidedness could thus be an artefact of aggregation rather than indicating limited deliberation. For instance, public deliberation could have been substantial early on and opinion could have coalesced. Or public deliberation could have occurred in advance of the key policy decisions in the period. With the available indicators, this would mean cacophonies of claims in early periods or leading up to policy choices, changing to a ‘harmony’ in later periods or as choices were made. There should also be considerably more discourse volume early on, while the public’s attention to the issue was needed for effective deliberation.

The timing of claims made by various sources in print media indicates how each discourse actually progressed (Figure 3 in the online supplemental data; data are presented semi-monthly). The time series do not contradict earlier indications of limited public deliberation. Few claims about vaccination were made in either country during the first three months of the pandemic. Claims were skewed heavily toward one position in all periods. Finally, modes did not generally coincide with key policy choices; vaccines were ordered in late June 2009 (determining how many people each country could vaccinate), and recipients and priority groups chosen between August and October (MSB Citation2011; SST Citation2011). A great deal more discourse activity occurred as these last policy choices were finalized. But claims were mostly on one side of the argument in both countries. Debate took place, but each public discourse contained one unwavering and dominant message.

Conceivably, dissenting claims could have gained equal public attention or respect through better placements in the news. Were dissenting claims presented more prominently or more respectably than pro-policy claims? To assess placement, the analysis considered four text types in which claims appeared: articles in a print medium or wire service (article/wire), op-eds or columns (op-ed/column), editorials and letters to the editor (Figure 4 in the online addendum).

Rather than counterbalancing sheer claim numbers, placement may have further favoured the pro-policy positions. All claims tended to be conveyed through journalistic reporting rather than as opinion; that is, in articles rather than alternatives. Articles conveyed 73 per cent of claims in Sweden and 78 per cent in Denmark. But dissenting claims appeared relatively less in reporting. Articles conveyed 57 per cent of Swedish and 50 per cent of Danish counter-policy claims, while they conveyed 78 per cent and 88 per cent of pro-policy claims respectively. Of all claims in articles, 79 per cent in Sweden and 88 per cent in Denmark supported national policy.

Consequently, opinion pieces (i.e., letters, op-eds and editorials) contributed significantly more to counter-policy than to pro-policy claims. Of nine letters to the editor in Sweden, three supported and six opposed policy. Of 21 letters in Denmark, nine supported and twelve opposed policy. Less dramatically, of eleven claims in Swedish op-eds or columns, six supported and five opposed policy. Of five such claims in Denmark, one supported and four opposed policy. Bucking the opinion trend, editorials tended to support policy. Of nine claims conveyed in Swedish editorials in the period, just one opposed the national H1N1 vaccination policy. Of two claims in Danish editorials, one supported and one opposed national policy.

Counting claims by text type shows that all newspaper coverage tended to convey pro-policy claims. Dissenting claims were more common in opinion pieces than in journalistic reporting. Hence, Danish and Swedish print media tended to frame pro-policy claims as fair reporting. In contrast, counter-policy claims were more frequently framed as mere opinion. In addition, counter-policy claims were disproportionately expressed in letters to editors (21 per cent in Sweden, 35 per cent in Denmark) rather than in presumably more authoritative editorials and op-eds.

Content qualitative analyses and discussion

Though claims in each country were evidently skewed quantitatively toward respective national policies (Figure 1 in the online supplemental data), debate was not absent. Though opinion pages were relatively more important for counter-policy claims (Figure 2 in the online supplemental data), appreciable minorities of all claims supported alternatives to national policies. Given that claims in both countries tended to be compatible and supportive of national policy, and given that dissenting claims were in more marginal positions in print media, might dissenters’ status have balanced out quantitative disadvantages and thus have informed public deliberation?

To answer, this section presents qualitative analyses of the same data analysed quantitatively in the previous section. Could quality balance out the quantity of pro-policy messages? Certified and other experts were primary contributors to response-making and to both countries’ debates (admittedly less so in Denmark). What follows focuses on experts voicing claims.

As stated, nearly three-quarters of identified claims supported while one-quarter opposed government policy. In stylized terms, to balance out ‘weights’ of pro-policy fronts, counter-policy claims would need to be on average three times ‘better’ than pro-policy claims.

The analysis used the relative professional or social status of claim-makers (i.e., sources). All texts identified in the search presented their sources’ formal titles or other credentials. Hence, the strength of each claim’s legitimacy (public acceptance) was likely to hinge on these reported markers of professional or social status. This made credentials relevant as gauges of the relative status of the claims.

Sweden

As described, certified experts made 62 of the 107 Swedish claims; an overwhelming 55 of these were pro-policy. The largest contributors were Anders Tegnell (the head of the infectious diseases division at Socialstyrelsen – the National Board of Health and Welfare) and Annika Linde (the state epidemiologist). Other certified expert sources included the director-general of Socialstyrelsen, regional public health heads from Stockholm and Gothenburg (i.e., Sweden’s major cities), and two leading EU agency health officials who were Swedish nationals (a chief scientist and a director). Certified experts also made seven counter-policy claims. Six of these were made by district medical officers (distriktsläkare) from far to the north of major population and administrative centres. The seventh was a claim by a mathematical modeller at Smittskyddsinstitutet (SMI), who argued that there was no difference between the immunizing effects of vaccinating 70 per cent and 90 per cent of a population. While this critiqued Sweden’s hard push to vaccinate everyone, it was no condemnation of mass vaccination as such. Hence, counter-policy claims by certified experts were not made by individuals whose status could counterbalance the prevailing claim in national print media coverage.

Other experts in Sweden contributed 16 identified claims. Eleven claims opposed national policy. One professor at Uppsala’s University Hospital made three of these claims, arguing that mass vaccination was unnecessary and too expensive. However, he later supported national policy, calling on people to seek vaccination for themselves and their children. Two counter-policy claims were attributed to a physician that one newspaper (derogatorily?) labelled ‘the doctor of fat’ (‘fettdoktorn’; Aftonbladet, 5 September 2009: 12). She argued against any vaccination implicitly by claiming that fatty diets would protect people against H1N1. She added that vaccines contained too much mercury, and that pharmaceutical companies were influencing the government. A former Karolinska Institute professor of infectious diseases contributed one counter-policy claim by advocating more targeted vaccination. Sources for remaining counter-policy claims included an unnamed group of American scientists, a pediatrician, a psychiatrist and a molecular biologist. As in the case of certified experts, the counter-policy claims of other experts did not credibly balance out the pro-policy expert claims. The most cited specialist changed or nuanced his opinion to favour policy, and hence may have neutralized his own impact. Other specialists were cited just once. Remaining experts opposing policy were clearly fringe members of the medical establishment or non-specialist, and hence relatively marginal.

These factors render implausible that the relative ‘weight’ of experts’ counter-policy claims made up for the number of pro-policy expert claims. Moreover, opponents of national policy were divided between favouring targeted and no vaccination. Relative status and unity suggest that Sweden’s pro-policy expert front was weightier than indicated by sheer claim quantities, rather than less. That is, qualitative analysis does not contradict that Sweden’s most legitimate experts were portrayed as agreeing that everyone should receive H1N1 vaccination. This makes credible that citizens received the impression that mass vaccination was the only serious option.

Finally, what did Swedish experts tend to say? SMI expert Johan Struwe summarized:

The recommendation is that as many [people] as possible be vaccinated, in part to reduce the strain on society, but also to reduce the total number of cases and, hence, the risk that you or someone else experiences a more severe illness. There is sufficient information on the vaccine’s safety so that you do not need to have any general ‘fear’ of the vaccine unless you have strictly medical reasons [for it]. (Expressen Citation2009)

Hence, Sweden’s certified experts justified general vaccination as broad societal in addition to public health protection, with little risk of adverse effects.

Denmark

Of Danish certified experts’ 36 identified claims, 33 were pro-policy. Most (25 out of 33) were from Else Smith, Anders Tegnell’s Danish counterpart (head of the infectious diseases unit at Sundhedsstyrelsen – the National Board of Health). Kåre Mølbak, head of the infectious diseases epidemiology section at Statens Seruminstitut (SSI), was a distant second. The WHO’s World Influenza Centre, unnamed Centers for Disease Control and Prevention (CDC) experts, the SSI director and another senior SSI specialist made the remaining pro-policy claims. Interestingly, two of the three counter-claims in Danish media came from Swedish government experts. These justified the Swedish policy but refused explicitly to criticize the Danish policy of targeted vaccination. A MD at an institute under Sundhedsstyrelsen, who was junior to all the pro-policy experts cited, made the only counter-claim by a Danish certified expert. He claimed that the targeted policy aimed to vaccinate too many people. Hence, counter-policy claims by certified experts in Denmark cannot credibly have balanced out pro-policy claims.

Other Danish experts contributed 12 claims. Several leading national specialists argued for the national policy, including professors of influenza epidemiology, children’s diseases, experimental virology and internal medicine. In return, four claims were made against policy. Of these, two came from one health economics professor who argued for economic benefits of general mass vaccination. The remaining two came from a Swedish expert (a medical doctor (MD) who headed the Swedish local government association’s health care division), and a domestic MD who voiced opposition to any vaccination.

Recall that counter-policy claims were prevalent in letters to the editor and other opinion pieces rather than in reporting. In addition, the relative status of claim-makers renders implausible that counter-policy claims by experts in Danish print media outweighed the number and placement of pro-policy expert claims. As described, three of the seven counter-policy claims were sourced to experts authorized in Sweden rather than Denmark. The more outright and domestic critics were relatively non-specialist or junior to the pro-policy experts. Finally, as in Sweden, opponents of policy were divided. The cited Swedes and the economics professor favoured general vaccination, while the others favoured even more limited or no vaccination. Like their Swedish counterparts, residents in Denmark were likely to receive the impression that only one policy option was reasonable.

Finally, what did Danish expert tend to say? Else Smith:

we have an influenza that has proven to be relatively peaceful and moderate for the great majority [of cases]. It strongly resembles the ordinary winter flu, where we also do not recommend that everyone be vaccinated, but rather target a risk group. In addition, we can expect a few more side effects with this vaccine than with the normal one. And the vaccine should not cause more damage than the illness. (Politiken Citation2009)

Hence, Danish experts’ public justifications included mild disease and potential adverse vaccination effects.

In line with media dynamics described previously, experts’ justifications and recommendations were seldom questioned publicly. Hence, numbers, placement and status of claims suggest that print media in Sweden and Denmark during 2009 H1N1 presented opposition to national vaccination policies as marginal. The significant difference between Denmark and Sweden was that policies supported by certified and other high-status experts in the respective public discourses were opposites.

True consensus, rally to the flag, or biased media selection?

The first section presented biased media selection and pre-emptive message adjustments by certain experts (i.e., rallying to the flag) as plausible explanations for experts’ unified fronts. Alternatively, national experts may actually have consensus. Fully tracing the origins of the unified expert fronts evident for 2009 H1N1 vaccination is beyond this article’s scope. However, primary evidence and secondary literature offer strong suggestions.

First, evidence points to media selection in favour of national unified fronts. As shown, media in each country could find dissenting expert opinions simply by looking to media coverage across the border. Media could and did find dissenting experts domestically; but as shown, these experts were given far less exposure than certified and other high-status experts. However, current evidence does not reveal whether media selected based on ignorance, convenience or strategic concerns.

Second, primary interview evidence indicates dominant views among and even self-censorship by certified experts. The most-cited Danish expert asserts that she consistently sought to publicly portray 2009 H1N1 as a low-level threat requiring modest responses: ‘when a pandemic hits, the point is not to prevent that people become ill … it’s about saving lives’; and for 2009 H1N1, it quickly became ‘very clear that the mortality was going to be very, very, very low’ (CitationSmith 2013). Denmark’s minister of health in 2009 recalled that he had ‘tried to follow a communication strategy that allayed public fears, but at the same time led to the result that [the experts] could decide what was right to do’ (Nielsen Citation2014).

Sweden’s certified experts agreed that 2009 H1N1 led to few fatalities. But other issues mattered, including ‘interrupting transmission’ for the sake of ‘protecting society’ and securing ‘business continuity’ (Tegnell Citation2014). In addition, vaccinating everyone was ‘based on that the vaccine was available, the very realistically presented excess risk of severe disease in young people outside the risk-groups and the lack of signals on severe side-effects from the vaccine’, and finally, that ‘very few in official Sweden were against [general mass] vaccination and many [of] those that in the aftermath say that they were did not speak up before or during the pandemic’ (Linde Citation2014). Indeed, at least one Swedish expert recalls wanting to ‘avoid upsetting the process’, and so deliberately kept reservations about general mass vaccination publicy quiet (Anonymous Citation2014).

Third, available evidence disproves genuine national epistemic consensuses. Newspapers in each country were able to find domestic (admittedly marginal) dissenters. In addition, as described, some senior experts withheld their objections from the public. Rather, relatively small certified expert groups centered at national public health agencies developed policy advice; key policy advisors also dominated public discourses, as described previously.

Hence, media selection and rallies to the flag are likely origins of unified expert fronts in Swedish and Danish public discourses during 2009 about H1N1 vaccination, rather than true domestic expert consensus.

Conclusions

Our research questions can now be answered. First, did nationally certified and other experts explain alternative policy options in the public arena? Certified and other experts with high status made little public mention of policy alternatives. Nearly all their claims supported policy. Experts making other claims tended to be marginal in terms of specialization or position. Second, to what extent was more than one policy option publicly deliberated? Public debate on policy options was skewed. National media gave many mentions, respectable placements and high status to claims supporting national policy. Alternatives were marginalized. The expectation that apparent consensus among credible experts can freeze public deliberation during crises is thus supported.

The public appearance of consensus is likely to matter (cf. Kahan et al. Citation2011). Selection and presentation of information (i.e., framing) are known to shape how citizens think about issues. Framing studies have shown that people who are exposed only to arguments for one position tend to endorse it, while more balanced discussions and information can limit political manipulation and have beneficial effects for opinion formation and change (Chong and Druckman Citation2013; Gerber et al. Citation2014). Since Swedish and Danish citizens were exposed to frames dominated by apparent consensus, past research would suggest that most would adopt the dominant stance.

Although politicians can access more information than citizens in general, the logic of blame-avoidance complicates policy without strong expert backing (Boin et al. Citation2008; Hood Citation2011; Weaver Citation1986). High likelihoods of doing too little, too late or too much, too wrong exist in all crises. Politicians who are publicly responsible for crisis response risk blame for poor management that endangers their future electability. Using the shield of publicized expert advice and judgment enables leaders to mitigate this risk (i.e., avoid blame). Hence, political leaders could be reluctant to support flu response policy that deviated from advice endorsed by certified experts (Baekkeskov Citation2016).

Policy advice publicized as experts’ consensus may then lock in policy. ‘The’ experts brief politicians and journalists. In turn, citizens mostly support the publicized policy option, based on consistent media messages. This popular legitimation of one position feeds back into the advisory and political systems, severely constraining policy options because changing course can threaten public faith in responsible officials. Certified expertise and rallying to the flag during crisis are useful tools of governance. The former promises evidence-based rather than interest-based policy; the latter promises timely action. But combined, the two factors may freeze public deliberation and lock in policy, regardless of best available options for public action.

Supplemental material

Online addendum - Freezing deliberation to public expert advice

Download MS Word (319.8 KB)

Acknowledgements

The authors are grateful for constructive comments from two anonymous reviewers and from panel participants at 2015′s International Conference on Public Policy in Milan and European Consortium for Political Research General Conference in Montreal.

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes on contributors

Erik Baekkeskov is lecturer at the School of Social and Political Sciences, The University of Melbourne.

PerOla Öberg is professor at the Department of Government, Uppsala University.

Additional information

Funding

Research for this article was funded by the Danish Council for Independent Research (0602-02543B) and the Swedish Research Council (2010-2306).

Notes

1. Other Swedish and Danish media are not currently amenable to textual content analyses.

References

  • Amato-Gauci, A. et al. (2011) ‘Surveillance trends of the 2009 influenza A(H1N1) pandemic in Europe’, Eurosurveillance 16(26), available at http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=19903
  • Adler, E. and Haas, P.M. (1992) ‘Conclusion: epistemic communities, world order and the creation of a reflective research program’, International Organization 46(1): 367–90. doi: 10.1017/S0020818300001533
  • Albæk, E., Christiansen, P.M. and Togeby, L. (2003) ‘Experts in the mass media: research as sources in danish daily newspapers 1961–2001’, Journalism & Mass Communication Quarterly 80(4): 937–48. doi: 10.1177/107769900308000412
  • Ansell, C., Boin, A. and Keller, A. (2010) ‘Managing transboundary crises: identifying the building blocks of an effective response system’, Journal of Contingencies and Crisis Management 18(4): 195–207. doi: 10.1111/j.1468-5973.2010.00620.x
  • Baekkeskov, E. (2016) ‘Same threat, different responses: experts steering politicians and stakeholders in 2009 H1N1 vaccination policy-making’, Public Administration, doi: 10.1111/padm.12244
  • Baekkeskov, E. (2015) ‘Transboundary crises: organization and coordination in pandemic influenza response’, in R. Dahlberg, O. Rubin and M.T. Vendelø (eds), Disaster Reseach: Multidisciplinary and International Perpectives, London: Routledge, pp. 189–206.
  • Barabas, J. (2004) ‘How deliberation affects policy opinions’, American Political Science Review 98(4): 687–701. doi: 10.1017/S0003055404041425
  • Baldwin, P. (2005) Disease and Democracy: The Industrialized World Faces AIDS, Berkeley and Los Angeles, CA: University of California Press.
  • Boin, A., McConnell, A. and 'T Hart, P. (eds) (2008) Governing after Crisis: The Politics of Investigation, Accountability, and Learning, New York: Cambridge University Press.
  • Boswell, C. (2009a) The Political Uses of Expert Knowledge. Immigration Policy and Social Research, Cambridge: Cambridge University Press.
  • Boswell, C. (2009b) ‘Knowledge, legitimation and the politics of risk: the functions of research in public debates on migration’, Political Studies 57: 165–86. doi: 10.1111/j.1467-9248.2008.00729.x
  • Christiano, T. (2012) ‘Rational deliberation among experts and citizens’, in J. Parkinson and J. Mansbridge (eds), Deliberative Systems, Cambridge: Cambridge University Press, pp. 27–51.
  • Cross, M.K.D. (2013) ‘Rethinking epistemic communities twenty years later’, Review of International Studies 39(1): 137–60. doi: 10.1017/S0260210512000034
  • Chong, D. and Druckman, J.N. (2013) ‘Counterframing effects’, The Journal of Politics 75(01): 1–16. doi: 10.1017/S0022381612000837
  • Dahl, R.A. (1989), Democracy and its Critics, New Haven, CT: Yale University Press.
  • Dunlop, C.A. (2009) ‘Policy transfer as learning: capturing variation in what decision-makers learn from epistemic communities’, Policy Studies 30(3): 289–311. doi: 10.1080/01442870902863869
  • Dunlop, C.A. (2013) ‘Epistemic communities’, in E. Araral Jr., S. Fritzen, M. Howlett, M. Ramesh and X. Wu (eds) Routledge Handbook of Public Policy, New York and Abingdon: Routledge, pp. 229–43.
  • Dunlop, C.A. (2014) ‘The possible experts: how epistemic communities negotiate barriers to knowledge use in ecosystems services policy’, Environment and Planning C: Government and Policy 32: 208–28. doi: 10.1068/c13192j
  • Esping-Andersen, G. (1990) The Three Worlds of Welfare Capitalism, Cambridge: Polity Press.
  • Expressen (2009) ’Hur dödlig är smittan?’, Expressen, 17 July pp. 10–11.
  • Ferretti, M.P. and Pavone, V. (2009) ‘What do civil society organisations expect from participation in science? Lessons from Germany and Spain on the issue of GMOs’, Science and Public Policy 36(4): 287–99. doi: 10.3152/030234209X436527
  • Fisher, F. and Gottweis, H. (2012) The Argumentative Turn Revisited. Policy as Communicative Practise, New York: Duke University Press.
  • Gerber, M., Bächtiger, A., Fiket, I., Steenbergen, M. and Steiner, J. (2014) ‘Deliberative and non-deliberative persuasion: mechanisms of opinion formation in EuroPolis’, European Union Politics 15(3): 410–29. doi: 10.1177/1465116514528757
  • Haas, P.M. (1989) ‘Do regimes matter? Epistemic communities and Mediterranean pollution control’, International Organizations 43(3): 377–403. doi: 10.1017/S0020818300032975
  • Haas, P.M. (1992) ‘Introduction: epistemic communities and internatinoal co-ordination’, International Organizations 46 (1): 1–36. doi: 10.1017/S0020818300001442
  • Haas, P.M. (2004) ‘When does power listen to truth? A constructivist approach to the policy process’, Journal of European Public Policy 11(4): 569–92. doi: 10.1080/1350176042000248034
  • Hajer, M. and Wagenaar, H. (eds) (2003) Deliberative Policy Analysis, Cambridge: Cambridge University Press.
  • Hood, C. (2011) The Blame Game: Spin, bureaucracy, and Self-preservation in Government, Princeton, NJ: Princeton University Press.
  • Howlett, M. and Lejano, R.P. (2012) ‘Tales from the crypt: the rise and fall (and rebirth?) of policy design’, Administration & Society 45(3): 357–81. doi: 10.1177/0095399712459725
  • Howlett, M. and Wellstead, A.M. (2011) ‘Policy analysts in the bureaucracy revisited: the nature of professional policy work in contemporary government’, Politics & Policy 49(4): 613–33. doi: 10.1111/j.1747-1346.2011.00306.x
  • Hoppe, R. (2005) ‘Rethinking the science-policy nexus: from knowledge utilization and science technology studies to types of boundary arrangements’, Poiesis Prax 3: 199–215. doi: 10.1007/s10202-005-0074-0
  • Ingold, K. and Gschwend, M. (2014) ‘Science in policy-making: nutreal experts or strategic policy-makers’, West European Politics 37(5): 993–1018. doi: 10.1080/01402382.2014.920983
  • James, T.E. and Jorgensen, P.D. (2009) ‘Policy knowledge, policy formulation, and change: revisiting a foundational question’, Policy Studies Journal 37(1): 141–62. doi: 10.1111/j.1541-0072.2008.00300.x
  • Jennings, E.T. Jr. and Hall, J.L. (2012) ‘Evidence-based practice and the use of information in state agency decision making’, Journal of Public Administration Research and Theory 22(2): 245–66. doi: 10.1093/jopart/mur040
  • Jordan, A., Rayner, T., Schroeder, H., Adger, N., Anderson, K., Bows, A., Le Quéré, C., Joshi, N., Mander, S., Vaughan, N. and Whitmarsh, L. (2013) ‘Going beyond two degrees? The risks and opportunities of alternative options.’ Climate Policy 13(6): 751–69. doi: 10.1080/14693062.2013.835705
  • Kahan, D.M., Jenkins-Smith, H. and Braman, D. (2011) ‘Cultural cognition of scientific consensus’, Journal of Risk Research 14(2): 147–74. doi: 10.1080/13669877.2010.511246
  • Keller, A.C. et al. (2012) ‘Improving pandemic response: a sensemaking perspective on the spring 2009 H1N1 pandemic’, Risk, Hazards & Crisis in Public Policy 3(2): 1–37. doi: 10.1515/1944-4079.1101
  • Lindblom, C.E. and Woodhouse, E.J. (1993) The Policy-Making Process, 3rd edn, Upper Saddle River, NJ: Prentice Hall.
  • Linder, S.H. and Peters, B.G. (1988) ‘The analysis of design or the design of analysis?’ Policy Studies Review 7(4): 738–50. doi: 10.1111/j.1541-1338.1988.tb00892.x
  • Linder, S.H. and Peters, B.G. (1990) ‘Policy formulation and the challenge of conscious design’, Evaluation and Program Planning 13: 303–11. doi: 10.1016/0149-7189(90)90061-Z
  • Lundin, M. and Öberg, P.O. (2014) ‘Expert knowledge use and deliberation in local policy making’, Policy Sciences 47(1): 25–49. doi: 10.1007/s11077-013-9182-1
  • MacPhail, T. (2014) The Viral Network: a Pathography of the H1N1 Influenza Pandemic, Ithaca, NY: Cornell University Press.
  • Mahon, R. and MacBride, S. (2009) ‘Standardizing and disseminating knowledge: the role of the OECD in global governance’, European Political Science Review 1(1): 83–101. doi: 10.1017/S1755773909000058
  • Mansbridge, J. (2003) ‘Rethinking representation’, American Political Science Review 97(4): 515–28. doi: 10.1017/S0003055403000856
  • Mereckiene, J. et al. (2012) ‘Influenza A(H1N1)PDM09 vaccination policies and coverage in Europe’, Eurosurveillance 17(4), available at http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=20064
  • Montpetit, É. (2011) ‘Scientific credibility, disagreement, and error costs in 17 biotechnology policy subsystems’, Policy Studies Journal 39(3): 513–33. doi: 10.1111/j.1541-0072.2011.00419.x
  • May, P.J. (2003) ‘Policy design and implementation’, in B.G. Peters and J. Pierre (eds), Handbook of Public Administration, Beverly Hills, CA: Sage, pp. 223–33.
  • MSB (2011) Influensa A(H1N1) 2009 - utvärdering av förberedelser och hantering av pandemin, Swedish Civil Contingencies Agency, Västerås: Edita Västra Aros.
  • Öberg, P.O., Lundin, M. and Thelander, J. (2015) ‘Political power and policy design: why are policy alternatives constrained?’, Policy Studies Journal 43(1): 93–114. doi: 10.1111/psj.12086
  • Parkinson, J. (2006) ‘Rickety bridges: using the media in deliberative democracy’, British Journal of Political Science 36(1): 175–83. doi: 10.1017/S0007123406000093
  • Parkinson, J. and Mansbridge, J. (2012) Deliberative Systems, Cambridge: Cambridge University Press.
  • Peters, G. (1998) Comparative Politics, Theory and Method, New York: New York University Press.
  • Politiken (2009) ‘Danmark er låst fast på H1N1-vaccine til hver fjerde borger’, Politiken, 1 August, p. 5.
  • Rapport till Socialstyrelsen augusti 2009, SKOP: Arkivnummer: S1AUG09.
  • Rosenthal, U., Charles, M. T. and 't Hart, P. (1989) Coping with Crises: The Management of Disasters, Riots and Terrorism, Springfield, IL: Charles C Thomas.
  • Roenthal, U. and 't Hart, P. (1991) ‘Experts and decision makers in crisis situations’, Knowledge: Creation, Diffusion, Utilization 12(4): 350–72.
  • SST (2011, 14 January) Redegørelse: Prioritering af pandemivacciner 2009, Copenhagen: Sundhedsstyrelsen.
  • Stallings, R.A. (1995) Promoting Risk: Constructing the Earthquake Threat, New York: Aldine de Gruyter.
  • Turner, S. (2001) ‘What is the problem with experts’, Social Studies of Science 31(1): 123–49. doi: 10.1177/030631201031001007
  • Vallgårda, S. (2007) ‘Problematizations and path dependency: HIV/AIDS policies in Denmark and Sweden’, Medical History 51: 99–112. doi: 10.1017/S0025727300000910
  • Van de Walle, S., Van Roosbroek, S. and Bouckaert, G. (2008) ‘Trust in the public sector: is there any evidence for a long-term decline?’, International Review of Administrative Sciences 74(1): 47–64. doi: 10.1177/0020852307085733
  • Weaver, K. (1986) ‘The politics of blame avoidance’, Journal of Public Policy 6(4): 371–98. doi: 10.1017/S0143814X00004219
  • Weible, C.M. (2008) ‘Expert-based information and policy subsystems: a review and synthesis’, Policy Studies Journal 36(4): 615–35. doi: 10.1111/j.1541-0072.2008.00287.x
  • Weible, C.M., Pattison, A. and Sabatier, P.A. (2010) ‘Harnessing expert-based information for learning and the sustainable management of complex socio-ecological systems’, Environmental Science & Policy 13: 522–34. doi: 10.1016/j.envsci.2010.05.005
  • Weible, C.M., Heikkila, T., de Leon, P. and Sabatier, P.A. (2012) ‘Understanding and influencing the policy process’, Policy Sciences 45: 1–21. doi: 10.1007/s11077-011-9143-5
  • Weingart, P. (1999) ‘Scientific expertise and political accountability: paradoxes of science in politics’, Science and public policy 26(3): 151–61. doi: 10.3152/147154399781782437
  • Weingart, P., Engels, A. and Pansegrau, P. (2000) ‘Risks of communication: discourses on climate change in science, politics, and the mass media’, Public Understanding of Science 9: 261–83. doi: 10.1088/0963-6625/9/3/304

List of interviews and personal communications

  • Anonymous (2014) Swedish certified expert, interview by E. Baekkeskov, 16 October.
  • Linde, A. (2014) Personal communication with E. Baekkeskov, 8 December.
  • Nielsen, J.A. (2014) former minister of health for Denmark, interview by E. Baekkeskov, 11 April.
  • Pedersen, N. S. (2013) Director of Statens Seruminstitut, interview by E. Baekkeskov, 20 November.
  • Smith, E. (2013) Former infectious diseases unit head at Sundhedsstyrelsen, interview by E. Baekkeskov, 12 November.
  • Tegnell, A. (2014) Former infectious diseases unit head at Socialstyrelsen, interview by E. Baekkeskov, 9 September.