2,733
Views
4
CrossRef citations to date
0
Altmetric
Articles

Perceived prevalence of misinformation fuels worries about COVID-19: a cross-country, multi-method investigation

ORCID Icon, ORCID Icon, , ORCID Icon, ORCID Icon, ORCID Icon, , ORCID Icon, ORCID Icon, , ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon show all
Pages 3133-3156 | Received 22 Dec 2021, Accepted 16 Oct 2022, Published online: 29 Nov 2022

ABSTRACT

Data suggests that the majority of citizens in various countries came across ‘fake news’ during the COVID-19 pandemic. We test the relationship between perceived prevalence of misinformation and people’s worries about COVID-19. In Study 1, analyses of a survey across 17 countries indicate a positive association: perceptions of high prevalence of misinformation are correlated with high worries about COVID-19. However, the relationship is weaker in countries with higher levels of case-fatality ratios, and independent from the actual amount of misinformation per country. Study 2 replicates the relationship using experimental data. Furthermore, Study 2 demonstrates the underlying mechanism, that is, perceived prevalence of misinformation fosters the belief that COVID-19 is spiralling out of control, which in turn, increases worries. Our findings suggest that perceived prevalence of misinformation can have significant psychological effects, even though audience members reject the information as being false.

In December 2019, first reports about a novel coronavirus, later entitled SARS-CoV-2, emerged in Wuhan, China. Within a few months, the virus reached virtually all parts of the world leading to a global pandemic with more than 3,000,000 deaths as of April 2021. Governments and political leaders around the world have attempted to reduce the spreading of the virus by introducing drastic measures, such as lockdowns, curfews, and more recently, rapid vaccinations. The success of those measures crucially depends on the information environment, and most importantly, the spread of misinformation about COVID-19. Misinformation, defined as misleading or false information (Fletcher, Citation2018), ranged from questioning the existence of COVID-19, providing alternative but false health advice to prevent infections (i.e., injecting disinfectants) to blatant conspiracy theories (Ali, Citation2020; Humprecht, Citation2019). Such misinformation has prompted the World Health Organization to warn of an ongoing ‘infodemic’ (World Health Organization, Citation2020). In fact, recent data suggest that the majority of citizens in various countries believe that they have been exposed to ‘fake news’ during the crisis (Nielsen et al., Citation2020). Perceived prevalence of misinformation may have significant psychological consequences, such as worries about the pandemic. Yet, the implications of perceived misinformation for dealing with COVID-19 remain underexplored.

As one important outcome, reactions related to COVID-19, such as worries about getting infected, or about personal and country-wide economic consequences, may shape citizens’ behaviours during the crisis, including the willingness to comply with restrictions or vaccine hesitancy. Furthermore, such worries may have detrimental health effects, such as sleep problems, depressive tendencies, or psychotic disorders (see Fitzpatrick et al., Citation2020; Yue et al., Citation2021; Yue et al., Citation2022). Against this background, examining people’s worries about the pandemic might help to understand some of the roots of the negative implications of the pandemic. In this paper, we therefore asked in a general research question how online perceived misinformation influences people’s worries about the pandemic.

We theorize that perceived exposure to misinformation may increase worries. We test this relationship using a unique cross-national survey tapping the perceived prevalence of misinformation by more than 28,000 individuals across 17 countries. Besides estimating the effects of perceived misinformation on worries, we also explore two specific research questions the influence of macro-level factors such as the cross-country variation in misinformation prevalence (Gallotti et al., Citation2020) and COVID-19 related case-fatality ratios. Since the cross-national survey data do not allow causal conclusions, we apply propensity score matching to test the robustness of our findings and to test against selection effects (Rubin & Thomas, Citation2000). To further validate the survey findings, we conducted an experimental study, directly manipulating perceived prevalence of misinformation and measuring the underlying mechanism, the belief that COVID-19 is spiralling out of control when misinformation prevails.

Misinformation and COVID-19

The term disinformation is often used interchangeably with the term misinformation, or the colloquial term ‘fake news’. Misinformation, however, is not the same as disinformation. Misinformation can be understood as ‘information that is false, but not created with the intention of causing harm’ (Wardle & Derakhshan, Citation2017, p. 20). By contrast, disinformation can be defined as ‘false, inaccurate, or misleading information designed, presented and promoted to intentionally cause public harm or for profit’ (High Level Experts Group, Citation2018, p. 10). Since, in this study, we cannot make claims about the intentions behind the falsified information, we use the term misinformation. As recommended by Wardle and Derakhshan (Citation2017), we furthermore refrain from the polarized and imprecise term ‘fake news’. We are also not using the terms conspiracy theory or conspiracy beliefs, which refer to the belief in secret plots by powerful individuals or organizations (Douglas et al., Citation2019). We generally focus on perception of information veracity, no matter the intent or nature of the belief, and therefore use the term misinformation.

Studies indicate that misinformation has been quite prevalent during the COVID-19 crisis. For instance, a recent study suggests that people in the United States and United Kingdom believed several falsehoods that were spread on social media (Geldsetzer, Citation2020). According to Li et al. (Citation2020), 25% of the most viewed COVID-19 related YouTube videos contained misleading information, totalling 62 million views worldwide. Typical misinformation included stories about the alternative cures such as the use of chloroquine, vulnerability based on ethnicity, the intentional use of the virus as a secret Chinese bio-weapon, low mortality numbers, or the statement that COVID-19 is not more dangerous than a typical flu, just to name a few (e.g., Evanega et al., Citation2020).

When looking at the effects of exposure to misinformation more generally, there are two different research logics. Following an attitudinal logic, the key interest is to understand who actually believes in misinformation (Hameleers & van der Meer, Citation2019; Walter & Murphy, Citation2018; Zerback et al., Citation2020). Here, the theory is that misinformation spreads and impacts attitudes due to its psychological appeal (Zerback et al., Citation2020). There is a flourishing literature building on psychological mechanisms trying to explain how and why people are affected by misinformation (or disinformation), mostly stemming from the idea that people are ‘cognitive misers’, using heuristics in decision-making (Tversky & Kahneman, Citation1974). The self-confirmation heuristic (Metzger et al., Citation2010), for instance, makes people evaluate information as credible when it confirms their prior beliefs. This heuristic is another way of interpreting the confirmation bias (Nickerson, Citation1998), which explains why people tend to believe information that confirms their existing beliefs. Once established, misinformation is hard to correct, even when people learn that the information was false (Huang & Wang, Citation2020). In the last years, research has shown that effects of misinformation could take many forms, from individual level behaviours, such as engagement with questionable information (Corbu et al., Citation2020; Glenski et al., Citation2020), resistance to correction efforts (Hameleers & van der Meer, Citation2019; Walter & Murphy, Citation2018), persuasive effects (Zerback et al., Citation2020), contextual behavioural effects, such as vaccine hesitancy (Wilson & Wiysonge, Citation2020) or societal effects (McKay & Tenove, Citation2020). Additionally, recent studies looked into possible measures to limit such effects (Hameleers, Citation2020; Vraga & Tully, Citation2021)

Following a perception logic, individuals can have the impression that misinformation is prevalent in online information environments, even though they do not accept and/or believe in it. That is, this line of research deals with consequences of perceived misinformation. Studies using the perception logic are scarce to date (Jones-Jang et al., Citation2020; Van Duyn & Collier, Citation2019). They build on the distinction between ‘fake news’ as a genre and as a label (Egelhofer & Lecheler, Citation2019) and investigate effects of elites’ discourse about ‘fake news’ on media trust (Van Duyn & Collier, Citation2019) or effects of perceptions about mis- and disinformation on political cynicism (Jones-Jang et al., Citation2020). More specifically, whenever scholars ask respondents whether or not they have seen or heard false information, we can speak of a perception logic. That is, the attitudinal logic studies those individuals who actually believe in the misinformation. The perception logic, by contrast, is concerned with the much larger (and in previous research largely ignored) group, those who do not believe in the misinformation. A perception logic is important because the perception of widespread misinformation can affect individual attitudes and behaviours. This paper follows the perception approach. We study the psychological consequences of citizens’ perception that there is frequent misinformation. By definition, when citizens characterize information as misinformation (and share that impression in a survey), they do not accept that information and regard it as false. Thus, we study the effects of the impression that misinformation is generally prevalent.

Misinformation and Worries about COVID-19

Worries about one's personal, social and economic environment have been documented to highly increase in times of crisis, such as the COVID-19 pandemic (Barber & Kim, Citation2021; Dryhurst et al., Citation2020; Taylor et al., Citation2020). Worry is not an emotion, but can be defined as a cognitive activity that involves negative thoughts about an ambiguous or uncertain issue (Jensen et al., Citation2010). Since the pandemic is characterized by enormous uncertainties, worry is an important cognitive activity, potentially driving behaviours (Coifman et al., Citation2021). More specifically, studies investigating worries during the COVID-19 crisis have looked into both personal fears, such as perceived risks for self and loved ones (Coifman et al., Citation2021; He et al., Citation2021), economic worries (Mann et al., Citation2020), or both (Bareket-Bojmel et al., Citation2020). To date, there is an increasing body of knowledge investigating consequences of worries in times of crisis (including health crises) (e.g., de Bruin & Bennett, Citation2020; Fitzpatrick et al., Citation2020; Wong & Jensen, Citation2020). Studies considering worries related to COVID-19 as a dependent variable have found correlations with personal experience with the virus, preventive health behaviours (Dryhurst et al., Citation2020), or news consumption (He et al., Citation2021).

There is no research, to the best of our knowledge, investigating how the perceived prevalence of misinformation affects worries about the pandemic. In particular, we theorize that frequent exposure to misinformation fuels worries related to the pandemic. We use the term worries instead of anxiety or fear because we construe worries as negative cognitions in light of uncertainty and ambiguity. The terms fear and anxiety refer to psychological affects, they are much stronger and can also be irrational and highly subjective (Coifman et al., Citation2021).

Why then should the perception of misinformation raise such worries? The reason, we theorize, lies in the impression of uncontrollability. The notion of controllability can be traced back to the Transactional Theory of Stress by Lazarus and Folkman (Citation1984). According to this theory, individuals continuously evaluate their environment and form an impression whether or not they have sufficient resources to deal with potentially challenging situations, such as a pandemic (Zacher & Rudolph, Citation2021). These appraisals can also refer to the level of controllability of a stressor and more specifically, whether a situation is controllable by oneself or by others. In a recent study, Zacher and Rudolph (Citation2021), for instance, found that the perception that the pandemic is controllable leads to higher subjective wellbeing.

Translated to the present paper, when citizens perceive that misinformation is out there, this perception implies that others also are exposed to (and affected by) this misinformation. That is, individuals may come to believe that a certain share of other people may actually believe in the erroneous information, ultimately guiding the behaviours of others. This theoretical explanation is build on the Influence of Presumed Media Influence model (IPMI, Gunther & Storey, Citation2003). The IPMI model holds that individuals implicitly assume an influence of the media on others, which in turn, can lead to cognitive and affective reactions and guide their own behaviours (Hong, Citation2021). In contrast to a ‘third person’ effect logic (Davison, Citation1983), the IPMI only looks at the perceived effect on others. The third-person-effect, however, takes the gap between the perceived media effects on oneself vs. others as the independent variable (Liu & Huang, Citation2020). The IPMI model would predict that an perceived impact on others may affect individuals’ impression about the crisis and how it can be handled.

Connecting the IPMI model with the Transactional Theory of Stress and its notion of (un)controllability, we can theorize a three-step process: First, individuals perceive a prevalence of misinformation about COVID-19. Second, they assume that such misinformation can have an impact on others, that is, others are likely to believe in this misinformation (see Cheng & Chen, Citation2020). Third, this presumed influence on others will foster the perception of uncontrollability of the pandemic. That is, when misinformation prevails, the pandemic is arguably difficult to control by authorities. Since a pandemic can only be effectively handled and controlled when a majority of citizens accept a basic set of accurate information, perceived spread of misinformation can be theorized to increase worries about COVID-19. This leads to our first hypothesis:

H1: Perceived prevalence of misinformation fuels people’s worries about the pandemic.

Misinformation prevalence and case-Fatality ratios as country differences

One could argue that the relationship described in H1 depends on the actual amount of misinformation that respondents were exposed to. More specifically, the share of misinformation in the media varies considerably between countries. Therefore, in one country, individuals may have the perception that misinformation is heavily present, while in other countries, people could have the feeling that misinformation is not actually prevalent, which could also be rooted in the real prevalence of misinformation. The relationship between perceived prevalence of misinformation and COVID-19 worries might be hence contingent on the actual amount of misinformation. We therefore need to look at the extent to which news consumers in different countries are exposed to higher or lower doses of misinformation. In a recent study, Gallotti et al. (Citation2020) developed a COVID-19 Infodemic Risk Index (which we use as a proxy for misinformation prevalence in the media) by categorizing Twitter posts as misinformation based on external ratings by fact checking agencies worldwide. They found substantial variations in misinformation across countries. Likewise, analyzing web searches for misinformation content, a study by Nsoesie et al. (Citation2020) suggests that the spread of misinformation depends on country contexts. They found that those searches varied in their start and peak times. Using survey data from 40 countries, Singh et al. (Citation2022) found that the belief in misinformation varied from 6% to 37% of individuals depending on country, with poorer regions being more susceptible to believing COVID-19 misinformation. Also, Madraki et al. (Citation2021), looking at the spread of COVID-19 misinformation on social media in multiple countries and on multiple platforms, showed that COVID-19 misinformation varied substantially across countries.

Such objective counts of misinformation may also affect the perceptions of how prevalent misinformation is and, by doing so, influence worries about the pandemic. It may be speculated that the relationship between perceived prevalence of misinformation and people’s worries is higher in countries with high as opposed to low levels of actual misinformation. The reason may be that the spread of misinformation may be out of control, people may perceive that, so worries are reinforced. However, given the apparent lack of any prior research and these conflicting considerations, we formulate the following specific research question:

RQ1: Is the relationship described in hypothesis 1 lower or higher with rising levels of actual misinformation in a country?

Besides the actual amount of misinformation, the death toll due to COVID-19 may also play a role at the country level. In a ten-country comparative study, Dryhurst et al. (Citation2020) suggest a huge variability across cultures in terms of perceptions of risk associated with COVID-19. Also, there were significant variations in the number of deaths at the beginning of the pandemic. But again, comparative research on COVID-19 is scarce, and there is not enough substance to formulate any hypothesis. In this study, we focus on the case-fatality ratio, that is, the number of deaths per infected people. The case-fatality ratio is the key epidemiological parameter for the seriousness of a infectious disease (e.g., Ghani et al., Citation2005; Luo et al., Citation2021). One could speculate that misinformation would lead to more worries for higher as compared to lower case-fatality ratios in a country. The reason could be that high case-fatality ratios may give additional weight to the misinformation. That is, the belief in misinformation by others may be perceived as more dangerous and more consequential. Independent of the theoretical mechanisms, the case-fatality ratio is an important country level factor that arguably needs to be explored. However, since there is no theoretical or empirical prior work, we ask in another specific research question:

RQ2: Is the relationship described in hypothesis 1 weaker or stronger with higher levels of the COVID-19 case-fatality ratio at the country level?

Trust as a Driver and Facilitator of Worries about COVID-19

In times of crisis, people rely heavily on information coming from the media, to get a basic orientation and to stay informed about the situation. News consumption spiked at the beginning of the pandemic (Kantar, Citation2020), across all age groups. In times of social disruption, ‘there is an unusually high need for information and sense-making by individuals’ (Lowery, Citation2004, p. 339). The need for orientation (NFO), that is people’s tendency to seek information about an issue in the news media, is particularly strong when an issue is highly relevant for an individual and contextual uncertainty is high (Matthes, Citation2006). Additionally, based on media system dependency theory (Ball-Rokeach & DeFleur, Citation1976), in times of crisis people rely on the media to offer timely and ‘expert’ information (Lowery, Citation2004, p. 339), and actively engage in news seeking to get updates of the unfolding situation (Lachlan et al., Citation2009).

We argue that, at the beginning of the pandemic, characterized by unusual levels of uncertainty and therefore by very high levels of need for orientation, people turned to the media particularly to stay informed with recent developments, and therefore, their NFO increased substantially. Though turning to media for information should arguably decrease the level of uncertainty about an issue, we believe that the COVID-19 crisis and the multiple lockdowns in various countries around the world as well as the monopolization of the public space with COVID-19 related information, and the constant reporting about the number of cases and deaths, may have made people even more concerned (Bareket-Bojmel et al., Citation2020). In fact, other research about times of crisis indicates that news media may accelerate fears and worries, rather than reducing it (e.g., Thompson et al., Citation2019). More germane to the purposes of the present study, Garfin et al. (Citation2020) reviewed the available literature and concluded that media exposure, in times of crisis, will accelerate, rather than reduce fears.

To our knowledge, the role of media trust in reducing fears is however understudied. Brashers et al. (Citation2000) suggest that information seeking could either reduce uncertainty by helping people ‘better discriminate between or among alternatives’ or increase uncertainty by ‘increasing the number of alternatives, or by blurring the distinction between or among alternatives’ (p. 63). Given the huge amounts of negative and potentially distressing information provided by the media during the early months of the pandemic, such as death counts and number of infections, we assume that trust in the news media fuelled feelings of concern during the pandemic. In fact, a recent study suggests that 91% of COVID-19 stories by U.S. major media outlets are negative in tone, and more interestingly, that such media negativity is not attenuated by positive developments regarding the pandemic (Sacerdote et al., Citation2020). Moreover, there is some evidence that the media use language inducing ‘scaremongering’, rather than language promoting self-efficacy (Ogbodo et al., Citation2020, p. 265). Therefore, we hypothesize:

H2. The more people trust news about COVID-19, the more concerned they are about the pandemic.

While trust in news media may increase people’s worries, other factors may work in the opposite direction. It can for example be assumed that trust in political actors such as the national government and parliament as well as trust in medical actors might help individuals cope with the situation, leading to less worries. In times of crisis, trust in political national institutions often increases, and such ‘rally-around-the-flag’ effects (Mueller, Citation1970) have been observed in many countries and contexts. In fact, studies suggest that there was an increase in political trust at the beginning of the pandemic, at which the majority of governments around the world reacted with strict lockdowns and measures (Bol et al., Citation2021). In most countries, people regarded the strict measures as necessary and tended to support those who enforced them (Bol et al., Citation2021). Against this background, we theorize that trust in national political institutions is associated with reduced levels of worries about the pandemic.

A similar argument can be made for medical actors. Medical experts, doctors, and nurses are perceived as the experts during medical emergency crises. Researchers have documented the key role of medical experts or health agencies in influencing people’s willingness to comply with recommended behaviours during previous pandemics (Siegrist & Zingg, Citation2014). Though medical actors could also serve as a source of alarmism, we would expect that trust in medical actors will provide individuals with the impression that the crisis can be handled and overcome. Obviously, medical expertise marks the way out of the pandemic. Also, in most countries, medical experts have urged the public to take the threat of COVID-19 seriously (World Health Organization, Citation2020), and argued in causal language about how the pandemic can be kept under control. We therefore theorize that trust in medical experts will reduce people’s levels of concern about the pandemic. Our final hypotheses thus are:

H3. The more people trust political actors, the less concerned they are about the pandemic

H4. The more people trust medical actors, the less concerned they are about the pandemic

Study 1

Method and measures

We use a two-wave panel survey fielded in 17 European countries (Austria, Belgium, Denmark, France, Germany, Greece, Hungary, Israel, Italy, the Netherlands, Norway, Poland, Romania, Spain, Sweden, Switzerland, and the UK) between December 2019 (wave 1, i.e., before COVID-19) and May and June 2020 (wave 2, i.e., after the outbreak), conducted by Dynata. Dynata recruits and verifies the identity of their panel members and then draw samples from their panels. In our sample, we used quotas for age, gender, and metropolitan region. The samples are not representative, as they are no random samples, but they are in line with the distribution of age, gender, and metropolitan region in a respective country. According to Aaron et al. (Citation2022), Dynata has a higher selection sampling quality as compared to MTurk samples.

In wave 1, a total of N = 28,317 respondents completed the survey. The average age was 42 and 55.4% of the sample were female. At wave 2, N = 14,218 respondents completed the survey with a sample size per country ranging from n = 641 to n = 1,002 cases, depending on country size. The retention rate ranged from 39.9-60.6% (for more information, see Authors, Citation2020). Since COVID-19 came up after the first panel wave, we primarily use the second panel wave data for our key independent and dependent variables.

All measures, means as well as standard deviations are detailed in the online APPENDIX at OSF: https://osf.io/px986/?view_only = 142874fda3184ce0ab281f14bde89476. Prevalence of misinformation in one's media diet was measured with two items asking respondents how often they came across information that they suspect is false (rSB = .68, M = 2.45, SD = 1.12, 5-point scale). As an alternative measure, we also used a single item specifically referring to prevalence of misinformation with respect to COVID-19.

Similar to related research (Barber & Kim, Citation2021; Coifman et al., Citation2021), worries regarding Covid-19 were tapped with three items asking about worries to get infected and economic consequences (α =  .68, M = 4.95, SD = 1.28, 7-point scale). Worries typically relate to different aspects (see Barber & Kim, Citation2021; Coifman et al., Citation2021; Taylor et al., Citation2020), and for COVID-19, worries center around two main dimensions: (a) Worries about the dangerousness of the virus for oneself and one's social relationships and (b) worries about socio-economic consequences. Trust was assessed by asking respondents about the extent to which they trusted political actors (two items, national parliament and national government, rSB = .86, M = 4.06, SD = 1.59), medical experts (two items, experts as well as doctors and nurses, rSB = .82, M = 5.27, SD = 1.27), and the news media (single item) to deal with and responding to the coronavirus outbreak (M = 3.71, SD = 1.49). We also controlled for age, gender, left-right ideology, objective knowledge about the virus (M = 4.36, SD = .82), and exposure to news about the virus.

The present study also accounts for cross-country variation in misinformation news prevalence. We used the ‘Infodemic Risk Index’ by Gallotti et al. (Citation2020) that categorized Twitter posts as misinformation based on external ratings by fact checking agencies worldwide. This project produces frequency estimates of misinformation per country on Twitter. The data are freely available on https://covid19obs.fbk.eu/#/api. The index assed all tweets posted about COVID-19 since 22 January 2020 using Filter API, For each country, we summarized the Tweets categorized as misinformation between January 1, 2020 and the starting date of the second panel wave per individual. The classification method is detailed in Gallotti et al. (Citation2020). We argue that this variable is a good proxy for country differences in misinformation prevalence. Even if Twitter is more likely to be used in one country than in another, Twitter is an important platform where misinformation spreads. If there are high amounts of misinformation on Twitter in one country, it is highly likely that this country also ranks higher in misinformation prevalence on other platforms. We cross-checked the Twitter-based ranking with information from the Poynter data-base which collects misinformation found by fact checking agencies on various platforms across countries and found a very similar ranking of countries. As for COVID-19 case-fatality ratios, we relied on the 2019 Novel Coronavirus Visual Dashboard (see Dong et al., Citation2020). We extracted the number of deaths in a country due to COVID-19 divided by the number of infections, up to the day of the individual interview per respondent as an objective measure.Footnote1

Data analysis

We ran multilevel mixed effects regressions, which account for country random effects (see Grilli & Rampichini, Citation2015). We do this to explain differences in the dependent variable between the countries. To test the robustness of our findings and to control for potential selection biases, we performed propensity score matching. One of the shortcomings of observational data to study causal inferences is difficulties in attaining the covariate balance between treatment and control group. Unlike in controlled experiments where the treatment is randomly assigned, in observational data, treatment and control groups often have systematically different covariates. To get rid of these systematic covariance differences, matching the individuals in treatment and control groups who share same or similar covariates could be performed. However, exact matching is almost impossible with observational data. To overcome this, Rosenbaum and Rubin (Citation1983) recommended the use of the propensity score. The propensity score is the probability of being assigned to the treatment (in our study, being exposed to misinformation) based on the individual’s covariates. Though the propensity score has limitations as it is calculated post-treatment and only based on the observed covariates, it is regarded as a robustness check.

Results

Findings are depicted in . In line with H1, results of the multilevel model suggest that perceived prevalence of misinformation positively predict worries about COVID-19 (b = .087, p < .001). Also in line with our second hypothesis, there was a positive relationship of trust in the news media with worries about COVID-19 (b = .058, p < .001). Confirming H3, trust in political actors to deal with the Covid-19 crisis was negatively related to worries (b = −.078, p < .001). Yet against expectations, trust in medical actors did not reduce, but accelerated, worries (b = .111, p < .001). To test the robustness of the observed relationship between perceived prevalence of misinformation and worries, we used a single item specifically asking for perceived prevalence of misinformation with respect to COVID-19. Similar to the initial finding, we found that perceived prevalence of misinformation regarding COVID-19 positively predict worries about COVID-19 (b = .038, p < .001). The same was found when using this specific item for the propensity score matching analysis.

Table 1. Multilevel model predicting emotional concerns about COVID-19, Regression coefficients with Standard Errors in brackets (Study 1).

There may, however, be substantial differences between the countries. To investigate those, we turn to the country level variables. Here, we found no significant relationships between actual misinformation prevalence and worries (b = .048, b = .69). Also, there was no cross-level interaction between actual misinformation prevalence and perceived prevalence of misinformation when explaining worries about the pandemic (b = −.002, b = .83). In an additional analysis, we tested for a possible mediation: one could expect that actual misinformation prevalence drives perceived prevalence, which then in turn, fuels concerns. However, we found no evidence for a mediation. There is no significant relationship between actual misinformation prevalence and perceived prevalence, both for the index (b = −.065, b = .42) and for the single item specifically asking for perceived prevalence of misinformation with respect to COVID-19 (b = −.078, b = .42)

We found no relationship with the case-fatality ratio at the country level (b = .028, b = .21). However, there was a significant negative interaction (b = −.004, p < .05) between the case-fatality ratio and perceived prevalence of misinformation. The negative sign of this interaction as well as additional probing suggest that the effect of perceived misinformation on worries is reduced with rising levels of the case-fatality ratio per country. Finally, with respect to the control variables, there was a positive relationship with news exposure about Covid-19 (b = .186, p < .001), interest in politics (b = .086, p < .001), and left-right ideology (b = .015, p < .001), but no significant effect of objective Corona knowledge (b = −.033, p = .11).

Since these were cross-sectional relationships, we turned to propensity score matching. We calculated the propensity score within a caliper distance of .04. The caliper width was set to be .2 of the standard deviation of the propensity score, based on the suggestion by Austin (Citation2011). In calculating the proper propensity score, choosing all covariates which could have affected the outcome (e.g., the potential confounders) is crucial. Hence, all the covariates used in the multilevel model were also included to calculate the propensity score, including the high-order interaction terms. The standardized mean differences between the covariates after matching were smaller than .25 and the variance ratios were between .5 and 2.0, and became closer to 1.0 after matching. We took 30% of our sample as a treatment group (which has prevalence of misinformation at a level higher than 4.5) and assigned the rest of the respondents into the control group (which has prevalence of misinformation level lower than 4.5 or equal to 4.5). The matching was performed with replacement since the number of treatments was smaller than the number of controls. At last, 4,210 individuals were matched. Once matched, the sample showed that perceived prevalence of misinformation had positive and significant Average Treatment Effect (ATE) on perceiving COVID-19 related worries (ATE = .23, SE = .03, p < .005), which corresponds to our findings from the multilevel analysis. In other words, perceived prevalence of misinformation had positive and significant influence on worries related to the pandemic.Footnote2

Discussion

The aim of Study 1 was to test the relationship between perceived prevalence of misinformation and worries about the pandemic. Using a multilevel regression model as well as propensity score matching as an additional validation, we found clear evidence that perceived prevalence of misinformation is positively related to COVID-19 related worries. We interpret this finding with the notion of perceived uncontrollability. That is, when people think that they see a lot of misinformation, they assume that misinformation is highly prevalent, that other people may be influenced by such prevalent misinformation, and thus they infer that COVID-19 is spinning out of control. This perception of uncontrollability is likely to increase worries about one's own and others’ situation. Interestingly, the effect was independent from the actual prevalence of misinformation at the country level. However, the case-fatality ratio at the country level significantly moderated this relationship. Findings suggest that the relation between perceived prevalence of misinformation and worries becomes weaker with rising levels of case-fatality ratios at the country level. We will revisit this finding in our general discussion section.

Also, we found that trust in the news media was positively related to worries, probably due to the negative nature of most news reports at the time of the study (see Sacerdote et al., Citation2020). Also, trust in political actors was negatively associated with worries suggesting that the measures taken during the first wave of the pandemic up to the summer of 2020 were perceived as reasonable, justified, and effective. Finally, against expectations, trust in medical actors was found to be more likely to increase rather than decrease worries. A potential explanation may be that medical actors were frequently cited in the media referring to the threat associated with the pandemic, as for instance, related to deaths and serious health consequences.

There are some limitations. First, though we used panel data, our key relationships were tested cross-sectionally with wave 2 data only. Even though we employed propensity score matching, we therefore cannot draw firm causal conclusions, and we cannot rule out a systematic influence of panel attrition on the findings. The reason for only using second wave panel data is that the COVID-19 pandemic hit in the midst of data collection, so we could not include questions on COVID-19 in the first wave. As with other COVID-19 research, a study at the outbreak of a pandemic cannot regarded standard research for which established measures are available. This limitation notwithstanding, we offer unique cross-national data from the early stages of the pandemic hardly available in the field.

Second and related, we did not measure the notion of perceived uncontrollability. Third, the Infodemic Risk Index has limitations since there are huge differences across countries regarding the use of Twitter. Fourth, we tested the role of the actual amount of misinformation at the country level. However, individuals may differ in the contents to which they were exposed, particularly misinformation about COVID-19. Misinformation may concern different aspects, such as threat of COVID-19, vaccinations, or conspiracy theories. These were not measured. To address these shortcomings, we conducted an experiment.

Study 2

Findings of Study 1 suggest that perceived prevalence of misinformation increases worries related to COVID-19. Study 2 was designed to replicate these findings, shedding light on the underlying mechanism – the belief that widespread misinformation makes COVID-19 difficult to control. When citizens believe that misinformation prevails, they may also think that misinformation potentially guides the behaviours of others and that the virus may get out of hand. Study 2 tests this mediation logic. It is theorized that the perception of prevalent misinformation will increase the notion of uncontrollability. This notion of uncontrollability, then, will foster worries related to the pandemic. In addition, Study 2 also separates economic worries from personal worries about getting infected. Finally, study 2 controls for the actual content of misinformation that individuals believe is prevalent.

Method and measures

We employed a between-subject design manipulating prevalence of misinformation on COVID-19. The experiment was conducted as part of a larger survey conducted by the private survey company Dynata in October 2020. A representative quota-sampling procedure of the Austrian population was applied with respect to age, gender, and education. The IRB board of the University of Vienna] approved the study. Participants (N = 224) were asked to take part in an online experiment. They were randomly assigned to one of the two experimental conditions. We used a multiple message design with two brief news articles in each condition, presented in random order. In the misinformation prevalence condition, individuals read two news articles arguing that internet misinformation on Covid-19 is on the rise (i.e., ‘Every third online news story on COVID-19 is false’). In the misinformation low-prevalence condition, it was argued that there is hardly any misinformation on COVID-19 in online news. Both versions were identical in length and content, except for the experimental manipulation of misinformation prevalence. It is important to note that the perceived content of prevalent false information that respondents may have had in mind was not manipulated and is thus randomly distributed across conditions. We only manipulated prevalence, but we statistically controlled for the perceived content of prevalent false information that respondents had in mind. Results are identical without this control. Participants were asked to read the news articles at their individual speed. All materials and items are listed in the online APPENDIX: https://osf.io/px986/?view_only = 142874fda3184ce0ab281f14bde89476.

We measured the dependent variable, worries about COVID-19, with the same three items as in Study 1, plus additional items to form two separate dimensions. In fact, Principal Component Analysis revealed two factors, worries about getting infected (three items, α =  .89, M = 4.82, SD = 1.64) and worries about economic consequences for oneself, one's family, and the country (three items, α =  .76, M = 4.80, SD = 1.54). The mediator, controllability, was measured with five items tapping the notion that due to misinformation, the virus cannot be controlled or that misinformation shapes the behaviours of individuals regarding COVID-19. The index was one-dimensional (α = .91, M = 4.34, SD = 1.54). As a control, we listed eight different areas of misinformation on COVID-19 and we asked participants how frequently they think these contents appear online. We controlled for age, gender, and education (see online APPENDIX).

As a manipulation check, we measured two items after stimulus exposure asking about the degree to which the articles state that the majority of news on COVID-19 is false (α = .85, M = 4.00, SD = 1.91). The experimental conditions showed a statistically significant difference between the conditions (prevalence condition: M = 5.09, SD = 1.37; low-prevalence condition: M = 2.94, SD = 1.76) in the expected direction (t = −10.20, p < .001). The two conditions did not significantly differ on all items tapping the perceived content of prevalent false information. Thus, we measured perceived prevalence, not the actual misinformation content or areas.

Results

We ran mediation analyses relying on a 95% bias-corrected bootstrap confidence interval (CI) based on 5,000 bootstrapped samples (see ). Worries served as the dependent and misinformation prevalence as the independent variable, and perceived uncontrollability as the mediator. As for worries about getting infected, we found a significant effect of the misinformation prevalence condition (compared to the low-prevalence condition) on perceived uncontrollability (b = .47, SE = .88, p < .001). As indicated in , uncontrollability was also explained by three of different types of misinformation that respondents had in mind. Overall, 35% of the variance was explained. In the next step, we looked at the effects on worries about getting infected. Here, we found that the notion of perceived uncontrollability significantly predicted worries (b = .47, SE = .08, p < .001). Furthermore, worries were predicted by three misinformation contents that respondents had in mind, explaining 28% of the variance overall. The indirect effect of misinformation prevalence on worries, mediated by uncontrollability, was significant (b = .32, LLCI = .15, ULCI = .59). There was however no direct effect of experimental condition on worries (b = −.23, SE = .20, p = .25). For worries about economic consequences, exactly the same pattern emerged. Experimental manipulation of misinformation prevalence positively predicted the notion of perceived uncontrollability (b = .68, SE = .17, p < .001) which, in turn, explained economic worries (b = .32, SE = .08, p < .001), while no direct effect of experimental condition on economic worries emerged (b = −.28, SE = .21, p = .18). The indirect effect was significant (b = .22, LLCI = .08, ULCI = .46).

Table 2. Mediation analysis predicting Worries about COVID-19 (Study 2).

Discussion

Findings clearly demonstrated the individuals’ belief that there is prevalent misinformation, independent from the actual content of misinformation, leads to the feeling that COVID-19 is difficult to control, which in turn, fuels worries. We extended Study 1 by distinguishing two dimensions of worries, i.e., worries of getting infected and worries about the economic situation. When only using the items employed in Study 1, the very same findings emerge. There was no direct effect of the experimental condition, although the manipulation was strong and significant. However, it needs to be noted that an experiment cannot serve as a direct and strict validation of survey data. In the survey data, the statistical power was rather strong, so a direct effect may be observable without the mediator. In the experiment, statistical power was much weaker, so no direct effect emerged. Conceptually, the mediation effect observed in Study 2 is in line with the theory.

Study 2 also has limitations. First, we used a forced exposure design with comparatively simple textual stimuli. We were only interested to manipulate the perceived prevalence of misinformation, and thus, the stimuli were designed to be high in internal validity. Future research should replicate the study with audiovisual material. We ran mediation models, for which the effect of the mediator on the outcome cannot be interpreted in causal terms. Future research should thus directly manipulate the notion of uncontrollability. Finally, we did not account for the amount of misinformation individuals may have received prior to the experiment. Given the randomization of respondents, the amount and content of misinformation should however be equally distributed across conditions. Furthermore, we asked respondents about what they believe are the most prevalent contents of misinformation and used these measures as controls. We can therefore confidently say that the effects we observed are due to the perceived prevalence of misinformation, not specific types of misinformation.

General discussion

The present research was designed to examine the relationship between the perceived prevalence of misinformation about COVID-19 and worries about the pandemic. We tested this relationship using a multi-country survey, applying multilevel models with cross-level interactions as well as propensity score matching. We also validated the findings of the survey with an experimental study. Thereby, we extend research on misinformation and COVID-19 in several ways. First, we offer correlational and causal evidence that perceived prevalence of misinformation can increase worries about the pandemic, which may have potentially detrimental effects on other psychological and social outcomes. Second, we shed light on the underlying mechanism. In fact, we theorized and demonstrated, based on the Transactional Theory of Stress by Lazarus and Folkman (Citation1984), that perceived prevalence of misinformation fuels the perception of uncontrollability, that is, the feeling that the virus may be hard to get under control. When misinformation is out there, governments and medical experts may struggle to implement effective measures. Thus, people may come to believe that misinformation represents a potential harm, delaying or impeding the fight against the pandemic.

Third, we add to the understanding of how misinformation affects individuals by turning attention to the perception logic. That is, we studied the effects of the perception that misinformation is prevalent rather than explaining the attitudinal effects of misinformation itself. That is, the mere talking or reporting about misinformation may lead to the impression of the public that misinformation is prevalent, and this alone can have significant consequences (Chang, Citation2021). To reiterate, whenever we ask respondents whether or not they have seen information that they believe is false, we move to the perceptual rather than the attitudinal dimension. That is, when respondents state the information is false, this response by definition implies that they do not believe the actual misinformation. Therefore, we show that the mere perception of prevalent misinformation can have significant effects, even though people do not believe in it.

Fourth, we looked at the role of macro-level variables such as the actual amount of misinformation prevalent as well as the case-fatality ratios in a country. In Study 1, the effect of perceived prevalence of misinformation on worries was mitigated with rising levels of case-fatality ratios. This finding suggests that, the deadlier the pandemic, the less misinformation will affect worries. This finding may appear counter-intuitive. However, case-fatality ratios refer to the share of people that die after being infected. This ratio is an objective and hard criterion about the pandemic. Most likely, lots of misinformation in early stages of the pandemic centered around questioning the harm and seriousness of COVID-19. With rising death tolls, such misinformation is simply less meaningful. Similarly, misinformation about fake cures and other medical myths may appear arbitrary and more obviously false when many people die after being infected. Surprisingly, the case-fatality ratio was also unrelated to worries, perhaps due to a ceiling effect. Needless to say, these conjectures cannot be proven with the present data, necessitating additional, particularly experimental research.

Fifth and finally, the multi-level analysis demonstrated that perceived prevalence of misinformation fuelled worries independent from the actual amount of misinformation in a country. Also, the actual levels of misinformation in a country, as measured by the Infodemic Risk Index (Gallotti et al., Citation2020) was unrelated to worries about COVID-19. Related to that, surprisingly, the objective amount of misinformation did not predict the perceived amount of misinformation. These findings suggests that perceptions can, as in the present case, matter a lot even for countries for which the actual amount of misinformation was low. Perceptions of misinformation, may not be accurate and may depend on the media diet of each individual.

But what is the substantive significance of these findings? In both studies, the relation between perceived prevalence of misinformation on the dependent variables was moderately strong. Also, the general pattern was visible in both studies, across several countries, using different methodologies. We therefore tentatively conclude that the perceived prevalence of misinformation – although Study 1 suggests that perceived prevalence is unrelated to actual prevalence – has important consequences for people's worries. Although worries are an important cognitive activity potentially driving behaviours (Coifman et al., Citation2021), our findings do not allow conclusions about concrete emotions or more arousing affective states.

Limitations and future research

A few further caveats should be mentioned. First, study one was conducted in May/June 2020, shortly after the outbreak of COVID-19 in Europe (March), while study 2 was conducted in October 2020. Thus, the contexts of both studies differed. However, in Study 2, we only manipulated prevalence of misinformation, without mentioning any contents or areas of misinformation. The experimental logic of Study 2 should therefore be independent of time and context. Second, this research was limited to European countries. Third, since we only assessed worries as cognitive outcomes, future research should specifically measure concrete emotions such as fear (see Coifman et al., Citation2021). And finally, though we believe it is a major contribution of this research to shed light on the perception logic, the interplay of perceptions about and beliefs in misinformation deserves more attention.

These limitations notwithstanding, our findings hold considerable implications. Besides the general detrimental effects of misinformation related to public health (Southwell et al., Citation2019), worries about COVID-19 can have important psychological and behavioural consequences, some of them with negative, some of them with positive consequences. On the one hand, worries may be dysfunctional, leading to negative psychological states, such as depressive tendencies or psychotic disorders (see Fitzpatrick et al., Citation2020). On the other hand, worries about COVID-19 could have functional outcomes, such as protective behaviours such as social distancing.

This research could be extended to other outcomes such as psychological well-being or distress. Also, it appears worthwhile to study the effects of misinformation perceptions on actual behaviour during the pandemic, especially with respect to vaccinations. Future research should also explore the roles of other macro-variables such as cultural dimensions or perhaps even differences in the healthcare system. Finally, the relationship between trust in the news media, political experts as well as medical experts deserves more attention, especially across countries.

Conclusion

Perceptions of prevalent misinformation do matter. In the case of COVID-19, they lead to the impression that the pandemic is difficult to control which, in turn, increases worries among the public. Our findings suggest that perceived misinformation can have significant psychological effects even though audience members reject the information as being false. In a global pandemic with extensive death rate up to this date, misinformation is indeed worrying, not only for citizens, but also politicians, medical experts, and journalists.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project was financially supported by the Network of European Political Communication Scholars (NEPOCS). Data collection in Denmark was supported by the University of Southern Denmark. The collection of data in Hungary and Poland was supported by the Economic and Social Research Council [ES/S01019X/1]. The collection of the data in France was supported by an Audencia Foundation grant. In Romania, the Interdisciplinary PhD school of SNSPA supported the data collection. The collection of data in Sweden was supported by the research project 'Knowledge resistance: causes, consequences, cures', funded by Riksbankens Jubileumsfond. Yannis Theocharis would like to acknowledge the support of the ZeMKI Lenkungskreis at the University of Bremen, which generously contributed to funding this research.

Notes on contributors

Jörg Matthes

Jörg Matthes is a professor of communication science at the University of Vienna. His research interests include political communication, digital media use, media effects, and advertising.

Nicoleta Corbu

Nicoleta Corbu is a professor of communication at the National University of Political Studies and Public Administration (SNSPA), Bucharest, Romania, where she coordinates the Center for Research in Communication and the Multi-disciplinary Ph.D. School. Her research interests focus on political communication, media effects, and education policies.

Soyeon Jin

Soyeon Jin is a doctoral candidate at the Department of Governance, School of Social Sciences and Technology, Technical University of Munich. Her dissertation focuses on media salience, public salience, immigration attitudes and immigrant integration.

Yannis Theocharis

Yannis Theocharis is a professor and chair of Digital Governance at the Department of Governance, School of Social Sciences and Technology, Technical University of Munich. His work focuses on political behavior, political communication, and computational social science.

Christian Schemer

Christian Schemer is a professor of Communication at the Department of Communication of the Johannes Gutenberg University in Mainz, Germany. His research is focused on political communication use and effects.

Peter van Aelst

Peter van Aelst is a research professor at the department of political science at the University of Antwerp and a founding member of the research group “Media, Movements and Politics” (M2P). His research focuses on political communication.

Jesper Strömbäck

Jesper Strömbäck is a professor in journalism and political communication at the Department of Journalism, Media and Communication, University of Gothenburg, Sweden.

Karolina Koc-Michalska

Karolina Koc-Michalska is a professor at the Audencia Business School and has affiliations with CEVIPOF Sciences Po Paris, France, and University of Silesia, Faculty of Social Sciences, Poland. Her research focuses on the strategies of political actors in the online environment and citizens' political engagement. She employs a comparative approach focusing on the United States and European countries.

Frank Esser

Frank Esser is a Head of the Department of Communication and Media Research and full professor of International & Comparative Media Research at the University of Zurich. Previously, he also held a part-time adjunct professorship in the Department of Media and Communication at the University of Oslo.

Toril Aalberg

Toril Aalberg is a professor at the Department of Sociology and Political Science at the Norwegian University of Science and Technology (NTNU) in Trondheim. She does empirical work on political communication, political behavior, and public opinion.

Ana Sofia Cardenal

Ana Sofia Cardenal is an associate professor of political science at the Law and Political Science Department at the Universitat Oberta de Catalunya (UOC) and a lecturer at the Universitat Pompeu Fabra (UPF). Her recent work focuses on the areas of comparative political communication, digital media, and public opinion.

Laia Castro

Laia Castro is an assistant professor at the Department of Political Science at University of Barcelona. She does empirical work on political communication, comparative media research and public opinion.

Claes de Vreese

Claes de Vreese is a professor of Political Communication (ASCoR) and a distinguished professor of AI and Democracy at the University of Amsterdam.

David Hopmann

David Hopmann is a professor at the Centre for Journalism, University of Southern Denmark. In his research he investigates the antecedents of media content and its effects on news users.

Tamir Sheafer

Tamir Sheafer is a professor in the Department of Political Science and the Department of Communication and Journalism, and the dean of the Faculty of Social Sciences at the Hebrew University of Jerusalem.

Sergio Splendore

Sergio Splendore is an associate professor at the Department of Social and Political Sciences at the University of Milan and his main research interests are journalism and political communication.

James Stanyer

James Stanyer is a professor of Communication and Media Analysis, at the School of Social Sciences and Humanities, Loughborough University, UK. His research is focused on political communication in advanced industrial democracies.

Agnieszka Stępińska

Agnieszka Stępińska is a professor at the Faculty of Political Science and Journalism at the Adam Mickiewicz University in Poznan, Poland. She does empirical work on political communication, comparative media research & journalistic role perception and performance.

Václav Štětka

Václav Štětka is a senior lecturer in Communication and Media Studies at the School of Social Sciences and Humanities, Loughborough University (UK). Previously he worked at Masaryk University in Brno, University of Oxford and Charles University in Prague. His research interests encompass political communication and polarization, journalistic autonomy, and the relationship between media and democracy in Central and Eastern Europe.

Alon Zoizner

Alon Zoizner is an assistant professor at the Department of Communication at the University of Haifa. His research bridges digital technologies, modern information environments, and current political developments, utilizing computational content analysis, experiments, survey analysis, and elite interviews.

Notes

1 As an alternative measure, we also used the number of deaths divided by the country population at the time of the interview. We found no interaction between perceived misinformation prevalence and number of deaths divided by the country population (b = -0.048, p = .181). Thus, the interaction only holds for case-fatality ratio, which is one of the most important epidemiological parameters (Luo et al., Citation2021).

2 In an additional analysis, we ran a model also controlling for the attitudinal logic, that is actual belief in misinformation (i.e., conspiracy misinformation such as “The coronavirus is a bioweapon that has been deliberately created by China to harm people”). We did this to check whether the effects of perceptions remain robust. In fact, none of the findings change. We can thus say that the relationship between perceived prevalence of misinformation and worries cannot be explained by the actual belief in misinformation.

References

  • Aaron, D., Arndt, J. B., Ford, B. J., & Babin, V. L. (2022). Collecting samples from online services: How to use screeners to improve data quality. International Journal of Research in Marketing, 39(1), 117–133. https://doi.org/10.1016/j.ijresmar.2021.05.001
  • Ali, S. (2020). Combatting against Covid-19 & misinformation: A systematic review. Human Arenas, http://doi.org/10.1007/s42087-020-00139-1
  • Austin, P. C. (2011). Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharmaceutical Statistics, 10(2), 150–161. http://doi.org/10.1002/pst.433
  • Authors. (2020). Blinded for peer review.
  • Ball-Rokeach, S. J., & DeFleur, M. L. (1976). A dependency model of mass-media effects. Communication Research, 3(1), 3–21. http://doi.org/10.1177/009365027600300101
  • Barber, S. J., & Kim, H. (2021). COVID-19 worries and behavior changes in older and younger men and women. The Journals of Gerontology: Series B, 76(2), e17–e23. https://doi.org/10.1093/geronb/gbaa068
  • Bareket-Bojmel, L., Shahar, G., & Margalit, M. (2020). COVID-19-related economic anxiety is as high as health anxiety: Findings from the USA, the UK, and Israel. International Journal of Cognitive Therapy, 1–9. http://doi.org/10.1007/s41811-020-00078-3
  • Bol, D., Giani, M., Blais, A., & Loewen, P. J. (2021). The effect of COVID-19 lockdowns on political support: Some good news for democracy? European Journal of Political Research, 60(2), 497–505. http://doi.org/10.1111/1475-6765.12401
  • Brashers, D. E., Neidig, J. L., Haas, S. M., Dobbs, L. K., Cardillo, L. W., & Russell, J. A. (2000). Communication in the management of uncertainty: The case of persons living with HIV or AIDS. Communications Monographs, 67(1), 63–84. http://doi.org/10.1080/03637750009376495
  • Chang, C. (2021). Fake news: Audience perceptions and concerted coping strategies. Digital Journalism, 9(5), 636–659. https://doi.org/10.1080/21670811.2021.1923403
  • Cheng, Y., & Chen, Z. F. (2020). The Influence of presumed fake news influence: Examining public support for corporate corrective response, media literacy interventions, and governmental regulation. Mass Communication and Society, 23(5), 705–729. https://doi.org/10.1080/15205436.2020.1750656
  • Coifman, K. G., Disabato, D. J., Aurora, P., Seah, T., Mitchell, B., Simonovic, N., Foust, J. L., Sidney, P. G., Thompson, C. A., & Taber, J. M. (2021). What drives preventive health behavior during a global pandemic? Emotion and worry. Annals of Behavioral Medicine, 55(8), 791–804. https://doi.org/10.1093/abm/kaab048
  • Corbu, N., Bârgăoanu, A., Buturoiu, R., & Ștefăniță, O. (2020). Does fake news lead to more engaging effects on social media? Evidence from Romania. Communications, 45(s1), 694–717. http://doi.org/10.1515/commun-2019-0152
  • Davison, W. P. (1983). The third-person effect in communication. Public Opinion Quarterly, 47(1), 1–15. http://doi.org/10.1086/268763
  • de Bruin, W. B., & Bennett, D. (2020). Relationships between initial COVID-19 risk perceptions and protective health behaviors: A national survey. American Journal of Preventive Medicine, 59(2), 157–167. http://doi.org/10.1016/j.amepre.2020.05.001
  • Dong, E., Du, H., & Gardner, L. (2020). An interactive web-based dashboard to track COVID-19 in real time. Lancet Infectious Diseases, 20(5), 533–534. doi: 10.1016/S1473-3099(20)30120-1”
  • Douglas, K. M., Uscinski, J. E., Sutton, R. M., Cichocka, A., Nefes, T., Ang, C. S., & Deravi, F. (2019). Understanding conspiracy theories. Political Psychology, 40(s1), 3–35. http://doi.org/10.1111/pops.12568
  • Dryhurst, S., Schneider, C. R., Kerr, J., Freeman, A. L., Recchia, G., Van Der Bles, A. M., … van der Linden, S. (2020). Risk perceptions of COVID-19 around the world. Journal of Risk Research, 23(7-8), 994–1006. http://doi.org/10.1080/13669877.2020.1758193
  • Egelhofer, J. L., & Lecheler, S. (2019). Fake news as a two-dimensional phenomenon: A framework and research agenda. Annals of the International Communication Association, 43(2), 97–116. http://doi.org/10.1080/23808985.2019.1602782
  • Evanega, S., Lynas, M., Adams, J., Smolenyak, K., & Insights, C. G. (2020). Coronavirus misinformation: quantifying sources and themes in the COVID-19 ‘infodemic’. JMIR Preprints.
  • Fitzpatrick, K. M., Harris, C., & Drawve, G. (2020). Fear of COVID-19 and the Mental Health Consequences in America. Psychological Trauma: Theory, Research, Practice, and Policy, Advance online publication. http://doi.org/10.1037/tra0000924
  • Fletcher, R. (2018). Misinformation and disinformation unpacked. In N. Newman, R. Fletche, A. Kalogeropoulos, D. A. L. Levy, & R. K. Nielsen (Eds.), Reuters Institute Digital News Report 2018 (pp. 38–41). Reuters Institute for the Study of Journalism.
  • Gallotti, R., Valle, F., Castaldo, N., Sacco, P., & De Domenico, M. (2020). Assessing the risks of ‘infodemics’ in response to COVID-19 epidemics. Nature Human Behaviour, 4(12), 1285–1293. https://doi.org/10.1038/s41562-020-00994-6
  • Garfin, D. R., Silver, R. C., & Holman, E. A. (2020). The novel coronavirus (COVID-2019) outbreak: Amplification of public health consequences by media exposure. Health Psychology, 39(5), 355–357. doi:10.1037/hea0000875
  • Geldsetzer, P. (2020). Knowledge and perceptions of COVID-19 among the general public in the United States and the United Kingdom: a cross-sectional online survey. Annals of Internal Medicine, 173(2), 157–160. https://doi.org/10.7326/M20-0912
  • Ghani, A. C., Donnelly, C. A., Cox, D. R., Griffin, J. T., Fraser, C., et al. (2005). Methods for estimating the case fatality ratio for a novel, emerging infectious disease. American Journal of Epidemiology, 162(5), 479–486. https://doi.org/10.1093/aje/kwi230
  • Glenski, M., Volkova, S., & Kumar, S. (2020). User engagement with digital deception. In K. Shu, S. Wang, D. Lee, & H. Liu (Eds.), Disinformation, misinformation, and fake news in social media (pp. 39–61). Springer.
  • Grilli, L., & Rampichini, C. (2015). Specification of random effects in multilevel models: a review. Quality & Quantity, 49(3), 967–976. https://doi.org/10.1007/s11135-014-0060-5
  • Gunther, A. C., & Storey, J. D. (2003). The influence of presumed influence. Journal of Communication, 53(2), 199–215. https://doi.org/10.1111/j.1460-2466.2003.tb02586.x
  • Hameleers, M. (2020). Separating truth from lies: Comparing the effects of news media literacy interventions and fact-checkers in response to political misinformation in the US and Netherlands. Information, Communication & Society, online first, 1–17. https://doi.org/10.1080/1369118X.2020.1764603
  • Hameleers, M., & van der Meer, T. G. (2019). Misinformation and polarization in a high-choice media environment: How effective are political fact-checkers? Communication Research, 47(2), 227–250. http://doi.org/10.1177/0093650218819671
  • He, S., Chen, S., Kong, L., & Liu, W. (2021). Analysis of risk perceptions and related factors concerning COVID-19 epidemic in Chongqing, China. Journal of Community Health, 46(2), 278–285. http://doi.org/10.1007/s10900-020-00870-4
  • High Level Experts Group. (2018). A multi-dimensional approach to disinformation: Report of the independent high-level group (HLEG) on fake news and online disinformation. Retrieved from ec.europa.eu/newsroom/dae/document.cfm?doc_id=50271.
  • Hong, Y. (2021). Extending the influence of presumed influence hypothesis: Information seeking and prosocial behaviors for HIV prevention. Health Communication, http://doi.org/10.1080/10410236.2021.1975902
  • Huang, Y., & Wang, W. (2020). When a story contradicts: Correcting health misinformation on social media through different message formats and mechanisms. Information, Communication & Society, online first, 1–18. https://doi.org/10.1080/1369118X.2020.1851390
  • Humprecht, E. (2019). Where ‘fake news’ flourishes: a comparison across four Western democracies. Information, Communication & Society, 22(13), 1973–1988. https://doi.org/10.1080/1369118X.2018.1474241
  • Jensen, J. D., Bernat, J. K., LaShara, A. D., & Yale, R. (2010). Dispositional cancer worry: Convergent, divergent, and predictive validity of existing scales. Journal of Psychosocial Oncology, 28(5), 470–489. DOI: 10.1080/07347332.2010.498459
  • Jones-Jang, S. M., Kim, D. H., & Kenski, K. (2020). Perceptions of mis- or disinformation exposure predict political cynicism: Evidence from a two-wave survey during the 2018 US midterm elections. New Media & Society, 1–21. http://doi.org/10.1177/1461444820943878
  • Kantar. (2020). COVID-19 Barometer: Consumer attitudes, media habits and expectations, 3 April 2020, Retreieved from https://www.kantar.com/inspiration/coronavirus/covid-19-barometer-consumer-attitudes-media-habits-and-expectations/.
  • Lachlan, K. A., Spence, P. R., & Seeger, M. (2009). Terrorist attacks and uncertainty reduction: Media use after September 11. Behavioral Sciences of Terrorism and Political Aggression, 1(2), 101–110. http://doi.org/10.1080/19434470902771683
  • Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer.
  • Li, H.-Y., Bailey, A., Huynh, D., & Chan, J. (2020). YouTube as a source of information on COVID-19: A pandemic of misinformation? BMJ Global Health, 5, e002604. http://doi.org/10.1136/bmjgh-2020-002604
  • Liu, P. L., & Huang, L. V. (2020). Digital disinformation about COVID-19 and the third-person effect: Examining the channel differences and negative emotional outcomes. Cyberpsychology, Behavior, and Social Networking, 23(11), 789–793. https://doi.org/10.1089/cyber.2020.0363
  • Lowery, W. (2004). Media dependency during a large-scale social disruption: The case of september 11. Mass Communication and Society, 7(3), 339–357. http://doi.org/10.1207/s15327825mcs0703_5
  • Luo, G., Zhang, X., Zheng, H., & He, D. (2021). Infection fatality ratio and case fatality ratio of COVID-19. International Journal of Infectious Diseases, 113, 43–46. https://doi.org/10.1016/j.ijid.2021.10.004
  • Madraki, G., Grasso, I., Otala, J. M., Liu, Y., & Matthews, J. (2021). Characterizing and Comparing COVID-19 Misinformation Across Languages, Countries and Platforms. Companion Proceedings of the Web Conference 2021 (WWW ‘21), 213–223. https://doi.org/10.1145/3442442.3452304.
  • Mann, F. D., Krueger, R. F., & Vohs, K. D. (2020). Personal economic anxiety in response to COVID-19. Personality and Individual Differences, 167, 110233. http://doi.org/10.1016/j.paid.2020.110233
  • Matthes, J. (2006). The Need for orientation towards news media: Revising and validating a classic concept. International Journal of Public Opinion Research, 18(4), 422–444. http://doi.org/10.1093/ijpor/edh118
  • McKay, S., & Tenove, C. (2020). Disinformation as a threat to deliberative democracy. Political Research Quarterly, online first, http://doi.org/10.1177/1065912920938143
  • Metzger, M. J., Flanagin, A. J., & Medders, R. (2010). Social and heuristic approaches to credibility evaluation online. Journal of Communication, 60(3), 413–439. http://doi.org/10.1111/j.1460-2466.2010.01488.x
  • Mueller, J. E. (1970). Presidential popularity from Truman to Johnson. American Political Science Review, 64(1), 18–34. http://doi.org/10.2307/1955610
  • Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of general psychology, 2(2), 175–220. https://doi.org/10.1037/1089-2680.2.2.175
  • Nielsen, R. K., Fletcher, R., Newman, N., Brennen, S. J., & Howard, P. N. (2020). Navigating the ‘infodemic’. Reuters Institute for the Study of Journalism. Retrieved from https://reutersinstitute.politics.ox.ac.uk/sites/default/files/2020-04/Navigating%20the%20Coronavirus%20Infodemic%20FINAL.pdf.
  • Nsoesie, E. O., Cesare, N., Müller, M., & Ozonoff, A. (2020). COVID-19 misinformation spread in eight countries: Exponential growth modeling study. Journal of Medical Internet Research, 22(12), e24425. https://doi.org/10.2196/24425
  • Ogbodo, J. N., Onwe, E. C., Chukwu, J., Nwasum, C. J., Nwakpu, E. S., Nwankwo, S. U., Nwamini, S., Elem, S., & Ogbaeja, N. I. (2020). Communicating health crisis: A content analysis of global media framing of COVID-19. Health Promotion Perspectives, 10(3), 257–269. https://doi.org/10.34172/hpp.2020.40
  • Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55. https://doi.org/10.1093/biomet/70.1.41
  • Rubin, D. B., & Thomas, N. (2000). Combining propensity score matching with additional adjustments for prognostic covariates. Journal of the American Statistical Association, 95(450), 573–585. http://doi.org/10.1080/01621459.2000.10474233
  • Sacerdote, B., Sehgal, R., & Cook, M. (2020). Why Is All COVID-19 News Bad News? National Bureau of Economic Research Working Paper No. 28110, November 2020.
  • Siegrist, M., & Zingg, A. (2014). The role of public trust during pandemics: Implications for crisis communication. European Psychologist, 19(1), 23–32. http://doi.org/10.1027/1016-9040/a000169
  • Singh, K., Lima, G., Cha, M., Cha, C., Kulshrestha, J., Ahn, Y.-Y., et al. (2022). Misinformation, believability, and vaccine acceptance over 40 countries: Takeaways from the initial phase of the COVID-19 infodemic. PLoS ONE, 17(2), e0263381. https://doi.org/10.1371/journal.pone.0263381
  • Southwell, B. G., Niederdeppe, J., Cappella, J. N., Gaysynsky, A., Kelley, D. E., Oh, A., Peterson, E. B., & Chou, W.-Y. S. (2019). Misinformation as a misunderstood challenge to public health. American Journal of Preventive Medicine, 57(2), 282–285. https://doi.org/10.1016/j.amepre.2019.03.009
  • Taylor, S., Landry, C. A., Paluszek, M. M., Rachor, G. S., & Asmundson, G. J. G. (2020). Worry, avoidance, and coping during the COVID-19 pandemic: A comprehensive network analysis. Journal of Anxiety Disorders, 76, 102327. https://doi.org/10.1016/j.janxdis.2020.102327
  • Thompson, R. R., Jones, N. M., Holman, E. A., & Silver, R. C. (2019). Media exposure to mass violence events can fuel a cycle of distress. Science Advances, 5(4), eaav3502. http://doi.org/10.1126/sciadv.aav3502
  • Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131. http://doi.org/10.1126/science.185.4157.1124
  • Van Duyn, E., & Collier, J. (2019). Priming and fake news: The effects of elite discourse on evaluations of news media. Mass Communication and Society, 22(1), 29–48. http://doi.org/10.1080/15205436.2018.1511807
  • Vraga, E. K., & Tully, M. (2021). News literacy, social media behaviors, and skepticism toward information on social media. Information, Communication & Society, 24(2), 150–166. https://doi.org/10.1080/1369118X.2019.1637445
  • Walter, N., & Murphy, S. T. (2018). How to unring the bell: A meta-analytic approach to correction of misinformation. Communication Monographs, 85(3), 423–441. http://doi.org/10.1080/03637751.2018.1467564
  • Wardle, C., & Derakhshan, H. (2017). Information Disorder: Toward an interdisciplinary framework for research and policy making. Report to the Council of Europe. Retrieved from https://rm.coe.int/information-disorder-toward-an-interdisciplinary-framework-for-researc/168076277c.
  • Wilson, S. L., & Wiysonge, C. (2020). Social media and vaccine hesitancy. BMJ Global Health, 5(10), e004206. http://doi.org/10.1136/bmjgh-2020-004206
  • Wong, C. M. L., & Jensen, O. (2020). The paradox of trust: Perceived risk and public compliance during the COVID-19 pandemic in Singapore. Journal of Risk Research, 23(7-8), 1021–1030. http://doi.org/10.1080/13669877.2020.1756386
  • World Health Organization (WHO). (2020). Novel Coronavirus (2019-nCoV) Situation Report (Nr. 13). Retrieved on March 31, 2021, from https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200202- sitrep-13-ncov-v3.pdf.
  • Yue, Y., Lee, D. S., Xiao, J., & Zhang, R. (2021). Social media use, psychological well-being and physical health during lockdown. Information, Communication & Society, https://doi.org/10.1080/1369118X.2021.2013917
  • Yue, Z., Zhang, R., & Xiao, J. (2022). Passive social media use and psychological well-being during the COVID-19 pandemic: The role of social comparison and emotion regulation. Computers in Human Behavior, 127, 107050. https://doi.org/10.1016/j.chb.2021.107050
  • Zacher, H., & Rudolph, C. W. (2021). Individual differences and changes in subjective wellbeing during the early stages of the COVID-19 pandemic. American Psychologist, 76(1), 50–62. http://doi.org/10.1037/amp0000702
  • Zerback, T., Töpfl, F., & Knöpfle, M. (2020). The disconcerting potential of online disinformation: Persuasive effects of astroturfing comments and three strategies for inoculation against them. New Media & Society, online first. http://doi.org/10.1177/1461444820908530