767
Views
3
CrossRef citations to date
0
Altmetric
Articles

A study of fake news reading and annotating in social media context

ORCID Icon, , , , ORCID Icon & ORCID Icon
Pages 97-127 | Received 05 Jun 2020, Accepted 09 Feb 2021, Published online: 28 Feb 2021
 

ABSTRACT

The online spreading of fake news is a major issue threatening entire societies. Much of this spreading is enabled by new media formats, namely social networks and online media sites. Researchers and practitioners have been trying to answer this by characterising the fake news and devising automated methods for detecting them. The detection methods had so far only limited success, mostly due to the complexity of the news content and context and lack of properly annotated datasets. One possible way to boost the efficiency of automated misinformation detection methods is to imitate the detection work of humans. It is also important to understand the news consumption behaviour of online users. In this paper, we present an eye-tracking study, in which we let 44 lay participants to casually read through a social media feed containing posts with news articles, some of which were fake. In a second run, we asked the participants to decide on the truthfulness of these articles. We also describe a follow-up qualitative study with a similar scenario but this time with seven expert fake news annotators. We present the description of both studies, characteristics of the resulting dataset (which we hereby publish) and several findings.

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes

2 Most of the students were in the last year of their high school studies, which, in Slovakia, roughly corresponds with the age of 18.

3 http://uxi.sk

4 The articles in this topic were centred around a particular political figure in Slovakia.

5 This particular article was true, although it referenced to a rather old study.

6 We use the term “expert” in the sense of “fact-checking experts” not “topic/domain experts”.

Additional information

Funding

This research was partially supported by TAILOR, a project funded by EU Horizon 2020 research and innovation programme under GA No. 952215.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 308.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.