Validity, Reliability, and the Case for Participant-Centered Research: Reflections on a Multi-Platform Social Media Study

ABSTRACT

Validity and reliability are long established as central tenets of ensuring good quality research. However, safeguarding validity and reliability can be challenging within the context of multi-platform social media research, as considerations such as access to data or self-selection place caveats upon the generalizability of any study and are exacerbated when multiple platforms are involved. In this article, examples are drawn from a recent empirical study and others to illustrate how these issues can become amplified within the context of multi-platform social media studies. These include reconsidering the concept of a representative sample across multiple platforms; issues balancing ethical considerations and terms of service in accessing data; and the effect of data repackaging strategies and extent to which similar data from different platforms can be comparable. The article will conclude by arguing that drawing upon qualitative approaches, particularly a complimentary reframing of the unit of analysis with a focus on particular users as case studies, can ameliorate these issues and strengthen the insight of multi-platform social media studies.

Acknowledgments

This work was funded as part of a CREET doctoral studentship provided by The Open University, UK. The author would like to thank her supervisors, Professor Martin Weller and Dr. Doug Clow, for their feedback and guidance. Particular thanks to all participants who took part in the survey, network analyses, and interviews.

Additional information

Funding

This work was funded as part of a CREET doctoral studentship provided by the Open University, UK.

Notes on contributors

Katy Jordan

Katy Jordan recently completed her doctoral studies within the Institute of Educational Technology, at the Open University, UK. Her research interests focus on the intersection of Internet Studies and Higher Education research.