Reassessing the Facebook experiment: critical thinking about the validity of Big Data research

References

• Abdullah, S., Murnane, E. L., Costa, J. M., & Choudhury, T. (2015, March 14–18). Collective smile: Measuring societal happiness from geolocated images. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, Vancouver, BC, Canada, pp. 361–374.
   Google Scholar
• Antin, J., & Shaw, A. (2012, May 5–10). Social desirability bias and self-reports of motivation: A study of Amazon Mechanical Turk in the US and India. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA, pp. 2925–2934.
   Google Scholar
• Asch, S. (1952). Social psychology. New York, NY: Prentice-Hall.
   Google Scholar
• Aspinwall, L. G., & Taylor, S. E. (1993). Effects of social comparison direction, threat, and self-esteem on affect, self-evaluation, and expected success. Journal of Personality and Social Psychology, 64(5), 708–722. doi: 10.1037/0022-3514.64.5.708
   PubMed Web of Science ®Google Scholar
• Backstrom, L. (2013). News Feed FYI: A window into News Feed. Facebook for Business. Retrieved from https://www.facebook.com/business/news/News-Feed-FYI-A-Window-Into-News-Feed
   Google Scholar
• Berger, J. (2011). Arousal increases social transmission of information. Psychological Science, 22(7), 891–893. doi: 10.1177/0956797611413294
   PubMed Web of Science ®Google Scholar
• Berger, J., & Milkman, K. (2012). What makes online content viral? Journal of Marketing Research, 49(2), 192–205. doi: 10.1509/jmr.10.0353
   Web of Science ®Google Scholar
• Berns, G., Chappelow, J., Zink, C., Pagnoni, G., Martin-Skurski, M., & Richards, J. (2005). Neurobiological correlates of social conformity and independence during mental rotation. Biological Psychiatry, 58(3), 245–253. doi: 10.1016/j.biopsych.2005.04.012
   PubMed Web of Science ®Google Scholar
• boyd, d. (2014). It's complicated: The social lives of networked teens. New Haven, CT: Yale University Press.
   Google Scholar
• boyd, d., & Crawford, K. (2012). Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society, 15(5), 662–679. doi: 10.1080/1369118X.2012.678878
   Web of Science ®Google Scholar
• Brown, J. D., Novick, N. J., Lord, K. A., & Richards, J. M. (1992). When Gulliver travels: Social context, psychological closeness, and self-appraisals. Journal of Personality and Social Psychology, 62(5), 717–727. doi: 10.1037/0022-3514.62.5.717
   Web of Science ®Google Scholar
• Burke, M. (2011). Reading, writing, relationships: The impact of social network sites on relationships and well-being (Unpublished doctoral dissertation). Carnegie Mellon University. Retrieved from http://repository.cmu.edu/dissertations/185/
   Google Scholar
• Burke, M., & Kraut, R. (2013, February 23–27). Using Facebook after losing a job: Differential benefits of strong and weak ties. Proceedings of the 2013 Conference on Computer Supported Cooperative Work, San Antonio, TX, USA, pp. 1419–1430.
   Google Scholar
• Burke, M., Kraut, R., & Marlow, C. (2011, May 7–12). Social capital on Facebook: Differentiating uses and users. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, pp. 571–580.
   Google Scholar
• Cohen, S. (2008). Basic psychometrics for ISEL-12. Retrieved from http://www.psy.cmu.edu/~scohen/scales.html
   Google Scholar
• Constine, J. (2013). Facebook tries letting you share emoticons of exactly what you're feeling, reading or eating. TechCrunch. Retrieved from http://techcrunch.com/2013/01/30/facebook-visual-sharing/
   Google Scholar
• Copeland, L. (2011). The anti-social network. Slate. Retrieved from http://www.slate.com/articles/double_x/doublex/2011/01/the_antisocial_network.html
   Google Scholar
• Crawford, K. (2013). Think again: Big data. Foreign Policy. Retrieved from http://foreignpolicy.com/2013/05/10/think-again-big-data/
   Google Scholar
• Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. The Journal of Nervous and Mental Disease, 175(9), 526–536. doi: 10.1097/00005053-198709000-00004
   PubMed Web of Science ®Google Scholar
• Das, S., & Kramer, A. (2013, July 8–11). Self-censorship on Facebook. Proceedings of the Seventh International AAAI Conference on Weblogs and Social Media, Cambridge, MA, USA, pp. 120–127.
   Google Scholar
• Davis, J., & Goadrich, M. (2006, June 25–29). The relationship between precision-recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA, pp. 233–240.
   Google Scholar
• De Choudhury, M., & Counts, S. (2013, February 23–27). Understanding affect in the workplace via social media. Proceedings of the 2013 ACM Conference on Computer Supported Cooperative Work, San Antonio, TX, USA, pp. 303–316.
   Google Scholar
• De Neve, J. E., Diener, E., Tay, L., & Xuereb, C. (2013). The objective benefits of subjective well-being. In J. Helliwell, R. Layard, & J. Sachs (Eds.), World happiness report (pp. 54–79). New York, NY: Sustainable Development Solutions Network.
   Google Scholar
• Dewey, C. (2014). The (one) simple thing fueling your social media addiction. Washington Post. Retrieved from http://www.washingtonpost.com/news/the-intersect/wp/2014/11/12/the-one-simple-thing-fueling-your-social-media-addiction/
   Google Scholar
• Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. doi: 10.1207/s15327752jpa4901_13
   PubMed Web of Science ®Google Scholar
• Diener, E., Oishi, S., & Lucas, R. E. (2009). Subjective well-being: The science of happiness and life satisfaction. In S. J. Lopez & C. R. Snyder (Eds.), Oxford handbook of positive psychology (pp. 185–194). New York, NY: Oxford University Press.
   Google Scholar
• Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M. (2011). Temporal patterns of happiness and information in a global social network: Hedonometrics and Twitter. PloS one, 6(12), e26752. doi: 10.1371/journal.pone.0026752
   PubMed Web of Science ®Google Scholar
• Dohmen, T., Falk, A., Fliessbach, K., Sunde, U., & Weber, B. (2010). Relative versus absolute income, joy of winning, and gender: Brain imaging evidence. Journal of Public Economics, 95(3–4), 279–285. Retrieved from http://www.sciencedirect.com/science/article/pii/S0047272710001854 doi: 10.1016/j.jpubeco.2010.11.025
   Web of Science ®Google Scholar
• Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7(2), 117–140. Retrieved from http://hum.sagepub.com/content/7/2/117 doi: 10.1177/001872675400700202
   Web of Science ®Google Scholar
• Fowler, J. H., & Christakis, N. A. (2008). Dynamic spread of happiness in a large social network: Longitudinal analysis over 20 years in the Framingham heart study. British Medical Journal, 337(2), a2338–a2338. doi: 10.1136/bmj.a2338
   Google Scholar
• Fox, J., & Moreland, J. J. (2015). The dark side of social networking sites: An exploration of the relational and psychological stressors associated with Facebook use and affordances. Computers in Human Behavior, 45, 168–176. doi: 10.1016/j.chb.2014.11.083
   Web of Science ®Google Scholar
• Get a life!. (2013). Economist. Retrieved from http://www.economist.com/news/science-and-technology/21583593-using-social-network-seems-make-people-more-miserable-get-life
   Google Scholar
• Goffman, E. (1956). The presentation of self in everday life. New York, NY: Doubleday.
   Google Scholar
• Golder, S., & Macy, M. (2011). Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science, 333(6051), 1878–1881. doi: 10.1126/science.1202775
   PubMed Web of Science ®Google Scholar
• Gonçalves, P., & Araújo, M. (2013, October 7–8). Comparing and combining sentiment analysis methods. Proceedings of the First ACM Conference on Online Social Networks, Boston, MA, USA, pp. 27–38.
   Google Scholar
• Grimes, S. (2011). Text-analytics demand approaches $1 billion. InformationWeek. Retrieved from http://www.informationweek.com/software/information-management/text-analytics-demand-approaches-$1-billion/d/d-id/1097709?
   Google Scholar
• Grimmelmann, J. (2014). The Facebook emotional manipulation study: Sources. The Laboratorium. Retrieved from http://laboratorium.net/archive/2014/06/30/the_facebook_emotional_manipulation_study_source
   Google Scholar
• Guillory, J., Spiegel, J., Drislane, M., Weiss, B., Donner, W., & Hancock, J. (2011, May 7–12). Upset now? Emotion contagion in distributed groups. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, pp. 745–748.
   Google Scholar
• Haferkamp, N., & Krämer, N. C. (2011). Social comparison 2.0: Examining the effects of online profiles on social-networking sites. Cyberpsychology, Behavior, and Social Networking, 14(5), 309–314. doi: 10.1089/cyber.2010.0120
   PubMed Web of Science ®Google Scholar
• Hagerty, M. (2000). Social comparisons of income in one's community: Evidence from national surveys of income and happiness. Journal of Personality and Social Psychology, 78(4), 764–771. doi: 10.1037/0022-3514.78.4.764
   PubMed Web of Science ®Google Scholar
• Hancock, J., Landrigan, C., & Silver, C. (2007, April 28–May 3). Expressing emotion in text-based communication. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, pp. 929–932.
   Google Scholar
• Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Thousand Oaks, CA: Sage.
   Google Scholar
• Hinsch, C., & Sheldon, K. M. (2013). The impact of frequent social Internet consumption: Increased procrastination and lower life satisfaction. Journal of Consumer Behaviour, 12(6), 496–505. doi: 10.1002/cb.1453
   Web of Science ®Google Scholar
• Jordan, A. H., Monin, B., Dweck, C. S., Lovett, B. J., John, O. P., & Gross, J. J. (2011). Misery has more company than people think: Underestimating the prevalence of others’ negative emotions. Personality and Social Psychology Bulletin, 37(1), 120–135. doi: 10.1177/0146167210390822
   PubMed Web of Science ®Google Scholar
• Kahneman, D., & Krueger, A. (2006). Developments in the measurement of subjective well-being. Journal of Economic Perspectives, 20(1), 3–24. doi: 10.1257/089533006776526030
   Web of Science ®Google Scholar
• Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004). A survey method for characterizing daily life experience: The day reconstruction method. Science, 306(5702), 1776–1780. doi: 10.1126/science.1103572
   PubMed Web of Science ®Google Scholar
• Kivran-Swaine, F., & Naaman, M. (2011, March 19–23). Network properties and social sharing of emotions in social awareness streams. Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, Hangzhou, China, pp. 379–382.
   Google Scholar
• Konnikova, M. (2013). How Facebook makes us unhappy. New Yorker. Retrieved from http://www.newyorker.com/tech/elements/how-facebook-makes-us-unhappy
   Google Scholar
• Kramer, A. (2010, April 10–15). An unobtrusive behavioral model of gross national happiness. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, pp. 287–290.
   Google Scholar
• Kramer, A. (2012, May 5–10). The spread of emotion via Facebook. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA, pp. 767–770.
   Google Scholar
• Kramer, A. (2014). Okay so. A lot of people have asked me … [Facebook post]. Retrieved from https://www.facebook.com/akramer/posts/10152987150867796
   Google Scholar
• Kramer, A., Guillory, J., & Hancock, J. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences 111(24), 8788–8790. Retrieved from http://www.pnas.org/content/111/24/8788.full.pdf+html doi: 10.1073/pnas.1320040111
   PubMed Web of Science ®Google Scholar
• Krasnova, H., Wenninger, H., Widjaja, T., & Buxmann, P. (2013, February 27–March 1). Envy on Facebook: A hidden threat to users’ life satisfaction? Proceedings of the 11th International Conference on Wirtschaftsinformatik, Leipzig, Germany.
   Google Scholar
• Kross, E., Verduyn, P., Demiralp, E., Park, J., Seungjae Lee, D., Lin, N. …, Ybarra, O. (2013). Facebook use predicts declines in subjective well-being in young adults. PLoS ONE, 8(8), e69841. Retrieved from http://dx.plos.org/10.1371/journal.pone.0069841 doi: 10.1371/journal.pone.0069841
   PubMed Web of Science ®Google Scholar
• Layard, R., Clark, A., & Senik, C. (2012). The causes of happiness and misery. In J. Helliwell, R. Layard, & J. Sachs (Eds.), UN world happiness report (pp. 58–89). New York, NY: Earth Institute.
   Google Scholar
• Lazer, D. M., Kennedy, R., King, G., & Vespignani, A. (2014). The parable of Google flu: Traps in big data analysis. Science, 343(6176), 1203–1205. doi: 10.1126/science.1248506
   PubMed Web of Science ®Google Scholar
• Lee, S. Y. (2014). How do people compare themselves with others on social network sites?: The case of Facebook. Computers in Human Behavior, 32, 253–260. doi: 10.1016/j.chb.2013.12.009
   Web of Science ®Google Scholar
• Lin, L. F., & Kulik, J. A. (2002). Social comparison and women's body satisfaction. Basic and Applied Social Psychology, 24(2), 115–123. doi: 10.1207/S15324834BASP2402_4
   Web of Science ®Google Scholar
• Lyubomirsky, S., & Ross, L. (1997). Hedonic consequences of social comparison: A contrast of happy and unhappy people. Journal of Personality and Social Psychology, 73(6), 1141–1157. doi: 10.1037/0022-3514.73.6.1141
   PubMed Web of Science ®Google Scholar
• Marche, S. (2012). Is Facebook making us lonely? The Atlantic. Retrieved from http://www.theatlantic.com/magazine/archive/2012/05/is-facebook-making-us-lonely/308930/
   Google Scholar
• Mislove, A., Lehmann, S., Ahn, Y. Y., Onnela, J. P., & Rosenquist, J. N. (2010). Pulse of the nation: U.S. mood throughout the day inferred from Twitter. Retrieved from http://www.ccs.neu.edu/home/amislove/twittermood/
   Google Scholar
• Mitchell, A., & Hitlin, P. (2013). Twitter reaction to events often at odds with overall public opinion. Pew Research Center. Retrieved from http://www.pewresearch.org/2013/03/04/twitter-reaction-to-events-often-at-odds-with-overall-public-opinion/
   Google Scholar
• Morse, S., & Gergen, K. J. (1970). Social comparison, self-consistency, and the concept of self. Journal of Personality and Social Psychology, 16(1), 148–156. doi: 10.1037/h0029862
   PubMed Web of Science ®Google Scholar
• Paltoglou, G., & Thelwall, M. (2012). Twitter, MySpace, Digg: Unsupervised sentiment analysis in social media. ACM Transactions on Intelligent Systems and Technology, 3(4), 1–19. doi: 10.1145/2337542.2337551
   Web of Science ®Google Scholar
• Panger, G. (2014, April 26–May 1). Social comparison in social media: A look at Facebook and Twitter. CHI '14 Extended Abstracts on Human Factors in Computing Systems, Toronto, ON, Canada, pp. 2095–2100.
   Google Scholar
• Pennebaker, J., Chung, C., Ireland, M., Gonzales, A., & Booth, R. (2007). The development and psychometric properties of LIWC2007. Retrieved from http://www.liwc.net/LIWC2007LanguageManual.pdf
   Google Scholar
• Przybylski, A. K., Murayama, K., DeHaan, C. R., & Gladwell, V. (2013). Motivational, emotional, and behavioral correlates of fear of missing out. Computers in Human Behavior, 29(4), 1841–1848. doi: 10.1016/j.chb.2013.02.014
   Web of Science ®Google Scholar
• Rosenfeld, E. (2015). Facebook user growth crushes estimates. CNBC. Retrieved from http://www.cnbc.com/id/102610670
   Google Scholar
• Ruths, D., & Pfeffer, J. (2014). Social media for large studies of behavior. Science, 346(6213), 1063–1064. doi: 10.1126/science.346.6213.1063
   PubMed Web of Science ®Google Scholar
• Sagioglou, C., & Greitemeyer, T. (2014). Facebook's emotional consequences: Why Facebook causes a decrease in mood and why people still use it. Computers in Human Behavior, 35, 359–363. doi: 10.1016/j.chb.2014.03.003
   Web of Science ®Google Scholar
• Salovey, P., & Rodin, J. (1984). Some antecedents and consequences of social-comparison jealousy. Journal of Personality and Social Psychology, 47(4), 780–792. doi: 10.1037/0022-3514.47.4.780
   Web of Science ®Google Scholar
• Schroepfer, M. (2014). Research at Facebook. Facebook Newsroom. Retrieved from http://newsroom.fb.com/news/2014/10/research-at-facebook/
   Google Scholar
• Scollon, C. N., Prieto, C. K., & Diener, E. (2009). Experience sampling: Promises and pitfalls, strength and weaknesses. In Assessing well-being (pp. 157–180). New York, NY: Springer.
   Google Scholar
• Stuart, H. C., Dabbish, L., Kiesler, S., Kinnaird, P., & Kang, R. (2012, February 11–15). Social transparency in networked information exchange: A framework and research question. Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, Seattle, Washington, USA, pp. 451–460.
   Google Scholar
• Taheri, A. A., Tepper, M., Benerjee, A., & Sapiro, G. (2012, October 29–November 2). If you are happy and you know it … tweet. Proceedings of the 21st ACM International Conference on Information and Knowledge Management, Maui, HI, USA, pp. 1602–1606.
   Google Scholar
• Tandoc, E. C., Ferrucci, P., & Duffy, M. (2015). Facebook use, envy, and depression among college students: Is Facebooking depressing?. Computers in Human Behavior, 43, 139–146. doi: 10.1016/j.chb.2014.10.053
   Web of Science ®Google Scholar
• Tow, S. (2011). Interesting News, Any Time You Visit. Facebook Newsroom. Retrieved from https://www.facebook.com/notes/facebook/interesting-news-any-time-you-visit/10150286921207131
   Google Scholar
• Tufekci, Z. (2014, June 2–4). Big questions for social media Big Data: Representativeness, validity and other methodological pitfalls. ICWSM '14: Proceedings of the 8th International AAAI Conference on Weblogs and Social Media, Ann Arbor, MI, USA.
   Google Scholar
• Turkle, S. (2011). Alone together: Why we expect more from technology and less from each other. New York, NY: Basic Books.
   Google Scholar
• Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131. doi: 10.1126/science.185.4157.1124
   PubMed Web of Science ®Google Scholar
• van Baaren, R., Janssen, L., Chartrand, T., & Dijksterhuis, A. (2009). Where is the love? The social aspects of mimicry. Philosophical Transactions of the Royal Society B, 364(1528), 2381–2389. doi: 10.1098/rstb.2009.0057
   PubMed Web of Science ®Google Scholar
• Verduyn, P., Lee, D., Park, J., Shablack, H., Orvell, A., Bayer, J., Ybarra, O., Jonides, J., & Kross, E. (2015). Passive Facebook usage undermines affective well-being: Experimental and longitudinal evidence. Journal of Experimental Psychology: General, 144(2), 480–488. doi: 10.1037/xge0000057
   PubMed Web of Science ®Google Scholar
• Vogel, E. A., Rose, J. P., Roberts, L. R., & Eckles, K. (2014). Social comparison, social media, and self-esteem. Psychology of Popular Media Culture, 3(4), 206–222. doi: 10.1037/ppm0000047
   Google Scholar
• Wheeler, L., & Miyake, K. (1992). Social comparison in everyday life. Journal of Personality and Social Psychology, 62(5), 760–773. doi: 10.1037/0022-3514.62.5.760
   Web of Science ®Google Scholar
• Wood, J. V. (1989). Theory and research concerning social comparisons of personal attributes. Psychological Bulletin, 106(2), 231–248. doi: 10.1037/0033-2909.106.2.231
   Web of Science ®Google Scholar
• Wortham, J. (2011). Feel like a wallflower? Maybe it's your Facebook wall. New York Times. Retrieved from http://www.nytimes.com/2011/04/10/business/10ping.html?_r=0
   Google Scholar
• Zimmerman, J. (2014). Facebook's study got it wrong: seeing our ‘friends’ happy can make us sad. Guardian. Retrieved from http://www.theguardian.com/commentisfree/2014/jul/02/facebook-study-emotions-friends-totally-wrong
   Google Scholar