From crisis of evidence to a “crisis” of relevance? Incentive-based answers for social psychology’s perennial relevance worries

References

• Abcarian, R. (June 6, 2016). Using persuasion and a dollop of science, Clinton volunteers dial for votes. The Los Angeles Times. Retrieved from http://www.latimes.com/local/abcarian/la-me-abcarian-clinton-volunteers-20160606-snap-story.html
   Google Scholar
• Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84, 888–918.
   Web of Science ®Google Scholar
• Anderson, C. A., Allen, J. J., Plante, C., Quigley-McBride, A., Lovett, A., & Rokkum, J. N. (2018). The MTurkification of social and personality psychology. Personality and social psychology bulletin, online publication. Retrieved from http://journals.sagepub.com/doi/abs/10.1177/0146167218798821.
   Google Scholar
• Anderson, C. A., Lindsay, J. J., & Bushman, B. J. (1999). Research in the psychological laboratory: Truth or triviality? Current Directions in Psychological Science, 8, 3–9.
   Web of Science ®Google Scholar
• Argyris, C. (1975). Dangers in applying results from experimental social psychology. American Psychologist, 30, 469–485.
   Web of Science ®Google Scholar
• Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J., Fiedler, K., … Perugini, M. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119.
   Web of Science ®Google Scholar
• Bargh, J. A., & Chartrand, T. L. (1999). The unbearable automaticity of being. American Psychologist, 54, 462–479.
   Web of Science ®Google Scholar
• Bauman, C. W., McGraw, A. P., Bartels, D. M., & Warren, C. (2014). Revisiting external validity: Concerns about trolley problems and other sacrificial dilemmas in moral psychology. Social and Personality Psychology Compass, 8, 536–554.
   Google Scholar
• Baumeister, R. F., Vohs, K. D., & Funder, D. C. (2007). Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior? Perspectives on Psychological Science, 2, 396–403.
   Web of Science ®Google Scholar
• Begley, C. G., & Ellis, L. M. (2012). Drug development: Raise standards for preclinical cancer research. Nature, 483, 531–533.
   PubMed Web of Science ®Google Scholar
• Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425.
   PubMed Web of Science ®Google Scholar
• Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012). Evaluating online labor markets for experimental research: Amazon.com’s mechanical turk. Political Analysis, 20, 351–368.
   Web of Science ®Google Scholar
• Billig, M. (2015). The myth of Kurt Lewin and the rhetoric of collective memory in social psychology textbooks. Theory & Psychology, 25, 703–718.
   Web of Science ®Google Scholar
• Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., & Geller, J., Giner-Sorolla, R., … van ’t Veer, A. (2014). The Replication Recipe: What makes for a convincing replication? Journal of Experimental Social Psychology, 50, 217–224
   Google Scholar
• Breckler, S. J. (2006a). Psychology is translational science. Monitor on Psychology, 37, 22.
   Google Scholar
• Breckler, S. J. (2006b). Embracing the many applications of psychology. Monitor on Psychology, 37, 24.
   Google Scholar
• Brim, O. G., Jr. (1969). Knowledge into action: Improving the nation’s use of the social sciences. (‘Report of the Special Commission on the Social Sciences of the National Science Board). Washington, D.C.: National Science Foundation, 1969.
   Google Scholar
• Britt, S. H. (1937). Past and present trends in the methods and subject matter of social psychology. Social Forces, 15, 462–469.
   Google Scholar
• Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s mechanical turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5.
   PubMed Web of Science ®Google Scholar
• Buschini, F., Guimond, S., & Breakwell, G. M. (2011). Social issues and social psychology: Distinctive pathways in applying social psychology to resolve major social problems. Revue Internationale De Psychologie Sociale, 23, 5–15.
   Google Scholar
• Calvert, J. (2006). What’s special about basic research? Science, Technology, & Human Values, 31(2), 199–220.
   Web of Science ®Google Scholar
• Cantril, H. (1934). The social psychology of everyday life. Psychological Bulletin, 31, 297–330.
   Google Scholar
• Carey, B. (Nov. 12, 2012). Academic “Dream Team” helped Obama’s effort. The New York Times. Retrieved from http://www.nytimes.com/2012/11/13/health/dream-team-of-behavioral-scientists-advised-obama-campaign.html?_r=0
   Google Scholar
• Carlson, R. (1984). What’s social about social psychology? Where’s the person in personality research? Journal of Personality and Social Psychology, 47, 1304–1309.
   Web of Science ®Google Scholar
• Carney, D. R. (2016). My position on “power poses”. Retrieved from http://faculty.haas.berkeley.edu/dana_carney/pdf_My%20position%20on%20power%20poses.pdf
   Google Scholar
• Carney, D. R., Cuddy, A. J., & Yap, A. J. (2015). Review and summary of research on the embodied effects of expansive (vs. contractive) nonverbal displays. Psychological Science, 26, 657–663.
   PubMed Web of Science ®Google Scholar
• Center for Open Science (2018). Implementing TOP. Retrieved from https://cos.io/our-services/top-guidelines/.
   Google Scholar
• Cesario, J. (2014). Priming, replication, and the hardest science. Perspectives on Psychological Science, 9, 40–48.
   Web of Science ®Google Scholar
• Cesario, J., Jonas, K. J., & Carney, D. R. (2017). CRSP special issue on power poses: What was the point and what did we learn? Comprehensive Results in Social Psychology, 2, 1–15.
   Google Scholar
• Chandler, J., Mueller, P., & Paolacci, G. (2014). Nonnaïveté among Amazon mechanical turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods, 46, 112–130.
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1962). The statistical power of abnormal-social psychological research. The Journal of Abnormal and Social Psychology, 65, 145–153.
   PubMed Web of Science ®Google Scholar
• Commons Select Committee on Culture, Media and Sport (2017). Disinformation and ‘fake news’: Interim Report. Retrieved from https://publications.parliament.uk/pa/cm201719/cmselect/cmcumeds/363/36302.htm
   Google Scholar
• Conner, A. C. (2014, March). Stanford SPARQ sparks change. APS Observer. Retrieved from https://www.psychologicalscience.org/observer/stanford-sparq-ignites-change.
   Google Scholar
• Cooper, M. L. (2016). Editorial. Journal of Personality and Social Psychology, 110, 431–434.
   PubMedGoogle Scholar
• Coppock, A. (2018). Generalizing from survey experiments conducted on mechanical turk: A replication approach. Political Science Research and Methods. doi:10.1017/psrm.2018.10
   PubMed Web of Science ®Google Scholar
• Craig, R. T. (1996). Practical theory: A reply to Sandelands. Journal for the Theory of Social Behaviour, 26, 65–79.
   Web of Science ®Google Scholar
• Crandall, C., Leach, C. W., Robinson, M., & West, T. (2017). The new editorial team of PSPB addresses editorial philosophy. Retrieved from http://www.spsp.org/publications/personality-and-social-psychology-bulletin/Jan2017-Editorial-Statement
   Google Scholar
• Cumming, G. (2014). The new statistics: Ehy and how. Psychological Science, 25(1), 7–29.
   PubMed Web of Science ®Google Scholar
• Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29.
   PubMed Web of Science ®Google Scholar
• Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., … Wilson, S. (2007). Statistical reform in psychology: Is anything changing? Psychological Science, 18, 230–232.
   PubMed Web of Science ®Google Scholar
• Davis, D. D., & Holt, C. A. (1992). Experimental economics. Princeton, NJ: Princeton University Press.
   Google Scholar
• De la Rey, C., & Ipser, J. (2004). The call for relevance: South African psychology ten years into democracy. South African Journal of Psychology, 34, 544–552.
   Web of Science ®Google Scholar
• Druckman, J. N., & Kam, C. D. (2011). Students as experimental participants. In J. N. Druckman, D. P. Green, J. H. Kuklinski, & A. Luria (Eds.), Cambridge handbook of experimental political science (pp. 41–57). UK: Cambridge.
   Google Scholar
• Duarte, J. L., Crawford, J. T., Stern, C., Haidt, J., Jussim, L., & Tetlock, P. E. (2015). Political diversity will improve social psychological science. Behavioral and Brain Sciences, 38, e130.
   PubMed Web of Science ®Google Scholar
• Dudo, A. (2015). Scientists, the media, and the public communication of science. Sociology Compass, 9, 761–775.
   Web of Science ®Google Scholar
• Eich, E. (2014). Business not as usual. Psychological Science, 25, 3–6.
   PubMed Web of Science ®Google Scholar
• Ellemers, N. (2013). Connecting the dots: Mobilizing theory to reveal the big picture in social psychology (and why we should do this). European Journal of Social Psychology, 43, 1–8.
   Web of Science ®Google Scholar
• Elms, A. C. (1975). The crisis of confidence in social psychology. American Psychologist, 30, 967–976.
   Web of Science ®Google Scholar
• Engber, D. (2017, February 14). Hips do lie. Retrieved from http://www.slate.com/articles/health_and_science/science/2017/02/why_did_the_press_cover_a_dubious_study_on_what_makes_women_great_dancers.html
   Google Scholar
• Eriksson, K., Coultas, J. C., & de Barra, M. (2016). Cross-cultural differences in emotional selection on transmission of information. Journal of Cognition and Culture, 16, 122–143.
   Web of Science ®Google Scholar
• European Commission (2002). The sixth framework programme at a glance. Retrieved from https://ec.europa.eu/research/fp6/pdf/fp6-in-brief_en.pdf. doi:10.1044/1059-0889(2002/er01)
   Google Scholar
• Fabrigar, L. R., & Wegener, D. T. (2016). Conceptualizing and evaluating the replication of research results. Journal of Experimental Social Psychology, 66, 68–80.
   Web of Science ®Google Scholar
• Faye, C. (2012). American social psychology: Examining the contours of the 1970s crisis. Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences, 43, 514–521.
   PubMedGoogle Scholar
• Fishman, D. B., & Neigher, W. D. (1982). American psychology in the eighties: Who will buy. American Psychologist, 37, 533–546.
   Web of Science ®Google Scholar
• Fraley, R. C., & Vazire, S. (2014). The n-pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PloS One, 9, e109019.
   PubMed Web of Science ®Google Scholar
• Francis, G. (2017). Comment on: Conceptualizing and evaluating the replication of research results. Journal of Experimental Social Psychology, 69, 237–240.
   Web of Science ®Google Scholar
• Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309–320.
   Web of Science ®Google Scholar
• Gernsbacher, M. A. (2006). Reaching for relevance. APS Observer, 19, 5–33.
   Google Scholar
• Gilbert, D. (2016, January 30). Talking to humans: Is it a good idea? Retrieved from http://www.danielgilbert.com/SPSP2016.pdf
   Google Scholar
• Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7, 562–571.
   Web of Science ®Google Scholar
• Giner-Sorolla, R. (2016). Approaching a fair deal for significance and other concerns. Journal of Experimental Social Psychology, 65, 1–6.
   Web of Science ®Google Scholar
• Gladwell, M. (2000). The tipping point: How little things can make a big difference. New York, NY: Little Brown.
   Google Scholar
• Godin, B. (2006). The linear model of innovation: The historical construction of an analytical framework. Science, Technology, & Human Values, 31, 639–667.
   Web of Science ®Google Scholar
• Goff, P. A., Jackson, M. C., Di Leone, B. A. L., Culotta, C. M., & DiTomasso, N. A. (2014). The essence of innocence: Consequences of dehumanizing black children. Journal of Personality and Social Psychology, 106, 526–545.
   PubMed Web of Science ®Google Scholar
• Goldacre, B. (2009). Bad science. London: Fourth Estate.
   Google Scholar
• Grassegger, H., & Krogerus, M. (2017) The data that turned the world upside down. Retrieved from https://motherboard.vice.com/en_us/article/how-our-likes-helped-trump-win
   Google Scholar
• Greenwald, A., Gonzalez, R., Harris, R., & Guthrie, D. (1996). Effect sizes and p values: What should be reported and what should be replicated? Psychophysiology, 33, 175–183.
   PubMed Web of Science ®Google Scholar
• Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20.
   Web of Science ®Google Scholar
• Greenwald, A. G., & Banaji, M. R. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102, 4–27.
   PubMed Web of Science ®Google Scholar
• Grignolo, A., & Pretorius, S. (2016). Phase III trial failures: Costly, but preventable. Applied Clinical Trials, 25, 36–42.
   Google Scholar
• Hacker Hughes, J. (2016, April). Twelve ways to make an impact. Presidential Address delivered at the Annual Conference of the British Psychological Society, Nottingham. Retrieved from https://www1.bps.org.uk/system/files/Public%20files/HOPC/J%20Hacker%20Hughes%20Pres%20Address.pdf
   Google Scholar
• Harford, T. (2014, March 21). Behavioural economics and public policy. Financial Times Online. Retrieved from https://www.ft.com/content/9d7d31a4-aea8-11e3-aaa6-00144feab7de.
   Google Scholar
• Harré, R., & Secord, P. (1972). The explanation of social behaviour. Oxford: Blackwell.
   Google Scholar
• Hegarty, P., & Bruckmüller, S. (2013). Asymmetric explanations of group differences: Experimental evidence of foucault’s disciplinary power. Social and Personality Psychology Compass, 7, 176–186.
   Google Scholar
• Helmreich, R. (1975). Applied social psychology: The unfulfilled promise. Personality and Social Psychology Bulletin, 1, 548–560.
   Google Scholar
• Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 61–135.
   PubMed Web of Science ®Google Scholar
• Hertwig, R., & Ortmann, A. (2001). Experimental practices in economics: A methodological challenge for psychologists? Behavioral and Brain Sciences, 24, 383–403.
   PubMed Web of Science ®Google Scholar
• Hoffman, R. R., & Deffenbacher, K. A. (1993). An analysis of the relations between basic and applied psychology. Ecological Psychology, 5, 315–352.
   Web of Science ®Google Scholar
• Issenberg, S. (2012). The victory lab. New York, NY: Crown Publishers.
   Google Scholar
• Judd, C. M., Westfall, J., & Kenny, D. A. (2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103, 54–69.
   PubMed Web of Science ®Google Scholar
• Kaslow, N. J. (2014). Translating our science for the public. Monitor on Psychology, 45, 5.
   Google Scholar
• Kaslow, N. J. (2015). Translating psychological science to the public. American Psychologist, 70, 361–371.
   Web of Science ®Google Scholar
• Keller-Allen, & Li, (2013, July). Psychological science and behavioral economics in the service of public policy. Retrieved from https://www.nia.nih.gov/sites/default/files/d7/psychological_science_and_behavioral_economics.pdf
   Google Scholar
• Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196–217.
   PubMedGoogle Scholar
• Kinderman, N. (2017). ‘Psychology is action, not thinking about oneself’. Retrieved from https://thepsychologist.bps.org.uk/volume-30/june-2017/psychology-action-not-thinking-about-oneself
   Google Scholar
• Kitayama, S. (2017). Editorial. Journal of Personality and Social Psychology, 112, 357–360.
   PubMed Web of Science ®Google Scholar
• Labonte, R., Feather, J., & Hills, M. (1999). A story/dialogue method for health promotion knowledge development and evaluation. Health Education Research, 14, 39–50.
   PubMed Web of Science ®Google Scholar
• Leary, M. (2015, January 21). Enhancing the relevance of personality and social psychology. Retrieved from http://www.spsp.org/news-center/announcements/enhancing-relevance-personality-and-social-psychology.
   Google Scholar
• LeBel, E., Borsboom, D., Giner-Sorolla, R., Hasselman, F., Peters, K., Ratliff, K., & Smith, C. (2013). Psychdisclosure.org: Grassroot support for reforming reporting standards in psychology. Perspectives on Psychological Science, 8, 319–325.
   Web of Science ®Google Scholar
• LeBel, E. P., & Peters, K. R. (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371–379.
   Web of Science ®Google Scholar
• Ledgerwood, A., & Sherman, J. W. (2012). Short, sweet, and problematic? The rise of the short report in psychological science. Perspectives on Psychological Science, 7, 60–66.
   Web of Science ®Google Scholar
• Leung, A. K. Y., Kim, S., Polman, E., Ong, L. S., Qiu, L., Goncalo, J. A., & Sanchez-Burks, J. (2012). Embodied metaphors and creative “acts”. Psychological Science, 23, 502–509.
   PubMed Web of Science ®Google Scholar
• Lévy-Leboyer, C. (1988). Success and failure in applying psychology. American Psychologist, 43, 779.
   Web of Science ®Google Scholar
• Lewin, K. (1951). Field theory of social science: Selected papers, D. Cartwright (Ed.). New York: Harper & Brothers.
   Google Scholar
• Lilienfeld, S. O. (2012). Public skepticism of psychology: Why many people perceive the study of human behavior as unscientific. The American Psychologist, 67, 111–129.
   PubMed Web of Science ®Google Scholar
• Limbaugh, R. (2011, Nov 4). Dutch sociologist falsified data to codify liberalism as science. Retrieved from https://www.rushlimbaugh.com/daily/2011/11/04/dutch_sociologist_falsified_data_to_codify_liberalism_as_science/.
   Google Scholar
• Lindsay, D. S. (2015). Replication in psychological science. Psychological Science, 26, 1827–1832.
   PubMed Web of Science ®Google Scholar
• Long, W., & Foster, D. (2013). The changing face of “relevance” in South African psychology. Psychology in Society, 45, 3–16.
   Google Scholar
• Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151–159.
   PubMed Web of Science ®Google Scholar
• Major, B. (2006). Toto, we’re not in Kansas any more. Dialogue, 21, 22–23.
   Google Scholar
• Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537–542.
   Web of Science ®Google Scholar
• Markus, H. R. (2004). Thinking outside the person. Dialogue, 19, 19–23.
   Google Scholar
• Maton, K. I. (2017). Influencing social policy: Applied psychology serving the public interest. Oxford, UK: Oxford University Press.
   Google Scholar
• McGuire, W. J. (2009). Theory-oriented research in natural settings: The best of both worlds for social psychology. In M. Sherif & C. M. Sherif (Eds.), Interdisciplinary relationships in the social sciences (pp. 21–51). New York, NY: Routledge.
   Google Scholar
• Medin, D. L. (2012). A dangerous dichotomy: Basic and applied research. APS Observer, 25. Retrieved from https://www.psychologicalscience.org/observer/a-dangerous-dichotomy-basic-and-applied-research
   Google Scholar
• Meyer, A. D. (1991). What is strategy’s distinctive competence? Journal of Management, 17, 821–833.
   Web of Science ®Google Scholar
• Miller, G. (1969). Psychology as a means of promoting human welfare. American Psychologist, 24, 1063–1075.
   Web of Science ®Google Scholar
• Mitchell, G. (2012). Revisiting truth or triviality: The external validity of research in the psychological laboratory. Perspectives on Psychological Science, 7, 109–117.
   Web of Science ®Google Scholar
• Moghaddam, F. M. (1987). Psychology in the three worlds. American Psychologist, 42, 912–920.
   Web of Science ®Google Scholar
• Moscovici, S. (1972). Society and theory in social psychology. In J. Israel & H. Tajfel (Eds.), The context of social psychology: A critical assessment (pp. 17–68). London: Academic Press.
   Google Scholar
• Moscovici, S. (2008). Psychoanalysis: Its image and its public. London: Polity.
   Google Scholar
• Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015). The generalizability of survey experiments. Journal of Experimental Political Science, 2, 109–138.
   Google Scholar
• Nairn, A., & Fine, C. (2008). Who’s messing with my mind? International Journal of Advertising, 27(3), 447–470.
   Web of Science ®Google Scholar
• Neuliep, J. W., & Crandall, R. (1990). Editorial bias against replication research. Journal of Social Behavior and Personality, 5, 85–90.
   Google Scholar
• Neuliep, J. W., & Crandall, R. (1993). Reviewer bias against replication research. Journal of Social Behavior and Personality, 8, 21–29.
   Google Scholar
• Nicks, S. D., Korn, J. H., & Mainieri, T. (1997). The rise and fall of deception in social psychology and personality research, 1921 to 1994. Ethics & Behavior, 7, 69–77.
   PubMed Web of Science ®Google Scholar
• Nishi, A., Christakis, N. A., & Rand, D. G. (2017). Cooperation, decision time, and culture: Online experiments with American and Indian participants. PLOS ONE, 12, e0171252.
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Contestabile, M. (2015). Promoting an open research culture. Science, 348, 1422–1425.
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., & Bar-Anan, Y. (2012). Scientific Utopia: I. Opening scientific communication. Psychological Inquiry, 23, 217–243.
   Web of Science ®Google Scholar
• Novelrank (2017). Web site. Retrieved from https://www.novelrank.com/asin/006124189X
   Google Scholar
• O’Donnell, J. M. (1979). The crisis of experimentalism in the 1920s. American Psychologist, 34, 289–295.
   Web of Science ®Google Scholar
• Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17, 776–783.
   Web of Science ®Google Scholar
• Packard, V. (1957). The hidden persuaders. New York, NY: McKay.
   Google Scholar
• Paolacci, G., & Chandler, J. (2014). Inside the turk: Understanding mechanical turk as a participant pool. Current Directions in Psychological Science, 23, 184–188.
   Web of Science ®Google Scholar
• Paolacci, G., Chandler, J., & Ipeirotis, P. (2010). Running experiments on Amazon mechanical turk. Judgment and Decision Making, 5, 411–419.
   Web of Science ®Google Scholar
• Parker, I. (1989). The crisis in modern social psychology—and how to end it. London: Routledge.
   Google Scholar
• Peer, E., Samat, S., Brandimarte, L., & Acquisti, A. (2016). Beyond the Turk: An empirical comparison of alternative platforms for crowdsourcing online behavioral research.
   Google Scholar
• Peters, M. (2016, October 1). “Power poses” Co-author: “I do not believe the effects are real.” Retrieved March 31, 2017, fromhttp://www.npr.org/2016/10/01/496093672/power-poses-co-author-i-do-not-believe-the-effects-are-real
   Google Scholar
• Peterson, R. A. (2001). On the use of college students in social science research: Insights from a second-order meta-analysis. Journal of Consumer Research, 28, 450–461.
   Web of Science ®Google Scholar
• Pettigrew, T. F. (2018). Summing up: Did social psychology answer Dr. King’s call? Journal of Social Issues, 74, 377–385.
   Web of Science ®Google Scholar
• Pielke, R. (2012). Basic research as a political symbol. Minerva, 50, 339–361.
   Web of Science ®Google Scholar
• Pratkanis, A. R. (2017). The (partial but) real crisis in social psychology. In S. O. Lilienfled & I. D. Waldman (Eds.), Psychological science under scrutiny: Recent challenges and proposed solutions (pp. 141–163). Oxford: Wiley Blackwell.
   Google Scholar
• Preregistration Challenge (2017). Retrieved from https://cos.io/prereg/.
   Google Scholar
• Ranehill, E., Dreber, A., Johannesson, M., Leiberg, S., Sul, S., & Weber, R. A. (2015). Assessing the robustness of power posing: No effect on hormones and risk tolerance in a large sample of men and women. Psychological Science, 26, 653–656.
   PubMed Web of Science ®Google Scholar
• Reis, H. T., & Stiller, J. (1992). Publication trends in jpsp: A three-decade review. Personality and Social Psychology Bulletin, 18(4), 465–472.
   Web of Science ®Google Scholar
• Richard, F. D., Bond, C. F., Jr, & Stokes-Zoota, J. J. (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7, 331–363.
   Web of Science ®Google Scholar
• Rijsman, J., & Stroebe, W. (1989). The two social psychologies or whatever happened to the crisis? European Journal of Social Psychology, 19, 339–343.
   Web of Science ®Google Scholar
• Ring, K. (1967). Experimental social psychology: Some sober questions about some frivolous values. Journal of Experimental Social Psychology, 3, 113–123.
   Web of Science ®Google Scholar
• Roll-Hansen, N. (2017). A historical perspective on the distinction between basic and applied science. Journal for General Philosophy of Science, 48, 535–551.
   Web of Science ®Google Scholar
• Rosenthal, R. (1963). On the social psychology of the psychological experiment: The experimenter’s hypothesis as unintended determinant of experimental results. American Scientist, 51, 268–283.
   PubMed Web of Science ®Google Scholar
• Schaller, M. (2016). The empirical benefits of conceptual rigor: Systematic articulation of conceptual hypotheses can reduce the risk of non-replicable results (and facilitate novel discoveries too). Journal of Experimental Social Psychology, 66, 107–115.
   Web of Science ®Google Scholar
• Schimmack, U. (2012). The ironic effect of significant results on the credibility of multiple-study articles. Psychological Methods, 17, 551–566.
   PubMed Web of Science ®Google Scholar
• Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47, 609–612.
   Web of Science ®Google Scholar
• Schwartz, B. (1997). Psychology, idea technology, and ideology. Psychological Science, 8, 21–27.
   Web of Science ®Google Scholar
• Sears, D. O. (1986). College sophomores in the laboratory: Influences of a narrow data base on social psychology’s view of human nature. Journal of Personality and Social Psychology, 51, 515–530.
   Web of Science ®Google Scholar
• Sears, D. O., & Freedman, J. L. (1967). Selective exposure to information: A critical review. Public Opinion Quarterly, 31, 194–213.
   Web of Science ®Google Scholar
• Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309–316.
   Web of Science ®Google Scholar
• Sherif, M. (1970). On the relevance of social psychology. American Psychologist, 25, 144–156.
   Web of Science ®Google Scholar
• Sherif, M. (1977). Crisis in social psychology: Some remarks towards breaking through the crisis. Personality and Social Psychology Bulletin, 3, 368–382.
   Web of Science ®Google Scholar
• Silverman, I. (1971). Crisis in social psychology: The relevance of relevance. American Psychologist, 26, 583.
   Web of Science ®Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.
   PubMed Web of Science ®Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U., (2012). A 21 word solution. Retrieved from https://ssrn.com/abstract=2160588 doi:10.2139/ssrn.2160588
   Google Scholar
• Smith, M. B. (1973). Is psychology relevant to new priorities? American Psychologist, 28(6), 463–471.
   Web of Science ®Google Scholar
• Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25, 970–975.
   Web of Science ®Google Scholar
• Smith, N. C., Goldstein, D. G., & Johnson, E. J. (2013). Choice without awareness: Ethical and policy implications of defaults. Journal of Public Policy & Marketing, 32, 159–172.
   Web of Science ®Google Scholar
• Snyder, M. (1993). Basic research and practical problems: The promise of a” functional” personality and social psychology. Personality and Social Psychology Bulletin, 19, 251–264.
   Web of Science ®Google Scholar
• Social and Behavioral Sciences Team (2017). Retrieved from https://sbst.gov/.
   Google Scholar
• Spellman, B. A. (2015). A short (personal) future history of Revolution 2.0. Perspectives on Psychological Science, 10, 886–899.
   Web of Science ®Google Scholar
• Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance—or vice versa. Journal of The American Statistical Association, 54, 30–34.
   Web of Science ®Google Scholar
• Stewart, N., Ungemach, C., Harris, A. J., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015). The average laboratory samples a population of 7,300 Amazon mechanical turk workers. Judgment and Decision Making, 10, 479.
   Web of Science ®Google Scholar
• Stillman, S. (January 23, 2017). Can behavioral science help in Flint? The New Yorker. Retrieved from http://www.newyorker.com/magazine/2017/01/23/can-behavioral-science-help-in-flint
   Google Scholar
• Sumner, P., Vivian-Griffiths, S., Boivin, J., Williams, A., Venetis, C. A., Davies, A., … Chambers, C. D. (2014). The association between exaggeration in health related science news and academic press releases: Retrospective observational study. BMJ : British Medical Journal, 349, g7015.
   Web of Science ®Google Scholar
• Tashiro, T., & Mortensen, L. (2006). Translational research: How social psychology can improve psychotherapy. The American Psychologist, 61, 959–966. doi:
   PubMed Web of Science ®Google Scholar
• Thoreson, R. W., Krauskopf, C. J., Mcaleer, C. A., & Wenger, H. D. (1972). The future for applied psychology. American Psychologist, 27, 134–139.
   Web of Science ®Google Scholar
• Trafimow, D., & Marks, M. (2015). Editorial. Basic and Applied Social Psychology, 37, 1–2.
   Web of Science ®Google Scholar
• Tressoldi, P. E., Cumming, G., Fresc, L., & Giofré, D. (2016). Effects of the psychological science new statistical, research disclosure statements and open practices submission guidelines from 2013 to 2015 (SSRN Scholarly Paper No. ID 2712603). Rochester, NY: Social Science Research Network. Retrieved from https://papers.ssrn.com/abstract=2712603
   Google Scholar
• Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine, 358, 252–260.
   PubMed Web of Science ®Google Scholar
• Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105–110.
   Google Scholar
• Vankov, I., Bowers, J., & Munafò, M. R. (2014). On the persistence of low power in psychological science. The Quarterly Journal of Experimental Psychology, 67, 1037–1040.
   PubMed Web of Science ®Google Scholar
• Vazire, S. (2016). Editorial. Social Psychological and Personality Science, 7, 3–7.
   Google Scholar
• Vitellin, R. (1988). The crisis issue assessed: An empirical analysis. Basic and Applied Social Psychology, 9, 301–309.
   Web of Science ®Google Scholar
• Wang, M. T. M., Bolland, M. J., Gamble, G., & Grey, A. (2015). Media coverage, journal press releases and editorials associated with randomized and observational studies in high-impact medical journals: A cohort study. PLOS ONE, 10, e0145294.
   PubMed Web of Science ®Google Scholar
• Ward, L. M. (1992). Mind in psychophysics. In D. Algom (Ed.), Psychophysical approaches to cognition (pp. 187–250). London: Elsevier.
   Google Scholar
• Webber, D., Babush, M., Schori-Eyal, N., Vazeou-Nieuwenhuis, A., Hettiarachchi, M., Bélanger, J. J., … Gelfand, M. J. (2018). The road to extremism: Field and experimental evidence that significance loss-induced need for closure fosters radicalization. Journal of Personality and Social Psychology, 114, 270–285.
   PubMed Web of Science ®Google Scholar
• Wegner, D. M. (1992). The premature demise of the solo experiment. Personality and Social Psychology Bulletin, 18, 504–508.
   Web of Science ®Google Scholar
• Wells, G. L., Memon, A., & Penrod, S. D. (2006). Eyewitness evidence: Improving its probative value. Psychological Science in the Public Interest, 7, 45–75.
   PubMedGoogle Scholar
• Wicker, A. W. (1969). Attitudes versus actions: The relationship of verbal and overt behavioral responses to attitude objects. Journal of Social Issues, 25, 41–78.
   Web of Science ®Google Scholar
• Wiener, R. L., Krauss, D. A., & Lieberman, J. D. (2011). Mock jury research: Where do we go from here? Behavioral Sciences and the Law, 29, 467–479.
   PubMed Web of Science ®Google Scholar
• Williamson, V. (2016, January). On the ethics of crowdsourced research. Retrieved April 6 2017, from http//core/journals/ps-political-science-and-politics/article/on-the-ethics-of-crowdsourced-research/B1BDFB1111B416DD0B71540CD6E7D94F doi:10.1017/S104909651500116X
   Google Scholar
• Witte, E. H., & Brandt, V. (2011). Social psychological research: The comparison of four journals. Retrieved from http://psydok.sulb.uni-saarland.de/volltexte/2011/2743
   Google Scholar
• Zhou, H., & Fishbach, A. (2016). The pitfall of experimenting on the web: How unattended selective attrition leads to surprising (yet false) research conclusions. Journal of Personality and Social Psychology, 111, 493–504.
   PubMed Web of Science ®Google Scholar