Risky Tests of Etiological Models in Psychopathology Research: The Need for Meta-Methodology

References

• Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J., Fiedler, K., & Wicherts, J. M. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119.
   Web of Science ®Google Scholar
• Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2014). The Hamilton depression rating scale: Has the gold standard become a lead weight? American Journal of Psychiatry, 161, 2163–2177.
   Web of Science ®Google Scholar
• Block, J. (1995). A contrarian view of the five-factor approach to personality description. Psychological Bulletin, 117, 187–215.
   PubMed Web of Science ®Google Scholar
• Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., & Moffitt, T. E. (2014). The p factor one general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2, 119–137.
   PubMedGoogle Scholar
• Chaplin, W. F., & Goldberg, L. R. (1984). A failure to replicate the Bem and Allen study of individual differences in cross-situational consistency. Journal of Personality and Social Psychology, 47, 1074–1090.
   PubMed Web of Science ®Google Scholar
• Cook, T. D. (2000). Toward a practical theory of external validity. In L. Bickman (Ed.), Validity and social experimentation: Donald Campbell's legacy (Vol. 1, pp. 3–43). Thousand Oaks, CA: Sage.
   Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
   PubMed Web of Science ®Google Scholar
• Duncan, O. D. (1984). Notes on social measurement, historical and critical. New York, NY: Russell Sage Foundation.
   Google Scholar
• Ermer, E., Kahn, R. E., Salovey, P., & Kiehl, K. A. (2012). Emotional intelligence in incarcerated men with psychopathic traits. Journal of Personality and Social Psychology, 103, 194–204.
   PubMed Web of Science ®Google Scholar
• Evans, D. L., Charney, D. S., Lewis, L., Golden, R. N., Gorman, J. M., Krishnan, K. R., & Valvo, W. J. (2005). Mood disorders in the medically ill: Scientific review and recommendations. Biological Psychiatry, 58, 175–189.
   PubMed Web of Science ®Google Scholar
• Evans, W. N., & Graham, J. D. (1991). Risk reduction or risk compensation? The case of mandatory safety-belt use laws. Journal of Risk and Uncertainty, 4, 61–73.
   Web of Science ®Google Scholar
• Faraone, S., & Tsuang, M. (1994). Measuring diagnostic accuracy in the absence of a “gold standard.” American Journal of Psychiatry, 151, 650–657.
   PubMed Web of Science ®Google Scholar
• Garber, J., & Hollon, S. D. (1991). What can specificity designs say about causality in psychopathology research? Psychological Bulletin, 110, 129–136.
   PubMed Web of Science ®Google Scholar
• Hartshorne, J. K., & Schachner, A. (2012). Tracking replicability as a method of post-publication open evaluation. Frontiers in Computational Neuroscience, 6, 8.
   Google Scholar
• Hendrick, C. (1990). Replications, strict replications, and conceptual replications: are they important? Journal of Social Behavior & Personality, 5, 41–49.
   Google Scholar
• Herpertz, S. C., Kunert, H. J., Schwenger, U. B., & Sass, H. (2014). Affective responsiveness in borderline personality disorder: A psychophysiological approach. American Journal of Psychiatry, 156, 1550–1556.
   Google Scholar
• Insel, T. R. (2009). Translating scientific opportunity into public health impact: a strategic plan for research on mental illness. Archives of General Psychiatry, 66, 128–133.
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124.
   PubMed Web of Science ®Google Scholar
• Kagan, J. (1988). The meanings of personality predicates. American Psychologist, 43, 614–620.
   PubMed Web of Science ®Google Scholar
• Kendler, K. S. (2005). Toward a philosophical structure for psychiatry. American Journal of Psychiatry, 162, 433–440.
   PubMed Web of Science ®Google Scholar
• Kendler, K. S. (2006). Reflections on the relationship between psychiatric genetics and psychiatric nosology. American Journal of Psychiatry, 163, 1138–1146.
   PubMed Web of Science ®Google Scholar
• Lilienfeld, S. O. (2004). Taking theoretical risks in a world of directional predictions. Applied and Preventive Psychology, 11, 47–51.
   Web of Science ®Google Scholar
• Lilienfeld, S. O. (2007). Cognitive neuroscience and depression: Legitimate versus illegitimate reductionism and five challenges. Cognitive Therapy and Research, 31, 263–272.
   Web of Science ®Google Scholar
• Lilienfeld, S. O., Waldman, I. D., & Israel, A. C. (1994). A critical examination of the use of the term and concept of comorbidity in psychopathology research. Clinical Psychology: Science and Practice, 1, 71–83.
   Google Scholar
• Lishner, D. A. (2015). A concise set of core recommendations to improve the dependability of psychological research. Review of General Psychology, 19, 52–68.
   Web of Science ®Google Scholar
• Lohne, J. A. (1968). Experimentum crucis. Notes and Records of the Royal Society of London, 23, 169–199.
   Google Scholar
• Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151–159.
   PubMed Web of Science ®Google Scholar
• Lykken, D. T. (1991). What's wrong with psychology anyway? In D. Cicchetti, & W. M. Grove (Eds.), Thinking clearly about psychology Volume 1: Matters of public interest (pp. 3–39). Minneapolis: University of Minnesota Press
   Google Scholar
• Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537–542.
   Web of Science ®Google Scholar
• McNally, R. J. (1996). Cognitive bias in the anxiety disorders. In Nebraska symposium on motivation (Vol. 43, pp. 211–250). Lincoln, NE: University of Nebraska Press.
   Google Scholar
• Meehl, P. E. (1971). High school yearbooks: A reply to Schwarz. Journal of Abnormal Psychology, 77, 143–148.
   Web of Science ®Google Scholar
• Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834.
   Web of Science ®Google Scholar
• Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2013). The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the comprehensive system. Psychological Bulletin, 139, 548–605.
   PubMed Web of Science ®Google Scholar
• Miller, G. A., & Chapman, J. P. (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 40–46.
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science, 7, 615–631.
   Web of Science ®Google Scholar
• Pinkerton, S. D. (2001). Sexual risk compensation and HIV/STD transmission: Empirical evidence and theoretical considerations. Risk Analysis, 21, 727–736.
   PubMed Web of Science ®Google Scholar
• Popper, K. (1959). The logic of scientific discovery. London, UK: Hutchinson.
   Google Scholar
• Satel, S., & Lilienfeld, S. O. (2013). Brainwashed: The seductive appeal of mindless neuroscience. New York, NY: Basic Books.
   Google Scholar
• Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529–540.
   Web of Science ®Google Scholar
• Simons, D. J. (2014). The value of direct replication. Perspectives on Psychological Science, 9, 76–80.
   Web of Science ®Google Scholar
• Skeem, J. L., & Cooke, D. J. (2010). Is criminal behavior a central component of psychopathy? Conceptual directions for resolving the debate. Psychological Assessment, 22, 433–445.
   PubMed Web of Science ®Google Scholar
• Stanovich, K. (2012). How to think straight about psychology (10th ed.). Boston, MA: Pearson.
   Google Scholar
• Stroebe, W., & Strack, F. (2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9, 59–71.
   Web of Science ®Google Scholar
• Tavris, C. A. (2012, May). Debunking pseudoneuroscience. APS David Myers Distinguished Lecture on the Science and Craft of Teaching Psychology, annual convention of the Association for Psychological Science, Chicago, IL.
   Google Scholar
• Tellegen, A., & Waller, N. G. (2008). Exploring personality through test construction: Development of the Multidimensional Personality Questionnaire. The SAGE Handbook of Personality Theory and Assessment, 2, 261–292.
   Google Scholar
• Turner, J. R., & Durham, T. A. (2014). Meta-methodology: Conducting and reporting meta-analyses. The Journal of Clinical Hypertension, 16, 91–93.
   PubMed Web of Science ®Google Scholar
• Van Bockstaele, B., Verschuere, B., Tibboel, H., De Houwer, J., Crombez, G., & Koster, E. H. (2014). A review of current evidence for the causal impact of attentional bias on fear and anxiety. Psychological Bulletin, 140, 682–721.
   Google Scholar
• Walker, E. F., & Diforio, D. (1997). Schizophrenia: A neural diathesis-stress model. Psychological Review, 104, 667–685.
   PubMed Web of Science ®Google Scholar
• Watson, D., & Clark, L. A. (1984). Negative affectivity: the disposition to experience aversive emotional states. Psychological Bulletin, 96, 465–490.
   PubMed Web of Science ®Google Scholar
• Wood, J. M., Garb, H. N., Nezworski, M. T., Lilienfeld, S. O., & Duke, M. C. (2015). A second look at the validity of widely used Rorschach indices: Comment on Mihura, Meyer, Dumitrascu, and Bombel (2013). Psychological Bulletin, 141, 236–249.
   PubMed Web of Science ®Google Scholar