4,323
Views
50
CrossRef citations to date
0
Altmetric
Focus Article

Rethinking Traditional Methods of Survey Validation

References

  • AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
  • Arnulf, J. K., Larsen, K. R., Martinsen, Ø. L., & Bong, C. H. (2014). Predicting survey responses: How and why semantics shape survey statistics on organizational behaviour. PloS One, 9(9), e106361. doi:10.1371/journal.pone.0106361
  • Bickhard, M. H. (2001). The tragedy of operationalism. Theory and Psychology, 11(1), 35–44. doi:10.1177/0959354301111002
  • Blackwell, L. S., Trzesniewski, K. H., & Dweck, C. S. (2007). Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. Child Development, 78(1), 246–263. doi:10.1111/cdev.2007.78.issue-1
  • Borsboom, D. (2006). The attack of the psychometricians. Psychometrika, 71(3), 425–440. doi:10.1007/s11336-006-1447-6
  • Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110, 203–219. doi:10.1037/0033-295X.110.2.203
  • Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071. doi:10.1037/0033-295X.111.4.1061
  • Bridgman, P. W. (1927). The logic of modern physics. New York: Macmillan.
  • Chang, H. (2004). Inventing temperature. Oxford, UK: Oxford University.
  • Chang, H. Operationalism. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Fall 2009 edition). Retrieved from http://plato.stanford.edu/archives/fall2009/entries/operationalism/
  • Cronbach, L. J. (1949). Essentials of psychological testing. New York: Harper & Row.
  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281. doi:10.1037/h0040957
  • Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6), 1087. doi:10.1037/0022-3514.92.6.1087
  • Duckworth, A. L., & Yeager, D. S. (2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. doi:10.3102/0013189X15584327
  • Dweck, C. (2006). Mindset: The new psychology of success. Philadelphia, PA: Psychology Press.
  • Ellis, J. L., & Van Den Wollenberg, A. L. (1993). Local homogeneity in latent trait models: A characterization of the homogeneous monotone IRT model. Psychometrika, 58, 417–429. doi:10.1007/BF02294649
  • Epstein, S. (1994). Trait theory as personality theory: Can a part be as great as the whole? Psychological Inquiry, 5, 120–122. doi:10.1207/s15327965pli0502_4
  • Feldman, J. M., & Lynch, J. G. (1988). Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. Journal of Applied Psychology, 73(3), 421. doi:10.1037/0021-9010.73.3.421
  • Gosling, S. D., Rentfrow, P. J., & Swann, W. B., Jr. (2003). A very brief measure of the big five personality domains. Journal of Research in Personality, 37, 504–528. doi:10.1016/S0092-6566(03)00046-1
  • Green, C. D. (1992). Of immortal mythological beasts: Operationism in psychology. Theory and Psychology, 2(3), 291–320. doi:10.1177/0959354392023003
  • Heath, S. B. (1983). Ways with words: Language, life and work in communities and classrooms. Cambridge, UK: Cambridge University Press.
  • Howe, K. R. (2003). Closing methodological divides: Toward democratic educational research (Vol. 11). Berlin, Germany: Springer Science & Business Media.
  • Humphry, S. (2013). Understanding measurement in light of its origins. Frontiers in Psychology, 4, 113. doi:10.3389/fpsyg.2013.00113
  • Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319–342. doi:10.1111/jedm.2001.38.issue-4
  • Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17–64). Santa Barbara, CA: Greenwood.
  • Kyngdon, A. (2013). Descriptive theories of behaviour may allow for the scientific measurement of psychological attributes. Theory and Psychology, 23, 227–250. doi:10.1177/0959354312468221
  • Lamiell, J. T. (1987). The psychology of personality: An epistemological inquiry. New York: Columbia University Press.
  • Latour, B., & Woolgar, S. (1973/2013). Laboratory life: The construction of scientific facts. Princeton, NJ: Princeton University Press.
  • MacCann, C., & Roberts, R. D. (2010). Do time management, grit, and self-control relate to academic achievement independently of conscientiousness? In R.E. Hicks (Ed.), Personality and individual differences: Current directions. Brisbane, Australia: Australian Academic Press
  • Maraun, M. D. (2012). Validity and measurement. Measurement: Interdisciplinary Issues and Perspectives, 10, 80–83.
  • Markus, K. A., & Borsboom, D. (2013). Frontiers of test validity theory: Measurement, causation, and meaning. Routledge.
  • Maul, A. (2012). The validity of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) as a measure of emotional intelligence. Emotion Review, 4, 394–402. doi:10.1177/1754073912445811
  • Maul, A. (2013a). Method effects and the meaning of measurement. Frontiers in Psychology, 4, 169. doi:10.3389/fpsyg.2013.00169
  • Maul, A. (2013b). The ontology of psychological attributes. Theory and Psychology, 23, 752–769. doi:10.1177/0959354313506273
  • Maul, A., Torres Irribarra, D., & Wilson, M. (2016). On the philosophical foundations of psychological measurement. Measurement, 79, 311–320. doi:10.1016/j.measurement.2015.11.001
  • McGrane, J. (2015). Stevens’ forgotten crossroads: The divergent measurement traditions in the physical and psychological sciences from the mid-twentieth century. Frontiers in Psychology, 6, 431. doi:10.3389/fpsyg.2015.00431
  • McCall, W.A. (1939). Measurement. New York: The Macmillan Company.
  • Mead, M. (1928). Coming of age in Samoa: A psychological study of primitive youth for western civilisation. New York, NY: William Morrow and Co.
  • Mellenbergh, G. J. (2011). A conceptual introduction to psychometrics: Development, analysis and application of psychological and educational tests. The Hague, Netherlands: Eleven International.
  • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education/Macmillian.
  • Messick, S. (1991). Psychology and methodology of response styles. In R. E. Snow & D. E. Wiley (Eds.), Improving inquiry in social science (pp. 161–200). Hillsdale, NJ: Erlbaum.
  • Michell, J. (1990). An introduction to the logic of psychological measurement. New York: Psychology Press.
  • Michell, J. (2005). The logic of measurement: A realist overview Measurement. 38(4), 285–294
  • Michell, J. (1997). Quantitative science and the definition of measurement in psychology. British Journal of Psychology, 88, 355–383. doi:10.1111/bjop.1997.88.issue-3
  • Michell, J. (1999). Measurement in psychology: A critical history of a methodological concept. Cambridge, UK: Cambridge University Press.
  • Michell, J. (2009). Invalidity in validity. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 135–170). Charlotte, NC: Information Age.
  • Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practice, 25(4), 6–20. doi:10.1111/j.1745-3992.2006.00075.x
  • Molenaar, P. C., Huizenga, H. M., & Nesselroade, J. R. (2003). The relationship between the structure of interindividual and intraindividual variability: A theoretical and empirical vindication of developmental systems theory. In U. M. Staudinger & U. Lindenberger (Eds.), Understanding human development (pp. 339–360). New York, NY: Springer US.
  • Molenaar, P. C. M. (1999). Longitudinal analysis. In H. J. Ade`R & G. J. Mellenbergh (Eds.), Research methodology in the life, behavioural and social sciences (pp. 143–167). Thousand Oaks, CA: Sage.
  • Newton, P., & Shaw, S. (2014). Validity in educational and psychological assessment. London, UK: Sage.
  • Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academies Press.
  • Pervin, L. A. (1994). A critical analysis of current trait theory (with commentaries). Psychological Inquiry, 5, 103–178. doi:10.1207/s15327965pli0502_1
  • Sherry, D. (2011). Thermoscopes, thermometers, and the foundations of measurement. Studies in the History and Philosophy of Science, 42, 509–524. doi:10.1016/j.shpsa.2011.07.001
  • Slaney, K. L., & Racine, T. P. (2013). What’s in a name? Psychology’s ever evasive construct. New Ideas in Psychology, 13, 4–12. doi:10.1016/j.newideapsych.2011.02.003
  • Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103(2684), 677–680. doi:10.1126/science.103.2684.677
  • Thorndike, E.L. (1918). The nature, purposes, and general methods of measurements of educational products. Chapter II in G.M. Whipple (Ed.), The Seventeenth yearbook of the National Society for Study of Education. Part II. The Measurement of Educational Products.. Bloomington, IL: Public School Publishing Co.
  • Wilson, M. (2004). Constructing measures: An item response theory approach. Mahwah, NJ: Routledge Academic.
  • Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82).Charlotte, NC: Information Age Publishing

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.