Validity of a Residualized Dependent Variable After Pretest Covariance Adjustments: Still the Same Variable?

REFERENCES

• Beck, A.T. (1990). Beck Anxiety Inventory (BAI). San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Beck, A.T. (1996). Beck Depression Inventory-II (BDI-II). San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Beck, A.T., & Steer, R.A. (1990). Manual for the Beck Anxiety Inventory. San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Beck, A.T., Steer, R.A., & Brown, G.K. (1996). BDI-II Manual. San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17, 10–17, 22.
   Google Scholar
• Clark, D.A., Steer, R.A., Beck, A.T., & Ross, L. (1995). Psychometric characteristics of revised Sociotropy and Autonomy Scales in college students. Behavorial Research Therapy, 33, 325–334.
   PubMed Web of Science ®Google Scholar
• Cliff, N. (1987). Analyzing multivariate data. San Diego, CA: Harcourt Brace Jovanovich.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Corder-Bolz, C.R., (1978). The evaluation of change: New evidence. Educational and Psychological Measurement, 38, 959–996.
   Web of Science ®Google Scholar
• Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart and Winston.
   Google Scholar
• Crowne, D.P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349–354.
   PubMedGoogle Scholar
• Henson, R.K. (1998, November). ANCOVA with intact groups: Don't do it!Paper presented at the annual meeting of the Mid-South Educational Research Association, New Orleans, LA (ERIC Document Reproduction Service No. ED 426 086).
   Google Scholar
• Johnson, H.J., Barnard-Brak, L., Saxon, T.F., Johnson, M.K. (2012). An experimental study of the effects of stereotype thread and stereotype lift on men and women's performance in mathematics. The Journal of Experimental Education, 80, 137–149.
   Web of Science ®Google Scholar
• Karagozoglu, C., Mastgern, W.G., Baloglu, M. (2005). Evidence for differentiating between anxiety and depression in Turkish college students. Social Behavior and Personality, 33, 579–586.
   Web of Science ®Google Scholar
• Kenny, D.A. (2012). Measuring model fit. Retrieved from http://davidakenny.net/cm/fit.htm
   Google Scholar
• Kojima, M., Furukawa, T.A., Takahashi, H., Kawai, M., Nagaya, T., & Tokudome, S. (2002). Cross-cultural validation of the Beck Depression Inventory-II in Japan. Psychiatry Research, 110, 291–299.
   PubMed Web of Science ®Google Scholar
• Lane, F.C., To, Y.M., Shelley, K., & Henson, R.K. (2012). An illustrative example of propensity score matching with education research. Career and Technical Education Research, 37, 187–212.
   Google Scholar
• Lynam, D.R., Hoyle, R.H., & Newman, J.P. (2006). The perils of partialling: Cautionary tales from aggression and psychopathy. Assessment, 13, 328–341.
   PubMed Web of Science ®Google Scholar
• Maxwell, S.E., Delaney, H.D., & Manheimer, J.M. (1985). ANOVA of residuals and ANCOVA: Correcting an illusion by using model comparisons and graphs. Journal of Educational Statistics, 10, 197–200.
   Google Scholar
• Meehl, P.E. (1971). High school yearbooks: A reply to Schwarz. Journal of Abnormal Psychology, 77, 143–148.
   Web of Science ®Google Scholar
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
   Web of Science ®Google Scholar
• Miller, G.A., & Chapman, J.P. (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 40–48.
   PubMed Web of Science ®Google Scholar
• Mitchell, M., & Jolley, J. (2001). Research design explained (4th ed.). Fort Worth, TX: Harcourt College Publishers.
   Google Scholar
• Nimon, K., Lewis, M., Kane, R., & Haynes, R.M. (2008). An R package to compute commonality coefficients in the multiple regression case: An introduction to the package and a practical example. Behavior Research Methods, 40, 457–466.
   PubMed Web of Science ®Google Scholar
• Nitschke, J.B., Heller, W., Imig, J.C., McDonald, R.P., Miller, G.A. (2001). Distinguishing between anxiety and depression. Cognitive Therapy and Research, 25, 1–22.
   Web of Science ®Google Scholar
• O’Connor, E.F. (1972). Extending classical test theory to the measurement of change. Review of Educational Research, 42, 73–97.
   Web of Science ®Google Scholar
• Onwuegbuzie, A.J., Roberts, J.K., & Daniel, L.G. (2004). A proposed new “what if” reliability analysis for assessing the statistical significance of bivariate relationships. Measurement and Evaluation in Counseling and Development, 37, 229–240.
   Google Scholar
• Osman, A., Downs, W.R., Barrios, F.X., Kopper, B.A., Gutierrez, P.M., & Chiros, C.E. (1997). Factor structure and psychometric characteristics of the Beck Depression Inventory-II. Journal of Psychopathology and Behavioral Assessment, 19, 359–376.
   Web of Science ®Google Scholar
• Pallesen, S., Nordhus, I.H., Carlstedt, B., Thayer, J.F., & Johnsen, T.B. (2006). A Norwegian adaptation of the Penn State Worry Questionnaire: Factor structure, reliability, validity and norms. Scandinavian Journal of Psychology, 47, 281–291.
   PubMed Web of Science ®Google Scholar
• Pedhazur, E.J., & Schmelkin, L.P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Erlbaum.
   Google Scholar
• Podsakoff, P.M., MacKenzie, S.M., Lee, J., & Podsakoff, N.P. (2003). Common method variance in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.
   PubMed Web of Science ®Google Scholar
• Preacher, K. (2006). Testing complex correlational hypotheses with structural equation models. Structural Equation Modeling, 13, 520–543.
   Web of Science ®Google Scholar
• Radloff, L.S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401.
   Web of Science ®Google Scholar
• Reynolds, W.M. (1992). Development of reliable and valid short forms of the Marlow-Crowne Social Desirability Scale. Journal of Clinical Psychology, 38, 119–125.
   Web of Science ®Google Scholar
• Skorikov, V.B., & Vandervoort, D.J. (2003). Relationships between the underlying constructs of the Beck Depression Inventory and the Center for Epidemiological Studies Depression Scale. Educational and Psychological Measurement, 63, 319–335.
   Web of Science ®Google Scholar
• Spielberger, C.D. (1977). State-Trait Anxiety Inventory. Palo Alto, CA: Mind Garden.
   Google Scholar
• Spielberger, C.D., Gorsuch, R.L., Lushene, R., Vagg, P.R., & Jacobs, G.A. (1983). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychological Press.
   Google Scholar
• Steer, R.A., & Clark, D.A. (1997). Psychometric characteristics of the Beck Depression Inventory-II with college students. Measurement and Evaluation in Counseling and Development, 30, 128–136.
   Web of Science ®Google Scholar
• Thompson, B. (1989). The place of qualitative research in contemporary social science: The importance of post-paradigmatic thought. In B. Thompson (Ed.), Advances in social science methodology: A research annual (Vol. 83, pp. 1–42). Greenwich, CT: JAI.
   Google Scholar
• Thompson, B. (1991). Review of Data Analysis for Research Designs. Educational and Psychological Measurement, 51, 500–510.
   Google Scholar
• Thompson, B. (1992). Misuse of ANCOVA and related “statistical control” procedures. Reading Psychology: An International Quarterly, 13, iii–xviii.
   Google Scholar
• Thompson, B. (2006). Foundations of behavioral statistics: An insight-based approach. New York, NY: Guilford Press.
   Google Scholar
• Tracz, S.M., Nelson, L.L., Newman, I., & Beltran, A. (2005). The misuse of ANCOVA: The academic and political implications of Type VI errors in studies of achievement and socioeconomic status. Multiple Linear Regression Viewpoints, 31, 16–21.
   Google Scholar
• Williams, R.H., & Zimmerman, D.W. (1982). Comparative validity of simple and residualized difference scores. Psychological Reports, 50, 91–94.
   Web of Science ®Google Scholar
• Winne, P.H. (1983). Distortions of construct validity in multiple regression analysis. Canadian Journal of Behavioral Science, 15, 187–202.
   Web of Science ®Google Scholar
• Winne, P.H., & Belfry, M.J. (1982). Interpretative problems when correcting for attenuation. Journal of Educational Measurement, 19, 125–134.
   Web of Science ®Google Scholar
• Young, C.W. (1936). The residual index. Journal of Educational Psychology, 27, 625–630.
   Google Scholar
• Zientek, L.R., & Thompson, B. (2009). Matrix summaries improve research reports: Secondary analyses using published literature. Educational Researcher, 38, 343–352.
   Web of Science ®Google Scholar
• Zimmerman, D.W. (2007). Correction for attenuation with biased reliability estimates and correlated errors in populations and samples. Educational and Psychological Measurement, 67, 920–939.
   Web of Science ®Google Scholar
• Zinbarg, R.E., Suzuki, S., Uliaszek, A.A., & Lewis A.R. (2010). Biased parameter estimates and inflated Type I error rates in analysis of covariance (and analysis of partial variance) arising from unreliability: Alternative and remedial strategies. Journal of Abnormal Psychology, 119, 307–319.
   PubMed Web of Science ®Google Scholar
• Zou, G.Y. (2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12, 399–413.
   PubMed Web of Science ®Google Scholar