Examining the Factor Structure and Incremental Utility of the Contrast Avoidance Questionnaires via Bifactor Analysis

References

• Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705
   Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders. (5th ed.).
   Google Scholar
• Arditte, K. A., Çek, D., Shaw, A. M., & Timpano, K. R. (2016). The importance of assessing clinical phenomena in Mechanical Turk research. Psychological Assessment, 28(6), 684–691.
   PubMed Web of Science ®Google Scholar
• Benfer, N., Bardeen, J. R., Fergus, T. A., & Rogers, T. A. (2019). Factor structure and incremental validity of the original and modified versions of the difficulties in emotion regulation scale. Journal of Personality Assessment, 101(6), 598–608.
   PubMed Web of Science ®Google Scholar
• Brown, T. A. (2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41(12), 1411–1426. https://doi.org/10.1016/s0005-7967(03)00059-7
   PubMed Web of Science ®Google Scholar
• Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
   Google Scholar
• Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011). AIC model selection and multimodel inference in behavioral ecology: Some background, observations, and comparisons. Behavioral Ecology and Sociobiology, 65(1), 23–35. https://doi.org/10.1007/s00265-010-1029-6
   Web of Science ®Google Scholar
• Burnham, M. J., Le, Y. K., & Piedmont, R. L. (2018). Who is MTurk? Personal characteristics and sample consistency of these online workers. Mental Health, Religion & Culture, 21(9-10), 934–944. https://doi.org/10.1080/13674676.2018.1486394
   Web of Science ®Google Scholar
• Calkins, A. W., Otto, M. W., Cohen, L. S., Soares, C. N., Vitonis, A. F., Hearon, B. A., & Harlow, B. L. (2009). Psychosocial predictors of the onset of anxiety disorders in women: Results from a prospective 3-year longitudinal study. Journal of Anxiety Disorders, 23(8), 1165–1169.
   PubMed Web of Science ®Google Scholar
• Calmes, C. A., & Roberts, J. E. (2007). Repetitive thought and emotional distress: Rumination and worry as prospective predictors of depressive and anxious symptomatology. Cognitive Therapy and Research, 31(3), 343–356. https://doi.org/10.1007/s10608-006-9026-9
   Web of Science ®Google Scholar
• Chandler, J., & Shapiro, D. (2016). Conducting clinical research using crowdsourced convenience samples. Annual Review of Clinical Psychology, 12, 53–81.
   PubMed Web of Science ®Google Scholar
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
   Web of Science ®Google Scholar
• Crouch, T. A., Lewis, J. A., Erickson, T. M., & Newman, M. G. (2017). Prospective investigation of the contrast avoidance model of generalized anxiety and worry. Behavior Therapy, 48(4), 544–556.
   PubMed Web of Science ®Google Scholar
• Cuijpers, P., Sijbrandij, M., Koole, S., Huibers, M., Berking, M., & Andersson, G. (2014). Psychological treatment of generalized anxiety disorder: A meta-analysis. Clinical Psychology Review, 34(2), 130–140.
   PubMed Web of Science ®Google Scholar
• Dalal, D. K., & Carter, N. T. (2015). Negatively worded items negatively impact survey research. In C. E. Lance & R. J. Vandenberg (Eds.), More statistical and methodological myths and urban legends: Doctrine, verity and fable in organizational and social sciences (pp. 112–132). Routledge.
   Google Scholar
• Dear, B. F., Titov, N., Sunderland, M., McMillan, D., Anderson, T., Lorian, C., & Robinson, E. (2011). Psychometric comparison of the Generalized Anxiety Disorder Scale-7 and the Penn State Worry Questionnaire for measuring response during treatment of generalized anxiety disorder. Cognitive Behaviour Therapy, 40(3), 216–227.
   PubMedGoogle Scholar
• Dueber, D. M. (2016, December). Bifactor Indices Calculator: A Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models. http://sites.education.uky.edu/apslab/resources
   Google Scholar
• Eng, W., & Heimberg, R. G. (2006). Interpersonal correlates of generalized anxiety disorder: Self versus other perception. Journal of Anxiety Disorders, 20(3), 380–387.
   PubMed Web of Science ®Google Scholar
• Flores-Kanter, P. E., Dominguez-Lara, S., Trógolo, M. A., & Medrano, L. A. (2018). Best practices in the use of bifactor models: Conceptual grounds, fit indices and complementary indicators. Revista Evaluar, 18(3), 44–48. https://doi.org/10.35670/1667-4545.v18.n3.22221
   Google Scholar
• Gignac, G. E. (2016). The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence, 55, 57–68. https://doi.org/10.1016/j.intell.2016.01.006
   Web of Science ®Google Scholar
• Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48(5), 639–662.
   PubMed Web of Science ®Google Scholar
• Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. Du Toit, & D. Sorbom (Eds.), Structural equation modeling: Present and future (pp. 195–216). Scientific Software International.
   Google Scholar
• Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., Bigham, J. P. (2018). April). A data-driven analysis of workers' earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–14). https://doi.org/10.1145/3173574.3174023
   Google Scholar
• Hirsch, C. R., Mathews, A., Lequertier, B., Perman, G., & Hayes, S. (2013). Characteristics of worry in generalized anxiety disorder. Journal of Behavior Therapy and Experimental Psychiatry, 44(4), 388–395.
   PubMed Web of Science ®Google Scholar
• Holaway, R. M., Rodebaugh, T. L., & Heimberg, R. G. (2006). The epidemiology of worry and generalized anxiety disorder. In G. C. L. Davey & A. Wells (Eds.), Worry and its psychological disorders: Theory, assessment and treatment (pp. 3–20). John Wiley and Sons.
   Google Scholar
• Hoyer, J., Becker, E. S., & Roth, W. T. (2001). Characteristics of worry in GAD patients, social phobics, and controls. Depression and Anxiety, 1(2), 89–96.
   Web of Science ®Google Scholar
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
   Web of Science ®Google Scholar
• Hunot, V., Churchill, R., Teixeira, V., de Lima, M. S., & Cochrane Common Mental Disorders Group. (2007). Psychological therapies for generalized anxiety disorder. Cochrane Database of Systematic Reviews, 1, CD001848. https://doi.org/10.1002/14651858.CD001848.pub4
   Google Scholar
• Kertz, S., Bigda-Peyton, J., & Bjorgvinsson, T. (2013). Validity of the Generalized Anxiety Disorder Scale-7 in an acute psychiatric sample. Clinical Psychology & Psychotherapy, 20(5), 456–464.
   PubMed Web of Science ®Google Scholar
• Kline, R. B. (2016). Principles and practices of structural equation modeling. Guilford Publications.
   Google Scholar
• Llera, S. J., & Newman, M. G. (2010). Effects of worry on physiological and subjective reactivity to emotional stimuli in generalized anxiety disorder and nonanxious control participants. Emotion, 10(5), 640–650.
   PubMed Web of Science ®Google Scholar
• Llera, S. J., & Newman, M. G. (2014). Rethinking the role of worry in generalized anxiety disorder: Evidence supporting a model of emotional contrast avoidance. Behavior Therapy, 45(3), 283–299. https://doi.org/10.1016/j.beth.2013.12.011
   PubMed Web of Science ®Google Scholar
• Llera, S. J., & Newman, M. G. (2017). Development and validation of two measures of emotional contrast avoidance: The contrast avoidance questionnaires. Journal of Anxiety Disorders, 49, 114–127.
   PubMed Web of Science ®Google Scholar
• Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008). Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical Care, 46(3), 266–274. https://doi.org/10.1097/MLR.0b013e318160d093
   PubMed Web of Science ®Google Scholar
• Marsh, H. W., Hau, K. T., & Grayson, D. (2005). Goodness of fit in structural equation models. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Multivariate applications book series. Contemporary psychometrics: A festschrift for Roderick. P. McDonald (pp. 275–340). Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28(6), 487–495.
   PubMed Web of Science ®Google Scholar
• Muthén, B., Kaplan, D., & Hollis, M. (1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 52(3), 431–462. https://doi.org/10.1007/BF02294365
   Web of Science ®Google Scholar
• Muthén, L. K., &., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.). Muthén & Muthén.
   Google Scholar
• Newman, M. G., & Erickson, T. M. (2010). Generalized anxiety disorder. In J. G. Beck (Ed.), Interpersonal processes in the anxiety disorders: Implications for understanding psychopathology and treatment (pp. 235–259). American Psychological Association.
   Google Scholar
• Newman, M. G., Jacobson, N. C., Zainal, N. H., Shin, K. E., Szkodny, L. E., & Sliwinski, M. J. (2019). The effects of worry in daily life: An ecological momentary assessment study supporting the tenets of the contrast avoidance model. Clinical Psychological Science, 7(4), 794–810.
   Web of Science ®Google Scholar
• Newman, M. G., & Llera, S. J. (2011). A novel theory of experiential avoidance in generalized anxiety disorder: A review and synthesis of research supporting a contrast avoidance model of worry. Clinical Psychology Review, 31(3), 371–382.
   PubMed Web of Science ®Google Scholar
• Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45(4), 867–872. https://doi.org/10.1016/j.jesp.2009.03.009
   Web of Science ®Google Scholar
• Ormel, J., Rosmalen, J., & Farmer, A. (2004). Neuroticism: A non-informative marker of vulnerability to psychopathology. Social Psychiatry and Psychiatric Epidemiology, 39(11), 906–912. https://doi.org/10.1007/s00127-004-0873-y
   PubMed Web of Science ®Google Scholar
• Ottaviani, C., Thayer, J. F., Verkuil, B., Lonigro, A., Medea, B., Couyoumdjian, A., & Brosschot, J. F. (2016). Physiological concomitants of perseverative cognition: A systematic review and meta-analysis. Psychological Bulletin, 142(3), 231–259.
   PubMed Web of Science ®Google Scholar
• Paas, L. J., Dolnicar, S., & Karlsson, L. (2018). Instructional manipulation checks: A longitudinal analysis with implications for MTurk. International Journal of Research in Marketing, 35(2), 258–269. https://doi.org/10.1016/j.ijresmar.2018.01.003
   Web of Science ®Google Scholar
• Peer, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46(4), 1023–1031.
   PubMed Web of Science ®Google Scholar
• Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016). Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. General Hospital Psychiatry, 39, 24–31.
   PubMed Web of Science ®Google Scholar
• Rashtbari, A., & Saed, O. (2020). Contrast avoidance model of worry and generalized anxiety disorder: A theoretical perspective. Cogent Psychology, 7(1), 1800262. https://doi.org/10.1080/23311908.2020.1800262
   Web of Science ®Google Scholar
• Reise, S. P. (2012). Invited paper: The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
   PubMed Web of Science ®Google Scholar
• Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150.
   PubMed Web of Science ®Google Scholar
• Roemer, L., Salters, K., Raffa, S. D., & Orsillo, S. M. (2005). Fear and avoidance of internal experiences in GAD: Preliminary tests of a conceptual model. Cognitive Therapy and Research, 29(1), 71–88. https://doi.org/10.1007/s10608-005-1650-2
   Web of Science ®Google Scholar
• Rogers, T. A., Bardeen, J. R., Fergus, T. A., & Benfer, N. (2020). Factor structure and incremental utility of the Distress Tolerance Scale: A bifactor analysis. Assessment, 27(2), 297–308. https://doi.org/10.1177/1073191118789496
   PubMed Web of Science ®Google Scholar
• Salzer, S., Pincus, A. L., Hoyer, J., Kreische, R., Leichsenring, F., & Leibing, E. (2008). Interpersonal subtypes within generalized anxiety disorder. Journal of Personality Assessment, 90(3), 292–299.
   PubMed Web of Science ®Google Scholar
• Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variables analysis: Applications for developmental research (pp. 399–419). Sage Publications, Inc.
   Google Scholar
• Schroder, H. S., Clark, D. A., & Moser, J. S. (2019). Screening for problematic worry in adults with a single item from the Penn State Worry Questionnaire. Assessment, 26(2), 336–346.
   PubMed Web of Science ®Google Scholar
• Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science, 1(2), 213–220. https://doi.org/10.1177/2167702612469015
   Google Scholar
• Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097.
   PubMed Web of Science ®Google Scholar
• Stucky, B. D., & Edelen, M. O. (2015). Using hierarchical IRT to create unidimensional measures from multidimensional data. In S. P. Reise & D. A. Revicki (Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 183–206). Routledge.
   Google Scholar
• Sugiura, N. (1978). Further analysts of the data by Akaike's information criterion and the finite corrections: Further analysts of the data by Akaike's. Communications in Statistics - Theory and Methods, 7(1), 13–26. https://doi.org/10.1080/03610927808827599
   Web of Science ®Google Scholar
• Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. https://doi.org/10.1007/BF02291170
   Web of Science ®Google Scholar
• Turk, C. L., Heimberg, R. G., Luterek, J. A., Mennin, D. S., & Fresco, D. M. (2005). Emotion dysregulation in generalized anxiety disorder: A comparison with social anxiety disorder. Cognitive Therapy and Research, 29(1), 89–106. https://doi.org/10.1007/s10608-005-1651-1
   Web of Science ®Google Scholar
• Tyrer, P., & Baldwin, D. (2006). Generalized anxiety disorder. The Lancet, 368(9553), 2156–2166. https://doi.org/10.1016/S0140-6736(06)69865-6
   PubMed Web of Science ®Google Scholar
• White, E. J., Grant, D. M., Kraft, J. D., Taylor, D. L., Deros, D. E., Nagel, K. M., & Frosio, K. E. (2021). Psychometric properties and prospective predictive utility of the contrast avoidance questionnaires. European Journal of Psychological Assessment, 37(6), 460–472. https://doi.org/10.27/1015-5759/a000630.
   Web of Science ®Google Scholar
• Wittchen, H. U. (2002). Generalized anxiety disorder: Prevalence, burden, and cost to society. Depression and Anxiety, 16(4), 162–171. https://doi.org/10.1002/da.10065
   PubMed Web of Science ®Google Scholar
• Yao, B., Sripada, R. K., Klumpp, H., Abelson, J. L., Muzik, M., Zhao, Z., Rosenblum, K., Briggs, H., Kaston, M., & Warren, R. (2016). Penn State Worry Questionnaire–10: A new tool for measurement-based care. Psychiatry Research, 239, 62–67.
   PubMed Web of Science ®Google Scholar
• Yarrish, C., Groshon, L., Mitchell, J. D., Appelbaum, A., Klock, S., Winternitz, T., & Friedman-Wheeler, D. G. (2019). Finding the signal in the noise: Minimizing responses from bots and inattentive humans in online research. The Behavior Therapist, 42(7), 235–242.
   Google Scholar