Addressing Psychometric Limitations of the Attentional Control Scale via Bifactor Modeling and Item Modification

References

• Abdi, H., & Williams, L. J. (2010). Principal component analysis. Wiley Interdisciplinary Reviews: Computational Statistics, 2(4), 433–459.
   Google Scholar
• Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176–181.
   Web of Science ®Google Scholar
• Asparouhov, T. (2005). Sampling weights in latent variable modeling. Structural Equation Modeling, 12(3), 411–434.
   Web of Science ®Google Scholar
• Bardeen, J. R., & Daniel, T. A. (2017). A longitudinal examination of the role of attentional control in the relationship between posttraumatic stress and threat-related attentional bias: An eye-tracking study. Behaviour Research and Therapy, 99, 67–77.
   PubMed Web of Science ®Google Scholar
• Bardeen, J. R., Fergus, T. A., & Orcutt, H. K. (2015). Attentional control as a prospective predictor of posttraumatic stress symptomatology. Personality and Individual Differences, 81, 124–128.
   Web of Science ®Google Scholar
• Bardeen, J. R., Kumpula, M. J., & Orcutt, H. K. (2013). Emotion regulation difficulties as a prospective predictor of posttraumatic stress symptoms following a mass shooting. Journal of Anxiety Disorders, 27(2), 188–196.
   PubMed Web of Science ®Google Scholar
• Bardeen, J. R., & Orcutt, H. K. (2011). Attentional control as a moderator of the relationship between posttraumatic stress symptoms and attentional threat bias. Journal of Anxiety Disorders, 25(8), 1008–1018.
   PubMed Web of Science ®Google Scholar
• Bardeen, J. R., & Read, J. P. (2010). Attentional control, trauma, and affect regulation: A preliminary investigation. Traumatology, 16(3), 11.
   Google Scholar
• Bardeen, J. R., Tull, M. T., Dixon-Gordon, K. L., Stevens, E. N., & Gratz, K. L. (2015). Attentional control as a moderator of the relationship between difficulties accessing effective emotion regulation strategies and distress tolerance. Journal of Psychopathology and Behavioral Assessment, 37(1), 79–84.
   Web of Science ®Google Scholar
• Barkley, R. A. (2011). Barkley deficits in executive functioning scale (BDEFS). New York, NY: Guilford.
   Google Scholar
• Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238
   PubMed Web of Science ®Google Scholar
• Bonifay, W., Lane, S. P., & Reise, S. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184–186.
   Web of Science ®Google Scholar
• Bradbury, C. L., Christensen, B. K., Lau, M. A., Ruttan, L. A., Arundine, A. L., & Green, R. E. (2008). The efficacy of cognitive behavior therapy in the treatment of emotional distress after acquired brain injury. Archives of Physical Medicine and Rehabilitation, 89(12), S61–S68.
   PubMed Web of Science ®Google Scholar
• Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press.
   Google Scholar
• Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. Sage Focus Editions, 154, 136.
   Google Scholar
• Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's mechanical Turk: a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science: a Journal of the Association for Psychological Science, 6(1), 3–5.
   PubMedGoogle Scholar
• Casler, K., Bickel, L., & Hackett, E. (2013). Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29(6), 2156–2160.
   Web of Science ®Google Scholar
• Chandler, J., & Shapiro, D. (2016). Conducting clinical research using crowdsourced convenience samples. Annual Review of Clinical Psychology, 12(1), 53.
   PubMed Web of Science ®Google Scholar
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255.
   Web of Science ®Google Scholar
• Clark, L. A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316.
   PubMed Web of Science ®Google Scholar
• Cox, R. C., Cole, D. A., Kramer, E. L., & Olatunji, B. O. (2018). Prospective associations between sleep disturbance and repetitive thinking: The mediating roles of focusing and shifting attentional control. Behavior Therapy, 49(1), 21–31.
   PubMed Web of Science ®Google Scholar
• Dalal, D. K., & Carter, N. T. (2015). Negatively worded items negatively impact survey research. More Statistical and Methodological Myths and Urban Legends, (pp. 112–132). New York, NY: Routledge.
   Google Scholar
• Derryberry, D., & Reed, M. A. (2002). Anxiety-related attentional biases and their regulation by attentional control. Journal of Abnormal Psychology, 111(2), 225–236.
   PubMed Web of Science ®Google Scholar
• Derryberry, D., & Rothbart, M. K. (1988). Arousal, affect, and attention as components of temperament. Journal of Personality and Social Psychology, 55(6), 958–966.
   PubMed Web of Science ®Google Scholar
• Dueber, D. M. (2017). Bifactor Indices Calculator: A Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models.
   Google Scholar
• Feldman, G., Knouse, L. E., & Robinson, A. (2013). Executive functioning difficulties and depression symptoms: Multidimensional assessment, incremental validity and prospective associations. Journal of Cognitive and Behavioral Psychotherapies, 13(2), 259–274.
   Google Scholar
• Fergus, T. A., Bardeen, J. R., & Orcutt, H. K. (2012). Attentional control moderates the relationship between activation of the cognitive attentional syndrome and symptoms of psychopathology. Personality and Individual Differences, 53(3), 213–217.
   Web of Science ®Google Scholar
• Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. Du Toit, & D. Sorbom (Eds.), Structural Equation Modeling: Present and Future (pp. 195–216). Lincolnwood, IL: Scientific Software International.
   Google Scholar
• Healy, B. (2010). The effect of attentional control and heart-period variability on negative affect and trait anxiety. The Journal of General Psychology, 137(2), 140–150.
   PubMed Web of Science ®Google Scholar
• Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44(2), 227–239.
   PubMed Web of Science ®Google Scholar
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
   Web of Science ®Google Scholar
• Hughes, G. D. (2009). The impact of incorrect responses to reverse-coded survey items. Research in the Schools, 16(2), 76–88.
   Google Scholar
• Jarrett, M. A. (2016). Attention-deficit/hyperactivity disorder (ADHD) symptoms, anxiety symptoms, and executive functioning in emerging adults. Psychological Assessment, 28(2), 245–250.
   PubMed Web of Science ®Google Scholar
• Jha, A. P., Krompinger, J., & Baime, M. J. (2007). Mindfulness training modifies subsystems of attention. Cognitive, Affective, & Behavioral Neuroscience, 7(2), 109–119.
   PubMed Web of Science ®Google Scholar
• Jones, C. R., Fazio, R. H., & Vasey, M. W. (2012). Attentional control buffers the effect of public-speaking anxiety on performance. Social Psychological and Personality Science, 3(5), 556–561.
   PubMed Web of Science ®Google Scholar
• Jöreskog, K. G., Sörbom, D., du Toit, S., & du Toit, M. (2000). LISEREL 8: new statistical features (2nd ed.). Chicago, IL: Scientific Software International.
   Google Scholar
• Judah, M. R., Grant, D. M., Mills, A. C., & Lechner, W. V. (2014). Factor structure and validation of the attentional control scale. Cognition and Emotion, 28(3), 433–451.
   PubMed Web of Science ®Google Scholar
• Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151.
   Web of Science ®Google Scholar
• Kanske, P., & Kotz, S. A. (2012). Effortful control, depression, and anxiety correlate with the influence of emotion on executive attentional control. Biological Psychology, 91(1), 88–95.
   PubMed Web of Science ®Google Scholar
• Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.
   Google Scholar
• Lovibond, S. H., & Lovibond, P. E. (1995). Manual for the depression anxiety stress scales. Sydney: Psychology Foundation.
   Google Scholar
• Mathews, A., Yiend, J., & Lawrence, A. D. (2004). Individual differences in the modulation of fear-related brain activation by attentional control. Journal of Cognitive Neuroscience, 16(10), 1683–1694.
   PubMed Web of Science ®Google Scholar
• Matsunaga, M. (2010). How to factor-analyze your data right: Do’s, don’ts, and how-to’s. International Journal of Psychological Research, 3(1), 97–2084.
   Google Scholar
• McHugh, R. K., Kertz, S. J., Weiss, R. B., Baskin-Sommers, A. R., Hearon, B. A., & Björgvinsson, T. (2014). Changes in distress intolerance and treatment outcome in a partial hospital setting. Behavior Therapy, 45(2), 232–240.
   PubMed Web of Science ®Google Scholar
• Meyers, L. S., Gamst, G., & Guarino, A. J. (2006). Applied multivariate research: Design and interpretation. Thousand Oaks, CA: Sage.
   Google Scholar
• Moras, K., Di Nardo, P. A., & Barlow, D. H. (1992). Distinguishing anxiety and depression: Reexamination of the reconstructed Hamilton scales. Psychological Assessment, 4(2), 224–227.
   Google Scholar
• Muthén, B., Kaplan, D., & Hollis, M. (1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 52(3), 431–462.
   Web of Science ®Google Scholar
• Muthen, L. K., & Muthen, B. O. (2015). Mplus (Version 7.4) [Computer software]. Los Angeles, CA: Muthen & Muthen.
   Google Scholar
• O’Brien, K. S., Latner, J. D., Puhl, R. M., Vartanian, L. R., Giles, C., Griva, K., & Carter, A. (2016). The relationship between weight stigma and eating behavior is explained by weight bias internalization and psychological distress. Appetite, 102, 70–76.
   PubMed Web of Science ®Google Scholar
• O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments and Computers, 32(3), 396–402.
   PubMedGoogle Scholar
• Ólafsson, R. P., Smári, J., Guðmundsdóttir, F., Olafsdóttir, G., Harðardóttir, H. L., & Einarsson, S. M. (2011). Self-reported attentional control with the Attentional Control Scale: Factor structure and relationship with symptoms of anxiety and depression. Journal of Anxiety Disorders, 25(6), 777–782.
   PubMed Web of Science ®Google Scholar
• Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012). The depression anxiety stress scales-21 (DASS‐21): Further examination of dimensions, scale reliability, and correlates. Journal of Clinical Psychology, 68(12), 1322–1338.
   PubMed Web of Science ®Google Scholar
• Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science, 23(3), 184–188.
   Web of Science ®Google Scholar
• Patrick, C. J., Hicks, B. M., Nichol, P. E., & Krueger, R. F. (2007). A bifactor approach to modeling the structure of the Psychopathy Checklist-Revised. Journal of Personality Disorders, 21(2), 118–141.
   PubMed Web of Science ®Google Scholar
• Paulhus, D. L., Robins, R. W., Trzesniewski, K. H., & Tracy, J. L. (2004). Two replicable suppressor situations in personality research. Multivariate Behavioral Research, 3, 303–328.
   Google Scholar
• Peers, P. V., & Lawrence, A. D. (2009). Attentional control of emotional distraction in rapid serial visual presentation. Emotion, 9(1), 140.
   PubMed Web of Science ®Google Scholar
• Quigley, L., Wright, C. A., Dobson, K. S., & Sears, C. R. (2017). Measuring attentional control ability or beliefs? Evaluation of the factor structure and convergent validity of the Attentional Control Scale. Journal of Psychopathology and Behavioral Assessment, 39(4), 742–754.
   Web of Science ®Google Scholar
• Reinholdt-Dunne, M. L., Mogg, K., & Bradley, B. P. (2009). Effects of anxiety and attention control on processing pictorial and linguistic emotional information. Behaviour Research and Therapy, 47(5), 410–417.
   PubMed Web of Science ®Google Scholar
• Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696.
   PubMed Web of Science ®Google Scholar
• Reise, S. P., Kim, D. S., Mansolf, M., & Widaman, K. F. (2016). Is the bifactor model a better model or is it just better at modeling implausible responses? Application of iteratively reweighted least squares to the Rosenberg Self-Esteem Scale. Multivariate Behavioral Research, 51(6), 818–838.
   PubMed Web of Science ®Google Scholar
• Richey, J. A., Keough, M. E., & Schmidt, N. B. (2012). Attentional control moderates fearful responding to a 35% CO2 challenge. Behavior Therapy, 43(2), 285–299.
   PubMed Web of Science ®Google Scholar
• Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reverse of social anxiety is not always the opposite: The reverse-scored items of the Social Interaction Anxiety Scale do not belong. Behavior Therapy, 38(2), 192–206.
   PubMed Web of Science ®Google Scholar
• Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150.
   PubMed Web of Science ®Google Scholar
• Sarapas, C., Weinberg, A., Langenecker, S. A., & Shankman, S. A. (2017). Relationships among attention networks and physiological responding to threat. Brain and Cognition, 111, 63–72.
   PubMed Web of Science ®Google Scholar
• Spada, M. M., Georgiou, G. A., & Wells, A. (2010). The relationship among metacognitions, attentional control, and state anxiety. Cognitive Behaviour Therapy, 39(1), 64–71.
   PubMedGoogle Scholar
• Spruijt, A. M., Dekker, M. C., Ziermans, T. B., & Swaab, H. (2018). Attentional control and executive functioning in school-aged children: Linking self-regulation and parenting strategies. Journal of Experimental Child Psychology, 166, 340–359.
   PubMed Web of Science ®Google Scholar
• Taylor, C. T., Cross, K., & Amir, N. (2016). Attentional control moderates the relationship between social anxiety symptoms and attentional disengagement from threatening information. Journal of Behavior Therapy and Experimental Psychiatry, 50, 68–76.
   PubMed Web of Science ®Google Scholar
• Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327.
   Web of Science ®Google Scholar
• Verwoerd, J., de Jong, P. J., & Wessel, I. (2008). Low attentional control and the development of intrusive memories following a laboratory stressor. Journal of Psychopathology and Behavioral Assessment, 30(4), 291–297.
   Web of Science ®Google Scholar
• Wang, M., & Russell, S. S. (2005). Measurement equivalence of the job descriptive index across Chinese and American workers: Results from confirmatory factor analysis and item response theory. Educational and Psychological Measurement, 65(4), 709–732.
   Web of Science ®Google Scholar
• Weems, G. H., & Onwuegbuzie, A. J. (2001). The impact of midpoint responses and reverse coding on survey data. Measurement and Evaluation in Counseling and Development, 34(3), 166.
   Web of Science ®Google Scholar
• Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432.
   Web of Science ®Google Scholar