Item Construction Using Reflective, Formative, or Rasch Measurement Models: Implications for Group Work

REFERENCES

• American Educational Research Association, American Psychological Association & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: Author.
   Google Scholar
• Andrich, D., & Kreiner, S. (2010). Quantifying response dependence between two dichotomous items using the Rasch model. Applied Psychological Measurement, 34, 181–192. doi:10.1177/0146621609360202
   Web of Science ®Google Scholar
• Association for Specialists in Group Work [ASGW]. (2000). Professional standards for the training of group workers. Alexandria, VA: Author.
   Google Scholar
• Baylor, C., Hula, W., Donovan, N. J., Doyle, P. J., Kendall, D., & Yorkston, K. (2011). An introduction to item response theory and Rasch models for speech-language pathologists. American Journal of Speech-Language Pathology, 20, 243–259. doi:10.1044/1058-0360(2011/10-0079)
   PubMed Web of Science ®Google Scholar
• Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110, 305–314. doi:10.1037/0033-2909.110.2.305
   Web of Science ®Google Scholar
• Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: Wiley-Interscience.
   Google Scholar
• Bordelon, T. D. (2006). A qualitative approach to developing an instrument for assessing MSW students’ group work performance. Social Work with Groups: A Journal of Community and Clinical Practice, 29(4), 75–91. doi:10.1300/J009v29n04_06
   Google Scholar
• Boyle, G. J. (1991). Does item homogeneity indicate internal consistency or item redundancy in psychometric scales? Personality and Individual Differences, 12, 291–294. doi:10.1016/0191-8869(91)90115-R
   Web of Science ®Google Scholar
• Burlingame, G. M., Cox, J. C., Davies, D. R., Layne, C. M., & Gleave, R. (2011). The group selection questionnaire: Further refinements in group member selection. Group Dynamics: Theory, Research, and Practice, 15(1), 60–74. doi:10.1037/a0020220
   Web of Science ®Google Scholar
• Cattell, R. B. (1978). The scientific use of factor analysis in behavioral and life sciences. New York, NY: Plenum Press.
   Google Scholar
• Coltman, T., Devinney, T. M., Midgley, D. F., & Venaik, S. (2008). Formative versus reflective measurement models: Two applications of formative measurement. Journal of Business Research, 61, 1250–1262. doi:10.1016/j.jbusres.2008.01.013
   Web of Science ®Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. doi:10.1007/bf02310555
   Web of Science ®Google Scholar
• DeLucia-Waack, J. L. (1997). Measuring the effectiveness of group work: A review and analysis of process and outcome measures. The Journal for Specialists in Group Work, 22, 277–293. doi:10.1080/01933929708415531
   Google Scholar
• DeVellis, R. F. (2012). Scale development: Theory and applications (Vol. 26). Sage.
   Google Scholar
• Diamantopoulos, A., Riefler, P., & Roth, K. P. (2008). Advancing formative measurement models. Journal of Business Research, 61, 1203–1218. doi:10.1016/j.jbusres.2008.01.009
   Web of Science ®Google Scholar
• Diamantopoulos, A., & Winklhofer, H. M. (2001). Index construction with formative indicators: An alternative to scale development. Journal of Marketing Research, 38, 269–277. doi:10.1509/jmkr.38.2.269.18845
   Web of Science ®Google Scholar
• Engelhard Jr, G., & Wang, J. (2014). Alternative measurement paradigms for measuring executive functions: SEM (formative and reflective models) and IRT (Rasch models). Measurement: Interdisciplinary Research & Perspectives, 12, 102–108. doi:10.1080/15366367.2014.943592
   Google Scholar
• Haynes, S. N., Richard, D., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238–247. doi:10.1037/1040-3590.7.3.238
   Web of Science ®Google Scholar
• Hudgens, S., Dineen, K., Webster, K., Lai, J. S., & Cella, D. (2004). Assessing statistically and clinically meaningful construct deficiency/saturation: Recommended criteria for content coverage and item writing. Rasch Measurement Transactions, 17, 954–955.
   Google Scholar
• Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30, 199–218. doi:10.1086/376806
   Web of Science ®Google Scholar
• MacKenzie, S. B., Podsakoff, P. M., & Jarvis, C. B. (2005). The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology, 90, 710–730. doi:10.1037/0021-9010.90.4.710
   PubMed Web of Science ®Google Scholar
• Marley, S. C. (2010). Psychological measurement for specialists in group work. The Journal for Specialists in Group Work, 35, 331–348. doi:10.1080/01933922.2010.514978
   Google Scholar
• McKinley, R. L. (1989). An introduction to item response theory. Measurement and Evaluation in Counseling and Development, 22(1), 37–57.
   Web of Science ®Google Scholar
• Nunnally, J. C. (1978). Psychometric theory. New York, NY: McGraw-Hill.
   Google Scholar
• Onwuegbuzie, A. J., Bustamante, R. M., & Nelson, J. A. (2010). Mixed research as a tool for developing quantitative instruments. Journal of Mixed Methods Research, 4(1), 56–78. doi:10.1177/1558689809355805
   Web of Science ®Google Scholar
• Peterson, C. H. (2012). The individual regulation component of group emotional intelligence: Measure development and validation. The Journal for Specialists in Group Work, 37, 232–251. doi:10.1080/01933922.2012.686962
   Google Scholar
• Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value in Health, 18(1), 25–34. doi:10.1016/j.jval.2014.10.005
   PubMed Web of Science ®Google Scholar
• Petter, S., Straub, D., & Rai, A. (2007). Specifying formative constructs in information systems research. MIS Quarterly, 31, 623–656.
   Web of Science ®Google Scholar
• Rossiter, J. R. (2002). The C-OAR-SE procedure for scale development in marketing. International Journal of Research in Marketing, 19, 305–335. doi:10.1016/S0167-8116(02)00097-6
   Web of Science ®Google Scholar
• Smith, E. V. (2001). Evidence for the reliability of measures and validity of measure interpretation: A Rasch measurement perspective. Journal of Applied Measurement, 2, 281–311.
   PubMedGoogle Scholar
• Smith, E. V. (2005). Effect of item redundancy on Rasch item and person estimates. Journal of Applied Measurement, 6, 147–163.
   PubMedGoogle Scholar
• Stark, S., Chernyshenko, O. S., Drasgow, F., & Williams, B. A. (2006). Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring? Journal of Applied Psychology, 91(1), 25–39. doi:10.1037/0021-9010.91.1.25
   PubMed Web of Science ®Google Scholar
• Streiner, D. L., Norman, G. R., & Cairney, J. (2014). Health measurement scales: A practical guide to their development and use. New York, NY: Oxford University Press.
   Google Scholar
• Tate, K. A., Rivera, E. T., Conwill, W. L., Miller, M. D., & Puig, A. (2013). Conceptualizing group dynamics from our clients’ perspective: Development of the conceptualization of group dynamics inventory. The Journal for Specialists in Group Work, 38, 146–168. doi:10.1080/01933922.2013.775206
   Google Scholar
• Wolfe, E. W., & Smith, E. V. (2006). Instrument development tools and activities for measure validation using Rasch models: Part I—Instrument development tools. Journal of Applied Measurement, 8(1), 97–123.
   Google Scholar
• Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34, 806–838. doi:10.1177/0011000006288127
   Web of Science ®Google Scholar
• Wymer, W., & Alves, H. M. B. (2013). Scale development research in nonprofit management & marketing: A content analysis and recommendation for best practices. International Review on Public and Nonprofit Marketing, 10(1), 65–86. doi:10.1007/s12208-012-0093
   Google Scholar
• Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187–213. doi:10.1111/j.1745-3984.1993.tb00423.x
   Web of Science ®Google Scholar
• Zenisky, A. L., Hambleton, R. K., & Sireci, S. G. (2002). Identification and evaluation of local item dependencies in the medical college admissions test. Journal of Educational Measurement, 39, 291–309. doi:10.1111/j.1745-3984.2002.tb01144.x
   Web of Science ®Google Scholar