A Two‐Facet Measurement Methodology for Assessing Item Parcels: An application to measuring political knowledge in secondary school

References

• Aish , A.‐M. and Jøreskog , K. G. 1990 . A panel model for political efficacy and responsiveness: An application of LISREL 7 with weighted least squares. . Quality & Quantity , 24 : 405 – 426 .
   Web of Science ®Google Scholar
• Anderson , J. C. and Gerbing , D. W. 1988 . Structural equation modeling in practice: A review and recommended two‐step approach. . Psychological Bulletin , 103 : 411 – 423 .
   Web of Science ®Google Scholar
• Bagozzi , R. P. and Heatherton , T. F. 1994 . A general approach to representing multifaceted personality constructs: Applications to state self‐esteem. . Structural Equation Modeling , 1 : 35 – 67 .
   Web of Science ®Google Scholar
• Bandalos , D. 1999 . The effects of item parceling in structural equation modeling: A Monte Carlo study Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Canada, April
   Google Scholar
• Bandalos , D. and Finney , S. 2001 . “ Item parceling issues in structural equation modeling. ” . In New developments and techniques in structural equation modeling , Edited by: Marcoulides , G. A and Schumacker , R. E . 269 – 295 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Bentler , P. M. and Bonett , D. G. 1980 . Significance tests and goodness‐of‐fit in the analysis of covariance structures. . Psychological Bulletin , 88 : 588 – 606 .
   Web of Science ®Google Scholar
• Bentler , P. M. and Chou , C. 1987 . Practical issues in structural modeling. . Sociological Methods and Research , 16 : 78 – 117 .
   Web of Science ®Google Scholar
• Bernstein , I. H. and Teng , G. 1989 . Factoring items and factoring scales are different. Spurious evidence for multidimensionality due to item categorization. . Psychological Bulletin , 105 : 467 – 477 .
   Web of Science ®Google Scholar
• Bollen , K. A. 1989 . Structural equations with latent variables , New York : Wiley .
   Google Scholar
• Bollen , K. and Lennox , R. 1991 . Conventional wisdom on measurement. A structural equation perspective. . Psychological Bulletin , 110 : 305 – 314 .
   Web of Science ®Google Scholar
• Brennan , R. L. 1992 . Elements of generalizability theory , Iowa City, IA : ACT .
   Google Scholar
• Brennan , R. L. 2001 . Generalizability theory , New York : Springer .
   Google Scholar
• Browne , M. W. and Cudeck , R. 1993 . “ Alternative ways of assessing model fit. ” . In Testing structural equation models , Edited by: Bollen , K and Long , J. S . 136 – 162 . Newbury Park, CA : Sage .
   Google Scholar
• Carpini , M. X. D. and Keeter , S. 1993 . Measuring political knowledge: Putting first things first. . American Political Science Review , 37 : 1179 – 1206 .
   Google Scholar
• Cattell , R. B. 1956 . Validation and intensification of the sixteen personality factor questionnaire. . Journal of Clinical Psychology , 12 : 205 – 214 .
   PubMed Web of Science ®Google Scholar
• Cattell , R. B. and Burdsal , C. A. 1975 . The radical parcel double factoring design: A solution to the item‐vs‐parcel controversy. . Multivariate Behavioral Research , 10 : 165 – 179 .
   Web of Science ®Google Scholar
• Cohen , P. , Cohen , J. , Teresi , J. , Marchi , M. and Noemi Velez , C. 1990 . Problems in the measurement of latent variables in structural equations causal models. . Applied Psychological Measurement , 14 : 183 – 196 .
   Web of Science ®Google Scholar
• Colton , D. A. 2002, April . Approaching validity through testlets Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans, April
   Google Scholar
• Cortina , J. M. 1993 . What is the coefficient alpha? An examination of theory and application. . Journal of Applied Psychology , 78 : 98 – 104 .
   Web of Science ®Google Scholar
• Cronbach , L. J. , Gleser , G. C. , Nanda , H. and Rajaratnam , N. 1972 . The dependability of behavioral measurement. Theory of generalizability for scores and profiles , New York : Wiley .
   Google Scholar
• DiStefano , C. A. 1998 . The effects of ignoring the metric level of data in confirmatory factor analysis Unpublished doctoral dissertation, University of Georgia, Athens, Georgia
   Google Scholar
• Eysenck , H. J. and Eysenck , S. B. G. 1969 . Personality structure and measurement , London : Routledge & Kegan Paul .
   Google Scholar
• Farnham‐Diggory , S. 1992 . Cognitive processes in education , New York : Harper Collins .
   Google Scholar
• Green , S. B. , Lissitz , R. W. and Mulaik , S. A. 1977 . Limitations of coefficient alpha as an index of test unidimensionality. . Educational and Psychological Measurement , 37 : 827 – 838 .
   Web of Science ®Google Scholar
• Gribbons , B. C. and Hocevar , D. 1998 . Levels of aggregation in higher level confirmatory factor analysis: Application for academic self‐concept. . Structural Equation Modeling , 5 : 377 – 390 .
   Web of Science ®Google Scholar
• Hagtvet , K. A. 1998 . Assessment of latent constructs: a joint application of generalizability theory and covariance modeling with an emphasis on inference and structure. . Scandinavian Journal of Educational Research , 42 : 41 – 63 .
   Google Scholar
• Hagtvet , K. A. 1999 . A covariance modeling approach to investigate dimensionality within a generalizability framework Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Canada, April
   Google Scholar
• Hagtvet , K. A. and Kim , S. 2000 . Assessing unidimensionality of item parcels in structural equation modeling: A simulation study Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA, April
   Google Scholar
• Hagtvet , K. A. , Man , F. and Sharma , S. 2001 . Generalizability of self‐related cognitions in test anxiety. . Personality and Individual Differences , 31 : 1147 – 1171 .
   Web of Science ®Google Scholar
• Hagtvet , K. A. and Nasser , F. M. 2004 . How well do item parcels represent conceptually defined latent constructs: A two‐facet approach. . Structural Equation Modeling , 11 : 168 – 193 .
   Web of Science ®Google Scholar
• Hagtvet , K. A. and Zuo , L. 2000 . Conceptual and empirical components of an internal domain study: An illustration in terms of the Achievement Motives Scale. . Scandinavian Journal of Educational Research , 44 : 49 – 78 .
   Google Scholar
• Hall , R. J. , Snell , A. F. and Foust , M. S. 1999 . Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. . Organizational Research Methods , 2 : 233 – 256 .
   Web of Science ®Google Scholar
• Hu , L. T. and Bentler , P. M. 1999 . Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. . Structural Equation Modeling , 6 : 1 – 55 .
   Web of Science ®Google Scholar
• Jarjoura , D. and Brennan , R. L. 1983 . “ Multivariate generalizability models for tests developed according to a table of specifications. ” . In New directions for testing and measurement: Generalizability theory , Edited by: Fyans , L. J . 83 – 101 . San Francisco : Jossey‐Bass .
   Google Scholar
• Joormann , J. and Stöber , J. 1997 . Measuring facets of worry: A Lisrel analysis of the Worry Domains questionnaire. . Personality and Individual Differences , 23 : 827 – 837 .
   Web of Science ®Google Scholar
• Jøreskog , K. G. 1971 . Simultaneous factor analysis in several populations. . Psychometrika , 36 : 409 – 426 .
   Web of Science ®Google Scholar
• Jøreskog , K. G. 1979 . “ Basic ideas of factor analysis and component analysis. ” . In Advances in factor analysis and structural equation models , Edited by: Jøreskog , K. G and Sørbom , D . (pp. 5 – 20) . Cambridge, MA : Abt Books .
   Google Scholar
• Jøreskog , K. G. 1990 . New developments in LISREL: Analysis of ordinal variables using polychoric correlations and weighted least squares. . Quality & Quantity , 24 : 387 – 404 .
   Web of Science ®Google Scholar
• Jøreskog , K. G. 1994 . “ Testing structural equation model. ” . In Testing structural equation models , Edited by: Bollen , K. A and Scott Long , J . 294 – 316 . Newbury Park, CA : Sage .
   Google Scholar
• Jøreskog , K. G. and Moustaki , I. 2001 . Factor analysis of ordinal variables: A comparison of three approaches. . Multivariate Behavioral Research , 36 : 347 – 387 .
   PubMed Web of Science ®Google Scholar
• Jøreskog , K. G. and Sørbom , D. 1985 . LISREL VI: Analysis of linear structural relationships by the method of maximum likelihood , Mooresville, IN : Scientific Software .
   Google Scholar
• Jøreskog , K. G. and Sørbom , D. 1988 . LISREL 7: A guide to the program and applications , Chicago : SPSS .
   Google Scholar
• Jøreskog , K. G. and Sørbom , D. 1993 . LISREL8: Structural equation modeling with the SIMPLIS command language , Chicago : Scientific Software .
   Google Scholar
• Jøreskog , K. G. and Sørbom , D. 1996 . PRELIS2: User's reference guide , Chicago : Scientific Software .
   Google Scholar
• Jøreskog , K. G. , Sørbom , D. and du Toit , S. H. C. 2000 . LISREL8: New statistical features , Chicago : Scientific Software .
   Google Scholar
• Kaplan , D. 1988 . The impact of specification error on the estimation, testing and improvement of structural equation models. . Multivariate Behavioral Research , 23 : 69 – 86 .
   PubMed Web of Science ®Google Scholar
• Kaplan , D. 1989 . Model modification in covariance structure analysis: Application of the expected parameter change. . Multivariate Behavioral Research , 24 : 285 – 305 .
   PubMed Web of Science ®Google Scholar
• Kaplan , D. 2000 . Structural equation modeling , Thousand Oaks, CA : Sage .
   Google Scholar
• Kim , S. 2000 . Assessment of item parcels in representing latent variables Unpublished doctoral dissertation, The University of Georgia, Athens, Georgia
   Google Scholar
• Kim , S. and Hagtvet , K. A. 2003 . The impact of misspecified item parceling on representing latent variables in covariance structural modeling: A simulation study. . Structural Equation Modeling , 10 : 101 – 127 .
   Web of Science ®Google Scholar
• Kishton , J. M. and Widaman , K. F. 1994 . Unidimensional versus domain representative parceling of questionnaire items: An empirical example. . Educational and Psychological Measurement , 54 : 757 – 765 .
   Web of Science ®Google Scholar
• Kirke‐, utdannings, og forskningsdepartementet . 1994 . “ Læreplan for videregående opplæring—Samfunnslære. Videregående kurs1 felles allment fag for alle studieretninger [Curriculum for upper secondary education—Civics, advanced course 1, Common general subject for all areas of study; in Norewgian]. ” . Oslo, , Norway : Kirke‐utdanningss‐ og forskningsdepartementet .
   Google Scholar
• Landis , R. S. , Beal , D. J. and Tesluk , P. E. 2000 . A comparison of approaches to forming composite measures in structural equation models. . Organizational Research Methods , 3 : 186 – 207 .
   Web of Science ®Google Scholar
• Lee , G. , Brennan , R. L. and Friesbie , D. A. 2000 . Incorporating the testlet concept in test score analyses. . Educational Measurement: Issues and Practice , 19 : 9 – 15 .
   Google Scholar
• Little , T. D. , Cunningham , W. A. , Shahar , G. and Widaman , K. F. 2002 . To parcel or not to parcel: Exploring the question, weighing the merits. . Structural Equation Modeling , 9 : 151 – 173 .
   Web of Science ®Google Scholar
• MacCallum , R. C. , Widaman , K. F. , Zhang , S. and Hong , S. 1999 . Sample size in factor analysis. . Psychological Methods , 4 : 84 – 99 .
   Web of Science ®Google Scholar
• Marsh , H. W. , Hau , K.‐T. , Balla , J. R. and Grayson , D. 1998 . Is more ever too much? The number of indicators per factor in confirmatory factor analysis. . Multivariate Behavioral Research , 33 : 181 – 220 .
   PubMed Web of Science ®Google Scholar
• McDonald , R. P. 1981 . The dimensionality of tests and items. . British Journal of Mathematical and Statistical Psychology , 34 : 100 – 117 .
   Web of Science ®Google Scholar
• Muthén , L. K. and Muthén , B. O. 1998 . Mplus. User's guide , Los Angeles : Muthén & Muthén .
   Google Scholar
• Nasser , F. , Takahashi , T. and Benson , J. 1997 . The structure of test anxiety in Israeli‐Arab high school students: An application of confirmatory factor analysis with miniscales. . Anxiety, Stress, and Coping , 10 : 129 – 151 .
   Web of Science ®Google Scholar
• Niemi , R. G. and Junn , J. 1998 . Civic education. What makes students Learn? , London : Yale University Press .
   Google Scholar
• Prats , D. C. 1990 . The effects of forming miniscales on the construct validity of the test anxiety inventory Paper presented at the National Council on Measurement in Education, Boston
   Google Scholar
• Reuterberg , S. and Gustafsson , J. 1990 . Confirmatory factor analysis and reliability: Testing measurement model assumptions , Goteborg, , Sweden : University of Goteborg Department of Education and Educational Research .
   Google Scholar
• Rushton , J. P. , Brainerd , J. C. and Pressley , M. 1983 . Behavioral development and construct validity: The principle of aggregation. . Psychological Bulletin , 94 : 18 – 38 .
   Web of Science ®Google Scholar
• Saris , W. E. , Satorra , A. and Sørbom , D. 1987 . “ The detection and correction of specification errors in structural equation models. ” . In Sociological methodology , Edited by: Cloggs , C. C . 105 – 129 . San Francisco : Jossey‐Bass .
   Google Scholar
• Satorra , A. and Bentler , P. M. 1988 . Scaling corrections for chi‐square statistics in covariance structure analysis. . Proceedings of the Business and Economic Statistics Section of the American Statistical Association , 1988 : 308 – 313 .
   Google Scholar
• Schau , C. , Stevens , J. , Dauphinee , T. and Vecchio , A. D. 1995 . The development and validation of the survey of attitudes toward statistics. . Educational and Psychological Measurement , 55 : 868 – 875 .
   Web of Science ®Google Scholar
• Skaalvik , E. M. and Hagtvet , K. A. 1990 . Academic achievement and self‐concept: An analysis of causal predominance in a developmental perspective. . Journal of Personality and Social Psychology , 58 : 292 – 307 .
   Web of Science ®Google Scholar
• Sobel , M. E. and Bohrnstedt , G. W. 1985 . “ Use of null models in evaluating the fit of covariance structure models. ” . In Sociological methodology 1985 , Edited by: Tuma , N. B . 152 – 178 . San Francisco : Jossey‐Bass .
   Google Scholar
• Solhaug , T. 2001 . On the measurement of political knowledge Paper presented at the IPSA/RPSEA Round Table Conference on Political Socialization, Participation, and Political Education, Wuppertal, Germany, June
   Google Scholar
• Solhaug , T. 2003 . Utdanning til demokratisk medborgerskap [Education for democratic citizenship; in Norwegian]. Unpublished doctoral dissertation, Department of Teacher Education and School Development. University of Oslo, Norway
   Google Scholar
• Spearman , C. 1904 . General intelligence: Objectively determined and measured. . American Journal of Psychology , 15 : 201 – 293 .
   Web of Science ®Google Scholar
• Spearman , C. 1914 . The theory of two factors. . Psychological Review , 21 : 101 – 115 .
   Google Scholar
• Takahashi , T. and Nasser , F. 1996 . The impact of using item parcels on ad hoc goodness of fit indices in confirmatory factor analysis: An empirical example Paper presented at the Annual Meeting of the American Educational Research Association, New York, April
   Google Scholar
• Thompson , B. and Melancon , J. G. 1996 . Using item “testlets” “parcels” in confirmatory factor analysis: An example using the PPSDQ‐78 Paper presented at the Annual Meeting of the Mid‐South Educational Research Association, Tuscaloosa, AL
   Google Scholar
• Thurstone , L. L. 1931 . Multiple factor analysis. . Psychological Review , 38 : 406 – 427 .
   Google Scholar
• Yuan , K.‐H.. , Bentler , P. M. and Kano , Y. 1997 . On averaging variables in a CFA model. . Behaviormetrika , 24 : 71 – 83 .
   Google Scholar
• West , S. G. , Finch , J. F. and Curra , P. J. 1995 . “ Structural equation models with non‐normal variables: Problems and remedies. ” . In Structural equation modeling. Concepts, issues, and applications , Edited by: Hoyle , R. H . 56 – 75 . London : Sage .
   Google Scholar