Method Bias in Comparative Research: Problems of Construct Validity as Exemplified by the Measurement of Ethnic Diversity

REFERENCES

• Adcock , R. , & Collier , D. ( 2001 ). Measurement validity: A shared standard for qualitative and quantitative research . American Political Science Review , 95 , 529 – 546 .
   Web of Science ®Google Scholar
• Albert , H. ( 1964 ). Problems in building theories: Development, structure and application of theories in social sciences [in German] . In H. Albert , (Ed.), Theory and reality (pp. 3 – 72 ). Tübingen, Germany : J.C.B. Mohr (Siebeck) .
   Google Scholar
• Alesina , A. , Baqir , R. , & Easterly , W. ( 1999 ). Public goods and ethnic division . Quarterly Journal of Economics , 114 , 1243 – 1284 .
   Web of Science ®Google Scholar
• Alesina , A. , Devleeschauwer , A. , Easterly , W. , Kurlat , W. , & Wacziarg , R. ( 2003 ). Fractionalization . Journal of Economic Growth , 8 , 155 – 194 .
   Web of Science ®Google Scholar
• Alesina , A. , & Glaeser , E. L. ( 2004 ). Fighting poverty in the U.S. and Europe—A world of differences . Oxford , UK : Oxford University Press .
   Google Scholar
• Alesina , A. , & La Ferrara , E. (2005). Ethnic diversity and economic performance. Journal of Economic Literature , 43, 762–800.
   Web of Science ®Google Scholar
• Atlas Narodov Mira . ( 1964 ). Moscow: Miklukho-Maklai, Ethnological Institute at the Department of Geodesy and Cartography of the State Geological Committee of the Soviet Union.
   Google Scholar
• Bagozzi , R. P. , & Yi , Y. ( 1991 ). Multitrait–multimethod matrices in consumer research . Journal of Consumer Research , 17 , 426 – 439 .
   Web of Science ®Google Scholar
• Bjørnskov , C. ( 2008 ). Social trust and fractionalization: A possible reinterpretation . European Sociological Review , 24 , 271 – 283 .
   Web of Science ®Google Scholar
• Blattman , C. , & Miguel , M. ( 2010 ). Civil war . Journal of Economic Literature , 48 , 3 – 57 .
   Web of Science ®Google Scholar
• Boix , C. ( 1999 ). Setting the rules of the game: The choice of electoral systems in advanced democracies . American Political Science Review , 93 , 609 – 624 .
   Web of Science ®Google Scholar
• Bollen , K. A. ( 1989 ). Structural equations with latent variables . New York, NY : Wiley .
   Google Scholar
• Bollen , K. A. , & Lennox , R. ( 1991 ). Conventional wisdom on measurement: A structural equation perspective . Psychological Bulletin , 110 , 305 – 314 .
   Web of Science ®Google Scholar
• Braithwaite , J. ( 1985 ). White collar crime . Annual Review of Sociology , 11 , 1 – 25 .
   Web of Science ®Google Scholar
• Brambor , T. , Clark , W. R. , & Golder , M. ( 2006 ). Understanding interaction models: Improving empirical analyses . Political Analysis , 14 , 63 – 82 .
   Web of Science ®Google Scholar
• Campbell , D. L. , & Fiske , D. W. ( 1959 ). Convergent and discriminant validation by multitrait-multimethod matrix . Psychological Bulletin , 56 , 81 – 105 .
   PubMed Web of Science ®Google Scholar
• Cederman , L.-E. , & Girardin , L. ( 2007 ). Beyond fractionalization: Mapping ethnicity onto nationalist insurgencies . American Political Science Review , 101 , 173 – 185 .
   Web of Science ®Google Scholar
• Cederman , L.-E. , Wimmer , A. , & Min , B. ( 2010 ). Why do ethnic groups rebel? New data and analysis . World Politics , 62 , 87 – 119 .
   Web of Science ®Google Scholar
• Central Intelligence Agency . ( 1996 ) . CIA world factbook , [online] . Washington , DC : Author .
   Google Scholar
• Chandra , K. , & Wilkinson , S. ( 2008 ). Measuring the effect of ethnicity . Comparative Political Studies , 41 , 515 – 563 .
   Web of Science ®Google Scholar
• Collier , P. , & Hoeffler , A. ( 2004 ). Greed and grievance in civil war . Oxford Economic Papers , 56 , 563 – 595 .
   Web of Science ®Google Scholar
• Collier , P. , & Hoeffler , A. ( 2007 ). Civil war . In K. Hartley & T. Sandler , (Eds.), Handbook of defense economics (pp. 711 – 739 ). Amsterdam , The Netherlands : Elsevier North Holland .
   Google Scholar
• Costa , D. L. , & Kahn , M. E. ( 2003 ). Civic engagement and community heterogeneity: An economist's perspective . Perspective on Politics , 1 , 103 – 111 .
   Google Scholar
• Cote , J. A. , & Buckley , R. ( 1987 ). Estimating trait, method, and error variance: Generalizing across 70 construct validation studies . Journal of Marketing Research , 24 , 315 – 318 .
   Web of Science ®Google Scholar
• Cronbach , L. J. , & Meehl , P. E. ( 1955 ). Construct validity in psychological tests . Psychological Bulletin , 52 , 281 – 302 .
   PubMed Web of Science ®Google Scholar
• Djankov , S. , Glaeser , E. , La Porta , R. , López-de-Silanes , F. , & Shleifer , A. ( 2003 ). The new comparative economics . Journal of Comparative Economics , 3 , 595 – 619 .
   Google Scholar
• Djankov , S. , La Porta , R. , López-de-Silanes , F. , & Shleifer , A. ( 2002 ). The regulation of entry . Quarterly Journal of Economics , 117 , 1 – 37 .
   Web of Science ®Google Scholar
• Easterly , W. , & Levine , R. ( 1997 ). Africa's growth tragedy: Policies and ethnic divisions . The Quarterly Journal of Economics , 112 , 1203 – 1250 .
   Web of Science ®Google Scholar
• Edwards , J. R. , & Bagozzi , R. ( 2000 ). On the nature and direction of relationships between constructs and measures . Psychological Methods , 5 , 155 – 174 .
   PubMed Web of Science ®Google Scholar
• Eid , M. ( 2000 ). A multitrait-multimethod model with minimal assumptions . Psychometrika , 65 , 241 – 261 .
   Web of Science ®Google Scholar
• Esteban , J. , & Schneider , G. ( 2008 ). Polarization and conflict: Theoretical and empirical issues . Journal of Peace Research , 45 , 131 – 141 .
   Web of Science ®Google Scholar
• Fearon , J. D. ( 2003 ). Ethnic and cultural diversity by country . Journal of Economic Growth , 8 , 195 – 222 .
   Web of Science ®Google Scholar
• Fearon , J. D. , & Laitin , D. D. (2003). Ethnicity, insurgency, and civil war. American Political Science Review , 97, 1–16.
   Web of Science ®Google Scholar
• Fearon , J. D. , & Posner , D. ( 2001 ). The implications of constructivism for constructing ethnic fractionalization indices . APSA-CP , 13 ( 1 ), 13 – 17 .
   Google Scholar
• Gamliel , E. , & Peer , E. ( 2006 ). Positive versus negative framing affects justice . Social Justice Research , 19 , 307 – 322 .
   Google Scholar
• Ganster , D. C. , Hennessey , H. W. , & Luthans , F. ( 1983 ). Social desirability response effects: Three alternative models . Academy of Management Journal , 26 , 321 – 331 .
   Web of Science ®Google Scholar
• Geddes , B. ( 2003 ). Paradigms and sand castles: Theory building and research design in comparative politics . Ann Arbor : University of Michigan Press .
   Google Scholar
• Gerring , J. , & Thacker , S. C. ( 2005 ). Do neoliberal policies deter political corruption? International Organization , 59 , 233 – 254 .
   Web of Science ®Google Scholar
• Graeff , P. , & Mehlkop , G. ( 2007 ). When amonie becomes a reason for suicide—a new macrosociological approach in the Duerkheimian tradition . European Sociological Review , 23 , 521 – 535 .
   Web of Science ®Google Scholar
• Habyarimana , J. , Humphreys , M. , Posner , D. , & Weinstein , J. M. ( 2007 ). Why does ethnic diversity undermine public good provision? American Political Science Review , 101 , 709 – 725 .
   Web of Science ®Google Scholar
• Hooghe , M. , Reeskens , T. , Stolle , D. , & Trappers , A. ( 2009 ). Ethnic diversity and generalized trust in Europe—a cross-national multilevel study . Comparative Political Studies , 42 , 198 – 223 .
   Web of Science ®Google Scholar
• Horowitz , D. ( 1985 ). Ethnic groups in conflict . Berkeley : University of California Press .
   Google Scholar
• Jöreskog , K. G. , & Sörbom , D. ( 1993 ). LISREL8: structural equation modeling with the SIMPLIS command language . Hillsdale , NJ : Earlbaum .
   Google Scholar
• Kalyvas , S. N. ( 2008 ). Ethnic defection in civil wars . Comparative Political Studies , 41 , 1043 – 1068 .
   Web of Science ®Google Scholar
• Kaufmann , D. , Kraay , A. , & Mastruzzi , M. ( 2007 ). Governance indicators: Aggregate and individual governance indicators for 1996–2005. Washington, DC: World Bank.
   Google Scholar
• Kaufmann , D. , Kraay , A. , & Mastruzzi , M. ( 2010 ). The worldwide governance indicators project: Answering the critics . European Journal of Development Research , 22 , 55 – 58 .
   Web of Science ®Google Scholar
• Laitin , D. , & Posner , D. N. ( 2001 , Winter). The implications of constructivism for constructing ethnic fractionalization indices . APSA-CP: The Comparative Politics Newsletter , 12 , 13 – 17 .
   Google Scholar
• Lakatos , I. ( 1976 ). Proofs and refutations . Cambridge , UK : Cambridge University Press .
   Google Scholar
• Langbein , L. , & Knack , S. ( 2008 ). The worldwide governance indicators and tautology: Causally related separable concepts, indicators of a common cause, or both? (Policy Research Working Paper 4669). Retrieved from https://openknowledge.worldbank.org/bitstream/handle/10986/6839/WPS4669.txt?sequence=2
   Google Scholar
• La Porta , R. , López-de-Silanes , F. , Shleifer , A. , & Vishny , R. ( 1998 ). Law and finance . Journal of Political Economy , 106 , 1113 – 1155 .
   Web of Science ®Google Scholar
• La Porta , R. , López-de-Silanes , F. , Shleifer , A. , & Vishny , R. ( 1999 ). The quality of government . Journal of Law, Economics and Organization , 15 , 222 – 279 .
   Web of Science ®Google Scholar
• Leamer , E. ( 1983 ). Let's take the con out of econometrics . American Economic Review , 73 , 31 – 43 .
   Web of Science ®Google Scholar
• Lijphart , A. ( 1992 ). Democratization and constitutional choices in Czecho-Slovakia, Hungary, and Poland, 1989–1991 . Journal of Theoretical Politics , 4 , 207 – 223 .
   Google Scholar
• Lipset , S. M. ( 1993 ). The social requisites of democracy revisited . American Sociological Review , 59 , 1 – 22 .
   Google Scholar
• Lipset , S. M. , & Marks , G. ( 2000 ). It didn't happen here: Why socialism failed in the United States . New York , NY : W.W. Norton .
   Google Scholar
• Lipset , S. M. , Seong. , K. R , & Torres , J. C. ( 1993 ). A comparative analysis of the social requisites of democracy . International Social Science Journal , 45 , 155 – 175 .
   Google Scholar
• Loehlin , J. C. ( 2004 ). Latent variable models . Mahwah , NJ : Lawrence Erlbaum Associates .
   Google Scholar
• MacKenzie , S. B. , Podsakoff , P. M. , & Jarvis , C. J. (2005). The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology , 90, 710–730.
   PubMed Web of Science ®Google Scholar
• Marsh , H. W. ( 1989 ). Confirmatory factor analyses of multitrait-multimethod data. Many problems and few solutions . Applied Psychological Measurement , 13 , 335 – 361 .
   Web of Science ®Google Scholar
• Marsh , H. W. , & Bailey , M. ( 1991 ). Confirmatory factor analyses of multitrait-multimethod data: A comparison of alternative models . Applied Psychological Measurement , 15 , 47 – 70 .
   Web of Science ®Google Scholar
• Mauro , P. ( 1995 ). Corruption and growth . The Quarterly Journal of Economics , 110 , 681 – 712 .
   Web of Science ®Google Scholar
• Merton , R. K. ( 1949 ). Social theory and social structure: Toward the codification of theory and research . Glencoe , IL : Free Press .
   Google Scholar
• Min , B. , Cederman , L.-E. , & Wimmer , A. ( 2009 ). Ethnic exclusion, economic growth, and civil war: A new dataset on ethnic power relations in the world, 1946–2005 . Unpublished manuscript, University of California, Los Angeles .
   Google Scholar
• Mishler , W. , & Rose , R. ( 2001 ). What are the origins of political trust? Testing institutional and cultural theories in post-Communist societies . Comparative Political Studies , 34 , 30 – 62 .
   Web of Science ®Google Scholar
• Montalvo , J. G. , & Reynal-Querol , M. ( 2005 ). Ethnic polarization, potential conflict and civil wars . American Economic Review , 95 , 796 – 816 .
   Web of Science ®Google Scholar
• Morton , R. B. ( 1999 ). Methods and models . New York , NY : CUP .
   Google Scholar
• Neumann , R. , & Graeff , P. ( 2010 ). A multitrait-multimethod approach to pinpoint the validity of aggregated governance indicators . Quality & Quantity , 44 , 849 – 864 .
   Google Scholar
• Podsakoff , P. M. , MacKenzie , S. B. , Lee , J. Y. , & Podsakoff , P. N. ( 2003 ). Common method bias in behavioral research: A critical review of the literature and recommended remedies . Journal of Applied Psychology , 88 , 879 – 903 .
   PubMed Web of Science ®Google Scholar
• Popper , K. ( 1963 ). Conjectures and refutations . London , UK : Routledge and Keagan Paul .
   Google Scholar
• Posner , D. N. ( 2004 ). Measuring ethnic fractionalization in Africa . American Journal of Political Science , 48 , 849 – 863 .
   Web of Science ®Google Scholar
• Przeworski , A. , Alvarez , M. E. , Cheibub , J. A. , & Limongi , F. ( 2000 ). Democracy and development: Political institutions and well-being in the world, 1950–1990 . New York , NY : Cambridge University Press .
   Google Scholar
• Putnam , R. D. ( 2007 ). E pluribus unum. Diversity and community in the twenty-first century . Scandinavian Political Studies , 30 , 137 – 174 .
   Web of Science ®Google Scholar
• Raykov , T. , & Widaman , K. F. ( 1995 ). Issues in applied structural equation modeling research. Structural Equation Modeling : A Multidisciplinary Journal , 2 , 289 – 318 .
   Web of Science ®Google Scholar
• Reynal-Querol , M. ( 2002 ). Ethnicity, political systems, and civil wars . Journal of Conflict Resolution , 46 , 29 – 54 .
   Web of Science ®Google Scholar
• Sambanis , N. ( 2001 ). Do ethnic and nonethnic civil wars have the same causes? Journal of Conflict Resolution , 45 , 259 – 282 .
   Web of Science ®Google Scholar
• Sambanis , N. ( 2004 ). What is civil war—Conceptual and empirical complexities of an operational definition . Journal of Conflict Resolution , 48 , 814 – 858 .
   Web of Science ®Google Scholar
• Sartori , R. , & Pasini , M. ( 2007 ). Quality and quantity in test validity: How can we be sure that psychological tests measure what they have to? Quality & Quantity , 41 , 359 – 374 .
   Web of Science ®Google Scholar
• Tajfel , H. ( 1982 ). Social psychology of intergroup relations . Annual Review of Psychology , 33 , 1 – 39 .
   Web of Science ®Google Scholar
• Tajfel , H. , & Turner , J. C. ( 1979 ). An integrative theory of intergroup conflict . In W. G. Austin & S. Worchel (Eds.), The social psychology of intergroup relations (pp. 33 – 47 ). Monterey , CA : Brooks/Cole .
   Google Scholar
• Thomas , M. ( 2010 ). What do the worldwide governance indicators measure? European Journal of Development Research , 22 , 31 – 54 .
   Web of Science ®Google Scholar
• Vanhannen , T. ( 2007 ). Measures of democracy 1810–2006 (FSD1289, Version 3.0; 2007-11-15) [computer file]. Tampere, Finland: University of Tampere, Department of Political Science and International Relations.
   Google Scholar
• World Bank. (2008). World development indicators 2008 . Washington , DC : Author.
   Google Scholar
• Weede , E. ( 1996 ). Economic development, social order, and world politics . Boulder , CO : Lynne Rienner .
   Google Scholar
• Weede , E. ( 2005 ). Balance of power, globalization and the capitalistic peace . Berlin , Germany : Liberal Verlag .
   Google Scholar
• Weidmann , N. B. ( 2009 ). Geography as motivation and opportunity: Group concentration and ethnic conflict . Journal of Conflict Resolution , 53 , 526 – 543 .
   Web of Science ®Google Scholar
• Widaman , K. F. ( 1985 ). Hierarchically nested covariance structure models model for multitrait-multimethod data . Applied Psychological Measurement , 10 , 1 – 22 .
   Google Scholar
• Wimmer , A. ( 2002 ). Nationalist exclusion and ethnic conflict: Shadows of modernity . Cambridge , UK : Cambridge University Press .
   Google Scholar
• Wimmer , A. ( 2008 ). The making and unmaking of ethnic boundaries: A multi-level process theory . American Journal of Sociology , 113 , 970 – 1022 .
   Web of Science ®Google Scholar
• Wimmer , A. , Cederman , L.-E. , & Min , B. ( 2009 ). Ethnic politics and armed conflict: A configurational analysis of a new global data set . American Sociological Review , 74 , 316 – 337 .
   Web of Science ®Google Scholar
• You , J.-S. , & Khagram , S. ( 2005 ). A comparative study on inequality and corruption . American Sociological Review , 70 , 136 – 157 .
   Web of Science ®Google Scholar