A preliminary validation of the Regional Proficiency Assessment Tool (RPAT)

References

• Allen, N. J., & Meyer, J. P. (1996). Affective, continuance, and normative commitment to the organization: An examination of construct validity. Journal of Vocational Behavior, 49, 252–276. doi:10.1006/jvbe.1996.0043
   PubMed Web of Science ®Google Scholar
• Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. (2007). Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and Organization Review, 3, 335–371. doi:10.1111/j.1740-8784.2007.00082.x
   Google Scholar
• Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., … Wicherts, J. M. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119. doi:10.1002/per.1919
   Web of Science ®Google Scholar
• Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of a new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9–30. doi:10.1111/1468-2389.00160
   Web of Science ®Google Scholar
• Beeftink, F., Van Eerde, W., Rutte, C. G., & Bertrand, J. W. M. (2012). Being successful in a creative profession: The role of innovative cognitive style, self-regulation, and self-efficacy. Journal of Business Psychology, 27, 71–81. doi:10.1007/s10869-011-9214-9
   PubMed Web of Science ®Google Scholar
• Biernacki, P., & Waldorf, D. (1981). Snowball sampling: Problems and techniques of chain referral sampling. Sociological Methods & Research, 10, 141–163. doi:10.1177/004912418101000205
   Web of Science ®Google Scholar
• Boyce, L. A., & Herd, A. M. (2003). The relationship between gender role stereotypes and requisite military leadership characteristics. Sex Roles, 49(7–8), 365–378. doi:10.1023/A:1025164221364
   Web of Science ®Google Scholar
• Brugman, C., Hughes, M., Maloney, S., Mathis, A., & Pavisic, I. (2013). Assessing regional proficiency: The completion of the RPAT algorithm. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Brugman, C., & Hughes, M. M. (In prep). From contested concept to intricate algorithm: Conceptualizing the Regional Proficiency Assessment Tool for the Department of Defense. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–104.
   PubMed Web of Science ®Google Scholar
• Chairman of the Joint Chiefs of Staff. (2013, January 31). Chairman of the Joint Chiefs of Staff instruction number 3126.01A: Language, regional expertise, and culture (LREC) capability identification, planning, and sourcing. Retrieved from http://www.jcs.mil/Portals/36/Documents/Library/Instructions/3126_01.pdf
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• DeCamp, J., Meadows, S. O., Costa, B., Williams, K. M., Bornmann, J., & Overton, M. (2012). An assessment of the ability of the U.S. Department of Defense and the services to measure and track language and culture training and capabilities among General Purpose Forces. Santa Monica, CA: RAND & MITRE Corporation.
   Google Scholar
• Demerouti, E., Bakker, A. B., Vardakou, I., & Kantas, A. (2003). The convergent validity of two burnout instruments: A multitrait-multimethod analysis. European Journal of Psychological Assessment, 19(1), 12. doi:10.1027//1015-5759.19.1.12
   Web of Science ®Google Scholar
• Furr, R. M., & Bacharach, V. R. (2014). Psychometrics: An introduction (2nd ed.). Los Angeles, CA: Sage.
   Google Scholar
• Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, 17(3), 1–13. Retrieved from http://pareonline.net/pdf/v17n3.pdf
   Google Scholar
• Goodman, L. A. (2011). Comment: On respondent-driven sampling and snowball sampling in hard-to-reach populations and snowball sampling not in hard-to-reach populations. Sociological Methodology, 41, 347–353. doi:10.1111/j.1467-9531.2011.01242.x
   Web of Science ®Google Scholar
• Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003). A very brief measure of the Big-Five personality domains. Journal of Research on Personality, 37, 504–528. doi:10.1016/S0092-6566(03)00046-1
   Web of Science ®Google Scholar
• Hackman, J. R., & Oldham, G. R. (1980). Work redesign. Reading, MA: Addison-Wesley.
   Google Scholar
• Handcock, M. S., & Gile, K. J. (2011). Comment: On the concept of snowball sampling. Sociological Methodology, 41, 367–371. doi:10.1111/j.1467-9531.2011.01243.x
   PubMed Web of Science ®Google Scholar
• Hinkle, D. E., Wiersma, W., & Jurs, S. S. (2003). Applied statistics for the behavioral sciences (5th ed.). Boston, MA: Houghton Mifflin.
   Google Scholar
• Hughes, M. M., Brugman, C., & Paletz, S. B. F. (2014). Refining an assessment of regional proficiency: A refined and revised RPAT algorithm. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Huntington, S. P. (1961). Interservice competition and the political roles of the armed services. American Political Science Review, 55(01), 40–52. doi:10.1017/S0003055400124165
   Google Scholar
• John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102–138). New York, NY: Guilford Press.
   Google Scholar
• Law, K. S., Wong, C.-S., & Mobley, W. H. (1998). Toward a taxonomy of multidimensional constructs. Academy of Management Review, 23, 741–755. doi:10.5465/amr.1998.1255636
   Web of Science ®Google Scholar
• Leung, K., Ang, S., & Tan, M. L. (2014). Intercultural competence. Annual Review of Organizational Psychology and Organizational Behavior, 1, 489–519. doi:10.1146/annurev-orgpsych-031413-091229
   Google Scholar
• Looney, J., Robinson-Kurpius, S. E., & Lucart, L. (2004). Military leadership evaluations: Effects of evaluator sex, leader sex, and gender role attitudes. Consulting Psychology Journal: Practice and Research, 56(2), 104. doi:10.1037/1061-4087.56.2.104
   Google Scholar
• Maddux, W. W., & Galinsky, A. (2009). Cultural borders and mental barriers: The relationship between living abroad and creativity. Journal of Personality and Social Personality, 96, 1047–1061. doi:10.1037/a0014861
   PubMed Web of Science ®Google Scholar
• Matsumoto, D., & Hwang, H. C. (2013). Assessing cross-cultural competence: A review of available tests. Journal of Cross-Cultural Psychology, 44, 849–873. doi:10.1177/0022022113492891
   Web of Science ®Google Scholar
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences form persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749. doi:10.1037/0003-066X.50.9.741
   Web of Science ®Google Scholar
• Miron, E., Erez, M., & Naveh, E. (2004). Do personal characteristics and cultural values that promote innovation, quality, and efficiency compete or complement each other? Journal of Organizational Behavior, 25, 175–199. doi:10.1002/(ISSN)1099-1379
   Web of Science ®Google Scholar
• Miron-Spektor, E., Erez, M., & Naveh, E. (2011). The effect of conformist and attentive-to-detail members on team innovation: Reconciling the innovation paradox. Academy of Management Journal, 54, 740–760. doi:10.5465/amj.2011.64870100
   Web of Science ®Google Scholar
• Mitchell, T. W. (1994). The utility of biodata. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata handbook: Theory, research, and use of biographical information in selection and performance prediction (pp. 485–518). Palo Alto, CA: CPP Books.
   Google Scholar
• Paletz, S. B. F., Hughes, M. M., & Brugman, C. (2014). RPAT face validity report. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Paletz, S. B. F., Hughes, M. M., Brugman, C., & Bunting, M. (2014). Research design for validation of the RPAT. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Paletz, S. B. F., Hughes, M. M., Sumer, A., & Brugman, C. (2016). Supporting regional-proficiency related decisions: The RPAT utility study. College Park, MD: University of Maryland Center for Advanced Study of Language.
   Google Scholar
• Pulakos, E. D., White, L. A., Oppler, S. H., & Borman, W. C. (1989). Examination of race and sex effects on performance ratings. Journal of Applied Psychology, 74(5), 770. Retrieved from http://www.dtic.mil/cgi-bin/GetTRDoc?AD=ADA261035#page=366
   Web of Science ®Google Scholar
• Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212. doi:10.1016/j.jrp.2006.02.001
   Web of Science ®Google Scholar
• Reinhart, G., Maloney, S., Brugman, C., Berens, M., Bloomfield, A., Brecht, R., … Strong, R. (2012). Assessing regional proficiency. College Park, MD: University of Maryland Center for the Advanced Study of Language.
   Google Scholar
• Soto, C. J., & John, O. P. (2017). The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113, 117–143. doi:10.1037/pspp0000096
   PubMed Web of Science ®Google Scholar
• Stokes, G. S., Mumford, M. D., & Owens, W. A. (Eds.). (1994). Biodata handbook: Theory, research, and use of biographical information in selection and performance prediction. Palo Alto, CA: CPP Books.
   Google Scholar
• United States Department of Defense. (2007, June 12). Department of Defense instruction number 5160.70: Management of DoD language and regional proficiency capabilities. Retrieved from http://www.dtic.mil/whs/directives/corres/pdf/516070p.pdf
   Google Scholar
• United States Department of Defense. (2016, December 30). Department of Defense instruction number 5160.70: Management of defense language, regional expertise, and culture (LREC) program. Retrieved from http://www.dtic.mil/whs/directives/corres/pdf/516070_dodi_2016.pdf
   Google Scholar
• Ward, C., Fischer, R., Lam, F. S. Z., & Hall, L. (2009). The convergent, discriminant, and incremental validity of scores on a self-report measure of cultural intelligence. Educational and Psychological Measurement, 69, 85–105. doi:10.1177/0013164408322001
   Web of Science ®Google Scholar
• Wilson, J., Ward, C., & Fischer, R. (2013). Beyond culture learning theory: What can personality tell us about cultural competence? Journal of Cross-Cultural Psychology, 44, 900–927. doi:10.1177/0022022113492889
   Web of Science ®Google Scholar