One size fits all? The limitations of standardised assessment in critical thinking

References

• Abrami, P. C., R. M. Bernard, E. Borokhovski, A. Wade, M. A. Surkes, R. Tamim, and D. Zhang. 2008. “Instructional Interventions Affecting Critical Thinking Skills and Dispositions: A Stage 1 Meta-Analysis.” Review of Educational Research 78 (4):1102–34.
   Web of Science ®Google Scholar
• Anderson, L., and D. Krathwohl. 2001. A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. New York: Longman.
   Google Scholar
• Association of American Colleges and Universities. 2011. The LEAP Vision for Learning: Outcomes, Practices, Impact, and Employers’ View. Washington, DC: Author.
   Google Scholar
• Bailin, S. 2002. “Critical Thinking and Science and Education.” Science and Education 11 (4):361–75.
   Google Scholar
• Bailin, S., R. Case, J. R. Coombs, and L. B. Daniels. 1999. “Conceptualizing Critical Thinking.” Journal of Curriculum Studies 31 (3):285–302.
   Web of Science ®Google Scholar
• Barnet, S., and H. Bedau. 2011. Critical Thinking, Reading, and Writing: A Brief Guide to Argument. 7th ed. Boston, MA: Bedford.
   Google Scholar
• Bernard, R., D. Zhang, P. Abrami, F. Sicoly, E. Borokhovski, and M. Surkes. 2008. “Exploring the Structure of the Watson–Glaser Critical Thinking Appraisal: One Scale or Many Subscales?” Thinking Skills and Creativity 3 (1):15–22.
   Web of Science ®Google Scholar
• Bloom, B. 1956. Taxonomy of Educational Objectives: The Classification of Educational Goals. Handbook 1: Cognitive Domain. New York: McKay.
   Google Scholar
• California Critical Thinking Skills Test Homepage. Accessed 12 August 2018.https://www.insightassessment.com/Products/Products-Summary/Critical-Thinking-Skills-Tests/California-Critical-Thinking-Skills-Test-CCTST
   Google Scholar
• Davies, M. 2016. “What is Critical Thinking? And Do Universities Really Teach It?” The Conversation, November 2016. Accessed 9 April 2018. http://theconversation.com/what-is-critical-thinking-and-do-universities-really-teach-it-69046
   Google Scholar
• Dewey, J. 1909, 1998. How We Think. Mineola, NY: Dover Publications.
   Google Scholar
• Ennis, R. H. 1985. “A Logical Basis for Measuring Critical Thinking Skills.” Educational Leadership 43 (2):44–8.
   Web of Science ®Google Scholar
• Ennis, R. H. 1987. “A Taxonomy of Critical Thinking Dispositions and Abilities.” In Teaching Thinking Skills: Theory and Practice, edited by J. Baron and R.J. Sternberg, 9–26. New York: W. H. Freeman and Company
   Google Scholar
• Ennis, R. H. 1989. “Critical Thinking and Subject Specificity: Clarification and Needed Research.” Educational Researcher 18 (3):4–10.
   Google Scholar
• Ennis, R. H. 2005. Supplement to the Test/Manual Entitled the Ennis–Weir Critical Thinking Essay Test. Urbana: Department of Educational Policy Studies, University of Illinois at Urbana–Champaign.
   Google Scholar
• Ennis, R. H., and E. Weir. 1985. The Ennis–Weir Critical Thinking Essay Test. Pacific Grove, CA: Midwest Publications.
   Google Scholar
• Ennis, R. H., J. Millman, and T. N. Tomko. 1985. Cornell Critical Thinking Tests. Pacific Grove, CA: Midwest Publications.
   Google Scholar
• Facione, P. A. 1990a. The California Critical Thinking Skills Test-College Level. Technical report #2. Factors Predictive of CT Skills. Millbrae, CA: California Academic Press.
   Google Scholar
• Facione, P. A. 1990b. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instructions. Research Findings and Recommendations. Millbrae, CA: California Academic Press.
   Google Scholar
• Facione, P. A., and N. C. Facione. 1992. The California Critical Thinking Dispositions Inventory. Millbrae, CA: California Academic Press.
   Google Scholar
• Facione, P. A. 2000. “The Disposition toward Critical Thinking: Its Character, Measurement, and Relation to Critical Thinking Skill.” Informal Logic 20 (1):61–84.
   Google Scholar
• Gellin, A. 2003. “The Effect of Undergraduate Student Involvement on Critical Thinking: A Meta-Analysis of the Literature 1991–2000.” Journal of College Student Development 44 (6):746–62.
   Web of Science ®Google Scholar
• Halpern, D. F. 1998. “Teaching Critical Thinking for Transfer across Domains: Dispositions, Skills, Structure Training, and Metacognitive Monitoring.” American Psychologist 53 (4):449–55.
   PubMed Web of Science ®Google Scholar
• Halpern, D. F. 2007. Halpern Critical Thinking Assessment Using Everyday Situations: Background and Scoring Standards. Claremont, CA: Claremont McKenna College.
   Google Scholar
• Halpern Critical Thinking Assessment homepage 2018. Accessed 12 August 2018. https://sites.google.com/site/dianehalperncmc/home/research/halpern-critical-thinking-assessment
   Google Scholar
• Hills, G. 1999. From Beggars to Choosers: University Funding for the Future. London: Politeia.
   Google Scholar
• Jankowski, N., J. Timmer, J. Kinzie, and G. Kuh. 2018. Assessment That Matters: Trending toward Practices That Document Authentic Student Learning. Urbana, IL: National Institute for Learning Outcomes Assessment.
   Google Scholar
• Ku, K. Y. 2009. “Assessing Students’ Critical Thinking Performance: Urging for Measurements Using Multi-Response Format.” Thinking Skills and Creativity 4 (1):70–6.
   Web of Science ®Google Scholar
• Kuh, G. D., N. Jankowski, S. O. Ikenberry, and J. Kinzie. 2014. Knowing What Students Know and Can Do: The Current State of Student Learning Outcomes Assessment in U.S. Colleges and Universities. Champaign, IL: National Institute for Learning Outcomes Assessment.
   Google Scholar
• Kuncel, N. R. 2011. “Measurement and Meaning of Critical Thinking.” Paper Presented at the National Research Council’s 21st Century Skills Workshop, Irvine, CA, January 6–8.
   Google Scholar
• Lai, E. 2011. Critical Thinking: A Literature Review. Pearson Research Report.
   Google Scholar
• Leppa, C. J. 1997. “Standardized Measures of Critical Thinking: Experience with the California Critical Thinking Tests.” Nurse Education 22 (5):29–33.
   PubMedGoogle Scholar
• Liu, O. L. 2008. Measuring Learning Outcomes in Higher Education Using the Measure of Academic Proficiency and Progress (MAPP) (Research Report No. RR-08-47). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Liu, O. L., L. Frankel, and K. Roohr. 2014. Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment (Research Report No. RR-08-47). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Liu, O. L., L. Mao, L. Frankel, and J. Xu. 2016. “Assessing Critical Thinking in Higher Education: The HEIghten™ Approach and Preliminary Validity Evidence.” Assessment & Evaluation in Higher Education 41 (5):677–94.
   Web of Science ®Google Scholar
• Loo, R., and K. Thorpe. 1999. “A Psychometric Investigation of Scores on the Watson-Glaser Critical Thinking Appraisal New Forms.” Educational and Psychological Measurement 59 (6):995–1003.
   Web of Science ®Google Scholar
• Macpherson, R., and K. E. Stanovich. 2007. “Cognitive Ability, Thinking Dispositions, and Instructional Set as Predictors of Critical Thinking.” Learning and Individual Differences 17 (2):115–27.
   Web of Science ®Google Scholar
• McMillan, J. H. 1987. “Enhancing College Students’ Critical Thinking: A Review of Studies.” Research in Higher Education 26 (1):3–29.
   Web of Science ®Google Scholar
• McPeck. J. E. 1981. Critical Thinking and Education. New York: St Martin’s Press.
   Google Scholar
• McPeck, J. E. 1990. “Critical Thinking and Subject Specificity: A Reply to Ennis.” Educational Researcher 19 (4):10–2.
   Google Scholar
• Moore, T. 2011. Critical Thinking and language: The Challenge of Generic Skills and Disciplinary Discourse. London: Bloomsbury.
   Google Scholar
• Nichols, S. L., G. V. Glass, and D. C. Berliner. 2006. “High-Stakes Testing and Student Achievement: Does Accountability Pressure Increase Student Learning?” Education Policy Analysis Archives 14:1–9. [online]. Accessed April 2018. http://hub.mspnet.org/index.cfm/12605
   Google Scholar
• Nickerson, R. S. 1988. “On Improving Thinking through Instruction.” Review of Research in Education 15:3–57.
   Web of Science ®Google Scholar
• Norris, S. P. 1989. “Can We Test Validly for Critical Thinking?” Educational Researcher 18 (9):21–6.
   Google Scholar
• O’Hare, L., and C. McGuinness. 2015. “The Validity of Critical Thinking Tests for Predicting Degree Performance: A Longitudinal Study.” International Journal of Educational Research 72:162–72.
   Web of Science ®Google Scholar
• Osborn, M. 2006. “Changing the Context of Teachers’ Work and Professional Development: A European Perspective.” International Journal of Educational Research 45 (4-5):242–53.
   Google Scholar
• Pascarella, E. T., and P. T. Terenzini. 2005. How College Affects Students: A Third Decade of Research. San Francisco: Jossey-Bass.
   Google Scholar
• Paul, R. 1992. “Critical Thinking: What, Why, and How?” New Directions for Community Colleges 1992 (77):3–24.
   Google Scholar
• Paul, R., and L. Elder. 2009. Critical Thinking: Concepts & Tools. Dillon Beach, CA: The Foundation for Critical Thinking.
   Google Scholar
• Perkins, D., E. Jay, and S. Tishman. 1993. “Beyond Abilities: A Dispositional Theory of Thinking.” Merrill-Palmer Quarterly 39 (1):1–21.
   Web of Science ®Google Scholar
• Ralston, P., and C. Bays. 2015. “Critical Thinking Development in Undergraduate Engineering Students: From Freshman through Senior Year: A 3-Cohort Longitudinal Study.” American Journal of Engineering Education (AJEE) 6 (2):85–98.
   Google Scholar
• Renaud, R., and H. Murray. 2008. “A Comparison of a Subject-Specific and a General Measure of Critical Thinking.” Thinking Skills and Creativity 3 (2):85–93.
   Web of Science ®Google Scholar
• Siller, T. 2001. “Sustainability and Critical Thinking in Civil Engineering Curriculum.” Journal of Professional Issues in Engineering Education and Practice 127 (3):104–8.
   Web of Science ®Google Scholar
• Taube, K. T. 1997. “Critical Thinking Ability and Disposition as Factors of Performance on a Written Critical Thinking Test.” Journal of General Education 46:129–64.
   Google Scholar
• Van Gelder, T. 2005. “Teaching Critical Thinking: Some Lessons from Cognitive Science.” College Teaching 53 (1):41–8.
   Google Scholar
• Watson, G., and E. M. Glaser. 1980. Watson–Glaser Critical Thinking Appraisal, Forms A and B Manual. San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Williams, R. L., R. Oliver, and S. Stockdale. 2004. “Psychological versus Generic Critical Thinking as Predictors and Outcome Measures in a Large Undergraduate Human Development Course.” Journal of General Education 53 (1):37–58.
   Google Scholar