Exploring the Relationships Between Independent Listening and Listening-Reading-Writing Tasks in Chinese Language Testing: Toward a Better Understanding of the Construct Underlying Integrated Writing Tasks

References

• Alderson, J. C. (2000). Assessing reading. New York, NY: Cambridge University Press.
   Google Scholar
• Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy of educational objectives. New York, NY: Longman.
   Google Scholar
• Asención, Y. (2004). Validation of reading-to-write assessment tasks performed by second language learners ( Unpublished doctoral dissertation). Northern Arizona University, Flagstaff, AZ.
   Google Scholar
• Barkaoui, K., Brooks, L., Swain, M., & Lapkin, S. (2013). Test-takers’ strategic behaviors in independent and integrated speaking tasks. Applied Linguistics, 34(3), 304–324. doi:10.1093/applin/ams046
   Web of Science ®Google Scholar
• Bartlett, M. S. (1954). A note on the multiplying factors for various X2 approximations in factor analysis. Journal of the Royal Statistical Society, 16(2), 296–298.
   Google Scholar
• Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability (formerly: Journal of Personnel Evaluation in Education), 21(1), 5–31. doi:10.1007/s11092-008-9068-5
   Web of Science ®Google Scholar
• Bloom, B. (1956). Taxonomy of educational objectives (Handbook I: The cognitive domain). New York, NY: David McKay.
   Google Scholar
• Brown, A., Iwashita, N., & McNamara, T. (2005). An examination of rater orientations and test-taker performance on English-for-Academic-Purposes speaking tasks. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Brown, G. (1995). Speakers, listeners and communication. New York, NY: Cambridge University Press.
   Google Scholar
• Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
   Google Scholar
• Buck, G. (2001). Assessing listening. New York, NY: Cambridge University Press.
   Google Scholar
• Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, application, and programming. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Cho, Y. (2003). Assessing writing: Are we bound by only one method? Assessing Writing, 8(3), 165–191. doi:10.1016/S1075-2935(03)00018-7
   Google Scholar
• Cook, V. J. (2010). The relationship between first and second language acquisition revisited. In E. Macaro (Ed.), The continuum companion to second language acquisition (pp. 137–157). London, UK: Continuum.
   Google Scholar
• Cumming, A. (2013). Assessing integrated writing tasks for academic purposes: Promises and perils. Language Assessment Quarterly, 10(1), 1–8. doi:10.1080/15434303.2011.622016
   Web of Science ®Google Scholar
• Cumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M. (2005). Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing, 10(1), 5–43. doi:10.1016/j.asw.2005.02.001
   Google Scholar
• DeVellis, R. F. (2003). Scale development: Theory and applications. Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Esmaeili, H. (2002). Integrated reading and writing tasks and ESL students’ reading and writing performance in an English language test. Canadian Modern Language Review, 58(4), 599–622. doi:10.3138/cmlr.58.4.599
   Web of Science ®Google Scholar
• Ferguson, E. (2001). Personality and coping traits: A joint factor analysis. British Journal of Health Psychology, 6(4), 311–325. doi:10.1348/135910701169232
   PubMed Web of Science ®Google Scholar
• Frost, K., Elder, C., & Wigglesworth, G. (2011). Investigating the validity of an integrated listening-speaking task: A discourse-based analysis of test-takers’ oral performances. Language Testing, 29(3), 345–369. doi:10.1177/0265532211424479
   Web of Science ®Google Scholar
• Gebril, A. (2006). Independent and integrated academic writing tasks: A study in generalizability and test method ( Unpublished doctoral dissertation). The University of Iowa, Iowa City, IA.
   Google Scholar
• Gebril, A. (2009). Score generalizability of academic writing tasks: Does one test method fit it all? Language Testing, 26(4), 507–531. doi:10.1177/0265532209340188
   Web of Science ®Google Scholar
• Gebril, A. (2010). Bringing reading-to-write and writing-only assessment tasks together: A generalizability analysis. Assessing Writing, 15(2), 100–117. doi:10.1016/j.asw.2010.05.002
   Google Scholar
• Gebril, A., & Plakans, L. (2009). Investigating source use, discourse features, and process in integrated writing tests. Spaan Fellow Working Papers in Second or Foreign Language Assessment, 7, 47–84.
   Google Scholar
• Gebril, A., & Plakans, L. (2013). Toward a transparent construct of reading-to-write tasks: The interface between discourse features and proficiency. Language Assessment Quarterly, 10(1), 9–27. doi:10.1080/15434303.2011.642040
   Web of Science ®Google Scholar
• Grabe, W. (1991). Current developments in second-language reading research. TESOL Quarterly, 25(3), 375–406. doi:10.2307/3586977
   Web of Science ®Google Scholar
• Guo, L., Crossley, S. A., & McNamara, D. S. (2013). Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study. Assessing Writing, 18(3), 218–238. doi:10.1016/j.asw.2013.05.002
   Web of Science ®Google Scholar
• Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Hong Kong Curriculum Development Committee. (1975). Provisional syllabus for Chinese Language (Form I-V). Hong Kong, PRC: Government Printer.
   Google Scholar
• Hong Kong Curriculum Development Council & Hong Kong Examinations and Assessment Authority (HKCDC & HKEAA). (2007). Chinese Language curriculum and assessment guide (Secondary 4 – 6). Hong Kong, PRC: HKCDC & HKEAA. Retrieved from http://www.edb.gov.hk/attachment/tc/curriculum-development/kla/chi-edu/chi_lang_final_5805.pdf
   Google Scholar
• Hong Kong Curriculum Development Council (HKCDC). (1990). Syllabus for Chinese Language (Secondary 1–5). Hong Kong, PRC: Government Printer. Retrieved from http://www.edb.gov.hk/attachment/tc/curriculum-development/kla/chi-edu/ChiSyl_1990.pdf
   Google Scholar
• Hong Kong Curriculum Development Council (HKCDC). (2001a). Chinese Language curriculum guide (Secondary1-7). Hong Kong, PRC: Education and Manpower Bureau.
   Google Scholar
• Hong Kong Curriculum Development Council (HKCDC). (2001b). Learning to learn - the way forward in curriculum. Hong Kong, PRC: Government Printer. Retrieved from http://www.edb.gov.hk/tc/curriculum-development/cs-curriculum-doc-report/wf-in-cur/index.html
   Google Scholar
• Hong Kong Examinations and Assessment Authority (HKEAA). (2005). HKCEE Chinese Language level descriptors and exemplars for standards-referenced assessment. Hong Kong, PRC: HKEAA.
   Google Scholar
• Hong Kong Examinations and Assessment Authority (HKEAA). (2012). Hong Kong diploma of secondary education examination revised assessment framework for category A subjects (Chinese Language). Hong Kong: HKEAA. Retrieved from http://www.hkeaa.edu.hk/DocLibrary/HKDSE/Subject_Information/chi_lang/2013hkdse-clang.pdf
   Google Scholar
• Kaiser, H. (1970). A second generation little jiffy. Psychometrika, 35(4), 401–415. doi:10.1007/BF02291817
   Web of Science ®Google Scholar
• Kaiser, H. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. doi:10.1007/BF02291575
   Web of Science ®Google Scholar
• Kaufman, A. S., Ishikuma, T., & Kaufman, N. L. (1994). A Horn analysis of the factors measured by the WAIS-R, Kaufman Adolescent and Adult Intelligence Test (KAIT), and two new brief cognitive measures for normal adolescents and adults. Assessment, 1(4), 353–366.
   Google Scholar
• Kline, R. B. (2005). Principles and practice of structural equation modeling. New York, NY: Guilford Press.
   Google Scholar
• Knoch, U., & Sitajalabhorn, W. (2013). A closer look at integrated writing tasks: Towards a more focussed definition for assessment purposes. Assessing Writing, 18(4), 300–308. doi:10.1016/j.asw.2013.09.003
   Web of Science ®Google Scholar
• Lee, Y. W. (2006). Dependability of scores for a new ESL speaking assessment consisting of integrated and independent tasks. Language Testing, 23(2), 131–166. doi:10.1191/0265532206lt325oa
   Google Scholar
• Lewkowicz, J. (1994, December). Writing from sources: Does source material help or hinder students’ performance. Paper presented at the Annual International Language in Education Conference, Hong Kong, PRC (ERIC Document Reproduction Service No. ED386050).
   Google Scholar
• McCrae, R. R. (1989). Why I advocate the five-factor model: Joint factor analyses of the NEO-PI with other instruments. In D. M. Buss, & N. Cantor (Eds.), Personality psychology: Recent trends and emerging directions (pp. 237–245). New York, NY: Springer.
   Google Scholar
• McGhee, R. (1993). Fluid and crystallized intelligence: Confirmatory factor analysis of the Differential Abilities Scale, Detroit Tests of Learning Aptitude-3, and Woodcock-Johnson Psycho-Educational Battery - Revised. Journal of Psychoeducational Assessment Monograph Series: Woodcock Johnson Psychoeducational Battery - Revised, 20–38. Brandon, VT: Clinical Psychology Publishing.
   Google Scholar
• Oxford, R. L. (1990). Language learning strategies: What every language teacher should know. New York, NY: Newbury House /HarperCollins.
   Google Scholar
• Peverly, S. T., Ramaswamy, V., Brown, C., Sumowski, J., Alidoost, M., & Garner, J. (2007). What predicts skill in lecture note taking? Journal of Educational Psychology, 99(1), 167–180. doi:10.1037/0022-0663.99.1.167
   Web of Science ®Google Scholar
• Plakans, L. (2008). Comparing composing processes in writing-only and reading-to-write test tasks. Assessing Writing, 13(2), 111–129. doi:10.1016/j.asw.2008.07.001
   Google Scholar
• Plakans, L. (2009a). The role of reading strategies in integrated L2 writing tasks. Journal of English for Academic Purposes, 8(4), 252–266. doi:10.1016/j.jeap.2009.05.001
   Google Scholar
• Plakans, L. (2009b). Discourse synthesis in integrated second language writing assessment. Language Testing, 26(4), 561–587. doi:10.1177/0265532209340192
   Web of Science ®Google Scholar
• Plakans, L., & Gebril, A. (2012). A close investigation into source use in integrated second language writing tasks. Assessing Writing, 17(1), 18–34. doi:10.1016/j.asw.2011.09.002
   Google Scholar
• Plakans, L., & Gebril, A. (2013). Using multiple texts in an integrated writing assessment: Source text use as a predictor of score. Journal of Second Language Writing, 22(3), 217–230. doi:10.1016/j.jslw.2013.02.003
   Web of Science ®Google Scholar
• Purpura, J. (1999). Strategy use and second language test performance: A structural equation modeling approach. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Purpura, J. E. (1997). An analysis of the relationships between test-takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47(2), 289–325. doi:10.1111/0023-8333.91997009
   Web of Science ®Google Scholar
• Purpura, J. E. (1998). Investigating the effects of strategy use and second language test performance with high- and low-ability test-takers: A structural equation modelling approach. Language Testing, 15(3), 333–379.
   Google Scholar
• Purpura, J. E. (2013). Cognition and language assessment. In A. J. Kunnan (Ed.), The companion to language assessment (pp. 1452–1476). Hoboken, NJ: Wiley/Blackwell.
   Google Scholar
• Read, J. (1990). Providing relevant content in an EAP writing test. English for Specific Purposes, 9(2), 109–121. doi:10.1016/0889-4906(90)90002-T
   Google Scholar
• Sawaki, Y., Quinlan, T., & Lee, Y. W. (2013). Understanding learner strengths and weaknesses: Assessing performance on an integrated writing task. Language Assessment Quarterly, 10(1), 73–95. doi:10.1080/15434303.2011.633305
   Web of Science ®Google Scholar
• Sawaki, Y., Stricker, L. J., & Oranje, A. H. (2009). Factor structure of the TOEFL Internet-based test. Language Testing, 26(1), 005–030. doi:10.1177/0265532208097335
   Web of Science ®Google Scholar
• Spivey, N. N. (1997). The constructivist metaphor: Reading, writing, and the making of meaning. New York, NY: Academic Press.
   Google Scholar
• Stark, K. D., & Laurent, J. (2001). Joint factor analysis of the children’s depression inventory and the revised children’s manifest anxiety scale. Journal of Clinical Child & Adolescent Psychology, 30(4), 552–567. doi:10.1207/S15374424JCCP3004_11
   Web of Science ®Google Scholar
• Tabachnick, B., & Fidell, L. (2013). Using multivariate statistics (6th ed.). Harlow, UK: Pearson Education.
   Google Scholar
• Taylor, S. (1996). Nature and measurement of anxiety sensitivity: Reply to Lilienfeld, Turner, and Jacob (1996). Journal of Anxiety Disorders, 10(5), 425–451. doi:10.1016/0887-6185(96)00021-7
   Web of Science ®Google Scholar
• Tse, S. K. (2009). Chinese Language education in Hong Kong: Twenty five years of educational research in Hong Kong. Educational Research Journal, 24(2), 231–255.
   Google Scholar
• van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York, NY: Academic Press.
   Google Scholar
• van Gelderen, A., Schoonen, R., De Glopper, K., Hulstijn, J., Simis, A., Snellings, P., & Ste-venson, M. (2004). Linguistic knowledge, processing speed, and metacognitive knowl-edge in first- and second-language reading comprehension: A componential analysis. Journal of Educational Psychology, 96(1), 19–30. doi:10.1037/0022-0663.96.1.19
   Web of Science ®Google Scholar
• Vandergrift, L. (1999). Facilitating second language listening comprehension: Acquiring successful strategies. ELT Journal, 53(3), 168–176. doi:10.1093/elt/53.3.168
   Google Scholar
• Watanabe, Y. (2001). Read-to-write tasks for the assessment of second language academic writing skills: Investigating text features and rater reactions ( Unpublished doctoral dissertation). University of Hawaii, Manoa, HI.
   Google Scholar
• Weigle, S. C. (2002). Assessing writing. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Weigle, S. C. (2004). Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing, 9(1), 27–55. doi:10.1016/j.asw.2004.01.002
   Google Scholar
• Weir, C. (1993). Understanding and developing language tests. Hemel Hempstead, UK: Prentice-Hall.
   Google Scholar
• Wolfersberger, M. (2013). Refining the construct of classroom-based writing-from-readings assessment: The role of task representation. Language Assessment Quarterly, 10(1), 49–72. doi:10.1080/15434303.2012.750661
   Web of Science ®Google Scholar
• Yang, H. (2009). Exploring the complexity of second language writers’ strategy use and performance on an integrated writing test through structural equation modeling and qualitative approaches (Doctoral dissertation). The University of Texas, Austin, TX. Retrieved from http://repositories.lib.utexas.edu/handle/2152/6619
   Google Scholar
• Yang, H. C., & Plakans, L. (2012). Second language writers’ strategy use and performance on an integrated reading‐listening‐writing task. TESOL Quarterly, 46(1), 80–103. doi:10.1002/tesq.6
   Web of Science ®Google Scholar
• Yu, G. (2013a). The use of summarization tasks: Some lexical and conceptual analyses. Language Assessment Quarterly, 10(1), 96–109. doi:10.1080/15434303.2012.750659
   Web of Science ®Google Scholar
• Yu, G. (2013b). From integrative to integrated language assessment: Are we there yet? Language Assessment Quarterly, 10(1), 110–114. doi:10.1080/15434303.2013.766744
   Web of Science ®Google Scholar
• Zhu, X. (2005). A study of setting standards of Chinese Language assessment in reading, writing and integrated skills. Technical Report (unpublished). Project No: CD/C/13-0309. Commissioned by Education and Manpower Bureau, HKSAR. Singapore: National Institute of Education, Nanyang Technological University.
   Google Scholar
• Zhu, X. (2012). Performance of Putonghua listening skills of secondary school students in Hong Kong. In S. D. Chan (Ed.), A study on Putonghua proficiency test for secondary school students (pp. 59–108). Hong Kong, PRC: Chung Hwa Book Co.
   Google Scholar
• Zhu, X. (2013). Research and development project on developing students’ language competency in the integrative use of language skills and strategies in Chinese Language education at the secondary level. Technical Report (unpublished). Project No: CD/CLE/73-1106. Commissioned by Education Bureau, HKSAR. Hong Kong: The Hong Kong Polytechnic University.
   Google Scholar
• Zhu, X. (2014). Assessment for learning: Principles and strategies. Beijing, PRC: People’s Education Press.
   Google Scholar
• Zhu, X. (2015). Implementing integrated testing of Chinese Language in Hong Kong secondary schools: The current situation and improvement strategies. Educational Research, 36(5), 114–121.
   Google Scholar
• Zhu, X., & Wu, Y. L. (2013). Secondary school students’ difficulties and learning expectation in integrated Chinese Language tasks in Hong Kong. Education Journal, 41(1–2), 27–45.
   Google Scholar
• Zhu, X., & Wu, Y. L. (2014). Strategies for secondary students to overcome difficulties of completing integrated writing tasks in Chinese Language. In A. D. Zhang (Ed.), Effective teaching and joyful learning (III) (pp. 21–34). Singapore, Singapore: Pearson Education.
   Google Scholar