INVESTIGATING THE ROLE OF RESPONSE FORMAT IN COMPUTER-BASED LECTURE COMPREHENSION TASKS

References

• Aryadoust, V. (2022). The known and unknown about the nature and assessment of L2 listening. International Journal of Listening, 36(2), 69–79. https://doi.org/10.1080/10904018.2022.2042951
   Google Scholar
• Aryadoust, V., & Luo, L. (2022). The typology of second language listening constructs: A systematic review. Language Testing, 40(2), 375–409. https://doi.org/10.1177/02655322221126604
   Web of Science ®Google Scholar
• Badger, R., & Yan, X. (2009). The use of tactics and strategies by Chinese students in the listening component of IELTS. In P. Thompson (Ed.), International English Language Testing System (IELTS) research reports 2009 (Vol. 9, pp. 67–98). British Council and IELTS Australia. Retrieved January , 2021, Available at https://search.informit.com.au/documentSummary;dn=070356543696560;res=IELHSS
   Google Scholar
• Baker, M. (2016). Scientists lift the lid on reproducibility. Nature, 1(7604), 500. https://doi.org/10.1038/533452a
   Google Scholar
• Batty, A. O. (2021). An eye-tracking study of attention to visual cues in L2 listening tests. Language Testing, 38(4), 511–535. https://doi.org/10.1177/0265532220951504
   Web of Science ®Google Scholar
• Buck, G. (2001). Assessing listening. Cambridge University Press.
   Google Scholar
• Chalhoub-Deville, M., & O’Sullivan, B. (2020). Validity theoretical development and integrated arguments. Equinox.
   Google Scholar
• Chang, A. C. S., & Read, J. (2013). Investigating the effects of multiple-choice listening test items in the oral versus written mode on L2 listeners’ performance and perceptions. System, 41(3), 575–586. https://doi.org/10.1016/j.system.2013.06.001
   Web of Science ®Google Scholar
• Cheng, H. (2008). A comparison of multiple-choice and open-ended response formats for the assessment of listening proficiency in English. Foreign Language Annals, 37(4), 544–553. https://doi.org/10.1111/j.1944-9720.2004.tb02421.x
   Google Scholar
• Cheng, L., & Zheng, Y. (2020). Measuring anxiety. In P. Winke & T. Brunfaut (Eds.), The Routledge handbook of second language acquisition and language testing (pp. 177–187). Routledge.
   Google Scholar
• Choi, Y. D. (2022). Validity of score interpretations on an online English placement writing test. Language Testing in Asia, 12(1), 12. https://doi.org/10.1186/s40468-022-00187-0
   Google Scholar
• Cobb, T. (2022a) Text Lex Compare v.5 [computer program]. https://www.lextutor.ca/cgi-bin/tl_compare/
   Google Scholar
• Cobb, T. (2022b) Web vocabprofile [computer program]. http://www.lextutor.ca/vp/
   Google Scholar
• Cohen, A. D. (2011). Strategies in learning and using a second language. Routledge.
   Google Scholar
• Cohen, A. D., & Upton, T. A. (2006). Strategies in responding to the new TOEFL reading tasks. ETS Research Report Series, 2006(1), i–162. https://doi.org/10.1002/j.2333-8504.2006.tb02012.x
   Google Scholar
• Coniam, D. (2006). Evaluating computer-based and paper-based versions of an English-language listening test. ReCALL, 18(2), 193–211. https://doi.org/10.1017/S0958344006000425
   Google Scholar
• Crossley, S. A., Clevinger, A., & Kim, Y. (2014). The role of lexical properties and cohesive devices in text integration and their effect on human ratings of speaking proficiency. Language Assessment Quarterly, 11(3), 250–270. https://doi.org/10.1080/15434303.2014.926905
   Web of Science ®Google Scholar
• Crossley, S. A., & Kim, Y. (2019). Text integration and speaking proficiency: Linguistic, individual differences, and strategy use considerations. Language Assessment Quarterly, 16(2), 217–235. https://doi.org/10.1080/15434303.2019.1628239
   Web of Science ®Google Scholar
• Cumming, A., Kantor, R., Baba, K., Eouanzoui, K., Erdosy, U., & Jamse, M. (2005). Analysis of discourse features and verification of scoring levels for independent and integrated prototype written tasks for the new TOEFL®. ETS Research Report Series, 2005(1), i–77. https://doi.org/10.1002/j.2333-8504.2005.tb01990.x
   Google Scholar
• Field, J. (2012). The cognitive validity of the lecture-based question in the IELTS listening paper. In L. Taylor & C. Weir (Eds.), IELTS collected paper 2: Research in reading and listening assessment (pp. 391–453). Cambridge University Press.
   Google Scholar
• Field, J. (2019). Rethinking the second language listening test from theory to practice. Equinox.
   Google Scholar
• Freeman, R. B., & Huang, W. (2014). Collaboration: Strength in diversity. Nature, 513(7518), 305–305. https://doi.org/10.1038/513305a
   PubMed Web of Science ®Google Scholar
• Frost, K., Wigglesworth, G., & Clothier, J. (2021). Relationships between comprehension, strategic behaviours and content-related aspects of test performances in integrated speaking tasks. Language Assessment Quarterly, 18(2), 133–153. https://doi.org/10.1080/15434303.2020.1835918
   Web of Science ®Google Scholar
• He, L., & Jiang, Z. (2020). Assessing second language listening over the past twenty years: A review within the socio-cognitive framework. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.02123
   PubMed Web of Science ®Google Scholar
• Holzknecht, F. (2019). Double Play in Listening Assessment [ Doctoral Thesis]. Lancaster University. https://doi.org/10.17635/lancaster/thesis/812
   Google Scholar
• Holzknecht, F., McCray, G., Eberharter, K., Kremmel, B., Zehentner, M., Spiby, R., & Dunlea, J. (2020). The effect of response order on candidate viewing behaviour and item difficulty in a multiple-choice listening test. Language Testing, 38(1), 41–61. https://doi.org/10.1177/0265532220917316
   Web of Science ®Google Scholar
• Huang, H. T. D., & Hung, S. T. A. (2013). Comparing the effects of test anxiety on independent and integrated speaking test performance. TESOL Quarterly, 47(2), 244–269. https://doi.org/10.1002/tesq.69
   Google Scholar
• Huang, H. T. D., Hung, S. T. A., & Hong, H. T. V. (2016). Test-taker characteristics and integrated speaking test performance: A path-analytic study. Language Assessment Quarterly, 13(4), 283–301. https://doi.org/10.1080/15434303.2016.1236111
   Web of Science ®Google Scholar
• Inoue, C. (2013). Task equivalence in speaking tasks. Peter Lang.
   Google Scholar
• Inoue, C., & Lam, D. M. (2021). The effects of extended planning time on candidates’ performance, processes, and strategy use in the lecture listening‐into‐speaking tasks of the TOEFL iBT® test. ETS Research Report Series, 2021(1), 1–32. https://doi.org/10.1002/ets2.12322
   Google Scholar
• Jong, N. (2016). Fluency in second language assessment. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 203–218). Berlin, Boston: De Gruyter Mouton. https://doi.org/10.1515/9781614513827-015
   Google Scholar
• Khabbazbashi, N., Chan, S., & Clark, T. (2022). Towards the new construct of academic English in the digital age. ELT Journal, 77(2), 207–216. https://doi.org/10.1093/elt/ccac010
   Web of Science ®Google Scholar
• Khalifa, H., & Weir, C. J. (2009). Examining reading: Research and practice in assessing second language reading. Cambridge University Press.
   Google Scholar
• Knoch, U., Macqueen, S., & O’Hagan, S. (2014). An investigation of the effect of task type on the discourse produced by students at various score levels in the TOEFL iBT® writing test. ETS Research Report Series, 2014(2), 1–74. https://doi.org/10.1002/ets2.12038
   Google Scholar
• Kormos, J., Brunfaut, T., & Michel, M. (2020). Motivational factors in computer-administered integrated skills tasks: A study of young learners. Language Assessment Quarterly, 17(1), 43–59. https://doi.org/10.1080/15434303.2019.1664551
   Web of Science ®Google Scholar
• Koyama, D., Sun, A., & Ockey, G. (2016). The effects of item preview on video-based multiple- choice listening assessments. Language Learning and Technology, 20(1), 148–165. https://doi.org/10.125/44450
   Web of Science ®Google Scholar
• Lee, S., & Winke, P. (2018). Young learners’ response processes when taking computerized tasks for speaking assessment. Language Testing, 35(2), 239–269. https://doi.org/10.1177/0265532217704009
   Web of Science ®Google Scholar
• Li, C., Chen, C., Wu, M., Kuo, Y.-C., Tseng, Y.-T., Tsai, S.-Y., & Shih, H.-C. (2017). The effects of cultural familiarity and question preview type on the listening comprehension of L2 learners at the secondary level. International Journal of Listening, 31(2), 98–112. https://doi.org/10.1080/10904018.2015.1058165
   Google Scholar
• O’Grady, S. (2023). Adapting multiple-choice comprehension question formats in a test of second language listening comprehension. Language Teaching Research, 27(6), 1431–1455. https://doi.org/10.1177/1362168820985367
   Web of Science ®Google Scholar
• Plakans, L. (2015). Integrated second language writing assessment: Why? what? how? Language and Linguistics Compass, 9(4), 159–167. https://doi.org/10.1111/lnc3.12124
   Google Scholar
• Rodriguez, M. C. (2005). Three options are optimal for multiple‐choice items: A meta‐analysis of 80 years of research. Educational Measurement Issues & Practice, 24(2), 3–13. https://doi.org/10.1111/j.1745-3992.2005.00006.x
   Google Scholar
• Rukthong, A. (2021). MC Listening questions vs. integrated listening-to-summarize tasks: What listening abilities do they assess? System, 97. https://doi.org/10.1016/j.system.2020.102439
   Web of Science ®Google Scholar
• Rukthong, A., & Brunfaut, T. (2020). Is anybody listening? The nature of second language listening in integrated listening-to-summarize tasks. Language Testing, 37(1), 31–53. https://doi.org/10.1177/0265532219871470
   Web of Science ®Google Scholar
• Rupp, A. A., Ferne, T., & Choi, H. (2006). How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing, 23(4), 441–474. https://doi.org/10.1191/0265532206lt337oa
   Google Scholar
• Suvorov, R., & He, S. (2022). Visuals in the assessment and testing of second language listening: A methodological synthesis. International Journal of Listening, 36(2), 80–99. https://doi.org/10.1080/10904018.2021.1941028
   Google Scholar
• Wagner, E. (2018). A comparison of listening performance on tests with scripted or authenticated spoken texts. In G. Ockey & E. Wagner (Eds.), Assessing L2 listening moving toward authenticity (pp. 29–44). John Benjamins
   Google Scholar
• Wagner, E. (2021). Assessing Listening. In G. Fulcher & L. Harding (Eds.), The Routledge handbook of language testing (2nd ed., pp. 223–235). Routledge.
   Google Scholar
• Wagner, E., Liao, Y., & Wagner, S. (2020). Authenticated spoken texts for L2 listening tests. Language Assessment Quarterly, 18(3), 205–227. https://doi.org/10.1080/15434303.2020.1860057
   Web of Science ®Google Scholar
• Weigle, S. C. (2004). Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing, 9(1), 27–55. https://doi.org/10.1016/j.asw.2004.01.002
   Google Scholar
• Weir, C. (2005). Language testing and validation. Palgrave Macmillan.
   Google Scholar
• Wei, W., & Zheng, Y. (2017). An investigation of integrative and independent listening test tasks in a computerised academic English test. Computer Assisted Language Learning, 30(8), 864–883. https://doi.org/10.1080/09588221.2017.1373131
   Web of Science ®Google Scholar
• Westbrook, C. (2023). The impact of input format on written performance in a listening-into-writing assessment. Journal of English for Academic Purposes, 61. https://doi.org/10.1016/j.jeap.2022.101190
   Web of Science ®Google Scholar
• Yanagawa, K., & Green, A. (2008). To show or not to show: The effects of item stems and answer options on performance on a multiple-choice listening comprehension test. System, 36(1), 107–122. https://doi.org/10.1016/j.system.2007.12.003
   Web of Science ®Google Scholar
• Yeager, R., & Meyer, Z. (2022). Question preview in English for academic purposes listening assessment: The effect of stem preview on difficulty, item type, and discrimination. International Journal of Listening, 36(3), 299–324. https://doi.org/10.1080/10904018.2022.2029705
   Google Scholar
• Yeom, S. (2016). The effects of presentation mode and item type on L2 learners’ listening test performance and perception. English Teaching, 71(4), 27–54. https://doi.org/10.15858/engtea.71.4.201612.27
   Google Scholar
• Zechner, K., & Evanini, K. (2020). Automated speaking assessment using language technologies to score spontaneous speech. Routledge.
   Google Scholar