The Development and Initial Validation of O-WSVLT, a Meaning-Recall Online L2 Spanish Vocabulary Levels Test

References

• Alderson, J. C. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment. Continuum.
   Google Scholar
• Baker, F. B. (2001). The basics of item response theory (2nd ed.). ERIC clearinghouse on assessment and evaluation. https://edres.org/irt/baker/
   Google Scholar
• Beavers, A. S., Lounsbury, J. W., Richards, J. K., Huck, S. W., Skolits, G. J., & Esquivel, S. L. (2013). Practical considerations for using exploratory factor analysis in educational research. Practical Assessment, Research & Evaluation, 18(6), 1–13. https://doi.org/10.7275/qv2q-rk76
   Google Scholar
• Beglar, D. (2010). A Rasch-based validation of the vocabulary size test. Language Testing, 27(1), 101–118. https://doi.org/10.1177/0265532209340194
   Web of Science ®Google Scholar
• Bond, T. G., Yan, Z., & Heene, M. (2020). Applying the Rasch model: Fundamental measurement in the human sciences (4th ed.). Routledge.
   Google Scholar
• Borsboom, D., Mellenbaugh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111(4), 1061–1071. https://doi.org/10.1037/0033-295X.111.4.1061
   PubMed Web of Science ®Google Scholar
• Brown, D., Stoeckel, T., McLean, S., & Stewart, J. (2022). The most appropriate lexical unit for L2 vocabulary research and pedagogy: A brief review of the evidence. Applied Linguistics, 43(3), 596–602. https://doi.org/10.1093/applin/amaa061
   Web of Science ®Google Scholar
• Brysbaert, M., Keuleers, E., & Mandera, P. (2021). Which words do English non-native speakers know? New supernational levels based on yes/no decision. Second Language Research, 37(2), 207–231. https://doi.org/10.1177/0267658320934526
   Web of Science ®Google Scholar
• Chandler, P. (2021). New vocabulary levels test for L2 Spanish. In J. Barcroft & J. Muñoz-Basols (Eds.), Spanish vocabulary learning in meaning-oriented instruction (pp. 150–170). Routledge.
   Google Scholar
• Davies, M. (2002). Corpus del Español. http://www.corpusdelespanol.org
   Google Scholar
• Davies, M., & Hayward Davies, K. (2017). A frequency dictionary of Spanish: Core vocabulary for learners (2nd ed.). Routledge.
   Google Scholar
• de Ayala, R. J. (2009). The theory and practice of item response theory. The Guilford Press.
   Google Scholar
• De Wilde, V. (2023). The auditory picture vocabulary test for English L2: A spoken receptive meaning-recognition test intended for Dutch-speaking L2 learners of english. Language Teaching Research, 136216882211474. Advanced Online Publication. https://doi.org/10.1177/13621688221147462
   Web of Science ®Google Scholar
• Dóczi, B., & Kormos, J. (2016). Longitudinal developments in vocabulary knowledge and lexical organization. Oxford University Press.
   Google Scholar
• Ellis, N. C. (2006). Cognitive perspectives on SLA: The associative-cognitive CREED. AILA Review, 19(1), 100–121. https://doi.org/10.1075/aila.19.08ell
   Google Scholar
• Grabe, W., & Stoller, F. L. (2020). Teaching and researching reading (3rd ed.). Routledge.
   Google Scholar
• Gyllstad, H., McLean, S., & Stewart, J. (2021). Using confidence intervals to determine adequate item sample sizes for vocabulary tests: An essential but overlooked practice. Language Testing, 38(4), 558–579. https://doi.org/10.1177/0265532220979562
   Web of Science ®Google Scholar
• Gyllstad, H., Vilkaitė, L., & Schmitt, N. (2015). Assessing vocabulary size through multiple- choice formats: Issues with guessing and sampling rates. International Journal of Applied Linguistics (ITL), 166(2), 278–306. https://doi.org/10.1075/itl.166.2.04gyl
   Google Scholar
• Hashimoto, B. J. (2021). Is frequency enough?: The frequency model in vocabulary size testing. Language Assessment Quarterly, 18(2), 171–187. https://doi.org/10.1080/15434303.2020.1860058
   Web of Science ®Google Scholar
• Hashimoto, B. J., & Egbert, J. (2019). More than frequency? Exploring predictors of word difficulty for second language learners. Language Learning, 69(4), 839–872. https://doi.org/10.1111/lang.12353
   Web of Science ®Google Scholar
• Herman, E., & Leeser, M. J. (2022). The relationship between lexical coverage and type of reading comprehension in beginning L2 Spanish learners. The Modern Language Journal, 106(1), 284–305. https://doi.org/10.1111/modl.12761
   Web of Science ®Google Scholar
• Institute for Test Research and Test Development. (2013). Vocabulary tests. https://itt-leipzig.de/about-the-vocabulary-tests-2/?lang=en#1505164286869-5364d3b3-8c9f
   Google Scholar
• Izura, C., Cuetos, F., & Brysbaert, M. (2014). Lextale-Esp: A test to rapidly and efficiently assess the Spanish vocabulary size. Psicológica, 35(1), 49–66.
   Web of Science ®Google Scholar
• Kane, M. (2013). The argument-based approach to validation. School Psychology Review, 42(4), 448–457. https://doi.org/10.1080/02796015.2013.12087465
   Web of Science ®Google Scholar
• Kremmel, B. (2016). Word families and frequency bands in vocabulary tests: Challenging conventions. TESOL Quarterly, 50(4), 976–987. https://doi.org/10.1002/tesq.329
   Web of Science ®Google Scholar
• Kremmel, B., & Schmitt, N. (2016). Interpreting vocabulary test scores: What do various item formats tell us about learners’ ability to employ words? Language Assessment Quarterly, 13(4), 377–392. https://doi.org/10.1080/15434303.2016.1237516
   Web of Science ®Google Scholar
• Laufer, B., & Aviad Levitzky, T. (2017). What type of vocabulary knowledge predicts reading comprehension: Word meaning recall or word meaning recognition? The Modern Language Journal, 101(4), 729–741. https://doi.org/10.1111/modl.12431
   Web of Science ®Google Scholar
• Laufer, B., & McLean, S. (2016). Loanwords and vocabulary size test scores: A case of different estimates for different L1 learners. Language Assessment Quarterly, 13(3), 202–217. https://doi.org/10.1080/15434303.2016.1210611
   Web of Science ®Google Scholar
• Linacre, J. M. (1995). Prioritizing misfit indicators. Rasch Measurement Transactions, 9(2), 422–423.
   Google Scholar
• Linacre, J. M. (2022). Winsteps® Rasch measurement computer program (version 5.2.2). https://www.winsteps.com/index.htm
   Google Scholar
• McLean, S. (2018). Evidence for the adoption of the flemma as an appropriate word counting unit. Applied Linguistics, 39(6), 823–845. https://doi.org/10.1093/applin/amw050
   Web of Science ®Google Scholar
• McLean, S., & Kramer, B. (2015). The creation of a new vocabulary levels test. Shiken, 19(2), 1–11. https://hosted.jalt.org/teval/sites/jalt.org.teval/files/Shiken_19-02_Complete-1.pdf#page=3
   Google Scholar
• McLean, S., Kramer, B., & Beglar, D. (2015). The creation and validation of a listening vocabulary levels test. Language Teaching Research, 19(6), 741–760. https://doi.org/10.1177/1362168814567889
   Web of Science ®Google Scholar
• McLean, S., Stewart, J., & Batty, A. O. (2020). Predicting L2 proficiency with modalities of vocabulary knowledge: A bootstrapping approach. Language Testing, 37(3), 389–411. https://doi.org/10.1177/0265532219898380
   Web of Science ®Google Scholar
• McNamara, T. (2006). Validity in language testing: The challenge of Sam Messick’s legacy. Language Assessment Quarterly, 3(1), 31–51. https://doi.org/10.1207/s15434311laq0301_3
   Google Scholar
• Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). American Council on Education and Macmillan Publishing Company.
   Google Scholar
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
   Web of Science ®Google Scholar
• Milton, J. (2006). Language lite? Learning French vocabulary in school. Journal of French Language Studies, 16(2), 187–205. https://doi.org/10.1017/S0959269506002420
   Google Scholar
• Milton, J., Wade, J., & Hopkins, N. (2010). Aural word recognition and oral competence in a foreign language. In R. Chacón-Beltrán, C. Abello-Contesse, M. Torreblanca-López, & M. D. López-Jiménez (Eds.), Further insights into nonnative vocabulary teaching and learning (pp. 83–97). Multilingual Matters.
   Google Scholar
• Nation, I. S. P. (1983). Testing and teaching vocabulary. Guidelines, 5(1), 12–25. https://www.wgtn.ac.nz/lals/resources/paul-nationsresources/paul-nations-publications/publications/documents/1983-Testing-and-teaching.pdf
   Google Scholar
• Nation, I. S. P. (2007). The four strands. Innovation in Language Learning & Teaching, 1(1), 2–13. https://doi.org/10.2167/illt039.0
   Google Scholar
• Nation, I. S. P. (2013). Learning vocabulary in another language (2nd ed.). Cambridge University Press.
   Google Scholar
• Nation, I. S. P., & Anthony, L. (2016). Measuring vocabulary size. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 355–368). Routledge.
   Google Scholar
• Nation, I. S. P., & Beglar, D. (2007). A vocabulary size test. The Language Teacher, 31(7), 96–13.
   Google Scholar
• Nation, I. S. P., & Webb, S. A. (2011). Researching and analyzing vocabulary. Cengage.
   Google Scholar
• Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Danmarks Paedogogiske Institute.
   Google Scholar
• Read, J., & Chapelle, C. (2001). A framework for second language vocabulary assessment. Language Testing, 18(1), 1–32. https://doi.org/10.1177/026553220101800101
   Google Scholar
• Robles-García, P. (2020). 3K-LEx: Desarrollo y Validación de una Prueba de Amplitud Léxica en Español. Journal of Spanish Language Teaching, 7(1), 64–76. https://doi.org/10.1080/23247797.2020.1770465
   Google Scholar
• Robles-García, P. (2022). Receptive vocabulary knowledge in L2 learners of Spanish: The role of high frequency words. Foreign Language Annals, 55(4), 963–984. https://doi.org/10.1111/flan.12630
   Web of Science ®Google Scholar
• Robles-García, P., Wallace, G. H., & Sánchez-Gutiérrez, C. (2022). 3K-LEx-MC: The creation and validation of a multiple-choice vocabulary placement test for Spanish language learners. International Journal of Applied Linguistics (ITL), 174(1), 135–165. https://doi.org/10.1075/itl.22008.rob
   Google Scholar
• Saito, K., Webb, S., Trofimovich, P., & Isaacs, T. (2016). Lexical profiles of comprehensible second language speech: The role of appropriateness, fluency, variation, sophistication, abstractness, and sense relations. Studies in Second Language Acquisition, 38(4), 677–701. https://doi.org/10.1017/S0272263115000297
   Web of Science ®Google Scholar
• Schmitt, N., Dunn, K., O’Sullivan, B., Anthony, L., & Kremmel, B. (2022). Introducing knowledge-based vocabulary lists (KVL). TESOL Journal, 12(4), 1–10. https://doi.org/10.1002/tesj.622
   Web of Science ®Google Scholar
• Schmitt, N., Jiang, X., & Grabe, W. (2011). The percentage of words known in a text and reading comprehension. The Modern Language Journal, 95(1), 26–43. https://doi.org/10.1111/j.1540-4781.2011.01146.x
   Web of Science ®Google Scholar
• Schmitt, N., Nation, P., & Kremmel, B. (2020). Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation. Language Teaching, 53(1), 109–120. https://doi.org/10.1017/S0261444819000326
   Web of Science ®Google Scholar
• Schmitt, N., Schmitt, D., & Clapham, C. (2001). Developing and exploring the behavior of two new versions of the vocabulary levels test. Language Testing, 18(1), 55–88. https://doi.org/10.1177/026553220101800103
   Google Scholar
• Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30(4), 510–532. https://doi.org/10.1093/applin/amp047
   Web of Science ®Google Scholar
• Smith, E. V., Jr. (2004). Evidence for the reliability of measures and validity of measure interpretation: A Rasch measurement perspective. In E. V. Smith & R. M. Smith (Eds.), Introduction to Rasch measurement: Theory, models, and applications (pp. 93–122). JAM Press.
   Google Scholar
• Stæhr, L. S. (2007). Vocabulary knowledge and listening comprehension in English as a foreign language: An empirical study employing data elicited from Danish EFL learners [ Doctoral dissertation]. Copenhagen Business School Samfundslitteratur. https://research.cbs.dk/en/publications/vocabulary-knowledge-and-listening-comprehension-in-english-as-a-
   Google Scholar
• Stæhr, L. S. (2008). Vocabulary size and the skills of listening, reading, and writing. Language Learning Journal, 36(2), 139–152. https://doi.org/10.1080/09571730802389975
   Google Scholar
• Stevens, J. (2002). Applied multivariate statistics for the social sciences (4th ed.). Erlbaum.
   Google Scholar
• Stewart, J., McLean, S., & Batty, O. A. (2021). Correlations of modalities of written vocabulary knowledge to listening and reading proficiency: A comparison. Vocabulary Language and Instruction, 10(2), 55–63. https://doi.org/10.7820/vli.v10.2.Stewart
   Google Scholar
• Stewart, J., Vitta, J., Nicklin, C., McLean, S., Pinchbeck, G., & Kramer, B. (2022). The relationship between word difficulty and frequency: A response to Hashimoto (2021. Language Assessment Quarterly, 19(1), 90–101. https://doi.org/10.1080/15434303.2021.1992629
   Web of Science ®Google Scholar
• Stoeckel, T., McLean, S., & Nation, P. (2021). Limitations of size and levels tests of written receptive vocabulary knowledge. Studies in Second Language Acquisition, 43(1), 181–203. https://doi.org/10.1017/S027226312000025X
   Web of Science ®Google Scholar
• Van Zeeland, H., & Schmitt, N. (2012). Lexical coverage in L1 and L2 listening comprehension: The same or different from reading comprehension? Applied Linguistics, 34(4), 457–479. https://doi.org/10.1093/applin/ams074
   Web of Science ®Google Scholar
• Vitta, J. P., Nicklin, C., & Albright, S. W. (2023). Academic word difficulty and multidimensional lexical sophistication: An English-for-academic-purposes focused conceptual replication of Hashimoto and Egbert (2019). The Modern Language Journal, 107(1), 373–397. https://doi.org/10.1111/modl.12835
   Web of Science ®Google Scholar
• Webb, S., Sasao, Y., & Ballance, O. (2017). The updated vocabulary levels test: Developing and validating two new forms of the VLT. International Journal of Applied Linguistics, 168(1), 33–69. https://doi.org/10.1075/itl.168.1.02web
   Google Scholar
• Zhang, S., & Zhang, X. (2022). The relationship between vocabulary knowledge and L2 reading/listening comprehension: A meta-analysis. Language Teaching Research, 26(4), 696–725. https://doi.org/10.1177/1362168820913998
   Web of Science ®Google Scholar