Empirical Benchmarks to Interpret Intervention Effects on Student Achievement in Elementary and Secondary School: Meta-Analytic Results from Germany

References

• American Educational Research Association (AERA). (2006). Standards for reporting on empirical social science research in AERA publications. Educational Researcher, 35, 33–40.
   Google Scholar
• Atteberry, A. C., & McEachin, A. J. (2020). Not where you start, but how much you grow: An addendum to the Coleman report. Educational Researcher, 49(9), 678–685. https://doi.org/10.3102/0013189X20940304
   Web of Science ®Google Scholar
• Autorengruppe Bildungsberichterstattung. (2020). Bildung in Deutschland 2020. wbv Media. https://doi.org/10.3278/6001820gw
   Google Scholar
• Baird, M. D., & Pane, J. F. (2019). Translating standardized effects of education programs into more interpretable metrics. Educational Researcher, 48(4), 217–228. https://doi.org/10.3102/0013189X19848729
   PubMed Web of Science ®Google Scholar
• Baumert, J., & Artelt, C. (2002). Bereichsübergreifende Perspektiven [Taking perspectives from different domains]. In J. Baumert, C. Artelt, E. Klieme, M. Neubrand, M. Prenzel, U. Schiefele, W. Schneider, K.-J. Tillmann, & M. Weiß (Eds.), PISA 2000—Die Länder der Bundesrepublik im Vergleich (pp. 219–236). Leske + Budrich.
   Google Scholar
• Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., Krauss, S., Neubrand, M., & Tsai, Y. M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47, 133–180.
   Web of Science ®Google Scholar
• Baumert, J., Lüdtke, O., Trautwein, U., & Brunner, M. (2009). Large-scale student assessment studies measure the results of processes of knowledge acquisition: Evidence in support of the distinction between intelligence and student achievement. Educational Research Review, 4, 165–176.
   Web of Science ®Google Scholar
• Becker, M., Lüdtke, O., Trautwein, U., & Baumert, J. (2006). Leistungszuwachs in Mathematik. Evidenz für einen Schereneffekt im mehrgliedrigen Schulsystem? Zeitschrift Für Pädagogische Psychologie, 20(4), 233–242. https://doi.org/10.1024/1010-0652.20.4.233
   Web of Science ®Google Scholar
• Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008). Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. Journal of Research on Educational Effectiveness, 1(4), 289–328. https://doi.org/10.1080/19345740802400072
   Google Scholar
• Blossfeld, H.-P., & Rossbach, H.-G. (Eds.). (2019). Education as a lifelong process: The German national educational panel study (NEPS). (2nd ed.). Springer Fachmedien Wiesbaden : Imprint: Springer VS. https://doi.org/10.1007/978-3-658-23162-0
   Google Scholar
• Böhme, K., Sebald, S., Weirich, S., & Stanat, P. (2016). Geschlechtsbezogene Disparitäten [Gender differences]. In P. Stanat, K. Böhme, S. Schipolowski, & N. Haag (Eds.), IQB-Bildungstrend 2015. Sprachliche Kompetenzen am Ende der 9. Jahrgangsstufe im zweiten Ländervergleich (pp. 377–408). Waxmann.
   Google Scholar
• Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017). Basics of meta-analysis: I2 is not an absolute measure of heterogeneity. Research Synthesis Methods, 8(1), 5–18. https://doi.org/10.1002/jrsm.1230
   PubMed Web of Science ®Google Scholar
• Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2003). Comprehensive school reform and achievement: A meta-analysis. Review of Educational Research, 73(2), 125–230. https://doi.org/10.3102/00346543073002125
   Web of Science ®Google Scholar
• Brunner, M., Keller, L., Stallasch, S. E., Kretschmann, J., Hasl, A., Preckel, F., Lüdtke, O., & Hedges, L. V. (2023). Meta-analyzing individual participant data from studies with complex survey designs: A tutorial on using the two-stage approach for data from educational large-scale assessments. Research Synthesis Methods, 14(1), 5–35. https://doi.org/10.1002/jrsm.1584
   PubMed Web of Science ®Google Scholar
• Burke, D. L., Ensor, J., & Riley, R. D. (2017). Meta‐analysis using individual participant data: One‐stage and two‐stage approaches, and why they may differ. Statistics in Medicine, 36(5), 855–875. https://doi.org/10.1002/sim.7141
   PubMed Web of Science ®Google Scholar
• Cheung, A. C. K., Xie, C., Zhuang, T., Neitzel, A. J., & Slavin, R. E. (2021). Success for all: A quantitative synthesis of U.S. Evaluations. Journal of Research on Educational Effectiveness, 14(1), 90–115. https://doi.org/10.1080/19345747.2020.1868031
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum.
   Google Scholar
• Cohen, J., Cohen, P., Aiken, L. S., & West, S. G. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Lawrence Erlbaum Associates.
   Google Scholar
• Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25(1), 7–29. https://doi.org/10.1177/0956797613504966
   PubMed Web of Science ®Google Scholar
• Dadey, N., & Briggs, D. C. (2012). A meta-analysis of growth trends from vertically scaled assessments. Practical Assessment, Research, and Evaluation, 17. https://doi.org/10.7275/F2BM-6R59
   Google Scholar
• Findley, M. G., Kikuta, K., & Denly, M. (2021). External validity. Annual Review of Political Science, 24(1), 365–393. https://doi.org/10.1146/annurev-polisci-041719-102556
   Google Scholar
• Ganzeboom, H. B. G., & Treiman, D. J. (1996). Internationally comparable measures of occupational status for the 1988 International Standards Classification of Occupations. Social Science Research, 25, 201–239.
   Web of Science ®Google Scholar
• Gerick, J., Massek, C., Eickelmann, B., & Labusch, A. (2019). Computer- und informationsbezogene Kompetenzen von Mädchen und Jungen im zweiten internationalen Vergleich [Computer and information literacy: Second international comparison of female and male students]. In B. Eickelmann, W. Bos, J. Gerick, F. Goldhammer, H. Schaumburg, K. Schwippert, M. Senkbeil, & J. Vahrenhold (Eds.), ICILS 2018 #Deutschland: Computer- und informationsbezogene Kompetenzen von Schülerinnen und Schülern im zweiten internationalen Vergleich und Kompetenzen im Bereich Computational Thinking (pp. 271–300). Waxmann.
   Google Scholar
• Gubbels, J., Put, C., & Assink, M. (2019). Risk factors for school absenteeism and dropout: A meta-analytic review. Journal of Youth and Adolescence, 48, 1637–1667. https://doi.org/10.1007/s10964-019-01072-5
   PubMed Web of Science ®Google Scholar
• Haag, N., Böhme, K., Rjosk, C., & Stanat, P. (2016). Zuwanderungsbezogene Disparitäten [Immigration-related disparities]. In P. Stanat, K. Böhme, S. Schipolowski, & N. Haag (Eds.), IQB-Bildungstrend 2015. Sprachliche Kompetenzen am Ende der 9. Jahrgangsstufe im zweiten Ländervergleich (pp. 431–480). Waxmann.
   Google Scholar
• Haag, N., Kocaj, A., Jansen, M., & Kuhl, P. (2017). Soziale Disparitäten [Social inequalities]. In P. Stanat, S. Schipolowski, C. Rjosk, S. Weirich, & N. Haag (Eds.), IQB-Bildungstrend 2016: Kompetenzen in den Fächern Deutsch und Mathematik am Ende der 4. Jahrgangsstufe im zweiten Ländervergleich (pp. 213–236). Waxmann.
   Google Scholar
• Hedges, L. V. (2019). Stochastically dependent effect sizes. In H. M. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), Handbook of research synthesis and meta-analysis. (3rd ed., pp. 245–280). Russell Sage Foundation.
   Google Scholar
• Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3(4), 486–504. https://doi.org/10.1037/1082-989X.3.4.486
   Web of Science ®Google Scholar
• Henschel, S., Heppt, B., Weirich, S., Edele, A., Schipolowski, S., & Stanat, P. (2019). Zuwanderungsbezogene Disparitäten [Immigration-related disparities]. In P. Stanat, S. Schipolowski, N. Mahler, S. Weirich, & S. Henschel (Eds.), IQB-Bildungstrend 2018. Mathematische und naturwissenschaftliche Kompetenzen am Ende der Sekundarstufe I im zweiten Ländervergleich (pp. 265–294). Waxmann. https://www.content-select.com/index.php?id=bib_view&ean=9783830990444
   Google Scholar
• Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (Eds.). (2021). Cochrane Handbook for systematic reviews of interventions. Cochrane. www.training.cochrane.org/handbook
   Google Scholar
• Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2, 172–177.
   Web of Science ®Google Scholar
• Hußmann, A., Stubbe, T. C., & Kasper, D. (2017). Soziale Herkunft und Lesekompetenzen von Schülerinnen und Schülern [Social origin and students’ reading competences]. In A. Hussmann, H. Wendt, W. Bos, A. Bremerich-Vos, D. Kasper, E.-M. Lankes, N. McElvany, T. C. Stubbe, & R. Valtin (Eds.), IGLU 2016: Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (pp. 195–218). Waxmann.
   Google Scholar
• Kievit, R. A., Brandmaier, A. M., Ziegler, G., van Harmelen, A.-L., de Mooij, S. M. M., Moutoussis, M., Goodyer, I. M., Bullmore, E., Jones, P. B., Fonagy, P., Lindenberger, U., & Dolan, R. J. (2018). Developmental cognitive neuroscience using latent change score models: A tutorial and applications. Developmental Cognitive Neuroscience, 33, 99–117. https://doi.org/10.1016/j.dcn.2017.11.007
   PubMed Web of Science ®Google Scholar
• Klieme, E. (2012). Assessment of student achievements in German and English as a foreign language (DESI) (version 1) [data set]. IQB - Institute for Educational Quality Improvement. https://doi.org/10.5159/IQB_DESI_V1
   Google Scholar
• KMK. (2012). Kompetenzstufenmodell zu den Bildungsstandards für den Hauptschulabschluss und den Mittleren Schulabschluss im Fach Mathematik. KMK. https://www.iqb.hu-berlin.de/bista/ksm/Kompetenzstufenm.pdf
   Google Scholar
• Konstantopoulos, S., & Hedges, L. V. (2008). How large an effect can we expect from school reforms? Teachers College Record, 110(8), 1611–1638.
   Web of Science ®Google Scholar
• Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798
   Web of Science ®Google Scholar
• Kuhfeld, M., & Soland, J. (2021). The Learning curve: Revisiting the assumption of linear growth during the school year. Journal of Research on Educational Effectiveness, 14(1), 143–171. https://doi.org/10.1080/19345747.2020.1839990
   Web of Science ®Google Scholar
• Kuhl, P., Haag, N., Federlein, F., Weirich, S., & Schipolowski, S. (2016). Soziale Disparitäten [Social inequalities]. In P. Stanat, K. Böhme, S. Schipolowski, & N. Haag (Eds.), IQB-Bildungstrend 2015. Sprachliche Kompetenzen am Ende der 9. Jahrgangsstufe im zweiten Ländervergleich (pp. 409–430). Waxmann.
   Google Scholar
• Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019). A comparison of heterogeneity variance estimators in simulated random-effects meta-analyses. Research Synthesis Methods, 10(1), 83–98. https://doi.org/10.1002/jrsm.1316
   PubMed Web of Science ®Google Scholar
• Lee, J., Finn, J., & Liu, X. (2019). Time-indexed effect size for educational research and evaluation: Reinterpreting program effects and achievement gaps in K–12 reading and math. The Journal of Experimental Education, 87(2), 193–213. https://doi.org/10.1080/00220973.2017.1409183
   Web of Science ®Google Scholar
• Lehner, M. C., Heine, J.-H., Sälzer, C., Reiss, K., Haag, N., & Heinze, A. (2017). Veränderung der mathematischen Kompetenz von der neunten zur zehnten Klassenstufe. Zeitschrift für Erziehungswissenschaft, 20(2), 7–36. https://doi.org/10.1007/s11618-017-0746-2
   Google Scholar
• Lipsey, M. W., Puzio, K., Yun, C., Hebert, M. A., Steinka-Fry, K., Cole, M. W., Roberts, M., Anthony, K. S., & Busick, M. D. (2012). Translating the statistical representation of the effects of education interventions into more readily interpretable forms. National Center for Special Education Research. http://eric.ed.gov/?id=ED537446
   Google Scholar
• Lortie-Forgues, H., Sio, U. N., & Inglis, M. (2021). How should educational effects be communicated to teachers? Educational Researcher, 50(6), 345–354. https://doi.org/10.3102/0013189X20987856
   PubMed Web of Science ®Google Scholar
• Mahler, N., & Kölm, J. (2019). Soziale Disparitäten [Social inequalities]. In P. Stanat, S. Schipolowski, N. Mahler, S. Weirich, & S. Henschel (Eds.), IQB-Bildungstrend 2018. Mathematische und naturwissenschaftliche Kompetenzen am Ende der Sekundarstufe I im zweiten Ländervergleich (pp. 265–294). Waxmann. https://www.content-select.com/index.php?id=bib_view&ean=9783830990444
   Google Scholar
• Mavridis, D., & Salanti, G. (2013). A practical introduction to multivariate meta-analysis. Statistical Methods in Medical Research, 22(2), 133–158. https://doi.org/10.1177/0962280211432219
   PubMed Web of Science ®Google Scholar
• McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60, 577–605. https://doi.org/10.1146/annurev.psych.60.110707.163612
   PubMed Web of Science ®Google Scholar
• McElvany, N., Kessels, U., Schwabe, F., & Kasper, D. (2017). Geschlecht und Lesekompetenz [Gender and reading competence]. In A. Hussmann, H. Wendt, W. Bos, A. Bremerich-Vos, D. Kasper, E.-M. Lankes, N. McElvany, T. C. Stubbe, & R. Valtin (Eds.), IGLU 2016: Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (pp. 177–194). Waxmann.
   Google Scholar
• Morris, T. P., Fisher, D. J., Kenward, M. G., & Carpenter, J. R. (2018). Meta-analysis of Gaussian individual patient data: Two-stage or not two-stage? Statistics in Medicine, 37(9), 1419–1438. https://doi.org/10.1002/sim.7589
   PubMed Web of Science ®Google Scholar
• NEPS Network. (2019). National educational panel study, scientific use file of starting cohort grade 9 (10.0.0) [data set]. Leibniz Institute for Educational Trajectories (LIfBi). https://doi.org/10.5157/NEPS:SC4:10.0.0
   Google Scholar
• NEPS Network. (2020a). National educational panel study, scientific use file of starting cohort grade 5 [data set]. Leibniz Institute for Educational Trajectories (LIfBi). https://doi.org/10.5157/NEPS:SC3:10.0.0
   Google Scholar
• NEPS Network. (2020b). National educational panel study, scientific use file of starting cohort kindergarten (8.0.1) [data set]. Leibniz Institute for Educational Trajectories (LIfBi). https://doi.org/10.5157/NEPS:SC2:8.0.1
   Google Scholar
• Organisation for Economic Co-operation and Development (OECD). (2003). Literacy skills for the world of tomorrow: Further results from PISA 2000. OECD.
   Google Scholar
• Organisation for Economic Co-operation and Development (OECD). (2007). PISA 2006. Science competencies for tomorrow’s world. Volume 1: Analysis. OECD.
   Google Scholar
• Organisation for Economic Co-operation and Development (OECD). (2014). PISA 2012 results. What students know and can do. Student performance in mathematics, reading, and science (Vol. I). OECD.
   Google Scholar
• Peng, C.-Y J., Chen, L.-T., Chiang, H.-M., & Chiang, Y.-C. (2013). The impact of APA and AERA guidelines on effect size reporting. Educational Psychology Review, 25(2), 157–209. https://doi.org/10.1007/s10648-013-9218-2
   Web of Science ®Google Scholar
• Pfost, M., Karing, C., Lorenz, C., & Artelt, C. (2010). Schereneffekte im ein- und mehrgliedrigen Schulsystem. Zeitschrift Für Pädagogische Psychologie, 24(3–4), 259–272. https://doi.org/10.1024/1010-0652/a000025
   Google Scholar
• Prenzel, M., Baumert, J., Blum, W., Lehmann, R., Leutner, D., Neubrand, M., Pekrun, R., Rost, J., & Schiefele, U. (2013). Programme for international student assessment plus 2003, 2004 (PISA-I-Plus) (version 1) [data set]. IQB - Institute for Educational Quality Improvement. https://doi.org/10.5159/IQB_PISA_I_PLUS_V1
   Google Scholar
• Pustejovsky, J. E. (2014). Converting from d to r to z when the design uses extreme groups, dichotomization, or experimental control. Psychological Methods, 19(1), 92–112. https://doi.org/10.1037/a0033788
   PubMed Web of Science ®Google Scholar
• Pustejovsky, J. E. (2021). ClubSandwich: Cluster-robust (sandwich) variance estimators with small-sample corrections. R package version 0.5.3. https://CRAN.R-project.org/package=clubSandwich
   Google Scholar
• R Core Team. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
   Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Sage.
   Google Scholar
• Reiss, K., Heine, J.-H., Klieme, E., Köller, O., & Stanat, P. (2020). Programme for international student assessment—plus 2012, 2013 (PISA-Plus 2012, 2013) (version 2) [data set]. IQB - Institute for Educational Quality Improvement. https://doi.org/10.5159/IQB_PISA_PLUS_2012-13_V2
   Google Scholar
• Retelsdorf, J., & Möller, J. (2008). Entwicklungen von Lesekompetenz und Lesemotivation Schereneffekte in der Sekundarstufe? Zeitschrift Für Entwicklungspsychologie Und Pädagogische Psychologie, 40(4), 179–188. https://doi.org/10.1026/0049-8637.40.4.179
   Google Scholar
• Rice, K., Higgins, J. P. T., & Lumley, T. (2018). A re-evaluation of fixed effect(s) meta-analysis. Journal of the Royal Statistical Society: Series A (Statistics in Society, )181(1), 205–227. https://doi.org/10.1111/rssa.12275
   Web of Science ®Google Scholar
• Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010). Meta-analysis of individual participant data: Rationale, conduct, and reporting. BMJ (Clinical Research Ed.), 340, c221. c221. https://doi.org/10.1136/bmj.c221
   PubMed Web of Science ®Google Scholar
• Rjosk, C., Haag, N., Heppt, B., & Stanat, P. (2017). Zuwanderungsbezogene Disparitäten [Immigration-related disparities]. In P. Stanat, S. Schipolowski, C. Rjosk, S. Weirich, & N. Haag (Eds.), IQB-Bildungstrend 2016: Kompetenzen in den Fächern Deutsch und Mathematik am Ende der 4. Jahrgangsstufe im zweiten Ländervergleich (pp. 213–236). Waxmann.
   Google Scholar
• Robitzsch, A., Lüdtke, O., Schwippert, K., Goldhammer, F., Kroehne, U., & Köller, O. (2020). Leistungsveränderungen in TIMSS zwischen 2015 und 2019: Die Rolle des Testmediums und des methodischen Vorgehens bei der Trendschätzung. In K. Schwippert, D. Kasper, O. Köller, N. McElvany, C. Selter, M. Steffensky, & H. Wendt (Eds.), TIMSS 2019. Mathematische und naturwissenschaftliche Kompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (pp. 169–186). Waxmann Verlag GmbH. https://doi.org/10.31244/9783830993193
   Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(1), 1–36. https://doi.org/10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Salchegger, S. (2016). Selective school systems and academic self-concept: How explicit and implicit school-level tracking relate to the big-fish-–little-pond effect across cultures. Journal of Educational Psychology, 108(3), 405–423. https://doi.org/10.1037/edu0000063
   Web of Science ®Google Scholar
• Scammacca, N. K., Fall, A.-M., & Roberts, G. (2015). Benchmarks for expected annual academic growth for students in the bottom quartile of the normative distribution. Journal of Research on Educational Effectiveness, 8(3), 366–379. https://doi.org/10.1080/19345747.2014.952464
   PubMed Web of Science ®Google Scholar
• Schiepe-Tiska, A., Rönnebeck, S., Heitmann, P., Schöps, K., Prenzel, M., & Nagy, G. (2017). Die Veränderung der naturwissenschaftlichen Kompetenz von der 9. Zur 10. Klasse bei PISA und den Bildungsstandards unter Berücksichtigung geschlechts- und schulartspezifischer Unterschiede sowie der Zusammensetzung der Schülerschaft. Zeitschrift für Erziehungswissenschaft, 20(2), 151–176. https://doi.org/10.1007/s11618-017-0754-2
   Google Scholar
• Schipolowski, S., Wittig, J., Mahler, N., & Stanat, P. (2019). Geschlechtsbezogene Disparitäten [Gender Differences]. In P. Stanat, S. Schipolowski, N. Mahler, S. Weirich, & S. Henschel (Eds.), IQB-Bildungstrend 2018. Mathematische und naturwissenschaftliche Kompetenzen am Ende der Sekundarstufe I im zweiten Ländervergleich (pp. 237–264). Waxmann. https://www.content-select.com/index.php?id=bib_view&ean=9783830990444
   Google Scholar
• Schipolowski, S., Wittig, J., Weirich, S., & Böhme, K. (2017). Geschlechtsbezogene Disparitäten [Gender Differences]. In P. Stanat, S. Schipolowski, C. Rjosk, S. Weirich, & N. Haag (Eds.), IQB-Bildungstrend 2016: Kompetenzen in den Fächern Deutsch und Mathematik am Ende der 4. Jahrgangsstufe im zweiten Ländervergleich (pp. 187–212). Waxmann.
   Google Scholar
• Schneider, W., & Stefanek, J. (2004). Entwicklungsveränderungen allgemeiner kognitiver Fähigkeiten und schulbezogener Fertigkeiten im Kindes- und Jugendalter. Zeitschrift Für Entwicklungspsychologie Und Pädagogische Psychologie, 36, 147–159.
   Google Scholar
• Secretariat of the Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal Republic of Germany (KMK). (2019). The Education System in the Federal Republic of Germany 2017/2018. KMK. https://www.kmk.org/fileadmin/Dateien/pdf/Eurydice/Bildungswesen-engl-pdfs/dossier_en_ebook.pdf
   Google Scholar
• Senkbeil, M., Drossel, K., Eickelmann, B., & Vennemann, M. (2019). Soziale Herkunft und computer- und informationsbezogene Kompetenzen von Schülerinnen und Schülern im zweiten internationalen Vergleich [Second international comparison: Social inequalities in students’ computer and information literacy]. In B. Eickelmann, W. Bos, J. Gerick, F. Goldhammer, H. Schaumburg, K. Schwippert, M. Senkbeil, & J. Vahrenhold (Eds.), ICILS 2018 #Deutschland: Computer- und informationsbezogene Kompetenzen von Schülerinnen und Schülern im zweiten internationalen Vergleich und Kompetenzen im Bereich Computational Thinking (pp. 301–334). Waxmann.
   Google Scholar
• Servicestelle der Initiative Klischeefrei. (2020). Fächerwahl und Schulleistungen [Course selection and academic achievement]. klischee-frei.de - Klischeefrei-Faktenblatt: Fächerwahl und Schulleistungen. https://www.klischee-frei.de/de/klischeefrei_101751.php
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Company.
   Google Scholar
• Sirin, S. R. (2005). Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research, 75, 417–453.
   Web of Science ®Google Scholar
• Stanat, P., & Christensen, G. (2006). Where immigrant students succeed: A comparative review of performance and engagement in PISA 2003. Organisation for Economic Co-operation and Development.
   Google Scholar
• Statistisches Bundesamt (Destatis). (2021). Schuljahr 2019/20 [School year 2019/2020]. Fachserie/11/1. https://www.statistischebibliothek.de/mir/receive/DEHeft_mods_00133256
   Google Scholar
• Tallmadge, G. K. (1977). The joint dissemination review panel IDEABOOK. U. S. Office of Education.
   Google Scholar
• Valentine, J. C., Aloe, A. M., & Wilson, S. J. (2019). Interpreting effect sizes. In H. M. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), Handbook of research synthesis and meta-analysis (3rd ed., pp. 433–452). Russell Sage Foundation.
   Google Scholar
• Vennemann, M., Schwippert, K., Eickelmann, B., & Massek, C. (2019). Computer- und informationsbezogene Kompetenzen von Schülerinnen und Schülern mit und ohne Migrationshintergrund im zweiten internationalen Vergleich [Computer and Information Literacy: Second international comparison of students with and without immigrant background]. In B. Eickelmann, W. Bos, J. Gerick, F. Goldhammer, H. Schaumburg, K. Schwippert, M. Senkbeil, & J. Vahrenhold (Eds.), ICILS 2018 #Deutschland: Computer- und informationsbezogene Kompetenzen von Schülerinnen und Schülern im zweiten internationalen Vergleich und Kompetenzen im Bereich Computational Thinking (pp. 335–366). Waxmann Verlag GmbH.
   Google Scholar
• Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
   PubMed Web of Science ®Google Scholar
• Wang, M. C., Haertel, G. D., & Walberg, H. J. (1993). Toward a Knowledge Base for School Learning. Review of Educational Research, 63(3), 249–294. https://doi.org/10.3102/00346543063003249
   Web of Science ®Google Scholar
• Weis, M., Doroganova, A., Hahnel, C., Becker-Mrotzek, M., Lindauer, T., Artelt, C., & Reis, K. (2019a). Lesekompetenz in PISA 2018. Ergebnisse in einer digitalen Welt [Reading competence in PISA 2018. Results in a digital world]. In K. Reiss, M. Weis, E. Klieme, & O. Köller (Eds.), PISA 2018 Grundbildung im internationalen Vergleich (pp. 47–80). Waxmann Verlag.
   Google Scholar
• Weis, M., Doroganova, A., Hahnel, C., Becker-Mrotzek, M., Lindauer, T., Artelt, C., & Reis, K. (2019b). Soziale Herkunft, Zuwanderungshintergrund und Lesekompetenz [Social origin, immigrant backround, and reading competence]. In K. Reiss, M. Weis, E. Klieme, & O. Köller (Eds.), PISA 2018 Grundbildung im internationalen Vergleich (pp. 129–162). Waxmann Verlag.
   Google Scholar
• Wendt, H., & Schwippert, K. (2017). Lesekompetenzen von Schülerinnen und Schülern mit und ohne Migrationshintergrund [Reading competences of students with and without immigrant background]. In A. Hussmann, H. Wendt, W. Bos, A. Bremerich-Vos, D. Kasper, E.-M. Lankes, N. McElvany, T. C. Stubbe, & R. Valtin (Eds.), IGLU 2016: Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (pp. 195–218). Waxmann.
   Google Scholar
• Wendt, H., Schwippert, K., Stubbe, T. C., & Jusufi, D. (2020). Mathematische und naturwissenschaftliche Kompetenzen von Schülerinnen und Schülern mit und ohne Migrationshintergrund [Mathematical and science competences of students with and without immigrant background]. In K. Schwippert, D. Kasper, O. Köller, N. McElvany, C. Selter, M. Steffensky, & H. Wendt (Eds.), TIMSS 2019. Mathematische und naturwissenschaftliche Kompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (pp. 291–314). Waxmann Verlag GmbH. https://doi.org/10.31244/9783830993193
   Google Scholar