Use and Usefulness of Assessments to Inform Instruction: Developing a K-12 Classroom Teacher Assessment Practice Measure

References

• Abrams, L., Varier, D., & Jackson, L. (2016). Unpacking instructional alignment: The influence of teachers’ use of assessment data on instruction. Perspectives in Education, 34(4), 15–28. https://doi.org/10.18820/2519593X/pie.v34i4.2
   Google Scholar
• Abrams, L. M., Varier, D., & McMillan, J. H. (2012). Formative assessment and benchmark testing: Phase 2. Metropolitan Educational Research Consortium. Virginia Commonwealth University. https://scholarscompass.vcu.edu/cgi/viewcontent.cgi?article=1014&context=merc_pubs
   Google Scholar
• Alexander, C. (2022). Examining the Smarter Balanced Assessment Consortium Exams, Scholastic Aptitude Test, and High School Grade Point Average as Predictors of College Readiness. [ Doctoral dissertation, Claremont Graduate University]. CGU Theses & Dissertations. https://scholarship.claremont.edu/cgu_etd/406
   Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
   Google Scholar
• Andrade, H. L. (2013). Classroom assessment in the context of learning theory and research. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment (pp. 17–34). SAGE. https://doi.org/10.4135/9781452218649.n2
   Google Scholar
• Andrade, H., & Cizek, G. J. (Eds.). (2009). Handbook of formative assessment. Routledge. https://doi.org/10.4324/9780203874851
   Google Scholar
• Andrade, H. L., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric‐referenced self‐assessment on elementary school students’ writing. Educational Measurement Issues & Practice, 27(2), 3–13. https://doi.org/10.1111/j.1745-3992.2008.00118.x
   Google Scholar
• Baglin, J. (2014). Improving your exploratory factor analysis for ordinal data: A demonstration using FACTOR. Practical Assessment, Research & Evaluation, 19(5), 1–15.
   Google Scholar
• Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. In G. R. Hancock, L. M. Stapleton, & R. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the social sciences (2nded), pp. 98–122. Routledge. https://doi.org/10.4324/9781315755649
   Google Scholar
• Baraldi, A. N., & Enders, C. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37. https://doi.org/10.1016/j.jsp.2009.10.001
   PubMed Web of Science ®Google Scholar
• Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
   Google Scholar
• Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
   Google Scholar
• Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
   Web of Science ®Google Scholar
• Brookhart, S. M. (2003). Developing measurement theory for classroom assessment purposes and uses. Educational Measurement Issues & Practice, 22(4), 5–12. https://doi.org/10.1111/j.1745-3992.2003.tb00139.x
   Google Scholar
• Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., Stevens, M. T., & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803–848. https://doi.org/10.3102/0034654316672069
   Web of Science ®Google Scholar
• Brookhart, S. M., & McMillan, J. H. (2020). Classroom assessment and educational measurement. Taylor & Francis. https://doi.org/10.4324/9780429507533
   Google Scholar
• Brown, G. T. (2004). Teachers’ conceptions of assessment: Implications for policy and professional development. Assessment in Education Principles, Policy & Practice, 11(3), 301–318. https://doi.org/10.1080/0969594042000304609
   Google Scholar
• Brown, G. T., Gebril, A., & Michaelides, M. P. (2019). Teachers’ conceptions of assessment: A global phenomenon or a global localism. Frontiers in Education, 4, 1–13. https://doi.org/10.3389/feduc.2019.00016
   Google Scholar
• Buhagiar, M. A. (2007). Classroom assessment within the alternative assessment paradigm: Revisiting the territory. The Curriculum Journal, 18(1), 39–56. https://doi.org/10.1080/09585170701292174
   Google Scholar
• CASEL. (2022). Fundamentals of SEL. https://casel.org/fundamentals-of-sel/
   Google Scholar
• Cizek, G. J., Andrade, H. L., & Bennett, R. E. (2019). Formative assessment: History, definition, and progress. In H. L. Andrade, R. E. Bennett, & G. J. Cizek (Eds.), Handbook of formative assessment in the disciplines (pp. 3–19). Routledge. https://doi.org/10.4324/9781315166933-1
   Google Scholar
• Coombs, A., DeLuca, C., & MacGregor, S. (2020). A person-centered analysis of teacher candidates’ approaches to assessment. Teaching and Teacher Education, 87, 102952. https://doi.org/10.1016/j.tate.2019.102952
   Web of Science ®Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
   PubMed Web of Science ®Google Scholar
• Dann, R. (2014). Assessment as learning: Blurring the boundaries of assessment and learning for theory, policy and practice. Assessment in Education Principles, Policy & Practice, 21(2), 149–166. https://doi.org/10.1080/0969594X.2014.898128
   Google Scholar
• Darling-Hammond, L., Pecheone, R., Jacquith, A., Schultz, S., Walker, L., & Wei, R. C. (2010, March). Developing an internationally comparable balanced assessment system that supports high-quality learning. National Conference on Next Generation K–12 Assessment Systems, Center for K–12 Assessment & Performance Management with the Education Commission of the States (ECS) and the Council of Great City Schools (CGCS), Washington, DC.
   Google Scholar
• DeLuca, C. (2020). Approaches to classroom assessment inventory instrument, version 3.0, specifications, and related material. https://www.cdeluca.com/teacher-assessment-literacy
   Google Scholar
• Dickinson, E. R., & Adelson, J. L. (2016). Choosing among multiple achievement measures: Applying multitrait–multimethod confirmatory factor analysis to state assessment, ACT, and student GPA data. Journal of Advanced Academics, 27(1), 4–22. https://doi.org/10.1177/1932202X15621905
   Web of Science ®Google Scholar
• Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Psychology, 3(55), 1–21. https://doi.org/10.3389/fpsyg.2012.00055
   PubMedGoogle Scholar
• Gotch, C. M., Carbonneau, K. J., & Van Orman, D. S. J. (2021). Preparing pre-service teachers for assessment of, for, and as learning. In S. Nichols & D. Varier (Eds.), Teaching on assessment (pp. 17–36). Information Age Publishing.
   Google Scholar
• Gotch, C. M., & French, B. F. (2014). A systematic review of assessment literacy measures. Educational Measurement Issues & Practice, 33(2), 14–18. https://doi.org/10.1111/emip.12030
   Google Scholar
• Guskey, T. R., & Brookhart, S. M. (2019). What we know about grading: What works, what doesn’t, and what’s next. ASCD.
   Google Scholar
• Hamilton, L. S., Doss, C. J., & Steiner, E. D. (2019). Support for social and emotional learning is widespread: Principals and teachers give insight into how they value, address, and measure it, and which supports they need. RAND. https://www.rand.org/pubs/research_briefs/RB10064.html
   Google Scholar
• Holcombe, R., Jennings, J., & Koretz, D. (2013). The roots of score inflation: An examination of opportunities in two states’ tests. In G. Sunderman (Ed.), Charting Reform, Achieving Equity in a Diverse Nation (pp. 163–189). Information Age Publishing.
   Google Scholar
• Hoover, N. R., & Abrams, L. M. (2013). Teachers’ instructional use of summative student assessment data. Applied Measurement in Education, 26(3), 219–231. https://doi.org/10.1080/08957347.2013.793187
   Web of Science ®Google Scholar
• Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447
   PubMed Web of Science ®Google Scholar
• Institute of Education Sciences. (2022). Measuring social and emotional learning in schools. Inside IES Research. https://ies.ed.gov/blogs/research/post/measuring-social-and-emotional-learning-in-schools
   Google Scholar
• Jennings, J. (2012). The effects of accountability system design on teachers’ use of test score data. Teachers College Record, 114(11), 1–23. https://doi.org/10.1177/016146811211401108
   Web of Science ®Google Scholar
• Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
   Web of Science ®Google Scholar
• Kloser, M., Borko, H., Martinez, J. F., Stecher, B., & Luskin, R. (2017). Evidence of middle school science assessment practice from classroom‐based portfolios. Science Education, 101(2), 209–231. https://doi.org/10.1002/sce.21256
   Web of Science ®Google Scholar
• Lee, C.-T., Zhang, G., & Edwards, M. C. (2012). Ordinary least squares estimation of parameters in exploratory factor analysis with ordinal data. Multivariate Behavioral Research, 47(2), 314–339. https://doi.org/10.1080/00273171.2012.658340
   PubMed Web of Science ®Google Scholar
• Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data. Wiley. https://doi.org/10.1002/9781119013563
   Google Scholar
• Liu, O. L., Lee, H. S., & Linn, M. C. (2010). Multifaceted assessment of inquiry-based science learning. Educational Assessment, 15(2), 69–86. https://doi.org/10.1080/10627197.2010.491067
   Google Scholar
• Lois, R. H., & Brown, G. T. L. (2009). The complexity of teachers’ conceptions of assessment: Tensions between the needs of schools and students. Assessment in Education Principles, Policy & Practice, 16(3), 365–381. https://doi.org/10.1080/09695940903319745
   Google Scholar
• Lyon, C. J., Miller, S., & Wylie, C. (2011). A validity argument for the assessment practices survey: A measure of teachers’ enactment of formative assessment. Annual meeting of the American Educational Research Association and the National Council on Measurement in Education, New Orleans, LA.
   Google Scholar
• Lyon, C. J., Wylie, E. C., Brockway, D., & Mavronikolas, E. (2018). Formative assessment and the role of teachers’ content area. School Science and Mathematics, 118(5), 144–155. https://doi.org/10.1111/ssm.12277
   Web of Science ®Google Scholar
• Mandinach, E. B., & Lash, A. A. (2015). Assessment illuminating pathways to learning. In L. Corno & E. M. Anderman (Eds.), Handbook of educational psychology (3rd ed., pp. 404–415). Routledge.
   Google Scholar
• Martínez, J. F. Borko, H. Stecher, B. Luskin, R., & Kloser, M. (2012). Measuring classroom assessment practice using instructional artifacts: A validation study of the QAS notebook. Educational Assessment, 17(2–3), 107–131. https://doi.org/10.1080/10627197.2012.715513
   Google Scholar
• McMillan, J. H. (2002). Understanding and improving teachers’ classroom assessment decision making: Implications for theory and practice. Educational Measurement Issues & Practice, 22(4), 34–43. https://doi.org/10.1111/j.1745-3992.2003.tb00142.x
   Google Scholar
• McMillan, J. H. (Ed.). (2013). SAGE handbook of research on classroom assessment. Sage. https://doi.org/10.4135/9781452218649
   Google Scholar
• McMillan, J. H., Myran, S., & Workman, D. (2002). Elementary teachers’ classroom assessment and grading practice. The Journal of Educational Research, 95(4), 203–213. https://doi.org/10.1080/00220670209596593
   Web of Science ®Google Scholar
• McMillan, J. H., Venable, J. C., & Varier, D. (2013). Studies of the effect of formative assessment on Student achievement: So much more is needed. Practical Assessment, Research & Evaluation, 18(2). https://scholarworks.umass.edu/pare/vol18/iss1/2z
   Google Scholar
• Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). Oryx Press.
   Google Scholar
• Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
   Web of Science ®Google Scholar
• Meyers, L. S., Gamst, G., & Guaino, A. J. (2017). Applied multivariate research: Design and interpretation (3rd ed.). Sage.
   Google Scholar
• Moss, P. A. (2013). Validity in action: Lessons from studies of data use. Journal of Educational Measurement, 50(1), 91–98. https://doi.org/10.1111/jedm.12003
   Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus user’s guide (8th ed.). Muthén & Muthén.
   Google Scholar
• Norris, M., & Lecavalier, L. (2010). Evaluating the use of exploratory factor analysis in developmental disability psychological research. Journal of Autism and Developmental Disorders, 40(1), 8–20. https://doi.org/10.1007/s10803-009-0816-2
   PubMed Web of Science ®Google Scholar
• Oláh, L. N., Lawrence, N. R., & Riggan, M. (2010). Learning to learn from benchmark assessment data: How teachers analyze results. Peabody Journal of Education, 85(2), 226–245. https://doi.org/10.1080/01619561003688688
   Google Scholar
• Osborne, J. W. (2012). Best practices in data cleaning: A complete guide to everything you need to do before and after collecting your data. Sage publications.
   Google Scholar
• Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128–138. https://doi.org/10.1016/j.tate.2019.05.003
   Web of Science ®Google Scholar
• Penuel, W. R., & Shepard, L. A. (2016). Assessment and teaching. In C. Bell & D. Gitomer (Eds.), Handbook of research on teaching (5th ed., pp. 787–850). American Educational Research Association. https://doi.org/10.3102/978-0-935302-48-6_12
   Google Scholar
• Pianta, R. C., La Paro, K. M., & Hamre, B. K. (2008). Classroom assessment scoring System™: Manual K-3. Paul H Brookes Publishing.
   Google Scholar
• Pituch, K. A., & Stevens, J. P. (2016). Applied statistics for the social sciences (6th ed.). Routledge. https://doi.org/10.4324/9781315814919
   Google Scholar
• Price, L. R. (2017). Psychometric methods: Theory into practice. Guilford Press.
   Google Scholar
• Randel, B., & Clark, T. (2013). Measuring classroom assessment practices. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment (pp. 145–163). SAGE. https://doi.org/10.4135/9781452218649.n9
   Google Scholar
• Raykov, T., & Marcoulides, G. (2011). Introduction to psychometric theory. Routledge. https://doi.org/10.4324/9780203841624
   Google Scholar
• R Core Team. (2017). R: A language and environment for statistical computing. Author. http://www.r-project.org
   Google Scholar
• Riggan, M., & Oláh, L. N. (2011). Locating interim assessments within teachers’ assessment practice. Educational Assessment, 16(1), 1–14. https://doi.org/10.1080/10627197.2011.551085
   Google Scholar
• Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714
   Web of Science ®Google Scholar
• Sadler, D. R. (1998). Formative assessment: Revisiting the territory. Assessment in Education Principles, Policy & Practice, 5(1), 77–84. https://doi.org/10.1080/0969595980050104
   Google Scholar
• Schellekens, L. H., Bok, H. G., de Jong, L. H., van der Schaaf, M. F., Kremer, W. D., & van der Vleuten, C. P. (2021). A scoping review on the notions of assessment as learning (AaL. Assessment for Learning (AfL), and Assessment of Learning (AoL) Studies in Educational Evaluation, 71, 1–15. https://doi.org/10.1016/j.stueduc.2021.101094
   Google Scholar
• Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14. https://doi.org/10.2307/1176145
   Google Scholar
• Shepard, L. A., Penuel, W. R., & Pellegrino, J. W. (2018). Using learning and motivation theories to coherently link formative assessment, grading practices, and large‐scale assessment. Educational Measurement Issues & Practice, 37(1), 21–34. https://doi.org/10.1111/emip.12189
   Google Scholar
• Stiggins, R. (2006). Balanced assessment systems: Redefining excellence in assessment. Educational Testing Service, 1–10. https://media.ride.ri.gov/PD/FA/CC/FA_CC_Module1_Lesson4/story_content/external_files/Stiggins_Balanced_Assessment_Systems%202006.pdf
   Google Scholar
• Supovitz, J. (2012). Getting at student understanding-the key to teachers’ use of test data. Teachers College Record, 114(11), 1–29. https://doi.org/10.1177/016146811211401105
   Web of Science ®Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.
   Google Scholar
• Torrance, H. (2007). Assessment as learning? How the use of explicit learning objectives, assessment criteria and feedback in post‐secondary education and training can come to dominate learning. Assessment in Education, 14(3), 281–294. https://doi.org/10.1080/09695940701591867
   Google Scholar
• Varier, D., & Nichols, S. (2021). Introduction: Toward a better understanding of assessment in teaching and teacher preparation. In S. Nichols & D. Varier (Eds.), Teaching on assessment. part of series by M. Yough, J.S., Vogler, & E.M. Anderman (eds.) theory to practice: Educational psychology for teachers and teaching (pp. 1–14). Information Age Publishing.
   Google Scholar
• Varier, D., Powell, M., Dodman, S., DeMulder, E., View, J. L., & Wolf, E. (2022a, August). Elementary school teachers’ equity perceptions and assessment use during COVID-19. Proceedings of the Annual Convention of the American Psychological Association, Minneapolis, MN, United States.
   Google Scholar
• Varier, D., Powell, M., Dodman, S., DeMulder, E., View, J. L., & Wolf, E. (2022b, April). Examining the relationship between teachers’ equity orientation and perceived usefulness of assessments of and for learning. Annual Meeting of the American Educational Research Association, San Diego, CA, United States.
   Google Scholar
• Watkins, M. W. (2021). A step-by-step guide to exploratory factor analysis with SPSS. Routledge. https://doi.org/10.4324/9781003149347
   Google Scholar
• Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010
   Web of Science ®Google Scholar
• Yan, Z., & Boud, D. (2021). Conceptualising assessment-as-learning. In Assessment as learning (pp. 11–24). Routledge. https://doi.org/10.4324/9781003052081-2
   Google Scholar
• Yan, Z., & Pastore, S. (2022). Assessing teachers’ strategies in formative assessment: The teacher formative assessment practice scale. Journal of Psychoeducational Assessment, 40(5), 592–604. https://doi.org/10.1177/07342829221075121
   Web of Science ®Google Scholar
• Zhang, Z., & Burry-Stock, J. (1995). A multivariate analysis of teachers’ perceived assessment competency as a function of measurement training and years of teaching. National Council on Measurement in Education Annual Meeting, Chicago, IL.
   Google Scholar
• Zhang, Z., & Burry-Stock, J. A. (2003). Classroom assessment practices and teachers’ self-perceived assessment skills. Applied Measurement in Education, 16(4), 323–342. https://doi.org/10.1207/S15324818AME1604_4
   Web of Science ®Google Scholar