How might rubric-based observations better support teacher learning and development?

References

• Archer, J., S. Cantrell, S. L. Holtzman, J. N. Joe, C. M. Tocci, and J. Wood. 2016. Better Feedback for Better Teaching: A Practical Guide to Improving Classroom Observations. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Bell, C. A., M. J. Dobbelaer, K. Klette, and A. Visscher. 2019. “Qualities of Classroom Observation Systems.” School Effectiveness and School Improvement 30 (1): 3–29. https://doi.org/10.1080/09243453.2018.1539014.
   Web of Science ®Google Scholar
• Bell, C. A., N. Jones, J. Lewis, Y. Qi, D. Kirui, L. Stickler, and S. Liu. 2015. “Understanding Consequential Assessment Systems of Teaching: Year 2 Final Report to Los Angeles Unified School District.” ETS. http://www.ets.org/Media/Research/pdf/RM-15-12.pdf.
   Google Scholar
• Bell, C. A., N. D. Jones, Y. Qi, and J. M. Lewis. 2018. “Strategies for Assessing Classroom Teaching: Examining Administrator Thinking as Validity Evidence.” Educational Assessment 23 (4): 229–249. https://doi.org/10.1080/10627197.2018.1513788.
   Web of Science ®Google Scholar
• Bell, C., and M. Kane. 2022. “Formative and Summative Teacher Evaluation in Social Context.” In Teacher Evaluation Around the World: Experiences, Dilemmas and Future Challenges, edited by J. Manzi, Y. Sun, and M. R. García, 9–38. Cham: Springer International Publishing. Teacher Education, Learning Innovation and Accountability. https://doi.org/10.1007/978-3-031-13639-9_2.
   Google Scholar
• Boston, M. D., and A. G. Candela. 2018. “The Instructional Quality Assessment as a Tool for Reflecting on Instructional Practice.” ZDM 50 (3): 427–444. https://doi.org/10.1007/s11858-018-0916-6.
   Google Scholar
• Bryk, A. S., P. B. Sebring, E. Allensworth, S. Luppescu, and J. Q. Easton. 2010. Organizing Schools for Improvement: Lessons from Chicago. Chicago; London: University Of Chicago Press.
   Google Scholar
• Close, K., A. Amrein-Beardsley, and C. Collins. 2020. “Putting Teacher Evaluation Systems on the Map: An Overview of State’s Teacher Evaluation Systems Post-Every Student Succeeds Act.” Education Policy Analysis Archives 28:58. https://doi.org/10.14507/epaa.28.5252.
   Google Scholar
• Coburn, C., and J. Russell. 2022. Getting the Most Out of Professional Learning Communities and Coaching: Promoting Interactions That Support Instructional Improvement. Pittsburgh, PA: University of Pittsburgh, Learning Policy Center. https://www.sesp.northwestern.edu/docs/publications/7373301757c9ac9dd89f0.pdf.
   Google Scholar
• Cohen, J. J., and D. Goldhaber. 2016. “Building a More Complete Understanding of Teacher Evaluation Using Classroom Observations.” Educational Researcher 45 (6): 378–387. https://doi.org/10.3102/0013189X16659442.
   Web of Science ®Google Scholar
• Cohen, J., L. Schuldt, L. Brown, and P. Grossman. 2016. “Leveraging Observation Tools for Instructional Improvement: Exploring Variability in Uptake of Ambitious Instructional Practices.” Teachers College Record 118 (11): 1–36. https://doi.org/10.1177/016146811611801105.
   Web of Science ®Google Scholar
• Cohen, D. K., J. P. Spillane, and D. J. Peurach. 2018. “The Dilemmas of Educational Reform.” Educational Researcher 47 (3): 204–212. https://doi.org/10.3102/0013189X17743488.
   Web of Science ®Google Scholar
• Danielson, C. 2007. Enhancing Professional Practice: A Framework for Teaching. 2nd Edition. 2nd ed. Alexandria, VA: Association for Supervision & Curriculum Development.
   Google Scholar
• Donaldson, M. L., and S. L. Woulfin. 2018. “From Tinkering to Going “Rogue”: How Principals Use Agency When Enacting New Teacher Evaluation Systems.” Educational Evaluation and Policy Analysis 40 (4): 531–556. https://doi.org/10.3102/0162373718784205.
   Web of Science ®Google Scholar
• Drake, T. A., E. Goldring, J. A. Grissom, M. Cannata, C. Neumerski, M. Rubin, and P. Schuermann. 2016. “Development or Dismissal? Exploring Principals’ Use of Teacher Effectiveness Data.” In Improving Teacher Evaluation Systems: Making the Most of Multiple Measures, edited byJ. A. Grissom and P. Youngs, 116–131. New York: Teachers College Press.
   Google Scholar
• Feldman, M. S., and B. T. Pentland. 2003. “Reconceptualizing Organizational Routines as a Source of Flexibility and Change.” Administrative Science Quarterly 48 (1): 94–118. https://doi.org/10.2307/3556620.
   Web of Science ®Google Scholar
• Fenstermacher, G., and V. Richardson. 2005. “On Making Determinations of Quality in Teaching.” The Teachers College Record 107 (1): 186–213. https://doi.org/10.1111/j.1467-9620.2005.00462.x.
   Web of Science ®Google Scholar
• Gallimore, R., B. Ermeling, W. Saunders, and C. Goldenberg. 2009. “Moving the Learning of Teaching Closer to Practice: Teacher Education Implications of School‐Based Inquiry Teams.” The Elementary School Journal 109 (5): 537–553. https://doi.org/10.1086/597001.
   Web of Science ®Google Scholar
• Gore, J., M. Smith, J. Bowe, H. Ellis, and D. Lubans. 2017. “Effects of Professional Development on the Quality of Teaching: Results from a Randomised Controlled Trial of Quality Teaching Rounds.” Teaching and Teacher Education 68 (November): 99–113. https://doi.org/10.1016/j.tate.2017.08.007.
   Google Scholar
• Gregory, A., J. P. Allen, A. Y. Mikami, C. A. Hafen, and R. C. Pianta. 2014. “Effects of a Professional Development Program on Behavioral Engagement of Students in Middle and High School.” Psychology in the Schools 51 (2): 143–163. https://doi.org/10.1002/pits.21741.
   PubMed Web of Science ®Google Scholar
• Grossman, P., and M. McDonald. 2008. “Back to the Future: Directions for Research in Teaching and Teacher Education.” American Educational Research Journal 45 (1): 184–205. https://doi.org/10.3102/0002831207312906.
   Web of Science ®Google Scholar
• Halverson, R. R., C. Kelley, and S. Kimball. 2004. “Implementing Teacher Evaluation Systems: How Principals Make Sense of Complex Artifacts to Shape Local Instructional Practice.” Educational Administration, Policy, and Reform: Research and Measurement, edited by W. K. Hoy and C. Miskel, 53–188. Greenwich, CT: Information Age Publishing.
   Google Scholar
• Ho, A. D., and T. J. Kane. 2013. The Reliability of Classroom Observations by School Personnel. MET Project. Bill & Melinda Gates Foundation. http://eric.ed.gov/?id=ED540957.
   Google Scholar
• Horn, I. S., and J. Warren Little. 2010. “Attending to Problems of Practice: Routines and Resources for Professional Learning in Teachers’ Workplace Interactions.” American Educational Research Journal 47 (1): 181–217. https://doi.org/10.3102/0002831209345158.
   Web of Science ®Google Scholar
• Hu, Y., and K. van Veen. 2020. “How Features of the Implementation Process Shape the Success of an Observation-Based Coaching Program: Perspectives of Teachers and Coaches.” The Elementary School Journal 121 (2): 283–310. https://doi.org/10.1086/711070.
   Web of Science ®Google Scholar
• Independent Group of Scientists appointed by the Secretary-General. 2019. “Global Sustainable Development Report 2019: The Future is Now – Science for Achieving Sustainable Development.” New York: United Nations. https://sdgs.un.org/sites/default/files/2020-07/24797GSDR_report_2019.pdf.
   Google Scholar
• Jamil, F. M., and B. K. Hamre. 2018. “Teacher Reflection in the Context of an Online Professional Development Course: Applying Principles of Cognitive Science to Promote Teacher Learning.” Action in Teacher Education 40 (2): 220–236. https://doi.org/10.1080/01626620.2018.1424051.
   Google Scholar
• Jensen, B., G. Valdés, and R. Gallimore. 2021. “Teachers Learning to Implement Equitable Classroom Talk.” Educational Researcher 50 (8): 546–556. https://doi.org/10.3102/0013189X211014859.
   Web of Science ®Google Scholar
• Jensen, B., and M. White. 2023. “Classroom Observation Systems for Teacher Collaborative Learning: Reliability of Teacher Raters.” Presented at the American Educational Research Association Annual Conference, Chicago, IL.
   Google Scholar
• Kane, T. J., D. O. Staiger, D. McCaffrey, S. Cantrell, J. Archer, S. Buhayar, and D. Parker. 2012. “Gathering Feedback for Teaching: Combining High-Quality Observations with Student Surveys and Achievement Gains.” Seattle, WA: Bill & Melinda Gates Foundation, Measures of Effective Teaching Project. http://eric.ed.gov/?id=ED540960.
   Google Scholar
• Kimball, S. M., and A. T. Milanowski. 2009. “Examining Teacher Evaluation Validity and Leadership Decision Making within a Standards-Based Evaluation System.” Educational Administration Quarterly 45 (1): 34–70. https://doi.org/10.1177/0013161X08327549.
   Web of Science ®Google Scholar
• Klette, K., and M. Blikstad-Balas. 2018. “Observation Manuals as Lenses to Classroom Teaching: Pitfalls and Possibilities.” European Educational Research Journal 17 (1): 129–146. https://doi.org/10.1177/1474904117703228.
   Web of Science ®Google Scholar
• Koedel, C., J. Li, M. G. Springer, and L. Tan. 2017. “The Impact of Performance Ratings on Job Satisfaction for Public School Teachers.” American Educational Research Journal 54 (2): 241–278. https://doi.org/10.3102/0002831216687531.
   Web of Science ®Google Scholar
• Kraft, M. A., D. Blazar, and D. Hogan. 2018. “The Effect of Teacher Coaching on Instruction and Achievement: A Meta-Analysis of the Causal Evidence.” Review of Educational Research 88 (4): 549–588. https://doi.org/10.3102/0034654318759268.
   Web of Science ®Google Scholar
• Kraft, M. A., and A. F. Gilmour. 2016. “Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals’ Views and Experiences.” Educational Administration Quarterly 52 (5): 711–753. https://doi.org/10.1177/0013161X16653445.
   PubMed Web of Science ®Google Scholar
• Kraft, M. A., and A. F. Gilmour. 2017. “Revisiting the Widget Effect: Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness.” Educational Researcher 46 (5): 234–249. https://doi.org/10.3102/0013189X17718797.
   Web of Science ®Google Scholar
• Kraft, M. A., and H. C. Hill. 2020. “Developing Ambitious Mathematics Instruction Through Web-Based Coaching: A Randomized Field Trial.” American Educational Research Journal 57 (6): 2378–2414. https://doi.org/10.3102/0002831220916840.
   Web of Science ®Google Scholar
• Liu, Y., J. Visone, M. B. Mongillo, and P. Lisi. 2019. “What Matters to Teachers if Evaluation is Meant to Help Them Improve?” Studies in Educational Evaluation 61 (June): 41–54. https://doi.org/10.1016/j.stueduc.2019.01.006.
   Google Scholar
• Marsh, J. A., S. Bush-Mecenas, K. O. Strunk, J. Arnold Lincove, and A. Huguet. 2017. “Evaluating Teachers in the Big Easy: How Organizational Context Shapes Policy Responses in New Orleans.” Educational Evaluation and Policy Analysis 39 (4): 539–570. https://doi.org/10.3102/0162373717698221.
   Web of Science ®Google Scholar
• Mehta, J., and S. Fine. 2015. “Bringing Values Back In: How Purposes Shape Practices in Coherent School Designs.” Journal of Educational Change 16 (4): 483–510. https://doi.org/10.1007/s10833-015-9263-3.
   Web of Science ®Google Scholar
• Mintrop, R., M. Ordenes, E. Coghlan, L. Pryor, and C. Madero. 2018. “Teacher Evaluation, Pay for Performance, and Learning Around Instruction: Between Dissonant Incentives and Resonant Procedures.” Educational Administration Quarterly 54 (1): 3–46. https://doi.org/10.1177/0013161X17696558.
   Web of Science ®Google Scholar
• Myung, J., and K. Martinez. 2013. Strategies for Enhancing the Impact of Post-Observation Feedback for Teachers. Stanford, CA: Carnegie Foundation for the Advancement of Teaching.
   Google Scholar
• Nelson, S. R., J. C. Leffler, and B. A. Hansen. 2009. Toward a Research Agenda for Understanding and Improving the Use of Research Evidence. Portland, OR: Northwest Regional Educational Laboratory.
   Google Scholar
• Nelson, F. L., and T. Sadler. 2013. “A Third Space for Reflection by Teacher Educators: A Heuristic for Understanding Orientations to and Components of Reflection.” Reflective Practice 14 (1): 43–57. https://doi.org/10.1080/14623943.2012.732946.
   Google Scholar
• Neumerski, C. M., J. A. Grissom, E. Goldring, T. A. Drake, M. Rubin, M. Cannata, and P. Schuermann. 2018. “Restructuring Instructional Leadership: How Multiple-Measure Teacher Evaluation Systems are Redefining the Role of the School Principal.” The Elementary School Journal 119 (2): 270–297. https://doi.org/10.1086/700597.
   Web of Science ®Google Scholar
• OECD. 2019. TALIS 2018 Results (Volume I): Teachers and School Leaders as Lifelong Learners. TALIS. OECD. https://doi.org/10.1787/1d0bc92a-en.
   Google Scholar
• Praetorius, A.-K., and C. Y. Charalambous. 2018. “Classroom Observation Frameworks for Studying Instructional Quality: Looking Back and Looking Forward.” ZDM 50 (3): 535–553. https://doi.org/10.1007/s11858-018-0946-0.
   Google Scholar
• Reinhorn, S. K., S. Moore Johnson, and N. S. Simon. 2017. “Investing in Development: Six High-Performing, High-Poverty Schools Implement the Massachusetts Teacher Evaluation Policy.” Educational Evaluation and Policy Analysis 39 (3): 383–406. https://doi.org/10.3102/0162373717690605.
   Web of Science ®Google Scholar
• Rigby, J. G. 2015. “Principals’ Sensemaking and Enactment of Teacher Evaluation.” Journal of Educational Administration 53 (3): 374–392. https://doi.org/10.1108/JEA-04-2014-0051.
   Web of Science ®Google Scholar
• Sartain, L., S. R. Stoelinga, E. R. Brown, K. K. Matsko, F. K. Miller, C. E. Durwood, J. Y. Jiang, and D. Glazer. 2011. Rethinking Teacher Evaluation in Chicago. Chicago, IL: Consortium on Chicago School Research at the University of Chicago.
   Google Scholar
• Schwartz, S. 1994. “The Fallacy of the Ecological Fallacy: The Potential Misuse of a Concept and the Consequences.” American Journal of Public Health 84 (5): 819–824. https://doi.org/10.2105/AJPH.84.5.819.
   PubMed Web of Science ®Google Scholar
• Shaked, H. 2018. “Why Principals Often Give Overly High Ratings on Teacher Evaluations.” Studies in Educational Evaluation 59 (December): 150–157. https://doi.org/10.1016/j.stueduc.2018.07.007.
   Google Scholar
• Smith, M. S. 2014. “Tools as a Catalyst for Practitioners’ Thinking.” Mathematics Teacher Educator 3 (1): 3–7. https://doi.org/10.5951/mathteaceduc.3.1.0003.
   Google Scholar
• Stecher, B., M. Garet, D. Holtzman, and L. Hamilton. 2012. “Implementing Measures of Teacher Effectiveness.” Phi Delta Kappan 94 (3): 39–43. https://doi.org/10.1177/003172171209400309.
   Web of Science ®Google Scholar
• Steinberg, M. P., and M. L. Donaldson. 2016. “The New Educational Accountability: Understanding the Landscape of Teacher Evaluation in the Post-NCLB Era.” Education Finance and Policy 11 (3): 1–40. https://doi.org/10.1162/EDFP_a_00186.
   Web of Science ®Google Scholar
• Taut, S., and K. Rakoczy. 2016. “Observing Instructional Quality in the Context of School Evaluation.” Learning and Instruction 46 (December): 45–60. https://doi.org/10.1016/j.learninstruc.2016.08.003.
   Google Scholar
• van de Grift, W. 2007. “Quality of Teaching in Four European Countries: A Review of the Literature and Application of an Assessment Instrument.” Educational Research 49 (2): 127–152. https://doi.org/10.1080/00131880701369651.
   Web of Science ®Google Scholar
• van Es, E. A., and M. G. Sherin. 2008. “Mathematics Teachers’ ‘Learning to Notice’ in the Context of a Video Club.” Teaching & Teacher Education 24 (2): 244–276. https://doi.org/10.1016/j.tate.2006.11.005.
   Web of Science ®Google Scholar
• Visone, J. D., M. B. Mongillo, and Y. Liu. 2022. “Teachers’ Perceptions of Collaboration within an Evolving Teacher Evaluation Context.” Journal of Educational Change 23 (4): 421–450. https://doi.org/10.1007/s10833-021-09424-4.
   Web of Science ®Google Scholar
• White, M., J. Luoto, K. Klette, and M. Blikstad-Balas. 2022. “Bringing the Conceptualization and Measurement of Teaching into Alignment.” Studies in Educational Evaluation 75 (December): 101204. https://doi.org/10.1016/j.stueduc.2022.101204.
   Google Scholar
• White, M., and M. Ronfeldt. 2023. Monitoring Rater Quality in Observational Systems: Issues Due to Unreliable Estimates of Rater Quality. Ann Arbor, MI: University of Michigan.
   Google Scholar