Learning Forward
Equity and excellence in teaching and learning.
Do You See What I See?
District designs learning plan to develop a clear vision of effective instruction
By Learning Forward
Categories: Educator evaluation, School leadershipDecember 2015
Read the remaining content with membership access. Join or log in below to continue.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis et quasi architecto beatae vitae dicta sunt explicabo. Nemo enim ipsam voluptatem quia voluptas sit aspernatur aut odit aut fugit, sed quia consequuntur magni dolores eos qui ratione voluptatem sequi nesciunt. Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit, sed quia non numquam eius modi tempora incidunt ut labore et dolore magnam aliquam quaerat voluptatem.
Steps In The Process
Guiding Assumptions
- Establishing clear guidelines and thorough, intense practice through experience with peers strengthens inter-rater reliability and observer agreement. If observers and raters have clear and concise instructions about how to rate behavior and can come to agreement about this rating, this agreement increases consistent ratings across the district.
- When using qualitative data using two or more observers, developing inter-rater reliability and observer agreement ensures that results generated will be useful in understanding the effectiveness of all teachers based on common vocabulary and can be used to design professional learning.
- If even one of the observers is erratic on his or her scoring system, the entire system may be jeopardized as perceptions of others may interfere with its effectiveness.
- Developing inter-rater reliability and observer agreement is more about having clear distinguishing descriptors, exemplars, and conversations than about simple agreement.
References
Bill & Melinda Gates Foundation. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Author.
Graham, M., Milanowski, A., & Miller, J. (2012, February). Measuring and promoting inter-rater agreement of teacher and principal performance ratings. Center for Educator Compensation Reform. Available at https://files.eric.ed.gov/fulltext/ED532068.pdf.
Hirsh, S., Psencik, K., & Brown, F. (2014). Becoming a learning system. Oxford, OH: Learning Forward.
Kimball, S. & Milanowski, A. (2009). Examining teacher evaluation validity and leadership decision making within a standards-based evaluation system. Educational Administration Quarterly, 45(1), 34-70.
Learning Forward is the only professional association devoted exclusively to those who work in educator professional development. We help our members plan, implement, and measure high-quality professional learning so they can achieve success with their systems, schools, and students.
Categories: Educator evaluation, School leadership
CURRENT ISSUE
Recent Issues
TAKING THE NEXT STEP
December 2023
Professional learning can open up new roles and challenges and help...
REACHING ALL LEARNERS
October 2023
Both special education and general education teachers need support to help...
THE TIME DILEMMA
August 2023
Prioritizing professional learning time is an investment in educators and...
ACCELERATING LEARNING
June 2023
Acceleration aims to ensure all students overcome learning gaps to do...
