Learning Forward
Equity and excellence in teaching and learning.
Do You See What I See?
District designs learning plan to develop a clear vision of effective instruction
By Learning Forward
Categories: Educator evaluation, School leadershipDecember 2015
Read the remaining content with membership access. Join or log in below to continue.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis et quasi architecto beatae vitae dicta sunt explicabo. Nemo enim ipsam voluptatem quia voluptas sit aspernatur aut odit aut fugit, sed quia consequuntur magni dolores eos qui ratione voluptatem sequi nesciunt. Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit, sed quia non numquam eius modi tempora incidunt ut labore et dolore magnam aliquam quaerat voluptatem.
Steps In The Process
Guiding Assumptions
- Establishing clear guidelines and thorough, intense practice through experience with peers strengthens inter-rater reliability and observer agreement. If observers and raters have clear and concise instructions about how to rate behavior and can come to agreement about this rating, this agreement increases consistent ratings across the district.
- When using qualitative data using two or more observers, developing inter-rater reliability and observer agreement ensures that results generated will be useful in understanding the effectiveness of all teachers based on common vocabulary and can be used to design professional learning.
- If even one of the observers is erratic on his or her scoring system, the entire system may be jeopardized as perceptions of others may interfere with its effectiveness.
- Developing inter-rater reliability and observer agreement is more about having clear distinguishing descriptors, exemplars, and conversations than about simple agreement.
References
Bill & Melinda Gates Foundation. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Author.
Graham, M., Milanowski, A., & Miller, J. (2012, February). Measuring and promoting inter-rater agreement of teacher and principal performance ratings. Center for Educator Compensation Reform. Available at https://files.eric.ed.gov/fulltext/ED532068.pdf.
Hirsh, S., Psencik, K., & Brown, F. (2014). Becoming a learning system. Oxford, OH: Learning Forward.
Kimball, S. & Milanowski, A. (2009). Examining teacher evaluation validity and leadership decision making within a standards-based evaluation system. Educational Administration Quarterly, 45(1), 34-70.
Learning Forward is the only professional association devoted exclusively to those who work in educator professional development. We help our members plan, implement, and measure high-quality professional learning so they can achieve success with their systems, schools, and students.
Categories: Educator evaluation, School leadership
CURRENT ISSUE
Subscribe
Recent Issues
LEARNING TO PIVOT
August 2024
Sometimes new information and situations call for major change. This issue...
GLOBAL PERSPECTIVES
June 2024
What does professional learning look like around the world? This issue...
WHERE TECHNOLOGY CAN TAKE US
April 2024
Technology is both a topic and a tool for professional learning. This...
EVALUATING PROFESSIONAL LEARNING
February 2024
How do you know your professional learning is working? This issue digs...
