Learning Forward
Equity and excellence in teaching and learning.
IDEAS
Chart a clear course
By Chase Nordengren and Thomas R. Guskey
Categories: Continuous improvement, Data, Evaluation & impact, Fundamentals, Outcomes, ResearchOctober 2020
Vol. 41, No. 5
When we engage in professional learning, we do it for one big reason: to get better at supporting students. Rigorous and thoughtful program evaluations can provide the critical connection between well-designed programs or initiatives and continuous improvement that builds essential knowledge and skills for educators. Evaluation helps us examine what has been accomplished in a professional learning initiative and identify course corrections that can help the initiative improve. The importance of high-quality evaluation is underscored in Learning Forward’s Standards for Professional Learning: Evaluation provides information that supports advocates, professional learning planners, and anyone who wants to know “about the contribution of professional learning to student achievement” (Learning Forward, 2011). Most importantly, high-quality evaluation provides the context around which educators make decisions about what professional learning
Read the remaining content with membership access. Join or log in below to continue.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis et quasi architecto beatae vitae dicta sunt explicabo. Nemo enim ipsam voluptatem quia voluptas sit aspernatur aut odit aut fugit, sed quia consequuntur magni dolores eos qui ratione voluptatem sequi nesciunt. Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit, sed quia non numquam eius modi tempora incidunt ut labore et dolore magnam aliquam quaerat voluptatem.
What evaluation looks like
As with many new professional learning partners, our work with Acorn Public Schools (pseudonym) began with a comprehensive needs assessment: NWEA selected 10% of schools participating in professional learning to represent their peers, and each participated in a half-day site visit that included principal and teacher interviews, observation of instructional planning sessions, and observation of instruction.
These data allowed us to create three distinct learning paths for schools in Acorn. While all ultimately will receive the same learning over time, each pathway prioritized the knowledge and skills that would provide teachers at that school the most substantial short-term successes based on each school’s priorities and existing skills.
The participant survey was the next step in this process. With responses from over 1,300 teachers, we learned that, while teachers rated their knowledge of how to use assessment data relatively high, their actual use of these skills was relatively low.
Comparing average scores on these measures with other districts who have taken our survey helped underscore the need for a particular focus in Acorn’s professional learning on how and why to use assessment skills.
This data informed adjustments to our professional learning plan that emphasized opportunities for practical application of assessment skills and focused on the specific contexts in which those skills could be applied in the district.
As next steps, district leaders in Acorn will now work with us to bring the teacher observation instrument and participant portfolio into regular use. While considering these tools, Acorn has recognized the importance of making sure its own measures of effective teaching align with the measures of effectiveness highlighted by our professional learning.
Building alignment between our evaluation tools and Acorn’s existing methods will provide the added benefit of deepening the alignment between our professional learning goals and district priorities.
References
Darling-Hammond, L., Hyler, M., & Gardner, M. (2017). Effective teacher professional development. learningpolicyinstitute.org/product/effective-teacher-professional-development-report.
Gersten, R., Taylor, M.J., Keys, T.D., Rolfhus, E., & Newman-Gonchar, R. (2014). Summary of research on the effectiveness of math professional development approaches (REL 2014–010). U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory.
Guskey, T.R. (2000).
Evaluating professional development.
Corwin Press.
Guskey, T.R. (2002). Does it make a difference? Evaluating professional development. Educational Leadership, 59(6), 45-51.
Guskey, T.R. (2014). Planning professional learning. Educational Leadership, 71(8), 10-16.
Hirsh, S. (2013). The impact factor: Why we can’t neglect professional learning evaluation. JSD, 34(5), 10-16.
Kirkpatrick, D.L. (1977). Evaluating training programs: Evidence vs. proof. Training and Development Journal, 31(11), 9-12.
Kirkpatrick, D.L. (1978). Evaluating in-house training programs. Training and Development Journal, 32(9), 6-9.
Kirkpatrick, D.L. (1996). Great ideas revisited: Techniques for evaluating training programs. Training & Development, 50(1), 54-59.
Learning Forward. (2011). Standards for Professional Learning. Learning Forward.
Lortie-Forgues, H. & Inglis, M. (2019). Rigorous large-scale educational RCTs are often uninformative: Should we be concerned? Educational Researcher. doi.org/10.3102/0013189×19832850.
Wiliam, D. (2019). Some reflections on the role of evidence in improving education. Educational Research and Evaluation, 25(1-2), 127-139.
Yoon, K.S., Lee, S. W.-Y., Duncan, T., Scarloss, B., & Shapley, K.L. (2007). Reviewing the evidence on how teacher professional development affects student achievement. ies.ed.gov/ncee/edlabs/regions/southwest/pdf/REL_2007033.pdf.
Chase Nordengren is a senior research scientist at NWEA, where he supports the professional learning team with primary and secondary research that drives instructional improvement. His work includes the development and execution of needs assessment and program evaluation services for partners, supporting school improvement processes, and thought leadership on formative assessment and student goal setting practices.
Thomas Guskey is a professor emeritus in the College of Education at the University of Kentucky, whose work is dedicated to helping teachers and school leaders use quality educational research to help all of their students learn. The author/ editor of 25 books and more than 250 articles and book chapters, he is an expert on educational measurement, evaluation, professional learning, assessment, and grading. His five-level framework of professional learning evaluation is a seminal resource in the field. His latest article for The Learning Professional, Learning Forward’s journal, is “Look beyond the satisfaction survey: A framework to evaluate results of professional learning.”
Categories: Continuous improvement, Data, Evaluation & impact, Fundamentals, Outcomes, Research
CURRENT ISSUE
Recent Issues
EVALUATING PROFESSIONAL LEARNING
February 2024
How do you know your professional learning is working? This issue digs...
TAKING THE NEXT STEP
December 2023
Professional learning can open up new roles and challenges and help...
REACHING ALL LEARNERS
October 2023
Both special education and general education teachers need support to help...
THE TIME DILEMMA
August 2023
Prioritizing professional learning time is an investment in educators and...
