Menu

Gauge Impact With 5 Levels Of Data

By Learning Forward
February 2016
Effective professional learning evaluation requires consideration of five critical stages or levels of information (Guskey, 2000a, 2002a, 2005). These five levels represent an adaptation of an evaluation model developed by Kirkpatrick (1959, 1998) for judging the value of supervisory training programs in business and industry. Kirkpatrick’s model, although widely applied, has seen limited use in education because of inadequate explanatory power. While helpful in addressing a broad range of “what” questions, many find it lacking when it comes to explaining “why” (Alliger & Janak, 1989; Holton, 1996). The five levels in this model are hierarchically arranged, from simple to more complex. With each succeeding level, the process of gathering evaluation data requires more time and resources. And because each level builds on those that come

Read the remaining content with membership access. Join or log in below to continue.

Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis et quasi architecto beatae vitae dicta sunt explicabo. Nemo enim ipsam voluptatem quia voluptas sit aspernatur aut odit aut fugit, sed quia consequuntur magni dolores eos qui ratione voluptatem sequi nesciunt. Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit, sed quia non numquam eius modi tempora incidunt ut labore et dolore magnam aliquam quaerat voluptatem.

Log In
   

Authors

Thomas R. Guskey

Thomas R. Guskey is professor of educational psychology in the College of Education at the University of Kentucky. He served on the policy research team of the National Commission on Teaching and America’s Future and on the task force to develop the Standards for Staff Development. He was named a fellow in the American Educational Research Association, which also honored him in 2006 for his outstanding contribution relating research to practice.

Thomas R. Guskey is an international expert in evaluation design, analysis, and educational reform. His essay explains why the Data standard for professional learning is an essential foundation for all of the other standards. “Because of its indispensable and fundamental nature,” Guskey writes, “no other standard is more important or more vital to the purpose of the Standards for Professional Learning.”

The full essay explores the meaning of data in the context of professional learning. In this excerpt, Guskey examines the use of data in the systemic evaluation of professional learning.

Professional learning that increases educator effectiveness and results for all students uses a variety of sources and types of student, educator, and system data to plan, assess, and evaluate professional learning.

About the book

guage-impact-with-5-levels-of-impactGuskey, T.R., Roy, P., & von Frank, V. (2014). Reach the highest standard in professional learning: Data. Thousand Oaks, CA: Corwin. Excerpted with permission.

References

Achinstein, B. (2002). Conflict amid community: The micropolitics of teacher collaboration. Teachers College Record, 104(3), 421-455.

Alliger, G.M. & Janak, E.A. (1989). Kirkpatrick’s levels of training criteria: Thirty years later. Personnel Psychology, 42(2), 331-342.

Chester, M.D. (2005). Making valid and consistent inferences about school effectiveness from multiple measures. Educational Measurement: Issues and Practice, 24(4), 40-52.

Cody, C.B. & Guskey, T.R. (1997). Professional development. In J.C. Lindle, J.M. Petrosko, & R.S. Pankratz (Eds.), 1996 Review of research on the Kentucky Education Reform Act (pp. 191-209). Frankfort, KY: The Kentucky Institute for Education Research.

Colton, A.B. & Langer, G.M. (2005). Looking at student work. Educational Leadership, 62(5), 22.

Corcoran, T., Fuhrman, S.H., & Belcher, C.L. (2001). The district role in instructional improvement. Phi Delta Kappan, 83(1), 78-84.

Epstein, J.L. & Associates. (2009). School, family, and community partnerships: Your handbook for action (3rd ed.). Thousand Oaks, CA: Corwin.

Guskey, T.R. (1997). Research needs to link professional development and student learning. Journal of Staff Development, 18(2), 36-40.

Guskey, T.R. (2000a). Evaluating professional development. Thousand Oaks, CA: Corwin.

Guskey, T.R. (2000b). Grading policies that work against standards … and how to fix them. NASSP Bulletin, 84(620), 20-29.

Guskey, T.R. (2001a). Backward planning: An outcomes-based strategy for professional development. Curriculum in Context, 28(2), 18-20.

Guskey, T.R. (2001b). The backward approach. Journal of Staff Development, 22(3), 60.

Guskey, T.R. (2002a). Does it make a difference? Evaluating professional development. Educational Leadership, 59(6), 45-51.

Guskey, T.R. (2002b). Professional development and teacher change. Teachers and Teaching: Theory and Practice, 8(3), 381-391.

Guskey, T.R. (2002c). How’s my kid doing? A parents’ guide to grades, marks, and report cards. San Francisco, CA: Jossey-Bass.

Guskey, T.R. (2003). Scooping up meaningful evidence. JSD, 24(4), 27-30.

Guskey, T.R. (2005). Taking a second look at accountability. JSD, 26(1), 10-18.

Guskey, T.R. (2007). Multiple sources of evidence: An analysis of stakeholders’ perceptions of various indicators of student learning. Educational Measurement: Issues and Practice, 26(1), 19-27.

Guskey, T.R. (2012). The rules of evidence. JSD, 33(4), 40-43.

Guskey, T.R. (2014). Planning professional learning. Educational Leadership, 71(8), 10-16.

Guskey, T.R. & Sparks, D. (2004). Linking professional development to improvements in student learning. In E.M. Guyton & J.R. Dangel (Eds.), Teacher education yearbook XII: Research linking teacher preparation and student performance. Dubuque, IA: Kendall/Hunt.

Guskey, T.R. & Yoon, K.S. (2009). What works in professional development? Phi Delta Kappan, 90(7), 495-500.

Hall, G.E. & Hord, S.M. (1987). Change in schools: Facilitating the process. Albany, NY: SUNY Press.

Hirsh, S. (2012). Student outcomes are the driving force behind professional learning decisions. JSD, 33(5), 72.

Holton, E.F. (1996). The flawed four-level evaluation model. Human Resource Development Quarterly, 7(1), 5-21.

Kirkpatrick, D.L. (1959). Techniques for evaluating training programs. A four-part series beginning in the November issue (Vol. 13, No. 11) of Training and Development Journal (then titled Journal for the American Society of Training Directors).

Kirkpatrick, D.L. (1998). Evaluating training programs: The four levels (2nd ed.). San Francisco, CA: Berrett-Koehler Publishers.

Langer, G.M. & Colton, A.B. (1994). Reflective decision making: The cornerstone of school reform. Journal of Staff Development, 15(1), 2-7.

Little, J.W. (1990). The persistence of privacy: Autonomy and initiative in teachers’ professional relations. Teachers College Record, 91(4), 509-536.

Parry, S.B. (1996). Measuring training’s ROI. Training & Development, 50(5), 72-75.

Phillips, J.J. (1997). Return on investment in training and performance improvement programs. Houston, TX: Gulf Publishing Co.

Raudenbush, S.W. (2005). Learning from attempts to improve schooling: The contribution of methodological diversity. Educational Researcher, 34(5), 25-31.

Sparks, D. (1996, February). Viewing reform from a systems perspective. The Developer, 2, 6.

Sparks, D. & Hirsh, S. (1997). A new vision for staff development. Alexandria, VA: ASCD.

Supovitz, J.A. (2002). Developing communities of instructional practice. Teachers College Record, 104(8), 1591-1626.

Todnem, G. & Warner, M.P. (1993). Using ROI to assess staff development efforts. Journal of Staff Development, 14(3), 32-34.


+ posts

Learning Forward is the only professional association devoted exclusively to those who work in educator professional development. We help our members plan, implement, and measure high-quality professional learning so they can achieve success with their systems, schools, and students.


Search
The Learning Professional


Published Date

CURRENT ISSUE




  • Just released!
    Order Today
  • Recent Issues

    BUILDING THE PIPELINE
    December 2020

    Excellent educators are made, not born, and it takes a system-wide...

    SUPPORTING EACH OTHER
    October 2020

    What does it mean to support learning in challenging times? It means...

    TURNING TO TECHNOLOGY
    August 2020

    Technology constantly creates new opportunities for professional learning....

    WHAT NOW?
    June 2020

    The COVID-19 pandemic has changed school as we know it. As we face an...