Repeating Policy Behaviors Over and Over Again Despite the Evidence
According to Albert Einstein, the definition of insanity is to repeat the same behaviors over and over again in the hope that different results will materialize “the next time,” perhaps after this is fiddled with or that is fine-tuned. In the case of VAMs, it seems, educational policymaker are stuck in such a pattern of insanity, propagating and regenerating policies based on the use of students’ test scores to evaluate teachers, despite the fact that this has been a policy initiative of now almost 25 years past. Yes, we have research from now almost 25 years ago re: why this is a bad idea!
Gene V Glass published a study about just this in 1990. Click here to check it out. While this study was conducted pre-VAM (as we currently know it, particularly in terms of policy not form), the research-based reason why this is wrong remains the same. Regardless of the machine or statistical technique to be used, “the machine that is meant to do the world’s work must be observed in the actual world where [the VAM-based research] designs meet reality.”
The issues then, continue to be the issues today: “[t]he issue of ‘pupil performance in teacher evaluation’ needs to be discussed in a way that has not been separated from the many other pressures that shape a personnel system of assessment and rewards. The issue cannot be judged apart from how it exists in real places. The validity of such a process of evaluating teachers, its economy, its power to engender belief and win acceptance, depend on how it fits with many other realities of the teaching profession. What now must be addressed is how this notion gets applied in a context as complicated as education. How is the idea transformed as it moves from the statistician’s mind to the real world? How does it fare when the tradeoffs and balances are struck? Is the concept of Repeating Policy Behaviors Over and Over Again Despite the Evidence |: