Controversial teacher evaluation method is on trial — literally — and the judge is not amused
Here is a report on what happened this week in a New York court where a judge is hearing the case brought by Sheri G. Lederman, a fourth-grade teacher in the Great Neck public school district, against state education officials over their controversial method of evaluating her — and, by extension, other N.Y. teachers.
The method is known as “value-added modeling,” or VAM, and it purports to be able to use student standardized test scores to determine the “value” of a teacher while factoring out every other influence on a student (including, for example, hunger, sickness, and stress). One way it works is by predicting, through a complicated computer model, how students with similar characteristics are supposed to perform on the exams, and teachers are then evaluated on how well their students measure up to the theoretical students. New York is just one of the many states where VAM is a key component of teacher assessment. Evaluation experts have warned policymakers that this method is not reliable for evaluating teachers, but VAM became popular among school reformers as a “data-driven” evaluation solution.
Lederman’s suit against state education officials — including John King, the former state education commissioner who is now a top adviser to U.S. Education Secretary Arne Duncan — challenges the rationality of the VAM model, and it alleges that the New York State Growth Measures “actually punishes excellence in education through a statistical black box which no rational educator or fact finder could see as fair, accurate or reliable.”
Here’s what happened to Lederman: In 2012-13, 68.75 percent of her New York students met or exceeded state standards in both English and math. She was labeled “effective” that year. In 2013-2014, her students’ test results were very similar, but she was rated “ineffective.” Meanwhile, her district superintendent, Thomas Dolan, declared that Lederman — whose students received standardized math and English Language Arts test scores consistently higher than the state average — has a “flawless record.”
Lederman and her attorney husband, Bruce Lederman, sued and obtained affidavits of support from a number of education experts. You can read about what they said here.
On Aug. 12, New York Supreme Court Justice Roger McDonough presided over a hearing in the case — and he was not amused with the state’s case. Following is a report on the hearing by Carol Burris, the executive director of the nonprofit Network for Public Education Fund. Burris retired in June as an award-winning principal at a New York high school, and she is the author of numerous articles, books and blog posts (including on The Answer Sheet) about the botched school reform efforts in her state.
By Carol Burris
The exasperated New York Supreme Court judge, Roger McDonough, tried to get Assistant Attorney General Galligan to answer his questions. He was looking for clarity and instead got circuitous responses about bell curves, “outliers” and adjustments. Fourth-grade teacher Sheri Lederman’s VAM score of “ineffective” was on trial.
The more Ms. Galligan tried to defend the bell curve of growth scores as science, the more the judge pushed back with common sense. It was clear that he did his homework. He understood that the New York State Education Department’s VAM system artificially set the percentage of “ineffective” teachers at 7 percent. That arbitrary decision clearly troubled him. “Doesn’t the bell curve make it subjective? There has to be failures,” he asked.
The defender of the curve said that she did not like the “failure” word.
The judge quipped, “Ineffectives, how about that?” Those in attendance laughed.
Ms. Galligan preferred the term “outlier.” Those who got ineffective growth Controversial teacher evaluation method is on trial — literally — and the judge is not amused - The Washington Post: