Monday, October 5, 2015

CURMUDGUCATION: PA: Value-less Data

CURMUDGUCATION: PA: Value-less Data:

PA: Value-less Data






It's autumn in Pennsylvania, which means it's time to look at the rich data to be gleaned from our Big Standardized Test (called PSSA for grades 3-8, and Keytsone Exams at the high school level).

We love us some value added data crunching in PA (our version is called PVAAS, an early version of the value-added baloney model). This is a model that promises far more than it can deliver, but it also makes up a sizeable chunk of our school evaluation model, which in turn is part of our teacher evaluation model.

Of course the data crunching and collecting is supposed to have many valuable benefits, not the least of which is unleashing a pack of rich and robust data hounds who will chase the wild beast of low student achievement up the tree of instructional re-alignment. Like every other state, we have been promised that the tests will have classroom teachers swimming in a vast vault of data, like Scrooge McDuck on a gold bullion bender. So this morning I set out early to the states Big Data Portal to see what riches the system could reveal.

Here's what I can learn from looking at the rich data.
CURMUDGUCATION: PA: Value-less Data:


From the Vault: PVAAS in 2009





In one of my many side jobs, I'm a columnist at a local paper. After some of us were sent off for training in PVAAS back in October of 2009, I wrote this piece. This is where Pennsylvania was with this business six years ago.

(News-Herald, October 22) This week I was schooled by the state about more awesomeness that is Pennsylvania’s System of School Assessment (the PSSA tests). This latest big vat of coolaid was served up, ironically, in the Hemlock Room at IU6. When the state lowers itself to send consultants to instruct the poor hicks who toil in local school districts, there is always lots to learn.

For those of you still following the PSSA’s, we are down to the crunch. Remember, No Child Left Behind mandates that in four years, every single American school child will test above average. Since this is only slightly more likely than pigs flying out of Ed Rendell’s nose, the ever-benevolent state has leapt to the rescue with—more statistical tools!

The number crunching is called the Pennsylvania Value-Added Assessment System. “Value Added” is a useful term from the manufacturing world. Simple explanation: If I take a ten cent piece of sheet metal and turn it into a two dollar widget, I’ve added a buck ninety’s worth of value.

What that principle has to do with testing or educating students is not clear, unless the state means 
From the Vault: PVAAS in 2009