Tuesday, July 17, 2012

Shanker Blog » How Often Do Proficiency Rates And Average Scores Move In Different Directions?

Shanker Blog » How Often Do Proficiency Rates And Average Scores Move In Different Directions?:


How Often Do Proficiency Rates And Average Scores Move In Different Directions?

New York State is set to release its annual testing data tomorrow. Throughout the state, and especially in New York City, we will hear a lot about changes in school and district proficiency rates. The rates themselves have advantages – they are easy to understand, comparable across grades and reflect a standards-based goal. But they also suffer severe weaknesses, such as their sensitivity to where the bar is set and the fact that proficiency rates and the actual scores upon which they’re based can paint very different pictures of student performance, both in a given year as well as over time. I’ve discussed this latter issue before in the NYC context (andelsewhere), but I’d like to revisit it quickly.
Proficiency rates can only tell you how many students scored above a certain line; they are completely uninformative as to how far above or below that line the scores might be. Consider a hypothetical example: A