An Open Letter to Bill Gates: Why Not Measure This?
Yesterday I posted an essay that pointed out that Bill Gates apparently uses a different set of outcomes in choosing a school for his own children than the measurable ones his foundation advocates for the children of the less fortunate. I shared the thoughts of mathematician Cathy O'Neil, who points out
...the person who defines the model defines success, and by obscuring this power behind a data collection process and incrementally improved model results, it seems somehow sanitized and objective when it's not.
Don't be fooled by the mathematical imprimatur: behind every model and every data set is a political process that chose that data and built that model and defined success for that model.As I pointed out yesterday, there are many outcomes that we value that are difficult to measure, leading to the first order of bias here, towards outcomes that are easily quantified. But there is a second order of bias at work