We live in the age of the algorithm. Decisions that affect our lives are not made by humans, but by mathematical models. In theory, this should lead to greater fairness: all are judged according to the same rules, without bias. But in reality, the exact opposite is true. The models used today are opaque, unregulated and uncontestable, even when they are wrong. This leads to a reinforcement of discrimination: if a poor student cannot get a loan because a loan model considers him too risky (by virtue of his or her zip code), he will be excluded from the type of education that could lift him out of poverty, resulting in a vicious spiral. Models prop up the lucky and punish the oppressed: welcome to the dark side of big data.
O'Neil sets out the models that shape our future, as individuals and as a society. These "weapons of mathematical destruction" qualify teachers and students, ...read more