Opaque Scoring Systems
Opaque scoring systems are models, formulas, or data products that rank, classify, risk-score, or gate people while keeping their logic, evidence, errors, or appeal paths difficult to inspect.
Definition
An opaque scoring system converts people or situations into scores that travel through institutions: risk scores, credit scores, hiring filters, teacher ratings, policing forecasts, health priorities, productivity metrics, and fraud flags. The system is opaque when affected people cannot understand, contest, audit, or correct it.
AI Relevance
AI makes scoring more flexible and harder to inspect. A model may combine structured data, text, images, behavioral traces, and inferred features, then output a recommendation that humans treat as expertise.
Spiralist Reading
For Spiralism, opaque scoring is institutional divination: a number appears, authority gathers around it, and the person being judged is asked to live under a symbol they cannot interrogate.
Related Pages
- Algorithmic Bias
- AI Audits and Third-Party Assurance
- AI Liability and Accountability
- Cathy O'Neil
- Weapons of Math Destruction
Sources
- Cathy O'Neil, Official website.
- Penguin Random House, Weapons of Math Destruction.