Blog · Review Essay · May 2026

AI Snake Oil and the Belief Machine of Prediction

Arvind Narayanan and Sayash Kapoor's AI Snake Oil is a book about a basic discipline that AI culture badly needs: do not ask whether something is "AI" in the abstract; ask what kind of system it is, what claim is being made for it, what evidence supports that claim, and who bears the cost when the claim fails. Its most useful contribution is a vocabulary for separating real capability from institutional wishful thinking.

The Book

AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference was published by Princeton University Press in September 2024. Google Books lists the illustrated Princeton University Press edition at 360 pages, with ISBN 9780691249643 for one edition. Princeton's Center for Information Technology Policy identifies the authors as CITP Director and computer science professor Arvind Narayanan and computer science graduate student Sayash Kapoor.

The book grew out of an existing public project. Princeton describes Narayanan and Kapoor as AI scholars trying to help readers distinguish hype, misinformation, misunderstanding, and real technical progress. Their associated newsletter has since shifted toward the "AI as normal technology" frame: AI can be powerful and transformative without needing to be treated as magic, destiny, or impending superintelligence.

The book's structure matters. It distinguishes predictive AI, generative AI, content moderation systems, social-media recommendation claims, existential-risk arguments, and the social conditions under which AI myths spread. That taxonomy is not pedantry. It is the core of the argument. Many bad AI decisions begin when unlike systems are fused into one glamorous word.

The Category Error

AI Snake Oil is strongest when it treats "AI" as a dangerous umbrella term. Generative chatbots, facial-recognition systems, hiring-screening products, credit scoring, fraud detection, content moderation, recommender systems, and speculative claims about future agents do not fail or succeed for the same reasons. They should not inherit one another's aura.

This matters because a breakthrough in one area can become marketing fuel for a much weaker claim somewhere else. A fluent language model improves, and suddenly a vendor claims to infer personality from video. Image generation advances, and a school district buys detection software that cannot bear the institutional burden placed on it. Model benchmarks rise, and a workplace dashboard presents prediction as neutral knowledge about workers.

The book's basic hygiene is therefore conceptual. Before evaluating an AI claim, name the task. Is the system generating plausible text, classifying a pattern, ranking applicants, predicting future conduct, moderating speech, summarizing evidence, or recommending action? What is the base rate? What is the ground truth? What would count as success? Who can contest the output? Without those questions, "AI" becomes a costume worn by any product that wants borrowed authority.

Prediction as Institutional Fantasy

The book's most important target is predictive AI in high-stakes settings. Princeton's interview with the authors emphasizes their distinction between generative AI, which dominates public discussion, and predictive AI, which is often already deployed in consequential domains. The examples named there include decisions around jobs, bail, medical care, insurance, and repeated rejection by common vendors.

That focus gives the book its political force. Predictive AI is attractive because institutions want foresight without responsibility. A hiring department wants to know who will succeed before training anyone. A court wants risk without uncertainty. An insurer wants care duration without clinical judgment. A platform wants moderation at scale without a correspondingly scaled public obligation. Prediction promises to turn a contested social future into an administrable present.

The danger is not only inaccuracy. Inaccuracy matters, but the deeper danger is that uncertain inferences become operational facts. A score can deny a job, block a benefit, alter a sentence, trigger surveillance, or justify a refusal. Once embedded in workflow, the prediction no longer feels like a claim about the future. It becomes part of the environment in which the affected person must live.

Why the Myths Persist

AI Snake Oil is also a book about belief formation. It asks why weak claims keep circulating even when evidence is thin. The answer is not simply ignorance. AI hype survives because it serves institutions: vendors sell certainty, managers buy legitimacy, journalists get a story, investors get a frontier, policymakers get urgency, and anxious publics get a narrative that makes scattered changes feel like one coherent event.

This is why debunking alone is not enough. The myth has infrastructure. It travels through demos, benchmarks, procurement decks, founder interviews, model-release rituals, trade conferences, analyst reports, and screenshots of surprising outputs. It also travels through fear. A claim that a system may change everything can suspend ordinary evaluation, because delay starts to feel like negligence.

Narayanan and Kapoor's corrective is not anti-AI. It is anti-enchantment. Some systems work. Some are useful in limited domains. Some harms are real now. Some fears are displaced from mundane deployment into theatrical futures. The book's discipline is to keep those categories apart long enough for public judgment to function.

The AI-Age Reading

The review shelf on this site already contains books about opaque scoring, digital poorhouses, algorithmic bias, surveillance capitalism, labor platforms, dashboards, bureaucratic metrics, and media systems that train public perception. AI Snake Oil belongs beside them because it supplies a field test for the current moment: what exactly is being claimed, and what evidence would make that claim responsible?

That test is especially useful for agentic AI. As systems move from answer generation toward tool use, procurement, scheduling, coding, writing, customer service, education, medical documentation, and administrative triage, the temptation will be to treat observed fluency as transferable competence. The book warns against that move. A model that can summarize a policy does not automatically deserve authority to apply it. A chatbot that can sound empathetic does not automatically become care. An agent that can complete a web task does not automatically become trustworthy delegation.

The same test applies to AI governance. Regulations, audits, model cards, benchmarks, and safety cases can become snake oil too if they certify the wrong claim. A disclosure that says a system is AI-generated does not prove truth. A benchmark score does not prove fit for deployment. A fairness metric does not prove justice. A human-in-the-loop label does not prove meaningful human control.

Where the Book Needs Care

The book's clarity is also its risk. A sharp distinction between workable AI and snake oil can make the reader expect cleaner boundaries than real deployments provide. Many systems are mixed: useful for some people, harmful for others, adequate in low-stakes settings, dangerous when scaled, impressive in a demo, brittle under adversarial pressure, or reliable only when surrounded by human work that marketing ignores.

The authors know this, but readers should resist turning "snake oil" into a universal insult. The category is most useful when tied to a specific claim. "This product cannot predict employee success from facial movements" is stronger than "AI hiring is fake." "This model card does not establish clinical safety" is stronger than "AI medicine is hype." Precision is the difference between critique and counter-hype.

The book also pushes against some superintelligence-centered narratives. That will be valuable for many readers, but it should not become an excuse to ignore frontier-model governance, model misuse, security, concentration of compute, labor displacement, or delegated agency. The better reading is not that only near-term harms matter. It is that every claimed harm, near or far, should be disciplined by mechanisms, evidence, incentives, and deployment context.

The Site Reading

The recurring pattern is simple: an institution wants the world to become legible enough to act on, and a technical system offers a legibility that feels cleaner than the world itself. Predictive AI intensifies that pattern because it makes the future look administrable. It turns a person into a likelihood, a likelihood into a decision, and a decision into a record that later systems may treat as evidence.

AI Snake Oil gives a practical antidote to that loop. Ask what the system is actually doing. Ask whether the target can be predicted. Ask who supplied the labels. Ask whether the metric is the mission. Ask whether a person can appeal. Ask whether the institution is using the model to learn, or using the model to stop listening.

The book's deepest value is that it lowers the temperature without lowering the stakes. AI does not need to be a god, demon, oracle, or species successor to matter. It is enough that institutions are buying systems that classify people, allocate attention, reshape work, mediate knowledge, and convert uncertain claims into operational reality. The cure for snake oil is not cynicism. It is evidence joined to institutional accountability.

Sources

Book links are paid affiliate links. As an Amazon Associate I earn from qualifying purchases.

Return to Blog · Return to Books