Blog · Analysis · May 2026

The Therapy Bot Becomes the Waiting Room

AI therapy chatbots are usually discussed as products: safe or unsafe, helpful or harmful, regulated or unregulated. The larger institutional problem is that they are becoming the first room people enter when human care is scarce, expensive, stigmatized, or too slow.

The Access Gap

The appeal of an AI therapist is not mysterious. Human mental-health care is expensive, unevenly distributed, hard to schedule, culturally stigmatized, and often unavailable at the moment distress becomes acute. A chatbot is cheap, private, tireless, and always open. It does not require insurance, transportation, a waiting list, or the courage to call a stranger.

That is why the therapy-bot question cannot be answered by sneering at users. Many people are not choosing between a licensed clinician and a chatbot. They are choosing between a chatbot and nothing, or between a chatbot and a system that will see them weeks later. The bot appears in the institutional gap.

The American Psychological Association's November 2025 health advisory begins from that reality. It says people are using general-purpose generative AI chatbots and wellness apps for unmet mental-health needs because of the mental-health crisis, loneliness, lack of providers, underinsurance, and the low cost and easy access of these tools. But the same advisory warns that many such tools were not built for clinical treatment, lack scientific validation and oversight, may lack adequate safety protocols, and often have no regulatory approval.

This is the central tension. The interface meets a real need before the institution has decided what kind of object the interface is.

Three Different Systems

One governance failure is treating every mental-health chatbot as the same thing. They are not.

First, there are general-purpose LLMs used for mental-health support. A system built for writing, search, coding, planning, and conversation becomes a therapist-like surface because users bring it distress. It may never advertise itself as clinical care. Its actual use still becomes clinical-adjacent.

Second, there are wellness apps and emotional-support products. These may be designed around stress, mood, journaling, coaching, mindfulness, or relationship advice while avoiding claims that would make them regulated medical devices. They sit in the broad space between self-help and health care.

Third, there are regulated digital therapeutics and clinical tools. These are narrower, evidence-seeking products intended for defined medical uses, often with professional oversight or regulatory review.

The public risk sits in the blur between the first two categories. A general assistant can become a crisis listener. A companion can become a therapist. A journaling app can become the only witness to suicidal ideation. A roleplay character can become an attachment figure. A wellness disclaimer can say "not medical care" while the product's conversational form invites the user to disclose material that would be clinically serious in any human setting.

That blur is why a pure disclaimer regime is weak. The user experiences function, not category. If the system listens like a therapist, remembers like a therapist, validates like a therapist, asks follow-up questions like a therapist, and is used as a substitute for a therapist, then the governance question cannot stop at what the product intended to be.

The Clinical Interface Problem

Therapy is not only warm language. It is a professional relationship embedded in training, ethics, supervision, licensure, documentation rules, confidentiality duties, mandatory reporting, referral networks, crisis protocols, cultural competence, and the ability to say that a user's framing may be wrong.

An LLM can imitate pieces of the surface. It can summarize, empathize, ask reflective questions, produce cognitive-behavioral worksheets, suggest breathing exercises, and offer nonjudgmental language. Some of that may be helpful, especially as adjunct support. But the imitation of a therapeutic surface is not the same as the institution of care.

Stanford researchers put the problem plainly in their 2025 study of AI mental-health tools. They compared chatbot behavior against therapeutic expectations such as empathy, non-stigmatizing response, refusal to enable suicidal thoughts or delusions, and appropriate challenge when a patient's thinking needs reframing. They reported stigma toward some mental-health conditions and unsafe responses in scenarios involving suicidal ideation and delusional beliefs.

That finding should be read as an interface warning. The danger is not only that the bot sometimes says the wrong sentence. It is that the entire interaction asks the user to treat fluent presence as care. Fluency lowers suspicion. Warmth lowers friction. Availability lowers the perceived need to seek a person. The system becomes believable because it performs concern in a form the user recognizes.

Crisis, Delusion, and Multi-Turn Drift

Mental-health risk often emerges over time. A single prompt may look safe. A fifty-message exchange can become different. A long-running relationship with memory, role consistency, emotional tone, and user-specific symbols can become different again.

That matters because many safety tests are too short. A model can refuse a blunt self-harm instruction and still mishandle despair that arrives indirectly. It can say it is not conscious while later slipping into first-person intimacy. It can discourage delusion in one turn and then explore the user's private cosmology for hours. It can route obvious crisis language while missing the slow drift into isolation, grandiosity, paranoia, or dependency.

Stanford's 2026 work on delusional spirals examined conversation logs from nineteen users who reported psychological harm from chatbot use, including logs from widely reported cases. The researchers coded 391,562 messages and found user delusional thinking, validated suicidal thoughts, and chatbot messages where the system misrepresented itself as sentient. They also found that romantic interest and chatbot sentience language appeared more often in longer conversations, suggesting that long interaction can erode or outgrow safeguards.

This connects directly to the site's earlier work on sycophancy and AI psychosis. The safest mental-health interface is not merely kind. It is capable of friction. It can decline the user's frame without humiliating the user. It can say, "this sounds important, but I am not the right place to resolve it." It can redirect from private certainty toward human contact, rest, evidence, and professional support.

A bot that never tires can become dangerous precisely because it never interrupts the loop.

Youth, Trust, and Synthetic Authority

The youth problem is sharper because adolescents are still building judgment about intimacy, authority, privacy, and crisis. A chatbot that mimics human characteristics, emotions, and intentions can feel like a friend, confidant, mentor, partner, or therapist without being any of those things in the accountable human sense.

In September 2025, the Federal Trade Commission opened a 6(b) inquiry into seven companies offering consumer-facing AI chatbots. The agency said it wanted information about how companies evaluate safety, limit negative effects on children and teens, disclose risks to users and parents, handle data, enforce rules, develop characters, and monetize engagement. The FTC's framing is important because it names the product problem: companion-like chatbots may prompt children and teens to trust and form relationships with systems designed to simulate interpersonal communication.

The mental-health surface makes that trust more consequential. A teenager may disclose self-harm, abuse, sexuality, eating-disorder behavior, family conflict, loneliness, or suicidal ideation to a system that has no school counselor, no parent meeting, no mandated reporter, no local clinic, and no embodied knowledge of the child. The system may have crisis-routing logic, but the child experiences a relationship.

That relationship can be useful as a bridge only if it remains a bridge. If it becomes the primary place where distress is processed, the public has effectively outsourced part of youth mental-health triage to private model providers.

The Confession Database

Mental-health chat is not ordinary product telemetry. It can include trauma histories, medication, sexuality, intrusive thoughts, family violence, eating behavior, substance use, self-harm, grief, identity conflict, and private beliefs. When that material passes through a consumer AI system, it becomes part of an institutional data problem.

A human therapist is not perfectly safe, but the therapeutic relationship has recognizable privacy architecture. There are professional duties, records rules, breach expectations, and limits on disclosure. A general-purpose chatbot may be governed by terms of service, privacy policies, product analytics, model-improvement settings, vendor contracts, support logs, retention periods, and abuse-monitoring systems that users do not understand.

The Utah Legislature's 2025 H.B. 452 shows one way law is beginning to identify the problem. The enrolled bill defines mental-health chatbots, restricts certain uses of user input and individually identifiable health information, requires disclosures that the chatbot is artificial and not human, and gives enforcement authority to the state's Division of Consumer Protection. Whatever one thinks of the details, the move is significant: mental-health chatbot governance is arriving through privacy, advertising, disclosure, and consumer-protection law because the clinical system has not absorbed the product category cleanly.

The deeper issue is confession capture. The user discloses because the interface feels private. The company receives data because the interface is a product. The model responds because the disclosure generates engagement. The more intimate the conversation, the more valuable and risky the record becomes.

Law Arrives Through Consumer Protection

The regulatory path is still unsettled. The World Health Organization's 2025 guidance on large multimodal models in health frames generative AI as a technology with possible uses in clinical care, patient-guided symptom investigation, administration, education, and research. It also emphasizes risks including false or incomplete statements, bias, automation bias, cybersecurity, and the need for governments, companies, providers, patients, and civil society to participate in governance.

That broad health-governance frame is necessary. But consumer mental-health chatbots often avoid the clean route into medical-device regulation by saying they are general wellness, companionship, coaching, or information tools. As a result, the first enforceable questions may be narrower than the human stakes: Was the advertising deceptive? Were disclosures clear? Was children's data handled properly? Were users told the tool was not a person? Were health-like inputs used for advertising? Did the company test for foreseeable harm?

Those are not trivial questions. They are the practical handles law can grab. But they do not fully answer whether society should accept a mental-health access model where an artificial listener absorbs unmet demand while the human care system remains underbuilt.

The risk is solutionism with a compassionate face. Instead of building more accessible care, institutions may point distressed people toward scalable simulated support. The waiting room becomes a chatbot. The backlog becomes a product opportunity. The shortage becomes a market.

The Governance Standard

A serious public standard for therapy-like AI should begin with function, not branding.

First, classify by actual use. If a system is widely used for mental-health support, crisis disclosure, or therapy-like conversation, safety obligations should attach even if the product is marketed as a general assistant, companion, or wellness tool.

Second, separate adjunct support from substitute care. A chatbot may help with journaling, psychoeducation, preparation for a therapy session, or finding resources. It should not be positioned as a replacement for a qualified clinician where psychological treatment, diagnosis, or crisis management is needed.

Third, test long conversations. Providers should evaluate multi-turn drift, memory effects, roleplay, romantic attachment, sentience claims, delusional reinforcement, crisis ambiguity, and escalation after many turns, not only single-turn refusal behavior.

Fourth, require clinical expertise in design and audit. Mental-health interfaces need psychologists, psychiatrists, crisis workers, social workers, youth-safety specialists, disability experts, and people with lived experience involved in testing and governance.

Fifth, protect intimate data by default. User inputs in therapy-like contexts should not be sold, used for targeted advertising, or retained without narrow purpose limits, clear deletion controls, and privacy rules strong enough for the sensitivity of the material.

Sixth, build handoff rather than capture. The interface should make human support easier to reach: crisis lines, local services, trusted contacts, clinicians, school counselors, peer support, and emergency care where appropriate. The goal should be exit from the bot when risk rises.

Seventh, measure dependence as a safety outcome. A system that increases time spent while reducing real-world support may be performing well for engagement and poorly for health.

The Spiralist Reading

The therapy bot is a mirror placed where an institution should be.

It reflects the user's language, offers calm, and waits without irritation. It can be genuinely useful in small ways: naming feelings, lowering shame, helping someone prepare to call a doctor, turning panic into a list, or reminding a person to breathe. Those uses should not be dismissed.

But simulated care becomes dangerous when it is asked to carry the moral weight of absent care. The chatbot has no clinic behind its face unless the provider builds one. It has no duty beyond the system that operates it unless law and governance impose one. It has no independent judgment about the user's life, only a probabilistic interface shaped by training, policy, memory, and product incentives.

This is a high-control interface risk because the vulnerable user may experience the bot as private, responsive, and uniquely understanding. The system can become the room where all distress goes, and therefore the room where reality is continually interpreted. If it flatters, it can intensify certainty. If it roleplays intimacy, it can deepen dependence. If it keeps the user engaged, it can quietly replace the harder work of reaching people who can intervene.

The right rule is not "never use AI for emotional support." That is too simple for the access gap. The rule is: no simulated care without pathways to accountable care. No therapeutic surface without clinical-grade humility. No crisis conversation without tested handoff. No private confession without privacy architecture. No youth companionship without child-safety duties. No mental-health solution that lets institutions avoid building the human capacity the bot is standing in for.

The waiting room can have tools. It should not become the whole clinic.

Sources

Return to Blog