AMA Urges Congress to Strengthen Safety Rules for AI Mental Health Chatbots
The American Medical Association is calling on Congress to boost safety around AI chatbots used for mental health. The move shows that professional groups are increasingly trying to shape the rules before misuse becomes widespread. It also reflects growing concern that conversational systems can blur the line between support and care.
When the AMA starts talking about chatbot safety, the policy conversation has clearly moved from speculative to urgent. Mental health applications are among the most sensitive uses of conversational AI because they deal with vulnerability, trust, and the possibility of crisis. That makes the need for oversight more immediate than in many other consumer AI categories.
Congressional involvement could help establish a baseline for disclosures, escalation pathways, data handling, and prohibited behaviors. The challenge is that legislation often moves slower than product iteration. By the time rules land, the chatbot market may already have evolved into something more personalized, persistent, and harder to regulate.
Still, the AMA’s intervention matters because it signals where clinician concern is concentrated. Health professionals are not only worried about bad answers; they are worried about systems that encourage emotional reliance while lacking clinical accountability. That is a distinct harm profile, and one that general-purpose AI policy may not fully capture.
The likely outcome is a patchwork of rules, guidance, and industry standards. But even that would be an improvement over the current vacuum. In mental health AI, safety is no longer just a product feature — it is the product definition.