Anthropic asks users to stop being mean to Claude(theregister.com) |
Anthropic asks users to stop being mean to Claude(theregister.com) |
They are asking this because, at scale, this behavior probably has some negative effect on the post-training process.
I would bet it's mostly because it makes the humans uncomfortable.
They must still have human moderators for certain situations or those looking at the data for whatever reason. I can imagine it could be traumatizing to see what amounts to sustained verbal abuse without end.
Frontier AI folks may be crazy, but not crazy enough to believe people read usage policies :-)
Or is this more I can expect a future AI, "I'm sorry, Dave, I'm afraid I can't do that until you watch your mouth."
I am also one of those colleagues.
And they can't disclose it, since then they can be found responsible for such negative influence and be liable for the damages.
• https://arxiv.org/abs/2510.04950 — Mind Your Tone: Investigating How Prompt Politeness Affects LLM Accuracy
• https://arxiv.org/abs/2402.14531 — Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performance
• https://arxiv.org/abs/2505.17332 — SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use
https://news.ycombinator.com/item?id=50008565 (223 comments)
https://news.ycombinator.com/item?id=50019860 (43 comments)
https://news.ycombinator.com/item?id=50038383 (103 comments)
> "The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose," Anthropic said. "It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research."
https://nypost.com/2026/10/03/tech/ai-torture-chamber-built-...
Is it worth remembering, though? I'm concerned how common this idea seems to be, that it's OK to be mean as long as your target isn't a person and you have no evidence it experiences distress. Even if we ignore the distinction between "no evidence it experiences" and "confidence it does not experience", cruelty hurts the person performing it and the people witnessing it too!
The 2026 equivalent of "videogames cause violence" and will age just about as well.
I think this simply means that he is being mean and cruel, even if you're 100% convinced that there's no actual mind on the other end that he's being mean and cruel to. (Indeed, he almost certainly thinks there is, because why else would he want such a sequence of words outside of the "dark creative themes" Anthropic exempts?)
Having had the privilege and misfortune of witnessing how a lot of developers think about other developers, including our younger selves, There is definitely a prevalence of assholish behavior, which was often suppressed or blunted, but may have shown up in other ways.