Elevated Errors for Opus 5(status.claude.com) |
Elevated Errors for Opus 5(status.claude.com) |
Anthropic seem to be both letting their competitors outplay them and making unforced errors (like the anti Open Weights models stuff and the frequent Fable->Opus downgrades for 'safety').
Outages are inevitable in this early high growth, rapid development era, but tactical errors are not.
OAI waits until overall cluster demand goes down before giving out a reset, they just happen to have much more spare capacity than Anthropic.
I don’t think Codex’s 99.98% uptime vs Claude Code’s 99.44%, is just due to OAI having more hardware to run it on.
Best would be a free week/month for anyone who sent a request during the downtime.
While there is some lock-in for the hardest tasks, for most of what people do LLMs are rapidly becoming a commodity.
In fact, right this minute I have Opus benchmarking Kimi alongside itself to determine which workflows we'll switch to using Kimi by default and Opus as the fallback instead of vice versa. It has already conceded Kimi does better on several tasks.
So Claude is now on vacation and is unavailable.
I think Anthropic is past this point. They are trying to get to profitability. They literally don't have enough compute to serve their demand.
OpenAI on the other hand I can totally see doing this. They need to gain marketshare and gain it fast or they're screwed.
If I needed to fall back on OpenRouter, it'd be paid per token, of course, but that'd take 4 major providers being down, in which case I suspect I'll have more critical things to worry about.
As it is, I use more than I could with a single $200 Claude Max subscription anyway, so I distribute my tasks across multiple providers.
Even without that it's cheap insurance given the cost of lost time.
You can also get a drift of it in their announcements - OpenAI has been far more aggressive in datacenter build-out partnerships as a more top-down allocation strategy since 2024, and Anthropic has rented out existing compute from infrastructure-heavy companies that are losing the model race in what seems like a more desperate ad-hoc compute acquisition strategy.
In all, Dario’s conservatism was in service of not going bankrupt, but any inspection of his argument that an overallocation of compute a year too early results in bankruptcy falls flat: there’s so much demand for mechanized intelligence in the world today that it’s easy to rent out compute if you have too great a supply.
[1]: recall that he was trying to court the saudis into investing $1T to build his own chips
https://qz.com/openai-investor-memo-compute-advantage-anthro...
There's less clear info about this from Anthropic's side, but given their frequent issues and lack of resets and overall less usage given to users on their subscriptions plans, it's a pretty simple conclusion to draw.
we are in the "millennial lifestyle subsidy" era for AI where companies ruthlessly undercut each other in an attempt to win marketshare, before then ratcheting up prices
This is bizarrely out of touch. It would be a courtesy but it's not a "reasonable expectation" at all.
At best you could maybe reasonably expect a prorated refund for the time of unavailability, but then Fable was still available.
Instead you should be compensated for your losses - the time and money it took you to repair that tyre.
Same with a web service. If I pay for 24 * 7 service and it's not working when I go to use it, I want compensation for my time and effort resolving the matter.
For some that'll be small - eg. Searching Google instead, taking 30 seconds. For others it'll be a big headache.
But downtime of 1 hour is almost certainly more costly for the consumer than 1/30/24 * subscription price.
Enough to offset any KV cache miss expenses is the absolute minimum.
The smart play is to refund customers something like $20-50 worth of unsubsidized credits.
Those are high margin and only the equivalent of 45 minutes of Fable usage once the KV cache reload costs are factored in.
Yet customers often need a few credits to finish a job without waiting 5 hours or days for their reset.
Keep in mind openAI already gives me free resets I can use when I want which are very useful to me. Seems a no brainer to tack those to subscriptions, actually.
It gives the user a little more flexibility, a little more control over their tools.
When you miss 1h of your job, do you give back a month for free?
Your contract doesn't have an SLA. If you are important enough, you can certainly negotiate one - and it will be far more expensive than your prosumer subscription.
And even then you will not get a 1:168 or 1:720 SLA like you are expecting - that's simply ludicrous and totally out of touch with every reality. Even if you were a lucrative enterprise customer (which you are not) they'd tell you to get lost.
> If there is a hole in the street and you fall down it, you wouldn't expect a refund just for the 1 second
Actually, you wouldn't get a refund at all unless you suffer damage or injury, which is an high bar to prove in court and a totally separate ball game.