"On the other hand, a missile with a man or two within, controlling flight by graphitics, would be lighter, more mobile, more intelligent. It would give us a lead that might well mean the margin of victory. Besides which, gentlemen, the exigencies of war compel us to remember one thing. A man is much more dispensable than a computer. Manned missiles could be launched in numbers and under circumstances that no good general would care to undertake as far as computer-directed missiles are concerned . . ."

Which doesn't seem like it. The ideal is to keep removing couplings. But in practice, I find that focusing on the statefulness, the distribution-specificness, these "accidentals", is how you actually get leverage.

The obvious social consequence is now the tendency towards centralization, tyranny, "you people can't think for yourselves, not because you have some kind of 'inherent intelligence defect', but because the world is so complicated and interconnected that only coherent systems thinking (conveniently administered from one central point) is what can save you". In the Enlightenment world, the ideal was that every man could in principle, think for themselves.

A good ending might be that everybody benefits each other by distributing intelligence, but in practice centralization always seems to win.

some weeks ago, we changed the billed credit card - something went wrong on their end we were unable to use it for ~8-9 days.

Some pepople during this period said to certain tasks: "I will care about that if Claude is available again"

So, we are already there

I dare companies to gamble on running their businesses on absolute skeleton crews long term

If people are spending less time bent over monitors or at desks under the dictates of corporate imperative, they will probably be spending more time doing actually interesting things. Reasoning is innately human. What we call "knowledge work" is not and is often anything but. People who are naturally curious will still discover things, even if irrelevant (from a market perspective) when the AI is on, for their own satisfaction.

If such an event were to occur, they would be called upon. It's really little different from what would happen today if suddenly the power grid or supply lines were down for a sustained period of time.

Now we know they won’t even be able to read and write. But maybe Claude sonnet 12817 can maintain the operating system. It’ll be 17,000 dependencies in and mostly written in JavaScript, but it’ll work.

Also I disagree with the permise. People learned how to make technology that never existed once already, they can learn to do it again if needed. It will take time, which we'll have plenty of because your phone won't be working.

If we practiced for these Armageddon scenarios what would a highly prepared group of 20 be able to accomplish in a year. How fast could they get humanity back to the bronze age?

Most humans aren't useless by any measure of most or usefulness. Our culture is our tools, dying due to a lack of antibiotics doesn't mean you didn't have anything to contribute, it means you didn't have access to the tool you needed. This is the problem we need to guard against.

No one is going to lose the ability to reason! This is accepting the most extreme version of the marketing presented by frontier labs, don't do it. People may lose fluency or familiarity or access to training on specific skills. We should put some care into making sure that can't be a catastrophe, for sure.

The titular Pump Six breaks down and basically there's nobody left in the world who knows how to even reason about the steps needed to fix it. There's just some log dump and nobody understands what it means. Humans are no longer capable of complex reasoning, they just live in the moment and hump.

Everyone must code alone

If you listen closely, you may hear them squawking in annoyance after each announcement.

The Samsara of AI subscriptions.

Would be interesting to see how OpenAI and Anthropic would respond to being "accidentally" hacked by their respective Frankenstein monsters.

It's just feelings.

Could you share a bit more about how you do it?

Opus isn’t even allowed to decrypt thinking blocks from Fable if you switch models mid-conversation.

https://platform.claude.com/docs/en/build-with-claude/preser...

There's an ocean between what "should" happen and what actually happens in tech today.

Not sure how long the latter will remain true – centralization is well underway there; try not to think of Cloudflare too much...

Isn't that a good news!

Likewise while at Google, they didn't let us put Google Voice numbers down as our oncall phone number. Some folks even had multiple phones on different networks as backups.

I'm sure they have either other SOTA models or open source models around to help if things to completely pear shaped.