(2023) Past discussions (219 points, 404 comments) https://news.ycombinator.com/item?id=35364833

(36 points, 79 comments) https://news.ycombinator.com/item?id=35504887

The genie is out of the bottle.

According to Mr. Yudkowsky, what it takes to get us out of danger's way is "a plan", which he surely would back up... A plan -- not direct action against the system which made this whole situation possible in the first place. I understand his preoccupation, but he makes it seem like salvation for humanity is just a matter of the industry going easy with this. It reminds me of Chinese factories and coal generators going offline for a couple of days so there can be beautiful blue skies in Beijing by the time Victory Day comes. Never mind that we, the powerless, are already shaken by the menace of nuclear war, the rise of neo-fascism, and unprecedented natural disasters. So we're supposed to believe the whole danger lies with AI now? Why should we care when presented with another danger if we never ceased to be surrounded by danger in the first place? Respectfully, I believe Mr. Yudkowsky's opinions are not radical enough. C'mon, Eliezer, what would Sarah Connor do? Me, if someone came up with a "Terminator 2: Judgement Day" kind of plan, I would surely back it up.

(2023)

Yudkowsky has to be the best hype man for AI.

> An open letter published today calls for “all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”

We need to shut down AI more than that, forever. Otherwise it's just the prisoner's dilemma to create an end technology that is too powerful for us to handle and it will create chaos. The world is better off without AI.