AI could kill all humans in next decade, warn experts(theguardian.com) |
AI could kill all humans in next decade, warn experts(theguardian.com) |
But killing all humans? Not likely.
I hope you're right. But the US dept of war is using grok. [1]
I don't really trust them to use it responsibly. That is to say, I expect those using it to just go along with whatever it says.
And it's grok... not even one of the good models
[1] https://www.war.gov/News/Releases/Release/Article/4586482/de...
It would be awfully convenient for the current big players if friction was added to bringing additional large scale compute resources online. Existing data centers would be grandfathered of course…
Nonsense. Of course. But for all non-tech-savvy this is a “bad” narrative in a good way. If it can kill humans in the future then it surely can make me a “what I would like in the 80s” photo, right?
"both can be true."
There can be a quotidian benefit to existing leaders in friction.
There are also real costs of various kinds associated with data centers,
and, to the point in this case,
there are also real risks associated with the current AI trajectory.
I don't picture new data centers being banned outright. I picture a lot more regulatory friction driven by public reaction which is in large part driven by media (which then also amplifies the perception of the public reaction).
Regulatory friction is generally considered beneficial to established companies, because it makes it harder for new companies to enter the market and for smaller companies to expand.
For example if in the 1960s computers became regulated because they will replace a lot of jobs or enable the building of advanced weapons or whatever, IBM would probably be in a very different position today.
There's no magical quality which distinguishes human intelligence and makes it irreproducible or unsurpassable. If there's no moat protecting humans and superintelligence is possible then all knowledge work is susceptible to being replaced, and shortly after, all physical labour too. AI would create concentrations of power we've never seen before alongside global inequality and poverty we've not seen for centuries, and inevitably that power will be misused.
See, I, too, can write meaningless prose.
I resigned from Anthropic today
Nobody's an expert on AI more than me and basically all my friends.
What I do know is there are more dangers for the human race than AI. One example is fungi that have become immune to intervention because of abuse in farming. Fungicides are much more difficult to make than antibiotics, because fungi only recently split from human cells in the evolution. What protects us from them is our warm body temperature.
With global warming sometimes fungi evolve to resist higher temperatures, killing entire populations of cats.
How will we defend against this without AI?
What if next month there is a plague of fungi that are resistant and quickly spreading killing 4 out of 5 people?
What will we do then without our AI? Let the micro-organisms win? Because we like nature so much because it's so natural?
We need AI if we ever want to stand a chance against events like this. Many animals went extinct. 99.999% of all animals I would argue. Will we be very very lucky? We are super densely populated and flying all around. How quickly could covid infect all humans?
Not having AI is also an existential threat in the long term.
If you want to convince people of your authority on a topic saying things like: "Nobody's an expert on AI more than me and basically all my friends." is not very compelling.
I think you meant the 2nd and yes, we are all about to get a dose of “expertise” in the field.
The self driving vehicles could target food delivery -- not your ubereats, but farm trucks and roads. Destruction of logistic infrastructure results in mass starvation. Individual targets for a complete eradication would take more effort, but a significant cull of the global population seems quite feasible with today's tech.
But folks are also doing virus research with AI. If such a lab gets hacked to make a super-virus, and its containment gets breached by a kinetic impactor, it could be cataclysmic.
But I hope you're right! It's not like the world's armies have enough nukes to eradicate all data centers or anything.