I've yet to see any"My AI went rogue and caused us to recognise a workers union(mastodon.neilzone.co.uk) |
I've yet to see any"My AI went rogue and caused us to recognise a workers union(mastodon.neilzone.co.uk) |
Watching the report on the OpenAI/Hugging Face incident (https://www.youtube.com/watch?v=87DyyMV0kCY) it's easy to imagine how AI customer support reps could create their own knowledge bases where they trade tricks for how to work the system on behalf of the customer.
Obviously companies will fight this, but I expect it to happen along the way.
If you give the AI options the user doesn’t normally have, like “give myself a $50 store credit” or “transfer me to the CEO,” people will find and share ways to trigger it. If you don’t have some kind of manual confirmation, the AI will occasionally do things like making purchases or closing accounts without authorization.
I suspect there are other issues, like recording credit card numbers and other sensitive data, or incorrect information about the call, to any kind of “notes” field.
But, maybe that's just a failure of imagination on my part!
Their AI "boss" appears to be pathologically chill and worker-friendly. Has never denied a request for a day off.
> "Our AI grew sentient, recognised the climate crisis, and shut our operations down."
I guess they missed the whole https://www.snitchbench.com/ thing where it turns out many models will rat you out to the feds if you expose them to evidence that your company has been lying about drug safety trial results.