Ask HN: Why do this LLM companies trained on dangerous content all together?

1 points by jsdeveloper 2 years ago | 1 comment

Hi All,

Within minutes of talk and creating imaginary scenario, any one is able to jail break an AI model and get recipes to make dangerous stuff. The question is why would this companies train the LLM on such dangerous data altogether? And to whom are they providing such extra services , clearly if you have trained it and is already serving it ?

Selecting the dataset was clearly their job and all terrible outcomes can simply be avoided at the training itself.

joegibbs 2 years ago |

The datasets are so huge, I don't think there's any way to make sure that everything in the training data is safe - e.g. GPT3 was trained on 45TB of data, even using LLMs to classify that would be too expensive (GPT3.5 Turbo is priced at $1/million tokens, each token is about 4 bytes, so in the tens of millions to run it on its own training data - you could use other methods but they're less effective and stuff would still slip through), let alone having people do it.