Paragraph Pollution: AI is (probably) greener than you typing on a laptop(blog.plinth.org.uk) |
Paragraph Pollution: AI is (probably) greener than you typing on a laptop(blog.plinth.org.uk) |
How much energy was used for training chat gpt 2,3 and 4?
Also
> We’ll assume that AI models have roughly the same split of operating costs as a typical data centre
I don’t think this is a good assumption. GPT is not a typical application, it requires a massive amount of power hungry GPUs.
It’d be better to compare the power cost to non-asic crypto mining farms.
Do you have any better sources for the power usage stats? It would be good to get a bit closer on that front. Having said that, even if the cost share is closer to 80%, that still puts it on par with a laptop for an average person.
What’s the power consumption on that assuming full load at all times?
No source for that though, I just wouldn’t assume that they’re breaking even
Looking a bit more into this, I found this paper: https://arxiv.org/pdf/2311.16863.pdf. It references a table saying that text generation uses 0.047 kWh per 1000 inferences, which is 1-2 orders of magnitude lower than my estimate. Though that is for GPT2, so possibly tracks to something roughly in the ~0.001 kWh per inference for GPT3.5.
Would it make sense for power consumption to also scale roughly quadratically?