Those projects should default to hosts less geared toward corporate governancy; custom internet domain being the first requirement.
I struggle to think of anywhere on the entire open internet you could put something like this where it could not be taken down.
- monitoring server error rates
- reviewing security footage
- watching plant growth / controlling watering
etc. Any long running task you can now just slap a PS5 on it. 70 cents a day in power cost means you now get ~2M output tokens per day (~$3.50 worth of usage). It's not the worst thing in the world if you have one lying around. 2bit isn't even that terrible - it's ~80% the accuracy of 27b at full quant, which should put it at around GPT-5 levels of intelligence (which honestly is crazy in its own right).
And at that price point or a little bit more you might as well just get an RTX 3060 and save yourself a lot of hassle (you also get DLSS, DLAA etc.)
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
https://www.ncsa.illinois.edu/2003/05/27/playing-the-superco...
However you can run comparable or better models than gpt4. Try to stay under 30b
I'm sure someone will point out some spec that's better on the PS5, but the extra $200 will make up the difference if you spend more time looking than the 15 seconds I just did.
(or if you just build a PC from parts yourself)