Ask HN: How much do you pay for LLM training and inference? I'd like to understand better the real costs of running a startup where custom LLMs are needed (e.g. any of the popular OSS ones, Mixtral or LLaMA) How much runway do you get in practice with 1M? |
No comments yet