Hetzner introduces GPU server for AI training(hetzner.com) |
Hetzner introduces GPU server for AI training(hetzner.com) |
This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670.
And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
It is actually paid by the hour.
The price per hour for this server is € 1.5980
more info: https://docs.hetzner.com/general/others/new-billing-model/
I've been pleasantly surprised by what such a mediocre GPU and Llama3 8B can do for certain (simple) use cases. Ollama makes it all pretty easy.
https://cocalc.com/features/compute-server
In case you are not familiar, CoCalc is a real-time collaborative environment for education and research that you can access via your web browser at https://cocalc.com/
Consider this use case: I want to upload 50 GB of audio somewhere and run whisper (biggest model) on it. I imagine the processing should be doable in minutes for a powerful GPU and must be very cheap, the script will be like 20 LOC, but I'll spend some time setting stuff up, uploading this and so on (which for example, makes colab a no-go for this). Any recommendations?
Also, when they say it's "per hour" do they mean an hour of GPU-time, or an hour of me "renting the equipment", so to say?
It is actually paid by the hour.
The price per hour for this server is € 1.5980
more info: https://docs.hetzner.com/general/others/new-billing-model/
Could you please clarify?
RTX 6000 Ada is ~A100
Hetzner is a great, reliable company with fantastic offerings and excellent support.
Ahh I just saw OP was saying sub 100$ - yeah that's never going to happen.
The problem isn't margin on the consumer cards, the problem is competing with their even higher margin workstation cards.
Have you seen GPU prices lately (last 5 years)? A RTX 4080 super with merely 16 GB of VRAM is at least 1k, there's no way a 32 GB next gen flagship would be released at this price range.
I have a dedicated machine with Hetzner, and AFAIK they charge me the full amount regardless of whether it's on or off. If I cancel on day 3 of the month, it makes sense to be charged for only those days' hours. However that's different to "turn it on for 6 hours" kind of hourly pricing.
https://www.hetzner.com/dedicated-rootserver/matrix-gpu/
But, as far as I know (hence the sibling question), you still need to pay the setup fee each time you launch.
> Cancellation period: 30 days to the end of the month
To me that indicates it's not possible to order the server for only a few hours.
Either way... it's a mess. They added hourly billing for dedicated servers six months ago, there's not much excuse for still having contradictory information hanging around.
I'm a big fan of Hetzner and have used it off and on for ten years now, including auction, dedicated and cloud. I've had very few complaints over the years. But I stand by my post above - the information on your site is not clear and contradictory, and really needs to be cleaned up.