Ask HN: Which laptop can run the largest LLM model? I’d like to experiment with LLMs locally and understand their infrastructure better. |
Ask HN: Which laptop can run the largest LLM model? I’d like to experiment with LLMs locally and understand their infrastructure better. |
The out of stock one has 128gb of unified system ram. AMD 395 ai chip.
So easily run 70B models on that much vram; but slower, probably in that 30-40tokens/s which is very usable.
Qwen 3 30b will be in that 60 tokens/s range.
llama 4 scout will be around 20-30tokens/s
That’s the same price as an M4 Max MBP with the same ram and storage. Any idea how they compare in performance?