vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep | Dark Hacker News

Dark Hacker News

new|best|ask|show|jobs

Built with the HackerNews API. Developed by LJT.AI

Note: The HackerNews API provides up to 500 stories per category

vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep | Dark Hacker News

vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep(blog.vllm.ai)

144 points by robertnishihara 1 day ago | 47 comments