New inference engine faster than vLLM, SGLang, TRT-LLM(layerscale.ai)2 points by logotype 133 days ago | 3 comments