New inference engine faster than vLLM, SGLang, TRT-LLM(layerscale.ai)2 points by logotype 87 days ago | 3 comments