chaoyu | Dark Hacker News

1.	Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TensorRT-LLM, TGI(bentoml.com) 15 points by chaoyu 1 year ago \| 1 comment
2.	Show HN: ML Serving orchestration framework on Kubernetes(github.com) 2 points by chaoyu 3 years ago \| 0 comments
3.	BentoML: The easiest way to build Machine Learning APIs(github.com) 4 points by chaoyu 5 years ago \| 1 comment
4.	Vote with Your Feet: SF Art Installation(votewithyourfeet.org) 1 points by chaoyu 9 years ago \| 0 comments