MLC LLM: Universal LLM Deployment with GPU Acceleration | Dark Hacker News

Dark Hacker News

new|best|ask|show|jobs

Built with the HackerNews API. Developed by LJT.AI

Note: The HackerNews API provides up to 500 stories per category

MLC LLM: Universal LLM Deployment with GPU Acceleration(github.com)

3 points by crowwork 3 years ago | 1 comment

MLC LLM: Universal LLM Deployment with GPU Acceleration | Dark Hacker News

crowwork 3 years ago |

Supported platforms include:

- Metal GPUs on iPhone and Intel/ARM MacBooks

- AMD and NVIDIA GPUs via Vulkan on Windows and Linux

- NVIDIA GPUs via CUDA on Windows and Linux

- WebGPU on browsers (through companion project WebLLM).