Show HN: mlxsh A lightweight CLI to serve multiple local LLMs on Apple

Show HN: mlxsh A lightweight CLI to serve multiple local LLMs on Apple(github.com)

3 points by ansnadeem 73 days ago | 1 comment

machine memory is the bottleneck/limit for running local models, how is the memory handled? did not find notes on that on the repo readme page. could you explain, thanks.

nittanymount 73 days ago |

machine memory is the bottleneck/limit for running local models, how is the memory handled? did not find notes on that on the repo readme page. could you explain, thanks.