Ask HN: How is everyone using Local LLMs? Hello Everyone, Would love to know how are you guys using Local LLMS on your machine Looking for interesting usecases here |
Ask HN: How is everyone using Local LLMs? Hello Everyone, Would love to know how are you guys using Local LLMS on your machine Looking for interesting usecases here |
https://github.com/verdverm/gmd
I run a "bigger" model on a second spark for coding tasks with an OpenCode Go sub for big models. It's nice to have access to the best open weight as well.