Local LLM Assistant in Zed Editor(github.com) |
Local LLM Assistant in Zed Editor(github.com) |
To integrate a custom model in Zed, I bypassed the limitation of only using OpenAI models. I did this by running the Mistral model from the Ollama library and cloning it to appear as "gpt-4-1106-preview." The steps included pulling and running the Mistral model, then using Ollama's commands to clone it. I updated Zed's settings to point to the local API URL of the cloned model. Restarting Zed applied these changes, enabling the use of the local LLM within Zed's environment.
For more details, you can refer to the GitHub issue directly: https://github.com/zed-industries/zed/issues/4424#issuecomme...