Ollama are 'try[ing to] achieve vendor lock-in'(github.com) |
Ollama are 'try[ing to] achieve vendor lock-in'(github.com) |
https://github.com/ggerganov/llama.cpp/pull/11016#issuecomme...
So Ollama are basically forking a little bit of everything to try and achieve vendor lock-in. Some examples:
The Ollama transport protocol, it just a slightly forked version of the OCI protocol (they are ex-Docker guys). Just forked enough so one can't use dockerhub, quay.io, helm, etc. (so people will have to buy Ollama Enterprise servers or whatever).
They have forked llama.cpp (I would much rather we upstreamed to llama.cpp than forked, like upstreamining to Linus's kernel tree).
They don't use jinja like everyone else, they use this:
etc.
So we started a project called RamaLama to unfork all these bits
It's a bit silly but I rolled out my own(*) "no-deps" C++ Jinja template library (https://github.com/google/minja) just to add tool call support to llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639).
(*): I mean, technically my employer's :-D*