Ask HN: What is your AI harness that lets you switch LLM models easily? Looks like we are at the end of the Fable-level model at subscription pricing. It will be double the cost at paid-per-token usage. I’m counting on the other models to compete now at the subscription level and I need my harness to be agnostic. What do you use? |
Personally using it for switching from and to locally served Gemma and Qwen endpoints.
OpenCode is also fine but more finnicky - if you’re ok with desktop apps, give OpenChamber a try.
I built BitRouter(https://github.com/bitrouter/bitrouter), open-sourced, 0 markup for all models, free BYOK/subscription, and works with any harnesses out of the box
I feel completely free to use any number of subscriptions alongside Claude. Nothing restricts me from utilizing LLM API keys or CLIs pinned to roles in the harness via config. However, that being said, I use this harness confident in using Anthropic models as my main model provider alongside other models (GPT*, GEMINI*, Cursor - Composer 2.5 etc) as more like workhorse models to spread/manage cost on large projects.
If cost is the underlying concern, then you might want to consider your actual cost associated with each task you run on your top frontier model. It might just be that not all of your tasks need to be sent to the most expensive model.