Inspired by Bullet (https://news.ycombinator.com/item?id=49283063), I thought "why doesn't the ChatGPT client support auto-routing?" Switching between models is cumbersome, and I'm constantly using the native client -- so I thought. why not just mod it? I've attempted to use the same "classifier" -> model approach they've used, along with some "dumb routing" based on word choices (design/architecture --> bumps up a model). And rather than share a binary, I've just given you the prompt to mod your own client. |