Hey HN, glad to see this here—I’m the founder and CEO of Not Diamond. Not Diamond makes it super easy to train your own custom AI model routers on your data to outperform any single model by intelligently routing to the highest-quality model for each query. We beat every foundation model on every major benchmark at a lower cost and latency.

To train a router, you literally just upload a dataset with your inputs and eval scores for different models. It’s completely agnostic to your choice of scoring metrics, frameworks, or tools. And if you don’t have your own eval data, you can still use Not Diamond’s base router out of the box—it takes <5m to set up.

Some other features worth noting:

• Python, TypeScript, and REST API support

• Option to route to faster/cheaper models when doing so doesn’t impact quality

• Joint prompt optimization interface

• Online, real-time personalization to hyperpersonalize model recommendations to individual end users

• Blazing fast inference speeds (<100ms)

• Easy deployments to your private infra

Would love to hear what folks think.

I've been working with the team at Not Diamond and trying out the private beta for a couple of weeks, and the routing experience is great. It makes it really easy to use different models and also route based on different tradeoffs. All I had to do was grab API keys from the different LLM APIs and quickly set it up.

Super cool to see this on HN. Saw Tomas demo an early version of it last year. Very neat work and the team behind it is brilliant.

Very nice, exactly what I have been looking for. Sign up was easy as well and I have it working in my personal project already.

Are computer vision models supported?

Looking into it

this is neat, where can i find more details on how the automatic routing logic works?