Leibler - Self Evolving Production Agents

Leibler - Self Evolving Production Agents(leibler.dev)

3 points by kkkamur 12 days ago | 3 comments

kkkamur 12 days ago |

We’re building Leibler, a harness that turns production agent traces into training data and environments, then post-trains smaller models for your actual workload.

Production traces → curated data & environments → evals → post-training → cheaper specialized model -> deployment

Our hypothesis: a post-trained Qwen3.8-27B can handle ~90% of production tasks at frontier-level performance, while cutting inference costs by up to 10×.

We have proved this with one of our pilots where we decreased their costs from $50k/month to $4.6k/month, we believe this is the closest we have gotten to self evolving agents.

We’re looking for teams running agents in production to test this with us.

https://leibler.dev

sshussain270 12 days ago |

So fine-tuning as a service (TaaS)?

kkkamur 12 days ago | |

Fine tuning is a part of it, but environment generation and evaluation so that the training data matches the production is the hardest part. After the data comes in we can try OPD, RL, SFT to understand what method is the best one. Is this something you would like to try on your production setting ?