Benchmarking AI Gateways: GoModel vs. LiteLLM vs. Portkey vs. Bifrost

Benchmarking AI Gateways: GoModel vs. LiteLLM vs. Portkey vs. Bifrost(enterpilot.io)

4 points by santiago-pl 6 days ago | 9 comments

GoModel author is here.

This is my attempt to honestly compare GoModel vs LiteLLM vs Portkey vs Bifrost AI gateways.

sjeno 6 days ago | |

Very interesting, I really wish that Python would stop being used for core things like gateways, just way way too inefficient and too much overhead. Great to see other options and the strengths of non-python stacks being highlighted, looking forward to trying out GoModel.

verdverm 6 days ago | | |

There seems to be movement within the Python/TypeScript ecosystem to replace implementations with Rust and continue distribution within said ecosystem.

I'm also looking to try out GoModel this weekend, met the creator in the OpenCode discord this last week. Looking to pair that with https://github.com/kubeopencode/kubeopencode

santiago-pl 6 days ago | | |

Thank you! Feel free to reach out to me over Discord in the case of any feedback or feature request.

verdverm 6 days ago | |

Appreciate the reproduction, perhaps we can expand it to cover more providers / local and build out a larger perspective.

Thoughts on breaking out the benchmarking code into a separate repo?

santiago-pl 6 days ago | | |

Currently, I want to keep them close to the documentation, where I link to them directly. The fewer repositories I have, the easier it is to maintain them.