Show HN: Agentpanel – Universal LLM API Written in Rust

Show HN: Agentpanel – Universal LLM API Written in Rust(github.com)

9 points by hackintoshrao 2 years ago | 4 comments

Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!

Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.

hamasho 2 years ago |

Interesting! And it looks much sane compared to LangChain.

Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?

hackintoshrao 2 years ago | |

Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.

mathnmusic 2 years ago | | |

Gemini models don't have "system" roles.

akash_sky 2 years ago |

gg stuff