Ask HN: How to manage AI APIs for SaaS application?

4 points by sbinnee 20 hours ago | 3 comments

I want to build an AI app. My idea is to support BYOK (bring your own key) or to manage one API key for each user.

What are the solutions to issue a lot of API keys for commercial apps? I would love to hear from the community.

mmarian 5 hours ago |

I've used LiteLLM for my 1k-user service https://LibreThinker.com Works okay-ish, but some vendors now default to MFA on API keys (eg OpenAI) which makes things tricky; I decided to simply let those fail for now.

sbinnee 58 minutes ago | |

I am a bit familiar with litellm. Do you proxy server?

jaspanglia 19 hours ago |

BYOK is becoming more common for AI SaaS. Interested to know how people handle rate limiting and key security at scale.