Ask HN: What are some good APIs to interact with large language models? I am looking to do simple things like image classification/text classification using APIs without running the LLMs in my local machine. What are some APIs that provide a uniform interface to access different LLMs? |
If you really must use a wrapper, a strategy I use is to look into open-source apps I like and see what they are using. Aider for instance seems to be using this "litellm" thing... If I were to need cross API support for AI, I would probably look into that [1]. llm uses opeanai directly [2]. Etc, etc.
--
1: https://github.com/Aider-AI/aider/blob/e76704e261647348fd7c1...
2: https://github.com/simonw/llm/blob/d654c9521235a737e59a4f1d7...
I also rented a GPU vm from them and ran huggingface models on it. That did require lot more coding and learning.