Ran some testing and discovered llama2 on replicate is faster than chatgpt!

Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...

Are others seeing similar results?

The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.