While working with LLMs I ran into two problems:

- While developing, when running into any unexpected issues I wanted to see the exact input/output but logging it every time made the logs too noisy and useless. - After launch, I wanted to see how my users were using my app.

So I built LLM Logger. It's a simple open source tool that has a comfy UI from which you can see the list of logs from your app nad do some filtering.

Live demo for those interested: https://llmlogger.com/logs?org_id=01910013-7d31-7f3b-bfd9-41...