Observability for LLM apps with structlog and DuckDB(ploomber.io) |
Observability for LLM apps with structlog and DuckDB(ploomber.io) |
Looks preeeetty cool. I rolled my own python logging system when I was using Textual and RichText, but the methods all revolved around style and flagging content. It never occurred to me structure logs in a way other than the (obviously, super noisy) call stack...
EDIT: Philosophy/"Why Structlog?" doc: https://www.structlog.org/en/stable/why.html
This really seems more like a Flask API tracing example with as LLM call as an endpoint. Dare I call it a shallow developer marketing piece?
re: LLM observability more generally, they mostly seem to be building their own full-stack suite, whereas I'd like them to ship to my existing Grafana LGTM stack. I'm keen to check out https://docs.openlit.io/latest/introduction and migrate away from LangFuse, but there is the feedback on model response -> training dataset that is really nice
HN generally appreciates if you account for this and only promote your project when it's relevant to the discussion.
https://github.com/Scale3-Labs/langtrace?tab=readme-ov-file#...
Another blocker for me is that it appears to need an API key for trying it out locally or self-hosting
---
I'm comparing your project to OpenLit on this front
2. Also, you do not need the API key. You only need to install the python or typescript sdk and use the custom exporter option - https://github.com/Scale3-Labs/langtrace-python-sdk?tab=read... . If you already have a OTEL exporter running, you don't need even that. Just initialize the sdk after installing and it will do its thing.
I am one of the core maintainers of the project. Do let me know if you have any questions.