Hi HN, I'm Brian, I spent the last few years at Vanta (YC W18), helping startups and enterprises become compliant and I recently started exploring what that might look like in a post-agentic world.

The problem Halo solves is: when a company buys an AI agent from a vendor and gives it access to their data, they have no way to check what the agent did with that data. Vendors may have built observability dashboards and audit logs, but those are editable and partisan. SOC 2 and ISO 27001 audit a company's controls, but controls are less predictive when the software is agentic. TLDR: give an agent the same prompt 50 times, and you get 50 slightly different actions/answers - so the only thing worth auditing in a post-agentic world is what happened at runtime.

Halo is an open-source project that produces agent runtime evidence. It's a small recorder that records every action an agent takes (eg. tool calls, model calls, data access, etc), and becomes a record in an append-only log. It's hash-chained, so anyone can re-verify.

Run the following command to see a fictional example:

     uvx --from halo-record halo demo --serve

Then, delete a line from one of the .jsonl files and reload, and the report will catch that it's been tampered with.

To wire up your own agent, run this line of Python:

     agent = trace(run_my_agent, profile="my-agent", log="audit.jsonl")

Then use this to generate a real report and give it to your customers:

     halo report audit.jsonl -o report.html

Disclaimer: this proves integrity, not completeness (as a self-held chain proves nothing was edited but does NOT prove that nothing was omitted). Catching this requires a witness outside the vendor and is what I'm working on next.

Halo is Apache-2.0, contains zero runtime dependencies, and is about 4,300 lines of Python with 125 tests (if you prefer TypeScript, here's that repo: https://github.com/bkuan001/halo-record-ts).

Give it a try, and please let me know if you have any feedback!

1.	1 points by nf-x 3 years ago \| discuss
2.	1 points by nf-x 3 years ago \| discuss
3.	1 points by nf-x 3 years ago \| discuss
4.	Exposing Azure Storage on Domain Apex with Let's Encrypt SSL(ssmertin.com) 1 points by nf-x 3 years ago \| 1 comment
5.	1 points by nf-x 3 years ago \| discuss
6.	1 points by nf-x 3 years ago \| discuss

user:	nf-x
created:	September 18, 2022
karma:	5