I've been playing with memory system last month and Karpathy's post was well timed. But I still had a few issues so I added a few things and open sourced the result:
- Passive recall - automatically injects a breadcrumb trail into your claude sessions based on topics discussed
- Passive memory filter - write your own filter on what should be remembered
- Tiered librarian - parses intake and raises questions when memories conflict
- Sources as trust graph - a wiki structure that uses citation to establish where memories came from
Hope that's helpful to others!