I'm not a developer at all, but is using something like Voyage and ChromaDB able to get most of the way there? I've implemented those for semantic search in a project I'm working on, but I'm wondering if rebuilding based on this would be better.