The result I call DocuBrowser and in it's current form is FOSS (GPL-3) licensed for your personal use. The UI is in your browser. The AI models used are held local and are tiny, Available for Linux(RPM,Deb, and tgz) Windows and Mac. Let me know what you think and thanks for taking the time to try it out.
Key difference I see is that you point it to a folder instead of uploading to a system.
It's pretty cool, I've set up a share where the scanner scans, and it automatically picks it up from there and ingests it into the system.
Also need to search git repos including all branches and history (TIL/xkcd#153'd GitLab's web search can basically only do one branch at a time).
There's some info for AnythingLLM[0] which supports RAG. AnythingLLM has LanceDB out of the box but also supports others including pgvector.
I'm working on a similar application called Hister (https://github.com/asciimoo/hister). I should borrow some of your ideas. =]
https://github.com/antflydb/antfly
They’ve put a lot of effort into optimizing the local llm pipelines and I have a lot of faith in the devs working on it.
The kill_port function only catches ImportError from the psutil block, so when psutil is installed but raises AccessDenied (common on macOS), it crashes instead of falling back to lsof.
In platform_paths.py - add two lines after line 250:
except psutil.Error: pass
Fixed. Now when psutil raises AccessDenied (as happens on macOS without elevated privileges), it falls through to the lsof/fuser fallback instead of crashing. Try docubrowser start again.
I will be using this, and I will be making contributions to it as well.
> I'm actually thinking of this for a commercial product feature
Would you consider writing down which features you would like to make commercial product features and how you would like to price them?
Today it happened I needed a simple way to embed & query 1TB+ of documents, and I was looking at open source options. Can anyone tell me what their go-to solution is now? Could this be the one?
And what are the key differences vs. other open source RAG tools like kotaemon?
Pretty much in that order
I didn't find screenshotting of spreadsheets worked well, vision wasn't very accurate on them. I do use it for PDFs though. For docx it's probably fine either way but I went with LibreOffice -> markdown.