Ask HN: Is there money in RAG? I see that the market strength of RAG-based solutions is in internal (proprietary) repositories of data. I built a small one for publicly accessible documents but the models (or models with internet access) are gaining ground. I wanted to hear more thoughts. |
The only way you will be able to beat them is in tiny niches, but when it comes to importing an organizations "knowledge" it will be hard to compete with the companies that already have it (O365, Google)
BUT - I do think its way way way overcrowded vendor market right now. The vector DB vendors are all RAG RAG RAG and have payed little attention to the fact they are actually a search solution focused on one type of index, and there are a million other applications of a search engine.
So its a crowded dumb market, but it probably has some kind of future.
I would have paid a good sum for it a year ago, but we figured it out. I think it's like setting up databases. There was a market for that kind of consulting 15 years ago, but in the long run it might not be there.
can you please elaborate? Thanks.