Microsoft recently open-sourced the GraphRAG framework, which enables more contextual responses than traditional vector-based RAG, especially for summarization-focused queries on textual data.

However, a common critique is the LLM costs for constructing the knowledge graph. With the newly released GPT-4o mini, working with GraphRAG would now be ~30x cheaper.

We built a demo with quarterly earning call transcripts from a few S&P 100 companies comparing GraphRAG with GPT-4o, GraphRAG with GPT-4o mini, and Baseline RAG.

Try out the demo here: https://graphrag-demo.deepset.ai

Looking forward to your feedback!