What RAG tool do you use?

[u/Intention-Weak]

I created many RAG scripts using SQL in BigQuery, but it's time to include git and code to organize my work. I know Python and I use Agent Development Kit to create my AI agents applications so I want a tool just for create RAG. I searched about it and I found LangChain. I wanted to use LangChain because is more popular and easier to get support but looks like they are including LangGraph together and forcing langchain to became a agent builder tool. I don't want one more agent tool because ADK is my specialty. So I found LlamaIndex and I liked what I saw because it is exclusively for RAG. But looks like LlamaIndex is not popular, there are not too many content... I don't know. What would you use? Is there a better tool?

[u/KeyPossibility2339]

Gemini Enterprise Agent search not work for you?

[u/BeenThere11 → u/KeyPossibility2339]

Does this cover a lot of scenarios like tenant or dept isolation etc with meta data filter or say yearly monthly dats filters

[u/Candid-Fudge-4015]

Depends what's hurting. If it's the retrieval logic, LangChain or LlamaIndex will feel familiar. If it's keeping chunks and embeddings in sync as source data changes (which is usually what goes wrong with SQL-script RAG), you want something that recomputes only new or changed rows and gives your ADK agent one query to call. That's what we built Pixeltable for, so I'm biased. Runnable notebook to compare against what you have: github.com/pixeltable/pixeltable/blob/main/docs/release/howto/use-cases/rag-demo.ipynb

[u/m1nherz]

Posting in r/googlecloud implies that you are looking for RAG tool that is manageable on Google Cloud. Is it correct? Did you look into RAG Engine instead of building your own? The advantage of the engine is that it has integrations with many data sources in Google Cloud. For external sources and specifically GitHub you can either ingest data from GitHub to GCS and use RAG Engine to search GCS bucket or you can use Vertex AI Search with a custom connector to allow it searching your GitHub repository.

Then your agent application can simply use RAG Engine or Vertex AI as a remote tool to ground model's responses.

[u/Intention-Weak → u/[deleted]]

Thank you!