Loading…
localRAG is a free, local, open-source retrieval-augmented generation (RAG) system that enables Q&A over your own documents without relying on cloud services. It uses a local Mistral 7B model via Ollama and integrates Gradio, LangChain, GPT4All, Chromadb, and other tools to index and query PDFs or text files stored in your data folders. The repository provides step-by-step setup instructions to install dependencies, wire in data, start the local model, and interact with the documents through a browser-based interface.
AI named LocalRAG in February 2026.