Local RAG Pipeline with Weaviate and Ollama
Local RAG Pipeline with Weaviate and Ollama
i’ve been experimenting with building a fully local rag pipeline: weaviate for vectors + hybrid search, node.js scripts, qwen 3.5 on ollama what i found is that most of the challenges live in retrieval and chunking, not the LLM, and a good chunking strategy + the right balance in hybrid search is more effective than using a bigger and more expensive model
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Local RAG with Ollama, Gemma and RETSim
AutoRAG – AutoML tool for RAG. Find an optimal RAG pipeline
Chipper AI/RAG Interface for Tinkerers (Ollama, Haystack RAG, Python)
Private RAG with Mistral, Ollama and Pathway
ThinkR – G1 but in R with Ollama
Open-Source RAG CLI for Ollama
Pipeline Accidents of the 21st Century – Visualized
Vectorless RAG
PageIndex – Vectorless RAG
Preprocess maximises RAG performances