New ask Hacker News story: Ask HN: Local RAG with private knowledge base

Ask HN: Local RAG with private knowledge base
2 by zephodb | 0 comments on Hacker News.
Looking for a free, local, open source RAG solution for running a reference library with 1000s of technical PDFs and word docs. Tried the Ollama + open webui, Ollama+Anything LLM with opensource models such as Llama3.2 etc. As expected the more documents we feed the lower the accuracy. Doing it for a bunch of senior citizens who still love geeking out.

Comments