Why your local LLM knowledge base gives bad answers (and how to fix it)
Alan West
The frustrating problem You set up a local model runner, downloaded a decent 7B or 13B, pointed it at a folder of your personal notes... and the answers are garbage. It either hallucinates wildly or returns "I don't have information about that" when the answer is literally in the documents you fed it. I've been down this rabbit hole for the past few months trying to build a personal knowledge base for non-coding life stuff — medical history, financial records, journal entries, recipe notes, hous