86. RAG: Giving Language Models Long-Term Memory
Akhilesh
Large language models know a lot. They do not know everything. They were trained on internet text up to a cutoff date. They have no idea what happened last week. They have no idea what is in your company's internal documentation. They have no idea what your customer support tickets say. When asked about things outside their training, they have two choices: say they do not know, or hallucinate something plausible-sounding. They often choose the latter. Confidently. Wrongly. RAG (Retrieval-Augment