Retrieval-augmented generation

1–2 minutes

Retrieval-augmented generation (RAG) is a technique that LLMs use to retrieve and incorporate new information from external data sources. The LLMs firstly refer to a specified set of documents and then respond to queries by the user, with these documents acting as supplementary information to the training data that has been used to train the LLM. In the early days of LLMs this was an approach that was frequently used to add either domain-specific or updated information that the training data didn’t contain (remember those messages that ChatGPT used to deliver about its knowledge cut-off date?). RAG can be used to allow internal company data to be used, or for using authoritative sources for generating responses.

Visited 3 times, 1 visit(s) today

Categories

Tags