RAGAS(Retrieval Augmented Generation Assessment)
Open-source framework designed to evaluate Retrieval-Augmented Generation (RAG) pipelines. RAGAS uses an LLM-based approach to score different stages of the RAG workflow, helping you understand where your pipeline is succeeding or failing
Metrics of RAGAS
RAGAS breaks down evaluation into components that address the two main stages of a RAG pipeline: Retrieval (finding the right data) and Generation (creating the answer).
| Metrics Name | Stage | Explanation |
|---|---|---|
| 1. Context Precision | Retrieval | Measures if the most relevant information is ranked highly in the search results. |
| 2 . Context Recall | Retrieval | Measures if the system retrieved all the information required to answer the query. |
| 3. Faithfulness | Generation | Measures if the generated answer is derived only from the retrieved context (prevents hallucinations). |
| 4. Answer Relevancy | Generation | Measures how closely the generated answer addresses the user's original query. |