📏Ragas
Also known as Ragas Metrics, Ragas Evaluation, RAG Assessment
A free Python tool. It scores AI apps that answer from your own documents.
Think of it like
It is like marking an open-book test. Did they find the right pages, and did they copy them right?
Example
Jack's help bot answers from 500 product manuals. Ragas shows context recall at 0.62, so he fixes how the bot finds pages before he touches the prompt.
Why it matters
A wrong answer can come from bad search or bad writing. Scoring each half shows which one to fix.
Definition
Example code
bash
pip install ragas
ragas quickstart rag_evalCommon mistake
Key takeaways
- 1Two halves. Fetching and answering, scored apart.
- 20 to 1 scores. Higher is better on every metric.
- 3Makes test sets. Questions built from your own files.