Skip to main content
PProfileMatch
Read Play
← Path

Retrieval-Augmented Generation · Evaluating RAG: Retrieval Metrics, Faithfulness and Failure Modes

0 XP
  1. 1 current stop: learning
  2. 2 upcoming
  3. 3 upcoming
  4. 4 upcoming
  5. 5 upcoming

Finish after stop 5

Stop 1 of 5 · Scoreboard at the top of the hill

Trick to keep in mind+3 XP

Recall@k: was the right chunk anywhere in the top k?

Recall@k asks a yes-or-no question for each test question: did the correct chunk appear among the top k results? Then it averages over the set. To compute it you need questions labelled with the chunk that answers them. It tells you whether the generator had any chance of answering.

Read it once, then a question tests whether the trick stuck.