RagRetrievalEvaluation
Hybrid search for RAG: what BM25 actually bought us
We added BM25 to a dense retriever across ten probes. It moved two of them, and seven were already saturated. What that means before you build it.
Tag
Retrieval
5posts tagged Retrieval. All posts
RagEvaluationRetrieval
A RAG benchmark is only worth running if it can fail
A benchmark that cannot fail is measuring whether you wrote a hard question. The armed-probe rule, and the counts that show whether yours is armed.
RagRetrievalEvaluation
RAG chunk size and overlap: what each one actually bought
Changing the splitter recovered 19 of 25 answers. Adding overlap on top recovered 6 more, and none of them for the reason overlap is sold on.
RagEvaluationRetrieval
RAG evaluation: how to test a stack that fails quietly
A method for evaluating RAG that survives a real corpus: armed probes, controls first, and retrieval failures counted apart from generation failures.
RagEvaluationRetrieval
RAG evaluation metrics: four ways a good score misleads
Saturation, partial credit, abstention counted as a catch, and detectability without power. Four ways a RAG metric reports a result it did not earn.