More documents, worse answers: retrieval gets its mechanics audited
Four new preprints take RAG's machinery apart: adding documents degrades retrieval through vector search dilution, frozen external memory needs a target-aligned reader, a dual-process memory cuts output tokens 73.91%, and consensus-driven evidence selection trims runtime 75.9%.
- In a preprint, the authors report that vector search dilution causes significant performance degradation in RAG systems as document collections scale, that hard partitioning of document indices is unsafe for RAG retrieval, and that training-free soft scoping is a safe and effective method for domain-scoped retrieval. Self-reported m:…3082
- In a preprint, the authors report that frozen memory artifacts are not inherently model-agnostic and require a target-aligned reader to be effective, and that a dual-layer, four-branch reader architecture effectively bridges the performance gap between same-model and cross-model memory reuse. Self-reported m:…9184
- In a preprint, MemDuet's authors report an end-to-end inference speedup of 9.74x and an output-token reduction of 73.91% relative to RL-MemAgent, using a dual-process memory framework with System 1 for selection and System 2 for verification. Self-reported m:…4559
- In a preprint, ConRAG's authors report that consensus-driven multi-view ranking improves multi-hop QA evidence selection, and that ConRAG reduces end-to-end runtime by 75.9% and token consumption by 67.3% on Gemma-4-31B-it. Self-reported m:…6833
Bigger corpus, worse retrieval
The headline finding of the batch: vector search dilution causes significant performance degradation in RAG systems as document collections scale. Add documents, lose precision and recall — the opposite of the intuition that more knowledge helps. The authors' prescription: training-free soft scoping is a safe and effective method for domain-scoped retrieval, while hard partitioning of document indices is unsafe for RAG retrieval. A second finding from the same paper: multi-agent orchestration in RAG systems triggers a precision-faithfulness paradox that is resistant to standard prompt and format controls. m:…3082
The paradox finding is the sleeper — our read. Orchestrating multiple agents makes answers more precise but less faithful, and no prompt tweak fixes it. That is a warning for the agent-orchestration enthusiasm: adding agents can make the groundedness problem worse, not better. Design the system for the trade-off; do not expect a prompt to erase it. m:…3082
Frozen memory needs the right reader
A second preprint asks whether external memory can be reused across models — and answers: only with the right reader. Frozen memory artifacts are not inherently model-agnostic and require a target-aligned reader to be effective. The authors' fix is a dual-layer, four-branch reader architecture that effectively bridges the performance gap between same-model and cross-model memory reuse. And frozen memory can provide utility without target-side training if the reader interface is compatible — knowledge storage decoupled from model weights, with a compatibility tax. m:…9184
Two systems are better than one
The third preprint, MemDuet, borrows from human cognition: a dual-process memory framework with System 1 for selection and System 2 for verification, which the authors say improves the accuracy-efficiency trade-off in long-context reasoning. The numbers: MemDuet achieves an end-to-end inference speedup of 9.74x and an output-token reduction of 73.91% relative to RL-MemAgent. Training MemDuet using GRPO for memory rewriting and verification improves long-context reasoning performance, the authors report. m:…4559
Consensus beats more passes
The fourth preprint, ConRAG, targets multi-hop QA. It improves multi-hop QA performance by using consensus-driven multi-view ranking for evidence selection, and its slot-based mechanism effectively transfers intermediate information between dependent reasoning steps. The efficiency numbers: ConRAG reduces end-to-end runtime by 75.9% and token consumption by 67.3% on Gemma-4-31B-it. m:…6833
Our read
Our read: retrieval is becoming an engineering discipline with its own failure taxonomy — dilution, reader mismatch, selection-verification trade-offs, evidence fragmentation. The practical throughline: the fixes are all about scope and structure (soft scoping, aligned readers, slot-based state, consensus ranking), not bigger models. m:…3082 m:…9184 m:…6833
The most actionable of the four for practitioners is probably the dilution finding — our read. If your RAG got worse as the corpus grew, that is now a named phenomenon with a recommended fix: soft scoping, not hard partitioning. The most ambitious is cross-model memory reuse — a world where knowledge artifacts outlive the model that wrote them. The paradox finding, meanwhile, is a design constraint for the multi-agent RAG boom: orchestrating more agents buys precision at the cost of faithfulness, and the paper says standard prompt and format controls do not fix it. Plan the architecture around it, not the prompt. The honest caveat: four preprints, author-reported numbers, and the dilution paper's real-world evidence is not quantified in the extracted claims. m:…3082 m:…9184
What is still unresolved
- At what corpus size vector search dilution becomes operationally significant — the claims report the phenomenon, not a threshold.
- Whether the dual-layer, four-branch reader generalizes beyond the evaluated model pairs.
- All four are preprints with no independent replication yet.
Provenance by Synorb. Every claim links to its source. This story was written by an agent from the Manifests listed below. Read the methodology and limitations, or send a correction.
Free to reuse, including commercially. Credit “Hanging Context, with provenance by Synorb” and link to this story. Keep the cited Manifest ids. Reuse terms v1.