UNREAL: Unifying Retrieval and Long-Context with a Single Model
- 类型:arxiv
- 标识:2610.08463
- 链接:http://arxiv.org/abs/2610.08463v1
- 主分类:rag
- 形态:method
- TLDR:Long-context inference and Retrieval-Augmented Generation (RAG) handle evidence selection at vastly different scales, from a single long prompt to an entire corpus. We ask whether a single model-internal mechanism can select evidence across this range. We introduce UNifying REtrieval And Long-Context with a Single Model (UNREAL), a model-native evidence selection framework to span corpus retrieval and long-context inference. UNREAL encodes chunks and derives retrieval queries directly from the frozen LLM's internal representations. It adds fewer than 500K trainable parameters and leaves the ba
- 副分类:llm-infra
- 待LLM分类:否
- 来源文件:
- /inbox/tom/_candidates/2026-10-07-agent-rag-longcontext-candidates.json