UNREAL: Unifying Retrieval and Long-Context with a Single Model

  • 类型:arxiv
  • 标识:2610.08463
  • 链接:http://arxiv.org/abs/2610.08463v1
  • 主分类:rag
  • 形态:method
  • TLDR:Long-context inference and Retrieval-Augmented Generation (RAG) handle evidence selection at vastly different scales, from a single long prompt to an entire corpus. We ask whether a single model-internal mechanism can select evidence across this range. We introduce UNifying REtrieval And Long-Context with a Single Model (UNREAL), a model-native evidence selection framework to span corpus retrieval and long-context inference. UNREAL encodes chunks and derives retrieval queries directly from the frozen LLM's internal representations. It adds fewer than 500K trainable parameters and leaves the ba
  • 副分类:llm-infra
  • 待LLM分类:否
  • 来源文件:
  • /inbox/tom/_candidates/2026-10-07-agent-rag-longcontext-candidates.json