Information-Aware KV Cache Compression for Long Reasoning

  • 类型:arxiv
  • 标识:2606.26875
  • 链接:https://arxiv.org/abs/2606.26875
  • 主分类:llm-infra
  • 形态:method
  • 被引:0
  • 被引来源:Semantic Scholar + OpenAlex
  • S2被引:0
  • OpenAlex被引:0
  • 影响力被引:0
  • TLDR:This paper revisits token importance from a forward-looking perspective and introduces Forward Influence, a metric that measures how compressed tokens affect future contexts, and proposes InfoKV, an entropy-aware KV cache compression framework that incorporates information-theoretic signals.
  • OpenAlex ID:W7166133554
  • OpenAlex DOI:10.48550/arxiv.2606.26875
  • DOI:10.48550/arxiv.2606.26875
  • DOI来源:OpenAlex
  • OpenAlex Venue:Edinburgh Research Explorer
  • Venue:Edinburgh Research Explorer
  • Venue键:other
  • Venue来源:OpenAlex
  • 开放获取:green
  • 开放获取链接:https://www.research.ed.ac.uk/files/672859680/KaiEtalArXiv2026Information-AwareKVCache.pdf
  • OpenAlex更新:2026-07-19
  • 待LLM分类:否
  • 标题中文:面向长推理的信息感知 KV Cache 压缩
  • TLDR中文:本文从前瞻视角重新审视 token 重要性,提出衡量压缩 token 对未来上下文影响的新指标 Forward Influence,以及融合信息论信号的熵感知 KV cache 压缩框架 InfoKV。
  • 来源文件
  • /inbox/tom/_candidates/2026-06-29-agent-memory-tool-use-candidates.json
  • [S2 enrich]
  • [OpenAlex backfill]