xHC: Expanded Hyper-Connections

  • 类型:arxiv
  • 标识:2607.14530
  • 链接:https://arxiv.org/abs/2607.14530
  • 主分类:engineering
  • 形态:method
  • 被引:0
  • 被引来源:Semantic Scholar
  • S2被引:0
  • 影响力被引:0
  • TLDR:This work proposes xHC (Expanded Hyper-Connections), the first HC-family method to achieve meaningful expansion beyond $N{=}4$ and introduces xHC-Flash, which reduces the per-sublayer memory traffic from $73.5C$ to $40C, comparable to the $34C$ required by mHC at $N{=}4$, while retaining the gains of full xHC.
  • 待LLM分类:否
  • 标题中文:xHC:扩展型超连接
  • TLDR中文:提出xHC(扩展型超连接),是首个在N=4之外实现有意义扩展的HC系列方法;引入xHC-Flash,将每个子层的内存访问量从73.5C降至40C(与mHC在N=4时的34C相当),同时保留完整xHC带来的性能增益。
  • 来源文件
  • /inbox/tom/_candidates/2026-07-20-agent-rag-longcontext-candidates.json
  • [S2 enrich]