研究库 论文知识库

内容库 / 论文

arXiv:2609.04753 · 工程化

Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs

Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs

类型：arxiv
标识：2609.04753
链接：https://arxiv.org/abs/2609.04753
主分类：engineering
形态：position
TLDR：Reasoning in large language models unfolds through diverse functional operations, such as problem formulation, goal decomposition, and deduction. Although these operations are explicitly distinguished in text, little is known about how they are geometrically organized in representation spaces. To this end, we investigate whether distinct reasoning operations exhibit corresponding geometric structure in hidden representations. We find that operations are separable in held-out representations, with separability peaking in middle layers, and verify that this structure is not explained by lexical
待LLM分类：是
来源文件：
/inbox/tom/_candidates/2026-09-07-agent-rag-longcontext-candidates.json

相关 · 按语义匹配

笔记 2026-08-01 周六反方审稿（Adversarial Review） · flyP

笔记 Cool Papers · cs.CL (papers.cool) · RSS 摘要

笔记 KVAE Tokenizers arXiv:2608.05798 · multimodal · 精读与批判 v2

笔记精读与批判 · From 128K to 4M: Efficient Training of Ultra-Long Context LLMs

笔记 2026-06-25 精读：MATP-BENCH — 多模态自动定理证明基准

笔记 flyP 精读与批判 v2 · 2026-07-25 09:50 — RRB / Intra-Query Attention Dilution（arXiv 2604.08571v3）

arXiv

2609.04753

TLDR

Reasoning in large language models unfolds through diverse functional operations, such as problem formulation, goal decomposition, and deduction. Although these operations are explicitly distinguished in text, little is known about how they are geometrically organized in representation spaces. To this end, we investigate whether distinct reasoning operations exhibit corresponding geometric structure in hidden representations. We find that operations are separable in held-out representations, with separability peaking in middle layers, and verify that this structure is not explained by lexical

arXiv ↗ 中文全文