TLDR
人类认知的一个核心原则是系统性，即理解一个概念本质上与理解该概念的相近变体相关联。推理模型能否稳健地展现这种系统性？如果可以，我们应能预期模型在其结构等价变体任务上表现一致。本文扩展了认知科学中既定的规则归纳任务，以评估当前推理模型思维的系统性。每个任务族都具有组合结构，我们借此通过任务同构创建结构等价的任务变体...A central tenet of human cognition is systematicity, the principle that understanding one concept is inherently tied to understanding close variations of that concept. Do reasoning models robustly exhibit such systematicity? If so, we would expect consistent performance on structurally equivalent variants of the same task. Here, we extend established rule induction tasks from cognitive science to assess the systematicity of thought in current reasoning models. Each task family has compositional structure that we use to create structurally equivalent task variations through task isomorphisms su