论文

本文提出 Vision-aligned Latent Reasoning（VaLR），一种简洁而有效的推理框架，在每个 Chain of Thought 推理步骤之前动态生成视觉对齐的 latent token，引导模型在 latent space 中基于感知线索进行推理。Vision-aligned Latent Reasoning (VaLR) is introduced, a simple, yet effective reasoning framework that dynamically generates vision-aligned latent tokens before each Chain of Thought reasoning step, guiding the model to reason based on perceptual cues in the latent space.

ViT-5 的设计与当代基础模型实践保持一致，可作为对 vanilla ViT 的直接替换升级方案，适用于 2020 年代中期的视觉骨干网络，并为生成建模提供更强大的骨干。With a design aligned with contemporary foundation-model practices, ViT-5 offers a simple drop-in upgrade over vanilla ViT for mid-2020s vision backbones and serves as a stronger backbone for generative modeling.

数据混合（而非过滤）是构建高质量训练数据集的关键：以指令型数据为主的混合在扩展时优于以描述型数据为主的混合，且规模越大优势越明显。It is found that data mixing, not filtering, is key to a high-quality training dataset: instruction-heavy mixtures scale better than caption-heavy ones, with gains widening at larger scales.