DataComp-VLM：面向视觉-语言模型的改进开源数据集
数据混合（而非过滤）是构建高质量训练数据集的关键：以指令型数据为主的混合在扩展时优于以描述型数据为主的混合，且规模越大优势越明显。It is found that data mixing, not filtering, is key to a high-quality training dataset: instruction-heavy mixtures scale better than caption-heavy ones, with gains widening at larger scales.