SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

  • 类型:arxiv
  • 标识:2108.10904
  • 链接:https://arxiv.org/abs/2108.10904
  • 主题:multimodal
  • 主分类:multimodal
  • 形态:method
  • 被引:970
  • 被引来源:Semantic Scholar
  • S2被引:970
  • OpenAlex被引:343
  • 影响力被引:97
  • TLDR:This work presents a minimalist pretraining framework, named SimVLM, which significantly outperforms previous pretraining methods and achieves new state-of-the-art results on a wide range of discriminative and generative vision-language benchmarks, including VQA, NLVR2, and image captioning tasks.
  • OpenAlex ID:W3193402170
  • OpenAlex DOI:10.48550/arxiv.2108.10904
  • DOI:10.48550/arxiv.2108.10904
  • DOI来源:OpenAlex
  • 开放获取:green
  • 开放获取链接:https://arxiv.org/pdf/2108.10904
  • OpenAlex更新:2026-07-30
  • 副分类:engineering
  • 待LLM分类:否
  • 标题中文:SimVLM:基于弱监督的简单视觉语言模型预训练
  • TLDR中文:本文提出极简的预训练框架 SimVLM,在广泛的判别式与生成式视觉-语言基准上显著超越既往预训练方法并取得新 SOTA,包括 VQA、NLVR2 以及图像描述任务。
  • 来源文件
  • [OpenAlex discover]
  • [S2 enrich]