OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

  • 类型:arxiv
  • 标识:2609.39903
  • 链接:https://arxiv.org/abs/2609.39903
  • 主分类:evaluation
  • 形态:benchmark
  • TLDR:Scientific software presents a demanding test for computer-using agents based on visual language models (VLMs): completing a research workflow requires interpreting specialized interfaces, manipulating scientific objects, and producing verifiable results. We thus introduce OSWorld-Science, a benchmark and evaluation environment that combines scientifically meaningful tasks, artifact-based evaluation, and an efficient agent harness for studying computer use in the scientific domain. The benchmark contains 12 VLMs and 146 high-quality tasks across several scientific domains and software configur
  • 副分类:agent
  • 待LLM分类:否
  • 来源文件:
  • /inbox/tom/_candidates/2026-10-01-agent-rag-longcontext-candidates.json