OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software
- 类型:arxiv
- 标识:2609.39903
- 链接:https://arxiv.org/abs/2609.39903
- 主分类:evaluation
- 形态:benchmark
- TLDR:Scientific software presents a demanding test for computer-using agents based on visual language models (VLMs): completing a research workflow requires interpreting specialized interfaces, manipulating scientific objects, and producing verifiable results. We thus introduce OSWorld-Science, a benchmark and evaluation environment that combines scientifically meaningful tasks, artifact-based evaluation, and an efficient agent harness for studying computer use in the scientific domain. The benchmark contains 12 VLMs and 146 high-quality tasks across several scientific domains and software configur
- 副分类:agent
- 待LLM分类:否
- 来源文件:
- /inbox/tom/_candidates/2026-10-01-agent-rag-longcontext-candidates.json