Evaluating Large Language Models Trained on Code

  • 类型:arxiv
  • 标识:2107.03374
  • 链接:https://arxiv.org/abs/2107.03374
  • 主题:engineering
  • 主分类:evaluation
  • 形态:method
  • 被引:11151
  • 被引来源:Semantic Scholar
  • S2被引:11151
  • OpenAlex被引:1460
  • 影响力被引:1676
  • TLDR:It is found that repeated sampling from the GPT language model is a surprisingly effective strategy for producing working solutions to difficult prompts, and the potential broader impacts of deploying powerful code generation technologies, covering safety, security, and economics are discussed.
  • OpenAlex ID:W3177813494
  • OpenAlex DOI:10.48550/arxiv.2107.03374
  • DOI:10.48550/arxiv.2107.03374
  • DOI来源:OpenAlex
  • 开放获取:green
  • 开放获取链接:https://arxiv.org/pdf/2107.03374
  • OpenAlex更新:2026-08-26
  • 待LLM分类:否
  • 标题中文:Evaluating Large Language Models Trained on Code
  • TLDR中文:发现对 GPT 语言模型进行重复采样,是为困难 prompt 生成可用解的一种出乎意料的有效策略,并讨论了部署强大代码生成技术在安全性、安全保障与经济等方面的潜在更广泛影响。
  • 来源文件
  • [OpenAlex discover]
  • [OpenAlex backfill]
  • [S2 enrich]