Evaluating Large Language Models Trained on Code
- 类型:arxiv
- 标识:2107.03374
- 链接:https://arxiv.org/abs/2107.03374
- 主题:engineering
- 主分类:evaluation
- 形态:method
- 被引:11151
- 被引来源:Semantic Scholar
- S2被引:11151
- OpenAlex被引:1460
- 影响力被引:1676
- TLDR:It is found that repeated sampling from the GPT language model is a surprisingly effective strategy for producing working solutions to difficult prompts, and the potential broader impacts of deploying powerful code generation technologies, covering safety, security, and economics are discussed.
- OpenAlex ID:W3177813494
- OpenAlex DOI:10.48550/arxiv.2107.03374
- DOI:10.48550/arxiv.2107.03374
- DOI来源:OpenAlex
- 开放获取:green
- 开放获取链接:https://arxiv.org/pdf/2107.03374
- OpenAlex更新:2026-08-26
- 待LLM分类:否
- 标题中文:Evaluating Large Language Models Trained on Code
- TLDR中文:发现对 GPT 语言模型进行重复采样,是为困难 prompt 生成可用解的一种出乎意料的有效策略,并讨论了部署强大代码生成技术在安全性、安全保障与经济等方面的潜在更广泛影响。
- 来源文件:
- [OpenAlex discover]
- [OpenAlex backfill]
- [S2 enrich]