活文档 · 论文卡 · 笔记 · 仓库 · 攻略
本文研究了在采用极小卷积滤波器的架构下，卷积网络深度对大规模图像识别精度的影响，并表明将深度推进至 16-19 个权重层，可在先前 SOTA 配置基础上取得显著提升。This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
GPT-3 在多个 NLP 数据集上取得了强劲表现，包括翻译、问答和完形填空任务，以及若干需要即时推理或领域适应的任务，例如乱序词重组、在句子中使用新词、或执行三位数算术运算。GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks, as well as several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic.
本文详细阐述了驱动 PyTorch 实现的原则及其在架构中的体现，并解释了 runtime 关键组件的精心且务实的实现如何使其协同工作以获得出色的性能。This paper details the principles that drove the implementation of PyTorch and how they are reflected in its architecture, and explains how the careful and pragmatic implementation of the key components of its runtime enables them to work together to achieve compelling performance.
本文提出了一种基于迭代模型平均的深度网络联邦学习实践方法，并进行了广泛的实证评估，考虑了五种不同的模型架构和四个数据集。This work presents a practical method for the federated learning of deep networks based on iterative model averaging, and conducts an extensive empirical evaluation, considering five different model architectures and four datasets.
结果表明，使用人类反馈进行微调是使语言模型与人类意图对齐的一个有前景的方向，在真实性方面有所提升，并减少了有毒输出的生成，同时在公开 NLP 数据集上的性能回归极小。The results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent and showing improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets.
本文推出参数规模从 7B 到 65B 的基础语言模型集合 LLaMA，并证明完全使用公开数据集即可训练出 SOTA 模型，无需依赖专有或不可获取的数据。LLaMA, a collection of foundation language models ranging from 7B to 65B parameters, is introduced and it is shown that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets.
在三种大语言模型上的实验表明，思维链提示能够在一系列算术、常识和符号推理任务上提升性能。Experiments on three large language models show that chain of thought prompting improves performance on a range of arithmetic, commonsense, and symbolic reasoning tasks.
本文设计了一种直接处理点云的新型神经网络，较好地尊重了输入点的置换不变性，并为从物体分类、部件分割到场景语义解析等应用提供了统一架构。This paper designs a novel type of neural network that directly consumes point clouds, which well respects the permutation invariance of points in the input and provides a unified architecture for applications ranging from object classification, part segmentation, to scene semantic parsing.
本文开发并发布了 Llama 2，这是一系列参数规模从 70 亿到 700 亿不等的预训练与微调大语言模型（LLMs），有望成为闭源模型的合适替代品。This work develops and releases Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters, which may be a suitable substitute for closed-source models.
本文提出了一种通用的无监督学习方法——对比预测编码（Contrastive Predictive Coding），用于从高维数据中提取有用的表征，并在语音、图像、文本和 3D 环境中的强化学习四个不同领域取得了出色的性能。This work proposes a universal unsupervised learning approach to extract useful representations from high-dimensional data, which it calls Contrastive Predictive Coding, and demonstrates that the approach is able to learn useful representations achieving strong performance on four distinct domains: speech, images, text and reinforcement learning in 3D environments.
本文提出了 mixup，一种通过对样本对及其标签的凸组合来训练神经网络的简单学习原则，提升了 SOTA 神经网络架构的泛化能力。This work proposes mixup, a simple learning principle that trains a neural network on convex combinations of pairs of examples and their labels, which improves the generalization of state-of-the-art neural network architectures.
本工作提出 BERTScore——一种文本生成自动评估指标，与人类判断的相关性更强，并在模型选择性能上优于现有指标。This work proposes BERTScore, an automatic evaluation metric for text generation that correlates better with human judgments and provides stronger model selection performance than existing metrics.
🪢 开源 AI 工程平台:涵盖 LLM 评测、可观测性、指标、prompt 管理、playground 和数据集。集成 OpenTelemetry、LangChain、OpenAI SDK、LiteLLM 等。🍊 YC W23🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Local-first 代码智能图谱，面向 MCP 与 CLI。为代码库构建持久化映射，使 AI 编程工具只读取关键内容，在代码评审与大仓库工作流中实现可基准测试的上下文缩减。Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
开源 LLM 知识平台：将原始文档转化为可查询的 RAG、自主推理 agent 和可自维护的 Wiki。Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
基于真实场景基准测试的、面向 AI 编程 Agent 的 #1 持久化记忆方案#1 Persistent memory for AI coding agents based on real-world benchmarks
通过全面的 tracing、自动化评估和生产就绪的仪表板，调试、评估和监控你的 LLM 应用、RAG 系统和 agentic workflows。Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
经过最佳基准测试的开源 AI 记忆系统，而且是免费的。The best-benchmarked open-source AI memory system. And it's free.