LLM 基础设施主题中枢

本文描述了 TensorFlow 接口及 Google 构建的该接口实现，已被用于开展研究，并在计算机科学及其他十余个领域中将机器学习系统部署至生产环境。The TensorFlow interface and an implementation of that interface that is built at Google are described, which has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields.

本文提出一种权重裁剪的替代方案：对 critic 相对于其输入的梯度范数施加惩罚。其性能优于标准 WGAN，能以几乎无需调参的方式稳定训练多种 GAN 架构。This work proposes an alternative to clipping weights: penalize the norm of gradient of the critic with respect to its input, which performs better than standard WGAN and enables stable training of a wide variety of GAN architectures with almost no hyperparameter tuning.

本文指出基于 Transformer 的次二次时间模型的关键缺陷在于无法执行基于内容的推理，并将选择性 SSM 集成到不包含注意力乃至 MLP 块的简化端到端神经网络架构（Mamba）中。This work identifies that a key weakness of subquadratic-time models based on Transformer architecture is their inability to perform content-based reasoning, and integrates selective SSMs into a simplified end-to-end neural network architecture without attention or even MLP blocks (Mamba).

当将监督规模扩展到 680,000 小时的多语言、多任务数据时，所得到的模型在标准 benchmark 上泛化良好，在 zero-shot transfer 设置下常可与此前全监督方法的结果相当，且无需任何微调。When scaled to 680,000 hours of multilingual and multitask supervision, the resulting models generalize well to standard benchmarks and are often competitive with prior fully supervised results but in a zero-shot transfer setting without the need for any fine-tuning.

对现有图神经网络模型进行了详细综述，系统性地归纳了其应用，并提出了四个有待解决的未来研究方向A detailed review over existing graph neural network models is provided, systematically categorize the applications, and four open problems for future research are proposed.

文章论证了 Transformers 可作为医学图像分割任务的强大编码器，并通过与 U-Net 结合，恢复了局部空间信息以增强更精细的细节。It is argued that Transformers can serve as strong encoders for medical image segmentation tasks, with the combination of U-Net to enhance finer details by recovering localized spatial information.

本文从技术演进的角度，对这一快速发展的研究领域进行了广泛综述，跨越超过四分之一世纪的时间跨度（从 1990 年代到 2022 年）。This article extensively reviews this fast-moving research field in the light of technical evolution, spanning over a quarter-century’s time (from the 1990s to 2022).

研究表明，利用变分方法最新进展的深度生成模型与近似贝叶斯推断能够带来显著提升，使生成式方法在半监督学习上极具竞争力。It is shown that deep generative models and approximate Bayesian inference exploiting recent advances in variational methods can be used to provide significant improvements, making generative approaches highly competitive for semi-supervised learning.

本工作提出一种通过引入自注意力来提取可解释句子嵌入的新模型，使用一个二维矩阵表示嵌入，其中矩阵的每一行关注句子的不同部分。A new model for extracting an interpretable sentence embedding by introducing self-attention is proposed, which uses a 2-D matrix to represent the embedding, with each row of the matrix attending on a different part of the sentence.

本工作指出，这些局部 patch 内部的注意力同样是构建高性能视觉 Transformer 的关键，并探索了一种新架构，即 Transformer iN Transformer (TNT)。It is pointed out that the attention inside these local patches are also essential for building visual transformers with high performance and a new architecture, namely, Transformer iN Transformer (TNT), is explored.

永不停止编码。免费的 MIT AI 网关：一个端点，340 家提供商（90+ 免费），1200+ 模型——Kimi、Claude、GPT、Gemini、GLM、DeepSeek、MiniMax。支持 Claude Code、Codex、Cursor、OpenCode、Cline 与 Copilot。具备配额感知自动回退、RTK+Caveman 压缩节省 15-95% token、MCP/A2A、桌面/PWA。由 450+ 贡献者构建。Never stop coding. Free MIT AI gateway: one endpoint, 340 providers (90+ free), 1200+ models — Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 450+ contributors

你的工作超级 Agent：本地优先，分钟级学习你的工作上下文，永不遗忘。Open-source All in One AI agent workspace. Run any agent — Claude Code, Codex — across your tools (100+ integrations + MCP), apps, browser, and files, with shared memory. Built-in models or BYOK.

与你一同成长的 Agent。The agent that grows with you

用于大规模搜索、抓取与交互网页的 API。🔥The context API to search, scrape, and interact with the web at scale. 🔥

《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码

让你的 AI Agent 像房间里最懒的资深开发者一样思考——最好的代码，就是从未写下的代码。Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.