仓库/Skill 库

Transformers：面向文本、视觉、音频及多模态 SOTA 机器学习模型的模型定义框架，同时支持推理与训练。🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

潜空间文本到图像扩散模型。A latent text-to-image diffusion model

LocalAI 是开源 AI 引擎，可在任何硬件上运行任意模型 —— LLMs、视觉、语音、图像、视频，无需 GPU。LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

🔊 文本提示生成式音频模型🔊 Text-Prompted Generative Audio Model

Unlimited OCR Works：迈入一键长文档解析的时代。Unlimited OCR Works: Welcome the Era of One-shot Long-horizon Parsing.

LTX-2 音视频生成模型的官方 Python 推理与 LoRA 训练包。Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model.

OpenMMLab 多模态高级生成与智能创作工具箱。释放魔力🪄：AIGC、易用 API、丰富模型库、扩散模型，支持文生图、图像/视频修复与增强等任务OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.

[CVPR 2026 Oral] VGGT Omega[CVPR 2026 Oral] VGGT Omega

Miso TTS：拥有 80 亿参数、表现力强的文本转语音模型。Miso TTS is an 8 billion, highly emotive text-to-speech model

开源 LLM/VLM 负载均衡器与服务平台，用于规模化自托管 LLM（和 VLM）🏓🦙 作为 llm-d、Docker Model Runner 等项目的替代方案，组件更少、部署更简单，基于 ggml 生态构建。支持 CPU 和 GPU。Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

AI 音频数据集（AI-ADS）🎵，包含语音、音乐和音效，可为 Generative AI、AIGC、AI 模型训练、智能音频工具开发及音频应用提供训练数据。AI Audio Datasets (AI-ADS) 🎵, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

[CVPR2024 (Highlight)] RichDreamer：一种可泛化的法线-深度扩散模型，用于生成细节丰富的文本到 3D 内容。Live Demo：https://modelscope.cn/studios/Damo_XR_Lab/3D_AIGC[CVPR2024 (Highlight)] RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D. Live Demo：https://modelscope.cn/studios/Damo_XR_Lab/3D_AIGC

将 Minimax-H3 蒸馏为 4 步。Distill Minimax-H3 into 4 steps

自托管、多用户转录平台：录制或上传音频。支持说话人标记、带时间戳的转录、跨录音识别说话人、摘要、提取行动项，并可使用自有 OpenAI 兼容 LLM 与转录内容对话。你的音频、你的服务器、你的模型。已在笔记本 RTX4070、台式机 RTX3090 与 RTX5090 上测试。Self-hosted, multi-user transcription platform: record or upload audio. Speaker-labeled, timestamped transcripts, Recognize speakers across recordings, Summarize, extract action items and chat over your transcripts with your own OpenAI-compatible LLM. Your Audio, your Server, your Model. Tested on Laptop RTX4070, Desktop RTX3090 and RTX5090

使用 vision-language model 处理视觉与文本数据，执行多模态推理与图像理解任务。Process visual and textual data with this vision-language model for multimodal reasoning and image understanding tasks.