A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-11-02
其他人工智能Apache-2.0
Repository dossier
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Brief / README 摘要
查看原文Docs | Cookbook | Website | Blog | Slack SGLang is an open-source inference framework for large language, vision-language, and diffusion models, optimized for agentic workloads, large-scale serving, and RL rollouts. SGLang Diffusion is its built-in image and video generation engine, included in this repository and the sglang Python package. 👋 Get started below, or meet the community at SGLang Events, including meetups, developer meetings, workshops, and office hours. SGLang Summit 2026: Meet the builders of open AI Our flagship annual gathering · November 12–13 · San Francisco Go deep on infe…
Topics / 标签
01
浏览全部相关推荐
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
其他人工智能更新于 2026-11-02
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-11-02
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
其他人工智能更新于 2026-11-02
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
其他人工智能更新于 2026-11-02
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
其他人工智能更新于 2026-11-02