A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-11-02
其他人工智能Apache-2.0
Repository dossier
xLLM-AI/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
Brief / README 摘要
查看原文2026-08-27: 🎉 We day-0 support the GLM-5.3-Flash model, please refer to the Deployment Document for deployment. 2026-07-06: 🎉 xLLM is officially donated to the OpenAtom Foundation! 2026-06-13: 🎉 We day-0 support the MiniMax-M3 model, please refer to the Deployment Document for deployment. 2026-04-24: 🎉 We day-0 support the DeepSeek-V4 model, please refer to the Deployment Document for deployment. 2026-02-12: 🎉 We day-0 support high-performance inference for the GLM-5 model, please refer to the Deployment Document for deployment. 2025-12-21: 🎉 We day-0 support high-performance inference f…
Topics / 标签
01
浏览全部相关推荐
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-11-02
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
其他人工智能更新于 2026-11-02
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
其他人工智能更新于 2026-11-02
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
其他人工智能更新于 2026-11-02
mlabonne/llm-course★ 84.8k
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
其他人工智能更新于 2026-02-05