A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-11-02
其他人工智能Apache-2.0
Repository dossier
sgl-project/sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
Brief / README 摘要
查看原文Blog | Documentation | Quick Start | Cookbook | SGLang | Join Slack ⭐ Star SGLang-Omni to help more builders discover open infrastructure for multimodal and speech serving! [2026/10] 🗺️ A unified runtime for interactive intelligence: native full-duplex models, turn-based multimodal models, and cascaded systems, coordinated through composable graphs and persistent sessions. \[Blog\] [2026/10] 🚀 SGLang-Omni v0.2.0 is on PyPI. Install with uv pip install --prerelease=allow "sglang-omni==0.2.0". \[Installation\] [2026/10] 🐟 Day-0 support for Fish Audio Drama 3: multi-speaker text-to-speech with…
Topics / 标签
01
浏览全部相关推荐
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
其他人工智能更新于 2026-11-01
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-11-02
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
其他人工智能更新于 2026-11-02
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.
其他人工智能更新于 2026-11-02