跳到主要内容
GitStars
登录
其他人工智能MIT

Repository dossier

microsoft/BitNet

Official inference framework for 1-bit LLMs

Brief / README 摘要

查看原文

07/23/2026: 📣 We released VibeASR.cpp — a real-time multilingual ASR inference engine on CPU using BitNet I2_S quantization, achieving RTF Code ] [ Models ] [ Report ] 07/20/2026: 📣 We released BitNet-embedding-0.6B and BitNet-embedding-270M on Hugging Face — the first 1-bit embedding models that deliver competitive embedding quality with significantly faster inference on CPUs. 1.42x to 2.28x speedup over F16 on BitNet-embedding-0.6B prefill (8 threads) 1.32x to 1.74x speedup over F16 on BitNet-embedding-270M prefill (8 threads) Supports I2_S conversion with optimized kernels on x86 CPUs Los…

01

相关推荐

浏览全部
01
opencv/opencv★ 91.4kC++

Open Source Computer Vision Library

其他人工智能更新于 2026-10-31
02
ggml-org/llama.cpp★ 133.1kC++

LLM inference in C/C++

其他人工智能更新于 2026-11-02
03

An Open Source Machine Learning Framework for Everyone

其他人工智能更新于 2026-11-01
04
opendatalab/MinerU★ 82.9kPython

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

其他人工智能更新于 2026-10-31
05
666ghj/MiroFish★ 83.2kPython

A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎,预测万物

其他人工智能更新于 2026-10-16
06
cheaper-inference/OmniRoute★ 83.7kTypeScript

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

其他人工智能更新于 2026-11-02