A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-11-02
其他人工智能AGPL-3.0
Repository dossier
p-e-w/heretic
Fully automatic censorship removal for language models
Brief / README 摘要
查看原文*Remove censorship**, suppress slop, reduce sycophancy, and more. All in an afternoon, on your gaming PC. [^1]: Heretic supports on-the-fly 4-bit model quantization with bitsandbytes, which can reduce the amount of VRAM required to process a model to the same amount that is used to run a typical quantized version of it, at a slight accuracy cost. Set the quantization option to bnb_4bit to enable this. Heretic is a unique tool that lets you do what only corporations with access to massive computing power usu…
Topics / 标签
01
浏览全部相关推荐
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-11-02
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
其他人工智能更新于 2026-11-02
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
其他人工智能更新于 2026-11-01
TradingAgents: Multi-Agents LLM Financial Trading Framework
其他人工智能更新于 2026-10-27