tiran/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Stars: 0Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubTransformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM