vllm-project/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
Stars: 4,649Language: Go
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubCost-efficient and pluggable Infrastructure components for GenAI inference