vllm-project/router
A high-performance and light-weight router for vLLM large scale deployment
Stars: 131Language: Rust
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubA high-performance and light-weight router for vLLM large scale deployment