vllm-project/tpu-inference
TPU inference for vLLM, with unified JAX and PyTorch support.
Stars: 246Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubTPU inference for vLLM, with unified JAX and PyTorch support.