bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Stars: 12,143Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.