Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Stars: 3,803Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.