togethercomputer/genai-bench
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
Stars: 0Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubGenai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.