vast-data/VUA
VUA stands for 'VAST Undivided Attention'. It's a global KVCache storage solution optimizing LLM time to first token (TTFT) and GPU utilization.
Stars: 37Language: Python
Give AlbumentationsX a star on GitHub — it powers this leaderboard
Star on GitHubVUA stands for 'VAST Undivided Attention'. It's a global KVCache storage solution optimizing LLM time to first token (TTFT) and GPU utilization.