LLM-KV-cache-calculator / requirements.txt
AndreHathora's picture
Add enhanced KV cache calculator with GQA/MHA detection and fp4 support
6e06b7a
raw
history blame
13 Bytes
transformers