"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization Paper • 2411.02355 • Published Nov 4, 2024 • 52
lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF Text Generation • 16B • Updated Jun 22, 2024 • 13.7k • 78