numen-tech
/

WhiteRabbitNeo-13B-v1-w4a16g128asym

Model card Files Files and versions

4-bit OmniQuant quantized version of WhiteRabbitNeo-13B-v1.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for numen-tech/WhiteRabbitNeo-13B-v1-w4a16g128asym

OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

Paper • 2308.13137 • Published Aug 25, 2023 • 18