experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
liked a model about 1 hour ago
deepseek-ai/DeepSeek-V4-Pro liked a model about 2 hours ago
deepseek-ai/DeepSeek-V4-Flash updated a collection 5 months ago
bnb-4bit-experimentalOrganizations
None yet
models 78
huggingkot/BlackSheep-24B-bnb-4bit
24B • Updated • 4
huggingkot/Impish_Magic_24B-bnb-4bit
24B • Updated • 6
huggingkot/aya-expanse-8b-bnb-4bit
8B • Updated • 45
huggingkot/aya-23-35B-bnb-4bit
35B • Updated • 6
huggingkot/Mistral-Nemo-Instruct-2407-bnb-4bit
12B • Updated • 4
huggingkot/Impish_Nemo_12B-q4f16_1-MLC
Text Generation • Updated • 1 • 1
huggingkot/Verina-GPT-SoVITS-v2ProPlus-DPO-EN-JA-ZH
Text-to-Speech • Updated • 1
huggingkot/Lily-Qwen1.5-0.5B-q4f16_1-MLC
Text Generation • Updated • 2
huggingkot/Lily-Qwen1.5-0.5B-bnb-4bit
0.5B • Updated • 1
huggingkot/Nano_Imp_1B-bnb-4bit
1B • Updated • 2
datasets 0
None public yet