Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

21,133

Base only

Active filters: quantized

tifin-india/sarvam-m-24b-q3-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 24

tifin-india/sarvam-m-24b-q4-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 46

tifin-india/sarvam-m-24b-q5-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 58 • 2

phazei/phazei-SkyReels-V2-fp8-e5m2

Text-to-Video • Updated May 25, 2025 • 4

Kikinoking/MNLP_M2_quantized_model

0.6B • Updated May 27, 2025 • 14

dinhnhat241103/Phi-4-mini-instruct-Vi

4B • Updated May 25, 2025 • 5

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated Sep 23, 2025 • 205k • 4

Raymond-dev-546730/MaterialsAnalyst-AI-7B

Text Generation • 8B • Updated Aug 1 • 253 • 8

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 24B • Updated May 26, 2025 • 42 • 2

tommytracx/CodeLlama-Edge-1.5B

Text Generation • Updated May 26, 2025 • 2 • 2

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 16

MWeste/MNLP_M2_quantized_model

0.6B • Updated Jun 6, 2025 • 8

steampunque/Qwen3-30B-A3B-MP-GGUF

31B • Updated Apr 22 • 48

steampunque/Qwen3-14B-MP-GGUF

15B • Updated Apr 21 • 59

steampunque/Mistral-Small-3.1-24B-Instruct-2503-MP-GGUF

24B • Updated Feb 18 • 126 • 1

ikerion/mistral-7b-magyar-q4-gguf

7B • Updated May 29, 2025 • 47

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 22.8k • 11

mahdi-b/viral-esm2-3b-hqq

2B • Updated May 30, 2025 • 11

geninhu/RakutenAI-7B-instruct-GPTQ

Updated May 30, 2025 • 7

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • 676B • Updated Apr 28 • 208 • 13

sallani/ELISARCyberAIEdge7B-LoRA-GGUF

Zero-Shot Classification • 41.9M • Updated Jul 18, 2025 • 3.23k • 1

Narutoouz/QwenLong-L1-32B-4bit-DWQ

Text Generation • 33B • Updated Jun 1, 2025 • 16

Narutoouz/GLM-4-9B-0414-4bit-DWQ

Text Generation • 9B • Updated Jun 1, 2025 • 28 • 2

steampunque/gemma-3-12b-it-MP-GGUF

12B • Updated Jul 9 • 70 • 1

roylin1003/royal-zhTW-ID-f16.gguf

Text Generation • 8B • Updated Jun 3, 2025 • 13 • 1

ykarout/MiMo-VL-7B-SFT-GGUF

Image-Text-to-Text • 8B • Updated Jun 2, 2025 • 85

RichardWoolsley/IceWhiskeyRP-7b-8bpw-exl2-Q4_0-GGUF

Updated Jun 2, 2025 • 2

Ro0tuX/MalForge-ThreatOracle-Mixtral-AWQ-v1

Text Generation • Updated Jun 3, 2025 • 10

roylin1003/royal-ZhTW-ID-q4_k_m.gguf

Text Generation • Updated Jun 3, 2025

roylin1003/royal-ZhTW-ID-q4_k_m

Text Generation • 8B • Updated Jun 3, 2025 • 14 • 1