Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43,041

Full-text search

Active filters: 4-bit

z-lab/Qwen3.5-9B-PARO

Image-Text-to-Text • 3B • Updated about 7 hours ago • 16.3k • 38

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated 12 days ago • 14.6k • 33

mlx-community/Qwen3.5-9B-MLX-4bit

2B • Updated 15 days ago • 86.7k • 50

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 16 days ago • 213k • 23

Kbenkhaled/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated 18 days ago • 25.5k • 22

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 21 days ago • 42.6k • 36

Jackrong/MLX-Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-4bit

Text Generation • 1B • Updated 11 days ago • 1.67k • 7

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 14 days ago • 96k • 27

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 14 days ago • 283k • 47

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated 7 days ago • 186 • 6

z-lab/Qwen3.5-27B-PARO

Image-Text-to-Text • 6B • Updated about 7 hours ago • 398 • 6

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 14 days ago • 161k • 26

Intel/Step-3.5-Flash-int4-mixed-AutoRound

Text Generation • 28B • Updated 3 days ago • 652 • 5

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated Feb 10 • 9.47k • 19

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 21 days ago • 39.1k • 23

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated 4 days ago • 57.9k • 19

Jackrong/MLX-Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-4bit

Text Generation • 0.7B • Updated 12 days ago • 1.76k • 5

inferencerlabs/NVIDIA-Nemotron-3-Super-120B-A12B-MLX-4.5bit

Text Generation • 121B • Updated 4 days ago • 2.58k • 4

QuantTrio/Qwen3.5-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated 19 days ago • 115k • 11

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 19 days ago • 35.8k • 16

saricles/MiniMax-M2.5-REAP-139B-A10B-NVFP4-GB10

Text Generation • 79B • Updated 16 days ago • 441 • 4

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 13 days ago • 4.04k • 8

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 12 days ago • 5.25k • 13

z-lab/Qwen3.5-4B-PARO

Image-Text-to-Text • 1B • Updated about 7 hours ago • 2.26k • 13

huihui-ai/Huihui-Qwen3.5-9B-abliterated-mlx-4bit

Image-Text-to-Text • 1B • Updated 7 days ago • 1.58k • 4

dealignai/Nemotron-3-Super-120B-A12B-4bit-MLX-CRACK-Uncensored

Text Generation • 121B • Updated 3 days ago • 348 • 3

happypatrick/Qwen3.5-122B-A10B-heretic-int4-AutoRound

Image-Text-to-Text • 19B • Updated 1 day ago • 241 • 3

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 1.18k • 12

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit

Text Generation • Updated Aug 6, 2025 • 2.55k • 14

TheCluster/Qwen3.5-27B-Heretic-MLX-mxfp4

Image-Text-to-Text • 27B • Updated 14 days ago • 1.76k • 2