-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
AgeOfAlgorithms/Llasa-1b-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
10
•
1
MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF
Text Generation
•
12B
•
Updated
•
118
•
4
unsloth/Phi-4-mini-instruct-bnb-4bit
Text Generation
•
4B
•
Updated
•
2.23k
•
5
unsloth/gemma-3-12b-it-bnb-4bit
Image-Text-to-Text
•
Updated
•
28.7k
•
35
mlx-community/meta-llama-Llama-4-Scout-17B-16E-4bit
Text Generation
•
Updated
•
142
•
8
unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-4bit
Image-Text-to-Text
•
112B
•
Updated
•
26
•
5
unsloth/Qwen3-0.6B-unsloth-bnb-4bit
Text Generation
•
0.6B
•
Updated
•
35.2k
•
21
unsloth/Qwen3-8B-unsloth-bnb-4bit
8B
•
Updated
•
78k
•
15
unsloth/Qwen3-8B-bnb-4bit
8B
•
Updated
•
149k
•
8
lmstudio-community/Qwen3-14B-MLX-4bit
Text Generation
•
2B
•
Updated
•
30.9k
•
5
MaziyarPanahi/Qwen3-30B-A3B-GGUF
Text Generation
•
31B
•
Updated
•
238k
•
4
Text Generation
•
33B
•
Updated
•
325k
•
125
Text Generation
•
Updated
•
112k
•
37
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
234k
•
45
Text Generation
•
4B
•
Updated
•
123k
•
24
Qwen/Qwen3-235B-A22B-GPTQ-Int4
Text Generation
•
235B
•
Updated
•
5.58k
•
27
Text Generation
•
0.2B
•
Updated
•
241
•
3
Text Generation
•
1B
•
Updated
•
610
•
8
Text Generation
•
0.6B
•
Updated
•
65.1k
•
24
Text Generation
•
2B
•
Updated
•
688
•
9
mlx-community/Qwen3-14B-4bit-DWQ-053125
Text Generation
•
Updated
•
104
•
6
mlx-community/Qwen3-Embedding-4B-4bit-DWQ
Feature Extraction
•
Updated
•
1.95k
•
•
7
Text Generation
•
5B
•
Updated
•
220
•
6
Qwen/Qwen3-30B-A3B-MLX-4bit
Text Generation
•
4B
•
Updated
•
369
•
11
Qwen/Qwen3-235B-A22B-MLX-4bit
Text Generation
•
33B
•
Updated
•
265
•
16
AngelSlim/Qwen3-32B_int4_gptq
33B
•
Updated
•
24.2k
•
1
mlx-community/SmolLM3-3B-4bit
Text Generation
•
Updated
•
2.37k
•
5
mlx-community/LFM2-350M-4bit
Text Generation
•
55.4M
•
Updated
•
480
•
6
unsloth/LFM2-350M-unsloth-bnb-4bit
Text Generation
•
0.4B
•
Updated
•
102
•
1
QuantTrio/Qwen3-235B-A22B-Instruct-2507-GPTQ-Int4-Int8Mix
Text Generation
•
248B
•
Updated
•
451
•
3