Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,563

Base only

Active filters: granite

imadreamerboy/antares-350m-3bit-mlx

Text Generation • 0.4B • Updated Jul 23

imadreamerboy/antares-1b-bf16-mlx

Text Generation • 2B • Updated Jul 23

imadreamerboy/antares-1b-8bit-mlx

Text Generation • 2B • Updated Jul 23

imadreamerboy/antares-1b-6bit-mlx

Text Generation • 2B • Updated Jul 23

imadreamerboy/antares-1b-4bit-mlx

Text Generation • 2B • Updated Jul 23

imadreamerboy/antares-1b-3bit-mlx

Text Generation • 2B • Updated Jul 23

HolkViking/antares-1b-Q4_K_M-GGUF

Text Generation • 2B • Updated Jul 24 • 951 • 2

HolkViking/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated Jul 24 • 21 • 1

Riswan-BluBridge/granite-4.1-3b

Text Generation • 3B • Updated Jul 25 • 10

DKAvocadoo/antares-1b-bf16-GGUF

Text Generation • 2B • Updated Jul 25 • 309

chartreuse-verte/orb-human-typeahead-1b-v2.2

Text Generation • 2B • Updated Jul 26 • 251

chartreuse-verte/orb-human-typeahead-350m-v1.2

Text Generation • 0.4B • Updated Jul 26 • 187 • 1

theophilusowiti/AfriqueLlama-8B-Q4-K-M

8B • Updated Jul 26 • 19

Zynerji/Ektome-granite-3.0-8b-instruct-PristinelyUncensored

Text Generation • 8B • Updated Jul 27 • 451 • 1

mradermacher/Ektome-granite-3.0-8b-instruct-PristinelyUncensored-GGUF

8B • Updated Jul 27 • 168 • 1

mradermacher/Ektome-granite-3.0-8b-instruct-PristinelyUncensored-i1-GGUF

8B • Updated Jul 27 • 742 • 2

Myric/granite-3.1-1b-a400m-instruct-APEX

Text Generation • 1B • Updated 4 days ago • 241

Tim2190/granite-278m-kk

Sentence Similarity • 0.3B • Updated Jul 30 • 112

spkc83/retail-bank-agent-9b

Text Generation • 8B • Updated Jul 29

infohound/ha-voice-granite-3b-GGUF

Text Generation • 3B • Updated Jul 30 • 38

mradermacher/wardensight-1b-GGUF

2B • Updated Jul 30 • 173

spkc83/retail-bank-servicing-agent-9b

Text Generation • 8B • Updated Aug 14

revoman/granite-4.1-30b-base

Text Generation • 29B • Updated Jul 31 • 18

mattjoyce/antares-1b-GGUF

Text Generation • 2B • Updated Aug 2 • 204 • 1

salohcin714/granite-4.1-3b-bf16-mlx

Text Generation • 3B • Updated Aug 1 • 19

salohcin714/granite-4.1-3b-8bit-mlx

Text Generation • 3B • Updated Aug 1 • 14

salohcin714/granite-4.1-3b-8bit-awq-mlx

Text Generation • 3B • Updated Aug 1 • 15

salohcin714/granite-4.1-3b-8bit-gptq-mlx

Text Generation • 3B • Updated Aug 1 • 60

salohcin714/granite-4.1-3b-6bit-mlx

Text Generation • 3B • Updated Aug 1 • 7

salohcin714/granite-4.1-3b-5bit-mlx

Text Generation • 3B • Updated Aug 1 • 9