Edit Models filters

Model Tree

ibm-granite/granite-3.3-2b-instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

48

Full-text search

Active filters: ibm-granite/granite-3.3-2b-instruct

ibm-granite/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 570 • 11

mlx-community/granite-3.3-2b-instruct-8bit

Text Generation • Updated Apr 16, 2025 • 11

mlx-community/granite-3.3-2b-instruct-6bit

Text Generation • Updated Apr 16, 2025 • 6

mlx-community/granite-3.3-2b-instruct-4bit

Text Generation • Updated Apr 16, 2025 • 997 • 1

NikolayKozloff/granite-3.3-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 22 • 1

mradermacher/granite-3.3-2b-instruct-GGUF

3B • Updated Jul 11, 2025 • 196 • 2

mradermacher/granite-3.3-2b-instruct-i1-GGUF

3B • Updated Jul 11, 2025 • 165 • 2

bartowski/ibm-granite_granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 327 • 5

lmstudio-community/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 693 • 3

DevQuasar/ibm-granite.granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 71

samuellimabraz/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 18, 2025 • 6

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs128-asym

Text Generation • 0.4B • Updated Apr 18, 2025 • 2 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs128-sym

Text Generation • 0.4B • Updated Apr 18, 2025 • 1 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs128-asym

Text Generation • 3B • Updated Apr 18, 2025

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs128-sym

Text Generation • 3B • Updated Apr 18, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs128-asym

Text Generation • 3B • Updated Apr 18, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs128-sym

Text Generation • 3B • Updated Apr 18, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs128-asym

Text Generation • 0.7B • Updated Apr 18, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs128-sym

Text Generation • 0.7B • Updated Apr 18, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Apr 18, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Apr 18, 2025 • 1

cgus/granite-3.3-2b-instruct-exl2

Text Generation • Updated Apr 19, 2025 • 6

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Apr 22, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 2

Triangle104/granite-3.3-2b-instruct-Q4_K_S-GGUF

Text Generation • 3B • Updated May 10, 2025 • 22

Triangle104/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated May 10, 2025 • 5