Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16

Base only

Active filters: smoothquant

adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8

Text Generation • Updated Apr 13, 2025 • 1 • 1

neonconverse/gemma-3-27b-abliterated-w8a8-8bit

Updated Oct 8, 2025

ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16

Text Generation • 6B • Updated Dec 16, 2025 • 1

JEILDLWLRMA/Qwen3VL-8B-Instruct-FP8

Image-to-Text • 9B • Updated Jan 20 • 12 • 1

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated Feb 2 • 15 • 1

JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic

Image-to-Text • 5B • Updated Feb 7 • 21

JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4

Image-to-Text • 3B • Updated Feb 7 • 295 • 2

cstr/Octen-Embedding-0.6B-ONNX-INT8

Sentence Similarity • Updated May 3 • 13 • 1

cstr/F2LLM-v2-0.6B-ONNX-INT8

Sentence Similarity • Updated May 3 • 14

jsyeom/llama-2-13b-hf-smooth

13B • Updated Mar 24 • 1

emreyigitozturk/llama-3.2-3b-smoothquant-gptq-hybrid

Text Generation • 4B • Updated Mar 24

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated Apr 2 • 1

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated Apr 2

vrfai/Qwen3-ASR-1.7B-int8

Automatic Speech Recognition • 2B • Updated Apr 10 • 3

Sensen02/Fast_dVLM_3B_W8A8_FP8

4B • Updated Apr 19 • 7 • 1

cstr/jina-embeddings-v5-text-small-retrieval-onnx-int8

Sentence Similarity • Updated 30 days ago • 22