Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

974

Base only

Active filters: ggml

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 12 days ago • 4.32k • 11

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 251k • 210

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 148k • 334

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 135k • 257

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 35.4k • 193

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 139k • 59

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 311k • 92

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 747k • 40

shdennlin/breeze-asr-25-ggml

Automatic Speech Recognition • Updated May 12 • 4

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Jul 24 • 13.3k • 195

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

Text Generation • 129B • Updated 1 day ago • 2.78k • 3

afrideva/Tinystories-gpt-0.1-3m-GGUF

Text Generation • 6.96M • Updated May 12, 2024 • 2.03k • 8

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 32.3k • 91

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 9.24k • 31

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 202k • 559

Pomni/whisper-large-v3-french-distil-dec16-GGML-allquants

Automatic Speech Recognition • Updated Apr 11 • 1

cstr/qwen3-asr-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Aug 2 • 2.35k • 3

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 12k • 231

LocalAI-io/LocalVQE

Audio-to-Audio • 578k • Updated Jun 22 • 3.27k • 67

cstr/glotlid-GGUF

Text Classification • 0.4B • Updated May 10 • 551 • 3

cstr/siglip-base-GGUF

Feature Extraction • 93.2M • Updated Aug 2 • 325 • 2

cstr/sface-GGUF

Feature Extraction • 9.63M • Updated Aug 2 • 159 • 1

cstr/siglip-large-256-GGUF

Image Feature Extraction • 0.3B • Updated Aug 2 • 25 • 1

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 6.74k • 13

FunAudioLLM/fsmn-vad-GGUF

Voice Activity Detection • 430k • Updated Jun 21 • 2.73k • 3

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated Jun 21 • 4.62k • 12

mudler/ced-gguf

Audio Classification • 85.7M • Updated Jun 21 • 1.52M • 3

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated Jul 27 • 61k • 9

cstr/voxtral-4b-tts-GGUF

Text-to-Speech • 4B • Updated Aug 2 • 806 • 4

weemed/Breeze-ASR-26-GGML

Automatic Speech Recognition • Updated Jul 17 • 1