Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

edge-deployment

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

176

Base only

Active filters: edge-deployment

StentorLabs/Stentor-12M

Text Generation • 12M • Updated Feb 10 • 181 • 1

LetheanNetwork/LEK-Gemma3-4B

Text Generation • 5B • Updated Feb 19 • 19

StentorLabs/Stentor-30M

Text Generation • 30.4M • Updated Feb 21 • 272 • 3

mradermacher/Stentor-30M-GGUF

Text Generation • 30.4M • Updated Feb 21 • 516 • 3

mradermacher/Stentor-30M-i1-GGUF

Text Generation • 30.4M • Updated Feb 21 • 610 • 2

StentorLabs/Stentor-30M-Instruct

Text Generation • 30.4M • Updated Feb 22 • 92 • 1

StentorLabs/Stentor-12M-Instruct

Text Generation • 12M • Updated Feb 22 • 85 • 2

mradermacher/Stentor-30M-Instruct-GGUF

Text Generation • 30.4M • Updated Feb 22 • 523 • 5

Flexan/StentorLabs-Stentor-12M-Instruct-GGUF

Text Generation • 12M • Updated Feb 23 • 183 • 1

hikewa/eisv-lumen-student

mradermacher/Stentor-12M-Instruct-GGUF

Text Generation • 12M • Updated Feb 23 • 117 • 1

StentorLabs/Stentor2-12M-Preview

Text Generation • 12.3M • Updated Feb 25 • 184 • 2

Thejmimiia/blackbird-she-doesnt-refuse-21b

21B • Updated Feb 24 • 19

WayBob/Qwen3VL-8B-4bit-GGUF-Jetson-Deployment

Image-Text-to-Text • 8B • Updated Mar 9 • 40

MihaiPopa-1/Stentor-30M-Instruct-heretic-safety-defiltered

Text Generation • 30.4M • Updated Feb 26 • 45 • 2

StentorLabs/Stentor2-12M

Text Generation • 12.3M • Updated Mar 8 • 38 • 2

forkjoin-ai/qwen2.5-0.5b-instruct-gguf

Text Generation • 0.6B • Updated Jun 7 • 23

forkjoin-ai/qwen2.5-7b-instruct-gguf

Text Generation • 8B • Updated Jul 8 • 71 • 1

forkjoin-ai/qwen3-4b-gguf

Text Generation • 4B • Updated Jun 30 • 57

forkjoin-ai/qwen3-8b-gguf

Text Generation • 8B • Updated Jun 30 • 28

forkjoin-ai/llama-3.2-3b-gguf

Text Generation • 3B • Updated Jun 9 • 19

forkjoin-ai/llama-3.3-70b-instruct-gguf

Text Generation • 71B • Updated Jun 9 • 51

forkjoin-ai/qwen2.5-vl-3b-instruct-gguf

Image-Text-to-Text • 3B • Updated Jun 9 • 44

forkjoin-ai/deepseek-ocr-2

Image-Text-to-Text • 3B • Updated Jun 9 • 38

forkjoin-ai/qwen3-tts-12hz-1.7b-customvoice

Text-to-Audio • 2B • Updated Jun 9 • 15 • 1

forkjoin-ai/qwen3-tts-12hz-1.7b-voicedesign

Text-to-Audio • 2B • Updated Jun 9 • 18

forkjoin-ai/qwen3-tts-12hz-0.6b-base

Text-to-Speech • 0.9B • Updated Jun 7 • 18

forkjoin-ai/qwen3-tts-12hz-0.6b-customvoice

Text-to-Audio • 0.9B • Updated Jun 9 • 13

forkjoin-ai/vibevoice-realtime-0.5b

Text-to-Audio • 1B • Updated Jun 9 • 14

forkjoin-ai/vibevoice-1.5b

Text-to-Audio • 3B • Updated Jun 9 • 6