Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

218

Base only

Active filters: mla

ubergarm/Kimi-K2-Instruct-0905-GGUF

Text Generation • 1T • Updated Sep 8, 2025 • 647 • 16

anikifoss/Kimi-K2-Instruct-0905-HQ4_K

Text Generation • 1T • Updated Nov 27, 2025 • 45 • 3

ubergarm/DeepSeek-V3.1-Terminus-GGUF

Text Generation • 671B • Updated Sep 26, 2025 • 645 • 9

anikifoss/DeepSeek-V3.1-Terminus-HQ4_K

Text Generation • 671B • Updated Nov 27, 2025 • 9 • 2

andtt/llama3.2-1b-mla-Q3_K_S-GGUF

1B • Updated Nov 2, 2025 • 16 • 1

ubergarm/Kimi-K2-Thinking-GGUF

Text Generation • 1T • Updated Nov 20, 2025 • 545 • 22

ubergarm/GigaChat3-10B-A1.8B-GGUF

Text Generation • 11B • Updated Nov 21, 2025 • 576 • 13

fs90/nano-start_64_26m_f32

Text Generation • 26.7M • Updated Dec 5, 2025 • 21

abal1000x/nano-start_64_26m_f32

Text Generation • 26.7M • Updated Dec 9, 2025 • 14

mlx-community/Youtu-LLM-2B

Text Generation • 2B • Updated Jan 1 • 21 • 1

mlx-community/Youtu-LLM-2B-4bit

Text Generation • 2B • Updated Jan 1 • 45 • 4

AaryanK/Youtu-LLM-2B-GGUF

Text Generation • 2B • Updated Jan 1 • 992 • 11

ChavyvAkvar/mla-baseline-1-epoch

27.8M • Updated Jan 10 • 9

ubergarm/Kimi-K2.5-GGUF

Text Generation • 1T • Updated Feb 6 • 314 • 11

Arko007/zenyx-v2-base

Text Generation • Updated Apr 14

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 574 • 10

carlyou/DeepSeek-V2-Lite-NVFP4

Text Generation • 9B • Updated Mar 8 • 73

sachin-sith/Mistral-Small-4-119B-2603-MLX-4bit

Text Generation • 119B • Updated Mar 21 • 82

sachin-sith/Mistral-Small-4-119B-2603-MLX-8bit

Text Generation • 119B • Updated Mar 21 • 39

JANGQ-AI/Mistral-Small-4-119B-A6B-JANG_2L

Text Generation • 61B • Updated 24 days ago • 858 • 8

JANGQ-AI/Mistral-Small-4-119B-A6B-JANG_4M

Text Generation • 61B • Updated 24 days ago • 303

JANGQ-AI/Mistral-Small-4-119B-A6B-JANG_6M

Text Generation • 119B • Updated 24 days ago • 317

dealignai/Mistral-Small-4-119B-JANG_2L-CRACK

Image-Text-to-Text • 61B • Updated 24 days ago • 374 • 3

AlgoDriveAI/AIMO_EP_25

Text Generation • Updated 11 days ago • 2

carlyou/DeepSeek-V2-Lite-FP8-Group

Text Generation • 16B • Updated Apr 4 • 68

mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated Aug 17 • 3.5k • 17

mudler/Mistral-Small-4-119B-2603-APEX-GGUF

119B • Updated Aug 17 • 4.83k • 2

caiovicentino1/GLM-4.7-Flash-HLWQ-Q5

Updated Apr 13 • 17 • 1

TitanPythons/Mistral-Small-4-119B-JANG_2L-CRACK

Image-Text-to-Text • 128B • Updated Mar 23 • 72 • 1

pandeyps/DeepSeekV3

Text Generation • 0.2B • Updated Apr 13 • 31