Saiga2 70B - GPTQ, Russian LLaMA2-based chatbot

Description

This repo contains GPTQ model files for Saiga2 70B

Downloads last month
10
Safetensors
Model size
69B params
Tensor type
I32
·
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Komposter43/saiga2_70b_lora-GPTQ

Quantized
(1)
this model