ModelCloud
/

Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1

Text Generation

4-bit precision

Model card Files Files and versions

lrl-modelcloud commited on Nov 9, 2024

Commit

6c8f29b

·

verified ·

1 Parent(s): 2aaa79e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -46,7 +46,7 @@ This model has been quantized using [GPTQModel](https://github.com/ModelCloud/GP
 from transformers import AutoTokenizer
 from gptqmodel import GPTQModel
-model_name = "ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortext-v1"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = GPTQModel.from_quantized(model_name)

 from transformers import AutoTokenizer
 from gptqmodel import GPTQModel
+model_name = "ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = GPTQModel.from_quantized(model_name)