Update README.md
Browse files
README.md
CHANGED
|
@@ -202,7 +202,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
| 202 |
|
| 203 |
```Shell
|
| 204 |
export MODEL=google/gemma-3-12b-it # or pytorch/gemma-3-12b-it-INT4
|
| 205 |
-
lm_eval --model hf --model_args pretrained
|
| 206 |
```
|
| 207 |
|
| 208 |
## multi-modal eval
|
|
|
|
| 202 |
|
| 203 |
```Shell
|
| 204 |
export MODEL=google/gemma-3-12b-it # or pytorch/gemma-3-12b-it-INT4
|
| 205 |
+
lm_eval --model hf --model_args pretrained=$MODEL --tasks mmlu --device cuda:0 --batch_size 8
|
| 206 |
```
|
| 207 |
|
| 208 |
## multi-modal eval
|