Update README.md
Browse files
README.md
CHANGED
|
@@ -113,11 +113,11 @@ AMD64.
|
|
| 113 |
|
| 114 |
## About Quantization Formats
|
| 115 |
|
| 116 |
-
This model works
|
| 117 |
-
|
| 118 |
-
|
| 119 |
aistudio.google.com. If you encounter any divergences, then try using
|
| 120 |
-
the BF16 weights, which have the original fidelity.
|
| 121 |
|
| 122 |
---
|
| 123 |
|
|
|
|
| 113 |
|
| 114 |
## About Quantization Formats
|
| 115 |
|
| 116 |
+
This model works well with any quantization format. Q6\_K is the best
|
| 117 |
+
choice overall. We tested that it's able to produce identical responses
|
| 118 |
+
to the Gemma2 27B model that's hosted by Google themselves on
|
| 119 |
aistudio.google.com. If you encounter any divergences, then try using
|
| 120 |
+
the BF16 weights, which have the original fidelity.
|
| 121 |
|
| 122 |
---
|
| 123 |
|