Instructions to use mradermacher/Open-Xi-Math-Preview-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Open-Xi-Math-Preview-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Open-Xi-Math-Preview-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mradermacher/Open-Xi-Math-Preview-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
Use Docker
docker model run hf.co/mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use mradermacher/Open-Xi-Math-Preview-GGUF with Ollama:
ollama run hf.co/mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use mradermacher/Open-Xi-Math-Preview-GGUF with Docker Model Runner:
docker model run hf.co/mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
- Lemonade
How to use mradermacher/Open-Xi-Math-Preview-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mradermacher/Open-Xi-Math-Preview-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Open-Xi-Math-Preview-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
uploaded from leia
Browse files- .gitattributes +12 -0
- Open-Xi-Math-Preview.IQ4_XS.gguf +3 -0
- Open-Xi-Math-Preview.Q2_K.gguf +3 -0
- Open-Xi-Math-Preview.Q3_K_L.gguf +3 -0
- Open-Xi-Math-Preview.Q3_K_M.gguf +3 -0
- Open-Xi-Math-Preview.Q3_K_S.gguf +3 -0
- Open-Xi-Math-Preview.Q4_K_M.gguf +3 -0
- Open-Xi-Math-Preview.Q4_K_S.gguf +3 -0
- Open-Xi-Math-Preview.Q5_K_M.gguf +3 -0
- Open-Xi-Math-Preview.Q5_K_S.gguf +3 -0
- Open-Xi-Math-Preview.Q6_K.gguf +3 -0
- Open-Xi-Math-Preview.Q8_0.gguf +3 -0
- Open-Xi-Math-Preview.f16.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
Open-Xi-Math-Preview.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
Open-Xi-Math-Preview.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
Open-Xi-Math-Preview.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
Open-Xi-Math-Preview.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
Open-Xi-Math-Preview.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
Open-Xi-Math-Preview.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
Open-Xi-Math-Preview.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
Open-Xi-Math-Preview.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
Open-Xi-Math-Preview.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
Open-Xi-Math-Preview.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
Open-Xi-Math-Preview.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
Open-Xi-Math-Preview.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
Open-Xi-Math-Preview.IQ4_XS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:264a50e6639c20601593bd6a9047b0d5c4adde0a66983c21e0aaca6b1d79dd6c
|
| 3 |
+
size 1026163840
|
Open-Xi-Math-Preview.Q2_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:deeb9c6a979cf0675686be023809e426719747f61a50f37007e03028a4f8de59
|
| 3 |
+
size 752881792
|
Open-Xi-Math-Preview.Q3_K_L.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c11d421fd2c3d39deb9a54cfbf07965516bad2197e23ad142a3313c8056faab7
|
| 3 |
+
size 980441728
|
Open-Xi-Math-Preview.Q3_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7bdc50bd646d31455b35faa8c3e80734583d50e1b646da38d65918b4a57315e9
|
| 3 |
+
size 924457600
|
Open-Xi-Math-Preview.Q3_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cae303cf534d8d08304b6e4ac7171a89a4d11978ca4af5dc2cbbad2ad099fd45
|
| 3 |
+
size 861223552
|
Open-Xi-Math-Preview.Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77794f7288a2679b0731d818ad0f31e1f6b32fb52ebd28792e05a9e4251428f7
|
| 3 |
+
size 1117322368
|
Open-Xi-Math-Preview.Q4_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64105477d6d9c474803ab5b6980d9443b675fb9ce52b619480deeba716f6e1e3
|
| 3 |
+
size 1071586432
|
Open-Xi-Math-Preview.Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c23c0d4bb293453c98683e83aefd3a1eaf1abe7b6072a68402acaa1b888f80e4
|
| 3 |
+
size 1285495936
|
Open-Xi-Math-Preview.Q5_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:34f57adcc30205e9b4e154b24b49dcf3b90213453c398e64bb56ffd5ccd0027c
|
| 3 |
+
size 1259175040
|
Open-Xi-Math-Preview.Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d9c0b8ed2b0df0f8ebab5e580a1262d683b9fde90e5ed479511d4de0371a247
|
| 3 |
+
size 1464180352
|
Open-Xi-Math-Preview.Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:22b014b7585e17c977c2c5a2bc073195339b816c2c6f7935acaf91133e84423f
|
| 3 |
+
size 1894533760
|
Open-Xi-Math-Preview.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3756b3b26a116825fe9d98b5167838e128868d5af71dbb2ca52f8ee6de414199
|
| 3 |
+
size 3560417920
|