Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ Read more about NVFP4 at NVIDIA (https://developer.nvidia.com/blog/introducing-n
|
|
| 23 |
- Quantization Method: NVFP4
|
| 24 |
- Base Model: [fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct)
|
| 25 |
- Tool: NVIDIA TensorRT Model Optimizer
|
| 26 |
-
- Environment: NVIDIA Spark
|
| 27 |
|
| 28 |
## Loading
|
| 29 |
Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.
|
|
|
|
| 23 |
- Quantization Method: NVFP4
|
| 24 |
- Base Model: [fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct)
|
| 25 |
- Tool: NVIDIA TensorRT Model Optimizer
|
| 26 |
+
- Environment: NVIDIA DGX Spark | NVIDIA-SMI 580.95.05 | Driver Version: 580.95.05 | CUDA Version: 13.0 |
|
| 27 |
|
| 28 |
## Loading
|
| 29 |
Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.
|