Text Classification
PEFT
Safetensors
decision-making
system-one
calibrated-probabilities
lora
qwen3
indic
hinglish
hindi
non-generative
Instructions to use cmul8-hf/nirnaya with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use cmul8-hf/nirnaya with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Remove changelog; soften language-coverage limitation
Browse files
README.md
CHANGED
|
@@ -113,7 +113,7 @@ ECE ≤ 0.077 on the three strong IndicJevBench datasets — well below the 0.10
|
|
| 113 |
- **English JevBench regression:** the *original* tier drops from 0.681 (mid-training) to 0.569 (final) — a −11pp regression. This is consistent with continued Indic-heavy fine-tuning drifting the decision heads away from English task phrasing. This is expected: Nirṇaya is India-first by design.
|
| 114 |
- **Score-type calibration on hard tasks:** ECE on JevBench *hard* tier is 0.388 (catastrophically overconfident on the hardest questions). Practical deployment should apply per-(type, K) temperature scaling on your own calibration split. A calibration recipe will ship alongside the inference package.
|
| 115 |
- **Not a generator:** Nirṇaya does not produce free-form text. Use a generative model for open-ended tasks.
|
| 116 |
-
- **Language coverage:** trained on 7 Indic languages (`hi bn ta te kn ml`) + English + Hinglish. Marathi
|
| 117 |
- **Prompt-injection surface:** because Nirṇaya reads `state` as raw text, adversarial content in the state can still influence probabilities. Do not use Nirṇaya as the sole safety gate for adversarial inputs.
|
| 118 |
|
| 119 |
---
|
|
@@ -182,9 +182,3 @@ Until the inference package lands, the checkpoint can be loaded via the training
|
|
| 182 |
- **Training frameworks:** [transformers](https://github.com/huggingface/transformers), [PEFT](https://github.com/huggingface/peft), PyTorch
|
| 183 |
- **Benchmark inspiration:** TypeSafe AI's Jev / JevBench
|
| 184 |
- **Companion benchmark:** [IndicJevBench](https://huggingface.co/datasets/cmul8-hf/IndicJevBench) — released alongside Nirṇaya
|
| 185 |
-
|
| 186 |
-
---
|
| 187 |
-
|
| 188 |
-
## Changelog
|
| 189 |
-
|
| 190 |
-
- **v1.0 — 2026-09-25:** Initial public release. Step-18616 checkpoint. Numbers frozen as reported above.
|
|
|
|
| 113 |
- **English JevBench regression:** the *original* tier drops from 0.681 (mid-training) to 0.569 (final) — a −11pp regression. This is consistent with continued Indic-heavy fine-tuning drifting the decision heads away from English task phrasing. This is expected: Nirṇaya is India-first by design.
|
| 114 |
- **Score-type calibration on hard tasks:** ECE on JevBench *hard* tier is 0.388 (catastrophically overconfident on the hardest questions). Practical deployment should apply per-(type, K) temperature scaling on your own calibration split. A calibration recipe will ship alongside the inference package.
|
| 115 |
- **Not a generator:** Nirṇaya does not produce free-form text. Use a generative model for open-ended tasks.
|
| 116 |
+
- **Language coverage:** trained on 7 Indic languages (`hi bn ta te kn ml`) + English + Hinglish. Marathi, Gujarati and other Indic languages will be added in future releases.
|
| 117 |
- **Prompt-injection surface:** because Nirṇaya reads `state` as raw text, adversarial content in the state can still influence probabilities. Do not use Nirṇaya as the sole safety gate for adversarial inputs.
|
| 118 |
|
| 119 |
---
|
|
|
|
| 182 |
- **Training frameworks:** [transformers](https://github.com/huggingface/transformers), [PEFT](https://github.com/huggingface/peft), PyTorch
|
| 183 |
- **Benchmark inspiration:** TypeSafe AI's Jev / JevBench
|
| 184 |
- **Companion benchmark:** [IndicJevBench](https://huggingface.co/datasets/cmul8-hf/IndicJevBench) — released alongside Nirṇaya
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|