---
license: apache-2.0
datasets:
- Multiverse4FM/Autoregressive-1K-mixed
- Multiverse4FM/Multiverse-1K
- simplescaling/s1K-1.1
base_model:
- Qwen/Qwen2.5-32B-Instruct
pipeline_tag: text-generation
library_name: transformers
---

# Model Summary

> Autoregressive-32B is a baseline of our Multiverse-32B built on autoregressive modeling.

- **Webpage:** [Multiverse](https://multiverse4fm.github.io/)
- **Paper:** [https://arxiv.org/abs/2506.09991](https://arxiv.org/abs/2506.09991)
# Use

The model usage is documented [here](https://github.com/Multiverse4FM/Multiverse).

# Evaluation

| Model | AIME24 | AIME25 | MATH500 | GPQA-Diamond |
| :--- | :---: | :---: | :---: | :---: |
| s1-32B | 35.4 | 25.8 | 88.6 | 48.0 |
| s1.1-32B | 52.9 | 41.7 | 93.4 | 62.6 |
| Qwen2.5-32B-Instruct | 15.8 | 10.4 | 80.4 | 47.0 |
| Autoregressive-32B | **54.6** | <u>45.0</u> | **92.8** | <u>61.6</u> |
| **Multiverse-32B-zero** | 52.1 | 44.2 | <u>92.4</u> | **63.6** |
| **Multiverse-32B** | 53.8 | **45.8** | 91.8 | 60.7 |

# Acknowledge

Thanks to the amazing s1 team for their s1.1 dataset as base data, and the Qwen team for their Qwen-2.5-32B-Instruct as base model.