Model Details

  • Qwen/Qwen3-0.6B Backbone + Qwen3-8B LM Head

Cite it

@article{li2026shadowpeft,
      title={ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning}, 
      author={Xianming Li and Zongxi Li and Tsz-fung Andrew Lee and Jing Li and Haoran Xie and Qing Li},
      year={2026},
      eprint={2604.19254},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2604.19254}, 
}
Downloads last month
61
Safetensors
Model size
1B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including shadow-llm/Qwen3-0.6B-H8B

Paper for shadow-llm/Qwen3-0.6B-H8B