Variable-width MoE expert pruning (Winnow): pruned OLMoE, Qwen3.6-35B-A3B and poolside Laguna-S-2.1 checkpoints, unhealed and healed.
-
hbfreed/Laguna-S-2.1-winnow-keep75
Text Generation • 89B • Updated • 413 -
hbfreed/Laguna-S-2.1-winnow-keep50
Text Generation • 61B • Updated • 499 -
hbfreed/Qwen3.6-35B-A3B-winnow-keep75
Text Generation • 27B • Updated • 432 • 1 -
hbfreed/Qwen3.6-35B-A3B-winnow-keep50
Text Generation • 19B • Updated • 423 • 1