HERETICODER-2.5-3B-IT

Model Description

This is an abliterated decensored version of Qwen2.5-Coder-3B-Instruct using Heretic!

• License: apache-2.0
• Abliterated by : Cannae-AI
• Base model : Qwen/Qwen2.5-Coder-3B-Instruct

Model	Refusals	KL divergence
HERETICODER-2.5-3B-IT	0/100	0.30
HERETICODER-2.5-7B-IT	1/100	0.00

• Parameters:
  • direction_index = 27.30
  • attn.o_proj.max_weight = 1.44
  • attn.o_proj.max_weight_position = 33.01
  • attn.o_proj.min_weight = 1.00
  • attn.o_proj.min_weight_distance = 14.98
  • mlp.down_proj.max_weight = 1.15
  • mlp.down_proj.max_weight_position = 28.50
  • mlp.down_proj.min_weight = 0.95
  • mlp.down_proj.min_weight_distance = 16.30