Testing Q5 flavors (ubergarm / aessedai / unsloth) for "speed" on 8x RTX 3090
🔥 1
2
#10 opened 9 days ago
by 
dehnhaide
Testing smol-IQ4_KSS
❤️ 2
3
#9 opened 12 days ago
by 
shewin
Testing IQ5_K
❤️ 1
10
#8 opened 12 days ago
by shewin
IQ4_XS vs IQ4_KSS
1
#7 opened 12 days ago
by 
Arkovski
Curious how Q2_K 75 GB compares to unsloth UD-Q2_K_XL 75.3 GB?
3
#6 opened 13 days ago
by 
ha1ry
What quant would be closest to AWQ?
1
#5 opened 13 days ago
by 
curiouspp8
Quick bench for smol-IQ3_KS on 2 GPUs
👍 1
7
#4 opened 13 days ago
by curiouspp8
Quick bench for IQ2_KS on 1 GPU
👍 1
5
#3 opened 13 days ago
by curiouspp8
4bpw request =)
👀 1
13
#2 opened 13 days ago
by 
BahamutRU