smol-IQ2_KS on a barely sufficient system
2
#11 opened 2 days ago
by
Hansi2024
when qwen_next (i just tested both model did well)
π
1
4
#10 opened 10 days ago
by
gopi87
IQ5_K on EPYC with a single GPU
π₯
1
1
#9 opened 10 days ago
by
sousekd
128K context does not work (possibly because YaRN meta information is missing?)
β
1
2
#8 opened 10 days ago
by
Lissanro
testing smol-IQ4-KSS
π
π
3
5
#7 opened 18 days ago
by
shewin
IQ2_K Ling 1T Discussion
π₯
2
3
#6 opened 19 days ago
by
Hunterx
Feedback on smol-IQ1_KT
π₯
1
#5 opened 19 days ago
by
wunderschnitzel
mainline llama.cpp?
2
#4 opened 21 days ago
by
gghfez
(IQ2_XSS) Initial Performance Results Inside γ96GB VRAM / 256GB DDR5 γ
π
π₯
2
3
#3 opened 21 days ago
by
phakio
Great Work!
β€οΈ
1
7
#2 opened 21 days ago
by
anikifoss
403 Error
6
#1 opened 21 days ago
by
ubergarm