EXL3 models
Collection
33 items
•
Updated
•
38
EXL3 quants of Qwen3-Next-80B-A3B-Thinking
⚠️ Requires ExLlamaV3 v0.0.7 (or v0.0.6 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Optimized:
2.08 bits per weight
2.27 bits per weight
2.78 bits per weight
3.14 bits per weight
3.53 bits per weight
4.06 bits per weight
4.51 bits per weight
Base model
Qwen/Qwen3-Next-80B-A3B-Thinking