Hugging Face's logo

unsloth
/
QwQ-32B-GGUF

Text Generation
GGUF
English
qwen2
chat
qwen
imatrix
conversational
Model card Files
xet
Community
11
danielhanchen commited on
Commit
0caee26
·
verified ·
1 Parent(s): 58a223e

Add files using upload-large-folder tool

Browse files
Files changed (7) hide show
  1. .gitattributes +4 -0
  2. QwQ-32B-IQ4_NL.gguf +3 -0
  3. QwQ-32B-IQ4_XS.gguf +3 -0
  4. QwQ-32B-Q2_K_L.gguf +2 -2
  5. QwQ-32B-Q4_0.gguf +3 -0
  6. QwQ-32B-Q4_1.gguf +3 -0
  7. QwQ-32B-Q5_K_M.gguf +2 -2
.gitattributes CHANGED
@@ -50,3 +50,7 @@ QwQ-32B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
50
  QwQ-32B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
51
  QwQ-32B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
  QwQ-32B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
50
  QwQ-32B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
51
  QwQ-32B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
  QwQ-32B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
53
+ QwQ-32B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
54
+ QwQ-32B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
55
+ QwQ-32B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
56
+ QwQ-32B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
QwQ-32B-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63d8108fc7c97958f398789541747beaaeef49525074eb051606318a9b30ff7d
3
+ size 18682174048
QwQ-32B-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:173439d7750cc8e8cf82113ef1d8c231577475c6f051f3b26b7d0343c8d691a4
3
+ size 17717484128
QwQ-32B-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9758aa98d50b7609e3b973a52676dbae58c815abc0ece7e3a28265be51f9131a
3
- size 12495575232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55730688b442bca6e3e84a2091b165432e56d7761e7e7886894ec3226ba68907
3
+ size 12495575648
QwQ-32B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88731435b50bec6d9de4d99d18d18e1a81be31567ecbbda616f39db362f2a15f
3
+ size 18711009888
QwQ-32B-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9186741bebe420385f1c536636fa62a99874d116b2d4cb37b2988de3270266dd
3
+ size 20639242848
QwQ-32B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:86b921a7c81dcca1f8adafa4f05b1ebdf43e1fe4cd7309f554107a82d63ced81
3
- size 23262156992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:723b827e74f7aee5df3e2904990d92359bd3cedac8d4ff883332ae285232651c
3
+ size 23262157408