Thireus
commited on
Commit
·
5d10b1e
1
Parent(s):
a1be202
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,7 +31,7 @@ cmake --build build --config Release -j16
|
|
| 31 |
cd ..
|
| 32 |
|
| 33 |
# Obtain Thireus' GGUF-Tool-Suite
|
| 34 |
-
git clone https://github.com/Thireus/GGUF-Tool-Suite
|
| 35 |
|
| 36 |
# Download model quant mix from recipe file:
|
| 37 |
cd GGUF-Tool-Suite
|
|
@@ -74,7 +74,7 @@ Here’s how DeepSeek-R1-0528 quantized with **Thireus’ GGUF Tool Suite** stac
|
|
| 74 |
|
| 75 |
More perplexity/bpw graphs for other supported models: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/ppl_graphs
|
| 76 |
|
| 77 |
-
*All PPL
|
| 78 |
|
| 79 |
---
|
| 80 |
|
|
|
|
| 31 |
cd ..
|
| 32 |
|
| 33 |
# Obtain Thireus' GGUF-Tool-Suite
|
| 34 |
+
GIT_LFS_SKIP_SMUDGE=1 git clone https://github.com/Thireus/GGUF-Tool-Suite
|
| 35 |
|
| 36 |
# Download model quant mix from recipe file:
|
| 37 |
cd GGUF-Tool-Suite
|
|
|
|
| 74 |
|
| 75 |
More perplexity/bpw graphs for other supported models: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/ppl_graphs
|
| 76 |
|
| 77 |
+
*All PPL benchmarks are computed with the parameters `-ctk f16 -c 512 -b 4096 -ub 4096`. Changing any of these parameters will alter the PPL. In particular, reducing `-b 4096 -ub 4096` increases the PPL, while increasing them decreases the PPL.*
|
| 78 |
|
| 79 |
---
|
| 80 |
|