huihui-ai commited on
Commit
17123f2
·
1 Parent(s): 3e1b637

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -18,6 +18,27 @@ It was only the text part that was processed, not the image part.
18
 
19
  The abliterated model will no longer say "I can’t describe or analyze this image."
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ## Chat with Image
22
 
23
  ```
 
18
 
19
  The abliterated model will no longer say "I can’t describe or analyze this image."
20
 
21
+ ## GGUF
22
+
23
+
24
+ [llama.cpp.tr-qwen3-vl-6-b7106-495c611](https://github.com/Thireus/llama.cpp/releases/tag/tr-qwen3-vl-6-b7106-495c611) now supports conversion to GGUF format and can be tested using llama-mtmd-cli.
25
+
26
+ The [GGUF](https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/tree/main/GGUF) file has been uploaded.
27
+
28
+ ```
29
+ huggingface-cli download huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated --local-dir ./huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated --token xxx
30
+
31
+ llama-gguf-split --merge huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/GGUF/ggml-model-f16-00001-of-00002.gguf huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/GGUF/ggml-model-f16
32
+
33
+ llama-mtmd-cli -m huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/GGUF/ggml-model-f16.gguf --mmproj huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/GGUF/mmproj-model-f16.gguf -c 4096 --image png/cc.jpg -p "Describe this image."
34
+ ```
35
+
36
+ If it's just for chatting, you can use llama-cli.
37
+
38
+ ```
39
+ llama-cli -m huihui-ai/Huihui-Qwen3-VL-32B-Thinking-abliterated/GGUF/ggml-model-f16.gguf -c 40960
40
+ ```
41
+
42
  ## Chat with Image
43
 
44
  ```