README.md

metadata

pipeline_tag: image-text-to-text
base_model:
  - huihui-ai/Huihui-Qwen3-VL-2B-Instruct-abliterated

These are quantizations of the model Huihui-Qwen3-VL-2B-Instruct-abliterated.

These quantizations were created using an imatrix merged from combined_all_large and harmful.txt to leverage the abliterated nature of the model.

Usage Notes:

• Download the latest llama.cpp to use these quantizations.
• Try to use the best quality you can run.
• For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).