---
license: apache-2.0
language:
- en
base_model:
- Qwen/Qwen3-4B-Thinking-2507
pipeline_tag: text-generation
library_name: transformers
---

This model is a gguf q4km format of janhq/Jan-v1-2509 generated by intel/auto-round algorithm. Embedding layer and lm-head layer are fallback to 8 bits and non expert layers are fallback to 4 bits
<br>
original model:<br>
https://huggingface.co/janhq/Jan-v1-2509
<br>
<br>
quant_methode:<br>
https://github.com/intel/auto-round
<br>
<br>
untested...