File size: 241 Bytes
7b65787 |
1 2 3 4 5 6 7 8 9 |
---
base_model:
- deepseek-ai/DeepSeek-V3-0324
pipeline_tag: text-generation
---
For inference with `sglang` and `kt-kernel`: https://lmsys.org/blog/2025-10-22-KTransformers/
This version is packed specifically for NUMA tensor parallel = 4 |