Darkhn-Quants
/

M3.2-24B-Animus-V6-Exp-GGUF

Model card Files Files and versions

Send me your support to help me feed the data beast! also taking comissions for universe specific models

model is an experiment not even a full epoch (0.8), it seems bad to me (for some reason it likes to generate smut, going back to 64 lora rank)

Downloads last month: 22

GGUF

Model size

24B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Darkhn-Quants/M3.2-24B-Animus-V6-Exp-GGUF

Base model

Darkhn/M3.2-24B-Animus-V6-Exp

Quantized

(1)

this model