Models

huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

Text Generation • Updated Feb 2 • 471 • 20

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.57k • 11

RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated Apr 3 • 41.7k • 3

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated Apr 10 • 14.4k • • 339

SistInf/Velvet-2B-GGUF

Updated Feb 12 • 91 • 5

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • Updated Mar 13 • 2.79k • 108

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated May 21 • 41k • 78

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • Updated Apr 13 • 28.1k • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 26 days ago • 8.92k • 8

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated 5 days ago • 156 • 1

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 26 days ago • 83 • 1

bullerwins/Devstral-Small-2505-fp8

Text2Text Generation • Updated May 21 • 861 • 4

lucyknada/unsloth_Devstral-Small-2505-exl3

Text2Text Generation • Updated May 21 • 4 • 1

huihui-ai/Devstral-Small-2505-abliterated

Text2Text Generation • Updated 16 days ago • 65 • 7

Mungert/Devstral-Small-2505-GGUF

Text2Text Generation • Updated 10 days ago • 3.57k • 4

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • Updated 16 days ago • 237 • 1

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 16 days ago • 496 • 5

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • Updated 16 days ago • 302 • 1

RedHatAI/Magistral-Small-2506-FP8

Updated 15 days ago • 6.79k • 6

abhishekchohan/Magistral-Small-2506-AWQ

Updated 14 days ago • 258 • 1

huihui-ai/Magistral-Small-2506-abliterated

Text2Text Generation • Updated 7 days ago • 162 • 9

kramster/evolve-mistral

Updated 6 days ago • 12 • 1

unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated 4 days ago • 4 • 1

matatonic/Mistral-Small-3.2-24B-Instruct-2506-5.0bpw-exl2

Image-Text-to-Text • Updated 4 days ago • 11 • 1

Inferless/deciLM-7B-GPTQ

Text Generation • Updated Jan 4, 2024 • 27 • 1

Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Jan 4, 2024 • 32 • 2

Inferless/Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation • Updated Jan 25, 2024 • 337 • 2

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 3.53k • 23

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • Updated Jul 18, 2024 • 167 • 3

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 5.32k • 8