Models

allenai/olmOCR-7B-0225-preview-FP8

Image-Text-to-Text • Updated 8 days ago • 338 • 7

rednote-hilab/dots.llm1.inst-FP8-dynamic

Text Generation • Updated 2 days ago • 4

RedHatAI/pixtral-12b-FP8-dynamic

Text Generation • Updated Feb 7 • 84.3k • 10

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 27 days ago • 8.4k • 25

justinjja/Qwen3-235B-A22B-INT4-W4A16

Text Generation • Updated Apr 30 • 1.98k • 9

boboliu/Qwen3-Embedding-0.6B-W4A16-G128

Feature Extraction • Updated 19 days ago • 171 • 2

RedHatAI/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2, 2024 • 4.37k • 24

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic

Updated Dec 6, 2024 • 2.72k • 12

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated 26 days ago • 13.3k • 8

root-signals/RootSignals-Judge-Llama-70B

Text Generation • Updated Feb 19 • 1.63k • 16

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.57k • 11

RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated Apr 3 • 41.7k • 3

JKCHSTR/llama-joycaption-alpha-two-hf-llava-FP8-Dynamic

Image-Text-to-Text • Updated Feb 18 • 65 • 4

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • Updated Apr 6 • 3.45k • 14

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • Updated Apr 13 • 28.1k • 5

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 26 days ago • 3.45k • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 26 days ago • 8.92k • 8

RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • Updated May 13 • 3.27k • 11

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • Updated May 13 • 3.71k • 7

bullerwins/Devstral-Small-2505-fp8

Text2Text Generation • Updated May 21 • 861 • 4

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • Updated 17 days ago • 237 • 1

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 17 days ago • 496 • 5

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • Updated 17 days ago • 302 • 1

RedHatAI/Magistral-Small-2506-FP8

Updated 16 days ago • 6.79k • 6

justinjja/MiniMax-M1-80k-W4A16-INT4

Text Generation • Updated 3 days ago • 21 • 1

noneUsername/Mistral-Small-3.2-24B-Instruct-hf-W8A8

Updated 2 days ago • 1

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated about 11 hours ago • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • Updated Oct 9, 2024 • 26

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • Updated Oct 9, 2024 • 23

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • Updated Oct 10, 2024 • 34