Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

109

Full-text search

Active filters: int4

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • Updated 26 days ago • 18.1k

RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16

Updated Jan 3 • 63

RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16

Updated Mar 1 • 70

RedHatAI/QwQ-32B-Preview-quantized.w4a16

Updated Jan 3 • 7

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • Updated Jan 3 • 32

nintwentydo/pixtral-12b-2409-W4A16-G128

Image-Text-to-Text • Updated Jan 5 • 28 • 2

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • Updated 27 days ago • 1.7k • 1

RedHatAI/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • Updated Feb 28 • 147

RedHatAI/DeepSeek-V2.5-1210-quantized.w4a16

Text Generation • Updated Jan 11 • 36

RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16

Text Generation • Updated Jan 12 • 110

RedHatAI/granite-3.1-2b-base-quantized.w4a16

Text Generation • Updated Feb 28 • 64

RedHatAI/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 27 days ago • 137

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-4bit

Text Generation • Updated May 13 • 68 • 1

inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated Jan 23 • 2.29k • 10

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1

Text Generation • Updated Jan 24 • 18 • 5

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • Updated Jan 24 • 1.88k • 7

RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128

Text Generation • Updated Feb 10 • 57 • 1

RedHatAI/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • Updated Jan 31 • 14 • 1

RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.7k

RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.7k • 2

RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.92k • 1

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.97k • 4

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated Feb 27 • 2.35k • 4

RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.75k

RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16

Image-Text-to-Text • Updated Mar 31 • 2.08k

RedHatAI/pixtral-12b-quantized.w4a16

Image-Text-to-Text • Updated Feb 26 • 1.88k • 1

RedHatAI/Llama-3.2-11B-Vision-Instruct-quantized.w4a16

Image-Text-to-Text • Updated Feb 13 • 1.85k

nm-testing/whisper-large-v3.w4a16

Automatic Speech Recognition • Updated Feb 14 • 15 • 1

context-labs/neuralmagic-llama-3.1-8b-instruct-Q4KM

Text Generation • Updated Feb 23 • 30

RedHatAI/phi-4-quantized.w4a16

Text Generation • Updated 27 days ago • 1.97k • 2