Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,380

Base only

Active filters: 4-bit

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 2 days ago • 663k • 217

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 1 day ago • 11.6k • 23

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated 6 days ago • 388 • 11

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 21k • 253

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 3 days ago • 15.2k • 26

Jackrong/Qwopus3.6-27B-v2-MLX-4bit

Text Generation • 27B • Updated 11 days ago • 3.11k • 15

mlx-community/Qwen3.6-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated Apr 16 • 94.3k • 60

unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit

Image-Text-to-Text • 6B • Updated Apr 20 • 112k • 87

mlx-community/LocateAnything-3B-4bit

Image-Text-to-Text • 1B • Updated 4 days ago • 531 • 6

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 3 days ago • 8.21k • 12

stamsam/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MLX-oQ4-MTP

Text Generation • 35B • Updated 21 days ago • 7.69k • 11

tomasmcm/Darwin-4B-Genesis-mlx-4Bit

Text Generation • 1B • Updated 10 days ago • 106 • 5

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 966k • 109

Intel/Qwen3.6-27B-int4-AutoRound

6B • Updated 12 days ago • 188k • 39

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated about 20 hours ago • 1.07k • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 183k • 142

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 7B • Updated Nov 22, 2024 • 137k • 41

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 3 days ago • 197k • 49

mlx-community/gemma-4-e4b-it-4bit

Any-to-Any • 2B • Updated 14 days ago • 37.9k • 27

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated 1 day ago • 91.2k • 45

mlx-community/Qwen3.6-27B-4bit

Image-Text-to-Text • 5B • Updated Apr 22 • 40.7k • 25

froggeric/Qwen3.6-35B-A3B-Uncensored-Heretic-MLX-4bit

Image-Text-to-Text • 6B • Updated 27 days ago • 5.55k • 8

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated 29 days ago • 43.4k • 31

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-text-oQ4

Text Generation • 6B • Updated 15 days ago • 2.91k • 4

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated 11 days ago • 5.38k • 12

shawnw3i/Qwen3.6-27B-AWQ-MTP

Image-Text-to-Text • 6B • Updated 5 days ago • 1.8k • 3

mlx-community/humanizer-1B-OptIQ-4bit

Text Generation • 0.2B • Updated 1 day ago • 128 • 3

openbmb/MiniCPM5-1B-MLX

Text Generation • 0.2B • Updated 8 days ago • 3.17k • 12

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 757k • 135

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit

Text Generation • Updated Aug 6, 2025 • 6.46k • 24