Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

36,030

Full-text search

Active filters: 4-bit

sid22669/MCQ_Generator

Text Generation • Updated 2 days ago • 4

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated May 12 • 39k • 11

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 330k • 77

Qwen/Qwen3-32B-AWQ

Text Generation • Updated May 21 • 121k • 73

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 10.5k • 17

cnfusion/Kimi-Dev-72B-mlx-4Bit

Text Generation • Updated 8 days ago • 245 • 3

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 7.31k • 83

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 276k • 102

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Feb 15 • 396k • 75

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated 23 days ago • 13.8k • 17

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 31.6k • 56

unsloth/gemma-3-12b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated May 12 • 39.7k • 16

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 7.14k • 25

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • Updated 3 days ago • 64.7k • 10

unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit

Text Generation • Updated 16 days ago • 27.1k • 5

adamo1139/DeepSeek-R1-0528-AWQ

Text Generation • Updated 21 days ago • 161 • 2

btbtyler09/Kimi-Dev-72B-GPTQ-4bit

Text Generation • Updated 6 days ago • 128 • 2

vlbosch/Qwen3-235B-A22B-MLX-mixed-4bit

Updated 5 days ago • 127 • 2

unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit

Image-Text-to-Text • Updated 2 days ago • 242 • 2

unsloth/Mistral-Small-3.2-24B-Instruct-2506-bnb-4bit

Image-Text-to-Text • Updated 2 days ago • 204 • 2

mlx-community/Mistral-Small-3.2-24B-Instruct-2506-4bit

Text Generation • Updated 4 days ago • 237 • 2

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.21k • 39

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 29 • 2

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 12 • 3

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 11.9k • 13

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 56.4k • 52

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 34.8k • 46

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 353 • 9

PrunaAI/Mistral-7B-Instruct-v0.2-bnb-4bit

Updated Aug 2, 2024 • 10 • 3

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 203k • 81