Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43,007

Base only

Active filters: bitsandbytes

unsloth/Qwen3.8-27B-unsloth-bnb-4bit

27B • Updated 28 days ago • 274k • 16

unsloth/llama-3-8b-bnb-4bit

Text Generation • 8B • Updated Jan 7, 2025 • 14.7k • 206

RichardErkhov/huihui-ai_-_Llama-3.2-3B-Instruct-abliterated-8bits

3B • Updated Oct 26, 2024 • 11 • 1

unsloth/Qwen3-14B-bnb-4bit

15B • Updated May 13, 2025 • 11.6k • 7

169Pi/Alpie-Core

Text Generation • Updated Jun 19 • 48 • 9

vpakarinen/qwen3-4b-lora-uncensored-thinking

Text Generation • Updated 2 days ago • 19 • 1

wavespeed/MiniCPM-V-4_5-abliterated-int8

Image-Text-to-Text • 9B • Updated Aug 20 • 44 • 2

unsloth/Apertus-70B-Instruct-2509-unsloth-bnb-4bit

Text Generation • 71B • Updated Oct 3, 2025 • 50 • 3

unsloth/Z-Image-Turbo-unsloth-bnb-4bit

Text-to-Image • 3B • Updated Jan 9 • 7.91k • 7

KrishnaHuYaar/Fitness-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 10 • 2

gokhanarkan/sommo-7b-v1

Text Generation • 8B • Updated Jan 13 • 14 • 2

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 221 • 7

Vishalshendge3198/orpheus-3b-tts-german-emotional-merged

Text-to-Speech • 3B • Updated Mar 21 • 1

unsloth/gemma-4-E4B-it-unsloth-bnb-4bit

Image-Text-to-Text • 8B • Updated Jul 17 • 350k • 23

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated Jul 17 • 19.3k • 25

Aero-Ex/KIMODO-Meta3_llm2vec_NF4

8B • Updated Apr 4 • 7.7k • 9

rajveer43/gemma-4-E4B-medical-legal-finance-qa

Text Generation • 8B • Updated Apr 12 • 320 • 13

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 4 • 1

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated May 26 • 89 • 9

NAMAA-Space/cohere-transcribe-arabic-07-2026-int8

Automatic Speech Recognition • 2B • Updated Jul 10 • 256 • 3

NAMAA-Space/cohere-transcribe-arabic-07-2026-int4

Automatic Speech Recognition • 2B • Updated Jul 10 • 116 • 5

Darksp33d/loreweaver-rp-v1

Text Generation • Updated Jul 25 • 22 • 1

Mikkkkoooo/adaption_adapt_market_analysis

Updated Aug 9 • 4 • 1

unsloth/Muse-Glimmer-30B-unsloth-bnb-4bit

Image-Text-to-Text • 30B • Updated Aug 10 • 7.45k • 14

cwnd/Kimi-K3-MoonViT-V2-INT8-W8A16

Image Feature Extraction • Updated Aug 12 • 2

Prathik/DeepSeek-R1-Distill-Qwen-Base-7B

Text Generation • 8B • Updated 4 days ago • 195 • 1

ixim/Image21-INT8

Text-to-Image • 7B • Updated 1 day ago • 50 • 1

LousisOfficial/LousisAI-4B

4B • Updated 1 day ago • 27 • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 15

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 10 • 3