Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,935

Base only

Active filters: llama.cpp

Vibe-Bataklik/open_jobs

8B • Updated Mar 27 • 35 • 1

Jackrong/Qwen3.5-4B-Python-Coder-GGUF

4B • Updated Mar 14 • 2.26k • 1

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 7.23k • 8

Bronsn/tiny-aya-global-tools-GGUF

Text Generation • Updated Mar 21 • 1

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX

Image-Text-to-Text • 9B • Updated Apr 1 • 671 • 6

jgebbeken/gemma-4-coder-gguf

8B • Updated Apr 19 • 11.3k • 19

LiquidAI/LFM2.5-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated Apr 6 • 7.84k • 46

apothic/bonsai-8B-1bit-turboquant

8B • Updated Apr 5 • 291 • 5

BrainboxAI/law-il-E2B

Text Generation • 5B • Updated Apr 22 • 193 • 3

Jackrong/Qwopus3.5-2B-v3-GGUF

2B • Updated Apr 12 • 1.71k • 4

Jackrong/Qwopus3.5-0.8B-v3-GGUF

0.8B • Updated Apr 12 • 1.36k • 4

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1

Image-Text-to-Text • 10B • Updated Apr 18 • 20.2k • 63

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated Apr 18 • 125k • 102

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 5.57k • 76

ponytang3/Qwen3.6-35B-A3B-heretic-ud-iq4_nl-GGUF

35B • Updated Apr 17 • 238 • 2

tomvaillant/gemma4-e4b-abliterated-journalist-GGUF

8B • Updated about 1 month ago • 144 • 1

batiai/Qwen3-VL-Embedding-8B-GGUF

Sentence Similarity • 8B • Updated Apr 18 • 2.04k • 7

kanarena/supergemma4-e4b-abliterated-multimodal-gguf-4bit

Image-Text-to-Text • 8B • Updated Apr 19 • 967 • 2

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 13.2k • 29

edbuildingstuff/splashco-drive-gguf

Text Generation • 1B • Updated Apr 20 • 9 • 1

jinaai/jina-embeddings-v5-omni-small-retrieval-GGUF

Feature Extraction • 0.6B • Updated 18 days ago • 2.1k • 3

mad-lab-ai/Qwen3.6-27B-tq-gguf

Text Generation • 27B • Updated Apr 23 • 961 • 5

Youseff1987/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF-with-mmproj

Text Generation • 35B • Updated Apr 23 • 1.7k • 1

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q5_K_M-GGUF

Text Generation • 35B • Updated Apr 23 • 9.91k • 10

loilkon/Qwopus3.5-9B-v3.5-Uncensored

Text Generation • 9B • Updated Apr 25 • 638 • 7

lambsea/Qwen3.6-35B-A3B-Abliterated-Heretic-UD-GGUF

35B • Updated Apr 25 • 584 • 1

zlaabsi/Qwen3.6-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated 28 days ago • 4.36k • 24

GestaltLabs/Ornstein-Hermes-3.6-27b-SABER-GGUF

Text Generation • 27B • Updated Apr 28 • 2.56k • 18

cHunter789/Qwen3.6-27B-i1-IQ4_XS-GGUF

Text Generation • 27B • Updated 28 days ago • 9.17k • 27

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 2.98k • 5