Edit Models filters

Apps

Apps with no match

Inference Providers

HF Inference API

Inference Providers with no match

Misc

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

780

Full-text search

Active filters: vllm

RedHatAI/Mistral-Small-24B-Instruct-2501

Text Generation • Updated 26 days ago • 142

drensin/DeepHermes-3-Llama-3-8B-Preview-Q8_0-GGUF

Updated May 11 • 18

jsbaicenter/r1-1776-distill-llama-70b-GPTQ-4bit

Text Generation • Updated May 13 • 13

enosislabs/math-mini-1.7b-preview-16bits

Text Generation • Updated May 25 • 26

chutesai/Devstral-Small-2505

Text2Text Generation • Updated May 21 • 361

reach-vb/Devstral-Small-2505

Text2Text Generation • Updated May 21 • 48

guysh-dev/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated May 21 • 33

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text2Text Generation • Updated May 24 • 3.42k • 4

Abdoul-AI/Devstral-Small-2505-GGUF

Text2Text Generation • Updated May 21

unsloth/Devstral-Small-2505-bnb-4bit

Text2Text Generation • Updated May 24 • 2.79k • 3

matatonic/Devstral-Small-2505-4.25bpw-exl2

Text2Text Generation • Updated May 21 • 77 • 2

matatonic/Devstral-Small-2505-5.0bpw-exl2

Text2Text Generation • Updated May 21 • 49 • 1

matatonic/Devstral-Small-2505-6.5bpw-h8-exl2

Text2Text Generation • Updated May 21 • 53 • 1

ArtusDev/mistralai_Devstral-Small-2505_EXL3_3.0bpw_H6

Text2Text Generation • Updated May 21 • 67

ArtusDev/mistralai_Devstral-Small-2505_EXL3_3.5bpw_H6

Text2Text Generation • Updated May 21 • 19

ArtusDev/mistralai_Devstral-Small-2505_EXL3_4.0bpw_H6

Text2Text Generation • Updated May 21 • 36 • 1

ArtusDev/mistralai_Devstral-Small-2505_EXL3_4.5bpw_H6

Text2Text Generation • Updated May 21 • 24

ArtusDev/mistralai_Devstral-Small-2505_EXL3_5.0bpw_H6

Text2Text Generation • Updated May 21 • 43

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.0bpw_H6

Text2Text Generation • Updated May 21 • 103

ArtusDev/mistralai_Devstral-Small-2505_EXL3_8.0bpw_H6

Text2Text Generation • Updated May 21 • 58

ArtusDev/mistralai_Devstral-Small-2505_EXL3_5.5bpw_H6

Text2Text Generation • Updated May 21 • 19

ArtusDev/mistralai_Devstral-Small-2505_EXL3_5.5bpw_H8

Text2Text Generation • Updated May 21 • 51

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.0bpw_H8

Text2Text Generation • Updated May 21 • 21

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.5bpw_H8

Text2Text Generation • Updated May 21 • 36

ArtusDev/mistralai_Devstral-Small-2505_EXL3_8.0bpw_H8

Text2Text Generation • Updated May 21 • 42 • 1

nm-testing/Devstral-Small-2505-FP8-dynamic

Text2Text Generation • Updated May 21 • 4.83k

async0x42/Devstral-Small-2505-exl3_4.0bpw

Text2Text Generation • Updated May 21 • 18

async0x42/Devstral-Small-2505-exl3_4.5bpw

Text2Text Generation • Updated May 21 • 15

casperhansen/Mistral-Small-3.1-24B-Base-2503-Text-Only

Updated May 22 • 93

Antigma/Devstral-Small-2505-GGUF

Text2Text Generation • Updated 27 days ago • 546 • 1