-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
MaziyarPanahi/VibeThinker-1.5B-GGUF
Text Generation
•
2B
•
Updated
•
16.5k
•
35
MaziyarPanahi/Bioxtral-4x7B-v0.1-GGUF
Text Generation
•
24B
•
Updated
•
75
•
3
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
80.1k
•
30
MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2
Updated
•
14
•
32
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
79.8k
•
19
MaziyarPanahi/MN-Violet-Lotus-12B-GGUF
Text Generation
•
12B
•
Updated
•
405
•
1
FluffyKaeloky/MistralThinker-v1.1-exl2-6.0bpw
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
•
12B
•
Updated
•
154k
•
12
MetaphoricalCode/Star-Command-R-32B-v1-exl3-6bpw-hb6
14B
•
Updated
•
3
•
1
lmstudio-community/Devstral-Small-2505-MLX-6bit
Text Generation
•
5B
•
Updated
•
75
•
7
mlx-community/Kimi-Dev-72B-6bit
Text Generation
•
73B
•
Updated
•
52
•
1
mlx-community/GLM-4.5-Air-6bit
Text Generation
•
107B
•
Updated
•
59
•
3
mlx-community/Kimi-VL-A3B-Thinking-2506-6bit
Image-Text-to-Text
•
Updated
•
75
•
2
mlx-community/Qwen3-Next-80B-A3B-Instruct-6bit
Text Generation
•
80B
•
Updated
•
132
•
3
mlx-community/Qwen3-Next-80B-A3B-Thinking-6bit
Text Generation
•
80B
•
Updated
•
57
•
1
mlx-community/DeepSeek-OCR-6bit
Image-Text-to-Text
•
1.0B
•
Updated
•
914
•
1
mlx-community/Kimi-Linear-48B-A3B-Instruct-6bit
Text Generation
•
49B
•
Updated
•
1k
•
3
DeathGodlike/Sweet-Dreams-12B_EXL3
Text Generation
•
Updated
•
3
•
2
MaziyarPanahi/Qwen3-4B-Thinking-2507-GGUF
Text Generation
•
4B
•
Updated
•
5.56k
•
1
garrison/GLM-4.5-Air-Derestricted-mlx-6Bit
Text Generation
•
107B
•
Updated
•
97
•
1
DeathGodlike/ThetaBlackGorgon-8B_EXL3
Text Generation
•
Updated
•
2
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
3
•
1
MaziyarPanahi/phi-2-GGUF
Text Generation
•
3B
•
Updated
•
239
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
82
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
167
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
191
•
5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
•
7B
•
Updated
•
129
•
3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
142
•
2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
163
•
2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
101
•
2