Models

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 31.6k • 57

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 330k • 77

Qwen/Qwen3-32B-AWQ

Text Generation • Updated May 21 • 121k • 73

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 7.14k • 25

adamo1139/DeepSeek-R1-0528-AWQ

Text Generation • Updated 22 days ago • 161 • 2

abhishekchohan/Magistral-Small-2506-AWQ

Updated 14 days ago • 258 • 2

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.21k • 39

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 29 • 2

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Feb 25 • 36 • 13

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 16.7k • 25

TechxGenus/DeepSeek-Coder-V2-Lite-Base-AWQ

Text Generation • Updated Jun 22, 2024 • 221k • 2

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 2.25k • 26

casperhansen/deepseek-r1-distill-llama-8b-awq

Updated Feb 8 • 2.27k • 3

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated Mar 29 • 3.36k • 83

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 20.1k • 41

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 3.98k • 13

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated Mar 29 • 3.68k • 22

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 53k • 49

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 5.3k • 4

jiangchengchengNLP/llama3.3-70B-instruct-abliterated-awq

Text Generation • Updated Apr 13 • 72 • 2

cognitivecomputations/Qwen3-235B-A22B-AWQ

Text Generation • Updated May 4 • 5.8k • 11

Sinensis/L3.3-Electra-R1-70b-AWQ

Text Generation • Updated 21 days ago • 16 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 19 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 37 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 33 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 22 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 14

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 1.78k • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 4.14k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023