CPU-Hybrid-MoE

community

AI & ML interests

Quantized MoE models for inference on CPU and hybrid CPU-GPU

Recent Activity

Doctor-Shotgun updated a model 8 days ago

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Doctor-Shotgun published a model 8 days ago

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Doctor-Shotgun updated a model 8 days ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8

View all activity

models 8

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Text Generation • 106B • Updated 8 days ago • 30

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8

Text Generation • Updated 8 days ago • 22

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4

Text Generation • Updated 8 days ago • 12

CPU-Hybrid-MoE/DeepSeek-R1-0528-CPU-NUMA2-AMXINT4

Text Generation • Updated 8 days ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA2-AMXINT4

Text Generation • Updated 9 days ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-GPU-FP8-GPTQ4

Text Generation • 106B • Updated 9 days ago • 3

CPU-Hybrid-MoE/GLM-4.5V-GPU-weight

Image-Text-to-Text • 33B • Updated 9 days ago • 7

CPU-Hybrid-MoE/GLM-4.5-Air-GPU-weight

32B • Updated 10 days ago • 13

datasets 0

None public yet