Deploying production ready Llama-4 models on your AWS with vLLM

❤️ 🔥 3

#34 opened 7 months ago by

agam30

Unethical comparisons with Deepseek replacing chinese languages by thai/vietnamese only

❤️ 🔥 10

#32 opened 7 months ago by

krustik

Request: DOI

#31 opened 7 months ago by

ylx2ai

Couldn't connect

#30 opened 7 months ago by

Wouze

Ridicolous demands for model gate.

👍 🚀 9

#29 opened 7 months ago by

marksverdhei

🔥🔥🔥中文测评视频

#28 opened 7 months ago by

leo009

Llama 4 - open-source fine-tuning script

🔥 6

#27 opened 7 months ago by

hiyouga

Bug in AutoModel

👍 1

#26 opened 7 months ago by

random-checkin

pad error

👍 ➕ 7

#25 opened 7 months ago by

bobber

AWQ version?

👍 18

#24 opened 7 months ago by

devops724

Object Detection?

#23 opened 7 months ago by

buckeye17-bah

Thanks zuck

👍 3

#22 opened 7 months ago by

WyattTheSkid

converstational?

#21 opened 7 months ago by

HassanStar

No one with a consumer grade GPU (< 32 vram) can run the lower L4 model... 😓

🤯 👍 10

#20 opened 7 months ago by

UniversalLove333

Request denied llama4 - lost access to whole meta-llama repos which I already had access

#19 opened 7 months ago by

doaonduty

Thank you!, Is it possible to run this with vLLM or sglang ?

#18 opened 7 months ago by

chriswritescode

Thanks! Request to access the model rejected due to typo

#17 opened 7 months ago by

Xinxinli

[request for feedback] Faster downloads with Xet

🔥 12

#16 opened 7 months ago by

clem

Thanks!

#15 opened 7 months ago by

FalconNet

License

👍 7

#14 opened 7 months ago by

mrfakename