Zamba: A Compact 7B SSM Hybrid Model
Paper β’ 2405.16712 β’ Published β’ 25
Quentin Anthony
qanthony-z
AI & ML interests
None yet
Recent Activity
updated a model 17 days ago
Zyphra/ZAYA1-reasoning-base new activity 17 days ago
Zyphra/ZAYA1-8B:Update README.md new activity 17 days ago
Zyphra/ZAYA1-8B:What on earth did you guys doOrganizations
authored a
paper about 2 years ago
authored 6
papers over 2 years ago
Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
Paper β’ 2401.08383 β’ Published β’ 1
The Case for Co-Designing Model Architectures with Hardware
Paper β’ 2401.14489 β’ Published β’ 4
Continual Pre-Training of Large Language Models: How to (re)warm your model?
Paper β’ 2308.04014 β’ Published β’ 2
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper β’ 2304.01373 β’ Published β’ 9
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Paper β’ 2204.06745 β’ Published β’ 1
BlackMamba: Mixture of Experts for State-Space Models
Paper β’ 2402.01771 β’ Published β’ 25