Idavidrein/gpqa
Benchmark • Updated • 1.25k • 132k • 451
seawolf PRO
seawolf2357
AI & ML interests
None yet
Recent Activity
liked a dataset 2 days ago
Idavidrein/gpqa liked a model 5 days ago
FINAL-Bench/Darwin-60B-DUO reacted to SeaWolf-AI's post with ❤️ 5 days ago
Darwin-60B-DUO: Two SOTAs, One Endpoint — 88.38% on GPQA Diamond 🚀
We're excited to release Darwin-60B-DUO, the Darwin family's first DUO model. Take two domain-verified specialists, hide them behind a single OpenAI-compatible endpoint, and let a router decide which one (or both) answers. You see one model, one API — but get the best of both.
The number that matters: on the full 198-question GPQA Diamond, Darwin-60B-DUO hits 88.38%. The constituents alone land at 69.70% (Darwin-28B-REASON) and 77.27% (AWAXIS-Think-31B); a naive cascade only reaches 83.84%. The DUO clears them all. Two small specialists, intelligently routed, beat one big generalist on cost and quality. Both are independently verified — Darwin-28B-REASON is #3 on the HF GPQA Diamond leaderboard, AWAXIS-Think-31B is #1 on Korea's national K-AI Leaderboard (MSIT).
The brains is a Hybrid-A router picking one of five strategies on the fly. Korean → AWAXIS, English/STEM → Darwin (single-backend, ~70% of traffic at 1× cost). When a Korean answer needs rigorous English reasoning, split_refine fires — Darwin drafts, AWAXIS polishes; MCQ/short-answer runs both with self-consistency + cross-verify. Net effective cost: only ~1.3× a single 30B model.
The part the community will care about: the gateway is model-agnostic and Apache-2.0. Point it at any two OpenAI-compatible backends and you've got a DUO in minutes — teach router.py when to use which, and parallel calls, response merging, and routing transparency via _duo_route are handled for you. Fork it and tell us what you built.
Painless deploy: docker compose up for both vLLM backends + gateway; FP8 ~30GB colocates on a single B200/H100. One git clone (~120GB). Text-only for now, streaming in v1.1.
Two SOTAs, one endpoint. Come build your own on the Community tab.
👇
🔗 https://huggingface.co/FINAL-Bench/Darwin-60B-DUOOrganizations
liked a
dataset 2 days ago
liked a
model 5 days ago
liked 11
models 6 days ago
ansulev/Darwin-9B-NEG
Text Generation • 10B • Updated • 536k • 15
FINAL-Bench/Darwin-28B-Coder
Text Generation • 27B • Updated • 866 • 19
FINAL-Bench/Darwin-35B-A3B-Opus-Q8-GGUF
Text Generation • 35B • Updated • 337 • 19
FINAL-Bench/Darwin-2B-Opus
Text Generation • 2B • Updated • 315 • 20
FINAL-Bench/Darwin-4B-Opus
Text Generation • 8B • Updated • 166 • 22
bartowski/FINAL-Bench_Darwin-35B-A3B-Opus-GGUF
Image-Text-to-Text • 35B • Updated • 3.01k • 27
FINAL-Bench/Darwin-9B-Opus
Text Generation • 10B • Updated • 300 • 30
FINAL-Bench/Darwin-27B-Opus
Text Generation • 28B • Updated • 58 • 33
bartowski/FINAL-Bench_Darwin-36B-Opus-GGUF
Text Generation • 35B • Updated • 8.44k • 37
FINAL-Bench/Darwin-4B-David
Text Generation • 8B • Updated • 221 • 42
FINAL-Bench/Darwin-35B-A3B-Opus
Image-Text-to-Text • 36B • Updated • 154 • 81
liked 7
models 16 days ago
FINAL-Bench/Darwin-4B-Genesis
Text Generation • 8B • Updated • 434 • 40
FINAL-Bench/Darwin-31B-Opus
Text Generation • 33B • Updated • 426 • 46
mradermacher/Darwin-4B-Opus-i1-GGUF
8B • Updated • 569 • 13
mradermacher/KorReason-35B-Darwin-i1-GGUF
35B • Updated • 467 • 12
21world/Darwin-35B-A3B-Opus
Text Generation • 36B • Updated • 218 • 12
WhoTookMyAmogusNickname/FINAL-Bench_Darwin-28B-Opus-GGUF
Text Generation • 27B • Updated • 1.55k • 11
Guilherme34/Darwin-36B-Opus-ABLITERATED-HERETIC
Image-Text-to-Text • 35B • Updated • 120 • 13