vLLM Semantic Router

community

https://vllm-sr.ai

Activity Feed Request to join this org

AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

Xunzhuo updated a Space about 18 hours ago

llm-semantic-router/vela-studio

Xunzhuo updated a model about 20 hours ago

llm-semantic-router/Vela-1.0-Omni-Mini

Xunzhuo updated a model about 20 hours ago

llm-semantic-router/Vela-1.0-Omni-Nano

View all activity

Organization Card

Community About org cards

Match every workload to the right model and hardware.

One fabric. Many minds. We're introducing Mixture of Models

A model family of specialized routing models that power intelligent routing.

GitHub: vllm-project/semantic-router - Website: vllm-sr.ai

Collections 3

View 3 collections

spaces 2

Vela Studio

Explore Vela models for language, images, and speech.

models 72

llm-semantic-router/Vela-1.0-Omni-Mini

Feature Extraction • 1B • Updated about 9 hours ago • 238 • 1

llm-semantic-router/Vela-1.0-Omni-Nano

Feature Extraction • 0.2B • Updated about 9 hours ago • 248 • 1

llm-semantic-router/Vela-1.0-Encoder-307M-Halu

Token Classification • 0.3B • Updated 2 days ago • 53 • 2

llm-semantic-router/Vela-1.0-Encoder-307M-Reranker

Text Classification • 0.3B • Updated 4 days ago • 625

llm-semantic-router/Vela-1.0-Encoder-307M-Embedding

Sentence Similarity • 0.3B • Updated 4 days ago • 4.43k • 7

llm-semantic-router/Vela-1.0-Encoder-307M-Guard

Text Classification • 0.3B • Updated 4 days ago • 1.41k • 1

llm-semantic-router/Vela-1.0-Encoder-307M-FactCheck

Text Classification • 0.3B • Updated 5 days ago • 1.34k

llm-semantic-router/Vela-1.0-Encoder-307M-Domain

Text Classification • 0.3B • Updated 5 days ago • 1.76k

llm-semantic-router/Vela-1.0-Encoder-307M-Hazard

Text Classification • 0.3B • Updated 6 days ago • 620

llm-semantic-router/Vela-1.0-Encoder-307M-Safety

Text Classification • 0.3B • Updated 6 days ago • 621

datasets 13

llm-semantic-router/modality-routing-dataset

Viewer • Updated Mar 20 • 5.04k • 36

llm-semantic-router/mlcommons-ai-safety-synth

Viewer • Updated Jan 23 • 12k • 70 • 1

llm-semantic-router/fact-check-classification-dataset

Viewer • Updated Jan 22 • 22.3k • 183 • 2

llm-semantic-router/jailbreak-detection-dataset

Viewer • Updated Jan 21 • 4.13k • 303 • 4

llm-semantic-router/feedback-detector-dataset

Viewer • Updated Jan 21 • 20.9k • 113 • 1

llm-semantic-router/halueval-llm-spans

Viewer • Updated Jan 10 • 10k • 40

llm-semantic-router/e2e-halspans

Viewer • Updated Jan 10 • 1.5k • 8

llm-semantic-router/dart-halspans

Viewer • Updated Jan 10 • 2k • 15

llm-semantic-router/halueval-spans

Viewer • Updated Jan 9 • 10k • 43 • 1

llm-semantic-router/longcontext-haldetect

Viewer • Updated Jan 9 • 800 • 123

View 13 datasets