Today
News
Research
Fields
Stacks
Market
Analytics
⌘K
Tool
Today
News
Research
Fields
Stacks
Market
Analytics
Fields · this week
Multimodal
493
Agents
479
Frontier LLMs
416
Inference & serving
243
Learning verifiable rewards
164
Image segmentation
160
Graph learning
155
3D scene
138
Evals
108
Voice AI
86
Forecasting time
75
Classifier & causal discovery
74
Flow matching
73
Training & fine-tuning
64
Teacher policy distillation
53
All 32 fields
vLLM · ByteTrail
Inference & serving
vLLM
A high-throughput and memory-efficient inference and serving engine for LLMs
This week
Coming with more sources: stars history
Downloads / week
423.2k
−6.2%
Stars
94.2k
growth from late November
Releases · 90 days
8
last Oct 18
Rising tools
#84
Weekly downloads · last year
Coming with more sources: stars history
PyPI
vllm
423.2k/wk
GitHub stars
Coming with more sources: stars history
Links
Coming with more sources: stars history
GitHub
vllm-project/vllm
Language
Python
PyPI
vllm
Docker Hub
vllm/vllm-openai