Today News Research Fields Stacks Market Analytics

⌘K

Tool

ByteTrail · AI and developer-tools intelligence

News Research Stacks API

Today News Research Fields Stacks Market Analytics

Fields · this week

Multimodal493 Agents479 Frontier LLMs416 Inference & serving243 Learning verifiable rewards164 Image segmentation160 Graph learning155 3D scene138 Evals108 Voice AI86 Forecasting time75 Classifier & causal discovery74 Flow matching73 Training & fine-tuning64 Teacher policy distillation53 All 32 fields

ExLlamaV2 · ByteTrail

Inference & serving

ExLlamaV2

A fast inference library for running LLMs locally on modern consumer-class GPUs

This week

Coming with more sources: stars history

Downloads / week390−0.6%

Stars4.6kgrowth from late November

Releases · 90 days0none listed

Rising tools—

Weekly downloads · last year

Coming with more sources: stars history

PyPIexllamav2390/wk

GitHub stars

Coming with more sources: stars history

Links

Coming with more sources: stars history

GitHub: turboderp-org/exllamav2
Language: Python
PyPI: exllamav2