Clear ×
★ –

Blackwell

6 repositories found

+ Follow domain
openlake-project

openlake-project

openlake
Rust Rising Star AI analysis

OpenLake is a distributed object storage engine optimized for GPU-accelerated AI workloads, built in Rust using io_uring for ultra-low-latency,...

Production ready Niche use case
blackwell gpt gpu
1.8k
298
82
86/wk
active
8/10 AI & ML
lightseekorg

lightseekorg

tokenspeed
Python AI analysis

TokenSpeed is a specialized LLM inference engine optimized for agentic workloads, combining TensorRT-LLM-level performance with vLLM-level usability....

Production ready Niche use case
blackwell deepseek glm
1.6k
189
34
36/wk
active
8/10 AI & ML
sgl-project

sgl-project

sglang
Python AI analysis

SGLang is a high-performance inference serving framework optimized for large language models and multimodal models, with support for speculative...

Production ready Niche use case
attention blackwell cuda
30.2k
7.1k
4.1k
251/wk +42 yesterday
active
8/10 AI & ML
NVIDIA

NVIDIA

TensorRT-LLM
Python AI analysis

TensorRT LLM is an NVIDIA-developed framework that optimizes inference for large language models and visual generation models on NVIDIA GPUs through...

Production ready Niche use case
blackwell cuda llm-serving
14.1k
2.5k
1.5k
70/wk
active
8/10 AI & ML
vllm-project

vllm-project

vllm
Python AI analysis

vLLM is a high-throughput, memory-efficient inference and serving engine for large language models, using PagedAttention and continuous batching to...

Production ready Niche use case
amd blackwell cuda
85.9k
19.2k
5.7k
596/wk +88 yesterday
active
10/10 AI & ML
GradientHQ

GradientHQ

parallax
Python AI analysis

Parallax is a distributed inference framework that enables decentralized LLM serving across heterogeneous devices using P2P communication and...

Production ready Niche use case
blackwell chatbot decentralized-inference
1.3k
143
21
4/wk
recent
7/10 AI & ML