vllm-project
vllm-ascendvLLM Ascend Plugin is a community-maintained hardware acceleration plugin for vLLM that enables large language model serving on Huawei Ascend...
6 repositories found
vllm-project
vllm-ascendvLLM Ascend Plugin is a community-maintained hardware acceleration plugin for vLLM that enables large language model serving on Huawei Ascend...
Project-HAMi
HAMiHAMi is a Kubernetes-native GPU virtualization and heterogeneous accelerator scheduling platform that enables sharing of expensive GPUs (NVIDIA,...
data-infra
cube-studioCubeStudio is a comprehensive cloud-native MLOps/AI platform designed for enterprise machine learning workflows, supporting distributed training,...
gpustack
gpustackGPUStack is an open-source GPU cluster manager designed for high-performance AI model serving (vLLM, SGLang, TensorRT-LLM) and on-demand GPU instance...
nndeploy
nndeploynndeploy is a C++ AI deployment framework designed to optimize inference for models (LLMs, diffusion models, transformers) across heterogeneous...
datawhalechina
torch-rechubTorch-RecHub is a PyTorch-based framework for building recommendation systems, offering 30+ pre-built algorithms for matching, ranking, and...
Weekly newsletter
Every Monday: the repos worth your attention, anomaly signals and deep AI analysis. No fluff, unsubscribe any time.