b4rtaz
distributed-llama
C++
AI analysis
Distributed Llama enables distributed LLM inference by connecting home devices into a cluster using tensor parallelism and Ethernet synchronization...
Production ready
Single maintainer
Niche use case
distributed-computing
distributed-llm
llama2
3k
238
48
9/wk