Distributed computing

AI-Horde is a distributed volunteer computing platform that crowdsources GPU/CPU resources for community-driven AI image and text generation, similar...

Sail is a Rust-based Apache Spark replacement designed for unified batch processing, stream processing, and AI workloads with Spark Connect protocol...

Zenoh is a distributed pub/sub and storage system written in Rust that unifies real-time data, persistent storage, and edge computations across...

TorchRL is a PyTorch-native reinforcement learning library providing modular, composable components for building RL systems including environments,...

Open Source Vizier is a Python-based distributed optimization service for black-box and hyperparameter tuning, directly derived from Google's...

Distributed Llama enables distributed LLM inference by connecting home devices into a cluster using tensor parallelism and Ethernet synchronization...

Beam is an open-source serverless runtime for AI workloads that emphasizes fast cold starts, GPU support, and developer experience through a Python...

Holochain is an open-source framework for building peer-to-peer distributed applications using Rust, emphasizing security, reliability, and...

Livebook is a web-based interactive notebook platform for Elixir that combines code execution, rich visualization, and real-time collaboration. It...

Daft is a high-performance data engine built in Rust with Python bindings, designed specifically for processing multimodal workloads (images, audio,...

BOINC is a distributed computing platform that enables volunteer computing by harnessing idle CPU cycles from home computers and organizations to...

Dask Distributed is a scheduler library that enables distributed task execution across multiple machines for the Dask parallel computing framework....

Proto Actor is a distributed actor framework for Go that enables ultra-high-performance concurrent and distributed computing using the actor model....

Gleam is a distributed map/reduce execution system written in Go that supports DAG-based computation flows, designed for high-performance data...

Hazelcast is a unified real-time data platform for stream processing and fast data storage, designed for enterprises that need sub-10ms latency...

Catalyst is a PyTorch framework designed to accelerate deep learning research and development by providing reusable components, training loops, and...

Chapel is a modern programming language designed for productive parallel computing at scale, targeting CPUs, GPUs, and distributed systems from...

Qix is a curated learning resource collection covering machine learning, deep learning, PostgreSQL, distributed systems, Node.js, and Go—essentially...

Colossal-AI is a distributed deep learning framework designed to reduce the cost and complexity of training and deploying large foundation models...