Stream processing

FastStream is an asynchronous Python framework for building event-driven microservices with unified APIs across multiple message brokers (Kafka,...

MediaPipe is a cross-platform ML framework for deploying on-device machine learning solutions across mobile (Android, iOS), web, desktop, edge...

Redpanda is a Kafka-compatible streaming data platform built in C++ without ZooKeeper or JVM dependencies, targeting developers who need lower...

JSON Machine is a PHP library for memory-efficient streaming parsing of large JSON files and HTTP responses, processing data one item at a time...

Proton is a high-performance SQL streaming engine written in C++ that processes real-time data from Kafka, logs, metrics, and CDC sources with...

rxRust is a zero-cost, type-safe Rust implementation of Reactive Extensions that enables functional reactive programming for handling asynchronous...

RisingWave is a SQL-based event streaming platform designed specifically for agentic AI and real-time applications that require continuously fresh,...

Fluent Bit is a lightweight, high-performance telemetry agent that collects, processes, and forwards logs, metrics, and traces from any source to any...

Vector is a high-performance observability data pipeline written in Rust that collects, transforms, and routes logs, metrics, and traces to multiple...

River is a Python library for online machine learning on streaming data, enabling incremental model training and prediction on data streams without...

PeerDB is a specialized ETL tool that replicates data from PostgreSQL to data warehouses, message queues, and storage systems using CDC (Change Data...

Watermill is a Go library for building event-driven applications with support for multiple pub/sub transports (Kafka, RabbitMQ, NATS, HTTP,...

Arroyo is a distributed stream processing engine written in Rust that enables complex, stateful computations on high-volume real-time data with...

Numaflow is a Kubernetes-native, serverless platform designed specifically for running massively parallel event-driven streaming and data-processing...

Spring Cloud Stream is a framework for building event-driven microservices with message-driven architectures, providing abstraction layers over...

Materialize is a real-time data integration platform that creates and maintains consistent SQL views of transactional data from multiple upstream...

Fluvio is a distributed data streaming engine and stream processing framework written in Rust, designed for real-time event processing and data...

Apache Hudi is an open data lakehouse platform providing upserts, deletes, and incremental processing on distributed big data systems like Apache...

Quix Streams is a pure-Python framework for building real-time data pipelines and stream processing applications on Apache Kafka. It serves data...

Redpanda Connect is a stream processor that moves data between diverse sources and sinks with built-in support for change-data-capture,...

Hazelcast is a unified real-time data platform for stream processing and fast data storage, designed for enterprises that need sub-10ms latency...

Bytewax is a Python framework for stateful stream processing built on a Rust engine, enabling developers to build scalable event-driven applications...

Pathway is a Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG applications, powered by a Rust engine built on...

Siddhi is a cloud-native stream processing and complex event processing (CEP) engine that interprets Streaming SQL queries to ingest, process, and...

A comprehensive educational resource and hands-on learning repository for Apache Flink, a stream processing framework. It provides tutorials, code...

Danfo.js is a JavaScript data manipulation library inspired by Python's Pandas, providing DataFrames, Series, and data processing tools for...

Walrus is a distributed message streaming engine written in Rust, designed as an alternative to Kafka with automatic load balancing, Raft-based fault...

A curated index of big data frameworks, tools, and resources covering databases, distributed systems, stream processing, and data analytics. Serves...