Pipeline

QuantMind is an AI-powered knowledge extraction and retrieval framework that transforms unstructured financial research (papers, news, reports, SEC...

SeaTunnel Web is a third-party web UI for Apache SeaTunnel that provides visual DAG pipeline building, batch and streaming data synchronization, and...

Argo CD is a declarative GitOps continuous delivery tool for Kubernetes that automates application deployment and lifecycle management through...

Prefect is a Python workflow orchestration framework for building and deploying resilient data pipelines with built-in scheduling, retries, caching,...

Galaxy is a web-based platform for accessible data-intensive scientific research, specifically designed for genomics, bioinformatics, and NGS...

XLS is a High-Level Synthesis (HLS) toolchain from Google that converts high-level functional descriptions into synthesizable Verilog/SystemVerilog...

CubeStudio is a comprehensive cloud-native MLOps/AI platform designed for enterprise machine learning workflows, supporting distributed training,...

marimo is a reactive Python notebook that combines the interactivity of Jupyter with reproducibility, git-friendliness, and deployment capabilities...

EmbedAnything is a Rust-based embedding pipeline for generating vector embeddings from multiple modalities (text, images, audio, PDFs, websites) with...

Kestra is an open-source, event-driven orchestration platform for scheduling and automating data, AI, and infrastructure workflows using declarative...

Apache Hop is an open-source data orchestration platform that provides a visual interface for designing, executing, and monitoring ETL pipelines and...

gitlab-ci-local allows developers to run GitLab CI pipelines locally without pushing code, supporting both shell and Docker executors. It is...

Proton is a high-performance SQL streaming engine written in C++ that processes real-time data from Kafka, logs, metrics, and CDC sources with...

httpx is a fast, multi-purpose HTTP toolkit designed for security professionals and penetration testers to run multiple HTTP probes with reliability...

Nextflow is a workflow engine for building scalable, portable, and reproducible data-driven computational pipelines using a dataflow programming...

GameDevMind is a comprehensive technical knowledge map for game developers, providing 118+ documents covering game development practices,...

AutoRAG is an open-source AutoML framework for automatically discovering and optimizing retrieval-augmented generation (RAG) pipelines. It...

Airbyte is an open-source data integration platform providing 600+ connectors for moving data from APIs, databases, and files to warehouses, lakes,...

Rill is a Go library for building concurrent programs using composable, channel-based primitives that reduce boilerplate while preserving Go's...

Great Expectations is a Python library for data quality testing and validation that enables teams to express data expectations as executable unit...

Numaflow is a Kubernetes-native, serverless platform designed specifically for running massively parallel event-driven streaming and data-processing...

CGraph is a cross-platform C++ DAG (Directed Acyclic Graph) framework with zero third-party dependencies that enables building parallel computation...

Instill Core is a full-stack AI infrastructure platform for orchestrating data pipelines, AI models, and workflows in a low-code/no-code environment....

stream-json is a memory-efficient library for parsing and processing JSON/JSONC files larger than available RAM using a SAX-inspired token API and...

Mage is a self-hosted, open-source data pipeline orchestration platform that enables teams to build, run, and manage ETL/ELT workflows using Python,...

PRQL is a modern pipelined query language that compiles to SQL, designed as a more readable and abstraction-friendly alternative to SQL for data...

Kubeflow Pipelines is an orchestration service for building and deploying end-to-end machine learning workflows on Kubernetes using a Python SDK. It...

Pipcook is a JavaScript application framework enabling web developers to build machine learning pipelines and train/serve models without ML...

Tekton Pipelines is a Kubernetes-native CI/CD framework that provides cloud-native resources for declaring and executing pipelines. It serves teams...

Taipy is a Python framework that converts data science and AI algorithms into production-ready web applications without requiring frontend expertise....