Clear ×

Data Engineering

321 repositories found

weifuwan

weifuwan

seatunnel-web
TypeScript Rising Star AI analysis

SeaTunnel Web is a third-party web UI for Apache SeaTunnel that provides visual DAG pipeline building, batch and streaming data synchronization, and...

Production ready Beginner friendly Niche use case
batch dag data-engineering
1.2k
125
26
164/wk
active
7/10 Data
EchoMusicApp

EchoMusicApp

Echo-Music
Kotlin Rising Star AI analysis

Echo Music is a Kotlin-based Android music streaming application that provides ad-free access to YouTube Music's library with added features like...

Production ready Single maintainer Niche use case
adfree foss kotlin
2.3k
141
548
172/wk
active
7/10 Media
OpenDCAI

OpenDCAI

DataFlow
Python Rising Star AI analysis

DataFlow is a low-code platform for generating, cleaning, and preparing data for LLM training using LLM-based operators and visual pipelines. It...

Production ready Beginner friendly Niche use case
data data-agent data-cleaning
6.2k
744
8
410/wk +76 yesterday
recent
7/10 AI & ML
Zleap-AI

Zleap-AI

SAG
TypeScript Rising Star AI analysis

SAG is a document retrieval workbench implementing a next-generation RAG (Retrieval-Augmented Generation) approach designed for multi-hop question...

Production ready Niche use case
agent ai data-engineering
2k
95
9
116/wk
recent
8/10 AI & ML
rocketride-org

rocketride-org

rocketride-server
Python Rising Star AI analysis

RocketRide is an open-source AI pipeline engine with a C++ core and 50+ extensible nodes that integrates 13+ LLM providers and 8+ vector databases....

Production ready Niche use case
ai cpp data-pipeline
5k
1.7k
244
189/wk
active
7/10 AI & ML
tddworks

tddworks

baguette
Swift Rising Star AI analysis

Baguette is a headless iOS Simulator manager and control platform that enables remote operation of iOS simulators via a web UI, supporting 60 fps...

Production ready Single maintainer Niche use case
agent cli devicefarm
1.5k
80
10
51/wk
active
8/10 Mobile
PavelGrigoryevDS

PavelGrigoryevDS

awesome-data-analysis
Rising Star AI analysis

Awesome Data Analysis is a comprehensive curated collection of 500+ resources for learning and practicing data analysis, data science, and related...

Beginner friendly Single maintainer Niche use case
ai analytics awesome-list
1.6k
234
10
57/wk
slow
7/10 Education
Observal

Observal

Observal
Python Rising Star AI analysis

Observal is a self-hosted registry and analytics platform for discovering, managing, and sharing internal AI components (Skills, MCPs, Agents) across...

Production ready Niche use case
agents analytics antigravity
2.2k
461
264
57/wk
active
7/10 AI & ML
semantica-agi

semantica-agi

semantica
Python AI analysis

Semantica is a Python framework for building AI systems with full explainability, auditability, and provenance tracking through knowledge graphs,...

Production ready Niche use case
agent-memory ai ai-governance
1.4k
201
7
41/wk
active
8/10 AI & ML
lipku

lipku

LiveTalking
Python Rising Star AI analysis

LiveTalking is a real-time streaming digital human engine that synchronizes audio and video for interactive conversations, supporting multiple AI...

Production ready Single maintainer Niche use case
aigc digihuman digital-human
8.3k
1.3k
402
210/wk +125 yesterday
active
7/10 AI & ML
XiaoYouChR

XiaoYouChR

Ghost-Downloader-3
Python Rising Star AI analysis

Ghost Downloader 3 is a feature-rich, cross-platform download manager written in Python and Qt that supports HTTP, BitTorrent, FTP, M3U8, MPEG-DASH,...

Production ready Single maintainer Niche use case
async asyncio bittorent
5.7k
302
53
139/wk
active
7/10 Productivity
truelockmc

truelockmc

streambert
JavaScript Rising Star AI analysis

StreamBert is a cross-platform Electron desktop application for streaming and downloading movies, TV series, and anime with a focus on a zero-ads,...

Production ready Beginner friendly Single maintainer Niche use case
anime anime-downloader anime-scraper
5.7k
507
30
139/wk
active
6/10 Media
getnao

getnao

nao
TypeScript AI analysis

nao is an open-source analytics agent framework that enables data teams to build conversational interfaces for querying data warehouses (BigQuery,...

Production ready Beginner friendly Niche use case
agentic-analytics analytics analytics-engineering
1.4k
204
167
29/wk
active
7/10 Data
Lynpoint

Lynpoint

CyberVerse
Python AI analysis

CyberVerse is a self-hosted, open-source framework for building real-time voice-interactive AI agents with optional digital-human video capabilities,...

Production ready Single maintainer Niche use case
ai-agents ai-companion digital-human
1.4k
188
5
26/wk
active
7/10 AI & ML
Kaelio

Kaelio

ktx
TypeScript AI analysis

ktx is a context layer that enables AI agents (Claude Code, Codex) to query analytical databases accurately using approved metric definitions and...

Production ready Niche use case
agent agent-skills agents
1.5k
87
32
27/wk
active
8/10 AI & ML
theopenco

theopenco

llmgateway
TypeScript AI analysis

LLM Gateway is an open-source API gateway that routes requests across multiple LLM providers (OpenAI, Anthropic, Google Vertex AI) through a unified...

Production ready Niche use case
ai ai-gateway analytics
1.4k
155
61
24/wk
active
7/10 AI & ML
feldera

feldera

feldera
Rust AI analysis

Feldera is a SQL query engine for incremental computation that processes only data changes rather than recomputing from scratch, enabling millions of...

Production ready Niche use case
data-analytics data-pipelines database
2k
138
519
27/wk
active
8/10 Data
langfuse

langfuse

langfuse
TypeScript AI analysis

Langfuse is an open-source AI engineering platform that provides LLM observability, evaluation, metrics, prompt management, and a playground...

Production ready Niche use case
analytics autogen evaluation
30.9k
3.3k
704
464/wk +86 yesterday
active
8/10 AI & ML
langwatch

langwatch

langwatch
TypeScript AI analysis

LangWatch is a platform for evaluating and testing LLM-powered agents end-to-end, combining tracing, datasets, evaluation, and prompt optimization in...

Production ready Niche use case
ai analytics datasets
3.4k
328
680
39/wk +31 yesterday
active
8/10 AI & ML
datajuicer

datajuicer

data-juicer
Python AI analysis

Data-Juicer is a modular data processing platform optimized for preparing multimodal datasets for foundation model training and inference. It...

Production ready Niche use case
data data-analysis data-pipeline
6.7k
391
67
73/wk
active
8/10 AI & ML
ruc-datalab

ruc-datalab

DeepAnalyze
Python AI analysis

DeepAnalyze is an agentic LLM system for autonomous data science workflows, automating tasks from data preparation through report generation across...

Production ready Niche use case
agent agentic agentic-ai
4.3k
687
23
43/wk
recent
7/10 AI & ML
webtorrent

webtorrent

webtorrent
JavaScript AI analysis

WebTorrent is a streaming torrent client that runs in Node.js and modern web browsers using WebRTC for peer-to-peer transport, eliminating the need...

Production ready Niche use case
bittorrent browser hacktoberfest
31.3k
2.8k
79
298/wk +159 yesterday
active
8/10 Web Dev
rotki

rotki

rotki
Python AI analysis

rotki is a self-hosted, open-source portfolio tracking and accounting tool designed specifically for cryptocurrency assets, with a strong focus on...

Production ready Beginner friendly Niche use case
accounting analytics bitcoin
3.9k
740
428
35/wk
active
8/10 Blockchain
datazip-inc

datazip-inc

olake
Go AI analysis

OLake Go is a high-performance, open-source data ingestion engine that replicates data from databases (PostgreSQL, MySQL, MongoDB, Oracle, DB2,...

Production ready Niche use case
apache-iceberg cdc change-data-capture
1.4k
236
144
12/wk
active
7/10 Data
lakehq

lakehq

sail
Rust AI analysis

Sail is a Rust-based Apache Spark replacement designed for unified batch processing, stream processing, and AI workloads with Spark Connect protocol...

Production ready Niche use case
apache-iceberg apache-spark arrow
3.1k
192
214
35/wk
active
8/10 Data
Maciek-roboblog

Maciek-roboblog

Claude-Code-Usage-Monitor
Python AI analysis

Claude Code Usage Monitor is a real-time terminal utility that tracks API usage, quota limits, and forecasts for Anthropic's Claude Code service. It...

Production ready Beginner friendly Single maintainer Niche use case
ai analytics claude
8.4k
434
23
82/wk
active
8/10 AI & ML
AlexxIT

AlexxIT

go2rtc
Go AI analysis

go2rtc is a standalone streaming application that acts as a unified protocol gateway, converting between dozens of camera streaming formats (RTSP,...

Production ready Single maintainer Niche use case
ffmpeg go golang
13.4k
1.2k
793
80/wk
active
8/10 IoT
rybbit-io

rybbit-io

rybbit
TypeScript AI analysis

Rybbit is an open-source, privacy-friendly analytics platform designed as a direct alternative to Google Analytics, featuring session replays,...

Production ready Beginner friendly
analytics google-analytics product-analytics
12.5k
690
171
74/wk
active
8/10 Data
opensearch-project

opensearch-project

OpenSearch
Java AI analysis

OpenSearch is an open-source, enterprise-grade distributed search and observability engine designed to organize and query unstructured data at scale....

Production ready
analytics apache2 foss
13.4k
2.7k
2.9k
79/wk
active
8/10 Data
DataTalksClub

DataTalksClub

data-engineering-zoomcamp
Jupyter Notebook AI analysis

Data Engineering Zoomcamp is a free, structured 9-week educational course teaching data engineering fundamentals through hands-on pipeline building...

Beginner friendly
course data-engineering dbt
43.4k
8.6k
392/wk +45 yesterday
recent
8/10 Education

Showing 30 of 321