Data & Analytics

Data pipelines, visualization, analytics platforms and business intelligence tools

636 repos
hasaneyldrm

hasaneyldrm

exercises-dataset
HTML Rising Star AI analysis

A curated dataset of 1,324 fitness exercises with animations, thumbnails, and multilingual instructions (9 languages) designed as a data layer for...

Production ready Beginner friendly Single maintainer Niche use case
dataset exercise-database exercises
11.2k
1.3k
12
2k/wk
active
8/10 Data
weifuwan

weifuwan

seatunnel-web
TypeScript Rising Star AI analysis

SeaTunnel Web is a third-party web UI for Apache SeaTunnel that provides visual DAG pipeline building, batch and streaming data synchronization, and...

Production ready Beginner friendly Niche use case
batch dag data-engineering
1.2k
125
26
164/wk
active
7/10 Data
opengeos

opengeos

GeoLibre
TypeScript Rising Star AI analysis

GeoLibre is a free, open-source GIS platform that visualizes and analyzes geospatial data across web browsers, desktop (Tauri), native mobile...

Production ready Beginner friendly Niche use case
data-science duckdb geospatial
1.6k
216
9
160/wk +42 yesterday
active
8/10 Data
GoogleCloudPlatform

GoogleCloudPlatform

knowledge-catalog
HTML Rising Star AI analysis

Knowledge Catalog is an AI-powered data catalog and metadata management platform from Google Cloud that organizes structured and unstructured data...

Production ready Niche use case
6.6k
531
103
567/wk
active
7/10 Data
microsoft

microsoft

pg_durable
Rust Rising Star AI analysis

pg_durable brings durable execution—a pattern for fault-tolerant, resumable workflows—directly into PostgreSQL as SQL functions, eliminating the need...

Production ready Niche use case
ai-pipelines ai-workflows durable-execution
2.2k
62
29
96/wk
active
8/10 Data
fjall-rs

fjall-rs

fjall
Rust Rising Star AI analysis

Fjall is a log-structured, embeddable key-value storage engine written in Rust, modeled after RocksDB's LSM-tree architecture. It serves developers...

Production ready Niche use case
database embeddable embeddable-database
2.2k
106
40
56/wk
active
8/10 Data
LadybugDB

LadybugDB

ladybug
C++ AI analysis

Ladybug is an embedded graph database optimized for complex analytical workloads on large datasets, offering Cypher query support, full-text search,...

Production ready Niche use case
database graph
1.4k
108
73
36/wk
active
8/10 Data
opendataloader-project

opendataloader-project

opendataloader-pdf
Java AI analysis

OpenDataLoader PDF is a specialized PDF parser designed for AI-ready data extraction and PDF accessibility automation. It extracts structured...

Production ready Niche use case
a11y accessibility ai
26.9k
2.6k
74
608/wk +423 yesterday
active
8/10 Data
getnao

getnao

nao
TypeScript AI analysis

nao is an open-source analytics agent framework that enables data teams to build conversational interfaces for querying data warehouses (BigQuery,...

Production ready Beginner friendly Niche use case
agentic-analytics analytics analytics-engineering
1.4k
204
167
29/wk
active
7/10 Data
feldera

feldera

feldera
Rust AI analysis

Feldera is a SQL query engine for incremental computation that processes only data changes rather than recomputing from scratch, enabling millions of...

Production ready Niche use case
data-analytics data-pipelines database
2k
138
519
27/wk
active
8/10 Data
chdb-io

chdb-io

chdb
Python AI analysis

chDB is an in-process OLAP SQL engine powered by ClickHouse, designed for Python developers who need SQL query performance without installing a...

Production ready Beginner friendly Niche use case
chdb clickhouse clickhouse-database
2.8k
125
41
44/wk
active
8/10 Data
D4Vinci

D4Vinci

Scrapling
Python AI analysis

Scrapling is an adaptive Python web scraping framework that handles everything from single HTTP requests to full browser-based crawling with stealth...

Production ready Beginner friendly Single maintainer Niche use case
ai ai-scraping automation
69k
6.8k
3
1k/wk +167 yesterday
active
9/10 Data
apache

apache

cassandra
Java AI analysis

Apache Cassandra is a distributed, highly-scalable NoSQL database designed for massive data volumes across commodity hardware clusters without...

Production ready Niche use case
cassandra database java
9.9k
4k
428
103/wk spike
active
8/10 Data
NanmiCoder

NanmiCoder

MediaCrawler
Python AI analysis

MediaCrawler is a multi-platform social media data scraping tool targeting Chinese platforms: Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Baidu...

Beginner friendly Single maintainer Niche use case
56k
11.3k
178
759/wk +110 yesterday
active
7/10 Data
getmaxun

getmaxun

maxun
TypeScript AI analysis

Maxun is an open-source no-code platform that converts websites into structured APIs through web scraping, crawling, and AI-powered data extraction....

Production ready Beginner friendly Niche use case
agents api automation
16.4k
1.4k
114
201/wk +43 yesterday
active
8/10 Data
lakekeeper

lakekeeper

lakekeeper
Rust AI analysis

Lakekeeper is an Apache Iceberg REST Catalog implementation written in Rust, designed for secure and performant lakehouse environments. It serves...

Production ready Niche use case
catalog data-lake iceberg
1.4k
147
95
12/wk
active
8/10 Data
gosom

gosom

google-maps-scraper
Go AI analysis

A Go-based web scraper for extracting business data from Google Maps, including names, addresses, phone numbers, ratings, reviews, and coordinates....

Production ready Single maintainer Niche use case
agent-skills claude-skills codex-skills
4.7k
724
65
56/wk
recent
8/10 Data
datazip-inc

datazip-inc

olake
Go AI analysis

OLake Go is a high-performance, open-source data ingestion engine that replicates data from databases (PostgreSQL, MySQL, MongoDB, Oracle, DB2,...

Production ready Niche use case
apache-iceberg cdc change-data-capture
1.4k
236
144
12/wk
active
7/10 Data
ArcadeData

ArcadeData

arcadedb
Java AI analysis

ArcadeDB is a multi-model database management system supporting SQL, Cypher, Gremlin, MongoDB, and Redis query languages, plus vector embeddings for...

Production ready Niche use case
arcadedb database dbms
1k
120
98
12/wk
active
7/10 Data
P3TERX

P3TERX

GeoLite.mmdb
AI analysis

This repository hosts MaxMind's GeoLite2 geolocation databases (Country, City, and ASN) in mmdb format, available for download via convenient URLs....

Production ready Single maintainer Niche use case
geoip geoip2 geolocation
5k
528
4
59/wk
active
7/10 Data
apache

apache

iceberg-python
Python AI analysis

PyIceberg is a Python library providing programmatic access to Apache Iceberg table metadata and data, implementing the Iceberg table specification....

Production ready Niche use case
apache hacktoberfest iceberg
1.1k
527
247
9/wk
active
7/10 Data
sapics

sapics

ip-location-db
JavaScript AI analysis

This project provides freely distributed IP-to-location databases in CSV and MMDB formats, aggregating data from multiple sources (ASN registries,...

Production ready Single maintainer Niche use case
asn autonomous-system geoip
2.1k
199
3
17/wk
active
7/10 Data
lakehq

lakehq

sail
Rust AI analysis

Sail is a Rust-based Apache Spark replacement designed for unified batch processing, stream processing, and AI workloads with Spark Connect protocol...

Production ready Niche use case
apache-iceberg apache-spark arrow
3.1k
192
214
35/wk
active
8/10 Data
adbar

adbar

trafilatura
Python AI analysis

Trafilatura is a Python package and command-line tool for web crawling, scraping, and extracting structured text and metadata from HTML. It...

Production ready Beginner friendly Niche use case
article-extractor corpus-builder corpus-tools
6.3k
395
74
47/wk
active
8/10 Data
rilldata

rilldata

rill
Go AI analysis

Rill is a business intelligence platform built on OLAP engines (DuckDB, ClickHouse) designed for both human analysts and AI agents to build, query,...

Production ready Niche use case
ai ai-chatbot bi
2.7k
185
208
29/wk
active
8/10 Data
valhalla

valhalla

valhalla
C++ AI analysis

Valhalla is an open-source routing engine built on OpenStreetMap data that provides directions, isochrones, time-distance matrices, map matching, and...

Production ready Niche use case
astar dijkstra directions
5.9k
928
904
42/wk
active
8/10 Data
PlotJuggler

PlotJuggler

PlotJuggler
C++ AI analysis

PlotJuggler is a specialized time series visualization tool designed for robotics, aerospace, and embedded systems engineers who need to analyze...

Production ready Single maintainer Niche use case
chart csv labstreaminglayer
6k
802
148
40/wk
recent
8/10 Data
rybbit-io

rybbit-io

rybbit
TypeScript AI analysis

Rybbit is an open-source, privacy-friendly analytics platform designed as a direct alternative to Google Analytics, featuring session replays,...

Production ready Beginner friendly
analytics google-analytics product-analytics
12.5k
690
171
74/wk
active
8/10 Data
opensearch-project

opensearch-project

OpenSearch
Java AI analysis

OpenSearch is an open-source, enterprise-grade distributed search and observability engine designed to organize and query unstructured data at scale....

Production ready
analytics apache2 foss
13.4k
2.7k
2.9k
79/wk
active
8/10 Data
probberechts

probberechts

soccerdata
Python AI analysis

SoccerData is a Python library that aggregates soccer data from eight major sources (FBref, ESPN, Understat, WhoScored, Sofascore, SoFIFA, Club Elo,...

Production ready Single maintainer Niche use case
elo-rating espn fbref
1.8k
286
37
17/wk
active
7/10 Data

Showing 30 of 636