Data Pipeline Repositories

8 open-source data pipeline projects analyzed for the hidden assumptions their code never validates, plus architecture and data flow.

Repository	Assumptions	Language	Components	Stars
chroma-core/chroma Data infrastructure for AI. 10 components, Rust. See how chroma is built.	12	Rust	10	27,516
kestra-io/kestra Event Driven Orchestration & Scheduling Platform for Mission Critical Applica.... 8 components, Java	0	Java	8	26,641
apache/flink Apache Flink. 10 components, Java. See how flink is built.	0	Java	10	25,907
airbytehq/airbyte The leading data integration platform for ETL / ELT data pipelines from APIs,.... 8 components, Pyth	13	Python	8	21,107
trinodb/trino Official repository of Trino, the distributed SQL query engine for big data, .... 8 components, Java	0	Java	8	12,674
orchest/orchest Build data pipelines, the easy way 🛠️. 10 components, TypeScript. See how orchest is built.	0	TypeScript	10	4,136
sodadata/soda-core Data Contracts engine for the modern data stack. https://www.soda.io. 10 components, Python. See how	0	Python	10	2,317
elementary-data/elementary The dbt-native data observability solution for data & analytics engineers. Mo.... 12 components, HTM	0	HTML	12	2,290

Popular Data Pipeline Comparisons

Browse Other Categories

Backend Api Cli Tool Dashboard Dev Tool Fullstack Library Ml Inference Ml Training All Repositories

Analyze your own data pipeline

Paste a GitHub URL and find the assumptions hiding in your code.

Try CodeSea