OpenDCAI/DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
A star delta has been computed for 61,707 of 62,629 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 00:36 and 02:28 (BKK).
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
An orchestration platform for the development, production, and observation of data assets.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
The Feldera Incremental Computation Engine
Maestro: Netflix’s Workflow Orchestrator
This dbt package captures metadata, artifacts, and test results so you can detect anomalies, monitor data quality, and build metadata tables. It powers Elementary OSS and feeds the wider context layer used by Elementary Cloud’s full Data & AI Control Plane.
ultra low latency graph based stream processing framework
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
That's all 14 repositories in this period.