PrefectHQ/prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Language: Python - Size: 172 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 19,046 - Forks: 1,794

Avaiga/taipy

Turns Data and AI algorithms into production-ready web applications in no time.

Language: Python - Size: 150 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 17,999 - Forks: 1,881

redpanda-data/connect

Fancy stream processing made operationally mundane

Language: Go - Size: 34 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 8,317 - Forks: 864

MarquezProject/marquez

Collect, aggregate, and visualize a data ecosystem's metadata

Language: Java - Size: 51.4 MB - Last synced at: about 13 hours ago - Pushed at: about 14 hours ago - Stars: 1,903 - Forks: 343

automaticmode/active_workflow

Polyglot workflows without leaving the comfort of your technology stack.

Language: Ruby - Size: 11.9 MB - Last synced at: 9 months ago - Pushed at: about 2 years ago - Stars: 814 - Forks: 67

snowflakedb/snowflake-cli

Snowflake CLI is an open-source command-line tool explicitly designed for developer-centric workloads in addition to SQL operations.

Language: Python - Size: 67.5 MB - Last synced at: about 18 hours ago - Pushed at: about 20 hours ago - Stars: 200 - Forks: 66

alexjc/weboptout

Opt-Out tool to check Copyright reservations in a way that even machines can understand.

Language: Python - Size: 75.2 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 194 - Forks: 1

datachecks/dcs-core

Open Source Data Quality Monitoring.

Language: Python - Size: 4.32 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 154 - Forks: 22

dqops/dqo

Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

Language: Java - Size: 90.5 MB - Last synced at: about 19 hours ago - Pushed at: 25 days ago - Stars: 143 - Forks: 27

aspuru-guzik-group/funsies

funsies is a lightweight workflow engine 🔧

Language: Python - Size: 1.4 MB - Last synced at: 4 days ago - Pushed at: over 3 years ago - Stars: 41 - Forks: 4

duyet/grant-rs

Manage Redshift/Postgres privileges in GitOps style written in Rust

Language: Rust - Size: 1.9 MB - Last synced at: 12 days ago - Pushed at: 3 months ago - Stars: 35 - Forks: 1

snowflakedb/snowflake-cli-action

Github Action enabling easy use of Snowflake CLI in your CI/CD workflows

Language: Shell - Size: 104 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 30 - Forks: 11

tosh2230/stairlight

A data lineage tool detects table dependencies from rendered SQL statements.

Language: Python - Size: 2.36 MB - Last synced at: 3 days ago - Pushed at: 28 days ago - Stars: 29 - Forks: 0

NucleusEngineering/hack-your-pipe

Efficient streaming data ingestion, transformation & activation

Language: Python - Size: 3.01 MB - Last synced at: 9 months ago - Pushed at: almost 2 years ago - Stars: 28 - Forks: 3

hundredlabs/console 📦

Open source data infrastructure platform. Designed for developers, built for speed.

Language: TypeScript - Size: 22.6 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 23 - Forks: 4

glentner/dataphile

Data analytics library for Python and suite of open source, command line based data ops tools.

Language: Python - Size: 351 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 14 - Forks: 3

GuinsooLab/sheenflow

A next-generation open source orchestration platform for the development, production, and observation of data assets.

Language: Python - Size: 54.5 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 1

marwan116/supreme-task

A prefect extension that builds on top of the task decorator to reduce negative engineering!

Language: Python - Size: 64.5 KB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0

ysv-rs/ysv

ysv: clean and transform CSV data along your rules encoded in YAML format, lightning fast

Language: Rust - Size: 153 KB - Last synced at: about 20 hours ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1

Quantyca/content-qshare

Raccogliamo qui tutti i link alle risorse menzionate durante i nostri QShare

Size: 66.4 KB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 2

kirnosenko/Repositorch

Repositorch is a VCS repository analysis engine written in C#.

Language: C# - Size: 725 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

marisogo/test

Turns Data and AI algorithms into full web applications in no time.

Size: 71.9 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 2

usedatabrew/open_ai_benthos_processor

Open AI processor for Benthos

Language: Go - Size: 35.2 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aacraf/projecteADSDB Fork of anbipa/projecteADSDB

simple data platform to study which country indicators are relevant for olympics sports outcome

Size: 32.8 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

retargetly/ds-search-engine

Language: Dockerfile - Size: 12 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0