realdatadriven/etlx

This project is an ETL (Extract, Transform, Load) Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

Language: Go - Size: 2.94 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 15 - Forks: 1

realdatadriven/central-set-go

This open-source project is a dynamic, data-driven, and configuration-driven application built with Golang. Out of the box, it provides an admin app that allows users to manage multiple applications, offering built-in authentication, user management, and role-based access control at the CRUD level for each table, ETL Workflow powered by DuckDB

Language: Go - Size: 35.8 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0

realdatadriven/awesome-duckdb Fork of davidgasquez/awesome-duckdb

🦆 A curated list of awesome DuckDB resources

Size: 374 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

realdatadriven/pb-store

Language: JavaScript - Size: 16.2 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

realdatadriven/etlx-wrapper

Language: Python - Size: 2.93 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

realdatadriven/pyetlx

PyETLX is a Python package designed for seamless ETL (Extract, Transform, Load) workflows, leveraging the power of the ETLX Go library under the hood. By using gopy, PyETLX bridges the efficiency and flexibility of Go with the accessibility and popularity of Python, offering a robust tool for data engineering tasks

Language: Python - Size: 68.4 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

realdatadriven/central-set

Multipurpose application written in python, supporting multiple database SQLite, Postgres, DuckDB, MySQL or any other SQL Database supported by SQLAlchemy. Suportes out of the box CRUD with capability of dynamic and customizable forms and tables or lists. User and profile management with capability of setting Create, Read and much more

Language: Python - Size: 1.76 MB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

realdatadriven/py-rust-odbc-csv

Extracting data from ODBC Source to CSV using Rust, made to be memory eficient and fast!

Language: Rust - Size: 40 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

realdatadriven/central-set-cli

A python cli for Central-Set

Language: Python - Size: 10.7 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

realdatadriven/central-set-docs

Documentation for Central Set

Language: JavaScript - Size: 354 KB - Last synced at: 20 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

realdatadriven/query_doc

A small package that allows you to break your query in manageable chunks (normally fields), allowing you to focus on building each variable / field independently, with notes / documentation and at the end cam be compiled to a single gigantic query string that otherwise would be impossible to manage or maintain

Size: 10.7 KB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0