An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: data-piplines

orbitalapi/orbital

Orbital automates integration between data sources (APIs, Databases, Queues and Functions). BFF's, API Composition and ETL pipelines that adapt as your specs change.

Language: TypeScript - Size: 220 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 314 - Forks: 11

wharfie/wharfie

Wharfie is an experimental table-oriented data application framework built ontop of AWS Athena.

Language: JavaScript - Size: 3.24 MB - Last synced at: 25 days ago - Pushed at: about 2 months ago - Stars: 7 - Forks: 0

opendatadiscovery/odd-collector 📦

Open-source metadata collector based on ODD Specification

Language: Python - Size: 1.96 MB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 43 - Forks: 13

M0hamedIbrahim1/Airflow-Data-Pipeline

This Airflow DAG processes and transforms orders data from an S3 bucket to a Snowflake data warehouse. The pipeline cleans, enriches, and merges the data to create a reporting-ready dataset.

Language: Python - Size: 396 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

thinh-vu/fullstory_api

Python Client for Fullstory API

Language: Python - Size: 25.4 KB - Last synced at: 25 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Roe-Binary-Bandits/Data-Engineering

Binary Bandits Data Engineering coursework.

Language: Python - Size: 5.99 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0