George-Nyamao/GCP_ETL_Project

An ETL pipeline to move an uploaded flat file ffrom GCS, mask PII, store Big Query, and Create a report in Looker.

Language: Python - Size: 66.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

bsrikanth24/gcp-data-engineering-etl-with-composer-dataflow

This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.

Language: Python - Size: 39.1 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

selvakrishnan/DataFusion_Airflow_Trigger

A simple dag for triggering the Cloud Data Fusion Pipeline using Apache Airflow.

Language: Python - Size: 2.93 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

thunchanokbow/AudibleBook-Revenue

Manage big data on cloud computing to find a list of best-selling audible books, generate reports and dashboards, and provide products and sales promotions that meet the needs of consumers in Thailand

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

thunchanokbow/Inventory-Amazon

Inventory value is also important for determining a company's liquidity, or its ability to meet its short-term financial obligations. A high inventory value can indicate that a company has too much money tied up in inventory, which could make it difficult for the company to pay its bills.

Language: Jupyter Notebook - Size: 21.3 MB - Last synced at: 6 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

okzapradhana/cloud-flower

Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build

Language: Python - Size: 980 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 6 - Forks: 6

aroraayush/airflow-spark-stackoverflow-logs-analysis

Ask Ubuntu Logs analysis with PySpark on GCP | Pipeline with Airflow (Cloud Composer)

Language: HTML - Size: 8.27 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

bmv3cg/cloud-composer

Language: HCL - Size: 1000 Bytes - Last synced at: 9 months ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0