GitHub / wonderakwei / End-To-End-Data-Engineering-Project-with-Etsy-API
A comprehensive data engineering pipeline, orchestrates data workflows with Apache Airflow, Python, Kafka, Zookeeper, Spark, and Cassandra. Containerized using Docker: to deploy and scale effortlessly. This Etsy API Data Pipeline extracts, processes, and analyzes Etsy marketplace data—retrieving product listings, shop details, and reviews.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wonderakwei%2FEnd-To-End-Data-Engineering-Project-with-Etsy-API
PURL: pkg:github/wonderakwei/End-To-End-Data-Engineering-Project-with-Etsy-API
Stars: 0
Forks: 0
Open issues: 0
License: None
Language:
Size: 7.81 KB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: over 1 year ago
Pushed at: over 1 year ago
Last synced at: over 1 year ago
Topics: apache, apache-airflow, api, cassandra, control-center, data-engineering, docker-compose, kafka, pipeline, postgresql, python, schema-registry, spark, zookeeper