Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / novakov-alexey-zz / spark-elt-jobs
Example of Spark ELT jobs using Airflow scheduling
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/novakov-alexey-zz%2Fspark-elt-jobs
Stars: 1
Forks: 0
Open Issues: 0
License: apache-2.0
Language: Python
Repo Size: 174 KB
Dependencies:
7
Created: almost 3 years ago
Updated: over 1 year ago
Last pushed: almost 2 years ago
Last synced: about 1 year ago
Topics: airflow, dag, data-engineering, etl, scala
Files
Loading...
Readme
Loading...
Dependencies
requirements.txt
pypi
- apache-airflow ==2.1.0
- apache-airflow-providers-amazon ==1.4.0
- apache-airflow-providers-apache-spark ==1.0.3
- apache-airflow-providers-http ==1.1.1
- dataclasses-json ==0.5.4
- mypy *
- requests ==2.25.1