Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / KumarRoshandot / AirFlow_Kafka_Spark_Docker

This is a recipe for docker container based architecture based on airflow, kafka,spark,docker

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KumarRoshandot%2FAirFlow_Kafka_Spark_Docker

Stars: 14
Forks: 50
Open Issues: 1

License: None
Language: Python
Repo Size: 6.49 MB
Dependencies: 20

Created: over 4 years ago
Updated: 9 months ago
Last pushed: over 1 year ago
Last synced: 9 months ago

Files

Loading...

Readme

Loading...

Dependencies

Project_Flight/airflow_docker/requirements.txt pypi

docker ==4.0.2
kafka-python ==1.4.6
matplotlib ==3.0.3
psycopg2-binary ==2.7.7
pyspark ==2.4.4

Project_Flight/spark_hadoop_docker/requirements.txt pypi

matplotlib ==3.0.3

Project_Flight_Docker2/airflow_docker/requirements.txt pypi

docker ==4.0.2
kafka-python ==1.4.6
matplotlib ==3.0.3
psycopg2-binary ==2.7.7
pyspark ==2.4.4

Project_Flight/airflow_docker/Dockerfile docker

puckel/docker-airflow 1.10.2 build

Project_Flight/docker-compose.yml docker

Project_Flight/spark_hadoop_docker/Dockerfile docker

cjonesy/docker-spark latest build

Project_Flight_Docker2/airflow_docker/Dockerfile docker

rose4earn/spark_airflow_hive part1 build

Project_Flight_Docker2/docker-compose.yml docker