Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / syedhassaanahmed / portable-etl
E2E data pipeline showcasing Spark's capabilities on Cloud and Edge
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/syedhassaanahmed%2Fportable-etl
Stars: 0
Forks: 2
Open Issues: 0
License: mit
Language: HCL
Repo Size: 1.21 MB
Dependencies:
11
Created: over 1 year ago
Updated: 9 months ago
Last pushed: 9 months ago
Last synced: 9 months ago
Topics: apache-kafka, apache-spark, azure-databricks, azure-event-hubs, azure-sql-database, azure-sql-server, cloud-computing, confluent-kafka, docker-compose, edge-computing, pyspark, smoke-test, terraform
Files
Dependencies
- actions/checkout v3 composite
- apache/spark-py v3.1.3
- confluentinc/cp-kafka latest
- confluentinc/cp-zookeeper latest
- mcr.microsoft.com/mssql/server 2022-latest
- mcr.microsoft.com/oss/azure-samples/azureiot-telemetrysimulator latest
- python 3-bullseye
- pyspark ==3.1.3
- setuptools *
- wheel *