spark-submit | Topic | Ecosyste.ms: Repos

Topic: "spark-submit"

kingekinge/spark-submit-ui

This is a based on playframwork for submit spark app

Language: CSS - Size: 5.33 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 60 - Forks: 36

pyjaime/docker-airflow-spark

Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks

Language: Shell - Size: 29.3 KB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 8

xxsacxx/alpine-python3-numpy-pandas-sparkContainer-spark-submit

Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.

Language: Dockerfile - Size: 12.7 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 1

tienlonghungson/BigData-HDFS-Spark-Elasticsearch-Kibana

Processing IT Recruitment Data in HDFS Cluster, Spark, Elasticsearch and Kibana, deployed by Docker compose

Language: Python - Size: 5.12 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 1

izhangzhihao/sbt-spark-submit Fork of saurfang/sbt-spark-submit

sbt plugin for spark-submit

Language: Scala - Size: 45.9 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 6 - Forks: 0

AIxHunter/Spark-k8s-pod-template

Steps to deploy a Spark app to Kubernetes cluster using spark-submit or a pod template

Language: Shell - Size: 12.7 KB - Last synced at: 25 days ago - Pushed at: 3 months ago - Stars: 4 - Forks: 1

cognitree/kronos-extensions

Kronos extensions for storage, queue and handlers.

Language: Java - Size: 296 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 1

HussainTaj-W/spark_submit_project

An easy to use script that automatically adds files to the spark-submit command.

Language: Python - Size: 32.2 KB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

yennanliu/spark-scala-word-count

Run a simple spark word count job via 1) scala sbt spark 2) docker

Language: Scala - Size: 470 KB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

Sabab080/pyspark-etl-customer-sales

PySpark-based ETL pipeline that extracts transaction data from a MySQL database, cleans and transforms it, aggregates monthly sales per customer, and writes the processed data to an S3 bucket in Parquet format.

Language: Python - Size: 6.84 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Shikhar97/Spatial-Hotspot-Analysis

Spatial Hotspot Analysis on Geo-Spatial Data using Apache Spark and Scala

Language: Scala - Size: 631 KB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

SpiRITlab/SparkFHE-Addon

scripts, configurations, resources, and others

Language: Shell - Size: 265 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

aksl20/GDELT-Explore Fork of tonio73/GDELT-Explore

GDELT Fu-Fu

Size: 6.84 MB - Last synced at: 6 months ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 0

branesh2k/AWS-emr-project

AWS EMR-based ETL pipeline using PySpark and S3. Executed using SSH spark-submit.

Language: Python - Size: 1.29 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Anas399/SPARK_CLUSTER_DOCKER

Set-up local spark cluster, hadoop (hdfs), airflow, postgresql on docker with ease, without any local installations

Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

ash-0521/Ensuring-Smiles-using-Spark-ML

The primary objective of this study is to explore the feasibility of using machine learning algorithms to classify health insurance plans based on their coverage for routine dental services. To achieve this, I used six different classification algorithms: LR, DT, RF, GBT, SVM, FM(Tech: PySpark, SQL, Databricks, Zeppelin books, Hadoop, Spark-Submit)

Language: Python - Size: 15.4 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0