GitHub topics: spark-ml

Repositories

hazecodeio/spark-sandbox

Language: Scala - Size: 13.1 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

CognonicLabs/awesome-AI-kubernetes

:snowflake: :whale: Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

Size: 326 KB - Last synced at: 6 days ago - Pushed at: 10 months ago - Stars: 129 - Forks: 47

qubole/sparklens

Qubole Sparklens tool for performance tuning Apache Spark

Language: Scala - Size: 175 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 574 - Forks: 141

locationtech/rasterframes

Geospatial Raster support for Spark DataFrames

Language: Jupyter Notebook - Size: 102 MB - Last synced at: 30 days ago - Pushed at: about 1 year ago - Stars: 251 - Forks: 45

FlorentF9/sparkml-som

:sparkles: Spark ML implementation of SOM algorithm (Kohonen self-organizing map)

Language: Scala - Size: 29.3 KB - Last synced at: 6 days ago - Pushed at: over 3 years ago - Stars: 18 - Forks: 6

lifeomic/sparkflow

Easy to use library to bring Tensorflow on Apache Spark

Language: Python - Size: 8.79 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 296 - Forks: 45

sueszli/sparkly-svm

distributed training of a SVM with sparkML

Language: Jupyter Notebook - Size: 21.6 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

wzhe06/SparkCTR

CTR prediction model based on spark(LR, GBDT, DNN)

Language: Scala - Size: 35 MB - Last synced at: about 1 month ago - Pushed at: about 5 years ago - Stars: 912 - Forks: 260

databrickslabs/geoscan

Geospatial clustering at massive scale

Language: Scala - Size: 2.44 MB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 99 - Forks: 19

LuisFalva/ophelia

Ophelian On Mars! More than a simple framework.

Language: Python - Size: 2.16 MB - Last synced at: 23 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 5

lykmapipo/Python-Spark-Log-Analysis

Python scripts to process, and analyze log files using PySpark.

Language: Python - Size: 131 KB - Last synced at: 18 days ago - Pushed at: 10 months ago - Stars: 5 - Forks: 0

roshankoirala/pySpark_tutorial

Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple DataFrames, visualization, Machine Learning

Language: Jupyter Notebook - Size: 202 KB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 29 - Forks: 26

glimmerphoenix/dataeng_book

Libro Fundamentos de Ingeniería de Datos

Language: TeX - Size: 634 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

lynnlangit/Spark-Scala-EKS

Spark Scala docker container sample for AWS testing - EKS & S3

Language: HCL - Size: 5.77 MB - Last synced at: about 19 hours ago - Pushed at: over 6 years ago - Stars: 24 - Forks: 13

AdrielC/skynet

Machine Learning (MLeap) Model Serving application for Scala

Language: Scala - Size: 150 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

mahmoudparsian/machine-learning-course

Machine Learning Course @ Santa Clara University

Size: 194 MB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 23 - Forks: 16

autodeployai/pmml4s-spark

PMML scoring library for Spark as SparkML Transformer

Language: Scala - Size: 50.8 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 19 - Forks: 8

pierrenodet/spark-ensemble

Ensemble Learning for Apache Spark 🌲

Language: Scala - Size: 3.61 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 23 - Forks: 7

dvgodoy/DSR-Spark-AppliedML

DSR Class - Applied Machine Learning with Apache Spark

Language: Jupyter Notebook - Size: 26.2 MB - Last synced at: about 1 month ago - Pushed at: about 6 years ago - Stars: 8 - Forks: 3

vasnake/spark.ml.SpatialJoinTransformer

spark.ml.transformer: join two datasets using spatial relations

Language: Scala - Size: 120 KB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 2 - Forks: 0

dvgodoy/YelpDatasetChallenge

Restaurant recommendations and review text-based quality predictions

Language: Jupyter Notebook - Size: 16.8 MB - Last synced at: about 1 month ago - Pushed at: about 8 years ago - Stars: 19 - Forks: 12

rahult18/NYC-Yellow-Taxi-Trip-Data-Pipeline

This is an end-to-end data pipeline that processes and analyzes NYC Yellow Taxi trip data. It includes data ingestion, cleaning, feature engineering, machine learning model training, and a REST API for fare amount prediction.

Language: Jupyter Notebook - Size: 81.8 MB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

IBM/sms-spam-filter-using-hortonworks 📦

Build Spam Filter Model on HDP using Watson Studio Local

Language: Jupyter Notebook - Size: 25.4 MB - Last synced at: 6 days ago - Pushed at: about 6 years ago - Stars: 6 - Forks: 10

datastaxdevs/workshop-introduction-to-machine-learning

Come ready to discover the goals and approaches of machine learning, and how to build effective algorithms and solutions!

Language: Jupyter Notebook - Size: 17.2 MB - Last synced at: 30 days ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 6

mnassrib/pyspark-examples

This tutorial presents some examples in order to give a quick overview of the Spark APIs.

Language: Jupyter Notebook - Size: 8.48 MB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

mnassrib/bankmarketing-sparkml-databricks

This tutorial analyses a binary classification example based on Spark ML applied with Python language programming and running a databricks cloud community edition cluster.

Language: Jupyter Notebook - Size: 79.1 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

mnassrib/categorical-data-python

A simple demo repository to show how to handling categorical data in python

Language: Jupyter Notebook - Size: 2.88 MB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

alivcor/SMORK

Implementation of SMOTE - Synthetic Minority Over-sampling Technique in SparkML / MLLib

Language: Scala - Size: 165 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 2

krobee/Stock-Price-Predictor

A system that can predict stock price based on Twitter data

Language: Scala - Size: 897 KB - Last synced at: 12 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

zhaoyongchuang/spark-ml

study spark ml

Language: Scala - Size: 208 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

aabdel-kader/Apache-Spark

A repository for my practices and projects using pyspark

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

HaiwenZhang/SearchAdsExample

Language: Java - Size: 7.81 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

felidsche/mail-spam-filter

An email spam filter using Apache Spark’s ML library

Language: Python - Size: 212 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 3 - Forks: 1

MoustafaAMahmoud/spark-sandbox

Spark Sandbox project

Language: Scala - Size: 8.79 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

josemarialuna/ExternalValidity

This package contains the code for calculating external clustering validity indices in Spark. The package includes Chi Index among others.

Language: Scala - Size: 146 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 1

AbdelmajidLh/Spark_ML_Weather

Projet d'apprentissage Scala et Spark : Prédire la pluie de demain avec des données historiques

Language: Scala - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

JBris/docker-spark-sparklyr

Docker setup for Apache Spark and the R sparklyr package

Language: Dockerfile - Size: 18.6 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

dimajix/spark-training

Repository used for Spark Trainings

Language: Jupyter Notebook - Size: 9 MB - Last synced at: 22 days ago - Pushed at: about 2 years ago - Stars: 53 - Forks: 66

jubins/Spark-And-MLlib-Projects

This repository contains Spark, MLlib, PySpark and Dataframes projects

Language: Jupyter Notebook - Size: 101 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 39 - Forks: 97

adityajn105/Apache-Spark-Tutorials

Apache spark is a big data analysis framework.

Language: Jupyter Notebook - Size: 789 KB - Last synced at: about 1 month ago - Pushed at: about 6 years ago - Stars: 2 - Forks: 5

venkateshavula/Evaluate-Spark-MLlib-using-PySpark

A UDF to evaluate Spark-MLlib classification model using PySpark

Language: Python - Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

cmpt-732/Amazon_Product_Analysis

Amazon Product analysis

Language: Python - Size: 5.5 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Language: Scala - Size: 1.33 MB - Last synced at: about 1 month ago - Pushed at: 12 months ago - Stars: 29 - Forks: 12

Heli515/San-Francisco-Crime-Analysis

Language: HTML - Size: 539 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

Heli515/Movie-Recommendation-System

Language: HTML - Size: 85 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

Heli515/Youtube-comments-analysis

Language: HTML - Size: 55.7 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

uosdmlab/nsmc-zeppelin-notebook

Movie review dataset Word2Vec & sentiment classification Zeppelin notebook

Size: 107 KB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 26 - Forks: 6

Jayveersinh-Raj/trip_duration_big_data

Taxi trip duration forecasting using Big data and spark ML

Language: Jupyter Notebook - Size: 203 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

titicaca/spark-iforest

Isolation Forest on Spark

Language: Scala - Size: 74.2 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 221 - Forks: 91

lediau/bigdata-data-engineering-ai-masters

Language: Python - Size: 122 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ksashok/Movie-Recommendation-PySpark

Movie Recommendation using Apache Spark MLlib

Language: Python - Size: 1.95 KB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 1

akarsh3007/MusicMillionData

HDF5 files in spark, MusicMillionData

Language: Scala - Size: 14.8 MB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

Dragon1573/Online-Works 📦

泰迪在线实习备份

Language: Scala - Size: 2.24 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

Jayasagar/sparkml-regression-models-bike-prediction

Basic Bike dataset regression models.

Language: Jupyter Notebook - Size: 353 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

Jayasagar/sparkml-regression-models-restaurant-predictions

Restaurant revenue prediction implementation through SparkML

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

Jayasagar/sparkml-regression-models-movie-revenue-predictions

TMDb movie dataset revenue predictions

Language: Jupyter Notebook - Size: 277 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

trendyol-data-eng-summer-intern-2019/recom-engine-streaming

Streaming component of the project, which is written with Spark Streaming.

Language: Scala - Size: 15.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 1

NashTech-Labs/Sparkathon

A library having Java and Scala examples for Spark 2.x

Language: Java - Size: 113 MB - Last synced at: about 1 month ago - Pushed at: over 8 years ago - Stars: 7 - Forks: 9

javiaspiroz/ml-spark-anime

Sistema recomendador usando un dataset similar al de Movielens pero usando CSVs de animes y utilizando Apache Spark en la ejecución del algoritmo ALS.

Language: Python - Size: 7.31 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

cloudmelon/quantum-playbook

Quantum playbook by cloudmelon

Language: Python - Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

arpitHub/Santander-Product-Recommendation

A product recommendation system build using Scala, Apache Spark and Play framework

Language: Scala - Size: 6.83 MB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 1

Dheeraj2444/spark

Learning PySpark

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 1

superboySB/SparkDocumentClassifier

Text-Classifier by SparkML

Language: Scala - Size: 5.45 MB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 1

shutterstock/spark-phrases

phrase detection using Google's Word2phrase

Language: Scala - Size: 4.88 KB - Last synced at: 30 days ago - Pushed at: about 6 years ago - Stars: 4 - Forks: 1

Siddharth1989/ProspectiveTopUpCustomerPrediction

Developed a model/Spark ML pipeline stream to identify potential customers that may purchase top up services in the future.

Language: Jupyter Notebook - Size: 6.17 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

JohnSnowLabs/spark-nlp-streamlit 📦

Spark NLP for Streamlit

Language: Python - Size: 8.7 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 15 - Forks: 12

typesafehub/fdp-modelserver

An umbrella project for multiple implementations of model serving

Language: Scala - Size: 163 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 46 - Forks: 20

Amir79Naziri/TwitterSentimentAnalysisWithSpark_Project

A sentiment analyzer using Spark ML library for Twitter Dataset

Language: Jupyter Notebook - Size: 13.7 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

sirCamp/spark-pspectrum

P-spectrum embedding and sequence relaxation for NLP in Spark

Language: Scala - Size: 87.9 KB - Last synced at: 2 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

pmb-7684/IBM-Data-Engineering-Professional-Certificate

Learning materials, assignments, and helpful resources for professional certification. Expected Completion June 2023

Size: 9.77 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

titicaca/spark-gbtlr

Hybrid model of Gradient Boosting Trees and Logistic Regression (GBDT+LR) on Spark

Language: Scala - Size: 520 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 89 - Forks: 27

feng-li/dlsa

Distributed least squares approximation (dlsa) implemented with Apache Spark

Language: Python - Size: 276 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 33 - Forks: 46

anmolmore/Enzyme-Classifier-Using-ML

Classify enzymes with geomic sequence using spark-ML

Language: Jupyter Notebook - Size: 719 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

John-CYHui/PySpark-Code

Code for PySpark Tutorial

Language: Python - Size: 38.7 MB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

maikeffi/spark_ml_boston

Loading a CSV from hadoop / hive and perform ml functions

Language: Jupyter Notebook - Size: 34.2 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

aipredict/ai-models-serialization

AI模型序列化总结

Size: 111 KB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 45 - Forks: 7

Rohini2505/Lending-Club-Loan-Analysis

Explanatory Data Analysis and ML model building using Apache Spark and PySpark

Language: HTML - Size: 6.26 MB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 10 - Forks: 12

s22s/pre-lt-raster-frames 📦

Spark DataFrames for earth observation data

Language: Scala - Size: 16.9 MB - Last synced at: 8 days ago - Pushed at: about 7 years ago - Stars: 19 - Forks: 5

pierrenodet/spark-smile 📦

Integrating SMILE and Spark

Language: Scala - Size: 341 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 0

alefbt/SparkML-spring-scoring-poc 📦

POC of socring rest service od Spark ML Pipelines

Language: Java - Size: 234 KB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

BlancRay/PUAdapter 📦

A PU-learning tool on spark

Language: Scala - Size: 22.5 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 2

theGuyWithBlackTie/electricChargingStations

Language: Jupyter Notebook - Size: 8.68 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0

xiaogp/customer_churn_prediction

零售电商客户流失模型，基于tensorflow，xgboost4j-spark，spark-ml实现LR，FM，GBDT，RF，进行模型效果对比，离线/在线部署方式总结

Language: Python - Size: 205 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 58 - Forks: 17

MHassaanButt/Crime-Spark-ML

In this project I stream data and do crime classification using Spark. This dataset contains incidents derived from the SFPD Crime Incident Reporting system. The data ranges from 1/1/2003 to 5/13/2015. I do some data analysis of crime scenes in different areas and with respect to other parameters.

Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0