GitHub topics: spark-dataframes

Repositories

mahmoudparsian/pyspark-tutorial

PySpark-Tutorial provides basic algorithms using PySpark

Language: Jupyter Notebook - Size: 8.96 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 1,223 - Forks: 478

mahmoudparsian/big-data-mapreduce-course

Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University

Language: HTML - Size: 601 MB - Last synced at: 9 days ago - Pushed at: 6 months ago - Stars: 158 - Forks: 143

26hzhang/StockPrediction

Plain Stock Close-Price Prediction via Graves LSTM RNNs

Language: Java - Size: 41.3 MB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 197 - Forks: 113

prajakta-3-patil/e-commerce-analysis

This project is about exploring and analysing E-commerce data. This primarily includes leveraging Apache Spark Dataframe API, joins, functions and aggregations to generate summarized results.

Language: Python - Size: 24.4 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

aravind2060/spark-sql-on-flight-data Fork of Cloud-Computing-Fall2024/assignment-4-advanced-spark-sql-on-flight-data

work with a flight dataset and use Spark SQL to analyze flight delays, airport traffic, and other key metrics

Language: Python - Size: 309 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

MaxineXiong/Item-based-collaborative-filtering

This project utilizes PySpark DataFrames and PySpark RDD to implement item-based collaborative filtering. By calculating cosine similarity scores or identifying movies with the highest number of shared viewers, the system recommends 10 similar movies for a given target movie that aligns users’ preferences.

Language: Jupyter Notebook - Size: 8.44 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 0

jubins/Spark-And-MLlib-Projects

This repository contains Spark, MLlib, PySpark and Dataframes projects

Language: Jupyter Notebook - Size: 101 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 39 - Forks: 97

mohammad-safari/spark-hadoop-exercise

spark hadoop exercise of cloud computing course - aut 1402-1403 fall

Language: Jupyter Notebook - Size: 33.2 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

WazirRohiman/Apache_Spark_Basics

This series explores the basics of Apache Spark with the application of some practical elements of Spark, PySpark & SparkSQL

Language: Jupyter Notebook - Size: 29.3 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

anshul1004/MutualFriends

Implementation of Hadoop and Spark

Language: Java - Size: 23 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 0

yennanliu/spark-etl-pipeline

Various data stream/batch process demo with Apache Scala Spark 🚀

Language: Scala - Size: 5.06 MB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 11 - Forks: 8

on2e/ntua-atdb

Advanced Topics in Databases course project - NTUA ECE - 2022-23

Language: Python - Size: 24.4 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

the-timoye/spark-examples

Language: Python - Size: 14.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 2

LucasDLee/CMPT-353-Final-Project

This is our final project for SFU's CMPT 353 taught by Greg Baker during Summer 2023

Language: Python - Size: 289 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

NashTech-Labs/Sparkathon

A library having Java and Scala examples for Spark 2.x

Language: Java - Size: 113 MB - Last synced at: 2 months ago - Pushed at: over 8 years ago - Stars: 7 - Forks: 9

teamclairvoyant/data-scalaxy-reader-text

Library to read data from various string formats (CSV/JSON/XML) text and parse it to spark dataframe.

Language: Scala - Size: 101 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Thomas-George-T/Movies-Analytics-in-Spark-and-Scala

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Language: Scala - Size: 11.3 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 63 - Forks: 46

Vivek-Murali/CarCrashAnalysis

BCG GAMMA CASE STUDY

Language: Jupyter Notebook - Size: 11.9 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

thenickben/SplitCSV-Spark

Big Data - Split a large CSV file into N smaller ones and save them into the local disk

Language: Scala - Size: 2.93 KB - Last synced at: 5 days ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0

rajeshsantha/MonitoredStructuredStreaming

Repository for Spark structured streaming use case implementations.

Language: Scala - Size: 65.4 KB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 1

zaha2020/Big_Data

This repository contains the implementation of a wide variety of BigData Projects in different applications of NoSQL databases, Spark, Data Pipelines, and map-reduce. These projects include university projects and projects implemented due to interest in BigData.

Language: Jupyter Notebook - Size: 34.4 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

spider-123-eng/Spark

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

Language: Scala - Size: 6.59 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 55 - Forks: 42