Topic: "spark-kafka-integration"
spider-123-eng/Spark
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
Language: Scala - Size: 6.59 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 55 - Forks: 42
zekeriyyaa/PySpark-Structured-Streaming-ROS-Kafka-ApacheSpark-Cassandra
A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.
Language: Python - Size: 652 KB - Last synced at: 22 days ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 6
akashsethi24/Spark-Kafka-Example
Example for Data Reading from and Writing to from Kafka Topic using Apache Spark DataFrame and DataSet
Language: Scala - Size: 150 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 6 - Forks: 4
xuanbo/spark-programming
spark代码
Language: Scala - Size: 28.3 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 3
mayankrawat/CSVJoin
Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.
Language: Java - Size: 10.7 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 0
RooseveltAdvisors/spark_structured_streaming_demo
A Log Analytics demo based on Spark Structured Streaming + Kafka
Language: Python - Size: 1.41 MB - Last synced at: 4 months ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 3
vchoudhari45/spark-kafka-integration
spark-kafka-integration
Language: Scala - Size: 14.6 KB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 0
kthristov/cubos-olap
Language: Scala - Size: 24.4 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0
spektom/kafka-dumper
Dumps events stored in Kafka to any Hadoop supported file system using Spark Streaming
Language: Scala - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0
yucl80/log-handle-tools
Language: Scala - Size: 133 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 1
