Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: spark-kafka

paljsingh/community-discussion

Language: Python - Size: 12.4 MB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

johngodoi/ScalaSparkKafka

This code just loads data to kafka through apache spark and reads it back.

Language: Scala - Size: 5.86 KB - Last synced: about 2 months ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0

LinMingQiang/spark-utils

:boom: :alien: :hotsprings::rocket:Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等

Language: Scala - Size: 168 KB - Last synced: about 2 months ago - Pushed: over 4 years ago - Stars: 35 - Forks: 14

LinMingQiang/sparkstreaming

:boom: :rocket: 封装sparkstreaming动态调节batch time(有数据就执行计算)；:rocket: 支持运行过程中增删topic；:rocket: 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Language: Scala - Size: 258 KB - Last synced: about 2 months ago - Pushed: about 3 years ago - Stars: 182 - Forks: 83

EthicalML/kafka-spark-streaming-zeppelin-docker

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Size: 1020 KB - Last synced: over 1 year ago - Pushed: almost 3 years ago - Stars: 99 - Forks: 69

martinKindall/NYC-Taxi-Limousine-Data-Spark

NYC Taxi & Limousine Commission's open data with Spark Streaming 3.0.0

Language: Scala - Size: 43.9 KB - Last synced: over 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1

vchoudhari45/spark-kafka-integration

spark-kafka-integration

Language: Scala - Size: 14.6 KB - Last synced: over 1 year ago - Pushed: about 5 years ago - Stars: 1 - Forks: 0

spektom/kafka-dumper

Dumps events stored in Kafka to any Hadoop supported file system using Spark Streaming

Language: Scala - Size: 13.7 KB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 0 - Forks: 0

mayankrawat/CSVJoin

Use this project to join data from multiple csv files. Currently in this project we support one to one and one to many join. Along with this you can find how to use kafka producer efficiently with spark.

Language: Java - Size: 10.7 KB - Last synced: over 1 year ago - Pushed: almost 2 years ago - Stars: 2 - Forks: 0

Related Keywords
spark-kafka 9 kafka 9 spark 7 spark-streaming 4 spark-kafka-integration 3 kafka-spark 3 docker 3 sparkstreaming 2 spark-streaming-kafka 2 kafka-consumer 2 kafka-producer 2 spark-sql 2 docker-compose 2 splunk 1 ssc-dstream 1 apache-kafka 1 kafka-spark-streaming 1 kafka-zeppelin 1 spark-structured-streaming 1 scala 1 nyc-taxi-dataset 1 zeppelin 1 streaming 1 spark-zeppelin 1 apache-spark 1 apachespark 1 integrate-kafka-spark 1 java 1 join-apache-spark 1 kafka-producer-spark 1 kafka-with-spark 1 one-to-many 1 one-to-many-join 1 one-to-many-joins-spark 1 one-to-one-join 1 spark-csv 1 spark-dataframes 1 spark-java 1 analytics 1 chat 1 dashboard 1 distributed 1 elasticsearch 1 flask 1 gridfs 1 kappa 1 kibana 1 mongo 1 singlenode 1 socket-io 1 vuejs 1 ssl 1 es-shade 1 flink 1 flink-kafka 1 hbase 1 hbase-util 1 kafka-ssl 1 kafka-util 1 kudu 1 rabbitmq-util 1 spark-es 1 spark-hbase 1 spark-kudu 1 sparkstreaming-kafka 1