GitHub / smsraj2001 / STREAM-BATCH-PROCESSING-KAFKA-SPARK
A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smsraj2001%2FSTREAM-BATCH-PROCESSING-KAFKA-SPARK
PURL: pkg:github/smsraj2001/STREAM-BATCH-PROCESSING-KAFKA-SPARK
Stars: 3
Forks: 0
Open issues: 0
License: None
Language: Python
Size: 3.93 MB
Dependencies parsed at: Pending
Created at: over 2 years ago
Updated at: about 1 year ago
Pushed at: about 2 years ago
Last synced at: 5 months ago
Topics: batch-processing, kafka, kafka-topics, lambda-architecture, mysql-database, no-api, pub-sub, pyspark, python3, realtime, spark, streaming, ubuntu2204, zookeeper