kishlayjeet/Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra

A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

Language: Python - Size: 2.3 MB - Last synced at: 17 days ago - Pushed at: almost 2 years ago - Stars: 25 - Forks: 7

microsoft/Mobius

C# and F# language binding and extensions to Apache Spark

Language: C# - Size: 6.44 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 940 - Forks: 211

tashi-2004/FMA-A-Dataset-For-Music-Analysis

Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interface is also included.

Language: Python - Size: 2.66 MB - Last synced at: 20 days ago - Pushed at: 2 months ago - Stars: 3 - Forks: 1

TheDataArtisanDev/Kafka-Streaming-Application

This repository contains the code to read the streaming kafka data and perform various streaming operations

Language: Java - Size: 123 KB - Last synced at: 22 days ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

IBM/ibm-streams-with-kafka 📦

Build a Kafka streaming app using IBM Streams

Language: Jupyter Notebook - Size: 5.53 MB - Last synced at: 4 months ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 7

NorthBrains/dashboard-1

An interactive dashboard simulating live sales and warehouse data for the company.

Language: Python - Size: 3.18 MB - Last synced at: 20 days ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

TechnocratSid/spring-kafka

Language: Java - Size: 3.91 KB - Last synced at: 11 months ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

sinhaGuild/ml-streming-kafka-cdc Fork of jaumpedro214/ml-streming-kafka-cdc

Machine Learning (Streaming) with KAFKA, Debezium and BentoML Service.

Size: 15.6 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

MartinKalema/confluent-kafka-data-streaming

Consumer Producer Components

Language: Python - Size: 232 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

hanchiang/apache-kafka-real-time-stream-processing

Learn kafka real-time stream processing

Language: Java - Size: 31.3 KB - Last synced at: 27 days ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

QuantumFuturist/datastack-kafka

This repository is a comprehensive guide and toolkit for anyone looking to understand and implement data streaming solutions using Apache Kafka.

Size: 9.77 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

hooniegit/pyspark

studying pyspark with various external applications

Language: Python - Size: 12.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

mallory-jpg/kafka-fraud

Streaming fraud detection system

Language: Python - Size: 3.5 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 1

gerardodavidlopezcastillo/GrafanaStepFunctionsSNS_Public

Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

s3ni0r/kafka-streams-base

Base project for kafka-streams development and testing

Language: Scala - Size: 37.1 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 0

Thomas-George-T/Covid19-Tweet-Data-Collection

Stream real time Tweets of current affairs like covid-19 using Kafka 2.0.0 high throughput producer & consumer into Elasticsearch using safe, idempotent and compression configurations. Aggregate the data and use it for further analytics.

Language: Java - Size: 130 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

ssamparn/spring-microservices-assorted

The purpose of this project is to learn, develop and explore microservices using spring boot, spring cloud, event streaming

Language: Java - Size: 71.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

wjc-van-es/ps-eda-kafka-streams

Example from Designing Event-driven Applications Using Apache Kafka Ecosystem By Bogdan Sucaciu m 5

Language: Java - Size: 21.5 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

ManikHossain08/Spark-ETL-Data-Pipeline-using-SparkStreaming-HDFS-Kafka-Hive

The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming

Language: Scala - Size: 1.09 MB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

pedrodeoliveira/kafka-streaming-tests

Kafka streaming performance tests.

Language: Python - Size: 38.1 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1

saLeox/Lambda-Streaming-HousePricePredict

Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.

Language: Java - Size: 35.2 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

saLeox/Kafka-Springboot-Integration

Kafka integration in Springboot, including producer, consumer, streaming, and interactive query of Ktable.

Language: Java - Size: 27.3 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

felipexw/getting-started-kafka

Language: Java - Size: 63.5 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

felipegutierrez/explore-kafka

This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.

Language: Java - Size: 10.8 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

ustari28/javaspark

Tests with Spark local, kafka streaming and socket streaming

Language: Java - Size: 779 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0