ArroyoSystems/arroyo

Distributed stream processing engine in Rust

Language: Rust - Size: 13.6 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 3,732 - Forks: 215

superstreamlabs/memphis

Memphis.dev is a highly scalable and effortless data streaming platform

Language: Go - Size: 468 MB - Last synced at: 9 days ago - Pushed at: 11 months ago - Stars: 3,294 - Forks: 223

Western-OC2-Lab/AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

Implementation/Tutorial of using Automated Machine Learning (AutoML) methods for static/batch and online/continual learning

Language: Jupyter Notebook - Size: 5.43 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 611 - Forks: 106

Fengrui-Liu/StreamAD

Online anomaly detection for data streams/ Real-time anomaly detection for time series data.

Language: Python - Size: 31 MB - Last synced at: 10 days ago - Pushed at: almost 2 years ago - Stars: 123 - Forks: 24

aartikis/RTEC

RTEC is an Event Calculus implementation optimised for stream reasoning

Language: Prolog - Size: 13 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 78 - Forks: 15

inloco/kafka-elasticsearch-injector 📦

Golang app to read records from a set of kafka topics and write them to an elasticsearch cluster

Language: Go - Size: 804 KB - Last synced at: 10 months ago - Pushed at: about 3 years ago - Stars: 75 - Forks: 15

marcosschroh/faust-docker-compose-example

Faust dockerized application

Language: Python - Size: 52.7 KB - Last synced at: 18 days ago - Pushed at: over 2 years ago - Stars: 68 - Forks: 12

oscimp/oscimpDigital

OscillatorIMP ecosystem for the digital characterization of ultrastable oscillators and Software Defined Radio (SDR) frontend processing

Size: 157 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 53 - Forks: 7

zmyzheng/TweetMap

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

Language: Java - Size: 40.9 MB - Last synced at: 22 days ago - Pushed at: about 2 years ago - Stars: 50 - Forks: 22

Western-OC2-Lab/AutoML-and-Adversarial-Attack-Defense-for-Zero-Touch-Network-Security

This repository includes code for the AutoML-based IDS and adversarial attack defense case studies presented in the paper "Enabling AutoML for Zero-Touch Network Security: Use-Case Driven Analysis" published in IEEE Transactions on Network and Service Management.

Language: Jupyter Notebook - Size: 10.1 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 32 - Forks: 9

anqorithm/RealTime-StockStream

RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data storage, making it a powerful yet easy-to-use tool for financial data analysis

Language: Python - Size: 5.36 MB - Last synced at: 3 days ago - Pushed at: 2 months ago - Stars: 25 - Forks: 3

officialarijit/RECS

Real-time Emotion Recognition using Physiological signals in e-Learning Here one can find the development of realtime emotion recognition using various physiological signals

Language: Jupyter Notebook - Size: 167 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 17 - Forks: 2

AhmetFurkanDEMIR/Flink-Example

Flink Example

Language: Scala - Size: 5.6 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 0

ognis1205/mutad

Realtime Data Processing and Search Engine Implementation.

Language: Java - Size: 210 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 15 - Forks: 0

JayKumarr/OSDM

This code belongs to ACL conference paper entitled as "An Online Semantic-enhanced Dirichlet Model for Short Text Stream Clustering"

Language: Python - Size: 831 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 14 - Forks: 4

ppatierno/kafka-hybrid-iot

Apache Kafka for the Hybrid IoT

Language: JavaScript - Size: 6.34 MB - Last synced at: 19 days ago - Pushed at: about 6 years ago - Stars: 10 - Forks: 0

Data-Wrangling-with-JavaScript/Chapter-7

Code examples for Chapter 7 of Data Wrangling with JavaScript

Language: JavaScript - Size: 752 KB - Last synced at: 12 months ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 3

damianhorna/nyc-taxi-flink

Simple big data pipeline

Language: Scala - Size: 5.96 MB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 0

radinhamidi/Hybrid_Forest

Hybrid Forest: A Concept Drift Aware Data Stream Mining Algorithm

Language: Python - Size: 3.39 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 7 - Forks: 3

officialarijit/ReMECS

Real-Time Multimodal Emotion Classification System in E-Learning Context

Language: Jupyter Notebook - Size: 1.09 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 5 - Forks: 0

vaibhavbhagee/Data-Mining

Data Mining course projects

Language: C++ - Size: 67.8 MB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 5 - Forks: 0

daq-tools/lorrystream

A lightweight and polyglot stream-processing library, to be used as a data backplane-, message relay-, or pipeline-subsystem.

Language: Python - Size: 260 KB - Last synced at: 16 days ago - Pushed at: 3 months ago - Stars: 4 - Forks: 0

ale93p/namb

Not only A Micro-Benchmark

Language: Java - Size: 1.36 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

tealtools/dekaf

Dekaf is a visual user interface for Apache Pulsar 🛸

Size: 51.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

kevinnguyen20/data-aggregation-in-distributed-networks

Assessing the throughput and end-to-end latency of queries in geo-distributed networks

Language: C - Size: 35.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

gmarciani/flink-app

Scaffolding for data stream processing applications, leveraging Apache Flink.

Language: Java - Size: 124 KB - Last synced at: 12 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0

tanaxer01/eStreSim

Simulation framework focused in stream processing systems

Language: C++ - Size: 33.2 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0

northern-64bit/RioDB-Headless-Client

A headless client for RioDB.

Language: Java - Size: 20.5 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 1

dvu4/udacity-data-streaming-project-1

Udacity Data Streaming - Project Optimizing Public Transportation

Language: Python - Size: 345 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 4

MauricioVazquezM/Spark_BigData_Architecture_Project

Final project for the course 'Architecture for Large Data Volumes', taught in the Bachelor's program in Data Science at ITAM

Language: Python - Size: 47.9 KB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 1

DataFloz/Metro

Metro is pipelines orchestrator platform for stream data.

Language: Python - Size: 642 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

hnjm/memphis-broker Fork of memphisdev/memphis

Next-Generation Real-Time Data Processing Platform

Size: 183 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

julian-rosas/geometric-figure-clasifier

Geometric Figure Clasifier program

Language: C# - Size: 61.5 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

janhaa/flink-starter

Apache Flink boilerplate to build performant data streaming applications from.

Language: Java - Size: 85 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

hrialan/m2ds-data-stream-project

Markets stocks prediction using Kafka and online regression tools

Language: HTML - Size: 8.54 MB - Last synced at: about 1 month ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

darkfennertrader/Optimizing-Public-Trasportation

Udacity Data Streaming project based on Apache Kafka

Language: Python - Size: 348 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

SC-CS-KS/KS-BigData

BigData knowledge system（大数据知识体系）.

Size: 54.4 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

Alxertion/RocketLeagueReplayAnalyzer

Analyzes rocket league replays, allowing the user to write Streaming-SQL to find out information about the replay as it plays.

Language: Python - Size: 11.7 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

conrezo/metody-sztucznej-inteligencji

Usage of the UOB algorithm in the unbalanced static data streams processing - Academic Project

Language: Python - Size: 397 KB - Last synced at: 11 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

DataSystemsGroupUT/Process-Discovery-over-unordered-streams

A Flink library to implement both a buffer-based and a speculative out-of-order event arrival handlers for online process discovery

Language: Java - Size: 43 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

ale93p/g5k-storm-cluster

Automated deployment of an Apache Storm cluster in your Grid'5000 reserved nodes.

Language: Python - Size: 27.3 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 1

c-dickens/stream-summaries-high-lev-rows

Code to find rows of high leverage in a data stream.

Language: Jupyter Notebook - Size: 34 MB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 1 - Forks: 0

phanvinh0526/data-stream-analysis-with-storm

My minor research in 10 months | Data Stream Analysis with Storm Apache | Frequent Pattern Mining on Item, Itemset | Sep 2014 - July 2015

Language: HTML - Size: 10.5 MB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 1 - Forks: 0

AyemunHossain/stream-buffers-in-nodejs

This project focuses on implementing and demonstrating how stream and buffer works along together in nodejs.

Language: JavaScript - Size: 28.5 MB - Last synced at: 29 days ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

lpTMD/Resource-Constrained-Drone-Work

This repo has various work I've done or assisted with in my capstone project for my Bachelors degree in Computer Engineering at Cal Poly Pomona.

Size: 11.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

AVINESHWAR-KRISHNA/DataStream-SQLServer

DataStream-SQLServer provides real-time data streaming from SQL Server using Zookeeper, Kafka, and Debezium. This repository contains the necessary configurations, Docker setups, and sample code to get you started.

Language: Python - Size: 20.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

MarcusLe02/realtime-pipeline-hiring-platform

Real-time data engineering pipeline for an American hiring platform

Language: Python - Size: 2.42 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

iamirmasoud/data_streaming

Hands on data streaming

Language: Jupyter Notebook - Size: 14.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

eli64s/pyflink-poc

PyFlink data stream processing utilities 🐿

Language: Python - Size: 32.2 KB - Last synced at: 13 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 1

Savimbi/rsvp-stream-pipeline

This project is a data pipeline to stream data from meetup, perform realtime analysis and mapping back to google map.

Language: Java - Size: 104 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

m-spangenberg/exercises_databases

A collection of exercises and notes to help me better understand SQL and NO-SQL databases. I attempt to touch on common approaches to schema modeling, normalization, and query optimization.

Size: 515 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

ntedgi/data-stream-counter

Distributed Frequency Count Algorithms for Data Streams

Language: Kotlin - Size: 37.1 KB - Last synced at: 6 days ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

rahiakela/data-structures-and-algorithms-specialization

Data Structures and Algorithms Specialization | Coursera

Language: Java - Size: 1.25 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

grc-iit/HFlow

HFlow is a platform for I/O forwarding managed elastically, dynamically, and actively

Language: C++ - Size: 3.61 MB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

amit-hm/Data-Streams-Analyzing-Tool

Tool to approximate the frequency of occurrences of different items in a data stream.

Language: Jupyter Notebook - Size: 98.6 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

ale93p/g5k-flink-cluster

Automated deployment of an Apache Flink cluster in your Grid'5000 reserved nodes.

Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 2

SixingYan/Sketch-for-Data-Stream

Language: Python - Size: 21.3 MB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

valerioditinno/light-system Fork of calmar3/light-system

In a team of 4 people, we implemented a public lighting control and monitoring system for a smart city

Size: 1020 KB - Last synced at: almost 2 years ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0

mirrors/memphis-broker

Memphis is an Open-Source, Real-Time Data Processing Platform

Language: JavaScript - Size: 276 MB - Last synced at: 10 months ago - Stars: 0 - Forks: 0