stream-processing | Topic | Ecosyste.ms: Repos

Topic: "stream-processing"

1e14/1e14

Tools for building function graphs

Language: TypeScript - Size: 306 KB - Last synced at: 2 days ago - Pushed at: almost 6 years ago - Stars: 5 - Forks: 0

piglovesyou/node-hole 📦

Async parallel stream for Node.js

Language: TypeScript - Size: 324 KB - Last synced at: 24 days ago - Pushed at: about 6 years ago - Stars: 5 - Forks: 0

williamb1024/fs-binary-codecs

Streamable binary to text encodings for .NET

Language: C# - Size: 692 KB - Last synced at: 5 days ago - Pushed at: almost 7 years ago - Stars: 5 - Forks: 0

eric810905/twiddit

Data Engineering Project @ Insight Data Science

Language: Python - Size: 979 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 3

ankushs92/apache-flink-aggregations-clickstreams

Count clicks in an unbounded clickstream over a Time window using Apache Flink's DataStream API

Language: Java - Size: 27.3 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 4

rosswilson/flink-telemetry

Complex Event Processing using Apache Flink for service health monitoring

Language: Scala - Size: 14.6 KB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 5 - Forks: 1

seanpquig/flink-streaming-confluent

DeserializationSchema compatible with Confluent's KafkaAvroDecoder

Language: Java - Size: 16.6 KB - Last synced at: over 1 year ago - Pushed at: almost 9 years ago - Stars: 5 - Forks: 3

KMax/cqels

A fork of CQELS (Continuous Query Evaluation over Linked Data)

Language: Java - Size: 2.85 MB - Last synced at: 19 days ago - Pushed at: over 9 years ago - Stars: 5 - Forks: 5

littlesaints/functional-streams

Smart functions for stream processing, fault-tolerance and Java Streams integration of non-streaming APIs and language constructs.

Last synced at: 30 days ago - Stars: 5 - Forks: 0

nirdslab/streaminghub

Build Realtime Experiments with Multimodal Biosignals

Language: Jupyter Notebook - Size: 10.4 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 4 - Forks: 0

IBMStreams/streamsx.dps

The IBMStreams/streamsx.dps GitHub repository is home to the Streams toolkit named DPS (Distributed Process Store)

Language: C++ - Size: 87.9 MB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 4 - Forks: 9

vojay-dev/flitch

Let's learn about Apache Flink and sentiment analysis by building a real-time sentiment analysis streaming application for the Twitch chat.

Language: Java - Size: 1.36 MB - Last synced at: 27 days ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

IBMStreams/streamsx.objectstorage

The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.

Language: Java - Size: 115 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 7

santiagocardin/barkend

Barkend project

Language: Java - Size: 1.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

catenae/catenae-stopover

Microservices Framework for Stopover

Language: Python - Size: 354 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

abhirockzz/oracle-functions-oci-streaming

Invoke Oracle Streaming Service from Oracle Functions

Language: Java - Size: 9.77 KB - Last synced at: 20 days ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 4

y5labs/seacreature

Transient event processing, realtime analytics and transactional data.

Language: JavaScript - Size: 2.18 MB - Last synced at: 11 days ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

Lambda Expression, Functional Interface, Stream ForEach and Filter Methods, Stream Sorting List and Map, Map vs FlatMap, Optional Class, Map and reduce mechanism, Parallel Stream Processing, Exception Handling,BiFunctional_BiConsumer_BiPredicate_Interface,Completable_Future & its methods & Joda Date-Time API

Language: Java - Size: 124 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

joshcastle/CodemashStreamProcessors

A repo to demo stream processors using Benthos for Codemash 2023!

Language: Java - Size: 14.1 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 1

iLoveTux/aina

aina is not AWK

Language: Python - Size: 50.8 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

Galarius/gs-scrambler

Streaming Audio Steganography Algorithm

Language: Python - Size: 4.9 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

slgobinath/wisdom

An adaptive and self-boosting stream processor

Language: Java - Size: 1.67 MB - Last synced at: 15 days ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 3

zbjob/EIRES

Efficient Integration of Remote Data in Event Stream Processing

Language: C++ - Size: 351 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 2

youheekil/udacity-data-streaming

Projects completed in the Udacity Data Streaming Nanodegree program. Tech used: Apache Kafka, Kafka Connect, KSQL, Faust Stream Processing, Spark Structured Streaming

Language: Python - Size: 1.01 MB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 4

IBMStreams/streamsx.jdbc

Supports Streams application to work with databases via JDBC

Language: Java - Size: 12 MB - Last synced at: 21 days ago - Pushed at: about 3 years ago - Stars: 4 - Forks: 15

alefais/flink-applications

A collection of Data Stream Processing applications built with Apache Flink.

Language: Java - Size: 24.5 MB - Last synced at: 18 days ago - Pushed at: about 3 years ago - Stars: 4 - Forks: 1

InesMartins31/iot-cves

IoT CVEs as abnormal events to evaluate a real-time host-based IDS. https://doi.org/10.1016/j.future.2022.03.001

Language: Dockerfile - Size: 1.45 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 4 - Forks: 0

GZHoffie/independence-in-streams

This repository contains code for identifying correlation in a stream of samples. The sketching of sketches algorithm and the counter matrix algorithm are implemented and benchmarked.

Language: Jupyter Notebook - Size: 1.49 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0

PierreKieffer/multiprocessing-template

Provides parallel and async execution of multiple methods, and processing of results in real time.

Language: Python - Size: 74.2 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 4 - Forks: 0

zbjob/AthenaCEP

Load Shedding for Complex Event Processing: Input-based and State-based Techniques.

Language: C++ - Size: 47 MB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 2

IBMStreams/streamsx.adaptiveParser

(Incubation) The toolkit allows to parse input format producing desired hierarchical tuple (including lists, maps and sets) saving the common step of mapping the flat format to the required Streams tuple.

Language: Perl - Size: 2.95 MB - Last synced at: 21 days ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 4

ArchitectAK/AdvancedNodeJS

Learn advanced techniques for asynchronous programming and data streaming in Node.js

Language: JavaScript - Size: 29 MB - Last synced at: 5 months ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 1

NSSTC/data-drift

Data streaming and scheduling library for Node.JS

Language: JavaScript - Size: 34.2 KB - Last synced at: 11 days ago - Pushed at: about 6 years ago - Stars: 4 - Forks: 0

thpham/datapipe

POC: Real time analytics pipeline

Language: Dockerfile - Size: 23.4 KB - Last synced at: 27 days ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 0

dannycho7/express-form-post

Simple and efficient nodejs http file upload middleware.

Language: JavaScript - Size: 5.33 MB - Last synced at: 6 days ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 3

reddy-s/kafka-avro-consumer

Kafka consumer application which reads messages from Kafka and based on the schema registered in a schema registry and enriches the data. This is just a prototype on how we can efficiently evolve a schema and read messages with BACKWARD compatibility with out breaking the consumers. This application can be used as a base for a stateless stream processing application which would involve processing one event at a time or filtering though a stream of events.

Language: Java - Size: 145 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 4 - Forks: 3

ehabqadah/in-situ-processing-datAcron

A component within the datAcron EU project.

Language: Java - Size: 1.1 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 2

Royz2123/Big-Data-Course

A collection of homework assignments from the Big Data course from Haifa University

Language: Python - Size: 235 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 0

brian-lau/FrequentDirections

Matlab implementation of Frequent Directions variants for matrix sketching

Language: Matlab - Size: 115 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 4

mh-cbon/plumber

builds pipes to transform a data stream

Language: Go - Size: 38.1 KB - Last synced at: 10 months ago - Pushed at: about 8 years ago - Stars: 4 - Forks: 1

amitsela/beam Fork of apache/beam

Mirror of Apache Beam

Language: Java - Size: 30 MB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 4 - Forks: 0

xiaohan2012/controversy_detection

Detecting controversial hashtags in twitter stream

Language: Jupyter Notebook - Size: 42.8 MB - Last synced at: 28 days ago - Pushed at: about 8 years ago - Stars: 4 - Forks: 2

csp-community/csp-adapter-discord

A csp adapter for discord

Language: Python - Size: 42 KB - Last synced at: 7 days ago - Pushed at: 9 days ago - Stars: 3 - Forks: 1

carverauto/eventrunner

high-speed opensource event processing engine

Language: Go - Size: 906 KB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 0

DSIN-INSA-Strasbourg/Hermes

Change Data Capture (CDC) tool from any source(s) to any target

Language: Python - Size: 549 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 1

TawfikYasser/Keyed-Watermarks-in-Apache-Flink

Keyed Watermarks in Apache Flink

Language: Java - Size: 509 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

diegofps/devstream

Intercept and transform events from Linux systems 🎾

Language: Python - Size: 1.68 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

rtyley/line-break-preserving-line-splitting

Language: Scala - Size: 43.9 KB - Last synced at: 10 days ago - Pushed at: 3 months ago - Stars: 3 - Forks: 6

longNguyen010203/Finance-Data-Ingestion-Pipeline-with-Kafka

Develop a real-time data ingestion pipeline using Kafka and Spark. Collect minute-level stock data from Yahoo Finance, ingest it into Kafka, and process it with Spark Streaming, storing the results in Cassandra. Orchestrated the workflow using Airflow deployed on Docker.

Language: Python - Size: 250 KB - Last synced at: 22 days ago - Pushed at: 5 months ago - Stars: 3 - Forks: 1

ccamel/poc-piper-worker-flink

:alembic: An experiment to make flink a worker for the workflow engine piper

Language: Scala - Size: 130 KB - Last synced at: 17 days ago - Pushed at: 6 months ago - Stars: 3 - Forks: 1

am-kantox/lazy_for

Lazy implementation of `Kernel.SpecialForms.for/1` based on streams

Language: Elixir - Size: 453 KB - Last synced at: 8 days ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

criblpacks/cribl-splunk-uf-internal-redux

Use this Pack to reduce your Splunk Forwarder log volume.

Size: 41 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 1

theboxahaan/pipelines

Create Async Processing Pipelines Quick!

Language: Python - Size: 57.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 2

relvaner/nodes4j-core 📦

Framework for parallel processing based on Actor4j. Useful for data analysis.

Language: Java - Size: 279 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 3

gfleury/gstreamtop

Real time analytical SQL Query on text streams

Language: Go - Size: 896 KB - Last synced at: 24 days ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

ostafen/hermes

EventStoreDB-like stream projections on top of Apachi Kafka.

Language: Go - Size: 54.7 KB - Last synced at: 17 days ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

never-sleeps/microservice-architecture

📚 Microservice Architecture course

Language: Java - Size: 3.76 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

sulunemre/twitch-stream-analytics

A stream processing project that analyzes the chat stream of a Twitch channel. Built on Apache Storm for CS442 Distributed Systems course.

Language: Java - Size: 55.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 2

labteral/stopover-python

Python client for Stopover

Language: Python - Size: 40 KB - Last synced at: 28 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

1e14/ninety

Web application framework built on 1e14

Language: TypeScript - Size: 1.27 MB - Last synced at: 8 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

eliias/gleam

Fun DSL for Apache Beam and Kotlin.

Language: Kotlin - Size: 2.72 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

cdbrkfxrpt/magritte

Implementation for my M.Sc. thesis project

Language: Rust - Size: 655 KB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

bytefish/FlinkExperiments

Experiments with Apache Flink.

Language: Java - Size: 402 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 1

geraked/bigdata

Implementation of Big Data Analytics Algorithms in Python

Language: Jupyter Notebook - Size: 11 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

alefais/packet-streaming-bench-sigcomm22poster

Source code of a heavy hitter packet streaming application implemented with four stream processing systems: Flink, Spark Streaming, Storm and WindFlow.

Language: C++ - Size: 3.95 MB - Last synced at: 18 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

zekeriyyaa/Building-A-Data-Pipeline-For-ROS-Compliant-Robotic-System-Via-Amazon-Web-Services

Language: Python - Size: 959 KB - Last synced at: 19 days ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 2

alefais/windflow-applications

A collection of Data Stream Processing applications built using the WindFlow library.

Language: C++ - Size: 27.2 MB - Last synced at: 18 days ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 0

IBM/ibm-streams-with-python-api 📦

access IBM Streams using Python API

Language: Jupyter Notebook - Size: 2.24 MB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 6

delftdata/s-query

S-Query, a novel system for querying stateful stream processors. Implemented on top of Hazelcast Jet.

Language: Java - Size: 134 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

perguard/pg-streaming-performance-data

Data collection, feature engineering and machine learning of performance traces

Language: Java - Size: 153 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 1

Wittline/optimizing-public-transportation

Streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.

Language: Python - Size: 362 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 1

Ugenteraan/gRPC-image-streaming

Stream image bytes to the server one row at a time!

Language: Python - Size: 357 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 0

krzysbaranski/kcache

Cache Library in Python

Language: Python - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 3 - Forks: 0

cedrickchee/nodejs-in-depth

Master and understand deeper Node.js fundamentals and internals

Language: JavaScript - Size: 18.6 KB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

IBMStreams/streamsx.network

Toolkit for working with network data

Language: C++ - Size: 71.1 MB - Last synced at: 21 days ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 13

IBMStreams/streamsx.json

Toolkit for working with JSON in SPL applications.

Language: C++ - Size: 31.6 MB - Last synced at: 21 days ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 19

blockchain-etl/anomalous-transactions-detector-dataflow

Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

Language: Java - Size: 41 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 1

neeraj97/irctc-tatkal-booking

Designing and building highly scalable and reliable ticket booking system that can process ticket orders with low latency.

Language: Java - Size: 294 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

kenju/go-pipeline 📦

concurrent stream-processing library in Go

Language: Go - Size: 64.5 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

bufferapp/cerone

Extensible consumer made for applications using Amazon's Kinesis Python Client Library (KCL).

Language: Python - Size: 12.7 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

IBMStreams/streamsx.edgevideoanalytics.starterkit

An end-to-end video analytic demonstration performing video analytics on edge devices and centralized system

Language: Java - Size: 1.07 MB - Last synced at: 21 days ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 6

IBMStreams/streamsx.cassandra

Operators for Cassandra

Language: Scala - Size: 7.27 MB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 1

nextorigin/riemann-query-parser

Query parser extracted from Riemann and ported from Clojure to Node

Language: JavaScript - Size: 47.9 KB - Last synced at: 6 days ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 0

mzabaluev/tokio-text

Utilities for text-oriented asynchronous I/O in the Tokio framework.

Language: Rust - Size: 28.3 KB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 1

ssheikholeslami/undergradthesis-report-farsi

Repository for the Farsi version of my Undergraduate Thesis (SDMiner: A Tool for Mining Data Streams on Top of Apache Spark)

Size: 12.1 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

RayofLightz/ingestion

A log enrichment stream processor built in golang for suricata.

Language: Go - Size: 1.16 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 3 - Forks: 2

LaPetiteSouris/KafkaStreaming

Simple stream-processing data pipeline in Kafka

Language: JavaScript - Size: 14.6 MB - Last synced at: 27 days ago - Pushed at: about 6 years ago - Stars: 3 - Forks: 0

vonzhou/storm-examples

学习Storm的示例， Examples To Learn Storm

Language: Java - Size: 12.7 KB - Last synced at: 2 months ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0

simon-xia/fuzzyQuantile

High performance quantile estimation(e.g. 95th) over unbounded streaming data, within expected error (e.g 0.1%) and low memory usage.

Language: Go - Size: 151 KB - Last synced at: 10 months ago - Pushed at: almost 7 years ago - Stars: 3 - Forks: 0

adilkhash/awesome-data-engineering

A curated list of resources to navigate data engineering

Size: 0 Bytes - Last synced at: 10 days ago - Pushed at: about 7 years ago - Stars: 3 - Forks: 0

IRC-SPHERE/HyperStreamOnlineLearning

Plugins for Online Learning (supervised or unsupervised) in HyperStream

Language: Python - Size: 110 KB - Last synced at: 28 days ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 1

findcoo/stream

make simple ReactiveX pattern for golang

Language: Go - Size: 25.4 KB - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0

deniskrumko/ksqldb-ui

Free and simple way to interact with ksqlDB using UI

Language: Python - Size: 608 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2 - Forks: 1

Data-to-Insight-Center/cyberinfrastructure-knowledge-network

An Edge AI Distributed Framework

Language: Python - Size: 83.5 MB - Last synced at: 1 day ago - Pushed at: 7 days ago - Stars: 2 - Forks: 2

iferdel/sensor-data-streaming-pubsub

Hybrid IIoT system using PubSub as backbone by means of Go/RabbitMQ, PostgreSQL with TimeScaleDB extension for storage, Alloy and Loki for logs, and Grafana for real-time visualization. Interaction via a CLI tool, which communicates with an HTTP REST API server. Deployed on Kubernetes through GitOps.

Language: Go - Size: 57.6 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 2 - Forks: 0